-- Logs begin at Sat 2022-04-16 20:01:17 UTC, end at Sat 2022-04-16 22:37:27 UTC. -- Apr 16 20:55:42.927842 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Apr 16 20:55:42.937090 ncdv-master-1 devstack@n-api.service[121813]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 16 20:55:42.938917 ncdv-master-1 devstack@n-api.service[121813]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Apr 16 20:55:42 2022] *** Apr 16 20:55:42.938917 ncdv-master-1 devstack@n-api.service[121813]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 16 20:55:42.938917 ncdv-master-1 devstack@n-api.service[121813]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 16 20:55:42.938917 ncdv-master-1 devstack@n-api.service[121813]: nodename: ncdv-master-1 Apr 16 20:55:42.938917 ncdv-master-1 devstack@n-api.service[121813]: machine: x86_64 Apr 16 20:55:42.938917 ncdv-master-1 devstack@n-api.service[121813]: clock source: unix Apr 16 20:55:42.938917 ncdv-master-1 devstack@n-api.service[121813]: pcre jit disabled Apr 16 20:55:42.938917 ncdv-master-1 devstack@n-api.service[121813]: detected number of CPU cores: 4 Apr 16 20:55:42.938917 ncdv-master-1 devstack@n-api.service[121813]: current working directory: / Apr 16 20:55:42.938917 ncdv-master-1 devstack@n-api.service[121813]: detected binary path: /usr/bin/uwsgi-core Apr 16 20:55:42.939634 ncdv-master-1 devstack@n-api.service[121813]: your processes number limit is 47680 Apr 16 20:55:42.939634 ncdv-master-1 devstack@n-api.service[121813]: your memory page size is 4096 bytes Apr 16 20:55:42.939634 ncdv-master-1 devstack@n-api.service[121813]: detected max file descriptor number: 2048 Apr 16 20:55:42.939634 ncdv-master-1 devstack@n-api.service[121813]: lock engine: pthread robust mutexes Apr 16 20:55:42.939634 ncdv-master-1 devstack@n-api.service[121813]: thunder lock: enabled Apr 16 20:55:42.939634 ncdv-master-1 devstack@n-api.service[121813]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 16 20:55:42.939634 ncdv-master-1 devstack@n-api.service[121813]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 16 20:55:42.987608 ncdv-master-1 devstack@n-api.service[121813]: Python main interpreter initialized at 0x5594f844a9c0 Apr 16 20:55:42.987608 ncdv-master-1 devstack@n-api.service[121813]: python threads support enabled Apr 16 20:55:42.987608 ncdv-master-1 devstack@n-api.service[121813]: your server socket listen backlog is limited to 100 connections Apr 16 20:55:42.987608 ncdv-master-1 devstack@n-api.service[121813]: your mercy for graceful operations on workers is 90 seconds Apr 16 20:55:42.987917 ncdv-master-1 devstack@n-api.service[121813]: mapped 403077 bytes (393 KB) for 2 cores Apr 16 20:55:42.987990 ncdv-master-1 devstack@n-api.service[121813]: *** Operational MODE: preforking *** Apr 16 20:55:42.988263 ncdv-master-1 devstack@n-api.service[121813]: *** uWSGI is running in multiple interpreter mode *** Apr 16 20:55:42.988263 ncdv-master-1 devstack@n-api.service[121813]: spawned uWSGI master process (pid: 121813) Apr 16 20:55:42.988440 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Apr 16 20:55:42.989810 ncdv-master-1 devstack@n-api.service[121813]: spawned uWSGI worker 1 (pid: 121814, cores: 1) Apr 16 20:55:42.989810 ncdv-master-1 devstack@n-api.service[121813]: spawned uWSGI worker 2 (pid: 121815, cores: 1) Apr 16 20:55:42.989810 ncdv-master-1 devstack@n-api.service[121813]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 16 20:55:44.249745 ncdv-master-1 devstack@n-api.service[121815]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 16 20:55:44.251165 ncdv-master-1 devstack@n-api.service[121814]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 16 20:55:45.121402 ncdv-master-1 devstack@n-api.service[121814]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 16 20:55:45.121402 ncdv-master-1 devstack@n-api.service[121814]: from cryptography.utils import int_from_bytes Apr 16 20:55:45.121725 ncdv-master-1 devstack@n-api.service[121814]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 16 20:55:45.121725 ncdv-master-1 devstack@n-api.service[121814]: from cryptography.utils import int_from_bytes Apr 16 20:55:45.122330 ncdv-master-1 devstack@n-api.service[121815]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 16 20:55:45.122330 ncdv-master-1 devstack@n-api.service[121815]: from cryptography.utils import int_from_bytes Apr 16 20:55:45.122674 ncdv-master-1 devstack@n-api.service[121815]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 16 20:55:45.122674 ncdv-master-1 devstack@n-api.service[121815]: from cryptography.utils import int_from_bytes Apr 16 20:55:47.667685 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 16 20:55:47.668369 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 16 20:55:47.668635 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 16 20:55:47.668838 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 16 20:55:47.669097 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 16 20:55:47.669529 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.669862 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.670180 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.670495 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.670821 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.671129 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.671447 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.671766 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.672050 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 16 20:55:47.672452 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.672534 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 16 20:55:47.672616 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.672684 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.672863 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 16 20:55:47.672952 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.673245 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 16 20:55:47.673337 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.673486 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 16 20:55:47.673582 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.673857 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.673990 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.674187 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.674295 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.674471 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.674564 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.674789 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.674881 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.675091 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.675184 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.675475 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.675588 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.676002 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.676165 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.676602 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.676748 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.676894 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.677051 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.677189 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.677316 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.677412 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.677493 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.677619 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.677810 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.677943 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.678117 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.678241 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.678423 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.678511 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.678744 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.678836 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.679048 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.679142 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.679398 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.679482 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.679738 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.679840 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.680051 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.680371 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.680493 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.684859 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.686056 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.686140 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.686218 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.686303 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.686391 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.686477 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.686562 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.686642 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.686724 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.686802 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.686891 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.686977 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.687082 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.687162 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.687252 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.687342 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.687420 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.687497 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.687573 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.687661 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.687746 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.687825 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.687955 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.688087 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.688202 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.688318 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.688400 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.688400 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.688548 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.688633 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.688712 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.688796 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.688873 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.688956 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.689040 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.689127 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.689212 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.689290 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.689388 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.689468 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.689468 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.689627 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.689722 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.689802 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.689879 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.689955 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.690040 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.690125 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.690203 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.690279 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.690354 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.690451 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.690538 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.690687 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.690786 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.690865 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.691000 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.691095 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.691181 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.691268 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.691347 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.691432 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.691509 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.691593 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.691699 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.691785 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.691869 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.691952 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.692035 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.692123 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.692241 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.692321 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.692398 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.692532 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.692532 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.692704 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.692782 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.692866 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.693063 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.693154 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.693398 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.693483 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.693714 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.693812 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.694020 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.694116 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.694326 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.694410 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.694639 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.694721 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.694939 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.695040 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.695242 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.695326 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.695543 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.695634 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.695858 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.695951 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.696206 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.696322 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.696511 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.696641 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.696744 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.696974 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.697069 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.697328 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.697424 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.697622 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.697711 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.697927 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.698019 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.698231 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.698325 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.698530 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.698614 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.698825 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.698910 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.699126 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.699210 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.699430 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.699521 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.699732 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.699815 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.700033 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.700123 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.700365 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.700467 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.700665 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.700787 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.701600 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.701693 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.701906 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.701999 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.702167 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.702258 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.702515 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.702627 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.702827 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.703059 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.703136 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.703203 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.703504 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.703609 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.703702 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.703785 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.704017 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.704103 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.704346 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.704443 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.704648 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.704823 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.704950 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.705037 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.705255 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.705337 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.705555 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.705639 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.705856 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.705943 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.706160 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.706243 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.706462 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.706554 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.706764 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.706851 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.707069 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.707153 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.707363 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.707456 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.707666 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.707751 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.707980 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.708066 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.708309 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.708423 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.708610 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.708702 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.708909 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.709003 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.709209 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.709296 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.709508 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.709601 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.709809 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.709895 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.710144 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.710244 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.710416 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.710522 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.710706 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.710806 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.711021 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.711115 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.711338 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.711423 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.711642 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.711735 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.711940 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.712030 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.712263 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.712353 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.712580 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.713483 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.713568 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.713742 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.713833 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.713912 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.713988 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.714079 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.714168 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.714246 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.714319 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.714392 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.714475 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.714542 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.714707 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.714798 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.714979 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.715065 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.715288 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.715375 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.715592 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.715701 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.715913 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.716005 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.716258 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.716348 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.716598 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.716685 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.716910 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.717002 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.717219 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.717312 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.717542 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.717627 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 20:55:47.717857 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.717952 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.718173 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.718258 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.718491 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.718596 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.718798 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.718897 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.719113 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.719241 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.719440 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.719545 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.719757 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.719868 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.720066 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.720153 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.720467 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.720599 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.720784 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.720943 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.721079 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.721215 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.721398 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.721533 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.721713 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.721855 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.722023 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.722159 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.722333 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.722474 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.722645 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.722785 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.722968 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.723097 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.723293 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.723427 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.723607 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.723742 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.723920 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.724053 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.724252 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.724367 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.724569 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.724667 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.724890 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.724993 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.725191 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.725330 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.725501 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.725683 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.725837 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.726036 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.726151 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.726358 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.726524 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.726693 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.726786 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.727020 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.727105 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.727340 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.727434 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.727651 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.727734 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.727963 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.728047 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.728300 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.728418 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.728606 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.728694 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.728910 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.728995 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.729218 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.729304 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.729521 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.729612 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.729838 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.729923 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.730166 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.730251 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.730476 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.730559 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.730794 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.730917 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.731100 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.731195 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.731408 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.731503 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.731716 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.731816 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.732048 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.732134 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.732379 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.732466 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.732689 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.732792 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.733000 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.733095 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.733304 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.733397 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.733625 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.733721 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.733934 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.734020 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.734236 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.734330 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.734562 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.734720 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.734861 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.734954 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.735165 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.735262 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.735476 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.735573 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.735785 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.735879 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.736094 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.736220 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.736427 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.736516 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.736738 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.736823 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.737050 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.737134 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.737357 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.737442 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.737667 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.737753 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.737990 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.738082 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.738306 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.738399 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.738610 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.738707 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.738923 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.739022 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.739238 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.739323 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.739548 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.739639 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.739851 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.739946 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.740159 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.742140 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.742140 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.742431 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.742431 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.742587 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.742667 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.742744 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.742832 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.742918 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.743011 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.743091 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.743176 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.743254 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.743332 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.743408 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.743498 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.743584 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.743652 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.743722 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.743800 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.743877 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.743967 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.744046 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.744123 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.744264 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.744346 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.744423 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.744519 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.744616 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.744682 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.744836 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.744923 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.745147 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.745233 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.745465 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.745550 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.745776 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.745861 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.746088 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.746175 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.746400 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.746485 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.746717 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.746804 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.747026 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.747113 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.747334 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.747426 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.748156 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.748314 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.748488 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.748577 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.748811 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.748907 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.749115 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.749201 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.749432 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.749519 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.749737 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.749822 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.750049 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.750144 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.750356 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.750447 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.750674 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.750759 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.750983 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.751083 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.751298 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.751383 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.751635 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.751722 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.751961 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.752055 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.752335 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.752439 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.752663 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.752748 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.752988 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.753084 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.753306 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.753392 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.753612 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.753751 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.753922 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.754077 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.754232 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.754397 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.754543 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.754725 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.754860 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.755043 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.755168 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.755370 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.755484 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.755687 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.755846 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.756020 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.756108 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.756363 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.756451 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.756690 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.756792 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.757002 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.757089 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.757311 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.757404 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.757635 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.757730 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.757967 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.758073 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.758273 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.758360 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.758586 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.758672 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.758903 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.759016 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.759207 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.759302 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.759513 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.759640 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.759824 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.759938 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.760128 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.760279 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.760456 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.760570 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.760766 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.760879 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.761082 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.761201 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.761392 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.761506 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.761700 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.761822 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.762002 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.762123 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.762313 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.762425 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.762618 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.762730 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.762918 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.763050 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.763290 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.763402 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.763607 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.763720 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.763929 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.764028 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.764260 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.764360 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.764578 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.764676 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.764896 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.764993 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.765199 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.765286 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.765501 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.765596 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.765815 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.765909 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.766118 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.766203 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.766421 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.766511 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.766721 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.766809 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.767023 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.767109 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.767333 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.767419 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.767650 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.767738 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.767950 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.768035 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.768287 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.768376 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.768601 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.768695 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.768953 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.769050 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.769208 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.769302 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.769515 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.769609 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.769823 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.769918 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.770140 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.770233 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.770449 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.770533 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.770756 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.770844 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.771071 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.771166 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.771377 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.771468 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.771683 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.771767 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.771992 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.772089 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.772325 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.772423 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.772633 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.772718 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.772939 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.773025 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.773243 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.773326 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.773543 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.773627 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.773852 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.773977 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.774170 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.774257 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.774499 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.774743 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.774841 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.775077 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.775256 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.775389 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.775475 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.775703 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.775799 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.776023 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.776148 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.776364 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.776451 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.776680 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.776766 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.776997 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.777084 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.777314 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.777399 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.777626 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.777722 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.777935 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.778022 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.778239 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.778325 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.778543 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.778683 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.779694 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.779839 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.779946 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.780033 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.780111 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.780224 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.780307 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.780385 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.780562 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.780648 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.780867 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.781159 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.781247 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.781464 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.781549 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.781768 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.781860 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.782078 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.782173 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.782380 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.782474 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.782692 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.782831 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.782996 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.783089 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.783316 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.783403 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.783623 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.783717 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.783926 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.784024 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.784264 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.784357 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.784570 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.784655 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.784913 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.785000 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.785220 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.785352 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.785534 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.785619 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.785843 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.785929 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.786153 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.786246 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.786470 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.786564 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.786779 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.786864 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.787085 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.787168 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.787391 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.787487 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.787694 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.787779 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.787997 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.788090 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.788326 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.788424 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.788633 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.788717 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.788936 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.789028 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.789247 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.789343 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.789562 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.789658 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.789864 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.789949 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.790169 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.790264 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.790467 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.790551 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.790774 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.790861 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.791076 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.791163 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.791395 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.791489 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.791705 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.791799 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.792009 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.792095 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.792335 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.792424 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.792646 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.792732 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.792955 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.793042 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.793258 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.793344 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.793566 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.793659 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.793870 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.793965 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.794184 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.794279 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.794549 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.794646 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.794855 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.794947 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.795188 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.795279 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.795499 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.795663 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.795803 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.795940 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.796096 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.796255 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.796429 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.796585 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.796746 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.796841 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.797046 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.797144 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.797348 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.797444 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.797656 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.797741 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.797956 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.798042 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.798257 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.798343 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.798562 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.798655 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.798883 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.798969 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.799197 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.799284 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.799497 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.799605 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.799807 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.799912 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.800107 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.800231 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.800436 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.800533 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.800737 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.800835 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.801042 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.801127 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.801596 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.801687 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.801907 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.802002 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.802208 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.802296 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.802508 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.802595 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.802808 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.802904 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.803126 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.803213 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.803431 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.803515 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.803729 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.803822 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.804029 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.804115 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.804358 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.804454 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.804675 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.804770 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.804985 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.805071 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.805310 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.805397 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.805622 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.805778 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.805923 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.806058 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.806229 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.806359 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.806533 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.806676 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.806835 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.806928 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.807141 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.807226 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.807443 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.807531 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.807748 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.807833 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.808054 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.808146 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.808383 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.808478 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.808680 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.808773 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.808982 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.809079 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.809299 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.809385 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.809604 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.809689 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.809911 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.810560 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.810729 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.810869 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.811046 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.811182 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.811368 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.811513 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.811655 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.811791 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.811964 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.812118 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.812300 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.812444 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.812610 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.812742 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.812916 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.813047 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.813222 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.813448 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.813598 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.813735 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.813872 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.814014 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.814176 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.814313 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.814448 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.814595 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.814729 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.814862 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.815013 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.815159 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.815294 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.815429 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.815564 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.815697 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.815866 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.815955 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.816290 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.816399 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.816613 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.816735 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.816917 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.817005 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.817225 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.817311 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.817528 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.817624 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.817834 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.817921 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.818135 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.818221 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.818443 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.818560 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.818758 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.818871 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.819072 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.819179 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.819386 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.819482 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.819706 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.819792 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.820024 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.820165 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.820362 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.820506 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.820679 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.820811 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.820977 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.821120 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.821288 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.821427 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.821604 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.821737 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.821913 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.822061 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.822243 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.822376 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.822556 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.822700 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.822854 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.822984 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.823128 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.823266 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.823452 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.823593 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.823754 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.823894 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.824047 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.824216 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.824350 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.824529 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.824667 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.824846 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.824984 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.825162 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.825300 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.825472 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.825661 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.825842 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.826054 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.826195 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.826358 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.826490 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.826747 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.827056 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.827160 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.827243 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.827366 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.827453 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.827689 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.827783 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.828009 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.828107 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.828356 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.828445 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.828664 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.828754 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.828979 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.829065 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.829290 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.829385 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.829609 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.829696 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.829917 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.830001 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.830226 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.830310 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.830532 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.830619 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.830830 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.830969 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.831151 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.831237 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.831471 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.831565 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.831782 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.831880 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.832106 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.832243 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.832513 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.832599 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.832852 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.832948 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.833161 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.833255 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.833484 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.833579 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.833810 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.833897 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.834114 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.834201 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.834416 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.834511 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.834725 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.834820 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.835028 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.835115 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.835330 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.835425 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.835651 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.835737 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.835955 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.836043 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.836287 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.836395 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.836599 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.836694 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.836905 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.836999 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.837207 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.837295 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.837509 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.837595 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.837830 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.837917 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.838134 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.838232 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.838453 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.838550 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.838763 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.838878 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.839083 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.839194 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.839401 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.839514 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.839703 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.839842 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.840024 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.840152 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.840357 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.840493 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.840659 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.840812 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.840960 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.841124 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.841262 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.841459 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.841663 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.841773 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.841969 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.842083 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.842294 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.842401 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.842622 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.842718 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.842950 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.843045 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.843258 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.843354 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.843589 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.843685 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.843914 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.844000 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.844241 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.844332 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.844558 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.844691 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.844872 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.844957 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.845172 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.845269 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.845476 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.845565 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.845783 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.845869 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.846086 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.846225 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.846384 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.846522 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.846666 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.846802 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.846968 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.847103 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.847270 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.847412 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.847572 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.847716 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.847859 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.848008 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.848190 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.848343 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.848564 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.848701 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.848886 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.849040 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.849179 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.849321 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.849484 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.849616 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.849757 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.849900 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.850056 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.850192 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.850398 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.850497 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.850700 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.850788 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.851033 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.851133 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.851346 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.851446 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.851662 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.851749 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.851970 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.852057 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.852302 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.852392 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.852617 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.852707 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.852929 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.853015 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.853237 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.853332 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.853546 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.853634 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.853855 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.853942 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.854163 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.854249 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.854474 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.854571 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.854784 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.854871 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.855095 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.855196 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.855400 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.855496 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.855710 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.855796 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.856015 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.856117 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.856389 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.856555 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.856701 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.856883 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.857556 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.857714 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.857877 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.858028 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.858205 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.858342 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.858539 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.858638 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.858857 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.858990 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.859188 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.859279 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.859511 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.859607 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.859832 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.859920 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.860140 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.860298 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.860484 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.860573 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.860803 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.860890 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.861123 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.861219 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.861445 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.861545 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.861754 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.861840 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.862069 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.862169 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.862383 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.862477 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.862701 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.862790 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.863057 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.863227 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.863370 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.863560 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.863675 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.863881 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.863976 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.864228 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.864335 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.864541 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.864627 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.864861 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.864956 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.865183 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.865270 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.865499 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.865584 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.865810 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.865905 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.866120 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.866207 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.866427 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.866514 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.866736 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.866833 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.867047 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.867134 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.867368 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.867455 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.867699 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.867790 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.868015 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.868100 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.868359 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.868446 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.868671 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.868760 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.868984 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.869089 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.869343 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.869492 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.869666 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.869805 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.869978 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.870137 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.870295 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.870462 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.870616 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.870784 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.870936 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.871096 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.871251 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.871415 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.871566 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.871743 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.871886 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.872046 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.872226 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.872373 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.872560 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.872765 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.872911 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.873075 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.873236 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.873377 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.873555 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.873696 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.873888 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.874006 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.874229 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.874326 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.874556 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.874643 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.874873 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.874966 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.875190 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.875415 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.875501 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.875761 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.876018 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.876112 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.876363 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.876451 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.876705 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.876794 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.877021 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.877115 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.877326 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.877413 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.877650 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.877776 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.877954 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.878050 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.878258 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.878346 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.878572 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.878665 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.878879 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.878977 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.879179 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.879264 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.879480 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.879575 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.879789 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.879885 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.880094 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.880208 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.880422 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.880509 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.880732 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.880821 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.881035 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.881123 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.881350 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.881442 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.881650 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.881884 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.881971 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.882233 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.882327 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.882543 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.882632 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.882845 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.882940 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.883145 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.883241 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.883446 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.883544 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.883749 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.883837 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.884057 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.884146 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.884383 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.884475 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.884690 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.884778 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.884992 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.885079 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.885300 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.885387 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.885600 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.885687 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.885905 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.885992 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.886217 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.886304 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.886531 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.886621 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.886839 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.886934 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.887137 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.887223 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.887449 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.887533 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.887751 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.887882 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.888073 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.888161 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.888932 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.889019 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.889243 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.889339 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.889561 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.889649 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.889873 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.889966 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.890180 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.890427 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.890514 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.890769 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.890931 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.891082 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.891177 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.891390 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.891484 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.891704 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.891794 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.892014 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.892107 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.892347 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.892437 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.892653 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.892739 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.892968 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.893071 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.893281 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.893366 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.893593 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.893687 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.893904 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.893991 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.894214 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.894302 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.894523 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.894617 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.894831 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.894918 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.895135 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.895221 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.895443 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.895530 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.895752 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.895840 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.896058 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.896144 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.896391 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.896479 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.896699 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.896957 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.897043 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.897301 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.897395 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.897625 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.897714 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.897943 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.898029 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.898258 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.898345 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.898573 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.898670 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.898880 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.898974 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.899185 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.899271 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.899494 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.899582 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.899802 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.899892 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.900114 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.900258 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.900455 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.900543 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.900762 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.900848 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.901067 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.901171 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.901376 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.901483 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.901691 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.901786 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.902006 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.902106 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.902322 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.902409 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.902635 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.902721 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.902950 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.903038 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.903265 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.903353 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.903588 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.903675 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.904490 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.904588 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.904805 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.904890 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.905131 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.905218 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.905454 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.905541 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.905775 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.905870 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.906091 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.906179 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.906390 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.906477 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.906694 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.906793 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.906998 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.907093 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.907305 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.907399 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.907621 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.907707 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.907930 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.908025 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.908255 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.908362 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.908556 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.908677 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.908862 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.908995 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.909164 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.909320 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.909465 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.909646 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.909767 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.909963 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.910098 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.910292 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.910378 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.910622 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.910717 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.910931 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.911020 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.911230 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.911320 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.911529 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.911625 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.911827 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.911913 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.912126 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.912233 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.912534 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.912631 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.912905 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.913002 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.913144 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.913231 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.913446 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.913534 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.913747 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.913833 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.914046 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.914134 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.914368 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.914455 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.914684 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.914770 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.914992 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.915093 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.915300 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.915388 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.915604 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.915690 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.915910 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.916008 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.916235 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.916326 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.916545 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.916631 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.916854 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.916953 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.917161 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.917247 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.917464 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.917555 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.917816 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.917924 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.918077 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.918165 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.918384 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.918480 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.918685 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.918784 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.918990 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.919077 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.919297 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.919381 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.919626 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.919722 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.919931 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.920016 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.920259 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.920357 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.920566 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.920655 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.920872 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.920959 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.921187 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.921272 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.921505 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.921592 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.921820 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.921914 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.922130 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.922227 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.922448 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.922534 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.922754 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.922848 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.923068 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.923170 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.923382 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.923470 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.923690 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.923776 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.923998 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.924101 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.924332 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.924434 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.924644 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.924739 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.924969 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.925064 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.925289 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.925375 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.925606 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.925698 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.925922 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.926018 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.926239 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.926593 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.926816 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.926906 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.927147 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.927247 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.927472 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.927565 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.927778 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.927863 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.928087 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.928201 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.928416 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.928516 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.928660 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121815) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 16 20:55:47.928756 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.929053 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.929370 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.929705 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.930022 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.930336 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.930656 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.930974 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.931291 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.931611 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.931932 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.932291 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.932625 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.932955 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.933286 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.933643 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.933959 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.934308 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.934644 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.934961 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.935304 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.935615 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 20:55:47.935864 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121814) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 16 20:55:47.951623 ncdv-master-1 devstack@n-api.service[121815]: DEBUG oslo_db.sqlalchemy.engines [None req-16d0dcd8-a7b3-4942-bb8a-9d1df64c5c34 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121815) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 16 20:55:47.958456 ncdv-master-1 devstack@n-api.service[121814]: DEBUG oslo_db.sqlalchemy.engines [None req-1413da5b-220b-403e-8e1d-5146b82577e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121814) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 16 20:55:48.014363 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.context [None req-16d0dcd8-a7b3-4942-bb8a-9d1df64c5c34 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) {{(pid=121815) load_cells /opt/stack/nova/nova/context.py:464}} Apr 16 20:55:48.018762 ncdv-master-1 devstack@n-api.service[121815]: DEBUG oslo_concurrency.lockutils [None req-16d0dcd8-a7b3-4942-bb8a-9d1df64c5c34 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 20:55:48.020393 ncdv-master-1 devstack@n-api.service[121815]: DEBUG oslo_concurrency.lockutils [None req-16d0dcd8-a7b3-4942-bb8a-9d1df64c5c34 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 20:55:48.021187 ncdv-master-1 devstack@n-api.service[121815]: DEBUG oslo_concurrency.lockutils [None req-16d0dcd8-a7b3-4942-bb8a-9d1df64c5c34 None None] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 20:55:48.022629 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.context [None req-1413da5b-220b-403e-8e1d-5146b82577e3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) {{(pid=121814) load_cells /opt/stack/nova/nova/context.py:464}} Apr 16 20:55:48.023089 ncdv-master-1 devstack@n-api.service[121815]: DEBUG oslo_concurrency.lockutils [None req-16d0dcd8-a7b3-4942-bb8a-9d1df64c5c34 None None] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121815) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 20:55:48.027045 ncdv-master-1 devstack@n-api.service[121814]: DEBUG oslo_concurrency.lockutils [None req-1413da5b-220b-403e-8e1d-5146b82577e3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 20:55:48.028674 ncdv-master-1 devstack@n-api.service[121814]: DEBUG oslo_concurrency.lockutils [None req-1413da5b-220b-403e-8e1d-5146b82577e3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 20:55:48.030039 ncdv-master-1 devstack@n-api.service[121814]: DEBUG oslo_concurrency.lockutils [None req-1413da5b-220b-403e-8e1d-5146b82577e3 None None] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 20:55:48.032010 ncdv-master-1 devstack@n-api.service[121814]: DEBUG oslo_concurrency.lockutils [None req-1413da5b-220b-403e-8e1d-5146b82577e3 None None] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 20:55:48.034323 ncdv-master-1 devstack@n-api.service[121815]: DEBUG oslo_db.sqlalchemy.engines [None req-16d0dcd8-a7b3-4942-bb8a-9d1df64c5c34 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121815) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 16 20:55:48.035213 ncdv-master-1 devstack@n-api.service[121815]: DEBUG oslo_db.sqlalchemy.engines [None req-16d0dcd8-a7b3-4942-bb8a-9d1df64c5c34 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121815) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 16 20:55:48.045428 ncdv-master-1 devstack@n-api.service[121814]: DEBUG oslo_db.sqlalchemy.engines [None req-1413da5b-220b-403e-8e1d-5146b82577e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121814) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 16 20:55:48.048361 ncdv-master-1 devstack@n-api.service[121814]: DEBUG oslo_db.sqlalchemy.engines [None req-1413da5b-220b-403e-8e1d-5146b82577e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121814) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 16 20:55:48.194577 ncdv-master-1 devstack@n-api.service[121815]: DEBUG oslo_db.sqlalchemy.engines [None req-16d0dcd8-a7b3-4942-bb8a-9d1df64c5c34 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121815) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 16 20:55:48.205775 ncdv-master-1 devstack@n-api.service[121814]: DEBUG oslo_db.sqlalchemy.engines [None req-1413da5b-220b-403e-8e1d-5146b82577e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121814) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 16 20:55:48.709179 ncdv-master-1 devstack@n-api.service[121815]: WARNING keystonemiddleware.auth_token [None req-16d0dcd8-a7b3-4942-bb8a-9d1df64c5c34 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 16 20:55:48.715692 ncdv-master-1 devstack@n-api.service[121815]: WARNING keystonemiddleware.auth_token [None req-16d0dcd8-a7b3-4942-bb8a-9d1df64c5c34 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 16 20:55:48.731187 ncdv-master-1 devstack@n-api.service[121814]: WARNING keystonemiddleware.auth_token [None req-1413da5b-220b-403e-8e1d-5146b82577e3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 16 20:55:48.737717 ncdv-master-1 devstack@n-api.service[121814]: WARNING keystonemiddleware.auth_token [None req-1413da5b-220b-403e-8e1d-5146b82577e3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 16 20:55:48.937277 ncdv-master-1 devstack@n-api.service[121815]: WARNING keystonemiddleware.auth_token [None req-16d0dcd8-a7b3-4942-bb8a-9d1df64c5c34 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 16 20:55:48.942416 ncdv-master-1 devstack@n-api.service[121815]: WARNING keystonemiddleware.auth_token [None req-16d0dcd8-a7b3-4942-bb8a-9d1df64c5c34 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 16 20:55:48.947527 ncdv-master-1 devstack@n-api.service[121815]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5594f844a9c0 pid: 121815 (default app) Apr 16 20:55:48.949591 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi [None req-16d0dcd8-a7b3-4942-bb8a-9d1df64c5c34 None None] Calling method '>' {{(pid=121815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 20:55:48.950834 ncdv-master-1 devstack@n-api.service[121815]: INFO nova.api.openstack.requestlog [None req-16d0dcd8-a7b3-4942-bb8a-9d1df64c5c34 None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001687 Apr 16 20:55:48.951715 ncdv-master-1 devstack@n-api.service[121815]: [pid: 121815|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Sat Apr 16 20:55:48 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 20:55:48.961855 ncdv-master-1 devstack@n-api.service[121814]: WARNING keystonemiddleware.auth_token [None req-1413da5b-220b-403e-8e1d-5146b82577e3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 16 20:55:48.967469 ncdv-master-1 devstack@n-api.service[121814]: WARNING keystonemiddleware.auth_token [None req-1413da5b-220b-403e-8e1d-5146b82577e3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 16 20:55:48.972852 ncdv-master-1 devstack@n-api.service[121814]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5594f844a9c0 pid: 121814 (default app) Apr 16 20:57:11.860363 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi [None req-16d0dcd8-a7b3-4942-bb8a-9d1df64c5c34 None None] Calling method '>' {{(pid=121815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 20:57:11.862058 ncdv-master-1 devstack@n-api.service[121815]: INFO nova.api.openstack.requestlog [None req-16d0dcd8-a7b3-4942-bb8a-9d1df64c5c34 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002166 Apr 16 20:57:11.862674 ncdv-master-1 devstack@n-api.service[121815]: [pid: 121815|app: 0|req: 2/2] 10.222.0.20 () {54 vars in 930 bytes} [Sat Apr 16 20:57:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 20:57:12.284600 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi [None req-2dcaae46-402f-455c-bc0e-3bbacd705a55 admin admin] Calling method '>' {{(pid=121814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 20:57:12.314023 ncdv-master-1 devstack@n-api.service[121814]: INFO nova.api.openstack.requestlog [None req-2dcaae46-402f-455c-bc0e-3bbacd705a55 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.444538 Apr 16 20:57:12.316234 ncdv-master-1 devstack@n-api.service[121814]: [pid: 121814|app: 0|req: 1/3] 10.222.0.20 () {60 vars in 1291 bytes} [Sat Apr 16 20:57:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 20:57:14.736254 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi [None req-16d0dcd8-a7b3-4942-bb8a-9d1df64c5c34 None None] Calling method '>' {{(pid=121815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 20:57:14.737219 ncdv-master-1 devstack@n-api.service[121815]: INFO nova.api.openstack.requestlog [None req-16d0dcd8-a7b3-4942-bb8a-9d1df64c5c34 None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Apr 16 20:57:14.737609 ncdv-master-1 devstack@n-api.service[121815]: [pid: 121815|app: 0|req: 3/4] 10.222.0.20 () {54 vars in 930 bytes} [Sat Apr 16 20:57:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 20:57:14.798539 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi [None req-9208c55b-6522-4f7d-a334-65ce0f764e42 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "c1", "name": "cirros256", "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "rxtx_factor": 1.0, "disk": 1}} {{(pid=121814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 20:57:14.817994 ncdv-master-1 devstack@n-api.service[121814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 20:57:14.817994 ncdv-master-1 devstack@n-api.service[121814]: warnings.warn(msg) Apr 16 20:57:14.947413 ncdv-master-1 devstack@n-api.service[121814]: INFO nova.api.openstack.requestlog [None req-9208c55b-6522-4f7d-a334-65ce0f764e42 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.203857 Apr 16 20:57:14.948201 ncdv-master-1 devstack@n-api.service[121814]: [pid: 121814|app: 0|req: 2/5] 10.222.0.20 () {64 vars in 1282 bytes} [Sat Apr 16 20:57:14 2022] POST /compute/v2.1/flavors => generated 407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 20:57:15.167099 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi [None req-caf99936-63a9-4684-be95-e1c3ab6dd241 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 20:57:15.170063 ncdv-master-1 devstack@n-api.service[121815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 20:57:15.170063 ncdv-master-1 devstack@n-api.service[121815]: warnings.warn(msg) Apr 16 20:57:15.288241 ncdv-master-1 devstack@n-api.service[121815]: INFO nova.api.openstack.requestlog [None req-caf99936-63a9-4684-be95-e1c3ab6dd241 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.331231 Apr 16 20:57:15.289079 ncdv-master-1 devstack@n-api.service[121815]: [pid: 121815|app: 0|req: 4/6] 10.222.0.20 () {64 vars in 1335 bytes} [Sat Apr 16 20:57:14 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 20:57:17.707022 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi [None req-9208c55b-6522-4f7d-a334-65ce0f764e42 admin admin] Calling method '>' {{(pid=121814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 20:57:17.708102 ncdv-master-1 devstack@n-api.service[121814]: INFO nova.api.openstack.requestlog [None req-9208c55b-6522-4f7d-a334-65ce0f764e42 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Apr 16 20:57:17.711871 ncdv-master-1 devstack@n-api.service[121814]: [pid: 121814|app: 0|req: 3/7] 10.222.0.20 () {54 vars in 930 bytes} [Sat Apr 16 20:57:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 20:57:17.837018 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi [None req-95f04047-006a-407c-a36a-1c28344c2b71 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 5, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512}} {{(pid=121815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 20:57:17.858107 ncdv-master-1 devstack@n-api.service[121815]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 20:57:17.858107 ncdv-master-1 devstack@n-api.service[121815]: warnings.warn(msg) Apr 16 20:57:17.981790 ncdv-master-1 devstack@n-api.service[121815]: INFO nova.api.openstack.requestlog [None req-95f04047-006a-407c-a36a-1c28344c2b71 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.267449 Apr 16 20:57:17.982543 ncdv-master-1 devstack@n-api.service[121815]: [pid: 121815|app: 0|req: 5/8] 10.222.0.20 () {64 vars in 1282 bytes} [Sat Apr 16 20:57:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 20:57:17.993953 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi [None req-dbc62bf2-1945-4065-8048-7c4959d04d9a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 20:57:17.995450 ncdv-master-1 devstack@n-api.service[121814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 20:57:17.995450 ncdv-master-1 devstack@n-api.service[121814]: warnings.warn(msg) Apr 16 20:57:18.105322 ncdv-master-1 devstack@n-api.service[121814]: INFO nova.api.openstack.requestlog [None req-dbc62bf2-1945-4065-8048-7c4959d04d9a admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114984 Apr 16 20:57:18.108438 ncdv-master-1 devstack@n-api.service[121814]: [pid: 121814|app: 0|req: 4/9] 10.222.0.20 () {64 vars in 1335 bytes} [Sat Apr 16 20:57:17 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 20:57:20.648625 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi [None req-95f04047-006a-407c-a36a-1c28344c2b71 admin admin] Calling method '>' {{(pid=121815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 20:57:20.650205 ncdv-master-1 devstack@n-api.service[121815]: INFO nova.api.openstack.requestlog [None req-95f04047-006a-407c-a36a-1c28344c2b71 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002184 Apr 16 20:57:20.661130 ncdv-master-1 devstack@n-api.service[121815]: [pid: 121815|app: 0|req: 6/10] 10.222.0.20 () {54 vars in 930 bytes} [Sat Apr 16 20:57:20 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 20:57:20.717921 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi [None req-1d25436c-ef46-42d8-9135-9da9565df7ac admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 10, "id": "d2", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "ram": 1024, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=121814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 20:57:20.834762 ncdv-master-1 devstack@n-api.service[121814]: INFO nova.api.openstack.requestlog [None req-1d25436c-ef46-42d8-9135-9da9565df7ac admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.177505 Apr 16 20:57:20.840775 ncdv-master-1 devstack@n-api.service[121814]: [pid: 121814|app: 0|req: 5/11] 10.222.0.20 () {64 vars in 1282 bytes} [Sat Apr 16 20:57:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 20:57:20.849023 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi [None req-ef8ca9b7-069d-4a63-9198-30c2d64550e3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 20:57:20.943944 ncdv-master-1 devstack@n-api.service[121815]: INFO nova.api.openstack.requestlog [None req-ef8ca9b7-069d-4a63-9198-30c2d64550e3 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098794 Apr 16 20:57:20.956323 ncdv-master-1 devstack@n-api.service[121815]: [pid: 121815|app: 0|req: 7/12] 10.222.0.20 () {64 vars in 1335 bytes} [Sat Apr 16 20:57:20 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 20:57:23.614009 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi [None req-1d25436c-ef46-42d8-9135-9da9565df7ac admin admin] Calling method '>' {{(pid=121814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 20:57:23.616685 ncdv-master-1 devstack@n-api.service[121814]: INFO nova.api.openstack.requestlog [None req-1d25436c-ef46-42d8-9135-9da9565df7ac admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003105 Apr 16 20:57:23.621607 ncdv-master-1 devstack@n-api.service[121814]: [pid: 121814|app: 0|req: 6/13] 10.222.0.20 () {54 vars in 930 bytes} [Sat Apr 16 20:57:23 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 20:57:23.720673 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi [None req-08795e9c-c075-4358-9d30-4fc0d3e1ef15 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d3", "os-flavor-access:is_public": true, "vcpus": 2, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "swap": 0, "ram": 2048}} {{(pid=121815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 20:57:23.886362 ncdv-master-1 devstack@n-api.service[121815]: INFO nova.api.openstack.requestlog [None req-08795e9c-c075-4358-9d30-4fc0d3e1ef15 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.261982 Apr 16 20:57:23.887092 ncdv-master-1 devstack@n-api.service[121815]: [pid: 121815|app: 0|req: 8/14] 10.222.0.20 () {64 vars in 1282 bytes} [Sat Apr 16 20:57:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 20:57:23.901837 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi [None req-8168bc55-9a98-4fad-83f7-1eebbebb16ed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 20:57:24.056559 ncdv-master-1 devstack@n-api.service[121814]: INFO nova.api.openstack.requestlog [None req-8168bc55-9a98-4fad-83f7-1eebbebb16ed admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.158577 Apr 16 20:57:24.057197 ncdv-master-1 devstack@n-api.service[121814]: [pid: 121814|app: 0|req: 7/15] 10.222.0.20 () {64 vars in 1335 bytes} [Sat Apr 16 20:57:23 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 20:57:26.736777 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi [None req-08795e9c-c075-4358-9d30-4fc0d3e1ef15 admin admin] Calling method '>' {{(pid=121815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 20:57:26.743081 ncdv-master-1 devstack@n-api.service[121815]: INFO nova.api.openstack.requestlog [None req-08795e9c-c075-4358-9d30-4fc0d3e1ef15 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Apr 16 20:57:26.743081 ncdv-master-1 devstack@n-api.service[121815]: [pid: 121815|app: 0|req: 9/16] 10.222.0.20 () {54 vars in 930 bytes} [Sat Apr 16 20:57:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 20:57:26.799382 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi [None req-4a615b82-da18-4ba5-b679-da42bc322566 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "name": "ds4G", "os-flavor-access:is_public": true, "vcpus": 4, "disk": 20, "ram": 4096, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=121814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 20:57:26.883315 ncdv-master-1 devstack@n-api.service[121814]: INFO nova.api.openstack.requestlog [None req-4a615b82-da18-4ba5-b679-da42bc322566 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.138388 Apr 16 20:57:26.883871 ncdv-master-1 devstack@n-api.service[121814]: [pid: 121814|app: 0|req: 8/17] 10.222.0.20 () {64 vars in 1282 bytes} [Sat Apr 16 20:57:26 2022] POST /compute/v2.1/flavors => generated 404 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 20:57:26.896063 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi [None req-6044625a-1995-47db-972a-e3f1822dfc90 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 20:57:26.983642 ncdv-master-1 devstack@n-api.service[121815]: INFO nova.api.openstack.requestlog [None req-6044625a-1995-47db-972a-e3f1822dfc90 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091201 Apr 16 20:57:26.984279 ncdv-master-1 devstack@n-api.service[121815]: [pid: 121815|app: 0|req: 10/18] 10.222.0.20 () {64 vars in 1335 bytes} [Sat Apr 16 20:57:26 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 20:57:29.671333 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi [None req-4a615b82-da18-4ba5-b679-da42bc322566 admin admin] Calling method '>' {{(pid=121814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 20:57:29.672942 ncdv-master-1 devstack@n-api.service[121814]: INFO nova.api.openstack.requestlog [None req-4a615b82-da18-4ba5-b679-da42bc322566 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002122 Apr 16 20:57:29.677257 ncdv-master-1 devstack@n-api.service[121814]: [pid: 121814|app: 0|req: 9/19] 10.222.0.20 () {54 vars in 930 bytes} [Sat Apr 16 20:57:29 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 20:57:29.737396 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi [None req-0a5c3b4c-d6e0-4b47-b6c2-f1ad5be39338 admin admin] Calling method '>' {{(pid=121815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 20:57:29.761239 ncdv-master-1 devstack@n-api.service[121815]: INFO nova.api.openstack.requestlog [None req-0a5c3b4c-d6e0-4b47-b6c2-f1ad5be39338 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081219 Apr 16 20:57:29.762017 ncdv-master-1 devstack@n-api.service[121815]: [pid: 121815|app: 0|req: 11/20] 10.222.0.20 () {60 vars in 1291 bytes} [Sat Apr 16 20:57:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 20:57:32.227619 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi [None req-4a615b82-da18-4ba5-b679-da42bc322566 admin admin] Calling method '>' {{(pid=121814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 20:57:32.228824 ncdv-master-1 devstack@n-api.service[121814]: INFO nova.api.openstack.requestlog [None req-4a615b82-da18-4ba5-b679-da42bc322566 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001914 Apr 16 20:57:32.229683 ncdv-master-1 devstack@n-api.service[121814]: [pid: 121814|app: 0|req: 10/21] 10.222.0.20 () {54 vars in 930 bytes} [Sat Apr 16 20:57:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 20:57:32.294651 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi [None req-618f172a-cc5d-4ea8-b2b0-74106e02dafe admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "os-flavor-access:is_public": true, "name": "m1.tiny", "vcpus": 1, "rxtx_factor": 1.0, "disk": 1, "swap": 0}} {{(pid=121815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 20:57:32.379013 ncdv-master-1 devstack@n-api.service[121815]: INFO nova.api.openstack.requestlog [None req-618f172a-cc5d-4ea8-b2b0-74106e02dafe admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.142627 Apr 16 20:57:32.379944 ncdv-master-1 devstack@n-api.service[121815]: [pid: 121815|app: 0|req: 12/22] 10.222.0.20 () {64 vars in 1282 bytes} [Sat Apr 16 20:57:32 2022] POST /compute/v2.1/flavors => generated 402 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 20:57:32.392195 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi [None req-b612c9af-01e1-4e78-9e83-af4577ae758c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 20:57:32.548662 ncdv-master-1 devstack@n-api.service[121814]: INFO nova.api.openstack.requestlog [None req-b612c9af-01e1-4e78-9e83-af4577ae758c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.160366 Apr 16 20:57:32.560989 ncdv-master-1 devstack@n-api.service[121814]: [pid: 121814|app: 0|req: 11/23] 10.222.0.20 () {64 vars in 1332 bytes} [Sat Apr 16 20:57:32 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 20:57:35.005599 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi [None req-618f172a-cc5d-4ea8-b2b0-74106e02dafe admin admin] Calling method '>' {{(pid=121815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 20:57:35.006612 ncdv-master-1 devstack@n-api.service[121815]: INFO nova.api.openstack.requestlog [None req-618f172a-cc5d-4ea8-b2b0-74106e02dafe admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Apr 16 20:57:35.007077 ncdv-master-1 devstack@n-api.service[121815]: [pid: 121815|app: 0|req: 13/24] 10.222.0.20 () {54 vars in 930 bytes} [Sat Apr 16 20:57:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 20:57:35.068627 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi [None req-6efe7f66-3465-4d08-b56c-2d951b296a37 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 20, "os-flavor-access:is_public": true, "id": "2", "name": "m1.small", "swap": 0, "ram": 2048, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=121814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 20:57:35.167511 ncdv-master-1 devstack@n-api.service[121814]: INFO nova.api.openstack.requestlog [None req-6efe7f66-3465-4d08-b56c-2d951b296a37 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.152914 Apr 16 20:57:35.250819 ncdv-master-1 devstack@n-api.service[121814]: [pid: 121814|app: 0|req: 12/25] 10.222.0.20 () {64 vars in 1282 bytes} [Sat Apr 16 20:57:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 20:57:35.250992 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi [None req-7dcaf5f1-a2e7-4b34-a279-38fadb7a92be admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 20:57:35.477532 ncdv-master-1 devstack@n-api.service[121815]: INFO nova.api.openstack.requestlog [None req-7dcaf5f1-a2e7-4b34-a279-38fadb7a92be admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.299665 Apr 16 20:57:35.479011 ncdv-master-1 devstack@n-api.service[121815]: [pid: 121815|app: 0|req: 14/26] 10.222.0.20 () {64 vars in 1332 bytes} [Sat Apr 16 20:57:35 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 20:57:37.956505 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi [None req-6efe7f66-3465-4d08-b56c-2d951b296a37 admin admin] Calling method '>' {{(pid=121814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 20:57:37.957449 ncdv-master-1 devstack@n-api.service[121814]: INFO nova.api.openstack.requestlog [None req-6efe7f66-3465-4d08-b56c-2d951b296a37 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Apr 16 20:57:37.958028 ncdv-master-1 devstack@n-api.service[121814]: [pid: 121814|app: 0|req: 13/27] 10.222.0.20 () {54 vars in 930 bytes} [Sat Apr 16 20:57:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 20:57:38.017819 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi [None req-79c1e8f2-dfc0-4ff5-9713-27773d789fa1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "m1.medium", "ram": 4096, "rxtx_factor": 1.0, "vcpus": 2, "disk": 40, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=121815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 20:57:38.105010 ncdv-master-1 devstack@n-api.service[121815]: INFO nova.api.openstack.requestlog [None req-79c1e8f2-dfc0-4ff5-9713-27773d789fa1 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.141142 Apr 16 20:57:38.106051 ncdv-master-1 devstack@n-api.service[121815]: [pid: 121815|app: 0|req: 15/28] 10.222.0.20 () {64 vars in 1282 bytes} [Sat Apr 16 20:57:37 2022] POST /compute/v2.1/flavors => generated 406 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 16 20:57:38.118310 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi [None req-a8893c68-c02d-426c-bb08-2245e8aea5f5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 20:57:38.376846 ncdv-master-1 devstack@n-api.service[121814]: INFO nova.api.openstack.requestlog [None req-a8893c68-c02d-426c-bb08-2245e8aea5f5 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.262622 Apr 16 20:57:38.377440 ncdv-master-1 devstack@n-api.service[121814]: [pid: 121814|app: 0|req: 14/29] 10.222.0.20 () {64 vars in 1332 bytes} [Sat Apr 16 20:57:38 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 20:57:40.881678 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi [None req-79c1e8f2-dfc0-4ff5-9713-27773d789fa1 admin admin] Calling method '>' {{(pid=121815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 20:57:40.882688 ncdv-master-1 devstack@n-api.service[121815]: INFO nova.api.openstack.requestlog [None req-79c1e8f2-dfc0-4ff5-9713-27773d789fa1 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Apr 16 20:57:40.883080 ncdv-master-1 devstack@n-api.service[121815]: [pid: 121815|app: 0|req: 16/30] 10.222.0.20 () {54 vars in 930 bytes} [Sat Apr 16 20:57:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 20:57:40.942091 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi [None req-6bb6d28e-fca3-429f-8a7e-8cad59a94882 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "name": "m1.large", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "disk": 80}} {{(pid=121814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 20:57:41.022854 ncdv-master-1 devstack@n-api.service[121814]: INFO nova.api.openstack.requestlog [None req-6bb6d28e-fca3-429f-8a7e-8cad59a94882 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.134106 Apr 16 20:57:41.023527 ncdv-master-1 devstack@n-api.service[121814]: [pid: 121814|app: 0|req: 15/31] 10.222.0.20 () {64 vars in 1282 bytes} [Sat Apr 16 20:57:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 20:57:41.035852 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi [None req-40bc842c-2118-4568-923d-14c3ddb1561b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 20:57:41.114942 ncdv-master-1 devstack@n-api.service[121815]: INFO nova.api.openstack.requestlog [None req-40bc842c-2118-4568-923d-14c3ddb1561b admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.082863 Apr 16 20:57:41.115546 ncdv-master-1 devstack@n-api.service[121815]: [pid: 121815|app: 0|req: 17/32] 10.222.0.20 () {64 vars in 1332 bytes} [Sat Apr 16 20:57:41 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 20:57:43.524850 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi [None req-6bb6d28e-fca3-429f-8a7e-8cad59a94882 admin admin] Calling method '>' {{(pid=121814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 20:57:43.526546 ncdv-master-1 devstack@n-api.service[121814]: INFO nova.api.openstack.requestlog [None req-6bb6d28e-fca3-429f-8a7e-8cad59a94882 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002221 Apr 16 20:57:43.526970 ncdv-master-1 devstack@n-api.service[121814]: [pid: 121814|app: 0|req: 16/33] 10.222.0.20 () {54 vars in 930 bytes} [Sat Apr 16 20:57:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 20:57:43.591731 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi [None req-66bf2218-8f33-4b62-b66c-5af69356beca admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "name": "m1.xlarge", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "5", "disk": 160, "ram": 16384, "rxtx_factor": 1.0}} {{(pid=121815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 20:57:43.666137 ncdv-master-1 devstack@n-api.service[121815]: INFO nova.api.openstack.requestlog [None req-66bf2218-8f33-4b62-b66c-5af69356beca admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.133093 Apr 16 20:57:43.666854 ncdv-master-1 devstack@n-api.service[121815]: [pid: 121815|app: 0|req: 18/34] 10.222.0.20 () {64 vars in 1282 bytes} [Sat Apr 16 20:57:43 2022] POST /compute/v2.1/flavors => generated 408 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 16 20:57:43.680284 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi [None req-d2274089-3055-4a6b-9ca8-7ca835cf55fe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=121814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 20:57:43.772070 ncdv-master-1 devstack@n-api.service[121814]: INFO nova.api.openstack.requestlog [None req-d2274089-3055-4a6b-9ca8-7ca835cf55fe admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095857 Apr 16 20:57:43.772918 ncdv-master-1 devstack@n-api.service[121814]: [pid: 121814|app: 0|req: 17/35] 10.222.0.20 () {64 vars in 1332 bytes} [Sat Apr 16 20:57:43 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 20:58:10.602821 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi [None req-66bf2218-8f33-4b62-b66c-5af69356beca admin admin] Calling method '>' {{(pid=121815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 20:58:10.603829 ncdv-master-1 devstack@n-api.service[121815]: INFO nova.api.openstack.requestlog [None req-66bf2218-8f33-4b62-b66c-5af69356beca admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Apr 16 20:58:10.604248 ncdv-master-1 devstack@n-api.service[121815]: [pid: 121815|app: 0|req: 19/36] 10.222.0.20 () {54 vars in 930 bytes} [Sat Apr 16 20:58:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 20:58:10.659868 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi [None req-4fad7966-9738-4f1d-b941-72b774411897 admin admin] Calling method '>' {{(pid=121814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 20:58:10.677030 ncdv-master-1 devstack@n-api.service[121814]: INFO nova.api.openstack.requestlog [None req-4fad7966-9738-4f1d-b941-72b774411897 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.066781 Apr 16 20:58:10.677563 ncdv-master-1 devstack@n-api.service[121814]: [pid: 121814|app: 0|req: 18/37] 10.222.0.20 () {60 vars in 1291 bytes} [Sat Apr 16 20:58:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 20:58:12.149437 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi [None req-66bf2218-8f33-4b62-b66c-5af69356beca admin admin] Calling method '>' {{(pid=121815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 20:58:12.150457 ncdv-master-1 devstack@n-api.service[121815]: INFO nova.api.openstack.requestlog [None req-66bf2218-8f33-4b62-b66c-5af69356beca admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Apr 16 20:58:12.150849 ncdv-master-1 devstack@n-api.service[121815]: [pid: 121815|app: 0|req: 20/38] 10.222.0.20 () {56 vars in 1074 bytes} [Sat Apr 16 20:58:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 20:58:12.388471 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi [None req-e0dd46d6-149f-4124-8ca6-2e36ea0ec7dd admin admin] Calling method '>' {{(pid=121814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 20:58:12.394021 ncdv-master-1 devstack@n-api.service[121814]: INFO nova.api.openstack.wsgi [None req-e0dd46d6-149f-4124-8ca6-2e36ea0ec7dd admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 16 20:58:12.394581 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi [None req-e0dd46d6-149f-4124-8ca6-2e36ea0ec7dd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=121814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 20:58:12.395366 ncdv-master-1 devstack@n-api.service[121814]: INFO nova.api.openstack.requestlog [None req-e0dd46d6-149f-4124-8ca6-2e36ea0ec7dd admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.057813 Apr 16 20:58:12.395875 ncdv-master-1 devstack@n-api.service[121814]: [pid: 121814|app: 0|req: 19/39] 10.222.0.20 () {60 vars in 1190 bytes} [Sat Apr 16 20:58:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 16 20:58:12.406332 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi [None req-98a7ec1f-5c52-409c-9774-e32f5a71e472 admin admin] Calling method '>' {{(pid=121815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 20:58:12.427076 ncdv-master-1 devstack@n-api.service[121815]: INFO nova.api.openstack.requestlog [None req-98a7ec1f-5c52-409c-9774-e32f5a71e472 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024080 Apr 16 20:58:12.427633 ncdv-master-1 devstack@n-api.service[121815]: [pid: 121815|app: 0|req: 21/40] 10.222.0.20 () {60 vars in 1210 bytes} [Sat Apr 16 20:58:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 20:58:12.437646 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi [None req-f37422b1-414f-499d-9e89-8e5ca489e7f7 admin admin] Calling method '>' {{(pid=121814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 20:58:12.460483 ncdv-master-1 devstack@n-api.service[121814]: INFO nova.api.openstack.requestlog [None req-f37422b1-414f-499d-9e89-8e5ca489e7f7 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026298 Apr 16 20:58:12.461028 ncdv-master-1 devstack@n-api.service[121814]: [pid: 121814|app: 0|req: 20/41] 10.222.0.20 () {60 vars in 1210 bytes} [Sat Apr 16 20:58:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 20:58:12.470331 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi [None req-fb29cdba-6b99-4e37-92d7-5060a9d8edbc admin admin] Calling method '>' {{(pid=121815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 20:58:12.475815 ncdv-master-1 devstack@n-api.service[121815]: INFO nova.api.openstack.wsgi [None req-fb29cdba-6b99-4e37-92d7-5060a9d8edbc admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 16 20:58:12.476417 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi [None req-fb29cdba-6b99-4e37-92d7-5060a9d8edbc admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=121815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 20:58:12.477196 ncdv-master-1 devstack@n-api.service[121815]: INFO nova.api.openstack.requestlog [None req-fb29cdba-6b99-4e37-92d7-5060a9d8edbc admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010453 Apr 16 20:58:12.477682 ncdv-master-1 devstack@n-api.service[121815]: [pid: 121815|app: 0|req: 22/42] 10.222.0.20 () {60 vars in 1190 bytes} [Sat Apr 16 20:58:12 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 16 20:58:13.802895 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi [None req-f37422b1-414f-499d-9e89-8e5ca489e7f7 admin admin] Calling method '>' {{(pid=121814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 20:58:13.803932 ncdv-master-1 devstack@n-api.service[121814]: INFO nova.api.openstack.requestlog [None req-f37422b1-414f-499d-9e89-8e5ca489e7f7 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Apr 16 20:58:13.804366 ncdv-master-1 devstack@n-api.service[121814]: [pid: 121814|app: 0|req: 21/43] 10.222.0.20 () {56 vars in 1074 bytes} [Sat Apr 16 20:58:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 20:58:14.000807 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi [None req-f682d6b9-071a-4502-a8e2-1f3aa7a1cabb admin admin] Calling method '>' {{(pid=121815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 20:58:14.005947 ncdv-master-1 devstack@n-api.service[121815]: INFO nova.api.openstack.wsgi [None req-f682d6b9-071a-4502-a8e2-1f3aa7a1cabb admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 16 20:58:14.006506 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi [None req-f682d6b9-071a-4502-a8e2-1f3aa7a1cabb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=121815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 20:58:14.007294 ncdv-master-1 devstack@n-api.service[121815]: INFO nova.api.openstack.requestlog [None req-f682d6b9-071a-4502-a8e2-1f3aa7a1cabb admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.057630 Apr 16 20:58:14.007805 ncdv-master-1 devstack@n-api.service[121815]: [pid: 121815|app: 0|req: 23/44] 10.222.0.20 () {60 vars in 1190 bytes} [Sat Apr 16 20:58:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 16 20:58:14.018146 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi [None req-980d6411-4dcf-454c-9d40-e0e6e6cf0564 admin admin] Calling method '>' {{(pid=121814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 20:58:14.031929 ncdv-master-1 devstack@n-api.service[121814]: INFO nova.api.openstack.requestlog [None req-980d6411-4dcf-454c-9d40-e0e6e6cf0564 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017368 Apr 16 20:58:14.034157 ncdv-master-1 devstack@n-api.service[121814]: [pid: 121814|app: 0|req: 22/45] 10.222.0.20 () {60 vars in 1210 bytes} [Sat Apr 16 20:58:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 20:58:14.042374 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi [None req-6c94fe95-d5cb-437d-858b-98bcd22c57a0 admin admin] Calling method '>' {{(pid=121815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 20:58:14.058272 ncdv-master-1 devstack@n-api.service[121815]: INFO nova.api.openstack.requestlog [None req-6c94fe95-d5cb-437d-858b-98bcd22c57a0 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019501 Apr 16 20:58:14.058794 ncdv-master-1 devstack@n-api.service[121815]: [pid: 121815|app: 0|req: 24/46] 10.222.0.20 () {60 vars in 1210 bytes} [Sat Apr 16 20:58:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 20:58:14.068668 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi [None req-cb49c638-eac9-4468-bf32-e71d472b2c00 admin admin] Calling method '>' {{(pid=121814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 20:58:14.074507 ncdv-master-1 devstack@n-api.service[121814]: INFO nova.api.openstack.wsgi [None req-cb49c638-eac9-4468-bf32-e71d472b2c00 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 16 20:58:14.075062 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi [None req-cb49c638-eac9-4468-bf32-e71d472b2c00 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=121814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 20:58:14.075835 ncdv-master-1 devstack@n-api.service[121814]: INFO nova.api.openstack.requestlog [None req-cb49c638-eac9-4468-bf32-e71d472b2c00 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011056 Apr 16 20:58:14.076348 ncdv-master-1 devstack@n-api.service[121814]: [pid: 121814|app: 0|req: 23/47] 10.222.0.20 () {60 vars in 1190 bytes} [Sat Apr 16 20:58:14 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Apr 16 20:58:15.413062 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi [None req-6c94fe95-d5cb-437d-858b-98bcd22c57a0 admin admin] Calling method '>' {{(pid=121815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 20:58:15.414365 ncdv-master-1 devstack@n-api.service[121815]: INFO nova.api.openstack.requestlog [None req-6c94fe95-d5cb-437d-858b-98bcd22c57a0 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001722 Apr 16 20:58:15.414763 ncdv-master-1 devstack@n-api.service[121815]: [pid: 121815|app: 0|req: 25/48] 10.222.0.20 () {56 vars in 1074 bytes} [Sat Apr 16 20:58:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 20:58:15.610058 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi [None req-585ecca3-717b-44f7-86bc-19c9654dcdbb admin admin] Calling method '>' {{(pid=121814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 20:58:15.615216 ncdv-master-1 devstack@n-api.service[121814]: INFO nova.api.openstack.wsgi [None req-585ecca3-717b-44f7-86bc-19c9654dcdbb admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 16 20:58:15.617814 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi [None req-585ecca3-717b-44f7-86bc-19c9654dcdbb admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=121814) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 20:58:15.618674 ncdv-master-1 devstack@n-api.service[121814]: INFO nova.api.openstack.requestlog [None req-585ecca3-717b-44f7-86bc-19c9654dcdbb admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059719 Apr 16 20:58:15.619255 ncdv-master-1 devstack@n-api.service[121814]: [pid: 121814|app: 0|req: 24/49] 10.222.0.20 () {60 vars in 1193 bytes} [Sat Apr 16 20:58:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 16 20:58:15.629906 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi [None req-ca99de7e-f0d3-4ee0-a539-b74260df1281 admin admin] Calling method '>' {{(pid=121815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 20:58:15.643746 ncdv-master-1 devstack@n-api.service[121815]: INFO nova.api.openstack.requestlog [None req-ca99de7e-f0d3-4ee0-a539-b74260df1281 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017411 Apr 16 20:58:15.644287 ncdv-master-1 devstack@n-api.service[121815]: [pid: 121815|app: 0|req: 26/50] 10.222.0.20 () {60 vars in 1210 bytes} [Sat Apr 16 20:58:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 20:58:15.654747 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi [None req-83114c28-d643-4e4a-9536-7a1237e0b6ea admin admin] Calling method '>' {{(pid=121814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 20:58:15.667748 ncdv-master-1 devstack@n-api.service[121814]: INFO nova.api.openstack.requestlog [None req-83114c28-d643-4e4a-9536-7a1237e0b6ea admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017527 Apr 16 20:58:15.668435 ncdv-master-1 devstack@n-api.service[121814]: [pid: 121814|app: 0|req: 25/51] 10.222.0.20 () {60 vars in 1210 bytes} [Sat Apr 16 20:58:15 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 20:58:15.677759 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi [None req-fce5a50c-2075-4df6-b11b-5c28716f6ca5 admin admin] Calling method '>' {{(pid=121815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 20:58:15.682994 ncdv-master-1 devstack@n-api.service[121815]: INFO nova.api.openstack.wsgi [None req-fce5a50c-2075-4df6-b11b-5c28716f6ca5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 16 20:58:15.683555 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi [None req-fce5a50c-2075-4df6-b11b-5c28716f6ca5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=121815) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 20:58:15.684380 ncdv-master-1 devstack@n-api.service[121815]: INFO nova.api.openstack.requestlog [None req-fce5a50c-2075-4df6-b11b-5c28716f6ca5 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010465 Apr 16 20:58:15.684891 ncdv-master-1 devstack@n-api.service[121815]: [pid: 121815|app: 0|req: 27/52] 10.222.0.20 () {60 vars in 1193 bytes} [Sat Apr 16 20:58:15 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 16 20:58:17.005297 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi [None req-83114c28-d643-4e4a-9536-7a1237e0b6ea admin admin] Calling method '>' {{(pid=121814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 20:58:17.006294 ncdv-master-1 devstack@n-api.service[121814]: INFO nova.api.openstack.requestlog [None req-83114c28-d643-4e4a-9536-7a1237e0b6ea admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Apr 16 20:58:17.006685 ncdv-master-1 devstack@n-api.service[121814]: [pid: 121814|app: 0|req: 26/53] 10.222.0.20 () {56 vars in 1074 bytes} [Sat Apr 16 20:58:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 20:58:17.203828 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi [None req-548af7f5-b01d-419b-8118-775f310ecae5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=121815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 20:58:17.299897 ncdv-master-1 devstack@n-api.service[121815]: INFO nova.api.openstack.requestlog [None req-548af7f5-b01d-419b-8118-775f310ecae5 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.145965 Apr 16 20:58:17.300387 ncdv-master-1 devstack@n-api.service[121815]: [pid: 121815|app: 0|req: 28/54] 10.222.0.20 () {64 vars in 1235 bytes} [Sat Apr 16 20:58:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 20:58:18.632475 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi [None req-83114c28-d643-4e4a-9536-7a1237e0b6ea admin admin] Calling method '>' {{(pid=121814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 20:58:18.633480 ncdv-master-1 devstack@n-api.service[121814]: INFO nova.api.openstack.requestlog [None req-83114c28-d643-4e4a-9536-7a1237e0b6ea admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Apr 16 20:58:18.633879 ncdv-master-1 devstack@n-api.service[121814]: [pid: 121814|app: 0|req: 27/55] 10.222.0.20 () {56 vars in 1074 bytes} [Sat Apr 16 20:58:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 20:58:18.834307 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi [None req-29c47cee-7e18-4ced-9809-dbe04d4afb9a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=121815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 20:58:18.899342 ncdv-master-1 devstack@n-api.service[121815]: INFO nova.api.openstack.requestlog [None req-29c47cee-7e18-4ced-9809-dbe04d4afb9a admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.116169 Apr 16 20:58:18.899771 ncdv-master-1 devstack@n-api.service[121815]: [pid: 121815|app: 0|req: 29/56] 10.222.0.20 () {64 vars in 1235 bytes} [Sat Apr 16 20:58:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 20:58:20.225876 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi [None req-83114c28-d643-4e4a-9536-7a1237e0b6ea admin admin] Calling method '>' {{(pid=121814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 20:58:20.226934 ncdv-master-1 devstack@n-api.service[121814]: INFO nova.api.openstack.requestlog [None req-83114c28-d643-4e4a-9536-7a1237e0b6ea admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Apr 16 20:58:20.227334 ncdv-master-1 devstack@n-api.service[121814]: [pid: 121814|app: 0|req: 28/57] 10.222.0.20 () {56 vars in 1074 bytes} [Sat Apr 16 20:58:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 20:58:20.419873 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi [None req-45fe7c96-d612-4f97-b039-68cfbd2ca1bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=121815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 20:58:20.499416 ncdv-master-1 devstack@n-api.service[121815]: INFO nova.api.openstack.requestlog [None req-45fe7c96-d612-4f97-b039-68cfbd2ca1bd admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.129656 Apr 16 20:58:20.499950 ncdv-master-1 devstack@n-api.service[121815]: [pid: 121815|app: 0|req: 30/58] 10.222.0.20 () {64 vars in 1235 bytes} [Sat Apr 16 20:58:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 20:58:21.837880 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi [None req-83114c28-d643-4e4a-9536-7a1237e0b6ea admin admin] Calling method '>' {{(pid=121814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 20:58:21.837880 ncdv-master-1 devstack@n-api.service[121814]: INFO nova.api.openstack.requestlog [None req-83114c28-d643-4e4a-9536-7a1237e0b6ea admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Apr 16 20:58:21.837880 ncdv-master-1 devstack@n-api.service[121814]: [pid: 121814|app: 0|req: 29/59] 10.222.0.20 () {56 vars in 1074 bytes} [Sat Apr 16 20:58:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 20:58:22.033123 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi [None req-bf50207e-ff7e-483a-87c6-b8b5986d0ba3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=121815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 20:58:22.126496 ncdv-master-1 devstack@n-api.service[121815]: INFO nova.api.openstack.requestlog [None req-bf50207e-ff7e-483a-87c6-b8b5986d0ba3 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.142876 Apr 16 20:58:22.127098 ncdv-master-1 devstack@n-api.service[121815]: [pid: 121815|app: 0|req: 31/60] 10.222.0.20 () {64 vars in 1235 bytes} [Sat Apr 16 20:58:21 2022] POST /compute/v2.1/flavors => generated 409 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 20:58:23.470639 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi [None req-83114c28-d643-4e4a-9536-7a1237e0b6ea admin admin] Calling method '>' {{(pid=121814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 20:58:23.471642 ncdv-master-1 devstack@n-api.service[121814]: INFO nova.api.openstack.requestlog [None req-83114c28-d643-4e4a-9536-7a1237e0b6ea admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Apr 16 20:58:23.472037 ncdv-master-1 devstack@n-api.service[121814]: [pid: 121814|app: 0|req: 30/61] 10.222.0.20 () {56 vars in 1074 bytes} [Sat Apr 16 20:58:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 20:58:23.665342 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi [None req-808d1d70-a5a9-4366-9acc-ec796c4b71b3 admin admin] Calling method '>' {{(pid=121815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 20:58:23.686144 ncdv-master-1 devstack@n-api.service[121815]: INFO nova.api.openstack.requestlog [None req-808d1d70-a5a9-4366-9acc-ec796c4b71b3 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071574 Apr 16 20:58:23.686719 ncdv-master-1 devstack@n-api.service[121815]: [pid: 121815|app: 0|req: 32/62] 10.222.0.20 () {60 vars in 1202 bytes} [Sat Apr 16 20:58:23 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 20:59:28.971874 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi [None req-83114c28-d643-4e4a-9536-7a1237e0b6ea admin admin] Calling method '>' {{(pid=121814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 20:59:28.972909 ncdv-master-1 devstack@n-api.service[121814]: INFO nova.api.openstack.requestlog [None req-83114c28-d643-4e4a-9536-7a1237e0b6ea admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Apr 16 20:59:28.973302 ncdv-master-1 devstack@n-api.service[121814]: [pid: 121814|app: 0|req: 31/63] 10.222.0.20 () {54 vars in 930 bytes} [Sat Apr 16 20:59:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 20:59:29.030489 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi [None req-4b3b064d-fb99-4d57-9cdf-015390aadb3d admin admin] Calling method '>' {{(pid=121815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 20:59:29.048990 ncdv-master-1 devstack@n-api.service[121815]: INFO nova.api.openstack.requestlog [None req-4b3b064d-fb99-4d57-9cdf-015390aadb3d admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.069782 Apr 16 20:59:29.049520 ncdv-master-1 devstack@n-api.service[121815]: [pid: 121815|app: 0|req: 33/64] 10.222.0.20 () {60 vars in 1291 bytes} [Sat Apr 16 20:59:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 20:59:29.071549 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi [None req-2c4ec2f4-c3d3-4dba-8f3f-52a4dec478ff admin admin] Calling method '>' {{(pid=121814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 20:59:29.079629 ncdv-master-1 devstack@n-api.service[121814]: INFO nova.api.openstack.requestlog [None req-2c4ec2f4-c3d3-4dba-8f3f-52a4dec478ff admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012198 Apr 16 20:59:29.080284 ncdv-master-1 devstack@n-api.service[121814]: [pid: 121814|app: 0|req: 32/65] 10.222.0.20 () {60 vars in 1282 bytes} [Sat Apr 16 20:59:29 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 20:59:29.091979 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi [None req-6467d69d-dd43-4d00-8aaf-bd313bf77705 admin admin] Calling method '>' {{(pid=121815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 20:59:29.099554 ncdv-master-1 devstack@n-api.service[121815]: INFO nova.api.openstack.requestlog [None req-6467d69d-dd43-4d00-8aaf-bd313bf77705 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011844 Apr 16 20:59:29.100066 ncdv-master-1 devstack@n-api.service[121815]: [pid: 121815|app: 0|req: 34/66] 10.222.0.20 () {60 vars in 1285 bytes} [Sat Apr 16 20:59:29 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 20:59:29.111108 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi [None req-587617af-4852-4ea5-8b44-27ccfb6f8900 admin admin] Calling method '>' {{(pid=121814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 20:59:29.118345 ncdv-master-1 devstack@n-api.service[121814]: INFO nova.api.openstack.requestlog [None req-587617af-4852-4ea5-8b44-27ccfb6f8900 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010697 Apr 16 20:59:29.118850 ncdv-master-1 devstack@n-api.service[121814]: [pid: 121814|app: 0|req: 33/67] 10.222.0.20 () {60 vars in 1285 bytes} [Sat Apr 16 20:59:29 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 20:59:29.129710 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi [None req-a517ae95-f25a-4b42-8a9d-6ce92bc164a4 admin admin] Calling method '>' {{(pid=121815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 20:59:29.137486 ncdv-master-1 devstack@n-api.service[121815]: INFO nova.api.openstack.requestlog [None req-a517ae95-f25a-4b42-8a9d-6ce92bc164a4 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011188 Apr 16 20:59:29.138013 ncdv-master-1 devstack@n-api.service[121815]: [pid: 121815|app: 0|req: 35/68] 10.222.0.20 () {60 vars in 1282 bytes} [Sat Apr 16 20:59:29 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:01:20.135763 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi [None req-d3ed84a8-be6d-4528-a638-0c29760873d0 tempest-verify_tempest_config-37118724 tempest-verify_tempest_config-37118724-project] Calling method '>' {{(pid=121814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:01:20.137769 ncdv-master-1 devstack@n-api.service[121814]: INFO nova.api.openstack.requestlog [None req-d3ed84a8-be6d-4528-a638-0c29760873d0 tempest-verify_tempest_config-37118724 tempest-verify_tempest_config-37118724-project] 10.222.0.20 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.107994 Apr 16 21:01:20.138286 ncdv-master-1 devstack@n-api.service[121814]: [pid: 121814|app: 0|req: 34/69] 10.222.0.20 () {58 vars in 1133 bytes} [Sat Apr 16 21:01:20 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:05:21.044868 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi [None req-a517ae95-f25a-4b42-8a9d-6ce92bc164a4 admin admin] Calling method '>' {{(pid=121815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:05:21.045876 ncdv-master-1 devstack@n-api.service[121815]: INFO nova.api.openstack.requestlog [None req-a517ae95-f25a-4b42-8a9d-6ce92bc164a4 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Apr 16 21:05:21.046265 ncdv-master-1 devstack@n-api.service[121815]: [pid: 121815|app: 0|req: 36/70] 10.222.0.20 () {56 vars in 1074 bytes} [Sat Apr 16 21:05:21 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:05:21.301254 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi [None req-6e7d1378-e4d7-4c6d-9cbb-a09454a5bd6a admin admin] Calling method '>' {{(pid=121814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:05:21.302504 ncdv-master-1 devstack@n-api.service[121814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:05:21.302504 ncdv-master-1 devstack@n-api.service[121814]: warnings.warn(msg) Apr 16 21:05:21.303706 ncdv-master-1 devstack@n-api.service[121814]: DEBUG oslo_concurrency.lockutils [None req-6e7d1378-e4d7-4c6d-9cbb-a09454a5bd6a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:05:21.304156 ncdv-master-1 devstack@n-api.service[121814]: DEBUG oslo_concurrency.lockutils [None req-6e7d1378-e4d7-4c6d-9cbb-a09454a5bd6a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:05:21.304968 ncdv-master-1 devstack@n-api.service[121814]: DEBUG oslo_concurrency.lockutils [None req-6e7d1378-e4d7-4c6d-9cbb-a09454a5bd6a admin admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:05:21.305956 ncdv-master-1 devstack@n-api.service[121814]: DEBUG oslo_concurrency.lockutils [None req-6e7d1378-e4d7-4c6d-9cbb-a09454a5bd6a admin admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:05:21.345756 ncdv-master-1 devstack@n-api.service[121814]: INFO nova.api.openstack.requestlog [None req-6e7d1378-e4d7-4c6d-9cbb-a09454a5bd6a admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.156529 Apr 16 21:05:21.346317 ncdv-master-1 devstack@n-api.service[121814]: [pid: 121814|app: 0|req: 35/71] 10.222.0.20 () {60 vars in 1193 bytes} [Sat Apr 16 21:05:21 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:05:22.681324 ncdv-master-1 devstack@n-api.service[121815]: DEBUG nova.api.openstack.wsgi [None req-a517ae95-f25a-4b42-8a9d-6ce92bc164a4 admin admin] Calling method '>' {{(pid=121815) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:05:22.682850 ncdv-master-1 devstack@n-api.service[121815]: INFO nova.api.openstack.requestlog [None req-a517ae95-f25a-4b42-8a9d-6ce92bc164a4 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002186 Apr 16 21:05:22.682850 ncdv-master-1 devstack@n-api.service[121815]: [pid: 121815|app: 0|req: 37/72] 10.222.0.20 () {56 vars in 1074 bytes} [Sat Apr 16 21:05:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:05:22.879679 ncdv-master-1 devstack@n-api.service[121814]: DEBUG nova.api.openstack.wsgi [None req-04bf128f-1a1b-4987-85b9-33479cbad86f admin admin] Calling method '>' {{(pid=121814) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:05:22.880890 ncdv-master-1 devstack@n-api.service[121814]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:05:22.880890 ncdv-master-1 devstack@n-api.service[121814]: warnings.warn(msg) Apr 16 21:05:22.882657 ncdv-master-1 devstack@n-api.service[121814]: DEBUG oslo_concurrency.lockutils [None req-04bf128f-1a1b-4987-85b9-33479cbad86f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:05:22.883100 ncdv-master-1 devstack@n-api.service[121814]: DEBUG oslo_concurrency.lockutils [None req-04bf128f-1a1b-4987-85b9-33479cbad86f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:05:22.883891 ncdv-master-1 devstack@n-api.service[121814]: DEBUG oslo_concurrency.lockutils [None req-04bf128f-1a1b-4987-85b9-33479cbad86f admin admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:05:22.884352 ncdv-master-1 devstack@n-api.service[121814]: DEBUG oslo_concurrency.lockutils [None req-04bf128f-1a1b-4987-85b9-33479cbad86f admin admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121814) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:05:22.905899 ncdv-master-1 devstack@n-api.service[121814]: INFO nova.api.openstack.requestlog [None req-04bf128f-1a1b-4987-85b9-33479cbad86f admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.90 time: 0.077534 Apr 16 21:05:22.906378 ncdv-master-1 devstack@n-api.service[121814]: [pid: 121814|app: 0|req: 36/73] 10.222.0.20 () {60 vars in 1193 bytes} [Sat Apr 16 21:05:22 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:06:11.282877 ncdv-master-1 devstack@n-api.service[121813]: Sat Apr 16 21:06:11 2022 - graceful shutdown triggered... Apr 16 21:06:11.283032 ncdv-master-1 systemd[1]: Stopping Devstack devstack@n-api.service... Apr 16 21:06:11.283895 ncdv-master-1 devstack@n-api.service[121814]: Gracefully killing worker 1 (pid: 121814)... Apr 16 21:06:11.284323 ncdv-master-1 devstack@n-api.service[121815]: Gracefully killing worker 2 (pid: 121815)... Apr 16 21:06:12.284263 ncdv-master-1 devstack@n-api.service[121813]: worker 1 buried after 1 seconds Apr 16 21:06:12.284263 ncdv-master-1 devstack@n-api.service[121813]: worker 2 buried after 1 seconds Apr 16 21:06:12.284263 ncdv-master-1 devstack@n-api.service[121813]: goodbye to uWSGI. Apr 16 21:06:12.285803 ncdv-master-1 systemd[1]: devstack@n-api.service: Succeeded. Apr 16 21:06:12.286368 ncdv-master-1 systemd[1]: Stopped Devstack devstack@n-api.service. Apr 16 21:06:12.289266 ncdv-master-1 systemd[1]: Starting Devstack devstack@n-api.service... Apr 16 21:06:12.340207 ncdv-master-1 devstack@n-api.service[137396]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 16 21:06:12.342557 ncdv-master-1 devstack@n-api.service[137396]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Apr 16 21:06:12 2022] *** Apr 16 21:06:12.342557 ncdv-master-1 devstack@n-api.service[137396]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 16 21:06:12.342557 ncdv-master-1 devstack@n-api.service[137396]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 16 21:06:12.342557 ncdv-master-1 devstack@n-api.service[137396]: nodename: ncdv-master-1 Apr 16 21:06:12.342557 ncdv-master-1 devstack@n-api.service[137396]: machine: x86_64 Apr 16 21:06:12.342557 ncdv-master-1 devstack@n-api.service[137396]: clock source: unix Apr 16 21:06:12.342557 ncdv-master-1 devstack@n-api.service[137396]: pcre jit disabled Apr 16 21:06:12.342557 ncdv-master-1 devstack@n-api.service[137396]: detected number of CPU cores: 4 Apr 16 21:06:12.342557 ncdv-master-1 devstack@n-api.service[137396]: current working directory: / Apr 16 21:06:12.342557 ncdv-master-1 devstack@n-api.service[137396]: detected binary path: /usr/bin/uwsgi-core Apr 16 21:06:12.342557 ncdv-master-1 devstack@n-api.service[137396]: your processes number limit is 47680 Apr 16 21:06:12.342557 ncdv-master-1 devstack@n-api.service[137396]: your memory page size is 4096 bytes Apr 16 21:06:12.342557 ncdv-master-1 devstack@n-api.service[137396]: detected max file descriptor number: 2048 Apr 16 21:06:12.342557 ncdv-master-1 devstack@n-api.service[137396]: lock engine: pthread robust mutexes Apr 16 21:06:12.343615 ncdv-master-1 devstack@n-api.service[137396]: thunder lock: enabled Apr 16 21:06:12.343615 ncdv-master-1 devstack@n-api.service[137396]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 16 21:06:12.343615 ncdv-master-1 devstack@n-api.service[137396]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 16 21:06:12.397801 ncdv-master-1 devstack@n-api.service[137396]: Python main interpreter initialized at 0x5582f5dc39c0 Apr 16 21:06:12.397801 ncdv-master-1 devstack@n-api.service[137396]: python threads support enabled Apr 16 21:06:12.397801 ncdv-master-1 devstack@n-api.service[137396]: your server socket listen backlog is limited to 100 connections Apr 16 21:06:12.397801 ncdv-master-1 devstack@n-api.service[137396]: your mercy for graceful operations on workers is 90 seconds Apr 16 21:06:12.398248 ncdv-master-1 devstack@n-api.service[137396]: mapped 403077 bytes (393 KB) for 2 cores Apr 16 21:06:12.398409 ncdv-master-1 devstack@n-api.service[137396]: *** Operational MODE: preforking *** Apr 16 21:06:12.398673 ncdv-master-1 devstack@n-api.service[137396]: *** uWSGI is running in multiple interpreter mode *** Apr 16 21:06:12.398673 ncdv-master-1 devstack@n-api.service[137396]: spawned uWSGI master process (pid: 137396) Apr 16 21:06:12.398876 ncdv-master-1 systemd[1]: Started Devstack devstack@n-api.service. Apr 16 21:06:12.400218 ncdv-master-1 devstack@n-api.service[137396]: spawned uWSGI worker 1 (pid: 137408, cores: 1) Apr 16 21:06:12.400218 ncdv-master-1 devstack@n-api.service[137396]: spawned uWSGI worker 2 (pid: 137409, cores: 1) Apr 16 21:06:12.400218 ncdv-master-1 devstack@n-api.service[137396]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 16 21:06:13.695768 ncdv-master-1 devstack@n-api.service[137408]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 16 21:06:13.742129 ncdv-master-1 devstack@n-api.service[137409]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 16 21:06:14.612696 ncdv-master-1 devstack@n-api.service[137408]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 16 21:06:14.612696 ncdv-master-1 devstack@n-api.service[137408]: from cryptography.utils import int_from_bytes Apr 16 21:06:14.613165 ncdv-master-1 devstack@n-api.service[137408]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 16 21:06:14.613165 ncdv-master-1 devstack@n-api.service[137408]: from cryptography.utils import int_from_bytes Apr 16 21:06:14.665970 ncdv-master-1 devstack@n-api.service[137409]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 16 21:06:14.665970 ncdv-master-1 devstack@n-api.service[137409]: from cryptography.utils import int_from_bytes Apr 16 21:06:14.666301 ncdv-master-1 devstack@n-api.service[137409]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 16 21:06:14.666301 ncdv-master-1 devstack@n-api.service[137409]: from cryptography.utils import int_from_bytes Apr 16 21:06:17.019342 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 16 21:06:17.019881 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 16 21:06:17.020038 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 16 21:06:17.020428 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 16 21:06:17.020687 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 16 21:06:17.021089 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.021420 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.021746 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.022067 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.022401 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.022712 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.023035 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.023356 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.023686 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.023950 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.024297 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.024624 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.024947 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.025257 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.025570 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.025893 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.026195 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.026521 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.027437 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.027949 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.028405 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.028718 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.029031 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.029397 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.029700 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.030011 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.030336 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.030647 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.030974 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.031293 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.031695 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.032013 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.032455 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.032671 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.033084 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.033397 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.033707 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.034027 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.034351 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.034662 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.034991 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.035313 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.035635 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.035960 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.036291 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.036609 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.036917 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.037239 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.037546 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.037855 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.038110 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.038421 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.038746 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.039603 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.039603 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.039993 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.039993 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.040323 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.040525 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.040844 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.041160 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.041467 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.041779 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.042353 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.042696 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.042995 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.043304 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.043803 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.044130 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.044482 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.044798 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.045122 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.045526 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.045781 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.046096 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.046437 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.046760 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.047070 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.047393 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.047718 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.048029 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.048365 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.048677 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.048996 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.049350 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.049640 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.049894 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.050201 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.050509 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.050831 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.051145 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.051455 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.051762 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.052064 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.052397 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.052708 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.053016 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.053326 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.053636 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.053939 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.054247 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.054552 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.054858 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.055180 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.055501 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.055811 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.056122 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.056454 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.056766 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.057088 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.057396 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.057704 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.058053 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.058362 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.058667 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.059007 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.059169 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 16 21:06:17.059608 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 16 21:06:17.059707 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.059707 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.059880 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 16 21:06:17.059982 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.060144 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 16 21:06:17.060310 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.060438 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 16 21:06:17.060545 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.060812 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.060900 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.061126 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.061221 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.061434 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.061536 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.061739 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.061837 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.062044 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.062149 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.062349 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.062440 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.062654 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.062745 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.062956 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.063047 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.063261 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.063352 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.063560 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.063683 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.063881 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.063990 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.064295 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.064427 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] console_host = ncdv-master-1 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.064612 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.064712 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.064922 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.065027 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.065229 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.065328 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.065550 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.065641 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.065869 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.065966 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.066210 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.066320 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.066510 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.066610 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.066865 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.067033 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.067191 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.067339 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.067526 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.067629 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.067850 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.068009 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.068152 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.068309 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.068540 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.068635 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.068873 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.068973 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.069136 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.069224 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.069452 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.069533 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.069770 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.069854 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.070096 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.070176 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.070418 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.070508 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] host = ncdv-master-1 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.070753 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.070835 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.071077 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.071169 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.071396 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.071478 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.071719 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.071813 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.072034 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.072123 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.072380 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.076294 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.076294 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.076496 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.076575 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.076658 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.076755 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.076836 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.076908 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.077005 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.077077 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.077161 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.077232 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.077301 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.077378 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.077449 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.077528 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.077613 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.077685 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.077763 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.077835 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.077913 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.077991 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.078075 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.078152 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.078231 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.078301 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.078378 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.078448 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.078531 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.078610 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.078691 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.078769 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.078840 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.078919 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.078998 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.079069 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.079146 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.079217 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.079722 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.079891 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.080045 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.080289 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.080449 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.080600 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.080760 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.080902 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.081045 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.081198 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.081346 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.081494 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.081644 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.081793 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.081933 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.082080 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.082221 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.082360 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.082745 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.082902 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.083059 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.083220 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.083369 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.083510 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.083510 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.083510 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.084044 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.084224 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.084456 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.084704 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.084861 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.085011 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.085155 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.085307 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.085461 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.085610 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.085759 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.085907 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.085907 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.086181 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.086181 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.086456 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.086597 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.086736 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.086736 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.087008 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.087157 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.087320 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.087462 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.087601 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.087739 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.087879 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.088100 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.088279 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.088431 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.088572 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.088719 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.088898 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.089061 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.089250 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.090035 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.090188 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.090338 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.090498 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.090640 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.090786 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.090936 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.091078 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.091225 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.091375 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.091524 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.091685 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.091845 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.091994 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.092143 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.092323 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.092323 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.092647 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.092979 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.093129 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.093270 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.093410 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.093560 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.093708 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.093708 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.094081 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.094234 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.094383 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.094539 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.094708 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.094923 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.095078 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.095227 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.095368 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.095518 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.095660 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.095801 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.095940 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.096091 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.096364 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.096513 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.096653 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.096802 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.096943 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.097093 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.097248 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.097397 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.097545 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.097693 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.097835 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.097975 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.098135 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.098284 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.098425 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.098574 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.098723 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.098864 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.099015 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.099162 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.099312 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.099462 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.099603 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.099749 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.099900 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.100041 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.100210 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.100358 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.100510 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.100659 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.100807 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.100949 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.101098 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.101254 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.101395 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.101535 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.101674 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.101830 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.101987 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.102130 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.102270 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.102409 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.102556 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.102705 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.103097 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.103260 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.103402 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.103541 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.103681 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.103837 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.103989 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.104247 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.104410 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.104553 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.104694 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.104851 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.105075 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.105223 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.105374 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.105515 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.105655 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.105804 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.105954 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.106116 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.106276 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.106535 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.106691 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.106842 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.106990 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 16 21:06:17.107143 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.107285 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.107425 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.107574 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.107729 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.107871 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.108010 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.108187 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.108373 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.108525 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.108675 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.108675 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.108951 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.109098 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.109247 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.109398 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.109547 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.109695 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.109844 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.110001 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.110143 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.110292 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.110434 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.110625 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.110775 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.110931 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.111157 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.111307 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.111458 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.111599 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.112118 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.112290 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.112463 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.112614 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.112757 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.112903 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.113291 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.113450 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.113609 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.113759 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.113902 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.114042 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.114208 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.114425 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.114589 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.114764 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.114911 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.115077 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.115077 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.115438 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.115588 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.115732 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.115881 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.116022 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.116203 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.116373 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.116540 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.116770 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.116924 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.117066 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.117214 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.117364 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.117513 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.117661 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.117803 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.117951 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.118099 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.118253 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.118395 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.118395 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.118679 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.118822 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.118962 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.119111 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.119260 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.119409 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.119557 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.119698 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.119854 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.120003 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.120153 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.120332 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.120485 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.121146 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.121303 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.121445 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.121584 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.121724 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.121864 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.122005 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.122159 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.122309 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.122451 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.122591 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.122731 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.122871 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.123032 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.123401 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.123558 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.123700 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.123849 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.123999 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.124149 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.124355 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.124507 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.124647 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.124802 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.124955 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.125116 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.125274 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.125274 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.125624 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.125774 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.125925 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.126077 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.126228 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.126368 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.126508 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.126656 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.126887 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.127035 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.127188 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.127336 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.127485 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.127639 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.127790 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.127981 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.128136 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.128324 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.128469 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.128623 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.128765 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.128905 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.129051 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.129210 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.129361 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.129361 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.129643 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.129783 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.129921 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.130060 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.130207 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.130358 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.130499 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.130639 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.130786 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.130935 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.131105 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.131247 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.131395 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.131543 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.131701 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.131842 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.131990 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.132131 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.132339 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.132484 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.132633 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.132773 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.132924 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.133073 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.133214 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.133569 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.133727 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.133886 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.134038 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.134179 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.134318 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.134468 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.134610 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.134610 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.135062 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.135226 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.135368 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.135541 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.135785 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.135935 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.136087 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.136876 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.137095 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.137260 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.137418 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.137573 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.137723 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.137878 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.138046 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.138202 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.138350 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.138504 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.138660 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.138808 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.138964 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.139112 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.139258 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.139404 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.139559 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.139706 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.139883 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.140073 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.140253 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.140409 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.140568 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.140724 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.140949 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.141100 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.141299 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.141463 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.141620 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.141783 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.141941 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.142108 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.142265 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.142413 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.142568 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.142737 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.142737 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.143042 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.143198 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.143346 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.143710 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.143875 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.144024 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.144196 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.144363 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.144523 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.144671 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.144828 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.144995 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.145158 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.145306 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.145453 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.145613 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.145780 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.146109 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.146109 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.146436 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.146604 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.146768 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.146916 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.147082 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.147307 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.147460 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.147619 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.147777 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.147932 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.148129 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.148305 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.148465 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.148621 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.148790 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.148940 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.149096 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.149255 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.149403 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.149559 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.149559 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.149886 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.150034 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.150182 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.150330 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.150486 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.150652 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.150809 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.150957 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.151112 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.151267 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.151425 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.151582 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.151730 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.151876 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.152031 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.152234 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.152405 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.152555 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.152722 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.152870 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.153025 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.153181 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.153345 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.153539 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.153900 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.154057 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.154213 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.154371 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.154529 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.154676 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.154837 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.155002 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.155150 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.155306 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.155463 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.155618 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.155766 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.155919 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.155919 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.156320 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.156476 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.156626 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.156781 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.156937 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.157095 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.157256 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.157497 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.157657 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.157806 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.157953 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.158110 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.158259 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.158405 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.158551 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.158698 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.158859 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.159040 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.159315 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.159492 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.159492 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.159788 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.159943 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.160101 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.160101 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.160544 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.160702 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.160852 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.161006 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.161167 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.161333 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.161481 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.161637 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.161787 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.161948 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.162096 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.162250 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.162398 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.162545 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.162691 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.162848 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.162996 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.163144 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.163308 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.163456 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.163603 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.164012 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.164187 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.164344 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.164506 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.164655 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.164801 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.164981 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.165130 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.165277 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.165431 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.165597 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.165759 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.165908 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.166064 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.166212 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.166445 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.166606 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.166764 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.166764 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.167304 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.167451 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.167686 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.167838 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.168009 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.168194 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.168362 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.168510 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.168665 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.168819 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.168977 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.169125 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.169273 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.169419 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.169574 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.169734 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.169885 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.170055 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.170205 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.170352 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.170499 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.170653 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.170809 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.170957 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.171112 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.171260 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.171407 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.171630 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.171630 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.171933 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.172093 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.172265 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.172416 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.172575 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.172729 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.172877 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.173029 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.173183 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.173346 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.173496 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.173642 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.173790 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.173966 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.174329 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.174494 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.174644 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.174790 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.174947 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.175102 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.175257 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.175421 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.175570 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.175726 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.175874 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.176020 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.176020 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.176373 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.176619 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.176781 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.176929 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.177084 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.177299 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.177470 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.177627 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.177863 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.178025 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.178175 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.178341 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.178525 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.178684 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.178833 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.178993 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.179170 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.179355 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.179504 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.179659 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.179808 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.179968 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.180116 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.180301 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.180301 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.180606 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.180606 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.180910 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.181058 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.181212 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.181368 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.181515 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.181678 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.181834 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.181990 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.182146 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.182301 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.182458 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.182615 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.182772 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.182930 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.183584 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.183734 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.183897 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.184053 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.184489 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.184791 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.184963 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.185115 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.185278 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.185439 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.185595 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.185751 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.185908 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.186064 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.186227 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.186377 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.186533 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.186770 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.186935 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.187096 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.187254 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.187424 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.187581 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.187731 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.187893 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.188123 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.188310 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.188461 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.188616 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.188616 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.188940 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.189097 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.189246 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.189246 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.189535 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.189691 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.189838 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.189998 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.190148 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.190303 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.190458 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.190613 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.190761 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.190917 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.191071 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.191228 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.191383 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.191549 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.191706 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.191854 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.192007 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.192205 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.192411 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.192572 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.192731 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.192889 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.193037 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.193184 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.193338 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.193487 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.193656 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.193805 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.193959 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.194115 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.194263 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.194623 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.194799 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.194953 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.195108 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.195256 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.195412 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.195575 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.195734 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.195881 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.196034 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.196209 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.196366 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.196366 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.196668 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.196900 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.197070 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.197226 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.197382 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.197540 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.197696 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.197854 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.198008 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.198238 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.198400 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.198564 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.199297 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.199457 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.199615 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.199763 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.199920 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.200068 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.200068 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.200404 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.200404 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.200699 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.200699 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.200998 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.200998 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.201287 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.201443 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.201598 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.201826 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.201985 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.202140 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.202287 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.202442 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.202609 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.202772 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.202920 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.203075 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.203222 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.203368 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.203529 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.203677 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.203834 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.203982 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.204137 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.204332 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.204725 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.204900 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.205054 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.205054 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.205345 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.205499 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.205659 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.205807 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.205955 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.205955 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.206233 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.206387 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.206549 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.206549 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.206844 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.207078 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.207232 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.207389 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.207546 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.207694 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.207840 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.207996 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.208153 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.208455 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.208614 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.208771 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.208939 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.209096 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.209254 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.209409 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.209565 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.209715 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.209869 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.210026 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.210181 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.210329 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.210476 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.210630 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.210778 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.210948 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.211098 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.211252 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.211400 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.211555 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.211710 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.211867 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.212023 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.212198 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.212364 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.212513 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.212659 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.212826 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.212826 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.213107 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.213263 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.213410 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.213569 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.213725 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.213881 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.214029 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.214029 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.214357 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.214517 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.215458 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.215635 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.215793 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.215951 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.216099 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.216307 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.216458 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.216607 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.216762 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.216910 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.217077 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.217314 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.217471 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.217621 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.217787 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.217944 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.218108 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.218257 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.218492 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.218648 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.218803 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.218952 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.219108 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.219265 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.219412 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.219569 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.219569 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.219871 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.219871 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.221299 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.221455 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.221606 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.221755 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.221918 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.222068 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.222225 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.222374 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.222374 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.222673 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.222836 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.222987 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.223134 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.223289 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.223443 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.223592 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.223750 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.223898 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.224045 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.225729 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.225909 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.226087 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.226258 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.226428 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.226581 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.226739 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.226896 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.227125 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.227296 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.227521 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.227682 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.227833 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.227988 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.228146 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.228357 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.228526 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.228746 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.228901 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.229058 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.229207 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.229363 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.229519 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.229519 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.229808 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.230001 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.230153 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.230300 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.230300 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.230600 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.230747 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.230907 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.231057 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.231203 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.231203 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.231499 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.231658 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.231817 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.232093 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.232263 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.248434 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.248434 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.248647 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.248727 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.248727 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.248727 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.248727 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.248727 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.249047 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.249135 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.249225 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.249306 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.249306 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.249435 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.249519 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.249598 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.249669 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.249738 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.249738 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.249913 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.249994 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.250073 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.250147 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.250225 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.250304 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.250390 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.250465 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.250543 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.250617 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.250695 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.250773 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.250853 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.250932 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.251011 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.251085 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.251156 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.251233 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.251313 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.251386 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.251464 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.251542 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.251620 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.251707 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.251781 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.251859 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.251932 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.252009 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.252087 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.252203 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.252282 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.252365 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.252438 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.252509 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.252578 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.252658 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.252738 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.252818 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.252897 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.252969 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.253054 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.253054 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.253054 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.253054 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.253315 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.253393 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.253393 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.253540 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.253613 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.253684 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.253762 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.253834 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.253916 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.253989 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.254058 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.254146 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.254225 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.254304 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.254385 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.254463 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.254541 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.254619 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.254692 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.254692 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.254836 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.254916 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.255006 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.255089 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.255168 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.255248 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.255323 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.255400 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.255473 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.255556 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.255636 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.255720 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.255793 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.255869 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.255948 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.256019 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.256104 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.259489 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.259655 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.259817 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.259817 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.260114 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.260293 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.260464 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.260614 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.260769 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.260918 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.261074 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.261872 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.261872 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.262381 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.262544 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.262707 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.262857 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.263016 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.263173 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.263173 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.263473 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.263633 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.263832 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.264041 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.264212 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.264382 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.264533 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.264688 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.264975 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.265146 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.265307 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.265456 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.265456 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.265456 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.265456 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.265456 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.266173 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.266323 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.266479 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.266637 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.266806 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.266963 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.267112 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.267266 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.267416 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.267572 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.267736 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.267894 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.268050 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.272735 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.272858 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.272958 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.273044 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.273124 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.273198 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.273269 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.273347 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.273429 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.273429 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.273576 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.273669 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.273743 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.273743 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.273886 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.273960 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.274030 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.274100 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.274169 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.274317 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.274399 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.274399 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.274538 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.274616 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.274688 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.274768 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.274840 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.274911 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.274982 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.275059 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.275059 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.275059 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.275272 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.275343 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.275422 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.275494 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.275571 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.275656 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.275729 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.275808 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.275880 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.275950 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.276043 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.276125 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.276125 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.276291 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.276372 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.276444 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.276522 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.276595 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.276671 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.276776 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.276860 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.276933 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.277011 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.277084 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.277160 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.277239 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.277319 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.277398 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.277483 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.277483 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.277611 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.277681 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.277758 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.277909 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.277985 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.278064 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.278064 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.278192 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.278262 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.278341 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.278414 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.278484 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.278560 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.278646 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.281580 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.281753 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.281912 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.282072 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.282247 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.282421 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.282622 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.282774 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.282923 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.282923 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.283206 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.283354 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.283354 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.283696 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.283848 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.283997 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.284157 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.284157 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.284502 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.284695 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.284947 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.285106 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.285265 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.285414 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.285573 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.285730 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.285879 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.286027 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.287110 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.289413 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.289584 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.289767 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.289926 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.290090 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.290241 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.290392 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.290549 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.290701 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.292856 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.293047 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.293222 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.293383 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.293383 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.293383 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.293826 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.293987 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.294145 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.294306 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.294457 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.294606 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.294765 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.294931 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.295093 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.295244 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.295393 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.295550 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.295807 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.295964 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.295964 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.295964 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.296310 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.301549 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.301697 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.301896 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.302005 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.302101 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.302101 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.302283 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.302382 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.302382 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.302554 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.302648 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.302747 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.302832 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.302832 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.302984 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.303074 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.303160 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.303246 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.303341 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.303427 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.303427 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.303581 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.303662 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.303752 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.303835 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.303909 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.303988 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.304070 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.304144 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.304251 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.304328 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.304407 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.304489 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.304570 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.304651 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.304724 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.304795 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=137408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 16 21:06:17.304874 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.304874 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.304874 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.304874 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.304874 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.304874 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.304874 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.304874 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.305359 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.305359 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.305359 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.305359 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.305359 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.305359 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.305359 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.305359 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.305884 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.305884 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.305884 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.305884 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.305884 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.305884 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.305884 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.305884 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.306405 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.306405 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.306405 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.306405 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.306405 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.306405 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.306405 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.306405 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.306913 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.306913 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.306913 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.306913 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.306913 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.306913 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.306913 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.306913 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.307542 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.307542 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.307542 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.307542 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.307542 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.307542 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.307542 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.307542 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.308612 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.308612 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.308612 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.308612 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.308612 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.308612 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.308612 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.308612 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.309135 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.309135 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.309135 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.309135 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.309135 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.309135 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.309135 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.309614 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.309784 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.310098 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.310419 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.310741 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.311063 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.311384 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.311704 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.312021 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.312393 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.312715 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.313039 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.313390 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.313646 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_db.sqlalchemy.engines [None req-6164d0d7-a23d-4c76-9994-b2b6db1857cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 16 21:06:17.313750 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.314035 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.314360 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.314686 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.315007 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.315326 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.315645 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.315963 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.316317 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.316656 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.317060 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.317295 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.317732 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.318053 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.318383 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.318715 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.319030 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.319361 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.319692 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.320011 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.320366 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.320688 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.321024 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.321377 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.321718 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.322052 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.322373 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.322687 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.323000 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.323317 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.323697 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.324527 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.324841 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.325153 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.325471 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.325850 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.326094 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.326399 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.327308 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.327308 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.328137 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.328477 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.332818 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.332818 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.332818 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.332818 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.332818 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.332818 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.332818 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.332818 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.335747 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.335747 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.335747 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.335747 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.335747 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.335747 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.335747 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.335747 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.336564 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.336564 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.336564 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.336564 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.336564 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.336564 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.336564 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.336564 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.337534 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.337534 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.337534 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.337534 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.338218 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.338218 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.338379 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.338568 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.338896 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.339249 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.339585 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.339903 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.340266 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.340593 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.340913 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.341238 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.341580 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.341878 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.342205 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.342538 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.342874 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.343210 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.343550 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.343888 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.344280 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.344607 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.344966 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.345306 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.345628 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.345949 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.346263 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 16 21:06:17.346517 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=137409) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 16 21:06:17.369783 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_db.sqlalchemy.engines [None req-01d2d0f7-7448-48ff-9418-7e1a0bb6ddce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 16 21:06:17.380111 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.context [None req-6164d0d7-a23d-4c76-9994-b2b6db1857cd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) {{(pid=137408) load_cells /opt/stack/nova/nova/context.py:464}} Apr 16 21:06:17.384567 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6164d0d7-a23d-4c76-9994-b2b6db1857cd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:06:17.387052 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6164d0d7-a23d-4c76-9994-b2b6db1857cd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:06:17.387893 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6164d0d7-a23d-4c76-9994-b2b6db1857cd None None] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:06:17.389879 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6164d0d7-a23d-4c76-9994-b2b6db1857cd None None] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:06:17.403061 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_db.sqlalchemy.engines [None req-6164d0d7-a23d-4c76-9994-b2b6db1857cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 16 21:06:17.404126 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_db.sqlalchemy.engines [None req-6164d0d7-a23d-4c76-9994-b2b6db1857cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 16 21:06:17.435706 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.context [None req-01d2d0f7-7448-48ff-9418-7e1a0bb6ddce None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) {{(pid=137409) load_cells /opt/stack/nova/nova/context.py:464}} Apr 16 21:06:17.440254 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-01d2d0f7-7448-48ff-9418-7e1a0bb6ddce None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:06:17.442269 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-01d2d0f7-7448-48ff-9418-7e1a0bb6ddce None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:06:17.443201 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-01d2d0f7-7448-48ff-9418-7e1a0bb6ddce None None] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:06:17.445105 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-01d2d0f7-7448-48ff-9418-7e1a0bb6ddce None None] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:06:17.457889 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_db.sqlalchemy.engines [None req-01d2d0f7-7448-48ff-9418-7e1a0bb6ddce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 16 21:06:17.459708 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_db.sqlalchemy.engines [None req-01d2d0f7-7448-48ff-9418-7e1a0bb6ddce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 16 21:06:17.568819 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_db.sqlalchemy.engines [None req-6164d0d7-a23d-4c76-9994-b2b6db1857cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 16 21:06:17.623394 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_db.sqlalchemy.engines [None req-01d2d0f7-7448-48ff-9418-7e1a0bb6ddce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=137409) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 16 21:06:18.005804 ncdv-master-1 devstack@n-api.service[137408]: WARNING keystonemiddleware.auth_token [None req-6164d0d7-a23d-4c76-9994-b2b6db1857cd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 16 21:06:18.012933 ncdv-master-1 devstack@n-api.service[137408]: WARNING keystonemiddleware.auth_token [None req-6164d0d7-a23d-4c76-9994-b2b6db1857cd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 16 21:06:18.057509 ncdv-master-1 devstack@n-api.service[137409]: WARNING keystonemiddleware.auth_token [None req-01d2d0f7-7448-48ff-9418-7e1a0bb6ddce None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 16 21:06:18.064505 ncdv-master-1 devstack@n-api.service[137409]: WARNING keystonemiddleware.auth_token [None req-01d2d0f7-7448-48ff-9418-7e1a0bb6ddce None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 16 21:06:18.237315 ncdv-master-1 devstack@n-api.service[137408]: WARNING keystonemiddleware.auth_token [None req-6164d0d7-a23d-4c76-9994-b2b6db1857cd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 16 21:06:18.242530 ncdv-master-1 devstack@n-api.service[137408]: WARNING keystonemiddleware.auth_token [None req-6164d0d7-a23d-4c76-9994-b2b6db1857cd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 16 21:06:18.248489 ncdv-master-1 devstack@n-api.service[137408]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5582f5dc39c0 pid: 137408 (default app) Apr 16 21:06:18.289056 ncdv-master-1 devstack@n-api.service[137409]: WARNING keystonemiddleware.auth_token [None req-01d2d0f7-7448-48ff-9418-7e1a0bb6ddce None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 16 21:06:18.295031 ncdv-master-1 devstack@n-api.service[137409]: WARNING keystonemiddleware.auth_token [None req-01d2d0f7-7448-48ff-9418-7e1a0bb6ddce None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 16 21:06:18.300494 ncdv-master-1 devstack@n-api.service[137409]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5582f5dc39c0 pid: 137409 (default app) Apr 16 21:07:07.438822 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e47b4c7f-ec11-4107-b574-2a8932dd92f3 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:07.441380 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:07.441380 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:07.453647 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e47b4c7f-ec11-4107-b574-2a8932dd92f3 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:07.454107 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e47b4c7f-ec11-4107-b574-2a8932dd92f3 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:07.454918 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e47b4c7f-ec11-4107-b574-2a8932dd92f3 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:07.455357 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e47b4c7f-ec11-4107-b574-2a8932dd92f3 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:07.504997 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e47b4c7f-ec11-4107-b574-2a8932dd92f3 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 1.415458 Apr 16 21:07:07.514181 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1/1] 10.222.0.20 () {58 vars in 1175 bytes} [Sat Apr 16 21:07:06 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:07.519120 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a6e7730a-06ae-4624-8f52-9558c968311c tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-405685844"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:07.536603 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:07.536603 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:07.537671 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.aggregate [None req-a6e7730a-06ae-4624-8f52-9558c968311c tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Generated uuid 52ca4559-3a2c-43e4-a802-532fa1f62b52 for aggregate {{(pid=137408) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 16 21:07:07.686727 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-18ec5703-248e-4256-9bbe-44704b0a5205 tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-128073149", "id": 2068565000, "os-flavor-access:is_public": "True"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:07.707459 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:07.707459 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:07.719562 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a6e7730a-06ae-4624-8f52-9558c968311c tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.204077 Apr 16 21:07:07.722464 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2/2] 10.222.0.20 () {60 vars in 1163 bytes} [Sat Apr 16 21:07:07 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:07.732409 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-53673c82-f6e3-4fce-941f-bf32ce5fb957 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:07.734265 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:07.734265 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:07.751308 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-53673c82-f6e3-4fce-941f-bf32ce5fb957 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:07.752118 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-53673c82-f6e3-4fce-941f-bf32ce5fb957 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:07.857417 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-18ec5703-248e-4256-9bbe-44704b0a5205 tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 1.546275 Apr 16 21:07:07.858830 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1/3] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:07:06 2022] POST /compute/v2.1/flavors => generated 429 bytes in 1549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:07.871811 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-dba9112c-8117-4e47-b48c-6c51cb55dadf tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:07.872907 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:07.872907 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:08.003201 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-dba9112c-8117-4e47-b48c-6c51cb55dadf tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/2068565000" status: 202 len: 0 microversion: 2.1 time: 0.135757 Apr 16 21:07:08.007580 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1160 bytes} [Sat Apr 16 21:07:07 2022] DELETE /compute/v2.1/flavors/2068565000 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 16 21:07:08.471914 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-339c8d2d-80cf-4f0d-a657-deb8a37cdf5a tempest-AggregatesAdminTestV241-2010896074 tempest-AggregatesAdminTestV241-2010896074-project-admin] Calling method '.version_select at 0x7fbb9ce214c0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:08.473509 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:08.473509 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:08.480220 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-339c8d2d-80cf-4f0d-a657-deb8a37cdf5a tempest-AggregatesAdminTestV241-2010896074 tempest-AggregatesAdminTestV241-2010896074-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) {{(pid=137409) load_cells /opt/stack/nova/nova/compute/api.py:306}} Apr 16 21:07:08.481251 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-339c8d2d-80cf-4f0d-a657-deb8a37cdf5a tempest-AggregatesAdminTestV241-2010896074 tempest-AggregatesAdminTestV241-2010896074-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:08.483590 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-339c8d2d-80cf-4f0d-a657-deb8a37cdf5a tempest-AggregatesAdminTestV241-2010896074 tempest-AggregatesAdminTestV241-2010896074-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:08.540735 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-339c8d2d-80cf-4f0d-a657-deb8a37cdf5a tempest-AggregatesAdminTestV241-2010896074 tempest-AggregatesAdminTestV241-2010896074-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:08.541571 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-339c8d2d-80cf-4f0d-a657-deb8a37cdf5a tempest-AggregatesAdminTestV241-2010896074 tempest-AggregatesAdminTestV241-2010896074-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:08.557991 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-339c8d2d-80cf-4f0d-a657-deb8a37cdf5a tempest-AggregatesAdminTestV241-2010896074 tempest-AggregatesAdminTestV241-2010896074-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:08.558847 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-339c8d2d-80cf-4f0d-a657-deb8a37cdf5a tempest-AggregatesAdminTestV241-2010896074 tempest-AggregatesAdminTestV241-2010896074-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:08.565736 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-339c8d2d-80cf-4f0d-a657-deb8a37cdf5a tempest-AggregatesAdminTestV241-2010896074 tempest-AggregatesAdminTestV241-2010896074-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.556924 Apr 16 21:07:08.572683 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3/5] 10.222.0.20 () {60 vars in 1207 bytes} [Sat Apr 16 21:07:08 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:07:08.584903 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-35f40a73-046b-4f7f-91fb-e7727db5180f tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:08.660377 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-35f40a73-046b-4f7f-91fb-e7727db5180f tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.076870 Apr 16 21:07:08.662355 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 4/6] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:07:08 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:08.919345 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8ec1d561-e564-4227-aad3-7d340ab4736e tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Calling method '.version_select at 0x7fbb9cd0b0d0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:08.919345 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:08.919345 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:08.919345 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8ec1d561-e564-4227-aad3-7d340ab4736e tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:08.919345 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8ec1d561-e564-4227-aad3-7d340ab4736e tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:08.925828 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8ec1d561-e564-4227-aad3-7d340ab4736e tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:08.925828 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8ec1d561-e564-4227-aad3-7d340ab4736e tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:08.938519 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8ec1d561-e564-4227-aad3-7d340ab4736e tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:08.939011 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8ec1d561-e564-4227-aad3-7d340ab4736e tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:08.945900 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8ec1d561-e564-4227-aad3-7d340ab4736e tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.282277 Apr 16 21:07:08.947287 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 5/7] 10.222.0.20 () {58 vars in 1166 bytes} [Sat Apr 16 21:07:08 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:08.992211 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-53673c82-f6e3-4fce-941f-bf32ce5fb957 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 241 microversion: 2.1 time: 1.254922 Apr 16 21:07:08.992211 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3/8] 10.222.0.20 () {60 vars in 1190 bytes} [Sat Apr 16 21:07:07 2022] POST /compute/v2.1/os-aggregates/1/action => generated 241 bytes in 1257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:07:08.994535 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c9780508-cc84-4086-8dd7-db2d9ca6515e tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-945760743", "id": 1569917527, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:08.997034 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:08.997034 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:09.067128 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c59bac42-20e5-4515-86f3-f6625ce9e800 tempest-AZAdminNegativeTestJSON-1216513474 tempest-AZAdminNegativeTestJSON-1216513474-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:09.067889 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:09.067889 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:09.068825 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c59bac42-20e5-4515-86f3-f6625ce9e800 tempest-AZAdminNegativeTestJSON-1216513474 tempest-AZAdminNegativeTestJSON-1216513474-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '39812b98f0dc4c268fbbfba142881a9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '614ffb3ecd5c4b9f99b30980988fc079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:09.069575 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c59bac42-20e5-4515-86f3-f6625ce9e800 tempest-AZAdminNegativeTestJSON-1216513474 tempest-AZAdminNegativeTestJSON-1216513474-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:07:09.070406 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c59bac42-20e5-4515-86f3-f6625ce9e800 tempest-AZAdminNegativeTestJSON-1216513474 tempest-AZAdminNegativeTestJSON-1216513474-project] 10.222.0.20 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.122154 Apr 16 21:07:09.070928 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 6/9] 10.222.0.20 () {58 vars in 1184 bytes} [Sat Apr 16 21:07:08 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 123 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:07:09.123411 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c9780508-cc84-4086-8dd7-db2d9ca6515e tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.137343 Apr 16 21:07:09.123937 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 4/10] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:07:08 2022] POST /compute/v2.1/flavors => generated 416 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:09.128594 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2a1227bb-3642-43e4-860a-7262b85e6e47 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:09.129833 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:09.129833 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:09.138945 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2a1227bb-3642-43e4-860a-7262b85e6e47 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:09.139406 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2a1227bb-3642-43e4-860a-7262b85e6e47 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:09.238718 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-2a1227bb-3642-43e4-860a-7262b85e6e47 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] HTTP exception thrown: Aggregate 1 already has host nch1-master-1. Apr 16 21:07:09.239352 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2a1227bb-3642-43e4-860a-7262b85e6e47 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Returning 409 to user: Aggregate 1 already has host nch1-master-1. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:07:09.240611 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2a1227bb-3642-43e4-860a-7262b85e6e47 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/1/action" status: 409 len: 95 microversion: 2.1 time: 0.115519 Apr 16 21:07:09.241346 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 5/11] 10.222.0.20 () {60 vars in 1190 bytes} [Sat Apr 16 21:07:09 2022] POST /compute/v2.1/os-aggregates/1/action => generated 95 bytes in 117 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Apr 16 21:07:09.246987 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2633a899-819c-4728-9c40-6d5781cd942b tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:09.287266 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2633a899-819c-4728-9c40-6d5781cd942b tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5397 microversion: 2.1 time: 0.044831 Apr 16 21:07:09.287860 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 6/12] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:07:09 2022] GET /compute/v2.1/flavors/detail => generated 5397 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:09.293308 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-26fda246-1fab-450d-867d-f4a53866746b tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:09.295545 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:09.295545 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:09.310419 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-26fda246-1fab-450d-867d-f4a53866746b tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:09.311061 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-26fda246-1fab-450d-867d-f4a53866746b tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:09.409636 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a69b807b-6e3a-4183-ac1e-401bf7b230b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-729262842", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:09.689292 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-26fda246-1fab-450d-867d-f4a53866746b tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 226 microversion: 2.1 time: 0.400111 Apr 16 21:07:09.696371 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 7/13] 10.222.0.20 () {60 vars in 1190 bytes} [Sat Apr 16 21:07:09 2022] POST /compute/v2.1/os-aggregates/1/action => generated 226 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:09.699659 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-62c44dfc-aac1-406f-ad46-9882c1150e4f tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:09.700549 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:09.700549 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:09.814869 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-62c44dfc-aac1-406f-ad46-9882c1150e4f tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1569917527" status: 202 len: 0 microversion: 2.1 time: 0.123836 Apr 16 21:07:09.815847 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 8/14] 10.222.0.20 () {58 vars in 1160 bytes} [Sat Apr 16 21:07:09 2022] DELETE /compute/v2.1/flavors/1569917527 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:07:09.822707 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5c1a20c5-04b5-4a1a-8d0b-e3e7dbbf8bf1 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:09.823894 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:09.823894 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:09.934515 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5c1a20c5-04b5-4a1a-8d0b-e3e7dbbf8bf1 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.1 time: 0.117836 Apr 16 21:07:09.935856 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 9/15] 10.222.0.20 () {58 vars in 1151 bytes} [Sat Apr 16 21:07:09 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 16 21:07:09.941929 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3250179c-d03a-4594-be0a-e461f7259eca tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:09.965737 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3250179c-d03a-4594-be0a-e461f7259eca tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.028590 Apr 16 21:07:09.966832 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 10/16] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:07:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:09.971729 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-adc4ab7e-b3a8-4c38-8faf-64d73d25d935 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1975799914"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:09.973239 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:09.973239 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:09.974342 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.aggregate [None req-adc4ab7e-b3a8-4c38-8faf-64d73d25d935 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Generated uuid 4196b3f1-c321-4093-9c14-5a44c5c60f1d for aggregate {{(pid=137408) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 16 21:07:10.096009 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-adc4ab7e-b3a8-4c38-8faf-64d73d25d935 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.123542 Apr 16 21:07:10.096009 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 11/17] 10.222.0.20 () {60 vars in 1163 bytes} [Sat Apr 16 21:07:09 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:10.101515 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-eba18440-5d2d-4b9f-a1b5-9c0d41b6379a tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1533310358", "id": 386952261, "os-flavor-access:is_public": "True"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:10.106591 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:10.106591 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:10.179832 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-a69b807b-6e3a-4183-ac1e-401bf7b230b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] validate_networks() for None {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:07:10.221053 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-eba18440-5d2d-4b9f-a1b5-9c0d41b6379a tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 426 microversion: 2.1 time: 0.116156 Apr 16 21:07:10.221053 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 12/18] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:07:10 2022] POST /compute/v2.1/flavors => generated 426 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:10.221053 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2ed8d3f5-fd30-4979-98cd-8e7691696238 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-784064479", "name": "tempest-test_aggregate-881922069"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:10.239707 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:10.239707 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:10.240842 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.aggregate [None req-2ed8d3f5-fd30-4979-98cd-8e7691696238 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Generated uuid 64d6a460-e92e-4058-b057-ef8a61618b44 for aggregate {{(pid=137408) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 16 21:07:10.443686 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2ed8d3f5-fd30-4979-98cd-8e7691696238 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.228317 Apr 16 21:07:10.449174 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 13/19] 10.222.0.20 () {60 vars in 1164 bytes} [Sat Apr 16 21:07:10 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:10.570383 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-a69b807b-6e3a-4183-ac1e-401bf7b230b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:07:10.571143 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-a69b807b-6e3a-4183-ac1e-401bf7b230b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:07:10.571897 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-a69b807b-6e3a-4183-ac1e-401bf7b230b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:07:10.572308 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-a69b807b-6e3a-4183-ac1e-401bf7b230b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:07:10.572734 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-a69b807b-6e3a-4183-ac1e-401bf7b230b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:07:10.602200 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a69b807b-6e3a-4183-ac1e-401bf7b230b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:10.603706 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a69b807b-6e3a-4183-ac1e-401bf7b230b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:10.604821 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a69b807b-6e3a-4183-ac1e-401bf7b230b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:10.605280 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a69b807b-6e3a-4183-ac1e-401bf7b230b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:10.658565 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-a69b807b-6e3a-4183-ac1e-401bf7b230b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Getting quotas for project 998f0203a6c741839bde8be2da375d4f. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:07:10.672562 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-a69b807b-6e3a-4183-ac1e-401bf7b230b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Getting quotas for user 82856a20b3764d17b5c9c1bebdd46c68 and project 998f0203a6c741839bde8be2da375d4f. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:07:10.688239 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a69b807b-6e3a-4183-ac1e-401bf7b230b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:07:10.691709 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a69b807b-6e3a-4183-ac1e-401bf7b230b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:07:10.722729 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5cc28ad2-fbc1-4790-93f0-7eb5b160b2b7 tempest-AggregatesAdminNegativeTestJSON-237797815 tempest-AggregatesAdminNegativeTestJSON-237797815-project] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:10.724033 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:10.724033 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:10.725243 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5cc28ad2-fbc1-4790-93f0-7eb5b160b2b7 tempest-AggregatesAdminNegativeTestJSON-237797815 tempest-AggregatesAdminNegativeTestJSON-237797815-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '65bb1dff7f744fdea36c7a6276db6f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4dd7ceb08f4c83910432bc4e0badde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:10.728338 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5cc28ad2-fbc1-4790-93f0-7eb5b160b2b7 tempest-AggregatesAdminNegativeTestJSON-237797815 tempest-AggregatesAdminNegativeTestJSON-237797815-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:07:10.728338 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5cc28ad2-fbc1-4790-93f0-7eb5b160b2b7 tempest-AggregatesAdminNegativeTestJSON-237797815 tempest-AggregatesAdminNegativeTestJSON-237797815-project] 10.222.0.20 "POST /compute/v2.1/os-aggregates/2/action" status: 403 len: 118 microversion: 2.1 time: 0.276423 Apr 16 21:07:10.735046 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 14/20] 10.222.0.20 () {60 vars in 1190 bytes} [Sat Apr 16 21:07:10 2022] POST /compute/v2.1/os-aggregates/2/action => generated 118 bytes in 282 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:07:10.749137 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ba204a96-5f9a-4606-83e5-dad2d0040a61 tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:10.752499 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:10.752499 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:10.876831 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ba204a96-5f9a-4606-83e5-dad2d0040a61 tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/386952261" status: 202 len: 0 microversion: 2.1 time: 0.142771 Apr 16 21:07:10.880129 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 15/21] 10.222.0.20 () {58 vars in 1157 bytes} [Sat Apr 16 21:07:10 2022] DELETE /compute/v2.1/flavors/386952261 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:07:10.889265 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-13bbb8e9-7463-4b34-9cdd-91f53ace7f91 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:10.890863 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:10.890863 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:10.908721 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-13bbb8e9-7463-4b34-9cdd-91f53ace7f91 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 514 microversion: 2.1 time: 0.026457 Apr 16 21:07:10.910912 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 16/22] 10.222.0.20 () {58 vars in 1142 bytes} [Sat Apr 16 21:07:10 2022] GET /compute/v2.1/os-aggregates => generated 514 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:10.913514 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a69b807b-6e3a-4183-ac1e-401bf7b230b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.840934 Apr 16 21:07:10.919309 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 7/23] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:07:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1843 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:07:10.923248 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1cf0ea12-d298-46d7-843b-2242c80de58c tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:10.925262 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:10.925262 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:10.933901 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8a40ecc5-bd21-40e8-8be7-7b4577aa33fe tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:10.982018 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8a40ecc5-bd21-40e8-8be7-7b4577aa33fe tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.061867 Apr 16 21:07:10.984613 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 8/24] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:07:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:10.995568 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-974a255a-fd54-4dbf-ae45-63fbcc5e4a91 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:10.999771 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1cf0ea12-d298-46d7-843b-2242c80de58c tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.087463 Apr 16 21:07:11.000664 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 17/25] 10.222.0.20 () {58 vars in 1151 bytes} [Sat Apr 16 21:07:10 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 16 21:07:11.009962 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-40528b40-d41e-4c9f-9654-0cc1471e4e63 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:11.010721 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-40528b40-d41e-4c9f-9654-0cc1471e4e63 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:11.017337 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:11.017337 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:11.068099 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-974a255a-fd54-4dbf-ae45-63fbcc5e4a91 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:11.068595 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-974a255a-fd54-4dbf-ae45-63fbcc5e4a91 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:12.065628 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-40528b40-d41e-4c9f-9654-0cc1471e4e63 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82856a20b3764d17b5c9c1bebdd46c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998f0203a6c741839bde8be2da375d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:12.106575 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-40528b40-d41e-4c9f-9654-0cc1471e4e63 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c" status: 200 len: 1219 microversion: 2.1 time: 1.100871 Apr 16 21:07:12.117168 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 18/26] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:11 2022] GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c => generated 1219 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:12.123827 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d916ba5f-4547-4731-b419-9e2d356255a2 tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1911650547", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:12.129540 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:12.129540 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:12.240242 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-974a255a-fd54-4dbf-ae45-63fbcc5e4a91 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 312 microversion: 2.1 time: 1.254092 Apr 16 21:07:12.254818 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 9/27] 10.222.0.20 () {60 vars in 1190 bytes} [Sat Apr 16 21:07:10 2022] POST /compute/v2.1/os-aggregates/3/action => generated 312 bytes in 1269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:12.266780 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5f5c9420-8c1c-424f-a9b1-4f89358a3faf tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-47416718"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:12.268526 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:12.268526 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:12.272695 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.aggregate [None req-5f5c9420-8c1c-424f-a9b1-4f89358a3faf tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Generated uuid d02b934f-2520-47c0-9130-4273ab161cf3 for aggregate {{(pid=137409) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 16 21:07:12.272811 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d916ba5f-4547-4731-b419-9e2d356255a2 tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.152848 Apr 16 21:07:12.272811 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 19/28] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:07:12 2022] POST /compute/v2.1/flavors => generated 507 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:12.284351 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-79d1fcb3-e007-4348-829a-049249d14795 tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:12.285145 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:12.285145 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:12.459992 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5f5c9420-8c1c-424f-a9b1-4f89358a3faf tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.201955 Apr 16 21:07:12.460798 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 10/29] 10.222.0.20 () {60 vars in 1163 bytes} [Sat Apr 16 21:07:12 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:12.483150 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-79d1fcb3-e007-4348-829a-049249d14795 tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/c27c7c29-7dff-4121-a122-368560aac057" status: 202 len: 0 microversion: 2.1 time: 0.198265 Apr 16 21:07:12.483150 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 20/30] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:07:12 2022] DELETE /compute/v2.1/flavors/c27c7c29-7dff-4121-a122-368560aac057 => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 16 21:07:12.484734 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-dabf28b9-fdd6-4df2-bdb5-8233ffb573cb tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1444352412"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:12.489839 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:12.489839 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:12.513846 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-dabf28b9-fdd6-4df2-bdb5-8233ffb573cb tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) {{(pid=137408) load_cells /opt/stack/nova/nova/compute/api.py:306}} Apr 16 21:07:12.523704 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dabf28b9-fdd6-4df2-bdb5-8233ffb573cb tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:12.524391 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dabf28b9-fdd6-4df2-bdb5-8233ffb573cb tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:12.556874 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dabf28b9-fdd6-4df2-bdb5-8233ffb573cb tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:12.558672 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dabf28b9-fdd6-4df2-bdb5-8233ffb573cb tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:12.571133 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-dabf28b9-fdd6-4df2-bdb5-8233ffb573cb tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1444352412 could not be found. Apr 16 21:07:12.572416 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-dabf28b9-fdd6-4df2-bdb5-8233ffb573cb tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1444352412 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:07:12.574235 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-dabf28b9-fdd6-4df2-bdb5-8233ffb573cb tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/4/action" status: 404 len: 111 microversion: 2.1 time: 0.093308 Apr 16 21:07:12.575347 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 21/31] 10.222.0.20 () {60 vars in 1190 bytes} [Sat Apr 16 21:07:12 2022] POST /compute/v2.1/os-aggregates/4/action => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:07:12.582162 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4640c2da-b3a2-4562-a97e-7db2de48e0b4 tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:12.606992 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4640c2da-b3a2-4562-a97e-7db2de48e0b4 tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029444 Apr 16 21:07:12.608480 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 22/32] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:07:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:12.905091 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-59100b7c-8e7b-4439-97ae-b0e0b6178240 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-944016427", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "availability_zone": "tempest-test_az-784064479"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:12.942387 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-59100b7c-8e7b-4439-97ae-b0e0b6178240 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:12.943460 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-59100b7c-8e7b-4439-97ae-b0e0b6178240 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:12.945856 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-59100b7c-8e7b-4439-97ae-b0e0b6178240 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:12.946649 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-59100b7c-8e7b-4439-97ae-b0e0b6178240 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:13.085242 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-59100b7c-8e7b-4439-97ae-b0e0b6178240 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] validate_networks() for None {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:07:13.228432 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-aeecdb39-1574-40bf-ba39-63d5f81c480e tempest-FlavorsV255TestJSON-2095387943 tempest-FlavorsV255TestJSON-2095387943-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-982781947", "id": 1496805614, "os-flavor-access:is_public": "True"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:13.233735 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:13.233735 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:13.347973 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-aeecdb39-1574-40bf-ba39-63d5f81c480e tempest-FlavorsV255TestJSON-2095387943 tempest-FlavorsV255TestJSON-2095387943-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 448 microversion: 2.55 time: 0.738123 Apr 16 21:07:13.349849 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 23/33] 10.222.0.20 () {62 vars in 1187 bytes} [Sat Apr 16 21:07:12 2022] POST /compute/v2.1/flavors => generated 448 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:07:13.357757 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f3d0f313-654a-44ad-afc7-916aeae5962c tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:13.358599 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:13.358599 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:13.469680 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f3d0f313-654a-44ad-afc7-916aeae5962c tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.119873 Apr 16 21:07:13.470283 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 24/34] 10.222.0.20 () {58 vars in 1151 bytes} [Sat Apr 16 21:07:13 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 16 21:07:13.471169 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-59100b7c-8e7b-4439-97ae-b0e0b6178240 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:07:13.471748 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-59100b7c-8e7b-4439-97ae-b0e0b6178240 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:07:13.472284 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-59100b7c-8e7b-4439-97ae-b0e0b6178240 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:07:13.478240 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-59100b7c-8e7b-4439-97ae-b0e0b6178240 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:07:13.478840 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9b198cf8-feb7-4acc-8962-88a2d8f858d5 tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-602613718", "id": "4d81dcf5-cfe3-4325-b4af-41353774da88", "os-flavor-access:is_public": "True"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:13.479175 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-59100b7c-8e7b-4439-97ae-b0e0b6178240 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:07:13.483015 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:13.483015 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:13.496948 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-59100b7c-8e7b-4439-97ae-b0e0b6178240 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:13.500615 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-59100b7c-8e7b-4439-97ae-b0e0b6178240 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:13.501673 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-59100b7c-8e7b-4439-97ae-b0e0b6178240 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:13.502136 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-59100b7c-8e7b-4439-97ae-b0e0b6178240 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:13.531731 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-59100b7c-8e7b-4439-97ae-b0e0b6178240 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Getting quotas for project 99672927446f4ecfb3b1e170073b6797. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:07:13.536588 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-59100b7c-8e7b-4439-97ae-b0e0b6178240 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Getting quotas for user e4c25e69f3ab461a99dac0a9a9ada83c and project 99672927446f4ecfb3b1e170073b6797. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:07:13.554896 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-59100b7c-8e7b-4439-97ae-b0e0b6178240 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:07:13.559692 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-59100b7c-8e7b-4439-97ae-b0e0b6178240 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] [instance: 8bf8828b-5b17-4317-a6b8-7856d023986a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:07:13.580397 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9b198cf8-feb7-4acc-8962-88a2d8f858d5 tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.108948 Apr 16 21:07:13.583508 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 25/35] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:07:13 2022] POST /compute/v2.1/flavors => generated 506 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:13.586793 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1e988204-f65e-40f4-855e-89c8edf8bc05 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:13.588015 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1e988204-f65e-40f4-855e-89c8edf8bc05 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:13.600246 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1e988204-f65e-40f4-855e-89c8edf8bc05 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:13.603415 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1e988204-f65e-40f4-855e-89c8edf8bc05 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:13.604514 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1e988204-f65e-40f4-855e-89c8edf8bc05 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:13.605177 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1e988204-f65e-40f4-855e-89c8edf8bc05 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:13.748146 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1e988204-f65e-40f4-855e-89c8edf8bc05 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82856a20b3764d17b5c9c1bebdd46c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998f0203a6c741839bde8be2da375d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:13.760611 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1e988204-f65e-40f4-855e-89c8edf8bc05 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c" status: 200 len: 1223 microversion: 2.1 time: 0.178317 Apr 16 21:07:13.761554 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 26/36] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:13 2022] GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c => generated 1223 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:13.772642 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-59100b7c-8e7b-4439-97ae-b0e0b6178240 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.303123 Apr 16 21:07:13.774256 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 11/37] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:07:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1313 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:07:13.780122 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-789c6728-91b5-471e-b4e0-97b479241db8 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:13.782149 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-789c6728-91b5-471e-b4e0-97b479241db8 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:07:13.783203 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-789c6728-91b5-471e-b4e0-97b479241db8 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.007787 Apr 16 21:07:13.783957 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 12/38] 10.222.0.20 () {60 vars in 1164 bytes} [Sat Apr 16 21:07:13 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:07:13.977979 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7b02a939-9db9-4ee6-bd2b-d6d9ff626b98 tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:13.978731 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:13.978731 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:14.061221 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7b02a939-9db9-4ee6-bd2b-d6d9ff626b98 tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/4d81dcf5-cfe3-4325-b4af-41353774da88" status: 202 len: 0 microversion: 2.1 time: 0.275964 Apr 16 21:07:14.061737 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 13/39] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:07:13 2022] DELETE /compute/v2.1/flavors/4d81dcf5-cfe3-4325-b4af-41353774da88 => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:07:14.066918 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6b5d625c-0286-488b-918d-a7cd77ccd44c tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:14.068370 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6b5d625c-0286-488b-918d-a7cd77ccd44c tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] [instance: 8bf8828b-5b17-4317-a6b8-7856d023986a] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:14.189638 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f7e85cfd-a663-47d0-8d1b-adeb0e2f7591 tempest-FlavorsV255TestJSON-235071291 tempest-FlavorsV255TestJSON-235071291-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:14.236701 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f7e85cfd-a663-47d0-8d1b-adeb0e2f7591 tempest-FlavorsV255TestJSON-235071291 tempest-FlavorsV255TestJSON-235071291-project] 10.222.0.20 "GET /compute/v2.1/flavors/1496805614" status: 200 len: 448 microversion: 2.55 time: 0.473840 Apr 16 21:07:14.240862 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6b5d625c-0286-488b-918d-a7cd77ccd44c tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c25e69f3ab461a99dac0a9a9ada83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99672927446f4ecfb3b1e170073b6797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:14.244159 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 27/40] 10.222.0.20 () {60 vars in 1198 bytes} [Sat Apr 16 21:07:13 2022] GET /compute/v2.1/flavors/1496805614 => generated 448 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:07:14.251325 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-55f3a85f-1af8-4f90-ad0b-8f8813930036 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:14.252867 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-55f3a85f-1af8-4f90-ad0b-8f8813930036 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:07:14.253902 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-55f3a85f-1af8-4f90-ad0b-8f8813930036 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.008325 Apr 16 21:07:14.259225 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 28/41] 10.222.0.20 () {60 vars in 1163 bytes} [Sat Apr 16 21:07:14 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:07:14.263871 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6b5d625c-0286-488b-918d-a7cd77ccd44c tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a" status: 200 len: 1241 microversion: 2.1 time: 0.200933 Apr 16 21:07:14.267912 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 14/42] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:14 2022] GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a => generated 1241 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:14.279272 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-241ae791-4820-4a1d-b34c-260fca428827 tempest-FlavorsV255TestJSON-2095387943 tempest-FlavorsV255TestJSON-2095387943-project-admin] Action: 'update', calling method: .version_select at 0x7fbb9d245430>, body: {"flavor": {"description": "new"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:14.292191 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:14.292191 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:14.419532 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d3562046-3d98-409e-83f4-10c7d5a9abfa tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:14.440229 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d3562046-3d98-409e-83f4-10c7d5a9abfa tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5408 microversion: 2.1 time: 0.179618 Apr 16 21:07:14.441144 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 29/43] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:07:14 2022] GET /compute/v2.1/flavors/detail => generated 5408 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:14.455462 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c91d4cfe-a635-4780-8915-8272e9c03ad4 tempest-AggregatesAdminNegativeTestJSON-237797815 tempest-AggregatesAdminNegativeTestJSON-237797815-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-770547649"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:14.456777 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:14.456777 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:14.458880 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c91d4cfe-a635-4780-8915-8272e9c03ad4 tempest-AggregatesAdminNegativeTestJSON-237797815 tempest-AggregatesAdminNegativeTestJSON-237797815-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '65bb1dff7f744fdea36c7a6276db6f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4dd7ceb08f4c83910432bc4e0badde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:14.458880 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c91d4cfe-a635-4780-8915-8272e9c03ad4 tempest-AggregatesAdminNegativeTestJSON-237797815 tempest-AggregatesAdminNegativeTestJSON-237797815-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:07:14.459260 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c91d4cfe-a635-4780-8915-8272e9c03ad4 tempest-AggregatesAdminNegativeTestJSON-237797815 tempest-AggregatesAdminNegativeTestJSON-237797815-project] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.017162 Apr 16 21:07:14.460182 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 30/44] 10.222.0.20 () {60 vars in 1163 bytes} [Sat Apr 16 21:07:14 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:07:14.466984 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bb00173f-04c9-43a5-8dd8-c4900abc4fd2 tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1679075560", "id": 1841608240, "os-flavor-access:is_public": "True"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:14.468620 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:14.468620 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:14.502531 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-241ae791-4820-4a1d-b34c-260fca428827 tempest-FlavorsV255TestJSON-2095387943 tempest-FlavorsV255TestJSON-2095387943-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/1496805614" status: 200 len: 449 microversion: 2.55 time: 0.235648 Apr 16 21:07:14.503437 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 15/45] 10.222.0.20 () {62 vars in 1218 bytes} [Sat Apr 16 21:07:14 2022] PUT /compute/v2.1/flavors/1496805614 => generated 449 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:07:14.507942 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b55bbf76-93e6-44b6-969c-6adfea06cdc0 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-191705344"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:14.514395 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:14.514395 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:14.515649 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.aggregate [None req-b55bbf76-93e6-44b6-969c-6adfea06cdc0 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Generated uuid d9ee997c-ce69-4d60-b4b6-dec2dcf5c189 for aggregate {{(pid=137409) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 16 21:07:14.650680 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b55bbf76-93e6-44b6-969c-6adfea06cdc0 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.145997 Apr 16 21:07:14.655295 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-bb00173f-04c9-43a5-8dd8-c4900abc4fd2 tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.191818 Apr 16 21:07:14.656520 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 31/46] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:07:14 2022] POST /compute/v2.1/flavors => generated 414 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:14.657411 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 16/47] 10.222.0.20 () {60 vars in 1163 bytes} [Sat Apr 16 21:07:14 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:14.663621 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3710db7a-ccc0-4c19-b50e-0081baa0ff79 tempest-FlavorsV255TestJSON-235071291 tempest-FlavorsV255TestJSON-235071291-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:14.691294 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b5c4da79-a709-41d8-b32c-c1c0a1aa081a tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-191705344"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:14.698096 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:14.698096 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:14.699860 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.aggregate [None req-b5c4da79-a709-41d8-b32c-c1c0a1aa081a tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Generated uuid 932b4397-ac37-4c3f-aaba-59b6f7675a47 for aggregate {{(pid=137409) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 16 21:07:14.721706 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-b5c4da79-a709-41d8-b32c-c1c0a1aa081a tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-191705344 already exists. Apr 16 21:07:14.722330 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b5c4da79-a709-41d8-b32c-c1c0a1aa081a tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-191705344 already exists. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:07:14.725392 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b5c4da79-a709-41d8-b32c-c1c0a1aa081a tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 409 len: 110 microversion: 2.1 time: 0.066974 Apr 16 21:07:14.725979 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 17/48] 10.222.0.20 () {60 vars in 1163 bytes} [Sat Apr 16 21:07:14 2022] POST /compute/v2.1/os-aggregates => generated 110 bytes in 68 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:07:14.735334 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ac25dc39-4ce6-4a29-bae3-584d7fc48ef3 tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:14.738652 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3710db7a-ccc0-4c19-b50e-0081baa0ff79 tempest-FlavorsV255TestJSON-235071291 tempest-FlavorsV255TestJSON-235071291-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 6149 microversion: 2.55 time: 0.079877 Apr 16 21:07:14.747983 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ac25dc39-4ce6-4a29-bae3-584d7fc48ef3 tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/1841608240" status: 200 len: 414 microversion: 2.1 time: 0.016143 Apr 16 21:07:14.749226 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 18/49] 10.222.0.20 () {58 vars in 1157 bytes} [Sat Apr 16 21:07:14 2022] GET /compute/v2.1/flavors/1841608240 => generated 414 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:14.763010 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 32/50] 10.222.0.20 () {60 vars in 1186 bytes} [Sat Apr 16 21:07:14 2022] GET /compute/v2.1/flavors/detail => generated 6149 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:07:14.765864 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-326b4614-562b-4208-bcb1-828464e26c95 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:14.766852 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:14.766852 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:14.915888 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-326b4614-562b-4208-bcb1-828464e26c95 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.164452 Apr 16 21:07:14.916836 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 19/51] 10.222.0.20 () {58 vars in 1151 bytes} [Sat Apr 16 21:07:14 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 16 21:07:14.928686 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-01dbeec5-f7d8-4913-b556-43205e9a8e30 tempest-FlavorsV255TestJSON-235071291 tempest-FlavorsV255TestJSON-235071291-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:14.979060 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-01dbeec5-f7d8-4913-b556-43205e9a8e30 tempest-FlavorsV255TestJSON-235071291 tempest-FlavorsV255TestJSON-235071291-project] 10.222.0.20 "GET /compute/v2.1/flavors" status: 200 len: 3410 microversion: 2.55 time: 0.059735 Apr 16 21:07:14.980263 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 20/52] 10.222.0.20 () {60 vars in 1165 bytes} [Sat Apr 16 21:07:14 2022] GET /compute/v2.1/flavors => generated 3410 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:07:14.986215 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-65b9a481-45c7-49a9-9ffc-346518da23b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:14.987033 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-65b9a481-45c7-49a9-9ffc-346518da23b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:14.994462 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-65b9a481-45c7-49a9-9ffc-346518da23b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:14.995267 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-65b9a481-45c7-49a9-9ffc-346518da23b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:14.996751 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-65b9a481-45c7-49a9-9ffc-346518da23b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:14.997464 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-65b9a481-45c7-49a9-9ffc-346518da23b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:15.225684 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-04aa318b-144a-4882-9496-16e0fb067ff4 tempest-FlavorsAdminTestJSON-968943332 tempest-FlavorsAdminTestJSON-968943332-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:15.298043 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-04aa318b-144a-4882-9496-16e0fb067ff4 tempest-FlavorsAdminTestJSON-968943332 tempest-FlavorsAdminTestJSON-968943332-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.542038 Apr 16 21:07:15.308267 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 33/53] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:07:14 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:15.314002 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ded92ac6-0d5d-4247-b09a-57ca966fd3bf tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1526630848"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:15.322333 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.aggregate [None req-ded92ac6-0d5d-4247-b09a-57ca966fd3bf tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Generated uuid 250cefc2-472a-4a64-b111-d30356a673fa for aggregate {{(pid=137408) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 16 21:07:15.372021 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-65b9a481-45c7-49a9-9ffc-346518da23b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82856a20b3764d17b5c9c1bebdd46c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998f0203a6c741839bde8be2da375d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:15.394615 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-65b9a481-45c7-49a9-9ffc-346518da23b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c" status: 200 len: 1279 microversion: 2.1 time: 0.411713 Apr 16 21:07:15.397202 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 21/54] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:14 2022] GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c => generated 1279 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:15.404381 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-551095e4-00c9-4dc0-9483-60b051b63eb9 tempest-FlavorsV255TestJSON-2095387943 tempest-FlavorsV255TestJSON-2095387943-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:15.405396 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:15.405396 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:15.477254 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ded92ac6-0d5d-4247-b09a-57ca966fd3bf tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.171208 Apr 16 21:07:15.481828 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 34/55] 10.222.0.20 () {60 vars in 1163 bytes} [Sat Apr 16 21:07:15 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:15.497329 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a68c432c-0345-44ca-8d9e-31829bc0f263 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:15.506824 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a68c432c-0345-44ca-8d9e-31829bc0f263 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] [instance: 8bf8828b-5b17-4317-a6b8-7856d023986a] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:15.518283 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-551095e4-00c9-4dc0-9483-60b051b63eb9 tempest-FlavorsV255TestJSON-2095387943 tempest-FlavorsV255TestJSON-2095387943-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1496805614" status: 202 len: 0 microversion: 2.55 time: 0.119710 Apr 16 21:07:15.525502 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 22/56] 10.222.0.20 () {60 vars in 1201 bytes} [Sat Apr 16 21:07:15 2022] DELETE /compute/v2.1/flavors/1496805614 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:07:15.526235 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a1a2fa20-7adc-48ff-8765-7302225236f7 tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:15.625462 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a68c432c-0345-44ca-8d9e-31829bc0f263 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c25e69f3ab461a99dac0a9a9ada83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99672927446f4ecfb3b1e170073b6797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:15.633413 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a68c432c-0345-44ca-8d9e-31829bc0f263 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a" status: 200 len: 1241 microversion: 2.1 time: 0.150427 Apr 16 21:07:15.646260 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 35/57] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:15 2022] GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a => generated 1241 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:15.658645 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-553bc11d-a394-40f6-bcc5-d55732071217 tempest-AggregatesAdminNegativeTestJSON-237797815 tempest-AggregatesAdminNegativeTestJSON-237797815-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:15.666369 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:15.666369 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:15.669988 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-553bc11d-a394-40f6-bcc5-d55732071217 tempest-AggregatesAdminNegativeTestJSON-237797815 tempest-AggregatesAdminNegativeTestJSON-237797815-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '65bb1dff7f744fdea36c7a6276db6f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4dd7ceb08f4c83910432bc4e0badde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:15.671015 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-553bc11d-a394-40f6-bcc5-d55732071217 tempest-AggregatesAdminNegativeTestJSON-237797815 tempest-AggregatesAdminNegativeTestJSON-237797815-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:07:15.672078 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-553bc11d-a394-40f6-bcc5-d55732071217 tempest-AggregatesAdminNegativeTestJSON-237797815 tempest-AggregatesAdminNegativeTestJSON-237797815-project] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/6" status: 403 len: 116 microversion: 2.1 time: 0.024354 Apr 16 21:07:15.673307 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 36/58] 10.222.0.20 () {58 vars in 1151 bytes} [Sat Apr 16 21:07:15 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 116 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:07:15.679192 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d2ec24ef-47dc-4c46-86ed-e04557c0000f tempest-FlavorsV255TestJSON-2095387943 tempest-FlavorsV255TestJSON-2095387943-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:15.703125 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d2ec24ef-47dc-4c46-86ed-e04557c0000f tempest-FlavorsV255TestJSON-2095387943 tempest-FlavorsV255TestJSON-2095387943-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5710 microversion: 2.55 time: 0.028409 Apr 16 21:07:15.704057 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 37/59] 10.222.0.20 () {60 vars in 1186 bytes} [Sat Apr 16 21:07:15 2022] GET /compute/v2.1/flavors/detail => generated 5710 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:07:15.721904 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a1a2fa20-7adc-48ff-8765-7302225236f7 tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1841608240" status: 202 len: 0 microversion: 2.1 time: 0.200424 Apr 16 21:07:15.725320 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 23/60] 10.222.0.20 () {58 vars in 1160 bytes} [Sat Apr 16 21:07:15 2022] DELETE /compute/v2.1/flavors/1841608240 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:07:15.742470 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d4feaad7-d4e2-4806-b231-70f5c2b57e8b tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:15.753543 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-52b8dc03-e1a0-4da9-b26c-aabb1404be49 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:15.803807 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d4feaad7-d4e2-4806-b231-70f5c2b57e8b tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.073882 Apr 16 21:07:15.821104 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 24/61] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:07:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:15.826864 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-02acbb5e-4535-4475-b31d-d0702c234208 tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-402782329", "id": 1725149661, "os-flavor-access:is_public": "False"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:15.828378 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:15.828378 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:15.886843 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-52b8dc03-e1a0-4da9-b26c-aabb1404be49 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.181270 Apr 16 21:07:15.887839 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 38/62] 10.222.0.20 () {58 vars in 1151 bytes} [Sat Apr 16 21:07:15 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 16 21:07:15.898864 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1c893026-d5df-46f2-9b62-c2a9fdd6de64 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:15.899708 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:15.899708 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:15.911200 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-1c893026-d5df-46f2-9b62-c2a9fdd6de64 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Apr 16 21:07:15.912354 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1c893026-d5df-46f2-9b62-c2a9fdd6de64 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:07:15.913448 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1c893026-d5df-46f2-9b62-c2a9fdd6de64 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.020567 Apr 16 21:07:15.914459 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 39/63] 10.222.0.20 () {58 vars in 1154 bytes} [Sat Apr 16 21:07:15 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Apr 16 21:07:15.933322 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-806245ce-a00a-4640-be2a-bca09f73ad94 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-54736428"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:15.934922 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:15.934922 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:15.936113 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.aggregate [None req-806245ce-a00a-4640-be2a-bca09f73ad94 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Generated uuid e51d1b61-cec4-4b9a-bd21-723cbdaefce0 for aggregate {{(pid=137408) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 16 21:07:15.949582 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-02acbb5e-4535-4475-b31d-d0702c234208 tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.127004 Apr 16 21:07:15.957837 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 25/64] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:07:15 2022] POST /compute/v2.1/flavors => generated 429 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:07:15.963276 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-21de30ea-99ea-491a-a681-8731fb3caeaa tempest-FlavorsAdminTestJSON-968943332 tempest-FlavorsAdminTestJSON-968943332-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "1725149661"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:15.972967 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-21de30ea-99ea-491a-a681-8731fb3caeaa tempest-FlavorsAdminTestJSON-968943332 tempest-FlavorsAdminTestJSON-968943332-project] HTTP exception thrown: Flavor 1725149661 could not be found. Apr 16 21:07:15.973579 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-21de30ea-99ea-491a-a681-8731fb3caeaa tempest-FlavorsAdminTestJSON-968943332 tempest-FlavorsAdminTestJSON-968943332-project] Returning 400 to user: Flavor 1725149661 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:07:15.974470 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-21de30ea-99ea-491a-a681-8731fb3caeaa tempest-FlavorsAdminTestJSON-968943332 tempest-FlavorsAdminTestJSON-968943332-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.015323 Apr 16 21:07:15.975190 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 26/65] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:07:15 2022] POST /compute/v2.1/servers => generated 81 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Apr 16 21:07:15.984052 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b8d251ad-7a7f-443e-b1cc-c0a96e51501b tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:16.123358 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b8d251ad-7a7f-443e-b1cc-c0a96e51501b tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1725149661" status: 202 len: 0 microversion: 2.1 time: 0.143693 Apr 16 21:07:16.123953 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 27/66] 10.222.0.20 () {58 vars in 1160 bytes} [Sat Apr 16 21:07:15 2022] DELETE /compute/v2.1/flavors/1725149661 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:07:16.132851 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a9f40092-3a97-4f1b-ae2b-a65c16fb5cd8 tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:16.135064 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-806245ce-a00a-4640-be2a-bca09f73ad94 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.206555 Apr 16 21:07:16.139959 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 40/67] 10.222.0.20 () {60 vars in 1163 bytes} [Sat Apr 16 21:07:15 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:16.145705 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bd4e2c8c-5a30-4d5a-b5be-3dda04a79ef8 tempest-AggregatesAdminNegativeTestJSON-237797815 tempest-AggregatesAdminNegativeTestJSON-237797815-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:16.146468 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:16.146468 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:16.147318 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-bd4e2c8c-5a30-4d5a-b5be-3dda04a79ef8 tempest-AggregatesAdminNegativeTestJSON-237797815 tempest-AggregatesAdminNegativeTestJSON-237797815-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '65bb1dff7f744fdea36c7a6276db6f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4dd7ceb08f4c83910432bc4e0badde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:16.147967 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bd4e2c8c-5a30-4d5a-b5be-3dda04a79ef8 tempest-AggregatesAdminNegativeTestJSON-237797815 tempest-AggregatesAdminNegativeTestJSON-237797815-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:07:16.157436 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-bd4e2c8c-5a30-4d5a-b5be-3dda04a79ef8 tempest-AggregatesAdminNegativeTestJSON-237797815 tempest-AggregatesAdminNegativeTestJSON-237797815-project] 10.222.0.20 "GET /compute/v2.1/os-aggregates/7" status: 403 len: 114 microversion: 2.1 time: 0.015099 Apr 16 21:07:16.162573 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a9f40092-3a97-4f1b-ae2b-a65c16fb5cd8 tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033551 Apr 16 21:07:16.163721 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 28/68] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:07:16 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:07:16.164094 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 41/69] 10.222.0.20 () {58 vars in 1148 bytes} [Sat Apr 16 21:07:16 2022] GET /compute/v2.1/os-aggregates/7 => generated 114 bytes in 22 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:07:16.181612 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9b01f733-8449-41a0-ad73-ddd39a786bfd tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:16.182749 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:16.182749 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:16.202139 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-53cf4adb-f204-40ee-b5e5-d40a634420d2 tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-235868789", "id": 1295314971, "os-flavor-access:is_public": "False"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:16.205666 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:16.205666 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:16.268331 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9b01f733-8449-41a0-ad73-ddd39a786bfd tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.103127 Apr 16 21:07:16.269124 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 29/70] 10.222.0.20 () {58 vars in 1151 bytes} [Sat Apr 16 21:07:16 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 16 21:07:16.290694 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-781a0464-7446-4e55-81cb-ef0853816be0 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:16.291792 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:16.291792 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:16.300946 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-781a0464-7446-4e55-81cb-ef0853816be0 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Apr 16 21:07:16.303428 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-781a0464-7446-4e55-81cb-ef0853816be0 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:07:16.306087 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-781a0464-7446-4e55-81cb-ef0853816be0 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.021765 Apr 16 21:07:16.311093 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 30/71] 10.222.0.20 () {58 vars in 1151 bytes} [Sat Apr 16 21:07:16 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Apr 16 21:07:16.319819 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-97f742fe-3aa1-4f4e-b848-294f27d5225d tempest-AggregatesAdminNegativeTestJSON-237797815 tempest-AggregatesAdminNegativeTestJSON-237797815-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:16.320945 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:16.320945 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:16.321976 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-97f742fe-3aa1-4f4e-b848-294f27d5225d tempest-AggregatesAdminNegativeTestJSON-237797815 tempest-AggregatesAdminNegativeTestJSON-237797815-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '65bb1dff7f744fdea36c7a6276db6f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4dd7ceb08f4c83910432bc4e0badde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:16.322767 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-97f742fe-3aa1-4f4e-b848-294f27d5225d tempest-AggregatesAdminNegativeTestJSON-237797815 tempest-AggregatesAdminNegativeTestJSON-237797815-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:07:16.323782 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-97f742fe-3aa1-4f4e-b848-294f27d5225d tempest-AggregatesAdminNegativeTestJSON-237797815 tempest-AggregatesAdminNegativeTestJSON-237797815-project] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.007814 Apr 16 21:07:16.324521 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 31/72] 10.222.0.20 () {58 vars in 1142 bytes} [Sat Apr 16 21:07:16 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:07:16.347922 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-53cf4adb-f204-40ee-b5e5-d40a634420d2 tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.170442 Apr 16 21:07:16.349248 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 42/73] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:07:16 2022] POST /compute/v2.1/flavors => generated 414 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:16.361245 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-dc739e08-04de-4286-be88-62c7fb8e274d tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1894220376", "id": 155245147, "os-flavor-access:is_public": "True"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:16.363065 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:16.363065 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:16.414103 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e686d02f-4885-4930-bf05-9182741a4e83 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:16.415573 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e686d02f-4885-4930-bf05-9182741a4e83 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:16.426571 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e686d02f-4885-4930-bf05-9182741a4e83 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:16.427045 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e686d02f-4885-4930-bf05-9182741a4e83 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:16.427843 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e686d02f-4885-4930-bf05-9182741a4e83 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:16.429879 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e686d02f-4885-4930-bf05-9182741a4e83 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:16.533755 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-dc739e08-04de-4286-be88-62c7fb8e274d tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.176853 Apr 16 21:07:16.536390 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 32/74] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:07:16 2022] POST /compute/v2.1/flavors => generated 411 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:16.550271 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bdec3f6e-70a5-4e9c-8762-92b28fc568d8 tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:16.584752 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e686d02f-4885-4930-bf05-9182741a4e83 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82856a20b3764d17b5c9c1bebdd46c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998f0203a6c741839bde8be2da375d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:16.593974 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bdec3f6e-70a5-4e9c-8762-92b28fc568d8 tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 417 microversion: 2.1 time: 0.051071 Apr 16 21:07:16.596468 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 33/75] 10.222.0.20 () {58 vars in 1168 bytes} [Sat Apr 16 21:07:16 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 417 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:16.597357 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e686d02f-4885-4930-bf05-9182741a4e83 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c" status: 200 len: 1277 microversion: 2.1 time: 0.186459 Apr 16 21:07:16.606321 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2cec2a6c-f309-42a5-bede-40d5cbbedc65 tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:16.608231 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 43/76] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:16 2022] GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c => generated 1277 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:16.627705 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2cec2a6c-f309-42a5-bede-40d5cbbedc65 tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 417 microversion: 2.1 time: 0.016305 Apr 16 21:07:16.627705 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 34/77] 10.222.0.20 () {58 vars in 1176 bytes} [Sat Apr 16 21:07:16 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 417 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:16.637871 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-404ca8e8-d41d-49dc-a347-e37b0697a5ba tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:16.655039 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-dbc0a5bb-c58c-4062-9884-7bdb159861bc tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:16.656869 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-dbc0a5bb-c58c-4062-9884-7bdb159861bc tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] [instance: 8bf8828b-5b17-4317-a6b8-7856d023986a] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:16.666571 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dbc0a5bb-c58c-4062-9884-7bdb159861bc tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:16.667246 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dbc0a5bb-c58c-4062-9884-7bdb159861bc tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:16.668654 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dbc0a5bb-c58c-4062-9884-7bdb159861bc tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:16.669590 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dbc0a5bb-c58c-4062-9884-7bdb159861bc tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:16.672533 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-404ca8e8-d41d-49dc-a347-e37b0697a5ba tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 417 microversion: 2.1 time: 0.038253 Apr 16 21:07:16.673653 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 44/78] 10.222.0.20 () {58 vars in 1170 bytes} [Sat Apr 16 21:07:16 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 417 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:16.684051 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-685f009a-fe72-4e45-8094-29b3227338f9 tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:16.725954 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-685f009a-fe72-4e45-8094-29b3227338f9 tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 417 microversion: 2.1 time: 0.045307 Apr 16 21:07:16.726549 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 45/79] 10.222.0.20 () {58 vars in 1168 bytes} [Sat Apr 16 21:07:16 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 417 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:07:16.746825 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cc82c64e-bca4-43ee-9dfa-2d7d63342cc5 tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:16.807893 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cc82c64e-bca4-43ee-9dfa-2d7d63342cc5 tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5392 microversion: 2.1 time: 0.072281 Apr 16 21:07:16.817957 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 46/80] 10.222.0.20 () {58 vars in 1168 bytes} [Sat Apr 16 21:07:16 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5392 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:16.824629 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-39887c74-0277-47d2-a268-3823aed4eeba tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:16.850886 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-dbc0a5bb-c58c-4062-9884-7bdb159861bc tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c25e69f3ab461a99dac0a9a9ada83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99672927446f4ecfb3b1e170073b6797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:16.860547 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-dbc0a5bb-c58c-4062-9884-7bdb159861bc tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a" status: 200 len: 1233 microversion: 2.1 time: 0.211792 Apr 16 21:07:16.861340 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 35/81] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:16 2022] GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a => generated 1233 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:07:16.867273 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-39887c74-0277-47d2-a268-3823aed4eeba tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5392 microversion: 2.1 time: 0.047023 Apr 16 21:07:16.868407 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 47/82] 10.222.0.20 () {58 vars in 1174 bytes} [Sat Apr 16 21:07:16 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5392 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:16.895496 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ddddae13-de87-4ad0-af07-205a30e03953 tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:16.919940 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ddddae13-de87-4ad0-af07-205a30e03953 tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5392 microversion: 2.1 time: 0.031531 Apr 16 21:07:16.937964 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-96c348a5-ade2-43b1-a08b-97553a16cb17 tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:16.944027 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 36/83] 10.222.0.20 () {58 vars in 1172 bytes} [Sat Apr 16 21:07:16 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5392 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:16.963440 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-96c348a5-ade2-43b1-a08b-97553a16cb17 tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5392 microversion: 2.1 time: 0.031116 Apr 16 21:07:16.975216 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 48/84] 10.222.0.20 () {58 vars in 1168 bytes} [Sat Apr 16 21:07:16 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5392 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:16.978909 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7f87c7ea-2144-44eb-a5b6-8d8daf0e30da tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:16.979746 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:16.979746 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:17.152555 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7f87c7ea-2144-44eb-a5b6-8d8daf0e30da tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/155245147" status: 202 len: 0 microversion: 2.1 time: 0.177595 Apr 16 21:07:17.153655 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 37/85] 10.222.0.20 () {58 vars in 1157 bytes} [Sat Apr 16 21:07:16 2022] DELETE /compute/v2.1/flavors/155245147 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:07:17.164374 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-afb7e5bc-bc8b-4bc9-9338-dd53a2f05b6b tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:17.245106 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-afb7e5bc-bc8b-4bc9-9338-dd53a2f05b6b tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.086515 Apr 16 21:07:17.248076 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 49/86] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:07:17 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:17.262349 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-dc88c624-d4c8-4f40-9201-faf6aebcc72a tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:17.264139 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:17.264139 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:17.393892 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-dc88c624-d4c8-4f40-9201-faf6aebcc72a tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1295314971" status: 202 len: 0 microversion: 2.1 time: 0.133001 Apr 16 21:07:17.393892 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 50/87] 10.222.0.20 () {58 vars in 1160 bytes} [Sat Apr 16 21:07:17 2022] DELETE /compute/v2.1/flavors/1295314971 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 16 21:07:17.400988 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-356fd4d9-95a3-49a3-a6f1-d38b827307aa tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:17.436082 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-356fd4d9-95a3-49a3-a6f1-d38b827307aa tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039515 Apr 16 21:07:17.450609 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 51/88] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:07:17 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:17.457103 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f78eb3d6-7203-4455-8f92-d96d0328f371 tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2094334805", "id": 911701825, "os-flavor-access:is_public": "False"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:17.459668 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:17.459668 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:17.548135 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f78eb3d6-7203-4455-8f92-d96d0328f371 tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.096056 Apr 16 21:07:17.557467 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 52/89] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:07:17 2022] POST /compute/v2.1/flavors => generated 412 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:17.584307 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1481b9e8-4ee5-404a-93a7-91feef4e037f tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:17.648019 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-eb1fa775-d6f2-4f32-899c-bc4f0271c931 tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-984694922", "id": 250718873, "os-flavor-access:is_public": "False"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:17.649651 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:17.649651 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:17.650184 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1481b9e8-4ee5-404a-93a7-91feef4e037f tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.090167 Apr 16 21:07:17.650894 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 53/90] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:07:17 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:17.655548 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e582651e-d182-436c-a183-d5b9439e451b tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:17.656316 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e582651e-d182-436c-a183-d5b9439e451b tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:17.665882 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e582651e-d182-436c-a183-d5b9439e451b tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:17.669282 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e582651e-d182-436c-a183-d5b9439e451b tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:17.670406 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e582651e-d182-436c-a183-d5b9439e451b tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:17.673477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e582651e-d182-436c-a183-d5b9439e451b tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:17.793961 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-eb1fa775-d6f2-4f32-899c-bc4f0271c931 tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.635090 Apr 16 21:07:17.795909 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 38/91] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:07:17 2022] POST /compute/v2.1/flavors => generated 435 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:17.801514 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ea7e48cb-05ce-4473-9ad0-9667cf10d7a9 tempest-FlavorsAdminTestJSON-968943332 tempest-FlavorsAdminTestJSON-968943332-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:17.904486 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ea7e48cb-05ce-4473-9ad0-9667cf10d7a9 tempest-FlavorsAdminTestJSON-968943332 tempest-FlavorsAdminTestJSON-968943332-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.107335 Apr 16 21:07:17.905268 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 39/92] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:07:17 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:17.923146 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8e2cb374-eb49-4082-9eff-8bfe385256c5 tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "1aa3fe953ad84249b118e9010fe0d2a8"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:17.924664 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:17.924664 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:18.135028 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8e2cb374-eb49-4082-9eff-8bfe385256c5 tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/250718873/action" status: 200 len: 96 microversion: 2.1 time: 0.217225 Apr 16 21:07:18.136309 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 40/93] 10.222.0.20 () {60 vars in 1196 bytes} [Sat Apr 16 21:07:17 2022] POST /compute/v2.1/flavors/250718873/action => generated 96 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:07:18.145162 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cd536c26-8919-471a-addb-8ff1ecbe9b66 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:18.146082 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-cd536c26-8919-471a-addb-8ff1ecbe9b66 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] [instance: 8bf8828b-5b17-4317-a6b8-7856d023986a] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:18.155039 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cd536c26-8919-471a-addb-8ff1ecbe9b66 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:18.155738 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cd536c26-8919-471a-addb-8ff1ecbe9b66 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:18.156773 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cd536c26-8919-471a-addb-8ff1ecbe9b66 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:18.157350 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cd536c26-8919-471a-addb-8ff1ecbe9b66 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:18.373050 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cd536c26-8919-471a-addb-8ff1ecbe9b66 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c25e69f3ab461a99dac0a9a9ada83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99672927446f4ecfb3b1e170073b6797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:18.389591 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cd536c26-8919-471a-addb-8ff1ecbe9b66 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a" status: 200 len: 1297 microversion: 2.1 time: 0.252018 Apr 16 21:07:18.395215 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 41/94] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:18 2022] GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a => generated 1297 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:18.409740 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d878ff99-ad63-47e4-a6c7-72555105f401 tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:18.413496 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:18.413496 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:18.593703 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d878ff99-ad63-47e4-a6c7-72555105f401 tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/911701825" status: 202 len: 0 microversion: 2.1 time: 0.197531 Apr 16 21:07:18.594466 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 42/95] 10.222.0.20 () {58 vars in 1157 bytes} [Sat Apr 16 21:07:18 2022] DELETE /compute/v2.1/flavors/911701825 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:07:18.604648 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4f3b921b-eccd-4850-8f3e-6b60e6cac576 tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "1aa3fe953ad84249b118e9010fe0d2a8"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:18.613127 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:18.613127 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:18.722970 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e582651e-d182-436c-a183-d5b9439e451b tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82856a20b3764d17b5c9c1bebdd46c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998f0203a6c741839bde8be2da375d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:18.734512 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e582651e-d182-436c-a183-d5b9439e451b tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c" status: 200 len: 1319 microversion: 2.1 time: 1.082452 Apr 16 21:07:18.735307 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 54/96] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:17 2022] GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c => generated 1319 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:18.764932 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-215fc494-5bf9-4955-879a-11e1d999b22c tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:18.845922 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-215fc494-5bf9-4955-879a-11e1d999b22c tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.091136 Apr 16 21:07:18.846557 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 55/97] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:07:18 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:18.880986 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-22926deb-6b39-4cd5-a916-217b54f7df49 tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1618595743", "id": 1343133158, "os-flavor-access:is_public": "True"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:18.883338 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:18.883338 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:19.070976 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-4f3b921b-eccd-4850-8f3e-6b60e6cac576 tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] HTTP exception thrown: Flavor access already exists for flavor 26 and project 1aa3fe953ad84249b118e9010fe0d2a8 combination. Apr 16 21:07:19.072493 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4f3b921b-eccd-4850-8f3e-6b60e6cac576 tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] Returning 409 to user: Flavor access already exists for flavor 26 and project 1aa3fe953ad84249b118e9010fe0d2a8 combination. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:07:19.073735 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4f3b921b-eccd-4850-8f3e-6b60e6cac576 tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/250718873/action" status: 409 len: 152 microversion: 2.1 time: 0.478132 Apr 16 21:07:19.074541 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 43/98] 10.222.0.20 () {60 vars in 1196 bytes} [Sat Apr 16 21:07:18 2022] POST /compute/v2.1/flavors/250718873/action => generated 152 bytes in 480 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:07:19.084599 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ff8c454d-fd1b-4ef5-9815-24244b679705 tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "1aa3fe953ad84249b118e9010fe0d2a8"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:19.088518 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:19.088518 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:19.144822 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-22926deb-6b39-4cd5-a916-217b54f7df49 tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.246313 Apr 16 21:07:19.144822 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 56/99] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:07:18 2022] POST /compute/v2.1/flavors => generated 414 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:19.151313 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0f246f95-6e70-4e14-b42c-15775b179b64 tempest-FlavorsAdminTestJSON-968943332 tempest-FlavorsAdminTestJSON-968943332-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:19.198565 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0f246f95-6e70-4e14-b42c-15775b179b64 tempest-FlavorsAdminTestJSON-968943332 tempest-FlavorsAdminTestJSON-968943332-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.051147 Apr 16 21:07:19.226779 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 57/100] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:07:19 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:19.246645 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c350bd0c-9f9e-4bd5-92dc-41f51e25f5f4 tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:19.249116 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:19.249116 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:19.339853 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ff8c454d-fd1b-4ef5-9815-24244b679705 tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/250718873/action" status: 200 len: 21 microversion: 2.1 time: 0.259952 Apr 16 21:07:19.340848 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 44/101] 10.222.0.20 () {60 vars in 1196 bytes} [Sat Apr 16 21:07:19 2022] POST /compute/v2.1/flavors/250718873/action => generated 21 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:07:19.363098 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-11f6b88d-221c-4593-b634-68d68720dd8f tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:19.371433 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c350bd0c-9f9e-4bd5-92dc-41f51e25f5f4 tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1343133158" status: 202 len: 0 microversion: 2.1 time: 0.141408 Apr 16 21:07:19.378024 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 58/102] 10.222.0.20 () {58 vars in 1160 bytes} [Sat Apr 16 21:07:19 2022] DELETE /compute/v2.1/flavors/1343133158 => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:07:19.385941 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8034e8d1-ff18-452c-ab47-83710b0413ae tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:19.464405 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8034e8d1-ff18-452c-ab47-83710b0413ae tempest-FlavorsAdminTestJSON-659114374 tempest-FlavorsAdminTestJSON-659114374-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.079923 Apr 16 21:07:19.479707 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 59/103] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:07:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:19.493493 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0d4ed4a8-5a06-4d14-ba91-8762a89687e9 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:19.496686 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0d4ed4a8-5a06-4d14-ba91-8762a89687e9 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] [instance: 8bf8828b-5b17-4317-a6b8-7856d023986a] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:19.508368 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0d4ed4a8-5a06-4d14-ba91-8762a89687e9 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:19.508934 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0d4ed4a8-5a06-4d14-ba91-8762a89687e9 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:19.512421 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0d4ed4a8-5a06-4d14-ba91-8762a89687e9 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:19.512959 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0d4ed4a8-5a06-4d14-ba91-8762a89687e9 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:19.519781 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-11f6b88d-221c-4593-b634-68d68720dd8f tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/250718873" status: 202 len: 0 microversion: 2.1 time: 0.173500 Apr 16 21:07:19.521449 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 45/104] 10.222.0.20 () {58 vars in 1157 bytes} [Sat Apr 16 21:07:19 2022] DELETE /compute/v2.1/flavors/250718873 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:07:19.549570 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-da509c53-f4e0-4978-ac8f-5e000a9bcdf4 tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:19.652312 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-da509c53-f4e0-4978-ac8f-5e000a9bcdf4 tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.125880 Apr 16 21:07:19.663426 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 46/105] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:07:19 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:19.698478 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-96a0109d-b1b9-4bcb-bcf1-bde4005fccd2 tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1084327720", "id": 1538571514, "os-flavor-access:is_public": "True"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:19.720714 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:19.720714 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:19.847688 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-96a0109d-b1b9-4bcb-bcf1-bde4005fccd2 tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.165704 Apr 16 21:07:19.849165 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 47/106] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:07:19 2022] POST /compute/v2.1/flavors => generated 438 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:19.868908 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8e4a898e-0f90-4293-a8d1-2f8012c40b22 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:19.881734 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8e4a898e-0f90-4293-a8d1-2f8012c40b22 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:19.888710 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8e4a898e-0f90-4293-a8d1-2f8012c40b22 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:19.889289 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8e4a898e-0f90-4293-a8d1-2f8012c40b22 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:19.890196 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8e4a898e-0f90-4293-a8d1-2f8012c40b22 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:19.890753 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8e4a898e-0f90-4293-a8d1-2f8012c40b22 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:20.130949 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0d4ed4a8-5a06-4d14-ba91-8762a89687e9 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c25e69f3ab461a99dac0a9a9ada83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99672927446f4ecfb3b1e170073b6797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:20.139849 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0d4ed4a8-5a06-4d14-ba91-8762a89687e9 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a" status: 200 len: 1295 microversion: 2.1 time: 0.658043 Apr 16 21:07:20.148353 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 60/107] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:19 2022] GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a => generated 1295 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:20.148353 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-26336bc5-c2d6-4062-84d8-2b978efd1b31 tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:20.148353 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:20.148353 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:20.180674 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-26336bc5-c2d6-4062-84d8-2b978efd1b31 tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] HTTP exception thrown: Access list not available for public flavors. Apr 16 21:07:20.183561 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-26336bc5-c2d6-4062-84d8-2b978efd1b31 tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:07:20.186317 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-26336bc5-c2d6-4062-84d8-2b978efd1b31 tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/1538571514/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.042889 Apr 16 21:07:20.191299 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 61/108] 10.222.0.20 () {58 vars in 1208 bytes} [Sat Apr 16 21:07:20 2022] GET /compute/v2.1/flavors/1538571514/os-flavor-access => generated 91 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:07:20.201670 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cded85c5-a5f7-4653-91e0-3e739ed7ad85 tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:20.205786 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:20.205786 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:20.318943 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cded85c5-a5f7-4653-91e0-3e739ed7ad85 tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1538571514" status: 202 len: 0 microversion: 2.1 time: 0.124506 Apr 16 21:07:20.325232 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 62/109] 10.222.0.20 () {58 vars in 1160 bytes} [Sat Apr 16 21:07:20 2022] DELETE /compute/v2.1/flavors/1538571514 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:07:20.334786 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0e3eca67-a622-49d2-8e8b-32ad760e9353 tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:20.384848 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0e3eca67-a622-49d2-8e8b-32ad760e9353 tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.054508 Apr 16 21:07:20.393441 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 63/110] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:07:20 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:07:20.412150 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e910f16a-da77-478b-a2b7-47f832e3ecde tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-974117645", "id": 406441158, "os-flavor-access:is_public": "False"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:20.416129 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:20.416129 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:20.518462 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e910f16a-da77-478b-a2b7-47f832e3ecde tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.110066 Apr 16 21:07:20.534265 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 64/111] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:07:20 2022] POST /compute/v2.1/flavors => generated 435 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:20.687766 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8e4a898e-0f90-4293-a8d1-2f8012c40b22 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82856a20b3764d17b5c9c1bebdd46c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998f0203a6c741839bde8be2da375d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:20.695339 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8e4a898e-0f90-4293-a8d1-2f8012c40b22 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c" status: 200 len: 1319 microversion: 2.1 time: 0.838654 Apr 16 21:07:20.698374 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 48/112] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:19 2022] GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c => generated 1319 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:21.172161 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-36615fbd-cd14-4dae-b66d-d18804bb9666 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:21.177468 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-36615fbd-cd14-4dae-b66d-d18804bb9666 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] [instance: 8bf8828b-5b17-4317-a6b8-7856d023986a] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:21.192020 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-36615fbd-cd14-4dae-b66d-d18804bb9666 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:21.204856 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-36615fbd-cd14-4dae-b66d-d18804bb9666 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:21.210021 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-36615fbd-cd14-4dae-b66d-d18804bb9666 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:21.220698 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-36615fbd-cd14-4dae-b66d-d18804bb9666 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:21.467659 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3651b3b3-e577-4b4a-adf3-83953c06db22 tempest-FlavorsAccessNegativeTestJSON-1181162808 tempest-FlavorsAccessNegativeTestJSON-1181162808-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "1aa3fe953ad84249b118e9010fe0d2a8"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:21.469086 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:21.469086 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:21.470070 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3651b3b3-e577-4b4a-adf3-83953c06db22 tempest-FlavorsAccessNegativeTestJSON-1181162808 tempest-FlavorsAccessNegativeTestJSON-1181162808-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '9e2a162bb3a5437eaa07561d49c2ade7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3fe953ad84249b118e9010fe0d2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:21.470818 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3651b3b3-e577-4b4a-adf3-83953c06db22 tempest-FlavorsAccessNegativeTestJSON-1181162808 tempest-FlavorsAccessNegativeTestJSON-1181162808-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:07:21.472006 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3651b3b3-e577-4b4a-adf3-83953c06db22 tempest-FlavorsAccessNegativeTestJSON-1181162808 tempest-FlavorsAccessNegativeTestJSON-1181162808-project] 10.222.0.20 "POST /compute/v2.1/flavors/406441158/action" status: 403 len: 130 microversion: 2.1 time: 0.938092 Apr 16 21:07:21.479919 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 65/113] 10.222.0.20 () {60 vars in 1196 bytes} [Sat Apr 16 21:07:20 2022] POST /compute/v2.1/flavors/406441158/action => generated 130 bytes in 947 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:07:21.495180 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3354f957-d2ec-4232-8556-59ef5d04b87e tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:21.619440 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-36615fbd-cd14-4dae-b66d-d18804bb9666 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c25e69f3ab461a99dac0a9a9ada83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99672927446f4ecfb3b1e170073b6797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:21.619876 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3354f957-d2ec-4232-8556-59ef5d04b87e tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/406441158" status: 202 len: 0 microversion: 2.1 time: 0.130667 Apr 16 21:07:21.620814 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 66/114] 10.222.0.20 () {58 vars in 1157 bytes} [Sat Apr 16 21:07:21 2022] DELETE /compute/v2.1/flavors/406441158 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:07:21.628794 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0230a557-1283-47f9-b4ee-a49c052b2bd5 tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:21.636652 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-36615fbd-cd14-4dae-b66d-d18804bb9666 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a" status: 200 len: 1295 microversion: 2.1 time: 0.474475 Apr 16 21:07:21.642552 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 49/115] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:21 2022] GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a => generated 1295 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:21.680810 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0230a557-1283-47f9-b4ee-a49c052b2bd5 tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.042228 Apr 16 21:07:21.681826 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 67/116] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:07:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:07:21.701029 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-66cd97a4-e977-4b96-a0fb-9739b74458cb tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1653261755", "id": 468163849, "os-flavor-access:is_public": "False"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:21.706116 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:21.706116 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:21.716729 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6c37fef3-e204-468f-9a37-958df5d6ee0e tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:21.717750 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6c37fef3-e204-468f-9a37-958df5d6ee0e tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:21.732089 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6c37fef3-e204-468f-9a37-958df5d6ee0e tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:21.734754 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6c37fef3-e204-468f-9a37-958df5d6ee0e tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:21.734754 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6c37fef3-e204-468f-9a37-958df5d6ee0e tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:21.734754 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6c37fef3-e204-468f-9a37-958df5d6ee0e tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:21.809286 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-66cd97a4-e977-4b96-a0fb-9739b74458cb tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.114426 Apr 16 21:07:21.819636 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 50/117] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:07:21 2022] POST /compute/v2.1/flavors => generated 436 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:21.835192 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6f040e25-bd11-4548-b13b-a073df100f0b tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "1aa3fe953ad84249b118e9010fe0d2a8"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:21.844605 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:21.844605 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:22.517015 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6f040e25-bd11-4548-b13b-a073df100f0b tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/468163849/action" status: 200 len: 96 microversion: 2.1 time: 0.689460 Apr 16 21:07:22.517984 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 51/118] 10.222.0.20 () {60 vars in 1196 bytes} [Sat Apr 16 21:07:21 2022] POST /compute/v2.1/flavors/468163849/action => generated 96 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:07:22.543738 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b1987fc8-0a28-4ec7-afb0-a6d40a501c3b tempest-FlavorsAccessNegativeTestJSON-1181162808 tempest-FlavorsAccessNegativeTestJSON-1181162808-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "1aa3fe953ad84249b118e9010fe0d2a8"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:22.545722 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:22.545722 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:22.549269 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b1987fc8-0a28-4ec7-afb0-a6d40a501c3b tempest-FlavorsAccessNegativeTestJSON-1181162808 tempest-FlavorsAccessNegativeTestJSON-1181162808-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '9e2a162bb3a5437eaa07561d49c2ade7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1aa3fe953ad84249b118e9010fe0d2a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:22.558296 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b1987fc8-0a28-4ec7-afb0-a6d40a501c3b tempest-FlavorsAccessNegativeTestJSON-1181162808 tempest-FlavorsAccessNegativeTestJSON-1181162808-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:07:22.559598 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b1987fc8-0a28-4ec7-afb0-a6d40a501c3b tempest-FlavorsAccessNegativeTestJSON-1181162808 tempest-FlavorsAccessNegativeTestJSON-1181162808-project] 10.222.0.20 "POST /compute/v2.1/flavors/468163849/action" status: 403 len: 133 microversion: 2.1 time: 0.029590 Apr 16 21:07:22.564211 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 52/119] 10.222.0.20 () {60 vars in 1196 bytes} [Sat Apr 16 21:07:22 2022] POST /compute/v2.1/flavors/468163849/action => generated 133 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:07:22.604240 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-adf53458-d202-4f90-b67e-037fdea99670 tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "1aa3fe953ad84249b118e9010fe0d2a8"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:23.066216 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-adf53458-d202-4f90-b67e-037fdea99670 tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/468163849/action" status: 200 len: 21 microversion: 2.1 time: 0.499438 Apr 16 21:07:23.070195 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 53/120] 10.222.0.20 () {60 vars in 1196 bytes} [Sat Apr 16 21:07:22 2022] POST /compute/v2.1/flavors/468163849/action => generated 21 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:07:23.076347 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cb6227c7-dc64-4c6b-aa45-494a8db4d240 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:23.076971 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-cb6227c7-dc64-4c6b-aa45-494a8db4d240 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] [instance: 8bf8828b-5b17-4317-a6b8-7856d023986a] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:23.112008 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cb6227c7-dc64-4c6b-aa45-494a8db4d240 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:23.114747 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cb6227c7-dc64-4c6b-aa45-494a8db4d240 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:23.116022 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cb6227c7-dc64-4c6b-aa45-494a8db4d240 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:23.116022 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cb6227c7-dc64-4c6b-aa45-494a8db4d240 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:23.274773 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cb6227c7-dc64-4c6b-aa45-494a8db4d240 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c25e69f3ab461a99dac0a9a9ada83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99672927446f4ecfb3b1e170073b6797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:23.282492 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cb6227c7-dc64-4c6b-aa45-494a8db4d240 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a" status: 200 len: 1295 microversion: 2.1 time: 0.209991 Apr 16 21:07:23.283086 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 54/121] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:23 2022] GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a => generated 1295 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:23.288722 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bcb67b67-c8b2-4c88-9368-59293062a8e2 tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:23.289530 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:23.289530 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:23.413807 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bcb67b67-c8b2-4c88-9368-59293062a8e2 tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/468163849" status: 202 len: 0 microversion: 2.1 time: 0.129631 Apr 16 21:07:23.414680 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 55/122] 10.222.0.20 () {58 vars in 1157 bytes} [Sat Apr 16 21:07:23 2022] DELETE /compute/v2.1/flavors/468163849 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:07:23.423047 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-890186b4-5605-4461-b7e9-a4efdd3ca6d4 tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:23.490159 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-890186b4-5605-4461-b7e9-a4efdd3ca6d4 tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049338 Apr 16 21:07:23.490714 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 56/123] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:07:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:07:23.509723 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0e8ce647-e7ee-4ca2-969c-bff740d91818 tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1394411338", "id": 1085990056, "os-flavor-access:is_public": "False"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:23.525482 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:23.525482 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:23.653814 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0e8ce647-e7ee-4ca2-969c-bff740d91818 tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.148139 Apr 16 21:07:23.654540 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 57/124] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:07:23 2022] POST /compute/v2.1/flavors => generated 439 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:23.689845 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f72b53a5-9b14-4536-bc78-c1cddf1a9497 tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "c596ddcbc45540a1ba591a40fd628d81"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:23.691714 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:23.691714 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:23.761129 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6c37fef3-e204-468f-9a37-958df5d6ee0e tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82856a20b3764d17b5c9c1bebdd46c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998f0203a6c741839bde8be2da375d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:23.773441 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6c37fef3-e204-468f-9a37-958df5d6ee0e tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c" status: 200 len: 1319 microversion: 2.1 time: 2.060846 Apr 16 21:07:23.788033 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 68/125] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:21 2022] GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c => generated 1319 bytes in 2077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:23.834059 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-f72b53a5-9b14-4536-bc78-c1cddf1a9497 tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] HTTP exception thrown: Flavor access not found for 31 / c596ddcbc45540a1ba591a40fd628d81 combination. Apr 16 21:07:23.834823 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f72b53a5-9b14-4536-bc78-c1cddf1a9497 tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] Returning 404 to user: Flavor access not found for 31 / c596ddcbc45540a1ba591a40fd628d81 combination. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:07:23.836088 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f72b53a5-9b14-4536-bc78-c1cddf1a9497 tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1085990056/action" status: 404 len: 124 microversion: 2.1 time: 0.172394 Apr 16 21:07:23.845702 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 58/126] 10.222.0.20 () {60 vars in 1199 bytes} [Sat Apr 16 21:07:23 2022] POST /compute/v2.1/flavors/1085990056/action => generated 124 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:07:23.848290 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4caa5e1c-4007-477e-adff-201fc7f137af tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:23.849323 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:23.849323 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:23.951818 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4caa5e1c-4007-477e-adff-201fc7f137af tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1085990056" status: 202 len: 0 microversion: 2.1 time: 0.108197 Apr 16 21:07:23.952972 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 69/127] 10.222.0.20 () {58 vars in 1160 bytes} [Sat Apr 16 21:07:23 2022] DELETE /compute/v2.1/flavors/1085990056 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:07:23.962279 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7d0713bd-00af-457f-bda2-859db2cd9f2d tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:24.010661 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7d0713bd-00af-457f-bda2-859db2cd9f2d tempest-FlavorsAccessNegativeTestJSON-70594589 tempest-FlavorsAccessNegativeTestJSON-70594589-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.053102 Apr 16 21:07:24.012835 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 59/128] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:07:23 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:24.145375 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-b07d21d6-94ad-45e1-8e7f-7efbde48b8ed req-5c5fa25f-d447-4df7-ad6a-f9e38971ec07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c", "tag": "efb6cd0f-aa21-4df1-b980-d8110795919e"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:24.178050 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-b07d21d6-94ad-45e1-8e7f-7efbde48b8ed req-5c5fa25f-d447-4df7-ad6a-f9e38971ec07 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:24.181791 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-b07d21d6-94ad-45e1-8e7f-7efbde48b8ed req-5c5fa25f-d447-4df7-ad6a-f9e38971ec07 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:24.237108 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-b07d21d6-94ad-45e1-8e7f-7efbde48b8ed req-5c5fa25f-d447-4df7-ad6a-f9e38971ec07 service nova] Creating event network-changed:efb6cd0f-aa21-4df1-b980-d8110795919e for instance 0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c on nch2-master-1 Apr 16 21:07:24.237979 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-b07d21d6-94ad-45e1-8e7f-7efbde48b8ed req-5c5fa25f-d447-4df7-ad6a-f9e38971ec07 service nova] Acquired lock "compute-rpcapi-router" {{(pid=137408) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 16 21:07:24.239620 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-608ff9a1-2dba-419d-9490-e96635a3417d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:24.240599 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-608ff9a1-2dba-419d-9490-e96635a3417d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:24.241682 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-608ff9a1-2dba-419d-9490-e96635a3417d None None] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:24.243811 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-608ff9a1-2dba-419d-9490-e96635a3417d None None] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:24.282689 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.compute.rpcapi [None req-608ff9a1-2dba-419d-9490-e96635a3417d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Apr 16 21:07:24.286308 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-608ff9a1-2dba-419d-9490-e96635a3417d None None] Releasing lock "compute-rpcapi-router" {{(pid=137408) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 16 21:07:24.311030 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b55f480b-f209-4e3b-b4a5-da085057bd77 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:24.312871 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-608ff9a1-2dba-419d-9490-e96635a3417d None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.286699 Apr 16 21:07:24.314230 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 70/129] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:24.314348 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b55f480b-f209-4e3b-b4a5-da085057bd77 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] [instance: 8bf8828b-5b17-4317-a6b8-7856d023986a] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:24.330258 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b55f480b-f209-4e3b-b4a5-da085057bd77 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:24.332532 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b55f480b-f209-4e3b-b4a5-da085057bd77 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:24.334417 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b55f480b-f209-4e3b-b4a5-da085057bd77 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:24.337297 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b55f480b-f209-4e3b-b4a5-da085057bd77 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:24.682159 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b55f480b-f209-4e3b-b4a5-da085057bd77 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c25e69f3ab461a99dac0a9a9ada83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99672927446f4ecfb3b1e170073b6797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:24.706457 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b55f480b-f209-4e3b-b4a5-da085057bd77 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a" status: 200 len: 1337 microversion: 2.1 time: 0.407222 Apr 16 21:07:24.730393 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 60/130] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:24 2022] GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a => generated 1337 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:24.809061 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b9891645-3cbb-4234-ba46-29e3d2654039 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:24.810124 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b9891645-3cbb-4234-ba46-29e3d2654039 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:24.827622 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b9891645-3cbb-4234-ba46-29e3d2654039 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:24.843268 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b9891645-3cbb-4234-ba46-29e3d2654039 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:24.847428 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b9891645-3cbb-4234-ba46-29e3d2654039 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:24.848203 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b9891645-3cbb-4234-ba46-29e3d2654039 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:25.739705 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b6553ddd-1a70-4224-8f03-264e3535fba4 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:25.743035 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b6553ddd-1a70-4224-8f03-264e3535fba4 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] [instance: 8bf8828b-5b17-4317-a6b8-7856d023986a] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:25.757281 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b6553ddd-1a70-4224-8f03-264e3535fba4 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:25.757830 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b6553ddd-1a70-4224-8f03-264e3535fba4 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:25.759365 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b6553ddd-1a70-4224-8f03-264e3535fba4 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:25.759908 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b6553ddd-1a70-4224-8f03-264e3535fba4 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:25.794738 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b9891645-3cbb-4234-ba46-29e3d2654039 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82856a20b3764d17b5c9c1bebdd46c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998f0203a6c741839bde8be2da375d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:25.810168 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b9891645-3cbb-4234-ba46-29e3d2654039 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c" status: 200 len: 1319 microversion: 2.1 time: 1.007971 Apr 16 21:07:25.818477 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 71/131] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:24 2022] GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c => generated 1319 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:07:26.522226 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b6553ddd-1a70-4224-8f03-264e3535fba4 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c25e69f3ab461a99dac0a9a9ada83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99672927446f4ecfb3b1e170073b6797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:26.538059 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b6553ddd-1a70-4224-8f03-264e3535fba4 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a" status: 200 len: 1337 microversion: 2.1 time: 0.802895 Apr 16 21:07:26.542318 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 61/132] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:25 2022] GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a => generated 1337 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:07:26.839415 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-96d87810-02af-4e11-81ab-97c79c589751 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:26.840615 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-96d87810-02af-4e11-81ab-97c79c589751 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:26.854959 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-96d87810-02af-4e11-81ab-97c79c589751 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:26.855661 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-96d87810-02af-4e11-81ab-97c79c589751 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:26.859010 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-96d87810-02af-4e11-81ab-97c79c589751 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:26.859965 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-96d87810-02af-4e11-81ab-97c79c589751 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:27.559759 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-78613cd2-010f-4cf0-a8ca-7b50c1d5c3ee tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:27.561069 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-78613cd2-010f-4cf0-a8ca-7b50c1d5c3ee tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] [instance: 8bf8828b-5b17-4317-a6b8-7856d023986a] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:27.580716 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-78613cd2-010f-4cf0-a8ca-7b50c1d5c3ee tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:27.581595 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-78613cd2-010f-4cf0-a8ca-7b50c1d5c3ee tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:27.582727 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-78613cd2-010f-4cf0-a8ca-7b50c1d5c3ee tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:27.583326 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-78613cd2-010f-4cf0-a8ca-7b50c1d5c3ee tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:27.900676 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-96d87810-02af-4e11-81ab-97c79c589751 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82856a20b3764d17b5c9c1bebdd46c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998f0203a6c741839bde8be2da375d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:27.927851 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-96d87810-02af-4e11-81ab-97c79c589751 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c" status: 200 len: 1319 microversion: 2.1 time: 1.092734 Apr 16 21:07:27.944097 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 72/133] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:26 2022] GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c => generated 1319 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:28.694989 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-78613cd2-010f-4cf0-a8ca-7b50c1d5c3ee tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c25e69f3ab461a99dac0a9a9ada83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99672927446f4ecfb3b1e170073b6797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:28.713833 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-78613cd2-010f-4cf0-a8ca-7b50c1d5c3ee tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a" status: 200 len: 1337 microversion: 2.1 time: 1.148942 Apr 16 21:07:28.715513 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 62/134] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:27 2022] GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a => generated 1337 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:07:28.952096 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-623f45c6-6847-46fd-a60c-f9f14676e50e tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:28.953699 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-623f45c6-6847-46fd-a60c-f9f14676e50e tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:28.985585 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-623f45c6-6847-46fd-a60c-f9f14676e50e tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:28.987699 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-623f45c6-6847-46fd-a60c-f9f14676e50e tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:28.988672 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-623f45c6-6847-46fd-a60c-f9f14676e50e tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:28.997999 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-623f45c6-6847-46fd-a60c-f9f14676e50e tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:29.281368 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7ddd2d20-5142-45fa-9cb8-13ab320275b6 tempest-HypervisorAdminV253TestBase-402699324 tempest-HypervisorAdminV253TestBase-402699324-project-admin] Calling method '.version_select at 0x7fbb9c3d4040>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:29.283864 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:29.283864 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:29.285682 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ddd2d20-5142-45fa-9cb8-13ab320275b6 tempest-HypervisorAdminV253TestBase-402699324 tempest-HypervisorAdminV253TestBase-402699324-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:29.287503 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ddd2d20-5142-45fa-9cb8-13ab320275b6 tempest-HypervisorAdminV253TestBase-402699324 tempest-HypervisorAdminV253TestBase-402699324-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:29.379424 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ddd2d20-5142-45fa-9cb8-13ab320275b6 tempest-HypervisorAdminV253TestBase-402699324 tempest-HypervisorAdminV253TestBase-402699324-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:29.379833 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ddd2d20-5142-45fa-9cb8-13ab320275b6 tempest-HypervisorAdminV253TestBase-402699324 tempest-HypervisorAdminV253TestBase-402699324-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:29.502131 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ddd2d20-5142-45fa-9cb8-13ab320275b6 tempest-HypervisorAdminV253TestBase-402699324 tempest-HypervisorAdminV253TestBase-402699324-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:29.502612 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ddd2d20-5142-45fa-9cb8-13ab320275b6 tempest-HypervisorAdminV253TestBase-402699324 tempest-HypervisorAdminV253TestBase-402699324-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:29.548878 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ddd2d20-5142-45fa-9cb8-13ab320275b6 tempest-HypervisorAdminV253TestBase-402699324 tempest-HypervisorAdminV253TestBase-402699324-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:29.551033 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ddd2d20-5142-45fa-9cb8-13ab320275b6 tempest-HypervisorAdminV253TestBase-402699324 tempest-HypervisorAdminV253TestBase-402699324-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:29.621320 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ddd2d20-5142-45fa-9cb8-13ab320275b6 tempest-HypervisorAdminV253TestBase-402699324 tempest-HypervisorAdminV253TestBase-402699324-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:29.621886 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ddd2d20-5142-45fa-9cb8-13ab320275b6 tempest-HypervisorAdminV253TestBase-402699324 tempest-HypervisorAdminV253TestBase-402699324-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:29.643447 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7ddd2d20-5142-45fa-9cb8-13ab320275b6 tempest-HypervisorAdminV253TestBase-402699324 tempest-HypervisorAdminV253TestBase-402699324-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1757 microversion: 2.53 time: 0.708990 Apr 16 21:07:29.659185 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 73/135] 10.222.0.20 () {60 vars in 1242 bytes} [Sat Apr 16 21:07:28 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1757 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:07:29.680809 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-4949b8d1-2e2c-41f1-a28b-261c42d422a8 req-4275b652-b51a-4943-8ea8-38563ede1cbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bf8828b-5b17-4317-a6b8-7856d023986a", "tag": "e2e09b69-7c90-4dc0-8fc8-f2c75d98a0f4"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:29.700983 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-4949b8d1-2e2c-41f1-a28b-261c42d422a8 req-4275b652-b51a-4943-8ea8-38563ede1cbd service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:29.701438 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-4949b8d1-2e2c-41f1-a28b-261c42d422a8 req-4275b652-b51a-4943-8ea8-38563ede1cbd service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:29.725039 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-4949b8d1-2e2c-41f1-a28b-261c42d422a8 req-4275b652-b51a-4943-8ea8-38563ede1cbd service nova] Creating event network-changed:e2e09b69-7c90-4dc0-8fc8-f2c75d98a0f4 for instance 8bf8828b-5b17-4317-a6b8-7856d023986a on nch1-master-1 Apr 16 21:07:29.732960 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-4949b8d1-2e2c-41f1-a28b-261c42d422a8 req-4275b652-b51a-4943-8ea8-38563ede1cbd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072357 Apr 16 21:07:29.733781 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 74/136] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:29.752880 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-623f45c6-6847-46fd-a60c-f9f14676e50e tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82856a20b3764d17b5c9c1bebdd46c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998f0203a6c741839bde8be2da375d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:29.754925 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e152f8c1-04e3-41d2-931f-45f6b69b0e52 tempest-HypervisorAdminV253TestBase-402699324 tempest-HypervisorAdminV253TestBase-402699324-project-admin] Calling method '.version_select at 0x7fbb9c2be8b0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:29.757440 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:29.757440 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:29.758860 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e152f8c1-04e3-41d2-931f-45f6b69b0e52 tempest-HypervisorAdminV253TestBase-402699324 tempest-HypervisorAdminV253TestBase-402699324-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:29.759560 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e152f8c1-04e3-41d2-931f-45f6b69b0e52 tempest-HypervisorAdminV253TestBase-402699324 tempest-HypervisorAdminV253TestBase-402699324-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:29.770665 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-623f45c6-6847-46fd-a60c-f9f14676e50e tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c" status: 200 len: 1319 microversion: 2.1 time: 0.823635 Apr 16 21:07:29.773017 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 63/137] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:28 2022] GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c => generated 1319 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:29.782977 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-60e46182-f96d-42ed-85ef-d7453235a0cf tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:29.783836 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-60e46182-f96d-42ed-85ef-d7453235a0cf tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] [instance: 8bf8828b-5b17-4317-a6b8-7856d023986a] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:29.790945 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-60e46182-f96d-42ed-85ef-d7453235a0cf tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:29.791628 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-60e46182-f96d-42ed-85ef-d7453235a0cf tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:29.792878 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-60e46182-f96d-42ed-85ef-d7453235a0cf tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:29.793654 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-60e46182-f96d-42ed-85ef-d7453235a0cf tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:29.814794 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e152f8c1-04e3-41d2-931f-45f6b69b0e52 tempest-HypervisorAdminV253TestBase-402699324 tempest-HypervisorAdminV253TestBase-402699324-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:29.815863 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e152f8c1-04e3-41d2-931f-45f6b69b0e52 tempest-HypervisorAdminV253TestBase-402699324 tempest-HypervisorAdminV253TestBase-402699324-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:29.859163 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e152f8c1-04e3-41d2-931f-45f6b69b0e52 tempest-HypervisorAdminV253TestBase-402699324 tempest-HypervisorAdminV253TestBase-402699324-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:29.860333 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e152f8c1-04e3-41d2-931f-45f6b69b0e52 tempest-HypervisorAdminV253TestBase-402699324 tempest-HypervisorAdminV253TestBase-402699324-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:29.887008 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e152f8c1-04e3-41d2-931f-45f6b69b0e52 tempest-HypervisorAdminV253TestBase-402699324 tempest-HypervisorAdminV253TestBase-402699324-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:29.887597 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e152f8c1-04e3-41d2-931f-45f6b69b0e52 tempest-HypervisorAdminV253TestBase-402699324 tempest-HypervisorAdminV253TestBase-402699324-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:29.960602 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e152f8c1-04e3-41d2-931f-45f6b69b0e52 tempest-HypervisorAdminV253TestBase-402699324 tempest-HypervisorAdminV253TestBase-402699324-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:29.962771 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e152f8c1-04e3-41d2-931f-45f6b69b0e52 tempest-HypervisorAdminV253TestBase-402699324 tempest-HypervisorAdminV253TestBase-402699324-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:29.975796 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e152f8c1-04e3-41d2-931f-45f6b69b0e52 tempest-HypervisorAdminV253TestBase-402699324 tempest-HypervisorAdminV253TestBase-402699324-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 449 microversion: 2.53 time: 0.239982 Apr 16 21:07:29.979443 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 75/138] 10.222.0.20 () {60 vars in 1221 bytes} [Sat Apr 16 21:07:29 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 449 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:07:29.992395 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0b79a693-f265-496f-9bd8-b7c38b363d9f tempest-HypervisorAdminV253TestBase-402699324 tempest-HypervisorAdminV253TestBase-402699324-project-admin] Calling method '.version_select at 0x7fbb9c494b80>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:29.995389 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:29.995389 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:30.002791 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0b79a693-f265-496f-9bd8-b7c38b363d9f tempest-HypervisorAdminV253TestBase-402699324 tempest-HypervisorAdminV253TestBase-402699324-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:30.018716 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0b79a693-f265-496f-9bd8-b7c38b363d9f tempest-HypervisorAdminV253TestBase-402699324 tempest-HypervisorAdminV253TestBase-402699324-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:30.088961 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0b79a693-f265-496f-9bd8-b7c38b363d9f tempest-HypervisorAdminV253TestBase-402699324 tempest-HypervisorAdminV253TestBase-402699324-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:30.093415 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0b79a693-f265-496f-9bd8-b7c38b363d9f tempest-HypervisorAdminV253TestBase-402699324 tempest-HypervisorAdminV253TestBase-402699324-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:30.113896 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0b79a693-f265-496f-9bd8-b7c38b363d9f tempest-HypervisorAdminV253TestBase-402699324 tempest-HypervisorAdminV253TestBase-402699324-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/c419ac35-cde4-4dc1-9de3-3a64a500ee12" status: 200 len: 792 microversion: 2.53 time: 0.128094 Apr 16 21:07:30.132903 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 76/139] 10.222.0.20 () {60 vars in 1297 bytes} [Sat Apr 16 21:07:29 2022] GET /compute/v2.1/os-hypervisors/c419ac35-cde4-4dc1-9de3-3a64a500ee12 => generated 792 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 16 21:07:30.788655 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7743ea48-9d2d-4837-b0ac-9a2b343a01b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:30.789741 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7743ea48-9d2d-4837-b0ac-9a2b343a01b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:30.805384 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7743ea48-9d2d-4837-b0ac-9a2b343a01b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:30.806310 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7743ea48-9d2d-4837-b0ac-9a2b343a01b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:30.808743 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7743ea48-9d2d-4837-b0ac-9a2b343a01b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:30.811130 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7743ea48-9d2d-4837-b0ac-9a2b343a01b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:30.965275 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-60e46182-f96d-42ed-85ef-d7453235a0cf tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c25e69f3ab461a99dac0a9a9ada83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99672927446f4ecfb3b1e170073b6797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:30.977064 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-60e46182-f96d-42ed-85ef-d7453235a0cf tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a" status: 200 len: 1337 microversion: 2.1 time: 1.202755 Apr 16 21:07:30.989869 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 64/140] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:29 2022] GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a => generated 1337 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:31.170265 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7743ea48-9d2d-4837-b0ac-9a2b343a01b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82856a20b3764d17b5c9c1bebdd46c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998f0203a6c741839bde8be2da375d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:31.182283 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7743ea48-9d2d-4837-b0ac-9a2b343a01b3 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c" status: 200 len: 1319 microversion: 2.1 time: 0.397581 Apr 16 21:07:31.185257 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 77/141] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:30 2022] GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c => generated 1319 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:31.749435 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-683ddb07-f764-4080-bded-0d8ba87581bf tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:31.760466 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-683ddb07-f764-4080-bded-0d8ba87581bf tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.604513 Apr 16 21:07:31.761397 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 65/142] 10.222.0.20 () {58 vars in 1136 bytes} [Sat Apr 16 21:07:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:32.009974 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-76d85a55-009c-4e27-9755-389260815dbe tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:32.011538 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-76d85a55-009c-4e27-9755-389260815dbe tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] [instance: 8bf8828b-5b17-4317-a6b8-7856d023986a] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:32.065300 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-76d85a55-009c-4e27-9755-389260815dbe tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:32.065300 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-76d85a55-009c-4e27-9755-389260815dbe tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:32.065300 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-76d85a55-009c-4e27-9755-389260815dbe tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:32.065300 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-76d85a55-009c-4e27-9755-389260815dbe tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:32.265413 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-76d85a55-009c-4e27-9755-389260815dbe tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c25e69f3ab461a99dac0a9a9ada83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99672927446f4ecfb3b1e170073b6797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:32.275514 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-76d85a55-009c-4e27-9755-389260815dbe tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a" status: 200 len: 1337 microversion: 2.1 time: 0.284257 Apr 16 21:07:32.276740 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 66/143] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:31 2022] GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a => generated 1337 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:32.300916 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2f16a5a7-cb52-4a95-8122-fe6122843dc7 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:32.302413 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2f16a5a7-cb52-4a95-8122-fe6122843dc7 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:32.310756 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2f16a5a7-cb52-4a95-8122-fe6122843dc7 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:32.311559 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2f16a5a7-cb52-4a95-8122-fe6122843dc7 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:32.312777 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2f16a5a7-cb52-4a95-8122-fe6122843dc7 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:32.313360 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2f16a5a7-cb52-4a95-8122-fe6122843dc7 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:32.515586 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2f16a5a7-cb52-4a95-8122-fe6122843dc7 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82856a20b3764d17b5c9c1bebdd46c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998f0203a6c741839bde8be2da375d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:32.527859 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2f16a5a7-cb52-4a95-8122-fe6122843dc7 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c" status: 200 len: 1319 microversion: 2.1 time: 0.248714 Apr 16 21:07:32.538527 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 67/144] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:32 2022] GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:33.011687 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4b89d5ee-4fc6-4cb9-a5b0-ad037229aaad tempest-ServersWithSpecificFlavorTestJSON-117667926 tempest-ServersWithSpecificFlavorTestJSON-117667926-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1238515661", "id": 624056270, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:33.013397 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:33.013397 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:33.296078 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-76cef1f9-1104-496b-b10f-111b5015a46d tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:33.297456 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-76cef1f9-1104-496b-b10f-111b5015a46d tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] [instance: 8bf8828b-5b17-4317-a6b8-7856d023986a] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:33.314385 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-76cef1f9-1104-496b-b10f-111b5015a46d tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:33.314861 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-76cef1f9-1104-496b-b10f-111b5015a46d tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:33.319088 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-76cef1f9-1104-496b-b10f-111b5015a46d tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:33.320016 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-76cef1f9-1104-496b-b10f-111b5015a46d tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:33.328907 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4b89d5ee-4fc6-4cb9-a5b0-ad037229aaad tempest-ServersWithSpecificFlavorTestJSON-117667926 tempest-ServersWithSpecificFlavorTestJSON-117667926-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 422 microversion: 2.1 time: 1.558472 Apr 16 21:07:33.329506 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 78/145] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:07:31 2022] POST /compute/v2.1/flavors => generated 422 bytes in 1560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:33.341764 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5146db8d-f61d-4e8a-8113-a5d639126c83 tempest-ServersWithSpecificFlavorTestJSON-117667926 tempest-ServersWithSpecificFlavorTestJSON-117667926-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:33.378960 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5146db8d-f61d-4e8a-8113-a5d639126c83 tempest-ServersWithSpecificFlavorTestJSON-117667926 tempest-ServersWithSpecificFlavorTestJSON-117667926-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.040990 Apr 16 21:07:33.382447 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 79/146] 10.222.0.20 () {58 vars in 1181 bytes} [Sat Apr 16 21:07:33 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:07:33.402317 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b2f05654-9bf3-4f95-9807-f74eca14c663 tempest-ServersWithSpecificFlavorTestJSON-117667926 tempest-ServersWithSpecificFlavorTestJSON-117667926-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1200512121", "id": 59862996, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:33.511861 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b2f05654-9bf3-4f95-9807-f74eca14c663 tempest-ServersWithSpecificFlavorTestJSON-117667926 tempest-ServersWithSpecificFlavorTestJSON-117667926-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 419 microversion: 2.1 time: 0.122177 Apr 16 21:07:33.526679 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 80/147] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:07:33 2022] POST /compute/v2.1/flavors => generated 419 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:33.547285 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4b907d1a-a1ad-4666-ae96-81910eeb28d0 tempest-ServersWithSpecificFlavorTestJSON-117667926 tempest-ServersWithSpecificFlavorTestJSON-117667926-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:33.576550 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4b907d1a-a1ad-4666-ae96-81910eeb28d0 tempest-ServersWithSpecificFlavorTestJSON-117667926 tempest-ServersWithSpecificFlavorTestJSON-117667926-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.047787 Apr 16 21:07:33.583031 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 81/148] 10.222.0.20 () {58 vars in 1181 bytes} [Sat Apr 16 21:07:33 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:07:33.588869 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-36ac8fc4-36d7-43a4-8a3e-163f6db77261 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:33.589765 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-36ac8fc4-36d7-43a4-8a3e-163f6db77261 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:33.597278 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-36ac8fc4-36d7-43a4-8a3e-163f6db77261 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:33.597747 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-36ac8fc4-36d7-43a4-8a3e-163f6db77261 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:33.598536 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-36ac8fc4-36d7-43a4-8a3e-163f6db77261 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:33.598982 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-36ac8fc4-36d7-43a4-8a3e-163f6db77261 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:33.705146 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-76cef1f9-1104-496b-b10f-111b5015a46d tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c25e69f3ab461a99dac0a9a9ada83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99672927446f4ecfb3b1e170073b6797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:33.723630 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-76cef1f9-1104-496b-b10f-111b5015a46d tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a" status: 200 len: 1337 microversion: 2.1 time: 0.430685 Apr 16 21:07:33.725739 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 68/149] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:33 2022] GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a => generated 1337 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:07:33.740317 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1733c16b-0957-48c6-9818-5fa29054b9e0 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Action: 'create', calling method: .version_select at 0x7fbb9c1e4e50>, body: {"keypair": {"name": "tempest-keypair-491807199"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:33.771776 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-36ac8fc4-36d7-43a4-8a3e-163f6db77261 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82856a20b3764d17b5c9c1bebdd46c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998f0203a6c741839bde8be2da375d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:33.786260 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-36ac8fc4-36d7-43a4-8a3e-163f6db77261 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c" status: 200 len: 1319 microversion: 2.1 time: 0.196188 Apr 16 21:07:33.786260 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 82/150] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:33 2022] GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:33.797461 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-1733c16b-0957-48c6-9818-5fa29054b9e0 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Getting quotas for project d6395bf8972949f8837289679b58d151. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:07:33.802723 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-1733c16b-0957-48c6-9818-5fa29054b9e0 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Getting quotas for user aa7da58ce23242bd947bbd7387b80b8d and project d6395bf8972949f8837289679b58d151. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:07:34.418855 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-1733c16b-0957-48c6-9818-5fa29054b9e0 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Getting quotas for project d6395bf8972949f8837289679b58d151. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:07:34.424676 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-1733c16b-0957-48c6-9818-5fa29054b9e0 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Getting quotas for user aa7da58ce23242bd947bbd7387b80b8d and project d6395bf8972949f8837289679b58d151. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:07:34.455536 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1733c16b-0957-48c6-9818-5fa29054b9e0 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.726737 Apr 16 21:07:34.456154 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 69/151] 10.222.0.20 () {60 vars in 1157 bytes} [Sat Apr 16 21:07:33 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:34.748725 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8d46bc11-c057-46d6-814a-14d3adc68d64 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:34.749342 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8d46bc11-c057-46d6-814a-14d3adc68d64 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] [instance: 8bf8828b-5b17-4317-a6b8-7856d023986a] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:34.760346 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8d46bc11-c057-46d6-814a-14d3adc68d64 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:34.760346 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8d46bc11-c057-46d6-814a-14d3adc68d64 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:34.760346 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8d46bc11-c057-46d6-814a-14d3adc68d64 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:34.760346 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8d46bc11-c057-46d6-814a-14d3adc68d64 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:34.910362 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a60074a3-943f-4ded-8456-4802a989678f tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Calling method '.version_select at 0x7fbb9c3311f0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:34.911190 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:34.911190 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:34.912550 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a60074a3-943f-4ded-8456-4802a989678f tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:34.912862 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a60074a3-943f-4ded-8456-4802a989678f tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:34.942056 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a60074a3-943f-4ded-8456-4802a989678f tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:34.945060 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a60074a3-943f-4ded-8456-4802a989678f tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:34.956602 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8d46bc11-c057-46d6-814a-14d3adc68d64 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c25e69f3ab461a99dac0a9a9ada83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99672927446f4ecfb3b1e170073b6797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:34.965138 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8d46bc11-c057-46d6-814a-14d3adc68d64 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a" status: 200 len: 1337 microversion: 2.1 time: 0.226475 Apr 16 21:07:34.966198 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 83/152] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:34 2022] GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a => generated 1337 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:34.981015 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-45069f2a-083b-4cee-97f1-e30fd01f2c46 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:34.982622 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a60074a3-943f-4ded-8456-4802a989678f tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:34.982801 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a60074a3-943f-4ded-8456-4802a989678f tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:34.983683 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-45069f2a-083b-4cee-97f1-e30fd01f2c46 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:34.991382 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-45069f2a-083b-4cee-97f1-e30fd01f2c46 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:34.992490 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-45069f2a-083b-4cee-97f1-e30fd01f2c46 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:34.993879 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-45069f2a-083b-4cee-97f1-e30fd01f2c46 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:34.994613 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-45069f2a-083b-4cee-97f1-e30fd01f2c46 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:34.998538 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a60074a3-943f-4ded-8456-4802a989678f tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.258477 Apr 16 21:07:35.001393 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 70/153] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:07:34 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:35.013961 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-121d374f-6fb3-418c-99bf-c8f86e04e4ba tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Calling method '.version_select at 0x7fbb9c250dc0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:35.015066 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:35.015066 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:35.018784 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-121d374f-6fb3-418c-99bf-c8f86e04e4ba tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:35.020025 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-121d374f-6fb3-418c-99bf-c8f86e04e4ba tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:35.077565 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-121d374f-6fb3-418c-99bf-c8f86e04e4ba tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:35.078231 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-121d374f-6fb3-418c-99bf-c8f86e04e4ba tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:35.090453 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-121d374f-6fb3-418c-99bf-c8f86e04e4ba tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:35.091114 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-121d374f-6fb3-418c-99bf-c8f86e04e4ba tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:35.107641 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-121d374f-6fb3-418c-99bf-c8f86e04e4ba tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.098716 Apr 16 21:07:35.110216 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 71/154] 10.222.0.20 () {58 vars in 1166 bytes} [Sat Apr 16 21:07:35 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:07:35.125618 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-aa7d8531-5b08-4f3e-9c07-e0163b3a19cb tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Calling method '.version_select at 0x7fbb9c1e4430>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:35.130343 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:35.130343 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:35.130343 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aa7d8531-5b08-4f3e-9c07-e0163b3a19cb tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:35.130343 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aa7d8531-5b08-4f3e-9c07-e0163b3a19cb tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:35.149801 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aa7d8531-5b08-4f3e-9c07-e0163b3a19cb tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:35.150569 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aa7d8531-5b08-4f3e-9c07-e0163b3a19cb tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:35.163082 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aa7d8531-5b08-4f3e-9c07-e0163b3a19cb tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:35.163911 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aa7d8531-5b08-4f3e-9c07-e0163b3a19cb tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:35.191270 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-aa7d8531-5b08-4f3e-9c07-e0163b3a19cb tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.056523 Apr 16 21:07:35.192542 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 72/155] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:07:35 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:35.202254 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-02ff6048-33af-450d-b50d-f0e3dd9c0882 tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Calling method '.version_select at 0x7fbb9c2325e0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:35.204688 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:35.204688 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:35.208495 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-02ff6048-33af-450d-b50d-f0e3dd9c0882 tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:35.209127 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-02ff6048-33af-450d-b50d-f0e3dd9c0882 tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:35.213790 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-45069f2a-083b-4cee-97f1-e30fd01f2c46 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82856a20b3764d17b5c9c1bebdd46c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998f0203a6c741839bde8be2da375d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:35.221184 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-45069f2a-083b-4cee-97f1-e30fd01f2c46 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c" status: 200 len: 1319 microversion: 2.1 time: 0.245010 Apr 16 21:07:35.221785 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 84/156] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:34 2022] GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:35.236130 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-02ff6048-33af-450d-b50d-f0e3dd9c0882 tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:35.236639 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-02ff6048-33af-450d-b50d-f0e3dd9c0882 tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:35.244331 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-02ff6048-33af-450d-b50d-f0e3dd9c0882 tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.045903 Apr 16 21:07:35.253006 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 73/157] 10.222.0.20 () {58 vars in 1151 bytes} [Sat Apr 16 21:07:35 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:35.257666 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-98c75414-e708-4dfc-8151-be2f6b19d095 tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Calling method '.version_select at 0x7fbb9c494b80>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:35.259070 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:35.259070 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:35.260330 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-98c75414-e708-4dfc-8151-be2f6b19d095 tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:35.260791 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-98c75414-e708-4dfc-8151-be2f6b19d095 tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:35.280073 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-98c75414-e708-4dfc-8151-be2f6b19d095 tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.026198 Apr 16 21:07:35.280746 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 85/158] 10.222.0.20 () {58 vars in 1178 bytes} [Sat Apr 16 21:07:35 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:07:35.291799 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b4936d17-1ff4-43b0-ac03-afbdfed15c5f tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Calling method '.version_select at 0x7fbb9c232040>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:35.292897 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:35.292897 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:35.294709 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b4936d17-1ff4-43b0-ac03-afbdfed15c5f tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:35.295345 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b4936d17-1ff4-43b0-ac03-afbdfed15c5f tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:35.310053 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b4936d17-1ff4-43b0-ac03-afbdfed15c5f tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:35.310781 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b4936d17-1ff4-43b0-ac03-afbdfed15c5f tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:35.322665 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b4936d17-1ff4-43b0-ac03-afbdfed15c5f tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:35.323374 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b4936d17-1ff4-43b0-ac03-afbdfed15c5f tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:35.330099 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b4936d17-1ff4-43b0-ac03-afbdfed15c5f tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.042343 Apr 16 21:07:35.331167 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 74/159] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:07:35 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:35.340575 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d3b29e78-5e03-4787-a425-515107520452 tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Calling method '.version_select at 0x7fbb9c30c430>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:35.341475 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:35.341475 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:35.342891 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d3b29e78-5e03-4787-a425-515107520452 tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:35.343490 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d3b29e78-5e03-4787-a425-515107520452 tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:35.360747 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d3b29e78-5e03-4787-a425-515107520452 tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:35.361441 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d3b29e78-5e03-4787-a425-515107520452 tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:35.368776 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d3b29e78-5e03-4787-a425-515107520452 tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.031873 Apr 16 21:07:35.369383 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 86/160] 10.222.0.20 () {58 vars in 1151 bytes} [Sat Apr 16 21:07:35 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:07:35.385783 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-865457f3-e073-45cf-b12e-991aa262299e tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Calling method '.version_select at 0x7fbb9c1e4ca0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:35.387193 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:35.387193 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:35.389047 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-865457f3-e073-45cf-b12e-991aa262299e tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:35.389558 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-865457f3-e073-45cf-b12e-991aa262299e tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:35.410509 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-865457f3-e073-45cf-b12e-991aa262299e tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:35.410938 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-865457f3-e073-45cf-b12e-991aa262299e tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:35.419440 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-865457f3-e073-45cf-b12e-991aa262299e tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.041699 Apr 16 21:07:35.421262 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 75/161] 10.222.0.20 () {58 vars in 1151 bytes} [Sat Apr 16 21:07:35 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:35.435122 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-08f2c32e-0bfa-4798-8b3b-e1dc72786a53 tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Calling method '.version_select at 0x7fbb9c1ad5e0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:35.436071 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:35.436071 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:35.437931 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-08f2c32e-0bfa-4798-8b3b-e1dc72786a53 tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:35.438670 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-08f2c32e-0bfa-4798-8b3b-e1dc72786a53 tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:35.460732 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-08f2c32e-0bfa-4798-8b3b-e1dc72786a53 tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:35.461472 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-08f2c32e-0bfa-4798-8b3b-e1dc72786a53 tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:35.474701 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-08f2c32e-0bfa-4798-8b3b-e1dc72786a53 tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:35.475152 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-08f2c32e-0bfa-4798-8b3b-e1dc72786a53 tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:35.703752 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-08f2c32e-0bfa-4798-8b3b-e1dc72786a53 tempest-HypervisorAdminTestJSON-52662810 tempest-HypervisorAdminTestJSON-52662810-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.272813 Apr 16 21:07:35.704517 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 87/162] 10.222.0.20 () {58 vars in 1172 bytes} [Sat Apr 16 21:07:35 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:35.983420 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8b9e114a-f773-4c9f-a1d9-c2a0a3dadfa1 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:35.984071 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8b9e114a-f773-4c9f-a1d9-c2a0a3dadfa1 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] [instance: 8bf8828b-5b17-4317-a6b8-7856d023986a] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:35.990457 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8b9e114a-f773-4c9f-a1d9-c2a0a3dadfa1 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:35.990909 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8b9e114a-f773-4c9f-a1d9-c2a0a3dadfa1 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:35.991694 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8b9e114a-f773-4c9f-a1d9-c2a0a3dadfa1 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:35.992211 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8b9e114a-f773-4c9f-a1d9-c2a0a3dadfa1 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:36.132724 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8b9e114a-f773-4c9f-a1d9-c2a0a3dadfa1 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c25e69f3ab461a99dac0a9a9ada83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99672927446f4ecfb3b1e170073b6797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:36.140422 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8b9e114a-f773-4c9f-a1d9-c2a0a3dadfa1 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a" status: 200 len: 1337 microversion: 2.1 time: 0.160938 Apr 16 21:07:36.140925 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 76/163] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:35 2022] GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a => generated 1337 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:36.238516 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f4430546-728d-4218-9dbe-bd147fdcbed1 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:36.239210 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f4430546-728d-4218-9dbe-bd147fdcbed1 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:36.249325 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f4430546-728d-4218-9dbe-bd147fdcbed1 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:36.249781 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f4430546-728d-4218-9dbe-bd147fdcbed1 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:36.250587 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f4430546-728d-4218-9dbe-bd147fdcbed1 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:36.251025 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f4430546-728d-4218-9dbe-bd147fdcbed1 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:36.378390 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f4430546-728d-4218-9dbe-bd147fdcbed1 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82856a20b3764d17b5c9c1bebdd46c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998f0203a6c741839bde8be2da375d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:36.386818 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f4430546-728d-4218-9dbe-bd147fdcbed1 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c" status: 200 len: 1319 microversion: 2.1 time: 0.152582 Apr 16 21:07:36.387383 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 88/164] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:36 2022] GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:37.160486 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9714b8c6-0947-4310-ba47-78347942141d tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:37.161105 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9714b8c6-0947-4310-ba47-78347942141d tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] [instance: 8bf8828b-5b17-4317-a6b8-7856d023986a] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:37.175720 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9714b8c6-0947-4310-ba47-78347942141d tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:37.176102 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9714b8c6-0947-4310-ba47-78347942141d tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:37.176917 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9714b8c6-0947-4310-ba47-78347942141d tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:37.177357 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9714b8c6-0947-4310-ba47-78347942141d tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:37.392794 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9714b8c6-0947-4310-ba47-78347942141d tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c25e69f3ab461a99dac0a9a9ada83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99672927446f4ecfb3b1e170073b6797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:37.403543 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9714b8c6-0947-4310-ba47-78347942141d tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a" status: 200 len: 1337 microversion: 2.1 time: 0.246532 Apr 16 21:07:37.404904 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 77/165] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:37 2022] GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a => generated 1337 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:07:37.411474 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ffe958d3-e540-4d02-8705-8f8dd25105c4 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:37.416020 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ffe958d3-e540-4d02-8705-8f8dd25105c4 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:37.431723 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ffe958d3-e540-4d02-8705-8f8dd25105c4 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:37.432571 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ffe958d3-e540-4d02-8705-8f8dd25105c4 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:37.434152 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ffe958d3-e540-4d02-8705-8f8dd25105c4 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:37.435391 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ffe958d3-e540-4d02-8705-8f8dd25105c4 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:37.600921 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ffe958d3-e540-4d02-8705-8f8dd25105c4 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82856a20b3764d17b5c9c1bebdd46c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998f0203a6c741839bde8be2da375d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:37.609900 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ffe958d3-e540-4d02-8705-8f8dd25105c4 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c" status: 200 len: 1319 microversion: 2.1 time: 0.208751 Apr 16 21:07:37.611360 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 89/166] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:37 2022] GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:38.421194 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-58a93ee5-4bdb-41bc-aac8-ddb02420b2c7 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:38.421809 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-58a93ee5-4bdb-41bc-aac8-ddb02420b2c7 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] [instance: 8bf8828b-5b17-4317-a6b8-7856d023986a] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:38.429383 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-58a93ee5-4bdb-41bc-aac8-ddb02420b2c7 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:38.429859 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-58a93ee5-4bdb-41bc-aac8-ddb02420b2c7 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:38.430643 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-58a93ee5-4bdb-41bc-aac8-ddb02420b2c7 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:38.431085 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-58a93ee5-4bdb-41bc-aac8-ddb02420b2c7 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:38.533659 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e0fcae5b-60cb-4b11-a467-8bf50a391632 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-249206202", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "59862996", "adminPass": "***", "networks": [{"uuid": "d01e7439-5429-4e84-9f79-f267906a4f33"}], "security_groups": [{"name": "tempest-securitygroup--1720119057"}], "key_name": "tempest-keypair-491807199", "user_data": "}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:38.625915 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-58a93ee5-4bdb-41bc-aac8-ddb02420b2c7 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c25e69f3ab461a99dac0a9a9ada83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99672927446f4ecfb3b1e170073b6797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:38.637067 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-58a93ee5-4bdb-41bc-aac8-ddb02420b2c7 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a" status: 200 len: 1337 microversion: 2.1 time: 0.219569 Apr 16 21:07:38.639937 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 78/167] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:38 2022] GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a => generated 1337 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:38.648959 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-533d92c0-633c-4b18-b2bd-322447efce06 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:38.650697 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-533d92c0-633c-4b18-b2bd-322447efce06 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:38.664156 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-533d92c0-633c-4b18-b2bd-322447efce06 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:38.665352 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-533d92c0-633c-4b18-b2bd-322447efce06 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:38.666800 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-533d92c0-633c-4b18-b2bd-322447efce06 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:38.667502 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-533d92c0-633c-4b18-b2bd-322447efce06 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:38.730951 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-e0fcae5b-60cb-4b11-a467-8bf50a391632 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] validate_networks() for [('d01e7439-5429-4e84-9f79-f267906a4f33', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:07:38.921512 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-533d92c0-633c-4b18-b2bd-322447efce06 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82856a20b3764d17b5c9c1bebdd46c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998f0203a6c741839bde8be2da375d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:38.930884 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-533d92c0-633c-4b18-b2bd-322447efce06 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c" status: 200 len: 1319 microversion: 2.1 time: 0.288908 Apr 16 21:07:38.941178 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 79/168] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:38 2022] GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c => generated 1319 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:39.151017 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-df916fb6-486b-41aa-ba3e-1e6ae593afd8 tempest-QuotaClassesAdminTestJSON-912952274 tempest-QuotaClassesAdminTestJSON-912952274-project-admin] Calling method '.version_select at 0x7fbb9c21d8b0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:39.151826 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:39.151826 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:39.163637 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-df916fb6-486b-41aa-ba3e-1e6ae593afd8 tempest-QuotaClassesAdminTestJSON-912952274 tempest-QuotaClassesAdminTestJSON-912952274-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.221129 Apr 16 21:07:39.164266 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 80/169] 10.222.0.20 () {58 vars in 1184 bytes} [Sat Apr 16 21:07:38 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:39.386665 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f4a06a6a-7fee-4b1c-b41f-b668112e5aee tempest-FlavorsExtraSpecsTestJSON-2050140255 tempest-FlavorsExtraSpecsTestJSON-2050140255-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1399241510", "ram": 512, "vcpus": 1, "disk": 10, "id": 1672825228, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:39.388535 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:39.388535 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:39.461764 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f4a06a6a-7fee-4b1c-b41f-b668112e5aee tempest-FlavorsExtraSpecsTestJSON-2050140255 tempest-FlavorsExtraSpecsTestJSON-2050140255-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.295936 Apr 16 21:07:39.463057 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 81/170] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:07:39 2022] POST /compute/v2.1/flavors => generated 416 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:39.467678 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-67342354-7d0b-4c73-bebb-e512946c93a0 tempest-QuotaClassesAdminTestJSON-912952274 tempest-QuotaClassesAdminTestJSON-912952274-project-admin] Action: 'update', calling method: .version_select at 0x7fbb9c2e6ca0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:39.469998 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:39.469998 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:39.586794 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-e0fcae5b-60cb-4b11-a467-8bf50a391632 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:07:39.587308 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-e0fcae5b-60cb-4b11-a467-8bf50a391632 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:07:39.587772 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-e0fcae5b-60cb-4b11-a467-8bf50a391632 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:07:39.588229 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-e0fcae5b-60cb-4b11-a467-8bf50a391632 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:07:39.588654 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-e0fcae5b-60cb-4b11-a467-8bf50a391632 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:07:39.602637 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e0fcae5b-60cb-4b11-a467-8bf50a391632 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:39.603093 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e0fcae5b-60cb-4b11-a467-8bf50a391632 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:39.603900 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e0fcae5b-60cb-4b11-a467-8bf50a391632 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:39.604371 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e0fcae5b-60cb-4b11-a467-8bf50a391632 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:39.633301 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-e0fcae5b-60cb-4b11-a467-8bf50a391632 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Getting quotas for project d6395bf8972949f8837289679b58d151. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:07:39.639568 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-e0fcae5b-60cb-4b11-a467-8bf50a391632 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Getting quotas for user aa7da58ce23242bd947bbd7387b80b8d and project d6395bf8972949f8837289679b58d151. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:07:39.651501 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e0fcae5b-60cb-4b11-a467-8bf50a391632 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:07:39.654376 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e0fcae5b-60cb-4b11-a467-8bf50a391632 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 8d5cf7af-51b8-4392-a551-9d0d9b96a45d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:07:39.776980 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e0fcae5b-60cb-4b11-a467-8bf50a391632 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.248014 Apr 16 21:07:39.780215 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 90/171] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:07:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 1250 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 16 21:07:39.783257 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-49ed36e6-e123-4e53-9846-13baf38b3744 tempest-FlavorsExtraSpecsTestJSON-2050140255 tempest-FlavorsExtraSpecsTestJSON-2050140255-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:39.785006 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:39.785006 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:39.938194 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-49ed36e6-e123-4e53-9846-13baf38b3744 tempest-FlavorsExtraSpecsTestJSON-2050140255 tempest-FlavorsExtraSpecsTestJSON-2050140255-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1672825228/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.157082 Apr 16 21:07:39.942691 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 91/172] 10.222.0.20 () {60 vars in 1223 bytes} [Sat Apr 16 21:07:39 2022] POST /compute/v2.1/flavors/1672825228/os-extra_specs => generated 66 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:07:39.944809 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-063b7b38-b4a1-4846-8f82-66ca6a5662ff tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:39.945445 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-063b7b38-b4a1-4846-8f82-66ca6a5662ff tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] [instance: 8bf8828b-5b17-4317-a6b8-7856d023986a] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:39.951860 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-063b7b38-b4a1-4846-8f82-66ca6a5662ff tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:39.952355 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-063b7b38-b4a1-4846-8f82-66ca6a5662ff tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:39.953119 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-063b7b38-b4a1-4846-8f82-66ca6a5662ff tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:39.953566 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-063b7b38-b4a1-4846-8f82-66ca6a5662ff tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:40.090113 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-063b7b38-b4a1-4846-8f82-66ca6a5662ff tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c25e69f3ab461a99dac0a9a9ada83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99672927446f4ecfb3b1e170073b6797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:40.097582 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-063b7b38-b4a1-4846-8f82-66ca6a5662ff tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a" status: 200 len: 1337 microversion: 2.1 time: 0.156811 Apr 16 21:07:40.098159 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 92/173] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:39 2022] GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a => generated 1337 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:40.104306 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-397ea31d-280f-4f28-b459-aa2fdff50740 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:40.105140 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-397ea31d-280f-4f28-b459-aa2fdff50740 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 8d5cf7af-51b8-4392-a551-9d0d9b96a45d] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:40.159095 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-397ea31d-280f-4f28-b459-aa2fdff50740 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7da58ce23242bd947bbd7387b80b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6395bf8972949f8837289679b58d151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:40.166223 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-397ea31d-280f-4f28-b459-aa2fdff50740 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "GET /compute/v2.1/servers/8d5cf7af-51b8-4392-a551-9d0d9b96a45d" status: 200 len: 1259 microversion: 2.1 time: 0.067081 Apr 16 21:07:40.167046 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 93/174] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:40 2022] GET /compute/v2.1/servers/8d5cf7af-51b8-4392-a551-9d0d9b96a45d => generated 1259 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:40.388627 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d2ca859a-272e-4ebe-b4f6-ecafa00abcb8 tempest-FlavorsExtraSpecsTestJSON-992078826 tempest-FlavorsExtraSpecsTestJSON-992078826-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:40.398733 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d2ca859a-272e-4ebe-b4f6-ecafa00abcb8 tempest-FlavorsExtraSpecsTestJSON-992078826 tempest-FlavorsExtraSpecsTestJSON-992078826-project] 10.222.0.20 "GET /compute/v2.1/flavors/1672825228/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.230474 Apr 16 21:07:40.399481 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 94/175] 10.222.0.20 () {58 vars in 1202 bytes} [Sat Apr 16 21:07:40 2022] GET /compute/v2.1/flavors/1672825228/os-extra_specs => generated 66 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:07:40.410058 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e9c8fbc1-5801-4390-8bfb-f258ec7e62f6 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:40.410880 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e9c8fbc1-5801-4390-8bfb-f258ec7e62f6 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:40.417873 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e9c8fbc1-5801-4390-8bfb-f258ec7e62f6 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:40.418756 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e9c8fbc1-5801-4390-8bfb-f258ec7e62f6 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:40.419797 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e9c8fbc1-5801-4390-8bfb-f258ec7e62f6 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:40.420470 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e9c8fbc1-5801-4390-8bfb-f258ec7e62f6 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:40.570807 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e9c8fbc1-5801-4390-8bfb-f258ec7e62f6 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82856a20b3764d17b5c9c1bebdd46c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998f0203a6c741839bde8be2da375d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:40.578121 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e9c8fbc1-5801-4390-8bfb-f258ec7e62f6 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c" status: 200 len: 1319 microversion: 2.1 time: 0.172519 Apr 16 21:07:40.578674 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 95/176] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:40 2022] GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:40.582906 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b5fe462f-c561-492b-b86d-5ba0ff6426fa tempest-FlavorsExtraSpecsTestJSON-2050140255 tempest-FlavorsExtraSpecsTestJSON-2050140255-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:40.584220 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:40.584220 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:40.602779 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b5fe462f-c561-492b-b86d-5ba0ff6426fa tempest-FlavorsExtraSpecsTestJSON-2050140255 tempest-FlavorsExtraSpecsTestJSON-2050140255-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1672825228/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.023139 Apr 16 21:07:40.603334 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 96/177] 10.222.0.20 () {60 vars in 1223 bytes} [Sat Apr 16 21:07:40 2022] POST /compute/v2.1/flavors/1672825228/os-extra_specs => generated 66 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:07:40.725581 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-0ff3a0c8-70ab-4538-8c90-0916a606642b req-c3bd3d81-daac-433c-abcd-d5c0137cac44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bf8828b-5b17-4317-a6b8-7856d023986a", "name": "network-vif-plugged", "status": "completed", "tag": "e2e09b69-7c90-4dc0-8fc8-f2c75d98a0f4"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:40.733985 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-0ff3a0c8-70ab-4538-8c90-0916a606642b req-c3bd3d81-daac-433c-abcd-d5c0137cac44 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:40.734433 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-0ff3a0c8-70ab-4538-8c90-0916a606642b req-c3bd3d81-daac-433c-abcd-d5c0137cac44 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:40.746006 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-0ff3a0c8-70ab-4538-8c90-0916a606642b req-c3bd3d81-daac-433c-abcd-d5c0137cac44 service nova] Creating event network-vif-plugged:e2e09b69-7c90-4dc0-8fc8-f2c75d98a0f4 for instance 8bf8828b-5b17-4317-a6b8-7856d023986a on nch1-master-1 Apr 16 21:07:40.751412 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-0ff3a0c8-70ab-4538-8c90-0916a606642b req-c3bd3d81-daac-433c-abcd-d5c0137cac44 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146939 Apr 16 21:07:40.752846 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 97/178] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:40.760833 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6a975623-d7ac-41c8-9a96-002d94ab474c tempest-FlavorsExtraSpecsTestJSON-992078826 tempest-FlavorsExtraSpecsTestJSON-992078826-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:40.771242 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6a975623-d7ac-41c8-9a96-002d94ab474c tempest-FlavorsExtraSpecsTestJSON-992078826 tempest-FlavorsExtraSpecsTestJSON-992078826-project] 10.222.0.20 "GET /compute/v2.1/flavors/1672825228/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.016906 Apr 16 21:07:40.772451 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 98/179] 10.222.0.20 () {58 vars in 1244 bytes} [Sat Apr 16 21:07:40 2022] GET /compute/v2.1/flavors/1672825228/os-extra_specs/hw:numa_nodes => generated 22 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:07:40.784223 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e125ccfa-69da-4e24-82d8-80ba87849581 tempest-FlavorsExtraSpecsTestJSON-2050140255 tempest-FlavorsExtraSpecsTestJSON-2050140255-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:40.790530 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:40.790530 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:40.815763 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e125ccfa-69da-4e24-82d8-80ba87849581 tempest-FlavorsExtraSpecsTestJSON-2050140255 tempest-FlavorsExtraSpecsTestJSON-2050140255-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1672825228/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.036670 Apr 16 21:07:40.820621 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 99/180] 10.222.0.20 () {60 vars in 1223 bytes} [Sat Apr 16 21:07:40 2022] POST /compute/v2.1/flavors/1672825228/os-extra_specs => generated 66 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 16 21:07:40.830661 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-71b6c57c-2350-4de6-8501-bf5da1cf4eca tempest-FlavorsExtraSpecsTestJSON-2050140255 tempest-FlavorsExtraSpecsTestJSON-2050140255-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:40.840792 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-71b6c57c-2350-4de6-8501-bf5da1cf4eca tempest-FlavorsExtraSpecsTestJSON-2050140255 tempest-FlavorsExtraSpecsTestJSON-2050140255-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/1672825228/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.016557 Apr 16 21:07:40.844202 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 100/181] 10.222.0.20 () {58 vars in 1202 bytes} [Sat Apr 16 21:07:40 2022] GET /compute/v2.1/flavors/1672825228/os-extra_specs => generated 66 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:07:40.851662 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d3c7dcba-1a62-4e9e-8826-367c0ce22dc1 tempest-FlavorsExtraSpecsTestJSON-2050140255 tempest-FlavorsExtraSpecsTestJSON-2050140255-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:40.853367 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:40.853367 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:40.911282 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-67342354-7d0b-4c73-bebb-e512946c93a0 tempest-QuotaClassesAdminTestJSON-912952274 tempest-QuotaClassesAdminTestJSON-912952274-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 1.447025 Apr 16 21:07:40.912218 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 82/182] 10.222.0.20 () {60 vars in 1205 bytes} [Sat Apr 16 21:07:39 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:40.922572 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-086c44e3-c977-4f43-b8ec-44b806a0a477 tempest-QuotaClassesAdminTestJSON-912952274 tempest-QuotaClassesAdminTestJSON-912952274-project-admin] Calling method '.version_select at 0x7fbb9c1a1dc0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:40.934070 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-086c44e3-c977-4f43-b8ec-44b806a0a477 tempest-QuotaClassesAdminTestJSON-912952274 tempest-QuotaClassesAdminTestJSON-912952274-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.015253 Apr 16 21:07:40.934636 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 83/183] 10.222.0.20 () {58 vars in 1184 bytes} [Sat Apr 16 21:07:40 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:40.944935 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-02d88d39-aae7-4dca-ba6c-2392caead0b2 tempest-QuotaClassesAdminTestJSON-912952274 tempest-QuotaClassesAdminTestJSON-912952274-project-admin] Action: 'update', calling method: .version_select at 0x7fbb9c18fc10>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:41.000648 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d3c7dcba-1a62-4e9e-8826-367c0ce22dc1 tempest-FlavorsExtraSpecsTestJSON-2050140255 tempest-FlavorsExtraSpecsTestJSON-2050140255-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/1672825228/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.153745 Apr 16 21:07:41.001521 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 101/184] 10.222.0.20 () {60 vars in 1264 bytes} [Sat Apr 16 21:07:40 2022] PUT /compute/v2.1/flavors/1672825228/os-extra_specs/hw:numa_nodes => generated 22 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 16 21:07:41.010006 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a333f701-f70e-4c38-b532-c49f31b17ccd tempest-FlavorsExtraSpecsTestJSON-2050140255 tempest-FlavorsExtraSpecsTestJSON-2050140255-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:41.017880 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a333f701-f70e-4c38-b532-c49f31b17ccd tempest-FlavorsExtraSpecsTestJSON-2050140255 tempest-FlavorsExtraSpecsTestJSON-2050140255-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/1672825228/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.011465 Apr 16 21:07:41.022934 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 102/185] 10.222.0.20 () {58 vars in 1202 bytes} [Sat Apr 16 21:07:41 2022] GET /compute/v2.1/flavors/1672825228/os-extra_specs => generated 66 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 16 21:07:41.028389 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9920dbb6-8663-4161-8a7e-48f891e38765 tempest-FlavorsExtraSpecsTestJSON-2050140255 tempest-FlavorsExtraSpecsTestJSON-2050140255-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:41.029141 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:41.029141 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:41.150027 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9920dbb6-8663-4161-8a7e-48f891e38765 tempest-FlavorsExtraSpecsTestJSON-2050140255 tempest-FlavorsExtraSpecsTestJSON-2050140255-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1672825228/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.125740 Apr 16 21:07:41.150685 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 103/186] 10.222.0.20 () {58 vars in 1247 bytes} [Sat Apr 16 21:07:41 2022] DELETE /compute/v2.1/flavors/1672825228/os-extra_specs/hw:numa_nodes => generated 0 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 16 21:07:41.155739 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-aa65a235-42c7-4bda-b39c-788e345d23c0 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:41.156509 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-aa65a235-42c7-4bda-b39c-788e345d23c0 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] [instance: 8bf8828b-5b17-4317-a6b8-7856d023986a] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:41.163063 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aa65a235-42c7-4bda-b39c-788e345d23c0 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:41.163523 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aa65a235-42c7-4bda-b39c-788e345d23c0 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:41.165533 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aa65a235-42c7-4bda-b39c-788e345d23c0 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:41.165986 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aa65a235-42c7-4bda-b39c-788e345d23c0 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:41.295138 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-aa65a235-42c7-4bda-b39c-788e345d23c0 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c25e69f3ab461a99dac0a9a9ada83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99672927446f4ecfb3b1e170073b6797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:41.302594 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-aa65a235-42c7-4bda-b39c-788e345d23c0 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a" status: 200 len: 1337 microversion: 2.1 time: 0.150653 Apr 16 21:07:41.303164 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 104/187] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:41 2022] GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a => generated 1337 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:41.307338 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9f970785-ddc7-4bb5-a420-9225dfd21558 tempest-FlavorsExtraSpecsTestJSON-2050140255 tempest-FlavorsExtraSpecsTestJSON-2050140255-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:41.308091 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:41.308091 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:41.384274 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9f970785-ddc7-4bb5-a420-9225dfd21558 tempest-FlavorsExtraSpecsTestJSON-2050140255 tempest-FlavorsExtraSpecsTestJSON-2050140255-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1672825228/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.080032 Apr 16 21:07:41.384853 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 105/188] 10.222.0.20 () {58 vars in 1247 bytes} [Sat Apr 16 21:07:41 2022] DELETE /compute/v2.1/flavors/1672825228/os-extra_specs/hw:cpu_policy => generated 0 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 16 21:07:41.389293 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-49da312c-634e-49d7-a23a-9fddc4f2737b tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:41.389893 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-49da312c-634e-49d7-a23a-9fddc4f2737b tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 8d5cf7af-51b8-4392-a551-9d0d9b96a45d] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:41.395395 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-49da312c-634e-49d7-a23a-9fddc4f2737b tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:41.395855 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-49da312c-634e-49d7-a23a-9fddc4f2737b tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:41.396660 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-49da312c-634e-49d7-a23a-9fddc4f2737b tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:41.397099 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-49da312c-634e-49d7-a23a-9fddc4f2737b tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:41.456450 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-49da312c-634e-49d7-a23a-9fddc4f2737b tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7da58ce23242bd947bbd7387b80b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6395bf8972949f8837289679b58d151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:41.464490 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-49da312c-634e-49d7-a23a-9fddc4f2737b tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "GET /compute/v2.1/servers/8d5cf7af-51b8-4392-a551-9d0d9b96a45d" status: 200 len: 1263 microversion: 2.1 time: 0.078633 Apr 16 21:07:41.468465 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 106/189] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:41 2022] GET /compute/v2.1/servers/8d5cf7af-51b8-4392-a551-9d0d9b96a45d => generated 1263 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:41.588906 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-431063d9-3994-48a2-a6a0-06849086800a tempest-HypervisorAdminV228Test-1044031218 tempest-HypervisorAdminV228Test-1044031218-project-admin] Calling method '.version_select at 0x7fbb9c30c550>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:41.589726 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:41.589726 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:41.590948 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-431063d9-3994-48a2-a6a0-06849086800a tempest-HypervisorAdminV228Test-1044031218 tempest-HypervisorAdminV228Test-1044031218-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:41.591438 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-431063d9-3994-48a2-a6a0-06849086800a tempest-HypervisorAdminV228Test-1044031218 tempest-HypervisorAdminV228Test-1044031218-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:41.613980 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-431063d9-3994-48a2-a6a0-06849086800a tempest-HypervisorAdminV228Test-1044031218 tempest-HypervisorAdminV228Test-1044031218-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:41.614825 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-431063d9-3994-48a2-a6a0-06849086800a tempest-HypervisorAdminV228Test-1044031218 tempest-HypervisorAdminV228Test-1044031218-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:41.624585 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-431063d9-3994-48a2-a6a0-06849086800a tempest-HypervisorAdminV228Test-1044031218 tempest-HypervisorAdminV228Test-1044031218-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:41.625051 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-431063d9-3994-48a2-a6a0-06849086800a tempest-HypervisorAdminV228Test-1044031218 tempest-HypervisorAdminV228Test-1044031218-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:41.630875 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-431063d9-3994-48a2-a6a0-06849086800a tempest-HypervisorAdminV228Test-1044031218 tempest-HypervisorAdminV228Test-1044031218-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.164842 Apr 16 21:07:41.631444 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 107/190] 10.222.0.20 () {60 vars in 1186 bytes} [Sat Apr 16 21:07:41 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:07:41.643520 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d3317248-76b1-4564-83ad-82761867bcdb tempest-FlavorsExtraSpecsTestJSON-2050140255 tempest-FlavorsExtraSpecsTestJSON-2050140255-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:41.644266 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d3317248-76b1-4564-83ad-82761867bcdb tempest-FlavorsExtraSpecsTestJSON-2050140255 tempest-FlavorsExtraSpecsTestJSON-2050140255-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/1672825228/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.011643 Apr 16 21:07:41.644829 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 108/191] 10.222.0.20 () {58 vars in 1202 bytes} [Sat Apr 16 21:07:41 2022] GET /compute/v2.1/flavors/1672825228/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:07:41.649764 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-53ff05bd-9149-44cf-930f-d2e5dfefe6c6 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:41.650586 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-53ff05bd-9149-44cf-930f-d2e5dfefe6c6 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:41.656572 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-53ff05bd-9149-44cf-930f-d2e5dfefe6c6 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:41.657033 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-53ff05bd-9149-44cf-930f-d2e5dfefe6c6 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:41.657820 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-53ff05bd-9149-44cf-930f-d2e5dfefe6c6 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:41.658271 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-53ff05bd-9149-44cf-930f-d2e5dfefe6c6 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:41.801759 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-53ff05bd-9149-44cf-930f-d2e5dfefe6c6 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82856a20b3764d17b5c9c1bebdd46c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998f0203a6c741839bde8be2da375d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:41.809396 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-53ff05bd-9149-44cf-930f-d2e5dfefe6c6 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c" status: 200 len: 1319 microversion: 2.1 time: 0.163619 Apr 16 21:07:41.809967 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 109/192] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:41 2022] GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:41.814301 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-aae41b3e-7649-44d7-ba59-1ac73463baaf tempest-HypervisorAdminV228Test-1044031218 tempest-HypervisorAdminV228Test-1044031218-project-admin] Calling method '.version_select at 0x7fbb9c0a7310>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:41.815122 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:41.815122 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:41.816323 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aae41b3e-7649-44d7-ba59-1ac73463baaf tempest-HypervisorAdminV228Test-1044031218 tempest-HypervisorAdminV228Test-1044031218-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:41.816784 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aae41b3e-7649-44d7-ba59-1ac73463baaf tempest-HypervisorAdminV228Test-1044031218 tempest-HypervisorAdminV228Test-1044031218-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:41.828984 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aae41b3e-7649-44d7-ba59-1ac73463baaf tempest-HypervisorAdminV228Test-1044031218 tempest-HypervisorAdminV228Test-1044031218-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:41.829443 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aae41b3e-7649-44d7-ba59-1ac73463baaf tempest-HypervisorAdminV228Test-1044031218 tempest-HypervisorAdminV228Test-1044031218-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:41.836617 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-aae41b3e-7649-44d7-ba59-1ac73463baaf tempest-HypervisorAdminV228Test-1044031218 tempest-HypervisorAdminV228Test-1044031218-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.024664 Apr 16 21:07:41.839522 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 110/193] 10.222.0.20 () {60 vars in 1192 bytes} [Sat Apr 16 21:07:41 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:07:41.842541 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3a0e9a87-5fce-4163-8cce-7f10d585de3c tempest-FlavorsExtraSpecsTestJSON-2050140255 tempest-FlavorsExtraSpecsTestJSON-2050140255-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:41.843294 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:41.843294 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:41.944549 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3a0e9a87-5fce-4163-8cce-7f10d585de3c tempest-FlavorsExtraSpecsTestJSON-2050140255 tempest-FlavorsExtraSpecsTestJSON-2050140255-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1672825228" status: 202 len: 0 microversion: 2.1 time: 0.105964 Apr 16 21:07:41.945895 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 111/194] 10.222.0.20 () {58 vars in 1160 bytes} [Sat Apr 16 21:07:41 2022] DELETE /compute/v2.1/flavors/1672825228 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:07:41.953387 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1460828d-77d1-4c18-958c-c372c15e7fdd tempest-FlavorsExtraSpecsTestJSON-2050140255 tempest-FlavorsExtraSpecsTestJSON-2050140255-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:41.972302 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1460828d-77d1-4c18-958c-c372c15e7fdd tempest-FlavorsExtraSpecsTestJSON-2050140255 tempest-FlavorsExtraSpecsTestJSON-2050140255-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.022322 Apr 16 21:07:41.972875 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 112/195] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:07:41 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:07:42.069457 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-02d88d39-aae7-4dca-ba6c-2392caead0b2 tempest-QuotaClassesAdminTestJSON-912952274 tempest-QuotaClassesAdminTestJSON-912952274-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 1.128184 Apr 16 21:07:42.070678 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 84/196] 10.222.0.20 () {60 vars in 1205 bytes} [Sat Apr 16 21:07:40 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:07:42.320574 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-614063b9-7ad4-4ba5-adff-e14c6995a488 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:42.321560 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-614063b9-7ad4-4ba5-adff-e14c6995a488 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] [instance: 8bf8828b-5b17-4317-a6b8-7856d023986a] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:42.328755 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-614063b9-7ad4-4ba5-adff-e14c6995a488 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:42.329218 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-614063b9-7ad4-4ba5-adff-e14c6995a488 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:42.330008 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-614063b9-7ad4-4ba5-adff-e14c6995a488 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:42.330749 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-614063b9-7ad4-4ba5-adff-e14c6995a488 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:42.469071 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-614063b9-7ad4-4ba5-adff-e14c6995a488 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c25e69f3ab461a99dac0a9a9ada83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99672927446f4ecfb3b1e170073b6797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:42.478098 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-614063b9-7ad4-4ba5-adff-e14c6995a488 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a" status: 200 len: 1337 microversion: 2.1 time: 0.160396 Apr 16 21:07:42.478386 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 113/197] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:42 2022] GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a => generated 1337 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:42.490402 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-50382b18-b5b0-4a03-89fc-5089efe5e56c tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:42.491180 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-50382b18-b5b0-4a03-89fc-5089efe5e56c tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 8d5cf7af-51b8-4392-a551-9d0d9b96a45d] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:42.498379 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-50382b18-b5b0-4a03-89fc-5089efe5e56c tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:42.498912 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-50382b18-b5b0-4a03-89fc-5089efe5e56c tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:42.499760 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-50382b18-b5b0-4a03-89fc-5089efe5e56c tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:42.500298 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-50382b18-b5b0-4a03-89fc-5089efe5e56c tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:42.689464 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-50382b18-b5b0-4a03-89fc-5089efe5e56c tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7da58ce23242bd947bbd7387b80b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6395bf8972949f8837289679b58d151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:42.697247 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-50382b18-b5b0-4a03-89fc-5089efe5e56c tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "GET /compute/v2.1/servers/8d5cf7af-51b8-4392-a551-9d0d9b96a45d" status: 200 len: 1319 microversion: 2.1 time: 0.220448 Apr 16 21:07:42.707152 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 85/198] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:42 2022] GET /compute/v2.1/servers/8d5cf7af-51b8-4392-a551-9d0d9b96a45d => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:07:42.827384 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e76fa0c2-5fa6-4278-a367-b13cfa7afbc8 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:42.828032 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e76fa0c2-5fa6-4278-a367-b13cfa7afbc8 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:42.834608 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e76fa0c2-5fa6-4278-a367-b13cfa7afbc8 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:42.835374 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e76fa0c2-5fa6-4278-a367-b13cfa7afbc8 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:42.846016 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e76fa0c2-5fa6-4278-a367-b13cfa7afbc8 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:42.846016 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e76fa0c2-5fa6-4278-a367-b13cfa7afbc8 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:42.974344 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-316c44ac-b9b4-4f03-8591-78dc4fcb5931 req-27192152-ddd2-451c-9a6f-6efee044a056 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c", "name": "network-vif-plugged", "status": "completed", "tag": "efb6cd0f-aa21-4df1-b980-d8110795919e"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:42.997239 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-316c44ac-b9b4-4f03-8591-78dc4fcb5931 req-27192152-ddd2-451c-9a6f-6efee044a056 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:42.997965 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-316c44ac-b9b4-4f03-8591-78dc4fcb5931 req-27192152-ddd2-451c-9a6f-6efee044a056 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:43.040836 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-316c44ac-b9b4-4f03-8591-78dc4fcb5931 req-27192152-ddd2-451c-9a6f-6efee044a056 service nova] Creating event network-vif-plugged:efb6cd0f-aa21-4df1-b980-d8110795919e for instance 0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c on nch2-master-1 Apr 16 21:07:43.041650 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-316c44ac-b9b4-4f03-8591-78dc4fcb5931 req-27192152-ddd2-451c-9a6f-6efee044a056 service nova] Acquired lock "compute-rpcapi-router" {{(pid=137409) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 16 21:07:43.042980 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c12cd997-d300-461a-82ab-6f25baf6c2ff None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:43.043561 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c12cd997-d300-461a-82ab-6f25baf6c2ff None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:43.044633 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c12cd997-d300-461a-82ab-6f25baf6c2ff None None] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:43.045621 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c12cd997-d300-461a-82ab-6f25baf6c2ff None None] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:43.098617 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.compute.rpcapi [None req-c12cd997-d300-461a-82ab-6f25baf6c2ff None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Apr 16 21:07:43.098617 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c12cd997-d300-461a-82ab-6f25baf6c2ff None None] Releasing lock "compute-rpcapi-router" {{(pid=137409) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 16 21:07:43.098617 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c12cd997-d300-461a-82ab-6f25baf6c2ff None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123970 Apr 16 21:07:43.098617 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 86/199] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:43.108957 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e76fa0c2-5fa6-4278-a367-b13cfa7afbc8 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82856a20b3764d17b5c9c1bebdd46c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998f0203a6c741839bde8be2da375d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:43.116731 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e76fa0c2-5fa6-4278-a367-b13cfa7afbc8 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c" status: 200 len: 1319 microversion: 2.1 time: 0.293429 Apr 16 21:07:43.127422 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 114/200] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:42 2022] GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c => generated 1319 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:07:43.497252 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e9cddd48-006c-4fa4-8279-deb7171e6694 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:43.499077 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e9cddd48-006c-4fa4-8279-deb7171e6694 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] [instance: 8bf8828b-5b17-4317-a6b8-7856d023986a] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:43.506737 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e9cddd48-006c-4fa4-8279-deb7171e6694 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:43.507273 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e9cddd48-006c-4fa4-8279-deb7171e6694 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:43.508813 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e9cddd48-006c-4fa4-8279-deb7171e6694 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:43.509424 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e9cddd48-006c-4fa4-8279-deb7171e6694 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:43.716107 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-83a49a20-6df7-408c-bdc8-65a575602b5c tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:43.716799 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-83a49a20-6df7-408c-bdc8-65a575602b5c tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 8d5cf7af-51b8-4392-a551-9d0d9b96a45d] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:43.741548 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-83a49a20-6df7-408c-bdc8-65a575602b5c tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:43.741548 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-83a49a20-6df7-408c-bdc8-65a575602b5c tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:43.750802 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-83a49a20-6df7-408c-bdc8-65a575602b5c tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:43.752858 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-83a49a20-6df7-408c-bdc8-65a575602b5c tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:43.785777 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e9cddd48-006c-4fa4-8279-deb7171e6694 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c25e69f3ab461a99dac0a9a9ada83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99672927446f4ecfb3b1e170073b6797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:43.795325 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e9cddd48-006c-4fa4-8279-deb7171e6694 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a" status: 200 len: 1485 microversion: 2.1 time: 0.303890 Apr 16 21:07:43.807905 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 87/201] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:43 2022] GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a => generated 1485 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:43.829716 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cdc1e3f7-a5eb-4e2c-897b-ce1ed5ee84b2 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:43.829716 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-cdc1e3f7-a5eb-4e2c-897b-ce1ed5ee84b2 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] [instance: 8bf8828b-5b17-4317-a6b8-7856d023986a] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:43.845795 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cdc1e3f7-a5eb-4e2c-897b-ce1ed5ee84b2 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:43.846253 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cdc1e3f7-a5eb-4e2c-897b-ce1ed5ee84b2 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:43.847100 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cdc1e3f7-a5eb-4e2c-897b-ce1ed5ee84b2 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:43.848835 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cdc1e3f7-a5eb-4e2c-897b-ce1ed5ee84b2 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:43.857925 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-83a49a20-6df7-408c-bdc8-65a575602b5c tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7da58ce23242bd947bbd7387b80b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6395bf8972949f8837289679b58d151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:43.865524 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-83a49a20-6df7-408c-bdc8-65a575602b5c tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "GET /compute/v2.1/servers/8d5cf7af-51b8-4392-a551-9d0d9b96a45d" status: 200 len: 1317 microversion: 2.1 time: 0.154092 Apr 16 21:07:43.871137 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 115/202] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:43 2022] GET /compute/v2.1/servers/8d5cf7af-51b8-4392-a551-9d0d9b96a45d => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:44.134562 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5d39548f-de57-4608-bdf8-addd7f89fc91 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:44.135543 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5d39548f-de57-4608-bdf8-addd7f89fc91 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:44.143304 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5d39548f-de57-4608-bdf8-addd7f89fc91 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:44.143304 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5d39548f-de57-4608-bdf8-addd7f89fc91 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:44.143910 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5d39548f-de57-4608-bdf8-addd7f89fc91 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:44.144432 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5d39548f-de57-4608-bdf8-addd7f89fc91 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:44.225971 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cdc1e3f7-a5eb-4e2c-897b-ce1ed5ee84b2 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a" status: 200 len: 1636 microversion: 2.1 time: 0.402303 Apr 16 21:07:44.230005 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 88/203] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:43 2022] GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a => generated 1636 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:44.247617 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b5fcb9c2-8549-4a89-9c3b-d87f7bcb5521 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:44.248666 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b5fcb9c2-8549-4a89-9c3b-d87f7bcb5521 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] [instance: 8bf8828b-5b17-4317-a6b8-7856d023986a] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:44.258416 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b5fcb9c2-8549-4a89-9c3b-d87f7bcb5521 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:44.258880 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b5fcb9c2-8549-4a89-9c3b-d87f7bcb5521 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:44.263123 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b5fcb9c2-8549-4a89-9c3b-d87f7bcb5521 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:44.263745 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b5fcb9c2-8549-4a89-9c3b-d87f7bcb5521 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:44.308749 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b5fcb9c2-8549-4a89-9c3b-d87f7bcb5521 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] [instance: 8bf8828b-5b17-4317-a6b8-7856d023986a] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:07:44.363922 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5d39548f-de57-4608-bdf8-addd7f89fc91 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82856a20b3764d17b5c9c1bebdd46c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998f0203a6c741839bde8be2da375d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:44.373151 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5d39548f-de57-4608-bdf8-addd7f89fc91 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c" status: 200 len: 1319 microversion: 2.1 time: 0.243332 Apr 16 21:07:44.376518 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 116/204] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:44 2022] GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c => generated 1319 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:07:44.819954 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b5fcb9c2-8549-4a89-9c3b-d87f7bcb5521 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a" status: 204 len: 0 microversion: 2.1 time: 0.577400 Apr 16 21:07:44.820887 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 89/205] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:07:44 2022] DELETE /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a => generated 0 bytes in 580 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:07:44.829951 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ef0dc026-6850-4245-9bf8-311b6acaa92a tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:44.830763 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ef0dc026-6850-4245-9bf8-311b6acaa92a tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] [instance: 8bf8828b-5b17-4317-a6b8-7856d023986a] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:44.838388 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ef0dc026-6850-4245-9bf8-311b6acaa92a tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:44.839598 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ef0dc026-6850-4245-9bf8-311b6acaa92a tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:44.840047 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ef0dc026-6850-4245-9bf8-311b6acaa92a tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:44.840537 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ef0dc026-6850-4245-9bf8-311b6acaa92a tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:44.886398 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0fc25ebb-64ef-4824-847c-22df6e80f8aa tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:44.887332 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0fc25ebb-64ef-4824-847c-22df6e80f8aa tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 8d5cf7af-51b8-4392-a551-9d0d9b96a45d] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:44.896098 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0fc25ebb-64ef-4824-847c-22df6e80f8aa tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:44.896610 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0fc25ebb-64ef-4824-847c-22df6e80f8aa tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:44.898129 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0fc25ebb-64ef-4824-847c-22df6e80f8aa tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:44.899307 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0fc25ebb-64ef-4824-847c-22df6e80f8aa tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:45.066397 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ef0dc026-6850-4245-9bf8-311b6acaa92a tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c25e69f3ab461a99dac0a9a9ada83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99672927446f4ecfb3b1e170073b6797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:45.076511 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ef0dc026-6850-4245-9bf8-311b6acaa92a tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a" status: 200 len: 1491 microversion: 2.1 time: 0.251112 Apr 16 21:07:45.077103 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 117/206] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:44 2022] GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a => generated 1491 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:45.164992 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0fc25ebb-64ef-4824-847c-22df6e80f8aa tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7da58ce23242bd947bbd7387b80b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6395bf8972949f8837289679b58d151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:45.174146 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0fc25ebb-64ef-4824-847c-22df6e80f8aa tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "GET /compute/v2.1/servers/8d5cf7af-51b8-4392-a551-9d0d9b96a45d" status: 200 len: 1385 microversion: 2.1 time: 0.292616 Apr 16 21:07:45.174761 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 90/207] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:44 2022] GET /compute/v2.1/servers/8d5cf7af-51b8-4392-a551-9d0d9b96a45d => generated 1385 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:45.356146 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-56d3972d-9614-41aa-a9ac-8bbaa3921680 req-79d7256e-a574-48fd-a953-f2b3128610f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d5cf7af-51b8-4392-a551-9d0d9b96a45d", "tag": "803ab649-d886-491f-afac-b601816b1ffe"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:45.371025 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-56d3972d-9614-41aa-a9ac-8bbaa3921680 req-79d7256e-a574-48fd-a953-f2b3128610f0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:45.371501 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-56d3972d-9614-41aa-a9ac-8bbaa3921680 req-79d7256e-a574-48fd-a953-f2b3128610f0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:45.385301 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-56d3972d-9614-41aa-a9ac-8bbaa3921680 req-79d7256e-a574-48fd-a953-f2b3128610f0 service nova] Creating event network-changed:803ab649-d886-491f-afac-b601816b1ffe for instance 8d5cf7af-51b8-4392-a551-9d0d9b96a45d on nch2-master-1 Apr 16 21:07:45.391631 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8eb3bd0a-46c4-421b-a084-6adf68b4b082 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:45.392550 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8eb3bd0a-46c4-421b-a084-6adf68b4b082 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:45.404700 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8eb3bd0a-46c4-421b-a084-6adf68b4b082 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:45.405200 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8eb3bd0a-46c4-421b-a084-6adf68b4b082 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:45.406720 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-56d3972d-9614-41aa-a9ac-8bbaa3921680 req-79d7256e-a574-48fd-a953-f2b3128610f0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051489 Apr 16 21:07:45.407226 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8eb3bd0a-46c4-421b-a084-6adf68b4b082 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:45.407833 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 118/208] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:45.408894 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8eb3bd0a-46c4-421b-a084-6adf68b4b082 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:45.800956 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8eb3bd0a-46c4-421b-a084-6adf68b4b082 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82856a20b3764d17b5c9c1bebdd46c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998f0203a6c741839bde8be2da375d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:45.808796 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8eb3bd0a-46c4-421b-a084-6adf68b4b082 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c" status: 200 len: 1319 microversion: 2.1 time: 0.422376 Apr 16 21:07:45.809761 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 91/209] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:45 2022] GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c => generated 1319 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:07:46.102796 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-aaa3d52a-2482-49ee-beea-4978eed0f460 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:46.104598 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-aaa3d52a-2482-49ee-beea-4978eed0f460 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] [instance: 8bf8828b-5b17-4317-a6b8-7856d023986a] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:46.114209 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aaa3d52a-2482-49ee-beea-4978eed0f460 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:46.114697 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aaa3d52a-2482-49ee-beea-4978eed0f460 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:46.116027 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aaa3d52a-2482-49ee-beea-4978eed0f460 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:46.116540 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aaa3d52a-2482-49ee-beea-4978eed0f460 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:46.191618 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6900723f-1d5b-4206-9d7d-55e86fd4ceba tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:46.192616 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6900723f-1d5b-4206-9d7d-55e86fd4ceba tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 8d5cf7af-51b8-4392-a551-9d0d9b96a45d] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:46.202082 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6900723f-1d5b-4206-9d7d-55e86fd4ceba tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:46.202916 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6900723f-1d5b-4206-9d7d-55e86fd4ceba tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:46.203780 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6900723f-1d5b-4206-9d7d-55e86fd4ceba tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:46.204317 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6900723f-1d5b-4206-9d7d-55e86fd4ceba tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:46.289133 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-aaa3d52a-2482-49ee-beea-4978eed0f460 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c25e69f3ab461a99dac0a9a9ada83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99672927446f4ecfb3b1e170073b6797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:46.298689 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-aaa3d52a-2482-49ee-beea-4978eed0f460 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a" status: 200 len: 1491 microversion: 2.1 time: 0.207748 Apr 16 21:07:46.304229 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 119/210] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:46 2022] GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a => generated 1491 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:46.562722 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6900723f-1d5b-4206-9d7d-55e86fd4ceba tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7da58ce23242bd947bbd7387b80b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6395bf8972949f8837289679b58d151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:46.570111 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6900723f-1d5b-4206-9d7d-55e86fd4ceba tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "GET /compute/v2.1/servers/8d5cf7af-51b8-4392-a551-9d0d9b96a45d" status: 200 len: 1385 microversion: 2.1 time: 0.383148 Apr 16 21:07:46.580585 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 92/211] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:46 2022] GET /compute/v2.1/servers/8d5cf7af-51b8-4392-a551-9d0d9b96a45d => generated 1385 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:07:46.826568 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-079e3944-95cf-4de3-a533-a46ffba7a86f tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:46.827393 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-079e3944-95cf-4de3-a533-a46ffba7a86f tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:46.834997 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-079e3944-95cf-4de3-a533-a46ffba7a86f tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:46.836452 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-079e3944-95cf-4de3-a533-a46ffba7a86f tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:46.836452 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-079e3944-95cf-4de3-a533-a46ffba7a86f tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:46.846041 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-079e3944-95cf-4de3-a533-a46ffba7a86f tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:46.990376 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-079e3944-95cf-4de3-a533-a46ffba7a86f tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82856a20b3764d17b5c9c1bebdd46c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998f0203a6c741839bde8be2da375d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:46.998674 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-079e3944-95cf-4de3-a533-a46ffba7a86f tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c" status: 200 len: 1469 microversion: 2.1 time: 0.176082 Apr 16 21:07:46.999493 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 120/212] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:46 2022] GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c => generated 1469 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:47.316795 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-899b43a3-d68b-472f-87cd-bb6c8c468ed4 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:47.316795 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-899b43a3-d68b-472f-87cd-bb6c8c468ed4 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] [instance: 8bf8828b-5b17-4317-a6b8-7856d023986a] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:47.344437 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-899b43a3-d68b-472f-87cd-bb6c8c468ed4 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:47.348690 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-899b43a3-d68b-472f-87cd-bb6c8c468ed4 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:47.348690 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-899b43a3-d68b-472f-87cd-bb6c8c468ed4 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:47.348690 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-899b43a3-d68b-472f-87cd-bb6c8c468ed4 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:47.431803 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-899b43a3-d68b-472f-87cd-bb6c8c468ed4 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c25e69f3ab461a99dac0a9a9ada83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99672927446f4ecfb3b1e170073b6797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:47.441036 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-899b43a3-d68b-472f-87cd-bb6c8c468ed4 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a" status: 200 len: 1449 microversion: 2.1 time: 0.129516 Apr 16 21:07:47.441968 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 121/213] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:47 2022] GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a => generated 1449 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:47.451796 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4fa597c9-8efb-43ae-bf5d-90864ad55d6e tempest-DeleteServersAdminTestJSON-401140112 tempest-DeleteServersAdminTestJSON-401140112-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:47.456512 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4fa597c9-8efb-43ae-bf5d-90864ad55d6e tempest-DeleteServersAdminTestJSON-401140112 tempest-DeleteServersAdminTestJSON-401140112-project-admin] [instance: 0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:47.456736 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-d8282e4b-28fc-4ffa-955b-262bdd80e90a req-c3719513-49af-40b5-b633-d9fc249e60a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bf8828b-5b17-4317-a6b8-7856d023986a", "name": "network-vif-deleted", "tag": "e2e09b69-7c90-4dc0-8fc8-f2c75d98a0f4"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:47.463984 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4fa597c9-8efb-43ae-bf5d-90864ad55d6e tempest-DeleteServersAdminTestJSON-401140112 tempest-DeleteServersAdminTestJSON-401140112-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:47.465275 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-d8282e4b-28fc-4ffa-955b-262bdd80e90a req-c3719513-49af-40b5-b633-d9fc249e60a0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:47.465618 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4fa597c9-8efb-43ae-bf5d-90864ad55d6e tempest-DeleteServersAdminTestJSON-401140112 tempest-DeleteServersAdminTestJSON-401140112-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:47.465743 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-d8282e4b-28fc-4ffa-955b-262bdd80e90a req-c3719513-49af-40b5-b633-d9fc249e60a0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:47.467441 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4fa597c9-8efb-43ae-bf5d-90864ad55d6e tempest-DeleteServersAdminTestJSON-401140112 tempest-DeleteServersAdminTestJSON-401140112-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:47.468401 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4fa597c9-8efb-43ae-bf5d-90864ad55d6e tempest-DeleteServersAdminTestJSON-401140112 tempest-DeleteServersAdminTestJSON-401140112-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:47.483081 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-d8282e4b-28fc-4ffa-955b-262bdd80e90a req-c3719513-49af-40b5-b633-d9fc249e60a0 service nova] Creating event network-vif-deleted:e2e09b69-7c90-4dc0-8fc8-f2c75d98a0f4 for instance 8bf8828b-5b17-4317-a6b8-7856d023986a on nch1-master-1 Apr 16 21:07:47.488639 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-d8282e4b-28fc-4ffa-955b-262bdd80e90a req-c3719513-49af-40b5-b633-d9fc249e60a0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045190 Apr 16 21:07:47.489568 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 122/214] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:47.507193 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4fa597c9-8efb-43ae-bf5d-90864ad55d6e tempest-DeleteServersAdminTestJSON-401140112 tempest-DeleteServersAdminTestJSON-401140112-project-admin] [instance: 0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:07:47.589973 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-552f005f-5219-4dc4-a015-36c57d0cc676 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:47.590792 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-552f005f-5219-4dc4-a015-36c57d0cc676 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 8d5cf7af-51b8-4392-a551-9d0d9b96a45d] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:47.597468 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-552f005f-5219-4dc4-a015-36c57d0cc676 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:47.597996 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-552f005f-5219-4dc4-a015-36c57d0cc676 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:47.598842 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-552f005f-5219-4dc4-a015-36c57d0cc676 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:47.599400 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-552f005f-5219-4dc4-a015-36c57d0cc676 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:47.760747 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-552f005f-5219-4dc4-a015-36c57d0cc676 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7da58ce23242bd947bbd7387b80b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6395bf8972949f8837289679b58d151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:47.768868 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-552f005f-5219-4dc4-a015-36c57d0cc676 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "GET /compute/v2.1/servers/8d5cf7af-51b8-4392-a551-9d0d9b96a45d" status: 200 len: 1385 microversion: 2.1 time: 0.183834 Apr 16 21:07:47.769607 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 123/215] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:47 2022] GET /compute/v2.1/servers/8d5cf7af-51b8-4392-a551-9d0d9b96a45d => generated 1385 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:07:47.812870 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4fa597c9-8efb-43ae-bf5d-90864ad55d6e tempest-DeleteServersAdminTestJSON-401140112 tempest-DeleteServersAdminTestJSON-401140112-project-admin] 10.222.0.20 "DELETE /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c" status: 204 len: 0 microversion: 2.1 time: 0.800307 Apr 16 21:07:47.813550 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 93/216] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:07:47 2022] DELETE /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c => generated 0 bytes in 802 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:07:47.822221 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9b66d828-6123-4048-a43b-bcf09eb64cff tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:47.822949 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9b66d828-6123-4048-a43b-bcf09eb64cff tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:47.829107 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9b66d828-6123-4048-a43b-bcf09eb64cff tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:47.829552 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9b66d828-6123-4048-a43b-bcf09eb64cff tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:47.830340 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9b66d828-6123-4048-a43b-bcf09eb64cff tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:47.830772 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9b66d828-6123-4048-a43b-bcf09eb64cff tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:47.971067 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9b66d828-6123-4048-a43b-bcf09eb64cff tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82856a20b3764d17b5c9c1bebdd46c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998f0203a6c741839bde8be2da375d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:47.980849 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9b66d828-6123-4048-a43b-bcf09eb64cff tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c" status: 200 len: 1475 microversion: 2.1 time: 0.163072 Apr 16 21:07:47.990565 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 124/217] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:47 2022] GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c => generated 1475 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:48.460214 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e37bde50-295d-46a9-9352-a06059974f9b tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:48.461137 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e37bde50-295d-46a9-9352-a06059974f9b tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] [instance: 8bf8828b-5b17-4317-a6b8-7856d023986a] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:48.471350 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e37bde50-295d-46a9-9352-a06059974f9b tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:48.472114 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e37bde50-295d-46a9-9352-a06059974f9b tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:48.473216 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e37bde50-295d-46a9-9352-a06059974f9b tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:48.473670 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e37bde50-295d-46a9-9352-a06059974f9b tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:48.508591 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e37bde50-295d-46a9-9352-a06059974f9b tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:48.509134 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e37bde50-295d-46a9-9352-a06059974f9b tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:48.509607 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-e37bde50-295d-46a9-9352-a06059974f9b tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lazy-loading 'fault' on Instance uuid 8bf8828b-5b17-4317-a6b8-7856d023986a {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:07:48.555576 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e37bde50-295d-46a9-9352-a06059974f9b tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4c25e69f3ab461a99dac0a9a9ada83c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99672927446f4ecfb3b1e170073b6797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:48.563937 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e37bde50-295d-46a9-9352-a06059974f9b tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a" status: 200 len: 1327 microversion: 2.1 time: 0.108734 Apr 16 21:07:48.564537 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 94/218] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:48 2022] GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a => generated 1327 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:48.786137 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-71b851b8-3b81-4ae7-9897-2f09f9fe1349 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:48.786753 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-71b851b8-3b81-4ae7-9897-2f09f9fe1349 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 8d5cf7af-51b8-4392-a551-9d0d9b96a45d] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:48.793854 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-71b851b8-3b81-4ae7-9897-2f09f9fe1349 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:48.797746 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-71b851b8-3b81-4ae7-9897-2f09f9fe1349 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:48.797746 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-71b851b8-3b81-4ae7-9897-2f09f9fe1349 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:48.797746 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-71b851b8-3b81-4ae7-9897-2f09f9fe1349 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:48.806344 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-628ef938-86a7-409f-9930-d9762bd47c86 tempest-HypervisorAdminUnderV252Test-1355494109 tempest-HypervisorAdminUnderV252Test-1355494109-project-admin] Calling method '.version_select at 0x7fbb9c0cadc0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:48.807488 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:48.807488 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:48.810079 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-628ef938-86a7-409f-9930-d9762bd47c86 tempest-HypervisorAdminUnderV252Test-1355494109 tempest-HypervisorAdminUnderV252Test-1355494109-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:48.810758 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-628ef938-86a7-409f-9930-d9762bd47c86 tempest-HypervisorAdminUnderV252Test-1355494109 tempest-HypervisorAdminUnderV252Test-1355494109-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:48.829983 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-628ef938-86a7-409f-9930-d9762bd47c86 tempest-HypervisorAdminUnderV252Test-1355494109 tempest-HypervisorAdminUnderV252Test-1355494109-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:48.830524 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-628ef938-86a7-409f-9930-d9762bd47c86 tempest-HypervisorAdminUnderV252Test-1355494109 tempest-HypervisorAdminUnderV252Test-1355494109-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:48.844337 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-628ef938-86a7-409f-9930-d9762bd47c86 tempest-HypervisorAdminUnderV252Test-1355494109 tempest-HypervisorAdminUnderV252Test-1355494109-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:48.844337 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-628ef938-86a7-409f-9930-d9762bd47c86 tempest-HypervisorAdminUnderV252Test-1355494109 tempest-HypervisorAdminUnderV252Test-1355494109-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:48.850836 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-628ef938-86a7-409f-9930-d9762bd47c86 tempest-HypervisorAdminUnderV252Test-1355494109 tempest-HypervisorAdminUnderV252Test-1355494109-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.361754 Apr 16 21:07:48.852863 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 125/219] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:07:48 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:48.864579 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2652d464-18ee-437c-9482-e9f042404b01 tempest-HypervisorAdminUnderV252Test-1355494109 tempest-HypervisorAdminUnderV252Test-1355494109-project-admin] Calling method '.version_select at 0x7fbb9c0c0430>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:48.864579 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:48.864579 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:48.866435 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2652d464-18ee-437c-9482-e9f042404b01 tempest-HypervisorAdminUnderV252Test-1355494109 tempest-HypervisorAdminUnderV252Test-1355494109-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:48.867218 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2652d464-18ee-437c-9482-e9f042404b01 tempest-HypervisorAdminUnderV252Test-1355494109 tempest-HypervisorAdminUnderV252Test-1355494109-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:48.887932 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2652d464-18ee-437c-9482-e9f042404b01 tempest-HypervisorAdminUnderV252Test-1355494109 tempest-HypervisorAdminUnderV252Test-1355494109-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:48.888354 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2652d464-18ee-437c-9482-e9f042404b01 tempest-HypervisorAdminUnderV252Test-1355494109 tempest-HypervisorAdminUnderV252Test-1355494109-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:48.902906 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2652d464-18ee-437c-9482-e9f042404b01 tempest-HypervisorAdminUnderV252Test-1355494109 tempest-HypervisorAdminUnderV252Test-1355494109-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:48.903534 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2652d464-18ee-437c-9482-e9f042404b01 tempest-HypervisorAdminUnderV252Test-1355494109 tempest-HypervisorAdminUnderV252Test-1355494109-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:48.909624 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2652d464-18ee-437c-9482-e9f042404b01 tempest-HypervisorAdminUnderV252Test-1355494109 tempest-HypervisorAdminUnderV252Test-1355494109-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/nch1-master-1/servers" status: 200 len: 104 microversion: 2.1 time: 0.051213 Apr 16 21:07:48.910781 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 126/220] 10.222.0.20 () {58 vars in 1211 bytes} [Sat Apr 16 21:07:48 2022] GET /compute/v2.1/os-hypervisors/nch1-master-1/servers => generated 104 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:48.922167 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1f24de75-c8d4-415d-893a-69179a28d871 tempest-HypervisorAdminUnderV252Test-1355494109 tempest-HypervisorAdminUnderV252Test-1355494109-project-admin] Calling method '.version_select at 0x7fbb9c0c0e50>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:48.923006 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:48.923006 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:48.924320 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1f24de75-c8d4-415d-893a-69179a28d871 tempest-HypervisorAdminUnderV252Test-1355494109 tempest-HypervisorAdminUnderV252Test-1355494109-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:48.924778 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1f24de75-c8d4-415d-893a-69179a28d871 tempest-HypervisorAdminUnderV252Test-1355494109 tempest-HypervisorAdminUnderV252Test-1355494109-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:48.939190 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1f24de75-c8d4-415d-893a-69179a28d871 tempest-HypervisorAdminUnderV252Test-1355494109 tempest-HypervisorAdminUnderV252Test-1355494109-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:48.939642 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1f24de75-c8d4-415d-893a-69179a28d871 tempest-HypervisorAdminUnderV252Test-1355494109 tempest-HypervisorAdminUnderV252Test-1355494109-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:48.950433 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1f24de75-c8d4-415d-893a-69179a28d871 tempest-HypervisorAdminUnderV252Test-1355494109 tempest-HypervisorAdminUnderV252Test-1355494109-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:48.951152 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1f24de75-c8d4-415d-893a-69179a28d871 tempest-HypervisorAdminUnderV252Test-1355494109 tempest-HypervisorAdminUnderV252Test-1355494109-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:48.956860 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1f24de75-c8d4-415d-893a-69179a28d871 tempest-HypervisorAdminUnderV252Test-1355494109 tempest-HypervisorAdminUnderV252Test-1355494109-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.038212 Apr 16 21:07:48.957625 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 127/221] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:07:48 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:07:48.967004 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f2182de8-71ea-4fcb-94be-009961901cef tempest-HypervisorAdminUnderV252Test-1355494109 tempest-HypervisorAdminUnderV252Test-1355494109-project-admin] Calling method '.version_select at 0x7fbb9c0a74c0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:48.967781 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:48.967781 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:48.968927 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f2182de8-71ea-4fcb-94be-009961901cef tempest-HypervisorAdminUnderV252Test-1355494109 tempest-HypervisorAdminUnderV252Test-1355494109-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:48.969466 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f2182de8-71ea-4fcb-94be-009961901cef tempest-HypervisorAdminUnderV252Test-1355494109 tempest-HypervisorAdminUnderV252Test-1355494109-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:48.972580 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-71b851b8-3b81-4ae7-9897-2f09f9fe1349 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7da58ce23242bd947bbd7387b80b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6395bf8972949f8837289679b58d151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:48.983145 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-71b851b8-3b81-4ae7-9897-2f09f9fe1349 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "GET /compute/v2.1/servers/8d5cf7af-51b8-4392-a551-9d0d9b96a45d" status: 200 len: 1385 microversion: 2.1 time: 0.200460 Apr 16 21:07:48.983640 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f2182de8-71ea-4fcb-94be-009961901cef tempest-HypervisorAdminUnderV252Test-1355494109 tempest-HypervisorAdminUnderV252Test-1355494109-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:48.984254 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f2182de8-71ea-4fcb-94be-009961901cef tempest-HypervisorAdminUnderV252Test-1355494109 tempest-HypervisorAdminUnderV252Test-1355494109-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:48.984474 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 95/222] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:48 2022] GET /compute/v2.1/servers/8d5cf7af-51b8-4392-a551-9d0d9b96a45d => generated 1385 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:07:48.990652 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f2182de8-71ea-4fcb-94be-009961901cef tempest-HypervisorAdminUnderV252Test-1355494109 tempest-HypervisorAdminUnderV252Test-1355494109-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/nch1-master-1/search" status: 200 len: 104 microversion: 2.1 time: 0.027097 Apr 16 21:07:48.997133 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 128/223] 10.222.0.20 () {58 vars in 1208 bytes} [Sat Apr 16 21:07:48 2022] GET /compute/v2.1/os-hypervisors/nch1-master-1/search => generated 104 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:07:48.998411 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-830d5abc-35e5-44ed-9438-8b78c836850e tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:48.999246 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-830d5abc-35e5-44ed-9438-8b78c836850e tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:49.005922 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-830d5abc-35e5-44ed-9438-8b78c836850e tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:49.006609 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-830d5abc-35e5-44ed-9438-8b78c836850e tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:49.007395 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-830d5abc-35e5-44ed-9438-8b78c836850e tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:49.007873 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-830d5abc-35e5-44ed-9438-8b78c836850e tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:49.137472 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-830d5abc-35e5-44ed-9438-8b78c836850e tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82856a20b3764d17b5c9c1bebdd46c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998f0203a6c741839bde8be2da375d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:49.146567 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-830d5abc-35e5-44ed-9438-8b78c836850e tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c" status: 200 len: 1475 microversion: 2.1 time: 0.152248 Apr 16 21:07:49.147075 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 96/224] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:48 2022] GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c => generated 1475 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:07:49.659890 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-997a287c-0566-4397-bd6f-738617d1fb75 tempest-HypervisorAdminNegativeUnderV252Test-562571715 tempest-HypervisorAdminNegativeUnderV252Test-562571715-project-admin] Calling method '.version_select at 0x7fbb9c212670>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:49.660703 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:49.660703 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:49.665487 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-997a287c-0566-4397-bd6f-738617d1fb75 tempest-HypervisorAdminNegativeUnderV252Test-562571715 tempest-HypervisorAdminNegativeUnderV252Test-562571715-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:49.665487 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-997a287c-0566-4397-bd6f-738617d1fb75 tempest-HypervisorAdminNegativeUnderV252Test-562571715 tempest-HypervisorAdminNegativeUnderV252Test-562571715-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:49.674619 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8014cc43-f96d-4fc0-8c80-340c26832ba6 tempest-QuotasAdminTestV257-1049568015 tempest-QuotasAdminTestV257-1049568015-project-admin] Action: 'update', calling method: .version_select at 0x7fbb9c120940>, body: {"quota_set": {"ram": "5120"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:49.676382 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-997a287c-0566-4397-bd6f-738617d1fb75 tempest-HypervisorAdminNegativeUnderV252Test-562571715 tempest-HypervisorAdminNegativeUnderV252Test-562571715-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:49.676838 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-997a287c-0566-4397-bd6f-738617d1fb75 tempest-HypervisorAdminNegativeUnderV252Test-562571715 tempest-HypervisorAdminNegativeUnderV252Test-562571715-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:49.691773 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-997a287c-0566-4397-bd6f-738617d1fb75 tempest-HypervisorAdminNegativeUnderV252Test-562571715 tempest-HypervisorAdminNegativeUnderV252Test-562571715-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:49.692109 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-997a287c-0566-4397-bd6f-738617d1fb75 tempest-HypervisorAdminNegativeUnderV252Test-562571715 tempest-HypervisorAdminNegativeUnderV252Test-562571715-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:49.698916 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-997a287c-0566-4397-bd6f-738617d1fb75 tempest-HypervisorAdminNegativeUnderV252Test-562571715 tempest-HypervisorAdminNegativeUnderV252Test-562571715-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.226020 Apr 16 21:07:49.699655 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 129/225] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:07:49 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:49.710242 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5f995924-0243-406f-b5fa-ee9c8ad0aca4 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:49.710887 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5f995924-0243-406f-b5fa-ee9c8ad0aca4 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] [instance: 8bf8828b-5b17-4317-a6b8-7856d023986a] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:49.717132 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5f995924-0243-406f-b5fa-ee9c8ad0aca4 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:49.717600 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5f995924-0243-406f-b5fa-ee9c8ad0aca4 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:49.718695 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5f995924-0243-406f-b5fa-ee9c8ad0aca4 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:49.719320 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5f995924-0243-406f-b5fa-ee9c8ad0aca4 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:49.736225 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-5f995924-0243-406f-b5fa-ee9c8ad0aca4 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] HTTP exception thrown: Instance 8bf8828b-5b17-4317-a6b8-7856d023986a could not be found. Apr 16 21:07:49.736416 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8014cc43-f96d-4fc0-8c80-340c26832ba6 tempest-QuotasAdminTestV257-1049568015 tempest-QuotasAdminTestV257-1049568015-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:49.736986 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8014cc43-f96d-4fc0-8c80-340c26832ba6 tempest-QuotasAdminTestV257-1049568015 tempest-QuotasAdminTestV257-1049568015-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:49.737191 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5f995924-0243-406f-b5fa-ee9c8ad0aca4 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Returning 404 to user: Instance 8bf8828b-5b17-4317-a6b8-7856d023986a could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:07:49.737790 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8014cc43-f96d-4fc0-8c80-340c26832ba6 tempest-QuotasAdminTestV257-1049568015 tempest-QuotasAdminTestV257-1049568015-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:49.738153 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5f995924-0243-406f-b5fa-ee9c8ad0aca4 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a" status: 404 len: 111 microversion: 2.1 time: 0.037591 Apr 16 21:07:49.738260 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8014cc43-f96d-4fc0-8c80-340c26832ba6 tempest-QuotasAdminTestV257-1049568015 tempest-QuotasAdminTestV257-1049568015-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:49.742937 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 130/226] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:49 2022] GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:07:49.855123 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-44d43c62-d277-43b9-b6b1-ca39bf46f10b tempest-HypervisorAdminNegativeUnderV252Test-277523423 tempest-HypervisorAdminNegativeUnderV252Test-277523423-project] Calling method '.version_select at 0x7fbb9c0aa040>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:49.855921 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:49.855921 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:49.857044 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-44d43c62-d277-43b9-b6b1-ca39bf46f10b tempest-HypervisorAdminNegativeUnderV252Test-277523423 tempest-HypervisorAdminNegativeUnderV252Test-277523423-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'fd291d872fde44cc900a99aab7b77f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15a1fbbd0514941bbbe4a26b2578af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:49.857713 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-44d43c62-d277-43b9-b6b1-ca39bf46f10b tempest-HypervisorAdminNegativeUnderV252Test-277523423 tempest-HypervisorAdminNegativeUnderV252Test-277523423-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:07:49.858505 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-44d43c62-d277-43b9-b6b1-ca39bf46f10b tempest-HypervisorAdminNegativeUnderV252Test-277523423 tempest-HypervisorAdminNegativeUnderV252Test-277523423-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/nch1-master-1/search" status: 403 len: 117 microversion: 2.1 time: 0.118368 Apr 16 21:07:49.859037 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 131/227] 10.222.0.20 () {58 vars in 1208 bytes} [Sat Apr 16 21:07:49 2022] GET /compute/v2.1/os-hypervisors/nch1-master-1/search => generated 117 bytes in 119 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:07:49.864832 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2ec7be38-5155-4f8e-9ff2-1e255be069c9 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:49.866132 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:49.866132 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:49.876003 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2ec7be38-5155-4f8e-9ff2-1e255be069c9 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:49.876498 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2ec7be38-5155-4f8e-9ff2-1e255be069c9 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:49.889226 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8014cc43-f96d-4fc0-8c80-340c26832ba6 tempest-QuotasAdminTestV257-1049568015 tempest-QuotasAdminTestV257-1049568015-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/d44d7bca45d646019a4b35a5c7a49b4d" status: 200 len: 148 microversion: 2.57 time: 0.342028 Apr 16 21:07:49.889895 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 97/228] 10.222.0.20 () {62 vars in 1302 bytes} [Sat Apr 16 21:07:49 2022] PUT /compute/v2.1/os-quota-sets/d44d7bca45d646019a4b35a5c7a49b4d => generated 148 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 16 21:07:49.894441 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-76a2946d-a916-4f33-a4c5-695f4d49ed08 tempest-HypervisorAdminNegativeUnderV252Test-562571715 tempest-HypervisorAdminNegativeUnderV252Test-562571715-project-admin] Calling method '.version_select at 0x7fbb9c03b0d0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:49.895557 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:49.895557 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:49.896709 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-76a2946d-a916-4f33-a4c5-695f4d49ed08 tempest-HypervisorAdminNegativeUnderV252Test-562571715 tempest-HypervisorAdminNegativeUnderV252Test-562571715-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:49.897191 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-76a2946d-a916-4f33-a4c5-695f4d49ed08 tempest-HypervisorAdminNegativeUnderV252Test-562571715 tempest-HypervisorAdminNegativeUnderV252Test-562571715-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:49.909558 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-76a2946d-a916-4f33-a4c5-695f4d49ed08 tempest-HypervisorAdminNegativeUnderV252Test-562571715 tempest-HypervisorAdminNegativeUnderV252Test-562571715-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Apr 16 21:07:49.910156 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-76a2946d-a916-4f33-a4c5-695f4d49ed08 tempest-HypervisorAdminNegativeUnderV252Test-562571715 tempest-HypervisorAdminNegativeUnderV252Test-562571715-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:07:49.917694 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-76a2946d-a916-4f33-a4c5-695f4d49ed08 tempest-HypervisorAdminNegativeUnderV252Test-562571715 tempest-HypervisorAdminNegativeUnderV252Test-562571715-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.020020 Apr 16 21:07:49.917694 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 98/229] 10.222.0.20 () {58 vars in 1250 bytes} [Sat Apr 16 21:07:49 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:07:49.917694 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6aec3a63-823e-45b0-a1b0-f3836223c4cd tempest-QuotasAdminTestV257-1049568015 tempest-QuotasAdminTestV257-1049568015-project-admin] Calling method '.version_select at 0x7fbb96f418b0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:49.981716 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6aec3a63-823e-45b0-a1b0-f3836223c4cd tempest-QuotasAdminTestV257-1049568015 tempest-QuotasAdminTestV257-1049568015-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:49.982317 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6aec3a63-823e-45b0-a1b0-f3836223c4cd tempest-QuotasAdminTestV257-1049568015 tempest-QuotasAdminTestV257-1049568015-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:49.983118 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6aec3a63-823e-45b0-a1b0-f3836223c4cd tempest-QuotasAdminTestV257-1049568015 tempest-QuotasAdminTestV257-1049568015-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:49.983567 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6aec3a63-823e-45b0-a1b0-f3836223c4cd tempest-QuotasAdminTestV257-1049568015 tempest-QuotasAdminTestV257-1049568015-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:50.002353 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6aec3a63-823e-45b0-a1b0-f3836223c4cd tempest-QuotasAdminTestV257-1049568015 tempest-QuotasAdminTestV257-1049568015-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/d44d7bca45d646019a4b35a5c7a49b4d/detail" status: 200 len: 463 microversion: 2.57 time: 0.089864 Apr 16 21:07:50.002958 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 99/230] 10.222.0.20 () {60 vars in 1303 bytes} [Sat Apr 16 21:07:49 2022] GET /compute/v2.1/os-quota-sets/d44d7bca45d646019a4b35a5c7a49b4d/detail => generated 463 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:07:50.007221 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a7a3d2c7-063f-4cbd-8cce-9b6a06ae7431 tempest-HypervisorAdminNegativeUnderV252Test-562571715 tempest-HypervisorAdminNegativeUnderV252Test-562571715-project-admin] Calling method '.version_select at 0x7fbb96f41f70>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:50.008032 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:50.008032 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:50.009843 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a7a3d2c7-063f-4cbd-8cce-9b6a06ae7431 tempest-HypervisorAdminNegativeUnderV252Test-562571715 tempest-HypervisorAdminNegativeUnderV252Test-562571715-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:50.010460 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a7a3d2c7-063f-4cbd-8cce-9b6a06ae7431 tempest-HypervisorAdminNegativeUnderV252Test-562571715 tempest-HypervisorAdminNegativeUnderV252Test-562571715-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:50.023358 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a7a3d2c7-063f-4cbd-8cce-9b6a06ae7431 tempest-HypervisorAdminNegativeUnderV252Test-562571715 tempest-HypervisorAdminNegativeUnderV252Test-562571715-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:50.023812 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a7a3d2c7-063f-4cbd-8cce-9b6a06ae7431 tempest-HypervisorAdminNegativeUnderV252Test-562571715 tempest-HypervisorAdminNegativeUnderV252Test-562571715-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:50.037059 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a7a3d2c7-063f-4cbd-8cce-9b6a06ae7431 tempest-HypervisorAdminNegativeUnderV252Test-562571715 tempest-HypervisorAdminNegativeUnderV252Test-562571715-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:50.037519 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a7a3d2c7-063f-4cbd-8cce-9b6a06ae7431 tempest-HypervisorAdminNegativeUnderV252Test-562571715 tempest-HypervisorAdminNegativeUnderV252Test-562571715-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:50.044629 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a7a3d2c7-063f-4cbd-8cce-9b6a06ae7431 tempest-HypervisorAdminNegativeUnderV252Test-562571715 tempest-HypervisorAdminNegativeUnderV252Test-562571715-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.040659 Apr 16 21:07:50.045258 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 100/231] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:07:50 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:50.050237 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d1e87a9e-729b-44be-8ccf-a602d4995c96 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:50.050916 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d1e87a9e-729b-44be-8ccf-a602d4995c96 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 8d5cf7af-51b8-4392-a551-9d0d9b96a45d] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:50.057428 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d1e87a9e-729b-44be-8ccf-a602d4995c96 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:50.057875 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d1e87a9e-729b-44be-8ccf-a602d4995c96 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:50.060371 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d1e87a9e-729b-44be-8ccf-a602d4995c96 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:50.060371 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d1e87a9e-729b-44be-8ccf-a602d4995c96 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:50.149633 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2ec7be38-5155-4f8e-9ff2-1e255be069c9 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 297 microversion: 2.1 time: 0.288329 Apr 16 21:07:50.150232 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 132/232] 10.222.0.20 () {60 vars in 1190 bytes} [Sat Apr 16 21:07:49 2022] POST /compute/v2.1/os-aggregates/3/action => generated 297 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:50.154881 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-35acd196-5346-4111-b51a-92f6fd30a9f1 tempest-HypervisorAdminNegativeUnderV252Test-277523423 tempest-HypervisorAdminNegativeUnderV252Test-277523423-project] Calling method '.version_select at 0x7fbb9c0a7310>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:50.156165 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:50.156165 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:50.157295 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-35acd196-5346-4111-b51a-92f6fd30a9f1 tempest-HypervisorAdminNegativeUnderV252Test-277523423 tempest-HypervisorAdminNegativeUnderV252Test-277523423-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'fd291d872fde44cc900a99aab7b77f35', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c15a1fbbd0514941bbbe4a26b2578af5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:50.157944 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-35acd196-5346-4111-b51a-92f6fd30a9f1 tempest-HypervisorAdminNegativeUnderV252Test-277523423 tempest-HypervisorAdminNegativeUnderV252Test-277523423-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:07:50.158754 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-35acd196-5346-4111-b51a-92f6fd30a9f1 tempest-HypervisorAdminNegativeUnderV252Test-277523423 tempest-HypervisorAdminNegativeUnderV252Test-277523423-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.007422 Apr 16 21:07:50.159287 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 133/233] 10.222.0.20 () {58 vars in 1175 bytes} [Sat Apr 16 21:07:50 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 8 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:07:50.163532 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5ff27f42-c397-4f8e-9809-c1622bdd1be9 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:50.165123 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:50.165123 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:50.199015 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d1e87a9e-729b-44be-8ccf-a602d4995c96 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7da58ce23242bd947bbd7387b80b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6395bf8972949f8837289679b58d151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:50.206264 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d1e87a9e-729b-44be-8ccf-a602d4995c96 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "GET /compute/v2.1/servers/8d5cf7af-51b8-4392-a551-9d0d9b96a45d" status: 200 len: 1385 microversion: 2.1 time: 0.159804 Apr 16 21:07:50.206821 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 101/234] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:50 2022] GET /compute/v2.1/servers/8d5cf7af-51b8-4392-a551-9d0d9b96a45d => generated 1385 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:50.211812 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-14ff2552-ab94-42f2-be39-3234c2726cf9 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:50.212393 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-14ff2552-ab94-42f2-be39-3234c2726cf9 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:50.217962 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-14ff2552-ab94-42f2-be39-3234c2726cf9 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:50.218414 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-14ff2552-ab94-42f2-be39-3234c2726cf9 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:50.219179 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-14ff2552-ab94-42f2-be39-3234c2726cf9 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:50.219747 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-14ff2552-ab94-42f2-be39-3234c2726cf9 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:50.296962 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5ff27f42-c397-4f8e-9809-c1622bdd1be9 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.136454 Apr 16 21:07:50.299398 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 134/235] 10.222.0.20 () {58 vars in 1151 bytes} [Sat Apr 16 21:07:50 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 16 21:07:50.307958 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-101017f1-7e28-405d-a77a-9fc1895d8815 tempest-HypervisorAdminNegativeUnderV252Test-562571715 tempest-HypervisorAdminNegativeUnderV252Test-562571715-project-admin] Calling method '.version_select at 0x7fbb9c3e0d30>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:50.313173 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:50.313173 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:50.317336 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-101017f1-7e28-405d-a77a-9fc1895d8815 tempest-HypervisorAdminNegativeUnderV252Test-562571715 tempest-HypervisorAdminNegativeUnderV252Test-562571715-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:50.317792 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-101017f1-7e28-405d-a77a-9fc1895d8815 tempest-HypervisorAdminNegativeUnderV252Test-562571715 tempest-HypervisorAdminNegativeUnderV252Test-562571715-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:50.324833 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-101017f1-7e28-405d-a77a-9fc1895d8815 tempest-HypervisorAdminNegativeUnderV252Test-562571715 tempest-HypervisorAdminNegativeUnderV252Test-562571715-project-admin] HTTP exception thrown: No hypervisor matching 'ea5790ff-4de0-42ef-9915-50d380455c86' could be found. Apr 16 21:07:50.325620 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-101017f1-7e28-405d-a77a-9fc1895d8815 tempest-HypervisorAdminNegativeUnderV252Test-562571715 tempest-HypervisorAdminNegativeUnderV252Test-562571715-project-admin] Returning 404 to user: No hypervisor matching 'ea5790ff-4de0-42ef-9915-50d380455c86' could be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:07:50.326901 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-101017f1-7e28-405d-a77a-9fc1895d8815 tempest-HypervisorAdminNegativeUnderV252Test-562571715 tempest-HypervisorAdminNegativeUnderV252Test-562571715-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/ea5790ff-4de0-42ef-9915-50d380455c86/servers" status: 404 len: 123 microversion: 2.1 time: 0.026415 Apr 16 21:07:50.328400 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 135/236] 10.222.0.20 () {58 vars in 1280 bytes} [Sat Apr 16 21:07:50 2022] GET /compute/v2.1/os-hypervisors/ea5790ff-4de0-42ef-9915-50d380455c86/servers => generated 123 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:07:50.334551 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-05f6bba8-3862-478e-a38b-0789b4cc4de2 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1950266271"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:50.336931 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:50.336931 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:50.338062 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.aggregate [None req-05f6bba8-3862-478e-a38b-0789b4cc4de2 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Generated uuid e080c8f8-28e5-4d0b-bd37-e93eaa859e00 for aggregate {{(pid=137408) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 16 21:07:50.376767 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-14ff2552-ab94-42f2-be39-3234c2726cf9 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82856a20b3764d17b5c9c1bebdd46c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998f0203a6c741839bde8be2da375d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:50.384713 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-14ff2552-ab94-42f2-be39-3234c2726cf9 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c" status: 200 len: 1475 microversion: 2.1 time: 0.176872 Apr 16 21:07:50.389188 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 102/237] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:50 2022] GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c => generated 1475 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:50.390207 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2280540c-4e21-412e-a325-d2da89ddd204 tempest-QuotasAdminTestV257-1049568015 tempest-QuotasAdminTestV257-1049568015-project-admin] Action: 'update', calling method: .version_select at 0x7fbb96f97310>, body: {"quota_set": {"ram": "2048"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:50.445605 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-05f6bba8-3862-478e-a38b-0789b4cc4de2 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.115627 Apr 16 21:07:50.446206 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 136/238] 10.222.0.20 () {60 vars in 1163 bytes} [Sat Apr 16 21:07:50 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:50.455943 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7487650a-a777-4a2c-8190-9ef6df2189ad tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:50.457347 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:50.457347 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:50.465904 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7487650a-a777-4a2c-8190-9ef6df2189ad tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:50.466306 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7487650a-a777-4a2c-8190-9ef6df2189ad tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:50.737068 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7487650a-a777-4a2c-8190-9ef6df2189ad tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 242 microversion: 2.1 time: 0.284791 Apr 16 21:07:50.737893 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 137/239] 10.222.0.20 () {60 vars in 1190 bytes} [Sat Apr 16 21:07:50 2022] POST /compute/v2.1/os-aggregates/8/action => generated 242 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:07:50.747938 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b96c53d2-140c-4060-b116-b003797021b8 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:50.748828 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:50.748828 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:50.755857 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b96c53d2-140c-4060-b116-b003797021b8 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 242 microversion: 2.1 time: 0.011442 Apr 16 21:07:50.756761 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 138/240] 10.222.0.20 () {58 vars in 1148 bytes} [Sat Apr 16 21:07:50 2022] GET /compute/v2.1/os-aggregates/8 => generated 242 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:50.767057 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-490ea7e0-32be-4ac1-a0bc-5abb59c3bc2f tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:50.768334 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:50.768334 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:50.776789 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-490ea7e0-32be-4ac1-a0bc-5abb59c3bc2f tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:50.777357 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-490ea7e0-32be-4ac1-a0bc-5abb59c3bc2f tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:51.119880 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-490ea7e0-32be-4ac1-a0bc-5abb59c3bc2f tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 227 microversion: 2.1 time: 0.356324 Apr 16 21:07:51.121375 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 139/241] 10.222.0.20 () {60 vars in 1190 bytes} [Sat Apr 16 21:07:50 2022] POST /compute/v2.1/os-aggregates/8/action => generated 227 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:07:51.130424 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-250cf3e7-d061-4e47-ac72-c4fdf01a661f tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:51.131301 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:51.131301 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:51.134967 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2280540c-4e21-412e-a325-d2da89ddd204 tempest-QuotasAdminTestV257-1049568015 tempest-QuotasAdminTestV257-1049568015-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:51.135485 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2280540c-4e21-412e-a325-d2da89ddd204 tempest-QuotasAdminTestV257-1049568015 tempest-QuotasAdminTestV257-1049568015-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:51.136344 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2280540c-4e21-412e-a325-d2da89ddd204 tempest-QuotasAdminTestV257-1049568015 tempest-QuotasAdminTestV257-1049568015-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:51.136958 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2280540c-4e21-412e-a325-d2da89ddd204 tempest-QuotasAdminTestV257-1049568015 tempest-QuotasAdminTestV257-1049568015-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:51.171967 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2280540c-4e21-412e-a325-d2da89ddd204 tempest-QuotasAdminTestV257-1049568015 tempest-QuotasAdminTestV257-1049568015-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:51.172473 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2280540c-4e21-412e-a325-d2da89ddd204 tempest-QuotasAdminTestV257-1049568015 tempest-QuotasAdminTestV257-1049568015-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:51.173281 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2280540c-4e21-412e-a325-d2da89ddd204 tempest-QuotasAdminTestV257-1049568015 tempest-QuotasAdminTestV257-1049568015-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:51.173723 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2280540c-4e21-412e-a325-d2da89ddd204 tempest-QuotasAdminTestV257-1049568015 tempest-QuotasAdminTestV257-1049568015-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:51.215371 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-250cf3e7-d061-4e47-ac72-c4fdf01a661f tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.088531 Apr 16 21:07:51.216140 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 140/242] 10.222.0.20 () {58 vars in 1151 bytes} [Sat Apr 16 21:07:51 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Apr 16 21:07:51.228487 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-24d719b4-5141-4138-a601-862ea96b9c3e tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1763649978"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:51.230033 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:51.230033 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:51.230954 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.aggregate [None req-24d719b4-5141-4138-a601-862ea96b9c3e tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Generated uuid 224ff492-59fe-47ab-9813-64784efe20fc for aggregate {{(pid=137408) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 16 21:07:51.314788 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2280540c-4e21-412e-a325-d2da89ddd204 tempest-QuotasAdminTestV257-1049568015 tempest-QuotasAdminTestV257-1049568015-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/d44d7bca45d646019a4b35a5c7a49b4d?user_id=70a1a6f328464c9a8c862918aa4d3e8b" status: 200 len: 148 microversion: 2.57 time: 0.928298 Apr 16 21:07:51.315453 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 103/243] 10.222.0.20 () {62 vars in 1383 bytes} [Sat Apr 16 21:07:50 2022] PUT /compute/v2.1/os-quota-sets/d44d7bca45d646019a4b35a5c7a49b4d?user_id=70a1a6f328464c9a8c862918aa4d3e8b => generated 148 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:07:51.327875 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-24d719b4-5141-4138-a601-862ea96b9c3e tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.103693 Apr 16 21:07:51.329122 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 141/244] 10.222.0.20 () {60 vars in 1163 bytes} [Sat Apr 16 21:07:51 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:07:51.330856 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1c0634bf-796f-4d68-9716-288e41514d96 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:51.332486 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1c0634bf-796f-4d68-9716-288e41514d96 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 8d5cf7af-51b8-4392-a551-9d0d9b96a45d] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:51.335238 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-29294375-fd23-4f71-bcd7-8b4f1aa4d30c tempest-QuotasAdminTestV257-1049568015 tempest-QuotasAdminTestV257-1049568015-project-admin] Calling method '.version_select at 0x7fbb9c212c10>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:51.340095 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1c0634bf-796f-4d68-9716-288e41514d96 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:51.340581 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1c0634bf-796f-4d68-9716-288e41514d96 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:51.341389 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1c0634bf-796f-4d68-9716-288e41514d96 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:51.341990 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1c0634bf-796f-4d68-9716-288e41514d96 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:51.557530 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-29294375-fd23-4f71-bcd7-8b4f1aa4d30c tempest-QuotasAdminTestV257-1049568015 tempest-QuotasAdminTestV257-1049568015-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/d44d7bca45d646019a4b35a5c7a49b4d?user_id=70a1a6f328464c9a8c862918aa4d3e8b" status: 200 len: 190 microversion: 2.57 time: 0.227117 Apr 16 21:07:51.558568 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 142/245] 10.222.0.20 () {60 vars in 1363 bytes} [Sat Apr 16 21:07:51 2022] GET /compute/v2.1/os-quota-sets/d44d7bca45d646019a4b35a5c7a49b4d?user_id=70a1a6f328464c9a8c862918aa4d3e8b => generated 190 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:07:51.563552 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-84fbcc3d-f4ff-4d12-ab4f-b6a788b404e5 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:51.565397 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:51.565397 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:51.576970 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-84fbcc3d-f4ff-4d12-ab4f-b6a788b404e5 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:51.577613 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-84fbcc3d-f4ff-4d12-ab4f-b6a788b404e5 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:51.635883 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1c0634bf-796f-4d68-9716-288e41514d96 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7da58ce23242bd947bbd7387b80b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6395bf8972949f8837289679b58d151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:51.643781 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1c0634bf-796f-4d68-9716-288e41514d96 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "GET /compute/v2.1/servers/8d5cf7af-51b8-4392-a551-9d0d9b96a45d" status: 200 len: 1385 microversion: 2.1 time: 0.326946 Apr 16 21:07:51.644630 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 104/246] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:51 2022] GET /compute/v2.1/servers/8d5cf7af-51b8-4392-a551-9d0d9b96a45d => generated 1385 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:51.649563 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cbb3f31d-dbf3-493c-a15c-4a5d89b5388a tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:51.650317 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-cbb3f31d-dbf3-493c-a15c-4a5d89b5388a tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:51.656710 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cbb3f31d-dbf3-493c-a15c-4a5d89b5388a tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:51.657365 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cbb3f31d-dbf3-493c-a15c-4a5d89b5388a tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:51.658149 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cbb3f31d-dbf3-493c-a15c-4a5d89b5388a tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:51.658600 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cbb3f31d-dbf3-493c-a15c-4a5d89b5388a tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:51.831757 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cbb3f31d-dbf3-493c-a15c-4a5d89b5388a tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82856a20b3764d17b5c9c1bebdd46c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998f0203a6c741839bde8be2da375d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:51.840479 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cbb3f31d-dbf3-493c-a15c-4a5d89b5388a tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c" status: 200 len: 1475 microversion: 2.1 time: 0.194588 Apr 16 21:07:51.850129 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 105/247] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:51 2022] GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c => generated 1475 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:51.944786 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-84fbcc3d-f4ff-4d12-ab4f-b6a788b404e5 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 242 microversion: 2.1 time: 0.384145 Apr 16 21:07:51.947187 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-97fea727-3844-44f2-96f2-483b375c0d8d req-2df446b5-0376-49e7-8385-ec0b8ab01f24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c", "name": "network-vif-deleted", "tag": "efb6cd0f-aa21-4df1-b980-d8110795919e"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:51.952499 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 143/248] 10.222.0.20 () {60 vars in 1190 bytes} [Sat Apr 16 21:07:51 2022] POST /compute/v2.1/os-aggregates/9/action => generated 242 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:51.959799 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-30bcf087-1344-4a50-affe-caeba15e2359 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:51.961861 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-97fea727-3844-44f2-96f2-483b375c0d8d req-2df446b5-0376-49e7-8385-ec0b8ab01f24 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:51.962222 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:51.962222 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:51.962998 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-97fea727-3844-44f2-96f2-483b375c0d8d req-2df446b5-0376-49e7-8385-ec0b8ab01f24 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:51.971542 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-30bcf087-1344-4a50-affe-caeba15e2359 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.017653 Apr 16 21:07:51.972663 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 144/249] 10.222.0.20 () {58 vars in 1142 bytes} [Sat Apr 16 21:07:51 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:51.981340 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-97fea727-3844-44f2-96f2-483b375c0d8d req-2df446b5-0376-49e7-8385-ec0b8ab01f24 service nova] Creating event network-vif-deleted:efb6cd0f-aa21-4df1-b980-d8110795919e for instance 0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c on nch2-master-1 Apr 16 21:07:51.987061 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-97fea727-3844-44f2-96f2-483b375c0d8d req-2df446b5-0376-49e7-8385-ec0b8ab01f24 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045237 Apr 16 21:07:51.987985 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 106/250] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:52.001427 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7be858b6-6b98-4781-9acb-0dc5e1714689 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:52.003098 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:52.003098 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:52.011877 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7be858b6-6b98-4781-9acb-0dc5e1714689 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:52.012654 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7be858b6-6b98-4781-9acb-0dc5e1714689 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:52.309166 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7be858b6-6b98-4781-9acb-0dc5e1714689 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/9/action" status: 200 len: 227 microversion: 2.1 time: 0.311503 Apr 16 21:07:52.310300 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 145/251] 10.222.0.20 () {60 vars in 1190 bytes} [Sat Apr 16 21:07:51 2022] POST /compute/v2.1/os-aggregates/9/action => generated 227 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:52.321310 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f1705d72-9f01-47ec-8708-32da34f3d95b tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:52.322764 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:52.322764 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:52.419180 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f1705d72-9f01-47ec-8708-32da34f3d95b tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.102755 Apr 16 21:07:52.420095 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 107/252] 10.222.0.20 () {58 vars in 1151 bytes} [Sat Apr 16 21:07:52 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 16 21:07:52.434685 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2ac3169c-eb53-48ea-80d2-93257f0bfa8d tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1250874793"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:52.436034 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:52.436034 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:52.436982 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.aggregate [None req-2ac3169c-eb53-48ea-80d2-93257f0bfa8d tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Generated uuid 5a4fc009-8d3a-431d-b662-aa445166667a for aggregate {{(pid=137408) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 16 21:07:52.525538 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2ac3169c-eb53-48ea-80d2-93257f0bfa8d tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.094483 Apr 16 21:07:52.529578 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 146/253] 10.222.0.20 () {60 vars in 1163 bytes} [Sat Apr 16 21:07:52 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:52.538210 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0138c332-12d6-4ab3-89c6-700e9a14341c tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:52.539722 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:52.539722 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:52.548276 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0138c332-12d6-4ab3-89c6-700e9a14341c tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:52.548954 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0138c332-12d6-4ab3-89c6-700e9a14341c tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:52.662196 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3af5cfab-fe36-486a-9962-366eb2cf08be tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:52.663224 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3af5cfab-fe36-486a-9962-366eb2cf08be tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 8d5cf7af-51b8-4392-a551-9d0d9b96a45d] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:52.671477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3af5cfab-fe36-486a-9962-366eb2cf08be tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:52.672431 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3af5cfab-fe36-486a-9962-366eb2cf08be tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:52.673501 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3af5cfab-fe36-486a-9962-366eb2cf08be tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:52.676633 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3af5cfab-fe36-486a-9962-366eb2cf08be tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:52.833846 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3af5cfab-fe36-486a-9962-366eb2cf08be tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7da58ce23242bd947bbd7387b80b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6395bf8972949f8837289679b58d151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:52.841390 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3af5cfab-fe36-486a-9962-366eb2cf08be tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "GET /compute/v2.1/servers/8d5cf7af-51b8-4392-a551-9d0d9b96a45d" status: 200 len: 1385 microversion: 2.1 time: 0.183921 Apr 16 21:07:52.841965 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 147/254] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:52 2022] GET /compute/v2.1/servers/8d5cf7af-51b8-4392-a551-9d0d9b96a45d => generated 1385 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:52.858958 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-15dfae75-89a3-4990-b83d-0b79d98721fb tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:52.859883 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-15dfae75-89a3-4990-b83d-0b79d98721fb tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:52.867861 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-15dfae75-89a3-4990-b83d-0b79d98721fb tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:52.873946 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-15dfae75-89a3-4990-b83d-0b79d98721fb tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:52.876560 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0138c332-12d6-4ab3-89c6-700e9a14341c tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 243 microversion: 2.1 time: 0.341938 Apr 16 21:07:52.883729 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 108/255] 10.222.0.20 () {60 vars in 1193 bytes} [Sat Apr 16 21:07:52 2022] POST /compute/v2.1/os-aggregates/10/action => generated 243 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:52.887168 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c5fe10cf-7acd-4d88-a7d0-b12c68545e1b tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:52.888800 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:52.888800 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:52.891304 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-15dfae75-89a3-4990-b83d-0b79d98721fb tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:52.891930 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-15dfae75-89a3-4990-b83d-0b79d98721fb tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:52.899245 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c5fe10cf-7acd-4d88-a7d0-b12c68545e1b tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:52.899920 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c5fe10cf-7acd-4d88-a7d0-b12c68545e1b tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:52.947989 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-15dfae75-89a3-4990-b83d-0b79d98721fb tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:52.948508 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-15dfae75-89a3-4990-b83d-0b79d98721fb tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:52.948991 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-15dfae75-89a3-4990-b83d-0b79d98721fb tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lazy-loading 'fault' on Instance uuid 0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:07:53.019335 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-15dfae75-89a3-4990-b83d-0b79d98721fb tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82856a20b3764d17b5c9c1bebdd46c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998f0203a6c741839bde8be2da375d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:53.033636 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-15dfae75-89a3-4990-b83d-0b79d98721fb tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c" status: 200 len: 1309 microversion: 2.1 time: 0.179481 Apr 16 21:07:53.036363 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 148/256] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:52 2022] GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c => generated 1309 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:07:53.103413 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-4b48a8c0-fd5a-4140-a301-3e71d39eb2b7 req-4e9fe89e-9645-44e9-b32f-b8714a01944f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d5cf7af-51b8-4392-a551-9d0d9b96a45d", "name": "network-vif-plugged", "status": "completed", "tag": "803ab649-d886-491f-afac-b601816b1ffe"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:53.113955 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-4b48a8c0-fd5a-4140-a301-3e71d39eb2b7 req-4e9fe89e-9645-44e9-b32f-b8714a01944f service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:53.117839 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-4b48a8c0-fd5a-4140-a301-3e71d39eb2b7 req-4e9fe89e-9645-44e9-b32f-b8714a01944f service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:53.130026 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-4b48a8c0-fd5a-4140-a301-3e71d39eb2b7 req-4e9fe89e-9645-44e9-b32f-b8714a01944f service nova] Creating event network-vif-plugged:803ab649-d886-491f-afac-b601816b1ffe for instance 8d5cf7af-51b8-4392-a551-9d0d9b96a45d on nch2-master-1 Apr 16 21:07:53.135615 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-4b48a8c0-fd5a-4140-a301-3e71d39eb2b7 req-4e9fe89e-9645-44e9-b32f-b8714a01944f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036597 Apr 16 21:07:53.136710 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 149/257] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Apr 16 21:07:53.293377 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c5fe10cf-7acd-4d88-a7d0-b12c68545e1b tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/10/action" status: 200 len: 228 microversion: 2.1 time: 0.409951 Apr 16 21:07:53.293986 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 109/258] 10.222.0.20 () {60 vars in 1193 bytes} [Sat Apr 16 21:07:52 2022] POST /compute/v2.1/os-aggregates/10/action => generated 228 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:53.310109 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cabff32d-be7f-40a8-98c2-076c45123764 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:53.311054 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:53.311054 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:53.432899 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cabff32d-be7f-40a8-98c2-076c45123764 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.131186 Apr 16 21:07:53.438204 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 150/259] 10.222.0.20 () {58 vars in 1154 bytes} [Sat Apr 16 21:07:53 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 16 21:07:53.443442 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-28cdaa6b-7251-4784-8869-1b84981bf586 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1621634023"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:53.446532 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:53.446532 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:53.447654 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.aggregate [None req-28cdaa6b-7251-4784-8869-1b84981bf586 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Generated uuid 4ca8695d-3022-4d5a-8fc8-201a6971f483 for aggregate {{(pid=137409) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 16 21:07:53.471449 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3f68a666-7f9b-47a3-80b6-06191692c98d tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1511672760"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:53.472870 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:53.472870 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:53.473910 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.aggregate [None req-3f68a666-7f9b-47a3-80b6-06191692c98d tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Generated uuid 2744026a-b411-4759-8ac3-c9c403936f00 for aggregate {{(pid=137408) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 16 21:07:53.580928 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-28cdaa6b-7251-4784-8869-1b84981bf586 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.141287 Apr 16 21:07:53.581774 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 110/260] 10.222.0.20 () {60 vars in 1163 bytes} [Sat Apr 16 21:07:53 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:53.592011 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-26a1d570-94a0-486f-9696-607eccecf62e tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:53.592996 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:53.592996 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:53.601206 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3f68a666-7f9b-47a3-80b6-06191692c98d tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.134126 Apr 16 21:07:53.601809 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 151/261] 10.222.0.20 () {60 vars in 1163 bytes} [Sat Apr 16 21:07:53 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:07:53.615945 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2f9eb318-3f93-4fce-bdc0-87f2e5395e57 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:53.620934 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:53.620934 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:53.634317 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2f9eb318-3f93-4fce-bdc0-87f2e5395e57 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:53.634834 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2f9eb318-3f93-4fce-bdc0-87f2e5395e57 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:53.697602 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-26a1d570-94a0-486f-9696-607eccecf62e tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.103139 Apr 16 21:07:53.697602 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 111/262] 10.222.0.20 () {58 vars in 1154 bytes} [Sat Apr 16 21:07:53 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Apr 16 21:07:53.701720 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fdb927d2-6e74-409f-a7eb-7832643ca869 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:53.702455 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:53.702455 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:53.708540 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-fdb927d2-6e74-409f-a7eb-7832643ca869 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Apr 16 21:07:53.709121 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fdb927d2-6e74-409f-a7eb-7832643ca869 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:07:53.710022 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fdb927d2-6e74-409f-a7eb-7832643ca869 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.012648 Apr 16 21:07:53.714140 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 112/263] 10.222.0.20 () {58 vars in 1151 bytes} [Sat Apr 16 21:07:53 2022] GET /compute/v2.1/os-aggregates/11 => generated 78 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:07:53.718937 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-aa162970-0454-4753-8c44-3195ac788618 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:53.719745 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:53.719745 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:53.731499 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-aa162970-0454-4753-8c44-3195ac788618 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] HTTP exception thrown: Aggregate 11 could not be found. Apr 16 21:07:53.732087 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-aa162970-0454-4753-8c44-3195ac788618 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Returning 404 to user: Aggregate 11 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:07:53.733014 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-aa162970-0454-4753-8c44-3195ac788618 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/11" status: 404 len: 78 microversion: 2.1 time: 0.017693 Apr 16 21:07:53.733505 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 113/264] 10.222.0.20 () {58 vars in 1154 bytes} [Sat Apr 16 21:07:53 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 78 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:07:53.746369 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-60abfdcc-cb49-46cd-9b6f-86a66803e16c tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-696742642", "name": "tempest-test_aggregate-1049397410"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:53.763123 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:53.763123 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:53.764255 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.aggregate [None req-60abfdcc-cb49-46cd-9b6f-86a66803e16c tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Generated uuid 731bce5c-c16e-4a65-813c-e8e8398d443b for aggregate {{(pid=137409) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 16 21:07:53.883559 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-60abfdcc-cb49-46cd-9b6f-86a66803e16c tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.142570 Apr 16 21:07:53.884199 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 114/265] 10.222.0.20 () {60 vars in 1164 bytes} [Sat Apr 16 21:07:53 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:53.889930 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-dffaaa06-cd1a-43c2-a324-36014fe22a92 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:53.890657 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-dffaaa06-cd1a-43c2-a324-36014fe22a92 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 8d5cf7af-51b8-4392-a551-9d0d9b96a45d] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:53.897081 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dffaaa06-cd1a-43c2-a324-36014fe22a92 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:53.897538 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dffaaa06-cd1a-43c2-a324-36014fe22a92 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:53.898350 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dffaaa06-cd1a-43c2-a324-36014fe22a92 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:53.898851 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dffaaa06-cd1a-43c2-a324-36014fe22a92 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:53.968575 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2f9eb318-3f93-4fce-bdc0-87f2e5395e57 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 243 microversion: 2.1 time: 0.360384 Apr 16 21:07:53.975374 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 152/266] 10.222.0.20 () {60 vars in 1193 bytes} [Sat Apr 16 21:07:53 2022] POST /compute/v2.1/os-aggregates/12/action => generated 243 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:07:53.978836 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8fcf7391-ee72-4bc5-b97c-9dd6295bebf4 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:53.979934 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:53.979934 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:54.042853 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-dffaaa06-cd1a-43c2-a324-36014fe22a92 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7da58ce23242bd947bbd7387b80b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6395bf8972949f8837289679b58d151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:54.050190 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-dffaaa06-cd1a-43c2-a324-36014fe22a92 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "GET /compute/v2.1/servers/8d5cf7af-51b8-4392-a551-9d0d9b96a45d" status: 200 len: 1385 microversion: 2.1 time: 0.164990 Apr 16 21:07:54.059915 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 115/267] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:53 2022] GET /compute/v2.1/servers/8d5cf7af-51b8-4392-a551-9d0d9b96a45d => generated 1385 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:54.065139 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e30b163e-b882-4ca5-a13d-b378142a9291 tempest-AggregatesAdminNegativeTestJSON-237797815 tempest-AggregatesAdminNegativeTestJSON-237797815-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:54.066637 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:54.066637 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:54.067478 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e30b163e-b882-4ca5-a13d-b378142a9291 tempest-AggregatesAdminNegativeTestJSON-237797815 tempest-AggregatesAdminNegativeTestJSON-237797815-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '65bb1dff7f744fdea36c7a6276db6f6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec4dd7ceb08f4c83910432bc4e0badde', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:54.068112 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e30b163e-b882-4ca5-a13d-b378142a9291 tempest-AggregatesAdminNegativeTestJSON-237797815 tempest-AggregatesAdminNegativeTestJSON-237797815-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:07:54.068931 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e30b163e-b882-4ca5-a13d-b378142a9291 tempest-AggregatesAdminNegativeTestJSON-237797815 tempest-AggregatesAdminNegativeTestJSON-237797815-project] 10.222.0.20 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 121 microversion: 2.1 time: 0.007833 Apr 16 21:07:54.069433 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 116/268] 10.222.0.20 () {60 vars in 1193 bytes} [Sat Apr 16 21:07:54 2022] POST /compute/v2.1/os-aggregates/12/action => generated 121 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:07:54.074329 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c473c2ad-542e-42fa-847b-39228408e58a tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:54.074923 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c473c2ad-542e-42fa-847b-39228408e58a tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:54.081477 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8fcf7391-ee72-4bc5-b97c-9dd6295bebf4 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.110013 Apr 16 21:07:54.082258 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c473c2ad-542e-42fa-847b-39228408e58a tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:54.082921 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c473c2ad-542e-42fa-847b-39228408e58a tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:54.083899 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c473c2ad-542e-42fa-847b-39228408e58a tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:54.084797 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c473c2ad-542e-42fa-847b-39228408e58a tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:54.088090 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 153/269] 10.222.0.20 () {58 vars in 1154 bytes} [Sat Apr 16 21:07:53 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 16 21:07:54.092109 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a09da27c-17af-4c50-936a-5463004c46ee tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:54.094117 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:54.094117 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:54.104126 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-c473c2ad-542e-42fa-847b-39228408e58a tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] HTTP exception thrown: Instance 0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c could not be found. Apr 16 21:07:54.104460 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a09da27c-17af-4c50-936a-5463004c46ee tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:54.104930 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a09da27c-17af-4c50-936a-5463004c46ee tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:54.105474 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c473c2ad-542e-42fa-847b-39228408e58a tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Returning 404 to user: Instance 0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:07:54.106736 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c473c2ad-542e-42fa-847b-39228408e58a tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c" status: 404 len: 111 microversion: 2.1 time: 0.035481 Apr 16 21:07:54.108126 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 117/270] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:54 2022] GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:07:54.113090 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-feb26b4a-66d8-4727-8498-caa7f400a694 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:54.113953 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:54.113953 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:54.122361 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-feb26b4a-66d8-4727-8498-caa7f400a694 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Apr 16 21:07:54.127258 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-feb26b4a-66d8-4727-8498-caa7f400a694 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:07:54.127258 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-feb26b4a-66d8-4727-8498-caa7f400a694 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.014405 Apr 16 21:07:54.127258 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 118/271] 10.222.0.20 () {58 vars in 1151 bytes} [Sat Apr 16 21:07:54 2022] GET /compute/v2.1/os-aggregates/13 => generated 78 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:07:54.133952 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8614abc2-d748-4599-8be6-35b83e565013 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:54.134703 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:54.134703 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:54.144858 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-8614abc2-d748-4599-8be6-35b83e565013 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] HTTP exception thrown: Aggregate 13 could not be found. Apr 16 21:07:54.145447 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8614abc2-d748-4599-8be6-35b83e565013 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Returning 404 to user: Aggregate 13 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:07:54.146253 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8614abc2-d748-4599-8be6-35b83e565013 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/13" status: 404 len: 78 microversion: 2.1 time: 0.016406 Apr 16 21:07:54.146784 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 119/272] 10.222.0.20 () {58 vars in 1154 bytes} [Sat Apr 16 21:07:54 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 78 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:07:54.155876 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-87e81fe0-79a9-4ac4-acda-c1dc27f5507c tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-812143262"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:54.157170 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:54.157170 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:54.158019 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.aggregate [None req-87e81fe0-79a9-4ac4-acda-c1dc27f5507c tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Generated uuid da42f250-f589-4d6c-a68f-0470caf4b509 for aggregate {{(pid=137409) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 16 21:07:54.288363 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-87e81fe0-79a9-4ac4-acda-c1dc27f5507c tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.135822 Apr 16 21:07:54.289889 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 120/273] 10.222.0.20 () {60 vars in 1163 bytes} [Sat Apr 16 21:07:54 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:54.299251 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f07013ba-bcb5-46de-8171-7520168c2e02 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:54.300023 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:54.300023 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:54.307766 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f07013ba-bcb5-46de-8171-7520168c2e02 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 227 microversion: 2.1 time: 0.011894 Apr 16 21:07:54.308343 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 121/274] 10.222.0.20 () {58 vars in 1151 bytes} [Sat Apr 16 21:07:54 2022] GET /compute/v2.1/os-aggregates/14 => generated 227 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:07:54.317992 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e7e5dac5-83a5-46d5-a360-13a2641bc49b tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:54.319546 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:54.319546 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:54.447109 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a09da27c-17af-4c50-936a-5463004c46ee tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/12/action" status: 200 len: 228 microversion: 2.1 time: 0.359239 Apr 16 21:07:54.449941 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 154/275] 10.222.0.20 () {60 vars in 1193 bytes} [Sat Apr 16 21:07:54 2022] POST /compute/v2.1/os-aggregates/12/action => generated 228 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:54.452004 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e7e5dac5-83a5-46d5-a360-13a2641bc49b tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/14/action" status: 200 len: 265 microversion: 2.1 time: 0.136308 Apr 16 21:07:54.452640 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 122/276] 10.222.0.20 () {60 vars in 1193 bytes} [Sat Apr 16 21:07:54 2022] POST /compute/v2.1/os-aggregates/14/action => generated 265 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:07:54.458279 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-614cfb99-75e3-4377-8ea3-daf09a6a2b10 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1532369529", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:54.463570 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-dd5f4c1b-344e-429a-981a-f38e540fe5f7 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:54.467840 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:54.467840 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:54.478419 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-dd5f4c1b-344e-429a-981a-f38e540fe5f7 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/14" status: 200 len: 241 microversion: 2.1 time: 0.019267 Apr 16 21:07:54.478974 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 123/277] 10.222.0.20 () {58 vars in 1151 bytes} [Sat Apr 16 21:07:54 2022] GET /compute/v2.1/os-aggregates/14 => generated 241 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:54.488069 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-75cab97a-ae74-49e9-b235-8b95d93d9548 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:54.489147 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:54.489147 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:54.532001 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-614cfb99-75e3-4377-8ea3-daf09a6a2b10 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] validate_networks() for None {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:07:54.615574 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-75cab97a-ae74-49e9-b235-8b95d93d9548 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.135091 Apr 16 21:07:54.616163 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 124/278] 10.222.0.20 () {58 vars in 1154 bytes} [Sat Apr 16 21:07:54 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 16 21:07:54.629498 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a5171044-ef5e-4414-ae98-80414973205d tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:54.630277 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:54.630277 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:54.750982 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-614cfb99-75e3-4377-8ea3-daf09a6a2b10 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:07:54.751409 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-614cfb99-75e3-4377-8ea3-daf09a6a2b10 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:07:54.751947 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-614cfb99-75e3-4377-8ea3-daf09a6a2b10 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:07:54.752412 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-614cfb99-75e3-4377-8ea3-daf09a6a2b10 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:07:54.752882 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-614cfb99-75e3-4377-8ea3-daf09a6a2b10 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:07:54.761692 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-614cfb99-75e3-4377-8ea3-daf09a6a2b10 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:54.762150 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-614cfb99-75e3-4377-8ea3-daf09a6a2b10 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:54.762968 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-614cfb99-75e3-4377-8ea3-daf09a6a2b10 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:54.763413 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-614cfb99-75e3-4377-8ea3-daf09a6a2b10 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:54.780840 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-614cfb99-75e3-4377-8ea3-daf09a6a2b10 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Getting quotas for project 998f0203a6c741839bde8be2da375d4f. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:07:54.785969 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-614cfb99-75e3-4377-8ea3-daf09a6a2b10 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Getting quotas for user 82856a20b3764d17b5c9c1bebdd46c68 and project 998f0203a6c741839bde8be2da375d4f. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:07:54.792043 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a5171044-ef5e-4414-ae98-80414973205d tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.169210 Apr 16 21:07:54.793902 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 125/279] 10.222.0.20 () {58 vars in 1154 bytes} [Sat Apr 16 21:07:54 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 16 21:07:54.800626 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7b52e5c6-b8ca-48e5-843d-4faa0a2bc167 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-693951125"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:54.802760 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:54.802760 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:54.803645 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.aggregate [None req-7b52e5c6-b8ca-48e5-843d-4faa0a2bc167 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Generated uuid 5d147c99-9afd-487c-8cfd-aca03047ffc0 for aggregate {{(pid=137409) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 16 21:07:54.803750 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-614cfb99-75e3-4377-8ea3-daf09a6a2b10 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:07:54.812340 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-614cfb99-75e3-4377-8ea3-daf09a6a2b10 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 229e6d83-6ece-40c3-a33a-99fc46429d8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:07:55.015676 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7b52e5c6-b8ca-48e5-843d-4faa0a2bc167 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.220018 Apr 16 21:07:55.016939 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 126/280] 10.222.0.20 () {60 vars in 1163 bytes} [Sat Apr 16 21:07:54 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:55.024900 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-614cfb99-75e3-4377-8ea3-daf09a6a2b10 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.575387 Apr 16 21:07:55.025538 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 155/281] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:07:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:07:55.044046 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2069ea07-23ac-4798-b6ea-2db1b967a5ab tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1341273728", "availability_zone": "tempest-test_az-296954431"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:55.045732 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:55.045732 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:55.045919 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5f7d1e46-b796-4cbd-b7e2-30ed3a008a5d tempest-AggregatesAdminTestV241-2010896074 tempest-AggregatesAdminTestV241-2010896074-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1508984024"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:55.046700 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.aggregate [None req-2069ea07-23ac-4798-b6ea-2db1b967a5ab tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Generated uuid aefc20cf-fa34-453e-9d50-748dc4d558c3 for aggregate {{(pid=137408) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 16 21:07:55.047171 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:55.047171 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:55.051309 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.aggregate [None req-5f7d1e46-b796-4cbd-b7e2-30ed3a008a5d tempest-AggregatesAdminTestV241-2010896074 tempest-AggregatesAdminTestV241-2010896074-project-admin] Generated uuid d3e37a32-350b-43e4-8f6c-da20c7f06b8d for aggregate {{(pid=137409) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 16 21:07:55.224236 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2069ea07-23ac-4798-b6ea-2db1b967a5ab tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.197373 Apr 16 21:07:55.225068 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 156/282] 10.222.0.20 () {60 vars in 1164 bytes} [Sat Apr 16 21:07:55 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:55.229597 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b685f8c3-744f-40fb-ba69-69f795f46b99 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:55.231407 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:55.231407 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:55.234372 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5f7d1e46-b796-4cbd-b7e2-30ed3a008a5d tempest-AggregatesAdminTestV241-2010896074 tempest-AggregatesAdminTestV241-2010896074-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 247 microversion: 2.41 time: 0.215387 Apr 16 21:07:55.239865 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b685f8c3-744f-40fb-ba69-69f795f46b99 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:55.240604 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b685f8c3-744f-40fb-ba69-69f795f46b99 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:55.240717 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 127/283] 10.222.0.20 () {62 vars in 1204 bytes} [Sat Apr 16 21:07:55 2022] POST /compute/v2.1/os-aggregates => generated 247 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:07:55.245669 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8bcc8f97-a2b3-4acc-aae6-57aa0b8e5e00 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:55.246452 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8bcc8f97-a2b3-4acc-aae6-57aa0b8e5e00 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 229e6d83-6ece-40c3-a33a-99fc46429d8c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:55.247277 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b685f8c3-744f-40fb-ba69-69f795f46b99 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:55.247799 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b685f8c3-744f-40fb-ba69-69f795f46b99 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:55.268413 ncdv-master-1 devstack@n-api.service[137408]: ERROR nova.api.openstack.compute.aggregates [None req-b685f8c3-744f-40fb-ba69-69f795f46b99 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Failed to remove host nonexist_host from aggregate 15. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Apr 16 21:07:55.269193 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-b685f8c3-744f-40fb-ba69-69f795f46b99 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 15 Apr 16 21:07:55.269930 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b685f8c3-744f-40fb-ba69-69f795f46b99 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 15 {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:07:55.270935 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b685f8c3-744f-40fb-ba69-69f795f46b99 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/15/action" status: 404 len: 94 microversion: 2.1 time: 0.044883 Apr 16 21:07:55.271854 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 157/284] 10.222.0.20 () {60 vars in 1193 bytes} [Sat Apr 16 21:07:55 2022] POST /compute/v2.1/os-aggregates/15/action => generated 94 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:07:55.306428 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8bcc8f97-a2b3-4acc-aae6-57aa0b8e5e00 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82856a20b3764d17b5c9c1bebdd46c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998f0203a6c741839bde8be2da375d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:55.313260 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8bcc8f97-a2b3-4acc-aae6-57aa0b8e5e00 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "GET /compute/v2.1/servers/229e6d83-6ece-40c3-a33a-99fc46429d8c" status: 200 len: 1220 microversion: 2.1 time: 0.071531 Apr 16 21:07:55.314016 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 128/285] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:55 2022] GET /compute/v2.1/servers/229e6d83-6ece-40c3-a33a-99fc46429d8c => generated 1220 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:55.318832 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-de0b06fb-56c1-42af-a4a5-c5a511b4094b tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:55.319782 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-de0b06fb-56c1-42af-a4a5-c5a511b4094b tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 8d5cf7af-51b8-4392-a551-9d0d9b96a45d] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:55.326629 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-de0b06fb-56c1-42af-a4a5-c5a511b4094b tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:55.328910 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-de0b06fb-56c1-42af-a4a5-c5a511b4094b tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:55.329350 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-de0b06fb-56c1-42af-a4a5-c5a511b4094b tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:55.330079 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-de0b06fb-56c1-42af-a4a5-c5a511b4094b tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:55.536628 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e3351016-16f1-4689-9aa8-55832c69d83c tempest-InstanceUsageAuditLogNegativeTestJSON-1510298031 tempest-InstanceUsageAuditLogNegativeTestJSON-1510298031-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:55.537961 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:55.537961 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:55.541240 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-e3351016-16f1-4689-9aa8-55832c69d83c tempest-InstanceUsageAuditLogNegativeTestJSON-1510298031 tempest-InstanceUsageAuditLogNegativeTestJSON-1510298031-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Apr 16 21:07:55.541858 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e3351016-16f1-4689-9aa8-55832c69d83c tempest-InstanceUsageAuditLogNegativeTestJSON-1510298031 tempest-InstanceUsageAuditLogNegativeTestJSON-1510298031-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:07:55.542686 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e3351016-16f1-4689-9aa8-55832c69d83c tempest-InstanceUsageAuditLogNegativeTestJSON-1510298031 tempest-InstanceUsageAuditLogNegativeTestJSON-1510298031-project-admin] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.269915 Apr 16 21:07:55.543212 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 158/286] 10.222.0.20 () {58 vars in 1223 bytes} [Sat Apr 16 21:07:55 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 271 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Apr 16 21:07:55.548425 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5f416a65-d93e-430d-97dd-2cc774012d2d tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1341273728_new", "availability_zone": "tempest-test_az-296954431_new"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:55.584631 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-de0b06fb-56c1-42af-a4a5-c5a511b4094b tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7da58ce23242bd947bbd7387b80b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6395bf8972949f8837289679b58d151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:55.594288 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-de0b06fb-56c1-42af-a4a5-c5a511b4094b tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "GET /compute/v2.1/servers/8d5cf7af-51b8-4392-a551-9d0d9b96a45d" status: 200 len: 1584 microversion: 2.1 time: 0.279057 Apr 16 21:07:55.595396 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 129/287] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:55 2022] GET /compute/v2.1/servers/8d5cf7af-51b8-4392-a551-9d0d9b96a45d => generated 1584 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:55.600411 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ee27fa60-d18d-4392-984a-2a106808f4df tempest-AggregatesAdminTestV241-2010896074 tempest-AggregatesAdminTestV241-2010896074-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1045730479"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:55.621730 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:55.621730 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:55.677748 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:55.677748 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:55.746799 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5f416a65-d93e-430d-97dd-2cc774012d2d tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:55.747476 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5f416a65-d93e-430d-97dd-2cc774012d2d tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:55.856927 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5f416a65-d93e-430d-97dd-2cc774012d2d tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-aggregates/16" status: 200 len: 335 microversion: 2.1 time: 0.308462 Apr 16 21:07:55.856927 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 159/288] 10.222.0.20 () {60 vars in 1172 bytes} [Sat Apr 16 21:07:55 2022] PUT /compute/v2.1/os-aggregates/16 => generated 335 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:55.859053 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ee27fa60-d18d-4392-984a-2a106808f4df tempest-AggregatesAdminTestV241-2010896074 tempest-AggregatesAdminTestV241-2010896074-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-aggregates/17" status: 200 len: 300 microversion: 2.41 time: 0.261623 Apr 16 21:07:55.859833 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 130/289] 10.222.0.20 () {62 vars in 1212 bytes} [Sat Apr 16 21:07:55 2022] PUT /compute/v2.1/os-aggregates/17 => generated 300 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:07:55.860521 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b6ad1c98-c853-41ce-94e7-9043a425e9d0 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:55.861620 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:55.861620 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:55.983069 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b6ad1c98-c853-41ce-94e7-9043a425e9d0 tempest-AggregatesAdminNegativeTestJSON-2047843860 tempest-AggregatesAdminNegativeTestJSON-2047843860-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.127500 Apr 16 21:07:55.983584 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 160/290] 10.222.0.20 () {58 vars in 1154 bytes} [Sat Apr 16 21:07:55 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 16 21:07:55.988446 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-424e792d-63d8-4cfb-821e-19183f68dc65 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:55.991305 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-424e792d-63d8-4cfb-821e-19183f68dc65 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 8d5cf7af-51b8-4392-a551-9d0d9b96a45d] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:55.995620 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-424e792d-63d8-4cfb-821e-19183f68dc65 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:55.996095 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-424e792d-63d8-4cfb-821e-19183f68dc65 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:55.996889 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-424e792d-63d8-4cfb-821e-19183f68dc65 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:55.997504 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-424e792d-63d8-4cfb-821e-19183f68dc65 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:56.045674 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f5507d23-c525-402e-8cbc-6d13912c30a9 tempest-InstanceUsageAuditLogNegativeTestJSON-966857413 tempest-InstanceUsageAuditLogNegativeTestJSON-966857413-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:56.046784 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:56.046784 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:56.048532 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f5507d23-c525-402e-8cbc-6d13912c30a9 tempest-InstanceUsageAuditLogNegativeTestJSON-966857413 tempest-InstanceUsageAuditLogNegativeTestJSON-966857413-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '804163f4174a478393dad4900c639d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76844f228ad4eda8ef337fbb6223f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:56.049443 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f5507d23-c525-402e-8cbc-6d13912c30a9 tempest-InstanceUsageAuditLogNegativeTestJSON-966857413 tempest-InstanceUsageAuditLogNegativeTestJSON-966857413-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:07:56.052960 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f5507d23-c525-402e-8cbc-6d13912c30a9 tempest-InstanceUsageAuditLogNegativeTestJSON-966857413 tempest-InstanceUsageAuditLogNegativeTestJSON-966857413-project] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.189388 Apr 16 21:07:56.054100 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 131/291] 10.222.0.20 () {58 vars in 1184 bytes} [Sat Apr 16 21:07:55 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 193 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:07:56.075728 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8e177121-ff3e-4070-97ad-875f181aaa29 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:56.077620 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:56.077620 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:56.093057 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8e177121-ff3e-4070-97ad-875f181aaa29 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 577 microversion: 2.1 time: 0.036834 Apr 16 21:07:56.094074 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 132/292] 10.222.0.20 () {58 vars in 1142 bytes} [Sat Apr 16 21:07:56 2022] GET /compute/v2.1/os-aggregates => generated 577 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:56.099232 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bbcb5690-50fc-4d09-91cb-a1efe654dae4 tempest-AggregatesAdminTestV241-2010896074 tempest-AggregatesAdminTestV241-2010896074-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:56.100295 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:56.100295 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:56.109800 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bbcb5690-50fc-4d09-91cb-a1efe654dae4 tempest-AggregatesAdminTestV241-2010896074 tempest-AggregatesAdminTestV241-2010896074-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/17" status: 200 len: 300 microversion: 2.41 time: 0.014287 Apr 16 21:07:56.110713 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 133/293] 10.222.0.20 () {60 vars in 1192 bytes} [Sat Apr 16 21:07:56 2022] GET /compute/v2.1/os-aggregates/17 => generated 300 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:07:56.115536 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cbf2f2c7-fe4b-4536-8f4c-5596ffd1005e tempest-InstanceUsageAuditLogNegativeTestJSON-966857413 tempest-InstanceUsageAuditLogNegativeTestJSON-966857413-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:56.116428 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:56.116428 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:56.119279 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cbf2f2c7-fe4b-4536-8f4c-5596ffd1005e tempest-InstanceUsageAuditLogNegativeTestJSON-966857413 tempest-InstanceUsageAuditLogNegativeTestJSON-966857413-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '804163f4174a478393dad4900c639d18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c76844f228ad4eda8ef337fbb6223f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:56.120191 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cbf2f2c7-fe4b-4536-8f4c-5596ffd1005e tempest-InstanceUsageAuditLogNegativeTestJSON-966857413 tempest-InstanceUsageAuditLogNegativeTestJSON-966857413-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:07:56.121379 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cbf2f2c7-fe4b-4536-8f4c-5596ffd1005e tempest-InstanceUsageAuditLogNegativeTestJSON-966857413 tempest-InstanceUsageAuditLogNegativeTestJSON-966857413-project] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log/2022-04-16 21:07:56" status: 403 len: 128 microversion: 2.1 time: 0.009624 Apr 16 21:07:56.122117 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 134/294] 10.222.0.20 () {58 vars in 1250 bytes} [Sat Apr 16 21:07:56 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-04-16%2021%3A07%3A56 => generated 128 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:07:56.129472 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-587c9605-1e1c-477b-8077-f7b26ab3e644 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:56.130587 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:56.130587 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:56.229000 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-424e792d-63d8-4cfb-821e-19183f68dc65 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "GET /compute/v2.1/servers/8d5cf7af-51b8-4392-a551-9d0d9b96a45d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.244159 Apr 16 21:07:56.229606 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 161/295] 10.222.0.20 () {58 vars in 1274 bytes} [Sat Apr 16 21:07:55 2022] GET /compute/v2.1/servers/8d5cf7af-51b8-4392-a551-9d0d9b96a45d/os-interface => generated 284 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:56.238793 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9a47fba0-bce8-4133-80c5-fcf8c4dfda73 tempest-AggregatesAdminTestV241-2010896074 tempest-AggregatesAdminTestV241-2010896074-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:56.238793 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:56.238793 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:56.239543 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-587c9605-1e1c-477b-8077-f7b26ab3e644 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.116034 Apr 16 21:07:56.240126 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 135/296] 10.222.0.20 () {58 vars in 1154 bytes} [Sat Apr 16 21:07:56 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 16 21:07:56.246183 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a47fba0-bce8-4133-80c5-fcf8c4dfda73 tempest-AggregatesAdminTestV241-2010896074 tempest-AggregatesAdminTestV241-2010896074-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:56.246698 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a47fba0-bce8-4133-80c5-fcf8c4dfda73 tempest-AggregatesAdminTestV241-2010896074 tempest-AggregatesAdminTestV241-2010896074-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:56.249121 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c9360e17-526f-4e99-bbc8-bb300d033265 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-96394332"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:56.250525 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:56.250525 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:56.251397 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.aggregate [None req-c9360e17-526f-4e99-bbc8-bb300d033265 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Generated uuid 64a4218e-7c80-4ae8-9c22-7a0153a7299e for aggregate {{(pid=137409) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 16 21:07:56.394626 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c9360e17-526f-4e99-bbc8-bb300d033265 tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.149137 Apr 16 21:07:56.401394 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 136/297] 10.222.0.20 () {60 vars in 1163 bytes} [Sat Apr 16 21:07:56 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:07:56.417693 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-521aacaf-0988-4c42-bd50-f0d3e0b94317 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:56.418328 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-521aacaf-0988-4c42-bd50-f0d3e0b94317 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 229e6d83-6ece-40c3-a33a-99fc46429d8c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:56.424635 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-521aacaf-0988-4c42-bd50-f0d3e0b94317 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:56.425088 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-521aacaf-0988-4c42-bd50-f0d3e0b94317 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:56.425869 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-521aacaf-0988-4c42-bd50-f0d3e0b94317 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:56.426309 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-521aacaf-0988-4c42-bd50-f0d3e0b94317 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:56.525318 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-521aacaf-0988-4c42-bd50-f0d3e0b94317 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82856a20b3764d17b5c9c1bebdd46c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998f0203a6c741839bde8be2da375d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:56.532887 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-521aacaf-0988-4c42-bd50-f0d3e0b94317 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "GET /compute/v2.1/servers/229e6d83-6ece-40c3-a33a-99fc46429d8c" status: 200 len: 1224 microversion: 2.1 time: 0.130250 Apr 16 21:07:56.533458 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 137/298] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:56 2022] GET /compute/v2.1/servers/229e6d83-6ece-40c3-a33a-99fc46429d8c => generated 1224 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:56.538084 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-619f710a-8ea1-46d5-bb18-6dab05dc9eee tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:56.538867 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:56.538867 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:56.546450 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-619f710a-8ea1-46d5-bb18-6dab05dc9eee tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 483 microversion: 2.1 time: 0.012047 Apr 16 21:07:56.547076 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 138/299] 10.222.0.20 () {58 vars in 1142 bytes} [Sat Apr 16 21:07:56 2022] GET /compute/v2.1/os-aggregates => generated 483 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:56.556946 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b469ff40-d19c-44ac-bc27-532ec17286be tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:56.557779 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:56.557779 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:56.786800 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9a47fba0-bce8-4133-80c5-fcf8c4dfda73 tempest-AggregatesAdminTestV241-2010896074 tempest-AggregatesAdminTestV241-2010896074-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 315 microversion: 2.41 time: 0.555894 Apr 16 21:07:56.799019 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b469ff40-d19c-44ac-bc27-532ec17286be tempest-AggregatesAdminTestJSON-1037272427 tempest-AggregatesAdminTestJSON-1037272427-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.245032 Apr 16 21:07:56.802107 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 139/300] 10.222.0.20 () {58 vars in 1154 bytes} [Sat Apr 16 21:07:56 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 16 21:07:56.806911 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 162/301] 10.222.0.20 () {62 vars in 1234 bytes} [Sat Apr 16 21:07:56 2022] POST /compute/v2.1/os-aggregates/17/action => generated 315 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:07:56.811167 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fb4936a9-85c3-4781-97c8-a7fcc4885c0c tempest-AggregatesAdminTestV241-2010896074 tempest-AggregatesAdminTestV241-2010896074-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:56.812895 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:56.812895 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:07:56.814277 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4ad59dea-0a0f-450e-b446-b5cf2eb3167b tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:56.814793 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4ad59dea-0a0f-450e-b446-b5cf2eb3167b tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] [instance: 8bf8828b-5b17-4317-a6b8-7856d023986a] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:56.826121 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fb4936a9-85c3-4781-97c8-a7fcc4885c0c tempest-AggregatesAdminTestV241-2010896074 tempest-AggregatesAdminTestV241-2010896074-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:56.827044 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fb4936a9-85c3-4781-97c8-a7fcc4885c0c tempest-AggregatesAdminTestV241-2010896074 tempest-AggregatesAdminTestV241-2010896074-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:56.841508 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4ad59dea-0a0f-450e-b446-b5cf2eb3167b tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:56.847361 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4ad59dea-0a0f-450e-b446-b5cf2eb3167b tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:56.847361 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4ad59dea-0a0f-450e-b446-b5cf2eb3167b tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:56.847361 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4ad59dea-0a0f-450e-b446-b5cf2eb3167b tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:56.878035 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-4ad59dea-0a0f-450e-b446-b5cf2eb3167b tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] HTTP exception thrown: Instance 8bf8828b-5b17-4317-a6b8-7856d023986a could not be found. Apr 16 21:07:56.880539 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4ad59dea-0a0f-450e-b446-b5cf2eb3167b tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Returning 404 to user: Instance 8bf8828b-5b17-4317-a6b8-7856d023986a could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:07:56.881592 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4ad59dea-0a0f-450e-b446-b5cf2eb3167b tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a" status: 404 len: 111 microversion: 2.1 time: 0.073420 Apr 16 21:07:56.893818 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 163/302] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:07:56 2022] DELETE /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:07:56.901907 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-62eff24e-afed-4011-bfbb-2abcea5393b1 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:56.903763 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-62eff24e-afed-4011-bfbb-2abcea5393b1 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] [instance: 8bf8828b-5b17-4317-a6b8-7856d023986a] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:56.913318 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-62eff24e-afed-4011-bfbb-2abcea5393b1 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:56.914026 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-62eff24e-afed-4011-bfbb-2abcea5393b1 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:56.915235 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-62eff24e-afed-4011-bfbb-2abcea5393b1 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:56.915950 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-62eff24e-afed-4011-bfbb-2abcea5393b1 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:56.941936 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-62eff24e-afed-4011-bfbb-2abcea5393b1 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] HTTP exception thrown: Instance 8bf8828b-5b17-4317-a6b8-7856d023986a could not be found. Apr 16 21:07:56.942544 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-62eff24e-afed-4011-bfbb-2abcea5393b1 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] Returning 404 to user: Instance 8bf8828b-5b17-4317-a6b8-7856d023986a could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:07:56.943376 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-62eff24e-afed-4011-bfbb-2abcea5393b1 tempest-AggregatesAdminTestJSON-30923853 tempest-AggregatesAdminTestJSON-30923853-project] 10.222.0.20 "GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a" status: 404 len: 111 microversion: 2.1 time: 0.045599 Apr 16 21:07:56.944530 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 164/303] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:56 2022] GET /compute/v2.1/servers/8bf8828b-5b17-4317-a6b8-7856d023986a => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:07:57.112087 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fb4936a9-85c3-4781-97c8-a7fcc4885c0c tempest-AggregatesAdminTestV241-2010896074 tempest-AggregatesAdminTestV241-2010896074-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 300 microversion: 2.41 time: 0.308265 Apr 16 21:07:57.112998 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 140/304] 10.222.0.20 () {62 vars in 1234 bytes} [Sat Apr 16 21:07:56 2022] POST /compute/v2.1/os-aggregates/17/action => generated 300 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:07:57.125783 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-54474a5c-036b-4f43-9c29-bc648cc25567 tempest-AggregatesAdminTestV241-2010896074 tempest-AggregatesAdminTestV241-2010896074-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:57.126769 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:07:57.126769 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:07:57.249930 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-54474a5c-036b-4f43-9c29-bc648cc25567 tempest-AggregatesAdminTestV241-2010896074 tempest-AggregatesAdminTestV241-2010896074-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.41 time: 0.129442 Apr 16 21:07:57.257838 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 165/305] 10.222.0.20 () {60 vars in 1195 bytes} [Sat Apr 16 21:07:57 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:07:57.551294 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-11ddb2ff-1630-4f9b-94a8-cb6e478cee68 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:57.551918 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-11ddb2ff-1630-4f9b-94a8-cb6e478cee68 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 229e6d83-6ece-40c3-a33a-99fc46429d8c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:57.559008 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-11ddb2ff-1630-4f9b-94a8-cb6e478cee68 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:57.559650 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-11ddb2ff-1630-4f9b-94a8-cb6e478cee68 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:57.568414 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-11ddb2ff-1630-4f9b-94a8-cb6e478cee68 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:57.568879 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-11ddb2ff-1630-4f9b-94a8-cb6e478cee68 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:57.748407 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-11ddb2ff-1630-4f9b-94a8-cb6e478cee68 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82856a20b3764d17b5c9c1bebdd46c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998f0203a6c741839bde8be2da375d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:57.759683 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-11ddb2ff-1630-4f9b-94a8-cb6e478cee68 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "GET /compute/v2.1/servers/229e6d83-6ece-40c3-a33a-99fc46429d8c" status: 200 len: 1272 microversion: 2.1 time: 0.213206 Apr 16 21:07:57.770454 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 141/306] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:57 2022] GET /compute/v2.1/servers/229e6d83-6ece-40c3-a33a-99fc46429d8c => generated 1272 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:58.533442 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-80fefb1a-483a-46bd-961e-f38533e09922 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:58.534106 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-cdde339d-4b89-49dd-aa36-0f493ad66674 req-9fa031bd-9c89-40b6-9b06-159e1936568f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d5cf7af-51b8-4392-a551-9d0d9b96a45d", "tag": "803ab649-d886-491f-afac-b601816b1ffe"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:07:58.535875 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-80fefb1a-483a-46bd-961e-f38533e09922 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 8d5cf7af-51b8-4392-a551-9d0d9b96a45d] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:58.547296 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-cdde339d-4b89-49dd-aa36-0f493ad66674 req-9fa031bd-9c89-40b6-9b06-159e1936568f service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:58.547755 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-cdde339d-4b89-49dd-aa36-0f493ad66674 req-9fa031bd-9c89-40b6-9b06-159e1936568f service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:58.563246 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-80fefb1a-483a-46bd-961e-f38533e09922 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:58.564961 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-80fefb1a-483a-46bd-961e-f38533e09922 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:58.567770 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-80fefb1a-483a-46bd-961e-f38533e09922 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:58.568142 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-cdde339d-4b89-49dd-aa36-0f493ad66674 req-9fa031bd-9c89-40b6-9b06-159e1936568f service nova] Creating event network-changed:803ab649-d886-491f-afac-b601816b1ffe for instance 8d5cf7af-51b8-4392-a551-9d0d9b96a45d on nch2-master-1 Apr 16 21:07:58.570821 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-80fefb1a-483a-46bd-961e-f38533e09922 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:58.574228 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-cdde339d-4b89-49dd-aa36-0f493ad66674 req-9fa031bd-9c89-40b6-9b06-159e1936568f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043774 Apr 16 21:07:58.575612 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 142/307] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:07:58.762035 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-80fefb1a-483a-46bd-961e-f38533e09922 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7da58ce23242bd947bbd7387b80b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6395bf8972949f8837289679b58d151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:58.771795 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-80fefb1a-483a-46bd-961e-f38533e09922 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "GET /compute/v2.1/servers/8d5cf7af-51b8-4392-a551-9d0d9b96a45d" status: 200 len: 1584 microversion: 2.1 time: 0.245760 Apr 16 21:07:58.778703 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b10aa6d3-25f4-4a59-8867-e5f3277c59cc tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:07:58.779639 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b10aa6d3-25f4-4a59-8867-e5f3277c59cc tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 229e6d83-6ece-40c3-a33a-99fc46429d8c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:07:58.787037 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 166/308] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:58 2022] GET /compute/v2.1/servers/8d5cf7af-51b8-4392-a551-9d0d9b96a45d => generated 1584 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:07:58.796050 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b10aa6d3-25f4-4a59-8867-e5f3277c59cc tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:58.797174 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b10aa6d3-25f4-4a59-8867-e5f3277c59cc tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:58.800210 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b10aa6d3-25f4-4a59-8867-e5f3277c59cc tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:07:58.811943 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b10aa6d3-25f4-4a59-8867-e5f3277c59cc tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:07:58.990033 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b10aa6d3-25f4-4a59-8867-e5f3277c59cc tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82856a20b3764d17b5c9c1bebdd46c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998f0203a6c741839bde8be2da375d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:07:59.002904 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b10aa6d3-25f4-4a59-8867-e5f3277c59cc tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "GET /compute/v2.1/servers/229e6d83-6ece-40c3-a33a-99fc46429d8c" status: 200 len: 1278 microversion: 2.1 time: 0.229154 Apr 16 21:07:59.004668 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 143/309] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:07:58 2022] GET /compute/v2.1/servers/229e6d83-6ece-40c3-a33a-99fc46429d8c => generated 1278 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:08:00.029304 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a9425b80-ac26-4edb-b7ad-0aead2cdbf39 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:00.031578 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a9425b80-ac26-4edb-b7ad-0aead2cdbf39 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 229e6d83-6ece-40c3-a33a-99fc46429d8c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:00.071989 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9425b80-ac26-4edb-b7ad-0aead2cdbf39 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:00.077770 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9425b80-ac26-4edb-b7ad-0aead2cdbf39 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:00.091926 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9425b80-ac26-4edb-b7ad-0aead2cdbf39 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:00.094139 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9425b80-ac26-4edb-b7ad-0aead2cdbf39 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:00.500363 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a9425b80-ac26-4edb-b7ad-0aead2cdbf39 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82856a20b3764d17b5c9c1bebdd46c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998f0203a6c741839bde8be2da375d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:00.517348 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a9425b80-ac26-4edb-b7ad-0aead2cdbf39 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "GET /compute/v2.1/servers/229e6d83-6ece-40c3-a33a-99fc46429d8c" status: 200 len: 1320 microversion: 2.1 time: 0.498580 Apr 16 21:08:00.528677 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 167/310] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:00 2022] GET /compute/v2.1/servers/229e6d83-6ece-40c3-a33a-99fc46429d8c => generated 1320 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:01.317492 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-9870aa6f-19e3-40af-bf92-08496bed619d req-29dec6b2-7d49-481b-9840-255a6b9e0358 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "229e6d83-6ece-40c3-a33a-99fc46429d8c", "tag": "2cf89b73-421e-4fab-a0c0-f1e5b07e8217"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:01.327060 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-9870aa6f-19e3-40af-bf92-08496bed619d req-29dec6b2-7d49-481b-9840-255a6b9e0358 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:01.328084 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-9870aa6f-19e3-40af-bf92-08496bed619d req-29dec6b2-7d49-481b-9840-255a6b9e0358 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:01.345386 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-9870aa6f-19e3-40af-bf92-08496bed619d req-29dec6b2-7d49-481b-9840-255a6b9e0358 service nova] Creating event network-changed:2cf89b73-421e-4fab-a0c0-f1e5b07e8217 for instance 229e6d83-6ece-40c3-a33a-99fc46429d8c on nch1-master-1 Apr 16 21:08:01.353042 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-9870aa6f-19e3-40af-bf92-08496bed619d req-29dec6b2-7d49-481b-9840-255a6b9e0358 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038923 Apr 16 21:08:01.354556 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 144/311] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:08:01.535355 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cb370f91-62a8-4d36-9995-ccbea881cb49 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:01.536753 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cb370f91-62a8-4d36-9995-ccbea881cb49 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 229e6d83-6ece-40c3-a33a-99fc46429d8c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:01.544040 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cb370f91-62a8-4d36-9995-ccbea881cb49 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:01.545003 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cb370f91-62a8-4d36-9995-ccbea881cb49 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:01.552057 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cb370f91-62a8-4d36-9995-ccbea881cb49 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:01.559753 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cb370f91-62a8-4d36-9995-ccbea881cb49 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:01.752292 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cb370f91-62a8-4d36-9995-ccbea881cb49 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82856a20b3764d17b5c9c1bebdd46c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998f0203a6c741839bde8be2da375d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:01.762354 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cb370f91-62a8-4d36-9995-ccbea881cb49 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "GET /compute/v2.1/servers/229e6d83-6ece-40c3-a33a-99fc46429d8c" status: 200 len: 1320 microversion: 2.1 time: 0.231381 Apr 16 21:08:01.772416 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 168/312] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:01 2022] GET /compute/v2.1/servers/229e6d83-6ece-40c3-a33a-99fc46429d8c => generated 1320 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:02.779678 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a47f0446-ac23-47b5-bd6c-c956da290fde tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:02.780584 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a47f0446-ac23-47b5-bd6c-c956da290fde tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 229e6d83-6ece-40c3-a33a-99fc46429d8c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:02.787077 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a47f0446-ac23-47b5-bd6c-c956da290fde tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:02.787562 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a47f0446-ac23-47b5-bd6c-c956da290fde tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:02.789225 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a47f0446-ac23-47b5-bd6c-c956da290fde tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:02.790443 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a47f0446-ac23-47b5-bd6c-c956da290fde tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:02.929741 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a47f0446-ac23-47b5-bd6c-c956da290fde tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82856a20b3764d17b5c9c1bebdd46c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998f0203a6c741839bde8be2da375d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:02.936996 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a47f0446-ac23-47b5-bd6c-c956da290fde tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "GET /compute/v2.1/servers/229e6d83-6ece-40c3-a33a-99fc46429d8c" status: 200 len: 1320 microversion: 2.1 time: 0.161936 Apr 16 21:08:02.937687 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 145/313] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:02 2022] GET /compute/v2.1/servers/229e6d83-6ece-40c3-a33a-99fc46429d8c => generated 1320 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:03.439915 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-affe65b4-d3de-4195-b199-c91e1abf2ad4 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-487965459", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:03.445019 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9e9bc400-24c2-4208-aeaf-81ecff35b7aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-426170342", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "341a7a54-447f-4bb3-9bb9-2193e32a0929"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:03.505700 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-affe65b4-d3de-4195-b199-c91e1abf2ad4 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] validate_networks() for None {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:08:03.535719 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-9e9bc400-24c2-4208-aeaf-81ecff35b7aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] validate_networks() for [('341a7a54-447f-4bb3-9bb9-2193e32a0929', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:08:03.747683 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-affe65b4-d3de-4195-b199-c91e1abf2ad4 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:08:03.747683 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-affe65b4-d3de-4195-b199-c91e1abf2ad4 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:08:03.747683 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-affe65b4-d3de-4195-b199-c91e1abf2ad4 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:08:03.748115 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-affe65b4-d3de-4195-b199-c91e1abf2ad4 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:08:03.748919 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-affe65b4-d3de-4195-b199-c91e1abf2ad4 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:08:03.761523 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-affe65b4-d3de-4195-b199-c91e1abf2ad4 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:03.761976 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-affe65b4-d3de-4195-b199-c91e1abf2ad4 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:03.762811 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-affe65b4-d3de-4195-b199-c91e1abf2ad4 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:03.763488 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-affe65b4-d3de-4195-b199-c91e1abf2ad4 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:03.781643 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-affe65b4-d3de-4195-b199-c91e1abf2ad4 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Getting quotas for project 487e280d7b014a7196cd1e4e9165cc7e. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:08:03.786563 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-affe65b4-d3de-4195-b199-c91e1abf2ad4 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Getting quotas for user 160e460966db4a7e8b697e26de50d0ff and project 487e280d7b014a7196cd1e4e9165cc7e. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:08:03.799930 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-affe65b4-d3de-4195-b199-c91e1abf2ad4 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:08:03.802379 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-affe65b4-d3de-4195-b199-c91e1abf2ad4 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] [instance: 84fdd641-4d23-472a-8b8f-fded89dbcc32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:08:04.041438 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-affe65b4-d3de-4195-b199-c91e1abf2ad4 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.131941 Apr 16 21:08:04.043514 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 169/314] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:08:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1135 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:08:04.050406 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bdfbecdf-c736-41f7-9b36-cc00530839ad tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:04.051019 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-bdfbecdf-c736-41f7-9b36-cc00530839ad tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 229e6d83-6ece-40c3-a33a-99fc46429d8c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:04.058997 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bdfbecdf-c736-41f7-9b36-cc00530839ad tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:04.059674 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bdfbecdf-c736-41f7-9b36-cc00530839ad tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:04.060636 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bdfbecdf-c736-41f7-9b36-cc00530839ad tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:04.061231 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bdfbecdf-c736-41f7-9b36-cc00530839ad tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:04.229576 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-bdfbecdf-c736-41f7-9b36-cc00530839ad tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82856a20b3764d17b5c9c1bebdd46c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998f0203a6c741839bde8be2da375d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:04.238071 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-bdfbecdf-c736-41f7-9b36-cc00530839ad tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "GET /compute/v2.1/servers/229e6d83-6ece-40c3-a33a-99fc46429d8c" status: 200 len: 1320 microversion: 2.1 time: 0.193529 Apr 16 21:08:04.238640 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 170/315] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:04 2022] GET /compute/v2.1/servers/229e6d83-6ece-40c3-a33a-99fc46429d8c => generated 1320 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:04.243626 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cef4e73b-8a58-4b54-9dd4-1c035bfe2c73 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:04.244444 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cef4e73b-8a58-4b54-9dd4-1c035bfe2c73 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] [instance: 84fdd641-4d23-472a-8b8f-fded89dbcc32] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:04.296019 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cef4e73b-8a58-4b54-9dd4-1c035bfe2c73 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160e460966db4a7e8b697e26de50d0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487e280d7b014a7196cd1e4e9165cc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:04.302970 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cef4e73b-8a58-4b54-9dd4-1c035bfe2c73 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] 10.222.0.20 "GET /compute/v2.1/servers/84fdd641-4d23-472a-8b8f-fded89dbcc32" status: 200 len: 1221 microversion: 2.1 time: 0.063374 Apr 16 21:08:04.303540 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 171/316] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:04 2022] GET /compute/v2.1/servers/84fdd641-4d23-472a-8b8f-fded89dbcc32 => generated 1221 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:04.652771 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-9e9bc400-24c2-4208-aeaf-81ecff35b7aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:08:04.653277 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-9e9bc400-24c2-4208-aeaf-81ecff35b7aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:08:04.653835 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-9e9bc400-24c2-4208-aeaf-81ecff35b7aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:08:04.654320 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-9e9bc400-24c2-4208-aeaf-81ecff35b7aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:08:04.654842 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-9e9bc400-24c2-4208-aeaf-81ecff35b7aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:08:04.664337 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9e9bc400-24c2-4208-aeaf-81ecff35b7aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:04.664748 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9e9bc400-24c2-4208-aeaf-81ecff35b7aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:04.665563 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9e9bc400-24c2-4208-aeaf-81ecff35b7aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:04.666001 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9e9bc400-24c2-4208-aeaf-81ecff35b7aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:04.683625 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-9e9bc400-24c2-4208-aeaf-81ecff35b7aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Getting quotas for project 68af3300a0d149adbbf934b4ff1f87d8. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:08:04.688801 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-9e9bc400-24c2-4208-aeaf-81ecff35b7aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Getting quotas for user 53d5464685cc40d9a1d891c6ae39a80f and project 68af3300a0d149adbbf934b4ff1f87d8. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:08:04.701350 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9e9bc400-24c2-4208-aeaf-81ecff35b7aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:08:04.703881 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9e9bc400-24c2-4208-aeaf-81ecff35b7aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d06de5cf-0b6e-4546-b316-545265d6af2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:08:04.849523 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9e9bc400-24c2-4208-aeaf-81ecff35b7aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.567745 Apr 16 21:08:04.850160 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 146/317] 10.222.0.20 () {62 vars in 1187 bytes} [Sat Apr 16 21:08:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1569 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Apr 16 21:08:04.860803 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4198440c-b23f-48af-a891-13c3f8bc8882 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:04.861456 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4198440c-b23f-48af-a891-13c3f8bc8882 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d06de5cf-0b6e-4546-b316-545265d6af2a] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:04.931345 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4198440c-b23f-48af-a891-13c3f8bc8882 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:04.941615 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4198440c-b23f-48af-a891-13c3f8bc8882 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:04.943764 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4198440c-b23f-48af-a891-13c3f8bc8882 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:04.945723 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4198440c-b23f-48af-a891-13c3f8bc8882 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a" status: 200 len: 1261 microversion: 2.25 time: 0.089382 Apr 16 21:08:04.946829 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 172/318] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:08:04 2022] GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a => generated 1261 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:08:05.255283 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d92583d4-5d16-4321-9c1b-7cfc084962b4 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:05.256152 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d92583d4-5d16-4321-9c1b-7cfc084962b4 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 229e6d83-6ece-40c3-a33a-99fc46429d8c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:05.265505 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d92583d4-5d16-4321-9c1b-7cfc084962b4 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:05.266194 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d92583d4-5d16-4321-9c1b-7cfc084962b4 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:05.268030 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d92583d4-5d16-4321-9c1b-7cfc084962b4 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:05.268818 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d92583d4-5d16-4321-9c1b-7cfc084962b4 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:05.323522 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-351c7eae-4528-4183-9e73-820cea85ec3d tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:05.324735 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-351c7eae-4528-4183-9e73-820cea85ec3d tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] [instance: 84fdd641-4d23-472a-8b8f-fded89dbcc32] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:05.409620 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-351c7eae-4528-4183-9e73-820cea85ec3d tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160e460966db4a7e8b697e26de50d0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487e280d7b014a7196cd1e4e9165cc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:05.417753 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-351c7eae-4528-4183-9e73-820cea85ec3d tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] 10.222.0.20 "GET /compute/v2.1/servers/84fdd641-4d23-472a-8b8f-fded89dbcc32" status: 200 len: 1221 microversion: 2.1 time: 0.101569 Apr 16 21:08:05.420217 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 173/319] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:05 2022] GET /compute/v2.1/servers/84fdd641-4d23-472a-8b8f-fded89dbcc32 => generated 1221 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:05.507096 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d92583d4-5d16-4321-9c1b-7cfc084962b4 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82856a20b3764d17b5c9c1bebdd46c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998f0203a6c741839bde8be2da375d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:05.515893 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d92583d4-5d16-4321-9c1b-7cfc084962b4 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "GET /compute/v2.1/servers/229e6d83-6ece-40c3-a33a-99fc46429d8c" status: 200 len: 1320 microversion: 2.1 time: 0.264681 Apr 16 21:08:05.516948 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 147/320] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:05 2022] GET /compute/v2.1/servers/229e6d83-6ece-40c3-a33a-99fc46429d8c => generated 1320 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:05.797179 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-daeea86a-4e50-454e-a0e0-9dd126cc5aa6 tempest-AZAdminV2TestJSON-489405216 tempest-AZAdminV2TestJSON-489405216-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:05.799990 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-daeea86a-4e50-454e-a0e0-9dd126cc5aa6 tempest-AZAdminV2TestJSON-489405216 tempest-AZAdminV2TestJSON-489405216-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:05.800851 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-daeea86a-4e50-454e-a0e0-9dd126cc5aa6 tempest-AZAdminV2TestJSON-489405216 tempest-AZAdminV2TestJSON-489405216-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:05.801688 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-daeea86a-4e50-454e-a0e0-9dd126cc5aa6 tempest-AZAdminV2TestJSON-489405216 tempest-AZAdminV2TestJSON-489405216-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:05.802107 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-daeea86a-4e50-454e-a0e0-9dd126cc5aa6 tempest-AZAdminV2TestJSON-489405216 tempest-AZAdminV2TestJSON-489405216-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:05.829388 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-daeea86a-4e50-454e-a0e0-9dd126cc5aa6 tempest-AZAdminV2TestJSON-489405216 tempest-AZAdminV2TestJSON-489405216-project-admin] 10.222.0.20 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.233636 Apr 16 21:08:05.831012 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 174/321] 10.222.0.20 () {58 vars in 1163 bytes} [Sat Apr 16 21:08:05 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:08:05.843399 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-911f8473-2252-4114-9f50-3b938ba74828 tempest-AZAdminV2TestJSON-489405216 tempest-AZAdminV2TestJSON-489405216-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:05.844409 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:05.844409 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:08:05.846730 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-911f8473-2252-4114-9f50-3b938ba74828 tempest-AZAdminV2TestJSON-489405216 tempest-AZAdminV2TestJSON-489405216-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:05.847396 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-911f8473-2252-4114-9f50-3b938ba74828 tempest-AZAdminV2TestJSON-489405216 tempest-AZAdminV2TestJSON-489405216-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:05.848698 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-911f8473-2252-4114-9f50-3b938ba74828 tempest-AZAdminV2TestJSON-489405216 tempest-AZAdminV2TestJSON-489405216-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:05.850334 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-911f8473-2252-4114-9f50-3b938ba74828 tempest-AZAdminV2TestJSON-489405216 tempest-AZAdminV2TestJSON-489405216-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:05.884347 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7d6da761-7d67-4bbe-8b5a-02c8a45eb334 tempest-FlavorsExtraSpecsNegativeTestJSON-1448301802 tempest-FlavorsExtraSpecsNegativeTestJSON-1448301802-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-292051666", "ram": 512, "vcpus": 1, "disk": 10, "id": 1953953502, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:05.884347 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:05.884347 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:08:05.884954 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-911f8473-2252-4114-9f50-3b938ba74828 tempest-AZAdminV2TestJSON-489405216 tempest-AZAdminV2TestJSON-489405216-project-admin] 10.222.0.20 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.040164 Apr 16 21:08:05.884954 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 175/322] 10.222.0.20 () {58 vars in 1184 bytes} [Sat Apr 16 21:08:05 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:08:05.963319 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-92c09af8-bebc-48db-a225-dfed635143dd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:05.963959 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-92c09af8-bebc-48db-a225-dfed635143dd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d06de5cf-0b6e-4546-b316-545265d6af2a] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:06.017759 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-92c09af8-bebc-48db-a225-dfed635143dd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:06.032651 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-92c09af8-bebc-48db-a225-dfed635143dd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:06.032651 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-92c09af8-bebc-48db-a225-dfed635143dd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:06.032651 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-92c09af8-bebc-48db-a225-dfed635143dd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a" status: 200 len: 1261 microversion: 2.25 time: 0.068176 Apr 16 21:08:06.032989 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 176/323] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:08:05 2022] GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a => generated 1261 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:08:06.084066 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7d6da761-7d67-4bbe-8b5a-02c8a45eb334 tempest-FlavorsExtraSpecsNegativeTestJSON-1448301802 tempest-FlavorsExtraSpecsNegativeTestJSON-1448301802-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.379130 Apr 16 21:08:06.091181 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 148/324] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:08:05 2022] POST /compute/v2.1/flavors => generated 415 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:08:06.437909 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2d499888-493b-406c-b02d-603f66037563 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:06.438822 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2d499888-493b-406c-b02d-603f66037563 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] [instance: 84fdd641-4d23-472a-8b8f-fded89dbcc32] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:06.445810 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6094e579-082c-4202-aacb-bf02c81ba240 tempest-FlavorsExtraSpecsNegativeTestJSON-601273337 tempest-FlavorsExtraSpecsNegativeTestJSON-601273337-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:06.458356 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2d499888-493b-406c-b02d-603f66037563 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:06.458501 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-6094e579-082c-4202-aacb-bf02c81ba240 tempest-FlavorsExtraSpecsNegativeTestJSON-601273337 tempest-FlavorsExtraSpecsNegativeTestJSON-601273337-project] HTTP exception thrown: Flavor 1953953502 has no extra specs with key hw:cpu_thread_policy. Apr 16 21:08:06.459422 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2d499888-493b-406c-b02d-603f66037563 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:06.461671 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2d499888-493b-406c-b02d-603f66037563 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:06.461917 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6094e579-082c-4202-aacb-bf02c81ba240 tempest-FlavorsExtraSpecsNegativeTestJSON-601273337 tempest-FlavorsExtraSpecsNegativeTestJSON-601273337-project] Returning 404 to user: Flavor 1953953502 has no extra specs with key hw:cpu_thread_policy. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:08:06.461993 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2d499888-493b-406c-b02d-603f66037563 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:06.462611 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6094e579-082c-4202-aacb-bf02c81ba240 tempest-FlavorsExtraSpecsNegativeTestJSON-601273337 tempest-FlavorsExtraSpecsNegativeTestJSON-601273337-project] 10.222.0.20 "GET /compute/v2.1/flavors/1953953502/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.369918 Apr 16 21:08:06.464861 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 177/325] 10.222.0.20 () {58 vars in 1265 bytes} [Sat Apr 16 21:08:06 2022] GET /compute/v2.1/flavors/1953953502/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 372 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:08:06.473556 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-79bc62d3-ea97-448c-aed6-195cc455e4f1 tempest-FlavorsExtraSpecsNegativeTestJSON-601273337 tempest-FlavorsExtraSpecsNegativeTestJSON-601273337-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:06.475125 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:06.475125 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:08:06.476768 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-79bc62d3-ea97-448c-aed6-195cc455e4f1 tempest-FlavorsExtraSpecsNegativeTestJSON-601273337 tempest-FlavorsExtraSpecsNegativeTestJSON-601273337-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'bb51245018d94dc883b1c40f94eb4322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56035dc6a13a4ced8c1abad8f04d87dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:06.477580 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-79bc62d3-ea97-448c-aed6-195cc455e4f1 tempest-FlavorsExtraSpecsNegativeTestJSON-601273337 tempest-FlavorsExtraSpecsNegativeTestJSON-601273337-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:08:06.478548 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-79bc62d3-ea97-448c-aed6-195cc455e4f1 tempest-FlavorsExtraSpecsNegativeTestJSON-601273337 tempest-FlavorsExtraSpecsNegativeTestJSON-601273337-project] 10.222.0.20 "POST /compute/v2.1/flavors/1953953502/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.009242 Apr 16 21:08:06.484016 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 178/326] 10.222.0.20 () {60 vars in 1223 bytes} [Sat Apr 16 21:08:06 2022] POST /compute/v2.1/flavors/1953953502/os-extra_specs => generated 124 bytes in 15 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:08:06.488675 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-61cb1e08-7476-4107-a1db-4ed158e86b0d tempest-FlavorsExtraSpecsNegativeTestJSON-1448301802 tempest-FlavorsExtraSpecsNegativeTestJSON-1448301802-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:06.537323 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2d499888-493b-406c-b02d-603f66037563 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160e460966db4a7e8b697e26de50d0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487e280d7b014a7196cd1e4e9165cc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:06.546093 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2d499888-493b-406c-b02d-603f66037563 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] 10.222.0.20 "GET /compute/v2.1/servers/84fdd641-4d23-472a-8b8f-fded89dbcc32" status: 200 len: 1273 microversion: 2.1 time: 0.112191 Apr 16 21:08:06.546658 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 149/327] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:06 2022] GET /compute/v2.1/servers/84fdd641-4d23-472a-8b8f-fded89dbcc32 => generated 1273 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:08:06.551418 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fb14a552-dd31-4818-818f-7bb53fb8144c tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:06.552325 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-fb14a552-dd31-4818-818f-7bb53fb8144c tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 229e6d83-6ece-40c3-a33a-99fc46429d8c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:06.564295 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fb14a552-dd31-4818-818f-7bb53fb8144c tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:06.565045 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fb14a552-dd31-4818-818f-7bb53fb8144c tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:06.570339 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fb14a552-dd31-4818-818f-7bb53fb8144c tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:06.570339 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fb14a552-dd31-4818-818f-7bb53fb8144c tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:06.603210 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-61cb1e08-7476-4107-a1db-4ed158e86b0d tempest-FlavorsExtraSpecsNegativeTestJSON-1448301802 tempest-FlavorsExtraSpecsNegativeTestJSON-1448301802-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1953953502/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.117929 Apr 16 21:08:06.604131 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 179/328] 10.222.0.20 () {60 vars in 1223 bytes} [Sat Apr 16 21:08:06 2022] POST /compute/v2.1/flavors/1953953502/os-extra_specs => generated 66 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:08:06.613861 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2c09245a-22e8-4e6d-b024-547156050255 tempest-FlavorsExtraSpecsNegativeTestJSON-601273337 tempest-FlavorsExtraSpecsNegativeTestJSON-601273337-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:06.614949 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:06.614949 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:08:06.615855 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2c09245a-22e8-4e6d-b024-547156050255 tempest-FlavorsExtraSpecsNegativeTestJSON-601273337 tempest-FlavorsExtraSpecsNegativeTestJSON-601273337-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'bb51245018d94dc883b1c40f94eb4322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56035dc6a13a4ced8c1abad8f04d87dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:06.617298 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2c09245a-22e8-4e6d-b024-547156050255 tempest-FlavorsExtraSpecsNegativeTestJSON-601273337 tempest-FlavorsExtraSpecsNegativeTestJSON-601273337-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:08:06.618901 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2c09245a-22e8-4e6d-b024-547156050255 tempest-FlavorsExtraSpecsNegativeTestJSON-601273337 tempest-FlavorsExtraSpecsNegativeTestJSON-601273337-project] 10.222.0.20 "DELETE /compute/v2.1/flavors/1953953502/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.008494 Apr 16 21:08:06.619888 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 180/329] 10.222.0.20 () {58 vars in 1247 bytes} [Sat Apr 16 21:08:06 2022] DELETE /compute/v2.1/flavors/1953953502/os-extra_specs/hw:numa_nodes => generated 124 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:08:06.630855 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-154eeb8f-6804-482a-9ed1-a124abd2a088 tempest-FlavorsExtraSpecsNegativeTestJSON-1448301802 tempest-FlavorsExtraSpecsNegativeTestJSON-1448301802-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:06.694235 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-154eeb8f-6804-482a-9ed1-a124abd2a088 tempest-FlavorsExtraSpecsNegativeTestJSON-1448301802 tempest-FlavorsExtraSpecsNegativeTestJSON-1448301802-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1953953502/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.069121 Apr 16 21:08:06.694871 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 181/330] 10.222.0.20 () {60 vars in 1223 bytes} [Sat Apr 16 21:08:06 2022] POST /compute/v2.1/flavors/1953953502/os-extra_specs => generated 66 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 16 21:08:06.727165 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-43136e48-984b-4289-9203-ed04a39085d6 tempest-FlavorsExtraSpecsNegativeTestJSON-601273337 tempest-FlavorsExtraSpecsNegativeTestJSON-601273337-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:06.731148 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:06.731148 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:08:06.732381 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-43136e48-984b-4289-9203-ed04a39085d6 tempest-FlavorsExtraSpecsNegativeTestJSON-601273337 tempest-FlavorsExtraSpecsNegativeTestJSON-601273337-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'bb51245018d94dc883b1c40f94eb4322', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56035dc6a13a4ced8c1abad8f04d87dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:06.734217 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-43136e48-984b-4289-9203-ed04a39085d6 tempest-FlavorsExtraSpecsNegativeTestJSON-601273337 tempest-FlavorsExtraSpecsNegativeTestJSON-601273337-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:08:06.737872 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-43136e48-984b-4289-9203-ed04a39085d6 tempest-FlavorsExtraSpecsNegativeTestJSON-601273337 tempest-FlavorsExtraSpecsNegativeTestJSON-601273337-project] 10.222.0.20 "PUT /compute/v2.1/flavors/1953953502/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.036959 Apr 16 21:08:06.746394 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 182/331] 10.222.0.20 () {60 vars in 1264 bytes} [Sat Apr 16 21:08:06 2022] PUT /compute/v2.1/flavors/1953953502/os-extra_specs/hw:numa_nodes => generated 124 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:08:06.752112 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0443a8e1-f10d-4a4d-8b5b-06226b50eb5a tempest-FlavorsExtraSpecsNegativeTestJSON-1448301802 tempest-FlavorsExtraSpecsNegativeTestJSON-1448301802-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:06.764962 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-0443a8e1-f10d-4a4d-8b5b-06226b50eb5a tempest-FlavorsExtraSpecsNegativeTestJSON-1448301802 tempest-FlavorsExtraSpecsNegativeTestJSON-1448301802-project-admin] HTTP exception thrown: Flavor 1953953502 has no extra specs with key hw:cpu_thread_policy. Apr 16 21:08:06.765574 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0443a8e1-f10d-4a4d-8b5b-06226b50eb5a tempest-FlavorsExtraSpecsNegativeTestJSON-1448301802 tempest-FlavorsExtraSpecsNegativeTestJSON-1448301802-project-admin] Returning 404 to user: Flavor 1953953502 has no extra specs with key hw:cpu_thread_policy. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:08:06.766419 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0443a8e1-f10d-4a4d-8b5b-06226b50eb5a tempest-FlavorsExtraSpecsNegativeTestJSON-1448301802 tempest-FlavorsExtraSpecsNegativeTestJSON-1448301802-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1953953502/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.018550 Apr 16 21:08:06.766966 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 183/332] 10.222.0.20 () {58 vars in 1268 bytes} [Sat Apr 16 21:08:06 2022] DELETE /compute/v2.1/flavors/1953953502/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:08:06.769694 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-fb14a552-dd31-4818-818f-7bb53fb8144c tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82856a20b3764d17b5c9c1bebdd46c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998f0203a6c741839bde8be2da375d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:06.777761 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fb14a552-dd31-4818-818f-7bb53fb8144c tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "GET /compute/v2.1/servers/229e6d83-6ece-40c3-a33a-99fc46429d8c" status: 200 len: 1320 microversion: 2.1 time: 0.229908 Apr 16 21:08:06.778024 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-023d308e-8565-4519-bc27-bba65f5906b5 tempest-FlavorsExtraSpecsNegativeTestJSON-1448301802 tempest-FlavorsExtraSpecsNegativeTestJSON-1448301802-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:06.778342 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 150/333] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:06 2022] GET /compute/v2.1/servers/229e6d83-6ece-40c3-a33a-99fc46429d8c => generated 1320 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:06.780016 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-023d308e-8565-4519-bc27-bba65f5906b5 tempest-FlavorsExtraSpecsNegativeTestJSON-1448301802 tempest-FlavorsExtraSpecsNegativeTestJSON-1448301802-project-admin] HTTP exception thrown: Request body and URI mismatch Apr 16 21:08:06.787271 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-023d308e-8565-4519-bc27-bba65f5906b5 tempest-FlavorsExtraSpecsNegativeTestJSON-1448301802 tempest-FlavorsExtraSpecsNegativeTestJSON-1448301802-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:08:06.787271 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-023d308e-8565-4519-bc27-bba65f5906b5 tempest-FlavorsExtraSpecsNegativeTestJSON-1448301802 tempest-FlavorsExtraSpecsNegativeTestJSON-1448301802-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/1953953502/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.007256 Apr 16 21:08:06.787271 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 184/334] 10.222.0.20 () {60 vars in 1264 bytes} [Sat Apr 16 21:08:06 2022] PUT /compute/v2.1/flavors/1953953502/os-extra_specs/hw:numa_nodes => generated 73 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Apr 16 21:08:06.793210 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-14e3a95b-12a7-417e-9aad-64959585d604 tempest-FlavorsExtraSpecsNegativeTestJSON-1448301802 tempest-FlavorsExtraSpecsNegativeTestJSON-1448301802-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:06.794508 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-14e3a95b-12a7-417e-9aad-64959585d604 tempest-FlavorsExtraSpecsNegativeTestJSON-1448301802 tempest-FlavorsExtraSpecsNegativeTestJSON-1448301802-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:08:06.795237 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-14e3a95b-12a7-417e-9aad-64959585d604 tempest-FlavorsExtraSpecsNegativeTestJSON-1448301802 tempest-FlavorsExtraSpecsNegativeTestJSON-1448301802-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/1953953502/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.006289 Apr 16 21:08:06.795749 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 151/335] 10.222.0.20 () {60 vars in 1264 bytes} [Sat Apr 16 21:08:06 2022] PUT /compute/v2.1/flavors/1953953502/os-extra_specs/hw:numa_nodes => generated 117 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:08:06.804789 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0e18418c-4389-45b5-9096-c063f70975d5 tempest-FlavorsExtraSpecsNegativeTestJSON-1448301802 tempest-FlavorsExtraSpecsNegativeTestJSON-1448301802-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:06.805796 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:06.805796 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:08:07.001865 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0e18418c-4389-45b5-9096-c063f70975d5 tempest-FlavorsExtraSpecsNegativeTestJSON-1448301802 tempest-FlavorsExtraSpecsNegativeTestJSON-1448301802-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1953953502" status: 202 len: 0 microversion: 2.1 time: 0.201194 Apr 16 21:08:07.005836 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 185/336] 10.222.0.20 () {58 vars in 1160 bytes} [Sat Apr 16 21:08:06 2022] DELETE /compute/v2.1/flavors/1953953502 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:08:07.012706 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e9983683-6e12-4586-b854-5d37c37ffa04 tempest-FlavorsExtraSpecsNegativeTestJSON-1448301802 tempest-FlavorsExtraSpecsNegativeTestJSON-1448301802-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:07.033445 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e9983683-6e12-4586-b854-5d37c37ffa04 tempest-FlavorsExtraSpecsNegativeTestJSON-1448301802 tempest-FlavorsExtraSpecsNegativeTestJSON-1448301802-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.026262 Apr 16 21:08:07.135500 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 186/337] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:08:07 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:07.135500 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e4990ffc-45cf-4fd3-9c9c-f70d09dd2e01 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:07.135500 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e4990ffc-45cf-4fd3-9c9c-f70d09dd2e01 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d06de5cf-0b6e-4546-b316-545265d6af2a] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:07.135500 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e4990ffc-45cf-4fd3-9c9c-f70d09dd2e01 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:07.137043 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e4990ffc-45cf-4fd3-9c9c-f70d09dd2e01 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:07.137043 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e4990ffc-45cf-4fd3-9c9c-f70d09dd2e01 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:07.137043 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e4990ffc-45cf-4fd3-9c9c-f70d09dd2e01 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:07.137893 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-45da82d3-3fbe-4ddd-9218-d647a17c641a tempest-FlavorMetadataValidation-283756537 tempest-FlavorMetadataValidation-283756537-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1614237198", "id": 1303719745, "os-flavor-access:is_public": "True"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:07.137893 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:07.137893 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:08:07.138773 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e4990ffc-45cf-4fd3-9c9c-f70d09dd2e01 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:07.138773 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e4990ffc-45cf-4fd3-9c9c-f70d09dd2e01 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:07.139137 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e4990ffc-45cf-4fd3-9c9c-f70d09dd2e01 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:07.139137 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e4990ffc-45cf-4fd3-9c9c-f70d09dd2e01 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a" status: 200 len: 1265 microversion: 2.25 time: 0.087273 Apr 16 21:08:07.139137 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 187/338] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:08:07 2022] GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:08:07.463116 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-45da82d3-3fbe-4ddd-9218-d647a17c641a tempest-FlavorMetadataValidation-283756537 tempest-FlavorMetadataValidation-283756537-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.611660 Apr 16 21:08:07.465165 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 152/339] 10.222.0.20 () {62 vars in 1187 bytes} [Sat Apr 16 21:08:06 2022] POST /compute/v2.1/flavors => generated 471 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:08:07.477107 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a396cd33-4b86-4af6-ae4c-e90b832927ee tempest-FlavorMetadataValidation-283756537 tempest-FlavorMetadataValidation-283756537-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:07.478405 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:07.478405 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:08:07.562817 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0dc56b71-c574-4e4d-a583-62ea77886e8b tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:07.565459 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0dc56b71-c574-4e4d-a583-62ea77886e8b tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] [instance: 84fdd641-4d23-472a-8b8f-fded89dbcc32] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:07.572667 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0dc56b71-c574-4e4d-a583-62ea77886e8b tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:07.583516 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0dc56b71-c574-4e4d-a583-62ea77886e8b tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:07.587215 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0dc56b71-c574-4e4d-a583-62ea77886e8b tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:07.587679 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0dc56b71-c574-4e4d-a583-62ea77886e8b tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:07.687342 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0dc56b71-c574-4e4d-a583-62ea77886e8b tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160e460966db4a7e8b697e26de50d0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487e280d7b014a7196cd1e4e9165cc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:07.697503 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0dc56b71-c574-4e4d-a583-62ea77886e8b tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] 10.222.0.20 "GET /compute/v2.1/servers/84fdd641-4d23-472a-8b8f-fded89dbcc32" status: 200 len: 1291 microversion: 2.1 time: 0.137859 Apr 16 21:08:07.698272 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 153/340] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:07 2022] GET /compute/v2.1/servers/84fdd641-4d23-472a-8b8f-fded89dbcc32 => generated 1291 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:07.766539 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a396cd33-4b86-4af6-ae4c-e90b832927ee tempest-FlavorMetadataValidation-283756537 tempest-FlavorMetadataValidation-283756537-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/1303719745/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.293568 Apr 16 21:08:07.772003 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 188/341] 10.222.0.20 () {62 vars in 1264 bytes} [Sat Apr 16 21:08:07 2022] POST /compute/v2.1/flavors/1303719745/os-extra_specs => generated 62 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:07.779960 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-52adcf31-25fa-405b-9f40-2dd0abbb5553 tempest-FlavorMetadataValidation-283756537 tempest-FlavorMetadataValidation-283756537-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:07.780762 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:07.780762 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:08:07.799447 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e55a4a11-4ab3-444a-8af1-159dd803f943 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:07.800056 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e55a4a11-4ab3-444a-8af1-159dd803f943 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 229e6d83-6ece-40c3-a33a-99fc46429d8c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:07.806557 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e55a4a11-4ab3-444a-8af1-159dd803f943 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:07.807047 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e55a4a11-4ab3-444a-8af1-159dd803f943 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:07.807823 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e55a4a11-4ab3-444a-8af1-159dd803f943 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:07.808311 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e55a4a11-4ab3-444a-8af1-159dd803f943 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:07.923464 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-52adcf31-25fa-405b-9f40-2dd0abbb5553 tempest-FlavorMetadataValidation-283756537 tempest-FlavorMetadataValidation-283756537-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1303719745" status: 202 len: 0 microversion: 2.86 time: 0.145972 Apr 16 21:08:07.930938 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 154/342] 10.222.0.20 () {60 vars in 1201 bytes} [Sat Apr 16 21:08:07 2022] DELETE /compute/v2.1/flavors/1303719745 => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:08:07.938791 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1206e7e5-df3a-429a-8ab3-96ba03cf62c6 tempest-FlavorMetadataValidation-283756537 tempest-FlavorMetadataValidation-283756537-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:07.963020 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e55a4a11-4ab3-444a-8af1-159dd803f943 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82856a20b3764d17b5c9c1bebdd46c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998f0203a6c741839bde8be2da375d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:07.976619 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e55a4a11-4ab3-444a-8af1-159dd803f943 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "GET /compute/v2.1/servers/229e6d83-6ece-40c3-a33a-99fc46429d8c" status: 200 len: 1320 microversion: 2.1 time: 0.180483 Apr 16 21:08:07.977593 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 189/343] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:07 2022] GET /compute/v2.1/servers/229e6d83-6ece-40c3-a33a-99fc46429d8c => generated 1320 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:08:07.988945 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1206e7e5-df3a-429a-8ab3-96ba03cf62c6 tempest-FlavorMetadataValidation-283756537 tempest-FlavorMetadataValidation-283756537-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 6676 microversion: 2.86 time: 0.057245 Apr 16 21:08:07.989720 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 155/344] 10.222.0.20 () {60 vars in 1186 bytes} [Sat Apr 16 21:08:07 2022] GET /compute/v2.1/flavors/detail => generated 6676 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:08:08.151666 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b74b2771-821e-4117-ae27-40ae4cdabd8f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:08.152337 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b74b2771-821e-4117-ae27-40ae4cdabd8f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d06de5cf-0b6e-4546-b316-545265d6af2a] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:08.158549 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b74b2771-821e-4117-ae27-40ae4cdabd8f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:08.159005 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b74b2771-821e-4117-ae27-40ae4cdabd8f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:08.159905 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b74b2771-821e-4117-ae27-40ae4cdabd8f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:08.160369 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b74b2771-821e-4117-ae27-40ae4cdabd8f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:08.238344 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b74b2771-821e-4117-ae27-40ae4cdabd8f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:08.250730 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b74b2771-821e-4117-ae27-40ae4cdabd8f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:08.255271 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b74b2771-821e-4117-ae27-40ae4cdabd8f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:08.260885 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b74b2771-821e-4117-ae27-40ae4cdabd8f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a" status: 200 len: 1313 microversion: 2.25 time: 0.109883 Apr 16 21:08:08.260885 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 190/345] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:08:08 2022] GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a => generated 1313 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:08:08.394576 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-d9ffb112-87f8-4fd6-8fae-292fdc51cf29 req-dd16f225-b090-4470-b2ea-84e67781976a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "229e6d83-6ece-40c3-a33a-99fc46429d8c", "name": "network-vif-plugged", "status": "completed", "tag": "2cf89b73-421e-4fab-a0c0-f1e5b07e8217"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:08.405011 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-d9ffb112-87f8-4fd6-8fae-292fdc51cf29 req-dd16f225-b090-4470-b2ea-84e67781976a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:08.405742 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-d9ffb112-87f8-4fd6-8fae-292fdc51cf29 req-dd16f225-b090-4470-b2ea-84e67781976a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:08.418211 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-d9ffb112-87f8-4fd6-8fae-292fdc51cf29 req-dd16f225-b090-4470-b2ea-84e67781976a service nova] Creating event network-vif-plugged:2cf89b73-421e-4fab-a0c0-f1e5b07e8217 for instance 229e6d83-6ece-40c3-a33a-99fc46429d8c on nch1-master-1 Apr 16 21:08:08.423983 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-d9ffb112-87f8-4fd6-8fae-292fdc51cf29 req-dd16f225-b090-4470-b2ea-84e67781976a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033540 Apr 16 21:08:08.425339 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 156/346] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:08:08.716978 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0993a631-d55c-457e-89fb-c61705327c27 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:08.717682 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0993a631-d55c-457e-89fb-c61705327c27 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] [instance: 84fdd641-4d23-472a-8b8f-fded89dbcc32] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:08.730152 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0993a631-d55c-457e-89fb-c61705327c27 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:08.730152 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0993a631-d55c-457e-89fb-c61705327c27 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:08.732964 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0993a631-d55c-457e-89fb-c61705327c27 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:08.734764 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0993a631-d55c-457e-89fb-c61705327c27 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:08.998693 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7cd73153-5ab9-421f-af5f-84d139de0d25 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:08.998693 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7cd73153-5ab9-421f-af5f-84d139de0d25 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 229e6d83-6ece-40c3-a33a-99fc46429d8c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:09.005471 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7cd73153-5ab9-421f-af5f-84d139de0d25 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:09.005823 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7cd73153-5ab9-421f-af5f-84d139de0d25 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:09.011065 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7cd73153-5ab9-421f-af5f-84d139de0d25 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:09.011528 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7cd73153-5ab9-421f-af5f-84d139de0d25 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:09.131511 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0993a631-d55c-457e-89fb-c61705327c27 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160e460966db4a7e8b697e26de50d0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487e280d7b014a7196cd1e4e9165cc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:09.141307 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0993a631-d55c-457e-89fb-c61705327c27 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] 10.222.0.20 "GET /compute/v2.1/servers/84fdd641-4d23-472a-8b8f-fded89dbcc32" status: 200 len: 1321 microversion: 2.1 time: 0.429996 Apr 16 21:08:09.142431 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 191/347] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:08 2022] GET /compute/v2.1/servers/84fdd641-4d23-472a-8b8f-fded89dbcc32 => generated 1321 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:09.275306 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ad8d1c7b-d417-4449-968e-3ce5c9409e2e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:09.277120 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ad8d1c7b-d417-4449-968e-3ce5c9409e2e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d06de5cf-0b6e-4546-b316-545265d6af2a] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:09.283726 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ad8d1c7b-d417-4449-968e-3ce5c9409e2e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:09.284230 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ad8d1c7b-d417-4449-968e-3ce5c9409e2e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:09.285065 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ad8d1c7b-d417-4449-968e-3ce5c9409e2e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:09.285508 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ad8d1c7b-d417-4449-968e-3ce5c9409e2e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:09.329300 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7cd73153-5ab9-421f-af5f-84d139de0d25 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82856a20b3764d17b5c9c1bebdd46c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998f0203a6c741839bde8be2da375d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:09.337335 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7cd73153-5ab9-421f-af5f-84d139de0d25 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "GET /compute/v2.1/servers/229e6d83-6ece-40c3-a33a-99fc46429d8c" status: 200 len: 1320 microversion: 2.1 time: 0.347262 Apr 16 21:08:09.338407 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 157/348] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:08 2022] GET /compute/v2.1/servers/229e6d83-6ece-40c3-a33a-99fc46429d8c => generated 1320 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:08:09.392557 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ad8d1c7b-d417-4449-968e-3ce5c9409e2e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:09.401821 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ad8d1c7b-d417-4449-968e-3ce5c9409e2e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:09.403436 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ad8d1c7b-d417-4449-968e-3ce5c9409e2e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:09.405480 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ad8d1c7b-d417-4449-968e-3ce5c9409e2e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a" status: 200 len: 1319 microversion: 2.25 time: 0.134423 Apr 16 21:08:09.406326 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 192/349] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:08:09 2022] GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a => generated 1319 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:08:10.158159 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-83481da0-8282-40b2-8906-83de8da67ced tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:10.161451 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-83481da0-8282-40b2-8906-83de8da67ced tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] [instance: 84fdd641-4d23-472a-8b8f-fded89dbcc32] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:10.173140 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-83481da0-8282-40b2-8906-83de8da67ced tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:10.173606 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-83481da0-8282-40b2-8906-83de8da67ced tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:10.174406 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-83481da0-8282-40b2-8906-83de8da67ced tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:10.174854 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-83481da0-8282-40b2-8906-83de8da67ced tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:10.222246 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-10b4dcea-dd5e-4081-97b4-2b093c4c796c req-0bcfd67c-b875-4690-8f9b-27c4d89e1849 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "84fdd641-4d23-472a-8b8f-fded89dbcc32", "tag": "bab3ec3e-82d0-419b-9ccb-11f635214fe4"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:10.231707 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-10b4dcea-dd5e-4081-97b4-2b093c4c796c req-0bcfd67c-b875-4690-8f9b-27c4d89e1849 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:10.232463 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-10b4dcea-dd5e-4081-97b4-2b093c4c796c req-0bcfd67c-b875-4690-8f9b-27c4d89e1849 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:10.247065 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-10b4dcea-dd5e-4081-97b4-2b093c4c796c req-0bcfd67c-b875-4690-8f9b-27c4d89e1849 service nova] Creating event network-changed:bab3ec3e-82d0-419b-9ccb-11f635214fe4 for instance 84fdd641-4d23-472a-8b8f-fded89dbcc32 on nch2-master-1 Apr 16 21:08:10.253656 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-10b4dcea-dd5e-4081-97b4-2b093c4c796c req-0bcfd67c-b875-4690-8f9b-27c4d89e1849 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033761 Apr 16 21:08:10.253656 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 193/350] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:08:10.356581 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-519c03de-24a7-4445-bf07-3b1cea1612b0 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:10.357924 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-519c03de-24a7-4445-bf07-3b1cea1612b0 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 229e6d83-6ece-40c3-a33a-99fc46429d8c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:10.365518 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-519c03de-24a7-4445-bf07-3b1cea1612b0 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:10.367250 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-519c03de-24a7-4445-bf07-3b1cea1612b0 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:10.368456 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-519c03de-24a7-4445-bf07-3b1cea1612b0 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:10.369149 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-519c03de-24a7-4445-bf07-3b1cea1612b0 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:10.573704 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-83481da0-8282-40b2-8906-83de8da67ced tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160e460966db4a7e8b697e26de50d0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487e280d7b014a7196cd1e4e9165cc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:10.590687 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-83481da0-8282-40b2-8906-83de8da67ced tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] 10.222.0.20 "GET /compute/v2.1/servers/84fdd641-4d23-472a-8b8f-fded89dbcc32" status: 200 len: 1321 microversion: 2.1 time: 0.432726 Apr 16 21:08:10.592592 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 158/351] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:10 2022] GET /compute/v2.1/servers/84fdd641-4d23-472a-8b8f-fded89dbcc32 => generated 1321 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:10.610918 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3f29b16d-f8dc-4189-8124-0a24dcd3ee01 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:10.611843 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3f29b16d-f8dc-4189-8124-0a24dcd3ee01 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d06de5cf-0b6e-4546-b316-545265d6af2a] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:10.640616 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3f29b16d-f8dc-4189-8124-0a24dcd3ee01 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:10.648201 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3f29b16d-f8dc-4189-8124-0a24dcd3ee01 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:10.648201 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3f29b16d-f8dc-4189-8124-0a24dcd3ee01 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:10.648201 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3f29b16d-f8dc-4189-8124-0a24dcd3ee01 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:10.794880 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-519c03de-24a7-4445-bf07-3b1cea1612b0 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82856a20b3764d17b5c9c1bebdd46c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998f0203a6c741839bde8be2da375d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:10.803079 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-519c03de-24a7-4445-bf07-3b1cea1612b0 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "GET /compute/v2.1/servers/229e6d83-6ece-40c3-a33a-99fc46429d8c" status: 200 len: 1470 microversion: 2.1 time: 0.452195 Apr 16 21:08:10.804642 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 194/352] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:10 2022] GET /compute/v2.1/servers/229e6d83-6ece-40c3-a33a-99fc46429d8c => generated 1470 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:08:10.821012 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-02db3e02-62fb-43be-ac45-660f047d94ed tempest-DeleteServersAdminTestJSON-401140112 tempest-DeleteServersAdminTestJSON-401140112-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:10.822082 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-02db3e02-62fb-43be-ac45-660f047d94ed tempest-DeleteServersAdminTestJSON-401140112 tempest-DeleteServersAdminTestJSON-401140112-project-admin] [instance: 229e6d83-6ece-40c3-a33a-99fc46429d8c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:10.829470 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-02db3e02-62fb-43be-ac45-660f047d94ed tempest-DeleteServersAdminTestJSON-401140112 tempest-DeleteServersAdminTestJSON-401140112-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:10.829937 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-02db3e02-62fb-43be-ac45-660f047d94ed tempest-DeleteServersAdminTestJSON-401140112 tempest-DeleteServersAdminTestJSON-401140112-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:10.830732 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-02db3e02-62fb-43be-ac45-660f047d94ed tempest-DeleteServersAdminTestJSON-401140112 tempest-DeleteServersAdminTestJSON-401140112-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:10.831357 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-02db3e02-62fb-43be-ac45-660f047d94ed tempest-DeleteServersAdminTestJSON-401140112 tempest-DeleteServersAdminTestJSON-401140112-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:11.158263 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3f29b16d-f8dc-4189-8124-0a24dcd3ee01 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:11.170579 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3f29b16d-f8dc-4189-8124-0a24dcd3ee01 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:11.172928 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3f29b16d-f8dc-4189-8124-0a24dcd3ee01 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:11.176253 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3f29b16d-f8dc-4189-8124-0a24dcd3ee01 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a" status: 200 len: 1361 microversion: 2.25 time: 0.579607 Apr 16 21:08:11.181558 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 159/353] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:08:10 2022] GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a => generated 1361 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:08:11.235726 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-02db3e02-62fb-43be-ac45-660f047d94ed tempest-DeleteServersAdminTestJSON-401140112 tempest-DeleteServersAdminTestJSON-401140112-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/229e6d83-6ece-40c3-a33a-99fc46429d8c/action" status: 202 len: 0 microversion: 2.1 time: 0.418693 Apr 16 21:08:11.236390 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 195/354] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:08:10 2022] POST /compute/v2.1/servers/229e6d83-6ece-40c3-a33a-99fc46429d8c/action => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:08:11.245626 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7166b877-8836-4e27-ac4c-a72b976b91ab tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:11.246849 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7166b877-8836-4e27-ac4c-a72b976b91ab tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 229e6d83-6ece-40c3-a33a-99fc46429d8c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:11.262748 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7166b877-8836-4e27-ac4c-a72b976b91ab tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:11.263510 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7166b877-8836-4e27-ac4c-a72b976b91ab tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:11.265291 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7166b877-8836-4e27-ac4c-a72b976b91ab tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:11.265959 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7166b877-8836-4e27-ac4c-a72b976b91ab tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:11.316318 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7166b877-8836-4e27-ac4c-a72b976b91ab tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:11.322946 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7166b877-8836-4e27-ac4c-a72b976b91ab tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:11.323545 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-7166b877-8836-4e27-ac4c-a72b976b91ab tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lazy-loading 'fault' on Instance uuid 229e6d83-6ece-40c3-a33a-99fc46429d8c {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:08:11.529228 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7166b877-8836-4e27-ac4c-a72b976b91ab tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82856a20b3764d17b5c9c1bebdd46c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998f0203a6c741839bde8be2da375d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:11.541449 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7166b877-8836-4e27-ac4c-a72b976b91ab tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "GET /compute/v2.1/servers/229e6d83-6ece-40c3-a33a-99fc46429d8c" status: 200 len: 1453 microversion: 2.1 time: 0.299984 Apr 16 21:08:11.543365 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 160/355] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:11 2022] GET /compute/v2.1/servers/229e6d83-6ece-40c3-a33a-99fc46429d8c => generated 1453 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:11.564789 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-890a1ee2-7ca4-4926-9e63-dfe7d7e950ee tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:11.567687 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-890a1ee2-7ca4-4926-9e63-dfe7d7e950ee tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 229e6d83-6ece-40c3-a33a-99fc46429d8c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:11.574785 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-890a1ee2-7ca4-4926-9e63-dfe7d7e950ee tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:11.575628 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-890a1ee2-7ca4-4926-9e63-dfe7d7e950ee tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:11.576836 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-890a1ee2-7ca4-4926-9e63-dfe7d7e950ee tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:11.581957 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-890a1ee2-7ca4-4926-9e63-dfe7d7e950ee tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:11.608730 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-890a1ee2-7ca4-4926-9e63-dfe7d7e950ee tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 229e6d83-6ece-40c3-a33a-99fc46429d8c] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:08:11.618769 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c2396f30-4307-4f49-b5ac-bbe1753e5839 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:11.620121 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c2396f30-4307-4f49-b5ac-bbe1753e5839 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] [instance: 84fdd641-4d23-472a-8b8f-fded89dbcc32] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:11.629736 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c2396f30-4307-4f49-b5ac-bbe1753e5839 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:11.634688 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c2396f30-4307-4f49-b5ac-bbe1753e5839 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:11.637014 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c2396f30-4307-4f49-b5ac-bbe1753e5839 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:11.637558 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c2396f30-4307-4f49-b5ac-bbe1753e5839 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:11.781508 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c2396f30-4307-4f49-b5ac-bbe1753e5839 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160e460966db4a7e8b697e26de50d0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487e280d7b014a7196cd1e4e9165cc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:11.787195 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c2396f30-4307-4f49-b5ac-bbe1753e5839 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] 10.222.0.20 "GET /compute/v2.1/servers/84fdd641-4d23-472a-8b8f-fded89dbcc32" status: 200 len: 1321 microversion: 2.1 time: 0.172933 Apr 16 21:08:11.796707 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 161/356] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:11 2022] GET /compute/v2.1/servers/84fdd641-4d23-472a-8b8f-fded89dbcc32 => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:12.080982 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-890a1ee2-7ca4-4926-9e63-dfe7d7e950ee tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "DELETE /compute/v2.1/servers/229e6d83-6ece-40c3-a33a-99fc46429d8c" status: 204 len: 0 microversion: 2.1 time: 0.521278 Apr 16 21:08:12.083206 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 196/357] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:08:11 2022] DELETE /compute/v2.1/servers/229e6d83-6ece-40c3-a33a-99fc46429d8c => generated 0 bytes in 526 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:08:12.095540 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e7c4e5bc-a598-49dc-aa5a-d7778993648b tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:12.097506 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e7c4e5bc-a598-49dc-aa5a-d7778993648b tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 229e6d83-6ece-40c3-a33a-99fc46429d8c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:12.105757 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e7c4e5bc-a598-49dc-aa5a-d7778993648b tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:12.106222 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e7c4e5bc-a598-49dc-aa5a-d7778993648b tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:12.107009 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e7c4e5bc-a598-49dc-aa5a-d7778993648b tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:12.107624 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e7c4e5bc-a598-49dc-aa5a-d7778993648b tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:12.157929 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-f3ab9f0d-3272-4692-b8cc-132464674463 req-34c72755-70c4-4956-a1fa-a1ac1e42dcf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d06de5cf-0b6e-4546-b316-545265d6af2a", "tag": "808376f5-de15-494a-b722-a554d5c81386"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:12.168551 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e7c4e5bc-a598-49dc-aa5a-d7778993648b tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:12.169212 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-f3ab9f0d-3272-4692-b8cc-132464674463 req-34c72755-70c4-4956-a1fa-a1ac1e42dcf1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:12.169964 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e7c4e5bc-a598-49dc-aa5a-d7778993648b tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:12.170556 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-f3ab9f0d-3272-4692-b8cc-132464674463 req-34c72755-70c4-4956-a1fa-a1ac1e42dcf1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:12.171465 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-e7c4e5bc-a598-49dc-aa5a-d7778993648b tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lazy-loading 'fault' on Instance uuid 229e6d83-6ece-40c3-a33a-99fc46429d8c {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:08:12.209575 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-f3ab9f0d-3272-4692-b8cc-132464674463 req-34c72755-70c4-4956-a1fa-a1ac1e42dcf1 service nova] Creating event network-changed:808376f5-de15-494a-b722-a554d5c81386 for instance d06de5cf-0b6e-4546-b316-545265d6af2a on nch2-master-1 Apr 16 21:08:12.214739 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-f3ab9f0d-3272-4692-b8cc-132464674463 req-34c72755-70c4-4956-a1fa-a1ac1e42dcf1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159504 Apr 16 21:08:12.221076 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 162/358] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:08:12.238491 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-59745ea4-2e4c-4295-b9c1-6a4da9ef1ee9 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:12.240483 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-59745ea4-2e4c-4295-b9c1-6a4da9ef1ee9 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d06de5cf-0b6e-4546-b316-545265d6af2a] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:12.258525 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-59745ea4-2e4c-4295-b9c1-6a4da9ef1ee9 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:12.259443 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-59745ea4-2e4c-4295-b9c1-6a4da9ef1ee9 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:12.261992 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-59745ea4-2e4c-4295-b9c1-6a4da9ef1ee9 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:12.265379 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-59745ea4-2e4c-4295-b9c1-6a4da9ef1ee9 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:12.361107 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e7c4e5bc-a598-49dc-aa5a-d7778993648b tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82856a20b3764d17b5c9c1bebdd46c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998f0203a6c741839bde8be2da375d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:12.369860 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e7c4e5bc-a598-49dc-aa5a-d7778993648b tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "GET /compute/v2.1/servers/229e6d83-6ece-40c3-a33a-99fc46429d8c" status: 200 len: 1459 microversion: 2.1 time: 0.282144 Apr 16 21:08:12.370456 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 197/359] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:12 2022] GET /compute/v2.1/servers/229e6d83-6ece-40c3-a33a-99fc46429d8c => generated 1459 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:12.632082 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-59745ea4-2e4c-4295-b9c1-6a4da9ef1ee9 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:12.639780 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-59745ea4-2e4c-4295-b9c1-6a4da9ef1ee9 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:12.641324 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-59745ea4-2e4c-4295-b9c1-6a4da9ef1ee9 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:12.642429 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-59745ea4-2e4c-4295-b9c1-6a4da9ef1ee9 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a" status: 200 len: 1361 microversion: 2.25 time: 0.413155 Apr 16 21:08:12.642986 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 163/360] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:08:12 2022] GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a => generated 1361 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:08:12.804271 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fbca493a-6d55-4106-89db-8c9929142adc tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:12.804915 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fbca493a-6d55-4106-89db-8c9929142adc tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] [instance: 84fdd641-4d23-472a-8b8f-fded89dbcc32] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:12.811157 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fbca493a-6d55-4106-89db-8c9929142adc tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:12.811618 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fbca493a-6d55-4106-89db-8c9929142adc tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:12.812434 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fbca493a-6d55-4106-89db-8c9929142adc tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:12.812893 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fbca493a-6d55-4106-89db-8c9929142adc tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:13.029655 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fbca493a-6d55-4106-89db-8c9929142adc tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160e460966db4a7e8b697e26de50d0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487e280d7b014a7196cd1e4e9165cc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:13.043044 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fbca493a-6d55-4106-89db-8c9929142adc tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] 10.222.0.20 "GET /compute/v2.1/servers/84fdd641-4d23-472a-8b8f-fded89dbcc32" status: 200 len: 1321 microversion: 2.1 time: 0.242183 Apr 16 21:08:13.044234 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 198/361] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:12 2022] GET /compute/v2.1/servers/84fdd641-4d23-472a-8b8f-fded89dbcc32 => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:13.388046 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-38399c0f-cf7d-44c9-a727-c9ac11d6c469 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:13.388046 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-38399c0f-cf7d-44c9-a727-c9ac11d6c469 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 229e6d83-6ece-40c3-a33a-99fc46429d8c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:13.394734 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-38399c0f-cf7d-44c9-a727-c9ac11d6c469 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:13.395186 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-38399c0f-cf7d-44c9-a727-c9ac11d6c469 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:13.395954 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-38399c0f-cf7d-44c9-a727-c9ac11d6c469 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:13.396470 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-38399c0f-cf7d-44c9-a727-c9ac11d6c469 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:13.426913 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-38399c0f-cf7d-44c9-a727-c9ac11d6c469 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:13.427345 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-38399c0f-cf7d-44c9-a727-c9ac11d6c469 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:13.427812 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-38399c0f-cf7d-44c9-a727-c9ac11d6c469 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lazy-loading 'fault' on Instance uuid 229e6d83-6ece-40c3-a33a-99fc46429d8c {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:08:13.660927 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-05e38f2d-b409-4b1b-82ae-c1a5f8299e54 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:13.665841 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-05e38f2d-b409-4b1b-82ae-c1a5f8299e54 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d06de5cf-0b6e-4546-b316-545265d6af2a] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:13.668721 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-05e38f2d-b409-4b1b-82ae-c1a5f8299e54 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:13.669365 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-05e38f2d-b409-4b1b-82ae-c1a5f8299e54 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:13.670318 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-05e38f2d-b409-4b1b-82ae-c1a5f8299e54 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:13.670761 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-05e38f2d-b409-4b1b-82ae-c1a5f8299e54 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:13.761772 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-38399c0f-cf7d-44c9-a727-c9ac11d6c469 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82856a20b3764d17b5c9c1bebdd46c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998f0203a6c741839bde8be2da375d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:13.774165 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-38399c0f-cf7d-44c9-a727-c9ac11d6c469 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "GET /compute/v2.1/servers/229e6d83-6ece-40c3-a33a-99fc46429d8c" status: 200 len: 1459 microversion: 2.1 time: 0.390507 Apr 16 21:08:13.777419 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 164/362] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:13 2022] GET /compute/v2.1/servers/229e6d83-6ece-40c3-a33a-99fc46429d8c => generated 1459 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:13.827212 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-05e38f2d-b409-4b1b-82ae-c1a5f8299e54 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:13.838973 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-05e38f2d-b409-4b1b-82ae-c1a5f8299e54 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:13.843429 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-05e38f2d-b409-4b1b-82ae-c1a5f8299e54 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:13.846048 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-05e38f2d-b409-4b1b-82ae-c1a5f8299e54 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a" status: 200 len: 1361 microversion: 2.25 time: 0.189443 Apr 16 21:08:13.846917 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 199/363] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:08:13 2022] GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a => generated 1361 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:08:14.063437 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9807e8b8-c3d3-4e7c-b1bc-3befe6ec7f8c tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:14.064138 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9807e8b8-c3d3-4e7c-b1bc-3befe6ec7f8c tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] [instance: 84fdd641-4d23-472a-8b8f-fded89dbcc32] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:14.074175 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9807e8b8-c3d3-4e7c-b1bc-3befe6ec7f8c tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:14.074633 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9807e8b8-c3d3-4e7c-b1bc-3befe6ec7f8c tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:14.075419 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9807e8b8-c3d3-4e7c-b1bc-3befe6ec7f8c tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:14.075854 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9807e8b8-c3d3-4e7c-b1bc-3befe6ec7f8c tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:14.166252 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c2048b96-64ac-4833-8a08-35c73bb527b2 tempest-FlavorsAccessTestJSON-1382810418 tempest-FlavorsAccessTestJSON-1382810418-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1989434006", "id": 937782589, "os-flavor-access:is_public": "False"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:14.168887 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:14.168887 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:08:14.326842 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c2048b96-64ac-4833-8a08-35c73bb527b2 tempest-FlavorsAccessTestJSON-1382810418 tempest-FlavorsAccessTestJSON-1382810418-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 0.548459 Apr 16 21:08:14.329086 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 165/364] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:08:13 2022] POST /compute/v2.1/flavors => generated 428 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:08:14.344979 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-efd94361-876c-4361-87ad-5f9e7711de12 tempest-FlavorsAccessTestJSON-1382810418 tempest-FlavorsAccessTestJSON-1382810418-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "8751f8ad36cd48039b683d5b567e6823"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:14.353746 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:14.353746 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:08:14.540974 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9807e8b8-c3d3-4e7c-b1bc-3befe6ec7f8c tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160e460966db4a7e8b697e26de50d0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487e280d7b014a7196cd1e4e9165cc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:14.548909 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9807e8b8-c3d3-4e7c-b1bc-3befe6ec7f8c tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] 10.222.0.20 "GET /compute/v2.1/servers/84fdd641-4d23-472a-8b8f-fded89dbcc32" status: 200 len: 1321 microversion: 2.1 time: 0.489374 Apr 16 21:08:14.549571 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 200/365] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:14 2022] GET /compute/v2.1/servers/84fdd641-4d23-472a-8b8f-fded89dbcc32 => generated 1321 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:14.556849 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-033545f9-d0e9-47e6-87aa-ed1f80278d06 req-c6dadddb-48d1-4279-9484-cdfa145b49e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "229e6d83-6ece-40c3-a33a-99fc46429d8c", "name": "network-vif-deleted", "tag": "2cf89b73-421e-4fab-a0c0-f1e5b07e8217"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:14.565163 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-033545f9-d0e9-47e6-87aa-ed1f80278d06 req-c6dadddb-48d1-4279-9484-cdfa145b49e4 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:14.565648 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-033545f9-d0e9-47e6-87aa-ed1f80278d06 req-c6dadddb-48d1-4279-9484-cdfa145b49e4 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:14.578254 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-033545f9-d0e9-47e6-87aa-ed1f80278d06 req-c6dadddb-48d1-4279-9484-cdfa145b49e4 service nova] Creating event network-vif-deleted:2cf89b73-421e-4fab-a0c0-f1e5b07e8217 for instance 229e6d83-6ece-40c3-a33a-99fc46429d8c on nch1-master-1 Apr 16 21:08:14.583624 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-033545f9-d0e9-47e6-87aa-ed1f80278d06 req-c6dadddb-48d1-4279-9484-cdfa145b49e4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030297 Apr 16 21:08:14.584224 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 201/366] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:08:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:08:14.794300 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-27e7b27d-7b13-4bbc-a496-e5e6fe47d5db tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:14.795033 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-27e7b27d-7b13-4bbc-a496-e5e6fe47d5db tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 229e6d83-6ece-40c3-a33a-99fc46429d8c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:14.801838 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-27e7b27d-7b13-4bbc-a496-e5e6fe47d5db tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:14.802296 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-27e7b27d-7b13-4bbc-a496-e5e6fe47d5db tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:14.813539 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-27e7b27d-7b13-4bbc-a496-e5e6fe47d5db tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:14.814012 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-27e7b27d-7b13-4bbc-a496-e5e6fe47d5db tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:14.851402 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-27e7b27d-7b13-4bbc-a496-e5e6fe47d5db tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:14.852036 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-27e7b27d-7b13-4bbc-a496-e5e6fe47d5db tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:14.852345 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-27e7b27d-7b13-4bbc-a496-e5e6fe47d5db tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lazy-loading 'fault' on Instance uuid 229e6d83-6ece-40c3-a33a-99fc46429d8c {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:08:14.935951 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-27e7b27d-7b13-4bbc-a496-e5e6fe47d5db tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82856a20b3764d17b5c9c1bebdd46c68', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '998f0203a6c741839bde8be2da375d4f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:14.946500 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-27e7b27d-7b13-4bbc-a496-e5e6fe47d5db tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "GET /compute/v2.1/servers/229e6d83-6ece-40c3-a33a-99fc46429d8c" status: 200 len: 1310 microversion: 2.1 time: 0.156656 Apr 16 21:08:14.948539 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 202/367] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:14 2022] GET /compute/v2.1/servers/229e6d83-6ece-40c3-a33a-99fc46429d8c => generated 1310 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:08:14.956982 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e71e40e7-d692-42ae-a9e2-3dcc89147a60 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:14.959622 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e71e40e7-d692-42ae-a9e2-3dcc89147a60 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d06de5cf-0b6e-4546-b316-545265d6af2a] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:14.975000 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e71e40e7-d692-42ae-a9e2-3dcc89147a60 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:14.977515 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e71e40e7-d692-42ae-a9e2-3dcc89147a60 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:14.979597 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e71e40e7-d692-42ae-a9e2-3dcc89147a60 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:14.980909 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e71e40e7-d692-42ae-a9e2-3dcc89147a60 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:15.171810 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e71e40e7-d692-42ae-a9e2-3dcc89147a60 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:15.181192 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e71e40e7-d692-42ae-a9e2-3dcc89147a60 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:15.185524 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e71e40e7-d692-42ae-a9e2-3dcc89147a60 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:15.185524 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e71e40e7-d692-42ae-a9e2-3dcc89147a60 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a" status: 200 len: 1361 microversion: 2.25 time: 0.232913 Apr 16 21:08:15.185524 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 203/368] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:08:14 2022] GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a => generated 1361 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:08:15.211239 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-efd94361-876c-4361-87ad-5f9e7711de12 tempest-FlavorsAccessTestJSON-1382810418 tempest-FlavorsAccessTestJSON-1382810418-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/937782589/action" status: 200 len: 96 microversion: 2.1 time: 0.872184 Apr 16 21:08:15.211789 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 166/369] 10.222.0.20 () {60 vars in 1196 bytes} [Sat Apr 16 21:08:14 2022] POST /compute/v2.1/flavors/937782589/action => generated 96 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:08:15.389292 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8798a572-ed8a-4b9b-a334-be6ad16c883b tempest-FlavorsAccessTestJSON-457104223 tempest-FlavorsAccessTestJSON-457104223-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:15.410836 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8798a572-ed8a-4b9b-a334-be6ad16c883b tempest-FlavorsAccessTestJSON-457104223 tempest-FlavorsAccessTestJSON-457104223-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 6230 microversion: 2.1 time: 0.193320 Apr 16 21:08:15.411423 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 204/370] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:08:15 2022] GET /compute/v2.1/flavors/detail => generated 6230 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:15.427272 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b55b962f-fb6e-4e35-8980-e827708e153b tempest-FlavorsAccessTestJSON-1382810418 tempest-FlavorsAccessTestJSON-1382810418-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "8751f8ad36cd48039b683d5b567e6823"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:15.429149 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:15.429149 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:08:15.565390 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7776e451-5780-4151-807a-85b701a43f12 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:15.566053 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7776e451-5780-4151-807a-85b701a43f12 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] [instance: 84fdd641-4d23-472a-8b8f-fded89dbcc32] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:15.572130 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7776e451-5780-4151-807a-85b701a43f12 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:15.572622 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7776e451-5780-4151-807a-85b701a43f12 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:15.573399 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7776e451-5780-4151-807a-85b701a43f12 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:15.573844 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7776e451-5780-4151-807a-85b701a43f12 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:15.707445 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7776e451-5780-4151-807a-85b701a43f12 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160e460966db4a7e8b697e26de50d0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487e280d7b014a7196cd1e4e9165cc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:15.715584 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7776e451-5780-4151-807a-85b701a43f12 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] 10.222.0.20 "GET /compute/v2.1/servers/84fdd641-4d23-472a-8b8f-fded89dbcc32" status: 200 len: 1321 microversion: 2.1 time: 0.154135 Apr 16 21:08:15.716360 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 205/371] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:15 2022] GET /compute/v2.1/servers/84fdd641-4d23-472a-8b8f-fded89dbcc32 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:08:15.965654 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4c260c6f-19a8-4613-9f07-673da45f7aa0 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:15.966265 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4c260c6f-19a8-4613-9f07-673da45f7aa0 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 229e6d83-6ece-40c3-a33a-99fc46429d8c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:15.972023 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4c260c6f-19a8-4613-9f07-673da45f7aa0 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:15.972697 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4c260c6f-19a8-4613-9f07-673da45f7aa0 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:15.973662 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4c260c6f-19a8-4613-9f07-673da45f7aa0 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:15.974253 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4c260c6f-19a8-4613-9f07-673da45f7aa0 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:15.988870 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-4c260c6f-19a8-4613-9f07-673da45f7aa0 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] HTTP exception thrown: Instance 229e6d83-6ece-40c3-a33a-99fc46429d8c could not be found. Apr 16 21:08:15.989636 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4c260c6f-19a8-4613-9f07-673da45f7aa0 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Returning 404 to user: Instance 229e6d83-6ece-40c3-a33a-99fc46429d8c could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:08:15.998890 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4c260c6f-19a8-4613-9f07-673da45f7aa0 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "GET /compute/v2.1/servers/229e6d83-6ece-40c3-a33a-99fc46429d8c" status: 404 len: 111 microversion: 2.1 time: 0.030266 Apr 16 21:08:15.998890 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 206/372] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:15 2022] GET /compute/v2.1/servers/229e6d83-6ece-40c3-a33a-99fc46429d8c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:08:16.012989 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-dc73b459-016a-4ad4-b4c6-df5d16e0f17d tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:16.013493 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-dc73b459-016a-4ad4-b4c6-df5d16e0f17d tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 229e6d83-6ece-40c3-a33a-99fc46429d8c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:16.028251 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dc73b459-016a-4ad4-b4c6-df5d16e0f17d tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:16.028251 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dc73b459-016a-4ad4-b4c6-df5d16e0f17d tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:16.028251 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dc73b459-016a-4ad4-b4c6-df5d16e0f17d tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:16.028251 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dc73b459-016a-4ad4-b4c6-df5d16e0f17d tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:16.042206 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-dc73b459-016a-4ad4-b4c6-df5d16e0f17d tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] HTTP exception thrown: Instance 229e6d83-6ece-40c3-a33a-99fc46429d8c could not be found. Apr 16 21:08:16.042812 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-dc73b459-016a-4ad4-b4c6-df5d16e0f17d tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Returning 404 to user: Instance 229e6d83-6ece-40c3-a33a-99fc46429d8c could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:08:16.043642 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-dc73b459-016a-4ad4-b4c6-df5d16e0f17d tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "DELETE /compute/v2.1/servers/229e6d83-6ece-40c3-a33a-99fc46429d8c" status: 404 len: 111 microversion: 2.1 time: 0.034547 Apr 16 21:08:16.044388 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 207/373] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:08:16 2022] DELETE /compute/v2.1/servers/229e6d83-6ece-40c3-a33a-99fc46429d8c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:08:16.052297 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-65a10791-3832-4cd1-aeaa-f7a4b5c0787f tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:16.052919 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-65a10791-3832-4cd1-aeaa-f7a4b5c0787f tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 229e6d83-6ece-40c3-a33a-99fc46429d8c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:16.062422 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-65a10791-3832-4cd1-aeaa-f7a4b5c0787f tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:16.062422 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-65a10791-3832-4cd1-aeaa-f7a4b5c0787f tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:16.062422 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-65a10791-3832-4cd1-aeaa-f7a4b5c0787f tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:16.062422 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-65a10791-3832-4cd1-aeaa-f7a4b5c0787f tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:16.078004 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-65a10791-3832-4cd1-aeaa-f7a4b5c0787f tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] HTTP exception thrown: Instance 229e6d83-6ece-40c3-a33a-99fc46429d8c could not be found. Apr 16 21:08:16.078728 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-65a10791-3832-4cd1-aeaa-f7a4b5c0787f tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Returning 404 to user: Instance 229e6d83-6ece-40c3-a33a-99fc46429d8c could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:08:16.079682 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-65a10791-3832-4cd1-aeaa-f7a4b5c0787f tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "GET /compute/v2.1/servers/229e6d83-6ece-40c3-a33a-99fc46429d8c" status: 404 len: 111 microversion: 2.1 time: 0.031171 Apr 16 21:08:16.083114 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 208/374] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:16 2022] GET /compute/v2.1/servers/229e6d83-6ece-40c3-a33a-99fc46429d8c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:08:16.089529 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-68ad562c-86cd-48fa-9405-e0aa9bf281d5 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:16.090173 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-68ad562c-86cd-48fa-9405-e0aa9bf281d5 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:16.098452 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-68ad562c-86cd-48fa-9405-e0aa9bf281d5 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:16.098918 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-68ad562c-86cd-48fa-9405-e0aa9bf281d5 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:16.101035 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-68ad562c-86cd-48fa-9405-e0aa9bf281d5 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:16.101660 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-68ad562c-86cd-48fa-9405-e0aa9bf281d5 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:16.118368 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b55b962f-fb6e-4e35-8980-e827708e153b tempest-FlavorsAccessTestJSON-1382810418 tempest-FlavorsAccessTestJSON-1382810418-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors/937782589/action" status: 200 len: 21 microversion: 2.1 time: 0.694756 Apr 16 21:08:16.123055 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 167/375] 10.222.0.20 () {60 vars in 1196 bytes} [Sat Apr 16 21:08:15 2022] POST /compute/v2.1/flavors/937782589/action => generated 21 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:08:16.133243 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-68ad562c-86cd-48fa-9405-e0aa9bf281d5 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] HTTP exception thrown: Instance 0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c could not be found. Apr 16 21:08:16.133583 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e3338aa7-9cd5-4822-b720-e9c8b873bd71 tempest-FlavorsAccessTestJSON-457104223 tempest-FlavorsAccessTestJSON-457104223-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:16.134348 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-68ad562c-86cd-48fa-9405-e0aa9bf281d5 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Returning 404 to user: Instance 0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:08:16.136256 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-68ad562c-86cd-48fa-9405-e0aa9bf281d5 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c" status: 404 len: 111 microversion: 2.1 time: 0.051263 Apr 16 21:08:16.137240 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 209/376] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:08:16 2022] DELETE /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:08:16.144575 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-76b295af-ac67-4893-bec2-c006e9f4bd95 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:16.145501 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-76b295af-ac67-4893-bec2-c006e9f4bd95 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] [instance: 0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:16.153459 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-76b295af-ac67-4893-bec2-c006e9f4bd95 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:16.154168 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-76b295af-ac67-4893-bec2-c006e9f4bd95 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:16.155168 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-76b295af-ac67-4893-bec2-c006e9f4bd95 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:16.155776 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-76b295af-ac67-4893-bec2-c006e9f4bd95 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:16.165682 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e3338aa7-9cd5-4822-b720-e9c8b873bd71 tempest-FlavorsAccessTestJSON-457104223 tempest-FlavorsAccessTestJSON-457104223-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.041097 Apr 16 21:08:16.175803 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 168/377] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:08:16 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:08:16.182482 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-76b295af-ac67-4893-bec2-c006e9f4bd95 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] HTTP exception thrown: Instance 0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c could not be found. Apr 16 21:08:16.183191 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-76b295af-ac67-4893-bec2-c006e9f4bd95 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] Returning 404 to user: Instance 0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:08:16.184154 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-76b295af-ac67-4893-bec2-c006e9f4bd95 tempest-DeleteServersAdminTestJSON-320304213 tempest-DeleteServersAdminTestJSON-320304213-project] 10.222.0.20 "GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c" status: 404 len: 111 microversion: 2.1 time: 0.043354 Apr 16 21:08:16.185097 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 210/378] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:16 2022] GET /compute/v2.1/servers/0cf3bf2e-f263-4ce9-86bd-7d05f383fd8c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:08:16.189862 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0d964a35-bc3d-45e2-8854-3e5f39917eb2 tempest-FlavorsAccessTestJSON-1382810418 tempest-FlavorsAccessTestJSON-1382810418-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:16.190709 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:16.190709 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:08:16.315777 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0d964a35-bc3d-45e2-8854-3e5f39917eb2 tempest-FlavorsAccessTestJSON-1382810418 tempest-FlavorsAccessTestJSON-1382810418-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/937782589" status: 202 len: 0 microversion: 2.1 time: 0.129403 Apr 16 21:08:16.316497 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 211/379] 10.222.0.20 () {58 vars in 1157 bytes} [Sat Apr 16 21:08:16 2022] DELETE /compute/v2.1/flavors/937782589 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:08:16.321613 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8b1da048-a8ab-4c12-a8c7-47ff06d7ed06 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:16.322221 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8b1da048-a8ab-4c12-a8c7-47ff06d7ed06 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d06de5cf-0b6e-4546-b316-545265d6af2a] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:16.328019 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8b1da048-a8ab-4c12-a8c7-47ff06d7ed06 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:16.328575 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8b1da048-a8ab-4c12-a8c7-47ff06d7ed06 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:16.329379 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8b1da048-a8ab-4c12-a8c7-47ff06d7ed06 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:16.329818 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8b1da048-a8ab-4c12-a8c7-47ff06d7ed06 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:16.427567 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-53980711-1865-4f65-91a7-39f1b557c4d1 tempest-HypervisorAdminNegativeTestJSON-1517538397 tempest-HypervisorAdminNegativeTestJSON-1517538397-project] Calling method '.version_select at 0x7fbb96f0f700>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:16.428610 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:16.428610 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:08:16.434346 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-53980711-1865-4f65-91a7-39f1b557c4d1 tempest-HypervisorAdminNegativeTestJSON-1517538397 tempest-HypervisorAdminNegativeTestJSON-1517538397-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': 'eef21b6df09542e3aa1c14e671750bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4dc13006e864a599117d3167b813d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:16.434346 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-53980711-1865-4f65-91a7-39f1b557c4d1 tempest-HypervisorAdminNegativeTestJSON-1517538397 tempest-HypervisorAdminNegativeTestJSON-1517538397-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:08:16.434346 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-53980711-1865-4f65-91a7-39f1b557c4d1 tempest-HypervisorAdminNegativeTestJSON-1517538397 tempest-HypervisorAdminNegativeTestJSON-1517538397-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.263556 Apr 16 21:08:16.434346 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 169/380] 10.222.0.20 () {58 vars in 1166 bytes} [Sat Apr 16 21:08:16 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 265 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:08:16.434645 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-53980711-1865-4f65-91a7-39f1b557c4d1 tempest-HypervisorAdminNegativeTestJSON-1517538397 tempest-HypervisorAdminNegativeTestJSON-1517538397-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:16.434645 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-53980711-1865-4f65-91a7-39f1b557c4d1 tempest-HypervisorAdminNegativeTestJSON-1517538397 tempest-HypervisorAdminNegativeTestJSON-1517538397-project] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001039 Apr 16 21:08:16.440479 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 170/381] 10.222.0.20 () {56 vars in 885 bytes} [Sat Apr 16 21:08:16 2022] GET /compute/ => generated 377 bytes in 8 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Apr 16 21:08:16.445838 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-398dba8d-918d-4b35-9ed8-6710aa9dd3d3 tempest-FlavorsAccessTestJSON-1382810418 tempest-FlavorsAccessTestJSON-1382810418-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:16.462313 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8b1da048-a8ab-4c12-a8c7-47ff06d7ed06 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:16.476566 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8b1da048-a8ab-4c12-a8c7-47ff06d7ed06 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:16.478279 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8b1da048-a8ab-4c12-a8c7-47ff06d7ed06 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:16.479396 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8b1da048-a8ab-4c12-a8c7-47ff06d7ed06 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a" status: 200 len: 1361 microversion: 2.25 time: 0.161902 Apr 16 21:08:16.483775 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-398dba8d-918d-4b35-9ed8-6710aa9dd3d3 tempest-FlavorsAccessTestJSON-1382810418 tempest-FlavorsAccessTestJSON-1382810418-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.042106 Apr 16 21:08:16.492432 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 212/382] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:08:16 2022] GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a => generated 1361 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:08:16.495524 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 171/383] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:08:16 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:16.500556 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-74dc09f8-e41e-40b2-b3d6-fb4aba9a8fef tempest-FlavorsAccessTestJSON-1382810418 tempest-FlavorsAccessTestJSON-1382810418-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-745052526", "id": 1789091935, "os-flavor-access:is_public": "False"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:16.500760 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8b1800b2-4187-4d95-a613-61c5b80bf7a8 tempest-HypervisorAdminNegativeTestJSON-1517538397 tempest-HypervisorAdminNegativeTestJSON-1517538397-project] Calling method '.version_select at 0x7fbb96d83a60>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:16.502212 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:16.502212 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:08:16.503381 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8b1800b2-4187-4d95-a613-61c5b80bf7a8 tempest-HypervisorAdminNegativeTestJSON-1517538397 tempest-HypervisorAdminNegativeTestJSON-1517538397-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': 'eef21b6df09542e3aa1c14e671750bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4dc13006e864a599117d3167b813d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:16.504204 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8b1800b2-4187-4d95-a613-61c5b80bf7a8 tempest-HypervisorAdminNegativeTestJSON-1517538397 tempest-HypervisorAdminNegativeTestJSON-1517538397-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:08:16.505613 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8b1800b2-4187-4d95-a613-61c5b80bf7a8 tempest-HypervisorAdminNegativeTestJSON-1517538397 tempest-HypervisorAdminNegativeTestJSON-1517538397-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.011573 Apr 16 21:08:16.506871 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 213/384] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:08:16 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:08:16.515486 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f9815994-3e27-4328-be3e-00b87bfa1fa4 tempest-HypervisorAdminNegativeTestJSON-1517538397 tempest-HypervisorAdminNegativeTestJSON-1517538397-project] Calling method '.version_select at 0x7fbb96dc75e0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:16.516410 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:16.516410 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:08:16.517637 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f9815994-3e27-4328-be3e-00b87bfa1fa4 tempest-HypervisorAdminNegativeTestJSON-1517538397 tempest-HypervisorAdminNegativeTestJSON-1517538397-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': 'eef21b6df09542e3aa1c14e671750bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4dc13006e864a599117d3167b813d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:16.518330 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f9815994-3e27-4328-be3e-00b87bfa1fa4 tempest-HypervisorAdminNegativeTestJSON-1517538397 tempest-HypervisorAdminNegativeTestJSON-1517538397-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:08:16.520274 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f9815994-3e27-4328-be3e-00b87bfa1fa4 tempest-HypervisorAdminNegativeTestJSON-1517538397 tempest-HypervisorAdminNegativeTestJSON-1517538397-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.007485 Apr 16 21:08:16.520274 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 214/385] 10.222.0.20 () {58 vars in 1178 bytes} [Sat Apr 16 21:08:16 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:08:16.601842 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-74dc09f8-e41e-40b2-b3d6-fb4aba9a8fef tempest-FlavorsAccessTestJSON-1382810418 tempest-FlavorsAccessTestJSON-1382810418-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.105025 Apr 16 21:08:16.602438 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 172/386] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:08:16 2022] POST /compute/v2.1/flavors => generated 430 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:08:16.612078 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2ed31d43-4034-4d3a-9866-ae4243595687 tempest-FlavorsAccessTestJSON-1382810418 tempest-FlavorsAccessTestJSON-1382810418-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:16.612868 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:16.612868 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:08:16.623976 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2ed31d43-4034-4d3a-9866-ae4243595687 tempest-FlavorsAccessTestJSON-1382810418 tempest-FlavorsAccessTestJSON-1382810418-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/1789091935/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.015217 Apr 16 21:08:16.624555 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 173/387] 10.222.0.20 () {58 vars in 1208 bytes} [Sat Apr 16 21:08:16 2022] GET /compute/v2.1/flavors/1789091935/os-flavor-access => generated 21 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 16 21:08:16.634252 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-eff4815f-bbca-4ea1-9460-8954a57cc176 tempest-FlavorsAccessTestJSON-1382810418 tempest-FlavorsAccessTestJSON-1382810418-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:16.634995 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:16.634995 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:08:16.773956 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-eff4815f-bbca-4ea1-9460-8954a57cc176 tempest-FlavorsAccessTestJSON-1382810418 tempest-FlavorsAccessTestJSON-1382810418-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1789091935" status: 202 len: 0 microversion: 2.1 time: 0.142854 Apr 16 21:08:16.774903 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 174/388] 10.222.0.20 () {58 vars in 1160 bytes} [Sat Apr 16 21:08:16 2022] DELETE /compute/v2.1/flavors/1789091935 => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 16 21:08:16.779812 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3323f272-ea62-40fa-a9b2-3886b34ccff0 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:16.780514 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3323f272-ea62-40fa-a9b2-3886b34ccff0 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] [instance: 84fdd641-4d23-472a-8b8f-fded89dbcc32] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:16.786474 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3323f272-ea62-40fa-a9b2-3886b34ccff0 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:16.787178 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3323f272-ea62-40fa-a9b2-3886b34ccff0 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:16.788093 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3323f272-ea62-40fa-a9b2-3886b34ccff0 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:16.788602 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3323f272-ea62-40fa-a9b2-3886b34ccff0 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:16.929381 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3323f272-ea62-40fa-a9b2-3886b34ccff0 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160e460966db4a7e8b697e26de50d0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487e280d7b014a7196cd1e4e9165cc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:16.937039 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3323f272-ea62-40fa-a9b2-3886b34ccff0 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] 10.222.0.20 "GET /compute/v2.1/servers/84fdd641-4d23-472a-8b8f-fded89dbcc32" status: 200 len: 1321 microversion: 2.1 time: 0.160934 Apr 16 21:08:16.947682 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 175/389] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:16 2022] GET /compute/v2.1/servers/84fdd641-4d23-472a-8b8f-fded89dbcc32 => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:16.953833 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5d60c7e9-2936-4794-95e1-ddfcc0985f05 tempest-FlavorsAccessTestJSON-1382810418 tempest-FlavorsAccessTestJSON-1382810418-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:16.977812 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5d60c7e9-2936-4794-95e1-ddfcc0985f05 tempest-FlavorsAccessTestJSON-1382810418 tempest-FlavorsAccessTestJSON-1382810418-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5812 microversion: 2.1 time: 0.028556 Apr 16 21:08:16.978920 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 176/390] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:08:16 2022] GET /compute/v2.1/flavors/detail => generated 5812 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:17.156223 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-17548c5e-fbd0-42d8-aa62-ee3abdfb7f16 tempest-HypervisorAdminNegativeTestJSON-1825344626 tempest-HypervisorAdminNegativeTestJSON-1825344626-project-admin] Calling method '.version_select at 0x7fbb96dd30d0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:17.158359 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-17548c5e-fbd0-42d8-aa62-ee3abdfb7f16 tempest-HypervisorAdminNegativeTestJSON-1825344626 tempest-HypervisorAdminNegativeTestJSON-1825344626-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:17.158952 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-17548c5e-fbd0-42d8-aa62-ee3abdfb7f16 tempest-HypervisorAdminNegativeTestJSON-1825344626 tempest-HypervisorAdminNegativeTestJSON-1825344626-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:17.173752 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-17548c5e-fbd0-42d8-aa62-ee3abdfb7f16 tempest-HypervisorAdminNegativeTestJSON-1825344626 tempest-HypervisorAdminNegativeTestJSON-1825344626-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:17.174289 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-17548c5e-fbd0-42d8-aa62-ee3abdfb7f16 tempest-HypervisorAdminNegativeTestJSON-1825344626 tempest-HypervisorAdminNegativeTestJSON-1825344626-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:17.186768 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-17548c5e-fbd0-42d8-aa62-ee3abdfb7f16 tempest-HypervisorAdminNegativeTestJSON-1825344626 tempest-HypervisorAdminNegativeTestJSON-1825344626-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:17.187257 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-17548c5e-fbd0-42d8-aa62-ee3abdfb7f16 tempest-HypervisorAdminNegativeTestJSON-1825344626 tempest-HypervisorAdminNegativeTestJSON-1825344626-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:17.193204 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-17548c5e-fbd0-42d8-aa62-ee3abdfb7f16 tempest-HypervisorAdminNegativeTestJSON-1825344626 tempest-HypervisorAdminNegativeTestJSON-1825344626-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.663400 Apr 16 21:08:17.193794 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 215/391] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:08:16 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:08:17.204422 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-37a6e6e9-3e5a-4cc6-904d-f1db8cf495bc tempest-HypervisorAdminNegativeTestJSON-1517538397 tempest-HypervisorAdminNegativeTestJSON-1517538397-project] Calling method '.version_select at 0x7fbb96f6b790>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:17.205576 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:17.205576 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:08:17.206857 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-37a6e6e9-3e5a-4cc6-904d-f1db8cf495bc tempest-HypervisorAdminNegativeTestJSON-1517538397 tempest-HypervisorAdminNegativeTestJSON-1517538397-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': 'eef21b6df09542e3aa1c14e671750bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4dc13006e864a599117d3167b813d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:17.207491 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-37a6e6e9-3e5a-4cc6-904d-f1db8cf495bc tempest-HypervisorAdminNegativeTestJSON-1517538397 tempest-HypervisorAdminNegativeTestJSON-1517538397-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:08:17.208339 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-37a6e6e9-3e5a-4cc6-904d-f1db8cf495bc tempest-HypervisorAdminNegativeTestJSON-1517538397 tempest-HypervisorAdminNegativeTestJSON-1517538397-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.007812 Apr 16 21:08:17.208833 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 177/392] 10.222.0.20 () {58 vars in 1172 bytes} [Sat Apr 16 21:08:17 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 9 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:08:17.222351 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6ef1cb27-2b1a-42da-a082-52df30bf2fd3 tempest-HypervisorAdminNegativeTestJSON-1825344626 tempest-HypervisorAdminNegativeTestJSON-1825344626-project-admin] Calling method '.version_select at 0x7fbb96d830d0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:17.223200 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:17.223200 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:08:17.224078 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-6ef1cb27-2b1a-42da-a082-52df30bf2fd3 tempest-HypervisorAdminNegativeTestJSON-1825344626 tempest-HypervisorAdminNegativeTestJSON-1825344626-project-admin] HTTP exception thrown: Hypervisor with ID 'fa3ef36d-759c-42a5-871d-2b9af2cbfc8a' could not be found. Apr 16 21:08:17.224742 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6ef1cb27-2b1a-42da-a082-52df30bf2fd3 tempest-HypervisorAdminNegativeTestJSON-1825344626 tempest-HypervisorAdminNegativeTestJSON-1825344626-project-admin] Returning 404 to user: Hypervisor with ID 'fa3ef36d-759c-42a5-871d-2b9af2cbfc8a' could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:08:17.225570 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6ef1cb27-2b1a-42da-a082-52df30bf2fd3 tempest-HypervisorAdminNegativeTestJSON-1825344626 tempest-HypervisorAdminNegativeTestJSON-1825344626-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/fa3ef36d-759c-42a5-871d-2b9af2cbfc8a/uptime" status: 404 len: 123 microversion: 2.1 time: 0.006872 Apr 16 21:08:17.226063 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 216/393] 10.222.0.20 () {58 vars in 1277 bytes} [Sat Apr 16 21:08:17 2022] GET /compute/v2.1/os-hypervisors/fa3ef36d-759c-42a5-871d-2b9af2cbfc8a/uptime => generated 123 bytes in 8 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:08:17.234869 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-67769ffa-593e-40ef-90b9-8a52f8bfafe8 tempest-HypervisorAdminNegativeTestJSON-1825344626 tempest-HypervisorAdminNegativeTestJSON-1825344626-project-admin] Calling method '.version_select at 0x7fbb9c055670>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:17.235666 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:17.235666 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:08:17.241576 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-67769ffa-593e-40ef-90b9-8a52f8bfafe8 tempest-HypervisorAdminNegativeTestJSON-1825344626 tempest-HypervisorAdminNegativeTestJSON-1825344626-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:17.241576 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-67769ffa-593e-40ef-90b9-8a52f8bfafe8 tempest-HypervisorAdminNegativeTestJSON-1825344626 tempest-HypervisorAdminNegativeTestJSON-1825344626-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:17.250972 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-67769ffa-593e-40ef-90b9-8a52f8bfafe8 tempest-HypervisorAdminNegativeTestJSON-1825344626 tempest-HypervisorAdminNegativeTestJSON-1825344626-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:17.251420 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-67769ffa-593e-40ef-90b9-8a52f8bfafe8 tempest-HypervisorAdminNegativeTestJSON-1825344626 tempest-HypervisorAdminNegativeTestJSON-1825344626-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:17.262214 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-67769ffa-593e-40ef-90b9-8a52f8bfafe8 tempest-HypervisorAdminNegativeTestJSON-1825344626 tempest-HypervisorAdminNegativeTestJSON-1825344626-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:17.262780 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-67769ffa-593e-40ef-90b9-8a52f8bfafe8 tempest-HypervisorAdminNegativeTestJSON-1825344626 tempest-HypervisorAdminNegativeTestJSON-1825344626-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:17.268621 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-67769ffa-593e-40ef-90b9-8a52f8bfafe8 tempest-HypervisorAdminNegativeTestJSON-1825344626 tempest-HypervisorAdminNegativeTestJSON-1825344626-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.037445 Apr 16 21:08:17.269349 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 178/394] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:08:17 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:08:17.279540 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9cbd8a41-9c1e-4e18-97db-f0e610e6feda tempest-HypervisorAdminNegativeTestJSON-1517538397 tempest-HypervisorAdminNegativeTestJSON-1517538397-project] Calling method '.version_select at 0x7fbb96dc7160>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:17.280540 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:17.280540 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:08:17.282646 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9cbd8a41-9c1e-4e18-97db-f0e610e6feda tempest-HypervisorAdminNegativeTestJSON-1517538397 tempest-HypervisorAdminNegativeTestJSON-1517538397-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': 'eef21b6df09542e3aa1c14e671750bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4dc13006e864a599117d3167b813d2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:17.283411 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9cbd8a41-9c1e-4e18-97db-f0e610e6feda tempest-HypervisorAdminNegativeTestJSON-1517538397 tempest-HypervisorAdminNegativeTestJSON-1517538397-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:08:17.284485 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9cbd8a41-9c1e-4e18-97db-f0e610e6feda tempest-HypervisorAdminNegativeTestJSON-1517538397 tempest-HypervisorAdminNegativeTestJSON-1517538397-project] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.009495 Apr 16 21:08:17.289898 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 217/395] 10.222.0.20 () {58 vars in 1151 bytes} [Sat Apr 16 21:08:17 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:08:17.295487 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-19fb0f3a-19bc-4020-9261-22d1a7edbd10 tempest-HypervisorAdminNegativeTestJSON-1825344626 tempest-HypervisorAdminNegativeTestJSON-1825344626-project-admin] Calling method '.version_select at 0x7fbb96f6b700>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:17.296398 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:17.296398 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:08:17.297301 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-19fb0f3a-19bc-4020-9261-22d1a7edbd10 tempest-HypervisorAdminNegativeTestJSON-1825344626 tempest-HypervisorAdminNegativeTestJSON-1825344626-project-admin] HTTP exception thrown: Hypervisor with ID '1fdd5734-14cf-404e-86bf-ec066fa2cce6' could not be found. Apr 16 21:08:17.297868 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-19fb0f3a-19bc-4020-9261-22d1a7edbd10 tempest-HypervisorAdminNegativeTestJSON-1825344626 tempest-HypervisorAdminNegativeTestJSON-1825344626-project-admin] Returning 404 to user: Hypervisor with ID '1fdd5734-14cf-404e-86bf-ec066fa2cce6' could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:08:17.298908 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-19fb0f3a-19bc-4020-9261-22d1a7edbd10 tempest-HypervisorAdminNegativeTestJSON-1825344626 tempest-HypervisorAdminNegativeTestJSON-1825344626-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors/1fdd5734-14cf-404e-86bf-ec066fa2cce6" status: 404 len: 123 microversion: 2.1 time: 0.007263 Apr 16 21:08:17.299449 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 179/396] 10.222.0.20 () {58 vars in 1256 bytes} [Sat Apr 16 21:08:17 2022] GET /compute/v2.1/os-hypervisors/1fdd5734-14cf-404e-86bf-ec066fa2cce6 => generated 123 bytes in 8 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:08:17.497658 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-08ff3be6-0ffc-4850-b269-1194161b6f14 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:17.498346 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-08ff3be6-0ffc-4850-b269-1194161b6f14 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d06de5cf-0b6e-4546-b316-545265d6af2a] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:17.504194 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-08ff3be6-0ffc-4850-b269-1194161b6f14 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:17.504865 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-08ff3be6-0ffc-4850-b269-1194161b6f14 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:17.506111 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-08ff3be6-0ffc-4850-b269-1194161b6f14 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:17.506802 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-08ff3be6-0ffc-4850-b269-1194161b6f14 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:17.638104 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-08ff3be6-0ffc-4850-b269-1194161b6f14 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:17.646045 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-08ff3be6-0ffc-4850-b269-1194161b6f14 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:17.647580 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-08ff3be6-0ffc-4850-b269-1194161b6f14 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:17.648954 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-08ff3be6-0ffc-4850-b269-1194161b6f14 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a" status: 200 len: 1361 microversion: 2.25 time: 0.154967 Apr 16 21:08:17.649259 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 218/397] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:08:17 2022] GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:08:17.954550 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a2f54b15-b242-4681-94a0-3cf21b244480 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:17.955676 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a2f54b15-b242-4681-94a0-3cf21b244480 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] [instance: 84fdd641-4d23-472a-8b8f-fded89dbcc32] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:17.965864 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a2f54b15-b242-4681-94a0-3cf21b244480 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:17.965864 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a2f54b15-b242-4681-94a0-3cf21b244480 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:17.965864 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a2f54b15-b242-4681-94a0-3cf21b244480 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:17.965864 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a2f54b15-b242-4681-94a0-3cf21b244480 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:18.097745 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a2f54b15-b242-4681-94a0-3cf21b244480 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160e460966db4a7e8b697e26de50d0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487e280d7b014a7196cd1e4e9165cc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:18.121509 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a2f54b15-b242-4681-94a0-3cf21b244480 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] 10.222.0.20 "GET /compute/v2.1/servers/84fdd641-4d23-472a-8b8f-fded89dbcc32" status: 200 len: 1321 microversion: 2.1 time: 0.170694 Apr 16 21:08:18.122579 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 180/398] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:17 2022] GET /compute/v2.1/servers/84fdd641-4d23-472a-8b8f-fded89dbcc32 => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:18.667664 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-94633d24-90d4-4cf8-bd91-c4a672a7a348 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:18.668868 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-94633d24-90d4-4cf8-bd91-c4a672a7a348 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d06de5cf-0b6e-4546-b316-545265d6af2a] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:18.679908 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-94633d24-90d4-4cf8-bd91-c4a672a7a348 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:18.685961 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-94633d24-90d4-4cf8-bd91-c4a672a7a348 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:18.685961 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-94633d24-90d4-4cf8-bd91-c4a672a7a348 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:18.685961 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-94633d24-90d4-4cf8-bd91-c4a672a7a348 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:18.874878 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-94633d24-90d4-4cf8-bd91-c4a672a7a348 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:18.887639 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-94633d24-90d4-4cf8-bd91-c4a672a7a348 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:18.891939 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-94633d24-90d4-4cf8-bd91-c4a672a7a348 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:18.893135 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-94633d24-90d4-4cf8-bd91-c4a672a7a348 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a" status: 200 len: 1361 microversion: 2.25 time: 0.230172 Apr 16 21:08:18.894869 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 219/399] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:08:18 2022] GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a => generated 1361 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:08:19.138989 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1514447b-a3b7-4cfa-8d93-84d059cea9e9 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:19.139601 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1514447b-a3b7-4cfa-8d93-84d059cea9e9 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] [instance: 84fdd641-4d23-472a-8b8f-fded89dbcc32] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:19.151819 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1514447b-a3b7-4cfa-8d93-84d059cea9e9 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:19.152303 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1514447b-a3b7-4cfa-8d93-84d059cea9e9 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:19.153219 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1514447b-a3b7-4cfa-8d93-84d059cea9e9 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:19.153775 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1514447b-a3b7-4cfa-8d93-84d059cea9e9 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:19.389172 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-dc56da70-fcff-4075-ba5f-6d93d4eafc53 req-8df12708-bab5-442d-a956-c63916dab0d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84fdd641-4d23-472a-8b8f-fded89dbcc32", "name": "network-vif-plugged", "status": "completed", "tag": "bab3ec3e-82d0-419b-9ccb-11f635214fe4"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:19.406271 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-dc56da70-fcff-4075-ba5f-6d93d4eafc53 req-8df12708-bab5-442d-a956-c63916dab0d5 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:19.406733 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-dc56da70-fcff-4075-ba5f-6d93d4eafc53 req-8df12708-bab5-442d-a956-c63916dab0d5 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:19.407507 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1514447b-a3b7-4cfa-8d93-84d059cea9e9 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160e460966db4a7e8b697e26de50d0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487e280d7b014a7196cd1e4e9165cc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:19.417822 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1514447b-a3b7-4cfa-8d93-84d059cea9e9 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] 10.222.0.20 "GET /compute/v2.1/servers/84fdd641-4d23-472a-8b8f-fded89dbcc32" status: 200 len: 1321 microversion: 2.1 time: 0.282636 Apr 16 21:08:19.419045 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 181/400] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:19 2022] GET /compute/v2.1/servers/84fdd641-4d23-472a-8b8f-fded89dbcc32 => generated 1321 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:19.441169 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-dc56da70-fcff-4075-ba5f-6d93d4eafc53 req-8df12708-bab5-442d-a956-c63916dab0d5 service nova] Creating event network-vif-plugged:bab3ec3e-82d0-419b-9ccb-11f635214fe4 for instance 84fdd641-4d23-472a-8b8f-fded89dbcc32 on nch2-master-1 Apr 16 21:08:19.450755 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-dc56da70-fcff-4075-ba5f-6d93d4eafc53 req-8df12708-bab5-442d-a956-c63916dab0d5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065769 Apr 16 21:08:19.455768 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 220/401] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:08:19.912905 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-76eec444-1aeb-48c9-8145-c89b81cf91b3 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:19.913526 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-76eec444-1aeb-48c9-8145-c89b81cf91b3 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d06de5cf-0b6e-4546-b316-545265d6af2a] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:19.919627 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-76eec444-1aeb-48c9-8145-c89b81cf91b3 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:19.920094 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-76eec444-1aeb-48c9-8145-c89b81cf91b3 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:19.929482 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-76eec444-1aeb-48c9-8145-c89b81cf91b3 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:19.929482 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-76eec444-1aeb-48c9-8145-c89b81cf91b3 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:20.053741 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-76eec444-1aeb-48c9-8145-c89b81cf91b3 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:20.061648 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-76eec444-1aeb-48c9-8145-c89b81cf91b3 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:20.063227 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-76eec444-1aeb-48c9-8145-c89b81cf91b3 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:20.064321 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-76eec444-1aeb-48c9-8145-c89b81cf91b3 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a" status: 200 len: 1361 microversion: 2.25 time: 0.155359 Apr 16 21:08:20.064891 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 182/402] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:08:19 2022] GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:08:20.436338 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3786e054-5d41-44c0-8003-dcbcb30adfa2 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:20.437046 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3786e054-5d41-44c0-8003-dcbcb30adfa2 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] [instance: 84fdd641-4d23-472a-8b8f-fded89dbcc32] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:20.444668 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3786e054-5d41-44c0-8003-dcbcb30adfa2 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:20.445538 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3786e054-5d41-44c0-8003-dcbcb30adfa2 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:20.446506 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3786e054-5d41-44c0-8003-dcbcb30adfa2 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:20.447108 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3786e054-5d41-44c0-8003-dcbcb30adfa2 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:20.615782 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3786e054-5d41-44c0-8003-dcbcb30adfa2 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160e460966db4a7e8b697e26de50d0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487e280d7b014a7196cd1e4e9165cc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:20.625304 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3786e054-5d41-44c0-8003-dcbcb30adfa2 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] 10.222.0.20 "GET /compute/v2.1/servers/84fdd641-4d23-472a-8b8f-fded89dbcc32" status: 200 len: 1321 microversion: 2.1 time: 0.193920 Apr 16 21:08:20.626128 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 221/403] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:20 2022] GET /compute/v2.1/servers/84fdd641-4d23-472a-8b8f-fded89dbcc32 => generated 1321 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:21.082829 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cb855abc-a7bb-46e6-a32c-e3897e1f7625 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:21.084043 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-cb855abc-a7bb-46e6-a32c-e3897e1f7625 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d06de5cf-0b6e-4546-b316-545265d6af2a] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:21.091068 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cb855abc-a7bb-46e6-a32c-e3897e1f7625 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:21.091846 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cb855abc-a7bb-46e6-a32c-e3897e1f7625 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:21.092889 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cb855abc-a7bb-46e6-a32c-e3897e1f7625 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:21.093573 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cb855abc-a7bb-46e6-a32c-e3897e1f7625 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:21.278219 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cb855abc-a7bb-46e6-a32c-e3897e1f7625 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:21.286176 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cb855abc-a7bb-46e6-a32c-e3897e1f7625 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:21.288487 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cb855abc-a7bb-46e6-a32c-e3897e1f7625 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:21.290122 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cb855abc-a7bb-46e6-a32c-e3897e1f7625 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a" status: 200 len: 1361 microversion: 2.25 time: 0.211288 Apr 16 21:08:21.290882 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 183/404] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:08:21 2022] GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a => generated 1361 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:08:21.465260 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-013df50a-441e-493a-b4cf-31414e1fdd11 req-e09b4325-f3d1-42e4-8a14-1b8bcaf648e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d06de5cf-0b6e-4546-b316-545265d6af2a", "name": "network-vif-plugged", "status": "completed", "tag": "808376f5-de15-494a-b722-a554d5c81386"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:21.473891 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-013df50a-441e-493a-b4cf-31414e1fdd11 req-e09b4325-f3d1-42e4-8a14-1b8bcaf648e0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:21.474347 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-013df50a-441e-493a-b4cf-31414e1fdd11 req-e09b4325-f3d1-42e4-8a14-1b8bcaf648e0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:21.484855 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-013df50a-441e-493a-b4cf-31414e1fdd11 req-e09b4325-f3d1-42e4-8a14-1b8bcaf648e0 service nova] Creating event network-vif-plugged:808376f5-de15-494a-b722-a554d5c81386 for instance d06de5cf-0b6e-4546-b316-545265d6af2a on nch2-master-1 Apr 16 21:08:21.489683 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-013df50a-441e-493a-b4cf-31414e1fdd11 req-e09b4325-f3d1-42e4-8a14-1b8bcaf648e0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028145 Apr 16 21:08:21.490337 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 222/405] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:08:21.644114 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-500dbbd3-dd2b-4592-95bd-f61805a6f18a tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:21.644114 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-500dbbd3-dd2b-4592-95bd-f61805a6f18a tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] [instance: 84fdd641-4d23-472a-8b8f-fded89dbcc32] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:21.649620 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-500dbbd3-dd2b-4592-95bd-f61805a6f18a tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:21.650954 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-500dbbd3-dd2b-4592-95bd-f61805a6f18a tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:21.650954 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-500dbbd3-dd2b-4592-95bd-f61805a6f18a tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:21.651275 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-500dbbd3-dd2b-4592-95bd-f61805a6f18a tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:21.786265 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-500dbbd3-dd2b-4592-95bd-f61805a6f18a tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160e460966db4a7e8b697e26de50d0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487e280d7b014a7196cd1e4e9165cc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:21.794291 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-500dbbd3-dd2b-4592-95bd-f61805a6f18a tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] 10.222.0.20 "GET /compute/v2.1/servers/84fdd641-4d23-472a-8b8f-fded89dbcc32" status: 200 len: 1470 microversion: 2.1 time: 0.155747 Apr 16 21:08:21.794863 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 223/406] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:21 2022] GET /compute/v2.1/servers/84fdd641-4d23-472a-8b8f-fded89dbcc32 => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:21.911635 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-09cb57cc-c1f4-4a92-a225-f677050f5ba0 tempest-NetworksTest-944733221 tempest-NetworksTest-944733221-project-admin] Calling method '.version_select at 0x7fbb96f7e310>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:22.058916 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-09cb57cc-c1f4-4a92-a225-f677050f5ba0 tempest-NetworksTest-944733221 tempest-NetworksTest-944733221-project-admin] 10.222.0.20 "GET /compute/v2.1/os-networks" status: 200 len: 4711 microversion: 2.1 time: 0.555524 Apr 16 21:08:22.059508 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 184/407] 10.222.0.20 () {58 vars in 1136 bytes} [Sat Apr 16 21:08:21 2022] GET /compute/v2.1/os-networks => generated 4711 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:22.066195 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9b8ac1b2-bc24-4040-ada3-b489164145b8 tempest-ServersAdminNegativeTestJSON-2107380563 tempest-ServersAdminNegativeTestJSON-2107380563-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:22.067456 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9b8ac1b2-bc24-4040-ada3-b489164145b8 tempest-ServersAdminNegativeTestJSON-2107380563 tempest-ServersAdminNegativeTestJSON-2107380563-project-admin] [instance: fd44800e-8256-43dd-bd51-4b7383d07baf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:22.067672 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e93a0c39-6c42-415f-856e-7e9947cee64c tempest-NetworksTest-944733221 tempest-NetworksTest-944733221-project-admin] Calling method '.version_select at 0x7fbb96f2e1f0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:22.074408 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-9b8ac1b2-bc24-4040-ada3-b489164145b8 tempest-ServersAdminNegativeTestJSON-2107380563 tempest-ServersAdminNegativeTestJSON-2107380563-project-admin] HTTP exception thrown: Instance fd44800e-8256-43dd-bd51-4b7383d07baf could not be found. Apr 16 21:08:22.075093 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9b8ac1b2-bc24-4040-ada3-b489164145b8 tempest-ServersAdminNegativeTestJSON-2107380563 tempest-ServersAdminNegativeTestJSON-2107380563-project-admin] Returning 404 to user: Instance fd44800e-8256-43dd-bd51-4b7383d07baf could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:08:22.076025 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9b8ac1b2-bc24-4040-ada3-b489164145b8 tempest-ServersAdminNegativeTestJSON-2107380563 tempest-ServersAdminNegativeTestJSON-2107380563-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/fd44800e-8256-43dd-bd51-4b7383d07baf/action" status: 404 len: 111 microversion: 2.1 time: 0.266879 Apr 16 21:08:22.076832 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 224/408] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:08:21 2022] POST /compute/v2.1/servers/fd44800e-8256-43dd-bd51-4b7383d07baf/action => generated 111 bytes in 268 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:08:22.166183 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e93a0c39-6c42-415f-856e-7e9947cee64c tempest-NetworksTest-944733221 tempest-NetworksTest-944733221-project-admin] 10.222.0.20 "GET /compute/v2.1/os-networks/f901fd27-41ce-4b49-9132-e60168d0f679" status: 200 len: 652 microversion: 2.1 time: 0.102232 Apr 16 21:08:22.166763 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 185/409] 10.222.0.20 () {58 vars in 1247 bytes} [Sat Apr 16 21:08:22 2022] GET /compute/v2.1/os-networks/f901fd27-41ce-4b49-9132-e60168d0f679 => generated 652 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:08:22.175718 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1b4fbf49-2cf3-4268-a40a-fdb50cdf4906 tempest-NetworksTest-944733221 tempest-NetworksTest-944733221-project-admin] Calling method '.version_select at 0x7fbb96d9ed30>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:22.314427 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-94dae3b9-d61c-4b18-9774-6bbee46b57d5 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:22.315798 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-94dae3b9-d61c-4b18-9774-6bbee46b57d5 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d06de5cf-0b6e-4546-b316-545265d6af2a] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:22.322474 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-94dae3b9-d61c-4b18-9774-6bbee46b57d5 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:22.323213 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-94dae3b9-d61c-4b18-9774-6bbee46b57d5 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:22.324220 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-94dae3b9-d61c-4b18-9774-6bbee46b57d5 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:22.324924 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-94dae3b9-d61c-4b18-9774-6bbee46b57d5 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:22.362766 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1b4fbf49-2cf3-4268-a40a-fdb50cdf4906 tempest-NetworksTest-944733221 tempest-NetworksTest-944733221-project-admin] 10.222.0.20 "GET /compute/v2.1/os-networks" status: 200 len: 4711 microversion: 2.1 time: 0.190423 Apr 16 21:08:22.363353 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 225/410] 10.222.0.20 () {58 vars in 1136 bytes} [Sat Apr 16 21:08:22 2022] GET /compute/v2.1/os-networks => generated 4711 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:22.368428 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4deb74de-7819-4584-95d6-5a4fe6b454e5 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1888093492", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:22.444843 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-4deb74de-7819-4584-95d6-5a4fe6b454e5 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] validate_networks() for None {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:08:22.501723 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-94dae3b9-d61c-4b18-9774-6bbee46b57d5 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:22.510444 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-94dae3b9-d61c-4b18-9774-6bbee46b57d5 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:22.512337 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-94dae3b9-d61c-4b18-9774-6bbee46b57d5 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:22.513713 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-94dae3b9-d61c-4b18-9774-6bbee46b57d5 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a" status: 200 len: 1361 microversion: 2.25 time: 0.203538 Apr 16 21:08:22.514839 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 186/411] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:08:22 2022] GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a => generated 1361 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:08:22.683609 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-4deb74de-7819-4584-95d6-5a4fe6b454e5 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:08:22.684059 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-4deb74de-7819-4584-95d6-5a4fe6b454e5 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:08:22.684626 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-4deb74de-7819-4584-95d6-5a4fe6b454e5 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:08:22.685285 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-4deb74de-7819-4584-95d6-5a4fe6b454e5 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:08:22.685880 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-4deb74de-7819-4584-95d6-5a4fe6b454e5 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:08:22.696005 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4deb74de-7819-4584-95d6-5a4fe6b454e5 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:22.696673 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4deb74de-7819-4584-95d6-5a4fe6b454e5 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:22.697554 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4deb74de-7819-4584-95d6-5a4fe6b454e5 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:22.698156 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4deb74de-7819-4584-95d6-5a4fe6b454e5 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:22.714876 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-4deb74de-7819-4584-95d6-5a4fe6b454e5 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Getting quotas for project 487e280d7b014a7196cd1e4e9165cc7e. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:08:22.719966 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-4deb74de-7819-4584-95d6-5a4fe6b454e5 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Getting quotas for user 160e460966db4a7e8b697e26de50d0ff and project 487e280d7b014a7196cd1e4e9165cc7e. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:08:22.732367 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4deb74de-7819-4584-95d6-5a4fe6b454e5 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:08:22.734952 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4deb74de-7819-4584-95d6-5a4fe6b454e5 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] [instance: 8ee974a7-0d36-49bc-80f4-e269a3fa48bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:08:22.936418 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4deb74de-7819-4584-95d6-5a4fe6b454e5 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.570674 Apr 16 21:08:22.942829 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 226/412] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:08:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:08:22.947495 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9a479d9e-6260-4907-b610-e48585670a84 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:22.948406 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9a479d9e-6260-4907-b610-e48585670a84 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] [instance: 8ee974a7-0d36-49bc-80f4-e269a3fa48bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:23.026045 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9a479d9e-6260-4907-b610-e48585670a84 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160e460966db4a7e8b697e26de50d0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487e280d7b014a7196cd1e4e9165cc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:23.032909 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9a479d9e-6260-4907-b610-e48585670a84 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] 10.222.0.20 "GET /compute/v2.1/servers/8ee974a7-0d36-49bc-80f4-e269a3fa48bf" status: 200 len: 1222 microversion: 2.1 time: 0.089022 Apr 16 21:08:23.033472 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 187/413] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:22 2022] GET /compute/v2.1/servers/8ee974a7-0d36-49bc-80f4-e269a3fa48bf => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:08:23.534554 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c64e5f78-46ab-4f93-83ca-257edf99d760 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:23.535177 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c64e5f78-46ab-4f93-83ca-257edf99d760 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d06de5cf-0b6e-4546-b316-545265d6af2a] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:23.543674 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c64e5f78-46ab-4f93-83ca-257edf99d760 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:23.543674 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c64e5f78-46ab-4f93-83ca-257edf99d760 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:23.544205 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c64e5f78-46ab-4f93-83ca-257edf99d760 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:23.544653 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c64e5f78-46ab-4f93-83ca-257edf99d760 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:23.736425 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c64e5f78-46ab-4f93-83ca-257edf99d760 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:23.744793 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c64e5f78-46ab-4f93-83ca-257edf99d760 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:23.747133 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c64e5f78-46ab-4f93-83ca-257edf99d760 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:23.749572 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c64e5f78-46ab-4f93-83ca-257edf99d760 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a" status: 200 len: 1557 microversion: 2.25 time: 0.218990 Apr 16 21:08:23.755633 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 227/414] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:08:23 2022] GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a => generated 1557 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:08:24.054369 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-77498b6c-c32c-4703-86e8-d157b5a0a88f tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:24.055047 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-77498b6c-c32c-4703-86e8-d157b5a0a88f tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] [instance: 8ee974a7-0d36-49bc-80f4-e269a3fa48bf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:24.066358 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-77498b6c-c32c-4703-86e8-d157b5a0a88f tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:24.066842 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-77498b6c-c32c-4703-86e8-d157b5a0a88f tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:24.067660 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-77498b6c-c32c-4703-86e8-d157b5a0a88f tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:24.068136 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-77498b6c-c32c-4703-86e8-d157b5a0a88f tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:24.130178 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-77498b6c-c32c-4703-86e8-d157b5a0a88f tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160e460966db4a7e8b697e26de50d0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487e280d7b014a7196cd1e4e9165cc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:24.139323 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-77498b6c-c32c-4703-86e8-d157b5a0a88f tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] 10.222.0.20 "GET /compute/v2.1/servers/8ee974a7-0d36-49bc-80f4-e269a3fa48bf" status: 200 len: 1226 microversion: 2.1 time: 0.092674 Apr 16 21:08:24.139890 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 228/415] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:24 2022] GET /compute/v2.1/servers/8ee974a7-0d36-49bc-80f4-e269a3fa48bf => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:08:24.242036 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5dc7c0ac-7abd-4f74-83ea-53a5361ace67 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:24.242919 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5dc7c0ac-7abd-4f74-83ea-53a5361ace67 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] [instance: d06de5cf-0b6e-4546-b316-545265d6af2a] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:24.251185 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5dc7c0ac-7abd-4f74-83ea-53a5361ace67 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:24.251965 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5dc7c0ac-7abd-4f74-83ea-53a5361ace67 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:24.253445 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5dc7c0ac-7abd-4f74-83ea-53a5361ace67 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:24.254338 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5dc7c0ac-7abd-4f74-83ea-53a5361ace67 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:24.390185 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-5dc7c0ac-7abd-4f74-83ea-53a5361ace67 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lazy-loading 'services' on Instance uuid d06de5cf-0b6e-4546-b316-545265d6af2a {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:08:24.444620 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5dc7c0ac-7abd-4f74-83ea-53a5361ace67 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a" status: 200 len: 2049 microversion: 2.25 time: 0.675458 Apr 16 21:08:24.445492 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 188/416] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:08:23 2022] GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a => generated 2049 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:08:24.462523 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fc8677f7-44db-4b59-9c6c-641d776a9804 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:24.463232 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fc8677f7-44db-4b59-9c6c-641d776a9804 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] [instance: d06de5cf-0b6e-4546-b316-545265d6af2a] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:24.469428 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fc8677f7-44db-4b59-9c6c-641d776a9804 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:24.470121 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fc8677f7-44db-4b59-9c6c-641d776a9804 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:24.470969 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fc8677f7-44db-4b59-9c6c-641d776a9804 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:24.471838 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fc8677f7-44db-4b59-9c6c-641d776a9804 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:24.652205 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-fc8677f7-44db-4b59-9c6c-641d776a9804 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lazy-loading 'services' on Instance uuid d06de5cf-0b6e-4546-b316-545265d6af2a {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:08:24.710020 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fc8677f7-44db-4b59-9c6c-641d776a9804 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a" status: 200 len: 2049 microversion: 2.25 time: 0.250709 Apr 16 21:08:24.710518 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 229/417] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:08:24 2022] GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a => generated 2049 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:08:24.727801 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3e189369-a6fd-4acf-a299-26adfd2236c9 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:24.729144 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:24.729144 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:08:24.730347 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e189369-a6fd-4acf-a299-26adfd2236c9 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:24.730799 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e189369-a6fd-4acf-a299-26adfd2236c9 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:24.731884 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e189369-a6fd-4acf-a299-26adfd2236c9 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:24.732355 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e189369-a6fd-4acf-a299-26adfd2236c9 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:24.755703 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3e189369-a6fd-4acf-a299-26adfd2236c9 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.031856 Apr 16 21:08:24.756846 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 189/418] 10.222.0.20 () {60 vars in 1216 bytes} [Sat Apr 16 21:08:24 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:08:24.769942 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-42cbca65-dfac-4012-b6d7-55445a0f6d06 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:24.771364 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-42cbca65-dfac-4012-b6d7-55445a0f6d06 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] [instance: d06de5cf-0b6e-4546-b316-545265d6af2a] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:24.777526 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-42cbca65-dfac-4012-b6d7-55445a0f6d06 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:24.777981 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-42cbca65-dfac-4012-b6d7-55445a0f6d06 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:24.778939 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-42cbca65-dfac-4012-b6d7-55445a0f6d06 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:24.779379 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-42cbca65-dfac-4012-b6d7-55445a0f6d06 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:24.853267 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-42cbca65-dfac-4012-b6d7-55445a0f6d06 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lazy-loading 'flavor' on Instance uuid d06de5cf-0b6e-4546-b316-545265d6af2a {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:08:24.903941 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-42cbca65-dfac-4012-b6d7-55445a0f6d06 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] [instance: d06de5cf-0b6e-4546-b316-545265d6af2a] Going to try to live migrate instance to nch1-master-1 {{(pid=137408) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Apr 16 21:08:25.422801 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-85b068e6-5345-4261-97a8-7f0980eeab19 tempest-InstanceUsageAuditLogTestJSON-164774120 tempest-InstanceUsageAuditLogTestJSON-164774120-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:25.423736 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:25.423736 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:08:25.446374 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-85b068e6-5345-4261-97a8-7f0980eeab19 tempest-InstanceUsageAuditLogTestJSON-164774120 tempest-InstanceUsageAuditLogTestJSON-164774120-project-admin] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log/2022-04-16 21:08:24" status: 200 len: 318 microversion: 2.1 time: 0.453861 Apr 16 21:08:25.446947 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 190/419] 10.222.0.20 () {58 vars in 1250 bytes} [Sat Apr 16 21:08:24 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-04-16%2021%3A08%3A24 => generated 318 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:08:25.571983 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ad82c814-3c49-45ad-a442-5b3d34d6b2e4 tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] Action: 'update', calling method: .version_select at 0x7fbb96f6b1f0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:25.573191 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:25.573191 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:08:25.574355 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ad82c814-3c49-45ad-a442-5b3d34d6b2e4 tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:25.574805 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ad82c814-3c49-45ad-a442-5b3d34d6b2e4 tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:25.592060 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ad82c814-3c49-45ad-a442-5b3d34d6b2e4 tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:25.592534 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ad82c814-3c49-45ad-a442-5b3d34d6b2e4 tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:25.603486 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-ad82c814-3c49-45ad-a442-5b3d34d6b2e4 tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] HTTP exception thrown: Service 4d76e920-3e4d-480d-8d7d-3dc1c5adfac1 could not be found. Apr 16 21:08:25.606606 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ad82c814-3c49-45ad-a442-5b3d34d6b2e4 tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] Returning 404 to user: Service 4d76e920-3e4d-480d-8d7d-3dc1c5adfac1 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:08:25.606606 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ad82c814-3c49-45ad-a442-5b3d34d6b2e4 tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-services/4d76e920-3e4d-480d-8d7d-3dc1c5adfac1" status: 404 len: 110 microversion: 2.53 time: 0.157125 Apr 16 21:08:25.606606 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 191/420] 10.222.0.20 () {62 vars in 1308 bytes} [Sat Apr 16 21:08:25 2022] PUT /compute/v2.1/os-services/4d76e920-3e4d-480d-8d7d-3dc1c5adfac1 => generated 110 bytes in 158 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:08:25.611197 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2c1ac7f0-9dcc-4557-bb88-6dc17bb439c6 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:25.611899 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2c1ac7f0-9dcc-4557-bb88-6dc17bb439c6 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] [instance: 8ee974a7-0d36-49bc-80f4-e269a3fa48bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:25.618005 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2c1ac7f0-9dcc-4557-bb88-6dc17bb439c6 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:25.618715 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2c1ac7f0-9dcc-4557-bb88-6dc17bb439c6 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:25.619680 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2c1ac7f0-9dcc-4557-bb88-6dc17bb439c6 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:25.620350 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2c1ac7f0-9dcc-4557-bb88-6dc17bb439c6 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:25.728961 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2c1ac7f0-9dcc-4557-bb88-6dc17bb439c6 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160e460966db4a7e8b697e26de50d0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487e280d7b014a7196cd1e4e9165cc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:25.739253 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2c1ac7f0-9dcc-4557-bb88-6dc17bb439c6 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] 10.222.0.20 "GET /compute/v2.1/servers/8ee974a7-0d36-49bc-80f4-e269a3fa48bf" status: 200 len: 1292 microversion: 2.1 time: 0.131990 Apr 16 21:08:25.740034 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 192/421] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:25 2022] GET /compute/v2.1/servers/8ee974a7-0d36-49bc-80f4-e269a3fa48bf => generated 1292 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:25.760714 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-af541030-1186-4562-b235-62d4321ea0b1 tempest-InstanceUsageAuditLogTestJSON-164774120 tempest-InstanceUsageAuditLogTestJSON-164774120-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:25.760714 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:25.760714 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:08:25.779252 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-af541030-1186-4562-b235-62d4321ea0b1 tempest-InstanceUsageAuditLogTestJSON-164774120 tempest-InstanceUsageAuditLogTestJSON-164774120-project-admin] 10.222.0.20 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.036267 Apr 16 21:08:25.786007 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 193/422] 10.222.0.20 () {58 vars in 1184 bytes} [Sat Apr 16 21:08:25 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:08:25.795411 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8fd2b7cb-3cc5-4593-83e9-cc7bc736dc08 tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] Action: 'update', calling method: .version_select at 0x7fbb96e86af0>, body: {"status": "disabled"} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:25.797025 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:25.797025 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:08:25.798190 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8fd2b7cb-3cc5-4593-83e9-cc7bc736dc08 tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:25.798642 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8fd2b7cb-3cc5-4593-83e9-cc7bc736dc08 tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:25.804647 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8fd2b7cb-3cc5-4593-83e9-cc7bc736dc08 tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:25.805094 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8fd2b7cb-3cc5-4593-83e9-cc7bc736dc08 tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:25.810689 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-8fd2b7cb-3cc5-4593-83e9-cc7bc736dc08 tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] HTTP exception thrown: Service 4d76e920-3e4d-480d-8d7d-3dc1c5adfac1 could not be found. Apr 16 21:08:25.811647 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8fd2b7cb-3cc5-4593-83e9-cc7bc736dc08 tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] Returning 404 to user: Service 4d76e920-3e4d-480d-8d7d-3dc1c5adfac1 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:08:25.812682 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8fd2b7cb-3cc5-4593-83e9-cc7bc736dc08 tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-services/4d76e920-3e4d-480d-8d7d-3dc1c5adfac1" status: 404 len: 110 microversion: 2.53 time: 0.025283 Apr 16 21:08:25.813610 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 194/423] 10.222.0.20 () {62 vars in 1308 bytes} [Sat Apr 16 21:08:25 2022] PUT /compute/v2.1/os-services/4d76e920-3e4d-480d-8d7d-3dc1c5adfac1 => generated 110 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:08:25.829833 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-98f5a36e-9fff-4715-a5a7-58e00e0dcba2 tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] Action: 'update', calling method: .version_select at 0x7fbb96f6b670>, body: {"status": "enabled"} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:25.833928 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-98f5a36e-9fff-4715-a5a7-58e00e0dcba2 tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:25.835100 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-98f5a36e-9fff-4715-a5a7-58e00e0dcba2 tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:25.842222 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-98f5a36e-9fff-4715-a5a7-58e00e0dcba2 tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:25.843078 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-98f5a36e-9fff-4715-a5a7-58e00e0dcba2 tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:25.849600 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-98f5a36e-9fff-4715-a5a7-58e00e0dcba2 tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] HTTP exception thrown: Service 4d76e920-3e4d-480d-8d7d-3dc1c5adfac1 could not be found. Apr 16 21:08:25.850727 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-98f5a36e-9fff-4715-a5a7-58e00e0dcba2 tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] Returning 404 to user: Service 4d76e920-3e4d-480d-8d7d-3dc1c5adfac1 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:08:25.851758 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-98f5a36e-9fff-4715-a5a7-58e00e0dcba2 tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-services/4d76e920-3e4d-480d-8d7d-3dc1c5adfac1" status: 404 len: 110 microversion: 2.53 time: 0.029863 Apr 16 21:08:25.853520 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 195/424] 10.222.0.20 () {62 vars in 1308 bytes} [Sat Apr 16 21:08:25 2022] PUT /compute/v2.1/os-services/4d76e920-3e4d-480d-8d7d-3dc1c5adfac1 => generated 110 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:08:25.862979 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6d92af75-cab3-40f5-bd42-f9fc4caf48cc tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:25.864340 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:25.864340 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:08:25.865671 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6d92af75-cab3-40f5-bd42-f9fc4caf48cc tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:25.866170 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6d92af75-cab3-40f5-bd42-f9fc4caf48cc tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:25.866990 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6d92af75-cab3-40f5-bd42-f9fc4caf48cc tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:25.867415 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6d92af75-cab3-40f5-bd42-f9fc4caf48cc tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:25.906185 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6d92af75-cab3-40f5-bd42-f9fc4caf48cc tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.046920 Apr 16 21:08:25.913677 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 196/425] 10.222.0.20 () {60 vars in 1177 bytes} [Sat Apr 16 21:08:25 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:08:25.918863 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5d9e672c-f4d7-44f1-b2f0-90450a8eef40 tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:25.920240 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:25.920240 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:08:25.921604 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5d9e672c-f4d7-44f1-b2f0-90450a8eef40 tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:25.922059 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5d9e672c-f4d7-44f1-b2f0-90450a8eef40 tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:25.922863 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5d9e672c-f4d7-44f1-b2f0-90450a8eef40 tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:25.923484 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5d9e672c-f4d7-44f1-b2f0-90450a8eef40 tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:25.948733 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5d9e672c-f4d7-44f1-b2f0-90450a8eef40 tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.033553 Apr 16 21:08:25.952598 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 197/426] 10.222.0.20 () {60 vars in 1210 bytes} [Sat Apr 16 21:08:25 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1242 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:08:26.335831 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c99caefd-8d71-4087-8165-7ff7aa4c51d6 tempest-FlavorsV261TestJSON-114073364 tempest-FlavorsV261TestJSON-114073364-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1347679358", "id": 391486420, "os-flavor-access:is_public": "True"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:26.338478 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:26.338478 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:08:26.458538 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c99caefd-8d71-4087-8165-7ff7aa4c51d6 tempest-FlavorsV261TestJSON-114073364 tempest-FlavorsV261TestJSON-114073364-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 465 microversion: 2.61 time: 0.501857 Apr 16 21:08:26.461442 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 198/427] 10.222.0.20 () {62 vars in 1187 bytes} [Sat Apr 16 21:08:25 2022] POST /compute/v2.1/flavors => generated 465 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:08:26.466787 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4ca800e6-2b15-4072-afba-cc519278602e tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:26.468745 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:26.468745 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:08:26.470563 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4ca800e6-2b15-4072-afba-cc519278602e tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:26.471126 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4ca800e6-2b15-4072-afba-cc519278602e tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:26.472409 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4ca800e6-2b15-4072-afba-cc519278602e tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:26.473119 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4ca800e6-2b15-4072-afba-cc519278602e tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:26.509321 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4ca800e6-2b15-4072-afba-cc519278602e tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.046609 Apr 16 21:08:26.510483 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 199/428] 10.222.0.20 () {60 vars in 1177 bytes} [Sat Apr 16 21:08:26 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:08:26.981947 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c0a445e5-dbb3-4ad2-92a4-22bcc39f7655 tempest-FlavorsV261TestJSON-561095999 tempest-FlavorsV261TestJSON-561095999-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:26.995893 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c0a445e5-dbb3-4ad2-92a4-22bcc39f7655 tempest-FlavorsV261TestJSON-561095999 tempest-FlavorsV261TestJSON-561095999-project] 10.222.0.20 "GET /compute/v2.1/flavors/391486420" status: 200 len: 465 microversion: 2.61 time: 0.484130 Apr 16 21:08:27.002574 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 200/429] 10.222.0.20 () {60 vars in 1195 bytes} [Sat Apr 16 21:08:26 2022] GET /compute/v2.1/flavors/391486420 => generated 465 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:08:27.007681 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-09c88b0b-08d5-46b7-87ae-e35c4c8ddd41 tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:27.009032 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:27.009032 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:08:27.010243 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-09c88b0b-08d5-46b7-87ae-e35c4c8ddd41 tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:27.010691 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-09c88b0b-08d5-46b7-87ae-e35c4c8ddd41 tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:27.030477 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-09c88b0b-08d5-46b7-87ae-e35c4c8ddd41 tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:27.030477 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-09c88b0b-08d5-46b7-87ae-e35c4c8ddd41 tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:27.056642 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-09c88b0b-08d5-46b7-87ae-e35c4c8ddd41 tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.056427 Apr 16 21:08:27.057460 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 201/430] 10.222.0.20 () {60 vars in 1236 bytes} [Sat Apr 16 21:08:26 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:27.062417 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-01db1cb0-1e5e-4496-9cb1-3bcf13055fcd tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:27.063169 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-01db1cb0-1e5e-4496-9cb1-3bcf13055fcd tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] [instance: 8ee974a7-0d36-49bc-80f4-e269a3fa48bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:27.071835 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-01db1cb0-1e5e-4496-9cb1-3bcf13055fcd tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:27.077030 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-01db1cb0-1e5e-4496-9cb1-3bcf13055fcd tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:27.078157 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-01db1cb0-1e5e-4496-9cb1-3bcf13055fcd tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:27.078915 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-01db1cb0-1e5e-4496-9cb1-3bcf13055fcd tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:27.602837 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-01db1cb0-1e5e-4496-9cb1-3bcf13055fcd tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160e460966db4a7e8b697e26de50d0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487e280d7b014a7196cd1e4e9165cc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:27.611531 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-01db1cb0-1e5e-4496-9cb1-3bcf13055fcd tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] 10.222.0.20 "GET /compute/v2.1/servers/8ee974a7-0d36-49bc-80f4-e269a3fa48bf" status: 200 len: 1322 microversion: 2.1 time: 0.552982 Apr 16 21:08:27.612128 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 202/431] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:27 2022] GET /compute/v2.1/servers/8ee974a7-0d36-49bc-80f4-e269a3fa48bf => generated 1322 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:28.070186 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-25e2369b-8e8b-466d-9dbc-a0adbe1d2564 tempest-QuotaClassesAdmin257Test-350227295 tempest-QuotaClassesAdmin257Test-350227295-project-admin] Calling method '.version_select at 0x7fbb96f0f5e0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:28.071015 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:28.071015 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:08:28.081856 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-25e2369b-8e8b-466d-9dbc-a0adbe1d2564 tempest-QuotaClassesAdmin257Test-350227295 tempest-QuotaClassesAdmin257Test-350227295-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.468490 Apr 16 21:08:28.082427 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 203/432] 10.222.0.20 () {60 vars in 1225 bytes} [Sat Apr 16 21:08:27 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:08:28.087721 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f7506d7a-e3bf-4c4b-b3c7-27ce5c005f3c tempest-FlavorsV261TestJSON-114073364 tempest-FlavorsV261TestJSON-114073364-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:28.089548 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:28.089548 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:08:28.178593 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f7506d7a-e3bf-4c4b-b3c7-27ce5c005f3c tempest-FlavorsV261TestJSON-114073364 tempest-FlavorsV261TestJSON-114073364-project-admin] 10.222.0.20 "PUT /compute/v2.1/flavors/391486420" status: 200 len: 466 microversion: 2.61 time: 0.094884 Apr 16 21:08:28.179247 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 204/433] 10.222.0.20 () {62 vars in 1215 bytes} [Sat Apr 16 21:08:28 2022] PUT /compute/v2.1/flavors/391486420 => generated 466 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:08:28.183676 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6b6b34a1-c4e3-4ae7-9700-9935c62e71a6 tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:28.184982 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:28.184982 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:08:28.186599 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6b6b34a1-c4e3-4ae7-9700-9935c62e71a6 tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:28.187122 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6b6b34a1-c4e3-4ae7-9700-9935c62e71a6 tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:28.188129 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6b6b34a1-c4e3-4ae7-9700-9935c62e71a6 tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:28.188596 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6b6b34a1-c4e3-4ae7-9700-9935c62e71a6 tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:28.212765 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6b6b34a1-c4e3-4ae7-9700-9935c62e71a6 tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1242 microversion: 2.53 time: 0.032355 Apr 16 21:08:28.213348 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 205/434] 10.222.0.20 () {60 vars in 1177 bytes} [Sat Apr 16 21:08:28 2022] GET /compute/v2.1/os-services => generated 1242 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:08:28.217915 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-a977d94b-ab59-407a-ab3c-74bf3fcc2950 req-5f750439-f8fa-42ac-991f-a0bfe1d9c9ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ee974a7-0d36-49bc-80f4-e269a3fa48bf", "tag": "73ab8831-7b70-423a-9fbd-e1e78b3be077"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:28.225744 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-a977d94b-ab59-407a-ab3c-74bf3fcc2950 req-5f750439-f8fa-42ac-991f-a0bfe1d9c9ba service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:28.226197 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-a977d94b-ab59-407a-ab3c-74bf3fcc2950 req-5f750439-f8fa-42ac-991f-a0bfe1d9c9ba service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:28.236504 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-a977d94b-ab59-407a-ab3c-74bf3fcc2950 req-5f750439-f8fa-42ac-991f-a0bfe1d9c9ba service nova] Creating event network-changed:73ab8831-7b70-423a-9fbd-e1e78b3be077 for instance 8ee974a7-0d36-49bc-80f4-e269a3fa48bf on nch1-master-1 Apr 16 21:08:28.241626 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-a977d94b-ab59-407a-ab3c-74bf3fcc2950 req-5f750439-f8fa-42ac-991f-a0bfe1d9c9ba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.026945 Apr 16 21:08:28.242202 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 206/435] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:08:28.247668 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-92d6be50-9219-4b49-af2c-82a68c5138f0 tempest-QuotaClassesAdmin257Test-350227295 tempest-QuotaClassesAdmin257Test-350227295-project-admin] Action: 'update', calling method: .version_select at 0x7fbb96f0f790>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:28.249260 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:28.249260 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:08:29.085057 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-92d6be50-9219-4b49-af2c-82a68c5138f0 tempest-QuotaClassesAdmin257Test-350227295 tempest-QuotaClassesAdmin257Test-350227295-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.841479 Apr 16 21:08:29.087053 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 207/436] 10.222.0.20 () {62 vars in 1246 bytes} [Sat Apr 16 21:08:28 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:08:29.092050 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b5491101-dd74-41b6-b598-606d6e84a381 tempest-FlavorsV261TestJSON-561095999 tempest-FlavorsV261TestJSON-561095999-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:29.119934 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b5491101-dd74-41b6-b598-606d6e84a381 tempest-FlavorsV261TestJSON-561095999 tempest-FlavorsV261TestJSON-561095999-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 7148 microversion: 2.61 time: 0.031520 Apr 16 21:08:29.120517 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 208/437] 10.222.0.20 () {60 vars in 1186 bytes} [Sat Apr 16 21:08:29 2022] GET /compute/v2.1/flavors/detail => generated 7148 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:08:29.124975 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-72f16f6c-8d4a-43fa-b8e6-3ee751eb8b4a tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:29.126237 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:29.126237 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:08:29.127584 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-72f16f6c-8d4a-43fa-b8e6-3ee751eb8b4a tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:29.128044 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-72f16f6c-8d4a-43fa-b8e6-3ee751eb8b4a tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:29.128879 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-72f16f6c-8d4a-43fa-b8e6-3ee751eb8b4a tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:29.129318 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-72f16f6c-8d4a-43fa-b8e6-3ee751eb8b4a tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:29.153222 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-72f16f6c-8d4a-43fa-b8e6-3ee751eb8b4a tempest-ServicesAdminNegativeV253TestJSON-1529587416 tempest-ServicesAdminNegativeV253TestJSON-1529587416-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.031503 Apr 16 21:08:29.153884 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 209/438] 10.222.0.20 () {60 vars in 1238 bytes} [Sat Apr 16 21:08:29 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:29.160490 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5b729418-f185-4c65-ba79-620417814503 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:29.161479 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5b729418-f185-4c65-ba79-620417814503 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] [instance: 8ee974a7-0d36-49bc-80f4-e269a3fa48bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:29.168808 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5b729418-f185-4c65-ba79-620417814503 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:29.169545 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5b729418-f185-4c65-ba79-620417814503 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:29.170704 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5b729418-f185-4c65-ba79-620417814503 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:29.171152 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5b729418-f185-4c65-ba79-620417814503 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:29.390578 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5b729418-f185-4c65-ba79-620417814503 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160e460966db4a7e8b697e26de50d0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487e280d7b014a7196cd1e4e9165cc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:29.398612 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5b729418-f185-4c65-ba79-620417814503 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] 10.222.0.20 "GET /compute/v2.1/servers/8ee974a7-0d36-49bc-80f4-e269a3fa48bf" status: 200 len: 1322 microversion: 2.1 time: 0.243527 Apr 16 21:08:29.399412 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 210/439] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:29 2022] GET /compute/v2.1/servers/8ee974a7-0d36-49bc-80f4-e269a3fa48bf => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:29.412223 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-877a9721-a853-4e88-a629-ece4c5c859b7 tempest-QuotaClassesAdmin257Test-350227295 tempest-QuotaClassesAdmin257Test-350227295-project-admin] Calling method '.version_select at 0x7fbb9c39fa60>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:29.413828 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:29.413828 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:08:29.427260 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-42cbca65-dfac-4012-b6d7-55445a0f6d06 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a/action" status: 202 len: 0 microversion: 2.25 time: 4.661120 Apr 16 21:08:29.431684 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 230/440] 10.222.0.20 () {62 vars in 1318 bytes} [Sat Apr 16 21:08:24 2022] POST /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a/action => generated 0 bytes in 4663 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:08:29.433407 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bd612816-a6a1-4a74-8fe4-2d24c521c57a tempest-FlavorsV261TestJSON-561095999 tempest-FlavorsV261TestJSON-561095999-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:29.439634 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-877a9721-a853-4e88-a629-ece4c5c859b7 tempest-QuotaClassesAdmin257Test-350227295 tempest-QuotaClassesAdmin257Test-350227295-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.030861 Apr 16 21:08:29.440440 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 211/441] 10.222.0.20 () {60 vars in 1225 bytes} [Sat Apr 16 21:08:29 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:08:29.468726 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-bd612816-a6a1-4a74-8fe4-2d24c521c57a tempest-FlavorsV261TestJSON-561095999 tempest-FlavorsV261TestJSON-561095999-project] 10.222.0.20 "GET /compute/v2.1/flavors" status: 200 len: 3675 microversion: 2.61 time: 0.038956 Apr 16 21:08:29.478553 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 231/442] 10.222.0.20 () {60 vars in 1165 bytes} [Sat Apr 16 21:08:29 2022] GET /compute/v2.1/flavors => generated 3675 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:08:29.653032 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-073c10c8-d41d-4c16-92d7-d77c5a8917f4 tempest-ServicesAdminNegativeV253TestJSON-98296581 tempest-ServicesAdminNegativeV253TestJSON-98296581-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:29.656450 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:29.656450 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:08:29.661921 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-073c10c8-d41d-4c16-92d7-d77c5a8917f4 tempest-ServicesAdminNegativeV253TestJSON-98296581 tempest-ServicesAdminNegativeV253TestJSON-98296581-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': 'b3eda36314084bb3a49e8de6f1da1eeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938bf0d761bb4af28aff60eef1b6bcbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:29.663960 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-073c10c8-d41d-4c16-92d7-d77c5a8917f4 tempest-ServicesAdminNegativeV253TestJSON-98296581 tempest-ServicesAdminNegativeV253TestJSON-98296581-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:08:29.665970 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-073c10c8-d41d-4c16-92d7-d77c5a8917f4 tempest-ServicesAdminNegativeV253TestJSON-98296581 tempest-ServicesAdminNegativeV253TestJSON-98296581-project] 10.222.0.20 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.224383 Apr 16 21:08:29.667474 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 212/443] 10.222.0.20 () {60 vars in 1177 bytes} [Sat Apr 16 21:08:29 2022] GET /compute/v2.1/os-services => generated 112 bytes in 227 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:08:29.715562 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-edd96c72-2439-4cc4-99e5-d60e82aa497f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:29.716894 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-edd96c72-2439-4cc4-99e5-d60e82aa497f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d06de5cf-0b6e-4546-b316-545265d6af2a] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:29.735058 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c48bf724-c079-491b-8ed5-6d8ee1206f76 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-2027580716", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:29.757371 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-edd96c72-2439-4cc4-99e5-d60e82aa497f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:29.758172 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-edd96c72-2439-4cc4-99e5-d60e82aa497f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:29.764319 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-edd96c72-2439-4cc4-99e5-d60e82aa497f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:29.765130 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-edd96c72-2439-4cc4-99e5-d60e82aa497f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:29.835692 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-c48bf724-c079-491b-8ed5-6d8ee1206f76 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] validate_networks() for None {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:08:29.927450 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-edd96c72-2439-4cc4-99e5-d60e82aa497f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:29.936244 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-edd96c72-2439-4cc4-99e5-d60e82aa497f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:29.938109 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-edd96c72-2439-4cc4-99e5-d60e82aa497f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:29.939579 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-edd96c72-2439-4cc4-99e5-d60e82aa497f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a" status: 200 len: 1567 microversion: 2.25 time: 0.270582 Apr 16 21:08:29.940128 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 213/444] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:08:29 2022] GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a => generated 1567 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:08:29.945289 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6f97dd8f-2dd3-4233-bf73-359b0ea6e8e2 tempest-QuotaClassesAdmin257Test-350227295 tempest-QuotaClassesAdmin257Test-350227295-project-admin] Action: 'update', calling method: .version_select at 0x7fbb96e869d0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:29.947294 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:29.947294 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:08:30.045585 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-c48bf724-c079-491b-8ed5-6d8ee1206f76 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:08:30.046275 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-c48bf724-c079-491b-8ed5-6d8ee1206f76 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:08:30.046805 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-c48bf724-c079-491b-8ed5-6d8ee1206f76 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:08:30.047223 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-c48bf724-c079-491b-8ed5-6d8ee1206f76 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:08:30.047633 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-c48bf724-c079-491b-8ed5-6d8ee1206f76 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:08:30.057087 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c48bf724-c079-491b-8ed5-6d8ee1206f76 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:30.057478 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c48bf724-c079-491b-8ed5-6d8ee1206f76 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:30.058271 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c48bf724-c079-491b-8ed5-6d8ee1206f76 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:30.058723 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c48bf724-c079-491b-8ed5-6d8ee1206f76 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:30.076087 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-c48bf724-c079-491b-8ed5-6d8ee1206f76 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Getting quotas for project 676a0384d9444d9d8e42073806728c43. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:08:30.081222 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-c48bf724-c079-491b-8ed5-6d8ee1206f76 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Getting quotas for user 01db629e453f41ff8debfefd155aa14c and project 676a0384d9444d9d8e42073806728c43. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:08:30.097644 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c48bf724-c079-491b-8ed5-6d8ee1206f76 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:08:30.099846 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c48bf724-c079-491b-8ed5-6d8ee1206f76 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] [instance: 1b5139ef-315a-4a27-9ec4-32c148154072] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:08:30.301591 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c48bf724-c079-491b-8ed5-6d8ee1206f76 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.831085 Apr 16 21:08:30.302239 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 232/445] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:08:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 832 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:08:30.313363 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-12593874-13e8-4176-8dd4-185381d885c2 tempest-FlavorsV261TestJSON-114073364 tempest-FlavorsV261TestJSON-114073364-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:30.318573 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:30.318573 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:08:30.495040 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-12593874-13e8-4176-8dd4-185381d885c2 tempest-FlavorsV261TestJSON-114073364 tempest-FlavorsV261TestJSON-114073364-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/391486420" status: 202 len: 0 microversion: 2.61 time: 0.185528 Apr 16 21:08:30.495532 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 233/446] 10.222.0.20 () {60 vars in 1198 bytes} [Sat Apr 16 21:08:30 2022] DELETE /compute/v2.1/flavors/391486420 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:08:30.500692 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0039bb4b-ae17-4fa2-a2ac-27f322c7cdae tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:30.501312 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0039bb4b-ae17-4fa2-a2ac-27f322c7cdae tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] [instance: 1b5139ef-315a-4a27-9ec4-32c148154072] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:30.565802 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0039bb4b-ae17-4fa2-a2ac-27f322c7cdae tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01db629e453f41ff8debfefd155aa14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676a0384d9444d9d8e42073806728c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:30.573490 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0039bb4b-ae17-4fa2-a2ac-27f322c7cdae tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5139ef-315a-4a27-9ec4-32c148154072" status: 200 len: 1223 microversion: 2.1 time: 0.076862 Apr 16 21:08:30.574090 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 234/447] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:30 2022] GET /compute/v2.1/servers/1b5139ef-315a-4a27-9ec4-32c148154072 => generated 1223 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:30.579754 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4abf6809-7406-4ce2-a861-6770569ba1e0 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:30.580388 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4abf6809-7406-4ce2-a861-6770569ba1e0 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] [instance: 8ee974a7-0d36-49bc-80f4-e269a3fa48bf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:30.586247 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4abf6809-7406-4ce2-a861-6770569ba1e0 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:30.586705 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4abf6809-7406-4ce2-a861-6770569ba1e0 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:30.587515 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4abf6809-7406-4ce2-a861-6770569ba1e0 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:30.587984 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4abf6809-7406-4ce2-a861-6770569ba1e0 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:30.762421 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4abf6809-7406-4ce2-a861-6770569ba1e0 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160e460966db4a7e8b697e26de50d0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487e280d7b014a7196cd1e4e9165cc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:30.772895 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4abf6809-7406-4ce2-a861-6770569ba1e0 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] 10.222.0.20 "GET /compute/v2.1/servers/8ee974a7-0d36-49bc-80f4-e269a3fa48bf" status: 200 len: 1322 microversion: 2.1 time: 0.197764 Apr 16 21:08:30.774163 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 235/448] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:30 2022] GET /compute/v2.1/servers/8ee974a7-0d36-49bc-80f4-e269a3fa48bf => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:30.789714 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b8691de4-e54f-4251-b18e-26ed368a933e tempest-FlavorsV261TestJSON-114073364 tempest-FlavorsV261TestJSON-114073364-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:30.816821 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b8691de4-e54f-4251-b18e-26ed368a933e tempest-FlavorsV261TestJSON-114073364 tempest-FlavorsV261TestJSON-114073364-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 6692 microversion: 2.61 time: 0.041115 Apr 16 21:08:30.818074 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 236/449] 10.222.0.20 () {60 vars in 1186 bytes} [Sat Apr 16 21:08:30 2022] GET /compute/v2.1/flavors/detail => generated 6692 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:08:30.853491 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6f97dd8f-2dd3-4233-bf73-359b0ea6e8e2 tempest-QuotaClassesAdmin257Test-350227295 tempest-QuotaClassesAdmin257Test-350227295-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.911788 Apr 16 21:08:30.854080 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 214/450] 10.222.0.20 () {62 vars in 1246 bytes} [Sat Apr 16 21:08:29 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:08:30.959858 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-12fc313c-00a6-49e4-a758-4d8a5067ff81 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:30.960558 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-12fc313c-00a6-49e4-a758-4d8a5067ff81 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d06de5cf-0b6e-4546-b316-545265d6af2a] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:30.966456 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-12fc313c-00a6-49e4-a758-4d8a5067ff81 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:30.966912 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-12fc313c-00a6-49e4-a758-4d8a5067ff81 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:30.967963 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-12fc313c-00a6-49e4-a758-4d8a5067ff81 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:30.968432 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-12fc313c-00a6-49e4-a758-4d8a5067ff81 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:31.112822 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-12fc313c-00a6-49e4-a758-4d8a5067ff81 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:31.121912 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-12fc313c-00a6-49e4-a758-4d8a5067ff81 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:31.123316 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-12fc313c-00a6-49e4-a758-4d8a5067ff81 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:31.124857 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-12fc313c-00a6-49e4-a758-4d8a5067ff81 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a" status: 200 len: 1567 microversion: 2.25 time: 0.169847 Apr 16 21:08:31.125877 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 237/451] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:08:30 2022] GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:08:31.482590 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-22018c5d-e2db-4a62-8845-75702b9c838f req-34bfb382-b5cc-40ef-b8de-32d1f873a3e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d06de5cf-0b6e-4546-b316-545265d6af2a", "name": "network-vif-unplugged", "status": "completed", "tag": "808376f5-de15-494a-b722-a554d5c81386"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:31.493348 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-22018c5d-e2db-4a62-8845-75702b9c838f req-34bfb382-b5cc-40ef-b8de-32d1f873a3e6 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:31.494359 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-22018c5d-e2db-4a62-8845-75702b9c838f req-34bfb382-b5cc-40ef-b8de-32d1f873a3e6 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:31.525872 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-22018c5d-e2db-4a62-8845-75702b9c838f req-34bfb382-b5cc-40ef-b8de-32d1f873a3e6 service nova] Creating event network-vif-unplugged:808376f5-de15-494a-b722-a554d5c81386 for instance d06de5cf-0b6e-4546-b316-545265d6af2a on nch2-master-1 Apr 16 21:08:31.531530 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-22018c5d-e2db-4a62-8845-75702b9c838f req-34bfb382-b5cc-40ef-b8de-32d1f873a3e6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052176 Apr 16 21:08:31.532218 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 215/452] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:08:31.590673 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6c98fec6-0604-4a96-8029-8a40d90e1b48 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:31.591315 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6c98fec6-0604-4a96-8029-8a40d90e1b48 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] [instance: 1b5139ef-315a-4a27-9ec4-32c148154072] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:31.654763 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6c98fec6-0604-4a96-8029-8a40d90e1b48 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01db629e453f41ff8debfefd155aa14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676a0384d9444d9d8e42073806728c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:31.659443 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6c98fec6-0604-4a96-8029-8a40d90e1b48 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5139ef-315a-4a27-9ec4-32c148154072" status: 200 len: 1223 microversion: 2.1 time: 0.072526 Apr 16 21:08:31.661941 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 238/453] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:31 2022] GET /compute/v2.1/servers/1b5139ef-315a-4a27-9ec4-32c148154072 => generated 1223 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:31.794103 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-dc055b87-1aa7-41d1-93f4-d002cae3bef0 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:31.796300 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-dc055b87-1aa7-41d1-93f4-d002cae3bef0 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] [instance: 8ee974a7-0d36-49bc-80f4-e269a3fa48bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:31.806444 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dc055b87-1aa7-41d1-93f4-d002cae3bef0 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:31.807175 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dc055b87-1aa7-41d1-93f4-d002cae3bef0 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:31.808145 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dc055b87-1aa7-41d1-93f4-d002cae3bef0 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:31.809318 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dc055b87-1aa7-41d1-93f4-d002cae3bef0 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:32.089781 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-dc055b87-1aa7-41d1-93f4-d002cae3bef0 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160e460966db4a7e8b697e26de50d0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487e280d7b014a7196cd1e4e9165cc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:32.101742 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-dc055b87-1aa7-41d1-93f4-d002cae3bef0 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] 10.222.0.20 "GET /compute/v2.1/servers/8ee974a7-0d36-49bc-80f4-e269a3fa48bf" status: 200 len: 1322 microversion: 2.1 time: 0.314752 Apr 16 21:08:32.105481 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 216/454] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:31 2022] GET /compute/v2.1/servers/8ee974a7-0d36-49bc-80f4-e269a3fa48bf => generated 1322 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:32.142805 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-333bc978-883e-4056-83a1-af629db4e8bf tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:32.143417 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-333bc978-883e-4056-83a1-af629db4e8bf tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d06de5cf-0b6e-4546-b316-545265d6af2a] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:32.154362 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-333bc978-883e-4056-83a1-af629db4e8bf tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:32.154814 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-333bc978-883e-4056-83a1-af629db4e8bf tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:32.155602 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-333bc978-883e-4056-83a1-af629db4e8bf tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:32.156042 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-333bc978-883e-4056-83a1-af629db4e8bf tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:32.378495 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-333bc978-883e-4056-83a1-af629db4e8bf tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:32.396252 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-333bc978-883e-4056-83a1-af629db4e8bf tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:32.398501 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-333bc978-883e-4056-83a1-af629db4e8bf tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:32.399866 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-333bc978-883e-4056-83a1-af629db4e8bf tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a" status: 200 len: 1567 microversion: 2.25 time: 0.260919 Apr 16 21:08:32.408835 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 239/455] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:08:32 2022] GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a => generated 1567 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:08:32.678375 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c5dbc8e6-e091-46db-8a94-19a729def437 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:32.679574 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c5dbc8e6-e091-46db-8a94-19a729def437 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] [instance: 1b5139ef-315a-4a27-9ec4-32c148154072] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:32.689104 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c5dbc8e6-e091-46db-8a94-19a729def437 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:32.689104 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c5dbc8e6-e091-46db-8a94-19a729def437 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:32.690283 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c5dbc8e6-e091-46db-8a94-19a729def437 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:32.690915 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c5dbc8e6-e091-46db-8a94-19a729def437 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:32.822630 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c5dbc8e6-e091-46db-8a94-19a729def437 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01db629e453f41ff8debfefd155aa14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676a0384d9444d9d8e42073806728c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:32.833884 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c5dbc8e6-e091-46db-8a94-19a729def437 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5139ef-315a-4a27-9ec4-32c148154072" status: 200 len: 1275 microversion: 2.1 time: 0.161569 Apr 16 21:08:32.844548 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 217/456] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:32 2022] GET /compute/v2.1/servers/1b5139ef-315a-4a27-9ec4-32c148154072 => generated 1275 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:33.123616 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7ac56c56-3c6c-4fa0-9dd2-e8f7e12d9160 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:33.124256 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7ac56c56-3c6c-4fa0-9dd2-e8f7e12d9160 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] [instance: 8ee974a7-0d36-49bc-80f4-e269a3fa48bf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:33.132734 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ac56c56-3c6c-4fa0-9dd2-e8f7e12d9160 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:33.132734 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ac56c56-3c6c-4fa0-9dd2-e8f7e12d9160 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:33.133253 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ac56c56-3c6c-4fa0-9dd2-e8f7e12d9160 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:33.133697 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ac56c56-3c6c-4fa0-9dd2-e8f7e12d9160 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:33.263549 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7ac56c56-3c6c-4fa0-9dd2-e8f7e12d9160 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160e460966db4a7e8b697e26de50d0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487e280d7b014a7196cd1e4e9165cc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:33.270945 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7ac56c56-3c6c-4fa0-9dd2-e8f7e12d9160 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] 10.222.0.20 "GET /compute/v2.1/servers/8ee974a7-0d36-49bc-80f4-e269a3fa48bf" status: 200 len: 1322 microversion: 2.1 time: 0.156320 Apr 16 21:08:33.271513 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 240/457] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:33 2022] GET /compute/v2.1/servers/8ee974a7-0d36-49bc-80f4-e269a3fa48bf => generated 1322 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:33.425090 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d3a4d1c9-2fc6-4bf9-a0b7-fe4471751b5f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:33.427008 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d3a4d1c9-2fc6-4bf9-a0b7-fe4471751b5f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d06de5cf-0b6e-4546-b316-545265d6af2a] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:33.433696 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d3a4d1c9-2fc6-4bf9-a0b7-fe4471751b5f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:33.434296 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d3a4d1c9-2fc6-4bf9-a0b7-fe4471751b5f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:33.435255 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d3a4d1c9-2fc6-4bf9-a0b7-fe4471751b5f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:33.435867 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d3a4d1c9-2fc6-4bf9-a0b7-fe4471751b5f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:33.593465 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-7c4c3be1-7180-43f1-a521-21e3682c6c90 req-c0092023-b25e-41a1-92f3-eab9005ba6a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d06de5cf-0b6e-4546-b316-545265d6af2a", "tag": "808376f5-de15-494a-b722-a554d5c81386"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:33.609141 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-7c4c3be1-7180-43f1-a521-21e3682c6c90 req-c0092023-b25e-41a1-92f3-eab9005ba6a9 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:33.609656 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-7c4c3be1-7180-43f1-a521-21e3682c6c90 req-c0092023-b25e-41a1-92f3-eab9005ba6a9 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:33.621764 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-7c4c3be1-7180-43f1-a521-21e3682c6c90 req-c0092023-b25e-41a1-92f3-eab9005ba6a9 service nova] Creating event network-changed:808376f5-de15-494a-b722-a554d5c81386 for instance d06de5cf-0b6e-4546-b316-545265d6af2a on nch2-master-1 Apr 16 21:08:33.627141 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-7c4c3be1-7180-43f1-a521-21e3682c6c90 req-c0092023-b25e-41a1-92f3-eab9005ba6a9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038108 Apr 16 21:08:33.627729 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 241/458] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:08:33.698142 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d3a4d1c9-2fc6-4bf9-a0b7-fe4471751b5f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:33.707224 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d3a4d1c9-2fc6-4bf9-a0b7-fe4471751b5f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:33.708799 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d3a4d1c9-2fc6-4bf9-a0b7-fe4471751b5f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:33.710535 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d3a4d1c9-2fc6-4bf9-a0b7-fe4471751b5f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a" status: 200 len: 1567 microversion: 2.25 time: 0.294985 Apr 16 21:08:33.711403 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 218/459] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:08:33 2022] GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a => generated 1567 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:08:33.857523 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-788562f2-d935-4346-b093-3709cd9fc369 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:33.858226 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-788562f2-d935-4346-b093-3709cd9fc369 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] [instance: 1b5139ef-315a-4a27-9ec4-32c148154072] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:33.864345 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-788562f2-d935-4346-b093-3709cd9fc369 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:33.865006 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-788562f2-d935-4346-b093-3709cd9fc369 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:33.865837 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-788562f2-d935-4346-b093-3709cd9fc369 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:33.866288 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-788562f2-d935-4346-b093-3709cd9fc369 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:33.953644 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-788562f2-d935-4346-b093-3709cd9fc369 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01db629e453f41ff8debfefd155aa14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676a0384d9444d9d8e42073806728c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:33.966156 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-788562f2-d935-4346-b093-3709cd9fc369 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5139ef-315a-4a27-9ec4-32c148154072" status: 200 len: 1293 microversion: 2.1 time: 0.112219 Apr 16 21:08:33.967087 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 242/460] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:33 2022] GET /compute/v2.1/servers/1b5139ef-315a-4a27-9ec4-32c148154072 => generated 1293 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:34.289320 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d24cb221-d0e4-44bf-a1a0-be73dd007655 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:34.289932 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d24cb221-d0e4-44bf-a1a0-be73dd007655 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] [instance: 8ee974a7-0d36-49bc-80f4-e269a3fa48bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:34.295799 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d24cb221-d0e4-44bf-a1a0-be73dd007655 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:34.296298 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d24cb221-d0e4-44bf-a1a0-be73dd007655 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:34.297124 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d24cb221-d0e4-44bf-a1a0-be73dd007655 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:34.297574 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d24cb221-d0e4-44bf-a1a0-be73dd007655 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:34.512762 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-fd85e3d3-f2a5-4c76-b8dc-d1803378464b req-c8115503-aead-4b37-98ad-74c5b30154c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ee974a7-0d36-49bc-80f4-e269a3fa48bf", "name": "network-vif-plugged", "status": "completed", "tag": "73ab8831-7b70-423a-9fbd-e1e78b3be077"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:34.528227 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-fd85e3d3-f2a5-4c76-b8dc-d1803378464b req-c8115503-aead-4b37-98ad-74c5b30154c8 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:34.529581 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-fd85e3d3-f2a5-4c76-b8dc-d1803378464b req-c8115503-aead-4b37-98ad-74c5b30154c8 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:34.534209 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d24cb221-d0e4-44bf-a1a0-be73dd007655 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160e460966db4a7e8b697e26de50d0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487e280d7b014a7196cd1e4e9165cc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:34.546183 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d24cb221-d0e4-44bf-a1a0-be73dd007655 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] 10.222.0.20 "GET /compute/v2.1/servers/8ee974a7-0d36-49bc-80f4-e269a3fa48bf" status: 200 len: 1322 microversion: 2.1 time: 0.260818 Apr 16 21:08:34.549549 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 219/461] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:34 2022] GET /compute/v2.1/servers/8ee974a7-0d36-49bc-80f4-e269a3fa48bf => generated 1322 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:08:34.570165 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-fd85e3d3-f2a5-4c76-b8dc-d1803378464b req-c8115503-aead-4b37-98ad-74c5b30154c8 service nova] Creating event network-vif-plugged:73ab8831-7b70-423a-9fbd-e1e78b3be077 for instance 8ee974a7-0d36-49bc-80f4-e269a3fa48bf on nch1-master-1 Apr 16 21:08:34.576556 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-fd85e3d3-f2a5-4c76-b8dc-d1803378464b req-c8115503-aead-4b37-98ad-74c5b30154c8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068319 Apr 16 21:08:34.577991 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 243/462] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:08:34.730370 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b6587f78-5b1c-4f5b-b250-53b09e4b7ede tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:34.730992 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b6587f78-5b1c-4f5b-b250-53b09e4b7ede tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d06de5cf-0b6e-4546-b316-545265d6af2a] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:34.738162 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b6587f78-5b1c-4f5b-b250-53b09e4b7ede tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:34.742095 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b6587f78-5b1c-4f5b-b250-53b09e4b7ede tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:34.742095 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b6587f78-5b1c-4f5b-b250-53b09e4b7ede tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:34.744969 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b6587f78-5b1c-4f5b-b250-53b09e4b7ede tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:34.985581 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-88f83b1c-af47-4254-aadc-10d233c82498 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:34.986363 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-88f83b1c-af47-4254-aadc-10d233c82498 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] [instance: 1b5139ef-315a-4a27-9ec4-32c148154072] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:34.993660 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-88f83b1c-af47-4254-aadc-10d233c82498 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:34.994456 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-88f83b1c-af47-4254-aadc-10d233c82498 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:34.995432 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-88f83b1c-af47-4254-aadc-10d233c82498 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:34.996140 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-88f83b1c-af47-4254-aadc-10d233c82498 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:35.152877 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-88f83b1c-af47-4254-aadc-10d233c82498 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01db629e453f41ff8debfefd155aa14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676a0384d9444d9d8e42073806728c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:35.172569 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-88f83b1c-af47-4254-aadc-10d233c82498 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5139ef-315a-4a27-9ec4-32c148154072" status: 200 len: 1323 microversion: 2.1 time: 0.191609 Apr 16 21:08:35.185126 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 244/463] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:34 2022] GET /compute/v2.1/servers/1b5139ef-315a-4a27-9ec4-32c148154072 => generated 1323 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:08:35.315630 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b6587f78-5b1c-4f5b-b250-53b09e4b7ede tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:35.331435 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b6587f78-5b1c-4f5b-b250-53b09e4b7ede tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:35.337045 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b6587f78-5b1c-4f5b-b250-53b09e4b7ede tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:35.339254 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b6587f78-5b1c-4f5b-b250-53b09e4b7ede tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a" status: 200 len: 1567 microversion: 2.25 time: 0.613768 Apr 16 21:08:35.345026 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 220/464] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:08:34 2022] GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a => generated 1567 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:08:35.563454 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-412c6c1e-9962-4683-8486-f5d790c59ea0 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:35.564074 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-412c6c1e-9962-4683-8486-f5d790c59ea0 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] [instance: 8ee974a7-0d36-49bc-80f4-e269a3fa48bf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:35.571261 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-412c6c1e-9962-4683-8486-f5d790c59ea0 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:35.571728 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-412c6c1e-9962-4683-8486-f5d790c59ea0 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:35.572554 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-412c6c1e-9962-4683-8486-f5d790c59ea0 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:35.573008 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-412c6c1e-9962-4683-8486-f5d790c59ea0 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:35.797378 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-412c6c1e-9962-4683-8486-f5d790c59ea0 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160e460966db4a7e8b697e26de50d0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487e280d7b014a7196cd1e4e9165cc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:35.805658 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-412c6c1e-9962-4683-8486-f5d790c59ea0 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] 10.222.0.20 "GET /compute/v2.1/servers/8ee974a7-0d36-49bc-80f4-e269a3fa48bf" status: 200 len: 1322 microversion: 2.1 time: 0.245968 Apr 16 21:08:35.806399 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 245/465] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:35 2022] GET /compute/v2.1/servers/8ee974a7-0d36-49bc-80f4-e269a3fa48bf => generated 1322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:36.190796 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e9c5b7ee-d36d-4e93-bfeb-1fcefef1a7af tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:36.191381 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e9c5b7ee-d36d-4e93-bfeb-1fcefef1a7af tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] [instance: 1b5139ef-315a-4a27-9ec4-32c148154072] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:36.197998 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e9c5b7ee-d36d-4e93-bfeb-1fcefef1a7af tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:36.198387 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e9c5b7ee-d36d-4e93-bfeb-1fcefef1a7af tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:36.199198 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e9c5b7ee-d36d-4e93-bfeb-1fcefef1a7af tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:36.199686 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e9c5b7ee-d36d-4e93-bfeb-1fcefef1a7af tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:36.362062 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-07de9c18-59de-4e57-aff9-e73983639ca2 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:36.362062 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-07de9c18-59de-4e57-aff9-e73983639ca2 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d06de5cf-0b6e-4546-b316-545265d6af2a] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:36.368120 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-07de9c18-59de-4e57-aff9-e73983639ca2 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:36.368786 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-07de9c18-59de-4e57-aff9-e73983639ca2 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:36.370156 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-07de9c18-59de-4e57-aff9-e73983639ca2 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:36.370609 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-07de9c18-59de-4e57-aff9-e73983639ca2 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:36.512842 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e9c5b7ee-d36d-4e93-bfeb-1fcefef1a7af tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01db629e453f41ff8debfefd155aa14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676a0384d9444d9d8e42073806728c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:36.520507 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e9c5b7ee-d36d-4e93-bfeb-1fcefef1a7af tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5139ef-315a-4a27-9ec4-32c148154072" status: 200 len: 1323 microversion: 2.1 time: 0.333551 Apr 16 21:08:36.521085 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 221/466] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:36 2022] GET /compute/v2.1/servers/1b5139ef-315a-4a27-9ec4-32c148154072 => generated 1323 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:08:36.544487 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-07de9c18-59de-4e57-aff9-e73983639ca2 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:36.553895 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-07de9c18-59de-4e57-aff9-e73983639ca2 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:36.555404 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-07de9c18-59de-4e57-aff9-e73983639ca2 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:36.556838 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-07de9c18-59de-4e57-aff9-e73983639ca2 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a" status: 200 len: 1567 microversion: 2.25 time: 0.200843 Apr 16 21:08:36.557770 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 246/467] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:08:36 2022] GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a => generated 1567 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:08:36.822722 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a4107824-1ec4-478b-b1f3-1105403e6eb7 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:36.823656 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a4107824-1ec4-478b-b1f3-1105403e6eb7 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] [instance: 8ee974a7-0d36-49bc-80f4-e269a3fa48bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:36.829644 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a4107824-1ec4-478b-b1f3-1105403e6eb7 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:36.833186 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a4107824-1ec4-478b-b1f3-1105403e6eb7 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:36.833186 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a4107824-1ec4-478b-b1f3-1105403e6eb7 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:36.833186 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a4107824-1ec4-478b-b1f3-1105403e6eb7 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:36.978582 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a4107824-1ec4-478b-b1f3-1105403e6eb7 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160e460966db4a7e8b697e26de50d0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487e280d7b014a7196cd1e4e9165cc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:36.982020 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a4107824-1ec4-478b-b1f3-1105403e6eb7 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] 10.222.0.20 "GET /compute/v2.1/servers/8ee974a7-0d36-49bc-80f4-e269a3fa48bf" status: 200 len: 1322 microversion: 2.1 time: 0.163259 Apr 16 21:08:36.982583 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 222/468] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:36 2022] GET /compute/v2.1/servers/8ee974a7-0d36-49bc-80f4-e269a3fa48bf => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:37.538971 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-adc8a652-81fa-439e-9679-b9b564cc3197 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:37.540779 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-adc8a652-81fa-439e-9679-b9b564cc3197 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] [instance: 1b5139ef-315a-4a27-9ec4-32c148154072] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:37.548667 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-adc8a652-81fa-439e-9679-b9b564cc3197 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:37.549512 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-adc8a652-81fa-439e-9679-b9b564cc3197 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:37.551858 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-adc8a652-81fa-439e-9679-b9b564cc3197 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:37.553050 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-adc8a652-81fa-439e-9679-b9b564cc3197 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:37.669026 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e4f01ba5-f721-4d2b-8fb7-bcc0c1d2b8e1 tempest-HostsAdminNegativeTestJSON-959813078 tempest-HostsAdminNegativeTestJSON-959813078-project-admin] Calling method '.version_select at 0x7fbb96db7430>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:37.670892 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:37.670892 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:08:37.672347 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e4f01ba5-f721-4d2b-8fb7-bcc0c1d2b8e1 tempest-HostsAdminNegativeTestJSON-959813078 tempest-HostsAdminNegativeTestJSON-959813078-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:37.675332 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e4f01ba5-f721-4d2b-8fb7-bcc0c1d2b8e1 tempest-HostsAdminNegativeTestJSON-959813078 tempest-HostsAdminNegativeTestJSON-959813078-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:37.679428 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e4f01ba5-f721-4d2b-8fb7-bcc0c1d2b8e1 tempest-HostsAdminNegativeTestJSON-959813078 tempest-HostsAdminNegativeTestJSON-959813078-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:37.679428 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e4f01ba5-f721-4d2b-8fb7-bcc0c1d2b8e1 tempest-HostsAdminNegativeTestJSON-959813078 tempest-HostsAdminNegativeTestJSON-959813078-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:37.753672 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e4f01ba5-f721-4d2b-8fb7-bcc0c1d2b8e1 tempest-HostsAdminNegativeTestJSON-959813078 tempest-HostsAdminNegativeTestJSON-959813078-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.448935 Apr 16 21:08:37.760269 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 247/469] 10.222.0.20 () {58 vars in 1127 bytes} [Sat Apr 16 21:08:37 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:08:37.769763 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c55e26ff-a523-46d8-823f-d9a5c4c7d0e6 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:37.770647 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c55e26ff-a523-46d8-823f-d9a5c4c7d0e6 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d06de5cf-0b6e-4546-b316-545265d6af2a] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:37.781495 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c55e26ff-a523-46d8-823f-d9a5c4c7d0e6 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:37.783631 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c55e26ff-a523-46d8-823f-d9a5c4c7d0e6 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:37.786315 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c55e26ff-a523-46d8-823f-d9a5c4c7d0e6 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:37.793454 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c55e26ff-a523-46d8-823f-d9a5c4c7d0e6 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:37.886958 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-adc8a652-81fa-439e-9679-b9b564cc3197 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01db629e453f41ff8debfefd155aa14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676a0384d9444d9d8e42073806728c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:37.894977 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-adc8a652-81fa-439e-9679-b9b564cc3197 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5139ef-315a-4a27-9ec4-32c148154072" status: 200 len: 1323 microversion: 2.1 time: 0.361089 Apr 16 21:08:37.895554 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 223/470] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:37 2022] GET /compute/v2.1/servers/1b5139ef-315a-4a27-9ec4-32c148154072 => generated 1323 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:37.967732 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c55e26ff-a523-46d8-823f-d9a5c4c7d0e6 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:37.975838 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c55e26ff-a523-46d8-823f-d9a5c4c7d0e6 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:37.977578 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c55e26ff-a523-46d8-823f-d9a5c4c7d0e6 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:37.978908 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c55e26ff-a523-46d8-823f-d9a5c4c7d0e6 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a" status: 200 len: 1567 microversion: 2.25 time: 0.217366 Apr 16 21:08:37.980068 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 248/471] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:08:37 2022] GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a => generated 1567 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:08:38.136428 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-df4dc41b-5ea9-45fa-aa7a-817ac2914cd4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-87835421", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "8cfbbf93-9e15-4e76-bfe0-e69ff753f337"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:38.212475 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-df4dc41b-5ea9-45fa-aa7a-817ac2914cd4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] validate_networks() for [('8cfbbf93-9e15-4e76-bfe0-e69ff753f337', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:08:38.243635 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d816d4f6-6285-409b-b171-db785b02bd2c tempest-HostsAdminNegativeTestJSON-784215770 tempest-HostsAdminNegativeTestJSON-784215770-project] Calling method '.version_select at 0x7fbb96c77550>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:38.244818 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:38.244818 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:08:38.246159 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d816d4f6-6285-409b-b171-db785b02bd2c tempest-HostsAdminNegativeTestJSON-784215770 tempest-HostsAdminNegativeTestJSON-784215770-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '37e723e8a2684eb8bf262e19beaa3cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49279e0f7f4b04956c562ccf3c0515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:38.255662 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d816d4f6-6285-409b-b171-db785b02bd2c tempest-HostsAdminNegativeTestJSON-784215770 tempest-HostsAdminNegativeTestJSON-784215770-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:08:38.255662 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d816d4f6-6285-409b-b171-db785b02bd2c tempest-HostsAdminNegativeTestJSON-784215770 tempest-HostsAdminNegativeTestJSON-784215770-project] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.267664 Apr 16 21:08:38.255662 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 249/472] 10.222.0.20 () {58 vars in 1127 bytes} [Sat Apr 16 21:08:37 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 269 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:08:38.255662 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2d2fdf2c-4897-4fcf-8025-2ca509059f64 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:38.255662 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2d2fdf2c-4897-4fcf-8025-2ca509059f64 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] [instance: 8ee974a7-0d36-49bc-80f4-e269a3fa48bf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:38.262812 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2d2fdf2c-4897-4fcf-8025-2ca509059f64 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:38.263480 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2d2fdf2c-4897-4fcf-8025-2ca509059f64 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:38.265079 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2d2fdf2c-4897-4fcf-8025-2ca509059f64 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:38.265818 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2d2fdf2c-4897-4fcf-8025-2ca509059f64 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:38.484288 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2d2fdf2c-4897-4fcf-8025-2ca509059f64 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160e460966db4a7e8b697e26de50d0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487e280d7b014a7196cd1e4e9165cc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:38.493951 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2d2fdf2c-4897-4fcf-8025-2ca509059f64 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] 10.222.0.20 "GET /compute/v2.1/servers/8ee974a7-0d36-49bc-80f4-e269a3fa48bf" status: 200 len: 1322 microversion: 2.1 time: 0.243573 Apr 16 21:08:38.495072 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 250/473] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:38 2022] GET /compute/v2.1/servers/8ee974a7-0d36-49bc-80f4-e269a3fa48bf => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:38.501348 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1a17a504-a554-45a8-a962-9c8971d0a56e tempest-HostsAdminNegativeTestJSON-784215770 tempest-HostsAdminNegativeTestJSON-784215770-project] Calling method '.version_select at 0x7fbb96c77f70>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:38.507616 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:38.507616 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:08:38.509236 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1a17a504-a554-45a8-a962-9c8971d0a56e tempest-HostsAdminNegativeTestJSON-784215770 tempest-HostsAdminNegativeTestJSON-784215770-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '37e723e8a2684eb8bf262e19beaa3cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49279e0f7f4b04956c562ccf3c0515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:38.535263 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1a17a504-a554-45a8-a962-9c8971d0a56e tempest-HostsAdminNegativeTestJSON-784215770 tempest-HostsAdminNegativeTestJSON-784215770-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:08:38.535263 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1a17a504-a554-45a8-a962-9c8971d0a56e tempest-HostsAdminNegativeTestJSON-784215770 tempest-HostsAdminNegativeTestJSON-784215770-project] 10.222.0.20 "GET /compute/v2.1/os-hosts/ncdv-master-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.014851 Apr 16 21:08:38.535263 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 251/474] 10.222.0.20 () {58 vars in 1190 bytes} [Sat Apr 16 21:08:38 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/reboot => generated 111 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:08:38.570945 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-91c5217c-7cc7-4d81-939b-0fd24604e9cf tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] Calling method '.version_select at 0x7fbb96c1b700>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:38.648022 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-91c5217c-7cc7-4d81-939b-0fd24604e9cf tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/909824797d2f48ef902ea9b1bba09d76" status: 200 len: 371 microversion: 2.1 time: 0.135115 Apr 16 21:08:38.648627 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 252/475] 10.222.0.20 () {58 vars in 1241 bytes} [Sat Apr 16 21:08:38 2022] GET /compute/v2.1/os-quota-sets/909824797d2f48ef902ea9b1bba09d76 => generated 371 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:08:38.653994 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b8658f7e-a5d6-4463-a558-33dfdbf8a5c4 tempest-HostsAdminNegativeTestJSON-959813078 tempest-HostsAdminNegativeTestJSON-959813078-project-admin] Calling method '.version_select at 0x7fbb96c77dc0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:38.662438 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-b8658f7e-a5d6-4463-a558-33dfdbf8a5c4 tempest-HostsAdminNegativeTestJSON-959813078 tempest-HostsAdminNegativeTestJSON-959813078-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Apr 16 21:08:38.663044 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b8658f7e-a5d6-4463-a558-33dfdbf8a5c4 tempest-HostsAdminNegativeTestJSON-959813078 tempest-HostsAdminNegativeTestJSON-959813078-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:08:38.664131 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b8658f7e-a5d6-4463-a558-33dfdbf8a5c4 tempest-HostsAdminNegativeTestJSON-959813078 tempest-HostsAdminNegativeTestJSON-959813078-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.014595 Apr 16 21:08:38.664713 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 253/476] 10.222.0.20 () {58 vars in 1211 bytes} [Sat Apr 16 21:08:38 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:08:38.669839 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4351142e-b136-4e02-939f-2aa611447725 tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] Action: 'update', calling method: .version_select at 0x7fbb96dc7af0>, body: {"quota_set": {"ram": "5120"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:38.717436 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-df4dc41b-5ea9-45fa-aa7a-817ac2914cd4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:08:38.718063 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-df4dc41b-5ea9-45fa-aa7a-817ac2914cd4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:08:38.718558 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-df4dc41b-5ea9-45fa-aa7a-817ac2914cd4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:08:38.719028 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-df4dc41b-5ea9-45fa-aa7a-817ac2914cd4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:08:38.719598 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-df4dc41b-5ea9-45fa-aa7a-817ac2914cd4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:08:38.732873 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-df4dc41b-5ea9-45fa-aa7a-817ac2914cd4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:38.733447 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-df4dc41b-5ea9-45fa-aa7a-817ac2914cd4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:38.734789 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-df4dc41b-5ea9-45fa-aa7a-817ac2914cd4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:38.735453 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-df4dc41b-5ea9-45fa-aa7a-817ac2914cd4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:38.758138 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4351142e-b136-4e02-939f-2aa611447725 tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:38.758138 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4351142e-b136-4e02-939f-2aa611447725 tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:38.758138 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4351142e-b136-4e02-939f-2aa611447725 tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:38.758138 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4351142e-b136-4e02-939f-2aa611447725 tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:38.758545 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-df4dc41b-5ea9-45fa-aa7a-817ac2914cd4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Getting quotas for project b18530cc69c44e6f8a46ca966b3e3a7f. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:08:38.761991 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-df4dc41b-5ea9-45fa-aa7a-817ac2914cd4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Getting quotas for user 547d9f3aa3a54867971074b795d83b81 and project b18530cc69c44e6f8a46ca966b3e3a7f. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:08:38.790981 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-df4dc41b-5ea9-45fa-aa7a-817ac2914cd4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:08:38.794289 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-df4dc41b-5ea9-45fa-aa7a-817ac2914cd4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: e641f7ec-0d41-4439-bc77-7158fb9d346e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:08:39.044775 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4351142e-b136-4e02-939f-2aa611447725 tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/909824797d2f48ef902ea9b1bba09d76" status: 200 len: 328 microversion: 2.1 time: 0.378217 Apr 16 21:08:39.047906 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 254/477] 10.222.0.20 () {60 vars in 1261 bytes} [Sat Apr 16 21:08:38 2022] PUT /compute/v2.1/os-quota-sets/909824797d2f48ef902ea9b1bba09d76 => generated 328 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:08:39.051199 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-df4dc41b-5ea9-45fa-aa7a-817ac2914cd4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.136204 Apr 16 21:08:39.052646 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 224/478] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:08:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1156 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:08:39.054262 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-14d166ce-dda4-42e1-8a92-1007c6cce3f8 tempest-HostsAdminNegativeTestJSON-784215770 tempest-HostsAdminNegativeTestJSON-784215770-project] Calling method '.version_select at 0x7fbb96c1be50>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:39.055057 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:39.055057 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:08:39.056218 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-14d166ce-dda4-42e1-8a92-1007c6cce3f8 tempest-HostsAdminNegativeTestJSON-784215770 tempest-HostsAdminNegativeTestJSON-784215770-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '37e723e8a2684eb8bf262e19beaa3cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49279e0f7f4b04956c562ccf3c0515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:39.056868 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-14d166ce-dda4-42e1-8a92-1007c6cce3f8 tempest-HostsAdminNegativeTestJSON-784215770 tempest-HostsAdminNegativeTestJSON-784215770-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:08:39.057700 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-14d166ce-dda4-42e1-8a92-1007c6cce3f8 tempest-HostsAdminNegativeTestJSON-784215770 tempest-HostsAdminNegativeTestJSON-784215770-project] 10.222.0.20 "GET /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 109 microversion: 2.1 time: 0.008595 Apr 16 21:08:39.058215 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 255/479] 10.222.0.20 () {58 vars in 1169 bytes} [Sat Apr 16 21:08:39 2022] GET /compute/v2.1/os-hosts/ncdv-master-1 => generated 109 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:08:39.058599 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-73c928d2-58ef-445e-b405-3eedf1823ea7 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:39.059555 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-73c928d2-58ef-445e-b405-3eedf1823ea7 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] [instance: 1b5139ef-315a-4a27-9ec4-32c148154072] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:39.067064 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-73c928d2-58ef-445e-b405-3eedf1823ea7 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:39.067849 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-73c928d2-58ef-445e-b405-3eedf1823ea7 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:39.070759 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-73c928d2-58ef-445e-b405-3eedf1823ea7 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:39.070759 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-73c928d2-58ef-445e-b405-3eedf1823ea7 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:39.082810 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d5c6941c-5cc4-411d-a852-799c860b6f9f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:39.086046 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d5c6941c-5cc4-411d-a852-799c860b6f9f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d06de5cf-0b6e-4546-b316-545265d6af2a] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:39.136502 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d5c6941c-5cc4-411d-a852-799c860b6f9f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:39.137158 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d5c6941c-5cc4-411d-a852-799c860b6f9f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:39.141951 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d5c6941c-5cc4-411d-a852-799c860b6f9f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:39.143753 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d5c6941c-5cc4-411d-a852-799c860b6f9f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:39.364118 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-73c928d2-58ef-445e-b405-3eedf1823ea7 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01db629e453f41ff8debfefd155aa14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676a0384d9444d9d8e42073806728c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:39.377934 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-73c928d2-58ef-445e-b405-3eedf1823ea7 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5139ef-315a-4a27-9ec4-32c148154072" status: 200 len: 1323 microversion: 2.1 time: 0.324165 Apr 16 21:08:39.378525 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 225/480] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:39 2022] GET /compute/v2.1/servers/1b5139ef-315a-4a27-9ec4-32c148154072 => generated 1323 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:39.383066 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3189c00d-dfe7-493a-b682-76c44242954d tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:39.493185 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3189c00d-dfe7-493a-b682-76c44242954d tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-quota-sets/909824797d2f48ef902ea9b1bba09d76" status: 202 len: 0 microversion: 2.1 time: 0.113444 Apr 16 21:08:39.494095 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 226/481] 10.222.0.20 () {58 vars in 1244 bytes} [Sat Apr 16 21:08:39 2022] DELETE /compute/v2.1/os-quota-sets/909824797d2f48ef902ea9b1bba09d76 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:08:39.499747 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2c505415-c4ef-4001-8a14-02730091d841 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:39.506899 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2c505415-c4ef-4001-8a14-02730091d841 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: e641f7ec-0d41-4439-bc77-7158fb9d346e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:39.565598 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2c505415-c4ef-4001-8a14-02730091d841 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:39.573963 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2c505415-c4ef-4001-8a14-02730091d841 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e" status: 200 len: 1209 microversion: 2.1 time: 0.078595 Apr 16 21:08:39.583406 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 227/482] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:39 2022] GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e => generated 1209 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:39.586935 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b08719fa-2c3a-4a74-8778-a61600416923 tempest-HostsAdminNegativeTestJSON-959813078 tempest-HostsAdminNegativeTestJSON-959813078-project-admin] Calling method '.version_select at 0x7fbb96e649d0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:39.588126 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:39.588126 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:08:39.593376 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d5c6941c-5cc4-411d-a852-799c860b6f9f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:39.594886 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-b08719fa-2c3a-4a74-8778-a61600416923 tempest-HostsAdminNegativeTestJSON-959813078 tempest-HostsAdminNegativeTestJSON-959813078-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Apr 16 21:08:39.595496 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b08719fa-2c3a-4a74-8778-a61600416923 tempest-HostsAdminNegativeTestJSON-959813078 tempest-HostsAdminNegativeTestJSON-959813078-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:08:39.596711 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b08719fa-2c3a-4a74-8778-a61600416923 tempest-HostsAdminNegativeTestJSON-959813078 tempest-HostsAdminNegativeTestJSON-959813078-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.020437 Apr 16 21:08:39.597612 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 228/483] 10.222.0.20 () {58 vars in 1190 bytes} [Sat Apr 16 21:08:39 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:08:39.602844 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-20ae1887-6fec-4d9e-b5c8-4bbd61921b80 req-65ebc802-74c8-4dfe-a23f-83b388f02190 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b5139ef-315a-4a27-9ec4-32c148154072", "tag": "b2b1f926-26c2-4967-962d-9fcdd23eac15"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:39.609724 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d5c6941c-5cc4-411d-a852-799c860b6f9f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:39.611791 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d5c6941c-5cc4-411d-a852-799c860b6f9f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:39.613306 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d5c6941c-5cc4-411d-a852-799c860b6f9f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a" status: 200 len: 1567 microversion: 2.25 time: 0.554188 Apr 16 21:08:39.614551 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 256/484] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:08:39 2022] GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a => generated 1567 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:08:39.620410 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-09408752-4ed1-4594-85c9-94ca4e72cea7 tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] Calling method '.version_select at 0x7fbb96bd3550>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:39.630353 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-20ae1887-6fec-4d9e-b5c8-4bbd61921b80 req-65ebc802-74c8-4dfe-a23f-83b388f02190 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:39.630932 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-20ae1887-6fec-4d9e-b5c8-4bbd61921b80 req-65ebc802-74c8-4dfe-a23f-83b388f02190 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:39.645175 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-20ae1887-6fec-4d9e-b5c8-4bbd61921b80 req-65ebc802-74c8-4dfe-a23f-83b388f02190 service nova] Creating event network-changed:b2b1f926-26c2-4967-962d-9fcdd23eac15 for instance 1b5139ef-315a-4a27-9ec4-32c148154072 on nch1-master-1 Apr 16 21:08:39.651057 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-20ae1887-6fec-4d9e-b5c8-4bbd61921b80 req-65ebc802-74c8-4dfe-a23f-83b388f02190 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052199 Apr 16 21:08:39.651793 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 229/485] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:08:39.657950 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3f361fa4-51d9-4e3b-ac26-c5147a1b2ad1 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:39.658711 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3f361fa4-51d9-4e3b-ac26-c5147a1b2ad1 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] [instance: 8ee974a7-0d36-49bc-80f4-e269a3fa48bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:39.667280 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3f361fa4-51d9-4e3b-ac26-c5147a1b2ad1 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:39.668380 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3f361fa4-51d9-4e3b-ac26-c5147a1b2ad1 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:39.669555 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3f361fa4-51d9-4e3b-ac26-c5147a1b2ad1 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:39.670200 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3f361fa4-51d9-4e3b-ac26-c5147a1b2ad1 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:39.725979 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-09408752-4ed1-4594-85c9-94ca4e72cea7 tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/909824797d2f48ef902ea9b1bba09d76" status: 200 len: 371 microversion: 2.1 time: 0.106639 Apr 16 21:08:39.727050 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 257/486] 10.222.0.20 () {58 vars in 1241 bytes} [Sat Apr 16 21:08:39 2022] GET /compute/v2.1/os-quota-sets/909824797d2f48ef902ea9b1bba09d76 => generated 371 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:08:39.738454 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fc215883-90d0-4461-ba48-98247c87001f tempest-HostsAdminNegativeTestJSON-784215770 tempest-HostsAdminNegativeTestJSON-784215770-project] Calling method '.version_select at 0x7fbb96bdf3a0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:39.742497 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:39.742497 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:08:39.744488 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fc215883-90d0-4461-ba48-98247c87001f tempest-HostsAdminNegativeTestJSON-784215770 tempest-HostsAdminNegativeTestJSON-784215770-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '37e723e8a2684eb8bf262e19beaa3cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49279e0f7f4b04956c562ccf3c0515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:39.745275 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fc215883-90d0-4461-ba48-98247c87001f tempest-HostsAdminNegativeTestJSON-784215770 tempest-HostsAdminNegativeTestJSON-784215770-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:08:39.748413 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fc215883-90d0-4461-ba48-98247c87001f tempest-HostsAdminNegativeTestJSON-784215770 tempest-HostsAdminNegativeTestJSON-784215770-project] 10.222.0.20 "GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.020177 Apr 16 21:08:39.751147 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 258/487] 10.222.0.20 () {58 vars in 1196 bytes} [Sat Apr 16 21:08:39 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/shutdown => generated 113 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:08:39.768438 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-eac9f975-3645-4002-9651-173e5c52efd2 tempest-HostsAdminNegativeTestJSON-959813078 tempest-HostsAdminNegativeTestJSON-959813078-project-admin] Calling method '.version_select at 0x7fbb96bdfe50>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:39.798831 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-eac9f975-3645-4002-9651-173e5c52efd2 tempest-HostsAdminNegativeTestJSON-959813078 tempest-HostsAdminNegativeTestJSON-959813078-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Apr 16 21:08:39.799825 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-eac9f975-3645-4002-9651-173e5c52efd2 tempest-HostsAdminNegativeTestJSON-959813078 tempest-HostsAdminNegativeTestJSON-959813078-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:08:39.802712 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-eac9f975-3645-4002-9651-173e5c52efd2 tempest-HostsAdminNegativeTestJSON-959813078 tempest-HostsAdminNegativeTestJSON-959813078-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.044592 Apr 16 21:08:39.806756 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 259/488] 10.222.0.20 () {58 vars in 1217 bytes} [Sat Apr 16 21:08:39 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:08:39.815947 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c286f8aa-7dbe-4193-87d5-d3280017cce4 tempest-HostsAdminNegativeTestJSON-784215770 tempest-HostsAdminNegativeTestJSON-784215770-project] Calling method '.version_select at 0x7fbb96dfd160>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:39.817093 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:39.817093 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:08:39.818560 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c286f8aa-7dbe-4193-87d5-d3280017cce4 tempest-HostsAdminNegativeTestJSON-784215770 tempest-HostsAdminNegativeTestJSON-784215770-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '37e723e8a2684eb8bf262e19beaa3cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49279e0f7f4b04956c562ccf3c0515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:39.819469 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c286f8aa-7dbe-4193-87d5-d3280017cce4 tempest-HostsAdminNegativeTestJSON-784215770 tempest-HostsAdminNegativeTestJSON-784215770-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:08:39.820471 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c286f8aa-7dbe-4193-87d5-d3280017cce4 tempest-HostsAdminNegativeTestJSON-784215770 tempest-HostsAdminNegativeTestJSON-784215770-project] 10.222.0.20 "GET /compute/v2.1/os-hosts/ncdv-master-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.008414 Apr 16 21:08:39.822210 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 260/489] 10.222.0.20 () {58 vars in 1193 bytes} [Sat Apr 16 21:08:39 2022] GET /compute/v2.1/os-hosts/ncdv-master-1/startup => generated 110 bytes in 11 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:08:39.831821 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a3df1622-b204-47d8-86e4-20fd7a0bd8db tempest-HostsAdminNegativeTestJSON-959813078 tempest-HostsAdminNegativeTestJSON-959813078-project-admin] Calling method '.version_select at 0x7fbb96c5a5e0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:39.850326 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-a3df1622-b204-47d8-86e4-20fd7a0bd8db tempest-HostsAdminNegativeTestJSON-959813078 tempest-HostsAdminNegativeTestJSON-959813078-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Apr 16 21:08:39.851425 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a3df1622-b204-47d8-86e4-20fd7a0bd8db tempest-HostsAdminNegativeTestJSON-959813078 tempest-HostsAdminNegativeTestJSON-959813078-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:08:39.853246 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a3df1622-b204-47d8-86e4-20fd7a0bd8db tempest-HostsAdminNegativeTestJSON-959813078 tempest-HostsAdminNegativeTestJSON-959813078-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.025619 Apr 16 21:08:39.854394 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 261/490] 10.222.0.20 () {58 vars in 1214 bytes} [Sat Apr 16 21:08:39 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:08:39.868763 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a4c6edf5-8563-4000-86d4-00b585305d11 tempest-HostsAdminNegativeTestJSON-959813078 tempest-HostsAdminNegativeTestJSON-959813078-project-admin] Action: 'update', calling method: .version_select at 0x7fbb96dfd1f0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:39.871001 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a4c6edf5-8563-4000-86d4-00b585305d11 tempest-HostsAdminNegativeTestJSON-959813078 tempest-HostsAdminNegativeTestJSON-959813078-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:08:39.871946 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a4c6edf5-8563-4000-86d4-00b585305d11 tempest-HostsAdminNegativeTestJSON-959813078 tempest-HostsAdminNegativeTestJSON-959813078-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 199 microversion: 2.1 time: 0.009078 Apr 16 21:08:39.874167 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 262/491] 10.222.0.20 () {60 vars in 1189 bytes} [Sat Apr 16 21:08:39 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 199 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:08:39.885758 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0f94f814-5ead-4766-8cc4-a21b1251e3e2 tempest-HostsAdminNegativeTestJSON-959813078 tempest-HostsAdminNegativeTestJSON-959813078-project-admin] Action: 'update', calling method: .version_select at 0x7fbb96bdf160>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:39.887521 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0f94f814-5ead-4766-8cc4-a21b1251e3e2 tempest-HostsAdminNegativeTestJSON-959813078 tempest-HostsAdminNegativeTestJSON-959813078-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:08:39.909605 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0f94f814-5ead-4766-8cc4-a21b1251e3e2 tempest-HostsAdminNegativeTestJSON-959813078 tempest-HostsAdminNegativeTestJSON-959813078-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 189 microversion: 2.1 time: 0.027940 Apr 16 21:08:39.910791 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 263/492] 10.222.0.20 () {60 vars in 1189 bytes} [Sat Apr 16 21:08:39 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 189 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:08:39.921837 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1959b5cd-f31b-48d6-8132-79edae423b1e tempest-HostsAdminNegativeTestJSON-784215770 tempest-HostsAdminNegativeTestJSON-784215770-project] Action: 'update', calling method: .version_select at 0x7fbb96bdf160>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:39.924451 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:39.924451 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:08:39.925926 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1959b5cd-f31b-48d6-8132-79edae423b1e tempest-HostsAdminNegativeTestJSON-784215770 tempest-HostsAdminNegativeTestJSON-784215770-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '37e723e8a2684eb8bf262e19beaa3cbb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c49279e0f7f4b04956c562ccf3c0515', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:39.927026 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1959b5cd-f31b-48d6-8132-79edae423b1e tempest-HostsAdminNegativeTestJSON-784215770 tempest-HostsAdminNegativeTestJSON-784215770-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:08:39.928027 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1959b5cd-f31b-48d6-8132-79edae423b1e tempest-HostsAdminNegativeTestJSON-784215770 tempest-HostsAdminNegativeTestJSON-784215770-project] 10.222.0.20 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 403 len: 111 microversion: 2.1 time: 0.011175 Apr 16 21:08:39.929088 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 264/493] 10.222.0.20 () {60 vars in 1189 bytes} [Sat Apr 16 21:08:39 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 111 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:08:39.949618 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-41a38821-a0bc-4fca-b441-940c393c8a84 tempest-HostsAdminNegativeTestJSON-959813078 tempest-HostsAdminNegativeTestJSON-959813078-project-admin] Action: 'update', calling method: .version_select at 0x7fbb96c5a670>, body: {"status": null, "maintenance_mode": null} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:39.953580 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-41a38821-a0bc-4fca-b441-940c393c8a84 tempest-HostsAdminNegativeTestJSON-959813078 tempest-HostsAdminNegativeTestJSON-959813078-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:08:39.954761 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-41a38821-a0bc-4fca-b441-940c393c8a84 tempest-HostsAdminNegativeTestJSON-959813078 tempest-HostsAdminNegativeTestJSON-959813078-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-hosts/ncdv-master-1" status: 400 len: 127 microversion: 2.1 time: 0.020383 Apr 16 21:08:39.955816 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 265/494] 10.222.0.20 () {60 vars in 1189 bytes} [Sat Apr 16 21:08:39 2022] PUT /compute/v2.1/os-hosts/ncdv-master-1 => generated 127 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 16 21:08:39.973657 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a19637fb-7a2a-49ce-b970-d5b0b7c43616 tempest-HostsAdminNegativeTestJSON-959813078 tempest-HostsAdminNegativeTestJSON-959813078-project-admin] Action: 'update', calling method: .version_select at 0x7fbb96c1b700>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:39.981975 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.hosts [None req-a19637fb-7a2a-49ce-b970-d5b0b7c43616 tempest-HostsAdminNegativeTestJSON-959813078 tempest-HostsAdminNegativeTestJSON-959813078-project-admin] Enabling host nonexistent_hostname. Apr 16 21:08:39.998959 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-a19637fb-7a2a-49ce-b970-d5b0b7c43616 tempest-HostsAdminNegativeTestJSON-959813078 tempest-HostsAdminNegativeTestJSON-959813078-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Apr 16 21:08:39.999773 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a19637fb-7a2a-49ce-b970-d5b0b7c43616 tempest-HostsAdminNegativeTestJSON-959813078 tempest-HostsAdminNegativeTestJSON-959813078-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:08:40.000822 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a19637fb-7a2a-49ce-b970-d5b0b7c43616 tempest-HostsAdminNegativeTestJSON-959813078 tempest-HostsAdminNegativeTestJSON-959813078-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.034894 Apr 16 21:08:40.003285 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 266/495] 10.222.0.20 () {60 vars in 1210 bytes} [Sat Apr 16 21:08:39 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:08:40.025194 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3f361fa4-51d9-4e3b-ac26-c5147a1b2ad1 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160e460966db4a7e8b697e26de50d0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487e280d7b014a7196cd1e4e9165cc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:40.036490 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3f361fa4-51d9-4e3b-ac26-c5147a1b2ad1 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] 10.222.0.20 "GET /compute/v2.1/servers/8ee974a7-0d36-49bc-80f4-e269a3fa48bf" status: 200 len: 1472 microversion: 2.1 time: 0.382343 Apr 16 21:08:40.040165 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 230/496] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:39 2022] GET /compute/v2.1/servers/8ee974a7-0d36-49bc-80f4-e269a3fa48bf => generated 1472 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:40.057633 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-efbbc241-e393-4cca-86cb-360f48fb5291 tempest-ServersAdminNegativeTestJSON-2107380563 tempest-ServersAdminNegativeTestJSON-2107380563-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:40.058726 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-efbbc241-e393-4cca-86cb-360f48fb5291 tempest-ServersAdminNegativeTestJSON-2107380563 tempest-ServersAdminNegativeTestJSON-2107380563-project-admin] [instance: 8ee974a7-0d36-49bc-80f4-e269a3fa48bf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:40.066452 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-efbbc241-e393-4cca-86cb-360f48fb5291 tempest-ServersAdminNegativeTestJSON-2107380563 tempest-ServersAdminNegativeTestJSON-2107380563-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:40.067304 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-efbbc241-e393-4cca-86cb-360f48fb5291 tempest-ServersAdminNegativeTestJSON-2107380563 tempest-ServersAdminNegativeTestJSON-2107380563-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:40.069832 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-efbbc241-e393-4cca-86cb-360f48fb5291 tempest-ServersAdminNegativeTestJSON-2107380563 tempest-ServersAdminNegativeTestJSON-2107380563-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:40.070534 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-efbbc241-e393-4cca-86cb-360f48fb5291 tempest-ServersAdminNegativeTestJSON-2107380563 tempest-ServersAdminNegativeTestJSON-2107380563-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:40.099052 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-efbbc241-e393-4cca-86cb-360f48fb5291 tempest-ServersAdminNegativeTestJSON-2107380563 tempest-ServersAdminNegativeTestJSON-2107380563-project-admin] Lazy-loading 'flavor' on Instance uuid 8ee974a7-0d36-49bc-80f4-e269a3fa48bf {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:08:40.163596 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c00da3f5-82d2-43b5-9457-2ab0d7bd6b9d tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] Calling method '.version_select at 0x7fbb96e0c310>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:40.422073 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-efbbc241-e393-4cca-86cb-360f48fb5291 tempest-ServersAdminNegativeTestJSON-2107380563 tempest-ServersAdminNegativeTestJSON-2107380563-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/8ee974a7-0d36-49bc-80f4-e269a3fa48bf/action" status: 202 len: 0 microversion: 2.1 time: 0.367713 Apr 16 21:08:40.426118 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 267/497] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:08:40 2022] POST /compute/v2.1/servers/8ee974a7-0d36-49bc-80f4-e269a3fa48bf/action => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:08:40.434313 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cd6040cb-4a36-4db0-b34b-2c6512a7a6c4 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:40.435360 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cd6040cb-4a36-4db0-b34b-2c6512a7a6c4 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] [instance: 1b5139ef-315a-4a27-9ec4-32c148154072] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:40.442704 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cd6040cb-4a36-4db0-b34b-2c6512a7a6c4 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:40.444019 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cd6040cb-4a36-4db0-b34b-2c6512a7a6c4 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:40.445012 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cd6040cb-4a36-4db0-b34b-2c6512a7a6c4 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:40.446972 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cd6040cb-4a36-4db0-b34b-2c6512a7a6c4 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:40.582352 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c00da3f5-82d2-43b5-9457-2ab0d7bd6b9d tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/a9468034a829404fb7c576272db2343c/defaults" status: 200 len: 371 microversion: 2.1 time: 0.422693 Apr 16 21:08:40.583312 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 231/498] 10.222.0.20 () {58 vars in 1268 bytes} [Sat Apr 16 21:08:40 2022] GET /compute/v2.1/os-quota-sets/a9468034a829404fb7c576272db2343c/defaults => generated 371 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:08:40.595378 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3ae3c28c-4f64-4267-b575-21bfaf366684 tempest-ServersAdminNegativeTestJSON-2107380563 tempest-ServersAdminNegativeTestJSON-2107380563-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:40.597616 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3ae3c28c-4f64-4267-b575-21bfaf366684 tempest-ServersAdminNegativeTestJSON-2107380563 tempest-ServersAdminNegativeTestJSON-2107380563-project-admin] [instance: 8ee974a7-0d36-49bc-80f4-e269a3fa48bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:40.607974 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3ae3c28c-4f64-4267-b575-21bfaf366684 tempest-ServersAdminNegativeTestJSON-2107380563 tempest-ServersAdminNegativeTestJSON-2107380563-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:40.610538 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3ae3c28c-4f64-4267-b575-21bfaf366684 tempest-ServersAdminNegativeTestJSON-2107380563 tempest-ServersAdminNegativeTestJSON-2107380563-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:40.611782 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3ae3c28c-4f64-4267-b575-21bfaf366684 tempest-ServersAdminNegativeTestJSON-2107380563 tempest-ServersAdminNegativeTestJSON-2107380563-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:40.612557 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3ae3c28c-4f64-4267-b575-21bfaf366684 tempest-ServersAdminNegativeTestJSON-2107380563 tempest-ServersAdminNegativeTestJSON-2107380563-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:41.012849 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cd6040cb-4a36-4db0-b34b-2c6512a7a6c4 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01db629e453f41ff8debfefd155aa14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676a0384d9444d9d8e42073806728c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:41.042667 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cd6040cb-4a36-4db0-b34b-2c6512a7a6c4 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5139ef-315a-4a27-9ec4-32c148154072" status: 200 len: 1323 microversion: 2.1 time: 0.599066 Apr 16 21:08:41.044108 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 268/499] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:40 2022] GET /compute/v2.1/servers/1b5139ef-315a-4a27-9ec4-32c148154072 => generated 1323 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:41.074083 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-25be4860-d587-49f4-a0ec-a5147f63e8c8 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:41.079432 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-25be4860-d587-49f4-a0ec-a5147f63e8c8 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: e641f7ec-0d41-4439-bc77-7158fb9d346e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:41.097941 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-25be4860-d587-49f4-a0ec-a5147f63e8c8 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:41.097941 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-25be4860-d587-49f4-a0ec-a5147f63e8c8 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:41.098654 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-25be4860-d587-49f4-a0ec-a5147f63e8c8 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:41.103058 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-25be4860-d587-49f4-a0ec-a5147f63e8c8 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:41.262056 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-25be4860-d587-49f4-a0ec-a5147f63e8c8 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:41.270891 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-25be4860-d587-49f4-a0ec-a5147f63e8c8 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e" status: 200 len: 1213 microversion: 2.1 time: 0.225598 Apr 16 21:08:41.280863 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 269/500] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:41 2022] GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e => generated 1213 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:41.285984 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6d78c5e0-2a58-4f3d-b681-557cd609dc0d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:41.287841 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6d78c5e0-2a58-4f3d-b681-557cd609dc0d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d06de5cf-0b6e-4546-b316-545265d6af2a] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:41.310302 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6d78c5e0-2a58-4f3d-b681-557cd609dc0d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:41.310754 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6d78c5e0-2a58-4f3d-b681-557cd609dc0d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:41.311734 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6d78c5e0-2a58-4f3d-b681-557cd609dc0d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:41.312210 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6d78c5e0-2a58-4f3d-b681-557cd609dc0d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:41.357250 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3ae3c28c-4f64-4267-b575-21bfaf366684 tempest-ServersAdminNegativeTestJSON-2107380563 tempest-ServersAdminNegativeTestJSON-2107380563-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/8ee974a7-0d36-49bc-80f4-e269a3fa48bf" status: 200 len: 1631 microversion: 2.1 time: 0.772357 Apr 16 21:08:41.357835 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 232/501] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:40 2022] GET /compute/v2.1/servers/8ee974a7-0d36-49bc-80f4-e269a3fa48bf => generated 1631 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:41.364257 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cb747b14-dc95-4278-a38b-a30fb29e0f7a tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] Action: 'update', calling method: .version_select at 0x7fbb96f0f550>, body: {"quota_set": {"ram": "5120"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:41.504557 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cb747b14-dc95-4278-a38b-a30fb29e0f7a tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:41.505005 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cb747b14-dc95-4278-a38b-a30fb29e0f7a tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:41.506331 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cb747b14-dc95-4278-a38b-a30fb29e0f7a tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:41.506770 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cb747b14-dc95-4278-a38b-a30fb29e0f7a tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:41.610415 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6d78c5e0-2a58-4f3d-b681-557cd609dc0d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:41.618609 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6d78c5e0-2a58-4f3d-b681-557cd609dc0d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:41.620146 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6d78c5e0-2a58-4f3d-b681-557cd609dc0d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:41.621784 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6d78c5e0-2a58-4f3d-b681-557cd609dc0d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a" status: 200 len: 1567 microversion: 2.25 time: 0.339670 Apr 16 21:08:41.622544 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 270/502] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:08:41 2022] GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a => generated 1567 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:08:41.697321 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cb747b14-dc95-4278-a38b-a30fb29e0f7a tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/6ed775fb93b64f20b4dc8806cfbabf2a" status: 200 len: 328 microversion: 2.1 time: 0.338246 Apr 16 21:08:41.698601 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 233/503] 10.222.0.20 () {60 vars in 1261 bytes} [Sat Apr 16 21:08:41 2022] PUT /compute/v2.1/os-quota-sets/6ed775fb93b64f20b4dc8806cfbabf2a => generated 328 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:08:41.709722 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1e015bba-f4c9-4d69-8b2a-ba237a5a509a tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] Calling method '.version_select at 0x7fbb96bdf280>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:41.785285 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1e015bba-f4c9-4d69-8b2a-ba237a5a509a tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:41.785972 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1e015bba-f4c9-4d69-8b2a-ba237a5a509a tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:41.787114 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1e015bba-f4c9-4d69-8b2a-ba237a5a509a tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:41.787750 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1e015bba-f4c9-4d69-8b2a-ba237a5a509a tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:41.808757 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1e015bba-f4c9-4d69-8b2a-ba237a5a509a tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/6ed775fb93b64f20b4dc8806cfbabf2a/detail" status: 200 len: 916 microversion: 2.1 time: 0.103364 Apr 16 21:08:41.809897 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 271/504] 10.222.0.20 () {58 vars in 1262 bytes} [Sat Apr 16 21:08:41 2022] GET /compute/v2.1/os-quota-sets/6ed775fb93b64f20b4dc8806cfbabf2a/detail => generated 916 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:08:42.059677 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f6d1bb96-b770-4186-a0c2-47fc6e774de0 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:42.060422 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f6d1bb96-b770-4186-a0c2-47fc6e774de0 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] [instance: 1b5139ef-315a-4a27-9ec4-32c148154072] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:42.069627 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f6d1bb96-b770-4186-a0c2-47fc6e774de0 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:42.074032 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f6d1bb96-b770-4186-a0c2-47fc6e774de0 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:42.074032 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f6d1bb96-b770-4186-a0c2-47fc6e774de0 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:42.074032 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f6d1bb96-b770-4186-a0c2-47fc6e774de0 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:42.168582 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d45e16da-802b-4e1c-b00b-1296b4a2ccf6 tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] Action: 'update', calling method: .version_select at 0x7fbb96c214c0>, body: {"quota_set": {"ram": "2048"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:42.266941 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d45e16da-802b-4e1c-b00b-1296b4a2ccf6 tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:42.268883 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d45e16da-802b-4e1c-b00b-1296b4a2ccf6 tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:42.270073 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d45e16da-802b-4e1c-b00b-1296b4a2ccf6 tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:42.270709 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d45e16da-802b-4e1c-b00b-1296b4a2ccf6 tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:42.334838 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d45e16da-802b-4e1c-b00b-1296b4a2ccf6 tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:42.335290 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d45e16da-802b-4e1c-b00b-1296b4a2ccf6 tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:42.353402 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d45e16da-802b-4e1c-b00b-1296b4a2ccf6 tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:42.353868 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d45e16da-802b-4e1c-b00b-1296b4a2ccf6 tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:42.474716 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f6d1bb96-b770-4186-a0c2-47fc6e774de0 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01db629e453f41ff8debfefd155aa14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676a0384d9444d9d8e42073806728c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:42.483908 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f6d1bb96-b770-4186-a0c2-47fc6e774de0 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5139ef-315a-4a27-9ec4-32c148154072" status: 200 len: 1323 microversion: 2.1 time: 0.428236 Apr 16 21:08:42.489627 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 234/505] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:42 2022] GET /compute/v2.1/servers/1b5139ef-315a-4a27-9ec4-32c148154072 => generated 1323 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:42.498864 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-31336985-4a04-424b-90a7-c3f5f5016f19 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:42.499656 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-31336985-4a04-424b-90a7-c3f5f5016f19 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: e641f7ec-0d41-4439-bc77-7158fb9d346e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:42.515995 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-31336985-4a04-424b-90a7-c3f5f5016f19 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:42.516502 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-31336985-4a04-424b-90a7-c3f5f5016f19 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:42.517295 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-31336985-4a04-424b-90a7-c3f5f5016f19 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:42.517908 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-31336985-4a04-424b-90a7-c3f5f5016f19 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:42.592319 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d45e16da-802b-4e1c-b00b-1296b4a2ccf6 tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/6ed775fb93b64f20b4dc8806cfbabf2a?user_id=53050a22639f4b1fa6be86a2cd722488" status: 200 len: 328 microversion: 2.1 time: 0.429740 Apr 16 21:08:42.595435 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 272/506] 10.222.0.20 () {60 vars in 1342 bytes} [Sat Apr 16 21:08:42 2022] PUT /compute/v2.1/os-quota-sets/6ed775fb93b64f20b4dc8806cfbabf2a?user_id=53050a22639f4b1fa6be86a2cd722488 => generated 328 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:08:42.608590 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2c938cbf-7239-402b-9a26-5172b021fe6d tempest-ServersAdminNegativeTestJSON-2107380563 tempest-ServersAdminNegativeTestJSON-2107380563-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:42.609218 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2c938cbf-7239-402b-9a26-5172b021fe6d tempest-ServersAdminNegativeTestJSON-2107380563 tempest-ServersAdminNegativeTestJSON-2107380563-project-admin] [instance: 8ee974a7-0d36-49bc-80f4-e269a3fa48bf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:42.627989 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2c938cbf-7239-402b-9a26-5172b021fe6d tempest-ServersAdminNegativeTestJSON-2107380563 tempest-ServersAdminNegativeTestJSON-2107380563-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:42.630095 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2c938cbf-7239-402b-9a26-5172b021fe6d tempest-ServersAdminNegativeTestJSON-2107380563 tempest-ServersAdminNegativeTestJSON-2107380563-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:42.631400 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2c938cbf-7239-402b-9a26-5172b021fe6d tempest-ServersAdminNegativeTestJSON-2107380563 tempest-ServersAdminNegativeTestJSON-2107380563-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:42.632274 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2c938cbf-7239-402b-9a26-5172b021fe6d tempest-ServersAdminNegativeTestJSON-2107380563 tempest-ServersAdminNegativeTestJSON-2107380563-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:42.681764 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-31336985-4a04-424b-90a7-c3f5f5016f19 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:42.701320 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-31336985-4a04-424b-90a7-c3f5f5016f19 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e" status: 200 len: 1205 microversion: 2.1 time: 0.198431 Apr 16 21:08:42.701320 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 235/507] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:42 2022] GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e => generated 1205 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:42.706104 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d7a8a07c-eb3a-46db-8ab5-91829d80f099 tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] Calling method '.version_select at 0x7fbb9ccb9b80>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:42.940720 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2c938cbf-7239-402b-9a26-5172b021fe6d tempest-ServersAdminNegativeTestJSON-2107380563 tempest-ServersAdminNegativeTestJSON-2107380563-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/8ee974a7-0d36-49bc-80f4-e269a3fa48bf" status: 200 len: 1614 microversion: 2.1 time: 0.344120 Apr 16 21:08:42.944487 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 273/508] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:42 2022] GET /compute/v2.1/servers/8ee974a7-0d36-49bc-80f4-e269a3fa48bf => generated 1614 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:42.949832 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-81c1224f-2a7b-4c5a-aab6-6b78bd9e9d1a tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:42.950691 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-81c1224f-2a7b-4c5a-aab6-6b78bd9e9d1a tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d06de5cf-0b6e-4546-b316-545265d6af2a] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:42.982345 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-81c1224f-2a7b-4c5a-aab6-6b78bd9e9d1a tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:42.983143 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-81c1224f-2a7b-4c5a-aab6-6b78bd9e9d1a tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:42.984428 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-81c1224f-2a7b-4c5a-aab6-6b78bd9e9d1a tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:42.986122 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-81c1224f-2a7b-4c5a-aab6-6b78bd9e9d1a tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:43.148244 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d7a8a07c-eb3a-46db-8ab5-91829d80f099 tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/6ed775fb93b64f20b4dc8806cfbabf2a?user_id=53050a22639f4b1fa6be86a2cd722488" status: 200 len: 370 microversion: 2.1 time: 0.449564 Apr 16 21:08:43.148244 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 236/509] 10.222.0.20 () {58 vars in 1322 bytes} [Sat Apr 16 21:08:42 2022] GET /compute/v2.1/os-quota-sets/6ed775fb93b64f20b4dc8806cfbabf2a?user_id=53050a22639f4b1fa6be86a2cd722488 => generated 370 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:08:43.156401 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a1e66588-68b1-4068-b431-a86b20f9466c tempest-ServersAdminNegativeTestJSON-2107380563 tempest-ServersAdminNegativeTestJSON-2107380563-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:43.158628 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a1e66588-68b1-4068-b431-a86b20f9466c tempest-ServersAdminNegativeTestJSON-2107380563 tempest-ServersAdminNegativeTestJSON-2107380563-project-admin] [instance: 8ee974a7-0d36-49bc-80f4-e269a3fa48bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:43.170566 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a1e66588-68b1-4068-b431-a86b20f9466c tempest-ServersAdminNegativeTestJSON-2107380563 tempest-ServersAdminNegativeTestJSON-2107380563-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:43.171282 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a1e66588-68b1-4068-b431-a86b20f9466c tempest-ServersAdminNegativeTestJSON-2107380563 tempest-ServersAdminNegativeTestJSON-2107380563-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:43.178921 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a1e66588-68b1-4068-b431-a86b20f9466c tempest-ServersAdminNegativeTestJSON-2107380563 tempest-ServersAdminNegativeTestJSON-2107380563-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:43.178921 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a1e66588-68b1-4068-b431-a86b20f9466c tempest-ServersAdminNegativeTestJSON-2107380563 tempest-ServersAdminNegativeTestJSON-2107380563-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:43.340564 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-a1e66588-68b1-4068-b431-a86b20f9466c tempest-ServersAdminNegativeTestJSON-2107380563 tempest-ServersAdminNegativeTestJSON-2107380563-project-admin] HTTP exception thrown: Cannot 'migrate' instance 8ee974a7-0d36-49bc-80f4-e269a3fa48bf while it is in vm_state suspended Apr 16 21:08:43.344438 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a1e66588-68b1-4068-b431-a86b20f9466c tempest-ServersAdminNegativeTestJSON-2107380563 tempest-ServersAdminNegativeTestJSON-2107380563-project-admin] Returning 409 to user: Cannot 'migrate' instance 8ee974a7-0d36-49bc-80f4-e269a3fa48bf while it is in vm_state suspended {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:08:43.350377 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a1e66588-68b1-4068-b431-a86b20f9466c tempest-ServersAdminNegativeTestJSON-2107380563 tempest-ServersAdminNegativeTestJSON-2107380563-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/8ee974a7-0d36-49bc-80f4-e269a3fa48bf/action" status: 409 len: 148 microversion: 2.1 time: 0.207526 Apr 16 21:08:43.351324 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 237/510] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:08:43 2022] POST /compute/v2.1/servers/8ee974a7-0d36-49bc-80f4-e269a3fa48bf/action => generated 148 bytes in 209 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:08:43.368675 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7806140e-394d-4fad-9cb1-7fddc201f1f7 tempest-ServersAdminNegativeTestJSON-2107380563 tempest-ServersAdminNegativeTestJSON-2107380563-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:43.372819 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7806140e-394d-4fad-9cb1-7fddc201f1f7 tempest-ServersAdminNegativeTestJSON-2107380563 tempest-ServersAdminNegativeTestJSON-2107380563-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:08:43.372819 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7806140e-394d-4fad-9cb1-7fddc201f1f7 tempest-ServersAdminNegativeTestJSON-2107380563 tempest-ServersAdminNegativeTestJSON-2107380563-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/84fdd641-4d23-472a-8b8f-fded89dbcc32/action" status: 400 len: 144 microversion: 2.1 time: 0.012086 Apr 16 21:08:43.373043 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 238/511] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:08:43 2022] POST /compute/v2.1/servers/84fdd641-4d23-472a-8b8f-fded89dbcc32/action => generated 144 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:08:43.382801 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2ad8bbbf-96cc-4e77-bc10-b653cc20f0f3 tempest-ServersAdminNegativeTestJSON-2107380563 tempest-ServersAdminNegativeTestJSON-2107380563-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:43.390163 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2ad8bbbf-96cc-4e77-bc10-b653cc20f0f3 tempest-ServersAdminNegativeTestJSON-2107380563 tempest-ServersAdminNegativeTestJSON-2107380563-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:08:43.392279 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2ad8bbbf-96cc-4e77-bc10-b653cc20f0f3 tempest-ServersAdminNegativeTestJSON-2107380563 tempest-ServersAdminNegativeTestJSON-2107380563-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/84fdd641-4d23-472a-8b8f-fded89dbcc32/action" status: 400 len: 120 microversion: 2.1 time: 0.014529 Apr 16 21:08:43.393641 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 239/512] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:08:43 2022] POST /compute/v2.1/servers/84fdd641-4d23-472a-8b8f-fded89dbcc32/action => generated 120 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:08:43.461691 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3db3753a-b9ea-40a2-a9c1-9b3d4aaa6ce8 tempest-ServersAdminNegativeTestJSON-2107380563 tempest-ServersAdminNegativeTestJSON-2107380563-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:43.466538 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3db3753a-b9ea-40a2-a9c1-9b3d4aaa6ce8 tempest-ServersAdminNegativeTestJSON-2107380563 tempest-ServersAdminNegativeTestJSON-2107380563-project-admin] Failed to fetch instance by id 999 {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2924}} Apr 16 21:08:43.468898 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-3db3753a-b9ea-40a2-a9c1-9b3d4aaa6ce8 tempest-ServersAdminNegativeTestJSON-2107380563 tempest-ServersAdminNegativeTestJSON-2107380563-project-admin] HTTP exception thrown: Instance 999 could not be found. Apr 16 21:08:43.470817 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3db3753a-b9ea-40a2-a9c1-9b3d4aaa6ce8 tempest-ServersAdminNegativeTestJSON-2107380563 tempest-ServersAdminNegativeTestJSON-2107380563-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:08:43.471724 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3db3753a-b9ea-40a2-a9c1-9b3d4aaa6ce8 tempest-ServersAdminNegativeTestJSON-2107380563 tempest-ServersAdminNegativeTestJSON-2107380563-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.031493 Apr 16 21:08:43.476860 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 240/513] 10.222.0.20 () {60 vars in 1178 bytes} [Sat Apr 16 21:08:43 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:08:43.491726 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5481efad-a85a-42ee-9caf-01b127d63311 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:43.492250 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5481efad-a85a-42ee-9caf-01b127d63311 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] [instance: 8ee974a7-0d36-49bc-80f4-e269a3fa48bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:43.508799 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5481efad-a85a-42ee-9caf-01b127d63311 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:43.521968 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5481efad-a85a-42ee-9caf-01b127d63311 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:43.521968 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5481efad-a85a-42ee-9caf-01b127d63311 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:43.521968 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5481efad-a85a-42ee-9caf-01b127d63311 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:43.549682 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5481efad-a85a-42ee-9caf-01b127d63311 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] [instance: 8ee974a7-0d36-49bc-80f4-e269a3fa48bf] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:08:43.551081 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-81c1224f-2a7b-4c5a-aab6-6b78bd9e9d1a tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:43.565357 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-81c1224f-2a7b-4c5a-aab6-6b78bd9e9d1a tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:43.571544 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-81c1224f-2a7b-4c5a-aab6-6b78bd9e9d1a tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:43.572847 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-81c1224f-2a7b-4c5a-aab6-6b78bd9e9d1a tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a" status: 200 len: 1567 microversion: 2.25 time: 0.627324 Apr 16 21:08:43.581402 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 274/514] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:08:42 2022] GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a => generated 1567 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:08:43.591091 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-31e1ecf9-cf05-4204-88df-97d49dd4bc14 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:43.593647 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-31e1ecf9-cf05-4204-88df-97d49dd4bc14 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] [instance: 1b5139ef-315a-4a27-9ec4-32c148154072] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:43.600537 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-31e1ecf9-cf05-4204-88df-97d49dd4bc14 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:43.601278 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-31e1ecf9-cf05-4204-88df-97d49dd4bc14 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:43.602300 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-31e1ecf9-cf05-4204-88df-97d49dd4bc14 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:43.602995 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-31e1ecf9-cf05-4204-88df-97d49dd4bc14 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:43.992358 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5481efad-a85a-42ee-9caf-01b127d63311 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8ee974a7-0d36-49bc-80f4-e269a3fa48bf" status: 204 len: 0 microversion: 2.1 time: 0.514176 Apr 16 21:08:43.999045 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 241/515] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:08:43 2022] DELETE /compute/v2.1/servers/8ee974a7-0d36-49bc-80f4-e269a3fa48bf => generated 0 bytes in 519 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:08:44.012427 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d830894f-06c0-49a0-a04f-7d52063a6577 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:44.013309 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d830894f-06c0-49a0-a04f-7d52063a6577 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: e641f7ec-0d41-4439-bc77-7158fb9d346e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:44.024376 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d830894f-06c0-49a0-a04f-7d52063a6577 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:44.025813 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d830894f-06c0-49a0-a04f-7d52063a6577 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:44.027099 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d830894f-06c0-49a0-a04f-7d52063a6577 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:44.028317 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d830894f-06c0-49a0-a04f-7d52063a6577 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:44.116071 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d830894f-06c0-49a0-a04f-7d52063a6577 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:44.124865 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d830894f-06c0-49a0-a04f-7d52063a6577 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e" status: 200 len: 1267 microversion: 2.1 time: 0.125897 Apr 16 21:08:44.128291 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 242/516] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:43 2022] GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e => generated 1267 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:44.135416 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9eea3250-aec4-440a-9b33-87c732f28b53 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:44.136286 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9eea3250-aec4-440a-9b33-87c732f28b53 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] [instance: 8ee974a7-0d36-49bc-80f4-e269a3fa48bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:44.142744 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9eea3250-aec4-440a-9b33-87c732f28b53 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:44.143348 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9eea3250-aec4-440a-9b33-87c732f28b53 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:44.144551 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9eea3250-aec4-440a-9b33-87c732f28b53 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:44.145145 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9eea3250-aec4-440a-9b33-87c732f28b53 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:44.303546 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9eea3250-aec4-440a-9b33-87c732f28b53 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160e460966db4a7e8b697e26de50d0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487e280d7b014a7196cd1e4e9165cc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:44.320899 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-31e1ecf9-cf05-4204-88df-97d49dd4bc14 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01db629e453f41ff8debfefd155aa14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676a0384d9444d9d8e42073806728c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:44.333187 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9eea3250-aec4-440a-9b33-87c732f28b53 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] 10.222.0.20 "GET /compute/v2.1/servers/8ee974a7-0d36-49bc-80f4-e269a3fa48bf" status: 200 len: 1469 microversion: 2.1 time: 0.192551 Apr 16 21:08:44.333187 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 243/517] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:44 2022] GET /compute/v2.1/servers/8ee974a7-0d36-49bc-80f4-e269a3fa48bf => generated 1469 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:44.333187 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ca77e70b-8232-4d4b-bca3-9f6c5603b1b5 tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] Calling method '.version_select at 0x7fbb96f6b670>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:44.343534 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-31e1ecf9-cf05-4204-88df-97d49dd4bc14 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5139ef-315a-4a27-9ec4-32c148154072" status: 200 len: 1323 microversion: 2.1 time: 0.764586 Apr 16 21:08:44.347521 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 275/518] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:43 2022] GET /compute/v2.1/servers/1b5139ef-315a-4a27-9ec4-32c148154072 => generated 1323 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:44.594757 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ffef5bbf-adcf-40c2-9962-0d8c299da69f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:44.595389 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ffef5bbf-adcf-40c2-9962-0d8c299da69f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d06de5cf-0b6e-4546-b316-545265d6af2a] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:44.597005 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ca77e70b-8232-4d4b-bca3-9f6c5603b1b5 tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/a9468034a829404fb7c576272db2343c/defaults" status: 200 len: 371 microversion: 2.1 time: 0.271818 Apr 16 21:08:44.605132 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 244/519] 10.222.0.20 () {58 vars in 1268 bytes} [Sat Apr 16 21:08:44 2022] GET /compute/v2.1/os-quota-sets/a9468034a829404fb7c576272db2343c/defaults => generated 371 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:08:44.609985 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ffef5bbf-adcf-40c2-9962-0d8c299da69f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:44.610453 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ffef5bbf-adcf-40c2-9962-0d8c299da69f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:44.611255 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ffef5bbf-adcf-40c2-9962-0d8c299da69f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:44.611703 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ffef5bbf-adcf-40c2-9962-0d8c299da69f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:44.629918 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1526ceb3-fc9c-402a-9bca-13c3b2465f73 tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] Action: 'update', calling method: .version_select at 0x7fbb96e04550>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:44.729306 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1526ceb3-fc9c-402a-9bca-13c3b2465f73 tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:44.729790 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1526ceb3-fc9c-402a-9bca-13c3b2465f73 tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:44.731236 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1526ceb3-fc9c-402a-9bca-13c3b2465f73 tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:44.732061 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1526ceb3-fc9c-402a-9bca-13c3b2465f73 tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:44.985888 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ffef5bbf-adcf-40c2-9962-0d8c299da69f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:44.994872 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ffef5bbf-adcf-40c2-9962-0d8c299da69f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:44.997180 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ffef5bbf-adcf-40c2-9962-0d8c299da69f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:44.998543 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ffef5bbf-adcf-40c2-9962-0d8c299da69f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a" status: 200 len: 1567 microversion: 2.25 time: 0.407676 Apr 16 21:08:44.999864 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 276/520] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:08:44 2022] GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a => generated 1567 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:08:45.142476 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-40f4b535-f4dc-40bf-830a-1210637bafb1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:45.143093 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-40f4b535-f4dc-40bf-830a-1210637bafb1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: e641f7ec-0d41-4439-bc77-7158fb9d346e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:45.160284 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40f4b535-f4dc-40bf-830a-1210637bafb1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:45.163227 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40f4b535-f4dc-40bf-830a-1210637bafb1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:45.171250 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40f4b535-f4dc-40bf-830a-1210637bafb1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:45.171758 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40f4b535-f4dc-40bf-830a-1210637bafb1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:45.289436 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-40f4b535-f4dc-40bf-830a-1210637bafb1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:45.300874 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-40f4b535-f4dc-40bf-830a-1210637bafb1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e" status: 200 len: 1267 microversion: 2.1 time: 0.162016 Apr 16 21:08:45.301946 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 277/521] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:45 2022] GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:08:45.351615 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-725be0f7-69de-4afd-a3fd-b38cb1c44703 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:45.355693 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-725be0f7-69de-4afd-a3fd-b38cb1c44703 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] [instance: 8ee974a7-0d36-49bc-80f4-e269a3fa48bf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:45.364061 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-725be0f7-69de-4afd-a3fd-b38cb1c44703 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:45.365041 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-725be0f7-69de-4afd-a3fd-b38cb1c44703 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:45.368570 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-725be0f7-69de-4afd-a3fd-b38cb1c44703 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:45.371709 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-725be0f7-69de-4afd-a3fd-b38cb1c44703 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:45.583197 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-725be0f7-69de-4afd-a3fd-b38cb1c44703 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160e460966db4a7e8b697e26de50d0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487e280d7b014a7196cd1e4e9165cc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:45.596044 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-725be0f7-69de-4afd-a3fd-b38cb1c44703 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] 10.222.0.20 "GET /compute/v2.1/servers/8ee974a7-0d36-49bc-80f4-e269a3fa48bf" status: 200 len: 1469 microversion: 2.1 time: 0.258390 Apr 16 21:08:45.604340 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 278/522] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:45 2022] GET /compute/v2.1/servers/8ee974a7-0d36-49bc-80f4-e269a3fa48bf => generated 1469 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:08:45.611866 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8935a1c7-da61-44c8-99cd-51532a5c6965 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:45.612908 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8935a1c7-da61-44c8-99cd-51532a5c6965 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] [instance: 1b5139ef-315a-4a27-9ec4-32c148154072] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:45.624795 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8935a1c7-da61-44c8-99cd-51532a5c6965 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:45.628032 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8935a1c7-da61-44c8-99cd-51532a5c6965 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:45.628032 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8935a1c7-da61-44c8-99cd-51532a5c6965 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:45.628032 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8935a1c7-da61-44c8-99cd-51532a5c6965 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:45.812580 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8935a1c7-da61-44c8-99cd-51532a5c6965 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01db629e453f41ff8debfefd155aa14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676a0384d9444d9d8e42073806728c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:45.829173 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8935a1c7-da61-44c8-99cd-51532a5c6965 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5139ef-315a-4a27-9ec4-32c148154072" status: 200 len: 1323 microversion: 2.1 time: 0.222948 Apr 16 21:08:45.833096 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 279/523] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:45 2022] GET /compute/v2.1/servers/1b5139ef-315a-4a27-9ec4-32c148154072 => generated 1323 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:46.125198 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-59312860-3fe0-4c85-bf57-903655d35faa tempest-FloatingIPDetailsNegativeTestJSON-2117789341 tempest-FloatingIPDetailsNegativeTestJSON-2117789341-project] Calling method '.version_select at 0x7fbb96b89a60>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:46.203387 ncdv-master-1 devstack@n-api.service[137408]: DEBUG neutronclient.v2_0.client [None req-59312860-3fe0-4c85-bf57-903655d35faa tempest-FloatingIPDetailsNegativeTestJSON-2117789341 tempest-FloatingIPDetailsNegativeTestJSON-2117789341-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP c66c2efd-b348-48b7-9400-3fbc4b0c4a72 could not be found", "detail": ""}} {{(pid=137408) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 16 21:08:46.204077 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-59312860-3fe0-4c85-bf57-903655d35faa tempest-FloatingIPDetailsNegativeTestJSON-2117789341 tempest-FloatingIPDetailsNegativeTestJSON-2117789341-project] HTTP exception thrown: Floating IP not found for ID c66c2efd-b348-48b7-9400-3fbc4b0c4a72 Apr 16 21:08:46.205151 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-59312860-3fe0-4c85-bf57-903655d35faa tempest-FloatingIPDetailsNegativeTestJSON-2117789341 tempest-FloatingIPDetailsNegativeTestJSON-2117789341-project] Returning 404 to user: Floating IP not found for ID c66c2efd-b348-48b7-9400-3fbc4b0c4a72 {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:08:46.205976 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-59312860-3fe0-4c85-bf57-903655d35faa tempest-FloatingIPDetailsNegativeTestJSON-2117789341 tempest-FloatingIPDetailsNegativeTestJSON-2117789341-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/c66c2efd-b348-48b7-9400-3fbc4b0c4a72" status: 404 len: 111 microversion: 2.1 time: 0.370190 Apr 16 21:08:46.206989 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 280/524] 10.222.0.20 () {58 vars in 1259 bytes} [Sat Apr 16 21:08:45 2022] GET /compute/v2.1/os-floating-ips/c66c2efd-b348-48b7-9400-3fbc4b0c4a72 => generated 111 bytes in 373 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:08:46.213667 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6edd5998-4ce6-4a80-b1e0-705614c2a101 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:46.214534 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6edd5998-4ce6-4a80-b1e0-705614c2a101 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d06de5cf-0b6e-4546-b316-545265d6af2a] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:46.225603 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6edd5998-4ce6-4a80-b1e0-705614c2a101 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:46.226327 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6edd5998-4ce6-4a80-b1e0-705614c2a101 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:46.227269 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6edd5998-4ce6-4a80-b1e0-705614c2a101 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:46.228051 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6edd5998-4ce6-4a80-b1e0-705614c2a101 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:46.314134 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1526ceb3-fc9c-402a-9bca-13c3b2465f73 tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/a9468034a829404fb7c576272db2343c" status: 200 len: 329 microversion: 2.1 time: 1.695916 Apr 16 21:08:46.423510 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 245/525] 10.222.0.20 () {60 vars in 1262 bytes} [Sat Apr 16 21:08:44 2022] PUT /compute/v2.1/os-quota-sets/a9468034a829404fb7c576272db2343c => generated 329 bytes in 1700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:08:46.423510 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-dbd7b2a5-befc-49f0-ba2c-a335d0bd5986 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:46.423510 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-dbd7b2a5-befc-49f0-ba2c-a335d0bd5986 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: e641f7ec-0d41-4439-bc77-7158fb9d346e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:46.423510 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dbd7b2a5-befc-49f0-ba2c-a335d0bd5986 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:46.423510 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dbd7b2a5-befc-49f0-ba2c-a335d0bd5986 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:46.424909 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dbd7b2a5-befc-49f0-ba2c-a335d0bd5986 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:46.424909 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dbd7b2a5-befc-49f0-ba2c-a335d0bd5986 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:46.465543 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-dbd7b2a5-befc-49f0-ba2c-a335d0bd5986 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:46.474041 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-dbd7b2a5-befc-49f0-ba2c-a335d0bd5986 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e" status: 200 len: 1267 microversion: 2.1 time: 0.151042 Apr 16 21:08:46.479142 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 246/526] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:46 2022] GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:46.487933 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1383ccf9-6c0a-468e-acf5-6c5d28899f32 tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] Action: 'update', calling method: .version_select at 0x7fbb96f6bee0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:46.547234 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6edd5998-4ce6-4a80-b1e0-705614c2a101 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:46.562257 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6edd5998-4ce6-4a80-b1e0-705614c2a101 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:46.564355 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6edd5998-4ce6-4a80-b1e0-705614c2a101 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:46.621706 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6edd5998-4ce6-4a80-b1e0-705614c2a101 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a" status: 200 len: 1557 microversion: 2.25 time: 0.357713 Apr 16 21:08:46.621706 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 281/527] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:08:46 2022] GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a => generated 1557 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:08:46.621706 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-66ef004e-629d-4e45-9a8a-7f37492e8ff4 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Calling method '.version_select at 0x7fbb96c24790>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:46.621706 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-66ef004e-629d-4e45-9a8a-7f37492e8ff4 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:46.623035 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-66ef004e-629d-4e45-9a8a-7f37492e8ff4 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:46.650256 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-66ef004e-629d-4e45-9a8a-7f37492e8ff4 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 680 microversion: 2.25 time: 0.065350 Apr 16 21:08:46.670760 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 282/528] 10.222.0.20 () {60 vars in 1183 bytes} [Sat Apr 16 21:08:46 2022] GET /compute/v2.1/os-migrations => generated 680 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:08:46.676636 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-13905c5c-0470-47cf-9b37-b26b2ef109c3 req-02a7c265-d678-4be9-a5e6-6c2770094e28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ee974a7-0d36-49bc-80f4-e269a3fa48bf", "name": "network-vif-deleted", "tag": "73ab8831-7b70-423a-9fbd-e1e78b3be077"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:46.715514 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-13905c5c-0470-47cf-9b37-b26b2ef109c3 req-02a7c265-d678-4be9-a5e6-6c2770094e28 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:46.719222 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-13905c5c-0470-47cf-9b37-b26b2ef109c3 req-02a7c265-d678-4be9-a5e6-6c2770094e28 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:46.754885 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-13905c5c-0470-47cf-9b37-b26b2ef109c3 req-02a7c265-d678-4be9-a5e6-6c2770094e28 service nova] Creating event network-vif-deleted:73ab8831-7b70-423a-9fbd-e1e78b3be077 for instance 8ee974a7-0d36-49bc-80f4-e269a3fa48bf on nch1-master-1 Apr 16 21:08:46.768326 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-13905c5c-0470-47cf-9b37-b26b2ef109c3 req-02a7c265-d678-4be9-a5e6-6c2770094e28 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094532 Apr 16 21:08:46.776062 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 283/529] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:08:46.787714 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fe8462b3-d3d3-4f00-9133-0429e4e015f7 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:46.789402 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fe8462b3-d3d3-4f00-9133-0429e4e015f7 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] [instance: 8ee974a7-0d36-49bc-80f4-e269a3fa48bf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:46.809131 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fe8462b3-d3d3-4f00-9133-0429e4e015f7 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:46.809895 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fe8462b3-d3d3-4f00-9133-0429e4e015f7 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:46.813487 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fe8462b3-d3d3-4f00-9133-0429e4e015f7 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:46.820310 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fe8462b3-d3d3-4f00-9133-0429e4e015f7 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:47.045053 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fe8462b3-d3d3-4f00-9133-0429e4e015f7 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160e460966db4a7e8b697e26de50d0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487e280d7b014a7196cd1e4e9165cc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:47.052934 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fe8462b3-d3d3-4f00-9133-0429e4e015f7 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] 10.222.0.20 "GET /compute/v2.1/servers/8ee974a7-0d36-49bc-80f4-e269a3fa48bf" status: 200 len: 1298 microversion: 2.1 time: 0.275477 Apr 16 21:08:47.053515 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 284/530] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:46 2022] GET /compute/v2.1/servers/8ee974a7-0d36-49bc-80f4-e269a3fa48bf => generated 1298 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:47.078504 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ad7d07fa-2e04-434a-acd7-7e41247b3b28 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:47.080966 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ad7d07fa-2e04-434a-acd7-7e41247b3b28 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] [instance: d06de5cf-0b6e-4546-b316-545265d6af2a] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:47.094986 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ad7d07fa-2e04-434a-acd7-7e41247b3b28 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:47.095443 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ad7d07fa-2e04-434a-acd7-7e41247b3b28 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:47.103843 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ad7d07fa-2e04-434a-acd7-7e41247b3b28 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:47.111542 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ad7d07fa-2e04-434a-acd7-7e41247b3b28 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:47.119408 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1383ccf9-6c0a-468e-acf5-6c5d28899f32 tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:47.121251 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1383ccf9-6c0a-468e-acf5-6c5d28899f32 tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:47.126060 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1383ccf9-6c0a-468e-acf5-6c5d28899f32 tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:47.131181 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1383ccf9-6c0a-468e-acf5-6c5d28899f32 tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:47.642325 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-ad7d07fa-2e04-434a-acd7-7e41247b3b28 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lazy-loading 'services' on Instance uuid d06de5cf-0b6e-4546-b316-545265d6af2a {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:08:47.672335 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ad7d07fa-2e04-434a-acd7-7e41247b3b28 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a" status: 200 len: 2049 microversion: 2.25 time: 0.610858 Apr 16 21:08:47.686961 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 285/531] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:08:47 2022] GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a => generated 2049 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:08:47.717759 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c5f4ab99-7a4c-4072-b693-75b49f3de3d2 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:47.718659 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c5f4ab99-7a4c-4072-b693-75b49f3de3d2 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] [instance: 1b5139ef-315a-4a27-9ec4-32c148154072] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:47.733759 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c5f4ab99-7a4c-4072-b693-75b49f3de3d2 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:47.734576 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c5f4ab99-7a4c-4072-b693-75b49f3de3d2 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:47.735570 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c5f4ab99-7a4c-4072-b693-75b49f3de3d2 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:47.737163 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c5f4ab99-7a4c-4072-b693-75b49f3de3d2 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:48.306724 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c5f4ab99-7a4c-4072-b693-75b49f3de3d2 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01db629e453f41ff8debfefd155aa14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676a0384d9444d9d8e42073806728c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:48.324508 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c5f4ab99-7a4c-4072-b693-75b49f3de3d2 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5139ef-315a-4a27-9ec4-32c148154072" status: 200 len: 1323 microversion: 2.1 time: 0.636043 Apr 16 21:08:48.325529 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 286/532] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:47 2022] GET /compute/v2.1/servers/1b5139ef-315a-4a27-9ec4-32c148154072 => generated 1323 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:48.330762 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8d8f439c-6ba0-4717-9ec1-cc7409701b49 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:48.331969 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8d8f439c-6ba0-4717-9ec1-cc7409701b49 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: e641f7ec-0d41-4439-bc77-7158fb9d346e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:48.340248 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8d8f439c-6ba0-4717-9ec1-cc7409701b49 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:48.340986 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8d8f439c-6ba0-4717-9ec1-cc7409701b49 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:48.342211 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8d8f439c-6ba0-4717-9ec1-cc7409701b49 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:48.343223 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8d8f439c-6ba0-4717-9ec1-cc7409701b49 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:48.564694 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8d8f439c-6ba0-4717-9ec1-cc7409701b49 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:48.572722 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8d8f439c-6ba0-4717-9ec1-cc7409701b49 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e" status: 200 len: 1309 microversion: 2.1 time: 0.245891 Apr 16 21:08:48.573556 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 287/533] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:48 2022] GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e => generated 1309 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:48.585599 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-2f931161-2b18-419e-b690-b58bd395c337 req-1b2ba7ff-b00c-4b59-b031-e15302a85e9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b5139ef-315a-4a27-9ec4-32c148154072", "name": "network-vif-plugged", "status": "completed", "tag": "b2b1f926-26c2-4967-962d-9fcdd23eac15"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:48.598535 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-2f931161-2b18-419e-b690-b58bd395c337 req-1b2ba7ff-b00c-4b59-b031-e15302a85e9a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:48.600223 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-2f931161-2b18-419e-b690-b58bd395c337 req-1b2ba7ff-b00c-4b59-b031-e15302a85e9a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:48.621859 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-2f931161-2b18-419e-b690-b58bd395c337 req-1b2ba7ff-b00c-4b59-b031-e15302a85e9a service nova] Creating event network-vif-plugged:b2b1f926-26c2-4967-962d-9fcdd23eac15 for instance 1b5139ef-315a-4a27-9ec4-32c148154072 on nch1-master-1 Apr 16 21:08:48.629418 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-2f931161-2b18-419e-b690-b58bd395c337 req-1b2ba7ff-b00c-4b59-b031-e15302a85e9a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054492 Apr 16 21:08:48.630830 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 288/534] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:08:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:08:48.815420 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8d909f55-c735-43ff-9c33-d60c54294b90 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1630286202", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:48.931845 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-8d909f55-c735-43ff-9c33-d60c54294b90 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] validate_networks() for None {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:08:49.423097 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-8d909f55-c735-43ff-9c33-d60c54294b90 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:08:49.423871 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-8d909f55-c735-43ff-9c33-d60c54294b90 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:08:49.424430 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-8d909f55-c735-43ff-9c33-d60c54294b90 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:08:49.424839 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-8d909f55-c735-43ff-9c33-d60c54294b90 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:08:49.425442 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-8d909f55-c735-43ff-9c33-d60c54294b90 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:08:49.428625 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1383ccf9-6c0a-468e-acf5-6c5d28899f32 tempest-QuotasAdminTestJSON-883591278 tempest-QuotasAdminTestJSON-883591278-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/a9468034a829404fb7c576272db2343c" status: 200 len: 329 microversion: 2.1 time: 2.948186 Apr 16 21:08:49.429213 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 247/535] 10.222.0.20 () {60 vars in 1262 bytes} [Sat Apr 16 21:08:46 2022] PUT /compute/v2.1/os-quota-sets/a9468034a829404fb7c576272db2343c => generated 329 bytes in 2949 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:08:49.437290 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8d909f55-c735-43ff-9c33-d60c54294b90 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:49.438101 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8d909f55-c735-43ff-9c33-d60c54294b90 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:49.440658 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8d909f55-c735-43ff-9c33-d60c54294b90 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:49.441443 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8d909f55-c735-43ff-9c33-d60c54294b90 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:49.442007 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1ed639c5-a084-4659-b5ca-50ba22f6282f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-270528483", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "341a7a54-447f-4bb3-9bb9-2193e32a0929"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:49.477664 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-8d909f55-c735-43ff-9c33-d60c54294b90 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Getting quotas for project 1924a4ceffaf45d0bf2bd76ebb421bcd. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:08:49.484771 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-8d909f55-c735-43ff-9c33-d60c54294b90 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Getting quotas for user eae06aafd64d46deacb8ae1791676d75 and project 1924a4ceffaf45d0bf2bd76ebb421bcd. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:08:49.501312 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8d909f55-c735-43ff-9c33-d60c54294b90 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:08:49.502642 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8d909f55-c735-43ff-9c33-d60c54294b90 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] [instance: bf93495b-7d10-4cb2-9353-0302e654d8fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:08:49.508260 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-1ed639c5-a084-4659-b5ca-50ba22f6282f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] validate_networks() for [('341a7a54-447f-4bb3-9bb9-2193e32a0929', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:08:49.692540 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8d909f55-c735-43ff-9c33-d60c54294b90 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.057588 Apr 16 21:08:49.693944 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 289/536] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:08:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1062 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:08:49.699318 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c05646f6-2461-46de-b62b-87b2fd963739 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:49.700440 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c05646f6-2461-46de-b62b-87b2fd963739 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] [instance: 8ee974a7-0d36-49bc-80f4-e269a3fa48bf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:49.709117 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c05646f6-2461-46de-b62b-87b2fd963739 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:49.709897 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c05646f6-2461-46de-b62b-87b2fd963739 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:49.710953 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c05646f6-2461-46de-b62b-87b2fd963739 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:49.711614 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c05646f6-2461-46de-b62b-87b2fd963739 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:49.736213 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-c05646f6-2461-46de-b62b-87b2fd963739 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] HTTP exception thrown: Instance 8ee974a7-0d36-49bc-80f4-e269a3fa48bf could not be found. Apr 16 21:08:49.738733 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c05646f6-2461-46de-b62b-87b2fd963739 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Returning 404 to user: Instance 8ee974a7-0d36-49bc-80f4-e269a3fa48bf could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:08:49.742898 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c05646f6-2461-46de-b62b-87b2fd963739 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] 10.222.0.20 "GET /compute/v2.1/servers/8ee974a7-0d36-49bc-80f4-e269a3fa48bf" status: 404 len: 111 microversion: 2.1 time: 0.047344 Apr 16 21:08:49.743491 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 290/537] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:49 2022] GET /compute/v2.1/servers/8ee974a7-0d36-49bc-80f4-e269a3fa48bf => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:08:49.753492 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-3d2088de-4b9f-4ffd-a1aa-c6ccd4ad45d4 req-f6e6cbd5-fd3a-407c-a0b4-f2e9007a2511 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e641f7ec-0d41-4439-bc77-7158fb9d346e", "tag": "cde5a5c3-65ba-417d-8651-74ec3a50ff0d"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:49.778060 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-3d2088de-4b9f-4ffd-a1aa-c6ccd4ad45d4 req-f6e6cbd5-fd3a-407c-a0b4-f2e9007a2511 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:49.778517 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-3d2088de-4b9f-4ffd-a1aa-c6ccd4ad45d4 req-f6e6cbd5-fd3a-407c-a0b4-f2e9007a2511 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:49.792552 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-3d2088de-4b9f-4ffd-a1aa-c6ccd4ad45d4 req-f6e6cbd5-fd3a-407c-a0b4-f2e9007a2511 service nova] Creating event network-changed:cde5a5c3-65ba-417d-8651-74ec3a50ff0d for instance e641f7ec-0d41-4439-bc77-7158fb9d346e on nch1-master-1 Apr 16 21:08:49.802939 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-3d2088de-4b9f-4ffd-a1aa-c6ccd4ad45d4 req-f6e6cbd5-fd3a-407c-a0b4-f2e9007a2511 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058130 Apr 16 21:08:49.804498 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 291/538] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:08:49.814211 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5d97b5ef-0c72-44df-bfa0-475e0fd66af7 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:49.815575 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5d97b5ef-0c72-44df-bfa0-475e0fd66af7 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] [instance: 1b5139ef-315a-4a27-9ec4-32c148154072] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:49.825824 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5d97b5ef-0c72-44df-bfa0-475e0fd66af7 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:49.826878 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5d97b5ef-0c72-44df-bfa0-475e0fd66af7 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:49.827928 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5d97b5ef-0c72-44df-bfa0-475e0fd66af7 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:49.828607 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5d97b5ef-0c72-44df-bfa0-475e0fd66af7 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:50.009788 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-1ed639c5-a084-4659-b5ca-50ba22f6282f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:08:50.011702 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-1ed639c5-a084-4659-b5ca-50ba22f6282f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:08:50.012950 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-1ed639c5-a084-4659-b5ca-50ba22f6282f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:08:50.013473 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-1ed639c5-a084-4659-b5ca-50ba22f6282f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:08:50.014087 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-1ed639c5-a084-4659-b5ca-50ba22f6282f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:08:50.025281 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1ed639c5-a084-4659-b5ca-50ba22f6282f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:50.025943 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1ed639c5-a084-4659-b5ca-50ba22f6282f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:50.027838 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1ed639c5-a084-4659-b5ca-50ba22f6282f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:50.028473 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1ed639c5-a084-4659-b5ca-50ba22f6282f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:50.049635 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-1ed639c5-a084-4659-b5ca-50ba22f6282f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Getting quotas for project 68af3300a0d149adbbf934b4ff1f87d8. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:08:50.059068 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-1ed639c5-a084-4659-b5ca-50ba22f6282f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Getting quotas for user 53d5464685cc40d9a1d891c6ae39a80f and project 68af3300a0d149adbbf934b4ff1f87d8. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:08:50.075419 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1ed639c5-a084-4659-b5ca-50ba22f6282f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:08:50.075976 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5d97b5ef-0c72-44df-bfa0-475e0fd66af7 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01db629e453f41ff8debfefd155aa14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676a0384d9444d9d8e42073806728c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:50.078258 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1ed639c5-a084-4659-b5ca-50ba22f6282f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: ffc4d9b2-dd4f-44dc-a189-354eff7a5573] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:08:50.085330 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5d97b5ef-0c72-44df-bfa0-475e0fd66af7 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5139ef-315a-4a27-9ec4-32c148154072" status: 200 len: 1323 microversion: 2.1 time: 0.279352 Apr 16 21:08:50.098238 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 292/539] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:49 2022] GET /compute/v2.1/servers/1b5139ef-315a-4a27-9ec4-32c148154072 => generated 1323 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:50.105043 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-37bb35a2-0857-41c9-8396-12cd50b799f3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:50.106177 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-37bb35a2-0857-41c9-8396-12cd50b799f3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: e641f7ec-0d41-4439-bc77-7158fb9d346e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:50.118077 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-37bb35a2-0857-41c9-8396-12cd50b799f3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:50.119003 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-37bb35a2-0857-41c9-8396-12cd50b799f3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:50.120810 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-37bb35a2-0857-41c9-8396-12cd50b799f3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:50.121668 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-37bb35a2-0857-41c9-8396-12cd50b799f3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:50.277914 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1ed639c5-a084-4659-b5ca-50ba22f6282f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.843287 Apr 16 21:08:50.278945 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 248/540] 10.222.0.20 () {62 vars in 1187 bytes} [Sat Apr 16 21:08:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 849 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 16 21:08:50.289095 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c3337c8c-9cf9-4b5a-99a4-ea4db073defd tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:50.289910 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c3337c8c-9cf9-4b5a-99a4-ea4db073defd tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] [instance: bf93495b-7d10-4cb2-9353-0302e654d8fa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:50.370893 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c3337c8c-9cf9-4b5a-99a4-ea4db073defd tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae06aafd64d46deacb8ae1791676d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1924a4ceffaf45d0bf2bd76ebb421bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:50.371136 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-37bb35a2-0857-41c9-8396-12cd50b799f3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:50.380893 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c3337c8c-9cf9-4b5a-99a4-ea4db073defd tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] 10.222.0.20 "GET /compute/v2.1/servers/bf93495b-7d10-4cb2-9353-0302e654d8fa" status: 200 len: 1219 microversion: 2.1 time: 0.098261 Apr 16 21:08:50.381564 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 249/541] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:50 2022] GET /compute/v2.1/servers/bf93495b-7d10-4cb2-9353-0302e654d8fa => generated 1219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:50.382304 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-37bb35a2-0857-41c9-8396-12cd50b799f3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e" status: 200 len: 1309 microversion: 2.1 time: 0.282866 Apr 16 21:08:50.383537 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 293/542] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:50 2022] GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e => generated 1309 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:50.395383 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-78f0217a-6f7e-49b2-829c-8bca9b361980 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:50.396822 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-78f0217a-6f7e-49b2-829c-8bca9b361980 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: ffc4d9b2-dd4f-44dc-a189-354eff7a5573] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:50.398834 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-27ae9345-692b-4ba1-ae01-9b855d4ce85c tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:50.399343 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-27ae9345-692b-4ba1-ae01-9b855d4ce85c tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] [instance: 84fdd641-4d23-472a-8b8f-fded89dbcc32] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:50.407180 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-27ae9345-692b-4ba1-ae01-9b855d4ce85c tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:50.407586 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-27ae9345-692b-4ba1-ae01-9b855d4ce85c tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:50.409269 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-27ae9345-692b-4ba1-ae01-9b855d4ce85c tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:50.409868 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-27ae9345-692b-4ba1-ae01-9b855d4ce85c tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:50.479438 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-27ae9345-692b-4ba1-ae01-9b855d4ce85c tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] [instance: 84fdd641-4d23-472a-8b8f-fded89dbcc32] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:08:50.534269 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-78f0217a-6f7e-49b2-829c-8bca9b361980 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:50.556393 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-78f0217a-6f7e-49b2-829c-8bca9b361980 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:50.571389 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-78f0217a-6f7e-49b2-829c-8bca9b361980 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:50.572609 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-78f0217a-6f7e-49b2-829c-8bca9b361980 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573" status: 200 len: 1261 microversion: 2.25 time: 0.187923 Apr 16 21:08:50.585061 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 294/543] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:08:50 2022] GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573 => generated 1261 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:08:50.915664 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-27ae9345-692b-4ba1-ae01-9b855d4ce85c tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] 10.222.0.20 "DELETE /compute/v2.1/servers/84fdd641-4d23-472a-8b8f-fded89dbcc32" status: 204 len: 0 microversion: 2.1 time: 0.532697 Apr 16 21:08:50.923559 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 250/544] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:08:50 2022] DELETE /compute/v2.1/servers/84fdd641-4d23-472a-8b8f-fded89dbcc32 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:08:50.925730 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d7889939-4a48-4b2b-9043-f337cc0ba2c3 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:50.926410 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d7889939-4a48-4b2b-9043-f337cc0ba2c3 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] [instance: 84fdd641-4d23-472a-8b8f-fded89dbcc32] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:50.937420 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d7889939-4a48-4b2b-9043-f337cc0ba2c3 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:50.937867 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d7889939-4a48-4b2b-9043-f337cc0ba2c3 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:50.938865 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d7889939-4a48-4b2b-9043-f337cc0ba2c3 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:50.939320 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d7889939-4a48-4b2b-9043-f337cc0ba2c3 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:51.103428 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-741b65c9-df33-462e-aabb-cd22f68b7461 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:51.104136 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-741b65c9-df33-462e-aabb-cd22f68b7461 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] [instance: 1b5139ef-315a-4a27-9ec4-32c148154072] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:51.121155 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-741b65c9-df33-462e-aabb-cd22f68b7461 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:51.121622 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-741b65c9-df33-462e-aabb-cd22f68b7461 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:51.122786 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-741b65c9-df33-462e-aabb-cd22f68b7461 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:51.123087 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-741b65c9-df33-462e-aabb-cd22f68b7461 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:51.329925 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d7889939-4a48-4b2b-9043-f337cc0ba2c3 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160e460966db4a7e8b697e26de50d0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487e280d7b014a7196cd1e4e9165cc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:51.337463 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d7889939-4a48-4b2b-9043-f337cc0ba2c3 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] 10.222.0.20 "GET /compute/v2.1/servers/84fdd641-4d23-472a-8b8f-fded89dbcc32" status: 200 len: 1476 microversion: 2.1 time: 0.417005 Apr 16 21:08:51.338040 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 295/545] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:50 2022] GET /compute/v2.1/servers/84fdd641-4d23-472a-8b8f-fded89dbcc32 => generated 1476 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:51.375452 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-741b65c9-df33-462e-aabb-cd22f68b7461 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01db629e453f41ff8debfefd155aa14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676a0384d9444d9d8e42073806728c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:51.383484 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-741b65c9-df33-462e-aabb-cd22f68b7461 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5139ef-315a-4a27-9ec4-32c148154072" status: 200 len: 1323 microversion: 2.1 time: 0.284754 Apr 16 21:08:51.393029 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 251/546] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:51 2022] GET /compute/v2.1/servers/1b5139ef-315a-4a27-9ec4-32c148154072 => generated 1323 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:08:51.399372 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0d30982c-a730-496b-92b3-5fe85b5157c8 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:51.400185 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0d30982c-a730-496b-92b3-5fe85b5157c8 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] [instance: bf93495b-7d10-4cb2-9353-0302e654d8fa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:51.401603 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-07243de9-db8c-4f38-9b9d-a97bc8cf7f48 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:51.402516 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-07243de9-db8c-4f38-9b9d-a97bc8cf7f48 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: e641f7ec-0d41-4439-bc77-7158fb9d346e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:51.407809 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0d30982c-a730-496b-92b3-5fe85b5157c8 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:51.408866 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0d30982c-a730-496b-92b3-5fe85b5157c8 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:51.409804 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0d30982c-a730-496b-92b3-5fe85b5157c8 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:51.412238 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-07243de9-db8c-4f38-9b9d-a97bc8cf7f48 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:51.413293 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-07243de9-db8c-4f38-9b9d-a97bc8cf7f48 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:51.415263 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0d30982c-a730-496b-92b3-5fe85b5157c8 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:51.421435 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-07243de9-db8c-4f38-9b9d-a97bc8cf7f48 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:51.421435 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-07243de9-db8c-4f38-9b9d-a97bc8cf7f48 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:51.515511 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0d30982c-a730-496b-92b3-5fe85b5157c8 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae06aafd64d46deacb8ae1791676d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1924a4ceffaf45d0bf2bd76ebb421bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:51.523932 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0d30982c-a730-496b-92b3-5fe85b5157c8 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] 10.222.0.20 "GET /compute/v2.1/servers/bf93495b-7d10-4cb2-9353-0302e654d8fa" status: 200 len: 1223 microversion: 2.1 time: 0.128476 Apr 16 21:08:51.525148 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 252/547] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:51 2022] GET /compute/v2.1/servers/bf93495b-7d10-4cb2-9353-0302e654d8fa => generated 1223 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:51.597154 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3ca7897c-2db1-449f-8b5a-b1fad3073781 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:51.597805 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3ca7897c-2db1-449f-8b5a-b1fad3073781 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: ffc4d9b2-dd4f-44dc-a189-354eff7a5573] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:51.604918 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3ca7897c-2db1-449f-8b5a-b1fad3073781 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:51.605386 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3ca7897c-2db1-449f-8b5a-b1fad3073781 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:51.606184 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3ca7897c-2db1-449f-8b5a-b1fad3073781 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:51.606632 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3ca7897c-2db1-449f-8b5a-b1fad3073781 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:51.692037 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3ca7897c-2db1-449f-8b5a-b1fad3073781 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:51.702662 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3ca7897c-2db1-449f-8b5a-b1fad3073781 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:51.704273 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3ca7897c-2db1-449f-8b5a-b1fad3073781 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:51.705452 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3ca7897c-2db1-449f-8b5a-b1fad3073781 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573" status: 200 len: 1265 microversion: 2.25 time: 0.112500 Apr 16 21:08:51.706551 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 253/548] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:08:51 2022] GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573 => generated 1265 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:08:51.938818 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-07243de9-db8c-4f38-9b9d-a97bc8cf7f48 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:51.939412 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-07243de9-db8c-4f38-9b9d-a97bc8cf7f48 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e" status: 200 len: 1309 microversion: 2.1 time: 0.543685 Apr 16 21:08:51.946028 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 296/549] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:51 2022] GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e => generated 1309 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:52.355273 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cca94b9a-ca9d-4ae2-b8ad-b8214d7bcb20 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:52.356783 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-cca94b9a-ca9d-4ae2-b8ad-b8214d7bcb20 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] [instance: 84fdd641-4d23-472a-8b8f-fded89dbcc32] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:52.363005 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cca94b9a-ca9d-4ae2-b8ad-b8214d7bcb20 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:52.363588 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cca94b9a-ca9d-4ae2-b8ad-b8214d7bcb20 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:52.365112 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cca94b9a-ca9d-4ae2-b8ad-b8214d7bcb20 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:52.365657 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cca94b9a-ca9d-4ae2-b8ad-b8214d7bcb20 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:52.401419 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6f690f98-9f5b-42cb-a6e8-bc5fb94c5e54 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:52.402395 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6f690f98-9f5b-42cb-a6e8-bc5fb94c5e54 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] [instance: 1b5139ef-315a-4a27-9ec4-32c148154072] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:52.410422 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6f690f98-9f5b-42cb-a6e8-bc5fb94c5e54 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:52.410885 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6f690f98-9f5b-42cb-a6e8-bc5fb94c5e54 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:52.411866 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6f690f98-9f5b-42cb-a6e8-bc5fb94c5e54 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:52.412333 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6f690f98-9f5b-42cb-a6e8-bc5fb94c5e54 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:52.583436 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cca94b9a-ca9d-4ae2-b8ad-b8214d7bcb20 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160e460966db4a7e8b697e26de50d0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487e280d7b014a7196cd1e4e9165cc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:52.594753 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cca94b9a-ca9d-4ae2-b8ad-b8214d7bcb20 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] 10.222.0.20 "GET /compute/v2.1/servers/84fdd641-4d23-472a-8b8f-fded89dbcc32" status: 200 len: 1476 microversion: 2.1 time: 0.243913 Apr 16 21:08:52.595411 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 254/550] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:52 2022] GET /compute/v2.1/servers/84fdd641-4d23-472a-8b8f-fded89dbcc32 => generated 1476 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:52.603991 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f2a454f8-8d09-4b3b-b9b2-fbae0da7ec7e tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:52.604672 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f2a454f8-8d09-4b3b-b9b2-fbae0da7ec7e tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] [instance: bf93495b-7d10-4cb2-9353-0302e654d8fa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:52.614220 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f2a454f8-8d09-4b3b-b9b2-fbae0da7ec7e tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:52.615483 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f2a454f8-8d09-4b3b-b9b2-fbae0da7ec7e tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:52.621844 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f2a454f8-8d09-4b3b-b9b2-fbae0da7ec7e tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:52.621844 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f2a454f8-8d09-4b3b-b9b2-fbae0da7ec7e tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:52.710028 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f2a454f8-8d09-4b3b-b9b2-fbae0da7ec7e tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae06aafd64d46deacb8ae1791676d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1924a4ceffaf45d0bf2bd76ebb421bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:52.719136 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f2a454f8-8d09-4b3b-b9b2-fbae0da7ec7e tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] 10.222.0.20 "GET /compute/v2.1/servers/bf93495b-7d10-4cb2-9353-0302e654d8fa" status: 200 len: 1215 microversion: 2.1 time: 0.122479 Apr 16 21:08:52.720190 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 255/551] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:52 2022] GET /compute/v2.1/servers/bf93495b-7d10-4cb2-9353-0302e654d8fa => generated 1215 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:52.740738 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-61bcd665-a223-431a-bf00-eff090fcb81b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:52.743500 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-61bcd665-a223-431a-bf00-eff090fcb81b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: ffc4d9b2-dd4f-44dc-a189-354eff7a5573] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:52.768265 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-61bcd665-a223-431a-bf00-eff090fcb81b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:52.768741 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-61bcd665-a223-431a-bf00-eff090fcb81b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:52.770541 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-61bcd665-a223-431a-bf00-eff090fcb81b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:52.772869 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-61bcd665-a223-431a-bf00-eff090fcb81b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:52.850047 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-61bcd665-a223-431a-bf00-eff090fcb81b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:52.861343 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-61bcd665-a223-431a-bf00-eff090fcb81b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:52.863247 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-61bcd665-a223-431a-bf00-eff090fcb81b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:52.864567 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-61bcd665-a223-431a-bf00-eff090fcb81b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573" status: 200 len: 1257 microversion: 2.25 time: 0.143121 Apr 16 21:08:52.865203 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 256/552] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:08:52 2022] GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573 => generated 1257 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:08:52.920816 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6f690f98-9f5b-42cb-a6e8-bc5fb94c5e54 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01db629e453f41ff8debfefd155aa14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676a0384d9444d9d8e42073806728c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:52.929221 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6f690f98-9f5b-42cb-a6e8-bc5fb94c5e54 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5139ef-315a-4a27-9ec4-32c148154072" status: 200 len: 1473 microversion: 2.1 time: 0.532749 Apr 16 21:08:52.930132 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 297/553] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:52 2022] GET /compute/v2.1/servers/1b5139ef-315a-4a27-9ec4-32c148154072 => generated 1473 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:52.947267 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c9cdcb22-b58a-4e9f-8e58-b54da13f0f7d tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:52.952239 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c9cdcb22-b58a-4e9f-8e58-b54da13f0f7d tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] [instance: 1b5139ef-315a-4a27-9ec4-32c148154072] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:52.954656 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c9cdcb22-b58a-4e9f-8e58-b54da13f0f7d tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:52.955112 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c9cdcb22-b58a-4e9f-8e58-b54da13f0f7d tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:52.955826 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4dffefa6-d076-45e2-9542-e0661bae8357 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:52.956302 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c9cdcb22-b58a-4e9f-8e58-b54da13f0f7d tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:52.956385 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c9cdcb22-b58a-4e9f-8e58-b54da13f0f7d tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:52.956482 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4dffefa6-d076-45e2-9542-e0661bae8357 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: e641f7ec-0d41-4439-bc77-7158fb9d346e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:52.964597 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4dffefa6-d076-45e2-9542-e0661bae8357 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:52.965359 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4dffefa6-d076-45e2-9542-e0661bae8357 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:52.967372 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4dffefa6-d076-45e2-9542-e0661bae8357 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:52.968105 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4dffefa6-d076-45e2-9542-e0661bae8357 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:52.987287 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c9cdcb22-b58a-4e9f-8e58-b54da13f0f7d tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '01db629e453f41ff8debfefd155aa14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676a0384d9444d9d8e42073806728c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:52.988266 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c9cdcb22-b58a-4e9f-8e58-b54da13f0f7d tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:08:52.989407 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c9cdcb22-b58a-4e9f-8e58-b54da13f0f7d tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5139ef-315a-4a27-9ec4-32c148154072/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.046695 Apr 16 21:08:52.990408 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 257/554] 10.222.0.20 () {58 vars in 1271 bytes} [Sat Apr 16 21:08:52 2022] GET /compute/v2.1/servers/1b5139ef-315a-4a27-9ec4-32c148154072/diagnostics => generated 117 bytes in 48 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:08:53.001739 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-44e60cf5-4c7e-45df-88b0-aaed6bf11bc4 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:53.002372 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-44e60cf5-4c7e-45df-88b0-aaed6bf11bc4 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] [instance: 1b5139ef-315a-4a27-9ec4-32c148154072] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:53.009974 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-44e60cf5-4c7e-45df-88b0-aaed6bf11bc4 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:53.011233 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-44e60cf5-4c7e-45df-88b0-aaed6bf11bc4 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:53.011233 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-44e60cf5-4c7e-45df-88b0-aaed6bf11bc4 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:53.012527 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-44e60cf5-4c7e-45df-88b0-aaed6bf11bc4 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:53.042195 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-44e60cf5-4c7e-45df-88b0-aaed6bf11bc4 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] [instance: 1b5139ef-315a-4a27-9ec4-32c148154072] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:08:53.372760 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-44e60cf5-4c7e-45df-88b0-aaed6bf11bc4 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1b5139ef-315a-4a27-9ec4-32c148154072" status: 204 len: 0 microversion: 2.1 time: 0.375396 Apr 16 21:08:53.373535 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 258/555] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:08:52 2022] DELETE /compute/v2.1/servers/1b5139ef-315a-4a27-9ec4-32c148154072 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 16 21:08:53.391424 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-90052ce9-4e46-408f-8c88-ba3bd12be8b5 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:53.392110 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-90052ce9-4e46-408f-8c88-ba3bd12be8b5 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] [instance: 1b5139ef-315a-4a27-9ec4-32c148154072] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:53.398211 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-90052ce9-4e46-408f-8c88-ba3bd12be8b5 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:53.406172 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-90052ce9-4e46-408f-8c88-ba3bd12be8b5 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:53.409700 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-90052ce9-4e46-408f-8c88-ba3bd12be8b5 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:53.410313 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-90052ce9-4e46-408f-8c88-ba3bd12be8b5 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:53.447442 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4dffefa6-d076-45e2-9542-e0661bae8357 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:53.455026 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4dffefa6-d076-45e2-9542-e0661bae8357 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e" status: 200 len: 1309 microversion: 2.1 time: 0.502909 Apr 16 21:08:53.460153 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 298/556] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:52 2022] GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e => generated 1309 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:08:53.574074 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-90052ce9-4e46-408f-8c88-ba3bd12be8b5 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01db629e453f41ff8debfefd155aa14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676a0384d9444d9d8e42073806728c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:53.583311 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-90052ce9-4e46-408f-8c88-ba3bd12be8b5 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5139ef-315a-4a27-9ec4-32c148154072" status: 200 len: 1479 microversion: 2.1 time: 0.196227 Apr 16 21:08:53.584291 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 259/557] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:53 2022] GET /compute/v2.1/servers/1b5139ef-315a-4a27-9ec4-32c148154072 => generated 1479 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:53.611001 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-17434e9f-7ca1-4d23-92e7-dca3f3ed302c tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:53.611883 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-17434e9f-7ca1-4d23-92e7-dca3f3ed302c tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] [instance: 84fdd641-4d23-472a-8b8f-fded89dbcc32] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:53.618675 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-17434e9f-7ca1-4d23-92e7-dca3f3ed302c tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:53.619140 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-17434e9f-7ca1-4d23-92e7-dca3f3ed302c tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:53.620156 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-17434e9f-7ca1-4d23-92e7-dca3f3ed302c tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:53.620778 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-17434e9f-7ca1-4d23-92e7-dca3f3ed302c tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:53.740902 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-20969e85-ba67-4ee8-9ab5-f7bcde70a57b tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:53.740902 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-20969e85-ba67-4ee8-9ab5-f7bcde70a57b tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] [instance: bf93495b-7d10-4cb2-9353-0302e654d8fa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:53.747959 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-20969e85-ba67-4ee8-9ab5-f7bcde70a57b tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:53.751260 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-20969e85-ba67-4ee8-9ab5-f7bcde70a57b tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:53.752686 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-20969e85-ba67-4ee8-9ab5-f7bcde70a57b tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:53.752686 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-20969e85-ba67-4ee8-9ab5-f7bcde70a57b tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:53.905632 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-20969e85-ba67-4ee8-9ab5-f7bcde70a57b tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae06aafd64d46deacb8ae1791676d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1924a4ceffaf45d0bf2bd76ebb421bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:53.923280 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-20969e85-ba67-4ee8-9ab5-f7bcde70a57b tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] 10.222.0.20 "GET /compute/v2.1/servers/bf93495b-7d10-4cb2-9353-0302e654d8fa" status: 200 len: 1279 microversion: 2.1 time: 0.190349 Apr 16 21:08:53.924073 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 260/558] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:53 2022] GET /compute/v2.1/servers/bf93495b-7d10-4cb2-9353-0302e654d8fa => generated 1279 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:08:53.937155 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-371e2666-f299-4e41-bebb-8cdd02e25242 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:53.939830 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-371e2666-f299-4e41-bebb-8cdd02e25242 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: ffc4d9b2-dd4f-44dc-a189-354eff7a5573] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:53.947568 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-371e2666-f299-4e41-bebb-8cdd02e25242 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:53.948014 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-371e2666-f299-4e41-bebb-8cdd02e25242 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:53.949007 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-371e2666-f299-4e41-bebb-8cdd02e25242 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:53.949747 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-371e2666-f299-4e41-bebb-8cdd02e25242 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:54.039830 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-371e2666-f299-4e41-bebb-8cdd02e25242 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:54.048842 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-371e2666-f299-4e41-bebb-8cdd02e25242 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:54.055900 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-371e2666-f299-4e41-bebb-8cdd02e25242 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:54.057278 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-371e2666-f299-4e41-bebb-8cdd02e25242 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573" status: 200 len: 1321 microversion: 2.25 time: 0.123979 Apr 16 21:08:54.057922 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 261/559] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:08:53 2022] GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573 => generated 1321 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:08:54.119060 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-ebbfb6ba-46be-4f3b-9ed4-8649622b22d5 req-0c467b04-2dfa-4d66-bbc2-5f32f9c2c679 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "84fdd641-4d23-472a-8b8f-fded89dbcc32", "name": "network-vif-deleted", "tag": "bab3ec3e-82d0-419b-9ccb-11f635214fe4"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:54.125471 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-17434e9f-7ca1-4d23-92e7-dca3f3ed302c tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160e460966db4a7e8b697e26de50d0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487e280d7b014a7196cd1e4e9165cc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:54.148126 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-17434e9f-7ca1-4d23-92e7-dca3f3ed302c tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] 10.222.0.20 "GET /compute/v2.1/servers/84fdd641-4d23-472a-8b8f-fded89dbcc32" status: 200 len: 1476 microversion: 2.1 time: 0.529369 Apr 16 21:08:54.153573 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 299/560] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:53 2022] GET /compute/v2.1/servers/84fdd641-4d23-472a-8b8f-fded89dbcc32 => generated 1476 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:54.156392 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-ebbfb6ba-46be-4f3b-9ed4-8649622b22d5 req-0c467b04-2dfa-4d66-bbc2-5f32f9c2c679 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:54.160795 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-ebbfb6ba-46be-4f3b-9ed4-8649622b22d5 req-0c467b04-2dfa-4d66-bbc2-5f32f9c2c679 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:54.189320 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-ebbfb6ba-46be-4f3b-9ed4-8649622b22d5 req-0c467b04-2dfa-4d66-bbc2-5f32f9c2c679 service nova] Creating event network-vif-deleted:bab3ec3e-82d0-419b-9ccb-11f635214fe4 for instance 84fdd641-4d23-472a-8b8f-fded89dbcc32 on nch2-master-1 Apr 16 21:08:54.195195 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-ebbfb6ba-46be-4f3b-9ed4-8649622b22d5 req-0c467b04-2dfa-4d66-bbc2-5f32f9c2c679 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081571 Apr 16 21:08:54.196234 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 262/561] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:08:54.485006 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fedd3460-0d85-4abe-8987-04f24af3225a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:54.485844 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fedd3460-0d85-4abe-8987-04f24af3225a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: e641f7ec-0d41-4439-bc77-7158fb9d346e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:54.492986 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fedd3460-0d85-4abe-8987-04f24af3225a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:54.493458 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fedd3460-0d85-4abe-8987-04f24af3225a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:54.496202 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fedd3460-0d85-4abe-8987-04f24af3225a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:54.496202 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fedd3460-0d85-4abe-8987-04f24af3225a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:54.602073 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fc2da127-2f9b-4709-b0a3-a44150dba169 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:54.602772 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-fc2da127-2f9b-4709-b0a3-a44150dba169 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] [instance: 1b5139ef-315a-4a27-9ec4-32c148154072] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:54.612093 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fc2da127-2f9b-4709-b0a3-a44150dba169 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:54.623894 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fc2da127-2f9b-4709-b0a3-a44150dba169 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:54.626746 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fc2da127-2f9b-4709-b0a3-a44150dba169 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:54.627377 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fc2da127-2f9b-4709-b0a3-a44150dba169 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:54.883239 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fedd3460-0d85-4abe-8987-04f24af3225a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:54.906223 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fedd3460-0d85-4abe-8987-04f24af3225a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e" status: 200 len: 1309 microversion: 2.1 time: 0.412205 Apr 16 21:08:54.917774 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 300/562] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:54 2022] GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e => generated 1309 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:54.922669 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-799caf52-043b-4d84-9a0e-1dcbc8648447 req-766299dd-8da6-4c2f-ad64-614306ad2158 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e641f7ec-0d41-4439-bc77-7158fb9d346e", "name": "network-vif-plugged", "status": "completed", "tag": "cde5a5c3-65ba-417d-8651-74ec3a50ff0d"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:54.932359 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-799caf52-043b-4d84-9a0e-1dcbc8648447 req-766299dd-8da6-4c2f-ad64-614306ad2158 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:54.932995 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-799caf52-043b-4d84-9a0e-1dcbc8648447 req-766299dd-8da6-4c2f-ad64-614306ad2158 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:54.954583 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-799caf52-043b-4d84-9a0e-1dcbc8648447 req-766299dd-8da6-4c2f-ad64-614306ad2158 service nova] Creating event network-vif-plugged:cde5a5c3-65ba-417d-8651-74ec3a50ff0d for instance e641f7ec-0d41-4439-bc77-7158fb9d346e on nch1-master-1 Apr 16 21:08:54.960749 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-799caf52-043b-4d84-9a0e-1dcbc8648447 req-766299dd-8da6-4c2f-ad64-614306ad2158 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041237 Apr 16 21:08:54.961714 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 301/563] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:08:54.967079 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-228d3c33-8855-4735-801d-1a91d9cfe096 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:54.967792 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-228d3c33-8855-4735-801d-1a91d9cfe096 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] [instance: bf93495b-7d10-4cb2-9353-0302e654d8fa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:54.976372 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-228d3c33-8855-4735-801d-1a91d9cfe096 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:54.977086 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-228d3c33-8855-4735-801d-1a91d9cfe096 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:54.978296 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-228d3c33-8855-4735-801d-1a91d9cfe096 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:54.980902 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-228d3c33-8855-4735-801d-1a91d9cfe096 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:55.072712 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-228d3c33-8855-4735-801d-1a91d9cfe096 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae06aafd64d46deacb8ae1791676d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1924a4ceffaf45d0bf2bd76ebb421bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:55.084527 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-228d3c33-8855-4735-801d-1a91d9cfe096 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] 10.222.0.20 "GET /compute/v2.1/servers/bf93495b-7d10-4cb2-9353-0302e654d8fa" status: 200 len: 1277 microversion: 2.1 time: 0.121261 Apr 16 21:08:55.085380 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 302/564] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:54 2022] GET /compute/v2.1/servers/bf93495b-7d10-4cb2-9353-0302e654d8fa => generated 1277 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:55.092250 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fe4aace1-5ced-46e9-8582-e31136545c97 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:55.093170 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fe4aace1-5ced-46e9-8582-e31136545c97 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: ffc4d9b2-dd4f-44dc-a189-354eff7a5573] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:55.101576 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fe4aace1-5ced-46e9-8582-e31136545c97 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:55.102310 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fe4aace1-5ced-46e9-8582-e31136545c97 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:55.103389 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fe4aace1-5ced-46e9-8582-e31136545c97 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:55.104290 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fe4aace1-5ced-46e9-8582-e31136545c97 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:55.345814 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fe4aace1-5ced-46e9-8582-e31136545c97 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:55.359160 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fe4aace1-5ced-46e9-8582-e31136545c97 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:55.360767 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fe4aace1-5ced-46e9-8582-e31136545c97 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:55.361892 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fe4aace1-5ced-46e9-8582-e31136545c97 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573" status: 200 len: 1361 microversion: 2.25 time: 0.274914 Apr 16 21:08:55.362440 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 303/565] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:08:55 2022] GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573 => generated 1361 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:08:55.370338 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b2846712-3926-4105-a4b6-dab948d884e8 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:55.370955 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b2846712-3926-4105-a4b6-dab948d884e8 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] [instance: 84fdd641-4d23-472a-8b8f-fded89dbcc32] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:55.379757 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b2846712-3926-4105-a4b6-dab948d884e8 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:55.380797 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b2846712-3926-4105-a4b6-dab948d884e8 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:55.381663 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b2846712-3926-4105-a4b6-dab948d884e8 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:55.382061 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b2846712-3926-4105-a4b6-dab948d884e8 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:55.425463 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b2846712-3926-4105-a4b6-dab948d884e8 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:55.426315 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b2846712-3926-4105-a4b6-dab948d884e8 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:55.427505 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-b2846712-3926-4105-a4b6-dab948d884e8 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lazy-loading 'fault' on Instance uuid 84fdd641-4d23-472a-8b8f-fded89dbcc32 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:08:55.459532 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-fc2da127-2f9b-4709-b0a3-a44150dba169 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01db629e453f41ff8debfefd155aa14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676a0384d9444d9d8e42073806728c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:55.470373 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fc2da127-2f9b-4709-b0a3-a44150dba169 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5139ef-315a-4a27-9ec4-32c148154072" status: 200 len: 1479 microversion: 2.1 time: 0.873463 Apr 16 21:08:55.484687 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 263/566] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:54 2022] GET /compute/v2.1/servers/1b5139ef-315a-4a27-9ec4-32c148154072 => generated 1479 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:55.518592 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b2846712-3926-4105-a4b6-dab948d884e8 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '160e460966db4a7e8b697e26de50d0ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '487e280d7b014a7196cd1e4e9165cc7e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:55.529360 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b2846712-3926-4105-a4b6-dab948d884e8 tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] 10.222.0.20 "GET /compute/v2.1/servers/84fdd641-4d23-472a-8b8f-fded89dbcc32" status: 200 len: 1311 microversion: 2.1 time: 0.165340 Apr 16 21:08:55.539431 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 304/567] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:55 2022] GET /compute/v2.1/servers/84fdd641-4d23-472a-8b8f-fded89dbcc32 => generated 1311 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:55.924698 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ea4bf87f-a984-467e-a7d5-3f9be54ebaff tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:55.925603 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ea4bf87f-a984-467e-a7d5-3f9be54ebaff tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: e641f7ec-0d41-4439-bc77-7158fb9d346e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:55.952521 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ea4bf87f-a984-467e-a7d5-3f9be54ebaff tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:55.952977 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ea4bf87f-a984-467e-a7d5-3f9be54ebaff tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:55.956123 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ea4bf87f-a984-467e-a7d5-3f9be54ebaff tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:55.956612 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ea4bf87f-a984-467e-a7d5-3f9be54ebaff tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:56.239952 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c3c8122c-9103-4db1-9ff2-5264802e6462 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-2061454839", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:56.298436 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ea4bf87f-a984-467e-a7d5-3f9be54ebaff tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:56.308826 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ea4bf87f-a984-467e-a7d5-3f9be54ebaff tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e" status: 200 len: 1309 microversion: 2.1 time: 0.388344 Apr 16 21:08:56.309792 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 305/568] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:55 2022] GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e => generated 1309 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:08:56.316920 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-99537583-f8db-4570-8e10-e901bfb9ec71 req-aa147ce0-5e42-4a64-a1a8-6907996a96b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b5139ef-315a-4a27-9ec4-32c148154072", "name": "network-vif-deleted", "tag": "b2b1f926-26c2-4967-962d-9fcdd23eac15"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:56.320842 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-c3c8122c-9103-4db1-9ff2-5264802e6462 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] validate_networks() for None {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:08:56.326765 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-99537583-f8db-4570-8e10-e901bfb9ec71 req-aa147ce0-5e42-4a64-a1a8-6907996a96b6 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:56.327218 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-99537583-f8db-4570-8e10-e901bfb9ec71 req-aa147ce0-5e42-4a64-a1a8-6907996a96b6 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:56.338912 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-99537583-f8db-4570-8e10-e901bfb9ec71 req-aa147ce0-5e42-4a64-a1a8-6907996a96b6 service nova] Creating event network-vif-deleted:b2b1f926-26c2-4967-962d-9fcdd23eac15 for instance 1b5139ef-315a-4a27-9ec4-32c148154072 on nch1-master-1 Apr 16 21:08:56.344759 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-99537583-f8db-4570-8e10-e901bfb9ec71 req-aa147ce0-5e42-4a64-a1a8-6907996a96b6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032222 Apr 16 21:08:56.346204 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 306/569] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:08:56.352003 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2c3dfe23-a3d9-4040-bbb7-452f1be92fdc tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:56.353330 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2c3dfe23-a3d9-4040-bbb7-452f1be92fdc tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] [instance: bf93495b-7d10-4cb2-9353-0302e654d8fa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:56.369728 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2c3dfe23-a3d9-4040-bbb7-452f1be92fdc tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:56.370195 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2c3dfe23-a3d9-4040-bbb7-452f1be92fdc tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:56.370996 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2c3dfe23-a3d9-4040-bbb7-452f1be92fdc tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:56.371439 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2c3dfe23-a3d9-4040-bbb7-452f1be92fdc tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:56.649261 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2c3dfe23-a3d9-4040-bbb7-452f1be92fdc tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae06aafd64d46deacb8ae1791676d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1924a4ceffaf45d0bf2bd76ebb421bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:56.663591 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2c3dfe23-a3d9-4040-bbb7-452f1be92fdc tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] 10.222.0.20 "GET /compute/v2.1/servers/bf93495b-7d10-4cb2-9353-0302e654d8fa" status: 200 len: 1319 microversion: 2.1 time: 0.314744 Apr 16 21:08:56.665235 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 307/570] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:56 2022] GET /compute/v2.1/servers/bf93495b-7d10-4cb2-9353-0302e654d8fa => generated 1319 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:56.682942 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-c3c8122c-9103-4db1-9ff2-5264802e6462 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:08:56.683379 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-c3c8122c-9103-4db1-9ff2-5264802e6462 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:08:56.684014 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-c3c8122c-9103-4db1-9ff2-5264802e6462 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:08:56.687965 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-c3c8122c-9103-4db1-9ff2-5264802e6462 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:08:56.687965 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-c3c8122c-9103-4db1-9ff2-5264802e6462 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:08:56.692541 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d4006b99-1935-4382-844a-e99f1fe372aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:56.693506 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d4006b99-1935-4382-844a-e99f1fe372aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: ffc4d9b2-dd4f-44dc-a189-354eff7a5573] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:56.699882 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c3c8122c-9103-4db1-9ff2-5264802e6462 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:56.701254 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d4006b99-1935-4382-844a-e99f1fe372aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:56.701700 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d4006b99-1935-4382-844a-e99f1fe372aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:56.702219 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c3c8122c-9103-4db1-9ff2-5264802e6462 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:56.703260 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d4006b99-1935-4382-844a-e99f1fe372aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:56.703858 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d4006b99-1935-4382-844a-e99f1fe372aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:56.704391 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c3c8122c-9103-4db1-9ff2-5264802e6462 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:56.704850 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c3c8122c-9103-4db1-9ff2-5264802e6462 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:56.730876 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-c3c8122c-9103-4db1-9ff2-5264802e6462 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Getting quotas for project ba3fef3234544544870ea9ee02d5b344. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:08:56.738013 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-c3c8122c-9103-4db1-9ff2-5264802e6462 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Getting quotas for user 7fa9708327d54bbea48ed890d0506ea2 and project ba3fef3234544544870ea9ee02d5b344. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:08:56.751962 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c3c8122c-9103-4db1-9ff2-5264802e6462 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:08:56.754403 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c3c8122c-9103-4db1-9ff2-5264802e6462 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:08:56.919114 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c3c8122c-9103-4db1-9ff2-5264802e6462 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.166806 Apr 16 21:08:56.921848 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 264/571] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:08:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1170 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 16 21:08:56.929356 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-30582263-0746-41da-9048-6985c682a3c5 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:56.930240 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-30582263-0746-41da-9048-6985c682a3c5 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] [instance: 1b5139ef-315a-4a27-9ec4-32c148154072] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:56.955360 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-30582263-0746-41da-9048-6985c682a3c5 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:56.959777 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-30582263-0746-41da-9048-6985c682a3c5 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:56.972714 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-30582263-0746-41da-9048-6985c682a3c5 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:56.980896 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-30582263-0746-41da-9048-6985c682a3c5 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:57.059331 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d4006b99-1935-4382-844a-e99f1fe372aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:57.069014 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d4006b99-1935-4382-844a-e99f1fe372aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:57.070537 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d4006b99-1935-4382-844a-e99f1fe372aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:57.076495 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-30582263-0746-41da-9048-6985c682a3c5 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:57.076955 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-30582263-0746-41da-9048-6985c682a3c5 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:57.077422 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-30582263-0746-41da-9048-6985c682a3c5 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lazy-loading 'fault' on Instance uuid 1b5139ef-315a-4a27-9ec4-32c148154072 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:08:57.080443 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d4006b99-1935-4382-844a-e99f1fe372aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573" status: 200 len: 1361 microversion: 2.25 time: 0.410985 Apr 16 21:08:57.088422 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 308/572] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:08:56 2022] GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573 => generated 1361 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:08:57.104207 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c60c5d51-1fe1-4aa3-86f0-3e741a44745a tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:57.106343 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c60c5d51-1fe1-4aa3-86f0-3e741a44745a tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] [instance: 84fdd641-4d23-472a-8b8f-fded89dbcc32] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:57.121677 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c60c5d51-1fe1-4aa3-86f0-3e741a44745a tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:57.121677 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c60c5d51-1fe1-4aa3-86f0-3e741a44745a tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:57.122669 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c60c5d51-1fe1-4aa3-86f0-3e741a44745a tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:57.123219 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c60c5d51-1fe1-4aa3-86f0-3e741a44745a tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:57.141684 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-c60c5d51-1fe1-4aa3-86f0-3e741a44745a tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] HTTP exception thrown: Instance 84fdd641-4d23-472a-8b8f-fded89dbcc32 could not be found. Apr 16 21:08:57.142866 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c60c5d51-1fe1-4aa3-86f0-3e741a44745a tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] Returning 404 to user: Instance 84fdd641-4d23-472a-8b8f-fded89dbcc32 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:08:57.144583 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c60c5d51-1fe1-4aa3-86f0-3e741a44745a tempest-ServersAdminNegativeTestJSON-1023558402 tempest-ServersAdminNegativeTestJSON-1023558402-project] 10.222.0.20 "GET /compute/v2.1/servers/84fdd641-4d23-472a-8b8f-fded89dbcc32" status: 404 len: 111 microversion: 2.1 time: 0.053844 Apr 16 21:08:57.144848 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 309/573] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:57 2022] GET /compute/v2.1/servers/84fdd641-4d23-472a-8b8f-fded89dbcc32 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:08:57.151466 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-07d2cdd8-3e57-47b9-b796-91cf3746eff2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1387265064", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:57.260192 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-07d2cdd8-3e57-47b9-b796-91cf3746eff2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] validate_networks() for None {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:08:57.320319 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-30582263-0746-41da-9048-6985c682a3c5 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '01db629e453f41ff8debfefd155aa14c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '676a0384d9444d9d8e42073806728c43', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:57.328480 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-30582263-0746-41da-9048-6985c682a3c5 tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5139ef-315a-4a27-9ec4-32c148154072" status: 200 len: 1313 microversion: 2.1 time: 0.405370 Apr 16 21:08:57.329634 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 265/574] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:56 2022] GET /compute/v2.1/servers/1b5139ef-315a-4a27-9ec4-32c148154072 => generated 1313 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:57.335022 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-a2759a8b-27fb-4cf2-82eb-5bb299c8f173 req-c3cdf487-7065-43e7-8c19-80e07379c46f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffc4d9b2-dd4f-44dc-a189-354eff7a5573", "tag": "fb4825e7-d0af-4d1c-a416-731410a77b41"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:57.351024 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-a2759a8b-27fb-4cf2-82eb-5bb299c8f173 req-c3cdf487-7065-43e7-8c19-80e07379c46f service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:57.358800 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-a2759a8b-27fb-4cf2-82eb-5bb299c8f173 req-c3cdf487-7065-43e7-8c19-80e07379c46f service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:57.376717 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-a2759a8b-27fb-4cf2-82eb-5bb299c8f173 req-c3cdf487-7065-43e7-8c19-80e07379c46f service nova] Creating event network-changed:fb4825e7-d0af-4d1c-a416-731410a77b41 for instance ffc4d9b2-dd4f-44dc-a189-354eff7a5573 on nch2-master-1 Apr 16 21:08:57.382024 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-a2759a8b-27fb-4cf2-82eb-5bb299c8f173 req-c3cdf487-7065-43e7-8c19-80e07379c46f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051008 Apr 16 21:08:57.382695 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 266/575] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:08:57.387895 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d1c74f5f-17ac-423d-96ad-c06ea90b7d42 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:57.390964 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d1c74f5f-17ac-423d-96ad-c06ea90b7d42 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: e641f7ec-0d41-4439-bc77-7158fb9d346e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:57.394887 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d1c74f5f-17ac-423d-96ad-c06ea90b7d42 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:57.395523 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d1c74f5f-17ac-423d-96ad-c06ea90b7d42 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:57.397029 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d1c74f5f-17ac-423d-96ad-c06ea90b7d42 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:57.397615 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d1c74f5f-17ac-423d-96ad-c06ea90b7d42 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:57.647040 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d1c74f5f-17ac-423d-96ad-c06ea90b7d42 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:57.655707 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d1c74f5f-17ac-423d-96ad-c06ea90b7d42 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e" status: 200 len: 1493 microversion: 2.1 time: 0.271523 Apr 16 21:08:57.657101 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 267/576] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:57 2022] GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e => generated 1493 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:57.685096 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-07d2cdd8-3e57-47b9-b796-91cf3746eff2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:08:57.685626 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-07d2cdd8-3e57-47b9-b796-91cf3746eff2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:08:57.686135 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-07d2cdd8-3e57-47b9-b796-91cf3746eff2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:08:57.686522 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-07d2cdd8-3e57-47b9-b796-91cf3746eff2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:08:57.687359 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-07d2cdd8-3e57-47b9-b796-91cf3746eff2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:08:57.707457 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-07d2cdd8-3e57-47b9-b796-91cf3746eff2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:57.721527 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-07d2cdd8-3e57-47b9-b796-91cf3746eff2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:57.724450 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-07d2cdd8-3e57-47b9-b796-91cf3746eff2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:57.725104 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-07d2cdd8-3e57-47b9-b796-91cf3746eff2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:57.770966 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-07d2cdd8-3e57-47b9-b796-91cf3746eff2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Getting quotas for project ba3fef3234544544870ea9ee02d5b344. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:08:57.778112 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-07d2cdd8-3e57-47b9-b796-91cf3746eff2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Getting quotas for user 7fa9708327d54bbea48ed890d0506ea2 and project ba3fef3234544544870ea9ee02d5b344. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:08:57.793884 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-07d2cdd8-3e57-47b9-b796-91cf3746eff2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:08:57.800326 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-07d2cdd8-3e57-47b9-b796-91cf3746eff2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4196bcfc-2c28-485b-8c51-5b460fee70e2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:08:58.024774 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-07d2cdd8-3e57-47b9-b796-91cf3746eff2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.877776 Apr 16 21:08:58.047141 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 310/577] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:08:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:08:58.064507 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-186bf356-249e-4095-af53-a8eb17277abf tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:58.068553 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-186bf356-249e-4095-af53-a8eb17277abf tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] [instance: bf93495b-7d10-4cb2-9353-0302e654d8fa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:58.084282 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-186bf356-249e-4095-af53-a8eb17277abf tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:58.085025 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-186bf356-249e-4095-af53-a8eb17277abf tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:58.086046 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-186bf356-249e-4095-af53-a8eb17277abf tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:58.088258 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-186bf356-249e-4095-af53-a8eb17277abf tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:58.099456 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f7ffec78-2423-4a26-bce7-bf365972a559 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:58.100734 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f7ffec78-2423-4a26-bce7-bf365972a559 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] [instance: e641f7ec-0d41-4439-bc77-7158fb9d346e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:58.115657 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f7ffec78-2423-4a26-bce7-bf365972a559 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:58.116116 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f7ffec78-2423-4a26-bce7-bf365972a559 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:58.116940 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f7ffec78-2423-4a26-bce7-bf365972a559 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:58.117384 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f7ffec78-2423-4a26-bce7-bf365972a559 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:58.313978 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-186bf356-249e-4095-af53-a8eb17277abf tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae06aafd64d46deacb8ae1791676d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1924a4ceffaf45d0bf2bd76ebb421bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:58.322102 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-186bf356-249e-4095-af53-a8eb17277abf tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] 10.222.0.20 "GET /compute/v2.1/servers/bf93495b-7d10-4cb2-9353-0302e654d8fa" status: 200 len: 1319 microversion: 2.1 time: 0.271657 Apr 16 21:08:58.331611 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 311/578] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:58 2022] GET /compute/v2.1/servers/bf93495b-7d10-4cb2-9353-0302e654d8fa => generated 1319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:58.336867 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3b4a0cca-02ff-42ec-b484-fa0552e9d872 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:58.337496 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3b4a0cca-02ff-42ec-b484-fa0552e9d872 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4196bcfc-2c28-485b-8c51-5b460fee70e2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:58.405361 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3b4a0cca-02ff-42ec-b484-fa0552e9d872 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:58.406143 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f7ffec78-2423-4a26-bce7-bf365972a559 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e" status: 200 len: 1644 microversion: 2.1 time: 0.716160 Apr 16 21:08:58.407077 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 268/579] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:57 2022] GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e => generated 1644 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:08:58.413059 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-216702b7-97ec-4eed-81ca-09e1147e31f5 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:58.413852 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-216702b7-97ec-4eed-81ca-09e1147e31f5 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: ffc4d9b2-dd4f-44dc-a189-354eff7a5573] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:58.414983 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3b4a0cca-02ff-42ec-b484-fa0552e9d872 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4196bcfc-2c28-485b-8c51-5b460fee70e2" status: 200 len: 1214 microversion: 2.1 time: 0.082016 Apr 16 21:08:58.416031 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 312/580] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:58 2022] GET /compute/v2.1/servers/4196bcfc-2c28-485b-8c51-5b460fee70e2 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:58.421131 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0cff8d41-aace-42da-a696-7fb48dfaff5c tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] Calling method '.version_select at 0x7fbb96b65310>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:58.444482 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-216702b7-97ec-4eed-81ca-09e1147e31f5 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:58.446184 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-216702b7-97ec-4eed-81ca-09e1147e31f5 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:58.447035 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-216702b7-97ec-4eed-81ca-09e1147e31f5 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:58.447487 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-216702b7-97ec-4eed-81ca-09e1147e31f5 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:58.467318 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0cff8d41-aace-42da-a696-7fb48dfaff5c tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] 10.222.0.20 "GET /compute/v2.1/images/7f67c23b-80d8-4b9e-b06a-9d1240562695" status: 200 len: 636 microversion: 2.1 time: 0.049976 Apr 16 21:08:58.467851 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 313/581] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:08:58 2022] GET /compute/v2.1/images/7f67c23b-80d8-4b9e-b06a-9d1240562695 => generated 636 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:08:58.472456 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-837b9ecc-850c-4344-bf2c-98176ababe6f tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:58.473066 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-837b9ecc-850c-4344-bf2c-98176ababe6f tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] [instance: 1b5139ef-315a-4a27-9ec4-32c148154072] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:58.480732 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-837b9ecc-850c-4344-bf2c-98176ababe6f tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:58.481304 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-837b9ecc-850c-4344-bf2c-98176ababe6f tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:58.482390 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-837b9ecc-850c-4344-bf2c-98176ababe6f tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:58.482993 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-837b9ecc-850c-4344-bf2c-98176ababe6f tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:58.497144 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-837b9ecc-850c-4344-bf2c-98176ababe6f tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] HTTP exception thrown: Instance 1b5139ef-315a-4a27-9ec4-32c148154072 could not be found. Apr 16 21:08:58.497759 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-837b9ecc-850c-4344-bf2c-98176ababe6f tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] Returning 404 to user: Instance 1b5139ef-315a-4a27-9ec4-32c148154072 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:08:58.498602 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-837b9ecc-850c-4344-bf2c-98176ababe6f tempest-ServerDiagnosticsNegativeTest-28835504 tempest-ServerDiagnosticsNegativeTest-28835504-project] 10.222.0.20 "GET /compute/v2.1/servers/1b5139ef-315a-4a27-9ec4-32c148154072" status: 404 len: 111 microversion: 2.1 time: 0.029825 Apr 16 21:08:58.499154 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 314/582] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:58 2022] GET /compute/v2.1/servers/1b5139ef-315a-4a27-9ec4-32c148154072 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:08:58.504017 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-a9ec723b-7a3c-4fd3-b6e1-2035530651a0 req-dc7d6afc-051e-4f0e-b2b5-24ab2b2574fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf93495b-7d10-4cb2-9353-0302e654d8fa", "tag": "9d341b6f-b81c-4d6c-924c-e8dc1d4fbebc"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:58.527362 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-a9ec723b-7a3c-4fd3-b6e1-2035530651a0 req-dc7d6afc-051e-4f0e-b2b5-24ab2b2574fe service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:58.527823 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-a9ec723b-7a3c-4fd3-b6e1-2035530651a0 req-dc7d6afc-051e-4f0e-b2b5-24ab2b2574fe service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:58.542382 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-a9ec723b-7a3c-4fd3-b6e1-2035530651a0 req-dc7d6afc-051e-4f0e-b2b5-24ab2b2574fe service nova] Creating event network-changed:9d341b6f-b81c-4d6c-924c-e8dc1d4fbebc for instance bf93495b-7d10-4cb2-9353-0302e654d8fa on nch2-master-1 Apr 16 21:08:58.548439 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-a9ec723b-7a3c-4fd3-b6e1-2035530651a0 req-dc7d6afc-051e-4f0e-b2b5-24ab2b2574fe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047882 Apr 16 21:08:58.549342 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 315/583] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:08:58.554947 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a290ee55-8278-4050-8a86-247124ed8f99 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:58.555655 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a290ee55-8278-4050-8a86-247124ed8f99 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] [instance: e641f7ec-0d41-4439-bc77-7158fb9d346e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:58.562411 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a290ee55-8278-4050-8a86-247124ed8f99 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:58.562884 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a290ee55-8278-4050-8a86-247124ed8f99 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:58.564121 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a290ee55-8278-4050-8a86-247124ed8f99 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:58.564673 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a290ee55-8278-4050-8a86-247124ed8f99 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:58.630318 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-216702b7-97ec-4eed-81ca-09e1147e31f5 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:58.639987 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-216702b7-97ec-4eed-81ca-09e1147e31f5 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:58.647268 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-216702b7-97ec-4eed-81ca-09e1147e31f5 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:58.648358 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-216702b7-97ec-4eed-81ca-09e1147e31f5 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573" status: 200 len: 1361 microversion: 2.25 time: 0.239895 Apr 16 21:08:58.649287 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 269/584] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:08:58 2022] GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573 => generated 1361 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:08:58.653931 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7ff5a516-40b7-4d02-b5df-eb807afe3c32 tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] Action: 'update_all', calling method: .version_select at 0x7fbb96e0c040>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:58.700597 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a290ee55-8278-4050-8a86-247124ed8f99 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e" status: 200 len: 1644 microversion: 2.1 time: 0.149916 Apr 16 21:08:58.701291 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 316/585] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:58 2022] GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e => generated 1644 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:58.714773 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-7ff5a516-40b7-4d02-b5df-eb807afe3c32 tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] Getting quotas for project 5e55104ab1e74c14b13b8de5c1f64aee. Resources: dict_keys(['metadata_items']) {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:08:58.716858 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7d89c7cc-0860-4105-bd3b-e7d074c2fa1e tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:58.718209 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:08:58.718209 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:08:58.719444 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7d89c7cc-0860-4105-bd3b-e7d074c2fa1e tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:58.719931 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7d89c7cc-0860-4105-bd3b-e7d074c2fa1e tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:58.720560 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-7ff5a516-40b7-4d02-b5df-eb807afe3c32 tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] Getting quotas for user a95e5ceb71ea4cdbb44fea8a2aa50c3d and project 5e55104ab1e74c14b13b8de5c1f64aee. Resources: dict_keys(['metadata_items']) {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:08:58.720778 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7d89c7cc-0860-4105-bd3b-e7d074c2fa1e tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:58.721225 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7d89c7cc-0860-4105-bd3b-e7d074c2fa1e tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:58.744576 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7d89c7cc-0860-4105-bd3b-e7d074c2fa1e tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.031253 Apr 16 21:08:58.745308 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 317/586] 10.222.0.20 () {58 vars in 1175 bytes} [Sat Apr 16 21:08:58 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:08:58.756293 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7d917795-e57f-494d-bba7-08b45a1c0141 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:08:58.757460 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7d917795-e57f-494d-bba7-08b45a1c0141 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] [instance: e641f7ec-0d41-4439-bc77-7158fb9d346e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:58.763729 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7d917795-e57f-494d-bba7-08b45a1c0141 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:58.764211 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7d917795-e57f-494d-bba7-08b45a1c0141 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:58.765073 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7d917795-e57f-494d-bba7-08b45a1c0141 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:58.765526 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7d917795-e57f-494d-bba7-08b45a1c0141 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:58.792795 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-7d917795-e57f-494d-bba7-08b45a1c0141 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lazy-loading 'flavor' on Instance uuid e641f7ec-0d41-4439-bc77-7158fb9d346e {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:08:58.805927 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7d917795-e57f-494d-bba7-08b45a1c0141 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] [instance: e641f7ec-0d41-4439-bc77-7158fb9d346e] Going to try to live migrate instance to nch2-master-1 {{(pid=137408) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Apr 16 21:08:59.203612 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7ff5a516-40b7-4d02-b5df-eb807afe3c32 tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] 10.222.0.20 "PUT /compute/v2.1/images/7f67c23b-80d8-4b9e-b06a-9d1240562695/metadata" status: 200 len: 61 microversion: 2.1 time: 0.552337 Apr 16 21:08:59.204023 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 270/587] 10.222.0.20 () {60 vars in 1279 bytes} [Sat Apr 16 21:08:58 2022] PUT /compute/v2.1/images/7f67c23b-80d8-4b9e-b06a-9d1240562695/metadata => generated 61 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:08:59.213263 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-30531861-0547-4d30-88d1-8409767f49ec tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] Calling method '.version_select at 0x7fbb96e04dc0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:59.682249 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-30531861-0547-4d30-88d1-8409767f49ec tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] 10.222.0.20 "DELETE /compute/v2.1/images/7f67c23b-80d8-4b9e-b06a-9d1240562695/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.472892 Apr 16 21:08:59.687231 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 271/588] 10.222.0.20 () {58 vars in 1295 bytes} [Sat Apr 16 21:08:59 2022] DELETE /compute/v2.1/images/7f67c23b-80d8-4b9e-b06a-9d1240562695/metadata/os_version => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 16 21:08:59.693814 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-55dab38c-3172-4683-9991-b7775f97098a tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:59.694559 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-55dab38c-3172-4683-9991-b7775f97098a tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] [instance: bf93495b-7d10-4cb2-9353-0302e654d8fa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:59.703595 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-55dab38c-3172-4683-9991-b7775f97098a tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:59.706253 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-55dab38c-3172-4683-9991-b7775f97098a tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:59.706253 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-55dab38c-3172-4683-9991-b7775f97098a tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:59.706253 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-55dab38c-3172-4683-9991-b7775f97098a tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:59.851588 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-55dab38c-3172-4683-9991-b7775f97098a tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae06aafd64d46deacb8ae1791676d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1924a4ceffaf45d0bf2bd76ebb421bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:59.860529 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-55dab38c-3172-4683-9991-b7775f97098a tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] 10.222.0.20 "GET /compute/v2.1/servers/bf93495b-7d10-4cb2-9353-0302e654d8fa" status: 200 len: 1319 microversion: 2.1 time: 0.170959 Apr 16 21:08:59.861119 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 272/589] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:59 2022] GET /compute/v2.1/servers/bf93495b-7d10-4cb2-9353-0302e654d8fa => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:59.867348 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6b2189f6-fe14-4385-8081-ea4fe61d0a82 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:59.868151 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6b2189f6-fe14-4385-8081-ea4fe61d0a82 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4196bcfc-2c28-485b-8c51-5b460fee70e2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:59.885446 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6b2189f6-fe14-4385-8081-ea4fe61d0a82 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:59.887335 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6b2189f6-fe14-4385-8081-ea4fe61d0a82 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:59.888202 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6b2189f6-fe14-4385-8081-ea4fe61d0a82 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:59.888668 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6b2189f6-fe14-4385-8081-ea4fe61d0a82 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:59.957853 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6b2189f6-fe14-4385-8081-ea4fe61d0a82 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:08:59.966141 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6b2189f6-fe14-4385-8081-ea4fe61d0a82 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4196bcfc-2c28-485b-8c51-5b460fee70e2" status: 200 len: 1210 microversion: 2.1 time: 0.104005 Apr 16 21:08:59.967110 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 273/590] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:08:59 2022] GET /compute/v2.1/servers/4196bcfc-2c28-485b-8c51-5b460fee70e2 => generated 1210 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:08:59.980150 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-76a882a1-6f91-4d01-ae95-7fc6c437e007 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:08:59.981131 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-76a882a1-6f91-4d01-ae95-7fc6c437e007 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: ffc4d9b2-dd4f-44dc-a189-354eff7a5573] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:08:59.987477 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-76a882a1-6f91-4d01-ae95-7fc6c437e007 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:59.988099 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-76a882a1-6f91-4d01-ae95-7fc6c437e007 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:08:59.988989 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-76a882a1-6f91-4d01-ae95-7fc6c437e007 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:08:59.990255 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-76a882a1-6f91-4d01-ae95-7fc6c437e007 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:00.118845 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-76a882a1-6f91-4d01-ae95-7fc6c437e007 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:00.126834 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-76a882a1-6f91-4d01-ae95-7fc6c437e007 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:00.128389 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-76a882a1-6f91-4d01-ae95-7fc6c437e007 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:00.129498 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-76a882a1-6f91-4d01-ae95-7fc6c437e007 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573" status: 200 len: 1361 microversion: 2.25 time: 0.161203 Apr 16 21:09:00.130878 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 274/591] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:08:59 2022] GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573 => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:09:00.135799 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1ea7e762-41f9-43cd-86b2-b5d899c424cc tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] Calling method '.version_select at 0x7fbb96d9ba60>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:00.180672 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1ea7e762-41f9-43cd-86b2-b5d899c424cc tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] 10.222.0.20 "GET /compute/v2.1/images/7f67c23b-80d8-4b9e-b06a-9d1240562695/metadata" status: 200 len: 37 microversion: 2.1 time: 0.048458 Apr 16 21:09:00.181495 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 275/592] 10.222.0.20 () {58 vars in 1259 bytes} [Sat Apr 16 21:09:00 2022] GET /compute/v2.1/images/7f67c23b-80d8-4b9e-b06a-9d1240562695/metadata => generated 37 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:09:00.191506 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e10e8049-8919-4054-b565-569bf108e848 tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] Action: 'update_all', calling method: .version_select at 0x7fbb96e04430>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:00.244475 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-e10e8049-8919-4054-b565-569bf108e848 tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] Getting quotas for project 5e55104ab1e74c14b13b8de5c1f64aee. Resources: dict_keys(['metadata_items']) {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:00.250661 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-e10e8049-8919-4054-b565-569bf108e848 tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] Getting quotas for user a95e5ceb71ea4cdbb44fea8a2aa50c3d and project 5e55104ab1e74c14b13b8de5c1f64aee. Resources: dict_keys(['metadata_items']) {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:00.737612 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e10e8049-8919-4054-b565-569bf108e848 tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] 10.222.0.20 "PUT /compute/v2.1/images/7f67c23b-80d8-4b9e-b06a-9d1240562695/metadata" status: 200 len: 61 microversion: 2.1 time: 0.546821 Apr 16 21:09:00.737612 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 276/593] 10.222.0.20 () {60 vars in 1279 bytes} [Sat Apr 16 21:09:00 2022] PUT /compute/v2.1/images/7f67c23b-80d8-4b9e-b06a-9d1240562695/metadata => generated 61 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 16 21:09:00.744873 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c91802c3-5ca9-43fc-94dd-4dd796e22d30 tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] Calling method '.version_select at 0x7fbb96f0f670>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:00.794542 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c91802c3-5ca9-43fc-94dd-4dd796e22d30 tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] 10.222.0.20 "GET /compute/v2.1/images/7f67c23b-80d8-4b9e-b06a-9d1240562695/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.053416 Apr 16 21:09:00.795142 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 277/594] 10.222.0.20 () {58 vars in 1289 bytes} [Sat Apr 16 21:09:00 2022] GET /compute/v2.1/images/7f67c23b-80d8-4b9e-b06a-9d1240562695/metadata/os_distro => generated 33 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:09:00.805106 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-813c91e0-c3d8-452d-a0a0-e42a5f69e83a tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] Action: 'update_all', calling method: .version_select at 0x7fbb96e04e50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:00.852051 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-813c91e0-c3d8-452d-a0a0-e42a5f69e83a tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] Getting quotas for project 5e55104ab1e74c14b13b8de5c1f64aee. Resources: dict_keys(['metadata_items']) {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:00.857718 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-813c91e0-c3d8-452d-a0a0-e42a5f69e83a tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] Getting quotas for user a95e5ceb71ea4cdbb44fea8a2aa50c3d and project 5e55104ab1e74c14b13b8de5c1f64aee. Resources: dict_keys(['metadata_items']) {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:01.134398 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-813c91e0-c3d8-452d-a0a0-e42a5f69e83a tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] 10.222.0.20 "PUT /compute/v2.1/images/7f67c23b-80d8-4b9e-b06a-9d1240562695/metadata" status: 200 len: 61 microversion: 2.1 time: 0.321085 Apr 16 21:09:01.135738 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 278/595] 10.222.0.20 () {60 vars in 1279 bytes} [Sat Apr 16 21:09:00 2022] PUT /compute/v2.1/images/7f67c23b-80d8-4b9e-b06a-9d1240562695/metadata => generated 61 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 16 21:09:01.142961 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-149c55d2-61bc-4ca0-98e6-242d7978a65c tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:01.143650 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-149c55d2-61bc-4ca0-98e6-242d7978a65c tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] [instance: bf93495b-7d10-4cb2-9353-0302e654d8fa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:01.150954 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-149c55d2-61bc-4ca0-98e6-242d7978a65c tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:01.151422 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-149c55d2-61bc-4ca0-98e6-242d7978a65c tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:01.152370 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-149c55d2-61bc-4ca0-98e6-242d7978a65c tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:01.165193 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-149c55d2-61bc-4ca0-98e6-242d7978a65c tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:01.417420 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-149c55d2-61bc-4ca0-98e6-242d7978a65c tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae06aafd64d46deacb8ae1791676d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1924a4ceffaf45d0bf2bd76ebb421bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:01.424625 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-149c55d2-61bc-4ca0-98e6-242d7978a65c tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] 10.222.0.20 "GET /compute/v2.1/servers/bf93495b-7d10-4cb2-9353-0302e654d8fa" status: 200 len: 1319 microversion: 2.1 time: 0.287575 Apr 16 21:09:01.425193 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 279/596] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:01 2022] GET /compute/v2.1/servers/bf93495b-7d10-4cb2-9353-0302e654d8fa => generated 1319 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:01.429734 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ffde9be3-02a2-44a8-958e-ba708466ed6a tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:01.430331 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ffde9be3-02a2-44a8-958e-ba708466ed6a tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4196bcfc-2c28-485b-8c51-5b460fee70e2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:01.436114 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ffde9be3-02a2-44a8-958e-ba708466ed6a tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:01.436600 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ffde9be3-02a2-44a8-958e-ba708466ed6a tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:01.437402 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ffde9be3-02a2-44a8-958e-ba708466ed6a tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:01.437834 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ffde9be3-02a2-44a8-958e-ba708466ed6a tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:01.508580 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ffde9be3-02a2-44a8-958e-ba708466ed6a tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:01.515981 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ffde9be3-02a2-44a8-958e-ba708466ed6a tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4196bcfc-2c28-485b-8c51-5b460fee70e2" status: 200 len: 1272 microversion: 2.1 time: 0.089813 Apr 16 21:09:01.516753 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 280/597] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:01 2022] GET /compute/v2.1/servers/4196bcfc-2c28-485b-8c51-5b460fee70e2 => generated 1272 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:01.521955 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7cd81d4f-4f89-4e0d-9efc-d8c2c3212505 tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] Calling method '.version_select at 0x7fbb96e86310>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:01.566671 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7cd81d4f-4f89-4e0d-9efc-d8c2c3212505 tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] 10.222.0.20 "GET /compute/v2.1/images/7f67c23b-80d8-4b9e-b06a-9d1240562695/metadata" status: 200 len: 61 microversion: 2.1 time: 0.048728 Apr 16 21:09:01.568216 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 281/598] 10.222.0.20 () {58 vars in 1259 bytes} [Sat Apr 16 21:09:01 2022] GET /compute/v2.1/images/7f67c23b-80d8-4b9e-b06a-9d1240562695/metadata => generated 61 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:09:01.573142 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-29227210-51bf-4ee2-973e-798e31e9b959 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:01.573945 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-29227210-51bf-4ee2-973e-798e31e9b959 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: ffc4d9b2-dd4f-44dc-a189-354eff7a5573] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:01.579955 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-29227210-51bf-4ee2-973e-798e31e9b959 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:01.580514 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-29227210-51bf-4ee2-973e-798e31e9b959 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:01.581293 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-29227210-51bf-4ee2-973e-798e31e9b959 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:01.581770 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-29227210-51bf-4ee2-973e-798e31e9b959 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:01.765512 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-29227210-51bf-4ee2-973e-798e31e9b959 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:01.774094 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-29227210-51bf-4ee2-973e-798e31e9b959 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:01.775634 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-29227210-51bf-4ee2-973e-798e31e9b959 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:01.776762 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-29227210-51bf-4ee2-973e-798e31e9b959 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573" status: 200 len: 1361 microversion: 2.25 time: 0.207566 Apr 16 21:09:01.777307 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 282/599] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:09:01 2022] GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573 => generated 1361 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:09:01.781646 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9e6b19c7-7cb8-4bae-be78-84c3f8c19fd5 tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] Action: 'update_all', calling method: .version_select at 0x7fbb96d00790>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:01.825866 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-9e6b19c7-7cb8-4bae-be78-84c3f8c19fd5 tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] Getting quotas for project 5e55104ab1e74c14b13b8de5c1f64aee. Resources: dict_keys(['metadata_items']) {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:01.830788 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-9e6b19c7-7cb8-4bae-be78-84c3f8c19fd5 tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] Getting quotas for user a95e5ceb71ea4cdbb44fea8a2aa50c3d and project 5e55104ab1e74c14b13b8de5c1f64aee. Resources: dict_keys(['metadata_items']) {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:02.081533 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9e6b19c7-7cb8-4bae-be78-84c3f8c19fd5 tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] 10.222.0.20 "PUT /compute/v2.1/images/7f67c23b-80d8-4b9e-b06a-9d1240562695/metadata" status: 200 len: 61 microversion: 2.1 time: 0.301489 Apr 16 21:09:02.089304 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 283/600] 10.222.0.20 () {60 vars in 1279 bytes} [Sat Apr 16 21:09:01 2022] PUT /compute/v2.1/images/7f67c23b-80d8-4b9e-b06a-9d1240562695/metadata => generated 61 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:09:02.094917 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d448cf7c-33cc-4869-8839-72d15141b810 tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] Action: 'update_all', calling method: .version_select at 0x7fbb96d9bf70>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:02.153244 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-d448cf7c-33cc-4869-8839-72d15141b810 tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] Getting quotas for project 5e55104ab1e74c14b13b8de5c1f64aee. Resources: dict_keys(['metadata_items']) {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:02.158965 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-d448cf7c-33cc-4869-8839-72d15141b810 tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] Getting quotas for user a95e5ceb71ea4cdbb44fea8a2aa50c3d and project 5e55104ab1e74c14b13b8de5c1f64aee. Resources: dict_keys(['metadata_items']) {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:02.670963 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d448cf7c-33cc-4869-8839-72d15141b810 tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] 10.222.0.20 "PUT /compute/v2.1/images/7f67c23b-80d8-4b9e-b06a-9d1240562695/metadata" status: 200 len: 64 microversion: 2.1 time: 0.580387 Apr 16 21:09:02.672132 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 284/601] 10.222.0.20 () {60 vars in 1279 bytes} [Sat Apr 16 21:09:02 2022] PUT /compute/v2.1/images/7f67c23b-80d8-4b9e-b06a-9d1240562695/metadata => generated 64 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:09:02.682487 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-06b05759-51c0-4876-abe2-5172f00e594c tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:02.683894 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-06b05759-51c0-4876-abe2-5172f00e594c tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] [instance: bf93495b-7d10-4cb2-9353-0302e654d8fa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:02.690617 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-06b05759-51c0-4876-abe2-5172f00e594c tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:02.691751 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-06b05759-51c0-4876-abe2-5172f00e594c tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:02.692600 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-06b05759-51c0-4876-abe2-5172f00e594c tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:02.693246 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-06b05759-51c0-4876-abe2-5172f00e594c tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:03.204698 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-06b05759-51c0-4876-abe2-5172f00e594c tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae06aafd64d46deacb8ae1791676d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1924a4ceffaf45d0bf2bd76ebb421bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:03.215793 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-06b05759-51c0-4876-abe2-5172f00e594c tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] 10.222.0.20 "GET /compute/v2.1/servers/bf93495b-7d10-4cb2-9353-0302e654d8fa" status: 200 len: 1319 microversion: 2.1 time: 0.537310 Apr 16 21:09:03.218334 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 285/602] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:02 2022] GET /compute/v2.1/servers/bf93495b-7d10-4cb2-9353-0302e654d8fa => generated 1319 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:03.260326 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-eb329501-9263-4f53-9491-561a913bb509 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:03.265188 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-eb329501-9263-4f53-9491-561a913bb509 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4196bcfc-2c28-485b-8c51-5b460fee70e2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:03.274830 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eb329501-9263-4f53-9491-561a913bb509 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:03.275696 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eb329501-9263-4f53-9491-561a913bb509 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:03.276754 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eb329501-9263-4f53-9491-561a913bb509 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:03.277359 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eb329501-9263-4f53-9491-561a913bb509 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:03.669126 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-eb329501-9263-4f53-9491-561a913bb509 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:03.685665 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-eb329501-9263-4f53-9491-561a913bb509 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4196bcfc-2c28-485b-8c51-5b460fee70e2" status: 200 len: 1314 microversion: 2.1 time: 0.466001 Apr 16 21:09:03.699830 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 286/603] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:03 2022] GET /compute/v2.1/servers/4196bcfc-2c28-485b-8c51-5b460fee70e2 => generated 1314 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:03.704867 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1021741e-25b3-4d78-947c-8b6d0e6ded49 tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] Calling method '.version_select at 0x7fbb9c39fa60>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:03.755792 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1021741e-25b3-4d78-947c-8b6d0e6ded49 tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] 10.222.0.20 "GET /compute/v2.1/images/7f67c23b-80d8-4b9e-b06a-9d1240562695/metadata" status: 200 len: 64 microversion: 2.1 time: 0.054751 Apr 16 21:09:03.756528 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 287/604] 10.222.0.20 () {58 vars in 1259 bytes} [Sat Apr 16 21:09:03 2022] GET /compute/v2.1/images/7f67c23b-80d8-4b9e-b06a-9d1240562695/metadata => generated 64 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:09:04.056088 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4f06c2c8-4123-4a53-9c54-f74ed2792445 tempest-TenantUsagesNegativeTestJSON-572788630 tempest-TenantUsagesNegativeTestJSON-572788630-project-admin] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-04-15T21%3A09%3A02.769868&end=2022-04-17T21%3A09%3A02.769868" status: 404 len: 112 microversion: - time: 0.298443 Apr 16 21:09:04.056837 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 288/605] 10.222.0.20 () {58 vars in 1315 bytes} [Sat Apr 16 21:09:03 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-04-15T21%3A09%3A02.769868&end=2022-04-17T21%3A09%3A02.769868 => generated 112 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 16 21:09:04.068791 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-99fa8926-cad6-4b02-ab99-e91f85a42c1f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:04.069653 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-99fa8926-cad6-4b02-ab99-e91f85a42c1f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: ffc4d9b2-dd4f-44dc-a189-354eff7a5573] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:04.077398 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-99fa8926-cad6-4b02-ab99-e91f85a42c1f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:04.078038 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-99fa8926-cad6-4b02-ab99-e91f85a42c1f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:04.079028 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-99fa8926-cad6-4b02-ab99-e91f85a42c1f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:04.079625 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-99fa8926-cad6-4b02-ab99-e91f85a42c1f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:04.266051 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-99fa8926-cad6-4b02-ab99-e91f85a42c1f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:04.273916 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-99fa8926-cad6-4b02-ab99-e91f85a42c1f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:04.275422 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-99fa8926-cad6-4b02-ab99-e91f85a42c1f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:04.276551 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-99fa8926-cad6-4b02-ab99-e91f85a42c1f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573" status: 200 len: 1361 microversion: 2.25 time: 0.218634 Apr 16 21:09:04.277158 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 289/606] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:09:04 2022] GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573 => generated 1361 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:09:04.285777 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-32657161-8eac-44ed-b637-8ccfee8c0ae3 tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] Action: 'update_all', calling method: .version_select at 0x7fbb96d00700>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:04.347953 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-32657161-8eac-44ed-b637-8ccfee8c0ae3 tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] Getting quotas for project 5e55104ab1e74c14b13b8de5c1f64aee. Resources: dict_keys(['metadata_items']) {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:04.354389 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-32657161-8eac-44ed-b637-8ccfee8c0ae3 tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] Getting quotas for user a95e5ceb71ea4cdbb44fea8a2aa50c3d and project 5e55104ab1e74c14b13b8de5c1f64aee. Resources: dict_keys(['metadata_items']) {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:04.823126 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7d917795-e57f-494d-bba7-08b45a1c0141 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e/action" status: 202 len: 0 microversion: 2.1 time: 6.068213 Apr 16 21:09:04.823126 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 318/607] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:08:58 2022] POST /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e/action => generated 0 bytes in 6070 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:09:04.825882 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-41be6f6f-3dc0-4f28-a324-a1bd11a199ea tempest-TenantUsagesNegativeTestJSON-572788630 tempest-TenantUsagesNegativeTestJSON-572788630-project-admin] Calling method '.version_select at 0x7fbb96b65280>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:04.833522 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-41be6f6f-3dc0-4f28-a324-a1bd11a199ea tempest-TenantUsagesNegativeTestJSON-572788630 tempest-TenantUsagesNegativeTestJSON-572788630-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Apr 16 21:09:04.834882 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-41be6f6f-3dc0-4f28-a324-a1bd11a199ea tempest-TenantUsagesNegativeTestJSON-572788630 tempest-TenantUsagesNegativeTestJSON-572788630-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:09:04.835928 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-41be6f6f-3dc0-4f28-a324-a1bd11a199ea tempest-TenantUsagesNegativeTestJSON-572788630 tempest-TenantUsagesNegativeTestJSON-572788630-project-admin] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage/277d5a3deb7845f99eb7476e7f84c3af?start=2022-04-17T21%3A09%3A02.769868&end=2022-04-15T21%3A09%3A02.769868" status: 400 len: 111 microversion: 2.1 time: 0.013829 Apr 16 21:09:04.836491 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 319/608] 10.222.0.20 () {58 vars in 1411 bytes} [Sat Apr 16 21:09:04 2022] GET /compute/v2.1/os-simple-tenant-usage/277d5a3deb7845f99eb7476e7f84c3af?start=2022-04-17T21%3A09%3A02.769868&end=2022-04-15T21%3A09%3A02.769868 => generated 111 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:09:04.856795 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-32657161-8eac-44ed-b637-8ccfee8c0ae3 tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] 10.222.0.20 "PUT /compute/v2.1/images/7f67c23b-80d8-4b9e-b06a-9d1240562695/metadata" status: 200 len: 61 microversion: 2.1 time: 0.568397 Apr 16 21:09:04.857884 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 290/609] 10.222.0.20 () {60 vars in 1279 bytes} [Sat Apr 16 21:09:04 2022] PUT /compute/v2.1/images/7f67c23b-80d8-4b9e-b06a-9d1240562695/metadata => generated 61 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:09:04.864591 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-930fced6-c7ca-4195-9f97-a3aafd68f891 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:04.865465 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-930fced6-c7ca-4195-9f97-a3aafd68f891 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] [instance: bf93495b-7d10-4cb2-9353-0302e654d8fa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:04.871623 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-930fced6-c7ca-4195-9f97-a3aafd68f891 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:04.872462 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-930fced6-c7ca-4195-9f97-a3aafd68f891 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:04.873252 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-930fced6-c7ca-4195-9f97-a3aafd68f891 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:04.873768 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-930fced6-c7ca-4195-9f97-a3aafd68f891 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:04.913589 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-89f60875-0440-4706-8168-e4d1e360ea4a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-832033363", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:04.979841 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-89f60875-0440-4706-8168-e4d1e360ea4a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] validate_networks() for None {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:09:05.233161 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-930fced6-c7ca-4195-9f97-a3aafd68f891 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae06aafd64d46deacb8ae1791676d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1924a4ceffaf45d0bf2bd76ebb421bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:05.241470 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-930fced6-c7ca-4195-9f97-a3aafd68f891 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] 10.222.0.20 "GET /compute/v2.1/servers/bf93495b-7d10-4cb2-9353-0302e654d8fa" status: 200 len: 1319 microversion: 2.1 time: 0.382393 Apr 16 21:09:05.242368 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 291/610] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:04 2022] GET /compute/v2.1/servers/bf93495b-7d10-4cb2-9353-0302e654d8fa => generated 1319 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:05.257629 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-89f60875-0440-4706-8168-e4d1e360ea4a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:09:05.258369 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-89f60875-0440-4706-8168-e4d1e360ea4a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:09:05.258705 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-80a31f01-28a5-4c6f-9a3f-e8aa1b03c2a7 req-7d8785c3-040e-4533-b32c-029223c9cf52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dfc548c-fae5-47a4-bb2e-8a022ebf6c17", "tag": "c0642788-5af8-4722-90dd-d3c3c1a8b4a7"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:05.258846 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-89f60875-0440-4706-8168-e4d1e360ea4a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:09:05.259367 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-89f60875-0440-4706-8168-e4d1e360ea4a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:09:05.259790 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-89f60875-0440-4706-8168-e4d1e360ea4a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:09:05.269015 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-80a31f01-28a5-4c6f-9a3f-e8aa1b03c2a7 req-7d8785c3-040e-4533-b32c-029223c9cf52 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:05.270003 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-80a31f01-28a5-4c6f-9a3f-e8aa1b03c2a7 req-7d8785c3-040e-4533-b32c-029223c9cf52 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:05.271111 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-89f60875-0440-4706-8168-e4d1e360ea4a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:05.271562 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-89f60875-0440-4706-8168-e4d1e360ea4a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:05.272399 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-89f60875-0440-4706-8168-e4d1e360ea4a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:05.272837 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-89f60875-0440-4706-8168-e4d1e360ea4a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:05.283452 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-80a31f01-28a5-4c6f-9a3f-e8aa1b03c2a7 req-7d8785c3-040e-4533-b32c-029223c9cf52 service nova] Creating event network-changed:c0642788-5af8-4722-90dd-d3c3c1a8b4a7 for instance 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 on nch1-master-1 Apr 16 21:09:05.289894 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-80a31f01-28a5-4c6f-9a3f-e8aa1b03c2a7 req-7d8785c3-040e-4533-b32c-029223c9cf52 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036397 Apr 16 21:09:05.290810 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 292/611] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:09:05.297255 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-187628f8-8a0b-401b-99bc-6bac915654e1 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:05.298089 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-89f60875-0440-4706-8168-e4d1e360ea4a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Getting quotas for project cd7c434915254744b7a0409ab8e6d33d. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:05.298778 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-187628f8-8a0b-401b-99bc-6bac915654e1 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4196bcfc-2c28-485b-8c51-5b460fee70e2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:05.305011 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-89f60875-0440-4706-8168-e4d1e360ea4a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Getting quotas for user 79f97c1afe5442dc83319237d121c11f and project cd7c434915254744b7a0409ab8e6d33d. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:05.314184 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-187628f8-8a0b-401b-99bc-6bac915654e1 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:05.316590 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-187628f8-8a0b-401b-99bc-6bac915654e1 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:05.318071 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-187628f8-8a0b-401b-99bc-6bac915654e1 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:05.318579 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-187628f8-8a0b-401b-99bc-6bac915654e1 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:05.325400 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-89f60875-0440-4706-8168-e4d1e360ea4a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:09:05.326248 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-89f60875-0440-4706-8168-e4d1e360ea4a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 7b856a59-2a62-4edc-b448-430f778c7b2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:09:05.492643 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-89f60875-0440-4706-8168-e4d1e360ea4a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.654773 Apr 16 21:09:05.493368 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 320/612] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:09:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:09:05.500327 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-78f6efd2-0571-4c7e-a3c9-2e724ec3e0fd tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:05.501323 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-78f6efd2-0571-4c7e-a3c9-2e724ec3e0fd tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: e641f7ec-0d41-4439-bc77-7158fb9d346e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:05.508672 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-78f6efd2-0571-4c7e-a3c9-2e724ec3e0fd tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:05.509348 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-78f6efd2-0571-4c7e-a3c9-2e724ec3e0fd tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:05.510464 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-78f6efd2-0571-4c7e-a3c9-2e724ec3e0fd tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:05.510921 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-78f6efd2-0571-4c7e-a3c9-2e724ec3e0fd tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:05.602643 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-187628f8-8a0b-401b-99bc-6bac915654e1 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:05.615579 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-187628f8-8a0b-401b-99bc-6bac915654e1 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4196bcfc-2c28-485b-8c51-5b460fee70e2" status: 200 len: 1314 microversion: 2.1 time: 0.320739 Apr 16 21:09:05.615579 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 293/613] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:05 2022] GET /compute/v2.1/servers/4196bcfc-2c28-485b-8c51-5b460fee70e2 => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:05.681139 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-78f6efd2-0571-4c7e-a3c9-2e724ec3e0fd tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:05.688758 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-78f6efd2-0571-4c7e-a3c9-2e724ec3e0fd tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e" status: 200 len: 1503 microversion: 2.1 time: 0.192460 Apr 16 21:09:05.689337 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 321/614] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:05 2022] GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e => generated 1503 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:05.702355 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a6ef2cce-5d97-484b-8947-6c5f51025529 tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] Action: 'update', calling method: .version_select at 0x7fbb96b61940>, body: {"meta": {"os_version": "alt"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:05.754845 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8fe29fec-ced3-4411-a00f-97031b2e4299 tempest-TenantUsagesNegativeTestJSON-1075420565 tempest-TenantUsagesNegativeTestJSON-1075420565-project] Calling method '.version_select at 0x7fbb96e04dc0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:05.757367 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8fe29fec-ced3-4411-a00f-97031b2e4299 tempest-TenantUsagesNegativeTestJSON-1075420565 tempest-TenantUsagesNegativeTestJSON-1075420565-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '4531808b1d50456faaa6681a75c894df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '277d5a3deb7845f99eb7476e7f84c3af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:05.758274 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8fe29fec-ced3-4411-a00f-97031b2e4299 tempest-TenantUsagesNegativeTestJSON-1075420565 tempest-TenantUsagesNegativeTestJSON-1075420565-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:09:05.759124 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8fe29fec-ced3-4411-a00f-97031b2e4299 tempest-TenantUsagesNegativeTestJSON-1075420565 tempest-TenantUsagesNegativeTestJSON-1075420565-project] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-04-15T21%3A09%3A02.769868&end=2022-04-17T21%3A09%3A02.769868&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.140874 Apr 16 21:09:05.759639 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 294/615] 10.222.0.20 () {58 vars in 1334 bytes} [Sat Apr 16 21:09:05 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-04-15T21%3A09%3A02.769868&end=2022-04-17T21%3A09%3A02.769868&detailed=1 => generated 123 bytes in 146 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:09:05.762422 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-a6ef2cce-5d97-484b-8947-6c5f51025529 tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] Getting quotas for project 5e55104ab1e74c14b13b8de5c1f64aee. Resources: dict_keys(['metadata_items']) {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:05.767745 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c4c3c580-feab-412f-86b9-34b5eea0bf66 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:05.768531 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-a6ef2cce-5d97-484b-8947-6c5f51025529 tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] Getting quotas for user a95e5ceb71ea4cdbb44fea8a2aa50c3d and project 5e55104ab1e74c14b13b8de5c1f64aee. Resources: dict_keys(['metadata_items']) {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:05.768657 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c4c3c580-feab-412f-86b9-34b5eea0bf66 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 8d5cf7af-51b8-4392-a551-9d0d9b96a45d] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:05.777002 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c4c3c580-feab-412f-86b9-34b5eea0bf66 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:05.777651 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c4c3c580-feab-412f-86b9-34b5eea0bf66 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:05.778592 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c4c3c580-feab-412f-86b9-34b5eea0bf66 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:05.779189 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c4c3c580-feab-412f-86b9-34b5eea0bf66 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:05.832376 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c4c3c580-feab-412f-86b9-34b5eea0bf66 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 8d5cf7af-51b8-4392-a551-9d0d9b96a45d] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:09:06.226266 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a6ef2cce-5d97-484b-8947-6c5f51025529 tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] 10.222.0.20 "PUT /compute/v2.1/images/7f67c23b-80d8-4b9e-b06a-9d1240562695/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.535439 Apr 16 21:09:06.226870 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 322/616] 10.222.0.20 () {60 vars in 1312 bytes} [Sat Apr 16 21:09:05 2022] PUT /compute/v2.1/images/7f67c23b-80d8-4b9e-b06a-9d1240562695/metadata/os_version => generated 31 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:09:06.229987 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c4c3c580-feab-412f-86b9-34b5eea0bf66 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8d5cf7af-51b8-4392-a551-9d0d9b96a45d" status: 204 len: 0 microversion: 2.1 time: 0.468649 Apr 16 21:09:06.230805 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 295/617] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:09:05 2022] DELETE /compute/v2.1/servers/8d5cf7af-51b8-4392-a551-9d0d9b96a45d => generated 0 bytes in 470 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:09:06.231657 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9eaef840-e6fc-4c85-9d82-0214f03f1ee3 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:06.232289 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9eaef840-e6fc-4c85-9d82-0214f03f1ee3 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: ffc4d9b2-dd4f-44dc-a189-354eff7a5573] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:06.236464 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-2dd800c7-9380-4e45-ae85-ba464bc023bb req-3ac746db-f93e-4ce3-ba4b-467fb57607ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffc4d9b2-dd4f-44dc-a189-354eff7a5573", "name": "network-vif-plugged", "status": "completed", "tag": "fb4825e7-d0af-4d1c-a416-731410a77b41"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:06.246034 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-2dd800c7-9380-4e45-ae85-ba464bc023bb req-3ac746db-f93e-4ce3-ba4b-467fb57607ac service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:06.246704 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-2dd800c7-9380-4e45-ae85-ba464bc023bb req-3ac746db-f93e-4ce3-ba4b-467fb57607ac service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:06.260240 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-2dd800c7-9380-4e45-ae85-ba464bc023bb req-3ac746db-f93e-4ce3-ba4b-467fb57607ac service nova] Creating event network-vif-plugged:fb4825e7-d0af-4d1c-a416-731410a77b41 for instance ffc4d9b2-dd4f-44dc-a189-354eff7a5573 on nch2-master-1 Apr 16 21:09:06.266501 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-2dd800c7-9380-4e45-ae85-ba464bc023bb req-3ac746db-f93e-4ce3-ba4b-467fb57607ac service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034193 Apr 16 21:09:06.267578 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 296/618] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:09:06.277477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9eaef840-e6fc-4c85-9d82-0214f03f1ee3 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:06.277963 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9eaef840-e6fc-4c85-9d82-0214f03f1ee3 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:06.278571 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4fdeddcc-145c-458d-9415-da13d1457fad tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:06.278980 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9eaef840-e6fc-4c85-9d82-0214f03f1ee3 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:06.279839 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4fdeddcc-145c-458d-9415-da13d1457fad tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 7b856a59-2a62-4edc-b448-430f778c7b2e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:06.282169 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9eaef840-e6fc-4c85-9d82-0214f03f1ee3 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:06.415447 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4fdeddcc-145c-458d-9415-da13d1457fad tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:06.418135 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4fdeddcc-145c-458d-9415-da13d1457fad tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/7b856a59-2a62-4edc-b448-430f778c7b2e" status: 200 len: 1216 microversion: 2.1 time: 0.145631 Apr 16 21:09:06.419235 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 297/619] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:06 2022] GET /compute/v2.1/servers/7b856a59-2a62-4edc-b448-430f778c7b2e => generated 1216 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:06.424604 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5c5d3e89-b2d0-4013-83c6-c39650fc800a tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] Calling method '.version_select at 0x7fbb96f6bb80>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:06.431480 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9eaef840-e6fc-4c85-9d82-0214f03f1ee3 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:06.441408 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9eaef840-e6fc-4c85-9d82-0214f03f1ee3 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:06.444516 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9eaef840-e6fc-4c85-9d82-0214f03f1ee3 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:06.458061 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9eaef840-e6fc-4c85-9d82-0214f03f1ee3 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573" status: 200 len: 1361 microversion: 2.25 time: 0.218321 Apr 16 21:09:06.458061 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 323/620] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:09:06 2022] GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573 => generated 1361 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:09:06.463975 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-00e235fd-4301-46a5-b1ef-5f4ee04f2df2 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:06.464982 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-00e235fd-4301-46a5-b1ef-5f4ee04f2df2 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] [instance: bf93495b-7d10-4cb2-9353-0302e654d8fa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:06.478025 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-00e235fd-4301-46a5-b1ef-5f4ee04f2df2 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:06.479523 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-00e235fd-4301-46a5-b1ef-5f4ee04f2df2 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:06.480546 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-00e235fd-4301-46a5-b1ef-5f4ee04f2df2 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:06.481062 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-00e235fd-4301-46a5-b1ef-5f4ee04f2df2 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:06.487938 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5c5d3e89-b2d0-4013-83c6-c39650fc800a tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] 10.222.0.20 "GET /compute/v2.1/images/7f67c23b-80d8-4b9e-b06a-9d1240562695/metadata" status: 200 len: 58 microversion: 2.1 time: 0.066116 Apr 16 21:09:06.492772 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 298/621] 10.222.0.20 () {58 vars in 1259 bytes} [Sat Apr 16 21:09:06 2022] GET /compute/v2.1/images/7f67c23b-80d8-4b9e-b06a-9d1240562695/metadata => generated 58 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:09:06.498436 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c50a4440-533a-44e0-b549-02eedad5c6b9 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-29267828", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "624056270", "adminPass": "***", "networks": [{"uuid": "d01e7439-5429-4e84-9f79-f267906a4f33"}], "security_groups": [{"name": "tempest-securitygroup--1720119057"}], "key_name": "tempest-keypair-491807199", "user_data": "}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:06.675147 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-00e235fd-4301-46a5-b1ef-5f4ee04f2df2 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae06aafd64d46deacb8ae1791676d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1924a4ceffaf45d0bf2bd76ebb421bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:06.689316 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-00e235fd-4301-46a5-b1ef-5f4ee04f2df2 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] 10.222.0.20 "GET /compute/v2.1/servers/bf93495b-7d10-4cb2-9353-0302e654d8fa" status: 200 len: 1319 microversion: 2.1 time: 0.239616 Apr 16 21:09:06.691007 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 324/622] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:06 2022] GET /compute/v2.1/servers/bf93495b-7d10-4cb2-9353-0302e654d8fa => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:06.696578 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-498772ef-1d0b-4999-bfeb-bfae18fde18b tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] Action: 'update_all', calling method: .version_select at 0x7fbb96b2e700>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:06.753818 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-498772ef-1d0b-4999-bfeb-bfae18fde18b tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] Getting quotas for project 5e55104ab1e74c14b13b8de5c1f64aee. Resources: dict_keys(['metadata_items']) {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:06.760110 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-498772ef-1d0b-4999-bfeb-bfae18fde18b tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] Getting quotas for user a95e5ceb71ea4cdbb44fea8a2aa50c3d and project 5e55104ab1e74c14b13b8de5c1f64aee. Resources: dict_keys(['metadata_items']) {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:07.043131 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-c50a4440-533a-44e0-b549-02eedad5c6b9 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] validate_networks() for [('d01e7439-5429-4e84-9f79-f267906a4f33', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:09:07.206335 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-498772ef-1d0b-4999-bfeb-bfae18fde18b tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] 10.222.0.20 "PUT /compute/v2.1/images/7f67c23b-80d8-4b9e-b06a-9d1240562695/metadata" status: 200 len: 61 microversion: 2.1 time: 0.514045 Apr 16 21:09:07.207191 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 325/623] 10.222.0.20 () {60 vars in 1279 bytes} [Sat Apr 16 21:09:06 2022] PUT /compute/v2.1/images/7f67c23b-80d8-4b9e-b06a-9d1240562695/metadata => generated 61 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:09:07.213615 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-10cbab76-252d-423b-a93a-b159e6eecdef tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:07.215787 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-10cbab76-252d-423b-a93a-b159e6eecdef tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4196bcfc-2c28-485b-8c51-5b460fee70e2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:07.224048 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-10cbab76-252d-423b-a93a-b159e6eecdef tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:07.225048 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-10cbab76-252d-423b-a93a-b159e6eecdef tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:07.225835 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-10cbab76-252d-423b-a93a-b159e6eecdef tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:07.226274 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-10cbab76-252d-423b-a93a-b159e6eecdef tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:07.453451 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-10cbab76-252d-423b-a93a-b159e6eecdef tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:07.465586 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-10cbab76-252d-423b-a93a-b159e6eecdef tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4196bcfc-2c28-485b-8c51-5b460fee70e2" status: 200 len: 1314 microversion: 2.1 time: 0.256988 Apr 16 21:09:07.468487 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 326/624] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:07 2022] GET /compute/v2.1/servers/4196bcfc-2c28-485b-8c51-5b460fee70e2 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:07.472670 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2077db0c-e6c1-4d22-9886-4555ebd15a51 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:07.473538 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2077db0c-e6c1-4d22-9886-4555ebd15a51 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: e641f7ec-0d41-4439-bc77-7158fb9d346e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:07.480744 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2077db0c-e6c1-4d22-9886-4555ebd15a51 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:07.481617 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2077db0c-e6c1-4d22-9886-4555ebd15a51 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:07.482623 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2077db0c-e6c1-4d22-9886-4555ebd15a51 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:07.483024 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2077db0c-e6c1-4d22-9886-4555ebd15a51 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:07.655889 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2077db0c-e6c1-4d22-9886-4555ebd15a51 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:07.664281 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2077db0c-e6c1-4d22-9886-4555ebd15a51 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e" status: 200 len: 1503 microversion: 2.1 time: 0.196616 Apr 16 21:09:07.665027 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 327/625] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:07 2022] GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e => generated 1503 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:07.669898 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-03b49f01-f16d-4951-b2b9-4cfe808232c8 tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] Action: 'create', calling method: .version_select at 0x7fbb96dc7c10>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:07.718670 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-03b49f01-f16d-4951-b2b9-4cfe808232c8 tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] Getting quotas for project 5e55104ab1e74c14b13b8de5c1f64aee. Resources: dict_keys(['metadata_items']) {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:07.723753 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-03b49f01-f16d-4951-b2b9-4cfe808232c8 tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] Getting quotas for user a95e5ceb71ea4cdbb44fea8a2aa50c3d and project 5e55104ab1e74c14b13b8de5c1f64aee. Resources: dict_keys(['metadata_items']) {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:07.884943 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-c50a4440-533a-44e0-b549-02eedad5c6b9 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:09:07.884943 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-c50a4440-533a-44e0-b549-02eedad5c6b9 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:09:07.884943 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-c50a4440-533a-44e0-b549-02eedad5c6b9 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:09:07.884943 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-c50a4440-533a-44e0-b549-02eedad5c6b9 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:09:07.884943 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-c50a4440-533a-44e0-b549-02eedad5c6b9 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:09:07.889332 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c50a4440-533a-44e0-b549-02eedad5c6b9 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:07.889786 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c50a4440-533a-44e0-b549-02eedad5c6b9 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:07.890776 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c50a4440-533a-44e0-b549-02eedad5c6b9 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:07.891219 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c50a4440-533a-44e0-b549-02eedad5c6b9 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:07.909368 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-c50a4440-533a-44e0-b549-02eedad5c6b9 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Getting quotas for project d6395bf8972949f8837289679b58d151. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:07.915923 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-c50a4440-533a-44e0-b549-02eedad5c6b9 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Getting quotas for user aa7da58ce23242bd947bbd7387b80b8d and project d6395bf8972949f8837289679b58d151. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:07.929193 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c50a4440-533a-44e0-b549-02eedad5c6b9 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:09:07.934587 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c50a4440-533a-44e0-b549-02eedad5c6b9 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 18557c2b-2ced-4cbc-998e-978ae82401e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:09:08.165513 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-03b49f01-f16d-4951-b2b9-4cfe808232c8 tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] 10.222.0.20 "POST /compute/v2.1/images/7f67c23b-80d8-4b9e-b06a-9d1240562695/metadata" status: 200 len: 85 microversion: 2.1 time: 0.499554 Apr 16 21:09:08.166111 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 328/626] 10.222.0.20 () {60 vars in 1280 bytes} [Sat Apr 16 21:09:07 2022] POST /compute/v2.1/images/7f67c23b-80d8-4b9e-b06a-9d1240562695/metadata => generated 85 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:09:08.170899 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-189ee605-9611-4d30-a28c-ec654f250983 req-bbecb208-e590-465b-b3cf-6bd2f9d3a009 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4196bcfc-2c28-485b-8c51-5b460fee70e2", "tag": "2819bc63-5a3d-4aac-8273-b90dbce3d22d"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:08.177962 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c50a4440-533a-44e0-b549-02eedad5c6b9 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.682551 Apr 16 21:09:08.177962 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 299/627] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:09:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 1684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:09:08.179784 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-189ee605-9611-4d30-a28c-ec654f250983 req-bbecb208-e590-465b-b3cf-6bd2f9d3a009 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:08.180288 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-189ee605-9611-4d30-a28c-ec654f250983 req-bbecb208-e590-465b-b3cf-6bd2f9d3a009 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:08.183234 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7b71683c-0d4a-450d-8a45-8e3661048005 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:08.183856 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7b71683c-0d4a-450d-8a45-8e3661048005 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 7b856a59-2a62-4edc-b448-430f778c7b2e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:08.191135 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-189ee605-9611-4d30-a28c-ec654f250983 req-bbecb208-e590-465b-b3cf-6bd2f9d3a009 service nova] Creating event network-changed:2819bc63-5a3d-4aac-8273-b90dbce3d22d for instance 4196bcfc-2c28-485b-8c51-5b460fee70e2 on nch1-master-1 Apr 16 21:09:08.191348 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7b71683c-0d4a-450d-8a45-8e3661048005 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:08.191635 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7b71683c-0d4a-450d-8a45-8e3661048005 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:08.192698 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7b71683c-0d4a-450d-8a45-8e3661048005 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:08.193773 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7b71683c-0d4a-450d-8a45-8e3661048005 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:08.197355 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-189ee605-9611-4d30-a28c-ec654f250983 req-bbecb208-e590-465b-b3cf-6bd2f9d3a009 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030075 Apr 16 21:09:08.199710 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 329/628] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:09:08.205254 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1c21a666-6b48-463d-858e-bebdfe146d44 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:08.206033 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1c21a666-6b48-463d-858e-bebdfe146d44 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: ffc4d9b2-dd4f-44dc-a189-354eff7a5573] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:08.216682 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1c21a666-6b48-463d-858e-bebdfe146d44 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:08.216682 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1c21a666-6b48-463d-858e-bebdfe146d44 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:08.216682 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1c21a666-6b48-463d-858e-bebdfe146d44 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:08.216682 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1c21a666-6b48-463d-858e-bebdfe146d44 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:08.281652 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7b71683c-0d4a-450d-8a45-8e3661048005 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:08.293222 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7b71683c-0d4a-450d-8a45-8e3661048005 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/7b856a59-2a62-4edc-b448-430f778c7b2e" status: 200 len: 1212 microversion: 2.1 time: 0.114397 Apr 16 21:09:08.295506 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 300/629] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:08 2022] GET /compute/v2.1/servers/7b856a59-2a62-4edc-b448-430f778c7b2e => generated 1212 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:08.302845 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9505d036-377a-479a-a4a9-2e075a3655c5 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:08.303505 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9505d036-377a-479a-a4a9-2e075a3655c5 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] [instance: bf93495b-7d10-4cb2-9353-0302e654d8fa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:08.312238 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9505d036-377a-479a-a4a9-2e075a3655c5 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:08.312680 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9505d036-377a-479a-a4a9-2e075a3655c5 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:08.313530 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9505d036-377a-479a-a4a9-2e075a3655c5 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:08.313956 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9505d036-377a-479a-a4a9-2e075a3655c5 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:08.405554 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1c21a666-6b48-463d-858e-bebdfe146d44 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:08.415638 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1c21a666-6b48-463d-858e-bebdfe146d44 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:08.418315 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1c21a666-6b48-463d-858e-bebdfe146d44 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:08.419997 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1c21a666-6b48-463d-858e-bebdfe146d44 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573" status: 200 len: 1361 microversion: 2.25 time: 0.218925 Apr 16 21:09:08.420848 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 330/630] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:09:08 2022] GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573 => generated 1361 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:09:08.458725 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-07c6113f-7f60-49b7-9b02-f65386a448e6 tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] Calling method '.version_select at 0x7fbb96b2e8b0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:08.544463 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-07c6113f-7f60-49b7-9b02-f65386a448e6 tempest-ImagesMetadataTestJSON-2099774477 tempest-ImagesMetadataTestJSON-2099774477-project] 10.222.0.20 "GET /compute/v2.1/images/7f67c23b-80d8-4b9e-b06a-9d1240562695/metadata" status: 200 len: 85 microversion: 2.1 time: 0.122200 Apr 16 21:09:08.545299 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 331/631] 10.222.0.20 () {58 vars in 1259 bytes} [Sat Apr 16 21:09:08 2022] GET /compute/v2.1/images/7f67c23b-80d8-4b9e-b06a-9d1240562695/metadata => generated 85 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:09:08.551305 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-992f7784-739e-4581-b2af-2ab5c56566a2 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:08.561195 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-992f7784-739e-4581-b2af-2ab5c56566a2 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 18557c2b-2ced-4cbc-998e-978ae82401e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:08.741999 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9505d036-377a-479a-a4a9-2e075a3655c5 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae06aafd64d46deacb8ae1791676d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1924a4ceffaf45d0bf2bd76ebb421bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:08.774346 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9505d036-377a-479a-a4a9-2e075a3655c5 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] 10.222.0.20 "GET /compute/v2.1/servers/bf93495b-7d10-4cb2-9353-0302e654d8fa" status: 200 len: 1319 microversion: 2.1 time: 0.469772 Apr 16 21:09:08.780359 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 301/632] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:08 2022] GET /compute/v2.1/servers/bf93495b-7d10-4cb2-9353-0302e654d8fa => generated 1319 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:08.792731 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-f8af97e5-cb2a-43b5-adc7-28543ff13a52 req-64d9265a-5043-4500-8f29-8ea54c778e88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf93495b-7d10-4cb2-9353-0302e654d8fa", "name": "network-vif-plugged", "status": "completed", "tag": "9d341b6f-b81c-4d6c-924c-e8dc1d4fbebc"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:08.807081 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-992f7784-739e-4581-b2af-2ab5c56566a2 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7da58ce23242bd947bbd7387b80b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6395bf8972949f8837289679b58d151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:08.820191 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-f8af97e5-cb2a-43b5-adc7-28543ff13a52 req-64d9265a-5043-4500-8f29-8ea54c778e88 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:08.820755 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-f8af97e5-cb2a-43b5-adc7-28543ff13a52 req-64d9265a-5043-4500-8f29-8ea54c778e88 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:08.840093 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-992f7784-739e-4581-b2af-2ab5c56566a2 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "GET /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7" status: 200 len: 1260 microversion: 2.1 time: 0.291053 Apr 16 21:09:08.842071 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-f8af97e5-cb2a-43b5-adc7-28543ff13a52 req-64d9265a-5043-4500-8f29-8ea54c778e88 service nova] Creating event network-vif-plugged:9d341b6f-b81c-4d6c-924c-e8dc1d4fbebc for instance bf93495b-7d10-4cb2-9353-0302e654d8fa on nch2-master-1 Apr 16 21:09:08.853367 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 332/633] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:08 2022] GET /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7 => generated 1260 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:08.857241 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-f8af97e5-cb2a-43b5-adc7-28543ff13a52 req-64d9265a-5043-4500-8f29-8ea54c778e88 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075258 Apr 16 21:09:08.858145 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 302/634] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:09:08.869920 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-35fa0ddd-ccc3-46db-86a6-90a6db82f79a tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:08.872081 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-35fa0ddd-ccc3-46db-86a6-90a6db82f79a tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4196bcfc-2c28-485b-8c51-5b460fee70e2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:08.878286 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e06b02b2-0fe8-4ed5-9a9e-26c30df7cb9a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:08.879093 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e06b02b2-0fe8-4ed5-9a9e-26c30df7cb9a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: e641f7ec-0d41-4439-bc77-7158fb9d346e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:08.881262 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-35fa0ddd-ccc3-46db-86a6-90a6db82f79a tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:08.882562 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-35fa0ddd-ccc3-46db-86a6-90a6db82f79a tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:08.884488 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-35fa0ddd-ccc3-46db-86a6-90a6db82f79a tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:08.885126 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-35fa0ddd-ccc3-46db-86a6-90a6db82f79a tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:08.900819 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e06b02b2-0fe8-4ed5-9a9e-26c30df7cb9a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:08.912878 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e06b02b2-0fe8-4ed5-9a9e-26c30df7cb9a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:08.913733 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e06b02b2-0fe8-4ed5-9a9e-26c30df7cb9a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:08.914186 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e06b02b2-0fe8-4ed5-9a9e-26c30df7cb9a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:09.193650 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e06b02b2-0fe8-4ed5-9a9e-26c30df7cb9a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:09.201550 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e06b02b2-0fe8-4ed5-9a9e-26c30df7cb9a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e" status: 200 len: 1503 microversion: 2.1 time: 0.342067 Apr 16 21:09:09.206476 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 303/635] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:08 2022] GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e => generated 1503 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:09.223841 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-35fa0ddd-ccc3-46db-86a6-90a6db82f79a tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:09.232314 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-35fa0ddd-ccc3-46db-86a6-90a6db82f79a tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4196bcfc-2c28-485b-8c51-5b460fee70e2" status: 200 len: 1314 microversion: 2.1 time: 0.379807 Apr 16 21:09:09.247612 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 333/636] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:08 2022] GET /compute/v2.1/servers/4196bcfc-2c28-485b-8c51-5b460fee70e2 => generated 1314 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:09.312358 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3de7f6a4-f880-43ec-824e-a07cb7b1d8a4 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:09.313278 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3de7f6a4-f880-43ec-824e-a07cb7b1d8a4 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 7b856a59-2a62-4edc-b448-430f778c7b2e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:09.320939 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3de7f6a4-f880-43ec-824e-a07cb7b1d8a4 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:09.321646 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3de7f6a4-f880-43ec-824e-a07cb7b1d8a4 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:09.322600 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3de7f6a4-f880-43ec-824e-a07cb7b1d8a4 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:09.323905 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3de7f6a4-f880-43ec-824e-a07cb7b1d8a4 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:09.423226 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3de7f6a4-f880-43ec-824e-a07cb7b1d8a4 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:09.431816 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3de7f6a4-f880-43ec-824e-a07cb7b1d8a4 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/7b856a59-2a62-4edc-b448-430f778c7b2e" status: 200 len: 1268 microversion: 2.1 time: 0.123223 Apr 16 21:09:09.439007 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ac62effd-3246-44ee-acb0-de782571756f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:09.439636 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ac62effd-3246-44ee-acb0-de782571756f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: ffc4d9b2-dd4f-44dc-a189-354eff7a5573] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:09.444278 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 304/637] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:09 2022] GET /compute/v2.1/servers/7b856a59-2a62-4edc-b448-430f778c7b2e => generated 1268 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:09.447032 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ac62effd-3246-44ee-acb0-de782571756f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:09.447501 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ac62effd-3246-44ee-acb0-de782571756f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:09.448332 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ac62effd-3246-44ee-acb0-de782571756f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:09.448824 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ac62effd-3246-44ee-acb0-de782571756f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:09.667320 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ac62effd-3246-44ee-acb0-de782571756f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:09.675647 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ac62effd-3246-44ee-acb0-de782571756f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:09.677680 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ac62effd-3246-44ee-acb0-de782571756f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:09.678856 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ac62effd-3246-44ee-acb0-de782571756f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573" status: 200 len: 1558 microversion: 2.25 time: 0.243795 Apr 16 21:09:09.679440 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 334/638] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:09:09 2022] GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573 => generated 1558 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:09:09.697155 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ef084f34-33f1-4743-aa62-d447b9fd2632 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:09.697774 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ef084f34-33f1-4743-aa62-d447b9fd2632 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] [instance: ffc4d9b2-dd4f-44dc-a189-354eff7a5573] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:09.703933 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ef084f34-33f1-4743-aa62-d447b9fd2632 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:09.704422 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ef084f34-33f1-4743-aa62-d447b9fd2632 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:09.705219 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ef084f34-33f1-4743-aa62-d447b9fd2632 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:09.705662 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ef084f34-33f1-4743-aa62-d447b9fd2632 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:09.786746 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3fc25676-8e6c-4e44-b135-df1bc97dae8d tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:09.787356 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3fc25676-8e6c-4e44-b135-df1bc97dae8d tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] [instance: bf93495b-7d10-4cb2-9353-0302e654d8fa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:09.793613 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3fc25676-8e6c-4e44-b135-df1bc97dae8d tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:09.794124 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3fc25676-8e6c-4e44-b135-df1bc97dae8d tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:09.794897 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3fc25676-8e6c-4e44-b135-df1bc97dae8d tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:09.795336 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3fc25676-8e6c-4e44-b135-df1bc97dae8d tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:09.829038 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-ef084f34-33f1-4743-aa62-d447b9fd2632 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lazy-loading 'services' on Instance uuid ffc4d9b2-dd4f-44dc-a189-354eff7a5573 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:09:09.842455 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ef084f34-33f1-4743-aa62-d447b9fd2632 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573" status: 200 len: 2050 microversion: 2.25 time: 0.149899 Apr 16 21:09:09.843031 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 305/639] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:09:09 2022] GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573 => generated 2050 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:09:09.858936 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a423fb70-e31a-492d-b64e-5c82c64f02c5 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:09.859543 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a423fb70-e31a-492d-b64e-5c82c64f02c5 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 18557c2b-2ced-4cbc-998e-978ae82401e7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:09.911677 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a423fb70-e31a-492d-b64e-5c82c64f02c5 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7da58ce23242bd947bbd7387b80b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6395bf8972949f8837289679b58d151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:09.918904 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a423fb70-e31a-492d-b64e-5c82c64f02c5 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "GET /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7" status: 200 len: 1260 microversion: 2.1 time: 0.063946 Apr 16 21:09:09.924474 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 306/640] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:09 2022] GET /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7 => generated 1260 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:09:09.924474 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-55bbeeab-8e10-4425-8114-84f1e487dd06 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:09.924820 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-55bbeeab-8e10-4425-8114-84f1e487dd06 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] [instance: ffc4d9b2-dd4f-44dc-a189-354eff7a5573] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:09.927739 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3fc25676-8e6c-4e44-b135-df1bc97dae8d tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae06aafd64d46deacb8ae1791676d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1924a4ceffaf45d0bf2bd76ebb421bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:09.931316 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-55bbeeab-8e10-4425-8114-84f1e487dd06 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:09.931766 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-55bbeeab-8e10-4425-8114-84f1e487dd06 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:09.932746 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-55bbeeab-8e10-4425-8114-84f1e487dd06 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:09.933216 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-55bbeeab-8e10-4425-8114-84f1e487dd06 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:09.936789 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3fc25676-8e6c-4e44-b135-df1bc97dae8d tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] 10.222.0.20 "GET /compute/v2.1/servers/bf93495b-7d10-4cb2-9353-0302e654d8fa" status: 200 len: 1319 microversion: 2.1 time: 0.153876 Apr 16 21:09:09.937369 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 335/641] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:09 2022] GET /compute/v2.1/servers/bf93495b-7d10-4cb2-9353-0302e654d8fa => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:09:10.077508 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-55bbeeab-8e10-4425-8114-84f1e487dd06 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lazy-loading 'services' on Instance uuid ffc4d9b2-dd4f-44dc-a189-354eff7a5573 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:09:10.092313 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-55bbeeab-8e10-4425-8114-84f1e487dd06 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573" status: 200 len: 2050 microversion: 2.25 time: 0.171715 Apr 16 21:09:10.093127 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 307/642] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:09:09 2022] GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573 => generated 2050 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:09:10.109470 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0afab15a-3f65-4866-a8fa-76d342bdb7e6 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:10.110901 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:09:10.110901 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:09:10.112132 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0afab15a-3f65-4866-a8fa-76d342bdb7e6 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:10.112654 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0afab15a-3f65-4866-a8fa-76d342bdb7e6 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:10.113565 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0afab15a-3f65-4866-a8fa-76d342bdb7e6 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:10.114011 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0afab15a-3f65-4866-a8fa-76d342bdb7e6 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:10.138820 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0afab15a-3f65-4866-a8fa-76d342bdb7e6 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.032964 Apr 16 21:09:10.139432 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 336/643] 10.222.0.20 () {60 vars in 1216 bytes} [Sat Apr 16 21:09:10 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:09:10.154669 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-98933b3a-bc51-4f52-ac57-6fb022685cf0 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:10.155211 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-98933b3a-bc51-4f52-ac57-6fb022685cf0 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] [instance: ffc4d9b2-dd4f-44dc-a189-354eff7a5573] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:10.162266 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-98933b3a-bc51-4f52-ac57-6fb022685cf0 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:10.162913 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-98933b3a-bc51-4f52-ac57-6fb022685cf0 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:10.163698 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-98933b3a-bc51-4f52-ac57-6fb022685cf0 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:10.164132 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-98933b3a-bc51-4f52-ac57-6fb022685cf0 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:10.214550 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-36c939b4-402c-4f98-9caa-4030576b5168 req-4257a039-2161-41ff-af3e-12272252db31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e641f7ec-0d41-4439-bc77-7158fb9d346e", "name": "network-vif-unplugged", "status": "completed", "tag": "cde5a5c3-65ba-417d-8651-74ec3a50ff0d"}, {"name": "network-changed", "server_uuid": "e641f7ec-0d41-4439-bc77-7158fb9d346e", "tag": "cde5a5c3-65ba-417d-8651-74ec3a50ff0d"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:10.236016 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-36c939b4-402c-4f98-9caa-4030576b5168 req-4257a039-2161-41ff-af3e-12272252db31 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:10.237869 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-36c939b4-402c-4f98-9caa-4030576b5168 req-4257a039-2161-41ff-af3e-12272252db31 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:10.256575 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-36c939b4-402c-4f98-9caa-4030576b5168 req-4257a039-2161-41ff-af3e-12272252db31 service nova] Creating event network-vif-unplugged:cde5a5c3-65ba-417d-8651-74ec3a50ff0d for instance e641f7ec-0d41-4439-bc77-7158fb9d346e on nch1-master-1 Apr 16 21:09:10.257873 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-36c939b4-402c-4f98-9caa-4030576b5168 req-4257a039-2161-41ff-af3e-12272252db31 service nova] Creating event network-changed:cde5a5c3-65ba-417d-8651-74ec3a50ff0d for instance e641f7ec-0d41-4439-bc77-7158fb9d346e on nch1-master-1 Apr 16 21:09:10.264030 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-36c939b4-402c-4f98-9caa-4030576b5168 req-4257a039-2161-41ff-af3e-12272252db31 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.053483 Apr 16 21:09:10.265459 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 337/644] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:09:10.274566 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-35076b33-18de-4e2d-9cda-ff201f212faf tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:10.275934 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-35076b33-18de-4e2d-9cda-ff201f212faf tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: e641f7ec-0d41-4439-bc77-7158fb9d346e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:10.295903 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-35076b33-18de-4e2d-9cda-ff201f212faf tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:10.296396 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-35076b33-18de-4e2d-9cda-ff201f212faf tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:10.297400 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-35076b33-18de-4e2d-9cda-ff201f212faf tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:10.297839 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-35076b33-18de-4e2d-9cda-ff201f212faf tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:10.507698 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-98933b3a-bc51-4f52-ac57-6fb022685cf0 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573/action" status: 202 len: 0 microversion: 2.25 time: 0.357036 Apr 16 21:09:10.509815 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 308/645] 10.222.0.20 () {62 vars in 1318 bytes} [Sat Apr 16 21:09:10 2022] POST /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573/action => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:09:10.562028 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-068191de-92dd-4b3f-b2cd-097a2cba1699 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:10.566608 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-068191de-92dd-4b3f-b2cd-097a2cba1699 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4196bcfc-2c28-485b-8c51-5b460fee70e2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:10.595308 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-068191de-92dd-4b3f-b2cd-097a2cba1699 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:10.599597 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-068191de-92dd-4b3f-b2cd-097a2cba1699 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:10.605273 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-068191de-92dd-4b3f-b2cd-097a2cba1699 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:10.610130 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-068191de-92dd-4b3f-b2cd-097a2cba1699 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:11.257164 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-068191de-92dd-4b3f-b2cd-097a2cba1699 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:11.282377 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-068191de-92dd-4b3f-b2cd-097a2cba1699 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4196bcfc-2c28-485b-8c51-5b460fee70e2" status: 200 len: 1314 microversion: 2.1 time: 0.768035 Apr 16 21:09:11.284150 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 309/646] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:10 2022] GET /compute/v2.1/servers/4196bcfc-2c28-485b-8c51-5b460fee70e2 => generated 1314 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:11.296530 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-35076b33-18de-4e2d-9cda-ff201f212faf tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:11.300057 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-44cabbf9-f126-4c5b-9103-2c6351437123 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:11.308451 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-35076b33-18de-4e2d-9cda-ff201f212faf tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e" status: 200 len: 1503 microversion: 2.1 time: 1.038561 Apr 16 21:09:11.310451 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 338/647] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:10 2022] GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e => generated 1503 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:11.318573 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-44cabbf9-f126-4c5b-9103-2c6351437123 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 7b856a59-2a62-4edc-b448-430f778c7b2e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:11.320450 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0bf11e74-fe29-44d4-af63-0396ec962652 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:11.324511 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0bf11e74-fe29-44d4-af63-0396ec962652 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] [instance: ffc4d9b2-dd4f-44dc-a189-354eff7a5573] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:11.338075 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0bf11e74-fe29-44d4-af63-0396ec962652 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:11.341975 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0bf11e74-fe29-44d4-af63-0396ec962652 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:11.344198 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0bf11e74-fe29-44d4-af63-0396ec962652 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:11.344850 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0bf11e74-fe29-44d4-af63-0396ec962652 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:11.355614 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-44cabbf9-f126-4c5b-9103-2c6351437123 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:11.358655 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-44cabbf9-f126-4c5b-9103-2c6351437123 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:11.360413 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-44cabbf9-f126-4c5b-9103-2c6351437123 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:11.360870 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-44cabbf9-f126-4c5b-9103-2c6351437123 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:11.535786 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-44cabbf9-f126-4c5b-9103-2c6351437123 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:11.551895 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-44cabbf9-f126-4c5b-9103-2c6351437123 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/7b856a59-2a62-4edc-b448-430f778c7b2e" status: 200 len: 1274 microversion: 2.1 time: 0.263592 Apr 16 21:09:11.556742 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 310/648] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:11 2022] GET /compute/v2.1/servers/7b856a59-2a62-4edc-b448-430f778c7b2e => generated 1274 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:11.569450 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-086ef264-9f47-45de-9695-d3ed761f4aad tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:11.570371 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-086ef264-9f47-45de-9695-d3ed761f4aad tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 18557c2b-2ced-4cbc-998e-978ae82401e7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:11.576794 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-086ef264-9f47-45de-9695-d3ed761f4aad tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:11.577473 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-086ef264-9f47-45de-9695-d3ed761f4aad tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:11.578483 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-086ef264-9f47-45de-9695-d3ed761f4aad tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:11.579087 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-086ef264-9f47-45de-9695-d3ed761f4aad tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:11.656267 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-0bf11e74-fe29-44d4-af63-0396ec962652 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lazy-loading 'services' on Instance uuid ffc4d9b2-dd4f-44dc-a189-354eff7a5573 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:09:11.671964 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0bf11e74-fe29-44d4-af63-0396ec962652 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573" status: 200 len: 2055 microversion: 2.25 time: 0.358336 Apr 16 21:09:11.672760 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 339/649] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:09:11 2022] GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573 => generated 2055 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:09:11.680152 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cbc6195e-31e8-4301-8599-2f7a03f56bbe tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:11.681069 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cbc6195e-31e8-4301-8599-2f7a03f56bbe tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] [instance: bf93495b-7d10-4cb2-9353-0302e654d8fa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:11.691577 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cbc6195e-31e8-4301-8599-2f7a03f56bbe tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:11.693586 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cbc6195e-31e8-4301-8599-2f7a03f56bbe tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:11.695714 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cbc6195e-31e8-4301-8599-2f7a03f56bbe tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:11.696610 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cbc6195e-31e8-4301-8599-2f7a03f56bbe tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:11.751890 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-086ef264-9f47-45de-9695-d3ed761f4aad tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7da58ce23242bd947bbd7387b80b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6395bf8972949f8837289679b58d151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:11.760286 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-086ef264-9f47-45de-9695-d3ed761f4aad tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "GET /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7" status: 200 len: 1312 microversion: 2.1 time: 0.194459 Apr 16 21:09:11.765488 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 311/650] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:11 2022] GET /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7 => generated 1312 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:11.776734 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-fd55d282-c32a-4a14-8490-903ad5ffe8f6 req-771345cf-994e-49c4-8313-0405fbe68b8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dfc548c-fae5-47a4-bb2e-8a022ebf6c17", "name": "network-vif-plugged", "status": "completed", "tag": "c0642788-5af8-4722-90dd-d3c3c1a8b4a7"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:11.815357 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-fd55d282-c32a-4a14-8490-903ad5ffe8f6 req-771345cf-994e-49c4-8313-0405fbe68b8f service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:11.823857 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-fd55d282-c32a-4a14-8490-903ad5ffe8f6 req-771345cf-994e-49c4-8313-0405fbe68b8f service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:11.861320 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-fd55d282-c32a-4a14-8490-903ad5ffe8f6 req-771345cf-994e-49c4-8313-0405fbe68b8f service nova] Creating event network-vif-plugged:c0642788-5af8-4722-90dd-d3c3c1a8b4a7 for instance 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 on nch1-master-1 Apr 16 21:09:11.877409 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-fd55d282-c32a-4a14-8490-903ad5ffe8f6 req-771345cf-994e-49c4-8313-0405fbe68b8f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108610 Apr 16 21:09:11.879539 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 312/651] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:09:11.897050 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-4773d5b5-c0e1-4705-9750-23fa1098d88f req-11526f2f-60a5-45da-bc2b-d6ca351b296c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d5cf7af-51b8-4392-a551-9d0d9b96a45d", "name": "network-vif-deleted", "tag": "803ab649-d886-491f-afac-b601816b1ffe"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:11.912127 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-4773d5b5-c0e1-4705-9750-23fa1098d88f req-11526f2f-60a5-45da-bc2b-d6ca351b296c service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:11.918139 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-4773d5b5-c0e1-4705-9750-23fa1098d88f req-11526f2f-60a5-45da-bc2b-d6ca351b296c service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:11.939975 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-4773d5b5-c0e1-4705-9750-23fa1098d88f req-11526f2f-60a5-45da-bc2b-d6ca351b296c service nova] Creating event network-vif-deleted:803ab649-d886-491f-afac-b601816b1ffe for instance 8d5cf7af-51b8-4392-a551-9d0d9b96a45d on nch2-master-1 Apr 16 21:09:11.949304 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-4773d5b5-c0e1-4705-9750-23fa1098d88f req-11526f2f-60a5-45da-bc2b-d6ca351b296c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068038 Apr 16 21:09:11.951164 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 313/652] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:09:11.959507 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cbc6195e-31e8-4301-8599-2f7a03f56bbe tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae06aafd64d46deacb8ae1791676d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1924a4ceffaf45d0bf2bd76ebb421bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:11.967560 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cbc6195e-31e8-4301-8599-2f7a03f56bbe tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] 10.222.0.20 "GET /compute/v2.1/servers/bf93495b-7d10-4cb2-9353-0302e654d8fa" status: 200 len: 1469 microversion: 2.1 time: 0.293447 Apr 16 21:09:11.968824 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 340/653] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:11 2022] GET /compute/v2.1/servers/bf93495b-7d10-4cb2-9353-0302e654d8fa => generated 1469 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:12.445564 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ff62c6e4-7873-4df4-8cfb-45479f11661c tempest-ImagesMetadataNegativeTestJSON-1261840338 tempest-ImagesMetadataNegativeTestJSON-1261840338-project] Calling method '.version_select at 0x7fbb96c24040>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:12.477677 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6ac47d9a-8440-43f1-af7b-0c1149d4b339 tempest-LiveMigrationNegativeTest-1640925737 tempest-LiveMigrationNegativeTest-1640925737-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-2131048945", "block_migration": true, "disk_over_commit": false}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:12.478605 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6ac47d9a-8440-43f1-af7b-0c1149d4b339 tempest-LiveMigrationNegativeTest-1640925737 tempest-LiveMigrationNegativeTest-1640925737-project-admin] [instance: bf93495b-7d10-4cb2-9353-0302e654d8fa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:12.493627 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-ff62c6e4-7873-4df4-8cfb-45479f11661c tempest-ImagesMetadataNegativeTestJSON-1261840338 tempest-ImagesMetadataNegativeTestJSON-1261840338-project] HTTP exception thrown: Image not found. Apr 16 21:09:12.494697 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ff62c6e4-7873-4df4-8cfb-45479f11661c tempest-ImagesMetadataNegativeTestJSON-1261840338 tempest-ImagesMetadataNegativeTestJSON-1261840338-project] Returning 404 to user: Image not found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:09:12.495821 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ff62c6e4-7873-4df4-8cfb-45479f11661c tempest-ImagesMetadataNegativeTestJSON-1261840338 tempest-ImagesMetadataNegativeTestJSON-1261840338-project] 10.222.0.20 "DELETE /compute/v2.1/images/3dd83952-1398-4501-9c48-68431f8a53fa/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.273562 Apr 16 21:09:12.499511 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6ac47d9a-8440-43f1-af7b-0c1149d4b339 tempest-LiveMigrationNegativeTest-1640925737 tempest-LiveMigrationNegativeTest-1640925737-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:12.503307 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6ac47d9a-8440-43f1-af7b-0c1149d4b339 tempest-LiveMigrationNegativeTest-1640925737 tempest-LiveMigrationNegativeTest-1640925737-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:12.506299 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 341/654] 10.222.0.20 () {58 vars in 1292 bytes} [Sat Apr 16 21:09:12 2022] DELETE /compute/v2.1/images/3dd83952-1398-4501-9c48-68431f8a53fa/metadata/os_distro => generated 62 bytes in 284 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Apr 16 21:09:12.513472 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6ac47d9a-8440-43f1-af7b-0c1149d4b339 tempest-LiveMigrationNegativeTest-1640925737 tempest-LiveMigrationNegativeTest-1640925737-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:12.513472 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6ac47d9a-8440-43f1-af7b-0c1149d4b339 tempest-LiveMigrationNegativeTest-1640925737 tempest-LiveMigrationNegativeTest-1640925737-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:12.513728 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-93102438-26c4-472e-9ace-8d6702d31504 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:12.514352 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-93102438-26c4-472e-9ace-8d6702d31504 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4196bcfc-2c28-485b-8c51-5b460fee70e2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:12.534888 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-93102438-26c4-472e-9ace-8d6702d31504 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:12.535693 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-93102438-26c4-472e-9ace-8d6702d31504 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:12.548144 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-93102438-26c4-472e-9ace-8d6702d31504 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:12.548144 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-93102438-26c4-472e-9ace-8d6702d31504 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:12.693443 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-6ac47d9a-8440-43f1-af7b-0c1149d4b339 tempest-LiveMigrationNegativeTest-1640925737 tempest-LiveMigrationNegativeTest-1640925737-project-admin] Lazy-loading 'flavor' on Instance uuid bf93495b-7d10-4cb2-9353-0302e654d8fa {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:09:12.817357 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6ac47d9a-8440-43f1-af7b-0c1149d4b339 tempest-LiveMigrationNegativeTest-1640925737 tempest-LiveMigrationNegativeTest-1640925737-project-admin] [instance: bf93495b-7d10-4cb2-9353-0302e654d8fa] Going to try to live migrate instance to tempest-host-2131048945 {{(pid=137409) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Apr 16 21:09:12.842431 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-6ac47d9a-8440-43f1-af7b-0c1149d4b339 tempest-LiveMigrationNegativeTest-1640925737 tempest-LiveMigrationNegativeTest-1640925737-project-admin] HTTP exception thrown: Compute host tempest-host-2131048945 could not be found. Apr 16 21:09:12.843205 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6ac47d9a-8440-43f1-af7b-0c1149d4b339 tempest-LiveMigrationNegativeTest-1640925737 tempest-LiveMigrationNegativeTest-1640925737-project-admin] Returning 400 to user: Compute host tempest-host-2131048945 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:09:12.844098 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6ac47d9a-8440-43f1-af7b-0c1149d4b339 tempest-LiveMigrationNegativeTest-1640925737 tempest-LiveMigrationNegativeTest-1640925737-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/bf93495b-7d10-4cb2-9353-0302e654d8fa/action" status: 400 len: 100 microversion: 2.1 time: 0.856164 Apr 16 21:09:12.844748 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 314/655] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Apr 16 21:09:11 2022] POST /compute/v2.1/servers/bf93495b-7d10-4cb2-9353-0302e654d8fa/action => generated 100 bytes in 864 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:09:12.852770 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-755cb8f7-9478-4d87-8097-ecf20d59af66 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:12.853709 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-755cb8f7-9478-4d87-8097-ecf20d59af66 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: e641f7ec-0d41-4439-bc77-7158fb9d346e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:12.863462 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-755cb8f7-9478-4d87-8097-ecf20d59af66 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:12.866253 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-755cb8f7-9478-4d87-8097-ecf20d59af66 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:12.867434 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-755cb8f7-9478-4d87-8097-ecf20d59af66 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:12.869448 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-755cb8f7-9478-4d87-8097-ecf20d59af66 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:12.874158 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-93102438-26c4-472e-9ace-8d6702d31504 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:12.884985 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-93102438-26c4-472e-9ace-8d6702d31504 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4196bcfc-2c28-485b-8c51-5b460fee70e2" status: 200 len: 1314 microversion: 2.1 time: 0.376992 Apr 16 21:09:12.887534 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 342/656] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:12 2022] GET /compute/v2.1/servers/4196bcfc-2c28-485b-8c51-5b460fee70e2 => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:12.894803 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f80484f4-ee97-48b3-85b9-0a77e7dc01c1 tempest-ImagesMetadataNegativeTestJSON-1261840338 tempest-ImagesMetadataNegativeTestJSON-1261840338-project] Calling method '.version_select at 0x7fbb96b17280>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:12.931842 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-f80484f4-ee97-48b3-85b9-0a77e7dc01c1 tempest-ImagesMetadataNegativeTestJSON-1261840338 tempest-ImagesMetadataNegativeTestJSON-1261840338-project] HTTP exception thrown: Image not found. Apr 16 21:09:12.932769 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f80484f4-ee97-48b3-85b9-0a77e7dc01c1 tempest-ImagesMetadataNegativeTestJSON-1261840338 tempest-ImagesMetadataNegativeTestJSON-1261840338-project] Returning 404 to user: Image not found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:09:12.933844 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f80484f4-ee97-48b3-85b9-0a77e7dc01c1 tempest-ImagesMetadataNegativeTestJSON-1261840338 tempest-ImagesMetadataNegativeTestJSON-1261840338-project] 10.222.0.20 "GET /compute/v2.1/images/849c5203-ac2f-4f59-aa2c-f49e67807313/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.045132 Apr 16 21:09:12.934559 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 343/657] 10.222.0.20 () {58 vars in 1292 bytes} [Sat Apr 16 21:09:12 2022] GET /compute/v2.1/images/849c5203-ac2f-4f59-aa2c-f49e67807313/metadata/os_version => generated 62 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:09:12.940493 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-727306ac-cb7a-4d41-aca0-dee2abb58480 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:12.944646 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-727306ac-cb7a-4d41-aca0-dee2abb58480 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 7b856a59-2a62-4edc-b448-430f778c7b2e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:12.956822 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-727306ac-cb7a-4d41-aca0-dee2abb58480 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:12.957581 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-727306ac-cb7a-4d41-aca0-dee2abb58480 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:12.958578 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-727306ac-cb7a-4d41-aca0-dee2abb58480 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:12.959370 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-727306ac-cb7a-4d41-aca0-dee2abb58480 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:13.094014 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-727306ac-cb7a-4d41-aca0-dee2abb58480 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:13.103113 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-727306ac-cb7a-4d41-aca0-dee2abb58480 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/7b856a59-2a62-4edc-b448-430f778c7b2e" status: 200 len: 1274 microversion: 2.1 time: 0.167186 Apr 16 21:09:13.103755 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 344/658] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:12 2022] GET /compute/v2.1/servers/7b856a59-2a62-4edc-b448-430f778c7b2e => generated 1274 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:13.125101 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-64667da8-eb51-4f2f-930e-85cae90c40b0 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:13.125763 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-64667da8-eb51-4f2f-930e-85cae90c40b0 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] [instance: ffc4d9b2-dd4f-44dc-a189-354eff7a5573] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:13.139096 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-64667da8-eb51-4f2f-930e-85cae90c40b0 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:13.139557 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-64667da8-eb51-4f2f-930e-85cae90c40b0 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:13.140925 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-64667da8-eb51-4f2f-930e-85cae90c40b0 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:13.141366 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-64667da8-eb51-4f2f-930e-85cae90c40b0 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:13.409279 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-755cb8f7-9478-4d87-8097-ecf20d59af66 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:13.430722 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-755cb8f7-9478-4d87-8097-ecf20d59af66 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e" status: 200 len: 1503 microversion: 2.1 time: 0.584799 Apr 16 21:09:13.431716 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 315/659] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:12 2022] GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e => generated 1503 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:13.437568 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b0183deb-0d03-409c-8938-2e80f62b1b91 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:13.438485 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b0183deb-0d03-409c-8938-2e80f62b1b91 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 18557c2b-2ced-4cbc-998e-978ae82401e7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:13.452309 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-64667da8-eb51-4f2f-930e-85cae90c40b0 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lazy-loading 'services' on Instance uuid ffc4d9b2-dd4f-44dc-a189-354eff7a5573 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:09:13.453317 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b0183deb-0d03-409c-8938-2e80f62b1b91 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:13.454502 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b0183deb-0d03-409c-8938-2e80f62b1b91 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:13.455859 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b0183deb-0d03-409c-8938-2e80f62b1b91 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:13.456486 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b0183deb-0d03-409c-8938-2e80f62b1b91 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:13.497972 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-64667da8-eb51-4f2f-930e-85cae90c40b0 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573" status: 200 len: 2035 microversion: 2.25 time: 0.383291 Apr 16 21:09:13.501629 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 345/660] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:09:13 2022] GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573 => generated 2035 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:09:13.511507 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-374901e8-00e8-4fff-84a5-d4551bbaa419 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:13.512131 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-374901e8-00e8-4fff-84a5-d4551bbaa419 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] [instance: bf93495b-7d10-4cb2-9353-0302e654d8fa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:13.532367 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-374901e8-00e8-4fff-84a5-d4551bbaa419 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:13.532833 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-374901e8-00e8-4fff-84a5-d4551bbaa419 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:13.533684 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-374901e8-00e8-4fff-84a5-d4551bbaa419 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:13.534867 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-374901e8-00e8-4fff-84a5-d4551bbaa419 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:13.660950 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b0183deb-0d03-409c-8938-2e80f62b1b91 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7da58ce23242bd947bbd7387b80b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6395bf8972949f8837289679b58d151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:13.707579 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b0183deb-0d03-409c-8938-2e80f62b1b91 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "GET /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7" status: 200 len: 1318 microversion: 2.1 time: 0.270297 Apr 16 21:09:13.717252 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 316/661] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:13 2022] GET /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7 => generated 1318 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:13.732610 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-28f51854-d50c-42fb-81c7-c5d25048d42c tempest-ImagesMetadataNegativeTestJSON-1261840338 tempest-ImagesMetadataNegativeTestJSON-1261840338-project] Calling method '.version_select at 0x7fbb96e64940>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:13.775858 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-28f51854-d50c-42fb-81c7-c5d25048d42c tempest-ImagesMetadataNegativeTestJSON-1261840338 tempest-ImagesMetadataNegativeTestJSON-1261840338-project] HTTP exception thrown: Image not found. Apr 16 21:09:13.776569 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-28f51854-d50c-42fb-81c7-c5d25048d42c tempest-ImagesMetadataNegativeTestJSON-1261840338 tempest-ImagesMetadataNegativeTestJSON-1261840338-project] Returning 404 to user: Image not found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:09:13.777481 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-28f51854-d50c-42fb-81c7-c5d25048d42c tempest-ImagesMetadataNegativeTestJSON-1261840338 tempest-ImagesMetadataNegativeTestJSON-1261840338-project] 10.222.0.20 "GET /compute/v2.1/images/ba9d59e1-80e6-477a-b93e-820a2def94c9/metadata" status: 404 len: 62 microversion: 2.1 time: 0.048925 Apr 16 21:09:13.778127 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 317/662] 10.222.0.20 () {58 vars in 1259 bytes} [Sat Apr 16 21:09:13 2022] GET /compute/v2.1/images/ba9d59e1-80e6-477a-b93e-820a2def94c9/metadata => generated 62 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:09:13.789982 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-eb71410e-06a6-4427-90be-9f3fcb4c0ee6 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:13.791461 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-eb71410e-06a6-4427-90be-9f3fcb4c0ee6 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] [instance: ffc4d9b2-dd4f-44dc-a189-354eff7a5573] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:13.808587 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eb71410e-06a6-4427-90be-9f3fcb4c0ee6 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:13.812607 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eb71410e-06a6-4427-90be-9f3fcb4c0ee6 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:13.813734 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eb71410e-06a6-4427-90be-9f3fcb4c0ee6 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:13.814255 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eb71410e-06a6-4427-90be-9f3fcb4c0ee6 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:13.851051 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-eb71410e-06a6-4427-90be-9f3fcb4c0ee6 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lazy-loading 'flavor' on Instance uuid ffc4d9b2-dd4f-44dc-a189-354eff7a5573 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:09:13.854850 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-374901e8-00e8-4fff-84a5-d4551bbaa419 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae06aafd64d46deacb8ae1791676d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1924a4ceffaf45d0bf2bd76ebb421bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:13.862436 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-374901e8-00e8-4fff-84a5-d4551bbaa419 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] 10.222.0.20 "GET /compute/v2.1/servers/bf93495b-7d10-4cb2-9353-0302e654d8fa" status: 200 len: 1469 microversion: 2.1 time: 0.356890 Apr 16 21:09:13.872974 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 346/663] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:13 2022] GET /compute/v2.1/servers/bf93495b-7d10-4cb2-9353-0302e654d8fa => generated 1469 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:13.872974 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-581074ef-0336-4d4d-8dae-13e1e396d9c5 tempest-ImagesMetadataNegativeTestJSON-1261840338 tempest-ImagesMetadataNegativeTestJSON-1261840338-project] Action: 'update_all', calling method: .version_select at 0x7fbb96b17ee0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:13.884882 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-eb71410e-06a6-4427-90be-9f3fcb4c0ee6 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] [instance: ffc4d9b2-dd4f-44dc-a189-354eff7a5573] Going to try to live migrate instance to nch1-master-1 {{(pid=137409) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Apr 16 21:09:13.906663 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-581074ef-0336-4d4d-8dae-13e1e396d9c5 tempest-ImagesMetadataNegativeTestJSON-1261840338 tempest-ImagesMetadataNegativeTestJSON-1261840338-project] HTTP exception thrown: Image not found. Apr 16 21:09:13.907355 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-581074ef-0336-4d4d-8dae-13e1e396d9c5 tempest-ImagesMetadataNegativeTestJSON-1261840338 tempest-ImagesMetadataNegativeTestJSON-1261840338-project] Returning 404 to user: Image not found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:09:13.908220 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-581074ef-0336-4d4d-8dae-13e1e396d9c5 tempest-ImagesMetadataNegativeTestJSON-1261840338 tempest-ImagesMetadataNegativeTestJSON-1261840338-project] 10.222.0.20 "PUT /compute/v2.1/images/0c9aba6f-ce5c-49fc-9253-6d7a3b3681e2/metadata" status: 404 len: 62 microversion: 2.1 time: 0.041715 Apr 16 21:09:13.908831 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 347/664] 10.222.0.20 () {60 vars in 1279 bytes} [Sat Apr 16 21:09:13 2022] PUT /compute/v2.1/images/0c9aba6f-ce5c-49fc-9253-6d7a3b3681e2/metadata => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:09:13.919469 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-152d20e9-25ca-48d2-9b4e-24b641535baa tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:13.920143 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-152d20e9-25ca-48d2-9b4e-24b641535baa tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4196bcfc-2c28-485b-8c51-5b460fee70e2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:13.929355 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-152d20e9-25ca-48d2-9b4e-24b641535baa tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:13.929816 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-152d20e9-25ca-48d2-9b4e-24b641535baa tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:13.930620 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-152d20e9-25ca-48d2-9b4e-24b641535baa tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:13.931068 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-152d20e9-25ca-48d2-9b4e-24b641535baa tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:14.335355 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-152d20e9-25ca-48d2-9b4e-24b641535baa tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:14.342848 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-152d20e9-25ca-48d2-9b4e-24b641535baa tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4196bcfc-2c28-485b-8c51-5b460fee70e2" status: 200 len: 1314 microversion: 2.1 time: 0.432985 Apr 16 21:09:14.343668 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 348/665] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:13 2022] GET /compute/v2.1/servers/4196bcfc-2c28-485b-8c51-5b460fee70e2 => generated 1314 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:14.367240 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-a271f2e9-4a74-4410-812b-9ad39694ee1c req-0feadd74-094f-440d-ad61-bb8579169249 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4196bcfc-2c28-485b-8c51-5b460fee70e2", "name": "network-vif-plugged", "status": "completed", "tag": "2819bc63-5a3d-4aac-8273-b90dbce3d22d"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:14.389884 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-a271f2e9-4a74-4410-812b-9ad39694ee1c req-0feadd74-094f-440d-ad61-bb8579169249 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:14.390622 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-a271f2e9-4a74-4410-812b-9ad39694ee1c req-0feadd74-094f-440d-ad61-bb8579169249 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:14.404138 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-a271f2e9-4a74-4410-812b-9ad39694ee1c req-0feadd74-094f-440d-ad61-bb8579169249 service nova] Creating event network-vif-plugged:2819bc63-5a3d-4aac-8273-b90dbce3d22d for instance 4196bcfc-2c28-485b-8c51-5b460fee70e2 on nch1-master-1 Apr 16 21:09:14.413851 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-a271f2e9-4a74-4410-812b-9ad39694ee1c req-0feadd74-094f-440d-ad61-bb8579169249 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068512 Apr 16 21:09:14.421088 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 349/666] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:09:14.483314 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-161d9d71-501d-45a1-8631-c45199b373a8 tempest-ImagesMetadataNegativeTestJSON-1261840338 tempest-ImagesMetadataNegativeTestJSON-1261840338-project] Action: 'update', calling method: .version_select at 0x7fbb96b17ca0>, body: {"meta": {"os_distro": "alt"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:14.517710 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-161d9d71-501d-45a1-8631-c45199b373a8 tempest-ImagesMetadataNegativeTestJSON-1261840338 tempest-ImagesMetadataNegativeTestJSON-1261840338-project] HTTP exception thrown: Image not found. Apr 16 21:09:14.517710 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-161d9d71-501d-45a1-8631-c45199b373a8 tempest-ImagesMetadataNegativeTestJSON-1261840338 tempest-ImagesMetadataNegativeTestJSON-1261840338-project] Returning 404 to user: Image not found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:09:14.519103 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-161d9d71-501d-45a1-8631-c45199b373a8 tempest-ImagesMetadataNegativeTestJSON-1261840338 tempest-ImagesMetadataNegativeTestJSON-1261840338-project] 10.222.0.20 "PUT /compute/v2.1/images/95e56929-10c8-4cae-be4c-b2ee73639ea6/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.097755 Apr 16 21:09:14.520203 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 350/667] 10.222.0.20 () {60 vars in 1309 bytes} [Sat Apr 16 21:09:14 2022] PUT /compute/v2.1/images/95e56929-10c8-4cae-be4c-b2ee73639ea6/metadata/os_distro => generated 62 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:09:14.528855 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d4fe34bf-f568-4921-9c07-23ebf09aa58f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:14.529816 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d4fe34bf-f568-4921-9c07-23ebf09aa58f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 7b856a59-2a62-4edc-b448-430f778c7b2e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:14.544282 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d4fe34bf-f568-4921-9c07-23ebf09aa58f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:14.548749 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d4fe34bf-f568-4921-9c07-23ebf09aa58f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:14.549700 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d4fe34bf-f568-4921-9c07-23ebf09aa58f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:14.550236 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d4fe34bf-f568-4921-9c07-23ebf09aa58f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:14.949182 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d4fe34bf-f568-4921-9c07-23ebf09aa58f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:14.957973 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d4fe34bf-f568-4921-9c07-23ebf09aa58f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/7b856a59-2a62-4edc-b448-430f778c7b2e" status: 200 len: 1316 microversion: 2.1 time: 0.436312 Apr 16 21:09:14.977438 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 351/668] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:14 2022] GET /compute/v2.1/servers/7b856a59-2a62-4edc-b448-430f778c7b2e => generated 1316 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:14.982925 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4680a4b0-9e5b-4ffe-8512-3f238e91e934 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-176035298", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:15.054090 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-4680a4b0-9e5b-4ffe-8512-3f238e91e934 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] validate_networks() for None {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:09:15.334740 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-4680a4b0-9e5b-4ffe-8512-3f238e91e934 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:09:15.335053 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-4680a4b0-9e5b-4ffe-8512-3f238e91e934 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:09:15.336641 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-4680a4b0-9e5b-4ffe-8512-3f238e91e934 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:09:15.337044 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-4680a4b0-9e5b-4ffe-8512-3f238e91e934 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:09:15.337510 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-4680a4b0-9e5b-4ffe-8512-3f238e91e934 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:09:15.350084 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4680a4b0-9e5b-4ffe-8512-3f238e91e934 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:15.350544 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4680a4b0-9e5b-4ffe-8512-3f238e91e934 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:15.351562 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4680a4b0-9e5b-4ffe-8512-3f238e91e934 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:15.352012 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4680a4b0-9e5b-4ffe-8512-3f238e91e934 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:15.380897 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-4680a4b0-9e5b-4ffe-8512-3f238e91e934 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Getting quotas for project 1924a4ceffaf45d0bf2bd76ebb421bcd. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:15.399433 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-4680a4b0-9e5b-4ffe-8512-3f238e91e934 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Getting quotas for user eae06aafd64d46deacb8ae1791676d75 and project 1924a4ceffaf45d0bf2bd76ebb421bcd. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:15.433643 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4680a4b0-9e5b-4ffe-8512-3f238e91e934 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:09:15.436020 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4680a4b0-9e5b-4ffe-8512-3f238e91e934 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] [instance: 3ebfe0ed-3568-4b90-b834-fd3ad244dcac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:09:15.607838 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4680a4b0-9e5b-4ffe-8512-3f238e91e934 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.629045 Apr 16 21:09:15.613634 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 352/669] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:09:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:09:15.623640 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1d79f17a-cfc0-437b-9662-cbcd73edc3a0 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:15.625226 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1d79f17a-cfc0-437b-9662-cbcd73edc3a0 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: e641f7ec-0d41-4439-bc77-7158fb9d346e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:15.635161 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1d79f17a-cfc0-437b-9662-cbcd73edc3a0 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:15.635889 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1d79f17a-cfc0-437b-9662-cbcd73edc3a0 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:15.647844 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1d79f17a-cfc0-437b-9662-cbcd73edc3a0 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:15.648369 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1d79f17a-cfc0-437b-9662-cbcd73edc3a0 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:15.881809 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1d79f17a-cfc0-437b-9662-cbcd73edc3a0 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:15.892353 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1d79f17a-cfc0-437b-9662-cbcd73edc3a0 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e" status: 200 len: 1503 microversion: 2.1 time: 0.281119 Apr 16 21:09:15.892979 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 353/670] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:15 2022] GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e => generated 1503 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:15.899136 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f1dd5199-50a0-4a2a-a3bb-0b35f240cd74 tempest-ImagesMetadataNegativeTestJSON-1261840338 tempest-ImagesMetadataNegativeTestJSON-1261840338-project] Action: 'create', calling method: .version_select at 0x7fbb96b6a3a0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:15.922308 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-f1dd5199-50a0-4a2a-a3bb-0b35f240cd74 tempest-ImagesMetadataNegativeTestJSON-1261840338 tempest-ImagesMetadataNegativeTestJSON-1261840338-project] HTTP exception thrown: Image not found. Apr 16 21:09:15.922847 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f1dd5199-50a0-4a2a-a3bb-0b35f240cd74 tempest-ImagesMetadataNegativeTestJSON-1261840338 tempest-ImagesMetadataNegativeTestJSON-1261840338-project] Returning 404 to user: Image not found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:09:15.923700 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f1dd5199-50a0-4a2a-a3bb-0b35f240cd74 tempest-ImagesMetadataNegativeTestJSON-1261840338 tempest-ImagesMetadataNegativeTestJSON-1261840338-project] 10.222.0.20 "POST /compute/v2.1/images/89898c6a-f700-4a1f-aa08-4d31c15a5419/metadata" status: 404 len: 62 microversion: 2.1 time: 0.029235 Apr 16 21:09:15.924279 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 354/671] 10.222.0.20 () {60 vars in 1280 bytes} [Sat Apr 16 21:09:15 2022] POST /compute/v2.1/images/89898c6a-f700-4a1f-aa08-4d31c15a5419/metadata => generated 62 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:09:15.937318 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-55c4e427-ce9d-4b74-b8fd-d515b5623975 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:15.939824 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-55c4e427-ce9d-4b74-b8fd-d515b5623975 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 18557c2b-2ced-4cbc-998e-978ae82401e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:15.949408 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-55c4e427-ce9d-4b74-b8fd-d515b5623975 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:15.949890 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-55c4e427-ce9d-4b74-b8fd-d515b5623975 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:15.950739 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-55c4e427-ce9d-4b74-b8fd-d515b5623975 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:15.951356 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-55c4e427-ce9d-4b74-b8fd-d515b5623975 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:16.235980 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-55c4e427-ce9d-4b74-b8fd-d515b5623975 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7da58ce23242bd947bbd7387b80b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6395bf8972949f8837289679b58d151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:16.245491 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-55c4e427-ce9d-4b74-b8fd-d515b5623975 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "GET /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7" status: 200 len: 1386 microversion: 2.1 time: 0.319696 Apr 16 21:09:16.253052 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 355/672] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:15 2022] GET /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7 => generated 1386 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:16.493621 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6435175c-f8fc-4a27-b6c3-583bc906f978 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-1392977475", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:16.598771 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-6435175c-f8fc-4a27-b6c3-583bc906f978 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] validate_networks() for None {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:09:17.054497 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-6435175c-f8fc-4a27-b6c3-583bc906f978 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:09:17.055881 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-6435175c-f8fc-4a27-b6c3-583bc906f978 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:09:17.056449 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-6435175c-f8fc-4a27-b6c3-583bc906f978 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:09:17.057026 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-6435175c-f8fc-4a27-b6c3-583bc906f978 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:09:17.057447 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-6435175c-f8fc-4a27-b6c3-583bc906f978 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:09:17.068065 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6435175c-f8fc-4a27-b6c3-583bc906f978 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:17.068899 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6435175c-f8fc-4a27-b6c3-583bc906f978 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:17.069971 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6435175c-f8fc-4a27-b6c3-583bc906f978 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:17.070639 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6435175c-f8fc-4a27-b6c3-583bc906f978 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:17.090349 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-6435175c-f8fc-4a27-b6c3-583bc906f978 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Getting quotas for project 3c60195eda214c42831714a690e64ed7. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:17.098078 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-6435175c-f8fc-4a27-b6c3-583bc906f978 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Getting quotas for user 5c3256e24aea41618454e831a0c2a7b0 and project 3c60195eda214c42831714a690e64ed7. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:17.116274 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6435175c-f8fc-4a27-b6c3-583bc906f978 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:09:17.118923 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6435175c-f8fc-4a27-b6c3-583bc906f978 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] [instance: 7f267f97-0675-4567-970e-9b51514392cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:09:17.284456 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6435175c-f8fc-4a27-b6c3-583bc906f978 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.029227 Apr 16 21:09:17.286035 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 356/673] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:09:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1032 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:09:17.302388 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fa837144-25d8-4ed9-a2ef-6e81c893d74d tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:17.307612 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fa837144-25d8-4ed9-a2ef-6e81c893d74d tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4196bcfc-2c28-485b-8c51-5b460fee70e2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:17.315629 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fa837144-25d8-4ed9-a2ef-6e81c893d74d tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:17.318790 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fa837144-25d8-4ed9-a2ef-6e81c893d74d tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:17.321307 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fa837144-25d8-4ed9-a2ef-6e81c893d74d tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:17.321933 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fa837144-25d8-4ed9-a2ef-6e81c893d74d tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:17.535189 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fa837144-25d8-4ed9-a2ef-6e81c893d74d tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:17.544816 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fa837144-25d8-4ed9-a2ef-6e81c893d74d tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4196bcfc-2c28-485b-8c51-5b460fee70e2" status: 200 len: 1464 microversion: 2.1 time: 0.257108 Apr 16 21:09:17.545774 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 357/674] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:17 2022] GET /compute/v2.1/servers/4196bcfc-2c28-485b-8c51-5b460fee70e2 => generated 1464 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:17.550465 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bcecc0d9-73b5-40dd-acc2-9ac718a28063 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:17.551074 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-bcecc0d9-73b5-40dd-acc2-9ac718a28063 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] [instance: 3ebfe0ed-3568-4b90-b834-fd3ad244dcac] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:17.570998 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bcecc0d9-73b5-40dd-acc2-9ac718a28063 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:17.571196 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bcecc0d9-73b5-40dd-acc2-9ac718a28063 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:17.572210 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bcecc0d9-73b5-40dd-acc2-9ac718a28063 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:17.572829 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bcecc0d9-73b5-40dd-acc2-9ac718a28063 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:17.597556 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-eb71410e-06a6-4427-90be-9f3fcb4c0ee6 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573/action" status: 202 len: 0 microversion: 2.25 time: 3.818270 Apr 16 21:09:17.598453 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 318/675] 10.222.0.20 () {62 vars in 1318 bytes} [Sat Apr 16 21:09:13 2022] POST /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573/action => generated 0 bytes in 3820 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:09:17.603850 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-6d3a8bd8-026c-45a4-bc8d-a045f2be4332 req-4b8c7cd5-3d7b-4e8a-a2f2-3daa70991b9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b856a59-2a62-4edc-b448-430f778c7b2e", "tag": "74297eec-fea7-4f18-9edd-1a7bb09d6fd5"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:17.616145 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-6d3a8bd8-026c-45a4-bc8d-a045f2be4332 req-4b8c7cd5-3d7b-4e8a-a2f2-3daa70991b9d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:17.616735 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-6d3a8bd8-026c-45a4-bc8d-a045f2be4332 req-4b8c7cd5-3d7b-4e8a-a2f2-3daa70991b9d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:17.627833 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-6d3a8bd8-026c-45a4-bc8d-a045f2be4332 req-4b8c7cd5-3d7b-4e8a-a2f2-3daa70991b9d service nova] Creating event network-changed:74297eec-fea7-4f18-9edd-1a7bb09d6fd5 for instance 7b856a59-2a62-4edc-b448-430f778c7b2e on nch2-master-1 Apr 16 21:09:17.632648 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-6d3a8bd8-026c-45a4-bc8d-a045f2be4332 req-4b8c7cd5-3d7b-4e8a-a2f2-3daa70991b9d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032387 Apr 16 21:09:17.633231 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 319/676] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:09:17.638727 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3bc7e8e7-42d4-4eb8-8a05-31d5678d71da tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:17.640359 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3bc7e8e7-42d4-4eb8-8a05-31d5678d71da tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 7b856a59-2a62-4edc-b448-430f778c7b2e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:17.646368 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3bc7e8e7-42d4-4eb8-8a05-31d5678d71da tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:17.646827 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3bc7e8e7-42d4-4eb8-8a05-31d5678d71da tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:17.647604 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3bc7e8e7-42d4-4eb8-8a05-31d5678d71da tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:17.648207 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3bc7e8e7-42d4-4eb8-8a05-31d5678d71da tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:17.652770 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-bcecc0d9-73b5-40dd-acc2-9ac718a28063 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae06aafd64d46deacb8ae1791676d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1924a4ceffaf45d0bf2bd76ebb421bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:17.660643 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-bcecc0d9-73b5-40dd-acc2-9ac718a28063 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebfe0ed-3568-4b90-b834-fd3ad244dcac" status: 200 len: 1214 microversion: 2.1 time: 0.113754 Apr 16 21:09:17.667376 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 358/677] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:17 2022] GET /compute/v2.1/servers/3ebfe0ed-3568-4b90-b834-fd3ad244dcac => generated 1214 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:17.670950 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-c544abe1-9a8b-455d-bea9-0a1693140470 req-6b722083-04fc-4a00-915a-42b1db272d3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18557c2b-2ced-4cbc-998e-978ae82401e7", "tag": "e6de744b-54d0-45c6-a666-8fc2c4a831b1"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:17.681528 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-c544abe1-9a8b-455d-bea9-0a1693140470 req-6b722083-04fc-4a00-915a-42b1db272d3b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:17.682426 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-c544abe1-9a8b-455d-bea9-0a1693140470 req-6b722083-04fc-4a00-915a-42b1db272d3b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:17.694293 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-c544abe1-9a8b-455d-bea9-0a1693140470 req-6b722083-04fc-4a00-915a-42b1db272d3b service nova] Creating event network-changed:e6de744b-54d0-45c6-a666-8fc2c4a831b1 for instance 18557c2b-2ced-4cbc-998e-978ae82401e7 on nch2-master-1 Apr 16 21:09:17.699126 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-c544abe1-9a8b-455d-bea9-0a1693140470 req-6b722083-04fc-4a00-915a-42b1db272d3b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035789 Apr 16 21:09:17.700083 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 359/678] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:09:17.705190 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-55f25d66-4efe-4a7a-bb19-1ecb64d1761b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:17.705879 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-55f25d66-4efe-4a7a-bb19-1ecb64d1761b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: e641f7ec-0d41-4439-bc77-7158fb9d346e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:17.711906 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-55f25d66-4efe-4a7a-bb19-1ecb64d1761b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:17.712401 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-55f25d66-4efe-4a7a-bb19-1ecb64d1761b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:17.713436 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-55f25d66-4efe-4a7a-bb19-1ecb64d1761b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:17.713885 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-55f25d66-4efe-4a7a-bb19-1ecb64d1761b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:17.798716 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3bc7e8e7-42d4-4eb8-8a05-31d5678d71da tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:17.806937 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3bc7e8e7-42d4-4eb8-8a05-31d5678d71da tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/7b856a59-2a62-4edc-b448-430f778c7b2e" status: 200 len: 1316 microversion: 2.1 time: 0.172329 Apr 16 21:09:17.807501 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 320/679] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:17 2022] GET /compute/v2.1/servers/7b856a59-2a62-4edc-b448-430f778c7b2e => generated 1316 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:17.812154 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-dbb7377b-df53-43c2-b556-7b47074b346d tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:17.813007 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-dbb7377b-df53-43c2-b556-7b47074b346d tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 18557c2b-2ced-4cbc-998e-978ae82401e7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:17.819047 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dbb7377b-df53-43c2-b556-7b47074b346d tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:17.819511 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dbb7377b-df53-43c2-b556-7b47074b346d tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:17.820322 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dbb7377b-df53-43c2-b556-7b47074b346d tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:17.820767 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dbb7377b-df53-43c2-b556-7b47074b346d tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:17.858008 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-55f25d66-4efe-4a7a-bb19-1ecb64d1761b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:17.867378 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-55f25d66-4efe-4a7a-bb19-1ecb64d1761b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e" status: 200 len: 1503 microversion: 2.1 time: 0.166089 Apr 16 21:09:17.867957 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 360/680] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:17 2022] GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e => generated 1503 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:17.872800 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9d6a195f-1b77-483a-bc84-d3877b594ce6 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:17.873399 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9d6a195f-1b77-483a-bc84-d3877b594ce6 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] [instance: 7f267f97-0675-4567-970e-9b51514392cc] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:17.936000 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9d6a195f-1b77-483a-bc84-d3877b594ce6 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3256e24aea41618454e831a0c2a7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c60195eda214c42831714a690e64ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:17.943928 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9d6a195f-1b77-483a-bc84-d3877b594ce6 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] 10.222.0.20 "GET /compute/v2.1/servers/7f267f97-0675-4567-970e-9b51514392cc" status: 200 len: 1216 microversion: 2.1 time: 0.074791 Apr 16 21:09:17.944532 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 361/681] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:17 2022] GET /compute/v2.1/servers/7f267f97-0675-4567-970e-9b51514392cc => generated 1216 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:17.949172 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8cf74cde-b84f-48a7-99f7-40b8a76019d6 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:17.950105 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8cf74cde-b84f-48a7-99f7-40b8a76019d6 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:17.958169 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8cf74cde-b84f-48a7-99f7-40b8a76019d6 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:17.960970 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8cf74cde-b84f-48a7-99f7-40b8a76019d6 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:17.966858 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8cf74cde-b84f-48a7-99f7-40b8a76019d6 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:17.967614 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8cf74cde-b84f-48a7-99f7-40b8a76019d6 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:17.977787 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-dbb7377b-df53-43c2-b556-7b47074b346d tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7da58ce23242bd947bbd7387b80b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6395bf8972949f8837289679b58d151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:17.987119 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-dbb7377b-df53-43c2-b556-7b47074b346d tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "GET /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7" status: 200 len: 1386 microversion: 2.1 time: 0.178322 Apr 16 21:09:17.988018 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 321/682] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:17 2022] GET /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7 => generated 1386 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:18.001512 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-415872a4-cc2d-4222-a961-65ba98ab7a98 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:18.002370 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-415872a4-cc2d-4222-a961-65ba98ab7a98 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: ffc4d9b2-dd4f-44dc-a189-354eff7a5573] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:18.014752 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-415872a4-cc2d-4222-a961-65ba98ab7a98 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:18.015530 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-415872a4-cc2d-4222-a961-65ba98ab7a98 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:18.017079 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-415872a4-cc2d-4222-a961-65ba98ab7a98 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:18.017576 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-415872a4-cc2d-4222-a961-65ba98ab7a98 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:18.119603 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8cf74cde-b84f-48a7-99f7-40b8a76019d6 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:18.127516 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8cf74cde-b84f-48a7-99f7-40b8a76019d6 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1464 microversion: 2.1 time: 0.181823 Apr 16 21:09:18.134723 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 362/683] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:17 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1464 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:18.172748 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-415872a4-cc2d-4222-a961-65ba98ab7a98 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:18.181546 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-415872a4-cc2d-4222-a961-65ba98ab7a98 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:18.183270 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-415872a4-cc2d-4222-a961-65ba98ab7a98 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:18.184484 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-415872a4-cc2d-4222-a961-65ba98ab7a98 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573" status: 200 len: 1568 microversion: 2.25 time: 0.195316 Apr 16 21:09:18.185593 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 322/684] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:09:17 2022] GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573 => generated 1568 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:09:18.237005 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f6dac66f-7c10-485a-90c9-19c67cf94e61 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-38323045", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "4dfc548c-fae5-47a4-bb2e-8a022ebf6c17"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:18.290352 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-f6dac66f-7c10-485a-90c9-19c67cf94e61 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] validate_networks() for None {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:09:18.517357 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-f6dac66f-7c10-485a-90c9-19c67cf94e61 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:09:18.517790 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-f6dac66f-7c10-485a-90c9-19c67cf94e61 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:09:18.518274 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-f6dac66f-7c10-485a-90c9-19c67cf94e61 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:09:18.518689 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-f6dac66f-7c10-485a-90c9-19c67cf94e61 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:09:18.519112 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-f6dac66f-7c10-485a-90c9-19c67cf94e61 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:09:18.534419 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6dac66f-7c10-485a-90c9-19c67cf94e61 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:18.534881 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6dac66f-7c10-485a-90c9-19c67cf94e61 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:18.535705 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6dac66f-7c10-485a-90c9-19c67cf94e61 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:18.536155 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6dac66f-7c10-485a-90c9-19c67cf94e61 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:18.556438 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-f6dac66f-7c10-485a-90c9-19c67cf94e61 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Getting quotas for project ba3fef3234544544870ea9ee02d5b344. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:18.562201 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-f6dac66f-7c10-485a-90c9-19c67cf94e61 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Getting quotas for user 7fa9708327d54bbea48ed890d0506ea2 and project ba3fef3234544544870ea9ee02d5b344. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:18.584216 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f6dac66f-7c10-485a-90c9-19c67cf94e61 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:09:18.587396 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f6dac66f-7c10-485a-90c9-19c67cf94e61 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: de422b8c-d5d0-4730-92c4-f30877d0cf2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:09:18.678393 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e5c406d0-f825-4836-a5df-433f9898b170 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:18.680262 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e5c406d0-f825-4836-a5df-433f9898b170 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] [instance: 3ebfe0ed-3568-4b90-b834-fd3ad244dcac] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:18.686863 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e5c406d0-f825-4836-a5df-433f9898b170 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:18.688253 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e5c406d0-f825-4836-a5df-433f9898b170 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:18.689129 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e5c406d0-f825-4836-a5df-433f9898b170 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:18.689644 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e5c406d0-f825-4836-a5df-433f9898b170 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:18.760034 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e5c406d0-f825-4836-a5df-433f9898b170 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae06aafd64d46deacb8ae1791676d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1924a4ceffaf45d0bf2bd76ebb421bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:18.767436 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e5c406d0-f825-4836-a5df-433f9898b170 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebfe0ed-3568-4b90-b834-fd3ad244dcac" status: 200 len: 1278 microversion: 2.1 time: 0.092851 Apr 16 21:09:18.767936 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 323/685] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:18 2022] GET /compute/v2.1/servers/3ebfe0ed-3568-4b90-b834-fd3ad244dcac => generated 1278 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:09:18.796416 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f6dac66f-7c10-485a-90c9-19c67cf94e61 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.563106 Apr 16 21:09:18.797316 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 363/686] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:09:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:09:18.811111 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4e964f6c-4d20-4219-a0f3-3a3936a78a61 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:18.811952 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4e964f6c-4d20-4219-a0f3-3a3936a78a61 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: de422b8c-d5d0-4730-92c4-f30877d0cf2b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:18.827049 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-60ee8ba6-c027-4ea2-b928-9d7e2c805747 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:18.827688 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-60ee8ba6-c027-4ea2-b928-9d7e2c805747 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 7b856a59-2a62-4edc-b448-430f778c7b2e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:18.837309 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-60ee8ba6-c027-4ea2-b928-9d7e2c805747 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:18.838846 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-60ee8ba6-c027-4ea2-b928-9d7e2c805747 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:18.840012 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-60ee8ba6-c027-4ea2-b928-9d7e2c805747 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:18.840634 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-60ee8ba6-c027-4ea2-b928-9d7e2c805747 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:18.890715 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4e964f6c-4d20-4219-a0f3-3a3936a78a61 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:18.900577 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4e964f6c-4d20-4219-a0f3-3a3936a78a61 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/de422b8c-d5d0-4730-92c4-f30877d0cf2b" status: 200 len: 1212 microversion: 2.1 time: 0.093134 Apr 16 21:09:18.901715 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 324/687] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:18 2022] GET /compute/v2.1/servers/de422b8c-d5d0-4730-92c4-f30877d0cf2b => generated 1212 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:18.910593 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-599d71c5-9cd7-4960-80cc-4f01671bdb6a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:18.910593 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-599d71c5-9cd7-4960-80cc-4f01671bdb6a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: e641f7ec-0d41-4439-bc77-7158fb9d346e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:18.920296 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-599d71c5-9cd7-4960-80cc-4f01671bdb6a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:18.920909 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-599d71c5-9cd7-4960-80cc-4f01671bdb6a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:18.921773 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-599d71c5-9cd7-4960-80cc-4f01671bdb6a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:18.922219 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-599d71c5-9cd7-4960-80cc-4f01671bdb6a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:19.055051 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-60ee8ba6-c027-4ea2-b928-9d7e2c805747 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:19.065538 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-60ee8ba6-c027-4ea2-b928-9d7e2c805747 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/7b856a59-2a62-4edc-b448-430f778c7b2e" status: 200 len: 1316 microversion: 2.1 time: 0.244792 Apr 16 21:09:19.067405 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 364/688] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:18 2022] GET /compute/v2.1/servers/7b856a59-2a62-4edc-b448-430f778c7b2e => generated 1316 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:19.072922 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a661ae28-3ec3-47e4-90ce-6efd55471d67 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:19.073779 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a661ae28-3ec3-47e4-90ce-6efd55471d67 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] [instance: 7f267f97-0675-4567-970e-9b51514392cc] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:19.081681 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a661ae28-3ec3-47e4-90ce-6efd55471d67 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:19.082221 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a661ae28-3ec3-47e4-90ce-6efd55471d67 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:19.094596 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a661ae28-3ec3-47e4-90ce-6efd55471d67 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:19.094596 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a661ae28-3ec3-47e4-90ce-6efd55471d67 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:19.149352 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-599d71c5-9cd7-4960-80cc-4f01671bdb6a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:19.157182 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-599d71c5-9cd7-4960-80cc-4f01671bdb6a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e" status: 200 len: 1503 microversion: 2.1 time: 0.254378 Apr 16 21:09:19.157858 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 325/689] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:18 2022] GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e => generated 1503 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:19.171735 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a661ae28-3ec3-47e4-90ce-6efd55471d67 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3256e24aea41618454e831a0c2a7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c60195eda214c42831714a690e64ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:19.175602 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0f3f832a-cf2e-4889-96e3-548d9f047ef0 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:19.176256 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0f3f832a-cf2e-4889-96e3-548d9f047ef0 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 18557c2b-2ced-4cbc-998e-978ae82401e7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:19.181026 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a661ae28-3ec3-47e4-90ce-6efd55471d67 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] 10.222.0.20 "GET /compute/v2.1/servers/7f267f97-0675-4567-970e-9b51514392cc" status: 200 len: 1220 microversion: 2.1 time: 0.111708 Apr 16 21:09:19.186475 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 365/690] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:19 2022] GET /compute/v2.1/servers/7f267f97-0675-4567-970e-9b51514392cc => generated 1220 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:19.186647 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0f3f832a-cf2e-4889-96e3-548d9f047ef0 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:19.186647 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0f3f832a-cf2e-4889-96e3-548d9f047ef0 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:19.186647 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0f3f832a-cf2e-4889-96e3-548d9f047ef0 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:19.186885 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0f3f832a-cf2e-4889-96e3-548d9f047ef0 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:19.326051 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-31e74e3e-ec73-4993-bf4c-ca010ec37ea3 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Action: 'create', calling method: .version_select at 0x7fbb96b37af0>, body: {"keypair": {"name": "tempest-keypair-1434352625"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:19.345618 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-31e74e3e-ec73-4993-bf4c-ca010ec37ea3 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Getting quotas for project 4cfabc21d04d4b4e9a5c354d9c0af120. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:19.352564 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-31e74e3e-ec73-4993-bf4c-ca010ec37ea3 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Getting quotas for user 5108baa5337443fc92507428447bd8e0 and project 4cfabc21d04d4b4e9a5c354d9c0af120. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:19.431019 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0f3f832a-cf2e-4889-96e3-548d9f047ef0 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7da58ce23242bd947bbd7387b80b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6395bf8972949f8837289679b58d151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:19.439258 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0f3f832a-cf2e-4889-96e3-548d9f047ef0 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "GET /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7" status: 200 len: 1386 microversion: 2.1 time: 0.280060 Apr 16 21:09:19.440117 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 326/691] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:19 2022] GET /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7 => generated 1386 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:19.450022 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-56cc2703-157d-40b1-b3ed-830d722b1390 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:19.450705 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-56cc2703-157d-40b1-b3ed-830d722b1390 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: ffc4d9b2-dd4f-44dc-a189-354eff7a5573] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:19.456905 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-56cc2703-157d-40b1-b3ed-830d722b1390 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:19.457370 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-56cc2703-157d-40b1-b3ed-830d722b1390 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:19.458210 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-56cc2703-157d-40b1-b3ed-830d722b1390 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:19.458663 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-56cc2703-157d-40b1-b3ed-830d722b1390 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:19.632016 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-56cc2703-157d-40b1-b3ed-830d722b1390 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:19.641552 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-56cc2703-157d-40b1-b3ed-830d722b1390 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:19.643681 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-56cc2703-157d-40b1-b3ed-830d722b1390 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:19.645292 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-56cc2703-157d-40b1-b3ed-830d722b1390 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573" status: 200 len: 1568 microversion: 2.25 time: 0.203907 Apr 16 21:09:19.646002 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 327/692] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:09:19 2022] GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573 => generated 1568 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:09:19.785334 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-77c7815a-b3c7-47a0-98e7-99950136ced6 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:19.787513 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-77c7815a-b3c7-47a0-98e7-99950136ced6 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] [instance: 3ebfe0ed-3568-4b90-b834-fd3ad244dcac] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:19.794327 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-77c7815a-b3c7-47a0-98e7-99950136ced6 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:19.794780 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-77c7815a-b3c7-47a0-98e7-99950136ced6 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:19.795568 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-77c7815a-b3c7-47a0-98e7-99950136ced6 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:19.796025 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-77c7815a-b3c7-47a0-98e7-99950136ced6 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:19.842408 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-31e74e3e-ec73-4993-bf4c-ca010ec37ea3 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Getting quotas for project 4cfabc21d04d4b4e9a5c354d9c0af120. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:19.848521 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-31e74e3e-ec73-4993-bf4c-ca010ec37ea3 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Getting quotas for user 5108baa5337443fc92507428447bd8e0 and project 4cfabc21d04d4b4e9a5c354d9c0af120. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:19.865636 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-31e74e3e-ec73-4993-bf4c-ca010ec37ea3 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.2 time: 0.681663 Apr 16 21:09:19.866243 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 366/693] 10.222.0.20 () {62 vars in 1197 bytes} [Sat Apr 16 21:09:19 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 684 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:09:19.876077 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-406cc986-8c3f-4e83-9e3c-e1479dcb3888 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Calling method '.version_select at 0x7fbb96b37d30>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:19.883256 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-406cc986-8c3f-4e83-9e3c-e1479dcb3888 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-1434352625" status: 200 len: 706 microversion: 2.2 time: 0.011075 Apr 16 21:09:19.883805 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 367/694] 10.222.0.20 () {60 vars in 1257 bytes} [Sat Apr 16 21:09:19 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1434352625 => generated 706 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:09:19.894229 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8fb51216-5896-4f24-ae9f-65f6d91b7da8 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Calling method '.version_select at 0x7fbb96b2b160>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:19.993332 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-77c7815a-b3c7-47a0-98e7-99950136ced6 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae06aafd64d46deacb8ae1791676d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1924a4ceffaf45d0bf2bd76ebb421bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:20.000884 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-77c7815a-b3c7-47a0-98e7-99950136ced6 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebfe0ed-3568-4b90-b834-fd3ad244dcac" status: 200 len: 1318 microversion: 2.1 time: 0.219492 Apr 16 21:09:20.011116 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8fb51216-5896-4f24-ae9f-65f6d91b7da8 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1434352625" status: 204 len: 0 microversion: 2.2 time: 0.111266 Apr 16 21:09:20.011315 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 328/695] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:19 2022] GET /compute/v2.1/servers/3ebfe0ed-3568-4b90-b834-fd3ad244dcac => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:09:20.011456 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 368/696] 10.222.0.20 () {60 vars in 1260 bytes} [Sat Apr 16 21:09:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1434352625 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:09:20.011550 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c7402969-71b9-4e6e-943b-2c02e6268328 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:20.011550 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c7402969-71b9-4e6e-943b-2c02e6268328 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: de422b8c-d5d0-4730-92c4-f30877d0cf2b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:20.015615 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c7402969-71b9-4e6e-943b-2c02e6268328 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:20.016134 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c7402969-71b9-4e6e-943b-2c02e6268328 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:20.016952 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c7402969-71b9-4e6e-943b-2c02e6268328 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:20.017398 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c7402969-71b9-4e6e-943b-2c02e6268328 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:20.017518 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b14cdb82-c5b4-4902-8fc6-a648195bc67d tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Action: 'create', calling method: .version_select at 0x7fbb96aef790>, body: {"keypair": {"name": "tempest-keypair-576421130"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:20.042536 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-b14cdb82-c5b4-4902-8fc6-a648195bc67d tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Getting quotas for project 4cfabc21d04d4b4e9a5c354d9c0af120. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:20.049153 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-b14cdb82-c5b4-4902-8fc6-a648195bc67d tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Getting quotas for user 5108baa5337443fc92507428447bd8e0 and project 4cfabc21d04d4b4e9a5c354d9c0af120. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:20.121942 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c7402969-71b9-4e6e-943b-2c02e6268328 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:20.130428 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c7402969-71b9-4e6e-943b-2c02e6268328 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/de422b8c-d5d0-4730-92c4-f30877d0cf2b" status: 200 len: 1216 microversion: 2.1 time: 0.127535 Apr 16 21:09:20.130997 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 329/697] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:20 2022] GET /compute/v2.1/servers/de422b8c-d5d0-4730-92c4-f30877d0cf2b => generated 1216 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:20.142561 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8afcce33-2ca7-4504-9c0f-2e321120ef3a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:20.143175 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8afcce33-2ca7-4504-9c0f-2e321120ef3a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 7b856a59-2a62-4edc-b448-430f778c7b2e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:20.149519 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8afcce33-2ca7-4504-9c0f-2e321120ef3a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:20.150010 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8afcce33-2ca7-4504-9c0f-2e321120ef3a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:20.150791 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8afcce33-2ca7-4504-9c0f-2e321120ef3a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:20.151236 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8afcce33-2ca7-4504-9c0f-2e321120ef3a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:20.359437 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-b14cdb82-c5b4-4902-8fc6-a648195bc67d tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Getting quotas for project 4cfabc21d04d4b4e9a5c354d9c0af120. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:20.365051 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-b14cdb82-c5b4-4902-8fc6-a648195bc67d tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Getting quotas for user 5108baa5337443fc92507428447bd8e0 and project 4cfabc21d04d4b4e9a5c354d9c0af120. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:20.379385 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b14cdb82-c5b4-4902-8fc6-a648195bc67d tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.2 time: 0.366052 Apr 16 21:09:20.379916 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 369/698] 10.222.0.20 () {62 vars in 1197 bytes} [Sat Apr 16 21:09:20 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 367 msecs (HTTP/1.1 201) 9 headers in 363 bytes (2 switches on core 0) Apr 16 21:09:20.385792 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-12dbbd10-29c4-42c3-88ab-3a88751993d7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:20.386403 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-12dbbd10-29c4-42c3-88ab-3a88751993d7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: e641f7ec-0d41-4439-bc77-7158fb9d346e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:20.392353 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-12dbbd10-29c4-42c3-88ab-3a88751993d7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:20.392843 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-12dbbd10-29c4-42c3-88ab-3a88751993d7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:20.400825 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-12dbbd10-29c4-42c3-88ab-3a88751993d7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:20.401401 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-12dbbd10-29c4-42c3-88ab-3a88751993d7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:20.512541 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8afcce33-2ca7-4504-9c0f-2e321120ef3a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:20.520613 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8afcce33-2ca7-4504-9c0f-2e321120ef3a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/7b856a59-2a62-4edc-b448-430f778c7b2e" status: 200 len: 1316 microversion: 2.1 time: 0.388230 Apr 16 21:09:20.521368 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 330/699] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:20 2022] GET /compute/v2.1/servers/7b856a59-2a62-4edc-b448-430f778c7b2e => generated 1316 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:20.527389 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1ff7bda1-2d5d-42d2-a86e-1c7dc1b1a365 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:20.528497 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1ff7bda1-2d5d-42d2-a86e-1c7dc1b1a365 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] [instance: 7f267f97-0675-4567-970e-9b51514392cc] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:20.535264 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1ff7bda1-2d5d-42d2-a86e-1c7dc1b1a365 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:20.535842 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1ff7bda1-2d5d-42d2-a86e-1c7dc1b1a365 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:20.537880 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1ff7bda1-2d5d-42d2-a86e-1c7dc1b1a365 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:20.539037 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1ff7bda1-2d5d-42d2-a86e-1c7dc1b1a365 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:20.565812 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-12dbbd10-29c4-42c3-88ab-3a88751993d7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:20.575875 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-12dbbd10-29c4-42c3-88ab-3a88751993d7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e" status: 200 len: 1503 microversion: 2.1 time: 0.194287 Apr 16 21:09:20.576498 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 370/700] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:20 2022] GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e => generated 1503 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:20.581116 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4449ac2b-b23e-4f7d-ae73-d527c87b1e35 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Calling method '.version_select at 0x7fbb96b6a4c0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:20.643581 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1ff7bda1-2d5d-42d2-a86e-1c7dc1b1a365 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3256e24aea41618454e831a0c2a7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c60195eda214c42831714a690e64ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:20.652272 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1ff7bda1-2d5d-42d2-a86e-1c7dc1b1a365 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] 10.222.0.20 "GET /compute/v2.1/servers/7f267f97-0675-4567-970e-9b51514392cc" status: 200 len: 1286 microversion: 2.1 time: 0.129915 Apr 16 21:09:20.652866 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 331/701] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:20 2022] GET /compute/v2.1/servers/7f267f97-0675-4567-970e-9b51514392cc => generated 1286 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:20.662590 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f57e74ea-27d9-41d5-8bd4-c82dd3bfb3d3 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:20.662590 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f57e74ea-27d9-41d5-8bd4-c82dd3bfb3d3 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 18557c2b-2ced-4cbc-998e-978ae82401e7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:20.667475 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f57e74ea-27d9-41d5-8bd4-c82dd3bfb3d3 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:20.668029 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f57e74ea-27d9-41d5-8bd4-c82dd3bfb3d3 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:20.668932 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f57e74ea-27d9-41d5-8bd4-c82dd3bfb3d3 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:20.669571 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f57e74ea-27d9-41d5-8bd4-c82dd3bfb3d3 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:20.704926 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4449ac2b-b23e-4f7d-ae73-d527c87b1e35 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-576421130" status: 204 len: 0 microversion: 2.2 time: 0.127276 Apr 16 21:09:20.705554 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 371/702] 10.222.0.20 () {60 vars in 1257 bytes} [Sat Apr 16 21:09:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-576421130 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:09:20.711380 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ef506b68-59bf-41ea-be6a-d0c714226d9f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:20.711996 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ef506b68-59bf-41ea-be6a-d0c714226d9f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: ffc4d9b2-dd4f-44dc-a189-354eff7a5573] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:20.718907 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ef506b68-59bf-41ea-be6a-d0c714226d9f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:20.719363 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ef506b68-59bf-41ea-be6a-d0c714226d9f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:20.720142 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ef506b68-59bf-41ea-be6a-d0c714226d9f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:20.720614 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ef506b68-59bf-41ea-be6a-d0c714226d9f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:20.830187 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f57e74ea-27d9-41d5-8bd4-c82dd3bfb3d3 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7da58ce23242bd947bbd7387b80b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6395bf8972949f8837289679b58d151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:20.839629 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f57e74ea-27d9-41d5-8bd4-c82dd3bfb3d3 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "GET /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7" status: 200 len: 1386 microversion: 2.1 time: 0.185718 Apr 16 21:09:20.849298 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 332/703] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:20 2022] GET /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7 => generated 1386 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:20.849298 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-11a1183c-d534-4b25-bf4a-b933ad3e2cc3 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Action: 'create', calling method: .version_select at 0x7fbb96c42820>, body: {"keypair": {"name": "tempest-keypair-1967412267", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:20.858907 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-11a1183c-d534-4b25-bf4a-b933ad3e2cc3 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Getting quotas for project 4cfabc21d04d4b4e9a5c354d9c0af120. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:20.861287 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ef506b68-59bf-41ea-be6a-d0c714226d9f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:20.864742 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-11a1183c-d534-4b25-bf4a-b933ad3e2cc3 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Getting quotas for user 5108baa5337443fc92507428447bd8e0 and project 4cfabc21d04d4b4e9a5c354d9c0af120. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:20.888947 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ef506b68-59bf-41ea-be6a-d0c714226d9f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:20.890723 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ef506b68-59bf-41ea-be6a-d0c714226d9f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:20.892674 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ef506b68-59bf-41ea-be6a-d0c714226d9f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573" status: 200 len: 1568 microversion: 2.25 time: 0.186084 Apr 16 21:09:20.893206 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 372/704] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:09:20 2022] GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573 => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:09:20.979592 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-11a1183c-d534-4b25-bf4a-b933ad3e2cc3 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.137947 Apr 16 21:09:20.980211 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 333/705] 10.222.0.20 () {62 vars in 1198 bytes} [Sat Apr 16 21:09:20 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 139 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Apr 16 21:09:20.990559 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ab027be5-27bc-4eed-b4b3-e1bf09a02bc8 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Calling method '.version_select at 0x7fbb96b37c10>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:21.018465 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6366f452-7549-4d5a-b8a6-b8abae36d2fd tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:21.019171 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6366f452-7549-4d5a-b8a6-b8abae36d2fd tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] [instance: 3ebfe0ed-3568-4b90-b834-fd3ad244dcac] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:21.026963 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6366f452-7549-4d5a-b8a6-b8abae36d2fd tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:21.027512 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6366f452-7549-4d5a-b8a6-b8abae36d2fd tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:21.028598 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6366f452-7549-4d5a-b8a6-b8abae36d2fd tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:21.029329 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6366f452-7549-4d5a-b8a6-b8abae36d2fd tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:21.110928 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ab027be5-27bc-4eed-b4b3-e1bf09a02bc8 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1967412267" status: 204 len: 0 microversion: 2.2 time: 0.124592 Apr 16 21:09:21.111972 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 373/706] 10.222.0.20 () {60 vars in 1260 bytes} [Sat Apr 16 21:09:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1967412267 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:09:21.121372 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-25e05789-e98f-4f98-9813-03f019f11113 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Action: 'create', calling method: .version_select at 0x7fbb96b2b9d0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-2065441432"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:21.137803 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-25e05789-e98f-4f98-9813-03f019f11113 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Getting quotas for project 4cfabc21d04d4b4e9a5c354d9c0af120. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:21.150741 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-25e05789-e98f-4f98-9813-03f019f11113 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Getting quotas for user 5108baa5337443fc92507428447bd8e0 and project 4cfabc21d04d4b4e9a5c354d9c0af120. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:21.335796 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6366f452-7549-4d5a-b8a6-b8abae36d2fd tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae06aafd64d46deacb8ae1791676d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1924a4ceffaf45d0bf2bd76ebb421bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:21.343627 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6366f452-7549-4d5a-b8a6-b8abae36d2fd tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebfe0ed-3568-4b90-b834-fd3ad244dcac" status: 200 len: 1318 microversion: 2.1 time: 0.330036 Apr 16 21:09:21.344234 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 334/707] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:21 2022] GET /compute/v2.1/servers/3ebfe0ed-3568-4b90-b834-fd3ad244dcac => generated 1318 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:09:21.349621 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c94f7231-07ea-4c49-86cf-77260840df94 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:21.350396 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c94f7231-07ea-4c49-86cf-77260840df94 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: de422b8c-d5d0-4730-92c4-f30877d0cf2b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:21.356886 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c94f7231-07ea-4c49-86cf-77260840df94 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:21.357886 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c94f7231-07ea-4c49-86cf-77260840df94 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:21.358246 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c94f7231-07ea-4c49-86cf-77260840df94 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:21.358694 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c94f7231-07ea-4c49-86cf-77260840df94 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:21.443299 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-25e05789-e98f-4f98-9813-03f019f11113 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Getting quotas for project 4cfabc21d04d4b4e9a5c354d9c0af120. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:21.466913 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-25e05789-e98f-4f98-9813-03f019f11113 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Getting quotas for user 5108baa5337443fc92507428447bd8e0 and project 4cfabc21d04d4b4e9a5c354d9c0af120. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:21.487103 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-25e05789-e98f-4f98-9813-03f019f11113 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 2340 microversion: 2.2 time: 0.368909 Apr 16 21:09:21.493958 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 374/708] 10.222.0.20 () {62 vars in 1197 bytes} [Sat Apr 16 21:09:21 2022] POST /compute/v2.1/os-keypairs => generated 2340 bytes in 372 msecs (HTTP/1.1 201) 9 headers in 363 bytes (2 switches on core 0) Apr 16 21:09:21.499692 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c94f7231-07ea-4c49-86cf-77260840df94 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:21.499889 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ebe729a2-2898-4126-a8b8-b563beafef01 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Action: 'create', calling method: .version_select at 0x7fbb96af6820>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-173269533"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:21.511408 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c94f7231-07ea-4c49-86cf-77260840df94 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/de422b8c-d5d0-4730-92c4-f30877d0cf2b" status: 200 len: 1272 microversion: 2.1 time: 0.165354 Apr 16 21:09:21.521563 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-ebe729a2-2898-4126-a8b8-b563beafef01 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Getting quotas for project 4cfabc21d04d4b4e9a5c354d9c0af120. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:21.522434 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 335/709] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:21 2022] GET /compute/v2.1/servers/de422b8c-d5d0-4730-92c4-f30877d0cf2b => generated 1272 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:21.528147 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-cfb90818-a666-4a4d-ad02-b0870663a7b2 req-ec015bd0-7ca1-4666-9104-9a13cb78f6e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ebfe0ed-3568-4b90-b834-fd3ad244dcac", "tag": "866329ca-a3b9-4787-9b58-31964260c59e"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:21.528809 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-ebe729a2-2898-4126-a8b8-b563beafef01 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Getting quotas for user 5108baa5337443fc92507428447bd8e0 and project 4cfabc21d04d4b4e9a5c354d9c0af120. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:21.548945 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-cfb90818-a666-4a4d-ad02-b0870663a7b2 req-ec015bd0-7ca1-4666-9104-9a13cb78f6e1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:21.549395 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-cfb90818-a666-4a4d-ad02-b0870663a7b2 req-ec015bd0-7ca1-4666-9104-9a13cb78f6e1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:21.588791 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-cfb90818-a666-4a4d-ad02-b0870663a7b2 req-ec015bd0-7ca1-4666-9104-9a13cb78f6e1 service nova] Creating event network-changed:866329ca-a3b9-4787-9b58-31964260c59e for instance 3ebfe0ed-3568-4b90-b834-fd3ad244dcac on nch1-master-1 Apr 16 21:09:21.601875 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-cfb90818-a666-4a4d-ad02-b0870663a7b2 req-ec015bd0-7ca1-4666-9104-9a13cb78f6e1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077826 Apr 16 21:09:21.603370 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 336/710] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:09:21.608559 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a014facd-cfa5-4691-bd83-1d2339409559 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:21.609554 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a014facd-cfa5-4691-bd83-1d2339409559 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 7b856a59-2a62-4edc-b448-430f778c7b2e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:21.617214 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a014facd-cfa5-4691-bd83-1d2339409559 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:21.617859 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a014facd-cfa5-4691-bd83-1d2339409559 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:21.618932 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a014facd-cfa5-4691-bd83-1d2339409559 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:21.619743 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a014facd-cfa5-4691-bd83-1d2339409559 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:21.863440 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-ebe729a2-2898-4126-a8b8-b563beafef01 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Getting quotas for project 4cfabc21d04d4b4e9a5c354d9c0af120. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:21.869075 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-ebe729a2-2898-4126-a8b8-b563beafef01 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Getting quotas for user 5108baa5337443fc92507428447bd8e0 and project 4cfabc21d04d4b4e9a5c354d9c0af120. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:21.885111 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ebe729a2-2898-4126-a8b8-b563beafef01 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 2335 microversion: 2.2 time: 0.389762 Apr 16 21:09:21.886258 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 375/711] 10.222.0.20 () {62 vars in 1197 bytes} [Sat Apr 16 21:09:21 2022] POST /compute/v2.1/os-keypairs => generated 2335 bytes in 391 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:09:21.891044 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a7e091ae-03fa-4a01-848a-e626e28879e8 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:21.891738 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a7e091ae-03fa-4a01-848a-e626e28879e8 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: e641f7ec-0d41-4439-bc77-7158fb9d346e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:21.898612 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a7e091ae-03fa-4a01-848a-e626e28879e8 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:21.899072 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a7e091ae-03fa-4a01-848a-e626e28879e8 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:21.899869 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a7e091ae-03fa-4a01-848a-e626e28879e8 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:21.900340 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a7e091ae-03fa-4a01-848a-e626e28879e8 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:22.045603 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a7e091ae-03fa-4a01-848a-e626e28879e8 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:22.055755 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a7e091ae-03fa-4a01-848a-e626e28879e8 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e" status: 200 len: 1503 microversion: 2.1 time: 0.168411 Apr 16 21:09:22.060993 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 376/712] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:21 2022] GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e => generated 1503 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:22.067235 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ab0a5238-a12a-4785-b7f0-231f8372a9c6 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:22.068522 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ab0a5238-a12a-4785-b7f0-231f8372a9c6 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] [instance: 7f267f97-0675-4567-970e-9b51514392cc] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:22.074496 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ab0a5238-a12a-4785-b7f0-231f8372a9c6 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:22.074953 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ab0a5238-a12a-4785-b7f0-231f8372a9c6 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:22.075787 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ab0a5238-a12a-4785-b7f0-231f8372a9c6 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:22.076343 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ab0a5238-a12a-4785-b7f0-231f8372a9c6 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:22.139739 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ab0a5238-a12a-4785-b7f0-231f8372a9c6 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3256e24aea41618454e831a0c2a7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c60195eda214c42831714a690e64ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:22.147959 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ab0a5238-a12a-4785-b7f0-231f8372a9c6 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] 10.222.0.20 "GET /compute/v2.1/servers/7f267f97-0675-4567-970e-9b51514392cc" status: 200 len: 1274 microversion: 2.1 time: 0.085686 Apr 16 21:09:22.148682 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 377/713] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:22 2022] GET /compute/v2.1/servers/7f267f97-0675-4567-970e-9b51514392cc => generated 1274 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:22.162764 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-282df610-7f68-4c51-bd9e-2fc2513b8140 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:22.163372 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-282df610-7f68-4c51-bd9e-2fc2513b8140 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 18557c2b-2ced-4cbc-998e-978ae82401e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:22.169160 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-282df610-7f68-4c51-bd9e-2fc2513b8140 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:22.169609 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-282df610-7f68-4c51-bd9e-2fc2513b8140 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:22.170379 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-282df610-7f68-4c51-bd9e-2fc2513b8140 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:22.170817 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-282df610-7f68-4c51-bd9e-2fc2513b8140 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:22.301897 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-282df610-7f68-4c51-bd9e-2fc2513b8140 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7da58ce23242bd947bbd7387b80b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6395bf8972949f8837289679b58d151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:22.306056 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a014facd-cfa5-4691-bd83-1d2339409559 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:22.310957 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-282df610-7f68-4c51-bd9e-2fc2513b8140 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "GET /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7" status: 200 len: 1386 microversion: 2.1 time: 0.152126 Apr 16 21:09:22.312544 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 378/714] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:22 2022] GET /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7 => generated 1386 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:22.318125 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a014facd-cfa5-4691-bd83-1d2339409559 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/7b856a59-2a62-4edc-b448-430f778c7b2e" status: 200 len: 1316 microversion: 2.1 time: 0.712988 Apr 16 21:09:22.321846 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 337/715] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:21 2022] GET /compute/v2.1/servers/7b856a59-2a62-4edc-b448-430f778c7b2e => generated 1316 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:22.322440 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ed9752fc-5c0d-413c-9071-a220efb48b2f tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Action: 'create', calling method: .version_select at 0x7fbb96ba7790>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1043654027"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:22.326463 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e4d3ce75-3dae-4606-b0b6-c4c89953ba15 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:22.327070 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e4d3ce75-3dae-4606-b0b6-c4c89953ba15 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: ffc4d9b2-dd4f-44dc-a189-354eff7a5573] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:22.334227 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e4d3ce75-3dae-4606-b0b6-c4c89953ba15 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:22.334834 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e4d3ce75-3dae-4606-b0b6-c4c89953ba15 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:22.335441 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e4d3ce75-3dae-4606-b0b6-c4c89953ba15 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:22.336064 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e4d3ce75-3dae-4606-b0b6-c4c89953ba15 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:22.340086 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-ed9752fc-5c0d-413c-9071-a220efb48b2f tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Getting quotas for project 4cfabc21d04d4b4e9a5c354d9c0af120. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:22.345449 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-ed9752fc-5c0d-413c-9071-a220efb48b2f tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Getting quotas for user 5108baa5337443fc92507428447bd8e0 and project 4cfabc21d04d4b4e9a5c354d9c0af120. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:22.822942 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-ed9752fc-5c0d-413c-9071-a220efb48b2f tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Getting quotas for project 4cfabc21d04d4b4e9a5c354d9c0af120. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:22.830449 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-ed9752fc-5c0d-413c-9071-a220efb48b2f tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Getting quotas for user 5108baa5337443fc92507428447bd8e0 and project 4cfabc21d04d4b4e9a5c354d9c0af120. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:22.867580 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ed9752fc-5c0d-413c-9071-a220efb48b2f tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 2340 microversion: 2.2 time: 0.554041 Apr 16 21:09:22.868525 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 379/716] 10.222.0.20 () {62 vars in 1197 bytes} [Sat Apr 16 21:09:22 2022] POST /compute/v2.1/os-keypairs => generated 2340 bytes in 555 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:09:22.873781 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e4d3ce75-3dae-4606-b0b6-c4c89953ba15 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:22.875366 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f8e0f769-586f-4bea-9340-149ae63747ae tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:22.875990 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f8e0f769-586f-4bea-9340-149ae63747ae tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] [instance: 3ebfe0ed-3568-4b90-b834-fd3ad244dcac] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:22.882749 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e4d3ce75-3dae-4606-b0b6-c4c89953ba15 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:22.885330 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f8e0f769-586f-4bea-9340-149ae63747ae tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:22.885488 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f8e0f769-586f-4bea-9340-149ae63747ae tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:22.886406 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f8e0f769-586f-4bea-9340-149ae63747ae tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:22.887580 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f8e0f769-586f-4bea-9340-149ae63747ae tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:22.896426 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e4d3ce75-3dae-4606-b0b6-c4c89953ba15 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:22.897852 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e4d3ce75-3dae-4606-b0b6-c4c89953ba15 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573" status: 200 len: 1568 microversion: 2.25 time: 0.574923 Apr 16 21:09:22.898446 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 338/717] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:09:22 2022] GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573 => generated 1568 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:09:22.914076 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b5c8f42c-45ea-471c-b783-044efceeed4a tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:22.914953 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b5c8f42c-45ea-471c-b783-044efceeed4a tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: de422b8c-d5d0-4730-92c4-f30877d0cf2b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:22.921427 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b5c8f42c-45ea-471c-b783-044efceeed4a tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:22.922132 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b5c8f42c-45ea-471c-b783-044efceeed4a tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:22.923087 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b5c8f42c-45ea-471c-b783-044efceeed4a tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:22.923687 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b5c8f42c-45ea-471c-b783-044efceeed4a tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:23.100266 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b5c8f42c-45ea-471c-b783-044efceeed4a tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:23.114986 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b5c8f42c-45ea-471c-b783-044efceeed4a tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/de422b8c-d5d0-4730-92c4-f30877d0cf2b" status: 200 len: 1270 microversion: 2.1 time: 0.205504 Apr 16 21:09:23.124886 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 339/718] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:22 2022] GET /compute/v2.1/servers/de422b8c-d5d0-4730-92c4-f30877d0cf2b => generated 1270 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:23.131375 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-250f9742-3ef8-4967-be57-f9061b1eb953 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Calling method '.version_select at 0x7fbb96ca79d0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:23.134475 ncdv-master-1 devstack@n-api.service[137409]: WARNING oslo_db.sqlalchemy.utils [None req-250f9742-3ef8-4967-be57-f9061b1eb953 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Unique keys not in sort_keys. The sorting order may be unstable. Apr 16 21:09:23.146929 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-250f9742-3ef8-4967-be57-f9061b1eb953 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 1723 microversion: 2.2 time: 0.029779 Apr 16 21:09:23.157225 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 340/719] 10.222.0.20 () {60 vars in 1176 bytes} [Sat Apr 16 21:09:23 2022] GET /compute/v2.1/os-keypairs => generated 1723 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:23.166459 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ecfeb165-323a-4d81-bb24-7200db3ea3ee tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:23.167244 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ecfeb165-323a-4d81-bb24-7200db3ea3ee tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: e641f7ec-0d41-4439-bc77-7158fb9d346e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:23.341751 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ecfeb165-323a-4d81-bb24-7200db3ea3ee tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:23.342399 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ecfeb165-323a-4d81-bb24-7200db3ea3ee tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:23.343187 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ecfeb165-323a-4d81-bb24-7200db3ea3ee tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:23.343693 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ecfeb165-323a-4d81-bb24-7200db3ea3ee tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:23.483613 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f8e0f769-586f-4bea-9340-149ae63747ae tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae06aafd64d46deacb8ae1791676d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1924a4ceffaf45d0bf2bd76ebb421bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:23.503276 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f8e0f769-586f-4bea-9340-149ae63747ae tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebfe0ed-3568-4b90-b834-fd3ad244dcac" status: 200 len: 1318 microversion: 2.1 time: 0.632980 Apr 16 21:09:23.514372 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 380/720] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:22 2022] GET /compute/v2.1/servers/3ebfe0ed-3568-4b90-b834-fd3ad244dcac => generated 1318 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:23.521261 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5abd9784-1819-4c59-b325-88e5ad70e4e9 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Calling method '.version_select at 0x7fbb96aefca0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:23.687396 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5abd9784-1819-4c59-b325-88e5ad70e4e9 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1043654027" status: 204 len: 0 microversion: 2.2 time: 0.169659 Apr 16 21:09:23.693580 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 381/721] 10.222.0.20 () {60 vars in 1320 bytes} [Sat Apr 16 21:09:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1043654027 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:09:23.695727 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-af6b9968-97a7-4a42-8fc3-8319d52836e7 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:23.696575 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-af6b9968-97a7-4a42-8fc3-8319d52836e7 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] [instance: 7f267f97-0675-4567-970e-9b51514392cc] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:23.702973 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-af6b9968-97a7-4a42-8fc3-8319d52836e7 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:23.703557 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-af6b9968-97a7-4a42-8fc3-8319d52836e7 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:23.704825 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-af6b9968-97a7-4a42-8fc3-8319d52836e7 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:23.705144 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-af6b9968-97a7-4a42-8fc3-8319d52836e7 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:23.939761 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ecfeb165-323a-4d81-bb24-7200db3ea3ee tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:23.954759 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ecfeb165-323a-4d81-bb24-7200db3ea3ee tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e" status: 200 len: 1503 microversion: 2.1 time: 0.792271 Apr 16 21:09:23.955438 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-af6b9968-97a7-4a42-8fc3-8319d52836e7 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3256e24aea41618454e831a0c2a7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c60195eda214c42831714a690e64ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:23.956730 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 341/722] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:23 2022] GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e => generated 1503 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:23.963121 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7b66d48f-2cc5-47a9-b4cf-5f8ba4591d4e tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:23.964502 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7b66d48f-2cc5-47a9-b4cf-5f8ba4591d4e tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 18557c2b-2ced-4cbc-998e-978ae82401e7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:23.974327 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7b66d48f-2cc5-47a9-b4cf-5f8ba4591d4e tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:23.974940 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7b66d48f-2cc5-47a9-b4cf-5f8ba4591d4e tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:23.977117 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-af6b9968-97a7-4a42-8fc3-8319d52836e7 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] 10.222.0.20 "GET /compute/v2.1/servers/7f267f97-0675-4567-970e-9b51514392cc" status: 200 len: 1316 microversion: 2.1 time: 0.286855 Apr 16 21:09:23.977902 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 382/723] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:23 2022] GET /compute/v2.1/servers/7f267f97-0675-4567-970e-9b51514392cc => generated 1316 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:23.988916 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7b66d48f-2cc5-47a9-b4cf-5f8ba4591d4e tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:23.989994 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7b66d48f-2cc5-47a9-b4cf-5f8ba4591d4e tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:23.998772 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-63ec306b-2ded-4b77-b79e-d2cb42888e6a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:23.999410 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-63ec306b-2ded-4b77-b79e-d2cb42888e6a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 7b856a59-2a62-4edc-b448-430f778c7b2e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:24.007120 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-63ec306b-2ded-4b77-b79e-d2cb42888e6a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:24.007653 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-63ec306b-2ded-4b77-b79e-d2cb42888e6a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:24.009005 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-63ec306b-2ded-4b77-b79e-d2cb42888e6a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:24.010656 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-63ec306b-2ded-4b77-b79e-d2cb42888e6a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:24.188782 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-63ec306b-2ded-4b77-b79e-d2cb42888e6a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:24.197949 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-63ec306b-2ded-4b77-b79e-d2cb42888e6a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/7b856a59-2a62-4edc-b448-430f778c7b2e" status: 200 len: 1316 microversion: 2.1 time: 0.216669 Apr 16 21:09:24.198533 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 383/724] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:23 2022] GET /compute/v2.1/servers/7b856a59-2a62-4edc-b448-430f778c7b2e => generated 1316 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:24.204849 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-c6e377d7-cb64-434a-9d5b-a405d9ffed17 req-52f8d673-5ac5-4ed4-96f0-f0e00de0e9c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b856a59-2a62-4edc-b448-430f778c7b2e", "name": "network-vif-plugged", "status": "completed", "tag": "74297eec-fea7-4f18-9edd-1a7bb09d6fd5"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:24.211238 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-c6e377d7-cb64-434a-9d5b-a405d9ffed17 req-52f8d673-5ac5-4ed4-96f0-f0e00de0e9c2 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:24.211863 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-c6e377d7-cb64-434a-9d5b-a405d9ffed17 req-52f8d673-5ac5-4ed4-96f0-f0e00de0e9c2 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:24.222991 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-c6e377d7-cb64-434a-9d5b-a405d9ffed17 req-52f8d673-5ac5-4ed4-96f0-f0e00de0e9c2 service nova] Creating event network-vif-plugged:74297eec-fea7-4f18-9edd-1a7bb09d6fd5 for instance 7b856a59-2a62-4edc-b448-430f778c7b2e on nch2-master-1 Apr 16 21:09:24.234509 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-c6e377d7-cb64-434a-9d5b-a405d9ffed17 req-52f8d673-5ac5-4ed4-96f0-f0e00de0e9c2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034667 Apr 16 21:09:24.235119 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 384/725] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:09:24.241313 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3f7ec1b4-f648-47c1-8779-bf054ba1f30f tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Calling method '.version_select at 0x7fbb96af68b0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:24.339734 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3f7ec1b4-f648-47c1-8779-bf054ba1f30f tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-173269533" status: 204 len: 0 microversion: 2.2 time: 0.103212 Apr 16 21:09:24.340786 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 385/726] 10.222.0.20 () {60 vars in 1317 bytes} [Sat Apr 16 21:09:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-173269533 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:09:24.346029 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f28413bf-d79d-4acb-9c3b-6d5c0fdf85d8 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:24.346784 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f28413bf-d79d-4acb-9c3b-6d5c0fdf85d8 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: ffc4d9b2-dd4f-44dc-a189-354eff7a5573] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:24.354121 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f28413bf-d79d-4acb-9c3b-6d5c0fdf85d8 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:24.355247 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f28413bf-d79d-4acb-9c3b-6d5c0fdf85d8 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:24.355536 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f28413bf-d79d-4acb-9c3b-6d5c0fdf85d8 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:24.355986 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f28413bf-d79d-4acb-9c3b-6d5c0fdf85d8 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:24.530930 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7b66d48f-2cc5-47a9-b4cf-5f8ba4591d4e tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7da58ce23242bd947bbd7387b80b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6395bf8972949f8837289679b58d151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:24.543116 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7b66d48f-2cc5-47a9-b4cf-5f8ba4591d4e tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "GET /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7" status: 200 len: 1386 microversion: 2.1 time: 0.585158 Apr 16 21:09:24.553340 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 342/727] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:23 2022] GET /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7 => generated 1386 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:24.557187 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-561b0b31-3eeb-4f12-bb62-4c668e4c77fa tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:24.557927 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-561b0b31-3eeb-4f12-bb62-4c668e4c77fa tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: de422b8c-d5d0-4730-92c4-f30877d0cf2b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:24.561477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f28413bf-d79d-4acb-9c3b-6d5c0fdf85d8 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:24.564374 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-561b0b31-3eeb-4f12-bb62-4c668e4c77fa tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:24.564868 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-561b0b31-3eeb-4f12-bb62-4c668e4c77fa tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:24.565662 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-561b0b31-3eeb-4f12-bb62-4c668e4c77fa tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:24.566166 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-561b0b31-3eeb-4f12-bb62-4c668e4c77fa tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:24.569888 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f28413bf-d79d-4acb-9c3b-6d5c0fdf85d8 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:24.571512 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f28413bf-d79d-4acb-9c3b-6d5c0fdf85d8 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:24.572816 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f28413bf-d79d-4acb-9c3b-6d5c0fdf85d8 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573" status: 200 len: 1568 microversion: 2.25 time: 0.230930 Apr 16 21:09:24.573687 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 386/728] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:09:24 2022] GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573 => generated 1568 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:09:24.589869 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a604310a-13ce-44cc-8234-fc496b31129c tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Calling method '.version_select at 0x7fbb96b08310>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:24.681134 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a604310a-13ce-44cc-8234-fc496b31129c tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2065441432" status: 204 len: 0 microversion: 2.2 time: 0.098217 Apr 16 21:09:24.682582 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 387/729] 10.222.0.20 () {60 vars in 1320 bytes} [Sat Apr 16 21:09:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2065441432 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:09:24.689528 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-40ff632d-9286-41ea-8fea-3cbbea972afa tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:24.690485 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-40ff632d-9286-41ea-8fea-3cbbea972afa tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] [instance: 3ebfe0ed-3568-4b90-b834-fd3ad244dcac] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:24.700790 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40ff632d-9286-41ea-8fea-3cbbea972afa tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:24.701257 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40ff632d-9286-41ea-8fea-3cbbea972afa tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:24.702309 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40ff632d-9286-41ea-8fea-3cbbea972afa tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:24.702724 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40ff632d-9286-41ea-8fea-3cbbea972afa tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:24.995997 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-561b0b31-3eeb-4f12-bb62-4c668e4c77fa tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:25.006909 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-561b0b31-3eeb-4f12-bb62-4c668e4c77fa tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/de422b8c-d5d0-4730-92c4-f30877d0cf2b" status: 200 len: 1312 microversion: 2.1 time: 0.455968 Apr 16 21:09:25.017390 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 343/730] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:24 2022] GET /compute/v2.1/servers/de422b8c-d5d0-4730-92c4-f30877d0cf2b => generated 1312 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:25.023182 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9c9fb016-ba4d-4698-8b2a-3df0eaf955ff tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Action: 'create', calling method: .version_select at 0x7fbb96cbd5e0>, body: {"keypair": {"name": "tempest-keypair-349983751"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:25.038611 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-40ff632d-9286-41ea-8fea-3cbbea972afa tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae06aafd64d46deacb8ae1791676d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1924a4ceffaf45d0bf2bd76ebb421bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:25.039299 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-9c9fb016-ba4d-4698-8b2a-3df0eaf955ff tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Getting quotas for project 4cfabc21d04d4b4e9a5c354d9c0af120. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:25.045057 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-9c9fb016-ba4d-4698-8b2a-3df0eaf955ff tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Getting quotas for user 5108baa5337443fc92507428447bd8e0 and project 4cfabc21d04d4b4e9a5c354d9c0af120. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:25.054290 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-40ff632d-9286-41ea-8fea-3cbbea972afa tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebfe0ed-3568-4b90-b834-fd3ad244dcac" status: 200 len: 1318 microversion: 2.1 time: 0.369917 Apr 16 21:09:25.063778 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 388/731] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:24 2022] GET /compute/v2.1/servers/3ebfe0ed-3568-4b90-b834-fd3ad244dcac => generated 1318 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:25.063778 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-55fe899a-d9e5-44b4-b0c1-b4f4a4c664ec tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:25.063778 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-55fe899a-d9e5-44b4-b0c1-b4f4a4c664ec tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: e641f7ec-0d41-4439-bc77-7158fb9d346e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:25.066416 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-55fe899a-d9e5-44b4-b0c1-b4f4a4c664ec tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:25.066862 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-55fe899a-d9e5-44b4-b0c1-b4f4a4c664ec tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:25.067864 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-55fe899a-d9e5-44b4-b0c1-b4f4a4c664ec tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:25.068521 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-55fe899a-d9e5-44b4-b0c1-b4f4a4c664ec tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:25.209237 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-55fe899a-d9e5-44b4-b0c1-b4f4a4c664ec tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:25.216923 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-55fe899a-d9e5-44b4-b0c1-b4f4a4c664ec tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e" status: 200 len: 1493 microversion: 2.1 time: 0.161019 Apr 16 21:09:25.217513 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 389/732] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:25 2022] GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e => generated 1493 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:25.233146 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-810d85d5-cacf-49d4-ac1a-629c59b4226e tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:25.233146 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-810d85d5-cacf-49d4-ac1a-629c59b4226e tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] [instance: 7f267f97-0675-4567-970e-9b51514392cc] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:25.238872 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-810d85d5-cacf-49d4-ac1a-629c59b4226e tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:25.240078 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-810d85d5-cacf-49d4-ac1a-629c59b4226e tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:25.241014 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-810d85d5-cacf-49d4-ac1a-629c59b4226e tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:25.241555 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-810d85d5-cacf-49d4-ac1a-629c59b4226e tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:25.387295 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-9c9fb016-ba4d-4698-8b2a-3df0eaf955ff tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Getting quotas for project 4cfabc21d04d4b4e9a5c354d9c0af120. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:25.397908 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-9c9fb016-ba4d-4698-8b2a-3df0eaf955ff tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Getting quotas for user 5108baa5337443fc92507428447bd8e0 and project 4cfabc21d04d4b4e9a5c354d9c0af120. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:25.409921 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-810d85d5-cacf-49d4-ac1a-629c59b4226e tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3256e24aea41618454e831a0c2a7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c60195eda214c42831714a690e64ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:25.422458 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-810d85d5-cacf-49d4-ac1a-629c59b4226e tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] 10.222.0.20 "GET /compute/v2.1/servers/7f267f97-0675-4567-970e-9b51514392cc" status: 200 len: 1316 microversion: 2.1 time: 0.200399 Apr 16 21:09:25.431995 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 390/733] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:25 2022] GET /compute/v2.1/servers/7f267f97-0675-4567-970e-9b51514392cc => generated 1316 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:25.433708 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7fa0b8b5-1490-4d0c-81ce-ceff812852d4 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:25.434331 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7fa0b8b5-1490-4d0c-81ce-ceff812852d4 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 7b856a59-2a62-4edc-b448-430f778c7b2e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:25.437426 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9c9fb016-ba4d-4698-8b2a-3df0eaf955ff tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.2 time: 0.418517 Apr 16 21:09:25.439172 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 344/734] 10.222.0.20 () {62 vars in 1197 bytes} [Sat Apr 16 21:09:25 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 421 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:09:25.445071 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e552bd3c-6188-4517-8ca9-656aee7c6eba tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Calling method '.version_select at 0x7fbb96f6b820>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:25.447806 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e552bd3c-6188-4517-8ca9-656aee7c6eba tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:25.448294 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e552bd3c-6188-4517-8ca9-656aee7c6eba tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:25.453692 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7fa0b8b5-1490-4d0c-81ce-ceff812852d4 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:25.454707 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7fa0b8b5-1490-4d0c-81ce-ceff812852d4 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:25.455541 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7fa0b8b5-1490-4d0c-81ce-ceff812852d4 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:25.456202 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7fa0b8b5-1490-4d0c-81ce-ceff812852d4 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:25.487923 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e552bd3c-6188-4517-8ca9-656aee7c6eba tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 1166 microversion: 2.1 time: 0.047649 Apr 16 21:09:25.488886 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 345/735] 10.222.0.20 () {58 vars in 1142 bytes} [Sat Apr 16 21:09:25 2022] GET /compute/v2.1/os-migrations => generated 1166 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:25.494092 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a1aedf41-8875-4627-98b2-264b42460f83 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Calling method '.version_select at 0x7fbb96c56160>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:25.502091 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a1aedf41-8875-4627-98b2-264b42460f83 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-349983751" status: 200 len: 705 microversion: 2.2 time: 0.011865 Apr 16 21:09:25.502775 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 346/736] 10.222.0.20 () {60 vars in 1254 bytes} [Sat Apr 16 21:09:25 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-349983751 => generated 705 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:09:25.508074 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1acd4706-a659-4799-8209-4ce9260953cb tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:25.508753 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1acd4706-a659-4799-8209-4ce9260953cb tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] [instance: e641f7ec-0d41-4439-bc77-7158fb9d346e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:25.516376 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1acd4706-a659-4799-8209-4ce9260953cb tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:25.519254 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1acd4706-a659-4799-8209-4ce9260953cb tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:25.519254 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1acd4706-a659-4799-8209-4ce9260953cb tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:25.519254 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1acd4706-a659-4799-8209-4ce9260953cb tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:25.628892 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7fa0b8b5-1490-4d0c-81ce-ceff812852d4 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:25.637633 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7fa0b8b5-1490-4d0c-81ce-ceff812852d4 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/7b856a59-2a62-4edc-b448-430f778c7b2e" status: 200 len: 1316 microversion: 2.1 time: 0.208127 Apr 16 21:09:25.647033 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 391/737] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:25 2022] GET /compute/v2.1/servers/7b856a59-2a62-4edc-b448-430f778c7b2e => generated 1316 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:25.647033 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8838dc83-0b99-41f9-9089-216da68064ca tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Calling method '.version_select at 0x7fbb96b01670>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:25.650145 ncdv-master-1 devstack@n-api.service[137408]: WARNING oslo_db.sqlalchemy.utils [None req-8838dc83-0b99-41f9-9089-216da68064ca tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Unique keys not in sort_keys. The sorting order may be unstable. Apr 16 21:09:25.658428 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8838dc83-0b99-41f9-9089-216da68064ca tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 563 microversion: 2.2 time: 0.018629 Apr 16 21:09:25.659005 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 392/738] 10.222.0.20 () {60 vars in 1176 bytes} [Sat Apr 16 21:09:25 2022] GET /compute/v2.1/os-keypairs => generated 563 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:09:25.664977 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-52dcd188-3cc1-48fd-a8eb-cb35d29ff6e3 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:25.665586 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-52dcd188-3cc1-48fd-a8eb-cb35d29ff6e3 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 18557c2b-2ced-4cbc-998e-978ae82401e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:25.672450 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-52dcd188-3cc1-48fd-a8eb-cb35d29ff6e3 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:25.672618 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-52dcd188-3cc1-48fd-a8eb-cb35d29ff6e3 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:25.673324 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-52dcd188-3cc1-48fd-a8eb-cb35d29ff6e3 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:25.673929 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-52dcd188-3cc1-48fd-a8eb-cb35d29ff6e3 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:25.812011 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-52dcd188-3cc1-48fd-a8eb-cb35d29ff6e3 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7da58ce23242bd947bbd7387b80b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6395bf8972949f8837289679b58d151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:25.820366 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-52dcd188-3cc1-48fd-a8eb-cb35d29ff6e3 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "GET /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7" status: 200 len: 1386 microversion: 2.1 time: 0.159999 Apr 16 21:09:25.820944 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 393/739] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:25 2022] GET /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7 => generated 1386 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:25.825543 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cbd11ed7-af10-4f06-9254-fe40f61ca27e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:25.826161 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cbd11ed7-af10-4f06-9254-fe40f61ca27e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: ffc4d9b2-dd4f-44dc-a189-354eff7a5573] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:25.832119 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cbd11ed7-af10-4f06-9254-fe40f61ca27e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:25.832748 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cbd11ed7-af10-4f06-9254-fe40f61ca27e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:25.834141 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cbd11ed7-af10-4f06-9254-fe40f61ca27e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:25.834610 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cbd11ed7-af10-4f06-9254-fe40f61ca27e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:25.909649 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1acd4706-a659-4799-8209-4ce9260953cb tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e" status: 200 len: 1644 microversion: 2.1 time: 0.405815 Apr 16 21:09:25.925545 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 347/740] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:25 2022] GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e => generated 1644 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:25.935001 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9009891a-047a-4bc4-ab18-069f6e8d96c6 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Calling method '.version_select at 0x7fbb96cbd3a0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:25.983513 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cbd11ed7-af10-4f06-9254-fe40f61ca27e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:25.991990 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cbd11ed7-af10-4f06-9254-fe40f61ca27e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:25.994157 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cbd11ed7-af10-4f06-9254-fe40f61ca27e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:25.994936 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cbd11ed7-af10-4f06-9254-fe40f61ca27e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573" status: 200 len: 1568 microversion: 2.25 time: 0.172999 Apr 16 21:09:25.995690 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 394/741] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:09:25 2022] GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:09:26.022555 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9009891a-047a-4bc4-ab18-069f6e8d96c6 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-349983751" status: 204 len: 0 microversion: 2.2 time: 0.098842 Apr 16 21:09:26.026351 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 348/742] 10.222.0.20 () {60 vars in 1257 bytes} [Sat Apr 16 21:09:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-349983751 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:09:26.026483 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ac47b79e-70d2-45d4-96c5-1268123276fa tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:26.030803 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ac47b79e-70d2-45d4-96c5-1268123276fa tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: de422b8c-d5d0-4730-92c4-f30877d0cf2b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:26.031752 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2c557cb7-2842-4d82-a068-a52d459ea2ce tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-362570722", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "8cfbbf93-9e15-4e76-bfe0-e69ff753f337"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:26.038021 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ac47b79e-70d2-45d4-96c5-1268123276fa tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:26.038485 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ac47b79e-70d2-45d4-96c5-1268123276fa tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:26.039502 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ac47b79e-70d2-45d4-96c5-1268123276fa tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:26.040044 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ac47b79e-70d2-45d4-96c5-1268123276fa tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:26.100788 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-2c557cb7-2842-4d82-a068-a52d459ea2ce tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] validate_networks() for [('8cfbbf93-9e15-4e76-bfe0-e69ff753f337', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:09:26.195812 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ac47b79e-70d2-45d4-96c5-1268123276fa tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:26.207752 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ac47b79e-70d2-45d4-96c5-1268123276fa tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/de422b8c-d5d0-4730-92c4-f30877d0cf2b" status: 200 len: 1312 microversion: 2.1 time: 0.187585 Apr 16 21:09:26.225563 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 395/743] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:26 2022] GET /compute/v2.1/servers/de422b8c-d5d0-4730-92c4-f30877d0cf2b => generated 1312 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:26.232059 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c32de746-9339-45f6-8753-65b58b9da999 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Action: 'create', calling method: .version_select at 0x7fbb96b17670>, body: {"keypair": {"name": "tempest-keypair-269222203", "type": "x509"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:26.249767 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-c32de746-9339-45f6-8753-65b58b9da999 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Getting quotas for project 4cfabc21d04d4b4e9a5c354d9c0af120. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:26.255976 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-c32de746-9339-45f6-8753-65b58b9da999 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Getting quotas for user 5108baa5337443fc92507428447bd8e0 and project 4cfabc21d04d4b4e9a5c354d9c0af120. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:26.274504 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.processutils [None req-c32de746-9339-45f6-8753-65b58b9da999 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmp0cax1ytk/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp0cax1ytk/temp.key -subj /CN=5108baa5337443fc92507428447bd8e0 -extensions v3_req_client {{(pid=137408) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 16 21:09:26.381802 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.processutils [None req-c32de746-9339-45f6-8753-65b58b9da999 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmp0cax1ytk/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmp0cax1ytk/temp.key -subj /CN=5108baa5337443fc92507428447bd8e0 -extensions v3_req_client" returned: 0 in 0.107s {{(pid=137408) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 16 21:09:26.383334 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.processutils [None req-c32de746-9339-45f6-8753-65b58b9da999 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmp0cax1ytk/temp.key -password pass: {{(pid=137408) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Apr 16 21:09:26.407952 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.processutils [None req-c32de746-9339-45f6-8753-65b58b9da999 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] CMD "openssl pkcs12 -export -inkey /tmp/tmp0cax1ytk/temp.key -password pass:" returned: 0 in 0.024s {{(pid=137408) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Apr 16 21:09:26.573573 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-c32de746-9339-45f6-8753-65b58b9da999 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Getting quotas for project 4cfabc21d04d4b4e9a5c354d9c0af120. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:26.580916 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-c32de746-9339-45f6-8753-65b58b9da999 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Getting quotas for user 5108baa5337443fc92507428447bd8e0 and project 4cfabc21d04d4b4e9a5c354d9c0af120. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:26.604308 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c32de746-9339-45f6-8753-65b58b9da999 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.376792 Apr 16 21:09:26.608081 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 396/744] 10.222.0.20 () {62 vars in 1197 bytes} [Sat Apr 16 21:09:26 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 379 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:09:26.611867 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f9653cbb-70f2-496f-9a1b-1458745d099d tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:26.612591 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f9653cbb-70f2-496f-9a1b-1458745d099d tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] [instance: 3ebfe0ed-3568-4b90-b834-fd3ad244dcac] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:26.620746 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9653cbb-70f2-496f-9a1b-1458745d099d tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:26.621237 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9653cbb-70f2-496f-9a1b-1458745d099d tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:26.622099 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9653cbb-70f2-496f-9a1b-1458745d099d tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:26.622562 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9653cbb-70f2-496f-9a1b-1458745d099d tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:26.795346 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f9653cbb-70f2-496f-9a1b-1458745d099d tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae06aafd64d46deacb8ae1791676d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1924a4ceffaf45d0bf2bd76ebb421bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:26.803132 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f9653cbb-70f2-496f-9a1b-1458745d099d tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebfe0ed-3568-4b90-b834-fd3ad244dcac" status: 200 len: 1318 microversion: 2.1 time: 0.196327 Apr 16 21:09:26.803696 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 397/745] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:26 2022] GET /compute/v2.1/servers/3ebfe0ed-3568-4b90-b834-fd3ad244dcac => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:26.808356 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-25544f73-dec2-4bfb-b135-e6cb90085328 req-299e3e38-1635-44a3-84e3-5317c77f24a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f267f97-0675-4567-970e-9b51514392cc", "tag": "680a72aa-61d1-4dad-a95b-9bdbe208caad"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:26.816514 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-25544f73-dec2-4bfb-b135-e6cb90085328 req-299e3e38-1635-44a3-84e3-5317c77f24a1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:26.816979 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-25544f73-dec2-4bfb-b135-e6cb90085328 req-299e3e38-1635-44a3-84e3-5317c77f24a1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:26.828614 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-25544f73-dec2-4bfb-b135-e6cb90085328 req-299e3e38-1635-44a3-84e3-5317c77f24a1 service nova] Creating event network-changed:680a72aa-61d1-4dad-a95b-9bdbe208caad for instance 7f267f97-0675-4567-970e-9b51514392cc on nch1-master-1 Apr 16 21:09:26.834465 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-25544f73-dec2-4bfb-b135-e6cb90085328 req-299e3e38-1635-44a3-84e3-5317c77f24a1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029371 Apr 16 21:09:26.835198 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 398/746] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:09:26.840007 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-69725811-f827-483f-8003-0a676de3e833 req-5203a68e-20a2-4b76-baa0-6e4352cc2ced service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18557c2b-2ced-4cbc-998e-978ae82401e7", "name": "network-vif-plugged", "status": "completed", "tag": "e6de744b-54d0-45c6-a666-8fc2c4a831b1"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:26.848447 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-69725811-f827-483f-8003-0a676de3e833 req-5203a68e-20a2-4b76-baa0-6e4352cc2ced service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:26.848989 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-69725811-f827-483f-8003-0a676de3e833 req-5203a68e-20a2-4b76-baa0-6e4352cc2ced service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:26.862340 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-69725811-f827-483f-8003-0a676de3e833 req-5203a68e-20a2-4b76-baa0-6e4352cc2ced service nova] Creating event network-vif-plugged:e6de744b-54d0-45c6-a666-8fc2c4a831b1 for instance 18557c2b-2ced-4cbc-998e-978ae82401e7 on nch2-master-1 Apr 16 21:09:26.868108 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-69725811-f827-483f-8003-0a676de3e833 req-5203a68e-20a2-4b76-baa0-6e4352cc2ced service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031741 Apr 16 21:09:26.868748 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 399/747] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:09:26.874256 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-14e3fbde-d6e8-4579-8155-abcd71dc6688 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:26.874891 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-14e3fbde-d6e8-4579-8155-abcd71dc6688 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] [instance: 7f267f97-0675-4567-970e-9b51514392cc] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:26.883124 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-14e3fbde-d6e8-4579-8155-abcd71dc6688 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:26.884536 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-14e3fbde-d6e8-4579-8155-abcd71dc6688 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:26.885842 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-14e3fbde-d6e8-4579-8155-abcd71dc6688 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:26.886501 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-14e3fbde-d6e8-4579-8155-abcd71dc6688 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:27.027598 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-14e3fbde-d6e8-4579-8155-abcd71dc6688 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3256e24aea41618454e831a0c2a7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c60195eda214c42831714a690e64ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:27.035412 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-14e3fbde-d6e8-4579-8155-abcd71dc6688 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] 10.222.0.20 "GET /compute/v2.1/servers/7f267f97-0675-4567-970e-9b51514392cc" status: 200 len: 1316 microversion: 2.1 time: 0.165409 Apr 16 21:09:27.035913 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 400/748] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:26 2022] GET /compute/v2.1/servers/7f267f97-0675-4567-970e-9b51514392cc => generated 1316 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:27.040859 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c7164d02-2982-468d-8c8c-731f6e78e182 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Calling method '.version_select at 0x7fbb96aef040>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:27.048083 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c7164d02-2982-468d-8c8c-731f6e78e182 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-269222203" status: 200 len: 1532 microversion: 2.2 time: 0.011184 Apr 16 21:09:27.048663 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 401/749] 10.222.0.20 () {60 vars in 1254 bytes} [Sat Apr 16 21:09:27 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-269222203 => generated 1532 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:27.053595 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-05b1a05a-7563-4a47-9696-5602b32c5e65 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:27.054295 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-05b1a05a-7563-4a47-9696-5602b32c5e65 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 7b856a59-2a62-4edc-b448-430f778c7b2e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:27.059972 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-05b1a05a-7563-4a47-9696-5602b32c5e65 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:27.060466 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-05b1a05a-7563-4a47-9696-5602b32c5e65 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:27.061251 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-05b1a05a-7563-4a47-9696-5602b32c5e65 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:27.061695 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-05b1a05a-7563-4a47-9696-5602b32c5e65 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:27.213239 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-05b1a05a-7563-4a47-9696-5602b32c5e65 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:27.220340 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-05b1a05a-7563-4a47-9696-5602b32c5e65 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/7b856a59-2a62-4edc-b448-430f778c7b2e" status: 200 len: 1316 microversion: 2.1 time: 0.170596 Apr 16 21:09:27.230506 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 402/750] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:27 2022] GET /compute/v2.1/servers/7b856a59-2a62-4edc-b448-430f778c7b2e => generated 1316 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:27.235745 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d6335a32-d99b-4b7c-9d27-159897cb4338 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:27.236405 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d6335a32-d99b-4b7c-9d27-159897cb4338 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 18557c2b-2ced-4cbc-998e-978ae82401e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:27.242770 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d6335a32-d99b-4b7c-9d27-159897cb4338 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:27.243232 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d6335a32-d99b-4b7c-9d27-159897cb4338 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:27.244085 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d6335a32-d99b-4b7c-9d27-159897cb4338 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:27.244580 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d6335a32-d99b-4b7c-9d27-159897cb4338 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:27.400980 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d6335a32-d99b-4b7c-9d27-159897cb4338 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7da58ce23242bd947bbd7387b80b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6395bf8972949f8837289679b58d151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:27.408817 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d6335a32-d99b-4b7c-9d27-159897cb4338 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "GET /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7" status: 200 len: 1386 microversion: 2.1 time: 0.176901 Apr 16 21:09:27.409384 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 403/751] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:27 2022] GET /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7 => generated 1386 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:27.414157 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-58fe6ef0-fcbf-4f09-b932-d90893d32a36 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:27.414765 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-58fe6ef0-fcbf-4f09-b932-d90893d32a36 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: ffc4d9b2-dd4f-44dc-a189-354eff7a5573] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:27.420491 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58fe6ef0-fcbf-4f09-b932-d90893d32a36 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:27.420951 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58fe6ef0-fcbf-4f09-b932-d90893d32a36 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:27.421741 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58fe6ef0-fcbf-4f09-b932-d90893d32a36 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:27.422186 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58fe6ef0-fcbf-4f09-b932-d90893d32a36 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:27.546978 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-2c557cb7-2842-4d82-a068-a52d459ea2ce tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:09:27.547478 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-2c557cb7-2842-4d82-a068-a52d459ea2ce tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:09:27.548229 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-2c557cb7-2842-4d82-a068-a52d459ea2ce tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:09:27.548748 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-2c557cb7-2842-4d82-a068-a52d459ea2ce tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:09:27.549283 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-2c557cb7-2842-4d82-a068-a52d459ea2ce tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:09:27.554923 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-58fe6ef0-fcbf-4f09-b932-d90893d32a36 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:27.559439 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2c557cb7-2842-4d82-a068-a52d459ea2ce tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:27.560050 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2c557cb7-2842-4d82-a068-a52d459ea2ce tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:27.561022 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2c557cb7-2842-4d82-a068-a52d459ea2ce tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:27.561590 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2c557cb7-2842-4d82-a068-a52d459ea2ce tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:27.565076 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-58fe6ef0-fcbf-4f09-b932-d90893d32a36 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:27.566582 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-58fe6ef0-fcbf-4f09-b932-d90893d32a36 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:27.568291 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-58fe6ef0-fcbf-4f09-b932-d90893d32a36 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573" status: 200 len: 1568 microversion: 2.25 time: 0.157950 Apr 16 21:09:27.569045 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 404/752] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:09:27 2022] GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:09:27.574817 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c7efa992-0632-4777-9a7f-7d88febd1cda tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Calling method '.version_select at 0x7fbb96b2bd30>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:27.576279 ncdv-master-1 devstack@n-api.service[137408]: WARNING oslo_db.sqlalchemy.utils [None req-c7efa992-0632-4777-9a7f-7d88febd1cda tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Unique keys not in sort_keys. The sorting order may be unstable. Apr 16 21:09:27.585994 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c7efa992-0632-4777-9a7f-7d88febd1cda tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.016135 Apr 16 21:09:27.591533 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 405/753] 10.222.0.20 () {60 vars in 1176 bytes} [Sat Apr 16 21:09:27 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:27.592053 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-edb35957-e9e6-4277-927f-bac099627036 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:27.592650 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-edb35957-e9e6-4277-927f-bac099627036 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: de422b8c-d5d0-4730-92c4-f30877d0cf2b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:27.598664 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-edb35957-e9e6-4277-927f-bac099627036 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:27.599129 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-edb35957-e9e6-4277-927f-bac099627036 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:27.599925 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-edb35957-e9e6-4277-927f-bac099627036 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:27.600405 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-edb35957-e9e6-4277-927f-bac099627036 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:27.603740 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-2c557cb7-2842-4d82-a068-a52d459ea2ce tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Getting quotas for project b18530cc69c44e6f8a46ca966b3e3a7f. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:27.613017 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-2c557cb7-2842-4d82-a068-a52d459ea2ce tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Getting quotas for user 547d9f3aa3a54867971074b795d83b81 and project b18530cc69c44e6f8a46ca966b3e3a7f. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:27.630984 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2c557cb7-2842-4d82-a068-a52d459ea2ce tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:09:27.633848 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2c557cb7-2842-4d82-a068-a52d459ea2ce tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: bc3b9549-fb07-458b-84bf-3f1d36449e6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:09:27.776383 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-edb35957-e9e6-4277-927f-bac099627036 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:27.783723 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-edb35957-e9e6-4277-927f-bac099627036 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/de422b8c-d5d0-4730-92c4-f30877d0cf2b" status: 200 len: 1312 microversion: 2.1 time: 0.195601 Apr 16 21:09:27.796279 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 406/754] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:27 2022] GET /compute/v2.1/servers/de422b8c-d5d0-4730-92c4-f30877d0cf2b => generated 1312 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:27.796279 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c319452d-a707-4b94-81bd-cf08393c3de0 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] Calling method '.version_select at 0x7fbb96aefa60>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:27.870447 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2c557cb7-2842-4d82-a068-a52d459ea2ce tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.842762 Apr 16 21:09:27.871260 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 349/755] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:09:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1845 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:09:27.882968 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5f55f741-32f4-4aef-a67e-9f94016f5f74 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:27.883824 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5f55f741-32f4-4aef-a67e-9f94016f5f74 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] [instance: 3ebfe0ed-3568-4b90-b834-fd3ad244dcac] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:27.893541 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5f55f741-32f4-4aef-a67e-9f94016f5f74 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:27.893953 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5f55f741-32f4-4aef-a67e-9f94016f5f74 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:27.895309 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5f55f741-32f4-4aef-a67e-9f94016f5f74 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:27.895913 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5f55f741-32f4-4aef-a67e-9f94016f5f74 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:27.900244 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c319452d-a707-4b94-81bd-cf08393c3de0 tempest-KeyPairsV22TestJSON-1278963972 tempest-KeyPairsV22TestJSON-1278963972-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-269222203" status: 204 len: 0 microversion: 2.2 time: 0.109843 Apr 16 21:09:27.902684 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 407/756] 10.222.0.20 () {60 vars in 1257 bytes} [Sat Apr 16 21:09:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-269222203 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:09:27.907687 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5a835f5e-8562-4fdf-8847-b59395d81df4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:27.909144 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5a835f5e-8562-4fdf-8847-b59395d81df4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: bc3b9549-fb07-458b-84bf-3f1d36449e6e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:28.006360 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5a835f5e-8562-4fdf-8847-b59395d81df4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:28.028165 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5a835f5e-8562-4fdf-8847-b59395d81df4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e" status: 200 len: 1210 microversion: 2.1 time: 0.124207 Apr 16 21:09:28.028783 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 408/757] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:27 2022] GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e => generated 1210 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:28.053534 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fd31b344-ed84-49b7-89d1-08eacbfe2cba tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:28.054303 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fd31b344-ed84-49b7-89d1-08eacbfe2cba tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] [instance: 7f267f97-0675-4567-970e-9b51514392cc] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:28.062078 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fd31b344-ed84-49b7-89d1-08eacbfe2cba tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:28.062078 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fd31b344-ed84-49b7-89d1-08eacbfe2cba tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:28.062689 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fd31b344-ed84-49b7-89d1-08eacbfe2cba tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:28.063148 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fd31b344-ed84-49b7-89d1-08eacbfe2cba tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:28.093367 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5f55f741-32f4-4aef-a67e-9f94016f5f74 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae06aafd64d46deacb8ae1791676d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1924a4ceffaf45d0bf2bd76ebb421bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:28.103889 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5f55f741-32f4-4aef-a67e-9f94016f5f74 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebfe0ed-3568-4b90-b834-fd3ad244dcac" status: 200 len: 1318 microversion: 2.1 time: 0.231506 Apr 16 21:09:28.104433 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 350/758] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:27 2022] GET /compute/v2.1/servers/3ebfe0ed-3568-4b90-b834-fd3ad244dcac => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:28.215576 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fd31b344-ed84-49b7-89d1-08eacbfe2cba tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3256e24aea41618454e831a0c2a7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c60195eda214c42831714a690e64ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:28.223891 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fd31b344-ed84-49b7-89d1-08eacbfe2cba tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] 10.222.0.20 "GET /compute/v2.1/servers/7f267f97-0675-4567-970e-9b51514392cc" status: 200 len: 1316 microversion: 2.1 time: 0.174374 Apr 16 21:09:28.224589 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 409/759] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:28 2022] GET /compute/v2.1/servers/7f267f97-0675-4567-970e-9b51514392cc => generated 1316 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:09:28.237566 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-87d20bc3-768f-42df-998c-dbc47f015512 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:28.238180 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-87d20bc3-768f-42df-998c-dbc47f015512 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 7b856a59-2a62-4edc-b448-430f778c7b2e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:28.245204 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-87d20bc3-768f-42df-998c-dbc47f015512 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:28.245653 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-87d20bc3-768f-42df-998c-dbc47f015512 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:28.246641 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-87d20bc3-768f-42df-998c-dbc47f015512 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:28.247240 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-87d20bc3-768f-42df-998c-dbc47f015512 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:28.375707 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-87d20bc3-768f-42df-998c-dbc47f015512 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:28.382945 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-87d20bc3-768f-42df-998c-dbc47f015512 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/7b856a59-2a62-4edc-b448-430f778c7b2e" status: 200 len: 1316 microversion: 2.1 time: 0.149893 Apr 16 21:09:28.392279 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 351/760] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:28 2022] GET /compute/v2.1/servers/7b856a59-2a62-4edc-b448-430f778c7b2e => generated 1316 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:28.426971 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-531d7492-e7bb-4366-a406-3a74e8ac6c0b tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:28.427592 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-531d7492-e7bb-4366-a406-3a74e8ac6c0b tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 18557c2b-2ced-4cbc-998e-978ae82401e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:28.441957 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-531d7492-e7bb-4366-a406-3a74e8ac6c0b tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:28.442443 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-531d7492-e7bb-4366-a406-3a74e8ac6c0b tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:28.443244 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-531d7492-e7bb-4366-a406-3a74e8ac6c0b tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:28.443752 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-531d7492-e7bb-4366-a406-3a74e8ac6c0b tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:28.595073 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cdf7024b-5e50-4d19-979a-28dc042a83ef tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:28.595683 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-cdf7024b-5e50-4d19-979a-28dc042a83ef tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: ffc4d9b2-dd4f-44dc-a189-354eff7a5573] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:28.602081 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cdf7024b-5e50-4d19-979a-28dc042a83ef tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:28.602534 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cdf7024b-5e50-4d19-979a-28dc042a83ef tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:28.603503 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cdf7024b-5e50-4d19-979a-28dc042a83ef tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:28.603946 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cdf7024b-5e50-4d19-979a-28dc042a83ef tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:28.608763 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-531d7492-e7bb-4366-a406-3a74e8ac6c0b tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7da58ce23242bd947bbd7387b80b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6395bf8972949f8837289679b58d151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:28.618826 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-531d7492-e7bb-4366-a406-3a74e8ac6c0b tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "GET /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7" status: 200 len: 1386 microversion: 2.1 time: 0.195665 Apr 16 21:09:28.619956 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 410/761] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:28 2022] GET /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7 => generated 1386 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:28.804558 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c935513e-f1ff-48f3-af3e-bfc7902fde57 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:28.805360 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c935513e-f1ff-48f3-af3e-bfc7902fde57 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: de422b8c-d5d0-4730-92c4-f30877d0cf2b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:28.811720 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c935513e-f1ff-48f3-af3e-bfc7902fde57 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:28.815580 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c935513e-f1ff-48f3-af3e-bfc7902fde57 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:28.815580 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c935513e-f1ff-48f3-af3e-bfc7902fde57 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:28.815580 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c935513e-f1ff-48f3-af3e-bfc7902fde57 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:28.835708 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cdf7024b-5e50-4d19-979a-28dc042a83ef tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:28.852646 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cdf7024b-5e50-4d19-979a-28dc042a83ef tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:28.855890 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cdf7024b-5e50-4d19-979a-28dc042a83ef tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:28.857375 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cdf7024b-5e50-4d19-979a-28dc042a83ef tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573" status: 200 len: 1568 microversion: 2.25 time: 0.266068 Apr 16 21:09:28.858105 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 352/762] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:09:28 2022] GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573 => generated 1568 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:09:28.864319 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-ae07c33d-038e-47d2-a5f3-f04cf4b7549f req-5082dbe2-038a-410c-afc3-9037f451728d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffc4d9b2-dd4f-44dc-a189-354eff7a5573", "name": "network-vif-unplugged", "status": "completed", "tag": "fb4825e7-d0af-4d1c-a416-731410a77b41"}, {"name": "network-changed", "server_uuid": "de422b8c-d5d0-4730-92c4-f30877d0cf2b", "tag": "aa28e0e4-5396-47b7-a21f-9f5effb36613"}, {"name": "network-changed", "server_uuid": "ffc4d9b2-dd4f-44dc-a189-354eff7a5573", "tag": "fb4825e7-d0af-4d1c-a416-731410a77b41"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:28.905710 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-ae07c33d-038e-47d2-a5f3-f04cf4b7549f req-5082dbe2-038a-410c-afc3-9037f451728d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:28.906895 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-ae07c33d-038e-47d2-a5f3-f04cf4b7549f req-5082dbe2-038a-410c-afc3-9037f451728d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:28.928283 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-ae07c33d-038e-47d2-a5f3-f04cf4b7549f req-5082dbe2-038a-410c-afc3-9037f451728d service nova] Creating event network-vif-unplugged:fb4825e7-d0af-4d1c-a416-731410a77b41 for instance ffc4d9b2-dd4f-44dc-a189-354eff7a5573 on nch2-master-1 Apr 16 21:09:28.928926 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-ae07c33d-038e-47d2-a5f3-f04cf4b7549f req-5082dbe2-038a-410c-afc3-9037f451728d service nova] Creating event network-changed:aa28e0e4-5396-47b7-a21f-9f5effb36613 for instance de422b8c-d5d0-4730-92c4-f30877d0cf2b on nch1-master-1 Apr 16 21:09:28.929590 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-ae07c33d-038e-47d2-a5f3-f04cf4b7549f req-5082dbe2-038a-410c-afc3-9037f451728d service nova] Creating event network-changed:fb4825e7-d0af-4d1c-a416-731410a77b41 for instance ffc4d9b2-dd4f-44dc-a189-354eff7a5573 on nch2-master-1 Apr 16 21:09:28.938293 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-ae07c33d-038e-47d2-a5f3-f04cf4b7549f req-5082dbe2-038a-410c-afc3-9037f451728d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.078093 Apr 16 21:09:28.939793 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 353/763] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:09:28.953267 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-5df6eb2a-4db0-4a2e-b86a-fb02aebb035a req-f565f6ac-42e4-4028-b159-87cb72a147a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ebfe0ed-3568-4b90-b834-fd3ad244dcac", "name": "network-vif-plugged", "status": "completed", "tag": "866329ca-a3b9-4787-9b58-31964260c59e"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:28.957147 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-5df6eb2a-4db0-4a2e-b86a-fb02aebb035a req-f565f6ac-42e4-4028-b159-87cb72a147a3 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:28.958689 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-5df6eb2a-4db0-4a2e-b86a-fb02aebb035a req-f565f6ac-42e4-4028-b159-87cb72a147a3 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:28.970479 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-5df6eb2a-4db0-4a2e-b86a-fb02aebb035a req-f565f6ac-42e4-4028-b159-87cb72a147a3 service nova] Creating event network-vif-plugged:866329ca-a3b9-4787-9b58-31964260c59e for instance 3ebfe0ed-3568-4b90-b834-fd3ad244dcac on nch1-master-1 Apr 16 21:09:28.975944 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-5df6eb2a-4db0-4a2e-b86a-fb02aebb035a req-f565f6ac-42e4-4028-b159-87cb72a147a3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034445 Apr 16 21:09:28.980338 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 354/764] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:09:28.986050 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c935513e-f1ff-48f3-af3e-bfc7902fde57 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:28.994330 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c935513e-f1ff-48f3-af3e-bfc7902fde57 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/de422b8c-d5d0-4730-92c4-f30877d0cf2b" status: 200 len: 1312 microversion: 2.1 time: 0.193972 Apr 16 21:09:28.995119 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 411/765] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:28 2022] GET /compute/v2.1/servers/de422b8c-d5d0-4730-92c4-f30877d0cf2b => generated 1312 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:29.045826 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-60069e72-d56c-457c-9a7a-8ccc71088f44 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:29.046676 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-60069e72-d56c-457c-9a7a-8ccc71088f44 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: bc3b9549-fb07-458b-84bf-3f1d36449e6e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:29.052927 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-60069e72-d56c-457c-9a7a-8ccc71088f44 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:29.053465 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-60069e72-d56c-457c-9a7a-8ccc71088f44 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:29.054258 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-60069e72-d56c-457c-9a7a-8ccc71088f44 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:29.054736 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-60069e72-d56c-457c-9a7a-8ccc71088f44 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:29.122732 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-70fdac2c-447e-4be6-8394-43eb551b9008 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:29.123341 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-70fdac2c-447e-4be6-8394-43eb551b9008 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] [instance: 3ebfe0ed-3568-4b90-b834-fd3ad244dcac] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:29.137737 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-70fdac2c-447e-4be6-8394-43eb551b9008 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:29.138203 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-70fdac2c-447e-4be6-8394-43eb551b9008 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:29.139001 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-70fdac2c-447e-4be6-8394-43eb551b9008 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:29.147224 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-70fdac2c-447e-4be6-8394-43eb551b9008 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:29.147380 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-60069e72-d56c-457c-9a7a-8ccc71088f44 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:29.151786 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-60069e72-d56c-457c-9a7a-8ccc71088f44 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e" status: 200 len: 1214 microversion: 2.1 time: 0.110013 Apr 16 21:09:29.153099 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 355/766] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:29 2022] GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e => generated 1214 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:09:29.243018 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b34b29d2-d99b-4119-b8bd-f84d28a9fd64 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:29.245527 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b34b29d2-d99b-4119-b8bd-f84d28a9fd64 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] [instance: 7f267f97-0675-4567-970e-9b51514392cc] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:29.256410 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b34b29d2-d99b-4119-b8bd-f84d28a9fd64 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:29.256410 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b34b29d2-d99b-4119-b8bd-f84d28a9fd64 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:29.256410 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b34b29d2-d99b-4119-b8bd-f84d28a9fd64 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:29.257359 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b34b29d2-d99b-4119-b8bd-f84d28a9fd64 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:29.347807 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-70fdac2c-447e-4be6-8394-43eb551b9008 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae06aafd64d46deacb8ae1791676d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1924a4ceffaf45d0bf2bd76ebb421bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:29.362233 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-70fdac2c-447e-4be6-8394-43eb551b9008 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebfe0ed-3568-4b90-b834-fd3ad244dcac" status: 200 len: 1318 microversion: 2.1 time: 0.243379 Apr 16 21:09:29.371359 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 412/767] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:29 2022] GET /compute/v2.1/servers/3ebfe0ed-3568-4b90-b834-fd3ad244dcac => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:29.399508 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3f91c8cd-3544-433a-bfd1-b0a68cffb045 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:29.400155 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3f91c8cd-3544-433a-bfd1-b0a68cffb045 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 7b856a59-2a62-4edc-b448-430f778c7b2e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:29.406456 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3f91c8cd-3544-433a-bfd1-b0a68cffb045 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:29.406996 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3f91c8cd-3544-433a-bfd1-b0a68cffb045 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:29.407888 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3f91c8cd-3544-433a-bfd1-b0a68cffb045 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:29.408498 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3f91c8cd-3544-433a-bfd1-b0a68cffb045 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:29.585390 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3f91c8cd-3544-433a-bfd1-b0a68cffb045 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:29.594211 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3f91c8cd-3544-433a-bfd1-b0a68cffb045 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/7b856a59-2a62-4edc-b448-430f778c7b2e" status: 200 len: 1466 microversion: 2.1 time: 0.199272 Apr 16 21:09:29.594865 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 413/768] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:29 2022] GET /compute/v2.1/servers/7b856a59-2a62-4edc-b448-430f778c7b2e => generated 1466 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:09:29.693697 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b34b29d2-d99b-4119-b8bd-f84d28a9fd64 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3256e24aea41618454e831a0c2a7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c60195eda214c42831714a690e64ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:29.706176 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b34b29d2-d99b-4119-b8bd-f84d28a9fd64 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] 10.222.0.20 "GET /compute/v2.1/servers/7f267f97-0675-4567-970e-9b51514392cc" status: 200 len: 1316 microversion: 2.1 time: 0.469080 Apr 16 21:09:29.706772 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 356/769] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:29 2022] GET /compute/v2.1/servers/7f267f97-0675-4567-970e-9b51514392cc => generated 1316 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:29.718602 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8436d3df-e9e8-4e26-8493-0e8fc63ad1d6 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:29.719219 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8436d3df-e9e8-4e26-8493-0e8fc63ad1d6 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 18557c2b-2ced-4cbc-998e-978ae82401e7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:29.726178 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8436d3df-e9e8-4e26-8493-0e8fc63ad1d6 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:29.726638 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8436d3df-e9e8-4e26-8493-0e8fc63ad1d6 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:29.727426 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8436d3df-e9e8-4e26-8493-0e8fc63ad1d6 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:29.727897 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8436d3df-e9e8-4e26-8493-0e8fc63ad1d6 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:29.943163 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cda8be38-3459-466b-a02e-ad353b165e25 tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:29.944291 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cda8be38-3459-466b-a02e-ad353b165e25 tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] [instance: 7b856a59-2a62-4edc-b448-430f778c7b2e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:29.947514 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8436d3df-e9e8-4e26-8493-0e8fc63ad1d6 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7da58ce23242bd947bbd7387b80b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6395bf8972949f8837289679b58d151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:29.951780 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cda8be38-3459-466b-a02e-ad353b165e25 tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:29.952592 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cda8be38-3459-466b-a02e-ad353b165e25 tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:29.953822 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cda8be38-3459-466b-a02e-ad353b165e25 tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:29.954463 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cda8be38-3459-466b-a02e-ad353b165e25 tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:29.960914 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8436d3df-e9e8-4e26-8493-0e8fc63ad1d6 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "GET /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7" status: 200 len: 1386 microversion: 2.1 time: 0.251957 Apr 16 21:09:29.961898 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 357/770] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:29 2022] GET /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7 => generated 1386 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:29.977374 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a4ca5138-599d-4fb6-b824-d4fc6b22dbfd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:29.978943 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a4ca5138-599d-4fb6-b824-d4fc6b22dbfd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: ffc4d9b2-dd4f-44dc-a189-354eff7a5573] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:29.988769 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a4ca5138-599d-4fb6-b824-d4fc6b22dbfd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:29.989535 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a4ca5138-599d-4fb6-b824-d4fc6b22dbfd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:29.991049 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a4ca5138-599d-4fb6-b824-d4fc6b22dbfd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:29.992087 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a4ca5138-599d-4fb6-b824-d4fc6b22dbfd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:30.268624 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cda8be38-3459-466b-a02e-ad353b165e25 tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/7b856a59-2a62-4edc-b448-430f778c7b2e" status: 200 len: 1617 microversion: 2.1 time: 0.661244 Apr 16 21:09:30.281309 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 414/771] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:29 2022] GET /compute/v2.1/servers/7b856a59-2a62-4edc-b448-430f778c7b2e => generated 1617 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:09:30.287490 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-397e3cb4-6ff4-4be0-a0d9-b7d67d86cabe tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:30.291895 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-397e3cb4-6ff4-4be0-a0d9-b7d67d86cabe tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: de422b8c-d5d0-4730-92c4-f30877d0cf2b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:30.294444 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-397e3cb4-6ff4-4be0-a0d9-b7d67d86cabe tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:30.294922 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-397e3cb4-6ff4-4be0-a0d9-b7d67d86cabe tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:30.295724 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-397e3cb4-6ff4-4be0-a0d9-b7d67d86cabe tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:30.296360 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-397e3cb4-6ff4-4be0-a0d9-b7d67d86cabe tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:30.364853 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a4ca5138-599d-4fb6-b824-d4fc6b22dbfd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:30.372989 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a4ca5138-599d-4fb6-b824-d4fc6b22dbfd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:30.374767 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a4ca5138-599d-4fb6-b824-d4fc6b22dbfd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:30.375953 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a4ca5138-599d-4fb6-b824-d4fc6b22dbfd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573" status: 200 len: 1568 microversion: 2.25 time: 0.411022 Apr 16 21:09:30.376568 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 358/772] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:09:29 2022] GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573 => generated 1568 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:09:30.383028 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-db352c8b-0f19-4d4f-b78e-bdfaeeedb145 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:30.388654 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-db352c8b-0f19-4d4f-b78e-bdfaeeedb145 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: bc3b9549-fb07-458b-84bf-3f1d36449e6e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:30.399460 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-db352c8b-0f19-4d4f-b78e-bdfaeeedb145 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:30.399922 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-db352c8b-0f19-4d4f-b78e-bdfaeeedb145 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:30.400856 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-db352c8b-0f19-4d4f-b78e-bdfaeeedb145 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:30.401299 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-db352c8b-0f19-4d4f-b78e-bdfaeeedb145 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:30.439271 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-397e3cb4-6ff4-4be0-a0d9-b7d67d86cabe tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:30.448128 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-397e3cb4-6ff4-4be0-a0d9-b7d67d86cabe tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/de422b8c-d5d0-4730-92c4-f30877d0cf2b" status: 200 len: 1312 microversion: 2.1 time: 0.165613 Apr 16 21:09:30.457897 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 415/773] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:30 2022] GET /compute/v2.1/servers/de422b8c-d5d0-4730-92c4-f30877d0cf2b => generated 1312 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:30.457897 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6207d3ea-97e3-4913-b7c8-1f062dc72087 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Action: 'create', calling method: .version_select at 0x7fbb96ba7c10>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1936263907", "policies": ["affinity"]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:30.470610 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-db352c8b-0f19-4d4f-b78e-bdfaeeedb145 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:30.476149 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-6207d3ea-97e3-4913-b7c8-1f062dc72087 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Getting quotas for project cd7c434915254744b7a0409ab8e6d33d. Resources: {'server_groups'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:30.478321 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-db352c8b-0f19-4d4f-b78e-bdfaeeedb145 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e" status: 200 len: 1262 microversion: 2.1 time: 0.100425 Apr 16 21:09:30.478968 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 359/774] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:30 2022] GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e => generated 1262 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:30.481500 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-6207d3ea-97e3-4913-b7c8-1f062dc72087 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Getting quotas for user 79f97c1afe5442dc83319237d121c11f and project cd7c434915254744b7a0409ab8e6d33d. Resources: {'server_groups'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:30.492961 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7d7dd7d3-c3e5-46de-9d9b-7e69fda1781d tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:30.493709 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7d7dd7d3-c3e5-46de-9d9b-7e69fda1781d tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] [instance: 3ebfe0ed-3568-4b90-b834-fd3ad244dcac] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:30.504581 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7d7dd7d3-c3e5-46de-9d9b-7e69fda1781d tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:30.505177 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7d7dd7d3-c3e5-46de-9d9b-7e69fda1781d tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:30.506048 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7d7dd7d3-c3e5-46de-9d9b-7e69fda1781d tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:30.506559 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7d7dd7d3-c3e5-46de-9d9b-7e69fda1781d tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:30.634972 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-6207d3ea-97e3-4913-b7c8-1f062dc72087 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Getting quotas for project cd7c434915254744b7a0409ab8e6d33d. Resources: {'server_groups'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:30.641917 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-6207d3ea-97e3-4913-b7c8-1f062dc72087 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Getting quotas for user 79f97c1afe5442dc83319237d121c11f and project cd7c434915254744b7a0409ab8e6d33d. Resources: {'server_groups'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:30.662781 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6207d3ea-97e3-4913-b7c8-1f062dc72087 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.211602 Apr 16 21:09:30.663566 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 416/775] 10.222.0.20 () {60 vars in 1173 bytes} [Sat Apr 16 21:09:30 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:09:30.723014 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-46663700-73e6-4a3e-b8c4-48df62f5128e tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:30.724227 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-46663700-73e6-4a3e-b8c4-48df62f5128e tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] [instance: 7f267f97-0675-4567-970e-9b51514392cc] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:30.731535 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-46663700-73e6-4a3e-b8c4-48df62f5128e tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:30.736213 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-46663700-73e6-4a3e-b8c4-48df62f5128e tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:30.742554 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-46663700-73e6-4a3e-b8c4-48df62f5128e tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:30.743244 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-46663700-73e6-4a3e-b8c4-48df62f5128e tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:30.763973 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7d7dd7d3-c3e5-46de-9d9b-7e69fda1781d tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae06aafd64d46deacb8ae1791676d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1924a4ceffaf45d0bf2bd76ebb421bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:30.797131 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7d7dd7d3-c3e5-46de-9d9b-7e69fda1781d tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebfe0ed-3568-4b90-b834-fd3ad244dcac" status: 200 len: 1318 microversion: 2.1 time: 0.317033 Apr 16 21:09:30.799485 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 360/776] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:30 2022] GET /compute/v2.1/servers/3ebfe0ed-3568-4b90-b834-fd3ad244dcac => generated 1318 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:30.822747 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1338914496", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "4627cf89-35ca-4dbd-84b8-c29fcd53e795"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:30.876400 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] validate_networks() for None {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:09:30.917660 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-46663700-73e6-4a3e-b8c4-48df62f5128e tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3256e24aea41618454e831a0c2a7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c60195eda214c42831714a690e64ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:30.929326 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-46663700-73e6-4a3e-b8c4-48df62f5128e tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] 10.222.0.20 "GET /compute/v2.1/servers/7f267f97-0675-4567-970e-9b51514392cc" status: 200 len: 1316 microversion: 2.1 time: 0.210137 Apr 16 21:09:30.931156 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 417/777] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:30 2022] GET /compute/v2.1/servers/7f267f97-0675-4567-970e-9b51514392cc => generated 1316 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:09:31.135274 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fae50f19-4b43-4a5a-8464-3db04f397119 tempest-AbsoluteLimitsTestJSON-1471976896 tempest-AbsoluteLimitsTestJSON-1471976896-project] Calling method '.version_select at 0x7fbb96ba7940>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:31.146292 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fae50f19-4b43-4a5a-8464-3db04f397119 tempest-AbsoluteLimitsTestJSON-1471976896 tempest-AbsoluteLimitsTestJSON-1471976896-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:31.146872 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fae50f19-4b43-4a5a-8464-3db04f397119 tempest-AbsoluteLimitsTestJSON-1471976896 tempest-AbsoluteLimitsTestJSON-1471976896-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:31.147808 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fae50f19-4b43-4a5a-8464-3db04f397119 tempest-AbsoluteLimitsTestJSON-1471976896 tempest-AbsoluteLimitsTestJSON-1471976896-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:31.148424 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fae50f19-4b43-4a5a-8464-3db04f397119 tempest-AbsoluteLimitsTestJSON-1471976896 tempest-AbsoluteLimitsTestJSON-1471976896-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:31.169035 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fae50f19-4b43-4a5a-8464-3db04f397119 tempest-AbsoluteLimitsTestJSON-1471976896 tempest-AbsoluteLimitsTestJSON-1471976896-project] 10.222.0.20 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.222438 Apr 16 21:09:31.169664 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 418/778] 10.222.0.20 () {58 vars in 1121 bytes} [Sat Apr 16 21:09:30 2022] GET /compute/v2.1/limits => generated 511 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:09:31.174498 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5c69b6ec-1366-415b-a764-c1c79cc8cea4 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:31.175117 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5c69b6ec-1366-415b-a764-c1c79cc8cea4 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 18557c2b-2ced-4cbc-998e-978ae82401e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:31.181872 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5c69b6ec-1366-415b-a764-c1c79cc8cea4 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:31.182345 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5c69b6ec-1366-415b-a764-c1c79cc8cea4 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:31.183258 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5c69b6ec-1366-415b-a764-c1c79cc8cea4 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:31.183720 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5c69b6ec-1366-415b-a764-c1c79cc8cea4 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:31.234940 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:09:31.236158 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:09:31.236666 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:09:31.237291 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:09:31.237919 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:09:31.294448 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:31.297259 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:31.298138 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:31.298589 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:31.323585 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Getting quotas for project cd7c434915254744b7a0409ab8e6d33d. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:31.329552 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Getting quotas for user 79f97c1afe5442dc83319237d121c11f and project cd7c434915254744b7a0409ab8e6d33d. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:31.344900 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Going to run 2 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:09:31.347739 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: e26a3424-8bc8-454c-a7e3-507bb1c71c03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:09:31.355682 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5c69b6ec-1366-415b-a764-c1c79cc8cea4 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7da58ce23242bd947bbd7387b80b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6395bf8972949f8837289679b58d151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:31.364680 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5c69b6ec-1366-415b-a764-c1c79cc8cea4 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "GET /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7" status: 200 len: 1585 microversion: 2.1 time: 0.193147 Apr 16 21:09:31.365363 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 419/779] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:31 2022] GET /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7 => generated 1585 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:31.381758 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ea6d1b47-e85c-44d1-ab04-b043e6b1badf tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:31.382578 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ea6d1b47-e85c-44d1-ab04-b043e6b1badf tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 18557c2b-2ced-4cbc-998e-978ae82401e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:31.389400 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ea6d1b47-e85c-44d1-ab04-b043e6b1badf tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:31.390056 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ea6d1b47-e85c-44d1-ab04-b043e6b1badf tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:31.395760 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ea6d1b47-e85c-44d1-ab04-b043e6b1badf tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:31.395760 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ea6d1b47-e85c-44d1-ab04-b043e6b1badf tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:31.483782 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ea6d1b47-e85c-44d1-ab04-b043e6b1badf tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "GET /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.106544 Apr 16 21:09:31.484434 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 420/780] 10.222.0.20 () {58 vars in 1274 bytes} [Sat Apr 16 21:09:31 2022] GET /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:09:31.491256 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-659e49bf-1df0-4e1f-bd79-eae29d1f8284 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:31.492075 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-659e49bf-1df0-4e1f-bd79-eae29d1f8284 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: ffc4d9b2-dd4f-44dc-a189-354eff7a5573] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:31.499873 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-659e49bf-1df0-4e1f-bd79-eae29d1f8284 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:31.500460 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-659e49bf-1df0-4e1f-bd79-eae29d1f8284 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:31.501269 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-659e49bf-1df0-4e1f-bd79-eae29d1f8284 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:31.501758 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-659e49bf-1df0-4e1f-bd79-eae29d1f8284 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:31.517609 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=137409) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Apr 16 21:09:31.543805 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Getting quotas for project cd7c434915254744b7a0409ab8e6d33d. Resources: {'server_group_members'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:31.549456 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Getting quotas for user 79f97c1afe5442dc83319237d121c11f and project cd7c434915254744b7a0409ab8e6d33d. Resources: {'server_group_members'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:31.694306 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Getting quotas for project cd7c434915254744b7a0409ab8e6d33d. Resources: {'server_group_members'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:31.700402 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Getting quotas for user 79f97c1afe5442dc83319237d121c11f and project cd7c434915254744b7a0409ab8e6d33d. Resources: {'server_group_members'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:31.715316 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 728c68c3-5252-4e9a-b1d0-c3afdfc8ba35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=e26a3424-8bc8-454c-a7e3-507bb1c71c03,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:09:31.824147 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Getting quotas for project cd7c434915254744b7a0409ab8e6d33d. Resources: {'server_group_members'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:31.829151 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-659e49bf-1df0-4e1f-bd79-eae29d1f8284 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:31.830592 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Getting quotas for user 79f97c1afe5442dc83319237d121c11f and project cd7c434915254744b7a0409ab8e6d33d. Resources: {'server_group_members'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:31.838303 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-659e49bf-1df0-4e1f-bd79-eae29d1f8284 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:31.840087 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-659e49bf-1df0-4e1f-bd79-eae29d1f8284 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:31.841715 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-659e49bf-1df0-4e1f-bd79-eae29d1f8284 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573" status: 200 len: 1568 microversion: 2.25 time: 0.355997 Apr 16 21:09:31.854027 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 421/781] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:09:31 2022] GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573 => generated 1568 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:09:31.860915 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e75f8bbc-5902-4b05-88f3-b5cc94f0eef3 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:31.861679 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e75f8bbc-5902-4b05-88f3-b5cc94f0eef3 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: de422b8c-d5d0-4730-92c4-f30877d0cf2b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:31.868691 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e75f8bbc-5902-4b05-88f3-b5cc94f0eef3 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:31.869267 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e75f8bbc-5902-4b05-88f3-b5cc94f0eef3 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:31.870042 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e75f8bbc-5902-4b05-88f3-b5cc94f0eef3 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:31.870541 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e75f8bbc-5902-4b05-88f3-b5cc94f0eef3 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:32.014694 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Getting quotas for project cd7c434915254744b7a0409ab8e6d33d. Resources: {'server_group_members'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:32.021668 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Getting quotas for user 79f97c1afe5442dc83319237d121c11f and project cd7c434915254744b7a0409ab8e6d33d. Resources: {'server_group_members'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:32.064869 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-25fc79c9-9f30-48c2-8e3e-468147b26e61 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.245858 Apr 16 21:09:32.066240 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 361/782] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:09:30 2022] POST /compute/v2.1/servers => generated 32 bytes in 1248 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Apr 16 21:09:32.071373 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-452461e8-a383-42ae-9f66-11487c9d66a9 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:32.071984 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-452461e8-a383-42ae-9f66-11487c9d66a9 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: bc3b9549-fb07-458b-84bf-3f1d36449e6e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:32.081398 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-452461e8-a383-42ae-9f66-11487c9d66a9 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:32.081957 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-452461e8-a383-42ae-9f66-11487c9d66a9 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:32.087341 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-452461e8-a383-42ae-9f66-11487c9d66a9 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:32.087341 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-452461e8-a383-42ae-9f66-11487c9d66a9 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:32.221222 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e75f8bbc-5902-4b05-88f3-b5cc94f0eef3 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:32.247830 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e75f8bbc-5902-4b05-88f3-b5cc94f0eef3 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/de422b8c-d5d0-4730-92c4-f30877d0cf2b" status: 200 len: 1312 microversion: 2.1 time: 0.391522 Apr 16 21:09:32.257403 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 422/783] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:31 2022] GET /compute/v2.1/servers/de422b8c-d5d0-4730-92c4-f30877d0cf2b => generated 1312 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:32.266013 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a1367af8-5c56-480d-860b-a271680410b2 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:32.266629 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a1367af8-5c56-480d-860b-a271680410b2 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] [instance: 3ebfe0ed-3568-4b90-b834-fd3ad244dcac] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:32.273261 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a1367af8-5c56-480d-860b-a271680410b2 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:32.274009 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a1367af8-5c56-480d-860b-a271680410b2 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:32.275298 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a1367af8-5c56-480d-860b-a271680410b2 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:32.275894 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a1367af8-5c56-480d-860b-a271680410b2 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:32.757996 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a1367af8-5c56-480d-860b-a271680410b2 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae06aafd64d46deacb8ae1791676d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1924a4ceffaf45d0bf2bd76ebb421bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:32.767589 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a1367af8-5c56-480d-860b-a271680410b2 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebfe0ed-3568-4b90-b834-fd3ad244dcac" status: 200 len: 1318 microversion: 2.1 time: 0.508731 Apr 16 21:09:32.768209 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 423/784] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:32 2022] GET /compute/v2.1/servers/3ebfe0ed-3568-4b90-b834-fd3ad244dcac => generated 1318 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:32.786048 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-137854b5-6dae-4b0a-a79f-33325d449ae5 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:32.787675 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-137854b5-6dae-4b0a-a79f-33325d449ae5 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] [instance: 7f267f97-0675-4567-970e-9b51514392cc] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:32.797723 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-137854b5-6dae-4b0a-a79f-33325d449ae5 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:32.798736 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-137854b5-6dae-4b0a-a79f-33325d449ae5 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:32.799849 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-137854b5-6dae-4b0a-a79f-33325d449ae5 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:32.800488 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-137854b5-6dae-4b0a-a79f-33325d449ae5 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:32.805554 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-452461e8-a383-42ae-9f66-11487c9d66a9 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:32.820953 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-452461e8-a383-42ae-9f66-11487c9d66a9 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e" status: 200 len: 1310 microversion: 2.1 time: 0.753449 Apr 16 21:09:32.821552 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 362/785] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:32 2022] GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e => generated 1310 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:32.835739 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fc018090-ab35-42d3-88a2-442b41245c0b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:32.840204 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-fc018090-ab35-42d3-88a2-442b41245c0b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:32.841169 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-fc018090-ab35-42d3-88a2-442b41245c0b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Searching by: {'deleted': False, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d'} {{(pid=137409) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:09:32.858578 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fc018090-ab35-42d3-88a2-442b41245c0b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:32.859333 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fc018090-ab35-42d3-88a2-442b41245c0b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:32.860921 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fc018090-ab35-42d3-88a2-442b41245c0b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:32.861372 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fc018090-ab35-42d3-88a2-442b41245c0b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:32.994277 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.multi_cell_list [None req-fc018090-ab35-42d3-88a2-442b41245c0b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=137409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 16 21:09:33.152329 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fc018090-ab35-42d3-88a2-442b41245c0b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 1003 microversion: 2.1 time: 0.320452 Apr 16 21:09:33.153591 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 363/786] 10.222.0.20 () {58 vars in 1124 bytes} [Sat Apr 16 21:09:32 2022] GET /compute/v2.1/servers => generated 1003 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:33.159608 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-357aeb61-3e8e-4ce9-886d-14eef234a164 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:33.161727 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-357aeb61-3e8e-4ce9-886d-14eef234a164 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: ffc4d9b2-dd4f-44dc-a189-354eff7a5573] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:33.171358 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-357aeb61-3e8e-4ce9-886d-14eef234a164 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:33.175033 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-357aeb61-3e8e-4ce9-886d-14eef234a164 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:33.177022 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-137854b5-6dae-4b0a-a79f-33325d449ae5 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3256e24aea41618454e831a0c2a7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c60195eda214c42831714a690e64ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:33.178061 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-357aeb61-3e8e-4ce9-886d-14eef234a164 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:33.185612 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-357aeb61-3e8e-4ce9-886d-14eef234a164 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:33.187174 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-137854b5-6dae-4b0a-a79f-33325d449ae5 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] 10.222.0.20 "GET /compute/v2.1/servers/7f267f97-0675-4567-970e-9b51514392cc" status: 200 len: 1316 microversion: 2.1 time: 0.414714 Apr 16 21:09:33.198665 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 424/787] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:32 2022] GET /compute/v2.1/servers/7f267f97-0675-4567-970e-9b51514392cc => generated 1316 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:33.198665 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-8eab01db-f909-420d-b7f9-6fa25e40cffd req-d0f32f34-46cf-4035-9310-9b120926c680 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f267f97-0675-4567-970e-9b51514392cc", "name": "network-vif-plugged", "status": "completed", "tag": "680a72aa-61d1-4dad-a95b-9bdbe208caad"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:33.219853 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-8eab01db-f909-420d-b7f9-6fa25e40cffd req-d0f32f34-46cf-4035-9310-9b120926c680 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:33.220248 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-8eab01db-f909-420d-b7f9-6fa25e40cffd req-d0f32f34-46cf-4035-9310-9b120926c680 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:33.244830 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-8eab01db-f909-420d-b7f9-6fa25e40cffd req-d0f32f34-46cf-4035-9310-9b120926c680 service nova] Creating event network-vif-plugged:680a72aa-61d1-4dad-a95b-9bdbe208caad for instance 7f267f97-0675-4567-970e-9b51514392cc on nch1-master-1 Apr 16 21:09:33.250275 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-8eab01db-f909-420d-b7f9-6fa25e40cffd req-d0f32f34-46cf-4035-9310-9b120926c680 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056302 Apr 16 21:09:33.250900 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 425/788] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:09:33.272887 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-aa0a81cf-1671-42d1-83fc-37abd24d89ef tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:33.274668 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-aa0a81cf-1671-42d1-83fc-37abd24d89ef tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 728c68c3-5252-4e9a-b1d0-c3afdfc8ba35] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:33.433085 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-aa0a81cf-1671-42d1-83fc-37abd24d89ef tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:33.440434 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-aa0a81cf-1671-42d1-83fc-37abd24d89ef tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/728c68c3-5252-4e9a-b1d0-c3afdfc8ba35" status: 200 len: 1219 microversion: 2.1 time: 0.182084 Apr 16 21:09:33.441402 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 426/789] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:33 2022] GET /compute/v2.1/servers/728c68c3-5252-4e9a-b1d0-c3afdfc8ba35 => generated 1219 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:33.451847 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-026967e5-5c89-4fe0-b261-58f45dbd413e tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:33.452836 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-026967e5-5c89-4fe0-b261-58f45dbd413e tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: de422b8c-d5d0-4730-92c4-f30877d0cf2b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:33.470073 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-026967e5-5c89-4fe0-b261-58f45dbd413e tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:33.470661 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-026967e5-5c89-4fe0-b261-58f45dbd413e tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:33.472903 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-026967e5-5c89-4fe0-b261-58f45dbd413e tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:33.474575 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-026967e5-5c89-4fe0-b261-58f45dbd413e tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:33.577848 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-357aeb61-3e8e-4ce9-886d-14eef234a164 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:33.588876 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-357aeb61-3e8e-4ce9-886d-14eef234a164 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:33.590829 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-357aeb61-3e8e-4ce9-886d-14eef234a164 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:33.592378 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-357aeb61-3e8e-4ce9-886d-14eef234a164 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573" status: 200 len: 1568 microversion: 2.25 time: 0.437558 Apr 16 21:09:33.593488 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 364/790] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:09:33 2022] GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573 => generated 1568 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:09:33.792151 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bb0c09c2-5e9d-4a68-a51f-6137f51cf97f tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:33.793809 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bb0c09c2-5e9d-4a68-a51f-6137f51cf97f tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] [instance: 3ebfe0ed-3568-4b90-b834-fd3ad244dcac] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:33.816596 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bb0c09c2-5e9d-4a68-a51f-6137f51cf97f tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:33.820828 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bb0c09c2-5e9d-4a68-a51f-6137f51cf97f tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:33.820828 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bb0c09c2-5e9d-4a68-a51f-6137f51cf97f tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:33.821848 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bb0c09c2-5e9d-4a68-a51f-6137f51cf97f tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:33.824403 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-026967e5-5c89-4fe0-b261-58f45dbd413e tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:33.835933 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-026967e5-5c89-4fe0-b261-58f45dbd413e tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/de422b8c-d5d0-4730-92c4-f30877d0cf2b" status: 200 len: 1312 microversion: 2.1 time: 0.392731 Apr 16 21:09:33.837029 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 427/791] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:33 2022] GET /compute/v2.1/servers/de422b8c-d5d0-4730-92c4-f30877d0cf2b => generated 1312 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:33.860014 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a34c4622-ff1b-49db-bb2c-d45cf25c48ac tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:33.860832 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a34c4622-ff1b-49db-bb2c-d45cf25c48ac tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: bc3b9549-fb07-458b-84bf-3f1d36449e6e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:33.877902 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a34c4622-ff1b-49db-bb2c-d45cf25c48ac tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:33.877902 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a34c4622-ff1b-49db-bb2c-d45cf25c48ac tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:33.877902 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a34c4622-ff1b-49db-bb2c-d45cf25c48ac tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:33.877902 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a34c4622-ff1b-49db-bb2c-d45cf25c48ac tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:34.084942 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-bb0c09c2-5e9d-4a68-a51f-6137f51cf97f tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae06aafd64d46deacb8ae1791676d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1924a4ceffaf45d0bf2bd76ebb421bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:34.094558 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bb0c09c2-5e9d-4a68-a51f-6137f51cf97f tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebfe0ed-3568-4b90-b834-fd3ad244dcac" status: 200 len: 1467 microversion: 2.1 time: 0.307010 Apr 16 21:09:34.095767 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 365/792] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:33 2022] GET /compute/v2.1/servers/3ebfe0ed-3568-4b90-b834-fd3ad244dcac => generated 1467 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:09:34.110340 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-73337d53-6aa2-4c86-b1ab-ce330abe4184 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:34.111918 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-73337d53-6aa2-4c86-b1ab-ce330abe4184 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 18557c2b-2ced-4cbc-998e-978ae82401e7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:34.114325 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a34c4622-ff1b-49db-bb2c-d45cf25c48ac tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:34.119353 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-73337d53-6aa2-4c86-b1ab-ce330abe4184 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:34.119825 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-73337d53-6aa2-4c86-b1ab-ce330abe4184 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:34.120862 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-73337d53-6aa2-4c86-b1ab-ce330abe4184 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:34.121967 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-73337d53-6aa2-4c86-b1ab-ce330abe4184 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:34.123779 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a34c4622-ff1b-49db-bb2c-d45cf25c48ac tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e" status: 200 len: 1310 microversion: 2.1 time: 0.277309 Apr 16 21:09:34.124408 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 428/793] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:33 2022] GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e => generated 1310 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:34.131712 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-d5fc6850-fceb-4852-b289-861810bd8600 req-d7d2100b-f93c-40d9-90e5-4aa56335ea37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18557c2b-2ced-4cbc-998e-978ae82401e7", "tag": "e6de744b-54d0-45c6-a666-8fc2c4a831b1"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:34.143750 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-d5fc6850-fceb-4852-b289-861810bd8600 req-d7d2100b-f93c-40d9-90e5-4aa56335ea37 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:34.144511 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-d5fc6850-fceb-4852-b289-861810bd8600 req-d7d2100b-f93c-40d9-90e5-4aa56335ea37 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:34.161710 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-d5fc6850-fceb-4852-b289-861810bd8600 req-d7d2100b-f93c-40d9-90e5-4aa56335ea37 service nova] Creating event network-changed:e6de744b-54d0-45c6-a666-8fc2c4a831b1 for instance 18557c2b-2ced-4cbc-998e-978ae82401e7 on nch2-master-1 Apr 16 21:09:34.183862 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-d5fc6850-fceb-4852-b289-861810bd8600 req-d7d2100b-f93c-40d9-90e5-4aa56335ea37 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057064 Apr 16 21:09:34.184930 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 429/794] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:09:34.196503 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-65125d90-03b1-40f4-9859-55b8183edadf tempest-LiveMigrationNegativeTest-1640925737 tempest-LiveMigrationNegativeTest-1640925737-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:34.197626 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-65125d90-03b1-40f4-9859-55b8183edadf tempest-LiveMigrationNegativeTest-1640925737 tempest-LiveMigrationNegativeTest-1640925737-project-admin] [instance: 3ebfe0ed-3568-4b90-b834-fd3ad244dcac] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:34.213441 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-65125d90-03b1-40f4-9859-55b8183edadf tempest-LiveMigrationNegativeTest-1640925737 tempest-LiveMigrationNegativeTest-1640925737-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:34.214267 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-65125d90-03b1-40f4-9859-55b8183edadf tempest-LiveMigrationNegativeTest-1640925737 tempest-LiveMigrationNegativeTest-1640925737-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:34.215271 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-65125d90-03b1-40f4-9859-55b8183edadf tempest-LiveMigrationNegativeTest-1640925737 tempest-LiveMigrationNegativeTest-1640925737-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:34.215824 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-65125d90-03b1-40f4-9859-55b8183edadf tempest-LiveMigrationNegativeTest-1640925737 tempest-LiveMigrationNegativeTest-1640925737-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:34.250062 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-65125d90-03b1-40f4-9859-55b8183edadf tempest-LiveMigrationNegativeTest-1640925737 tempest-LiveMigrationNegativeTest-1640925737-project-admin] Lazy-loading 'flavor' on Instance uuid 3ebfe0ed-3568-4b90-b834-fd3ad244dcac {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:09:34.399844 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-73337d53-6aa2-4c86-b1ab-ce330abe4184 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7da58ce23242bd947bbd7387b80b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6395bf8972949f8837289679b58d151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:34.408498 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-73337d53-6aa2-4c86-b1ab-ce330abe4184 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "GET /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7" status: 200 len: 1585 microversion: 2.1 time: 0.311528 Apr 16 21:09:34.409332 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 366/795] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:34 2022] GET /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7 => generated 1585 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:34.421752 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-441eca14-a3ae-47d5-9813-8ffb22fca446 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:34.421752 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-441eca14-a3ae-47d5-9813-8ffb22fca446 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] [instance: 7f267f97-0675-4567-970e-9b51514392cc] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:34.424190 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-441eca14-a3ae-47d5-9813-8ffb22fca446 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:34.424830 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-441eca14-a3ae-47d5-9813-8ffb22fca446 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:34.426007 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-441eca14-a3ae-47d5-9813-8ffb22fca446 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:34.427237 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-441eca14-a3ae-47d5-9813-8ffb22fca446 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:34.648911 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-441eca14-a3ae-47d5-9813-8ffb22fca446 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3256e24aea41618454e831a0c2a7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c60195eda214c42831714a690e64ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:34.662361 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-441eca14-a3ae-47d5-9813-8ffb22fca446 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] 10.222.0.20 "GET /compute/v2.1/servers/7f267f97-0675-4567-970e-9b51514392cc" status: 200 len: 1316 microversion: 2.1 time: 0.249911 Apr 16 21:09:34.664518 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 367/796] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:34 2022] GET /compute/v2.1/servers/7f267f97-0675-4567-970e-9b51514392cc => generated 1316 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:34.695027 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-470a6634-7a42-446c-a59d-a4a4f95759b1 req-670e2d9c-3ec1-4806-b1d3-c90ab46df33a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc3b9549-fb07-458b-84bf-3f1d36449e6e", "tag": "a34708cf-de0c-422b-ad52-0051f88b2bb4"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:34.704316 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-470a6634-7a42-446c-a59d-a4a4f95759b1 req-670e2d9c-3ec1-4806-b1d3-c90ab46df33a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:34.704901 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-470a6634-7a42-446c-a59d-a4a4f95759b1 req-670e2d9c-3ec1-4806-b1d3-c90ab46df33a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:34.721236 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-470a6634-7a42-446c-a59d-a4a4f95759b1 req-670e2d9c-3ec1-4806-b1d3-c90ab46df33a service nova] Creating event network-changed:a34708cf-de0c-422b-ad52-0051f88b2bb4 for instance bc3b9549-fb07-458b-84bf-3f1d36449e6e on nch2-master-1 Apr 16 21:09:34.727813 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-470a6634-7a42-446c-a59d-a4a4f95759b1 req-670e2d9c-3ec1-4806-b1d3-c90ab46df33a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058887 Apr 16 21:09:34.729046 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 368/797] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:09:34.734329 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a4fcacce-289c-4d44-a051-962b77909859 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:34.735236 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a4fcacce-289c-4d44-a051-962b77909859 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 728c68c3-5252-4e9a-b1d0-c3afdfc8ba35] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:34.764239 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a4fcacce-289c-4d44-a051-962b77909859 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:34.766638 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a4fcacce-289c-4d44-a051-962b77909859 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:34.767008 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a4fcacce-289c-4d44-a051-962b77909859 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:34.769450 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a4fcacce-289c-4d44-a051-962b77909859 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:34.866525 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-65125d90-03b1-40f4-9859-55b8183edadf tempest-LiveMigrationNegativeTest-1640925737 tempest-LiveMigrationNegativeTest-1640925737-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/3ebfe0ed-3568-4b90-b834-fd3ad244dcac/action" status: 202 len: 0 microversion: 2.1 time: 0.679893 Apr 16 21:09:34.867877 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 430/798] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:09:34 2022] POST /compute/v2.1/servers/3ebfe0ed-3568-4b90-b834-fd3ad244dcac/action => generated 0 bytes in 682 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:09:34.872986 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ab7d3369-38a0-4093-a355-6c38f2491cfd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:34.874763 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ab7d3369-38a0-4093-a355-6c38f2491cfd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: ffc4d9b2-dd4f-44dc-a189-354eff7a5573] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:34.881575 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ab7d3369-38a0-4093-a355-6c38f2491cfd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:34.882381 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ab7d3369-38a0-4093-a355-6c38f2491cfd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:34.886559 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a4fcacce-289c-4d44-a051-962b77909859 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:34.894891 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a4fcacce-289c-4d44-a051-962b77909859 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/728c68c3-5252-4e9a-b1d0-c3afdfc8ba35" status: 200 len: 1223 microversion: 2.1 time: 0.164534 Apr 16 21:09:34.895262 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ab7d3369-38a0-4093-a355-6c38f2491cfd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:34.896077 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ab7d3369-38a0-4093-a355-6c38f2491cfd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:34.901432 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 369/799] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:34 2022] GET /compute/v2.1/servers/728c68c3-5252-4e9a-b1d0-c3afdfc8ba35 => generated 1223 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:34.917643 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-82a774ac-5b3b-45d7-974b-1b31d8d937d0 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:34.918504 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-82a774ac-5b3b-45d7-974b-1b31d8d937d0 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: de422b8c-d5d0-4730-92c4-f30877d0cf2b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:34.924797 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-82a774ac-5b3b-45d7-974b-1b31d8d937d0 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:34.925567 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-82a774ac-5b3b-45d7-974b-1b31d8d937d0 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:34.927216 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-82a774ac-5b3b-45d7-974b-1b31d8d937d0 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:34.930909 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-82a774ac-5b3b-45d7-974b-1b31d8d937d0 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:35.204933 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-82a774ac-5b3b-45d7-974b-1b31d8d937d0 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:35.217377 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-82a774ac-5b3b-45d7-974b-1b31d8d937d0 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/de422b8c-d5d0-4730-92c4-f30877d0cf2b" status: 200 len: 1312 microversion: 2.1 time: 0.313855 Apr 16 21:09:35.218269 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 370/800] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:34 2022] GET /compute/v2.1/servers/de422b8c-d5d0-4730-92c4-f30877d0cf2b => generated 1312 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:35.231642 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a26aa5ac-6f41-4a6f-a33c-959413cc3111 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:35.232717 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a26aa5ac-6f41-4a6f-a33c-959413cc3111 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] [instance: 3ebfe0ed-3568-4b90-b834-fd3ad244dcac] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:35.254776 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a26aa5ac-6f41-4a6f-a33c-959413cc3111 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:35.255248 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a26aa5ac-6f41-4a6f-a33c-959413cc3111 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:35.257227 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a26aa5ac-6f41-4a6f-a33c-959413cc3111 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:35.257688 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a26aa5ac-6f41-4a6f-a33c-959413cc3111 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:35.263215 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ab7d3369-38a0-4093-a355-6c38f2491cfd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:35.276031 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ab7d3369-38a0-4093-a355-6c38f2491cfd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:35.278760 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ab7d3369-38a0-4093-a355-6c38f2491cfd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:35.280300 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ab7d3369-38a0-4093-a355-6c38f2491cfd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573" status: 200 len: 1568 microversion: 2.25 time: 0.411480 Apr 16 21:09:35.281724 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 431/801] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:09:34 2022] GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573 => generated 1568 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:09:35.288754 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-800ce5a0-feaa-4ff9-b41d-4919d452046d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:35.289826 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-800ce5a0-feaa-4ff9-b41d-4919d452046d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: bc3b9549-fb07-458b-84bf-3f1d36449e6e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:35.297485 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-800ce5a0-feaa-4ff9-b41d-4919d452046d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:35.303642 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-800ce5a0-feaa-4ff9-b41d-4919d452046d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:35.303642 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-800ce5a0-feaa-4ff9-b41d-4919d452046d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:35.303642 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-800ce5a0-feaa-4ff9-b41d-4919d452046d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:35.495163 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-800ce5a0-feaa-4ff9-b41d-4919d452046d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:35.506989 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-800ce5a0-feaa-4ff9-b41d-4919d452046d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e" status: 200 len: 1310 microversion: 2.1 time: 0.223053 Apr 16 21:09:35.509042 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 432/802] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:35 2022] GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e => generated 1310 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:35.540460 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a26aa5ac-6f41-4a6f-a33c-959413cc3111 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae06aafd64d46deacb8ae1791676d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1924a4ceffaf45d0bf2bd76ebb421bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:35.548335 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a26aa5ac-6f41-4a6f-a33c-959413cc3111 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebfe0ed-3568-4b90-b834-fd3ad244dcac" status: 200 len: 1475 microversion: 2.1 time: 0.328847 Apr 16 21:09:35.549028 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 371/803] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:35 2022] GET /compute/v2.1/servers/3ebfe0ed-3568-4b90-b834-fd3ad244dcac => generated 1475 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:35.680919 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-54d6882d-c9e9-43c6-bac9-af8c0090e443 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:35.681940 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-54d6882d-c9e9-43c6-bac9-af8c0090e443 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] [instance: 7f267f97-0675-4567-970e-9b51514392cc] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:35.688643 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-54d6882d-c9e9-43c6-bac9-af8c0090e443 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:35.689225 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-54d6882d-c9e9-43c6-bac9-af8c0090e443 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:35.690091 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-54d6882d-c9e9-43c6-bac9-af8c0090e443 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:35.690538 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-54d6882d-c9e9-43c6-bac9-af8c0090e443 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:35.913500 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-54d6882d-c9e9-43c6-bac9-af8c0090e443 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3256e24aea41618454e831a0c2a7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c60195eda214c42831714a690e64ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:35.918704 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2473c731-adfd-45a0-b876-c1f6fb996b25 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:35.919628 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2473c731-adfd-45a0-b876-c1f6fb996b25 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 728c68c3-5252-4e9a-b1d0-c3afdfc8ba35] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:35.921790 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-54d6882d-c9e9-43c6-bac9-af8c0090e443 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] 10.222.0.20 "GET /compute/v2.1/servers/7f267f97-0675-4567-970e-9b51514392cc" status: 200 len: 1465 microversion: 2.1 time: 0.244943 Apr 16 21:09:35.929348 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 433/804] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:35 2022] GET /compute/v2.1/servers/7f267f97-0675-4567-970e-9b51514392cc => generated 1465 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:35.936339 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2473c731-adfd-45a0-b876-c1f6fb996b25 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:35.936339 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2473c731-adfd-45a0-b876-c1f6fb996b25 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:35.944365 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2473c731-adfd-45a0-b876-c1f6fb996b25 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:35.946867 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2473c731-adfd-45a0-b876-c1f6fb996b25 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:35.947026 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5029cce3-237f-4975-a0c7-bc85a0fa052a tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:35.947526 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5029cce3-237f-4975-a0c7-bc85a0fa052a tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] [instance: 7f267f97-0675-4567-970e-9b51514392cc] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:35.961287 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5029cce3-237f-4975-a0c7-bc85a0fa052a tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:35.962909 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5029cce3-237f-4975-a0c7-bc85a0fa052a tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:35.963982 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5029cce3-237f-4975-a0c7-bc85a0fa052a tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:35.964454 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5029cce3-237f-4975-a0c7-bc85a0fa052a tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:35.992138 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5029cce3-237f-4975-a0c7-bc85a0fa052a tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] [instance: 7f267f97-0675-4567-970e-9b51514392cc] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:09:36.040468 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2473c731-adfd-45a0-b876-c1f6fb996b25 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:36.047695 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2473c731-adfd-45a0-b876-c1f6fb996b25 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/728c68c3-5252-4e9a-b1d0-c3afdfc8ba35" status: 200 len: 1271 microversion: 2.1 time: 0.133811 Apr 16 21:09:36.048283 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 372/805] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:35 2022] GET /compute/v2.1/servers/728c68c3-5252-4e9a-b1d0-c3afdfc8ba35 => generated 1271 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:36.240323 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-de874a31-6c5f-4daa-9523-545a940aedb8 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:36.240991 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-de874a31-6c5f-4daa-9523-545a940aedb8 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: de422b8c-d5d0-4730-92c4-f30877d0cf2b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:36.252010 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-de874a31-6c5f-4daa-9523-545a940aedb8 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:36.252578 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-de874a31-6c5f-4daa-9523-545a940aedb8 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:36.253804 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-de874a31-6c5f-4daa-9523-545a940aedb8 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:36.254789 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-de874a31-6c5f-4daa-9523-545a940aedb8 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:36.400503 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5029cce3-237f-4975-a0c7-bc85a0fa052a tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7f267f97-0675-4567-970e-9b51514392cc" status: 204 len: 0 microversion: 2.1 time: 0.457109 Apr 16 21:09:36.401223 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 434/806] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:09:35 2022] DELETE /compute/v2.1/servers/7f267f97-0675-4567-970e-9b51514392cc => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 16 21:09:36.408662 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e5909978-0776-4a6c-80df-244d552d565a tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:36.410769 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e5909978-0776-4a6c-80df-244d552d565a tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: ffc4d9b2-dd4f-44dc-a189-354eff7a5573] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:36.428542 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e5909978-0776-4a6c-80df-244d552d565a tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:36.429097 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e5909978-0776-4a6c-80df-244d552d565a tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:36.429994 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e5909978-0776-4a6c-80df-244d552d565a tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:36.431225 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e5909978-0776-4a6c-80df-244d552d565a tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:36.550415 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-de874a31-6c5f-4daa-9523-545a940aedb8 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:36.558461 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-de874a31-6c5f-4daa-9523-545a940aedb8 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/de422b8c-d5d0-4730-92c4-f30877d0cf2b" status: 200 len: 1312 microversion: 2.1 time: 0.326392 Apr 16 21:09:36.559234 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 373/807] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:36 2022] GET /compute/v2.1/servers/de422b8c-d5d0-4730-92c4-f30877d0cf2b => generated 1312 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:09:36.564559 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-84c804f0-0823-43fb-bbe2-edee41df7a56 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:36.565884 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-84c804f0-0823-43fb-bbe2-edee41df7a56 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] [instance: 7f267f97-0675-4567-970e-9b51514392cc] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:36.575726 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-84c804f0-0823-43fb-bbe2-edee41df7a56 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:36.575726 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-84c804f0-0823-43fb-bbe2-edee41df7a56 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:36.575726 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-84c804f0-0823-43fb-bbe2-edee41df7a56 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:36.575726 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-84c804f0-0823-43fb-bbe2-edee41df7a56 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:36.597675 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e5909978-0776-4a6c-80df-244d552d565a tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:36.613949 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e5909978-0776-4a6c-80df-244d552d565a tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:36.615465 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e5909978-0776-4a6c-80df-244d552d565a tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:36.616757 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e5909978-0776-4a6c-80df-244d552d565a tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573" status: 200 len: 1568 microversion: 2.25 time: 0.214143 Apr 16 21:09:36.617326 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 435/808] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:09:36 2022] GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573 => generated 1568 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:09:36.621807 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6c2bb4d1-d265-4539-9a3e-b8aae073d676 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:36.622412 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6c2bb4d1-d265-4539-9a3e-b8aae073d676 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: bc3b9549-fb07-458b-84bf-3f1d36449e6e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:36.628731 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6c2bb4d1-d265-4539-9a3e-b8aae073d676 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:36.629200 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6c2bb4d1-d265-4539-9a3e-b8aae073d676 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:36.630025 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6c2bb4d1-d265-4539-9a3e-b8aae073d676 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:36.630472 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6c2bb4d1-d265-4539-9a3e-b8aae073d676 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:36.713039 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-84c804f0-0823-43fb-bbe2-edee41df7a56 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3256e24aea41618454e831a0c2a7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c60195eda214c42831714a690e64ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:36.720863 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-84c804f0-0823-43fb-bbe2-edee41df7a56 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] 10.222.0.20 "GET /compute/v2.1/servers/7f267f97-0675-4567-970e-9b51514392cc" status: 200 len: 1471 microversion: 2.1 time: 0.160589 Apr 16 21:09:36.728712 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 374/809] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:36 2022] GET /compute/v2.1/servers/7f267f97-0675-4567-970e-9b51514392cc => generated 1471 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:36.728712 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5aa1531e-fa8b-42de-bc1a-be6692ab912c tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:36.728712 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5aa1531e-fa8b-42de-bc1a-be6692ab912c tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] [instance: 3ebfe0ed-3568-4b90-b834-fd3ad244dcac] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:36.732966 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5aa1531e-fa8b-42de-bc1a-be6692ab912c tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:36.733418 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5aa1531e-fa8b-42de-bc1a-be6692ab912c tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:36.734187 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5aa1531e-fa8b-42de-bc1a-be6692ab912c tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:36.734657 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5aa1531e-fa8b-42de-bc1a-be6692ab912c tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:36.773541 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6c2bb4d1-d265-4539-9a3e-b8aae073d676 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:36.781314 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6c2bb4d1-d265-4539-9a3e-b8aae073d676 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e" status: 200 len: 1310 microversion: 2.1 time: 0.162949 Apr 16 21:09:36.781897 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 436/810] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:36 2022] GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e => generated 1310 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:36.869717 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5aa1531e-fa8b-42de-bc1a-be6692ab912c tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae06aafd64d46deacb8ae1791676d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1924a4ceffaf45d0bf2bd76ebb421bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:36.877368 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5aa1531e-fa8b-42de-bc1a-be6692ab912c tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebfe0ed-3568-4b90-b834-fd3ad244dcac" status: 200 len: 1458 microversion: 2.1 time: 0.154882 Apr 16 21:09:36.877943 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 375/811] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:36 2022] GET /compute/v2.1/servers/3ebfe0ed-3568-4b90-b834-fd3ad244dcac => generated 1458 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:36.897845 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ca26a6a1-7df0-426a-9253-89a07dbfeea7 tempest-LiveMigrationNegativeTest-1640925737 tempest-LiveMigrationNegativeTest-1640925737-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:36.898558 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ca26a6a1-7df0-426a-9253-89a07dbfeea7 tempest-LiveMigrationNegativeTest-1640925737 tempest-LiveMigrationNegativeTest-1640925737-project-admin] [instance: 3ebfe0ed-3568-4b90-b834-fd3ad244dcac] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:36.904582 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ca26a6a1-7df0-426a-9253-89a07dbfeea7 tempest-LiveMigrationNegativeTest-1640925737 tempest-LiveMigrationNegativeTest-1640925737-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:36.905117 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ca26a6a1-7df0-426a-9253-89a07dbfeea7 tempest-LiveMigrationNegativeTest-1640925737 tempest-LiveMigrationNegativeTest-1640925737-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:36.905967 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ca26a6a1-7df0-426a-9253-89a07dbfeea7 tempest-LiveMigrationNegativeTest-1640925737 tempest-LiveMigrationNegativeTest-1640925737-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:36.906414 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ca26a6a1-7df0-426a-9253-89a07dbfeea7 tempest-LiveMigrationNegativeTest-1640925737 tempest-LiveMigrationNegativeTest-1640925737-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:37.065975 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-99b85dc8-5c1e-461d-83b0-9d2f5bdf5f82 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:37.067524 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-99b85dc8-5c1e-461d-83b0-9d2f5bdf5f82 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 728c68c3-5252-4e9a-b1d0-c3afdfc8ba35] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:37.074377 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-99b85dc8-5c1e-461d-83b0-9d2f5bdf5f82 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:37.075085 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-99b85dc8-5c1e-461d-83b0-9d2f5bdf5f82 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:37.076160 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-99b85dc8-5c1e-461d-83b0-9d2f5bdf5f82 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:37.076634 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-99b85dc8-5c1e-461d-83b0-9d2f5bdf5f82 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:37.158284 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-99b85dc8-5c1e-461d-83b0-9d2f5bdf5f82 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:37.178209 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-99b85dc8-5c1e-461d-83b0-9d2f5bdf5f82 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/728c68c3-5252-4e9a-b1d0-c3afdfc8ba35" status: 200 len: 1279 microversion: 2.1 time: 0.116073 Apr 16 21:09:37.189431 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 376/812] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:37 2022] GET /compute/v2.1/servers/728c68c3-5252-4e9a-b1d0-c3afdfc8ba35 => generated 1279 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:09:37.227980 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ca26a6a1-7df0-426a-9253-89a07dbfeea7 tempest-LiveMigrationNegativeTest-1640925737 tempest-LiveMigrationNegativeTest-1640925737-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/3ebfe0ed-3568-4b90-b834-fd3ad244dcac" status: 200 len: 1609 microversion: 2.1 time: 0.333805 Apr 16 21:09:37.229188 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 437/813] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:36 2022] GET /compute/v2.1/servers/3ebfe0ed-3568-4b90-b834-fd3ad244dcac => generated 1609 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:37.246981 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1618d889-c983-4952-b176-c9863a4adc1e tempest-LiveMigrationNegativeTest-1640925737 tempest-LiveMigrationNegativeTest-1640925737-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:37.246981 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:09:37.246981 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:09:37.247542 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1618d889-c983-4952-b176-c9863a4adc1e tempest-LiveMigrationNegativeTest-1640925737 tempest-LiveMigrationNegativeTest-1640925737-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:37.248014 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1618d889-c983-4952-b176-c9863a4adc1e tempest-LiveMigrationNegativeTest-1640925737 tempest-LiveMigrationNegativeTest-1640925737-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:37.248997 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1618d889-c983-4952-b176-c9863a4adc1e tempest-LiveMigrationNegativeTest-1640925737 tempest-LiveMigrationNegativeTest-1640925737-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:37.249277 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1618d889-c983-4952-b176-c9863a4adc1e tempest-LiveMigrationNegativeTest-1640925737 tempest-LiveMigrationNegativeTest-1640925737-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:37.274884 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1618d889-c983-4952-b176-c9863a4adc1e tempest-LiveMigrationNegativeTest-1640925737 tempest-LiveMigrationNegativeTest-1640925737-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.033632 Apr 16 21:09:37.275498 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 377/814] 10.222.0.20 () {58 vars in 1175 bytes} [Sat Apr 16 21:09:37 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:09:37.291621 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4dbc847a-54c7-43c2-a153-9c53f1a15c53 tempest-LiveMigrationNegativeTest-1640925737 tempest-LiveMigrationNegativeTest-1640925737-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:37.291621 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4dbc847a-54c7-43c2-a153-9c53f1a15c53 tempest-LiveMigrationNegativeTest-1640925737 tempest-LiveMigrationNegativeTest-1640925737-project-admin] [instance: 3ebfe0ed-3568-4b90-b834-fd3ad244dcac] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:37.297344 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4dbc847a-54c7-43c2-a153-9c53f1a15c53 tempest-LiveMigrationNegativeTest-1640925737 tempest-LiveMigrationNegativeTest-1640925737-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:37.298029 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4dbc847a-54c7-43c2-a153-9c53f1a15c53 tempest-LiveMigrationNegativeTest-1640925737 tempest-LiveMigrationNegativeTest-1640925737-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:37.299004 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4dbc847a-54c7-43c2-a153-9c53f1a15c53 tempest-LiveMigrationNegativeTest-1640925737 tempest-LiveMigrationNegativeTest-1640925737-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:37.299509 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4dbc847a-54c7-43c2-a153-9c53f1a15c53 tempest-LiveMigrationNegativeTest-1640925737 tempest-LiveMigrationNegativeTest-1640925737-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:37.326044 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-4dbc847a-54c7-43c2-a153-9c53f1a15c53 tempest-LiveMigrationNegativeTest-1640925737 tempest-LiveMigrationNegativeTest-1640925737-project-admin] Lazy-loading 'flavor' on Instance uuid 3ebfe0ed-3568-4b90-b834-fd3ad244dcac {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:09:37.346462 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-4dbc847a-54c7-43c2-a153-9c53f1a15c53 tempest-LiveMigrationNegativeTest-1640925737 tempest-LiveMigrationNegativeTest-1640925737-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance 3ebfe0ed-3568-4b90-b834-fd3ad244dcac while it is in vm_state suspended Apr 16 21:09:37.347110 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4dbc847a-54c7-43c2-a153-9c53f1a15c53 tempest-LiveMigrationNegativeTest-1640925737 tempest-LiveMigrationNegativeTest-1640925737-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance 3ebfe0ed-3568-4b90-b834-fd3ad244dcac while it is in vm_state suspended {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:09:37.348004 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4dbc847a-54c7-43c2-a153-9c53f1a15c53 tempest-LiveMigrationNegativeTest-1640925737 tempest-LiveMigrationNegativeTest-1640925737-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/3ebfe0ed-3568-4b90-b834-fd3ad244dcac/action" status: 409 len: 155 microversion: 2.1 time: 0.065810 Apr 16 21:09:37.349148 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 438/815] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:09:37 2022] POST /compute/v2.1/servers/3ebfe0ed-3568-4b90-b834-fd3ad244dcac/action => generated 155 bytes in 67 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:09:37.355536 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-073edafe-a80c-4c4a-8cbf-f6d18f484bbe req-5371be62-2825-48c1-9a34-33038d886018 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de422b8c-d5d0-4730-92c4-f30877d0cf2b", "name": "network-vif-plugged", "status": "completed", "tag": "aa28e0e4-5396-47b7-a21f-9f5effb36613"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:37.363559 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-073edafe-a80c-4c4a-8cbf-f6d18f484bbe req-5371be62-2825-48c1-9a34-33038d886018 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:37.364126 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-073edafe-a80c-4c4a-8cbf-f6d18f484bbe req-5371be62-2825-48c1-9a34-33038d886018 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:37.378690 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-073edafe-a80c-4c4a-8cbf-f6d18f484bbe req-5371be62-2825-48c1-9a34-33038d886018 service nova] Creating event network-vif-plugged:aa28e0e4-5396-47b7-a21f-9f5effb36613 for instance de422b8c-d5d0-4730-92c4-f30877d0cf2b on nch1-master-1 Apr 16 21:09:37.383973 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-073edafe-a80c-4c4a-8cbf-f6d18f484bbe req-5371be62-2825-48c1-9a34-33038d886018 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033465 Apr 16 21:09:37.384680 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 439/816] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:09:37.390114 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-403834c1-93e4-4302-9277-952e6f8f0332 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:37.390784 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-403834c1-93e4-4302-9277-952e6f8f0332 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] [instance: 3ebfe0ed-3568-4b90-b834-fd3ad244dcac] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:37.397694 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-403834c1-93e4-4302-9277-952e6f8f0332 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:37.398244 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-403834c1-93e4-4302-9277-952e6f8f0332 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:37.399145 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-403834c1-93e4-4302-9277-952e6f8f0332 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:37.399817 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-403834c1-93e4-4302-9277-952e6f8f0332 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:37.425321 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-403834c1-93e4-4302-9277-952e6f8f0332 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] [instance: 3ebfe0ed-3568-4b90-b834-fd3ad244dcac] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:09:37.471259 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7ed85873-1607-4a22-a954-028735dfdd2e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2014059963", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "a0b0bf8e-874a-496e-bcac-07806d7d7d7a"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:37.529350 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-7ed85873-1607-4a22-a954-028735dfdd2e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] validate_networks() for [('a0b0bf8e-874a-496e-bcac-07806d7d7d7a', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:09:37.824297 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-403834c1-93e4-4302-9277-952e6f8f0332 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3ebfe0ed-3568-4b90-b834-fd3ad244dcac" status: 204 len: 0 microversion: 2.1 time: 0.437602 Apr 16 21:09:37.825045 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 440/817] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:09:37 2022] DELETE /compute/v2.1/servers/3ebfe0ed-3568-4b90-b834-fd3ad244dcac => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:09:37.832141 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d75cfef4-bc2c-4152-9248-c84f59eb7d4d tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:37.833786 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d75cfef4-bc2c-4152-9248-c84f59eb7d4d tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: de422b8c-d5d0-4730-92c4-f30877d0cf2b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:37.850577 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d75cfef4-bc2c-4152-9248-c84f59eb7d4d tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:37.851536 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d75cfef4-bc2c-4152-9248-c84f59eb7d4d tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:37.853075 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d75cfef4-bc2c-4152-9248-c84f59eb7d4d tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:37.854695 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d75cfef4-bc2c-4152-9248-c84f59eb7d4d tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:38.030483 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d75cfef4-bc2c-4152-9248-c84f59eb7d4d tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:38.041212 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d75cfef4-bc2c-4152-9248-c84f59eb7d4d tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/de422b8c-d5d0-4730-92c4-f30877d0cf2b" status: 200 len: 1312 microversion: 2.1 time: 0.214953 Apr 16 21:09:38.047635 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 441/818] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:37 2022] GET /compute/v2.1/servers/de422b8c-d5d0-4730-92c4-f30877d0cf2b => generated 1312 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:38.059056 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b891bf49-beeb-4d74-8428-4da794a3ad70 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:38.060520 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b891bf49-beeb-4d74-8428-4da794a3ad70 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: ffc4d9b2-dd4f-44dc-a189-354eff7a5573] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:38.067523 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b891bf49-beeb-4d74-8428-4da794a3ad70 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:38.067986 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b891bf49-beeb-4d74-8428-4da794a3ad70 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:38.068837 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b891bf49-beeb-4d74-8428-4da794a3ad70 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:38.069428 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b891bf49-beeb-4d74-8428-4da794a3ad70 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:38.210875 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b891bf49-beeb-4d74-8428-4da794a3ad70 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:38.220068 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b891bf49-beeb-4d74-8428-4da794a3ad70 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:38.221829 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b891bf49-beeb-4d74-8428-4da794a3ad70 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:38.223061 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b891bf49-beeb-4d74-8428-4da794a3ad70 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573" status: 200 len: 1568 microversion: 2.25 time: 0.174482 Apr 16 21:09:38.223817 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 442/819] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:09:38 2022] GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573 => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:09:38.228773 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9efc5bee-5d00-4597-a3d2-d4db8c3539c0 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:38.229388 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9efc5bee-5d00-4597-a3d2-d4db8c3539c0 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] [instance: 7f267f97-0675-4567-970e-9b51514392cc] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:38.239198 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9efc5bee-5d00-4597-a3d2-d4db8c3539c0 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:38.239656 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9efc5bee-5d00-4597-a3d2-d4db8c3539c0 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:38.240478 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9efc5bee-5d00-4597-a3d2-d4db8c3539c0 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:38.240920 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9efc5bee-5d00-4597-a3d2-d4db8c3539c0 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:38.389597 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9efc5bee-5d00-4597-a3d2-d4db8c3539c0 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3256e24aea41618454e831a0c2a7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c60195eda214c42831714a690e64ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:38.402013 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9efc5bee-5d00-4597-a3d2-d4db8c3539c0 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] 10.222.0.20 "GET /compute/v2.1/servers/7f267f97-0675-4567-970e-9b51514392cc" status: 200 len: 1471 microversion: 2.1 time: 0.177318 Apr 16 21:09:38.402615 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 443/820] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:38 2022] GET /compute/v2.1/servers/7f267f97-0675-4567-970e-9b51514392cc => generated 1471 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:38.421479 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1fef896c-b0b2-46fe-aace-9e16fbe33d0d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:38.422231 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1fef896c-b0b2-46fe-aace-9e16fbe33d0d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: bc3b9549-fb07-458b-84bf-3f1d36449e6e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:38.430310 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1fef896c-b0b2-46fe-aace-9e16fbe33d0d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:38.430772 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1fef896c-b0b2-46fe-aace-9e16fbe33d0d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:38.431567 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1fef896c-b0b2-46fe-aace-9e16fbe33d0d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:38.432218 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1fef896c-b0b2-46fe-aace-9e16fbe33d0d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:38.604154 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1fef896c-b0b2-46fe-aace-9e16fbe33d0d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:38.614226 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1fef896c-b0b2-46fe-aace-9e16fbe33d0d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e" status: 200 len: 1310 microversion: 2.1 time: 0.209368 Apr 16 21:09:38.615863 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 444/821] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:38 2022] GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e => generated 1310 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:38.621344 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-be9e6bc4-2622-4853-a6b1-41068a08ad36 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:38.622126 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-be9e6bc4-2622-4853-a6b1-41068a08ad36 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] [instance: 3ebfe0ed-3568-4b90-b834-fd3ad244dcac] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:38.628151 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-7ed85873-1607-4a22-a954-028735dfdd2e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:09:38.628641 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-7ed85873-1607-4a22-a954-028735dfdd2e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:09:38.629894 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-7ed85873-1607-4a22-a954-028735dfdd2e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:09:38.630333 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-7ed85873-1607-4a22-a954-028735dfdd2e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:09:38.630512 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-be9e6bc4-2622-4853-a6b1-41068a08ad36 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:38.630762 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-7ed85873-1607-4a22-a954-028735dfdd2e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:09:38.631432 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-be9e6bc4-2622-4853-a6b1-41068a08ad36 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:38.632454 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-be9e6bc4-2622-4853-a6b1-41068a08ad36 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:38.633203 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-be9e6bc4-2622-4853-a6b1-41068a08ad36 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:38.643603 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7ed85873-1607-4a22-a954-028735dfdd2e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:38.644319 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7ed85873-1607-4a22-a954-028735dfdd2e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:38.645763 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7ed85873-1607-4a22-a954-028735dfdd2e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:38.648327 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7ed85873-1607-4a22-a954-028735dfdd2e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:38.676822 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-7ed85873-1607-4a22-a954-028735dfdd2e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Getting quotas for project 6d26c031a97c437dad0a3eae0fe2ab8c. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:38.693337 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-7ed85873-1607-4a22-a954-028735dfdd2e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Getting quotas for user 0dbf714013674b60b34b2d775a15e722 and project 6d26c031a97c437dad0a3eae0fe2ab8c. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:38.712681 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7ed85873-1607-4a22-a954-028735dfdd2e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:09:38.716229 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7ed85873-1607-4a22-a954-028735dfdd2e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 2b27c826-905d-4c1f-9daf-42150b1025a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:09:38.799670 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-be9e6bc4-2622-4853-a6b1-41068a08ad36 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae06aafd64d46deacb8ae1791676d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1924a4ceffaf45d0bf2bd76ebb421bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:38.808743 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-be9e6bc4-2622-4853-a6b1-41068a08ad36 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebfe0ed-3568-4b90-b834-fd3ad244dcac" status: 200 len: 1464 microversion: 2.1 time: 0.191352 Apr 16 21:09:38.809415 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 445/822] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:38 2022] GET /compute/v2.1/servers/3ebfe0ed-3568-4b90-b834-fd3ad244dcac => generated 1464 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:38.813859 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ac705978-cce4-41fa-a3e0-0fcd074430a5 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:38.814632 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ac705978-cce4-41fa-a3e0-0fcd074430a5 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 728c68c3-5252-4e9a-b1d0-c3afdfc8ba35] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:38.824257 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ac705978-cce4-41fa-a3e0-0fcd074430a5 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:38.825363 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ac705978-cce4-41fa-a3e0-0fcd074430a5 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:38.826047 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ac705978-cce4-41fa-a3e0-0fcd074430a5 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:38.826047 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ac705978-cce4-41fa-a3e0-0fcd074430a5 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:38.882387 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7ed85873-1607-4a22-a954-028735dfdd2e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.548083 Apr 16 21:09:38.883034 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 378/823] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:09:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 16 21:09:38.934497 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ac705978-cce4-41fa-a3e0-0fcd074430a5 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:38.949406 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8e41e007-6ccb-4d04-96a7-5018477c8795 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-255153475", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "a0b0bf8e-874a-496e-bcac-07806d7d7d7a"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:38.965451 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ac705978-cce4-41fa-a3e0-0fcd074430a5 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/728c68c3-5252-4e9a-b1d0-c3afdfc8ba35" status: 200 len: 1289 microversion: 2.1 time: 0.155058 Apr 16 21:09:38.970439 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 446/824] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:38 2022] GET /compute/v2.1/servers/728c68c3-5252-4e9a-b1d0-c3afdfc8ba35 => generated 1289 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:39.039485 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-8e41e007-6ccb-4d04-96a7-5018477c8795 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] validate_networks() for [('a0b0bf8e-874a-496e-bcac-07806d7d7d7a', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:09:39.060244 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9957f420-3feb-48e7-8295-f0ef4e29843e tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:39.061115 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9957f420-3feb-48e7-8295-f0ef4e29843e tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: de422b8c-d5d0-4730-92c4-f30877d0cf2b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:39.068694 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9957f420-3feb-48e7-8295-f0ef4e29843e tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:39.069312 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9957f420-3feb-48e7-8295-f0ef4e29843e tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:39.070340 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9957f420-3feb-48e7-8295-f0ef4e29843e tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:39.070784 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9957f420-3feb-48e7-8295-f0ef4e29843e tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:39.284310 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9957f420-3feb-48e7-8295-f0ef4e29843e tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:39.295387 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9957f420-3feb-48e7-8295-f0ef4e29843e tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/de422b8c-d5d0-4730-92c4-f30877d0cf2b" status: 200 len: 1312 microversion: 2.1 time: 0.240317 Apr 16 21:09:39.306129 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 447/825] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:39 2022] GET /compute/v2.1/servers/de422b8c-d5d0-4730-92c4-f30877d0cf2b => generated 1312 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:09:39.312516 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-dba0bbc3-04e2-430a-8d40-e6368d614127 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:39.319651 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-dba0bbc3-04e2-430a-8d40-e6368d614127 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: ffc4d9b2-dd4f-44dc-a189-354eff7a5573] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:39.326377 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dba0bbc3-04e2-430a-8d40-e6368d614127 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:39.326851 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dba0bbc3-04e2-430a-8d40-e6368d614127 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:39.327831 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dba0bbc3-04e2-430a-8d40-e6368d614127 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:39.328318 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dba0bbc3-04e2-430a-8d40-e6368d614127 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:39.733558 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-dba0bbc3-04e2-430a-8d40-e6368d614127 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:39.767461 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-dba0bbc3-04e2-430a-8d40-e6368d614127 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:39.773890 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-dba0bbc3-04e2-430a-8d40-e6368d614127 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:39.779877 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-dba0bbc3-04e2-430a-8d40-e6368d614127 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573" status: 200 len: 1568 microversion: 2.25 time: 0.467339 Apr 16 21:09:39.788977 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 448/826] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:09:39 2022] GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573 => generated 1568 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:09:39.802087 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-417f8579-b213-4a4a-a838-b583dff96adb tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:39.803108 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-417f8579-b213-4a4a-a838-b583dff96adb tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] [instance: 7f267f97-0675-4567-970e-9b51514392cc] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:39.810954 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-417f8579-b213-4a4a-a838-b583dff96adb tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:39.811976 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-417f8579-b213-4a4a-a838-b583dff96adb tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:39.814957 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-417f8579-b213-4a4a-a838-b583dff96adb tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:39.815615 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-417f8579-b213-4a4a-a838-b583dff96adb tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:40.392896 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-8e41e007-6ccb-4d04-96a7-5018477c8795 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:09:40.393990 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-8e41e007-6ccb-4d04-96a7-5018477c8795 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:09:40.394681 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-8e41e007-6ccb-4d04-96a7-5018477c8795 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:09:40.395839 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-8e41e007-6ccb-4d04-96a7-5018477c8795 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:09:40.397194 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-8e41e007-6ccb-4d04-96a7-5018477c8795 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:09:40.406495 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8e41e007-6ccb-4d04-96a7-5018477c8795 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:40.407214 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8e41e007-6ccb-4d04-96a7-5018477c8795 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:40.408402 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8e41e007-6ccb-4d04-96a7-5018477c8795 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:40.410077 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8e41e007-6ccb-4d04-96a7-5018477c8795 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:40.438243 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-8e41e007-6ccb-4d04-96a7-5018477c8795 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Getting quotas for project 6d26c031a97c437dad0a3eae0fe2ab8c. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:40.469521 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-8e41e007-6ccb-4d04-96a7-5018477c8795 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Getting quotas for user 0dbf714013674b60b34b2d775a15e722 and project 6d26c031a97c437dad0a3eae0fe2ab8c. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:40.469521 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8e41e007-6ccb-4d04-96a7-5018477c8795 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:09:40.470808 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8e41e007-6ccb-4d04-96a7-5018477c8795 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 615ea5db-3cca-4736-b69a-cc7bdc8f0e6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:09:40.543306 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-417f8579-b213-4a4a-a838-b583dff96adb tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3256e24aea41618454e831a0c2a7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c60195eda214c42831714a690e64ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:40.551423 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-417f8579-b213-4a4a-a838-b583dff96adb tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] 10.222.0.20 "GET /compute/v2.1/servers/7f267f97-0675-4567-970e-9b51514392cc" status: 200 len: 1471 microversion: 2.1 time: 0.761016 Apr 16 21:09:40.552345 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 449/827] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:39 2022] GET /compute/v2.1/servers/7f267f97-0675-4567-970e-9b51514392cc => generated 1471 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:40.563989 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-840a50a9-d40c-4b9b-b5ee-68d5ce7ee529 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:40.564791 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-840a50a9-d40c-4b9b-b5ee-68d5ce7ee529 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: bc3b9549-fb07-458b-84bf-3f1d36449e6e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:40.570959 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-840a50a9-d40c-4b9b-b5ee-68d5ce7ee529 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:40.571761 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-840a50a9-d40c-4b9b-b5ee-68d5ce7ee529 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:40.572707 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-840a50a9-d40c-4b9b-b5ee-68d5ce7ee529 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:40.573263 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-840a50a9-d40c-4b9b-b5ee-68d5ce7ee529 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:40.873163 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-840a50a9-d40c-4b9b-b5ee-68d5ce7ee529 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:40.899524 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-840a50a9-d40c-4b9b-b5ee-68d5ce7ee529 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e" status: 200 len: 1310 microversion: 2.1 time: 0.335708 Apr 16 21:09:40.900681 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 450/828] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:40 2022] GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e => generated 1310 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:40.913236 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d5b98746-70a8-48dc-aa31-9efa50e93217 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:40.915571 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8e41e007-6ccb-4d04-96a7-5018477c8795 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.971962 Apr 16 21:09:40.916749 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 379/829] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:09:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1974 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 16 21:09:40.921712 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-96fe3eb2-b4bc-40d7-8240-1b68a22f6886 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:40.922599 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d5b98746-70a8-48dc-aa31-9efa50e93217 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] [instance: 3ebfe0ed-3568-4b90-b834-fd3ad244dcac] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:40.963263 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-96fe3eb2-b4bc-40d7-8240-1b68a22f6886 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 728c68c3-5252-4e9a-b1d0-c3afdfc8ba35] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:40.966811 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d5b98746-70a8-48dc-aa31-9efa50e93217 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:40.967860 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d5b98746-70a8-48dc-aa31-9efa50e93217 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:40.973932 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d5b98746-70a8-48dc-aa31-9efa50e93217 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:40.975070 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d5b98746-70a8-48dc-aa31-9efa50e93217 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:40.980476 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-96fe3eb2-b4bc-40d7-8240-1b68a22f6886 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:40.983545 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-96fe3eb2-b4bc-40d7-8240-1b68a22f6886 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:40.984466 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-96fe3eb2-b4bc-40d7-8240-1b68a22f6886 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:40.985511 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-96fe3eb2-b4bc-40d7-8240-1b68a22f6886 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:41.161632 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d5b98746-70a8-48dc-aa31-9efa50e93217 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae06aafd64d46deacb8ae1791676d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1924a4ceffaf45d0bf2bd76ebb421bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:41.175951 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d5b98746-70a8-48dc-aa31-9efa50e93217 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebfe0ed-3568-4b90-b834-fd3ad244dcac" status: 200 len: 1422 microversion: 2.1 time: 0.264103 Apr 16 21:09:41.185524 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 451/830] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:40 2022] GET /compute/v2.1/servers/3ebfe0ed-3568-4b90-b834-fd3ad244dcac => generated 1422 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:41.200917 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4fb960d8-d82b-4a68-8718-b40eca4c6cef tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:41.203862 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4fb960d8-d82b-4a68-8718-b40eca4c6cef tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: de422b8c-d5d0-4730-92c4-f30877d0cf2b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:41.235787 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4fb960d8-d82b-4a68-8718-b40eca4c6cef tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:41.236623 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4fb960d8-d82b-4a68-8718-b40eca4c6cef tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:41.237726 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4fb960d8-d82b-4a68-8718-b40eca4c6cef tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:41.238379 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4fb960d8-d82b-4a68-8718-b40eca4c6cef tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:41.506190 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4fb960d8-d82b-4a68-8718-b40eca4c6cef tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:41.516705 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4fb960d8-d82b-4a68-8718-b40eca4c6cef tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/de422b8c-d5d0-4730-92c4-f30877d0cf2b" status: 200 len: 1312 microversion: 2.1 time: 0.329705 Apr 16 21:09:41.528411 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 452/831] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:41 2022] GET /compute/v2.1/servers/de422b8c-d5d0-4730-92c4-f30877d0cf2b => generated 1312 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:41.535075 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e5ad963d-b15b-4117-b09c-94f8dfa74a27 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:41.536479 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e5ad963d-b15b-4117-b09c-94f8dfa74a27 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: ffc4d9b2-dd4f-44dc-a189-354eff7a5573] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:41.584129 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e5ad963d-b15b-4117-b09c-94f8dfa74a27 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:41.584751 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e5ad963d-b15b-4117-b09c-94f8dfa74a27 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:41.587446 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e5ad963d-b15b-4117-b09c-94f8dfa74a27 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:41.587914 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e5ad963d-b15b-4117-b09c-94f8dfa74a27 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:41.897105 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e5ad963d-b15b-4117-b09c-94f8dfa74a27 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:41.906102 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e5ad963d-b15b-4117-b09c-94f8dfa74a27 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:41.909076 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e5ad963d-b15b-4117-b09c-94f8dfa74a27 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:41.918519 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-96fe3eb2-b4bc-40d7-8240-1b68a22f6886 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:41.921381 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e5ad963d-b15b-4117-b09c-94f8dfa74a27 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573" status: 200 len: 1543 microversion: 2.25 time: 0.380591 Apr 16 21:09:41.924554 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 453/832] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:09:41 2022] GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573 => generated 1543 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:09:41.932820 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6352e1ed-c812-456d-af0e-707a12369cdc tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-28394932", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "451", "networks": [{"uuid": "a0b0bf8e-874a-496e-bcac-07806d7d7d7a"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:41.935601 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-96fe3eb2-b4bc-40d7-8240-1b68a22f6886 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/728c68c3-5252-4e9a-b1d0-c3afdfc8ba35" status: 200 len: 1319 microversion: 2.1 time: 1.010623 Apr 16 21:09:41.936250 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 380/833] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:40 2022] GET /compute/v2.1/servers/728c68c3-5252-4e9a-b1d0-c3afdfc8ba35 => generated 1319 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:41.943540 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-1b58ee1b-d40e-4d4f-9886-b107fb94c5a3 req-0e312886-f811-4691-8041-5bbd9a355094 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ebfe0ed-3568-4b90-b834-fd3ad244dcac", "name": "network-vif-deleted", "tag": "866329ca-a3b9-4787-9b58-31964260c59e"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:41.974421 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-1b58ee1b-d40e-4d4f-9886-b107fb94c5a3 req-0e312886-f811-4691-8041-5bbd9a355094 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:41.974930 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-1b58ee1b-d40e-4d4f-9886-b107fb94c5a3 req-0e312886-f811-4691-8041-5bbd9a355094 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:41.998864 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-1b58ee1b-d40e-4d4f-9886-b107fb94c5a3 req-0e312886-f811-4691-8041-5bbd9a355094 service nova] Creating event network-vif-deleted:866329ca-a3b9-4787-9b58-31964260c59e for instance 3ebfe0ed-3568-4b90-b834-fd3ad244dcac on nch1-master-1 Apr 16 21:09:42.010198 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-1b58ee1b-d40e-4d4f-9886-b107fb94c5a3 req-0e312886-f811-4691-8041-5bbd9a355094 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072570 Apr 16 21:09:42.011559 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-6352e1ed-c812-456d-af0e-707a12369cdc tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] validate_networks() for [('a0b0bf8e-874a-496e-bcac-07806d7d7d7a', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:09:42.015367 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 381/834] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:09:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:09:42.024083 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a2836b99-041f-4288-8119-4d6faa28c7dc tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:42.025949 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a2836b99-041f-4288-8119-4d6faa28c7dc tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] [instance: 7f267f97-0675-4567-970e-9b51514392cc] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:42.034002 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a2836b99-041f-4288-8119-4d6faa28c7dc tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:42.034899 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a2836b99-041f-4288-8119-4d6faa28c7dc tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:42.036438 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a2836b99-041f-4288-8119-4d6faa28c7dc tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:42.037407 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a2836b99-041f-4288-8119-4d6faa28c7dc tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:42.095497 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a2836b99-041f-4288-8119-4d6faa28c7dc tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:42.096967 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a2836b99-041f-4288-8119-4d6faa28c7dc tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:42.098753 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-a2836b99-041f-4288-8119-4d6faa28c7dc tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lazy-loading 'fault' on Instance uuid 7f267f97-0675-4567-970e-9b51514392cc {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:09:42.168016 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a2836b99-041f-4288-8119-4d6faa28c7dc tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c3256e24aea41618454e831a0c2a7b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c60195eda214c42831714a690e64ed7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:42.175784 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a2836b99-041f-4288-8119-4d6faa28c7dc tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] 10.222.0.20 "GET /compute/v2.1/servers/7f267f97-0675-4567-970e-9b51514392cc" status: 200 len: 1306 microversion: 2.1 time: 0.159220 Apr 16 21:09:42.176915 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 382/835] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:42 2022] GET /compute/v2.1/servers/7f267f97-0675-4567-970e-9b51514392cc => generated 1306 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:42.181937 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b23aa956-038f-4e99-b864-4a5fbbe187e1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:42.182734 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b23aa956-038f-4e99-b864-4a5fbbe187e1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: bc3b9549-fb07-458b-84bf-3f1d36449e6e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:42.193357 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b23aa956-038f-4e99-b864-4a5fbbe187e1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:42.193834 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b23aa956-038f-4e99-b864-4a5fbbe187e1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:42.194598 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b23aa956-038f-4e99-b864-4a5fbbe187e1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:42.195064 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b23aa956-038f-4e99-b864-4a5fbbe187e1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:42.361748 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b23aa956-038f-4e99-b864-4a5fbbe187e1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:42.370233 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b23aa956-038f-4e99-b864-4a5fbbe187e1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e" status: 200 len: 1310 microversion: 2.1 time: 0.191957 Apr 16 21:09:42.374746 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 383/836] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:42 2022] GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e => generated 1310 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:42.383852 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-63c7935c-1842-47b4-9155-e080a34323d4 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Calling method '.version_select at 0x7fbb96b47ee0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:42.388763 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-63c7935c-1842-47b4-9155-e080a34323d4 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:42.389495 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-63c7935c-1842-47b4-9155-e080a34323d4 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:42.399835 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-63c7935c-1842-47b4-9155-e080a34323d4 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 1520 microversion: 2.25 time: 0.027691 Apr 16 21:09:42.404380 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 384/837] 10.222.0.20 () {60 vars in 1183 bytes} [Sat Apr 16 21:09:42 2022] GET /compute/v2.1/os-migrations => generated 1520 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:09:42.405791 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-a9b91777-ca1e-4c69-99a2-7f5271d71300 req-b279db44-90d6-49f8-bf64-14e0a57d70b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc3b9549-fb07-458b-84bf-3f1d36449e6e", "name": "network-vif-plugged", "status": "completed", "tag": "a34708cf-de0c-422b-ad52-0051f88b2bb4"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:42.414705 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-a9b91777-ca1e-4c69-99a2-7f5271d71300 req-b279db44-90d6-49f8-bf64-14e0a57d70b1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:42.415336 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-a9b91777-ca1e-4c69-99a2-7f5271d71300 req-b279db44-90d6-49f8-bf64-14e0a57d70b1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:42.428337 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-a9b91777-ca1e-4c69-99a2-7f5271d71300 req-b279db44-90d6-49f8-bf64-14e0a57d70b1 service nova] Creating event network-vif-plugged:a34708cf-de0c-422b-ad52-0051f88b2bb4 for instance bc3b9549-fb07-458b-84bf-3f1d36449e6e on nch2-master-1 Apr 16 21:09:42.433501 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-a9b91777-ca1e-4c69-99a2-7f5271d71300 req-b279db44-90d6-49f8-bf64-14e0a57d70b1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031430 Apr 16 21:09:42.434152 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 385/838] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:09:42.441888 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3072629d-4655-4707-8c13-26a999fa23a3 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:42.443223 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3072629d-4655-4707-8c13-26a999fa23a3 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] [instance: 3ebfe0ed-3568-4b90-b834-fd3ad244dcac] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:42.449525 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3072629d-4655-4707-8c13-26a999fa23a3 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:42.450020 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3072629d-4655-4707-8c13-26a999fa23a3 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:42.450799 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3072629d-4655-4707-8c13-26a999fa23a3 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:42.451242 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3072629d-4655-4707-8c13-26a999fa23a3 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:42.463933 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-6352e1ed-c812-456d-af0e-707a12369cdc tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:09:42.464838 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-6352e1ed-c812-456d-af0e-707a12369cdc tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:09:42.465464 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-6352e1ed-c812-456d-af0e-707a12369cdc tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:09:42.466917 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-6352e1ed-c812-456d-af0e-707a12369cdc tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:09:42.469707 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-6352e1ed-c812-456d-af0e-707a12369cdc tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:09:42.485250 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6352e1ed-c812-456d-af0e-707a12369cdc tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:42.486095 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6352e1ed-c812-456d-af0e-707a12369cdc tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:42.487896 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6352e1ed-c812-456d-af0e-707a12369cdc tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:42.489275 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6352e1ed-c812-456d-af0e-707a12369cdc tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:42.518820 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-6352e1ed-c812-456d-af0e-707a12369cdc tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Getting quotas for project 6d26c031a97c437dad0a3eae0fe2ab8c. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:42.521795 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-6352e1ed-c812-456d-af0e-707a12369cdc tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Getting quotas for user 0dbf714013674b60b34b2d775a15e722 and project 6d26c031a97c437dad0a3eae0fe2ab8c. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:42.542813 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6352e1ed-c812-456d-af0e-707a12369cdc tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:09:42.549205 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6352e1ed-c812-456d-af0e-707a12369cdc tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 524e8c67-957c-4856-a882-fc0a4befaedd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:09:42.549341 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3072629d-4655-4707-8c13-26a999fa23a3 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:42.556525 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3072629d-4655-4707-8c13-26a999fa23a3 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:42.556525 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-3072629d-4655-4707-8c13-26a999fa23a3 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lazy-loading 'fault' on Instance uuid 3ebfe0ed-3568-4b90-b834-fd3ad244dcac {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:09:42.737633 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6352e1ed-c812-456d-af0e-707a12369cdc tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.811308 Apr 16 21:09:42.741120 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 454/839] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:09:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:09:42.749662 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c14a4692-6946-4245-8222-a2a102737265 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:42.751503 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c14a4692-6946-4245-8222-a2a102737265 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] [instance: ffc4d9b2-dd4f-44dc-a189-354eff7a5573] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:42.769273 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c14a4692-6946-4245-8222-a2a102737265 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:42.772802 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c14a4692-6946-4245-8222-a2a102737265 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:42.776795 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3072629d-4655-4707-8c13-26a999fa23a3 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae06aafd64d46deacb8ae1791676d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1924a4ceffaf45d0bf2bd76ebb421bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:42.778704 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c14a4692-6946-4245-8222-a2a102737265 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:42.779476 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c14a4692-6946-4245-8222-a2a102737265 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:42.786383 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3072629d-4655-4707-8c13-26a999fa23a3 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebfe0ed-3568-4b90-b834-fd3ad244dcac" status: 200 len: 1308 microversion: 2.1 time: 0.347799 Apr 16 21:09:42.790340 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 386/840] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:42 2022] GET /compute/v2.1/servers/3ebfe0ed-3568-4b90-b834-fd3ad244dcac => generated 1308 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:42.800778 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-959d3546-594d-4f91-be85-07825e149a58 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:42.802620 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-959d3546-594d-4f91-be85-07825e149a58 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: de422b8c-d5d0-4730-92c4-f30877d0cf2b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:42.818786 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-959d3546-594d-4f91-be85-07825e149a58 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:42.820165 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-959d3546-594d-4f91-be85-07825e149a58 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:42.823576 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-959d3546-594d-4f91-be85-07825e149a58 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:42.825335 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-959d3546-594d-4f91-be85-07825e149a58 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:42.961918 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-c14a4692-6946-4245-8222-a2a102737265 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lazy-loading 'services' on Instance uuid ffc4d9b2-dd4f-44dc-a189-354eff7a5573 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:09:42.977602 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c14a4692-6946-4245-8222-a2a102737265 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573" status: 200 len: 2035 microversion: 2.25 time: 0.235091 Apr 16 21:09:42.985818 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 455/841] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:09:42 2022] GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573 => generated 2035 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:09:42.985818 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ed2c444b-41ac-4c1f-875c-2ad395385fc2 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:42.985818 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ed2c444b-41ac-4c1f-875c-2ad395385fc2 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 524e8c67-957c-4856-a882-fc0a4befaedd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:43.046528 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ed2c444b-41ac-4c1f-875c-2ad395385fc2 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:43.055600 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ed2c444b-41ac-4c1f-875c-2ad395385fc2 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/524e8c67-957c-4856-a882-fc0a4befaedd" status: 200 len: 1219 microversion: 2.1 time: 0.075846 Apr 16 21:09:43.056265 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 456/842] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:42 2022] GET /compute/v2.1/servers/524e8c67-957c-4856-a882-fc0a4befaedd => generated 1219 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:43.067495 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1d2da02d-d97e-444a-bb3a-c57abbf30cb4 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:43.068132 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1d2da02d-d97e-444a-bb3a-c57abbf30cb4 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 728c68c3-5252-4e9a-b1d0-c3afdfc8ba35] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:43.076128 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1d2da02d-d97e-444a-bb3a-c57abbf30cb4 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:43.076128 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1d2da02d-d97e-444a-bb3a-c57abbf30cb4 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:43.076619 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1d2da02d-d97e-444a-bb3a-c57abbf30cb4 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:43.077073 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1d2da02d-d97e-444a-bb3a-c57abbf30cb4 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:43.322254 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1d2da02d-d97e-444a-bb3a-c57abbf30cb4 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:43.339436 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1d2da02d-d97e-444a-bb3a-c57abbf30cb4 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/728c68c3-5252-4e9a-b1d0-c3afdfc8ba35" status: 200 len: 1319 microversion: 2.1 time: 0.274299 Apr 16 21:09:43.341337 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 457/843] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:43 2022] GET /compute/v2.1/servers/728c68c3-5252-4e9a-b1d0-c3afdfc8ba35 => generated 1319 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:43.364421 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5b61d2b9-84ce-4b4d-9f03-15d308fb348e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1761831308", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "341a7a54-447f-4bb3-9bb9-2193e32a0929"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:43.427782 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-5b61d2b9-84ce-4b4d-9f03-15d308fb348e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] validate_networks() for [('341a7a54-447f-4bb3-9bb9-2193e32a0929', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:09:43.477233 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-959d3546-594d-4f91-be85-07825e149a58 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:43.516257 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-959d3546-594d-4f91-be85-07825e149a58 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/de422b8c-d5d0-4730-92c4-f30877d0cf2b" status: 200 len: 1462 microversion: 2.1 time: 0.695224 Apr 16 21:09:43.518583 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 387/844] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:42 2022] GET /compute/v2.1/servers/de422b8c-d5d0-4730-92c4-f30877d0cf2b => generated 1462 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:43.538013 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0752f8bf-fd86-41a3-a518-c5de8cea5dd2 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:43.538013 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0752f8bf-fd86-41a3-a518-c5de8cea5dd2 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] [instance: 7f267f97-0675-4567-970e-9b51514392cc] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:43.544726 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0752f8bf-fd86-41a3-a518-c5de8cea5dd2 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:43.545193 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0752f8bf-fd86-41a3-a518-c5de8cea5dd2 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:43.545987 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0752f8bf-fd86-41a3-a518-c5de8cea5dd2 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:43.546605 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0752f8bf-fd86-41a3-a518-c5de8cea5dd2 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:43.562168 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-0752f8bf-fd86-41a3-a518-c5de8cea5dd2 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] HTTP exception thrown: Instance 7f267f97-0675-4567-970e-9b51514392cc could not be found. Apr 16 21:09:43.563213 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0752f8bf-fd86-41a3-a518-c5de8cea5dd2 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Returning 404 to user: Instance 7f267f97-0675-4567-970e-9b51514392cc could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:09:43.564127 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0752f8bf-fd86-41a3-a518-c5de8cea5dd2 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] 10.222.0.20 "GET /compute/v2.1/servers/7f267f97-0675-4567-970e-9b51514392cc" status: 404 len: 111 microversion: 2.1 time: 0.043277 Apr 16 21:09:43.569977 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 388/845] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:43 2022] GET /compute/v2.1/servers/7f267f97-0675-4567-970e-9b51514392cc => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:09:43.570314 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ba847299-a878-4d53-a1fb-efece552a8c3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:43.570934 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ba847299-a878-4d53-a1fb-efece552a8c3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: bc3b9549-fb07-458b-84bf-3f1d36449e6e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:43.577267 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ba847299-a878-4d53-a1fb-efece552a8c3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:43.577722 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ba847299-a878-4d53-a1fb-efece552a8c3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:43.578519 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ba847299-a878-4d53-a1fb-efece552a8c3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:43.578969 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ba847299-a878-4d53-a1fb-efece552a8c3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:43.922891 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-5b61d2b9-84ce-4b4d-9f03-15d308fb348e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:09:43.923419 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-5b61d2b9-84ce-4b4d-9f03-15d308fb348e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:09:43.923805 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-5b61d2b9-84ce-4b4d-9f03-15d308fb348e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:09:43.924274 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-5b61d2b9-84ce-4b4d-9f03-15d308fb348e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:09:43.927508 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-5b61d2b9-84ce-4b4d-9f03-15d308fb348e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:09:43.948589 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5b61d2b9-84ce-4b4d-9f03-15d308fb348e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:43.949989 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5b61d2b9-84ce-4b4d-9f03-15d308fb348e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:43.951305 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5b61d2b9-84ce-4b4d-9f03-15d308fb348e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:43.954460 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5b61d2b9-84ce-4b4d-9f03-15d308fb348e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:43.979479 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-5b61d2b9-84ce-4b4d-9f03-15d308fb348e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Getting quotas for project 68af3300a0d149adbbf934b4ff1f87d8. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:43.985386 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-5b61d2b9-84ce-4b4d-9f03-15d308fb348e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Getting quotas for user 53d5464685cc40d9a1d891c6ae39a80f and project 68af3300a0d149adbbf934b4ff1f87d8. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:43.998715 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5b61d2b9-84ce-4b4d-9f03-15d308fb348e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:09:44.000906 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5b61d2b9-84ce-4b4d-9f03-15d308fb348e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:09:44.120849 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ba847299-a878-4d53-a1fb-efece552a8c3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:44.128589 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ba847299-a878-4d53-a1fb-efece552a8c3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e" status: 200 len: 1310 microversion: 2.1 time: 0.562623 Apr 16 21:09:44.140032 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 389/846] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:43 2022] GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e => generated 1310 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:44.198068 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5b61d2b9-84ce-4b4d-9f03-15d308fb348e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.854811 Apr 16 21:09:44.199433 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 458/847] 10.222.0.20 () {62 vars in 1187 bytes} [Sat Apr 16 21:09:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 857 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 16 21:09:44.206242 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6dbb6331-7e34-41b1-b5c1-b08fff8190f2 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-785572809", "metadata": {"image_type": "test"}}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:44.208406 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6dbb6331-7e34-41b1-b5c1-b08fff8190f2 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] [instance: 7f267f97-0675-4567-970e-9b51514392cc] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:44.220239 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6dbb6331-7e34-41b1-b5c1-b08fff8190f2 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:44.221032 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6dbb6331-7e34-41b1-b5c1-b08fff8190f2 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:44.222900 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6dbb6331-7e34-41b1-b5c1-b08fff8190f2 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:44.224999 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6dbb6331-7e34-41b1-b5c1-b08fff8190f2 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:44.250351 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-6dbb6331-7e34-41b1-b5c1-b08fff8190f2 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] HTTP exception thrown: Instance 7f267f97-0675-4567-970e-9b51514392cc could not be found. Apr 16 21:09:44.251091 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6dbb6331-7e34-41b1-b5c1-b08fff8190f2 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Returning 404 to user: Instance 7f267f97-0675-4567-970e-9b51514392cc could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:09:44.252296 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6dbb6331-7e34-41b1-b5c1-b08fff8190f2 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] 10.222.0.20 "POST /compute/v2.1/servers/7f267f97-0675-4567-970e-9b51514392cc/action" status: 404 len: 111 microversion: 2.1 time: 0.051302 Apr 16 21:09:44.253925 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 459/848] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Apr 16 21:09:44 2022] POST /compute/v2.1/servers/7f267f97-0675-4567-970e-9b51514392cc/action => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:09:44.260532 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5647ab9c-6cf2-4d2f-9eaa-5564a0bc8f83 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:44.261621 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5647ab9c-6cf2-4d2f-9eaa-5564a0bc8f83 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] [instance: 3ebfe0ed-3568-4b90-b834-fd3ad244dcac] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:44.271071 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5647ab9c-6cf2-4d2f-9eaa-5564a0bc8f83 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:44.272039 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5647ab9c-6cf2-4d2f-9eaa-5564a0bc8f83 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:44.273084 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5647ab9c-6cf2-4d2f-9eaa-5564a0bc8f83 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:44.277608 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5647ab9c-6cf2-4d2f-9eaa-5564a0bc8f83 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:44.292095 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-5647ab9c-6cf2-4d2f-9eaa-5564a0bc8f83 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] HTTP exception thrown: Instance 3ebfe0ed-3568-4b90-b834-fd3ad244dcac could not be found. Apr 16 21:09:44.293121 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5647ab9c-6cf2-4d2f-9eaa-5564a0bc8f83 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Returning 404 to user: Instance 3ebfe0ed-3568-4b90-b834-fd3ad244dcac could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:09:44.295180 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5647ab9c-6cf2-4d2f-9eaa-5564a0bc8f83 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] 10.222.0.20 "GET /compute/v2.1/servers/3ebfe0ed-3568-4b90-b834-fd3ad244dcac" status: 404 len: 111 microversion: 2.1 time: 0.038716 Apr 16 21:09:44.296603 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 460/849] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:44 2022] GET /compute/v2.1/servers/3ebfe0ed-3568-4b90-b834-fd3ad244dcac => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:09:44.303211 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-6c26cf82-d67a-49de-b00e-d175d1c83747 req-a56aa4b4-fcef-41a0-a3fb-f2d261a35307 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f267f97-0675-4567-970e-9b51514392cc", "name": "network-vif-deleted", "tag": "680a72aa-61d1-4dad-a95b-9bdbe208caad"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:44.323297 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-6c26cf82-d67a-49de-b00e-d175d1c83747 req-a56aa4b4-fcef-41a0-a3fb-f2d261a35307 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:44.325477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-6c26cf82-d67a-49de-b00e-d175d1c83747 req-a56aa4b4-fcef-41a0-a3fb-f2d261a35307 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:44.343169 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-aaf73285-4f76-4d19-ade1-bc648ded6471 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:44.346224 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-6c26cf82-d67a-49de-b00e-d175d1c83747 req-a56aa4b4-fcef-41a0-a3fb-f2d261a35307 service nova] Creating event network-vif-deleted:680a72aa-61d1-4dad-a95b-9bdbe208caad for instance 7f267f97-0675-4567-970e-9b51514392cc on nch1-master-1 Apr 16 21:09:44.347170 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-aaf73285-4f76-4d19-ade1-bc648ded6471 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Searching by: {'deleted': False, 'project_id': 'c56d51ea763d499ba979cd85810b0407'} {{(pid=137409) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:09:44.353784 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-6c26cf82-d67a-49de-b00e-d175d1c83747 req-a56aa4b4-fcef-41a0-a3fb-f2d261a35307 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055378 Apr 16 21:09:44.354333 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 461/850] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:09:44.369806 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-611d627c-9c3f-41e0-a749-eda7ccd33255 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:44.370523 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-611d627c-9c3f-41e0-a749-eda7ccd33255 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 524e8c67-957c-4856-a882-fc0a4befaedd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:44.377288 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aaf73285-4f76-4d19-ade1-bc648ded6471 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:44.378026 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aaf73285-4f76-4d19-ade1-bc648ded6471 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:44.379621 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aaf73285-4f76-4d19-ade1-bc648ded6471 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:44.381143 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aaf73285-4f76-4d19-ade1-bc648ded6471 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:44.402237 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-611d627c-9c3f-41e0-a749-eda7ccd33255 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:44.403025 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-611d627c-9c3f-41e0-a749-eda7ccd33255 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:44.403998 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-611d627c-9c3f-41e0-a749-eda7ccd33255 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:44.404565 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-611d627c-9c3f-41e0-a749-eda7ccd33255 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:44.526181 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-aaf73285-4f76-4d19-ade1-bc648ded6471 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.394929 Apr 16 21:09:44.526772 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 390/851] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:09:44 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:09:44.533179 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-a30ca25a-f279-41fe-920b-553e8b11df50 req-44f3412a-27d4-4421-a2fc-3a6fb9565020 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e26a3424-8bc8-454c-a7e3-507bb1c71c03", "tag": "b1f2adf4-34d0-4e59-9590-bd8f2631ee09"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:44.545373 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-a30ca25a-f279-41fe-920b-553e8b11df50 req-44f3412a-27d4-4421-a2fc-3a6fb9565020 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:44.546070 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-a30ca25a-f279-41fe-920b-553e8b11df50 req-44f3412a-27d4-4421-a2fc-3a6fb9565020 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:44.560078 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-a30ca25a-f279-41fe-920b-553e8b11df50 req-44f3412a-27d4-4421-a2fc-3a6fb9565020 service nova] Creating event network-changed:b1f2adf4-34d0-4e59-9590-bd8f2631ee09 for instance e26a3424-8bc8-454c-a7e3-507bb1c71c03 on nch1-master-1 Apr 16 21:09:44.586491 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-a30ca25a-f279-41fe-920b-553e8b11df50 req-44f3412a-27d4-4421-a2fc-3a6fb9565020 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057954 Apr 16 21:09:44.590082 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 391/852] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:09:44.594502 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-611d627c-9c3f-41e0-a749-eda7ccd33255 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:44.605350 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7f073edc-2396-4fd0-95c0-25f357e7b38d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:44.606085 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7f073edc-2396-4fd0-95c0-25f357e7b38d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:44.607385 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-611d627c-9c3f-41e0-a749-eda7ccd33255 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/524e8c67-957c-4856-a882-fc0a4befaedd" status: 200 len: 1223 microversion: 2.1 time: 0.248482 Apr 16 21:09:44.613074 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 462/853] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:44 2022] GET /compute/v2.1/servers/524e8c67-957c-4856-a882-fc0a4befaedd => generated 1223 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:44.624104 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8465a25d-3df1-4a98-9d5f-7eb4300c3be3 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-210867618", "metadata": {"image_type": "test"}}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:44.625233 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8465a25d-3df1-4a98-9d5f-7eb4300c3be3 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Failed to fetch instance by id tempest-invalid-1829947401 {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2924}} Apr 16 21:09:44.625759 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-8465a25d-3df1-4a98-9d5f-7eb4300c3be3 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] HTTP exception thrown: Instance tempest-invalid-1829947401 could not be found. Apr 16 21:09:44.631297 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8465a25d-3df1-4a98-9d5f-7eb4300c3be3 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Returning 404 to user: Instance tempest-invalid-1829947401 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:09:44.632237 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8465a25d-3df1-4a98-9d5f-7eb4300c3be3 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] 10.222.0.20 "POST /compute/v2.1/servers/tempest-invalid-1829947401/action" status: 404 len: 101 microversion: 2.1 time: 0.016049 Apr 16 21:09:44.632817 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 463/854] 10.222.0.20 () {60 vars in 1248 bytes} [Sat Apr 16 21:09:44 2022] POST /compute/v2.1/servers/tempest-invalid-1829947401/action => generated 101 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:09:44.650888 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e9d2062d-c84e-4f88-b129-e4db887c12d3 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:44.651651 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e9d2062d-c84e-4f88-b129-e4db887c12d3 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] [instance: bf93495b-7d10-4cb2-9353-0302e654d8fa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:44.658951 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e9d2062d-c84e-4f88-b129-e4db887c12d3 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:44.659661 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e9d2062d-c84e-4f88-b129-e4db887c12d3 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:44.661304 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e9d2062d-c84e-4f88-b129-e4db887c12d3 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:44.662045 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e9d2062d-c84e-4f88-b129-e4db887c12d3 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:44.697014 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e9d2062d-c84e-4f88-b129-e4db887c12d3 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] [instance: bf93495b-7d10-4cb2-9353-0302e654d8fa] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:09:44.758772 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7f073edc-2396-4fd0-95c0-25f357e7b38d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:44.767930 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7f073edc-2396-4fd0-95c0-25f357e7b38d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:44.769716 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7f073edc-2396-4fd0-95c0-25f357e7b38d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:44.771071 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7f073edc-2396-4fd0-95c0-25f357e7b38d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd" status: 200 len: 1262 microversion: 2.25 time: 0.179633 Apr 16 21:09:44.771674 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 392/855] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:09:44 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd => generated 1262 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:09:44.782920 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-56dfcdd7-303b-42bf-b03f-1eb42bf8cf5f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:44.782920 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-56dfcdd7-303b-42bf-b03f-1eb42bf8cf5f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 728c68c3-5252-4e9a-b1d0-c3afdfc8ba35] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:44.788605 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-56dfcdd7-303b-42bf-b03f-1eb42bf8cf5f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:44.789207 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-56dfcdd7-303b-42bf-b03f-1eb42bf8cf5f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:44.790093 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-56dfcdd7-303b-42bf-b03f-1eb42bf8cf5f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:44.790666 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-56dfcdd7-303b-42bf-b03f-1eb42bf8cf5f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:45.211631 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e9d2062d-c84e-4f88-b129-e4db887c12d3 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bf93495b-7d10-4cb2-9353-0302e654d8fa" status: 204 len: 0 microversion: 2.1 time: 0.577384 Apr 16 21:09:45.212416 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 464/856] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:09:44 2022] DELETE /compute/v2.1/servers/bf93495b-7d10-4cb2-9353-0302e654d8fa => generated 0 bytes in 579 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:09:45.220421 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-431d1757-5244-484b-883c-467a81c8301a tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:45.226681 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-431d1757-5244-484b-883c-467a81c8301a tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Searching by: {'deleted': False} {{(pid=137408) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:09:45.238787 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-431d1757-5244-484b-883c-467a81c8301a tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:45.239488 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-431d1757-5244-484b-883c-467a81c8301a tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:45.240576 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-431d1757-5244-484b-883c-467a81c8301a tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:45.241171 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-431d1757-5244-484b-883c-467a81c8301a tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:45.260308 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-56dfcdd7-303b-42bf-b03f-1eb42bf8cf5f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:45.284519 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-56dfcdd7-303b-42bf-b03f-1eb42bf8cf5f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/728c68c3-5252-4e9a-b1d0-c3afdfc8ba35" status: 200 len: 1319 microversion: 2.1 time: 0.510319 Apr 16 21:09:45.294706 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 393/857] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:44 2022] GET /compute/v2.1/servers/728c68c3-5252-4e9a-b1d0-c3afdfc8ba35 => generated 1319 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:45.294706 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-dcd485e2-530c-4e04-993e-121de104f9ae tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1569292395"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:45.294706 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-dcd485e2-530c-4e04-993e-121de104f9ae tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2924}} Apr 16 21:09:45.294706 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-dcd485e2-530c-4e04-993e-121de104f9ae tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Apr 16 21:09:45.294706 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-dcd485e2-530c-4e04-993e-121de104f9ae tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:09:45.301897 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-dcd485e2-530c-4e04-993e-121de104f9ae tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] 10.222.0.20 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.008614 Apr 16 21:09:45.301897 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 394/858] 10.222.0.20 () {60 vars in 1274 bytes} [Sat Apr 16 21:09:45 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 10 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:09:45.303512 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7d64e028-8487-49db-bdb9-ad7f7c4a9c7b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:45.304130 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7d64e028-8487-49db-bdb9-ad7f7c4a9c7b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: bc3b9549-fb07-458b-84bf-3f1d36449e6e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:45.311720 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7d64e028-8487-49db-bdb9-ad7f7c4a9c7b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:45.312371 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7d64e028-8487-49db-bdb9-ad7f7c4a9c7b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:45.313345 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7d64e028-8487-49db-bdb9-ad7f7c4a9c7b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:45.313953 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7d64e028-8487-49db-bdb9-ad7f7c4a9c7b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:45.395531 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.multi_cell_list [None req-431d1757-5244-484b-883c-467a81c8301a tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Listed batch of 16 results from cell out of 999 limit. Returned 16 total so far. {{(pid=137408) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 16 21:09:45.528968 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-431d1757-5244-484b-883c-467a81c8301a tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:45.529426 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-431d1757-5244-484b-883c-467a81c8301a tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:45.670009 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7d64e028-8487-49db-bdb9-ad7f7c4a9c7b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:45.685356 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7d64e028-8487-49db-bdb9-ad7f7c4a9c7b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e" status: 200 len: 1493 microversion: 2.1 time: 0.386801 Apr 16 21:09:45.698231 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 395/859] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:45 2022] GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e => generated 1493 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:45.703831 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a4ce62e3-b6db-4be5-ba60-9e8ef03521e1 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:45.704860 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a4ce62e3-b6db-4be5-ba60-9e8ef03521e1 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] [instance: bf93495b-7d10-4cb2-9353-0302e654d8fa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:45.711520 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a4ce62e3-b6db-4be5-ba60-9e8ef03521e1 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:45.719314 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a4ce62e3-b6db-4be5-ba60-9e8ef03521e1 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:45.719314 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a4ce62e3-b6db-4be5-ba60-9e8ef03521e1 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:45.719314 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a4ce62e3-b6db-4be5-ba60-9e8ef03521e1 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:45.996709 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-431d1757-5244-484b-883c-467a81c8301a tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 24889 microversion: 2.1 time: 0.780245 Apr 16 21:09:45.997444 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 465/860] 10.222.0.20 () {58 vars in 1170 bytes} [Sat Apr 16 21:09:45 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 24889 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:09:46.004257 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4ecde0ae-14de-4d82-adee-185d8beebec7 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-430322828"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:46.005664 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4ecde0ae-14de-4d82-adee-185d8beebec7 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2924}} Apr 16 21:09:46.006419 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-4ecde0ae-14de-4d82-adee-185d8beebec7 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Apr 16 21:09:46.007255 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4ecde0ae-14de-4d82-adee-185d8beebec7 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:09:46.008348 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4ecde0ae-14de-4d82-adee-185d8beebec7 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] 10.222.0.20 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.009693 Apr 16 21:09:46.013519 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 466/861] 10.222.0.20 () {60 vars in 1280 bytes} [Sat Apr 16 21:09:45 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:09:46.042931 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7f4730fb-9a6f-4fb1-a78b-1980b625a073 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:46.044582 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7f4730fb-9a6f-4fb1-a78b-1980b625a073 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 524e8c67-957c-4856-a882-fc0a4befaedd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:46.054625 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7f4730fb-9a6f-4fb1-a78b-1980b625a073 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:46.056147 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7f4730fb-9a6f-4fb1-a78b-1980b625a073 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:46.056572 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7f4730fb-9a6f-4fb1-a78b-1980b625a073 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:46.056827 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7f4730fb-9a6f-4fb1-a78b-1980b625a073 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:46.127318 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7f4730fb-9a6f-4fb1-a78b-1980b625a073 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:46.135949 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7f4730fb-9a6f-4fb1-a78b-1980b625a073 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/524e8c67-957c-4856-a882-fc0a4befaedd" status: 200 len: 1271 microversion: 2.1 time: 0.120727 Apr 16 21:09:46.136569 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 467/862] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:46 2022] GET /compute/v2.1/servers/524e8c67-957c-4856-a882-fc0a4befaedd => generated 1271 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:46.144482 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d863ab6b-ce81-4a21-be77-7b0a361479c4 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:46.145735 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d863ab6b-ce81-4a21-be77-7b0a361479c4 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] [instance: bc3b9549-fb07-458b-84bf-3f1d36449e6e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:46.151927 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d863ab6b-ce81-4a21-be77-7b0a361479c4 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:46.153285 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d863ab6b-ce81-4a21-be77-7b0a361479c4 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:46.161138 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d863ab6b-ce81-4a21-be77-7b0a361479c4 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:46.161138 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d863ab6b-ce81-4a21-be77-7b0a361479c4 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:46.289428 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d863ab6b-ce81-4a21-be77-7b0a361479c4 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e" status: 200 len: 1644 microversion: 2.1 time: 0.151640 Apr 16 21:09:46.290351 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 468/863] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:46 2022] GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e => generated 1644 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:46.296284 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d93308b6-2104-4d44-8944-7f6823784d7c tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:46.296284 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d93308b6-2104-4d44-8944-7f6823784d7c tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:46.302774 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d93308b6-2104-4d44-8944-7f6823784d7c tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:46.303235 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d93308b6-2104-4d44-8944-7f6823784d7c tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:46.303344 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a4ce62e3-b6db-4be5-ba60-9e8ef03521e1 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae06aafd64d46deacb8ae1791676d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1924a4ceffaf45d0bf2bd76ebb421bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:46.304060 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d93308b6-2104-4d44-8944-7f6823784d7c tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:46.304548 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d93308b6-2104-4d44-8944-7f6823784d7c tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:46.311522 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a4ce62e3-b6db-4be5-ba60-9e8ef03521e1 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] 10.222.0.20 "GET /compute/v2.1/servers/bf93495b-7d10-4cb2-9353-0302e654d8fa" status: 200 len: 1475 microversion: 2.1 time: 0.611969 Apr 16 21:09:46.312120 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 396/864] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:45 2022] GET /compute/v2.1/servers/bf93495b-7d10-4cb2-9353-0302e654d8fa => generated 1475 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:46.320575 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-86e8dd58-b4b8-4789-9a1d-ef354faa9c0b tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:46.321362 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-86e8dd58-b4b8-4789-9a1d-ef354faa9c0b tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] [instance: 7f267f97-0675-4567-970e-9b51514392cc] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:46.327123 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-86e8dd58-b4b8-4789-9a1d-ef354faa9c0b tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:46.327648 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-86e8dd58-b4b8-4789-9a1d-ef354faa9c0b tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:46.328529 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-86e8dd58-b4b8-4789-9a1d-ef354faa9c0b tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:46.329188 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-86e8dd58-b4b8-4789-9a1d-ef354faa9c0b tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:46.343783 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-86e8dd58-b4b8-4789-9a1d-ef354faa9c0b tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] HTTP exception thrown: Instance 7f267f97-0675-4567-970e-9b51514392cc could not be found. Apr 16 21:09:46.344503 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-86e8dd58-b4b8-4789-9a1d-ef354faa9c0b tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Returning 404 to user: Instance 7f267f97-0675-4567-970e-9b51514392cc could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:09:46.345318 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-86e8dd58-b4b8-4789-9a1d-ef354faa9c0b tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7f267f97-0675-4567-970e-9b51514392cc" status: 404 len: 111 microversion: 2.1 time: 0.032167 Apr 16 21:09:46.345875 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 397/865] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:09:46 2022] DELETE /compute/v2.1/servers/7f267f97-0675-4567-970e-9b51514392cc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:09:46.350527 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9832a9d6-d429-42c2-876e-b550223947a5 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:46.354413 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9832a9d6-d429-42c2-876e-b550223947a5 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Searching by: {'deleted': False, 'project_id': 'c56d51ea763d499ba979cd85810b0407'} {{(pid=137409) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:09:46.359223 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9832a9d6-d429-42c2-876e-b550223947a5 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:46.359747 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9832a9d6-d429-42c2-876e-b550223947a5 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:46.360599 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9832a9d6-d429-42c2-876e-b550223947a5 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:46.361018 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9832a9d6-d429-42c2-876e-b550223947a5 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:46.367304 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d93308b6-2104-4d44-8944-7f6823784d7c tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:46.375145 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d93308b6-2104-4d44-8944-7f6823784d7c tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:46.376839 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d93308b6-2104-4d44-8944-7f6823784d7c tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:46.378038 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d93308b6-2104-4d44-8944-7f6823784d7c tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd" status: 200 len: 1266 microversion: 2.25 time: 0.086519 Apr 16 21:09:46.378608 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 469/866] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:09:46 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:09:46.383542 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fd222e09-5997-4060-9dd9-bb8bc88fafd1 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:46.384150 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fd222e09-5997-4060-9dd9-bb8bc88fafd1 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 728c68c3-5252-4e9a-b1d0-c3afdfc8ba35] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:46.390168 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fd222e09-5997-4060-9dd9-bb8bc88fafd1 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:46.390615 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fd222e09-5997-4060-9dd9-bb8bc88fafd1 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:46.390815 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9832a9d6-d429-42c2-876e-b550223947a5 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?tenant_id=ba3fef3234544544870ea9ee02d5b344" status: 200 len: 15 microversion: 2.1 time: 0.043833 Apr 16 21:09:46.391407 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fd222e09-5997-4060-9dd9-bb8bc88fafd1 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:46.391656 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 398/867] 10.222.0.20 () {58 vars in 1230 bytes} [Sat Apr 16 21:09:46 2022] GET /compute/v2.1/servers/detail?tenant_id=ba3fef3234544544870ea9ee02d5b344 => generated 15 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:09:46.391853 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fd222e09-5997-4060-9dd9-bb8bc88fafd1 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:46.396855 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-be62d814-acc9-4cae-bbb6-c63c728b514c tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:46.397464 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-be62d814-acc9-4cae-bbb6-c63c728b514c tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] [instance: bc3b9549-fb07-458b-84bf-3f1d36449e6e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:46.403116 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-be62d814-acc9-4cae-bbb6-c63c728b514c tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:46.403605 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-be62d814-acc9-4cae-bbb6-c63c728b514c tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:46.404398 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-be62d814-acc9-4cae-bbb6-c63c728b514c tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:46.404854 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-be62d814-acc9-4cae-bbb6-c63c728b514c tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:46.606266 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fd222e09-5997-4060-9dd9-bb8bc88fafd1 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:46.621093 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fd222e09-5997-4060-9dd9-bb8bc88fafd1 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/728c68c3-5252-4e9a-b1d0-c3afdfc8ba35" status: 200 len: 1319 microversion: 2.1 time: 0.240014 Apr 16 21:09:46.621923 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 470/868] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:46 2022] GET /compute/v2.1/servers/728c68c3-5252-4e9a-b1d0-c3afdfc8ba35 => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:46.628034 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3bf7d6fb-fb19-4365-9635-6bc6fd750a13 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:46.629026 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3bf7d6fb-fb19-4365-9635-6bc6fd750a13 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] [instance: 7f267f97-0675-4567-970e-9b51514392cc] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:46.639826 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3bf7d6fb-fb19-4365-9635-6bc6fd750a13 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:46.640825 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3bf7d6fb-fb19-4365-9635-6bc6fd750a13 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:46.640943 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-be62d814-acc9-4cae-bbb6-c63c728b514c tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e" status: 200 len: 1644 microversion: 2.1 time: 0.247669 Apr 16 21:09:46.641619 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 399/869] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:46 2022] GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e => generated 1644 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:46.652572 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3bf7d6fb-fb19-4365-9635-6bc6fd750a13 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:46.652572 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3bf7d6fb-fb19-4365-9635-6bc6fd750a13 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:46.657746 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e3ce2246-dcaa-4e8f-bf1e-9e7247debd96 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:46.659714 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-3bf7d6fb-fb19-4365-9635-6bc6fd750a13 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] HTTP exception thrown: Instance 7f267f97-0675-4567-970e-9b51514392cc could not be found. Apr 16 21:09:46.659714 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3bf7d6fb-fb19-4365-9635-6bc6fd750a13 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] Returning 404 to user: Instance 7f267f97-0675-4567-970e-9b51514392cc could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:09:46.660310 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3bf7d6fb-fb19-4365-9635-6bc6fd750a13 tempest-ImagesNegativeTestJSON-1628678755 tempest-ImagesNegativeTestJSON-1628678755-project] 10.222.0.20 "GET /compute/v2.1/servers/7f267f97-0675-4567-970e-9b51514392cc" status: 404 len: 111 microversion: 2.1 time: 0.036690 Apr 16 21:09:46.661196 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 471/870] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:46 2022] GET /compute/v2.1/servers/7f267f97-0675-4567-970e-9b51514392cc => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:09:46.663247 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e3ce2246-dcaa-4e8f-bf1e-9e7247debd96 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Searching by: {'tenant_id': 'ba3fef3234544544870ea9ee02d5b344', 'deleted': False} {{(pid=137409) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:09:46.666608 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-9f4a42ba-76b4-4495-90a2-e04a9de69706 req-5e978c2d-14dd-4df3-acfa-1e4aae9d10e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "728c68c3-5252-4e9a-b1d0-c3afdfc8ba35", "tag": "60d57b69-5719-4183-b383-e1c20b54b232"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:46.669934 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e3ce2246-dcaa-4e8f-bf1e-9e7247debd96 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:46.670775 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e3ce2246-dcaa-4e8f-bf1e-9e7247debd96 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:46.672205 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e3ce2246-dcaa-4e8f-bf1e-9e7247debd96 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:46.672807 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e3ce2246-dcaa-4e8f-bf1e-9e7247debd96 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:46.693858 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-9f4a42ba-76b4-4495-90a2-e04a9de69706 req-5e978c2d-14dd-4df3-acfa-1e4aae9d10e9 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:46.695978 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-9f4a42ba-76b4-4495-90a2-e04a9de69706 req-5e978c2d-14dd-4df3-acfa-1e4aae9d10e9 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:46.712635 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.multi_cell_list [None req-e3ce2246-dcaa-4e8f-bf1e-9e7247debd96 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 16 21:09:46.721494 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-9f4a42ba-76b4-4495-90a2-e04a9de69706 req-5e978c2d-14dd-4df3-acfa-1e4aae9d10e9 service nova] Creating event network-changed:60d57b69-5719-4183-b383-e1c20b54b232 for instance 728c68c3-5252-4e9a-b1d0-c3afdfc8ba35 on nch1-master-1 Apr 16 21:09:46.734062 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-9f4a42ba-76b4-4495-90a2-e04a9de69706 req-5e978c2d-14dd-4df3-acfa-1e4aae9d10e9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070982 Apr 16 21:09:46.735149 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 472/871] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:09:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:09:46.747253 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-99f8ca16-d3b5-4a3b-b667-aefe359abc98 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:46.750523 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:09:46.750523 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:09:46.755211 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-99f8ca16-d3b5-4a3b-b667-aefe359abc98 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:46.760083 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-99f8ca16-d3b5-4a3b-b667-aefe359abc98 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:46.762610 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-99f8ca16-d3b5-4a3b-b667-aefe359abc98 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:46.763198 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-99f8ca16-d3b5-4a3b-b667-aefe359abc98 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:46.791432 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-99f8ca16-d3b5-4a3b-b667-aefe359abc98 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.049619 Apr 16 21:09:46.792534 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 473/872] 10.222.0.20 () {58 vars in 1175 bytes} [Sat Apr 16 21:09:46 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:09:46.807326 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-11dfb2e2-7468-46fc-bbe8-5797c30054d6 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:46.808205 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-11dfb2e2-7468-46fc-bbe8-5797c30054d6 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] [instance: bc3b9549-fb07-458b-84bf-3f1d36449e6e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:46.815445 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-11dfb2e2-7468-46fc-bbe8-5797c30054d6 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:46.815922 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-11dfb2e2-7468-46fc-bbe8-5797c30054d6 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:46.817324 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-11dfb2e2-7468-46fc-bbe8-5797c30054d6 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:46.817780 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-11dfb2e2-7468-46fc-bbe8-5797c30054d6 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:46.849031 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e3ce2246-dcaa-4e8f-bf1e-9e7247debd96 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:46.849524 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e3ce2246-dcaa-4e8f-bf1e-9e7247debd96 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:47.003487 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e3ce2246-dcaa-4e8f-bf1e-9e7247debd96 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=ba3fef3234544544870ea9ee02d5b344" status: 200 len: 4826 microversion: 2.1 time: 0.341675 Apr 16 21:09:47.003487 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 400/873] 10.222.0.20 () {58 vars in 1256 bytes} [Sat Apr 16 21:09:46 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=ba3fef3234544544870ea9ee02d5b344 => generated 4826 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:47.015333 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d6d21347-0f30-4f99-b324-86bd098e2070 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:47.022384 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d6d21347-0f30-4f99-b324-86bd098e2070 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Searching by: {'tenant_id': 'c56d51ea763d499ba979cd85810b0407', 'deleted': False} {{(pid=137409) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:09:47.030293 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d6d21347-0f30-4f99-b324-86bd098e2070 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:47.031115 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d6d21347-0f30-4f99-b324-86bd098e2070 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:47.032786 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d6d21347-0f30-4f99-b324-86bd098e2070 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:47.033548 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d6d21347-0f30-4f99-b324-86bd098e2070 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:47.075036 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d6d21347-0f30-4f99-b324-86bd098e2070 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c56d51ea763d499ba979cd85810b0407" status: 200 len: 15 microversion: 2.1 time: 0.063322 Apr 16 21:09:47.075609 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 401/874] 10.222.0.20 () {58 vars in 1256 bytes} [Sat Apr 16 21:09:47 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=c56d51ea763d499ba979cd85810b0407 => generated 15 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 16 21:09:47.089349 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-11dfb2e2-7468-46fc-bbe8-5797c30054d6 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e/action" status: 202 len: 0 microversion: 2.1 time: 0.286857 Apr 16 21:09:47.093019 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 474/875] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:09:46 2022] POST /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:09:47.093178 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0f37fb1f-22dc-4b5e-8c7e-575e4d963556 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:47.099768 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-74754c90-a852-43ae-a87a-aa1125efbd38 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:47.100713 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-74754c90-a852-43ae-a87a-aa1125efbd38 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] [instance: bc3b9549-fb07-458b-84bf-3f1d36449e6e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:47.102337 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0f37fb1f-22dc-4b5e-8c7e-575e4d963556 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.013834 Apr 16 21:09:47.103692 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 402/876] 10.222.0.20 () {58 vars in 1188 bytes} [Sat Apr 16 21:09:47 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 16 21:09:47.109732 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-74754c90-a852-43ae-a87a-aa1125efbd38 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:47.110198 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-74754c90-a852-43ae-a87a-aa1125efbd38 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:47.111021 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-74754c90-a852-43ae-a87a-aa1125efbd38 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:47.111852 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-74754c90-a852-43ae-a87a-aa1125efbd38 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:47.122148 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-47814525-78b1-4e7f-bdce-4b999d8cb361 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:47.129660 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-47814525-78b1-4e7f-bdce-4b999d8cb361 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:47.130112 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-47814525-78b1-4e7f-bdce-4b999d8cb361 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:47.130725 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-47814525-78b1-4e7f-bdce-4b999d8cb361 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:47.131511 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-47814525-78b1-4e7f-bdce-4b999d8cb361 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:47.131953 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-47814525-78b1-4e7f-bdce-4b999d8cb361 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:47.458140 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-74754c90-a852-43ae-a87a-aa1125efbd38 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e" status: 200 len: 1649 microversion: 2.1 time: 0.363632 Apr 16 21:09:47.460489 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 475/877] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:47 2022] GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e => generated 1649 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:47.473429 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e5ecaee6-1cae-4cd4-a0bb-f03e2897a3d5 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:47.474044 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e5ecaee6-1cae-4cd4-a0bb-f03e2897a3d5 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 524e8c67-957c-4856-a882-fc0a4befaedd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:47.484841 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e5ecaee6-1cae-4cd4-a0bb-f03e2897a3d5 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:47.485372 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e5ecaee6-1cae-4cd4-a0bb-f03e2897a3d5 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:47.486348 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e5ecaee6-1cae-4cd4-a0bb-f03e2897a3d5 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:47.486807 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e5ecaee6-1cae-4cd4-a0bb-f03e2897a3d5 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:47.618776 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e5ecaee6-1cae-4cd4-a0bb-f03e2897a3d5 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:47.641847 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e5ecaee6-1cae-4cd4-a0bb-f03e2897a3d5 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/524e8c67-957c-4856-a882-fc0a4befaedd" status: 200 len: 1279 microversion: 2.1 time: 0.180153 Apr 16 21:09:47.643740 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 476/878] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:47 2022] GET /compute/v2.1/servers/524e8c67-957c-4856-a882-fc0a4befaedd => generated 1279 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:47.650669 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-13826023-e0ff-48b4-abe0-cf5c54c9b831 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:47.651281 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-13826023-e0ff-48b4-abe0-cf5c54c9b831 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] [instance: bf93495b-7d10-4cb2-9353-0302e654d8fa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:47.655605 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-47814525-78b1-4e7f-bdce-4b999d8cb361 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17/action" status: 202 len: 0 microversion: 2.1 time: 0.539075 Apr 16 21:09:47.659202 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 403/879] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:09:47 2022] POST /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17/action => generated 0 bytes in 541 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:09:47.672517 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6965a96c-5d69-4960-9221-ab3d73dfe1b8 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:47.674707 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6965a96c-5d69-4960-9221-ab3d73dfe1b8 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:47.704731 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6965a96c-5d69-4960-9221-ab3d73dfe1b8 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:47.705400 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6965a96c-5d69-4960-9221-ab3d73dfe1b8 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:47.705602 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-13826023-e0ff-48b4-abe0-cf5c54c9b831 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:47.706220 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6965a96c-5d69-4960-9221-ab3d73dfe1b8 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:47.706559 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-13826023-e0ff-48b4-abe0-cf5c54c9b831 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:47.706672 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6965a96c-5d69-4960-9221-ab3d73dfe1b8 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:47.707783 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-13826023-e0ff-48b4-abe0-cf5c54c9b831 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:47.708559 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-13826023-e0ff-48b4-abe0-cf5c54c9b831 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:47.855103 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6965a96c-5d69-4960-9221-ab3d73dfe1b8 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:47.868352 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6965a96c-5d69-4960-9221-ab3d73dfe1b8 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:47.870377 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6965a96c-5d69-4960-9221-ab3d73dfe1b8 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:47.873042 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6965a96c-5d69-4960-9221-ab3d73dfe1b8 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd" status: 200 len: 1314 microversion: 2.25 time: 0.211319 Apr 16 21:09:47.883832 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 404/880] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:09:47 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:09:47.883832 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-92348ff7-593e-4fcd-b162-bbbd8c443bec tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:47.883832 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-92348ff7-593e-4fcd-b162-bbbd8c443bec tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 728c68c3-5252-4e9a-b1d0-c3afdfc8ba35] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:47.886641 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-92348ff7-593e-4fcd-b162-bbbd8c443bec tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:47.887095 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-92348ff7-593e-4fcd-b162-bbbd8c443bec tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:47.888103 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-92348ff7-593e-4fcd-b162-bbbd8c443bec tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:47.888698 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-92348ff7-593e-4fcd-b162-bbbd8c443bec tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:47.960650 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-13826023-e0ff-48b4-abe0-cf5c54c9b831 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae06aafd64d46deacb8ae1791676d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1924a4ceffaf45d0bf2bd76ebb421bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:47.968283 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-13826023-e0ff-48b4-abe0-cf5c54c9b831 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] 10.222.0.20 "GET /compute/v2.1/servers/bf93495b-7d10-4cb2-9353-0302e654d8fa" status: 200 len: 1475 microversion: 2.1 time: 0.323453 Apr 16 21:09:47.969093 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 477/881] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:47 2022] GET /compute/v2.1/servers/bf93495b-7d10-4cb2-9353-0302e654d8fa => generated 1475 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:47.974367 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cca43d48-efe1-4db4-b17e-c64a7572c656 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:47.978007 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cca43d48-efe1-4db4-b17e-c64a7572c656 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:47.979021 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cca43d48-efe1-4db4-b17e-c64a7572c656 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'ba3fef3234544544870ea9ee02d5b344'} {{(pid=137408) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:09:47.985761 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cca43d48-efe1-4db4-b17e-c64a7572c656 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:47.986224 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cca43d48-efe1-4db4-b17e-c64a7572c656 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:47.987026 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cca43d48-efe1-4db4-b17e-c64a7572c656 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:47.987641 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cca43d48-efe1-4db4-b17e-c64a7572c656 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:48.078495 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.multi_cell_list [None req-cca43d48-efe1-4db4-b17e-c64a7572c656 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137408) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 16 21:09:48.148759 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cca43d48-efe1-4db4-b17e-c64a7572c656 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.178362 Apr 16 21:09:48.154928 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 478/882] 10.222.0.20 () {58 vars in 1149 bytes} [Sat Apr 16 21:09:47 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:09:48.161026 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ad7b0eda-9906-49c0-82ff-dd961e982cab tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:48.162555 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ad7b0eda-9906-49c0-82ff-dd961e982cab tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:48.169448 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ad7b0eda-9906-49c0-82ff-dd961e982cab tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:48.170141 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ad7b0eda-9906-49c0-82ff-dd961e982cab tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:48.171189 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ad7b0eda-9906-49c0-82ff-dd961e982cab tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:48.171794 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ad7b0eda-9906-49c0-82ff-dd961e982cab tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:48.502237 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-92348ff7-593e-4fcd-b162-bbbd8c443bec tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:48.513226 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-92348ff7-593e-4fcd-b162-bbbd8c443bec tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/728c68c3-5252-4e9a-b1d0-c3afdfc8ba35" status: 200 len: 1319 microversion: 2.1 time: 0.638303 Apr 16 21:09:48.514944 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 405/883] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:47 2022] GET /compute/v2.1/servers/728c68c3-5252-4e9a-b1d0-c3afdfc8ba35 => generated 1319 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:48.521486 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-a37353cc-1b12-4fad-b680-65ff6c7bbda9 req-6d970bb3-e983-4e2a-abdd-b5132211ec10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf93495b-7d10-4cb2-9353-0302e654d8fa", "name": "network-vif-deleted", "tag": "9d341b6f-b81c-4d6c-924c-e8dc1d4fbebc"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:48.530631 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-a37353cc-1b12-4fad-b680-65ff6c7bbda9 req-6d970bb3-e983-4e2a-abdd-b5132211ec10 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:48.531340 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-a37353cc-1b12-4fad-b680-65ff6c7bbda9 req-6d970bb3-e983-4e2a-abdd-b5132211ec10 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:48.566105 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-a37353cc-1b12-4fad-b680-65ff6c7bbda9 req-6d970bb3-e983-4e2a-abdd-b5132211ec10 service nova] Creating event network-vif-deleted:9d341b6f-b81c-4d6c-924c-e8dc1d4fbebc for instance bf93495b-7d10-4cb2-9353-0302e654d8fa on nch2-master-1 Apr 16 21:09:48.573366 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-a37353cc-1b12-4fad-b680-65ff6c7bbda9 req-6d970bb3-e983-4e2a-abdd-b5132211ec10 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056895 Apr 16 21:09:48.574235 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 406/884] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:09:48.587283 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-09151391-b1ca-4da9-b18d-e1693a2f7b14 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:48.589399 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-09151391-b1ca-4da9-b18d-e1693a2f7b14 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] [instance: bc3b9549-fb07-458b-84bf-3f1d36449e6e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:48.597214 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-09151391-b1ca-4da9-b18d-e1693a2f7b14 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:48.599186 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-09151391-b1ca-4da9-b18d-e1693a2f7b14 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:48.600633 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-09151391-b1ca-4da9-b18d-e1693a2f7b14 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:48.601296 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-09151391-b1ca-4da9-b18d-e1693a2f7b14 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:48.604396 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ad7b0eda-9906-49c0-82ff-dd961e982cab tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17/action" status: 202 len: 0 microversion: 2.1 time: 0.447593 Apr 16 21:09:48.605404 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 479/885] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:09:48 2022] POST /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17/action => generated 0 bytes in 450 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:09:48.612866 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f22b2af8-bc02-4ba7-b366-afeabacf2aba tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:48.614280 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f22b2af8-bc02-4ba7-b366-afeabacf2aba tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:48.628056 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f22b2af8-bc02-4ba7-b366-afeabacf2aba tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:48.629658 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f22b2af8-bc02-4ba7-b366-afeabacf2aba tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:48.630637 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f22b2af8-bc02-4ba7-b366-afeabacf2aba tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:48.631234 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f22b2af8-bc02-4ba7-b366-afeabacf2aba tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:48.905565 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f22b2af8-bc02-4ba7-b366-afeabacf2aba tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1615 microversion: 2.1 time: 0.296243 Apr 16 21:09:48.906542 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 480/886] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:48 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1615 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:09:48.913453 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d4895f49-74b8-4698-af09-680ec12e074e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:48.914437 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d4895f49-74b8-4698-af09-680ec12e074e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 524e8c67-957c-4856-a882-fc0a4befaedd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:48.922580 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d4895f49-74b8-4698-af09-680ec12e074e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:48.923645 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d4895f49-74b8-4698-af09-680ec12e074e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:48.924624 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d4895f49-74b8-4698-af09-680ec12e074e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:48.925225 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d4895f49-74b8-4698-af09-680ec12e074e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:49.057411 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d4895f49-74b8-4698-af09-680ec12e074e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:49.074834 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d4895f49-74b8-4698-af09-680ec12e074e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/524e8c67-957c-4856-a882-fc0a4befaedd" status: 200 len: 1277 microversion: 2.1 time: 0.166297 Apr 16 21:09:49.075476 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 481/887] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:48 2022] GET /compute/v2.1/servers/524e8c67-957c-4856-a882-fc0a4befaedd => generated 1277 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:49.080154 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-85cb0bf4-632c-41e1-afb5-2a3c18ea3de3 req-2b53adb0-1675-4e88-b6e2-ad6d3dcfbd2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b27c826-905d-4c1f-9daf-42150b1025a8", "tag": "2c7070d9-a898-425b-bd50-ce8c757adf87"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:49.101936 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-85cb0bf4-632c-41e1-afb5-2a3c18ea3de3 req-2b53adb0-1675-4e88-b6e2-ad6d3dcfbd2b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:49.102402 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-85cb0bf4-632c-41e1-afb5-2a3c18ea3de3 req-2b53adb0-1675-4e88-b6e2-ad6d3dcfbd2b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:49.127673 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-85cb0bf4-632c-41e1-afb5-2a3c18ea3de3 req-2b53adb0-1675-4e88-b6e2-ad6d3dcfbd2b service nova] Creating event network-changed:2c7070d9-a898-425b-bd50-ce8c757adf87 for instance 2b27c826-905d-4c1f-9daf-42150b1025a8 on nch2-master-1 Apr 16 21:09:49.135291 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-85cb0bf4-632c-41e1-afb5-2a3c18ea3de3 req-2b53adb0-1675-4e88-b6e2-ad6d3dcfbd2b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058432 Apr 16 21:09:49.136335 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 482/888] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:09:49.146323 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-73e26387-077b-440a-b9ce-4e287cafed7f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:49.147299 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-73e26387-077b-440a-b9ce-4e287cafed7f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:49.155818 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-73e26387-077b-440a-b9ce-4e287cafed7f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:49.156556 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-73e26387-077b-440a-b9ce-4e287cafed7f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:49.157516 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-73e26387-077b-440a-b9ce-4e287cafed7f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:49.158143 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-73e26387-077b-440a-b9ce-4e287cafed7f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:49.325559 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-73e26387-077b-440a-b9ce-4e287cafed7f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:49.335731 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-73e26387-077b-440a-b9ce-4e287cafed7f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:49.348158 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-73e26387-077b-440a-b9ce-4e287cafed7f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:49.348158 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-73e26387-077b-440a-b9ce-4e287cafed7f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd" status: 200 len: 1320 microversion: 2.25 time: 0.208466 Apr 16 21:09:49.348158 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 483/889] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:09:49 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd => generated 1320 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:09:49.355765 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9778eb7f-a3ec-4f62-b55e-f47c9e16807d tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:49.358714 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9778eb7f-a3ec-4f62-b55e-f47c9e16807d tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:49.375188 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9778eb7f-a3ec-4f62-b55e-f47c9e16807d tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:49.376344 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9778eb7f-a3ec-4f62-b55e-f47c9e16807d tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:49.377415 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9778eb7f-a3ec-4f62-b55e-f47c9e16807d tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:49.378054 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9778eb7f-a3ec-4f62-b55e-f47c9e16807d tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:49.422539 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-09151391-b1ca-4da9-b18d-e1693a2f7b14 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e" status: 200 len: 1629 microversion: 2.1 time: 0.841485 Apr 16 21:09:49.423131 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 407/890] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:48 2022] GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e => generated 1629 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:49.440819 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5f43f4f5-3e7a-4528-918f-cbaa124fd3a5 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:49.441753 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5f43f4f5-3e7a-4528-918f-cbaa124fd3a5 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] [instance: bf93495b-7d10-4cb2-9353-0302e654d8fa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:49.448627 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5f43f4f5-3e7a-4528-918f-cbaa124fd3a5 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:49.449429 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5f43f4f5-3e7a-4528-918f-cbaa124fd3a5 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:49.450418 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5f43f4f5-3e7a-4528-918f-cbaa124fd3a5 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:49.451086 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5f43f4f5-3e7a-4528-918f-cbaa124fd3a5 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:49.499186 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5f43f4f5-3e7a-4528-918f-cbaa124fd3a5 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:49.500053 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5f43f4f5-3e7a-4528-918f-cbaa124fd3a5 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:49.500751 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-5f43f4f5-3e7a-4528-918f-cbaa124fd3a5 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lazy-loading 'fault' on Instance uuid bf93495b-7d10-4cb2-9353-0302e654d8fa {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:09:49.710430 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5f43f4f5-3e7a-4528-918f-cbaa124fd3a5 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eae06aafd64d46deacb8ae1791676d75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1924a4ceffaf45d0bf2bd76ebb421bcd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:49.721058 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5f43f4f5-3e7a-4528-918f-cbaa124fd3a5 tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] 10.222.0.20 "GET /compute/v2.1/servers/bf93495b-7d10-4cb2-9353-0302e654d8fa" status: 200 len: 1309 microversion: 2.1 time: 0.296671 Apr 16 21:09:49.731204 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 408/891] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:49 2022] GET /compute/v2.1/servers/bf93495b-7d10-4cb2-9353-0302e654d8fa => generated 1309 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:49.731204 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4b56800c-2d25-4bd2-bca9-d5665f7f5a0c tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:49.731204 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4b56800c-2d25-4bd2-bca9-d5665f7f5a0c tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] [instance: bc3b9549-fb07-458b-84bf-3f1d36449e6e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:49.736690 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4b56800c-2d25-4bd2-bca9-d5665f7f5a0c tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:49.737290 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4b56800c-2d25-4bd2-bca9-d5665f7f5a0c tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:49.738806 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4b56800c-2d25-4bd2-bca9-d5665f7f5a0c tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:49.739324 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4b56800c-2d25-4bd2-bca9-d5665f7f5a0c tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:49.766713 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-4b56800c-2d25-4bd2-bca9-d5665f7f5a0c tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lazy-loading 'flavor' on Instance uuid bc3b9549-fb07-458b-84bf-3f1d36449e6e {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:09:49.791069 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4b56800c-2d25-4bd2-bca9-d5665f7f5a0c tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] [instance: bc3b9549-fb07-458b-84bf-3f1d36449e6e] Going to try to live migrate instance to nch1-master-1 {{(pid=137409) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Apr 16 21:09:50.038125 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9778eb7f-a3ec-4f62-b55e-f47c9e16807d tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1615 microversion: 2.1 time: 0.691018 Apr 16 21:09:50.038801 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 484/892] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:49 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1615 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:50.043685 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-79ec6125-b42d-4487-987a-c84c9b34e859 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:50.044689 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-79ec6125-b42d-4487-987a-c84c9b34e859 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 728c68c3-5252-4e9a-b1d0-c3afdfc8ba35] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:50.051751 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-79ec6125-b42d-4487-987a-c84c9b34e859 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:50.052258 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-79ec6125-b42d-4487-987a-c84c9b34e859 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:50.053058 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-79ec6125-b42d-4487-987a-c84c9b34e859 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:50.053500 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-79ec6125-b42d-4487-987a-c84c9b34e859 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:50.221620 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-79ec6125-b42d-4487-987a-c84c9b34e859 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:50.237049 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-79ec6125-b42d-4487-987a-c84c9b34e859 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/728c68c3-5252-4e9a-b1d0-c3afdfc8ba35" status: 200 len: 1319 microversion: 2.1 time: 0.196661 Apr 16 21:09:50.239353 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 485/893] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:50 2022] GET /compute/v2.1/servers/728c68c3-5252-4e9a-b1d0-c3afdfc8ba35 => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:50.245690 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9fb92a39-3e0b-4b7e-805d-f76f020b6a0d tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:50.275508 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9fb92a39-3e0b-4b7e-805d-f76f020b6a0d tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Searching by: {'host': 'nch1-master-1', 'deleted': False} {{(pid=137408) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:09:50.293377 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9fb92a39-3e0b-4b7e-805d-f76f020b6a0d tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:50.301648 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9fb92a39-3e0b-4b7e-805d-f76f020b6a0d tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:50.302652 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9fb92a39-3e0b-4b7e-805d-f76f020b6a0d tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:50.303109 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9fb92a39-3e0b-4b7e-805d-f76f020b6a0d tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:50.404972 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.multi_cell_list [None req-9fb92a39-3e0b-4b7e-805d-f76f020b6a0d tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Listed batch of 8 results from cell out of 1000 limit. Returned 8 total so far. {{(pid=137408) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 16 21:09:50.477386 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9fb92a39-3e0b-4b7e-805d-f76f020b6a0d tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] 10.222.0.20 "GET /compute/v2.1/servers?host=nch1-master-1&all_tenants=1" status: 200 len: 2652 microversion: 2.1 time: 0.236553 Apr 16 21:09:50.491365 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 486/894] 10.222.0.20 () {58 vars in 1189 bytes} [Sat Apr 16 21:09:50 2022] GET /compute/v2.1/servers?host=nch1-master-1&all_tenants=1 => generated 2652 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:50.501755 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-706fd50e-bc00-4e1d-9460-29e8735f76eb tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:50.502368 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-706fd50e-bc00-4e1d-9460-29e8735f76eb tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 524e8c67-957c-4856-a882-fc0a4befaedd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:50.508691 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-706fd50e-bc00-4e1d-9460-29e8735f76eb tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:50.509155 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-706fd50e-bc00-4e1d-9460-29e8735f76eb tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:50.510061 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-706fd50e-bc00-4e1d-9460-29e8735f76eb tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:50.510687 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-706fd50e-bc00-4e1d-9460-29e8735f76eb tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:50.582866 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-706fd50e-bc00-4e1d-9460-29e8735f76eb tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:50.591467 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-706fd50e-bc00-4e1d-9460-29e8735f76eb tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/524e8c67-957c-4856-a882-fc0a4befaedd" status: 200 len: 1277 microversion: 2.1 time: 0.096470 Apr 16 21:09:50.591467 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 487/895] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:50 2022] GET /compute/v2.1/servers/524e8c67-957c-4856-a882-fc0a4befaedd => generated 1277 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:50.766729 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2d18a526-5d48-4c43-9bf4-17f3dec744be tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-1134942957", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:50.819941 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-2d18a526-5d48-4c43-9bf4-17f3dec744be tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] validate_networks() for None {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:09:51.056611 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-2d18a526-5d48-4c43-9bf4-17f3dec744be tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:09:51.057201 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-2d18a526-5d48-4c43-9bf4-17f3dec744be tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:09:51.057817 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-2d18a526-5d48-4c43-9bf4-17f3dec744be tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:09:51.058291 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-2d18a526-5d48-4c43-9bf4-17f3dec744be tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:09:51.058720 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-2d18a526-5d48-4c43-9bf4-17f3dec744be tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:09:51.073437 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2d18a526-5d48-4c43-9bf4-17f3dec744be tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:51.074248 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2d18a526-5d48-4c43-9bf4-17f3dec744be tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:51.075266 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2d18a526-5d48-4c43-9bf4-17f3dec744be tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:51.075769 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2d18a526-5d48-4c43-9bf4-17f3dec744be tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:51.101297 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-2d18a526-5d48-4c43-9bf4-17f3dec744be tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Getting quotas for project d2a21b6df375491fb09fc22109fb4a5c. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:09:51.107172 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-2d18a526-5d48-4c43-9bf4-17f3dec744be tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Getting quotas for user 2db9403ce44e460a8165587ae22f0ad2 and project d2a21b6df375491fb09fc22109fb4a5c. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:09:51.120475 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2d18a526-5d48-4c43-9bf4-17f3dec744be tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:09:51.125725 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2d18a526-5d48-4c43-9bf4-17f3dec744be tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] [instance: 04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:09:51.255140 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2d18a526-5d48-4c43-9bf4-17f3dec744be tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.663265 Apr 16 21:09:51.256455 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 488/896] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:09:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:09:51.285972 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ba67a851-b6c3-4049-9554-6e47f236c24b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:51.290713 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ba67a851-b6c3-4049-9554-6e47f236c24b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:51.307401 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ba67a851-b6c3-4049-9554-6e47f236c24b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:51.315202 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ba67a851-b6c3-4049-9554-6e47f236c24b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:51.315202 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ba67a851-b6c3-4049-9554-6e47f236c24b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:51.315202 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ba67a851-b6c3-4049-9554-6e47f236c24b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:51.479109 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ba67a851-b6c3-4049-9554-6e47f236c24b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:51.489784 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ba67a851-b6c3-4049-9554-6e47f236c24b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:51.503171 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ba67a851-b6c3-4049-9554-6e47f236c24b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:51.503171 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ba67a851-b6c3-4049-9554-6e47f236c24b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd" status: 200 len: 1362 microversion: 2.25 time: 0.230522 Apr 16 21:09:51.503171 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 489/897] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:09:51 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:09:51.503171 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-38639627-01ab-4ca6-9d6d-83577c5135b9 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:51.503990 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-38639627-01ab-4ca6-9d6d-83577c5135b9 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=137408) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:09:51.515978 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-38639627-01ab-4ca6-9d6d-83577c5135b9 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:51.516529 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-38639627-01ab-4ca6-9d6d-83577c5135b9 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:51.517473 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-38639627-01ab-4ca6-9d6d-83577c5135b9 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:51.518108 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-38639627-01ab-4ca6-9d6d-83577c5135b9 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:51.543235 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-38639627-01ab-4ca6-9d6d-83577c5135b9 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] 10.222.0.20 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.048410 Apr 16 21:09:51.544215 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 490/898] 10.222.0.20 () {58 vars in 1195 bytes} [Sat Apr 16 21:09:51 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:09:51.549632 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-660f8445-70c2-4e5e-aeda-86eec0e549bd req-71436655-e3f8-4e6a-bb26-542cd6e09971 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "615ea5db-3cca-4736-b69a-cc7bdc8f0e6e", "tag": "f83d9a73-0d97-45bc-8f40-3dbeed933e20"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:51.557874 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-660f8445-70c2-4e5e-aeda-86eec0e549bd req-71436655-e3f8-4e6a-bb26-542cd6e09971 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:51.558324 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-660f8445-70c2-4e5e-aeda-86eec0e549bd req-71436655-e3f8-4e6a-bb26-542cd6e09971 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:51.569423 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-660f8445-70c2-4e5e-aeda-86eec0e549bd req-71436655-e3f8-4e6a-bb26-542cd6e09971 service nova] Creating event network-changed:f83d9a73-0d97-45bc-8f40-3dbeed933e20 for instance 615ea5db-3cca-4736-b69a-cc7bdc8f0e6e on nch2-master-1 Apr 16 21:09:51.574103 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-660f8445-70c2-4e5e-aeda-86eec0e549bd req-71436655-e3f8-4e6a-bb26-542cd6e09971 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028702 Apr 16 21:09:51.574692 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 491/899] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:09:51.579724 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-876e0d08-91e8-45a7-8958-11cc2b98ee7f tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:51.580616 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-876e0d08-91e8-45a7-8958-11cc2b98ee7f tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] [instance: bf93495b-7d10-4cb2-9353-0302e654d8fa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:51.587196 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-876e0d08-91e8-45a7-8958-11cc2b98ee7f tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:51.592289 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-876e0d08-91e8-45a7-8958-11cc2b98ee7f tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:51.592289 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-876e0d08-91e8-45a7-8958-11cc2b98ee7f tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:51.592289 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-876e0d08-91e8-45a7-8958-11cc2b98ee7f tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:51.603959 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-876e0d08-91e8-45a7-8958-11cc2b98ee7f tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] HTTP exception thrown: Instance bf93495b-7d10-4cb2-9353-0302e654d8fa could not be found. Apr 16 21:09:51.604705 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-876e0d08-91e8-45a7-8958-11cc2b98ee7f tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] Returning 404 to user: Instance bf93495b-7d10-4cb2-9353-0302e654d8fa could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:09:51.605619 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-876e0d08-91e8-45a7-8958-11cc2b98ee7f tempest-LiveMigrationNegativeTest-860092607 tempest-LiveMigrationNegativeTest-860092607-project] 10.222.0.20 "GET /compute/v2.1/servers/bf93495b-7d10-4cb2-9353-0302e654d8fa" status: 404 len: 111 microversion: 2.1 time: 0.029801 Apr 16 21:09:51.606250 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 492/900] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:51 2022] GET /compute/v2.1/servers/bf93495b-7d10-4cb2-9353-0302e654d8fa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:09:51.611012 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-49332e9b-2221-4093-bdb4-8a15b6905dba tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:51.611621 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-49332e9b-2221-4093-bdb4-8a15b6905dba tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 728c68c3-5252-4e9a-b1d0-c3afdfc8ba35] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:51.625707 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-49332e9b-2221-4093-bdb4-8a15b6905dba tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:51.625707 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-49332e9b-2221-4093-bdb4-8a15b6905dba tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:51.625707 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-49332e9b-2221-4093-bdb4-8a15b6905dba tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:51.625707 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-49332e9b-2221-4093-bdb4-8a15b6905dba tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:51.819092 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-49332e9b-2221-4093-bdb4-8a15b6905dba tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:51.827637 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-49332e9b-2221-4093-bdb4-8a15b6905dba tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/728c68c3-5252-4e9a-b1d0-c3afdfc8ba35" status: 200 len: 1319 microversion: 2.1 time: 0.220318 Apr 16 21:09:51.828439 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 493/901] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:51 2022] GET /compute/v2.1/servers/728c68c3-5252-4e9a-b1d0-c3afdfc8ba35 => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:51.838654 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-064cc249-3482-4359-adf0-1b54bc4fe5f3 req-244246de-846f-430b-a9f4-489804328558 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e26a3424-8bc8-454c-a7e3-507bb1c71c03", "name": "network-vif-plugged", "status": "completed", "tag": "b1f2adf4-34d0-4e59-9590-bd8f2631ee09"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:51.849642 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-064cc249-3482-4359-adf0-1b54bc4fe5f3 req-244246de-846f-430b-a9f4-489804328558 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:51.850364 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-064cc249-3482-4359-adf0-1b54bc4fe5f3 req-244246de-846f-430b-a9f4-489804328558 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:51.865139 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-064cc249-3482-4359-adf0-1b54bc4fe5f3 req-244246de-846f-430b-a9f4-489804328558 service nova] Creating event network-vif-plugged:b1f2adf4-34d0-4e59-9590-bd8f2631ee09 for instance e26a3424-8bc8-454c-a7e3-507bb1c71c03 on nch1-master-1 Apr 16 21:09:51.872334 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-064cc249-3482-4359-adf0-1b54bc4fe5f3 req-244246de-846f-430b-a9f4-489804328558 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042746 Apr 16 21:09:51.874355 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 494/902] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:09:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:09:51.882571 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-842c0871-958b-496f-859f-76901195a13b tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:51.883879 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-842c0871-958b-496f-859f-76901195a13b tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] [instance: 04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:51.947662 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-842c0871-958b-496f-859f-76901195a13b tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db9403ce44e460a8165587ae22f0ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2a21b6df375491fb09fc22109fb4a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:51.957967 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-842c0871-958b-496f-859f-76901195a13b tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88" status: 200 len: 1217 microversion: 2.1 time: 0.081958 Apr 16 21:09:51.960305 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 495/903] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:51 2022] GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88 => generated 1217 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:51.965067 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3daf151a-edb7-4322-a757-7f888f202684 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:51.966019 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3daf151a-edb7-4322-a757-7f888f202684 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:51.974415 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3daf151a-edb7-4322-a757-7f888f202684 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:51.974796 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3daf151a-edb7-4322-a757-7f888f202684 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:51.975611 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3daf151a-edb7-4322-a757-7f888f202684 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:51.976043 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3daf151a-edb7-4322-a757-7f888f202684 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:52.342748 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3daf151a-edb7-4322-a757-7f888f202684 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17/action" status: 202 len: 0 microversion: 2.1 time: 0.381770 Apr 16 21:09:52.343992 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 496/904] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:09:51 2022] POST /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17/action => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:09:52.348565 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-797c2556-d2bb-4026-b5ac-55e7b945be45 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:52.357048 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-797c2556-d2bb-4026-b5ac-55e7b945be45 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 524e8c67-957c-4856-a882-fc0a4befaedd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:52.357048 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-797c2556-d2bb-4026-b5ac-55e7b945be45 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:52.357048 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-797c2556-d2bb-4026-b5ac-55e7b945be45 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:52.357717 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-797c2556-d2bb-4026-b5ac-55e7b945be45 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:52.358182 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-797c2556-d2bb-4026-b5ac-55e7b945be45 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:52.597721 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-797c2556-d2bb-4026-b5ac-55e7b945be45 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:52.606987 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-797c2556-d2bb-4026-b5ac-55e7b945be45 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/524e8c67-957c-4856-a882-fc0a4befaedd" status: 200 len: 1319 microversion: 2.1 time: 0.262181 Apr 16 21:09:52.608735 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 497/905] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:52 2022] GET /compute/v2.1/servers/524e8c67-957c-4856-a882-fc0a4befaedd => generated 1319 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:52.615795 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-cc1ed212-3307-4c0a-9972-1c93584e7213 req-f4c35c81-82a2-4e1d-a822-00e8ac12efdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "524e8c67-957c-4856-a882-fc0a4befaedd", "tag": "afaec7f6-0723-4b6e-9610-7d38f4870889"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:52.624070 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-cc1ed212-3307-4c0a-9972-1c93584e7213 req-f4c35c81-82a2-4e1d-a822-00e8ac12efdb service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:52.624563 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-cc1ed212-3307-4c0a-9972-1c93584e7213 req-f4c35c81-82a2-4e1d-a822-00e8ac12efdb service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:52.637631 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-cc1ed212-3307-4c0a-9972-1c93584e7213 req-f4c35c81-82a2-4e1d-a822-00e8ac12efdb service nova] Creating event network-changed:afaec7f6-0723-4b6e-9610-7d38f4870889 for instance 524e8c67-957c-4856-a882-fc0a4befaedd on nch1-master-1 Apr 16 21:09:52.658683 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-cc1ed212-3307-4c0a-9972-1c93584e7213 req-f4c35c81-82a2-4e1d-a822-00e8ac12efdb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047168 Apr 16 21:09:52.662379 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 498/906] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:09:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:09:52.676227 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-34bed044-cf57-4974-b3c3-e39472e68f52 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:52.678351 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-34bed044-cf57-4974-b3c3-e39472e68f52 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:52.695005 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-34bed044-cf57-4974-b3c3-e39472e68f52 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:52.696153 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-34bed044-cf57-4974-b3c3-e39472e68f52 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:52.697811 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-34bed044-cf57-4974-b3c3-e39472e68f52 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:52.698716 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-34bed044-cf57-4974-b3c3-e39472e68f52 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:52.820988 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-34bed044-cf57-4974-b3c3-e39472e68f52 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:09:52.822714 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-34bed044-cf57-4974-b3c3-e39472e68f52 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:09:52.822714 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-34bed044-cf57-4974-b3c3-e39472e68f52 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:09:52.822714 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-34bed044-cf57-4974-b3c3-e39472e68f52 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:09:52.823509 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-34bed044-cf57-4974-b3c3-e39472e68f52 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:09:53.165517 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-34bed044-cf57-4974-b3c3-e39472e68f52 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:53.178119 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-34bed044-cf57-4974-b3c3-e39472e68f52 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:53.186350 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-34bed044-cf57-4974-b3c3-e39472e68f52 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:53.194715 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-34bed044-cf57-4974-b3c3-e39472e68f52 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:53.194715 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-34bed044-cf57-4974-b3c3-e39472e68f52 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:53.223496 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-34bed044-cf57-4974-b3c3-e39472e68f52 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "POST /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17/action" status: 202 len: 1068 microversion: 2.1 time: 0.559023 Apr 16 21:09:53.224588 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 499/907] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:09:52 2022] POST /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17/action => generated 1068 bytes in 561 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 16 21:09:53.236550 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cdc92fc2-c2b4-475e-9e74-8f42f6a5c30e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:53.236550 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cdc92fc2-c2b4-475e-9e74-8f42f6a5c30e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:53.237388 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cdc92fc2-c2b4-475e-9e74-8f42f6a5c30e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:53.238056 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cdc92fc2-c2b4-475e-9e74-8f42f6a5c30e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:53.239268 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cdc92fc2-c2b4-475e-9e74-8f42f6a5c30e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:53.239929 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cdc92fc2-c2b4-475e-9e74-8f42f6a5c30e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:53.697741 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cdc92fc2-c2b4-475e-9e74-8f42f6a5c30e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:53.714306 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cdc92fc2-c2b4-475e-9e74-8f42f6a5c30e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:53.719046 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cdc92fc2-c2b4-475e-9e74-8f42f6a5c30e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:53.721736 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cdc92fc2-c2b4-475e-9e74-8f42f6a5c30e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd" status: 200 len: 1362 microversion: 2.25 time: 0.495330 Apr 16 21:09:53.724698 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 500/908] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:09:53 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd => generated 1362 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:09:53.731866 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-24b23386-c025-4577-a1b0-53bc20037fd2 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:53.737503 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-24b23386-c025-4577-a1b0-53bc20037fd2 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 728c68c3-5252-4e9a-b1d0-c3afdfc8ba35] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:53.746155 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-24b23386-c025-4577-a1b0-53bc20037fd2 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:53.746647 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-24b23386-c025-4577-a1b0-53bc20037fd2 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:53.747451 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-24b23386-c025-4577-a1b0-53bc20037fd2 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:53.747898 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-24b23386-c025-4577-a1b0-53bc20037fd2 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:54.030550 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-24b23386-c025-4577-a1b0-53bc20037fd2 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:54.038562 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-24b23386-c025-4577-a1b0-53bc20037fd2 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/728c68c3-5252-4e9a-b1d0-c3afdfc8ba35" status: 200 len: 1319 microversion: 2.1 time: 0.315007 Apr 16 21:09:54.039149 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 501/909] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:53 2022] GET /compute/v2.1/servers/728c68c3-5252-4e9a-b1d0-c3afdfc8ba35 => generated 1319 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:54.044160 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4753b211-bdd8-4cf1-a351-c81042e2da22 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:54.044895 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4753b211-bdd8-4cf1-a351-c81042e2da22 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] [instance: 04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:54.051474 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4753b211-bdd8-4cf1-a351-c81042e2da22 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:54.051936 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4753b211-bdd8-4cf1-a351-c81042e2da22 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:54.052783 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4753b211-bdd8-4cf1-a351-c81042e2da22 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:54.053223 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4753b211-bdd8-4cf1-a351-c81042e2da22 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:54.113769 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4753b211-bdd8-4cf1-a351-c81042e2da22 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db9403ce44e460a8165587ae22f0ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2a21b6df375491fb09fc22109fb4a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:54.121254 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4753b211-bdd8-4cf1-a351-c81042e2da22 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88" status: 200 len: 1269 microversion: 2.1 time: 0.081013 Apr 16 21:09:54.121827 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 502/910] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:54 2022] GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88 => generated 1269 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:54.126210 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ad9f9cd9-b632-42aa-bfb8-4c550b5ee850 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:54.126818 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ad9f9cd9-b632-42aa-bfb8-4c550b5ee850 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:54.133101 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ad9f9cd9-b632-42aa-bfb8-4c550b5ee850 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:54.133563 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ad9f9cd9-b632-42aa-bfb8-4c550b5ee850 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:54.134378 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ad9f9cd9-b632-42aa-bfb8-4c550b5ee850 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:54.134826 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ad9f9cd9-b632-42aa-bfb8-4c550b5ee850 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:54.306621 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ad9f9cd9-b632-42aa-bfb8-4c550b5ee850 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:54.314277 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ad9f9cd9-b632-42aa-bfb8-4c550b5ee850 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1472 microversion: 2.1 time: 0.191470 Apr 16 21:09:54.314850 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 503/911] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:54 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1472 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:54.328998 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e32c66ca-27da-4558-9131-ed056b739142 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:54.329615 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e32c66ca-27da-4558-9131-ed056b739142 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 524e8c67-957c-4856-a882-fc0a4befaedd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:54.336321 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e32c66ca-27da-4558-9131-ed056b739142 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:54.336786 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e32c66ca-27da-4558-9131-ed056b739142 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:54.337576 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e32c66ca-27da-4558-9131-ed056b739142 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:54.338110 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e32c66ca-27da-4558-9131-ed056b739142 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:54.380816 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4b56800c-2d25-4bd2-bca9-d5665f7f5a0c tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e/action" status: 202 len: 0 microversion: 2.1 time: 4.656997 Apr 16 21:09:54.381429 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 409/912] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:09:49 2022] POST /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e/action => generated 0 bytes in 4659 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:09:54.386059 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-325874fe-e845-4851-a04f-58bcd7ec3312 req-2e3f5866-a495-4671-99be-8c9661ac5c0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "728c68c3-5252-4e9a-b1d0-c3afdfc8ba35", "name": "network-vif-plugged", "status": "completed", "tag": "60d57b69-5719-4183-b383-e1c20b54b232"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:54.396261 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-325874fe-e845-4851-a04f-58bcd7ec3312 req-2e3f5866-a495-4671-99be-8c9661ac5c0b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:54.396713 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-325874fe-e845-4851-a04f-58bcd7ec3312 req-2e3f5866-a495-4671-99be-8c9661ac5c0b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:54.407095 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-325874fe-e845-4851-a04f-58bcd7ec3312 req-2e3f5866-a495-4671-99be-8c9661ac5c0b service nova] Creating event network-vif-plugged:60d57b69-5719-4183-b383-e1c20b54b232 for instance 728c68c3-5252-4e9a-b1d0-c3afdfc8ba35 on nch1-master-1 Apr 16 21:09:54.413064 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-325874fe-e845-4851-a04f-58bcd7ec3312 req-2e3f5866-a495-4671-99be-8c9661ac5c0b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030293 Apr 16 21:09:54.413647 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 410/913] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:09:54.419051 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-4f27d1da-c1c7-46ed-a9e1-c3b0214615f4 req-1b25f0db-3b26-4fb0-8217-b8800b0aee9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a60c9986-12b3-4fc4-9bde-7bf7f34f90bd", "tag": "69daf0de-dee8-41ab-85fa-24c0d402ba05"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:54.427881 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-4f27d1da-c1c7-46ed-a9e1-c3b0214615f4 req-1b25f0db-3b26-4fb0-8217-b8800b0aee9a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:54.428393 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-4f27d1da-c1c7-46ed-a9e1-c3b0214615f4 req-1b25f0db-3b26-4fb0-8217-b8800b0aee9a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:54.439578 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-4f27d1da-c1c7-46ed-a9e1-c3b0214615f4 req-1b25f0db-3b26-4fb0-8217-b8800b0aee9a service nova] Creating event network-changed:69daf0de-dee8-41ab-85fa-24c0d402ba05 for instance a60c9986-12b3-4fc4-9bde-7bf7f34f90bd on nch2-master-1 Apr 16 21:09:54.444832 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-4f27d1da-c1c7-46ed-a9e1-c3b0214615f4 req-1b25f0db-3b26-4fb0-8217-b8800b0aee9a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029711 Apr 16 21:09:54.445952 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 411/914] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:09:54.451261 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8bcbf399-ec07-43ed-a212-58763d5abc3e tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:54.451961 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8bcbf399-ec07-43ed-a212-58763d5abc3e tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: bc3b9549-fb07-458b-84bf-3f1d36449e6e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:54.458712 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8bcbf399-ec07-43ed-a212-58763d5abc3e tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:54.459203 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8bcbf399-ec07-43ed-a212-58763d5abc3e tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:54.459986 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8bcbf399-ec07-43ed-a212-58763d5abc3e tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:54.460465 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8bcbf399-ec07-43ed-a212-58763d5abc3e tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:54.481258 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e32c66ca-27da-4558-9131-ed056b739142 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:54.494322 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e32c66ca-27da-4558-9131-ed056b739142 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/524e8c67-957c-4856-a882-fc0a4befaedd" status: 200 len: 1319 microversion: 2.1 time: 0.164054 Apr 16 21:09:54.494322 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 504/915] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:54 2022] GET /compute/v2.1/servers/524e8c67-957c-4856-a882-fc0a4befaedd => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:54.596484 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8bcbf399-ec07-43ed-a212-58763d5abc3e tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:54.604610 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8bcbf399-ec07-43ed-a212-58763d5abc3e tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e" status: 200 len: 1503 microversion: 2.1 time: 0.157334 Apr 16 21:09:54.605183 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 412/916] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:54 2022] GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:54.739865 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9c51d374-2f8a-4522-a9c0-0f7cb6442792 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:54.740613 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9c51d374-2f8a-4522-a9c0-0f7cb6442792 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:54.747634 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9c51d374-2f8a-4522-a9c0-0f7cb6442792 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:54.748073 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9c51d374-2f8a-4522-a9c0-0f7cb6442792 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:54.748883 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9c51d374-2f8a-4522-a9c0-0f7cb6442792 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:54.751025 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9c51d374-2f8a-4522-a9c0-0f7cb6442792 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:54.886383 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9c51d374-2f8a-4522-a9c0-0f7cb6442792 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:54.894181 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9c51d374-2f8a-4522-a9c0-0f7cb6442792 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:54.896255 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9c51d374-2f8a-4522-a9c0-0f7cb6442792 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:54.897358 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9c51d374-2f8a-4522-a9c0-0f7cb6442792 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd" status: 200 len: 1362 microversion: 2.25 time: 0.161548 Apr 16 21:09:54.898665 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 505/917] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:09:54 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:09:55.054747 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9c9c773b-2da5-4bba-92c1-46cb63b5dee3 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:55.055334 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9c9c773b-2da5-4bba-92c1-46cb63b5dee3 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 728c68c3-5252-4e9a-b1d0-c3afdfc8ba35] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:55.062485 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9c9c773b-2da5-4bba-92c1-46cb63b5dee3 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:55.063166 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9c9c773b-2da5-4bba-92c1-46cb63b5dee3 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:55.064134 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9c9c773b-2da5-4bba-92c1-46cb63b5dee3 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:55.064766 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9c9c773b-2da5-4bba-92c1-46cb63b5dee3 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:55.138804 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bcb532f1-2086-497c-ae81-17204da86d44 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:55.139421 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-bcb532f1-2086-497c-ae81-17204da86d44 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] [instance: 04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:55.146393 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bcb532f1-2086-497c-ae81-17204da86d44 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:55.146933 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bcb532f1-2086-497c-ae81-17204da86d44 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:55.147904 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bcb532f1-2086-497c-ae81-17204da86d44 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:55.149065 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bcb532f1-2086-497c-ae81-17204da86d44 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:55.211246 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-bcb532f1-2086-497c-ae81-17204da86d44 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db9403ce44e460a8165587ae22f0ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2a21b6df375491fb09fc22109fb4a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:55.219456 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-bcb532f1-2086-497c-ae81-17204da86d44 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88" status: 200 len: 1269 microversion: 2.1 time: 0.084478 Apr 16 21:09:55.220037 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 506/918] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:55 2022] GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88 => generated 1269 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:09:55.319549 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9c9c773b-2da5-4bba-92c1-46cb63b5dee3 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:55.337516 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9c9c773b-2da5-4bba-92c1-46cb63b5dee3 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/728c68c3-5252-4e9a-b1d0-c3afdfc8ba35" status: 200 len: 1319 microversion: 2.1 time: 0.276473 Apr 16 21:09:55.337516 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 413/919] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:55 2022] GET /compute/v2.1/servers/728c68c3-5252-4e9a-b1d0-c3afdfc8ba35 => generated 1319 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:55.337703 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-10bd90bd-6a29-436d-8d7d-01073ae1fa62 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:55.337703 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-10bd90bd-6a29-436d-8d7d-01073ae1fa62 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:55.339664 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-10bd90bd-6a29-436d-8d7d-01073ae1fa62 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:55.340123 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-10bd90bd-6a29-436d-8d7d-01073ae1fa62 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:55.340924 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-10bd90bd-6a29-436d-8d7d-01073ae1fa62 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:55.341365 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-10bd90bd-6a29-436d-8d7d-01073ae1fa62 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:55.474668 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-10bd90bd-6a29-436d-8d7d-01073ae1fa62 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:55.479752 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-10bd90bd-6a29-436d-8d7d-01073ae1fa62 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1472 microversion: 2.1 time: 0.151814 Apr 16 21:09:55.480551 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 507/920] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:55 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1472 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:09:55.514148 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0efa64cb-bb6d-49f0-8973-be0900b873e5 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:55.514148 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0efa64cb-bb6d-49f0-8973-be0900b873e5 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 524e8c67-957c-4856-a882-fc0a4befaedd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:55.514148 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0efa64cb-bb6d-49f0-8973-be0900b873e5 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:55.514148 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0efa64cb-bb6d-49f0-8973-be0900b873e5 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:55.514901 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0efa64cb-bb6d-49f0-8973-be0900b873e5 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:55.514901 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0efa64cb-bb6d-49f0-8973-be0900b873e5 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:55.622394 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fc2c25d4-d562-407f-9361-20ca287f77a2 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:55.623333 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fc2c25d4-d562-407f-9361-20ca287f77a2 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: bc3b9549-fb07-458b-84bf-3f1d36449e6e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:55.630508 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fc2c25d4-d562-407f-9361-20ca287f77a2 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:55.631056 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fc2c25d4-d562-407f-9361-20ca287f77a2 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:55.632069 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fc2c25d4-d562-407f-9361-20ca287f77a2 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:55.632585 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fc2c25d4-d562-407f-9361-20ca287f77a2 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:55.697843 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0efa64cb-bb6d-49f0-8973-be0900b873e5 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:55.704508 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0efa64cb-bb6d-49f0-8973-be0900b873e5 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/524e8c67-957c-4856-a882-fc0a4befaedd" status: 200 len: 1319 microversion: 2.1 time: 0.201972 Apr 16 21:09:55.705433 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 414/921] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:55 2022] GET /compute/v2.1/servers/524e8c67-957c-4856-a882-fc0a4befaedd => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:55.776429 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fc2c25d4-d562-407f-9361-20ca287f77a2 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:55.784438 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fc2c25d4-d562-407f-9361-20ca287f77a2 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e" status: 200 len: 1503 microversion: 2.1 time: 0.166094 Apr 16 21:09:55.785529 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 508/922] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:55 2022] GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e => generated 1503 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:09:55.916541 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ef565ab1-f367-4ede-9204-2c57c4af3af4 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:55.917157 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ef565ab1-f367-4ede-9204-2c57c4af3af4 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:55.923381 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ef565ab1-f367-4ede-9204-2c57c4af3af4 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:55.923910 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ef565ab1-f367-4ede-9204-2c57c4af3af4 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:55.924723 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ef565ab1-f367-4ede-9204-2c57c4af3af4 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:55.925163 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ef565ab1-f367-4ede-9204-2c57c4af3af4 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:56.064293 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ef565ab1-f367-4ede-9204-2c57c4af3af4 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:56.073031 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ef565ab1-f367-4ede-9204-2c57c4af3af4 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:56.074667 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ef565ab1-f367-4ede-9204-2c57c4af3af4 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:56.075868 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ef565ab1-f367-4ede-9204-2c57c4af3af4 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd" status: 200 len: 1362 microversion: 2.25 time: 0.163786 Apr 16 21:09:56.079181 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-53b96d39-6054-4a46-8e2c-b608c1f72f77 tempest-SecurityGroupsTestAdminJSON-2061309716 tempest-SecurityGroupsTestAdminJSON-2061309716-project] Action: 'create', calling method: .version_select at 0x7fbb96a5cd30>, body: {"security_group": {"name": "tempest-securitygroup-2144332963", "description": "tempest-description-1737292476"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:56.087124 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 509/923] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:09:55 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:09:56.237060 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5667bcbe-e44b-4c3b-889d-7935c70d8be5 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:56.237670 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5667bcbe-e44b-4c3b-889d-7935c70d8be5 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] [instance: 04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:56.244917 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5667bcbe-e44b-4c3b-889d-7935c70d8be5 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:56.245677 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5667bcbe-e44b-4c3b-889d-7935c70d8be5 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:56.246461 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5667bcbe-e44b-4c3b-889d-7935c70d8be5 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:56.246910 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5667bcbe-e44b-4c3b-889d-7935c70d8be5 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:56.309598 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5667bcbe-e44b-4c3b-889d-7935c70d8be5 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db9403ce44e460a8165587ae22f0ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2a21b6df375491fb09fc22109fb4a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:56.317919 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5667bcbe-e44b-4c3b-889d-7935c70d8be5 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88" status: 200 len: 1269 microversion: 2.1 time: 0.085800 Apr 16 21:09:56.318424 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 510/924] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:56 2022] GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88 => generated 1269 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:09:56.344556 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3d33e4e0-5ce7-4b0c-a657-45acf312a12b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:56.345162 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3d33e4e0-5ce7-4b0c-a657-45acf312a12b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 728c68c3-5252-4e9a-b1d0-c3afdfc8ba35] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:56.351281 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d33e4e0-5ce7-4b0c-a657-45acf312a12b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:56.351732 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d33e4e0-5ce7-4b0c-a657-45acf312a12b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:56.352536 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d33e4e0-5ce7-4b0c-a657-45acf312a12b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:56.352975 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d33e4e0-5ce7-4b0c-a657-45acf312a12b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:56.501963 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3d33e4e0-5ce7-4b0c-a657-45acf312a12b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:56.510497 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3d33e4e0-5ce7-4b0c-a657-45acf312a12b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/728c68c3-5252-4e9a-b1d0-c3afdfc8ba35" status: 200 len: 1319 microversion: 2.1 time: 0.169408 Apr 16 21:09:56.519963 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 511/925] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:56 2022] GET /compute/v2.1/servers/728c68c3-5252-4e9a-b1d0-c3afdfc8ba35 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:09:56.519963 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-f92e244c-c10d-4d7c-a22b-c9adc073f05b req-9b4e8a69-f004-4cdd-874b-2f67d8797749 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b27c826-905d-4c1f-9daf-42150b1025a8", "name": "network-vif-plugged", "status": "completed", "tag": "2c7070d9-a898-425b-bd50-ce8c757adf87"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:56.524066 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-f92e244c-c10d-4d7c-a22b-c9adc073f05b req-9b4e8a69-f004-4cdd-874b-2f67d8797749 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:56.524585 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-f92e244c-c10d-4d7c-a22b-c9adc073f05b req-9b4e8a69-f004-4cdd-874b-2f67d8797749 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:56.535740 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-f92e244c-c10d-4d7c-a22b-c9adc073f05b req-9b4e8a69-f004-4cdd-874b-2f67d8797749 service nova] Creating event network-vif-plugged:2c7070d9-a898-425b-bd50-ce8c757adf87 for instance 2b27c826-905d-4c1f-9daf-42150b1025a8 on nch2-master-1 Apr 16 21:09:56.540803 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-f92e244c-c10d-4d7c-a22b-c9adc073f05b req-9b4e8a69-f004-4cdd-874b-2f67d8797749 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028201 Apr 16 21:09:56.541398 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 512/926] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:09:56.546626 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9eeb6085-0865-495c-8568-3aa10232c514 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:56.547222 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9eeb6085-0865-495c-8568-3aa10232c514 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:56.557683 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9eeb6085-0865-495c-8568-3aa10232c514 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:56.557683 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9eeb6085-0865-495c-8568-3aa10232c514 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:56.557683 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9eeb6085-0865-495c-8568-3aa10232c514 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:56.557683 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9eeb6085-0865-495c-8568-3aa10232c514 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:56.702950 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9eeb6085-0865-495c-8568-3aa10232c514 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:56.710821 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9eeb6085-0865-495c-8568-3aa10232c514 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1472 microversion: 2.1 time: 0.168249 Apr 16 21:09:56.711540 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 513/927] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:56 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1472 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:56.721700 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-79a0a49e-2bdb-4515-848e-719b09a3a4de tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:56.722861 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-79a0a49e-2bdb-4515-848e-719b09a3a4de tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 524e8c67-957c-4856-a882-fc0a4befaedd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:56.728772 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-79a0a49e-2bdb-4515-848e-719b09a3a4de tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:56.729226 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-79a0a49e-2bdb-4515-848e-719b09a3a4de tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:56.730329 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-79a0a49e-2bdb-4515-848e-719b09a3a4de tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:56.730449 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-79a0a49e-2bdb-4515-848e-719b09a3a4de tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:56.816772 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-53b96d39-6054-4a46-8e2c-b608c1f72f77 tempest-SecurityGroupsTestAdminJSON-2061309716 tempest-SecurityGroupsTestAdminJSON-2061309716-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.921263 Apr 16 21:09:56.817358 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 415/928] 10.222.0.20 () {60 vars in 1179 bytes} [Sat Apr 16 21:09:55 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:09:56.825172 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-be2141d6-11a6-4e6d-85aa-39c5986791da tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:56.825998 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-be2141d6-11a6-4e6d-85aa-39c5986791da tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: bc3b9549-fb07-458b-84bf-3f1d36449e6e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:56.833726 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-be2141d6-11a6-4e6d-85aa-39c5986791da tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:56.834423 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-be2141d6-11a6-4e6d-85aa-39c5986791da tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:56.835448 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-be2141d6-11a6-4e6d-85aa-39c5986791da tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:56.836084 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-be2141d6-11a6-4e6d-85aa-39c5986791da tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:57.057030 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-79a0a49e-2bdb-4515-848e-719b09a3a4de tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:57.067950 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-79a0a49e-2bdb-4515-848e-719b09a3a4de tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/524e8c67-957c-4856-a882-fc0a4befaedd" status: 200 len: 1319 microversion: 2.1 time: 0.349812 Apr 16 21:09:57.068634 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 514/929] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:56 2022] GET /compute/v2.1/servers/524e8c67-957c-4856-a882-fc0a4befaedd => generated 1319 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:09:57.079363 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b1debeac-cbed-48e3-90ee-663c2d0abb50 tempest-SecurityGroupsTestAdminJSON-2061309716 tempest-SecurityGroupsTestAdminJSON-2061309716-project] Action: 'create', calling method: .version_select at 0x7fbb96aef5e0>, body: {"security_group": {"name": "tempest-securitygroup-720196585", "description": "tempest-description-554557976"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:57.086119 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-be2141d6-11a6-4e6d-85aa-39c5986791da tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:57.096871 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-be2141d6-11a6-4e6d-85aa-39c5986791da tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e" status: 200 len: 1503 microversion: 2.1 time: 0.277193 Apr 16 21:09:57.100828 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 416/930] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:56 2022] GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e => generated 1503 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:57.112377 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cab8a14a-9c66-4704-8fe5-35878d8afefe tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:57.113801 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-cab8a14a-9c66-4704-8fe5-35878d8afefe tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:57.128326 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cab8a14a-9c66-4704-8fe5-35878d8afefe tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:57.131565 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cab8a14a-9c66-4704-8fe5-35878d8afefe tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:57.131565 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cab8a14a-9c66-4704-8fe5-35878d8afefe tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:57.133393 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cab8a14a-9c66-4704-8fe5-35878d8afefe tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:57.270852 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cab8a14a-9c66-4704-8fe5-35878d8afefe tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:57.279551 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cab8a14a-9c66-4704-8fe5-35878d8afefe tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:57.281667 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cab8a14a-9c66-4704-8fe5-35878d8afefe tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:57.282972 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cab8a14a-9c66-4704-8fe5-35878d8afefe tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd" status: 200 len: 1362 microversion: 2.25 time: 0.180433 Apr 16 21:09:57.283732 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 417/931] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:09:57 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:09:57.334868 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-89af6f2c-949a-4794-99cf-60b14f275a79 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:57.335485 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-89af6f2c-949a-4794-99cf-60b14f275a79 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] [instance: 04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:57.341349 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-89af6f2c-949a-4794-99cf-60b14f275a79 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:57.343212 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-89af6f2c-949a-4794-99cf-60b14f275a79 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:57.343212 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-89af6f2c-949a-4794-99cf-60b14f275a79 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:57.343212 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-89af6f2c-949a-4794-99cf-60b14f275a79 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:57.425666 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-89af6f2c-949a-4794-99cf-60b14f275a79 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db9403ce44e460a8165587ae22f0ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2a21b6df375491fb09fc22109fb4a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:57.436416 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-89af6f2c-949a-4794-99cf-60b14f275a79 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88" status: 200 len: 1277 microversion: 2.1 time: 0.106224 Apr 16 21:09:57.447571 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 418/932] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:57 2022] GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88 => generated 1277 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:09:57.526922 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e2d96149-13df-4e63-bace-161055ce7a94 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:57.527861 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e2d96149-13df-4e63-bace-161055ce7a94 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 728c68c3-5252-4e9a-b1d0-c3afdfc8ba35] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:57.533894 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e2d96149-13df-4e63-bace-161055ce7a94 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:57.534465 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e2d96149-13df-4e63-bace-161055ce7a94 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:57.535347 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e2d96149-13df-4e63-bace-161055ce7a94 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:57.535860 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e2d96149-13df-4e63-bace-161055ce7a94 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:57.576191 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b1debeac-cbed-48e3-90ee-663c2d0abb50 tempest-SecurityGroupsTestAdminJSON-2061309716 tempest-SecurityGroupsTestAdminJSON-2061309716-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.506565 Apr 16 21:09:57.577189 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 515/933] 10.222.0.20 () {60 vars in 1179 bytes} [Sat Apr 16 21:09:57 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:09:57.649029 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-be632b33-943b-4b60-a204-fb8e223a72e9 tempest-SecurityGroupsTestAdminJSON-1482374319 tempest-SecurityGroupsTestAdminJSON-1482374319-project-admin] Action: 'create', calling method: .version_select at 0x7fbb9cd4f550>, body: {"security_group": {"name": "tempest-securitygroup-38348813", "description": "tempest-description-1772403708"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:57.808052 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e2d96149-13df-4e63-bace-161055ce7a94 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:57.817694 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e2d96149-13df-4e63-bace-161055ce7a94 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/728c68c3-5252-4e9a-b1d0-c3afdfc8ba35" status: 200 len: 1469 microversion: 2.1 time: 0.294715 Apr 16 21:09:57.819060 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 419/934] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:57 2022] GET /compute/v2.1/servers/728c68c3-5252-4e9a-b1d0-c3afdfc8ba35 => generated 1469 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:09:57.835236 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-55c23f73-51da-44d1-9924-9cd960e797a6 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:57.835891 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-55c23f73-51da-44d1-9924-9cd960e797a6 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:57.841804 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-55c23f73-51da-44d1-9924-9cd960e797a6 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:57.842261 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-55c23f73-51da-44d1-9924-9cd960e797a6 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:57.843169 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-55c23f73-51da-44d1-9924-9cd960e797a6 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:57.843614 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-55c23f73-51da-44d1-9924-9cd960e797a6 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:58.178794 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-55c23f73-51da-44d1-9924-9cd960e797a6 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:58.197059 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-55c23f73-51da-44d1-9924-9cd960e797a6 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1472 microversion: 2.1 time: 0.365484 Apr 16 21:09:58.213035 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 420/935] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:57 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1472 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:58.223018 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a057ffe4-b527-4980-b913-edb37bb16c04 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:58.224074 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a057ffe4-b527-4980-b913-edb37bb16c04 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: e26a3424-8bc8-454c-a7e3-507bb1c71c03] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:58.231472 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a057ffe4-b527-4980-b913-edb37bb16c04 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:58.232500 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a057ffe4-b527-4980-b913-edb37bb16c04 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:58.233749 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a057ffe4-b527-4980-b913-edb37bb16c04 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:58.234343 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a057ffe4-b527-4980-b913-edb37bb16c04 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:58.239504 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-be632b33-943b-4b60-a204-fb8e223a72e9 tempest-SecurityGroupsTestAdminJSON-1482374319 tempest-SecurityGroupsTestAdminJSON-1482374319-project-admin] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.654790 Apr 16 21:09:58.240942 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 516/936] 10.222.0.20 () {60 vars in 1179 bytes} [Sat Apr 16 21:09:57 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:09:58.246920 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ca59abae-ac5a-436d-9e17-44c65e99d789 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:58.247606 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ca59abae-ac5a-436d-9e17-44c65e99d789 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 524e8c67-957c-4856-a882-fc0a4befaedd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:58.265208 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ca59abae-ac5a-436d-9e17-44c65e99d789 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:58.265673 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ca59abae-ac5a-436d-9e17-44c65e99d789 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:58.266481 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ca59abae-ac5a-436d-9e17-44c65e99d789 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:58.270485 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ca59abae-ac5a-436d-9e17-44c65e99d789 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:58.440812 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ca59abae-ac5a-436d-9e17-44c65e99d789 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:58.448682 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ca59abae-ac5a-436d-9e17-44c65e99d789 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/524e8c67-957c-4856-a882-fc0a4befaedd" status: 200 len: 1319 microversion: 2.1 time: 0.206549 Apr 16 21:09:58.449298 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 517/937] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:58 2022] GET /compute/v2.1/servers/524e8c67-957c-4856-a882-fc0a4befaedd => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:58.462569 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-19615196-5925-491a-9b07-9bd6d94f2018 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:58.463229 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-19615196-5925-491a-9b07-9bd6d94f2018 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: bc3b9549-fb07-458b-84bf-3f1d36449e6e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:58.469050 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-19615196-5925-491a-9b07-9bd6d94f2018 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:58.470165 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-19615196-5925-491a-9b07-9bd6d94f2018 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:58.470323 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-19615196-5925-491a-9b07-9bd6d94f2018 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:58.470939 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-19615196-5925-491a-9b07-9bd6d94f2018 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:58.550007 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a057ffe4-b527-4980-b913-edb37bb16c04 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:58.558303 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a057ffe4-b527-4980-b913-edb37bb16c04 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/e26a3424-8bc8-454c-a7e3-507bb1c71c03" status: 200 len: 1469 microversion: 2.1 time: 0.342999 Apr 16 21:09:58.560729 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 421/938] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:58 2022] GET /compute/v2.1/servers/e26a3424-8bc8-454c-a7e3-507bb1c71c03 => generated 1469 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:58.568258 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-75e879d5-a960-4079-bb6d-6524d4b8b6ed tempest-SecurityGroupsTestAdminJSON-1482374319 tempest-SecurityGroupsTestAdminJSON-1482374319-project-admin] Action: 'create', calling method: .version_select at 0x7fbb96a6f0d0>, body: {"security_group": {"name": "tempest-securitygroup-1293271205", "description": "tempest-description-1354202836"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:58.740598 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-19615196-5925-491a-9b07-9bd6d94f2018 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:58.752315 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-19615196-5925-491a-9b07-9bd6d94f2018 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e" status: 200 len: 1503 microversion: 2.1 time: 0.292859 Apr 16 21:09:58.753205 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 518/939] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:58 2022] GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e => generated 1503 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:58.759337 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-17b60be8-0613-4975-aaef-9afb1b01b0f3 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:58.760030 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-17b60be8-0613-4975-aaef-9afb1b01b0f3 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:58.767602 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-17b60be8-0613-4975-aaef-9afb1b01b0f3 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:58.768366 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-17b60be8-0613-4975-aaef-9afb1b01b0f3 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:58.770944 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-17b60be8-0613-4975-aaef-9afb1b01b0f3 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:58.771417 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-17b60be8-0613-4975-aaef-9afb1b01b0f3 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:58.916248 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-17b60be8-0613-4975-aaef-9afb1b01b0f3 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:58.929959 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-17b60be8-0613-4975-aaef-9afb1b01b0f3 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:58.939453 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-17b60be8-0613-4975-aaef-9afb1b01b0f3 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:58.940714 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-17b60be8-0613-4975-aaef-9afb1b01b0f3 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd" status: 200 len: 1362 microversion: 2.25 time: 0.185708 Apr 16 21:09:58.948974 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 519/940] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:09:58 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:09:58.961286 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-88347fd9-ab6c-4b62-acd3-c6cacbe637c5 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:58.962111 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-88347fd9-ab6c-4b62-acd3-c6cacbe637c5 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] [instance: 04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:58.968029 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-88347fd9-ab6c-4b62-acd3-c6cacbe637c5 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:58.968533 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-88347fd9-ab6c-4b62-acd3-c6cacbe637c5 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:58.969366 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-88347fd9-ab6c-4b62-acd3-c6cacbe637c5 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:58.969809 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-88347fd9-ab6c-4b62-acd3-c6cacbe637c5 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:59.122937 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-88347fd9-ab6c-4b62-acd3-c6cacbe637c5 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db9403ce44e460a8165587ae22f0ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2a21b6df375491fb09fc22109fb4a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:59.132357 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-88347fd9-ab6c-4b62-acd3-c6cacbe637c5 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88" status: 200 len: 1317 microversion: 2.1 time: 0.182115 Apr 16 21:09:59.133563 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 520/941] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:58 2022] GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88 => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:59.139489 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-59fcc5b9-d349-4838-aeca-74a14e2a91aa tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:59.145964 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-59fcc5b9-d349-4838-aeca-74a14e2a91aa tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:59.146998 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-59fcc5b9-d349-4838-aeca-74a14e2a91aa tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Searching by: {'reservation_id': 'r-ryz84w30', 'deleted': False, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d'} {{(pid=137408) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:09:59.152861 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-59fcc5b9-d349-4838-aeca-74a14e2a91aa tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:59.153578 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-59fcc5b9-d349-4838-aeca-74a14e2a91aa tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:59.154398 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-59fcc5b9-d349-4838-aeca-74a14e2a91aa tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:59.154840 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-59fcc5b9-d349-4838-aeca-74a14e2a91aa tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:59.317145 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.multi_cell_list [None req-59fcc5b9-d349-4838-aeca-74a14e2a91aa tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=137408) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 16 21:09:59.399849 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-59fcc5b9-d349-4838-aeca-74a14e2a91aa tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:59.412810 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-59fcc5b9-d349-4838-aeca-74a14e2a91aa tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:59.412810 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-59fcc5b9-d349-4838-aeca-74a14e2a91aa tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:59.445586 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-75e879d5-a960-4079-bb6d-6524d4b8b6ed tempest-SecurityGroupsTestAdminJSON-1482374319 tempest-SecurityGroupsTestAdminJSON-1482374319-project-admin] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.875325 Apr 16 21:09:59.445586 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 422/942] 10.222.0.20 () {60 vars in 1179 bytes} [Sat Apr 16 21:09:58 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:09:59.449987 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9f491c9e-5d17-415c-ac9e-7d85793a59a1 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:59.450608 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9f491c9e-5d17-415c-ac9e-7d85793a59a1 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:59.468565 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9f491c9e-5d17-415c-ac9e-7d85793a59a1 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:59.469266 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9f491c9e-5d17-415c-ac9e-7d85793a59a1 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:59.470348 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9f491c9e-5d17-415c-ac9e-7d85793a59a1 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:59.473226 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9f491c9e-5d17-415c-ac9e-7d85793a59a1 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:59.580958 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-59fcc5b9-d349-4838-aeca-74a14e2a91aa tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?reservation_id=r-ryz84w30" status: 200 len: 2931 microversion: 2.1 time: 0.446061 Apr 16 21:09:59.588297 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 521/943] 10.222.0.20 () {58 vars in 1196 bytes} [Sat Apr 16 21:09:59 2022] GET /compute/v2.1/servers/detail?reservation_id=r-ryz84w30 => generated 2931 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:59.588297 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-116fdea2-9545-4479-beed-f39d4293afca req-d0c1de71-49a6-492c-8724-58768d255178 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "524e8c67-957c-4856-a882-fc0a4befaedd", "name": "network-vif-plugged", "status": "completed", "tag": "afaec7f6-0723-4b6e-9610-7d38f4870889"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:59.596511 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-116fdea2-9545-4479-beed-f39d4293afca req-d0c1de71-49a6-492c-8724-58768d255178 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:59.597028 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-116fdea2-9545-4479-beed-f39d4293afca req-d0c1de71-49a6-492c-8724-58768d255178 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:59.608350 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-116fdea2-9545-4479-beed-f39d4293afca req-d0c1de71-49a6-492c-8724-58768d255178 service nova] Creating event network-vif-plugged:afaec7f6-0723-4b6e-9610-7d38f4870889 for instance 524e8c67-957c-4856-a882-fc0a4befaedd on nch1-master-1 Apr 16 21:09:59.614471 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-116fdea2-9545-4479-beed-f39d4293afca req-d0c1de71-49a6-492c-8724-58768d255178 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030638 Apr 16 21:09:59.615112 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 522/944] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:09:59.624695 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-574f46b3-7eaf-4529-a903-b88162461c67 tempest-SecurityGroupsTestAdminJSON-1482374319 tempest-SecurityGroupsTestAdminJSON-1482374319-project-admin] Calling method '.version_select at 0x7fbb96817ca0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:59.630723 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9f491c9e-5d17-415c-ac9e-7d85793a59a1 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:59.638485 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9f491c9e-5d17-415c-ac9e-7d85793a59a1 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1472 microversion: 2.1 time: 0.196092 Apr 16 21:09:59.639264 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 423/945] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:59 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1472 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:59.652798 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1a258b7a-c500-4d5b-92e5-b4120e87de2c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:09:59.653407 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1a258b7a-c500-4d5b-92e5-b4120e87de2c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 524e8c67-957c-4856-a882-fc0a4befaedd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:09:59.662679 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1a258b7a-c500-4d5b-92e5-b4120e87de2c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:59.663117 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1a258b7a-c500-4d5b-92e5-b4120e87de2c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:59.663908 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1a258b7a-c500-4d5b-92e5-b4120e87de2c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:59.664375 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1a258b7a-c500-4d5b-92e5-b4120e87de2c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:59.951543 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1a258b7a-c500-4d5b-92e5-b4120e87de2c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:09:59.962489 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1a258b7a-c500-4d5b-92e5-b4120e87de2c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/524e8c67-957c-4856-a882-fc0a4befaedd" status: 200 len: 1319 microversion: 2.1 time: 0.322040 Apr 16 21:09:59.963332 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 424/946] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:09:59 2022] GET /compute/v2.1/servers/524e8c67-957c-4856-a882-fc0a4befaedd => generated 1319 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:09:59.968308 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-b85bce7f-5a2b-4ffc-bf97-508eb96ce833 req-724d44b6-7745-4340-b39c-837b1d9370d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc3b9549-fb07-458b-84bf-3f1d36449e6e", "name": "network-vif-unplugged", "status": "completed", "tag": "a34708cf-de0c-422b-ad52-0051f88b2bb4"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:09:59.978157 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-b85bce7f-5a2b-4ffc-bf97-508eb96ce833 req-724d44b6-7745-4340-b39c-837b1d9370d2 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:09:59.978841 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-b85bce7f-5a2b-4ffc-bf97-508eb96ce833 req-724d44b6-7745-4340-b39c-837b1d9370d2 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:09:59.991788 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-b85bce7f-5a2b-4ffc-bf97-508eb96ce833 req-724d44b6-7745-4340-b39c-837b1d9370d2 service nova] Creating event network-vif-unplugged:a34708cf-de0c-422b-ad52-0051f88b2bb4 for instance bc3b9549-fb07-458b-84bf-3f1d36449e6e on nch2-master-1 Apr 16 21:09:59.996925 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-b85bce7f-5a2b-4ffc-bf97-508eb96ce833 req-724d44b6-7745-4340-b39c-837b1d9370d2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032209 Apr 16 21:09:59.997630 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 425/947] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:10:00.002890 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a3d71deb-9635-46ca-be40-ed76ecd0a85c tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:00.017183 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.compute.server_groups [None req-a3d71deb-9635-46ca-be40-ed76ecd0a85c tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Querying cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) for 2 instances {{(pid=137409) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Apr 16 21:10:00.017992 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a3d71deb-9635-46ca-be40-ed76ecd0a85c tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:00.018446 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a3d71deb-9635-46ca-be40-ed76ecd0a85c tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:00.050217 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a3d71deb-9635-46ca-be40-ed76ecd0a85c tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/4627cf89-35ca-4dbd-84b8-c29fcd53e795" status: 200 len: 266 microversion: 2.1 time: 0.051327 Apr 16 21:10:00.051308 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 426/948] 10.222.0.20 () {58 vars in 1262 bytes} [Sat Apr 16 21:09:59 2022] GET /compute/v2.1/os-server-groups/4627cf89-35ca-4dbd-84b8-c29fcd53e795 => generated 266 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:10:00.056064 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ab70dd8b-50d2-4938-b003-0a97d346127d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:00.056689 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ab70dd8b-50d2-4938-b003-0a97d346127d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: bc3b9549-fb07-458b-84bf-3f1d36449e6e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:00.062538 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ab70dd8b-50d2-4938-b003-0a97d346127d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:00.063628 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ab70dd8b-50d2-4938-b003-0a97d346127d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:00.068846 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ab70dd8b-50d2-4938-b003-0a97d346127d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:00.072551 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ab70dd8b-50d2-4938-b003-0a97d346127d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:00.281135 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ab70dd8b-50d2-4938-b003-0a97d346127d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:00.288947 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ab70dd8b-50d2-4938-b003-0a97d346127d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e" status: 200 len: 1503 microversion: 2.1 time: 0.236650 Apr 16 21:10:00.289498 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 427/949] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:00 2022] GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e => generated 1503 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:00.294291 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bb7ac02b-ef61-4c32-99ef-742f75ce888e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:00.295058 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bb7ac02b-ef61-4c32-99ef-742f75ce888e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:00.307127 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bb7ac02b-ef61-4c32-99ef-742f75ce888e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:00.307587 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bb7ac02b-ef61-4c32-99ef-742f75ce888e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:00.308395 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bb7ac02b-ef61-4c32-99ef-742f75ce888e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:00.308838 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bb7ac02b-ef61-4c32-99ef-742f75ce888e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:00.454010 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-bb7ac02b-ef61-4c32-99ef-742f75ce888e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:00.463341 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-bb7ac02b-ef61-4c32-99ef-742f75ce888e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:00.464923 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-bb7ac02b-ef61-4c32-99ef-742f75ce888e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:00.466071 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bb7ac02b-ef61-4c32-99ef-742f75ce888e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd" status: 200 len: 1362 microversion: 2.25 time: 0.175452 Apr 16 21:10:00.466636 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 428/950] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:10:00 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:10:00.471408 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9650380f-166c-4cab-b947-1dacfb8d705c tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:00.472900 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9650380f-166c-4cab-b947-1dacfb8d705c tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] [instance: 728c68c3-5252-4e9a-b1d0-c3afdfc8ba35] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:00.479366 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9650380f-166c-4cab-b947-1dacfb8d705c tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:00.482682 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9650380f-166c-4cab-b947-1dacfb8d705c tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:00.482682 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9650380f-166c-4cab-b947-1dacfb8d705c tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:00.482682 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9650380f-166c-4cab-b947-1dacfb8d705c tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:00.618141 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9650380f-166c-4cab-b947-1dacfb8d705c tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/728c68c3-5252-4e9a-b1d0-c3afdfc8ba35" status: 200 len: 1620 microversion: 2.1 time: 0.150205 Apr 16 21:10:00.618730 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 429/951] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:00 2022] GET /compute/v2.1/servers/728c68c3-5252-4e9a-b1d0-c3afdfc8ba35 => generated 1620 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:00.623222 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5151c9df-ead5-4f13-ac99-a480ba62f770 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:00.623833 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5151c9df-ead5-4f13-ac99-a480ba62f770 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] [instance: 04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:00.630871 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5151c9df-ead5-4f13-ac99-a480ba62f770 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:00.631332 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5151c9df-ead5-4f13-ac99-a480ba62f770 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:00.632132 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5151c9df-ead5-4f13-ac99-a480ba62f770 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:00.632601 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5151c9df-ead5-4f13-ac99-a480ba62f770 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:00.770153 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5151c9df-ead5-4f13-ac99-a480ba62f770 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db9403ce44e460a8165587ae22f0ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2a21b6df375491fb09fc22109fb4a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:00.777717 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5151c9df-ead5-4f13-ac99-a480ba62f770 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88" status: 200 len: 1317 microversion: 2.1 time: 0.157995 Apr 16 21:10:00.778512 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 430/952] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:00 2022] GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:00.783178 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f18cc8b3-bd31-49d4-aa76-d9a793fe3677 tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:00.783725 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f18cc8b3-bd31-49d4-aa76-d9a793fe3677 tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] [instance: e26a3424-8bc8-454c-a7e3-507bb1c71c03] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:00.790183 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f18cc8b3-bd31-49d4-aa76-d9a793fe3677 tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:00.790637 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f18cc8b3-bd31-49d4-aa76-d9a793fe3677 tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:00.791402 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f18cc8b3-bd31-49d4-aa76-d9a793fe3677 tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:00.791841 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f18cc8b3-bd31-49d4-aa76-d9a793fe3677 tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:00.913116 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f18cc8b3-bd31-49d4-aa76-d9a793fe3677 tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/e26a3424-8bc8-454c-a7e3-507bb1c71c03" status: 200 len: 1620 microversion: 2.1 time: 0.133180 Apr 16 21:10:00.913691 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 431/953] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:00 2022] GET /compute/v2.1/servers/e26a3424-8bc8-454c-a7e3-507bb1c71c03 => generated 1620 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:00.921202 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5e9d69be-615f-4878-bea5-b37b8055aefb tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:00.921202 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5e9d69be-615f-4878-bea5-b37b8055aefb tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:00.924609 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5e9d69be-615f-4878-bea5-b37b8055aefb tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:00.925066 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5e9d69be-615f-4878-bea5-b37b8055aefb tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:00.926625 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5e9d69be-615f-4878-bea5-b37b8055aefb tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:00.926818 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5e9d69be-615f-4878-bea5-b37b8055aefb tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:01.058528 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5e9d69be-615f-4878-bea5-b37b8055aefb tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:01.066048 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5e9d69be-615f-4878-bea5-b37b8055aefb tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1472 microversion: 2.1 time: 0.151392 Apr 16 21:10:01.066623 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 432/954] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:00 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1472 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:01.071194 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0a33c589-87da-4a0b-8b61-f61c54dde0dd tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Action: 'create', calling method: .version_select at 0x7fbb96a58430>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1336039266", "policies": ["anti-affinity"]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:10:01.086717 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-0a33c589-87da-4a0b-8b61-f61c54dde0dd tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Getting quotas for project cd7c434915254744b7a0409ab8e6d33d. Resources: {'server_groups'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:10:01.091879 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-0a33c589-87da-4a0b-8b61-f61c54dde0dd tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Getting quotas for user 79f97c1afe5442dc83319237d121c11f and project cd7c434915254744b7a0409ab8e6d33d. Resources: {'server_groups'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:10:01.224979 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-0a33c589-87da-4a0b-8b61-f61c54dde0dd tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Getting quotas for project cd7c434915254744b7a0409ab8e6d33d. Resources: {'server_groups'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:10:01.230112 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-0a33c589-87da-4a0b-8b61-f61c54dde0dd tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Getting quotas for user 79f97c1afe5442dc83319237d121c11f and project cd7c434915254744b7a0409ab8e6d33d. Resources: {'server_groups'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:10:01.244051 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0a33c589-87da-4a0b-8b61-f61c54dde0dd tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.176139 Apr 16 21:10:01.256072 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 433/955] 10.222.0.20 () {60 vars in 1173 bytes} [Sat Apr 16 21:10:01 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:10:01.261949 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9efefabc-f5b8-4b00-b02e-1df02f1a470f tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:01.262647 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9efefabc-f5b8-4b00-b02e-1df02f1a470f tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 524e8c67-957c-4856-a882-fc0a4befaedd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:01.270369 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9efefabc-f5b8-4b00-b02e-1df02f1a470f tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:01.270997 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9efefabc-f5b8-4b00-b02e-1df02f1a470f tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:01.271790 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9efefabc-f5b8-4b00-b02e-1df02f1a470f tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:01.272270 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9efefabc-f5b8-4b00-b02e-1df02f1a470f tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:01.416622 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9efefabc-f5b8-4b00-b02e-1df02f1a470f tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:01.423931 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9efefabc-f5b8-4b00-b02e-1df02f1a470f tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/524e8c67-957c-4856-a882-fc0a4befaedd" status: 200 len: 1319 microversion: 2.1 time: 0.166699 Apr 16 21:10:01.424758 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 434/956] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:01 2022] GET /compute/v2.1/servers/524e8c67-957c-4856-a882-fc0a4befaedd => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:01.428999 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6603cdca-eb18-46d1-9558-efe40331deb9 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:01.429594 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6603cdca-eb18-46d1-9558-efe40331deb9 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: bc3b9549-fb07-458b-84bf-3f1d36449e6e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:01.435829 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6603cdca-eb18-46d1-9558-efe40331deb9 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:01.436316 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6603cdca-eb18-46d1-9558-efe40331deb9 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:01.437089 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6603cdca-eb18-46d1-9558-efe40331deb9 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:01.437527 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6603cdca-eb18-46d1-9558-efe40331deb9 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:01.576139 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6603cdca-eb18-46d1-9558-efe40331deb9 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:01.585419 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6603cdca-eb18-46d1-9558-efe40331deb9 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e" status: 200 len: 1503 microversion: 2.1 time: 0.159888 Apr 16 21:10:01.586443 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 435/957] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:01 2022] GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:01.591327 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-397653124", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "f04e9963-900e-472a-990e-34003d968b06"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:10:01.702534 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] validate_networks() for None {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:10:01.718836 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-574f46b3-7eaf-4529-a903-b88162461c67 tempest-SecurityGroupsTestAdminJSON-1482374319 tempest-SecurityGroupsTestAdminJSON-1482374319-project-admin] 10.222.0.20 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 13113 microversion: 2.1 time: 2.099223 Apr 16 21:10:01.719440 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 523/958] 10.222.0.20 () {58 vars in 1190 bytes} [Sat Apr 16 21:09:59 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 13113 bytes in 2104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:10:01.725481 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-91a8fc8b-426d-47e5-8799-d69cbe1bb934 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:01.726486 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-91a8fc8b-426d-47e5-8799-d69cbe1bb934 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:01.733704 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-91a8fc8b-426d-47e5-8799-d69cbe1bb934 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:01.734193 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-91a8fc8b-426d-47e5-8799-d69cbe1bb934 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:01.735044 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-91a8fc8b-426d-47e5-8799-d69cbe1bb934 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:01.735484 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-91a8fc8b-426d-47e5-8799-d69cbe1bb934 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:01.867207 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-91a8fc8b-426d-47e5-8799-d69cbe1bb934 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:01.875248 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-91a8fc8b-426d-47e5-8799-d69cbe1bb934 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:01.876892 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-91a8fc8b-426d-47e5-8799-d69cbe1bb934 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:01.878067 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-91a8fc8b-426d-47e5-8799-d69cbe1bb934 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd" status: 200 len: 1362 microversion: 2.25 time: 0.157445 Apr 16 21:10:01.880649 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 524/959] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:10:01 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:10:01.885542 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-3b1c2d9e-9548-40bd-90fd-e8a3e7c260df req-02f37fc3-7e30-4079-859e-ffa7a66e6abc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "615ea5db-3cca-4736-b69a-cc7bdc8f0e6e", "name": "network-vif-plugged", "status": "completed", "tag": "f83d9a73-0d97-45bc-8f40-3dbeed933e20"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:10:01.893829 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-3b1c2d9e-9548-40bd-90fd-e8a3e7c260df req-02f37fc3-7e30-4079-859e-ffa7a66e6abc service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:01.894942 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-3b1c2d9e-9548-40bd-90fd-e8a3e7c260df req-02f37fc3-7e30-4079-859e-ffa7a66e6abc service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:01.908582 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-3b1c2d9e-9548-40bd-90fd-e8a3e7c260df req-02f37fc3-7e30-4079-859e-ffa7a66e6abc service nova] Creating event network-vif-plugged:f83d9a73-0d97-45bc-8f40-3dbeed933e20 for instance 615ea5db-3cca-4736-b69a-cc7bdc8f0e6e on nch2-master-1 Apr 16 21:10:01.914595 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-3b1c2d9e-9548-40bd-90fd-e8a3e7c260df req-02f37fc3-7e30-4079-859e-ffa7a66e6abc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032710 Apr 16 21:10:01.915832 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 525/960] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:10:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:10:01.921362 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f2053492-c397-43a6-87f4-38ca7793a007 tempest-SecurityGroupsTestAdminJSON-2061309716 tempest-SecurityGroupsTestAdminJSON-2061309716-project] Calling method '.version_select at 0x7fbb9687b940>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:02.083940 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:10:02.084897 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:10:02.084897 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:10:02.085363 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:10:02.087685 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f2053492-c397-43a6-87f4-38ca7793a007 tempest-SecurityGroupsTestAdminJSON-2061309716 tempest-SecurityGroupsTestAdminJSON-2061309716-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.170369 Apr 16 21:10:02.088297 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 526/961] 10.222.0.20 () {58 vars in 1190 bytes} [Sat Apr 16 21:10:01 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:02.092742 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b020d794-c040-44c8-a211-f11d6f368dca tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:02.093470 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b020d794-c040-44c8-a211-f11d6f368dca tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] [instance: 04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:02.095049 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:10:02.104252 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b020d794-c040-44c8-a211-f11d6f368dca tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:02.104717 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b020d794-c040-44c8-a211-f11d6f368dca tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:02.105519 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b020d794-c040-44c8-a211-f11d6f368dca tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:02.105942 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b020d794-c040-44c8-a211-f11d6f368dca tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:02.117378 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:02.117763 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:02.118571 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:02.119015 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:02.136116 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Getting quotas for project cd7c434915254744b7a0409ab8e6d33d. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:10:02.141872 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Getting quotas for user 79f97c1afe5442dc83319237d121c11f and project cd7c434915254744b7a0409ab8e6d33d. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:10:02.157464 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Going to run 2 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:10:02.160390 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 970fc2c2-b7bc-496e-bbf5-be24bc6cf248] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:10:02.273987 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b020d794-c040-44c8-a211-f11d6f368dca tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db9403ce44e460a8165587ae22f0ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2a21b6df375491fb09fc22109fb4a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:02.281628 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b020d794-c040-44c8-a211-f11d6f368dca tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88" status: 200 len: 1317 microversion: 2.1 time: 0.192199 Apr 16 21:10:02.291950 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 527/962] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:02 2022] GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88 => generated 1317 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:02.295736 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-d38def91-97c8-4e3a-ae35-5611f393e4e8 req-5188bb69-a6ea-4d7c-8a88-310818b4c1fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc3b9549-fb07-458b-84bf-3f1d36449e6e", "tag": "a34708cf-de0c-422b-ad52-0051f88b2bb4"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:10:02.303484 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-d38def91-97c8-4e3a-ae35-5611f393e4e8 req-5188bb69-a6ea-4d7c-8a88-310818b4c1fa service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:02.303943 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-d38def91-97c8-4e3a-ae35-5611f393e4e8 req-5188bb69-a6ea-4d7c-8a88-310818b4c1fa service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:02.314706 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-d38def91-97c8-4e3a-ae35-5611f393e4e8 req-5188bb69-a6ea-4d7c-8a88-310818b4c1fa service nova] Creating event network-changed:a34708cf-de0c-422b-ad52-0051f88b2bb4 for instance bc3b9549-fb07-458b-84bf-3f1d36449e6e on nch2-master-1 Apr 16 21:10:02.319688 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-d38def91-97c8-4e3a-ae35-5611f393e4e8 req-5188bb69-a6ea-4d7c-8a88-310818b4c1fa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036070 Apr 16 21:10:02.320479 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 528/963] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:10:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:10:02.325243 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-66b06cad-aa76-4280-9d0d-ee3a215e3068 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:02.325940 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-66b06cad-aa76-4280-9d0d-ee3a215e3068 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:02.332671 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-66b06cad-aa76-4280-9d0d-ee3a215e3068 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:02.333135 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-66b06cad-aa76-4280-9d0d-ee3a215e3068 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:02.333915 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-66b06cad-aa76-4280-9d0d-ee3a215e3068 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:02.334362 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-66b06cad-aa76-4280-9d0d-ee3a215e3068 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:02.348648 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Getting quotas for project cd7c434915254744b7a0409ab8e6d33d. Resources: {'server_group_members'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:10:02.354341 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Getting quotas for user 79f97c1afe5442dc83319237d121c11f and project cd7c434915254744b7a0409ab8e6d33d. Resources: {'server_group_members'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:10:02.488012 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-66b06cad-aa76-4280-9d0d-ee3a215e3068 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:02.495343 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Getting quotas for project cd7c434915254744b7a0409ab8e6d33d. Resources: {'server_group_members'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:10:02.496804 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-66b06cad-aa76-4280-9d0d-ee3a215e3068 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1472 microversion: 2.1 time: 0.175339 Apr 16 21:10:02.497657 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 529/964] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:02 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1472 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:02.502010 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7b597f6a-2ef3-404c-804b-91d01210ebfb tempest-SecurityGroupsTestAdminJSON-1482374319 tempest-SecurityGroupsTestAdminJSON-1482374319-project-admin] Calling method '.version_select at 0x7fbb96f7c820>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:02.503821 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Getting quotas for user 79f97c1afe5442dc83319237d121c11f and project cd7c434915254744b7a0409ab8e6d33d. Resources: {'server_group_members'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:10:02.529584 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 8255008b-aaf4-444d-bdcd-6746d42c267b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=970fc2c2-b7bc-496e-bbf5-be24bc6cf248,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:10:02.759589 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Getting quotas for project cd7c434915254744b7a0409ab8e6d33d. Resources: {'server_group_members'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:10:02.766260 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Getting quotas for user 79f97c1afe5442dc83319237d121c11f and project cd7c434915254744b7a0409ab8e6d33d. Resources: {'server_group_members'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:10:02.815529 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7b597f6a-2ef3-404c-804b-91d01210ebfb tempest-SecurityGroupsTestAdminJSON-1482374319 tempest-SecurityGroupsTestAdminJSON-1482374319-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/18352d97-2e47-4597-abbc-09e305fdd335" status: 202 len: 0 microversion: 2.1 time: 0.317066 Apr 16 21:10:02.817814 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 530/965] 10.222.0.20 () {58 vars in 1271 bytes} [Sat Apr 16 21:10:02 2022] DELETE /compute/v2.1/os-security-groups/18352d97-2e47-4597-abbc-09e305fdd335 => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:10:02.823630 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0fbfc236-177f-4cca-9823-2516c1d701ea tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:02.828387 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0fbfc236-177f-4cca-9823-2516c1d701ea tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 524e8c67-957c-4856-a882-fc0a4befaedd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:02.837043 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0fbfc236-177f-4cca-9823-2516c1d701ea tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:02.837504 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0fbfc236-177f-4cca-9823-2516c1d701ea tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:02.838339 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0fbfc236-177f-4cca-9823-2516c1d701ea tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:02.844707 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0fbfc236-177f-4cca-9823-2516c1d701ea tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:02.935486 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Getting quotas for project cd7c434915254744b7a0409ab8e6d33d. Resources: {'server_group_members'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:10:02.941142 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Getting quotas for user 79f97c1afe5442dc83319237d121c11f and project cd7c434915254744b7a0409ab8e6d33d. Resources: {'server_group_members'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:10:02.976457 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ea9d4cfc-671b-4136-8cb5-51907147fd14 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.388932 Apr 16 21:10:02.979977 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 436/966] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:10:01 2022] POST /compute/v2.1/servers => generated 32 bytes in 1390 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Apr 16 21:10:02.982386 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-203c3df8-edd8-4fdf-96ab-18fe6359bbc0 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:02.982679 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0fbfc236-177f-4cca-9823-2516c1d701ea tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:02.983002 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-203c3df8-edd8-4fdf-96ab-18fe6359bbc0 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: bc3b9549-fb07-458b-84bf-3f1d36449e6e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:02.989379 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-203c3df8-edd8-4fdf-96ab-18fe6359bbc0 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:02.989838 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-203c3df8-edd8-4fdf-96ab-18fe6359bbc0 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:02.990446 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0fbfc236-177f-4cca-9823-2516c1d701ea tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/524e8c67-957c-4856-a882-fc0a4befaedd" status: 200 len: 1510 microversion: 2.1 time: 0.171389 Apr 16 21:10:02.990747 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-203c3df8-edd8-4fdf-96ab-18fe6359bbc0 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:02.996269 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-203c3df8-edd8-4fdf-96ab-18fe6359bbc0 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:02.996422 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 531/967] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:02 2022] GET /compute/v2.1/servers/524e8c67-957c-4856-a882-fc0a4befaedd => generated 1510 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:02.996422 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fec7d02c-a6d5-48b9-ace7-f31ba5ff255b tempest-SecurityGroupsTestAdminJSON-1482374319 tempest-SecurityGroupsTestAdminJSON-1482374319-project-admin] Calling method '.version_select at 0x7fbb96b65b80>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:03.150671 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-203c3df8-edd8-4fdf-96ab-18fe6359bbc0 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:03.158208 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-203c3df8-edd8-4fdf-96ab-18fe6359bbc0 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e" status: 200 len: 1503 microversion: 2.1 time: 0.179720 Apr 16 21:10:03.159124 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 437/968] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:02 2022] GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e => generated 1503 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:03.170440 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-12de78c9-36d9-4d94-b5ee-9cf8ac092e37 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:03.170440 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-12de78c9-36d9-4d94-b5ee-9cf8ac092e37 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:03.172318 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-12de78c9-36d9-4d94-b5ee-9cf8ac092e37 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:03.172782 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-12de78c9-36d9-4d94-b5ee-9cf8ac092e37 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:03.173594 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-12de78c9-36d9-4d94-b5ee-9cf8ac092e37 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:03.174131 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-12de78c9-36d9-4d94-b5ee-9cf8ac092e37 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:03.250621 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fec7d02c-a6d5-48b9-ace7-f31ba5ff255b tempest-SecurityGroupsTestAdminJSON-1482374319 tempest-SecurityGroupsTestAdminJSON-1482374319-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/2c766359-ee98-48bd-a89e-355da205ab2b" status: 202 len: 0 microversion: 2.1 time: 0.258216 Apr 16 21:10:03.251501 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 532/969] 10.222.0.20 () {58 vars in 1271 bytes} [Sat Apr 16 21:10:02 2022] DELETE /compute/v2.1/os-security-groups/2c766359-ee98-48bd-a89e-355da205ab2b => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:10:03.256993 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2b719514-f506-4606-857c-c0fd9275a4c4 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:03.260755 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2b719514-f506-4606-857c-c0fd9275a4c4 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:03.261676 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2b719514-f506-4606-857c-c0fd9275a4c4 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Searching by: {'deleted': False, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d'} {{(pid=137408) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:10:03.279323 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b719514-f506-4606-857c-c0fd9275a4c4 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:03.290743 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b719514-f506-4606-857c-c0fd9275a4c4 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:03.292337 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b719514-f506-4606-857c-c0fd9275a4c4 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:03.292337 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b719514-f506-4606-857c-c0fd9275a4c4 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:03.335983 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-12de78c9-36d9-4d94-b5ee-9cf8ac092e37 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:03.345144 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-12de78c9-36d9-4d94-b5ee-9cf8ac092e37 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:03.346981 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-12de78c9-36d9-4d94-b5ee-9cf8ac092e37 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:03.349004 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-12de78c9-36d9-4d94-b5ee-9cf8ac092e37 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd" status: 200 len: 1362 microversion: 2.25 time: 0.188702 Apr 16 21:10:03.359892 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 438/970] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:10:03 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd => generated 1362 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:10:03.365493 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ef483e95-5031-4880-b8d7-64e02eb57d18 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:03.366404 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ef483e95-5031-4880-b8d7-64e02eb57d18 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 2b27c826-905d-4c1f-9daf-42150b1025a8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:03.373153 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ef483e95-5031-4880-b8d7-64e02eb57d18 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:03.373987 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ef483e95-5031-4880-b8d7-64e02eb57d18 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:03.375982 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ef483e95-5031-4880-b8d7-64e02eb57d18 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:03.375982 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ef483e95-5031-4880-b8d7-64e02eb57d18 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:03.391312 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.multi_cell_list [None req-2b719514-f506-4606-857c-c0fd9275a4c4 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=137408) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 16 21:10:03.466223 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2b719514-f506-4606-857c-c0fd9275a4c4 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 1663 microversion: 2.1 time: 0.213488 Apr 16 21:10:03.466952 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 533/971] 10.222.0.20 () {58 vars in 1124 bytes} [Sat Apr 16 21:10:03 2022] GET /compute/v2.1/servers => generated 1663 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:03.471610 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1d016452-9bac-4f54-a924-84bcecad7fcf tempest-SecurityGroupsTestAdminJSON-2061309716 tempest-SecurityGroupsTestAdminJSON-2061309716-project] Calling method '.version_select at 0x7fbb968765e0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:03.614260 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ef483e95-5031-4880-b8d7-64e02eb57d18 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:03.622481 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ef483e95-5031-4880-b8d7-64e02eb57d18 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8" status: 200 len: 1512 microversion: 2.1 time: 0.261294 Apr 16 21:10:03.623145 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 439/972] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:03 2022] GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8 => generated 1512 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:03.638595 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ef49e024-1a74-438b-bf36-874b079b741a tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:03.639282 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ef49e024-1a74-438b-bf36-874b079b741a tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] [instance: 04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:03.645871 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ef49e024-1a74-438b-bf36-874b079b741a tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:03.646034 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ef49e024-1a74-438b-bf36-874b079b741a tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:03.647166 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ef49e024-1a74-438b-bf36-874b079b741a tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:03.647728 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ef49e024-1a74-438b-bf36-874b079b741a tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:03.871929 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1d016452-9bac-4f54-a924-84bcecad7fcf tempest-SecurityGroupsTestAdminJSON-2061309716 tempest-SecurityGroupsTestAdminJSON-2061309716-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/e5c9f89e-74a7-490f-ab70-8cb56f6ed2aa" status: 202 len: 0 microversion: 2.1 time: 0.403634 Apr 16 21:10:03.873397 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 534/973] 10.222.0.20 () {58 vars in 1271 bytes} [Sat Apr 16 21:10:03 2022] DELETE /compute/v2.1/os-security-groups/e5c9f89e-74a7-490f-ab70-8cb56f6ed2aa => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:10:03.878201 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-719d0780-4d70-44a0-b34c-c4a039a9d6e1 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:03.879670 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-719d0780-4d70-44a0-b34c-c4a039a9d6e1 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 8255008b-aaf4-444d-bdcd-6746d42c267b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:03.929846 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ef49e024-1a74-438b-bf36-874b079b741a tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db9403ce44e460a8165587ae22f0ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2a21b6df375491fb09fc22109fb4a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:03.937556 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ef49e024-1a74-438b-bf36-874b079b741a tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88" status: 200 len: 1317 microversion: 2.1 time: 0.304212 Apr 16 21:10:03.941463 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 440/974] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:03 2022] GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88 => generated 1317 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:03.947046 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9339845e-6412-433c-bb97-3d7c7c7de8cc tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:03.950389 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9339845e-6412-433c-bb97-3d7c7c7de8cc tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:03.950547 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-719d0780-4d70-44a0-b34c-c4a039a9d6e1 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:03.960213 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-719d0780-4d70-44a0-b34c-c4a039a9d6e1 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/8255008b-aaf4-444d-bdcd-6746d42c267b" status: 200 len: 1218 microversion: 2.1 time: 0.082778 Apr 16 21:10:03.960213 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 535/975] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:03 2022] GET /compute/v2.1/servers/8255008b-aaf4-444d-bdcd-6746d42c267b => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:03.960514 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9339845e-6412-433c-bb97-3d7c7c7de8cc tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:03.960514 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9339845e-6412-433c-bb97-3d7c7c7de8cc tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:03.960514 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9339845e-6412-433c-bb97-3d7c7c7de8cc tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:03.960514 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9339845e-6412-433c-bb97-3d7c7c7de8cc tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:03.969791 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-808f585b-daa8-4bff-92d5-a272619a3fa3 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:03.974856 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-808f585b-daa8-4bff-92d5-a272619a3fa3 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 615ea5db-3cca-4736-b69a-cc7bdc8f0e6e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:03.985095 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-808f585b-daa8-4bff-92d5-a272619a3fa3 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:03.985797 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-808f585b-daa8-4bff-92d5-a272619a3fa3 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:03.988964 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-808f585b-daa8-4bff-92d5-a272619a3fa3 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:03.988964 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-808f585b-daa8-4bff-92d5-a272619a3fa3 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:04.117532 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9339845e-6412-433c-bb97-3d7c7c7de8cc tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:04.127659 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9339845e-6412-433c-bb97-3d7c7c7de8cc tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1472 microversion: 2.1 time: 0.184211 Apr 16 21:10:04.136637 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 441/976] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:03 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1472 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:04.136637 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-da5fa48b-7b81-4a57-b1df-d3bed36e5fa6 tempest-SecurityGroupsTestAdminJSON-2061309716 tempest-SecurityGroupsTestAdminJSON-2061309716-project] Calling method '.version_select at 0x7fbb96a5c3a0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:04.169715 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-808f585b-daa8-4bff-92d5-a272619a3fa3 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:04.178524 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-808f585b-daa8-4bff-92d5-a272619a3fa3 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/615ea5db-3cca-4736-b69a-cc7bdc8f0e6e" status: 200 len: 1511 microversion: 2.1 time: 0.217424 Apr 16 21:10:04.184760 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 536/977] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:03 2022] GET /compute/v2.1/servers/615ea5db-3cca-4736-b69a-cc7bdc8f0e6e => generated 1511 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:04.184760 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7b80a5b0-a022-45f6-bb08-1841013205f2 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:04.184760 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7b80a5b0-a022-45f6-bb08-1841013205f2 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: bc3b9549-fb07-458b-84bf-3f1d36449e6e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:04.191297 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7b80a5b0-a022-45f6-bb08-1841013205f2 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:04.191766 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7b80a5b0-a022-45f6-bb08-1841013205f2 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:04.192712 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7b80a5b0-a022-45f6-bb08-1841013205f2 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:04.193016 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7b80a5b0-a022-45f6-bb08-1841013205f2 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:04.334847 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7b80a5b0-a022-45f6-bb08-1841013205f2 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:04.343055 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7b80a5b0-a022-45f6-bb08-1841013205f2 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e" status: 200 len: 1503 microversion: 2.1 time: 0.162481 Apr 16 21:10:04.343640 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 537/978] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:04 2022] GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e => generated 1503 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:04.348359 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-48ef269d-5558-407e-8980-9bd75199217e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:04.351926 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-48ef269d-5558-407e-8980-9bd75199217e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:04.352728 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-48ef269d-5558-407e-8980-9bd75199217e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c'} {{(pid=137408) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:10:04.364237 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-48ef269d-5558-407e-8980-9bd75199217e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:04.364696 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-48ef269d-5558-407e-8980-9bd75199217e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:04.365508 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-48ef269d-5558-407e-8980-9bd75199217e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:04.365944 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-48ef269d-5558-407e-8980-9bd75199217e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:04.396587 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-da5fa48b-7b81-4a57-b1df-d3bed36e5fa6 tempest-SecurityGroupsTestAdminJSON-2061309716 tempest-SecurityGroupsTestAdminJSON-2061309716-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/1329c9e5-7a34-4e27-bf1a-93aa84e75c0a" status: 202 len: 0 microversion: 2.1 time: 0.266558 Apr 16 21:10:04.402560 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 442/979] 10.222.0.20 () {58 vars in 1271 bytes} [Sat Apr 16 21:10:04 2022] DELETE /compute/v2.1/os-security-groups/1329c9e5-7a34-4e27-bf1a-93aa84e75c0a => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:10:04.407721 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-13120339-0e5e-4306-89e6-7f60bde9453e req-e082cb75-9177-4830-888a-9f27921bab89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88", "tag": "b490e936-9731-4964-89b6-ba2e9e7ac544"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:10:04.424071 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-13120339-0e5e-4306-89e6-7f60bde9453e req-e082cb75-9177-4830-888a-9f27921bab89 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:04.426587 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-13120339-0e5e-4306-89e6-7f60bde9453e req-e082cb75-9177-4830-888a-9f27921bab89 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:04.448554 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-13120339-0e5e-4306-89e6-7f60bde9453e req-e082cb75-9177-4830-888a-9f27921bab89 service nova] Creating event network-changed:b490e936-9731-4964-89b6-ba2e9e7ac544 for instance 04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88 on nch2-master-1 Apr 16 21:10:04.453634 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-13120339-0e5e-4306-89e6-7f60bde9453e req-e082cb75-9177-4830-888a-9f27921bab89 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055042 Apr 16 21:10:04.457465 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 443/980] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:10:04.462650 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.multi_cell_list [None req-48ef269d-5558-407e-8980-9bd75199217e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137408) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 16 21:10:04.462887 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-72710fbb-1a72-4293-908d-a66967bae38d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:04.463552 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-72710fbb-1a72-4293-908d-a66967bae38d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:04.469864 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-72710fbb-1a72-4293-908d-a66967bae38d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:04.470342 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-72710fbb-1a72-4293-908d-a66967bae38d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:04.471162 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-72710fbb-1a72-4293-908d-a66967bae38d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:04.471555 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-72710fbb-1a72-4293-908d-a66967bae38d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:04.534321 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-48ef269d-5558-407e-8980-9bd75199217e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:04.540980 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-48ef269d-5558-407e-8980-9bd75199217e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:04.541584 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-48ef269d-5558-407e-8980-9bd75199217e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:04.635550 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-72710fbb-1a72-4293-908d-a66967bae38d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:04.644471 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-72710fbb-1a72-4293-908d-a66967bae38d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:04.645995 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-72710fbb-1a72-4293-908d-a66967bae38d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:04.647141 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-72710fbb-1a72-4293-908d-a66967bae38d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd" status: 200 len: 1362 microversion: 2.25 time: 0.188354 Apr 16 21:10:04.647915 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 444/981] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:10:04 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:10:04.658899 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-48ef269d-5558-407e-8980-9bd75199217e tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1513 microversion: 2.1 time: 0.314011 Apr 16 21:10:04.659517 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 538/982] 10.222.0.20 () {58 vars in 1166 bytes} [Sat Apr 16 21:10:04 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1513 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:04.678285 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2937547a-60e2-4d71-bac0-82332f8044f4 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:04.682862 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2937547a-60e2-4d71-bac0-82332f8044f4 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:04.684639 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2937547a-60e2-4d71-bac0-82332f8044f4 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-2014059963', 'deleted': False, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c'} {{(pid=137409) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:10:04.689392 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2937547a-60e2-4d71-bac0-82332f8044f4 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:04.689844 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2937547a-60e2-4d71-bac0-82332f8044f4 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:04.690653 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2937547a-60e2-4d71-bac0-82332f8044f4 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:04.691118 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2937547a-60e2-4d71-bac0-82332f8044f4 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:04.781251 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.multi_cell_list [None req-2937547a-60e2-4d71-bac0-82332f8044f4 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 16 21:10:04.849871 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2937547a-60e2-4d71-bac0-82332f8044f4 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:04.855935 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2937547a-60e2-4d71-bac0-82332f8044f4 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:04.856425 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2937547a-60e2-4d71-bac0-82332f8044f4 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:04.958485 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3d0b3486-e572-4a80-8127-2fbf6d10252b tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:04.959139 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3d0b3486-e572-4a80-8127-2fbf6d10252b tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] [instance: 04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:04.970864 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d0b3486-e572-4a80-8127-2fbf6d10252b tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:04.971342 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d0b3486-e572-4a80-8127-2fbf6d10252b tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:04.973861 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d0b3486-e572-4a80-8127-2fbf6d10252b tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:04.974340 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d0b3486-e572-4a80-8127-2fbf6d10252b tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:04.985795 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2937547a-60e2-4d71-bac0-82332f8044f4 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-2014059963" status: 200 len: 1515 microversion: 2.1 time: 0.311090 Apr 16 21:10:04.987929 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 445/983] 10.222.0.20 () {58 vars in 1262 bytes} [Sat Apr 16 21:10:04 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-2014059963 => generated 1515 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:04.996391 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b6d5dcee-e35b-4a6a-a064-3c5ee1c249e5 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:04.997744 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b6d5dcee-e35b-4a6a-a064-3c5ee1c249e5 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 8255008b-aaf4-444d-bdcd-6746d42c267b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:05.004954 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b6d5dcee-e35b-4a6a-a064-3c5ee1c249e5 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:05.005646 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b6d5dcee-e35b-4a6a-a064-3c5ee1c249e5 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:05.006806 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b6d5dcee-e35b-4a6a-a064-3c5ee1c249e5 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:05.007483 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b6d5dcee-e35b-4a6a-a064-3c5ee1c249e5 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:05.085436 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b6d5dcee-e35b-4a6a-a064-3c5ee1c249e5 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:05.093238 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b6d5dcee-e35b-4a6a-a064-3c5ee1c249e5 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/8255008b-aaf4-444d-bdcd-6746d42c267b" status: 200 len: 1222 microversion: 2.1 time: 0.104014 Apr 16 21:10:05.103351 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 446/984] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:04 2022] GET /compute/v2.1/servers/8255008b-aaf4-444d-bdcd-6746d42c267b => generated 1222 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:05.108419 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6cda0ba5-e592-4684-8f98-8853d65cee85 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:05.111479 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6cda0ba5-e592-4684-8f98-8853d65cee85 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:05.112301 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6cda0ba5-e592-4684-8f98-8853d65cee85 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c'} {{(pid=137409) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:10:05.118262 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6cda0ba5-e592-4684-8f98-8853d65cee85 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:05.118704 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6cda0ba5-e592-4684-8f98-8853d65cee85 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:05.119522 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6cda0ba5-e592-4684-8f98-8853d65cee85 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:05.119938 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6cda0ba5-e592-4684-8f98-8853d65cee85 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:05.165345 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3d0b3486-e572-4a80-8127-2fbf6d10252b tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db9403ce44e460a8165587ae22f0ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2a21b6df375491fb09fc22109fb4a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:05.174375 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3d0b3486-e572-4a80-8127-2fbf6d10252b tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88" status: 200 len: 1317 microversion: 2.1 time: 0.220838 Apr 16 21:10:05.176430 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 539/985] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:04 2022] GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88 => generated 1317 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:10:05.181367 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9d6685b0-251a-44b9-ac8c-b6e6429f36e1 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:05.182185 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9d6685b0-251a-44b9-ac8c-b6e6429f36e1 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:05.188794 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9d6685b0-251a-44b9-ac8c-b6e6429f36e1 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:05.189509 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9d6685b0-251a-44b9-ac8c-b6e6429f36e1 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:05.193603 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9d6685b0-251a-44b9-ac8c-b6e6429f36e1 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:05.193603 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9d6685b0-251a-44b9-ac8c-b6e6429f36e1 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:05.233524 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.multi_cell_list [None req-6cda0ba5-e592-4684-8f98-8853d65cee85 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 16 21:10:05.308636 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6cda0ba5-e592-4684-8f98-8853d65cee85 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:05.318235 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6cda0ba5-e592-4684-8f98-8853d65cee85 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:05.319304 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6cda0ba5-e592-4684-8f98-8853d65cee85 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:05.338979 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9d6685b0-251a-44b9-ac8c-b6e6429f36e1 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:05.346518 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9d6685b0-251a-44b9-ac8c-b6e6429f36e1 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1472 microversion: 2.1 time: 0.168837 Apr 16 21:10:05.347213 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 540/986] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:05 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1472 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:05.360306 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7b8220bb-4ef3-4427-9545-74da712e59ba tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:05.361120 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7b8220bb-4ef3-4427-9545-74da712e59ba tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: bc3b9549-fb07-458b-84bf-3f1d36449e6e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:05.367824 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7b8220bb-4ef3-4427-9545-74da712e59ba tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:05.368322 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7b8220bb-4ef3-4427-9545-74da712e59ba tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:05.369161 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7b8220bb-4ef3-4427-9545-74da712e59ba tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:05.369607 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7b8220bb-4ef3-4427-9545-74da712e59ba tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:05.474646 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6cda0ba5-e592-4684-8f98-8853d65cee85 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4516 microversion: 2.1 time: 0.370108 Apr 16 21:10:05.475259 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 447/987] 10.222.0.20 () {58 vars in 1172 bytes} [Sat Apr 16 21:10:05 2022] GET /compute/v2.1/servers/detail?status=active => generated 4516 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:05.495009 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b6467086-9c61-41a8-84b6-243854d8f944 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:05.498616 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b6467086-9c61-41a8-84b6-243854d8f944 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:05.503989 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.compute.servers [None req-b6467086-9c61-41a8-84b6-243854d8f944 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Removing options 'limit' from query {{(pid=137409) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Apr 16 21:10:05.503989 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b6467086-9c61-41a8-84b6-243854d8f944 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Searching by: {'deleted': False, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c'} {{(pid=137409) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:10:05.505399 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b6467086-9c61-41a8-84b6-243854d8f944 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:05.505848 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b6467086-9c61-41a8-84b6-243854d8f944 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:05.506637 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b6467086-9c61-41a8-84b6-243854d8f944 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:05.507072 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b6467086-9c61-41a8-84b6-243854d8f944 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:05.516298 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7b8220bb-4ef3-4427-9545-74da712e59ba tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:05.523884 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7b8220bb-4ef3-4427-9545-74da712e59ba tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e" status: 200 len: 1503 microversion: 2.1 time: 0.168972 Apr 16 21:10:05.524841 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 541/988] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:05 2022] GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e => generated 1503 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:10:05.540671 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b6467086-9c61-41a8-84b6-243854d8f944 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:05.546523 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b6467086-9c61-41a8-84b6-243854d8f944 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:05.546987 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b6467086-9c61-41a8-84b6-243854d8f944 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:05.666134 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1c679c6e-c9e2-4e5c-8ef1-23eac69cd610 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:05.666597 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b6467086-9c61-41a8-84b6-243854d8f944 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1659 microversion: 2.1 time: 0.175330 Apr 16 21:10:05.666813 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1c679c6e-c9e2-4e5c-8ef1-23eac69cd610 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:05.667582 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 448/989] 10.222.0.20 () {58 vars in 1160 bytes} [Sat Apr 16 21:10:05 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1659 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:10:05.686673 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-edfb8e1e-6a26-4585-a9cc-b9bbbea14fba tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:05.690021 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-edfb8e1e-6a26-4585-a9cc-b9bbbea14fba tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:05.690769 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-edfb8e1e-6a26-4585-a9cc-b9bbbea14fba tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c'} {{(pid=137409) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:10:05.693180 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1c679c6e-c9e2-4e5c-8ef1-23eac69cd610 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:05.693647 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1c679c6e-c9e2-4e5c-8ef1-23eac69cd610 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:05.694447 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1c679c6e-c9e2-4e5c-8ef1-23eac69cd610 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:05.694922 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1c679c6e-c9e2-4e5c-8ef1-23eac69cd610 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:05.696093 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-edfb8e1e-6a26-4585-a9cc-b9bbbea14fba tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:05.696600 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-edfb8e1e-6a26-4585-a9cc-b9bbbea14fba tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:05.697412 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-edfb8e1e-6a26-4585-a9cc-b9bbbea14fba tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:05.697856 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-edfb8e1e-6a26-4585-a9cc-b9bbbea14fba tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:05.787187 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.multi_cell_list [None req-edfb8e1e-6a26-4585-a9cc-b9bbbea14fba tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 16 21:10:05.845085 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1c679c6e-c9e2-4e5c-8ef1-23eac69cd610 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:05.849508 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-edfb8e1e-6a26-4585-a9cc-b9bbbea14fba tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers?status=active" status: 200 len: 1009 microversion: 2.1 time: 0.166680 Apr 16 21:10:05.850104 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 449/990] 10.222.0.20 () {58 vars in 1151 bytes} [Sat Apr 16 21:10:05 2022] GET /compute/v2.1/servers?status=active => generated 1009 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:05.853252 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1c679c6e-c9e2-4e5c-8ef1-23eac69cd610 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:05.855448 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1c679c6e-c9e2-4e5c-8ef1-23eac69cd610 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:05.855896 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1c679c6e-c9e2-4e5c-8ef1-23eac69cd610 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd" status: 200 len: 1362 microversion: 2.25 time: 0.194365 Apr 16 21:10:05.856934 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 542/991] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:10:05 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:10:05.861736 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-322a7230-a03f-4e38-a8ad-38753c90d51c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:05.865706 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-322a7230-a03f-4e38-a8ad-38753c90d51c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:05.866157 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.compute.servers [None req-322a7230-a03f-4e38-a8ad-38753c90d51c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Removing options 'limit' from query {{(pid=137409) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Apr 16 21:10:05.866946 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-322a7230-a03f-4e38-a8ad-38753c90d51c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Searching by: {'deleted': False, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c'} {{(pid=137409) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:10:05.872158 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-322a7230-a03f-4e38-a8ad-38753c90d51c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:05.872649 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-322a7230-a03f-4e38-a8ad-38753c90d51c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:05.873450 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-322a7230-a03f-4e38-a8ad-38753c90d51c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:05.873889 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-322a7230-a03f-4e38-a8ad-38753c90d51c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:05.899991 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.multi_cell_list [None req-322a7230-a03f-4e38-a8ad-38753c90d51c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 16 21:10:05.929377 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-322a7230-a03f-4e38-a8ad-38753c90d51c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1009 microversion: 2.1 time: 0.071377 Apr 16 21:10:05.929966 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 450/992] 10.222.0.20 () {58 vars in 1149 bytes} [Sat Apr 16 21:10:05 2022] GET /compute/v2.1/servers?limit=100000 => generated 1009 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:10:05.940235 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-aedcd5ab-0f5d-4944-9dc1-1f657f7a5127 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:05.944260 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-aedcd5ab-0f5d-4944-9dc1-1f657f7a5127 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:05.944925 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-aedcd5ab-0f5d-4944-9dc1-1f657f7a5127 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Searching by: {'deleted': False, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c'} {{(pid=137408) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:10:05.950039 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aedcd5ab-0f5d-4944-9dc1-1f657f7a5127 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:05.950494 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aedcd5ab-0f5d-4944-9dc1-1f657f7a5127 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:05.951301 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aedcd5ab-0f5d-4944-9dc1-1f657f7a5127 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:05.951747 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aedcd5ab-0f5d-4944-9dc1-1f657f7a5127 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:05.978407 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.multi_cell_list [None req-aedcd5ab-0f5d-4944-9dc1-1f657f7a5127 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137408) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 16 21:10:06.005805 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-aedcd5ab-0f5d-4944-9dc1-1f657f7a5127 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 1009 microversion: 2.1 time: 0.069268 Apr 16 21:10:06.006390 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 543/993] 10.222.0.20 () {58 vars in 1124 bytes} [Sat Apr 16 21:10:05 2022] GET /compute/v2.1/servers => generated 1009 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:06.018059 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bed3f4b8-3f27-4ab6-ad12-b0b9161635b1 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:06.021565 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-bed3f4b8-3f27-4ab6-ad12-b0b9161635b1 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:06.022219 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bed3f4b8-3f27-4ab6-ad12-b0b9161635b1 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c'} {{(pid=137409) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:10:06.033409 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bed3f4b8-3f27-4ab6-ad12-b0b9161635b1 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:06.033855 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bed3f4b8-3f27-4ab6-ad12-b0b9161635b1 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:06.034648 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bed3f4b8-3f27-4ab6-ad12-b0b9161635b1 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:06.035084 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bed3f4b8-3f27-4ab6-ad12-b0b9161635b1 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:06.110470 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-20ef538e-c7c6-437f-9f57-87ee72f67f7c tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:06.111231 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-20ef538e-c7c6-437f-9f57-87ee72f67f7c tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 8255008b-aaf4-444d-bdcd-6746d42c267b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:06.117783 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-20ef538e-c7c6-437f-9f57-87ee72f67f7c tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:06.118248 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-20ef538e-c7c6-437f-9f57-87ee72f67f7c tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:06.118798 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.multi_cell_list [None req-bed3f4b8-3f27-4ab6-ad12-b0b9161635b1 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 16 21:10:06.119032 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-20ef538e-c7c6-437f-9f57-87ee72f67f7c tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:06.119722 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-20ef538e-c7c6-437f-9f57-87ee72f67f7c tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:06.178229 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bed3f4b8-3f27-4ab6-ad12-b0b9161635b1 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 344 microversion: 2.1 time: 0.163908 Apr 16 21:10:06.178821 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 451/994] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:10:06 2022] GET /compute/v2.1/servers?flavor=451 => generated 344 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:10:06.190052 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-56307698-5d93-4b16-804f-9fc19ce8f975 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:06.194427 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-56307698-5d93-4b16-804f-9fc19ce8f975 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:06.194882 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.compute.servers [None req-56307698-5d93-4b16-804f-9fc19ce8f975 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Removing options 'limit' from query {{(pid=137409) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Apr 16 21:10:06.195533 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-56307698-5d93-4b16-804f-9fc19ce8f975 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Searching by: {'deleted': False, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c'} {{(pid=137409) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:10:06.197885 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-20ef538e-c7c6-437f-9f57-87ee72f67f7c tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:06.201347 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-56307698-5d93-4b16-804f-9fc19ce8f975 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:06.201811 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-56307698-5d93-4b16-804f-9fc19ce8f975 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:06.202625 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-56307698-5d93-4b16-804f-9fc19ce8f975 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:06.203086 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-56307698-5d93-4b16-804f-9fc19ce8f975 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:06.206369 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-20ef538e-c7c6-437f-9f57-87ee72f67f7c tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/8255008b-aaf4-444d-bdcd-6746d42c267b" status: 200 len: 1222 microversion: 2.1 time: 0.099691 Apr 16 21:10:06.207127 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 544/995] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:06 2022] GET /compute/v2.1/servers/8255008b-aaf4-444d-bdcd-6746d42c267b => generated 1222 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:10:06.219348 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-57fa5bff-c87f-4d24-a893-b31cfb0fe299 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:06.220357 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-57fa5bff-c87f-4d24-a893-b31cfb0fe299 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] [instance: 04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:06.226681 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-57fa5bff-c87f-4d24-a893-b31cfb0fe299 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:06.227354 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-57fa5bff-c87f-4d24-a893-b31cfb0fe299 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:06.228143 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-57fa5bff-c87f-4d24-a893-b31cfb0fe299 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:06.228613 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-57fa5bff-c87f-4d24-a893-b31cfb0fe299 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:06.229119 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-56307698-5d93-4b16-804f-9fc19ce8f975 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=1" status: 200 len: 483 microversion: 2.1 time: 0.042687 Apr 16 21:10:06.234392 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 452/996] 10.222.0.20 () {58 vars in 1139 bytes} [Sat Apr 16 21:10:06 2022] GET /compute/v2.1/servers?limit=1 => generated 483 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:10:06.241351 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-91e7d927-679c-444f-80cf-ed1fa3db9e39 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:06.245248 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-91e7d927-679c-444f-80cf-ed1fa3db9e39 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:06.245922 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-91e7d927-679c-444f-80cf-ed1fa3db9e39 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-2014059963', 'deleted': False, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c'} {{(pid=137409) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:10:06.251024 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-91e7d927-679c-444f-80cf-ed1fa3db9e39 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:06.251484 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-91e7d927-679c-444f-80cf-ed1fa3db9e39 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:06.252559 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-91e7d927-679c-444f-80cf-ed1fa3db9e39 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:06.252770 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-91e7d927-679c-444f-80cf-ed1fa3db9e39 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:06.337169 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.multi_cell_list [None req-91e7d927-679c-444f-80cf-ed1fa3db9e39 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 16 21:10:06.380409 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-57fa5bff-c87f-4d24-a893-b31cfb0fe299 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db9403ce44e460a8165587ae22f0ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2a21b6df375491fb09fc22109fb4a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:06.387775 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-57fa5bff-c87f-4d24-a893-b31cfb0fe299 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88" status: 200 len: 1317 microversion: 2.1 time: 0.179556 Apr 16 21:10:06.388457 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 545/997] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:06 2022] GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88 => generated 1317 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:06.397523 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a32c9e7f-fcb8-41c7-b85f-b4b5e0b099be tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:06.397523 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a32c9e7f-fcb8-41c7-b85f-b4b5e0b099be tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:06.397848 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-91e7d927-679c-444f-80cf-ed1fa3db9e39 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-2014059963" status: 200 len: 346 microversion: 2.1 time: 0.157818 Apr 16 21:10:06.397848 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 453/998] 10.222.0.20 () {58 vars in 1241 bytes} [Sat Apr 16 21:10:06 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-2014059963 => generated 346 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:10:06.400226 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a32c9e7f-fcb8-41c7-b85f-b4b5e0b099be tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:06.405762 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a32c9e7f-fcb8-41c7-b85f-b4b5e0b099be tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:06.405762 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a32c9e7f-fcb8-41c7-b85f-b4b5e0b099be tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:06.405762 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a32c9e7f-fcb8-41c7-b85f-b4b5e0b099be tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:06.406447 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-399e42a0-50d2-4074-b43c-6493432d3eea tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:10:06.413189 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-399e42a0-50d2-4074-b43c-6493432d3eea tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:06.413655 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-399e42a0-50d2-4074-b43c-6493432d3eea tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:06.476086 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-399e42a0-50d2-4074-b43c-6493432d3eea tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 2b27c826-905d-4c1f-9daf-42150b1025a8] Going to try to stop instance {{(pid=137409) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 16 21:10:06.555152 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a32c9e7f-fcb8-41c7-b85f-b4b5e0b099be tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:06.560919 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a32c9e7f-fcb8-41c7-b85f-b4b5e0b099be tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1472 microversion: 2.1 time: 0.171348 Apr 16 21:10:06.561497 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 546/999] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:06 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1472 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:06.566546 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-22190912-8260-46ed-9bd4-f142a5c23bdd tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:06.567152 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-22190912-8260-46ed-9bd4-f142a5c23bdd tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: bc3b9549-fb07-458b-84bf-3f1d36449e6e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:06.572882 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-22190912-8260-46ed-9bd4-f142a5c23bdd tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:06.573336 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-22190912-8260-46ed-9bd4-f142a5c23bdd tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:06.574109 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-22190912-8260-46ed-9bd4-f142a5c23bdd tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:06.574683 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-22190912-8260-46ed-9bd4-f142a5c23bdd tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:06.703916 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-22190912-8260-46ed-9bd4-f142a5c23bdd tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:06.711565 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-22190912-8260-46ed-9bd4-f142a5c23bdd tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e" status: 200 len: 1503 microversion: 2.1 time: 0.149067 Apr 16 21:10:06.712841 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 547/1000] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:06 2022] GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e => generated 1503 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:06.780367 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-399e42a0-50d2-4074-b43c-6493432d3eea tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "POST /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8/action" status: 202 len: 0 microversion: 2.1 time: 0.377360 Apr 16 21:10:06.780976 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 454/1001] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:10:06 2022] POST /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8/action => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 16 21:10:06.789208 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2a831712-067a-47a9-b525-d6b00631c499 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:06.789823 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2a831712-067a-47a9-b525-d6b00631c499 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 2b27c826-905d-4c1f-9daf-42150b1025a8] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:06.796037 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2a831712-067a-47a9-b525-d6b00631c499 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:06.796527 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2a831712-067a-47a9-b525-d6b00631c499 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:06.801534 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2a831712-067a-47a9-b525-d6b00631c499 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:06.801534 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2a831712-067a-47a9-b525-d6b00631c499 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:06.831068 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-39aa0285-0395-4c85-aa9f-6ed9c56333e9 req-164849ee-1029-4ea4-a6f9-6bfa9e556329 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a60c9986-12b3-4fc4-9bde-7bf7f34f90bd", "name": "network-vif-plugged", "status": "completed", "tag": "69daf0de-dee8-41ab-85fa-24c0d402ba05"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:10:06.840416 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-39aa0285-0395-4c85-aa9f-6ed9c56333e9 req-164849ee-1029-4ea4-a6f9-6bfa9e556329 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:06.840876 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-39aa0285-0395-4c85-aa9f-6ed9c56333e9 req-164849ee-1029-4ea4-a6f9-6bfa9e556329 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:06.852139 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-39aa0285-0395-4c85-aa9f-6ed9c56333e9 req-164849ee-1029-4ea4-a6f9-6bfa9e556329 service nova] Creating event network-vif-plugged:69daf0de-dee8-41ab-85fa-24c0d402ba05 for instance a60c9986-12b3-4fc4-9bde-7bf7f34f90bd on nch2-master-1 Apr 16 21:10:06.857547 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-39aa0285-0395-4c85-aa9f-6ed9c56333e9 req-164849ee-1029-4ea4-a6f9-6bfa9e556329 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031783 Apr 16 21:10:06.858148 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 455/1002] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:10:06.876742 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f075177a-95ae-470f-94f1-5cc3b58fc999 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:06.876910 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f075177a-95ae-470f-94f1-5cc3b58fc999 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:06.884000 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f075177a-95ae-470f-94f1-5cc3b58fc999 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:06.884523 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f075177a-95ae-470f-94f1-5cc3b58fc999 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:06.885311 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f075177a-95ae-470f-94f1-5cc3b58fc999 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:06.885755 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f075177a-95ae-470f-94f1-5cc3b58fc999 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:06.931714 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2a831712-067a-47a9-b525-d6b00631c499 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:06.942382 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2a831712-067a-47a9-b525-d6b00631c499 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8" status: 200 len: 1522 microversion: 2.1 time: 0.157113 Apr 16 21:10:06.943122 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 548/1003] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:06 2022] GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:10:07.033495 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f075177a-95ae-470f-94f1-5cc3b58fc999 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:07.042059 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f075177a-95ae-470f-94f1-5cc3b58fc999 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:07.043604 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f075177a-95ae-470f-94f1-5cc3b58fc999 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:07.044749 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f075177a-95ae-470f-94f1-5cc3b58fc999 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd" status: 200 len: 1362 microversion: 2.25 time: 0.173492 Apr 16 21:10:07.045302 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 456/1004] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:10:06 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:10:07.223722 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-de5c939a-48fa-45a9-b7df-2e0a40a35fce tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:07.224371 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-de5c939a-48fa-45a9-b7df-2e0a40a35fce tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 8255008b-aaf4-444d-bdcd-6746d42c267b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:07.231031 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-de5c939a-48fa-45a9-b7df-2e0a40a35fce tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:07.232185 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-de5c939a-48fa-45a9-b7df-2e0a40a35fce tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:07.233160 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-de5c939a-48fa-45a9-b7df-2e0a40a35fce tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:07.233606 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-de5c939a-48fa-45a9-b7df-2e0a40a35fce tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:07.342996 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-de5c939a-48fa-45a9-b7df-2e0a40a35fce tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:07.351726 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-de5c939a-48fa-45a9-b7df-2e0a40a35fce tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/8255008b-aaf4-444d-bdcd-6746d42c267b" status: 200 len: 1222 microversion: 2.1 time: 0.131434 Apr 16 21:10:07.364224 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 549/1005] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:07 2022] GET /compute/v2.1/servers/8255008b-aaf4-444d-bdcd-6746d42c267b => generated 1222 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:07.405987 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-87d3955a-7a16-4bda-afd0-b4e97ad85147 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:07.406917 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-87d3955a-7a16-4bda-afd0-b4e97ad85147 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] [instance: 04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:07.414674 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-87d3955a-7a16-4bda-afd0-b4e97ad85147 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:07.418254 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-87d3955a-7a16-4bda-afd0-b4e97ad85147 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:07.418254 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-87d3955a-7a16-4bda-afd0-b4e97ad85147 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:07.418254 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-87d3955a-7a16-4bda-afd0-b4e97ad85147 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:07.578302 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cd8cf2b5-e63a-4bc4-8793-e0fa6272813c tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:07.579222 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cd8cf2b5-e63a-4bc4-8793-e0fa6272813c tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:07.586236 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cd8cf2b5-e63a-4bc4-8793-e0fa6272813c tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:07.586763 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cd8cf2b5-e63a-4bc4-8793-e0fa6272813c tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:07.587615 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cd8cf2b5-e63a-4bc4-8793-e0fa6272813c tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:07.588124 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cd8cf2b5-e63a-4bc4-8793-e0fa6272813c tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:07.737390 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cd8cf2b5-e63a-4bc4-8793-e0fa6272813c tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:07.749049 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cd8cf2b5-e63a-4bc4-8793-e0fa6272813c tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1472 microversion: 2.1 time: 0.174364 Apr 16 21:10:07.750300 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 550/1006] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:07 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1472 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:07.759297 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-87d3955a-7a16-4bda-afd0-b4e97ad85147 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db9403ce44e460a8165587ae22f0ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2a21b6df375491fb09fc22109fb4a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:07.764326 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ef29db00-ebbf-4030-bfe1-ddd6aa5f4654 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:07.765503 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ef29db00-ebbf-4030-bfe1-ddd6aa5f4654 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: bc3b9549-fb07-458b-84bf-3f1d36449e6e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:07.770345 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-87d3955a-7a16-4bda-afd0-b4e97ad85147 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88" status: 200 len: 1317 microversion: 2.1 time: 0.367161 Apr 16 21:10:07.772064 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 457/1007] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:07 2022] GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88 => generated 1317 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:07.779386 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ef29db00-ebbf-4030-bfe1-ddd6aa5f4654 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:07.780935 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ef29db00-ebbf-4030-bfe1-ddd6aa5f4654 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:07.781835 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ef29db00-ebbf-4030-bfe1-ddd6aa5f4654 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:07.782447 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ef29db00-ebbf-4030-bfe1-ddd6aa5f4654 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:07.962621 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7587ac0f-9128-445b-93df-16747146a824 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:07.963922 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7587ac0f-9128-445b-93df-16747146a824 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 2b27c826-905d-4c1f-9daf-42150b1025a8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:07.970510 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7587ac0f-9128-445b-93df-16747146a824 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:07.970965 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7587ac0f-9128-445b-93df-16747146a824 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:07.972400 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7587ac0f-9128-445b-93df-16747146a824 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:07.972874 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7587ac0f-9128-445b-93df-16747146a824 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:08.007601 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ef29db00-ebbf-4030-bfe1-ddd6aa5f4654 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:08.028604 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ef29db00-ebbf-4030-bfe1-ddd6aa5f4654 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e" status: 200 len: 1503 microversion: 2.1 time: 0.276224 Apr 16 21:10:08.040164 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 551/1008] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:07 2022] GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e => generated 1503 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:08.062927 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7ec1d75c-b68e-46d6-90f1-fea236ae9896 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:08.063664 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7ec1d75c-b68e-46d6-90f1-fea236ae9896 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:08.069850 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ec1d75c-b68e-46d6-90f1-fea236ae9896 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:08.070309 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ec1d75c-b68e-46d6-90f1-fea236ae9896 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:08.071084 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ec1d75c-b68e-46d6-90f1-fea236ae9896 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:08.071563 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ec1d75c-b68e-46d6-90f1-fea236ae9896 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:08.210443 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7ec1d75c-b68e-46d6-90f1-fea236ae9896 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:08.218504 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7ec1d75c-b68e-46d6-90f1-fea236ae9896 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:08.220108 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7ec1d75c-b68e-46d6-90f1-fea236ae9896 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:08.221557 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7ec1d75c-b68e-46d6-90f1-fea236ae9896 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd" status: 200 len: 1362 microversion: 2.25 time: 0.162601 Apr 16 21:10:08.222834 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 552/1009] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:10:08 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:10:08.270892 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7587ac0f-9128-445b-93df-16747146a824 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:08.278150 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7587ac0f-9128-445b-93df-16747146a824 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8" status: 200 len: 1522 microversion: 2.1 time: 0.323154 Apr 16 21:10:08.278707 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 458/1010] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:07 2022] GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8 => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:08.369811 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b83538b5-f5f5-4d94-963f-ef95869f5b1b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:08.371139 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b83538b5-f5f5-4d94-963f-ef95869f5b1b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 8255008b-aaf4-444d-bdcd-6746d42c267b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:08.377759 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b83538b5-f5f5-4d94-963f-ef95869f5b1b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:08.379229 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b83538b5-f5f5-4d94-963f-ef95869f5b1b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:08.381975 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b83538b5-f5f5-4d94-963f-ef95869f5b1b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:08.381975 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b83538b5-f5f5-4d94-963f-ef95869f5b1b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:08.445742 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b83538b5-f5f5-4d94-963f-ef95869f5b1b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:08.453349 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b83538b5-f5f5-4d94-963f-ef95869f5b1b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/8255008b-aaf4-444d-bdcd-6746d42c267b" status: 200 len: 1270 microversion: 2.1 time: 0.087522 Apr 16 21:10:08.454336 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 553/1011] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:08 2022] GET /compute/v2.1/servers/8255008b-aaf4-444d-bdcd-6746d42c267b => generated 1270 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:08.780916 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-05cc7d1e-f298-44e8-866e-7a2720eb3447 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:08.783082 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-05cc7d1e-f298-44e8-866e-7a2720eb3447 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:08.798191 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-05cc7d1e-f298-44e8-866e-7a2720eb3447 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:08.800952 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-05cc7d1e-f298-44e8-866e-7a2720eb3447 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:08.803646 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-05cc7d1e-f298-44e8-866e-7a2720eb3447 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:08.821888 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-05cc7d1e-f298-44e8-866e-7a2720eb3447 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:09.016866 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5f937129-b992-45c0-ae24-d6ad1251dff3 tempest-ServicesAdminTestJSON-1258479471 tempest-ServicesAdminTestJSON-1258479471-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:09.018143 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:10:09.018143 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:10:09.022250 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5f937129-b992-45c0-ae24-d6ad1251dff3 tempest-ServicesAdminTestJSON-1258479471 tempest-ServicesAdminTestJSON-1258479471-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:09.022250 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5f937129-b992-45c0-ae24-d6ad1251dff3 tempest-ServicesAdminTestJSON-1258479471 tempest-ServicesAdminTestJSON-1258479471-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:09.022250 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5f937129-b992-45c0-ae24-d6ad1251dff3 tempest-ServicesAdminTestJSON-1258479471 tempest-ServicesAdminTestJSON-1258479471-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:09.022250 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5f937129-b992-45c0-ae24-d6ad1251dff3 tempest-ServicesAdminTestJSON-1258479471 tempest-ServicesAdminTestJSON-1258479471-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:09.037607 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-05cc7d1e-f298-44e8-866e-7a2720eb3447 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:09.046938 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-05cc7d1e-f298-44e8-866e-7a2720eb3447 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1478 microversion: 2.1 time: 0.276306 Apr 16 21:10:09.057457 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 459/1012] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:08 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1478 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:09.061461 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-10996e2c-e2b9-403d-8e55-26443c6e3027 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:09.062180 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5f937129-b992-45c0-ae24-d6ad1251dff3 tempest-ServicesAdminTestJSON-1258479471 tempest-ServicesAdminTestJSON-1258479471-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.293483 Apr 16 21:10:09.062326 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-10996e2c-e2b9-403d-8e55-26443c6e3027 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] [instance: 04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:09.068743 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 554/1013] 10.222.0.20 () {58 vars in 1136 bytes} [Sat Apr 16 21:10:08 2022] GET /compute/v2.1/os-services => generated 947 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:10:09.068743 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bf2282d5-ad3f-4dec-a9bf-e97d9ce9e069 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:09.069522 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-bf2282d5-ad3f-4dec-a9bf-e97d9ce9e069 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: bc3b9549-fb07-458b-84bf-3f1d36449e6e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:09.074298 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-10996e2c-e2b9-403d-8e55-26443c6e3027 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:09.075403 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-10996e2c-e2b9-403d-8e55-26443c6e3027 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:09.075934 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bf2282d5-ad3f-4dec-a9bf-e97d9ce9e069 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:09.076495 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bf2282d5-ad3f-4dec-a9bf-e97d9ce9e069 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:09.077225 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-10996e2c-e2b9-403d-8e55-26443c6e3027 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:09.077389 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bf2282d5-ad3f-4dec-a9bf-e97d9ce9e069 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:09.077905 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bf2282d5-ad3f-4dec-a9bf-e97d9ce9e069 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:09.078164 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-10996e2c-e2b9-403d-8e55-26443c6e3027 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:09.224851 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-bf2282d5-ad3f-4dec-a9bf-e97d9ce9e069 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:09.233213 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-bf2282d5-ad3f-4dec-a9bf-e97d9ce9e069 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e" status: 200 len: 1503 microversion: 2.1 time: 0.169232 Apr 16 21:10:09.233788 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 555/1014] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:09 2022] GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e => generated 1503 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:09.236885 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-10996e2c-e2b9-403d-8e55-26443c6e3027 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db9403ce44e460a8165587ae22f0ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2a21b6df375491fb09fc22109fb4a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:09.238704 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0de3b11a-e51a-42b6-9887-8ffc87672f45 tempest-ServicesAdminTestJSON-1258479471 tempest-ServicesAdminTestJSON-1258479471-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:09.241233 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:10:09.241233 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:10:09.242766 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0de3b11a-e51a-42b6-9887-8ffc87672f45 tempest-ServicesAdminTestJSON-1258479471 tempest-ServicesAdminTestJSON-1258479471-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:09.243611 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0de3b11a-e51a-42b6-9887-8ffc87672f45 tempest-ServicesAdminTestJSON-1258479471 tempest-ServicesAdminTestJSON-1258479471-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:09.244619 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0de3b11a-e51a-42b6-9887-8ffc87672f45 tempest-ServicesAdminTestJSON-1258479471 tempest-ServicesAdminTestJSON-1258479471-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:09.245060 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0de3b11a-e51a-42b6-9887-8ffc87672f45 tempest-ServicesAdminTestJSON-1258479471 tempest-ServicesAdminTestJSON-1258479471-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:09.248148 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-10996e2c-e2b9-403d-8e55-26443c6e3027 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88" status: 200 len: 1317 microversion: 2.1 time: 0.198818 Apr 16 21:10:09.249170 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 460/1015] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:09 2022] GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88 => generated 1317 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:09.259089 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-75db20da-84ba-4454-a489-0d750803ea4f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:09.259089 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-75db20da-84ba-4454-a489-0d750803ea4f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:09.264855 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-75db20da-84ba-4454-a489-0d750803ea4f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:09.265861 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-75db20da-84ba-4454-a489-0d750803ea4f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:09.266654 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-75db20da-84ba-4454-a489-0d750803ea4f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:09.267292 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-75db20da-84ba-4454-a489-0d750803ea4f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:09.278951 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0de3b11a-e51a-42b6-9887-8ffc87672f45 tempest-ServicesAdminTestJSON-1258479471 tempest-ServicesAdminTestJSON-1258479471-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=ncdv-master-1" status: 200 len: 581 microversion: 2.1 time: 0.043961 Apr 16 21:10:09.289488 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 556/1016] 10.222.0.20 () {58 vars in 1173 bytes} [Sat Apr 16 21:10:09 2022] GET /compute/v2.1/os-services?host=ncdv-master-1 => generated 581 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:10:09.294693 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2461c17f-10b4-4c29-8e22-dd14ee1ef5c2 tempest-ServicesAdminTestJSON-1258479471 tempest-ServicesAdminTestJSON-1258479471-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:09.296666 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:10:09.296666 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:10:09.298306 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2461c17f-10b4-4c29-8e22-dd14ee1ef5c2 tempest-ServicesAdminTestJSON-1258479471 tempest-ServicesAdminTestJSON-1258479471-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:09.298930 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2461c17f-10b4-4c29-8e22-dd14ee1ef5c2 tempest-ServicesAdminTestJSON-1258479471 tempest-ServicesAdminTestJSON-1258479471-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:09.300135 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2461c17f-10b4-4c29-8e22-dd14ee1ef5c2 tempest-ServicesAdminTestJSON-1258479471 tempest-ServicesAdminTestJSON-1258479471-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:09.300858 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2461c17f-10b4-4c29-8e22-dd14ee1ef5c2 tempest-ServicesAdminTestJSON-1258479471 tempest-ServicesAdminTestJSON-1258479471-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:09.335265 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2461c17f-10b4-4c29-8e22-dd14ee1ef5c2 tempest-ServicesAdminTestJSON-1258479471 tempest-ServicesAdminTestJSON-1258479471-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.044171 Apr 16 21:10:09.335888 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 557/1017] 10.222.0.20 () {58 vars in 1175 bytes} [Sat Apr 16 21:10:09 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:10:09.340770 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1244b009-c2c3-4153-a253-347e03e6adeb tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:09.341374 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1244b009-c2c3-4153-a253-347e03e6adeb tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 2b27c826-905d-4c1f-9daf-42150b1025a8] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:09.349077 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1244b009-c2c3-4153-a253-347e03e6adeb tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:09.349844 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1244b009-c2c3-4153-a253-347e03e6adeb tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:09.350623 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1244b009-c2c3-4153-a253-347e03e6adeb tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:09.351065 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1244b009-c2c3-4153-a253-347e03e6adeb tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:09.488131 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1244b009-c2c3-4153-a253-347e03e6adeb tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:09.497124 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1244b009-c2c3-4153-a253-347e03e6adeb tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8" status: 200 len: 1522 microversion: 2.1 time: 0.160135 Apr 16 21:10:09.497791 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 558/1018] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:09 2022] GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:09.502262 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a98c32cb-a5e2-4e08-b4bc-86c116e2c666 tempest-ServicesAdminTestJSON-1258479471 tempest-ServicesAdminTestJSON-1258479471-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:09.504120 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:10:09.504120 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:10:09.505449 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a98c32cb-a5e2-4e08-b4bc-86c116e2c666 tempest-ServicesAdminTestJSON-1258479471 tempest-ServicesAdminTestJSON-1258479471-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:09.506006 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a98c32cb-a5e2-4e08-b4bc-86c116e2c666 tempest-ServicesAdminTestJSON-1258479471 tempest-ServicesAdminTestJSON-1258479471-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:09.506826 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a98c32cb-a5e2-4e08-b4bc-86c116e2c666 tempest-ServicesAdminTestJSON-1258479471 tempest-ServicesAdminTestJSON-1258479471-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:09.507442 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a98c32cb-a5e2-4e08-b4bc-86c116e2c666 tempest-ServicesAdminTestJSON-1258479471 tempest-ServicesAdminTestJSON-1258479471-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:09.531884 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a98c32cb-a5e2-4e08-b4bc-86c116e2c666 tempest-ServicesAdminTestJSON-1258479471 tempest-ServicesAdminTestJSON-1258479471-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.033040 Apr 16 21:10:09.532738 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 559/1019] 10.222.0.20 () {58 vars in 1136 bytes} [Sat Apr 16 21:10:09 2022] GET /compute/v2.1/os-services => generated 947 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:10:09.554719 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2a4415b7-f370-4514-a383-171cd358cfdc tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:09.555658 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2a4415b7-f370-4514-a383-171cd358cfdc tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 8255008b-aaf4-444d-bdcd-6746d42c267b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:09.564489 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2a4415b7-f370-4514-a383-171cd358cfdc tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:09.566290 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2a4415b7-f370-4514-a383-171cd358cfdc tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:09.567300 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2a4415b7-f370-4514-a383-171cd358cfdc tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:09.568060 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2a4415b7-f370-4514-a383-171cd358cfdc tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:09.591776 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-75db20da-84ba-4454-a489-0d750803ea4f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:09.602986 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-75db20da-84ba-4454-a489-0d750803ea4f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:09.604939 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-75db20da-84ba-4454-a489-0d750803ea4f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:09.606323 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-75db20da-84ba-4454-a489-0d750803ea4f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd" status: 200 len: 1362 microversion: 2.25 time: 0.355810 Apr 16 21:10:09.618316 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 461/1020] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:10:09 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd => generated 1362 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:10:09.660882 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2a4415b7-f370-4514-a383-171cd358cfdc tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:09.668761 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2a4415b7-f370-4514-a383-171cd358cfdc tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/8255008b-aaf4-444d-bdcd-6746d42c267b" status: 200 len: 1270 microversion: 2.1 time: 0.134678 Apr 16 21:10:09.669359 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 560/1021] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:09 2022] GET /compute/v2.1/servers/8255008b-aaf4-444d-bdcd-6746d42c267b => generated 1270 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:10.066772 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-89eb617a-521c-4b27-9852-8612548960db tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:10.067678 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-89eb617a-521c-4b27-9852-8612548960db tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:10.081509 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-89eb617a-521c-4b27-9852-8612548960db tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:10.083825 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-89eb617a-521c-4b27-9852-8612548960db tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:10.085864 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-89eb617a-521c-4b27-9852-8612548960db tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:10.085995 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-89eb617a-521c-4b27-9852-8612548960db tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:10.250932 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-29939f99-3a5a-409d-bc19-81051a45c808 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:10.251725 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-29939f99-3a5a-409d-bc19-81051a45c808 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: bc3b9549-fb07-458b-84bf-3f1d36449e6e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:10.258928 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-29939f99-3a5a-409d-bc19-81051a45c808 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:10.259392 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-29939f99-3a5a-409d-bc19-81051a45c808 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:10.260398 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-29939f99-3a5a-409d-bc19-81051a45c808 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:10.260996 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-29939f99-3a5a-409d-bc19-81051a45c808 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:10.398553 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-89eb617a-521c-4b27-9852-8612548960db tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:10.408700 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-89eb617a-521c-4b27-9852-8612548960db tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1478 microversion: 2.1 time: 0.347625 Apr 16 21:10:10.418375 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 462/1022] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:10 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1478 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:10.424115 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8d3fd770-ab3a-45fd-9ebc-e63df291ddd3 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:10.425002 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8d3fd770-ab3a-45fd-9ebc-e63df291ddd3 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] [instance: 04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:10.431990 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8d3fd770-ab3a-45fd-9ebc-e63df291ddd3 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:10.432484 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8d3fd770-ab3a-45fd-9ebc-e63df291ddd3 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:10.434831 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8d3fd770-ab3a-45fd-9ebc-e63df291ddd3 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:10.434831 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8d3fd770-ab3a-45fd-9ebc-e63df291ddd3 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:10.548272 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-29939f99-3a5a-409d-bc19-81051a45c808 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:10.578086 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-29939f99-3a5a-409d-bc19-81051a45c808 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e" status: 200 len: 1503 microversion: 2.1 time: 0.330824 Apr 16 21:10:10.578708 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 561/1023] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:10 2022] GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e => generated 1503 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:10.584928 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-30701f78-44ee-493d-857d-2baaea014a4a tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:10.585559 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-30701f78-44ee-493d-857d-2baaea014a4a tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 2b27c826-905d-4c1f-9daf-42150b1025a8] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:10.596425 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-30701f78-44ee-493d-857d-2baaea014a4a tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:10.597652 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-30701f78-44ee-493d-857d-2baaea014a4a tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:10.598530 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-30701f78-44ee-493d-857d-2baaea014a4a tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:10.598993 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-30701f78-44ee-493d-857d-2baaea014a4a tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:10.764742 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8d3fd770-ab3a-45fd-9ebc-e63df291ddd3 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db9403ce44e460a8165587ae22f0ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2a21b6df375491fb09fc22109fb4a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:10.774599 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8d3fd770-ab3a-45fd-9ebc-e63df291ddd3 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88" status: 200 len: 1317 microversion: 2.1 time: 0.354913 Apr 16 21:10:10.775808 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 463/1024] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:10 2022] GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88 => generated 1317 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:10.781925 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-705444fb-60ed-435c-bec3-7812d80a07ac tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:10.782958 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-705444fb-60ed-435c-bec3-7812d80a07ac tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:10.791107 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-705444fb-60ed-435c-bec3-7812d80a07ac tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:10.792234 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-705444fb-60ed-435c-bec3-7812d80a07ac tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:10.793495 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-705444fb-60ed-435c-bec3-7812d80a07ac tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:10.794296 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-705444fb-60ed-435c-bec3-7812d80a07ac tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:10.901640 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-30701f78-44ee-493d-857d-2baaea014a4a tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:10.913414 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-30701f78-44ee-493d-857d-2baaea014a4a tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8" status: 200 len: 1522 microversion: 2.1 time: 0.332694 Apr 16 21:10:10.914085 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 562/1025] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:10 2022] GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8 => generated 1522 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:10.931290 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-981053a9-d406-47e1-91c6-e57fb4b01330 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:10.932516 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-981053a9-d406-47e1-91c6-e57fb4b01330 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 8255008b-aaf4-444d-bdcd-6746d42c267b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:10.944524 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-981053a9-d406-47e1-91c6-e57fb4b01330 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:10.945270 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-981053a9-d406-47e1-91c6-e57fb4b01330 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:10.946442 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-981053a9-d406-47e1-91c6-e57fb4b01330 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:10.947135 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-981053a9-d406-47e1-91c6-e57fb4b01330 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:11.062144 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-981053a9-d406-47e1-91c6-e57fb4b01330 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:11.076590 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-981053a9-d406-47e1-91c6-e57fb4b01330 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/8255008b-aaf4-444d-bdcd-6746d42c267b" status: 200 len: 1276 microversion: 2.1 time: 0.151381 Apr 16 21:10:11.077474 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 563/1026] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:10 2022] GET /compute/v2.1/servers/8255008b-aaf4-444d-bdcd-6746d42c267b => generated 1276 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:11.090493 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-705444fb-60ed-435c-bec3-7812d80a07ac tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:11.101285 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-705444fb-60ed-435c-bec3-7812d80a07ac tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:11.102812 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-705444fb-60ed-435c-bec3-7812d80a07ac tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:11.104096 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-705444fb-60ed-435c-bec3-7812d80a07ac tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd" status: 200 len: 1558 microversion: 2.25 time: 0.327109 Apr 16 21:10:11.106528 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 464/1027] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:10:10 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd => generated 1558 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:10:11.128006 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7ee448ac-93f4-4aad-902f-ca4c5d49426d tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:11.129027 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7ee448ac-93f4-4aad-902f-ca4c5d49426d tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:11.137045 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ee448ac-93f4-4aad-902f-ca4c5d49426d tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:11.137608 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ee448ac-93f4-4aad-902f-ca4c5d49426d tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:11.138464 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ee448ac-93f4-4aad-902f-ca4c5d49426d tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:11.138981 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ee448ac-93f4-4aad-902f-ca4c5d49426d tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:11.289372 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-89cf9315-c296-40cb-97b3-a84cc6826034 req-4c3cb0b5-8d80-4a26-a596-3263af093167 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "970fc2c2-b7bc-496e-bbf5-be24bc6cf248", "tag": "e4213a8a-25d6-4171-9e1d-b2165b7b93f4"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:10:11.311801 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-7ee448ac-93f4-4aad-902f-ca4c5d49426d tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lazy-loading 'services' on Instance uuid a60c9986-12b3-4fc4-9bde-7bf7f34f90bd {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:10:11.325322 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-89cf9315-c296-40cb-97b3-a84cc6826034 req-4c3cb0b5-8d80-4a26-a596-3263af093167 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:11.325793 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-89cf9315-c296-40cb-97b3-a84cc6826034 req-4c3cb0b5-8d80-4a26-a596-3263af093167 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:11.335575 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7ee448ac-93f4-4aad-902f-ca4c5d49426d tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd" status: 200 len: 2051 microversion: 2.25 time: 0.211339 Apr 16 21:10:11.336270 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 564/1028] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:10:11 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd => generated 2051 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:10:11.363546 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-89cf9315-c296-40cb-97b3-a84cc6826034 req-4c3cb0b5-8d80-4a26-a596-3263af093167 service nova] Creating event network-changed:e4213a8a-25d6-4171-9e1d-b2165b7b93f4 for instance 970fc2c2-b7bc-496e-bbf5-be24bc6cf248 on nch1-master-1 Apr 16 21:10:11.365623 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b3fca2ce-9ec4-495b-8f6f-0cbac1ae6c14 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:11.367497 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:10:11.367497 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:10:11.370858 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b3fca2ce-9ec4-495b-8f6f-0cbac1ae6c14 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:11.371718 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b3fca2ce-9ec4-495b-8f6f-0cbac1ae6c14 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:11.373702 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b3fca2ce-9ec4-495b-8f6f-0cbac1ae6c14 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:11.374469 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b3fca2ce-9ec4-495b-8f6f-0cbac1ae6c14 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:11.374941 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-89cf9315-c296-40cb-97b3-a84cc6826034 req-4c3cb0b5-8d80-4a26-a596-3263af093167 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090485 Apr 16 21:10:11.375976 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 465/1029] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:10:11.428774 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f7e819ae-d655-4613-b7c9-c4f96aabfc81 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:11.429870 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f7e819ae-d655-4613-b7c9-c4f96aabfc81 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:11.442269 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f7e819ae-d655-4613-b7c9-c4f96aabfc81 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:11.442740 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f7e819ae-d655-4613-b7c9-c4f96aabfc81 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:11.443591 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f7e819ae-d655-4613-b7c9-c4f96aabfc81 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:11.444275 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f7e819ae-d655-4613-b7c9-c4f96aabfc81 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:11.454545 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b3fca2ce-9ec4-495b-8f6f-0cbac1ae6c14 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.095089 Apr 16 21:10:11.462166 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 565/1030] 10.222.0.20 () {60 vars in 1216 bytes} [Sat Apr 16 21:10:11 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:10:11.606414 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-babbbd44-3cbd-4184-93f7-597a9e41e79c tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:11.613376 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-babbbd44-3cbd-4184-93f7-597a9e41e79c tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: bc3b9549-fb07-458b-84bf-3f1d36449e6e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:11.631112 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-babbbd44-3cbd-4184-93f7-597a9e41e79c tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:11.637518 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-babbbd44-3cbd-4184-93f7-597a9e41e79c tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:11.637518 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-babbbd44-3cbd-4184-93f7-597a9e41e79c tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:11.637518 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-babbbd44-3cbd-4184-93f7-597a9e41e79c tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:11.952265 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f7e819ae-d655-4613-b7c9-c4f96aabfc81 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:11.964332 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f7e819ae-d655-4613-b7c9-c4f96aabfc81 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1478 microversion: 2.1 time: 0.538759 Apr 16 21:10:11.965934 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 466/1031] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:11 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1478 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:11.982660 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-701269d9-7021-42e5-b9df-4ba78844bb79 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:11.982660 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-701269d9-7021-42e5-b9df-4ba78844bb79 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] [instance: 04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:11.997961 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-701269d9-7021-42e5-b9df-4ba78844bb79 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:11.999814 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-701269d9-7021-42e5-b9df-4ba78844bb79 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:12.001056 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-701269d9-7021-42e5-b9df-4ba78844bb79 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:12.005013 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-701269d9-7021-42e5-b9df-4ba78844bb79 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:12.301706 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-701269d9-7021-42e5-b9df-4ba78844bb79 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db9403ce44e460a8165587ae22f0ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2a21b6df375491fb09fc22109fb4a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:12.307816 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-babbbd44-3cbd-4184-93f7-597a9e41e79c tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:12.311844 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-701269d9-7021-42e5-b9df-4ba78844bb79 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88" status: 200 len: 1317 microversion: 2.1 time: 0.340863 Apr 16 21:10:12.313039 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 467/1032] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:11 2022] GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88 => generated 1317 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:12.318280 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-68b98986-66bd-4ac9-957e-8b70fc1cd4f1 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:12.318917 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-68b98986-66bd-4ac9-957e-8b70fc1cd4f1 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 2b27c826-905d-4c1f-9daf-42150b1025a8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:12.329915 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-68b98986-66bd-4ac9-957e-8b70fc1cd4f1 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:12.330613 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-68b98986-66bd-4ac9-957e-8b70fc1cd4f1 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:12.334292 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-68b98986-66bd-4ac9-957e-8b70fc1cd4f1 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:12.334292 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-68b98986-66bd-4ac9-957e-8b70fc1cd4f1 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:12.345246 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-babbbd44-3cbd-4184-93f7-597a9e41e79c tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e" status: 200 len: 1478 microversion: 2.1 time: 0.752941 Apr 16 21:10:12.345858 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 566/1033] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:11 2022] GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e => generated 1478 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:12.375971 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c04fec8e-a71d-449e-b5c7-07472fa550bd tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:12.381781 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c04fec8e-a71d-449e-b5c7-07472fa550bd tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 8255008b-aaf4-444d-bdcd-6746d42c267b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:12.396431 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c04fec8e-a71d-449e-b5c7-07472fa550bd tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:12.396905 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c04fec8e-a71d-449e-b5c7-07472fa550bd tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:12.397727 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c04fec8e-a71d-449e-b5c7-07472fa550bd tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:12.410707 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c04fec8e-a71d-449e-b5c7-07472fa550bd tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:12.681569 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-68b98986-66bd-4ac9-957e-8b70fc1cd4f1 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:12.691248 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-68b98986-66bd-4ac9-957e-8b70fc1cd4f1 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8" status: 200 len: 1522 microversion: 2.1 time: 0.376530 Apr 16 21:10:12.696566 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 468/1034] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:12 2022] GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8 => generated 1522 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:12.703788 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-26d87866-4841-4dea-83b6-c374dea62c5d req-3be1d7e6-0c5b-4002-a10e-e766f7d5696e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88", "name": "network-vif-plugged", "status": "completed", "tag": "b490e936-9731-4964-89b6-ba2e9e7ac544"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:10:12.714565 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-26d87866-4841-4dea-83b6-c374dea62c5d req-3be1d7e6-0c5b-4002-a10e-e766f7d5696e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:12.715270 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-26d87866-4841-4dea-83b6-c374dea62c5d req-3be1d7e6-0c5b-4002-a10e-e766f7d5696e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:12.727785 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-26d87866-4841-4dea-83b6-c374dea62c5d req-3be1d7e6-0c5b-4002-a10e-e766f7d5696e service nova] Creating event network-vif-plugged:b490e936-9731-4964-89b6-ba2e9e7ac544 for instance 04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88 on nch2-master-1 Apr 16 21:10:12.733198 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-26d87866-4841-4dea-83b6-c374dea62c5d req-3be1d7e6-0c5b-4002-a10e-e766f7d5696e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039440 Apr 16 21:10:12.738625 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 469/1035] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:10:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:10:12.741229 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c04fec8e-a71d-449e-b5c7-07472fa550bd tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:12.744220 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4f031254-c637-4c88-b16c-db054ca8bbb6 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Calling method '.version_select at 0x7fbb96637b80>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:12.746882 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4f031254-c637-4c88-b16c-db054ca8bbb6 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:12.747355 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4f031254-c637-4c88-b16c-db054ca8bbb6 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:12.752352 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c04fec8e-a71d-449e-b5c7-07472fa550bd tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/8255008b-aaf4-444d-bdcd-6746d42c267b" status: 200 len: 1318 microversion: 2.1 time: 0.386831 Apr 16 21:10:12.756453 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 567/1036] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:12 2022] GET /compute/v2.1/servers/8255008b-aaf4-444d-bdcd-6746d42c267b => generated 1318 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:12.759834 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4f031254-c637-4c88-b16c-db054ca8bbb6 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 1550 microversion: 2.1 time: 0.020307 Apr 16 21:10:12.773023 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 470/1037] 10.222.0.20 () {58 vars in 1142 bytes} [Sat Apr 16 21:10:12 2022] GET /compute/v2.1/os-migrations => generated 1550 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:12.775696 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-88ec9350-7dc7-4f31-8747-db362b6bd089 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:12.776402 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-88ec9350-7dc7-4f31-8747-db362b6bd089 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] [instance: bc3b9549-fb07-458b-84bf-3f1d36449e6e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:12.782688 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-88ec9350-7dc7-4f31-8747-db362b6bd089 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:12.784310 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-88ec9350-7dc7-4f31-8747-db362b6bd089 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:12.785400 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-88ec9350-7dc7-4f31-8747-db362b6bd089 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:12.786304 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-88ec9350-7dc7-4f31-8747-db362b6bd089 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:12.983731 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b59550c8-27e6-415f-9827-052c50c3e455 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:12.989590 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b59550c8-27e6-415f-9827-052c50c3e455 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:12.993700 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b59550c8-27e6-415f-9827-052c50c3e455 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:12.994280 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b59550c8-27e6-415f-9827-052c50c3e455 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:12.995488 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b59550c8-27e6-415f-9827-052c50c3e455 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:12.995920 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b59550c8-27e6-415f-9827-052c50c3e455 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:13.009932 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-88ec9350-7dc7-4f31-8747-db362b6bd089 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e" status: 200 len: 1629 microversion: 2.1 time: 0.240605 Apr 16 21:10:13.014029 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 568/1038] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:12 2022] GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e => generated 1629 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:10:13.145436 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9424fe71-3fc0-4aa3-b9e0-bd99c1ed2aad tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-384409039", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "8cfbbf93-9e15-4e76-bfe0-e69ff753f337"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:10:13.207128 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-9424fe71-3fc0-4aa3-b9e0-bd99c1ed2aad tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] validate_networks() for [('8cfbbf93-9e15-4e76-bfe0-e69ff753f337', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:10:13.255431 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b59550c8-27e6-415f-9827-052c50c3e455 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:13.267151 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b59550c8-27e6-415f-9827-052c50c3e455 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1478 microversion: 2.1 time: 0.288014 Apr 16 21:10:13.267728 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 471/1039] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:12 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1478 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:10:13.280536 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-004f3e76-183f-46f8-90ae-aece6acf107f req-93a12280-69fb-4dea-b5b1-ce61272b0461 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8255008b-aaf4-444d-bdcd-6746d42c267b", "tag": "259c9f9f-e7b7-4e10-9e05-3056d94db8ff"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:10:13.297009 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-004f3e76-183f-46f8-90ae-aece6acf107f req-93a12280-69fb-4dea-b5b1-ce61272b0461 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:13.297710 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-004f3e76-183f-46f8-90ae-aece6acf107f req-93a12280-69fb-4dea-b5b1-ce61272b0461 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:13.310247 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-004f3e76-183f-46f8-90ae-aece6acf107f req-93a12280-69fb-4dea-b5b1-ce61272b0461 service nova] Creating event network-changed:259c9f9f-e7b7-4e10-9e05-3056d94db8ff for instance 8255008b-aaf4-444d-bdcd-6746d42c267b on nch2-master-1 Apr 16 21:10:13.319303 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-004f3e76-183f-46f8-90ae-aece6acf107f req-93a12280-69fb-4dea-b5b1-ce61272b0461 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046980 Apr 16 21:10:13.321946 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 472/1040] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:10:13.330508 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cf02365c-f277-47c8-bab0-5baf9b9d94de tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:13.331971 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-cf02365c-f277-47c8-bab0-5baf9b9d94de tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] [instance: 04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:13.338641 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cf02365c-f277-47c8-bab0-5baf9b9d94de tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:13.339343 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cf02365c-f277-47c8-bab0-5baf9b9d94de tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:13.340217 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cf02365c-f277-47c8-bab0-5baf9b9d94de tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:13.340869 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cf02365c-f277-47c8-bab0-5baf9b9d94de tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:13.542981 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cf02365c-f277-47c8-bab0-5baf9b9d94de tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db9403ce44e460a8165587ae22f0ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2a21b6df375491fb09fc22109fb4a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:13.552487 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cf02365c-f277-47c8-bab0-5baf9b9d94de tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88" status: 200 len: 1317 microversion: 2.1 time: 0.225909 Apr 16 21:10:13.553651 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 473/1041] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:13 2022] GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88 => generated 1317 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:10:13.679131 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-9424fe71-3fc0-4aa3-b9e0-bd99c1ed2aad tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:10:13.679603 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-9424fe71-3fc0-4aa3-b9e0-bd99c1ed2aad tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:10:13.683503 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-9424fe71-3fc0-4aa3-b9e0-bd99c1ed2aad tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:10:13.683941 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-9424fe71-3fc0-4aa3-b9e0-bd99c1ed2aad tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:10:13.684400 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-9424fe71-3fc0-4aa3-b9e0-bd99c1ed2aad tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:10:13.693246 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9424fe71-3fc0-4aa3-b9e0-bd99c1ed2aad tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:13.693696 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9424fe71-3fc0-4aa3-b9e0-bd99c1ed2aad tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:13.694503 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9424fe71-3fc0-4aa3-b9e0-bd99c1ed2aad tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:13.694947 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9424fe71-3fc0-4aa3-b9e0-bd99c1ed2aad tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:13.709476 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-015fbf11-468e-48fe-b376-7c1da8f95da1 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:13.710130 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-015fbf11-468e-48fe-b376-7c1da8f95da1 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 2b27c826-905d-4c1f-9daf-42150b1025a8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:13.711820 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-9424fe71-3fc0-4aa3-b9e0-bd99c1ed2aad tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Getting quotas for project b18530cc69c44e6f8a46ca966b3e3a7f. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:10:13.715918 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-015fbf11-468e-48fe-b376-7c1da8f95da1 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:13.716408 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-015fbf11-468e-48fe-b376-7c1da8f95da1 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:13.716873 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-9424fe71-3fc0-4aa3-b9e0-bd99c1ed2aad tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Getting quotas for user 547d9f3aa3a54867971074b795d83b81 and project b18530cc69c44e6f8a46ca966b3e3a7f. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:10:13.717175 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-015fbf11-468e-48fe-b376-7c1da8f95da1 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:13.717656 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-015fbf11-468e-48fe-b376-7c1da8f95da1 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:13.729660 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9424fe71-3fc0-4aa3-b9e0-bd99c1ed2aad tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:10:13.731923 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9424fe71-3fc0-4aa3-b9e0-bd99c1ed2aad tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:10:13.858749 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9424fe71-3fc0-4aa3-b9e0-bd99c1ed2aad tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.720600 Apr 16 21:10:13.860071 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 569/1042] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:10:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:10:13.870295 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7636b7dd-fed5-42ab-8aca-06f20d13bbe6 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:13.877602 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7636b7dd-fed5-42ab-8aca-06f20d13bbe6 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 8255008b-aaf4-444d-bdcd-6746d42c267b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:13.880017 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7636b7dd-fed5-42ab-8aca-06f20d13bbe6 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:13.880692 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7636b7dd-fed5-42ab-8aca-06f20d13bbe6 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:13.881408 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-015fbf11-468e-48fe-b376-7c1da8f95da1 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:13.881855 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7636b7dd-fed5-42ab-8aca-06f20d13bbe6 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:13.882452 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7636b7dd-fed5-42ab-8aca-06f20d13bbe6 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:13.895094 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-015fbf11-468e-48fe-b376-7c1da8f95da1 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8" status: 200 len: 1522 microversion: 2.1 time: 0.189687 Apr 16 21:10:13.896588 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 474/1043] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:13 2022] GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:10:13.902338 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-950627df-7a1d-409d-9ad7-ec3bc230c757 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:13.903209 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-950627df-7a1d-409d-9ad7-ec3bc230c757 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:13.975990 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-950627df-7a1d-409d-9ad7-ec3bc230c757 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:13.985086 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-950627df-7a1d-409d-9ad7-ec3bc230c757 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1210 microversion: 2.1 time: 0.086921 Apr 16 21:10:13.988123 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 475/1044] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:13 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1210 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:14.071089 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7636b7dd-fed5-42ab-8aca-06f20d13bbe6 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:14.080322 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7636b7dd-fed5-42ab-8aca-06f20d13bbe6 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/8255008b-aaf4-444d-bdcd-6746d42c267b" status: 200 len: 1318 microversion: 2.1 time: 0.218823 Apr 16 21:10:14.090705 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 570/1045] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:13 2022] GET /compute/v2.1/servers/8255008b-aaf4-444d-bdcd-6746d42c267b => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:14.285382 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b4858f76-469b-445d-b555-27099a8d51db tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:14.285999 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b4858f76-469b-445d-b555-27099a8d51db tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:14.297587 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b4858f76-469b-445d-b555-27099a8d51db tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:14.297587 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b4858f76-469b-445d-b555-27099a8d51db tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:14.297587 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b4858f76-469b-445d-b555-27099a8d51db tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:14.297587 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b4858f76-469b-445d-b555-27099a8d51db tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:14.466419 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b4858f76-469b-445d-b555-27099a8d51db tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:14.474781 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b4858f76-469b-445d-b555-27099a8d51db tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1478 microversion: 2.1 time: 0.193955 Apr 16 21:10:14.476219 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 476/1046] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:14 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1478 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:14.572891 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1571f26b-2cd0-4c7b-ba21-6d22f2641bc3 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:14.572891 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1571f26b-2cd0-4c7b-ba21-6d22f2641bc3 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] [instance: 04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:14.579693 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1571f26b-2cd0-4c7b-ba21-6d22f2641bc3 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:14.580740 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1571f26b-2cd0-4c7b-ba21-6d22f2641bc3 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:14.582405 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1571f26b-2cd0-4c7b-ba21-6d22f2641bc3 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:14.583043 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1571f26b-2cd0-4c7b-ba21-6d22f2641bc3 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:14.750899 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-07e3e20d-a3bd-404b-8c33-b4a52cb5bb82 req-b8740066-3e26-4433-abb2-e56e750ee365 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dfc548c-fae5-47a4-bb2e-8a022ebf6c17", "name": "network-vif-plugged", "status": "completed", "tag": "c0642788-5af8-4722-90dd-d3c3c1a8b4a7"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:10:14.764059 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-07e3e20d-a3bd-404b-8c33-b4a52cb5bb82 req-b8740066-3e26-4433-abb2-e56e750ee365 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:14.765741 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-07e3e20d-a3bd-404b-8c33-b4a52cb5bb82 req-b8740066-3e26-4433-abb2-e56e750ee365 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:14.791009 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-07e3e20d-a3bd-404b-8c33-b4a52cb5bb82 req-b8740066-3e26-4433-abb2-e56e750ee365 service nova] Creating event network-vif-plugged:c0642788-5af8-4722-90dd-d3c3c1a8b4a7 for instance 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 on nch1-master-1 Apr 16 21:10:14.797953 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-07e3e20d-a3bd-404b-8c33-b4a52cb5bb82 req-b8740066-3e26-4433-abb2-e56e750ee365 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052227 Apr 16 21:10:14.798636 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 477/1047] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:10:14.856521 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1571f26b-2cd0-4c7b-ba21-6d22f2641bc3 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db9403ce44e460a8165587ae22f0ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2a21b6df375491fb09fc22109fb4a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:14.865686 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1571f26b-2cd0-4c7b-ba21-6d22f2641bc3 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88" status: 200 len: 1317 microversion: 2.1 time: 0.300470 Apr 16 21:10:14.872642 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 571/1048] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:14 2022] GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88 => generated 1317 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:14.916825 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-18bd606c-b1c9-4341-955a-e8340dae6467 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:14.917867 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-18bd606c-b1c9-4341-955a-e8340dae6467 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 2b27c826-905d-4c1f-9daf-42150b1025a8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:14.925869 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-18bd606c-b1c9-4341-955a-e8340dae6467 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:14.926646 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-18bd606c-b1c9-4341-955a-e8340dae6467 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:14.927656 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-18bd606c-b1c9-4341-955a-e8340dae6467 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:14.928353 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-18bd606c-b1c9-4341-955a-e8340dae6467 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:15.001461 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4f7193b6-134c-4690-a7ea-af8112691f65 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:15.002053 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4f7193b6-134c-4690-a7ea-af8112691f65 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:15.134593 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4f7193b6-134c-4690-a7ea-af8112691f65 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:15.143169 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4f7193b6-134c-4690-a7ea-af8112691f65 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1210 microversion: 2.1 time: 0.145422 Apr 16 21:10:15.145449 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 572/1049] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:14 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1210 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:10:15.167756 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9595caa8-a784-41e4-9116-bdc085d112a9 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:15.169268 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9595caa8-a784-41e4-9116-bdc085d112a9 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 8255008b-aaf4-444d-bdcd-6746d42c267b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:15.178353 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9595caa8-a784-41e4-9116-bdc085d112a9 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:15.179161 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9595caa8-a784-41e4-9116-bdc085d112a9 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:15.180477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9595caa8-a784-41e4-9116-bdc085d112a9 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:15.181159 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9595caa8-a784-41e4-9116-bdc085d112a9 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:15.232569 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-18bd606c-b1c9-4341-955a-e8340dae6467 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:15.242526 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-18bd606c-b1c9-4341-955a-e8340dae6467 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8" status: 200 len: 1522 microversion: 2.1 time: 0.333381 Apr 16 21:10:15.243391 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 478/1050] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:14 2022] GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8 => generated 1522 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:15.249010 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-37fb6ab9-73f5-4783-9296-349d59358ba9 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0bbd6c4-67eb-4f42-a9e2-e08052fd877f", "device": "/dev/xvdb"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:10:15.251010 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-37fb6ab9-73f5-4783-9296-349d59358ba9 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:15.266449 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-37fb6ab9-73f5-4783-9296-349d59358ba9 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:15.267794 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-37fb6ab9-73f5-4783-9296-349d59358ba9 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:15.273483 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-37fb6ab9-73f5-4783-9296-349d59358ba9 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:15.273971 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-37fb6ab9-73f5-4783-9296-349d59358ba9 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:15.460250 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9595caa8-a784-41e4-9116-bdc085d112a9 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:15.465676 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9595caa8-a784-41e4-9116-bdc085d112a9 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/8255008b-aaf4-444d-bdcd-6746d42c267b" status: 200 len: 1318 microversion: 2.1 time: 0.313326 Apr 16 21:10:15.468205 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 573/1051] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:15 2022] GET /compute/v2.1/servers/8255008b-aaf4-444d-bdcd-6746d42c267b => generated 1318 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:15.491926 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f7b4c79b-4b6d-4646-bdee-6823c6d55c50 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:15.492656 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f7b4c79b-4b6d-4646-bdee-6823c6d55c50 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:15.500491 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f7b4c79b-4b6d-4646-bdee-6823c6d55c50 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:15.501402 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f7b4c79b-4b6d-4646-bdee-6823c6d55c50 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:15.503554 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f7b4c79b-4b6d-4646-bdee-6823c6d55c50 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:15.504122 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f7b4c79b-4b6d-4646-bdee-6823c6d55c50 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:15.731327 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f7b4c79b-4b6d-4646-bdee-6823c6d55c50 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:15.746713 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f7b4c79b-4b6d-4646-bdee-6823c6d55c50 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1478 microversion: 2.1 time: 0.257125 Apr 16 21:10:15.746713 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 574/1052] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:15 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1478 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:15.889111 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c3ea705b-2da8-4815-bceb-6e825ea6fc69 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:15.889942 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c3ea705b-2da8-4815-bceb-6e825ea6fc69 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] [instance: 04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:15.896441 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3ea705b-2da8-4815-bceb-6e825ea6fc69 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:15.896811 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3ea705b-2da8-4815-bceb-6e825ea6fc69 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:15.897660 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3ea705b-2da8-4815-bceb-6e825ea6fc69 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:15.898165 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3ea705b-2da8-4815-bceb-6e825ea6fc69 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:16.027479 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c3ea705b-2da8-4815-bceb-6e825ea6fc69 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db9403ce44e460a8165587ae22f0ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2a21b6df375491fb09fc22109fb4a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:16.035876 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c3ea705b-2da8-4815-bceb-6e825ea6fc69 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88" status: 200 len: 1467 microversion: 2.1 time: 0.150649 Apr 16 21:10:16.036923 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 575/1053] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:15 2022] GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88 => generated 1467 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:10:16.053877 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d16962d5-79c8-4f2a-882a-05b0cfcecd76 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-164659722", "metadata": {"image_type": "test"}}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:10:16.055091 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d16962d5-79c8-4f2a-882a-05b0cfcecd76 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] [instance: 04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:16.061296 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d16962d5-79c8-4f2a-882a-05b0cfcecd76 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:16.061821 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d16962d5-79c8-4f2a-882a-05b0cfcecd76 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:16.062607 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d16962d5-79c8-4f2a-882a-05b0cfcecd76 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:16.063050 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d16962d5-79c8-4f2a-882a-05b0cfcecd76 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:16.099453 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-d16962d5-79c8-4f2a-882a-05b0cfcecd76 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Getting quotas for project d2a21b6df375491fb09fc22109fb4a5c. Resources: dict_keys(['metadata_items']) {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:10:16.105026 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-d16962d5-79c8-4f2a-882a-05b0cfcecd76 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Getting quotas for user 2db9403ce44e460a8165587ae22f0ad2 and project d2a21b6df375491fb09fc22109fb4a5c. Resources: dict_keys(['metadata_items']) {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:10:16.416510 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-37fb6ab9-73f5-4783-9296-349d59358ba9 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "POST /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 1.171629 Apr 16 21:10:16.417502 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 479/1054] 10.222.0.20 () {62 vars in 1363 bytes} [Sat Apr 16 21:10:15 2022] POST /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd/os-volume_attachments => generated 194 bytes in 1173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:10:16.423203 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6ab1e04b-b0c3-4d0f-871e-7e7d31483440 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:16.424011 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6ab1e04b-b0c3-4d0f-871e-7e7d31483440 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:16.434665 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6ab1e04b-b0c3-4d0f-871e-7e7d31483440 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:16.434665 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6ab1e04b-b0c3-4d0f-871e-7e7d31483440 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:16.434665 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6ab1e04b-b0c3-4d0f-871e-7e7d31483440 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:16.434958 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6ab1e04b-b0c3-4d0f-871e-7e7d31483440 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:16.517377 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6ab1e04b-b0c3-4d0f-871e-7e7d31483440 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:16.525579 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6ab1e04b-b0c3-4d0f-871e-7e7d31483440 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1262 microversion: 2.1 time: 0.106580 Apr 16 21:10:16.526244 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 480/1055] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:16 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1262 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:16.530890 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-401b5c58-8609-4d11-a13b-30126d174c49 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:16.531695 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-401b5c58-8609-4d11-a13b-30126d174c49 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 2b27c826-905d-4c1f-9daf-42150b1025a8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:16.538704 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-401b5c58-8609-4d11-a13b-30126d174c49 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:16.539155 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-401b5c58-8609-4d11-a13b-30126d174c49 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:16.539969 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-401b5c58-8609-4d11-a13b-30126d174c49 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:16.540426 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-401b5c58-8609-4d11-a13b-30126d174c49 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:16.626039 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d16962d5-79c8-4f2a-882a-05b0cfcecd76 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "POST /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88/action" status: 202 len: 0 microversion: 2.1 time: 0.576395 Apr 16 21:10:16.626700 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 576/1056] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:10:16 2022] POST /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88/action => generated 0 bytes in 578 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 16 21:10:16.635921 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-508b0979-cec1-48cb-9372-76b8e454a792 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:16.636874 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-508b0979-cec1-48cb-9372-76b8e454a792 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 8255008b-aaf4-444d-bdcd-6746d42c267b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:16.645296 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-508b0979-cec1-48cb-9372-76b8e454a792 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:16.645437 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-508b0979-cec1-48cb-9372-76b8e454a792 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:16.646318 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-508b0979-cec1-48cb-9372-76b8e454a792 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:16.646705 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-508b0979-cec1-48cb-9372-76b8e454a792 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:16.707713 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-401b5c58-8609-4d11-a13b-30126d174c49 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:16.716025 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-401b5c58-8609-4d11-a13b-30126d174c49 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8" status: 200 len: 1522 microversion: 2.1 time: 0.188716 Apr 16 21:10:16.716831 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 481/1057] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:16 2022] GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:16.725013 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5f1f6f66-8155-4c3f-8024-dbeecb862a20 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb964ff820>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:16.775237 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5f1f6f66-8155-4c3f-8024-dbeecb862a20 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef" status: 200 len: 1421 microversion: 2.1 time: 0.055845 Apr 16 21:10:16.776547 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 482/1058] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:10:16 2022] GET /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef => generated 1421 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:16.785813 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-73126b3c-a91e-4df0-9fe0-2a3d41be71c0 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:16.791306 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-73126b3c-a91e-4df0-9fe0-2a3d41be71c0 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:16.794553 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-73126b3c-a91e-4df0-9fe0-2a3d41be71c0 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:16.795248 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-73126b3c-a91e-4df0-9fe0-2a3d41be71c0 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:16.796219 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-73126b3c-a91e-4df0-9fe0-2a3d41be71c0 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:16.796816 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-73126b3c-a91e-4df0-9fe0-2a3d41be71c0 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:16.821045 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-508b0979-cec1-48cb-9372-76b8e454a792 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:16.833948 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-508b0979-cec1-48cb-9372-76b8e454a792 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/8255008b-aaf4-444d-bdcd-6746d42c267b" status: 200 len: 1318 microversion: 2.1 time: 0.205772 Apr 16 21:10:16.835077 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 577/1059] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:16 2022] GET /compute/v2.1/servers/8255008b-aaf4-444d-bdcd-6746d42c267b => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:16.936866 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-73126b3c-a91e-4df0-9fe0-2a3d41be71c0 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:16.944776 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-73126b3c-a91e-4df0-9fe0-2a3d41be71c0 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1478 microversion: 2.1 time: 0.166932 Apr 16 21:10:16.947085 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 483/1060] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:16 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1478 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:17.545241 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4824673b-587b-47ed-90da-50ac79b189e5 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:17.546013 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4824673b-587b-47ed-90da-50ac79b189e5 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:17.560851 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4824673b-587b-47ed-90da-50ac79b189e5 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:17.561676 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4824673b-587b-47ed-90da-50ac79b189e5 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:17.562389 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4824673b-587b-47ed-90da-50ac79b189e5 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:17.562908 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4824673b-587b-47ed-90da-50ac79b189e5 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:17.676323 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4824673b-587b-47ed-90da-50ac79b189e5 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:17.685461 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4824673b-587b-47ed-90da-50ac79b189e5 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1262 microversion: 2.1 time: 0.144292 Apr 16 21:10:17.686864 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 578/1061] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:17 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1262 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:17.734056 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-33d27a3a-c39c-4ca0-aa2d-f28de3cb148a tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:17.734961 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-33d27a3a-c39c-4ca0-aa2d-f28de3cb148a tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 2b27c826-905d-4c1f-9daf-42150b1025a8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:17.747637 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-33d27a3a-c39c-4ca0-aa2d-f28de3cb148a tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:17.748093 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-33d27a3a-c39c-4ca0-aa2d-f28de3cb148a tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:17.748917 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-33d27a3a-c39c-4ca0-aa2d-f28de3cb148a tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:17.749358 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-33d27a3a-c39c-4ca0-aa2d-f28de3cb148a tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:17.788814 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5ea1be06-8c3a-40e5-b603-37cdf9601c41 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb9658eaf0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:17.843168 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5ea1be06-8c3a-40e5-b603-37cdf9601c41 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef" status: 200 len: 1421 microversion: 2.1 time: 0.058560 Apr 16 21:10:17.844054 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 579/1062] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:10:17 2022] GET /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef => generated 1421 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:17.854316 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-48d14086-07f2-4de2-a48c-8f770bb5d455 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:17.854316 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-48d14086-07f2-4de2-a48c-8f770bb5d455 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 8255008b-aaf4-444d-bdcd-6746d42c267b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:17.858678 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-48d14086-07f2-4de2-a48c-8f770bb5d455 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:17.859289 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-48d14086-07f2-4de2-a48c-8f770bb5d455 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:17.860287 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-48d14086-07f2-4de2-a48c-8f770bb5d455 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:17.860970 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-48d14086-07f2-4de2-a48c-8f770bb5d455 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:17.903480 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-33d27a3a-c39c-4ca0-aa2d-f28de3cb148a tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:17.912124 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-33d27a3a-c39c-4ca0-aa2d-f28de3cb148a tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8" status: 200 len: 1522 microversion: 2.1 time: 0.182165 Apr 16 21:10:17.921359 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 484/1063] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:17 2022] GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:17.934752 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-6000f110-8c33-493a-a74d-f61d27df8274 req-1eecee82-30be-4b95-bf2e-43b71dd6116d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "970fc2c2-b7bc-496e-bbf5-be24bc6cf248", "name": "network-vif-plugged", "status": "completed", "tag": "e4213a8a-25d6-4171-9e1d-b2165b7b93f4"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:10:17.942016 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-6000f110-8c33-493a-a74d-f61d27df8274 req-1eecee82-30be-4b95-bf2e-43b71dd6116d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:17.942830 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-6000f110-8c33-493a-a74d-f61d27df8274 req-1eecee82-30be-4b95-bf2e-43b71dd6116d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:17.954880 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-6000f110-8c33-493a-a74d-f61d27df8274 req-1eecee82-30be-4b95-bf2e-43b71dd6116d service nova] Creating event network-vif-plugged:e4213a8a-25d6-4171-9e1d-b2165b7b93f4 for instance 970fc2c2-b7bc-496e-bbf5-be24bc6cf248 on nch1-master-1 Apr 16 21:10:17.961527 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-6000f110-8c33-493a-a74d-f61d27df8274 req-1eecee82-30be-4b95-bf2e-43b71dd6116d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038438 Apr 16 21:10:17.962903 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 485/1064] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:10:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:10:17.967970 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c65925ea-44a4-4437-b2da-f7f0eb059739 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:17.968910 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c65925ea-44a4-4437-b2da-f7f0eb059739 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:17.975164 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c65925ea-44a4-4437-b2da-f7f0eb059739 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:17.975952 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c65925ea-44a4-4437-b2da-f7f0eb059739 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:17.976831 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c65925ea-44a4-4437-b2da-f7f0eb059739 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:17.977372 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c65925ea-44a4-4437-b2da-f7f0eb059739 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:18.128724 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-48d14086-07f2-4de2-a48c-8f770bb5d455 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:18.136774 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-48d14086-07f2-4de2-a48c-8f770bb5d455 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/8255008b-aaf4-444d-bdcd-6746d42c267b" status: 200 len: 1318 microversion: 2.1 time: 0.289789 Apr 16 21:10:18.137959 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 580/1065] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:17 2022] GET /compute/v2.1/servers/8255008b-aaf4-444d-bdcd-6746d42c267b => generated 1318 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:18.190356 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c65925ea-44a4-4437-b2da-f7f0eb059739 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:18.199464 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c65925ea-44a4-4437-b2da-f7f0eb059739 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1464 microversion: 2.1 time: 0.235659 Apr 16 21:10:18.200396 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 486/1066] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:17 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1464 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:18.216517 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2b063cbc-2c72-410a-a0ea-ca0340cc7f12 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:18.217139 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2b063cbc-2c72-410a-a0ea-ca0340cc7f12 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:18.224344 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b063cbc-2c72-410a-a0ea-ca0340cc7f12 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:18.224799 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b063cbc-2c72-410a-a0ea-ca0340cc7f12 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:18.225789 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b063cbc-2c72-410a-a0ea-ca0340cc7f12 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:18.226197 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b063cbc-2c72-410a-a0ea-ca0340cc7f12 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:18.469988 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2b063cbc-2c72-410a-a0ea-ca0340cc7f12 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:18.479615 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2b063cbc-2c72-410a-a0ea-ca0340cc7f12 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1464 microversion: 2.1 time: 0.267000 Apr 16 21:10:18.480216 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 581/1067] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:18 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1464 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:18.497034 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-16cb9a80-e29f-4aea-8c37-671a531a4bea tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:10:18.498615 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-16cb9a80-e29f-4aea-8c37-671a531a4bea tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:18.506455 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-16cb9a80-e29f-4aea-8c37-671a531a4bea tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:18.507228 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-16cb9a80-e29f-4aea-8c37-671a531a4bea tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:18.507897 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-16cb9a80-e29f-4aea-8c37-671a531a4bea tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:18.508458 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-16cb9a80-e29f-4aea-8c37-671a531a4bea tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:18.625244 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-16cb9a80-e29f-4aea-8c37-671a531a4bea tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:10:18.625759 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-16cb9a80-e29f-4aea-8c37-671a531a4bea tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:10:18.628480 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-16cb9a80-e29f-4aea-8c37-671a531a4bea tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:10:18.629563 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-16cb9a80-e29f-4aea-8c37-671a531a4bea tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:10:18.630006 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-16cb9a80-e29f-4aea-8c37-671a531a4bea tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:10:18.702745 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f130fd96-f73f-4d9e-8e62-6b9cc0c55f6d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:18.703357 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f130fd96-f73f-4d9e-8e62-6b9cc0c55f6d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:18.718584 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f130fd96-f73f-4d9e-8e62-6b9cc0c55f6d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:18.719060 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f130fd96-f73f-4d9e-8e62-6b9cc0c55f6d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:18.720513 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f130fd96-f73f-4d9e-8e62-6b9cc0c55f6d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:18.720959 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f130fd96-f73f-4d9e-8e62-6b9cc0c55f6d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:18.813365 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f130fd96-f73f-4d9e-8e62-6b9cc0c55f6d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:18.822180 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f130fd96-f73f-4d9e-8e62-6b9cc0c55f6d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1262 microversion: 2.1 time: 0.123131 Apr 16 21:10:18.823266 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 582/1068] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:18 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1262 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:10:18.856801 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b87b45bf-af35-4066-b7d6-5d9afa09d899 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb9658ea60>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:18.935712 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b87b45bf-af35-4066-b7d6-5d9afa09d899 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef" status: 200 len: 1421 microversion: 2.1 time: 0.083654 Apr 16 21:10:18.936750 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 583/1069] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:10:18 2022] GET /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef => generated 1421 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:10:18.946123 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-52f39919-350f-47e4-afb3-556157780d5a tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:18.946878 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-52f39919-350f-47e4-afb3-556157780d5a tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 2b27c826-905d-4c1f-9daf-42150b1025a8] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:18.954024 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-52f39919-350f-47e4-afb3-556157780d5a tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:18.957544 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-52f39919-350f-47e4-afb3-556157780d5a tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:18.957544 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-52f39919-350f-47e4-afb3-556157780d5a tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:18.957544 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-52f39919-350f-47e4-afb3-556157780d5a tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:18.959780 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-16cb9a80-e29f-4aea-8c37-671a531a4bea tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:18.968045 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-16cb9a80-e29f-4aea-8c37-671a531a4bea tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:18.968537 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-16cb9a80-e29f-4aea-8c37-671a531a4bea tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:18.969533 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-16cb9a80-e29f-4aea-8c37-671a531a4bea tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:18.970177 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-16cb9a80-e29f-4aea-8c37-671a531a4bea tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:19.001251 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-16cb9a80-e29f-4aea-8c37-671a531a4bea tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "POST /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17/action" status: 202 len: 1068 microversion: 2.1 time: 0.508152 Apr 16 21:10:19.001915 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 487/1070] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:10:18 2022] POST /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17/action => generated 1068 bytes in 510 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 16 21:10:19.020272 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7a807cdb-d7e9-4f3d-a781-31c1840edebb tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:19.021301 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7a807cdb-d7e9-4f3d-a781-31c1840edebb tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:19.029006 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7a807cdb-d7e9-4f3d-a781-31c1840edebb tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:19.029474 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7a807cdb-d7e9-4f3d-a781-31c1840edebb tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:19.030269 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7a807cdb-d7e9-4f3d-a781-31c1840edebb tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:19.030723 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7a807cdb-d7e9-4f3d-a781-31c1840edebb tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:19.187843 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7a807cdb-d7e9-4f3d-a781-31c1840edebb tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:19.196895 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7a807cdb-d7e9-4f3d-a781-31c1840edebb tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1473 microversion: 2.1 time: 0.184915 Apr 16 21:10:19.208235 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-52f39919-350f-47e4-afb3-556157780d5a tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:19.208390 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 488/1071] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:19 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1473 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:10:19.208390 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ec3baafe-c155-4061-8a71-a6172118e701 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:19.208667 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-52f39919-350f-47e4-afb3-556157780d5a tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8" status: 200 len: 1522 microversion: 2.1 time: 0.268069 Apr 16 21:10:19.208748 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ec3baafe-c155-4061-8a71-a6172118e701 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 8255008b-aaf4-444d-bdcd-6746d42c267b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:19.208830 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 584/1072] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:18 2022] GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8 => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:19.215596 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ec3baafe-c155-4061-8a71-a6172118e701 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:19.216268 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ec3baafe-c155-4061-8a71-a6172118e701 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:19.217658 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ec3baafe-c155-4061-8a71-a6172118e701 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:19.218180 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ec3baafe-c155-4061-8a71-a6172118e701 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:19.375413 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ec3baafe-c155-4061-8a71-a6172118e701 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:19.385792 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ec3baafe-c155-4061-8a71-a6172118e701 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/8255008b-aaf4-444d-bdcd-6746d42c267b" status: 200 len: 1318 microversion: 2.1 time: 0.187193 Apr 16 21:10:19.386590 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 489/1073] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:19 2022] GET /compute/v2.1/servers/8255008b-aaf4-444d-bdcd-6746d42c267b => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:19.838916 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a5e86db4-700c-4377-a7e7-412300cfaf2c tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:19.840194 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a5e86db4-700c-4377-a7e7-412300cfaf2c tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:19.847816 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a5e86db4-700c-4377-a7e7-412300cfaf2c tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:19.849703 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a5e86db4-700c-4377-a7e7-412300cfaf2c tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:19.849703 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a5e86db4-700c-4377-a7e7-412300cfaf2c tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:19.849954 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a5e86db4-700c-4377-a7e7-412300cfaf2c tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:19.933702 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a5e86db4-700c-4377-a7e7-412300cfaf2c tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:19.947012 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a5e86db4-700c-4377-a7e7-412300cfaf2c tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1270 microversion: 2.1 time: 0.111833 Apr 16 21:10:19.947608 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 585/1074] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:19 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1270 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:19.950391 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e779eab5-e1d2-4ac9-923a-635ba6d949c9 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb965700d0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:20.006655 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e779eab5-e1d2-4ac9-923a-635ba6d949c9 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef" status: 200 len: 1421 microversion: 2.1 time: 0.060313 Apr 16 21:10:20.008205 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 490/1075] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:10:19 2022] GET /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef => generated 1421 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:10:20.214475 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-080b4bd7-a4bd-451a-957f-5b07f0b610db tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:20.222685 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-080b4bd7-a4bd-451a-957f-5b07f0b610db tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:20.223946 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-da3d9ef0-1eb1-4466-9a66-0b6601190b48 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:20.224792 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-da3d9ef0-1eb1-4466-9a66-0b6601190b48 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 2b27c826-905d-4c1f-9daf-42150b1025a8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:20.232707 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-080b4bd7-a4bd-451a-957f-5b07f0b610db tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:20.234598 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-da3d9ef0-1eb1-4466-9a66-0b6601190b48 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:20.235238 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-080b4bd7-a4bd-451a-957f-5b07f0b610db tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:20.236672 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-da3d9ef0-1eb1-4466-9a66-0b6601190b48 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:20.238253 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-da3d9ef0-1eb1-4466-9a66-0b6601190b48 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:20.238431 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-080b4bd7-a4bd-451a-957f-5b07f0b610db tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:20.239028 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-080b4bd7-a4bd-451a-957f-5b07f0b610db tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:20.243778 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-da3d9ef0-1eb1-4466-9a66-0b6601190b48 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:20.419251 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-da3d9ef0-1eb1-4466-9a66-0b6601190b48 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:20.431557 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-da3d9ef0-1eb1-4466-9a66-0b6601190b48 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8" status: 200 len: 1522 microversion: 2.1 time: 0.211233 Apr 16 21:10:20.432155 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 491/1076] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:20 2022] GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:10:20.448020 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-74aa99c0-65ec-4565-abd2-f36a9854370b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:20.448891 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-74aa99c0-65ec-4565-abd2-f36a9854370b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 8255008b-aaf4-444d-bdcd-6746d42c267b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:20.466014 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-74aa99c0-65ec-4565-abd2-f36a9854370b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:20.466014 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-74aa99c0-65ec-4565-abd2-f36a9854370b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:20.466991 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-74aa99c0-65ec-4565-abd2-f36a9854370b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:20.467546 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-74aa99c0-65ec-4565-abd2-f36a9854370b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:20.672373 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-74aa99c0-65ec-4565-abd2-f36a9854370b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:20.681366 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-74aa99c0-65ec-4565-abd2-f36a9854370b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/8255008b-aaf4-444d-bdcd-6746d42c267b" status: 200 len: 1318 microversion: 2.1 time: 0.247793 Apr 16 21:10:20.683319 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 492/1077] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:20 2022] GET /compute/v2.1/servers/8255008b-aaf4-444d-bdcd-6746d42c267b => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:20.837870 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-080b4bd7-a4bd-451a-957f-5b07f0b610db tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:20.849028 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-080b4bd7-a4bd-451a-957f-5b07f0b610db tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1473 microversion: 2.1 time: 0.637651 Apr 16 21:10:20.872149 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 586/1078] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:20 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1473 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:20.964465 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6d38bd5b-200e-4873-9289-7969caa5b964 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:20.965253 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6d38bd5b-200e-4873-9289-7969caa5b964 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:20.972939 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6d38bd5b-200e-4873-9289-7969caa5b964 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:20.978175 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6d38bd5b-200e-4873-9289-7969caa5b964 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:20.982582 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6d38bd5b-200e-4873-9289-7969caa5b964 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:20.983113 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6d38bd5b-200e-4873-9289-7969caa5b964 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:21.037068 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e05263cb-f019-493e-b0db-f13f096e96a6 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb965889d0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:21.081539 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6d38bd5b-200e-4873-9289-7969caa5b964 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:21.089759 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e05263cb-f019-493e-b0db-f13f096e96a6 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef" status: 200 len: 1421 microversion: 2.1 time: 0.063399 Apr 16 21:10:21.089983 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6d38bd5b-200e-4873-9289-7969caa5b964 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1268 microversion: 2.1 time: 0.129310 Apr 16 21:10:21.091110 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 493/1079] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:20 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1268 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:21.091286 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 587/1080] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:10:21 2022] GET /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef => generated 1421 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:21.448859 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-497db85e-ddae-4da0-aceb-2f70e9694d15 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:21.449721 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-497db85e-ddae-4da0-aceb-2f70e9694d15 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 2b27c826-905d-4c1f-9daf-42150b1025a8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:21.456860 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-497db85e-ddae-4da0-aceb-2f70e9694d15 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:21.457346 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-497db85e-ddae-4da0-aceb-2f70e9694d15 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:21.458409 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-497db85e-ddae-4da0-aceb-2f70e9694d15 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:21.458909 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-497db85e-ddae-4da0-aceb-2f70e9694d15 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:21.627111 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-497db85e-ddae-4da0-aceb-2f70e9694d15 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:21.636664 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-497db85e-ddae-4da0-aceb-2f70e9694d15 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8" status: 200 len: 1522 microversion: 2.1 time: 0.191536 Apr 16 21:10:21.637502 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 494/1081] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:21 2022] GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8 => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:21.698917 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d5face88-a577-4be8-a587-f048b6fd0c19 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:21.699780 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d5face88-a577-4be8-a587-f048b6fd0c19 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 8255008b-aaf4-444d-bdcd-6746d42c267b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:21.707440 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d5face88-a577-4be8-a587-f048b6fd0c19 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:21.707907 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d5face88-a577-4be8-a587-f048b6fd0c19 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:21.708744 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d5face88-a577-4be8-a587-f048b6fd0c19 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:21.709191 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d5face88-a577-4be8-a587-f048b6fd0c19 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:21.866677 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-02508e45-a431-4908-8dbf-7d7a26181fe9 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:21.867288 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-02508e45-a431-4908-8dbf-7d7a26181fe9 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:21.873931 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-02508e45-a431-4908-8dbf-7d7a26181fe9 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:21.874503 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-02508e45-a431-4908-8dbf-7d7a26181fe9 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:21.877268 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-02508e45-a431-4908-8dbf-7d7a26181fe9 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:21.877268 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-02508e45-a431-4908-8dbf-7d7a26181fe9 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:22.026421 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d5face88-a577-4be8-a587-f048b6fd0c19 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:22.029253 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-02508e45-a431-4908-8dbf-7d7a26181fe9 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:22.037446 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d5face88-a577-4be8-a587-f048b6fd0c19 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/8255008b-aaf4-444d-bdcd-6746d42c267b" status: 200 len: 1318 microversion: 2.1 time: 0.342080 Apr 16 21:10:22.038664 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 588/1082] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:21 2022] GET /compute/v2.1/servers/8255008b-aaf4-444d-bdcd-6746d42c267b => generated 1318 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:22.038983 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-02508e45-a431-4908-8dbf-7d7a26181fe9 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1473 microversion: 2.1 time: 0.175941 Apr 16 21:10:22.040040 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 495/1083] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:21 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1473 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:10:22.106319 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-048add3f-bfaf-4546-9478-530a2a72acd9 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb965c5700>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:22.107122 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-67aa7c1d-6bba-4493-bb9f-8156571059c7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:22.108296 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-67aa7c1d-6bba-4493-bb9f-8156571059c7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:22.115430 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-67aa7c1d-6bba-4493-bb9f-8156571059c7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:22.116320 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-67aa7c1d-6bba-4493-bb9f-8156571059c7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:22.118274 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-67aa7c1d-6bba-4493-bb9f-8156571059c7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:22.118867 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-67aa7c1d-6bba-4493-bb9f-8156571059c7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:22.175206 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-048add3f-bfaf-4546-9478-530a2a72acd9 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef" status: 200 len: 1421 microversion: 2.1 time: 0.072967 Apr 16 21:10:22.176402 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 589/1084] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:10:22 2022] GET /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef => generated 1421 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:22.274851 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-67aa7c1d-6bba-4493-bb9f-8156571059c7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:22.282718 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-67aa7c1d-6bba-4493-bb9f-8156571059c7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1310 microversion: 2.1 time: 0.179827 Apr 16 21:10:22.283288 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 496/1085] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:22 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1310 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:22.655605 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-dc08ad0f-2db3-4362-a7b6-90dbbdf690ae tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:22.656633 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-dc08ad0f-2db3-4362-a7b6-90dbbdf690ae tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 2b27c826-905d-4c1f-9daf-42150b1025a8] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:22.672678 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dc08ad0f-2db3-4362-a7b6-90dbbdf690ae tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:22.673246 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dc08ad0f-2db3-4362-a7b6-90dbbdf690ae tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:22.674112 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dc08ad0f-2db3-4362-a7b6-90dbbdf690ae tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:22.675010 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dc08ad0f-2db3-4362-a7b6-90dbbdf690ae tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:22.937423 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-dc08ad0f-2db3-4362-a7b6-90dbbdf690ae tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:22.947619 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-dc08ad0f-2db3-4362-a7b6-90dbbdf690ae tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8" status: 200 len: 1522 microversion: 2.1 time: 0.297665 Apr 16 21:10:22.952458 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 590/1086] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:22 2022] GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8 => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:22.983754 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-00bae2a1-d2b9-430e-9234-0a908575c57d req-04181a13-5038-42ea-902f-4812949e4118 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8255008b-aaf4-444d-bdcd-6746d42c267b", "name": "network-vif-plugged", "status": "completed", "tag": "259c9f9f-e7b7-4e10-9e05-3056d94db8ff"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:10:22.995908 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-00bae2a1-d2b9-430e-9234-0a908575c57d req-04181a13-5038-42ea-902f-4812949e4118 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:22.995908 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-00bae2a1-d2b9-430e-9234-0a908575c57d req-04181a13-5038-42ea-902f-4812949e4118 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:23.010666 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-00bae2a1-d2b9-430e-9234-0a908575c57d req-04181a13-5038-42ea-902f-4812949e4118 service nova] Creating event network-vif-plugged:259c9f9f-e7b7-4e10-9e05-3056d94db8ff for instance 8255008b-aaf4-444d-bdcd-6746d42c267b on nch2-master-1 Apr 16 21:10:23.017635 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-00bae2a1-d2b9-430e-9234-0a908575c57d req-04181a13-5038-42ea-902f-4812949e4118 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037632 Apr 16 21:10:23.018431 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 497/1087] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:10:23.059039 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ef39bf01-9631-4785-840d-4ef2d703bc50 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:23.059039 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ef39bf01-9631-4785-840d-4ef2d703bc50 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 8255008b-aaf4-444d-bdcd-6746d42c267b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:23.059700 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-283fecad-3d1f-4a72-b4ad-8c843a08e450 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:23.059844 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-283fecad-3d1f-4a72-b4ad-8c843a08e450 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:23.070329 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-283fecad-3d1f-4a72-b4ad-8c843a08e450 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:23.071836 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-283fecad-3d1f-4a72-b4ad-8c843a08e450 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:23.073073 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-283fecad-3d1f-4a72-b4ad-8c843a08e450 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:23.074108 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-283fecad-3d1f-4a72-b4ad-8c843a08e450 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:23.095682 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ef39bf01-9631-4785-840d-4ef2d703bc50 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:23.097354 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ef39bf01-9631-4785-840d-4ef2d703bc50 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:23.100163 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ef39bf01-9631-4785-840d-4ef2d703bc50 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:23.100652 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ef39bf01-9631-4785-840d-4ef2d703bc50 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:23.288400 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-283fecad-3d1f-4a72-b4ad-8c843a08e450 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:23.301098 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-283fecad-3d1f-4a72-b4ad-8c843a08e450 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1473 microversion: 2.1 time: 0.245476 Apr 16 21:10:23.301098 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 498/1088] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:23 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1473 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:23.307585 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-5e65cf5e-e6f0-4dfe-adc7-ed1f8470af3f req-43b31151-6c6d-4f1c-96e7-0c516d05afeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d971969c-aa4b-4761-a632-23f88b833ec4", "tag": "0e96d99c-8339-47c4-aadc-62a791ca4b9a"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:10:23.318651 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-5e65cf5e-e6f0-4dfe-adc7-ed1f8470af3f req-43b31151-6c6d-4f1c-96e7-0c516d05afeb service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:23.319274 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-5e65cf5e-e6f0-4dfe-adc7-ed1f8470af3f req-43b31151-6c6d-4f1c-96e7-0c516d05afeb service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:23.331803 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-5e65cf5e-e6f0-4dfe-adc7-ed1f8470af3f req-43b31151-6c6d-4f1c-96e7-0c516d05afeb service nova] Creating event network-changed:0e96d99c-8339-47c4-aadc-62a791ca4b9a for instance d971969c-aa4b-4761-a632-23f88b833ec4 on nch2-master-1 Apr 16 21:10:23.340377 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-5e65cf5e-e6f0-4dfe-adc7-ed1f8470af3f req-43b31151-6c6d-4f1c-96e7-0c516d05afeb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038281 Apr 16 21:10:23.341207 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 499/1089] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:10:23.353898 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7f60ca84-9903-4f2a-a9c2-5e1af8d47d0d tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb9652d1f0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:23.360890 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ef39bf01-9631-4785-840d-4ef2d703bc50 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:23.370698 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ef39bf01-9631-4785-840d-4ef2d703bc50 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/8255008b-aaf4-444d-bdcd-6746d42c267b" status: 200 len: 1318 microversion: 2.1 time: 0.318530 Apr 16 21:10:23.371287 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 591/1090] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:23 2022] GET /compute/v2.1/servers/8255008b-aaf4-444d-bdcd-6746d42c267b => generated 1318 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:23.377214 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d20f0ff7-2d74-4ebf-b458-1f6bdc0e8107 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:23.378058 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d20f0ff7-2d74-4ebf-b458-1f6bdc0e8107 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:23.385064 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d20f0ff7-2d74-4ebf-b458-1f6bdc0e8107 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:23.385572 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d20f0ff7-2d74-4ebf-b458-1f6bdc0e8107 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:23.386375 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d20f0ff7-2d74-4ebf-b458-1f6bdc0e8107 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:23.386907 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d20f0ff7-2d74-4ebf-b458-1f6bdc0e8107 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:23.398665 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7f60ca84-9903-4f2a-a9c2-5e1af8d47d0d tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef" status: 200 len: 1421 microversion: 2.1 time: 0.056061 Apr 16 21:10:23.407465 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 500/1091] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:10:23 2022] GET /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef => generated 1421 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:23.528552 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d20f0ff7-2d74-4ebf-b458-1f6bdc0e8107 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:23.536716 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d20f0ff7-2d74-4ebf-b458-1f6bdc0e8107 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1310 microversion: 2.1 time: 0.164332 Apr 16 21:10:23.537341 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 592/1092] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:23 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1310 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:23.969273 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7b1bcc11-6bea-465e-ad13-f53918db1b7a tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:23.970012 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7b1bcc11-6bea-465e-ad13-f53918db1b7a tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 2b27c826-905d-4c1f-9daf-42150b1025a8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:23.976305 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7b1bcc11-6bea-465e-ad13-f53918db1b7a tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:23.976768 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7b1bcc11-6bea-465e-ad13-f53918db1b7a tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:23.977652 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7b1bcc11-6bea-465e-ad13-f53918db1b7a tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:23.978074 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7b1bcc11-6bea-465e-ad13-f53918db1b7a tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:24.117571 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7b1bcc11-6bea-465e-ad13-f53918db1b7a tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:24.125386 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7b1bcc11-6bea-465e-ad13-f53918db1b7a tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8" status: 200 len: 1522 microversion: 2.1 time: 0.160168 Apr 16 21:10:24.126849 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 501/1093] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:23 2022] GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:10:24.317312 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2d6a75e1-b603-4f37-9cc7-6944a5517025 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:24.318484 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2d6a75e1-b603-4f37-9cc7-6944a5517025 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:24.325127 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2d6a75e1-b603-4f37-9cc7-6944a5517025 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:24.325578 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2d6a75e1-b603-4f37-9cc7-6944a5517025 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:24.326520 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2d6a75e1-b603-4f37-9cc7-6944a5517025 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:24.327127 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2d6a75e1-b603-4f37-9cc7-6944a5517025 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:24.389825 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d7d74d9d-3e0e-4a4a-9010-216560fe9363 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:24.390355 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d7d74d9d-3e0e-4a4a-9010-216560fe9363 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 8255008b-aaf4-444d-bdcd-6746d42c267b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:24.396887 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d7d74d9d-3e0e-4a4a-9010-216560fe9363 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:24.397278 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d7d74d9d-3e0e-4a4a-9010-216560fe9363 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:24.398052 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d7d74d9d-3e0e-4a4a-9010-216560fe9363 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:24.398661 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d7d74d9d-3e0e-4a4a-9010-216560fe9363 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:24.512447 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2d6a75e1-b603-4f37-9cc7-6944a5517025 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:24.527860 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2d6a75e1-b603-4f37-9cc7-6944a5517025 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1473 microversion: 2.1 time: 0.214322 Apr 16 21:10:24.529138 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 593/1094] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:24 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1473 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:24.535284 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8c84b83f-b769-4680-b511-198dd1e1aefd tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb965a2430>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:24.600618 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8c84b83f-b769-4680-b511-198dd1e1aefd tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef" status: 200 len: 1421 microversion: 2.1 time: 0.068668 Apr 16 21:10:24.602232 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 594/1095] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:10:24 2022] GET /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef => generated 1421 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:24.611089 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d7d74d9d-3e0e-4a4a-9010-216560fe9363 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:24.614132 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5551b852-2097-45a9-8744-387e71d3e5e7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:24.614833 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5551b852-2097-45a9-8744-387e71d3e5e7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:24.620605 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d7d74d9d-3e0e-4a4a-9010-216560fe9363 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/8255008b-aaf4-444d-bdcd-6746d42c267b" status: 200 len: 1318 microversion: 2.1 time: 0.234668 Apr 16 21:10:24.632707 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 502/1096] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:24 2022] GET /compute/v2.1/servers/8255008b-aaf4-444d-bdcd-6746d42c267b => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:10:24.636547 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5551b852-2097-45a9-8744-387e71d3e5e7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:24.636547 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5551b852-2097-45a9-8744-387e71d3e5e7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:24.636547 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5551b852-2097-45a9-8744-387e71d3e5e7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:24.636547 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5551b852-2097-45a9-8744-387e71d3e5e7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:24.903489 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5551b852-2097-45a9-8744-387e71d3e5e7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:24.915426 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5551b852-2097-45a9-8744-387e71d3e5e7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1310 microversion: 2.1 time: 0.311345 Apr 16 21:10:24.916424 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 595/1097] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:24 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1310 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:25.142781 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9395c9c2-eca6-47b5-82a3-73f5d1569fd3 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:25.143405 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9395c9c2-eca6-47b5-82a3-73f5d1569fd3 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 2b27c826-905d-4c1f-9daf-42150b1025a8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:25.153615 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9395c9c2-eca6-47b5-82a3-73f5d1569fd3 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:25.153615 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9395c9c2-eca6-47b5-82a3-73f5d1569fd3 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:25.153983 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9395c9c2-eca6-47b5-82a3-73f5d1569fd3 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:25.154390 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9395c9c2-eca6-47b5-82a3-73f5d1569fd3 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:25.311870 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9395c9c2-eca6-47b5-82a3-73f5d1569fd3 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:25.320493 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9395c9c2-eca6-47b5-82a3-73f5d1569fd3 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8" status: 200 len: 1522 microversion: 2.1 time: 0.181492 Apr 16 21:10:25.321168 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 503/1098] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:25 2022] GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:25.546050 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2ad9a3b3-f6ff-4679-b4c8-c161af53d8f2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:25.546671 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2ad9a3b3-f6ff-4679-b4c8-c161af53d8f2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:25.554334 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2ad9a3b3-f6ff-4679-b4c8-c161af53d8f2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:25.555117 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2ad9a3b3-f6ff-4679-b4c8-c161af53d8f2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:25.556118 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2ad9a3b3-f6ff-4679-b4c8-c161af53d8f2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:25.556596 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2ad9a3b3-f6ff-4679-b4c8-c161af53d8f2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:25.615724 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fd39ac4d-5886-4841-87a6-ed491659e14d tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb9652dc10>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:25.688715 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fd39ac4d-5886-4841-87a6-ed491659e14d tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef" status: 200 len: 1421 microversion: 2.1 time: 0.077320 Apr 16 21:10:25.689888 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 504/1099] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:10:25 2022] GET /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef => generated 1421 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:25.695725 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cec89ecd-61c3-4d03-a3d2-d1fbfe19f48d tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:25.696670 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-cec89ecd-61c3-4d03-a3d2-d1fbfe19f48d tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 8255008b-aaf4-444d-bdcd-6746d42c267b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:25.704501 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cec89ecd-61c3-4d03-a3d2-d1fbfe19f48d tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:25.705217 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cec89ecd-61c3-4d03-a3d2-d1fbfe19f48d tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:25.706277 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cec89ecd-61c3-4d03-a3d2-d1fbfe19f48d tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:25.706963 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cec89ecd-61c3-4d03-a3d2-d1fbfe19f48d tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:25.791504 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2ad9a3b3-f6ff-4679-b4c8-c161af53d8f2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:25.799090 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2ad9a3b3-f6ff-4679-b4c8-c161af53d8f2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1473 microversion: 2.1 time: 0.256905 Apr 16 21:10:25.800648 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 596/1100] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:25 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1473 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:10:25.888005 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cec89ecd-61c3-4d03-a3d2-d1fbfe19f48d tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:25.898969 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cec89ecd-61c3-4d03-a3d2-d1fbfe19f48d tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/8255008b-aaf4-444d-bdcd-6746d42c267b" status: 200 len: 1318 microversion: 2.1 time: 0.207141 Apr 16 21:10:25.899569 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 505/1101] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:25 2022] GET /compute/v2.1/servers/8255008b-aaf4-444d-bdcd-6746d42c267b => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:25.932423 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7464f609-460b-4663-8e36-3758ea75c422 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:25.933052 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7464f609-460b-4663-8e36-3758ea75c422 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:25.939784 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7464f609-460b-4663-8e36-3758ea75c422 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:25.940810 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7464f609-460b-4663-8e36-3758ea75c422 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:25.941636 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7464f609-460b-4663-8e36-3758ea75c422 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:25.944000 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7464f609-460b-4663-8e36-3758ea75c422 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:26.101564 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7464f609-460b-4663-8e36-3758ea75c422 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:26.108968 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7464f609-460b-4663-8e36-3758ea75c422 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1310 microversion: 2.1 time: 0.180542 Apr 16 21:10:26.109766 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 597/1102] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:25 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1310 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:26.337783 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-78da5029-e026-46f5-bb87-680f20c2ec18 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:26.338401 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-78da5029-e026-46f5-bb87-680f20c2ec18 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 2b27c826-905d-4c1f-9daf-42150b1025a8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:26.345317 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-78da5029-e026-46f5-bb87-680f20c2ec18 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:26.347881 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-78da5029-e026-46f5-bb87-680f20c2ec18 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:26.347881 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-78da5029-e026-46f5-bb87-680f20c2ec18 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:26.347881 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-78da5029-e026-46f5-bb87-680f20c2ec18 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:26.493221 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-78da5029-e026-46f5-bb87-680f20c2ec18 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:26.501460 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-78da5029-e026-46f5-bb87-680f20c2ec18 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8" status: 200 len: 1522 microversion: 2.1 time: 0.167534 Apr 16 21:10:26.502084 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 506/1103] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:26 2022] GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:26.702990 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-791b7c9f-60d0-4a5a-8bab-1d04a2eece74 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb965a24c0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:26.756677 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-791b7c9f-60d0-4a5a-8bab-1d04a2eece74 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef" status: 200 len: 1421 microversion: 2.1 time: 0.057512 Apr 16 21:10:26.757283 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 598/1104] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:10:26 2022] GET /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef => generated 1421 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:26.818546 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5b4359e5-0b61-41f7-8ef1-d0c328189d1e tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:26.819850 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5b4359e5-0b61-41f7-8ef1-d0c328189d1e tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:26.826348 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5b4359e5-0b61-41f7-8ef1-d0c328189d1e tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:26.826806 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5b4359e5-0b61-41f7-8ef1-d0c328189d1e tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:26.827605 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5b4359e5-0b61-41f7-8ef1-d0c328189d1e tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:26.828237 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5b4359e5-0b61-41f7-8ef1-d0c328189d1e tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:26.915261 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d395bf9e-62b6-4325-82cc-a2f818520931 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:26.915875 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d395bf9e-62b6-4325-82cc-a2f818520931 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 8255008b-aaf4-444d-bdcd-6746d42c267b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:26.926732 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d395bf9e-62b6-4325-82cc-a2f818520931 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:26.927210 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d395bf9e-62b6-4325-82cc-a2f818520931 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:26.927989 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d395bf9e-62b6-4325-82cc-a2f818520931 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:26.928853 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d395bf9e-62b6-4325-82cc-a2f818520931 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:26.993287 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5b4359e5-0b61-41f7-8ef1-d0c328189d1e tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:27.001168 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5b4359e5-0b61-41f7-8ef1-d0c328189d1e tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1473 microversion: 2.1 time: 0.187674 Apr 16 21:10:27.002371 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 507/1105] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:26 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1473 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:27.020344 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-fa1bba41-6053-44fe-9e4a-6e170a72db61 req-89540e52-ba22-46ab-9445-14f3a1473235 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88", "name": "network-vif-plugged", "status": "completed", "tag": "b490e936-9731-4964-89b6-ba2e9e7ac544"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:10:27.028910 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-fa1bba41-6053-44fe-9e4a-6e170a72db61 req-89540e52-ba22-46ab-9445-14f3a1473235 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:27.029420 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-fa1bba41-6053-44fe-9e4a-6e170a72db61 req-89540e52-ba22-46ab-9445-14f3a1473235 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:27.041735 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-fa1bba41-6053-44fe-9e4a-6e170a72db61 req-89540e52-ba22-46ab-9445-14f3a1473235 service nova] Creating event network-vif-plugged:b490e936-9731-4964-89b6-ba2e9e7ac544 for instance 04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88 on nch2-master-1 Apr 16 21:10:27.047399 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-fa1bba41-6053-44fe-9e4a-6e170a72db61 req-89540e52-ba22-46ab-9445-14f3a1473235 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031002 Apr 16 21:10:27.048317 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 508/1106] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:10:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:10:27.133659 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d395bf9e-62b6-4325-82cc-a2f818520931 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:27.136100 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e8787df4-04bc-4189-91af-e24a7e273bc4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:27.137291 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e8787df4-04bc-4189-91af-e24a7e273bc4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:27.146260 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d395bf9e-62b6-4325-82cc-a2f818520931 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/8255008b-aaf4-444d-bdcd-6746d42c267b" status: 200 len: 1318 microversion: 2.1 time: 0.234913 Apr 16 21:10:27.147013 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 599/1107] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:26 2022] GET /compute/v2.1/servers/8255008b-aaf4-444d-bdcd-6746d42c267b => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:27.148563 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e8787df4-04bc-4189-91af-e24a7e273bc4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:27.149077 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e8787df4-04bc-4189-91af-e24a7e273bc4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:27.152867 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e8787df4-04bc-4189-91af-e24a7e273bc4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:27.152867 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e8787df4-04bc-4189-91af-e24a7e273bc4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:27.296593 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e8787df4-04bc-4189-91af-e24a7e273bc4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:27.305270 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e8787df4-04bc-4189-91af-e24a7e273bc4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1310 microversion: 2.1 time: 0.181234 Apr 16 21:10:27.308233 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 509/1108] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:27 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1310 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:27.519409 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5c73d52b-753c-479e-a17b-c2625d78bf89 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:27.520039 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5c73d52b-753c-479e-a17b-c2625d78bf89 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 2b27c826-905d-4c1f-9daf-42150b1025a8] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:27.526687 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5c73d52b-753c-479e-a17b-c2625d78bf89 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:27.527715 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5c73d52b-753c-479e-a17b-c2625d78bf89 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:27.528803 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5c73d52b-753c-479e-a17b-c2625d78bf89 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:27.529423 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5c73d52b-753c-479e-a17b-c2625d78bf89 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:27.745761 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5c73d52b-753c-479e-a17b-c2625d78bf89 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:27.755411 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5c73d52b-753c-479e-a17b-c2625d78bf89 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8" status: 200 len: 1522 microversion: 2.1 time: 0.240216 Apr 16 21:10:27.756243 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 600/1109] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:27 2022] GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:27.770262 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d59fe7cf-697f-4dba-8762-a18295ad3acd tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb965709d0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:27.819808 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d59fe7cf-697f-4dba-8762-a18295ad3acd tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef" status: 200 len: 1421 microversion: 2.1 time: 0.053494 Apr 16 21:10:27.820519 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 510/1110] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:10:27 2022] GET /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef => generated 1421 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:28.020005 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b24c5915-bbc1-4b0c-b278-08999edb5f5a tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:28.020683 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b24c5915-bbc1-4b0c-b278-08999edb5f5a tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:28.026702 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b24c5915-bbc1-4b0c-b278-08999edb5f5a tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:28.027161 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b24c5915-bbc1-4b0c-b278-08999edb5f5a tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:28.027954 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b24c5915-bbc1-4b0c-b278-08999edb5f5a tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:28.028437 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b24c5915-bbc1-4b0c-b278-08999edb5f5a tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:28.163024 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3c4ea484-9c03-4888-8c50-3c5a7ae873dc tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:28.163655 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3c4ea484-9c03-4888-8c50-3c5a7ae873dc tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 8255008b-aaf4-444d-bdcd-6746d42c267b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:28.170576 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3c4ea484-9c03-4888-8c50-3c5a7ae873dc tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:28.171203 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3c4ea484-9c03-4888-8c50-3c5a7ae873dc tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:28.171830 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3c4ea484-9c03-4888-8c50-3c5a7ae873dc tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:28.172307 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3c4ea484-9c03-4888-8c50-3c5a7ae873dc tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:28.246980 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b24c5915-bbc1-4b0c-b278-08999edb5f5a tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:28.263555 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b24c5915-bbc1-4b0c-b278-08999edb5f5a tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1473 microversion: 2.1 time: 0.247229 Apr 16 21:10:28.265025 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 601/1111] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:28 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1473 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:28.319153 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3c4ea484-9c03-4888-8c50-3c5a7ae873dc tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:28.322964 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ead48266-47bd-4e6b-b2cc-5559ad71dac8 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:28.323725 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ead48266-47bd-4e6b-b2cc-5559ad71dac8 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:28.329030 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3c4ea484-9c03-4888-8c50-3c5a7ae873dc tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/8255008b-aaf4-444d-bdcd-6746d42c267b" status: 200 len: 1318 microversion: 2.1 time: 0.170079 Apr 16 21:10:28.329917 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ead48266-47bd-4e6b-b2cc-5559ad71dac8 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:28.331201 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ead48266-47bd-4e6b-b2cc-5559ad71dac8 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:28.332188 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ead48266-47bd-4e6b-b2cc-5559ad71dac8 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:28.332809 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ead48266-47bd-4e6b-b2cc-5559ad71dac8 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:28.339482 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 511/1112] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:28 2022] GET /compute/v2.1/servers/8255008b-aaf4-444d-bdcd-6746d42c267b => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:10:28.596276 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ead48266-47bd-4e6b-b2cc-5559ad71dac8 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:28.606218 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ead48266-47bd-4e6b-b2cc-5559ad71dac8 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1310 microversion: 2.1 time: 0.287090 Apr 16 21:10:28.616652 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 602/1113] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:28 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1310 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:28.772800 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cf4a3af3-41de-48a4-8d41-2d3bd7f5ab20 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:28.773425 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-cf4a3af3-41de-48a4-8d41-2d3bd7f5ab20 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 2b27c826-905d-4c1f-9daf-42150b1025a8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:28.780768 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cf4a3af3-41de-48a4-8d41-2d3bd7f5ab20 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:28.781229 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cf4a3af3-41de-48a4-8d41-2d3bd7f5ab20 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:28.782015 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cf4a3af3-41de-48a4-8d41-2d3bd7f5ab20 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:28.782459 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cf4a3af3-41de-48a4-8d41-2d3bd7f5ab20 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:28.834754 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e563b049-d470-4833-88d9-cd12535b75ac tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb96556ee0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:28.890203 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e563b049-d470-4833-88d9-cd12535b75ac tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef" status: 200 len: 1421 microversion: 2.1 time: 0.059484 Apr 16 21:10:28.897186 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 603/1114] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:10:28 2022] GET /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef => generated 1421 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:28.947792 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cf4a3af3-41de-48a4-8d41-2d3bd7f5ab20 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:28.955885 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cf4a3af3-41de-48a4-8d41-2d3bd7f5ab20 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8" status: 200 len: 1522 microversion: 2.1 time: 0.187012 Apr 16 21:10:28.956911 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 512/1115] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:28 2022] GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:29.281579 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9a64e196-0976-45e7-bf15-b977e1b9a3e9 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:29.282319 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9a64e196-0976-45e7-bf15-b977e1b9a3e9 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:29.290073 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a64e196-0976-45e7-bf15-b977e1b9a3e9 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:29.290537 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a64e196-0976-45e7-bf15-b977e1b9a3e9 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:29.291319 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a64e196-0976-45e7-bf15-b977e1b9a3e9 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:29.291769 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a64e196-0976-45e7-bf15-b977e1b9a3e9 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:29.347173 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-022e7489-ef7d-4ae7-bf82-71038f7f15db tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:29.348020 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-022e7489-ef7d-4ae7-bf82-71038f7f15db tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 8255008b-aaf4-444d-bdcd-6746d42c267b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:29.354338 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-022e7489-ef7d-4ae7-bf82-71038f7f15db tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:29.354789 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-022e7489-ef7d-4ae7-bf82-71038f7f15db tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:29.355840 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-022e7489-ef7d-4ae7-bf82-71038f7f15db tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:29.356308 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-022e7489-ef7d-4ae7-bf82-71038f7f15db tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:29.563271 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9a64e196-0976-45e7-bf15-b977e1b9a3e9 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:29.571333 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9a64e196-0976-45e7-bf15-b977e1b9a3e9 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1473 microversion: 2.1 time: 0.293500 Apr 16 21:10:29.571926 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 604/1116] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:29 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1473 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:29.623991 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b70cde59-ec47-4bd6-85ea-333704b94c5b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:29.626218 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b70cde59-ec47-4bd6-85ea-333704b94c5b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:29.636163 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b70cde59-ec47-4bd6-85ea-333704b94c5b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:29.636844 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b70cde59-ec47-4bd6-85ea-333704b94c5b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:29.637949 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b70cde59-ec47-4bd6-85ea-333704b94c5b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:29.638573 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b70cde59-ec47-4bd6-85ea-333704b94c5b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:29.820327 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b70cde59-ec47-4bd6-85ea-333704b94c5b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:29.828087 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-022e7489-ef7d-4ae7-bf82-71038f7f15db tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:29.842564 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-022e7489-ef7d-4ae7-bf82-71038f7f15db tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/8255008b-aaf4-444d-bdcd-6746d42c267b" status: 200 len: 1468 microversion: 2.1 time: 0.499559 Apr 16 21:10:29.843419 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 513/1117] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:29 2022] GET /compute/v2.1/servers/8255008b-aaf4-444d-bdcd-6746d42c267b => generated 1468 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:29.849180 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b70cde59-ec47-4bd6-85ea-333704b94c5b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1310 microversion: 2.1 time: 0.229263 Apr 16 21:10:29.858656 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 605/1118] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:29 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1310 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:10:29.859112 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4e9acb28-2048-4fb1-8cb3-58988c064683 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:29.859844 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4e9acb28-2048-4fb1-8cb3-58988c064683 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 970fc2c2-b7bc-496e-bbf5-be24bc6cf248] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:29.868691 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4e9acb28-2048-4fb1-8cb3-58988c064683 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:29.869347 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4e9acb28-2048-4fb1-8cb3-58988c064683 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:29.870228 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4e9acb28-2048-4fb1-8cb3-58988c064683 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:29.870756 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4e9acb28-2048-4fb1-8cb3-58988c064683 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:29.904122 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0d89617d-df20-4d64-b284-c39963afd66e tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb965b6160>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:29.956030 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0d89617d-df20-4d64-b284-c39963afd66e tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef" status: 200 len: 1421 microversion: 2.1 time: 0.055649 Apr 16 21:10:29.956643 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 606/1119] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:10:29 2022] GET /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef => generated 1421 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:10:29.972316 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-72005581-ecfb-4870-89ba-fbdb090874b0 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:29.972942 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-72005581-ecfb-4870-89ba-fbdb090874b0 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 2b27c826-905d-4c1f-9daf-42150b1025a8] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:29.979316 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-72005581-ecfb-4870-89ba-fbdb090874b0 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:29.979783 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-72005581-ecfb-4870-89ba-fbdb090874b0 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:29.980631 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-72005581-ecfb-4870-89ba-fbdb090874b0 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:29.981086 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-72005581-ecfb-4870-89ba-fbdb090874b0 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:30.013306 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4e9acb28-2048-4fb1-8cb3-58988c064683 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:30.021829 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4e9acb28-2048-4fb1-8cb3-58988c064683 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/970fc2c2-b7bc-496e-bbf5-be24bc6cf248" status: 200 len: 1468 microversion: 2.1 time: 0.166439 Apr 16 21:10:30.022413 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 514/1120] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:29 2022] GET /compute/v2.1/servers/970fc2c2-b7bc-496e-bbf5-be24bc6cf248 => generated 1468 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:30.038671 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0e401b15-afa9-4d80-b65a-a8662bfea6e5 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:30.043108 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0e401b15-afa9-4d80-b65a-a8662bfea6e5 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:30.043977 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0e401b15-afa9-4d80-b65a-a8662bfea6e5 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Searching by: {'reservation_id': 'r-ancmpyb0', 'deleted': False, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d'} {{(pid=137409) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:10:30.050412 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0e401b15-afa9-4d80-b65a-a8662bfea6e5 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:30.050987 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0e401b15-afa9-4d80-b65a-a8662bfea6e5 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:30.051990 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0e401b15-afa9-4d80-b65a-a8662bfea6e5 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:30.052565 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0e401b15-afa9-4d80-b65a-a8662bfea6e5 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:30.154979 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.multi_cell_list [None req-0e401b15-afa9-4d80-b65a-a8662bfea6e5 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=137409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 16 21:10:30.224778 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-72005581-ecfb-4870-89ba-fbdb090874b0 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:30.232659 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0e401b15-afa9-4d80-b65a-a8662bfea6e5 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:30.232921 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-72005581-ecfb-4870-89ba-fbdb090874b0 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8" status: 200 len: 1522 microversion: 2.1 time: 0.264482 Apr 16 21:10:30.234125 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 607/1121] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:29 2022] GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8 => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:10:30.243665 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0e401b15-afa9-4d80-b65a-a8662bfea6e5 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:30.244437 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0e401b15-afa9-4d80-b65a-a8662bfea6e5 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:30.399102 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0e401b15-afa9-4d80-b65a-a8662bfea6e5 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/detail?reservation_id=r-ancmpyb0" status: 200 len: 2929 microversion: 2.1 time: 0.364327 Apr 16 21:10:30.399924 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 515/1122] 10.222.0.20 () {58 vars in 1196 bytes} [Sat Apr 16 21:10:30 2022] GET /compute/v2.1/servers/detail?reservation_id=r-ancmpyb0 => generated 2929 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:10:30.417348 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9e2b778c-158e-4126-857f-654be92f0769 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:30.453536 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.compute.server_groups [None req-9e2b778c-158e-4126-857f-654be92f0769 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Querying cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) for 2 instances {{(pid=137408) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Apr 16 21:10:30.454586 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9e2b778c-158e-4126-857f-654be92f0769 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:30.455223 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9e2b778c-158e-4126-857f-654be92f0769 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:30.493858 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9e2b778c-158e-4126-857f-654be92f0769 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/f04e9963-900e-472a-990e-34003d968b06" status: 200 len: 271 microversion: 2.1 time: 0.079747 Apr 16 21:10:30.494867 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 608/1123] 10.222.0.20 () {58 vars in 1262 bytes} [Sat Apr 16 21:10:30 2022] GET /compute/v2.1/os-server-groups/f04e9963-900e-472a-990e-34003d968b06 => generated 271 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:10:30.504692 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c9f524a3-9602-49f6-91a4-79fef61ad411 tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:30.505319 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c9f524a3-9602-49f6-91a4-79fef61ad411 tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] [instance: 8255008b-aaf4-444d-bdcd-6746d42c267b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:30.511876 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c9f524a3-9602-49f6-91a4-79fef61ad411 tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:30.512360 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c9f524a3-9602-49f6-91a4-79fef61ad411 tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:30.513166 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c9f524a3-9602-49f6-91a4-79fef61ad411 tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:30.513620 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c9f524a3-9602-49f6-91a4-79fef61ad411 tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:30.591007 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ffd49bf0-6be9-40c1-bde1-3cc553873eb2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:30.592203 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ffd49bf0-6be9-40c1-bde1-3cc553873eb2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:30.602040 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ffd49bf0-6be9-40c1-bde1-3cc553873eb2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:30.605970 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ffd49bf0-6be9-40c1-bde1-3cc553873eb2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:30.607007 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ffd49bf0-6be9-40c1-bde1-3cc553873eb2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:30.608144 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ffd49bf0-6be9-40c1-bde1-3cc553873eb2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:30.750638 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c9f524a3-9602-49f6-91a4-79fef61ad411 tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/8255008b-aaf4-444d-bdcd-6746d42c267b" status: 200 len: 1619 microversion: 2.1 time: 0.249685 Apr 16 21:10:30.761870 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 516/1124] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:30 2022] GET /compute/v2.1/servers/8255008b-aaf4-444d-bdcd-6746d42c267b => generated 1619 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:30.770130 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3ee2d836-b89f-4eb7-ac70-fb8c59cd68af tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:30.770130 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3ee2d836-b89f-4eb7-ac70-fb8c59cd68af tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] [instance: 970fc2c2-b7bc-496e-bbf5-be24bc6cf248] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:30.776815 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3ee2d836-b89f-4eb7-ac70-fb8c59cd68af tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:30.777495 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3ee2d836-b89f-4eb7-ac70-fb8c59cd68af tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:30.779222 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3ee2d836-b89f-4eb7-ac70-fb8c59cd68af tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:30.779832 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3ee2d836-b89f-4eb7-ac70-fb8c59cd68af tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:30.836000 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ffd49bf0-6be9-40c1-bde1-3cc553873eb2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:30.845138 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ffd49bf0-6be9-40c1-bde1-3cc553873eb2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1473 microversion: 2.1 time: 0.259959 Apr 16 21:10:30.852227 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 609/1125] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:30 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1473 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:30.873683 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-45d7c637-6f30-43b4-998b-d62d0294def3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:30.874612 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-45d7c637-6f30-43b4-998b-d62d0294def3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:30.897022 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-45d7c637-6f30-43b4-998b-d62d0294def3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:30.897619 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-45d7c637-6f30-43b4-998b-d62d0294def3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:30.898535 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-45d7c637-6f30-43b4-998b-d62d0294def3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:30.899058 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-45d7c637-6f30-43b4-998b-d62d0294def3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:31.089324 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-45d7c637-6f30-43b4-998b-d62d0294def3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:31.102544 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-45d7c637-6f30-43b4-998b-d62d0294def3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1310 microversion: 2.1 time: 0.238722 Apr 16 21:10:31.113425 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 610/1126] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:30 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1310 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:31.124792 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b78511a6-b651-475f-a795-4a20771f48cb tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb965a2f70>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:31.173348 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b78511a6-b651-475f-a795-4a20771f48cb tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef" status: 200 len: 1421 microversion: 2.1 time: 0.055736 Apr 16 21:10:31.175126 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 611/1127] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:10:31 2022] GET /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef => generated 1421 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:31.249825 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fb8f4e3e-d484-4b7f-86c6-1855162faaa7 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:31.250719 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fb8f4e3e-d484-4b7f-86c6-1855162faaa7 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 2b27c826-905d-4c1f-9daf-42150b1025a8] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:31.261108 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fb8f4e3e-d484-4b7f-86c6-1855162faaa7 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:31.261775 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fb8f4e3e-d484-4b7f-86c6-1855162faaa7 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:31.262740 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fb8f4e3e-d484-4b7f-86c6-1855162faaa7 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:31.263348 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fb8f4e3e-d484-4b7f-86c6-1855162faaa7 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:31.294549 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3ee2d836-b89f-4eb7-ac70-fb8c59cd68af tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/970fc2c2-b7bc-496e-bbf5-be24bc6cf248" status: 200 len: 1619 microversion: 2.1 time: 0.530557 Apr 16 21:10:31.300773 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 517/1128] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:30 2022] GET /compute/v2.1/servers/970fc2c2-b7bc-496e-bbf5-be24bc6cf248 => generated 1619 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:10:31.550388 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fb8f4e3e-d484-4b7f-86c6-1855162faaa7 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:31.564993 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8280c723-05df-4703-9ef7-3d45957aa4d0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-622135200", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "7b856a59-2a62-4edc-b448-430f778c7b2e"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:10:31.570486 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fb8f4e3e-d484-4b7f-86c6-1855162faaa7 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8" status: 200 len: 1522 microversion: 2.1 time: 0.324314 Apr 16 21:10:31.572889 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 612/1129] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:31 2022] GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8 => generated 1522 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:31.647754 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-8280c723-05df-4703-9ef7-3d45957aa4d0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] validate_networks() for None {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:10:31.698527 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4d08efd4-5d47-4d17-8c14-902908fa9a94 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:31.699438 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4d08efd4-5d47-4d17-8c14-902908fa9a94 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:31.707366 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4d08efd4-5d47-4d17-8c14-902908fa9a94 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:31.707840 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4d08efd4-5d47-4d17-8c14-902908fa9a94 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:31.708667 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4d08efd4-5d47-4d17-8c14-902908fa9a94 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:31.709124 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4d08efd4-5d47-4d17-8c14-902908fa9a94 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:31.881847 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-4d08efd4-5d47-4d17-8c14-902908fa9a94 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lazy-loading 'services' on Instance uuid a60c9986-12b3-4fc4-9bde-7bf7f34f90bd {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:10:31.903900 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4d08efd4-5d47-4d17-8c14-902908fa9a94 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd" status: 200 len: 2129 microversion: 2.25 time: 0.209519 Apr 16 21:10:31.918187 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 613/1130] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:10:31 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd => generated 2129 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:10:31.925361 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-39eea79c-1e4c-4719-92fa-770e974b5234 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:31.926220 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-39eea79c-1e4c-4719-92fa-770e974b5234 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:31.933131 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-39eea79c-1e4c-4719-92fa-770e974b5234 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:31.933895 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-39eea79c-1e4c-4719-92fa-770e974b5234 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:31.935107 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-39eea79c-1e4c-4719-92fa-770e974b5234 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:31.935759 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-39eea79c-1e4c-4719-92fa-770e974b5234 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:32.138090 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-39eea79c-1e4c-4719-92fa-770e974b5234 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:32.147601 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-39eea79c-1e4c-4719-92fa-770e974b5234 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1473 microversion: 2.1 time: 0.227960 Apr 16 21:10:32.149204 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 614/1131] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:31 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1473 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:32.154939 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ecaf414e-cbbf-42e7-b3d2-f5e6e1c57def tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:10:32.156660 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ecaf414e-cbbf-42e7-b3d2-f5e6e1c57def tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:32.165508 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ecaf414e-cbbf-42e7-b3d2-f5e6e1c57def tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:32.166542 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ecaf414e-cbbf-42e7-b3d2-f5e6e1c57def tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:32.167730 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ecaf414e-cbbf-42e7-b3d2-f5e6e1c57def tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:32.168338 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ecaf414e-cbbf-42e7-b3d2-f5e6e1c57def tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:32.207369 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-ecaf414e-cbbf-42e7-b3d2-f5e6e1c57def tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lazy-loading 'flavor' on Instance uuid a60c9986-12b3-4fc4-9bde-7bf7f34f90bd {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:10:32.221758 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ecaf414e-cbbf-42e7-b3d2-f5e6e1c57def tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Going to try to live migrate instance to nch1-master-1 {{(pid=137408) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Apr 16 21:10:32.281544 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-8280c723-05df-4703-9ef7-3d45957aa4d0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:10:32.281984 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-8280c723-05df-4703-9ef7-3d45957aa4d0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:10:32.282538 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-8280c723-05df-4703-9ef7-3d45957aa4d0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:10:32.283342 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-8280c723-05df-4703-9ef7-3d45957aa4d0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:10:32.283754 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-8280c723-05df-4703-9ef7-3d45957aa4d0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:10:32.293831 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8280c723-05df-4703-9ef7-3d45957aa4d0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:32.294681 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8280c723-05df-4703-9ef7-3d45957aa4d0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:32.296194 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8280c723-05df-4703-9ef7-3d45957aa4d0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:32.296670 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8280c723-05df-4703-9ef7-3d45957aa4d0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:32.320136 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-8280c723-05df-4703-9ef7-3d45957aa4d0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Getting quotas for project cd7c434915254744b7a0409ab8e6d33d. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:10:32.331302 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-8280c723-05df-4703-9ef7-3d45957aa4d0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Getting quotas for user 79f97c1afe5442dc83319237d121c11f and project cd7c434915254744b7a0409ab8e6d33d. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:10:32.360981 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8280c723-05df-4703-9ef7-3d45957aa4d0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:10:32.364674 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8280c723-05df-4703-9ef7-3d45957aa4d0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: a1064818-2a5f-42f7-9566-57a10ea5eb57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:10:32.571937 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8280c723-05df-4703-9ef7-3d45957aa4d0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.013275 Apr 16 21:10:32.576657 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 518/1132] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:10:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1020 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 16 21:10:32.584050 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3a920d20-f70f-4f89-b2b9-3d93b7f0f0b1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:32.584050 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3a920d20-f70f-4f89-b2b9-3d93b7f0f0b1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:32.591026 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3a920d20-f70f-4f89-b2b9-3d93b7f0f0b1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:32.591546 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3a920d20-f70f-4f89-b2b9-3d93b7f0f0b1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:32.592577 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3a920d20-f70f-4f89-b2b9-3d93b7f0f0b1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:32.593221 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3a920d20-f70f-4f89-b2b9-3d93b7f0f0b1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:32.801500 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3a920d20-f70f-4f89-b2b9-3d93b7f0f0b1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:32.810548 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3a920d20-f70f-4f89-b2b9-3d93b7f0f0b1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1310 microversion: 2.1 time: 0.232247 Apr 16 21:10:32.820511 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 519/1133] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:32 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1310 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:32.826075 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-adb396f7-4d5d-44b3-93d3-3d4ad1c4a1b2 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb964c1670>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:35.438221 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-adb396f7-4d5d-44b3-93d3-3d4ad1c4a1b2 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef" status: 200 len: 1421 microversion: 2.1 time: 2.613872 Apr 16 21:10:35.450856 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 520/1134] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:10:32 2022] GET /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef => generated 1421 bytes in 2630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:35.470668 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e1df0ddc-9023-4c3d-bc65-4659ef8689b4 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:35.473383 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e1df0ddc-9023-4c3d-bc65-4659ef8689b4 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: a1064818-2a5f-42f7-9566-57a10ea5eb57] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:35.490092 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e1df0ddc-9023-4c3d-bc65-4659ef8689b4 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:35.494971 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e1df0ddc-9023-4c3d-bc65-4659ef8689b4 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:35.494971 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e1df0ddc-9023-4c3d-bc65-4659ef8689b4 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:35.494971 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e1df0ddc-9023-4c3d-bc65-4659ef8689b4 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:35.649212 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e1df0ddc-9023-4c3d-bc65-4659ef8689b4 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:35.665043 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e1df0ddc-9023-4c3d-bc65-4659ef8689b4 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/a1064818-2a5f-42f7-9566-57a10ea5eb57" status: 200 len: 1212 microversion: 2.1 time: 0.209507 Apr 16 21:10:35.667226 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 521/1135] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:35 2022] GET /compute/v2.1/servers/a1064818-2a5f-42f7-9566-57a10ea5eb57 => generated 1212 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:35.677246 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-dddc1848-9981-4b36-8e57-c00d62449968 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:35.677246 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-dddc1848-9981-4b36-8e57-c00d62449968 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 2b27c826-905d-4c1f-9daf-42150b1025a8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:35.680449 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dddc1848-9981-4b36-8e57-c00d62449968 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:35.681067 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dddc1848-9981-4b36-8e57-c00d62449968 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:35.682713 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dddc1848-9981-4b36-8e57-c00d62449968 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:35.682713 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dddc1848-9981-4b36-8e57-c00d62449968 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:35.982374 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-dddc1848-9981-4b36-8e57-c00d62449968 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:35.992596 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-dddc1848-9981-4b36-8e57-c00d62449968 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8" status: 200 len: 1522 microversion: 2.1 time: 0.325581 Apr 16 21:10:36.002940 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 522/1136] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:35 2022] GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8 => generated 1522 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:36.007740 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-01cda430-4632-42eb-aee0-f774023408a1 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:36.013136 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-01cda430-4632-42eb-aee0-f774023408a1 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:36.031332 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-01cda430-4632-42eb-aee0-f774023408a1 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:36.031819 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-01cda430-4632-42eb-aee0-f774023408a1 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:36.032646 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-01cda430-4632-42eb-aee0-f774023408a1 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:36.033104 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-01cda430-4632-42eb-aee0-f774023408a1 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:36.275904 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-01cda430-4632-42eb-aee0-f774023408a1 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:36.284950 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-01cda430-4632-42eb-aee0-f774023408a1 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1473 microversion: 2.1 time: 0.280878 Apr 16 21:10:36.292722 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 523/1137] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:36 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1473 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:36.307151 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2a93d97b-578f-4357-8e7f-35fe95a297eb tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:36.309512 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2a93d97b-578f-4357-8e7f-35fe95a297eb tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:36.314292 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2a93d97b-578f-4357-8e7f-35fe95a297eb tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:36.314876 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2a93d97b-578f-4357-8e7f-35fe95a297eb tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:36.315753 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2a93d97b-578f-4357-8e7f-35fe95a297eb tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:36.316364 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2a93d97b-578f-4357-8e7f-35fe95a297eb tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:36.688831 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2a93d97b-578f-4357-8e7f-35fe95a297eb tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:36.723227 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2a93d97b-578f-4357-8e7f-35fe95a297eb tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1310 microversion: 2.1 time: 0.436050 Apr 16 21:10:36.733852 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 524/1138] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:36 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1310 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:36.740544 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-aaa07dfc-ce04-4d7e-8217-52d730e42aae req-634687ff-bfb8-4323-b193-ce5338e96598 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d971969c-aa4b-4761-a632-23f88b833ec4", "name": "network-vif-plugged", "status": "completed", "tag": "0e96d99c-8339-47c4-aadc-62a791ca4b9a"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:10:36.779591 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ecaf414e-cbbf-42e7-b3d2-f5e6e1c57def tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd/action" status: 202 len: 0 microversion: 2.25 time: 4.629047 Apr 16 21:10:36.784652 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 615/1139] 10.222.0.20 () {62 vars in 1318 bytes} [Sat Apr 16 21:10:32 2022] POST /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd/action => generated 0 bytes in 4632 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:10:36.789236 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6cf1f934-08d2-4dfe-98c6-3e05cf2a2a0e tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb964ea310>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:36.794896 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-aaa07dfc-ce04-4d7e-8217-52d730e42aae req-634687ff-bfb8-4323-b193-ce5338e96598 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:36.796376 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-aaa07dfc-ce04-4d7e-8217-52d730e42aae req-634687ff-bfb8-4323-b193-ce5338e96598 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:36.869589 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-aaa07dfc-ce04-4d7e-8217-52d730e42aae req-634687ff-bfb8-4323-b193-ce5338e96598 service nova] Creating event network-vif-plugged:0e96d99c-8339-47c4-aadc-62a791ca4b9a for instance d971969c-aa4b-4761-a632-23f88b833ec4 on nch2-master-1 Apr 16 21:10:36.892936 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-aaa07dfc-ce04-4d7e-8217-52d730e42aae req-634687ff-bfb8-4323-b193-ce5338e96598 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158001 Apr 16 21:10:36.897147 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 525/1140] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:10:36.922164 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6cf1f934-08d2-4dfe-98c6-3e05cf2a2a0e tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef" status: 200 len: 1421 microversion: 2.1 time: 0.137788 Apr 16 21:10:36.922781 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 616/1141] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:10:36 2022] GET /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef => generated 1421 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:36.945995 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b1a3365a-7f7d-4fd0-af72-b2481d248398 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:36.947369 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-de449c2b-1e5a-4cb4-8360-8509d3095442 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:36.947985 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-de449c2b-1e5a-4cb4-8360-8509d3095442 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:36.950230 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b1a3365a-7f7d-4fd0-af72-b2481d248398 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: a1064818-2a5f-42f7-9566-57a10ea5eb57] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:36.978434 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-de449c2b-1e5a-4cb4-8360-8509d3095442 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:36.980557 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b1a3365a-7f7d-4fd0-af72-b2481d248398 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:36.981510 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-de449c2b-1e5a-4cb4-8360-8509d3095442 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:36.982205 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b1a3365a-7f7d-4fd0-af72-b2481d248398 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:36.984402 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-de449c2b-1e5a-4cb4-8360-8509d3095442 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:36.985498 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-de449c2b-1e5a-4cb4-8360-8509d3095442 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:36.985748 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b1a3365a-7f7d-4fd0-af72-b2481d248398 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:36.986596 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b1a3365a-7f7d-4fd0-af72-b2481d248398 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:37.353911 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-de449c2b-1e5a-4cb4-8360-8509d3095442 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:37.363575 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b1a3365a-7f7d-4fd0-af72-b2481d248398 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:37.376436 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b1a3365a-7f7d-4fd0-af72-b2481d248398 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/a1064818-2a5f-42f7-9566-57a10ea5eb57" status: 200 len: 1276 microversion: 2.1 time: 0.477662 Apr 16 21:10:37.379694 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 526/1142] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:36 2022] GET /compute/v2.1/servers/a1064818-2a5f-42f7-9566-57a10ea5eb57 => generated 1276 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:37.382567 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-de449c2b-1e5a-4cb4-8360-8509d3095442 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:37.387208 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-de449c2b-1e5a-4cb4-8360-8509d3095442 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:37.390757 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-affc867d-8584-455f-b53a-6ace8faf43e6 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:37.391653 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-de449c2b-1e5a-4cb4-8360-8509d3095442 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd" status: 200 len: 1646 microversion: 2.25 time: 0.454246 Apr 16 21:10:37.394374 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-affc867d-8584-455f-b53a-6ace8faf43e6 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 2b27c826-905d-4c1f-9daf-42150b1025a8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:37.394564 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 617/1143] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:10:36 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd => generated 1646 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:10:37.407850 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-26e31ce0-6482-400e-894e-df766db77d7d tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:37.410103 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-26e31ce0-6482-400e-894e-df766db77d7d tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:37.412678 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-affc867d-8584-455f-b53a-6ace8faf43e6 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:37.414346 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-affc867d-8584-455f-b53a-6ace8faf43e6 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:37.425213 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-affc867d-8584-455f-b53a-6ace8faf43e6 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:37.425213 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-affc867d-8584-455f-b53a-6ace8faf43e6 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:37.427486 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-26e31ce0-6482-400e-894e-df766db77d7d tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:37.430623 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-26e31ce0-6482-400e-894e-df766db77d7d tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:37.431447 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-26e31ce0-6482-400e-894e-df766db77d7d tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:37.431894 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-26e31ce0-6482-400e-894e-df766db77d7d tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:37.815888 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-26e31ce0-6482-400e-894e-df766db77d7d tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:37.828952 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-26e31ce0-6482-400e-894e-df766db77d7d tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1473 microversion: 2.1 time: 0.432086 Apr 16 21:10:37.829733 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 618/1144] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:37 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1473 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:37.843927 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1d3912f8-5e0f-4e41-8f2e-b4439372bad0 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:37.846033 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1d3912f8-5e0f-4e41-8f2e-b4439372bad0 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:37.856104 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1d3912f8-5e0f-4e41-8f2e-b4439372bad0 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:37.856874 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1d3912f8-5e0f-4e41-8f2e-b4439372bad0 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:37.858021 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1d3912f8-5e0f-4e41-8f2e-b4439372bad0 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:37.858752 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1d3912f8-5e0f-4e41-8f2e-b4439372bad0 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:38.123464 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1d3912f8-5e0f-4e41-8f2e-b4439372bad0 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:38.132094 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1d3912f8-5e0f-4e41-8f2e-b4439372bad0 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1310 microversion: 2.1 time: 0.298223 Apr 16 21:10:38.137458 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 619/1145] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:37 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1310 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:38.153169 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1262e6fe-72dc-41f6-a408-881ae6ad3306 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb964eab80>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:38.194006 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-affc867d-8584-455f-b53a-6ace8faf43e6 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:38.202057 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-affc867d-8584-455f-b53a-6ace8faf43e6 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8" status: 200 len: 1522 microversion: 2.1 time: 0.819934 Apr 16 21:10:38.205834 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 527/1146] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:37 2022] GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8 => generated 1522 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:38.226976 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1262e6fe-72dc-41f6-a408-881ae6ad3306 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef" status: 200 len: 1421 microversion: 2.1 time: 0.078724 Apr 16 21:10:38.237903 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 620/1147] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:10:38 2022] GET /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef => generated 1421 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:38.428452 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-abea06ee-f59d-4b76-a660-0a8dffeb7924 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:38.430009 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-abea06ee-f59d-4b76-a660-0a8dffeb7924 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: a1064818-2a5f-42f7-9566-57a10ea5eb57] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:38.431699 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e4b9f9e0-c51b-4315-9083-52ce991eb2ef tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:38.433231 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e4b9f9e0-c51b-4315-9083-52ce991eb2ef tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:38.463217 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e4b9f9e0-c51b-4315-9083-52ce991eb2ef tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:38.464782 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-abea06ee-f59d-4b76-a660-0a8dffeb7924 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:38.465562 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-abea06ee-f59d-4b76-a660-0a8dffeb7924 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:38.467528 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e4b9f9e0-c51b-4315-9083-52ce991eb2ef tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:38.472754 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e4b9f9e0-c51b-4315-9083-52ce991eb2ef tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:38.473116 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-abea06ee-f59d-4b76-a660-0a8dffeb7924 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:38.473750 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e4b9f9e0-c51b-4315-9083-52ce991eb2ef tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:38.474420 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-abea06ee-f59d-4b76-a660-0a8dffeb7924 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:38.707696 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-abea06ee-f59d-4b76-a660-0a8dffeb7924 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:38.719342 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-abea06ee-f59d-4b76-a660-0a8dffeb7924 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/a1064818-2a5f-42f7-9566-57a10ea5eb57" status: 200 len: 1274 microversion: 2.1 time: 0.302117 Apr 16 21:10:38.731559 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 528/1148] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:38 2022] GET /compute/v2.1/servers/a1064818-2a5f-42f7-9566-57a10ea5eb57 => generated 1274 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:38.794054 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e4b9f9e0-c51b-4315-9083-52ce991eb2ef tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:38.810095 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e4b9f9e0-c51b-4315-9083-52ce991eb2ef tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:38.812494 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e4b9f9e0-c51b-4315-9083-52ce991eb2ef tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:38.814731 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e4b9f9e0-c51b-4315-9083-52ce991eb2ef tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd" status: 200 len: 1646 microversion: 2.25 time: 0.397752 Apr 16 21:10:38.815490 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 621/1149] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:10:38 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd => generated 1646 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:10:38.859559 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b098719a-039e-4340-9655-24d97a4f92d3 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:38.862853 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b098719a-039e-4340-9655-24d97a4f92d3 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:38.877262 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b098719a-039e-4340-9655-24d97a4f92d3 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:38.878366 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b098719a-039e-4340-9655-24d97a4f92d3 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:38.881985 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b098719a-039e-4340-9655-24d97a4f92d3 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:38.882652 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b098719a-039e-4340-9655-24d97a4f92d3 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:39.152799 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b098719a-039e-4340-9655-24d97a4f92d3 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:39.156236 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-53b629d0-988b-4ca5-857b-53050eb7cb04 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:39.157479 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-53b629d0-988b-4ca5-857b-53050eb7cb04 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:39.185191 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b098719a-039e-4340-9655-24d97a4f92d3 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1473 microversion: 2.1 time: 0.336769 Apr 16 21:10:39.190857 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 529/1150] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:38 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1473 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:39.192699 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-53b629d0-988b-4ca5-857b-53050eb7cb04 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:39.195886 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-53b629d0-988b-4ca5-857b-53050eb7cb04 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:39.200045 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-53b629d0-988b-4ca5-857b-53050eb7cb04 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:39.204954 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-53b629d0-988b-4ca5-857b-53050eb7cb04 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:39.249581 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7e7689b1-5664-4c55-b629-1cd2257f9b2f tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:39.273219 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7e7689b1-5664-4c55-b629-1cd2257f9b2f tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 2b27c826-905d-4c1f-9daf-42150b1025a8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:39.330075 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7e7689b1-5664-4c55-b629-1cd2257f9b2f tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:39.345151 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7e7689b1-5664-4c55-b629-1cd2257f9b2f tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:39.352975 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7e7689b1-5664-4c55-b629-1cd2257f9b2f tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:39.353572 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7e7689b1-5664-4c55-b629-1cd2257f9b2f tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:39.725233 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-53b629d0-988b-4ca5-857b-53050eb7cb04 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:39.736717 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-53b629d0-988b-4ca5-857b-53050eb7cb04 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1310 microversion: 2.1 time: 0.587249 Apr 16 21:10:39.776650 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 622/1151] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:39 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1310 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:39.796322 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c27c4edc-ce5b-4be4-9fed-1719026e1195 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb9c01fc10>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:39.909926 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c27c4edc-ce5b-4be4-9fed-1719026e1195 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef" status: 200 len: 1421 microversion: 2.1 time: 0.134689 Apr 16 21:10:39.911765 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 623/1152] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:10:39 2022] GET /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef => generated 1421 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:39.917704 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d81f5572-6047-46f2-8606-dd0e944dd125 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:39.920241 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d81f5572-6047-46f2-8606-dd0e944dd125 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: a1064818-2a5f-42f7-9566-57a10ea5eb57] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:39.928878 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d81f5572-6047-46f2-8606-dd0e944dd125 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:39.929726 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d81f5572-6047-46f2-8606-dd0e944dd125 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:39.930787 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d81f5572-6047-46f2-8606-dd0e944dd125 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:39.932897 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d81f5572-6047-46f2-8606-dd0e944dd125 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:39.971416 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7e7689b1-5664-4c55-b629-1cd2257f9b2f tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:39.985764 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7e7689b1-5664-4c55-b629-1cd2257f9b2f tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8" status: 200 len: 1522 microversion: 2.1 time: 0.766797 Apr 16 21:10:39.991040 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 530/1153] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:39 2022] GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8 => generated 1522 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:40.007962 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-228f29b5-a89d-4423-94cf-83eb0af89a21 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:40.009068 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-228f29b5-a89d-4423-94cf-83eb0af89a21 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:40.036931 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-228f29b5-a89d-4423-94cf-83eb0af89a21 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:40.037877 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-228f29b5-a89d-4423-94cf-83eb0af89a21 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:40.040273 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-228f29b5-a89d-4423-94cf-83eb0af89a21 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:40.040990 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-228f29b5-a89d-4423-94cf-83eb0af89a21 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:40.387035 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d81f5572-6047-46f2-8606-dd0e944dd125 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:40.397613 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d81f5572-6047-46f2-8606-dd0e944dd125 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/a1064818-2a5f-42f7-9566-57a10ea5eb57" status: 200 len: 1316 microversion: 2.1 time: 0.483948 Apr 16 21:10:40.405487 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 624/1154] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:39 2022] GET /compute/v2.1/servers/a1064818-2a5f-42f7-9566-57a10ea5eb57 => generated 1316 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:40.415375 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9f0efe1f-f6d3-4e8c-9c4c-376cae586653 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:40.422850 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9f0efe1f-f6d3-4e8c-9c4c-376cae586653 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:40.451611 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9f0efe1f-f6d3-4e8c-9c4c-376cae586653 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:40.452437 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9f0efe1f-f6d3-4e8c-9c4c-376cae586653 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:40.458400 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9f0efe1f-f6d3-4e8c-9c4c-376cae586653 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:40.459714 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9f0efe1f-f6d3-4e8c-9c4c-376cae586653 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:40.751537 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9f0efe1f-f6d3-4e8c-9c4c-376cae586653 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:40.763374 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9f0efe1f-f6d3-4e8c-9c4c-376cae586653 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1473 microversion: 2.1 time: 0.362706 Apr 16 21:10:40.765029 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 625/1155] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:40 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1473 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:40.771515 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4baae82d-42b5-4ac1-a31f-dac789a3a059 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:40.772320 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4baae82d-42b5-4ac1-a31f-dac789a3a059 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:40.780961 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4baae82d-42b5-4ac1-a31f-dac789a3a059 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:40.781571 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4baae82d-42b5-4ac1-a31f-dac789a3a059 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:40.782550 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4baae82d-42b5-4ac1-a31f-dac789a3a059 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:40.783105 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4baae82d-42b5-4ac1-a31f-dac789a3a059 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:40.921866 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-228f29b5-a89d-4423-94cf-83eb0af89a21 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:40.931212 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-228f29b5-a89d-4423-94cf-83eb0af89a21 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:40.943501 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-228f29b5-a89d-4423-94cf-83eb0af89a21 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:40.943501 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-228f29b5-a89d-4423-94cf-83eb0af89a21 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd" status: 200 len: 1646 microversion: 2.25 time: 0.949030 Apr 16 21:10:40.953208 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 531/1156] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:10:39 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd => generated 1646 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:10:40.959798 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fb48ee49-2d85-4035-a284-b9f643249220 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb964ffb80>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:41.060003 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fb48ee49-2d85-4035-a284-b9f643249220 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef" status: 200 len: 1421 microversion: 2.1 time: 0.104968 Apr 16 21:10:41.061262 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 532/1157] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:10:40 2022] GET /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef => generated 1421 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:41.084383 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cf17dfad-478b-4a0e-a93e-7e34500e112c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:41.085277 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-cf17dfad-478b-4a0e-a93e-7e34500e112c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 2b27c826-905d-4c1f-9daf-42150b1025a8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:41.096098 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cf17dfad-478b-4a0e-a93e-7e34500e112c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:41.118657 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cf17dfad-478b-4a0e-a93e-7e34500e112c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:41.131726 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cf17dfad-478b-4a0e-a93e-7e34500e112c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:41.133139 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cf17dfad-478b-4a0e-a93e-7e34500e112c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:41.153716 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4baae82d-42b5-4ac1-a31f-dac789a3a059 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:41.163716 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4baae82d-42b5-4ac1-a31f-dac789a3a059 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1493 microversion: 2.1 time: 0.397537 Apr 16 21:10:41.177670 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 626/1158] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:40 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1493 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:41.264646 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-feda6aca-bf33-49f7-827d-302cd616f982 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:41.264646 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-feda6aca-bf33-49f7-827d-302cd616f982 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:41.264646 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-feda6aca-bf33-49f7-827d-302cd616f982 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:41.264646 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-feda6aca-bf33-49f7-827d-302cd616f982 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:41.265090 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-feda6aca-bf33-49f7-827d-302cd616f982 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:41.265090 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-feda6aca-bf33-49f7-827d-302cd616f982 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:41.524156 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-feda6aca-bf33-49f7-827d-302cd616f982 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1644 microversion: 2.1 time: 0.310976 Apr 16 21:10:41.524953 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 627/1159] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:41 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1644 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:41.532192 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0dfd658f-4395-464d-8022-d0e763c3d6d8 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:41.532192 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0dfd658f-4395-464d-8022-d0e763c3d6d8 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: a1064818-2a5f-42f7-9566-57a10ea5eb57] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:41.538500 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0dfd658f-4395-464d-8022-d0e763c3d6d8 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:41.538988 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0dfd658f-4395-464d-8022-d0e763c3d6d8 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:41.539839 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0dfd658f-4395-464d-8022-d0e763c3d6d8 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:41.541883 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0dfd658f-4395-464d-8022-d0e763c3d6d8 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:41.577253 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cf17dfad-478b-4a0e-a93e-7e34500e112c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:41.590126 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cf17dfad-478b-4a0e-a93e-7e34500e112c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8" status: 200 len: 1522 microversion: 2.1 time: 0.523334 Apr 16 21:10:41.590126 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 533/1160] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:41 2022] GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8 => generated 1522 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:41.592550 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b53dfa95-47a0-4476-85bd-3d213e86c59f tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:41.593971 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:10:41.593971 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:10:41.595397 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b53dfa95-47a0-4476-85bd-3d213e86c59f tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:41.595915 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b53dfa95-47a0-4476-85bd-3d213e86c59f tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:41.596785 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b53dfa95-47a0-4476-85bd-3d213e86c59f tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:41.597371 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b53dfa95-47a0-4476-85bd-3d213e86c59f tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:41.625444 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b53dfa95-47a0-4476-85bd-3d213e86c59f tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.036534 Apr 16 21:10:41.626461 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 534/1161] 10.222.0.20 () {58 vars in 1175 bytes} [Sat Apr 16 21:10:41 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:10:41.782285 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0dfd658f-4395-464d-8022-d0e763c3d6d8 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:41.789376 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c5d8d584-9622-4cfb-a2a2-a2af42aab1a4 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:41.790261 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c5d8d584-9622-4cfb-a2a2-a2af42aab1a4 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:41.793553 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0dfd658f-4395-464d-8022-d0e763c3d6d8 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/a1064818-2a5f-42f7-9566-57a10ea5eb57" status: 200 len: 1316 microversion: 2.1 time: 0.267720 Apr 16 21:10:41.801548 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 628/1162] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:41 2022] GET /compute/v2.1/servers/a1064818-2a5f-42f7-9566-57a10ea5eb57 => generated 1316 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:41.840195 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c5d8d584-9622-4cfb-a2a2-a2af42aab1a4 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:41.876241 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c5d8d584-9622-4cfb-a2a2-a2af42aab1a4 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:41.884095 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c5d8d584-9622-4cfb-a2a2-a2af42aab1a4 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:41.887453 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c5d8d584-9622-4cfb-a2a2-a2af42aab1a4 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:41.901664 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-a0edac8c-86f8-42eb-93bc-901389d904ea req-1f902d41-d682-4c07-bc8b-8f78ed1f4d50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a1064818-2a5f-42f7-9566-57a10ea5eb57", "tag": "214939ad-5504-4c41-a66d-6940e76ded8b"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:10:41.940959 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-a0edac8c-86f8-42eb-93bc-901389d904ea req-1f902d41-d682-4c07-bc8b-8f78ed1f4d50 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:41.942045 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-a0edac8c-86f8-42eb-93bc-901389d904ea req-1f902d41-d682-4c07-bc8b-8f78ed1f4d50 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:41.975119 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-a0edac8c-86f8-42eb-93bc-901389d904ea req-1f902d41-d682-4c07-bc8b-8f78ed1f4d50 service nova] Creating event network-changed:214939ad-5504-4c41-a66d-6940e76ded8b for instance a1064818-2a5f-42f7-9566-57a10ea5eb57 on nch1-master-1 Apr 16 21:10:41.983361 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-a0edac8c-86f8-42eb-93bc-901389d904ea req-1f902d41-d682-4c07-bc8b-8f78ed1f4d50 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094496 Apr 16 21:10:41.984852 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 629/1163] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:10:41.998334 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b652f85c-75fe-459d-86f1-3f8afa702e91 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:42.007818 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b652f85c-75fe-459d-86f1-3f8afa702e91 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:42.037182 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b652f85c-75fe-459d-86f1-3f8afa702e91 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:42.038208 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b652f85c-75fe-459d-86f1-3f8afa702e91 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:42.039289 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b652f85c-75fe-459d-86f1-3f8afa702e91 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:42.039971 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b652f85c-75fe-459d-86f1-3f8afa702e91 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:42.337954 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b652f85c-75fe-459d-86f1-3f8afa702e91 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:42.349904 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b652f85c-75fe-459d-86f1-3f8afa702e91 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:42.351730 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b652f85c-75fe-459d-86f1-3f8afa702e91 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:42.353568 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b652f85c-75fe-459d-86f1-3f8afa702e91 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd" status: 200 len: 1646 microversion: 2.25 time: 0.367090 Apr 16 21:10:42.364196 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 630/1164] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:10:41 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd => generated 1646 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:10:42.364196 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c84ee76a-7493-46ef-94cc-0b8491b3f69e tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb964dcc10>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:42.466221 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c5d8d584-9622-4cfb-a2a2-a2af42aab1a4 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:42.469550 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c84ee76a-7493-46ef-94cc-0b8491b3f69e tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef" status: 200 len: 1421 microversion: 2.1 time: 0.114098 Apr 16 21:10:42.473313 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 631/1165] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:10:42 2022] GET /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef => generated 1421 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:42.490217 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c5d8d584-9622-4cfb-a2a2-a2af42aab1a4 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1473 microversion: 2.1 time: 0.707315 Apr 16 21:10:42.492105 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 535/1166] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:41 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1473 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:10:42.631291 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4e21bb71-3e7c-4588-b12d-ca99c5b1bf3c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:42.632009 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4e21bb71-3e7c-4588-b12d-ca99c5b1bf3c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 2b27c826-905d-4c1f-9daf-42150b1025a8] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:42.645637 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4e21bb71-3e7c-4588-b12d-ca99c5b1bf3c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:42.646105 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4e21bb71-3e7c-4588-b12d-ca99c5b1bf3c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:42.646914 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4e21bb71-3e7c-4588-b12d-ca99c5b1bf3c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:42.647360 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4e21bb71-3e7c-4588-b12d-ca99c5b1bf3c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:42.816789 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c2201852-4f52-43e7-a39e-45b4b54d9e44 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:42.817517 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c2201852-4f52-43e7-a39e-45b4b54d9e44 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: a1064818-2a5f-42f7-9566-57a10ea5eb57] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:42.836147 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c2201852-4f52-43e7-a39e-45b4b54d9e44 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:42.839191 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c2201852-4f52-43e7-a39e-45b4b54d9e44 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:42.840042 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c2201852-4f52-43e7-a39e-45b4b54d9e44 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:42.841940 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c2201852-4f52-43e7-a39e-45b4b54d9e44 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:42.963150 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4e21bb71-3e7c-4588-b12d-ca99c5b1bf3c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:43.016362 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4e21bb71-3e7c-4588-b12d-ca99c5b1bf3c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8" status: 200 len: 1499 microversion: 2.1 time: 0.390147 Apr 16 21:10:43.059269 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 632/1167] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:42 2022] GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8 => generated 1499 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:43.079980 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3fe0bcfc-8ed7-48a3-bd18-3e00a28a1a67 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:43.087618 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3fe0bcfc-8ed7-48a3-bd18-3e00a28a1a67 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:43.099026 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3fe0bcfc-8ed7-48a3-bd18-3e00a28a1a67 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c'} {{(pid=137408) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:10:43.099026 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3fe0bcfc-8ed7-48a3-bd18-3e00a28a1a67 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:43.099430 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3fe0bcfc-8ed7-48a3-bd18-3e00a28a1a67 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:43.100389 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3fe0bcfc-8ed7-48a3-bd18-3e00a28a1a67 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:43.100719 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3fe0bcfc-8ed7-48a3-bd18-3e00a28a1a67 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:43.135280 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.multi_cell_list [None req-3fe0bcfc-8ed7-48a3-bd18-3e00a28a1a67 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137408) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 16 21:10:43.229809 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3fe0bcfc-8ed7-48a3-bd18-3e00a28a1a67 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.151093 Apr 16 21:10:43.233483 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 633/1168] 10.222.0.20 () {58 vars in 1153 bytes} [Sat Apr 16 21:10:43 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:10:43.246227 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b4f044d7-b7a1-487d-b224-dbf7fd6e57fc tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:10:43.261648 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b4f044d7-b7a1-487d-b224-dbf7fd6e57fc tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:43.268464 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b4f044d7-b7a1-487d-b224-dbf7fd6e57fc tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:43.465081 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b4f044d7-b7a1-487d-b224-dbf7fd6e57fc tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 2b27c826-905d-4c1f-9daf-42150b1025a8] Going to try to start instance {{(pid=137408) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 16 21:10:43.667421 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c2201852-4f52-43e7-a39e-45b4b54d9e44 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:43.706427 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c2201852-4f52-43e7-a39e-45b4b54d9e44 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/a1064818-2a5f-42f7-9566-57a10ea5eb57" status: 200 len: 1316 microversion: 2.1 time: 0.897030 Apr 16 21:10:43.711755 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 536/1169] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:42 2022] GET /compute/v2.1/servers/a1064818-2a5f-42f7-9566-57a10ea5eb57 => generated 1316 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:43.718353 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4477958b-a50a-407e-8315-b3a33b387875 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:43.719354 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4477958b-a50a-407e-8315-b3a33b387875 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:43.731789 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4477958b-a50a-407e-8315-b3a33b387875 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:43.733678 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4477958b-a50a-407e-8315-b3a33b387875 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:43.737331 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4477958b-a50a-407e-8315-b3a33b387875 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:43.740962 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4477958b-a50a-407e-8315-b3a33b387875 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:43.849917 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b4f044d7-b7a1-487d-b224-dbf7fd6e57fc tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "POST /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8/action" status: 202 len: 0 microversion: 2.1 time: 0.612175 Apr 16 21:10:43.853501 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 634/1170] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:10:43 2022] POST /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8/action => generated 0 bytes in 614 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:10:43.858824 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c2d46f18-8e20-40b6-8de6-97ae37a57799 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb9654b1f0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:43.949049 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c2d46f18-8e20-40b6-8de6-97ae37a57799 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef" status: 200 len: 1421 microversion: 2.1 time: 0.096593 Apr 16 21:10:43.949928 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 635/1171] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:10:43 2022] GET /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef => generated 1421 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:43.957129 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-62e965d2-f40a-47c1-af53-2ae8da13f094 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:43.959325 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-62e965d2-f40a-47c1-af53-2ae8da13f094 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:43.967566 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-62e965d2-f40a-47c1-af53-2ae8da13f094 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:43.968333 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-62e965d2-f40a-47c1-af53-2ae8da13f094 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:43.969308 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-62e965d2-f40a-47c1-af53-2ae8da13f094 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:43.969914 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-62e965d2-f40a-47c1-af53-2ae8da13f094 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:44.198748 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-62e965d2-f40a-47c1-af53-2ae8da13f094 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:44.210623 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4477958b-a50a-407e-8315-b3a33b387875 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:44.212017 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-62e965d2-f40a-47c1-af53-2ae8da13f094 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1473 microversion: 2.1 time: 0.260861 Apr 16 21:10:44.225153 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 636/1172] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:43 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1473 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:44.232644 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0cba5574-b2c8-4a58-ac02-b5aa8b18e65c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:44.233550 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0cba5574-b2c8-4a58-ac02-b5aa8b18e65c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 2b27c826-905d-4c1f-9daf-42150b1025a8] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:44.242540 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0cba5574-b2c8-4a58-ac02-b5aa8b18e65c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:44.243002 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0cba5574-b2c8-4a58-ac02-b5aa8b18e65c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:44.243814 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0cba5574-b2c8-4a58-ac02-b5aa8b18e65c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:44.244310 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0cba5574-b2c8-4a58-ac02-b5aa8b18e65c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:44.250555 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4477958b-a50a-407e-8315-b3a33b387875 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:44.255470 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4477958b-a50a-407e-8315-b3a33b387875 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:44.260838 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4477958b-a50a-407e-8315-b3a33b387875 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd" status: 200 len: 1646 microversion: 2.25 time: 0.551744 Apr 16 21:10:44.264704 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 537/1173] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:10:43 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd => generated 1646 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:10:44.448304 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0cba5574-b2c8-4a58-ac02-b5aa8b18e65c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:44.458475 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0cba5574-b2c8-4a58-ac02-b5aa8b18e65c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8" status: 200 len: 1508 microversion: 2.1 time: 0.232027 Apr 16 21:10:44.468073 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 637/1174] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:44 2022] GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8 => generated 1508 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:44.728262 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-18881557-0ed5-4c44-b3f6-314f9bb8442b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:44.732754 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-18881557-0ed5-4c44-b3f6-314f9bb8442b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: a1064818-2a5f-42f7-9566-57a10ea5eb57] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:44.749880 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-18881557-0ed5-4c44-b3f6-314f9bb8442b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:44.750590 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-18881557-0ed5-4c44-b3f6-314f9bb8442b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:44.751721 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-18881557-0ed5-4c44-b3f6-314f9bb8442b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:44.752835 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-18881557-0ed5-4c44-b3f6-314f9bb8442b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:44.962847 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d3a1ed74-fe37-4f9a-a027-d3361637f287 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb964dc040>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:45.141226 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-18881557-0ed5-4c44-b3f6-314f9bb8442b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:45.149662 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-18881557-0ed5-4c44-b3f6-314f9bb8442b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/a1064818-2a5f-42f7-9566-57a10ea5eb57" status: 200 len: 1316 microversion: 2.1 time: 0.426011 Apr 16 21:10:45.150253 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 538/1175] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:44 2022] GET /compute/v2.1/servers/a1064818-2a5f-42f7-9566-57a10ea5eb57 => generated 1316 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:45.233792 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-49850ec9-51f3-45d1-85a7-4bbd3ffc7d0e tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:45.234338 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-49850ec9-51f3-45d1-85a7-4bbd3ffc7d0e tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:45.278069 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-49850ec9-51f3-45d1-85a7-4bbd3ffc7d0e tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:45.281391 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-49850ec9-51f3-45d1-85a7-4bbd3ffc7d0e tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:45.282230 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-49850ec9-51f3-45d1-85a7-4bbd3ffc7d0e tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:45.282689 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-49850ec9-51f3-45d1-85a7-4bbd3ffc7d0e tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:45.879965 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-49850ec9-51f3-45d1-85a7-4bbd3ffc7d0e tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:45.889802 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-49850ec9-51f3-45d1-85a7-4bbd3ffc7d0e tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1473 microversion: 2.1 time: 0.660887 Apr 16 21:10:45.894036 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 539/1176] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:45 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1473 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:10:45.906799 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-71084ac4-9784-4743-9aeb-66e99638e78b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:45.914485 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-71084ac4-9784-4743-9aeb-66e99638e78b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:45.952122 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-71084ac4-9784-4743-9aeb-66e99638e78b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:45.961268 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-71084ac4-9784-4743-9aeb-66e99638e78b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:45.962431 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-71084ac4-9784-4743-9aeb-66e99638e78b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:45.963099 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-71084ac4-9784-4743-9aeb-66e99638e78b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:46.270946 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-71084ac4-9784-4743-9aeb-66e99638e78b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:46.286083 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-71084ac4-9784-4743-9aeb-66e99638e78b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:46.291294 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-71084ac4-9784-4743-9aeb-66e99638e78b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:46.292805 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-71084ac4-9784-4743-9aeb-66e99638e78b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd" status: 200 len: 1646 microversion: 2.25 time: 0.397063 Apr 16 21:10:46.293555 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 540/1177] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:10:45 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd => generated 1646 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:10:46.303934 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bc58093a-204d-450d-aafd-e2c98864671f tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47811ce7-10e6-4421-b54d-89b4bcfc2df7", "device": "/dev/xvdb"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:10:46.305427 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bc58093a-204d-450d-aafd-e2c98864671f tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:46.315671 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bc58093a-204d-450d-aafd-e2c98864671f tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:46.316364 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bc58093a-204d-450d-aafd-e2c98864671f tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:46.317431 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bc58093a-204d-450d-aafd-e2c98864671f tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:46.320371 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bc58093a-204d-450d-aafd-e2c98864671f tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:47.771275 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bc58093a-204d-450d-aafd-e2c98864671f tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "POST /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.476244 Apr 16 21:10:47.773150 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 541/1178] 10.222.0.20 () {60 vars in 1322 bytes} [Sat Apr 16 21:10:46 2022] POST /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4/os-volume_attachments => generated 194 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:10:47.786724 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-02c71039-4883-4372-9a81-d1afe7459804 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:47.789673 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-02c71039-4883-4372-9a81-d1afe7459804 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 2b27c826-905d-4c1f-9daf-42150b1025a8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:47.808965 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-02c71039-4883-4372-9a81-d1afe7459804 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:47.808965 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-02c71039-4883-4372-9a81-d1afe7459804 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:47.808965 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-02c71039-4883-4372-9a81-d1afe7459804 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:47.808965 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-02c71039-4883-4372-9a81-d1afe7459804 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:48.384985 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-02c71039-4883-4372-9a81-d1afe7459804 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:48.396053 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-02c71039-4883-4372-9a81-d1afe7459804 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8" status: 200 len: 1512 microversion: 2.1 time: 0.620888 Apr 16 21:10:48.397073 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 542/1179] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:47 2022] GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8 => generated 1512 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:48.414354 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3eb78664-de74-4168-aea1-85eb5ded54c0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:48.417286 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3eb78664-de74-4168-aea1-85eb5ded54c0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: a1064818-2a5f-42f7-9566-57a10ea5eb57] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:48.432725 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3eb78664-de74-4168-aea1-85eb5ded54c0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:48.437330 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3eb78664-de74-4168-aea1-85eb5ded54c0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:48.437330 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3eb78664-de74-4168-aea1-85eb5ded54c0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:48.437330 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3eb78664-de74-4168-aea1-85eb5ded54c0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:48.706100 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3eb78664-de74-4168-aea1-85eb5ded54c0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:48.727319 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3eb78664-de74-4168-aea1-85eb5ded54c0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/a1064818-2a5f-42f7-9566-57a10ea5eb57" status: 200 len: 1316 microversion: 2.1 time: 0.328058 Apr 16 21:10:48.737338 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 543/1180] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:48 2022] GET /compute/v2.1/servers/a1064818-2a5f-42f7-9566-57a10ea5eb57 => generated 1316 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:48.737338 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-11220cbb-4bc2-4759-a6c6-f07074fc8685 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:48.737338 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-11220cbb-4bc2-4759-a6c6-f07074fc8685 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:48.741608 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-11220cbb-4bc2-4759-a6c6-f07074fc8685 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:48.742099 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-11220cbb-4bc2-4759-a6c6-f07074fc8685 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:48.742902 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-11220cbb-4bc2-4759-a6c6-f07074fc8685 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:48.743353 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-11220cbb-4bc2-4759-a6c6-f07074fc8685 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:49.035751 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-11220cbb-4bc2-4759-a6c6-f07074fc8685 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:49.045526 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-11220cbb-4bc2-4759-a6c6-f07074fc8685 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1479 microversion: 2.1 time: 0.315940 Apr 16 21:10:49.058765 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 544/1181] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:48 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1479 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:49.070533 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4ca41740-e8f0-4ee1-a14e-f4ef311aefad tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:49.071156 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4ca41740-e8f0-4ee1-a14e-f4ef311aefad tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:49.085106 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4ca41740-e8f0-4ee1-a14e-f4ef311aefad tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:49.086303 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4ca41740-e8f0-4ee1-a14e-f4ef311aefad tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:49.093119 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4ca41740-e8f0-4ee1-a14e-f4ef311aefad tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:49.093591 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4ca41740-e8f0-4ee1-a14e-f4ef311aefad tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:49.328637 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4ca41740-e8f0-4ee1-a14e-f4ef311aefad tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:49.343098 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4ca41740-e8f0-4ee1-a14e-f4ef311aefad tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:49.347781 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4ca41740-e8f0-4ee1-a14e-f4ef311aefad tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:49.354516 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4ca41740-e8f0-4ee1-a14e-f4ef311aefad tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd" status: 200 len: 1646 microversion: 2.25 time: 0.289229 Apr 16 21:10:49.364721 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 545/1182] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:10:49 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd => generated 1646 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:10:49.374708 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-607f5f6e-c4ee-478b-b197-de373141c31c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:49.379484 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-607f5f6e-c4ee-478b-b197-de373141c31c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:49.379965 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.compute.servers [None req-607f5f6e-c4ee-478b-b197-de373141c31c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Removing options 'limit' from query {{(pid=137409) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Apr 16 21:10:49.381579 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-607f5f6e-c4ee-478b-b197-de373141c31c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Searching by: {'deleted': False, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c'} {{(pid=137409) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:10:49.383009 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-607f5f6e-c4ee-478b-b197-de373141c31c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:49.383471 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-607f5f6e-c4ee-478b-b197-de373141c31c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:49.384480 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-607f5f6e-c4ee-478b-b197-de373141c31c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:49.384920 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-607f5f6e-c4ee-478b-b197-de373141c31c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:49.386299 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-607f5f6e-c4ee-478b-b197-de373141c31c tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.020446 Apr 16 21:10:49.387059 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 546/1183] 10.222.0.20 () {58 vars in 1139 bytes} [Sat Apr 16 21:10:49 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:10:49.398411 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-33567df7-16c0-4b43-83a8-6ab3c6fb9748 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:49.399038 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-33567df7-16c0-4b43-83a8-6ab3c6fb9748 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 2b27c826-905d-4c1f-9daf-42150b1025a8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:49.405396 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-33567df7-16c0-4b43-83a8-6ab3c6fb9748 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:49.405850 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-33567df7-16c0-4b43-83a8-6ab3c6fb9748 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:49.409625 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-33567df7-16c0-4b43-83a8-6ab3c6fb9748 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:49.410101 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-33567df7-16c0-4b43-83a8-6ab3c6fb9748 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:49.553747 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-33567df7-16c0-4b43-83a8-6ab3c6fb9748 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:49.563841 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-33567df7-16c0-4b43-83a8-6ab3c6fb9748 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8" status: 200 len: 1512 microversion: 2.1 time: 0.167820 Apr 16 21:10:49.563841 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 547/1184] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:49 2022] GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8 => generated 1512 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:10:49.579863 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b57e0058-8328-4f1e-bc41-5615af2e406b tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:49.582497 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b57e0058-8328-4f1e-bc41-5615af2e406b tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 615ea5db-3cca-4736-b69a-cc7bdc8f0e6e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:49.587183 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b57e0058-8328-4f1e-bc41-5615af2e406b tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:49.587644 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b57e0058-8328-4f1e-bc41-5615af2e406b tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:49.588467 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b57e0058-8328-4f1e-bc41-5615af2e406b tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:49.588971 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b57e0058-8328-4f1e-bc41-5615af2e406b tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:49.834396 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b57e0058-8328-4f1e-bc41-5615af2e406b tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:49.852553 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b57e0058-8328-4f1e-bc41-5615af2e406b tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/615ea5db-3cca-4736-b69a-cc7bdc8f0e6e" status: 200 len: 1511 microversion: 2.1 time: 0.271758 Apr 16 21:10:49.856603 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 548/1185] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:49 2022] GET /compute/v2.1/servers/615ea5db-3cca-4736-b69a-cc7bdc8f0e6e => generated 1511 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:49.867002 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c8391f8b-b522-4b71-90f7-be206abcf4f2 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:49.868002 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c8391f8b-b522-4b71-90f7-be206abcf4f2 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: a1064818-2a5f-42f7-9566-57a10ea5eb57] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:49.884030 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c8391f8b-b522-4b71-90f7-be206abcf4f2 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:49.884572 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c8391f8b-b522-4b71-90f7-be206abcf4f2 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:49.885374 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c8391f8b-b522-4b71-90f7-be206abcf4f2 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:49.885875 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c8391f8b-b522-4b71-90f7-be206abcf4f2 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:50.153206 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c8391f8b-b522-4b71-90f7-be206abcf4f2 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:50.162358 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c8391f8b-b522-4b71-90f7-be206abcf4f2 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/a1064818-2a5f-42f7-9566-57a10ea5eb57" status: 200 len: 1316 microversion: 2.1 time: 0.303895 Apr 16 21:10:50.163165 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 549/1186] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:49 2022] GET /compute/v2.1/servers/a1064818-2a5f-42f7-9566-57a10ea5eb57 => generated 1316 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:50.187762 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3d8b64c6-55e8-4595-ba43-c4506e58f25f tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:50.190512 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3d8b64c6-55e8-4595-ba43-c4506e58f25f tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 524e8c67-957c-4856-a882-fc0a4befaedd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:50.195159 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3d8b64c6-55e8-4595-ba43-c4506e58f25f tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:50.195634 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3d8b64c6-55e8-4595-ba43-c4506e58f25f tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:50.196812 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3d8b64c6-55e8-4595-ba43-c4506e58f25f tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:50.197405 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3d8b64c6-55e8-4595-ba43-c4506e58f25f tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:50.394133 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3d8b64c6-55e8-4595-ba43-c4506e58f25f tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:50.404951 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3d8b64c6-55e8-4595-ba43-c4506e58f25f tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/524e8c67-957c-4856-a882-fc0a4befaedd" status: 200 len: 1510 microversion: 2.1 time: 0.233060 Apr 16 21:10:50.417879 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 550/1187] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:50 2022] GET /compute/v2.1/servers/524e8c67-957c-4856-a882-fc0a4befaedd => generated 1510 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:50.427080 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-67f28195-0cdb-4f87-93b2-fb62d78e6231 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:50.430569 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-67f28195-0cdb-4f87-93b2-fb62d78e6231 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:50.444512 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-67f28195-0cdb-4f87-93b2-fb62d78e6231 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:50.444959 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-67f28195-0cdb-4f87-93b2-fb62d78e6231 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:50.445774 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-67f28195-0cdb-4f87-93b2-fb62d78e6231 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:50.446548 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-67f28195-0cdb-4f87-93b2-fb62d78e6231 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:50.824255 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-67f28195-0cdb-4f87-93b2-fb62d78e6231 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:50.831663 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-67f28195-0cdb-4f87-93b2-fb62d78e6231 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1479 microversion: 2.1 time: 0.411623 Apr 16 21:10:50.832250 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 551/1188] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:50 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1479 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:50.873640 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-db622e31-678a-4496-b8df-17ae230f2f89 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:50.873640 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-db622e31-678a-4496-b8df-17ae230f2f89 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:50.873640 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-db622e31-678a-4496-b8df-17ae230f2f89 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:50.873640 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-db622e31-678a-4496-b8df-17ae230f2f89 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:50.874079 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-db622e31-678a-4496-b8df-17ae230f2f89 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:50.874079 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-db622e31-678a-4496-b8df-17ae230f2f89 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:51.083549 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-db622e31-678a-4496-b8df-17ae230f2f89 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:51.097265 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-db622e31-678a-4496-b8df-17ae230f2f89 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:51.098776 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-db622e31-678a-4496-b8df-17ae230f2f89 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:51.099972 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-db622e31-678a-4496-b8df-17ae230f2f89 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd" status: 200 len: 1646 microversion: 2.25 time: 0.266418 Apr 16 21:10:51.100757 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 552/1189] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:10:50 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd => generated 1646 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:10:51.110402 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-93aeab7d-590a-415f-a56e-31e2dd60d4b7 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:51.114127 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-93aeab7d-590a-415f-a56e-31e2dd60d4b7 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:51.114930 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-93aeab7d-590a-415f-a56e-31e2dd60d4b7 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Searching by: {'ip': '172.20.0.9', 'deleted': False, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c'} {{(pid=137409) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:10:51.284162 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-93aeab7d-590a-415f-a56e-31e2dd60d4b7 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:51.287115 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-93aeab7d-590a-415f-a56e-31e2dd60d4b7 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:51.288228 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-93aeab7d-590a-415f-a56e-31e2dd60d4b7 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:51.288682 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-93aeab7d-590a-415f-a56e-31e2dd60d4b7 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:51.380507 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.multi_cell_list [None req-93aeab7d-590a-415f-a56e-31e2dd60d4b7 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 16 21:10:51.463929 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-93aeab7d-590a-415f-a56e-31e2dd60d4b7 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers?ip=172.20.0.9" status: 200 len: 345 microversion: 2.1 time: 0.362265 Apr 16 21:10:51.465231 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 553/1190] 10.222.0.20 () {58 vars in 1151 bytes} [Sat Apr 16 21:10:51 2022] GET /compute/v2.1/servers?ip=172.20.0.9 => generated 345 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:10:51.476063 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-dae29f81-ce16-48ba-bfdf-a2f50b8798ec req-27f76674-b80c-47c3-acdd-3208eb687ec9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1064818-2a5f-42f7-9566-57a10ea5eb57", "name": "network-vif-plugged", "status": "completed", "tag": "214939ad-5504-4c41-a66d-6940e76ded8b"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:10:51.488437 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-dae29f81-ce16-48ba-bfdf-a2f50b8798ec req-27f76674-b80c-47c3-acdd-3208eb687ec9 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:51.488902 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-dae29f81-ce16-48ba-bfdf-a2f50b8798ec req-27f76674-b80c-47c3-acdd-3208eb687ec9 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:51.500920 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-dae29f81-ce16-48ba-bfdf-a2f50b8798ec req-27f76674-b80c-47c3-acdd-3208eb687ec9 service nova] Creating event network-vif-plugged:214939ad-5504-4c41-a66d-6940e76ded8b for instance a1064818-2a5f-42f7-9566-57a10ea5eb57 on nch1-master-1 Apr 16 21:10:51.506355 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-dae29f81-ce16-48ba-bfdf-a2f50b8798ec req-27f76674-b80c-47c3-acdd-3208eb687ec9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039938 Apr 16 21:10:51.507313 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 554/1191] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:10:51.512801 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ec9d1a8d-0cbf-4706-8159-9694512f9772 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:51.513619 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ec9d1a8d-0cbf-4706-8159-9694512f9772 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: a1064818-2a5f-42f7-9566-57a10ea5eb57] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:51.520385 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ec9d1a8d-0cbf-4706-8159-9694512f9772 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:51.520852 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ec9d1a8d-0cbf-4706-8159-9694512f9772 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:51.521822 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ec9d1a8d-0cbf-4706-8159-9694512f9772 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:51.522269 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ec9d1a8d-0cbf-4706-8159-9694512f9772 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:51.927147 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ec9d1a8d-0cbf-4706-8159-9694512f9772 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:51.941380 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ec9d1a8d-0cbf-4706-8159-9694512f9772 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/a1064818-2a5f-42f7-9566-57a10ea5eb57" status: 200 len: 1316 microversion: 2.1 time: 0.430513 Apr 16 21:10:51.944600 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 555/1192] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:51 2022] GET /compute/v2.1/servers/a1064818-2a5f-42f7-9566-57a10ea5eb57 => generated 1316 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:51.955391 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-fca1f4e2-f59a-4ee3-ae04-36057070cb7e req-16344c79-fd22-48d4-8af3-1cf090f0e2e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a60c9986-12b3-4fc4-9bde-7bf7f34f90bd", "name": "network-vif-unplugged", "status": "completed", "tag": "69daf0de-dee8-41ab-85fa-24c0d402ba05"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:10:51.975523 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-fca1f4e2-f59a-4ee3-ae04-36057070cb7e req-16344c79-fd22-48d4-8af3-1cf090f0e2e3 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:51.977164 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-fca1f4e2-f59a-4ee3-ae04-36057070cb7e req-16344c79-fd22-48d4-8af3-1cf090f0e2e3 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:52.004470 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-fca1f4e2-f59a-4ee3-ae04-36057070cb7e req-16344c79-fd22-48d4-8af3-1cf090f0e2e3 service nova] Creating event network-vif-unplugged:69daf0de-dee8-41ab-85fa-24c0d402ba05 for instance a60c9986-12b3-4fc4-9bde-7bf7f34f90bd on nch2-master-1 Apr 16 21:10:52.010712 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-fca1f4e2-f59a-4ee3-ae04-36057070cb7e req-16344c79-fd22-48d4-8af3-1cf090f0e2e3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064859 Apr 16 21:10:52.021024 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 556/1193] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:10:52.029535 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6aac732f-cf9d-4b33-bed0-26a55db92d9d tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:52.030635 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6aac732f-cf9d-4b33-bed0-26a55db92d9d tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 2b27c826-905d-4c1f-9daf-42150b1025a8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:52.040816 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6aac732f-cf9d-4b33-bed0-26a55db92d9d tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:52.067781 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6aac732f-cf9d-4b33-bed0-26a55db92d9d tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:52.071171 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6aac732f-cf9d-4b33-bed0-26a55db92d9d tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:52.074980 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6aac732f-cf9d-4b33-bed0-26a55db92d9d tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:52.362675 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6aac732f-cf9d-4b33-bed0-26a55db92d9d tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:52.372393 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6aac732f-cf9d-4b33-bed0-26a55db92d9d tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8" status: 200 len: 1512 microversion: 2.1 time: 0.347627 Apr 16 21:10:52.373327 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 557/1194] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:52 2022] GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8 => generated 1512 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:52.378222 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-acb58657-6b7d-4a8b-92c7-995c54ac7953 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:52.379107 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-acb58657-6b7d-4a8b-92c7-995c54ac7953 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:52.386595 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-acb58657-6b7d-4a8b-92c7-995c54ac7953 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:52.387162 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-acb58657-6b7d-4a8b-92c7-995c54ac7953 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:52.388451 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-acb58657-6b7d-4a8b-92c7-995c54ac7953 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:52.388657 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-acb58657-6b7d-4a8b-92c7-995c54ac7953 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:52.571178 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-acb58657-6b7d-4a8b-92c7-995c54ac7953 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:52.584031 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-acb58657-6b7d-4a8b-92c7-995c54ac7953 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1479 microversion: 2.1 time: 0.208707 Apr 16 21:10:52.585012 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 558/1195] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:52 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1479 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:52.590756 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-56abcf63-aa86-4905-9cf4-775d73603695 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:52.591533 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-56abcf63-aa86-4905-9cf4-775d73603695 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:52.599709 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-56abcf63-aa86-4905-9cf4-775d73603695 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:52.600381 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-56abcf63-aa86-4905-9cf4-775d73603695 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:52.601329 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-56abcf63-aa86-4905-9cf4-775d73603695 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:52.602089 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-56abcf63-aa86-4905-9cf4-775d73603695 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:52.801149 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-56abcf63-aa86-4905-9cf4-775d73603695 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:52.813076 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-56abcf63-aa86-4905-9cf4-775d73603695 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:52.815620 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-56abcf63-aa86-4905-9cf4-775d73603695 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:52.817085 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-56abcf63-aa86-4905-9cf4-775d73603695 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd" status: 200 len: 1646 microversion: 2.25 time: 0.230861 Apr 16 21:10:52.818106 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 559/1196] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:10:52 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd => generated 1646 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:10:52.823160 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-199f9665-8bc8-4d97-9dd3-daa24a2482db tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:52.823974 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-199f9665-8bc8-4d97-9dd3-daa24a2482db tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 615ea5db-3cca-4736-b69a-cc7bdc8f0e6e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:52.831114 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-199f9665-8bc8-4d97-9dd3-daa24a2482db tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:52.831964 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-199f9665-8bc8-4d97-9dd3-daa24a2482db tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:52.833099 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-199f9665-8bc8-4d97-9dd3-daa24a2482db tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:52.833696 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-199f9665-8bc8-4d97-9dd3-daa24a2482db tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:52.957925 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d3a1ed74-fe37-4f9a-a027-d3361637f287 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef" status: 200 len: 1430 microversion: 2.1 time: 7.998829 Apr 16 21:10:52.959477 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 638/1197] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:10:44 2022] GET /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef => generated 1430 bytes in 8001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:10:52.971453 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9a9e729b-5409-4ca7-b150-a4c5e0a11c41 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:52.972100 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9a9e729b-5409-4ca7-b150-a4c5e0a11c41 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: a1064818-2a5f-42f7-9566-57a10ea5eb57] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:52.981343 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a9e729b-5409-4ca7-b150-a4c5e0a11c41 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:52.986763 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a9e729b-5409-4ca7-b150-a4c5e0a11c41 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:52.986763 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a9e729b-5409-4ca7-b150-a4c5e0a11c41 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:52.986763 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a9e729b-5409-4ca7-b150-a4c5e0a11c41 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:53.012067 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-199f9665-8bc8-4d97-9dd3-daa24a2482db tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:53.021030 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-199f9665-8bc8-4d97-9dd3-daa24a2482db tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/615ea5db-3cca-4736-b69a-cc7bdc8f0e6e" status: 200 len: 1511 microversion: 2.1 time: 0.201708 Apr 16 21:10:53.021604 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 560/1198] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:52 2022] GET /compute/v2.1/servers/615ea5db-3cca-4736-b69a-cc7bdc8f0e6e => generated 1511 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:53.026622 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7289ca0d-a878-4852-b3d9-a2c54ba18a78 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb96a6f1f0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:53.100724 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7289ca0d-a878-4852-b3d9-a2c54ba18a78 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef" status: 200 len: 1430 microversion: 2.1 time: 0.074425 Apr 16 21:10:53.101302 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 561/1199] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:10:53 2022] GET /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef => generated 1430 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:53.112427 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5ac3d3b8-a9a2-43f0-86df-23f004bf0ddf tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:53.113155 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5ac3d3b8-a9a2-43f0-86df-23f004bf0ddf tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 524e8c67-957c-4856-a882-fc0a4befaedd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:53.126274 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5ac3d3b8-a9a2-43f0-86df-23f004bf0ddf tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:53.127301 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5ac3d3b8-a9a2-43f0-86df-23f004bf0ddf tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:53.128108 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5ac3d3b8-a9a2-43f0-86df-23f004bf0ddf tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:53.128830 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5ac3d3b8-a9a2-43f0-86df-23f004bf0ddf tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:53.138080 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9a9e729b-5409-4ca7-b150-a4c5e0a11c41 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:53.149155 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9a9e729b-5409-4ca7-b150-a4c5e0a11c41 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/a1064818-2a5f-42f7-9566-57a10ea5eb57" status: 200 len: 1316 microversion: 2.1 time: 0.188336 Apr 16 21:10:53.150703 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 639/1200] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:52 2022] GET /compute/v2.1/servers/a1064818-2a5f-42f7-9566-57a10ea5eb57 => generated 1316 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:53.156192 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1935f1ee-cea3-4557-ab77-4664c7edf6af tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:53.157082 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1935f1ee-cea3-4557-ab77-4664c7edf6af tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] [instance: 04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:53.165422 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1935f1ee-cea3-4557-ab77-4664c7edf6af tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:53.166250 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1935f1ee-cea3-4557-ab77-4664c7edf6af tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:53.167290 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1935f1ee-cea3-4557-ab77-4664c7edf6af tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:53.167968 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1935f1ee-cea3-4557-ab77-4664c7edf6af tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:53.309532 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5ac3d3b8-a9a2-43f0-86df-23f004bf0ddf tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:53.323579 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5ac3d3b8-a9a2-43f0-86df-23f004bf0ddf tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/524e8c67-957c-4856-a882-fc0a4befaedd" status: 200 len: 1510 microversion: 2.1 time: 0.220497 Apr 16 21:10:53.324240 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 562/1201] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:53 2022] GET /compute/v2.1/servers/524e8c67-957c-4856-a882-fc0a4befaedd => generated 1510 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:53.335253 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1935f1ee-cea3-4557-ab77-4664c7edf6af tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db9403ce44e460a8165587ae22f0ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2a21b6df375491fb09fc22109fb4a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:53.346363 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8121b86e-71f3-4b2e-ad18-a0b73c4411be tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:53.349386 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1935f1ee-cea3-4557-ab77-4664c7edf6af tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88" status: 200 len: 1480 microversion: 2.1 time: 0.197310 Apr 16 21:10:53.349991 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 640/1202] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:53 2022] GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88 => generated 1480 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:53.353652 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8121b86e-71f3-4b2e-ad18-a0b73c4411be tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:53.354748 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8121b86e-71f3-4b2e-ad18-a0b73c4411be tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Searching by: {'deleted': False, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c'} {{(pid=137409) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:10:53.360573 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8121b86e-71f3-4b2e-ad18-a0b73c4411be tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:53.361584 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8121b86e-71f3-4b2e-ad18-a0b73c4411be tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:53.362404 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8121b86e-71f3-4b2e-ad18-a0b73c4411be tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:53.362850 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8121b86e-71f3-4b2e-ad18-a0b73c4411be tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:53.408565 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.multi_cell_list [None req-8121b86e-71f3-4b2e-ad18-a0b73c4411be tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 16 21:10:53.452227 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8121b86e-71f3-4b2e-ad18-a0b73c4411be tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:53.460445 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8121b86e-71f3-4b2e-ad18-a0b73c4411be tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:53.460901 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8121b86e-71f3-4b2e-ad18-a0b73c4411be tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:53.514485 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bc653698-4e98-4c02-a810-1b3ee82dc6a1 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:53.515303 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-bc653698-4e98-4c02-a810-1b3ee82dc6a1 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:53.522497 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bc653698-4e98-4c02-a810-1b3ee82dc6a1 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:53.523413 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bc653698-4e98-4c02-a810-1b3ee82dc6a1 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:53.524683 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bc653698-4e98-4c02-a810-1b3ee82dc6a1 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:53.525130 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bc653698-4e98-4c02-a810-1b3ee82dc6a1 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:53.623923 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8121b86e-71f3-4b2e-ad18-a0b73c4411be tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 4516 microversion: 2.1 time: 0.283336 Apr 16 21:10:53.624574 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 563/1203] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:10:53 2022] GET /compute/v2.1/servers/detail => generated 4516 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:53.630633 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-14ee38f9-633e-41cb-8c9b-ced88d7f036c req-27d5d6ab-9594-4b8e-b659-3a69c2761b3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dfc548c-fae5-47a4-bb2e-8a022ebf6c17", "name": "network-vif-unplugged", "status": "completed", "tag": "c0642788-5af8-4722-90dd-d3c3c1a8b4a7"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:10:53.640883 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-14ee38f9-633e-41cb-8c9b-ced88d7f036c req-27d5d6ab-9594-4b8e-b659-3a69c2761b3f service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:53.641333 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-14ee38f9-633e-41cb-8c9b-ced88d7f036c req-27d5d6ab-9594-4b8e-b659-3a69c2761b3f service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:53.655412 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-14ee38f9-633e-41cb-8c9b-ced88d7f036c req-27d5d6ab-9594-4b8e-b659-3a69c2761b3f service nova] Creating event network-vif-unplugged:c0642788-5af8-4722-90dd-d3c3c1a8b4a7 for instance 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 on nch1-master-1 Apr 16 21:10:53.661258 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-14ee38f9-633e-41cb-8c9b-ced88d7f036c req-27d5d6ab-9594-4b8e-b659-3a69c2761b3f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034966 Apr 16 21:10:53.661880 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 564/1204] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:10:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:10:53.667147 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-db1bfb78-dc70-48ad-afb0-013235805e53 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:53.667858 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-db1bfb78-dc70-48ad-afb0-013235805e53 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:53.674558 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-db1bfb78-dc70-48ad-afb0-013235805e53 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:53.675010 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-db1bfb78-dc70-48ad-afb0-013235805e53 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:53.675838 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-db1bfb78-dc70-48ad-afb0-013235805e53 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:53.676322 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-db1bfb78-dc70-48ad-afb0-013235805e53 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:53.819754 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-db1bfb78-dc70-48ad-afb0-013235805e53 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:53.827834 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-db1bfb78-dc70-48ad-afb0-013235805e53 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1479 microversion: 2.1 time: 0.164814 Apr 16 21:10:53.828451 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 565/1205] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:53 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1479 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:53.833850 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4810279f-72f9-4063-afa1-02d3dc4c8aa8 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:53.837665 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4810279f-72f9-4063-afa1-02d3dc4c8aa8 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:53.838447 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4810279f-72f9-4063-afa1-02d3dc4c8aa8 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c'} {{(pid=137409) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:10:53.877350 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-bc653698-4e98-4c02-a810-1b3ee82dc6a1 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1690 microversion: 2.1 time: 0.366783 Apr 16 21:10:53.877934 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 641/1206] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:53 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1690 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:10:53.885701 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-72a1ef3c-0575-4259-9ebc-78e050d46766 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:53.887464 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-72a1ef3c-0575-4259-9ebc-78e050d46766 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:53.893465 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-72a1ef3c-0575-4259-9ebc-78e050d46766 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:53.893929 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-72a1ef3c-0575-4259-9ebc-78e050d46766 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:53.894717 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-72a1ef3c-0575-4259-9ebc-78e050d46766 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:53.895158 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-72a1ef3c-0575-4259-9ebc-78e050d46766 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:53.902441 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4810279f-72f9-4063-afa1-02d3dc4c8aa8 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:53.902902 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4810279f-72f9-4063-afa1-02d3dc4c8aa8 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:53.903723 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4810279f-72f9-4063-afa1-02d3dc4c8aa8 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:53.904204 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4810279f-72f9-4063-afa1-02d3dc4c8aa8 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:53.933767 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.multi_cell_list [None req-4810279f-72f9-4063-afa1-02d3dc4c8aa8 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 16 21:10:53.962444 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4810279f-72f9-4063-afa1-02d3dc4c8aa8 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1009 microversion: 2.1 time: 0.132930 Apr 16 21:10:53.963034 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 566/1207] 10.222.0.20 () {58 vars in 1149 bytes} [Sat Apr 16 21:10:53 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1009 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:53.967557 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9e7a8ef2-5b45-4e9a-be77-6330ad79b54d tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": true, "disk_over_commit": false}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:10:53.970266 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9e7a8ef2-5b45-4e9a-be77-6330ad79b54d tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:53.974751 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9e7a8ef2-5b45-4e9a-be77-6330ad79b54d tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:53.975217 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9e7a8ef2-5b45-4e9a-be77-6330ad79b54d tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:53.976001 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9e7a8ef2-5b45-4e9a-be77-6330ad79b54d tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:53.976474 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9e7a8ef2-5b45-4e9a-be77-6330ad79b54d tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:54.000700 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-9e7a8ef2-5b45-4e9a-be77-6330ad79b54d tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lazy-loading 'flavor' on Instance uuid d971969c-aa4b-4761-a632-23f88b833ec4 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:10:54.014684 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9e7a8ef2-5b45-4e9a-be77-6330ad79b54d tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Going to try to live migrate instance to nch1-master-1 {{(pid=137409) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Apr 16 21:10:54.034363 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-72a1ef3c-0575-4259-9ebc-78e050d46766 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:54.043134 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-72a1ef3c-0575-4259-9ebc-78e050d46766 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:54.058896 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-72a1ef3c-0575-4259-9ebc-78e050d46766 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:54.060031 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-72a1ef3c-0575-4259-9ebc-78e050d46766 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd" status: 200 len: 1646 microversion: 2.25 time: 0.181165 Apr 16 21:10:54.060613 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 642/1208] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:10:53 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd => generated 1646 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:10:54.065583 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-314d4afc-0a22-4a02-a05a-4f97ec8e61ec tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:54.069234 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-314d4afc-0a22-4a02-a05a-4f97ec8e61ec tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:54.074225 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-314d4afc-0a22-4a02-a05a-4f97ec8e61ec tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c'} {{(pid=137408) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:10:54.079398 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-314d4afc-0a22-4a02-a05a-4f97ec8e61ec tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:54.079926 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-314d4afc-0a22-4a02-a05a-4f97ec8e61ec tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:54.080769 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-314d4afc-0a22-4a02-a05a-4f97ec8e61ec tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:54.081207 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-314d4afc-0a22-4a02-a05a-4f97ec8e61ec tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:54.169313 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.multi_cell_list [None req-314d4afc-0a22-4a02-a05a-4f97ec8e61ec tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137408) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 16 21:10:54.233950 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-314d4afc-0a22-4a02-a05a-4f97ec8e61ec tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1009 microversion: 2.1 time: 0.172248 Apr 16 21:10:54.234565 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 643/1209] 10.222.0.20 () {58 vars in 1211 bytes} [Sat Apr 16 21:10:54 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1009 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:54.244977 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-84f2a9a6-9234-41cc-b94c-895fe9abc9c2 req-62f1c401-699b-45bf-95fc-935d54a693e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a60c9986-12b3-4fc4-9bde-7bf7f34f90bd", "tag": "69daf0de-dee8-41ab-85fa-24c0d402ba05"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:10:54.253641 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-84f2a9a6-9234-41cc-b94c-895fe9abc9c2 req-62f1c401-699b-45bf-95fc-935d54a693e2 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:54.254258 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-84f2a9a6-9234-41cc-b94c-895fe9abc9c2 req-62f1c401-699b-45bf-95fc-935d54a693e2 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:54.266151 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-84f2a9a6-9234-41cc-b94c-895fe9abc9c2 req-62f1c401-699b-45bf-95fc-935d54a693e2 service nova] Creating event network-changed:69daf0de-dee8-41ab-85fa-24c0d402ba05 for instance a60c9986-12b3-4fc4-9bde-7bf7f34f90bd on nch2-master-1 Apr 16 21:10:54.272413 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-84f2a9a6-9234-41cc-b94c-895fe9abc9c2 req-62f1c401-699b-45bf-95fc-935d54a693e2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036456 Apr 16 21:10:54.273083 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 644/1210] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:10:54.278555 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-88626fb0-6010-45b2-9e1f-25b370205d59 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:54.279365 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-88626fb0-6010-45b2-9e1f-25b370205d59 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: a1064818-2a5f-42f7-9566-57a10ea5eb57] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:54.294489 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-88626fb0-6010-45b2-9e1f-25b370205d59 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:54.294489 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-88626fb0-6010-45b2-9e1f-25b370205d59 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:54.294489 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-88626fb0-6010-45b2-9e1f-25b370205d59 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:54.294489 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-88626fb0-6010-45b2-9e1f-25b370205d59 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:54.885679 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-88626fb0-6010-45b2-9e1f-25b370205d59 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:54.895022 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-88626fb0-6010-45b2-9e1f-25b370205d59 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/a1064818-2a5f-42f7-9566-57a10ea5eb57" status: 200 len: 1466 microversion: 2.1 time: 0.620703 Apr 16 21:10:54.896696 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 645/1211] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:54 2022] GET /compute/v2.1/servers/a1064818-2a5f-42f7-9566-57a10ea5eb57 => generated 1466 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:54.901923 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6328a50e-3e01-42f1-a9cb-c0ff3df85f8f tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:54.905840 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6328a50e-3e01-42f1-a9cb-c0ff3df85f8f tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:54.907063 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6328a50e-3e01-42f1-a9cb-c0ff3df85f8f tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c'} {{(pid=137408) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:10:54.913345 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6328a50e-3e01-42f1-a9cb-c0ff3df85f8f tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:54.913819 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6328a50e-3e01-42f1-a9cb-c0ff3df85f8f tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:54.914644 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6328a50e-3e01-42f1-a9cb-c0ff3df85f8f tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:54.915344 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6328a50e-3e01-42f1-a9cb-c0ff3df85f8f tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:55.028557 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.multi_cell_list [None req-6328a50e-3e01-42f1-a9cb-c0ff3df85f8f tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137408) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 16 21:10:55.109921 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6328a50e-3e01-42f1-a9cb-c0ff3df85f8f tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1009 microversion: 2.1 time: 0.211910 Apr 16 21:10:55.116054 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 646/1212] 10.222.0.20 () {58 vars in 1195 bytes} [Sat Apr 16 21:10:54 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1009 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:55.120894 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3c444323-2fb5-4465-afaa-e9968e7009e5 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:55.121668 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3c444323-2fb5-4465-afaa-e9968e7009e5 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] [instance: 04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:55.130881 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3c444323-2fb5-4465-afaa-e9968e7009e5 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:55.130881 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3c444323-2fb5-4465-afaa-e9968e7009e5 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:55.133072 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3c444323-2fb5-4465-afaa-e9968e7009e5 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:55.133072 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3c444323-2fb5-4465-afaa-e9968e7009e5 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:55.363710 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3c444323-2fb5-4465-afaa-e9968e7009e5 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db9403ce44e460a8165587ae22f0ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2a21b6df375491fb09fc22109fb4a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:55.371642 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3c444323-2fb5-4465-afaa-e9968e7009e5 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88" status: 200 len: 1467 microversion: 2.1 time: 0.254428 Apr 16 21:10:55.384727 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 647/1213] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:55 2022] GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88 => generated 1467 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:55.389058 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9eafb538-81eb-43cb-b24c-f14902613cb2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:55.389697 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9eafb538-81eb-43cb-b24c-f14902613cb2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:55.400248 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9eafb538-81eb-43cb-b24c-f14902613cb2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:55.400723 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9eafb538-81eb-43cb-b24c-f14902613cb2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:55.401527 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9eafb538-81eb-43cb-b24c-f14902613cb2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:55.402012 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9eafb538-81eb-43cb-b24c-f14902613cb2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:55.598006 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9eafb538-81eb-43cb-b24c-f14902613cb2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:55.609700 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9eafb538-81eb-43cb-b24c-f14902613cb2 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1479 microversion: 2.1 time: 0.233701 Apr 16 21:10:55.610738 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 648/1214] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:55 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1479 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:55.616323 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6031a880-a96a-481f-8777-da0a62d64690 tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:55.617017 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6031a880-a96a-481f-8777-da0a62d64690 tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] [instance: a1064818-2a5f-42f7-9566-57a10ea5eb57] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:55.623706 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6031a880-a96a-481f-8777-da0a62d64690 tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:55.624262 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6031a880-a96a-481f-8777-da0a62d64690 tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:55.625036 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6031a880-a96a-481f-8777-da0a62d64690 tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:55.625495 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6031a880-a96a-481f-8777-da0a62d64690 tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:55.790959 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6031a880-a96a-481f-8777-da0a62d64690 tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/a1064818-2a5f-42f7-9566-57a10ea5eb57" status: 200 len: 1617 microversion: 2.1 time: 0.178539 Apr 16 21:10:55.795235 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 649/1215] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:55 2022] GET /compute/v2.1/servers/a1064818-2a5f-42f7-9566-57a10ea5eb57 => generated 1617 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:55.800555 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-58a2bf64-8cc8-4624-b2ca-4b1c830867b2 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:55.810744 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-58a2bf64-8cc8-4624-b2ca-4b1c830867b2 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:55.820295 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58a2bf64-8cc8-4624-b2ca-4b1c830867b2 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:55.821496 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58a2bf64-8cc8-4624-b2ca-4b1c830867b2 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:55.823143 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58a2bf64-8cc8-4624-b2ca-4b1c830867b2 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:55.823696 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58a2bf64-8cc8-4624-b2ca-4b1c830867b2 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:55.983253 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-58a2bf64-8cc8-4624-b2ca-4b1c830867b2 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:55.994138 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-58a2bf64-8cc8-4624-b2ca-4b1c830867b2 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:55.996271 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-58a2bf64-8cc8-4624-b2ca-4b1c830867b2 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:55.997466 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-58a2bf64-8cc8-4624-b2ca-4b1c830867b2 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd" status: 200 len: 1646 microversion: 2.25 time: 0.201365 Apr 16 21:10:56.000224 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 650/1216] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:10:55 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd => generated 1646 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:10:56.003651 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-774669ff-3758-426f-a4d3-bf53ce050a56 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:56.008452 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-774669ff-3758-426f-a4d3-bf53ce050a56 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:56.008452 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-774669ff-3758-426f-a4d3-bf53ce050a56 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Searching by: {'name': '2014059963', 'deleted': False, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c'} {{(pid=137408) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:10:56.018943 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-774669ff-3758-426f-a4d3-bf53ce050a56 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:56.019599 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-774669ff-3758-426f-a4d3-bf53ce050a56 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:56.020456 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-774669ff-3758-426f-a4d3-bf53ce050a56 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:56.020910 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-774669ff-3758-426f-a4d3-bf53ce050a56 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:56.117322 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.multi_cell_list [None req-774669ff-3758-426f-a4d3-bf53ce050a56 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137408) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 16 21:10:56.196724 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-774669ff-3758-426f-a4d3-bf53ce050a56 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers?name=2014059963" status: 200 len: 346 microversion: 2.1 time: 0.196947 Apr 16 21:10:56.198587 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 651/1217] 10.222.0.20 () {58 vars in 1155 bytes} [Sat Apr 16 21:10:55 2022] GET /compute/v2.1/servers?name=2014059963 => generated 346 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:10:56.203929 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-109f0cb9-3be3-4a5c-85ec-d7eec1645b2b tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb96698e50>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:56.255932 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-109f0cb9-3be3-4a5c-85ec-d7eec1645b2b tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/88bbe9a7-19d2-4102-9634-058b7c590848" status: 200 len: 784 microversion: 2.1 time: 0.057142 Apr 16 21:10:56.256718 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 652/1218] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:10:56 2022] GET /compute/v2.1/images/88bbe9a7-19d2-4102-9634-058b7c590848 => generated 784 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:10:56.276798 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-574c2d5d-56e8-4024-8dbe-9ee56a0ef361 req-d982bd96-0547-46ab-9807-4fac7cd9632a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88", "name": "network-vif-unplugged", "status": "completed", "tag": "b490e936-9731-4964-89b6-ba2e9e7ac544"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:10:56.296492 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-574c2d5d-56e8-4024-8dbe-9ee56a0ef361 req-d982bd96-0547-46ab-9807-4fac7cd9632a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:56.299757 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-574c2d5d-56e8-4024-8dbe-9ee56a0ef361 req-d982bd96-0547-46ab-9807-4fac7cd9632a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:56.315037 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-574c2d5d-56e8-4024-8dbe-9ee56a0ef361 req-d982bd96-0547-46ab-9807-4fac7cd9632a service nova] Creating event network-vif-unplugged:b490e936-9731-4964-89b6-ba2e9e7ac544 for instance 04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88 on nch2-master-1 Apr 16 21:10:56.321065 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-574c2d5d-56e8-4024-8dbe-9ee56a0ef361 req-d982bd96-0547-46ab-9807-4fac7cd9632a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056862 Apr 16 21:10:56.322166 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 653/1219] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:10:56.328488 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6b814682-e7e8-4e65-9369-84087c3c9c5f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-365664244", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["7b856a59-2a62-4edc-b448-430f778c7b2e"]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:10:56.401294 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-6b814682-e7e8-4e65-9369-84087c3c9c5f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] validate_networks() for None {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:10:56.763388 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-6b814682-e7e8-4e65-9369-84087c3c9c5f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:10:56.763836 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-6b814682-e7e8-4e65-9369-84087c3c9c5f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:10:56.764358 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-6b814682-e7e8-4e65-9369-84087c3c9c5f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:10:56.764780 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-6b814682-e7e8-4e65-9369-84087c3c9c5f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:10:56.765269 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-6b814682-e7e8-4e65-9369-84087c3c9c5f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:10:56.777134 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6b814682-e7e8-4e65-9369-84087c3c9c5f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:56.777608 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6b814682-e7e8-4e65-9369-84087c3c9c5f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:56.778432 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6b814682-e7e8-4e65-9369-84087c3c9c5f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:56.778904 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6b814682-e7e8-4e65-9369-84087c3c9c5f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:56.801716 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-6b814682-e7e8-4e65-9369-84087c3c9c5f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Getting quotas for project cd7c434915254744b7a0409ab8e6d33d. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:10:56.807317 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-6b814682-e7e8-4e65-9369-84087c3c9c5f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Getting quotas for user 79f97c1afe5442dc83319237d121c11f and project cd7c434915254744b7a0409ab8e6d33d. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:10:56.821410 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6b814682-e7e8-4e65-9369-84087c3c9c5f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:10:56.824050 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6b814682-e7e8-4e65-9369-84087c3c9c5f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 88a6591a-336d-477a-8a77-d4e30a1bb0bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:10:57.007603 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6b814682-e7e8-4e65-9369-84087c3c9c5f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.684088 Apr 16 21:10:57.008647 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 654/1220] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:10:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:10:57.014404 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3fbf28e5-47ee-46e5-b212-0f1bcb660bf7 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:57.019977 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3fbf28e5-47ee-46e5-b212-0f1bcb660bf7 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:57.020974 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3fbf28e5-47ee-46e5-b212-0f1bcb660bf7 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c'} {{(pid=137408) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:10:57.027585 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3fbf28e5-47ee-46e5-b212-0f1bcb660bf7 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:57.028799 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3fbf28e5-47ee-46e5-b212-0f1bcb660bf7 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:57.028941 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3fbf28e5-47ee-46e5-b212-0f1bcb660bf7 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:57.029351 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3fbf28e5-47ee-46e5-b212-0f1bcb660bf7 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:57.089519 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9e7a8ef2-5b45-4e9a-be77-6330ad79b54d tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4/action" status: 202 len: 0 microversion: 2.1 time: 3.125338 Apr 16 21:10:57.092993 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 567/1221] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:10:53 2022] POST /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4/action => generated 0 bytes in 3127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:10:57.099684 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-54fec5b8-69fa-4383-b6eb-5cdfb58dd4da tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:57.111407 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-54fec5b8-69fa-4383-b6eb-5cdfb58dd4da tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018694 Apr 16 21:10:57.122202 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 568/1222] 10.222.0.20 () {58 vars in 1136 bytes} [Sat Apr 16 21:10:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:10:57.122202 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e72a3073-0485-4ae7-8174-d84a7b050179 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:57.122202 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e72a3073-0485-4ae7-8174-d84a7b050179 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:57.128908 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e72a3073-0485-4ae7-8174-d84a7b050179 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:57.129472 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e72a3073-0485-4ae7-8174-d84a7b050179 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:57.130362 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e72a3073-0485-4ae7-8174-d84a7b050179 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:57.130885 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e72a3073-0485-4ae7-8174-d84a7b050179 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:57.177216 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.multi_cell_list [None req-3fbf28e5-47ee-46e5-b212-0f1bcb660bf7 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=137408) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 16 21:10:57.252843 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3fbf28e5-47ee-46e5-b212-0f1bcb660bf7 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1009 microversion: 2.1 time: 0.243192 Apr 16 21:10:57.259859 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 655/1223] 10.222.0.20 () {58 vars in 1153 bytes} [Sat Apr 16 21:10:57 2022] GET /compute/v2.1/servers?name=-instance => generated 1009 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:57.260698 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a710be75-393d-4ff2-8f56-f3af30176fd1 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:57.261337 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a710be75-393d-4ff2-8f56-f3af30176fd1 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:57.269672 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a710be75-393d-4ff2-8f56-f3af30176fd1 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:57.270135 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a710be75-393d-4ff2-8f56-f3af30176fd1 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:57.271134 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a710be75-393d-4ff2-8f56-f3af30176fd1 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:57.271589 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a710be75-393d-4ff2-8f56-f3af30176fd1 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:57.309958 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e72a3073-0485-4ae7-8174-d84a7b050179 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:57.318764 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e72a3073-0485-4ae7-8174-d84a7b050179 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1479 microversion: 2.1 time: 0.205072 Apr 16 21:10:57.319487 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 569/1224] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:57 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1479 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:57.326095 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bb4fdbc0-41ac-45f3-816d-f493aea68709 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:57.327069 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bb4fdbc0-41ac-45f3-816d-f493aea68709 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 88a6591a-336d-477a-8a77-d4e30a1bb0bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:57.387325 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-bb4fdbc0-41ac-45f3-816d-f493aea68709 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:57.394773 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bb4fdbc0-41ac-45f3-816d-f493aea68709 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf" status: 200 len: 1216 microversion: 2.1 time: 0.073625 Apr 16 21:10:57.395356 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 570/1225] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:57 2022] GET /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf => generated 1216 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:57.399903 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f58132cc-be44-46e6-9a78-77853fcd5b4b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:57.400538 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f58132cc-be44-46e6-9a78-77853fcd5b4b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:57.407478 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f58132cc-be44-46e6-9a78-77853fcd5b4b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:57.407973 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f58132cc-be44-46e6-9a78-77853fcd5b4b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:57.408790 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f58132cc-be44-46e6-9a78-77853fcd5b4b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:57.409236 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f58132cc-be44-46e6-9a78-77853fcd5b4b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:57.434622 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a710be75-393d-4ff2-8f56-f3af30176fd1 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:57.446104 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a710be75-393d-4ff2-8f56-f3af30176fd1 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:57.446629 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a710be75-393d-4ff2-8f56-f3af30176fd1 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:57.447805 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a710be75-393d-4ff2-8f56-f3af30176fd1 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd" status: 200 len: 1646 microversion: 2.25 time: 0.193212 Apr 16 21:10:57.456568 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 656/1226] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:10:57 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd => generated 1646 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:10:57.461329 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a929f89c-475e-4325-ad01-42f9fd35ec72 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb96745940>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:57.550884 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f58132cc-be44-46e6-9a78-77853fcd5b4b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:57.559999 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f58132cc-be44-46e6-9a78-77853fcd5b4b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1549 microversion: 2.1 time: 0.163548 Apr 16 21:10:57.560700 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 571/1227] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:57 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1549 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:57.566089 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-803858ee-aaa6-4de0-a574-a10c1e155b95 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:57.569830 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-803858ee-aaa6-4de0-a574-a10c1e155b95 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:57.570507 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-803858ee-aaa6-4de0-a574-a10c1e155b95 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-201405996', 'deleted': False, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c'} {{(pid=137409) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:10:57.576037 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-803858ee-aaa6-4de0-a574-a10c1e155b95 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:57.576537 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-803858ee-aaa6-4de0-a574-a10c1e155b95 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:57.577350 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-803858ee-aaa6-4de0-a574-a10c1e155b95 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:57.577790 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-803858ee-aaa6-4de0-a574-a10c1e155b95 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:57.664900 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.multi_cell_list [None req-803858ee-aaa6-4de0-a574-a10c1e155b95 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 16 21:10:57.721729 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-803858ee-aaa6-4de0-a574-a10c1e155b95 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-201405996" status: 200 len: 346 microversion: 2.1 time: 0.159814 Apr 16 21:10:57.722333 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 572/1228] 10.222.0.20 () {58 vars in 1227 bytes} [Sat Apr 16 21:10:57 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-201405996 => generated 346 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:10:57.732520 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8772106d-ca0c-4f68-9b11-eacdcb0f4f10 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:57.733016 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8772106d-ca0c-4f68-9b11-eacdcb0f4f10 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 524e8c67-957c-4856-a882-fc0a4befaedd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:57.739205 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8772106d-ca0c-4f68-9b11-eacdcb0f4f10 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:57.739666 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8772106d-ca0c-4f68-9b11-eacdcb0f4f10 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:57.740469 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8772106d-ca0c-4f68-9b11-eacdcb0f4f10 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:57.740917 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8772106d-ca0c-4f68-9b11-eacdcb0f4f10 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:57.765340 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8772106d-ca0c-4f68-9b11-eacdcb0f4f10 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 524e8c67-957c-4856-a882-fc0a4befaedd] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:10:58.377005 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8772106d-ca0c-4f68-9b11-eacdcb0f4f10 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "DELETE /compute/v2.1/servers/524e8c67-957c-4856-a882-fc0a4befaedd" status: 204 len: 0 microversion: 2.1 time: 0.647228 Apr 16 21:10:58.382064 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 573/1229] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:10:57 2022] DELETE /compute/v2.1/servers/524e8c67-957c-4856-a882-fc0a4befaedd => generated 0 bytes in 650 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 16 21:10:58.387761 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-97d5d5a5-e2fb-46de-b796-8089aa998cc8 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:58.388604 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-97d5d5a5-e2fb-46de-b796-8089aa998cc8 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:58.396133 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-97d5d5a5-e2fb-46de-b796-8089aa998cc8 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:58.396873 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-97d5d5a5-e2fb-46de-b796-8089aa998cc8 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:58.397784 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-97d5d5a5-e2fb-46de-b796-8089aa998cc8 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:58.398303 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-97d5d5a5-e2fb-46de-b796-8089aa998cc8 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:58.551383 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-97d5d5a5-e2fb-46de-b796-8089aa998cc8 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:58.559599 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-97d5d5a5-e2fb-46de-b796-8089aa998cc8 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1479 microversion: 2.1 time: 0.175894 Apr 16 21:10:58.560343 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 574/1230] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:58 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1479 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:58.576694 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-63878c7f-cee8-4f17-ba29-7f18588e1ef1 req-a5cc6504-853a-433a-aa65-b17b5a527487 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dfc548c-fae5-47a4-bb2e-8a022ebf6c17", "name": "network-vif-plugged", "status": "completed", "tag": "c0642788-5af8-4722-90dd-d3c3c1a8b4a7"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:10:58.586079 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-63878c7f-cee8-4f17-ba29-7f18588e1ef1 req-a5cc6504-853a-433a-aa65-b17b5a527487 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:58.586592 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-63878c7f-cee8-4f17-ba29-7f18588e1ef1 req-a5cc6504-853a-433a-aa65-b17b5a527487 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:58.605069 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-63878c7f-cee8-4f17-ba29-7f18588e1ef1 req-a5cc6504-853a-433a-aa65-b17b5a527487 service nova] Creating event network-vif-plugged:c0642788-5af8-4722-90dd-d3c3c1a8b4a7 for instance 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 on nch1-master-1 Apr 16 21:10:58.610117 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-63878c7f-cee8-4f17-ba29-7f18588e1ef1 req-a5cc6504-853a-433a-aa65-b17b5a527487 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039320 Apr 16 21:10:58.610749 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 575/1231] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:10:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:10:58.615726 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3e575b22-e740-410a-aeb9-7bae3eb04df7 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:58.616450 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3e575b22-e740-410a-aeb9-7bae3eb04df7 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 524e8c67-957c-4856-a882-fc0a4befaedd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:58.622685 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e575b22-e740-410a-aeb9-7bae3eb04df7 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:58.623142 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e575b22-e740-410a-aeb9-7bae3eb04df7 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:58.623916 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e575b22-e740-410a-aeb9-7bae3eb04df7 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:58.624391 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e575b22-e740-410a-aeb9-7bae3eb04df7 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:58.759723 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3e575b22-e740-410a-aeb9-7bae3eb04df7 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:58.767707 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3e575b22-e740-410a-aeb9-7bae3eb04df7 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/524e8c67-957c-4856-a882-fc0a4befaedd" status: 200 len: 1516 microversion: 2.1 time: 0.155247 Apr 16 21:10:58.768319 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 576/1232] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:58 2022] GET /compute/v2.1/servers/524e8c67-957c-4856-a882-fc0a4befaedd => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:58.772605 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a893b0a4-c688-47b0-b8bf-24a532d022c4 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:58.773214 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a893b0a4-c688-47b0-b8bf-24a532d022c4 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 88a6591a-336d-477a-8a77-d4e30a1bb0bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:58.778668 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a893b0a4-c688-47b0-b8bf-24a532d022c4 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:58.779121 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a893b0a4-c688-47b0-b8bf-24a532d022c4 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:58.779890 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a893b0a4-c688-47b0-b8bf-24a532d022c4 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:58.780378 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a893b0a4-c688-47b0-b8bf-24a532d022c4 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:58.840895 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a893b0a4-c688-47b0-b8bf-24a532d022c4 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:58.848842 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a893b0a4-c688-47b0-b8bf-24a532d022c4 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf" status: 200 len: 1220 microversion: 2.1 time: 0.079547 Apr 16 21:10:58.849407 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 577/1233] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:58 2022] GET /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf => generated 1220 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:58.853997 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-865752e4-5e45-4ec9-83fc-7f20b7ce05d2 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:58.857736 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-865752e4-5e45-4ec9-83fc-7f20b7ce05d2 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:58.864627 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-865752e4-5e45-4ec9-83fc-7f20b7ce05d2 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:58.865087 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-865752e4-5e45-4ec9-83fc-7f20b7ce05d2 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:58.865872 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-865752e4-5e45-4ec9-83fc-7f20b7ce05d2 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:58.866314 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-865752e4-5e45-4ec9-83fc-7f20b7ce05d2 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:58.992263 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-865752e4-5e45-4ec9-83fc-7f20b7ce05d2 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:59.001928 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-865752e4-5e45-4ec9-83fc-7f20b7ce05d2 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:59.004289 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-865752e4-5e45-4ec9-83fc-7f20b7ce05d2 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:59.005508 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-865752e4-5e45-4ec9-83fc-7f20b7ce05d2 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd" status: 200 len: 1646 microversion: 2.25 time: 0.155155 Apr 16 21:10:59.006067 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 578/1234] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:10:58 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd => generated 1646 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:10:59.010518 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c0371997-1337-4af0-8384-55b07165cb5e tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:59.011061 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c0371997-1337-4af0-8384-55b07165cb5e tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:59.019371 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c0371997-1337-4af0-8384-55b07165cb5e tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:59.022381 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c0371997-1337-4af0-8384-55b07165cb5e tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:59.022381 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c0371997-1337-4af0-8384-55b07165cb5e tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:59.022381 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c0371997-1337-4af0-8384-55b07165cb5e tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:59.152420 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c0371997-1337-4af0-8384-55b07165cb5e tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:59.160625 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c0371997-1337-4af0-8384-55b07165cb5e tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1549 microversion: 2.1 time: 0.153269 Apr 16 21:10:59.161513 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 579/1235] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:59 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:59.391566 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1acb3951-19a3-4bc8-a075-2dc4bd1a8be9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Action: 'create', calling method: .version_select at 0x7fbb96f2e9d0>, body: {"keypair": {"name": "tempest-keypair-1429791756"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:10:59.405605 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-1acb3951-19a3-4bc8-a075-2dc4bd1a8be9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Getting quotas for project 2dc15580ef8a449ca359a9d5b799e24d. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:10:59.411475 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-1acb3951-19a3-4bc8-a075-2dc4bd1a8be9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Getting quotas for user 453306648f4e4da58ee344c3a51f8110 and project 2dc15580ef8a449ca359a9d5b799e24d. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:10:59.597458 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a929f89c-475e-4325-ad01-42f9fd35ec72 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "DELETE /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef" status: 204 len: 0 microversion: 2.1 time: 2.139734 Apr 16 21:10:59.598043 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 657/1236] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:57 2022] DELETE /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef => generated 0 bytes in 2141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:10:59.602732 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-10b4cf7a-192e-45bd-baa5-5418fc861162 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:59.603348 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-10b4cf7a-192e-45bd-baa5-5418fc861162 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:59.610058 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-10b4cf7a-192e-45bd-baa5-5418fc861162 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:59.610555 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-10b4cf7a-192e-45bd-baa5-5418fc861162 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:59.611340 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-10b4cf7a-192e-45bd-baa5-5418fc861162 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:59.611791 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-10b4cf7a-192e-45bd-baa5-5418fc861162 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:59.737516 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-1acb3951-19a3-4bc8-a075-2dc4bd1a8be9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Getting quotas for project 2dc15580ef8a449ca359a9d5b799e24d. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:10:59.741689 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-10b4cf7a-192e-45bd-baa5-5418fc861162 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:10:59.743519 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-1acb3951-19a3-4bc8-a075-2dc4bd1a8be9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Getting quotas for user 453306648f4e4da58ee344c3a51f8110 and project 2dc15580ef8a449ca359a9d5b799e24d. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:10:59.750197 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-10b4cf7a-192e-45bd-baa5-5418fc861162 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1479 microversion: 2.1 time: 0.151095 Apr 16 21:10:59.751918 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 658/1237] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:59 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1479 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:10:59.757316 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-68d92a35-fff5-428e-b04c-508c5258b9b9 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb96745670>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:59.769742 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1acb3951-19a3-4bc8-a075-2dc4bd1a8be9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.534542 Apr 16 21:10:59.770449 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 580/1238] 10.222.0.20 () {60 vars in 1157 bytes} [Sat Apr 16 21:10:59 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:10:59.778327 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-68d92a35-fff5-428e-b04c-508c5258b9b9 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] HTTP exception thrown: Image not found. Apr 16 21:10:59.779036 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-68d92a35-fff5-428e-b04c-508c5258b9b9 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Returning 404 to user: Image not found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:10:59.780038 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-68d92a35-fff5-428e-b04c-508c5258b9b9 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef" status: 404 len: 62 microversion: 2.1 time: 0.026724 Apr 16 21:10:59.783968 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 659/1239] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:10:59 2022] GET /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef => generated 62 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:10:59.786586 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bc6c4511-0772-4d60-9810-0ce11eb4f217 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:10:59.786928 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bc6c4511-0772-4d60-9810-0ce11eb4f217 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 524e8c67-957c-4856-a882-fc0a4befaedd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:59.794640 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1fe86509-0b46-4a05-9971-e69c63bc8489 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-418036668"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:10:59.794823 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bc6c4511-0772-4d60-9810-0ce11eb4f217 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:59.795220 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bc6c4511-0772-4d60-9810-0ce11eb4f217 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:59.795735 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1fe86509-0b46-4a05-9971-e69c63bc8489 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] [instance: 04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:10:59.796404 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bc6c4511-0772-4d60-9810-0ce11eb4f217 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:59.796853 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bc6c4511-0772-4d60-9810-0ce11eb4f217 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:59.804487 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1fe86509-0b46-4a05-9971-e69c63bc8489 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:59.804947 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1fe86509-0b46-4a05-9971-e69c63bc8489 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:10:59.805739 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1fe86509-0b46-4a05-9971-e69c63bc8489 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:10:59.806183 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1fe86509-0b46-4a05-9971-e69c63bc8489 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:00.021752 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-bc6c4511-0772-4d60-9810-0ce11eb4f217 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:00.029404 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bc6c4511-0772-4d60-9810-0ce11eb4f217 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/524e8c67-957c-4856-a882-fc0a4befaedd" status: 200 len: 1516 microversion: 2.1 time: 0.247990 Apr 16 21:11:00.029975 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 581/1240] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:10:59 2022] GET /compute/v2.1/servers/524e8c67-957c-4856-a882-fc0a4befaedd => generated 1516 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:11:00.039260 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c3a7706e-c3de-4426-8fa7-2fdfc7546370 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:00.039260 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c3a7706e-c3de-4426-8fa7-2fdfc7546370 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 88a6591a-336d-477a-8a77-d4e30a1bb0bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:00.041568 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c3a7706e-c3de-4426-8fa7-2fdfc7546370 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:00.042032 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c3a7706e-c3de-4426-8fa7-2fdfc7546370 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:00.042841 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c3a7706e-c3de-4426-8fa7-2fdfc7546370 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:00.043270 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c3a7706e-c3de-4426-8fa7-2fdfc7546370 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:00.138073 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c3a7706e-c3de-4426-8fa7-2fdfc7546370 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:00.152295 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c3a7706e-c3de-4426-8fa7-2fdfc7546370 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf" status: 200 len: 1220 microversion: 2.1 time: 0.117768 Apr 16 21:11:00.153584 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 582/1241] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:00 2022] GET /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf => generated 1220 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:00.158373 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b1d3d9a0-c15f-428b-b136-d0a36ec22264 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:00.161201 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b1d3d9a0-c15f-428b-b136-d0a36ec22264 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:00.169514 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b1d3d9a0-c15f-428b-b136-d0a36ec22264 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:00.170355 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b1d3d9a0-c15f-428b-b136-d0a36ec22264 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:00.172525 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b1d3d9a0-c15f-428b-b136-d0a36ec22264 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:00.173825 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b1d3d9a0-c15f-428b-b136-d0a36ec22264 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:00.396440 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b1d3d9a0-c15f-428b-b136-d0a36ec22264 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:00.402885 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b1d3d9a0-c15f-428b-b136-d0a36ec22264 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:00.404733 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b1d3d9a0-c15f-428b-b136-d0a36ec22264 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:00.405908 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b1d3d9a0-c15f-428b-b136-d0a36ec22264 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd" status: 200 len: 1646 microversion: 2.25 time: 0.251203 Apr 16 21:11:00.406469 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 583/1242] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:11:00 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd => generated 1646 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:11:00.412896 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cdc519ac-9f40-4edb-bbdd-f72a4625ba15 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:00.413511 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-cdc519ac-9f40-4edb-bbdd-f72a4625ba15 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:00.419712 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cdc519ac-9f40-4edb-bbdd-f72a4625ba15 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:00.422689 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cdc519ac-9f40-4edb-bbdd-f72a4625ba15 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:00.422689 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cdc519ac-9f40-4edb-bbdd-f72a4625ba15 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:00.422689 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cdc519ac-9f40-4edb-bbdd-f72a4625ba15 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:00.578030 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1fe86509-0b46-4a05-9971-e69c63bc8489 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "POST /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88/action" status: 202 len: 0 microversion: 2.1 time: 0.787833 Apr 16 21:11:00.578682 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 660/1243] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:10:59 2022] POST /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88/action => generated 0 bytes in 789 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 16 21:11:00.588982 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6e2026e1-bfcb-4aba-a6d8-3f416e143417 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb965e7310>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:00.593992 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cdc519ac-9f40-4edb-bbdd-f72a4625ba15 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:00.604220 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cdc519ac-9f40-4edb-bbdd-f72a4625ba15 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1549 microversion: 2.1 time: 0.196666 Apr 16 21:11:00.608486 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 584/1244] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:00 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1549 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:00.638824 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6e2026e1-bfcb-4aba-a6d8-3f416e143417 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430" status: 200 len: 1426 microversion: 2.1 time: 0.053769 Apr 16 21:11:00.639339 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 661/1245] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:11:00 2022] GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430 => generated 1426 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:11:00.769880 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-513efd37-c426-41c8-9226-4879bda31c5f tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:00.770512 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-513efd37-c426-41c8-9226-4879bda31c5f tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:00.777542 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-513efd37-c426-41c8-9226-4879bda31c5f tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:00.778016 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-513efd37-c426-41c8-9226-4879bda31c5f tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:00.778818 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-513efd37-c426-41c8-9226-4879bda31c5f tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:00.779300 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-513efd37-c426-41c8-9226-4879bda31c5f tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:00.779741 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-76e383f4-9e4b-4bb9-a625-424ec6849d15 req-8d7f2c19-990c-44ac-8fb5-ad71f6a24167 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "524e8c67-957c-4856-a882-fc0a4befaedd", "name": "network-vif-deleted", "tag": "afaec7f6-0723-4b6e-9610-7d38f4870889"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:11:00.793667 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-76e383f4-9e4b-4bb9-a625-424ec6849d15 req-8d7f2c19-990c-44ac-8fb5-ad71f6a24167 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:00.794248 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-76e383f4-9e4b-4bb9-a625-424ec6849d15 req-8d7f2c19-990c-44ac-8fb5-ad71f6a24167 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:00.806434 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-76e383f4-9e4b-4bb9-a625-424ec6849d15 req-8d7f2c19-990c-44ac-8fb5-ad71f6a24167 service nova] Creating event network-vif-deleted:afaec7f6-0723-4b6e-9610-7d38f4870889 for instance 524e8c67-957c-4856-a882-fc0a4befaedd on nch1-master-1 Apr 16 21:11:00.811902 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-76e383f4-9e4b-4bb9-a625-424ec6849d15 req-8d7f2c19-990c-44ac-8fb5-ad71f6a24167 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036608 Apr 16 21:11:00.813078 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 662/1246] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:11:00.925141 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-513efd37-c426-41c8-9226-4879bda31c5f tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:00.932883 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-513efd37-c426-41c8-9226-4879bda31c5f tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1479 microversion: 2.1 time: 0.168693 Apr 16 21:11:00.933501 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 585/1247] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:00 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1479 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:01.047287 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3bc36243-120f-47b6-b571-4920da45f320 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:01.048124 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3bc36243-120f-47b6-b571-4920da45f320 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 524e8c67-957c-4856-a882-fc0a4befaedd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:01.054932 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3bc36243-120f-47b6-b571-4920da45f320 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:01.055443 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3bc36243-120f-47b6-b571-4920da45f320 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:01.056363 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3bc36243-120f-47b6-b571-4920da45f320 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:01.056902 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3bc36243-120f-47b6-b571-4920da45f320 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:01.121132 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3bc36243-120f-47b6-b571-4920da45f320 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:01.129659 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3bc36243-120f-47b6-b571-4920da45f320 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/524e8c67-957c-4856-a882-fc0a4befaedd" status: 200 len: 1474 microversion: 2.1 time: 0.087118 Apr 16 21:11:01.130229 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 663/1248] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:01 2022] GET /compute/v2.1/servers/524e8c67-957c-4856-a882-fc0a4befaedd => generated 1474 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:01.169627 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6c2432f0-e185-47a0-8839-2ab88738e39a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:01.170247 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6c2432f0-e185-47a0-8839-2ab88738e39a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 88a6591a-336d-477a-8a77-d4e30a1bb0bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:01.177788 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6c2432f0-e185-47a0-8839-2ab88738e39a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:01.178191 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6c2432f0-e185-47a0-8839-2ab88738e39a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:01.178993 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6c2432f0-e185-47a0-8839-2ab88738e39a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:01.179467 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6c2432f0-e185-47a0-8839-2ab88738e39a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:01.251135 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6c2432f0-e185-47a0-8839-2ab88738e39a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:01.252018 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6c2432f0-e185-47a0-8839-2ab88738e39a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf" status: 200 len: 1268 microversion: 2.1 time: 0.086233 Apr 16 21:11:01.252678 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 586/1249] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:01 2022] GET /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf => generated 1268 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:01.425536 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f6caa6b9-ac74-41c7-87d7-c23c72febf9f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:01.426159 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f6caa6b9-ac74-41c7-87d7-c23c72febf9f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:01.432982 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6caa6b9-ac74-41c7-87d7-c23c72febf9f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:01.433167 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6caa6b9-ac74-41c7-87d7-c23c72febf9f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:01.433923 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6caa6b9-ac74-41c7-87d7-c23c72febf9f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:01.434371 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6caa6b9-ac74-41c7-87d7-c23c72febf9f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:01.582460 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f6caa6b9-ac74-41c7-87d7-c23c72febf9f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:01.591186 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f6caa6b9-ac74-41c7-87d7-c23c72febf9f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:01.592755 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f6caa6b9-ac74-41c7-87d7-c23c72febf9f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:01.594547 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f6caa6b9-ac74-41c7-87d7-c23c72febf9f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd" status: 200 len: 1646 microversion: 2.25 time: 0.172942 Apr 16 21:11:01.594547 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 664/1250] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:11:01 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd => generated 1646 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:11:01.622124 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2aba2c8c-5034-46ec-8cfd-86aff9a8da99 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:01.622748 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2aba2c8c-5034-46ec-8cfd-86aff9a8da99 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:01.629626 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2aba2c8c-5034-46ec-8cfd-86aff9a8da99 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:01.630093 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2aba2c8c-5034-46ec-8cfd-86aff9a8da99 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:01.630883 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2aba2c8c-5034-46ec-8cfd-86aff9a8da99 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:01.631348 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2aba2c8c-5034-46ec-8cfd-86aff9a8da99 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:01.653547 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7a8f8c3b-ad29-4f7e-afd3-bcccf3e76b1c tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb965e71f0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:01.711657 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7a8f8c3b-ad29-4f7e-afd3-bcccf3e76b1c tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430" status: 200 len: 1426 microversion: 2.1 time: 0.063311 Apr 16 21:11:01.712278 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 665/1251] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:11:01 2022] GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430 => generated 1426 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:01.884880 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2aba2c8c-5034-46ec-8cfd-86aff9a8da99 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:01.893804 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2aba2c8c-5034-46ec-8cfd-86aff9a8da99 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1549 microversion: 2.1 time: 0.275578 Apr 16 21:11:01.904399 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 587/1252] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:01 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1549 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:01.950627 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ca8a1f39-4d1f-4c66-8e29-bee3115a2d73 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:01.951169 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ca8a1f39-4d1f-4c66-8e29-bee3115a2d73 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:01.958357 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ca8a1f39-4d1f-4c66-8e29-bee3115a2d73 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:01.959014 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ca8a1f39-4d1f-4c66-8e29-bee3115a2d73 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:01.959903 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ca8a1f39-4d1f-4c66-8e29-bee3115a2d73 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:01.960399 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ca8a1f39-4d1f-4c66-8e29-bee3115a2d73 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:02.093536 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ca8a1f39-4d1f-4c66-8e29-bee3115a2d73 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:02.101089 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ca8a1f39-4d1f-4c66-8e29-bee3115a2d73 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1464 microversion: 2.1 time: 0.154735 Apr 16 21:11:02.101657 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 666/1253] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:01 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1464 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:02.125639 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-70737125-9e89-4471-946f-7eab363c957d tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:11:02.127565 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-70737125-9e89-4471-946f-7eab363c957d tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:02.133915 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-70737125-9e89-4471-946f-7eab363c957d tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:02.134380 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-70737125-9e89-4471-946f-7eab363c957d tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:02.135179 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-70737125-9e89-4471-946f-7eab363c957d tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:02.135625 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-70737125-9e89-4471-946f-7eab363c957d tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:02.146569 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e06dd425-784b-444b-ac73-f26586d6c568 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:02.147189 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e06dd425-784b-444b-ac73-f26586d6c568 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 524e8c67-957c-4856-a882-fc0a4befaedd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:02.153993 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e06dd425-784b-444b-ac73-f26586d6c568 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:02.154513 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e06dd425-784b-444b-ac73-f26586d6c568 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:02.155547 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e06dd425-784b-444b-ac73-f26586d6c568 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:02.156151 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e06dd425-784b-444b-ac73-f26586d6c568 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:02.190743 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e06dd425-784b-444b-ac73-f26586d6c568 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:02.191190 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e06dd425-784b-444b-ac73-f26586d6c568 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:02.191659 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-e06dd425-784b-444b-ac73-f26586d6c568 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lazy-loading 'fault' on Instance uuid 524e8c67-957c-4856-a882-fc0a4befaedd {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:11:02.254782 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e06dd425-784b-444b-ac73-f26586d6c568 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:02.277245 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e06dd425-784b-444b-ac73-f26586d6c568 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/524e8c67-957c-4856-a882-fc0a4befaedd" status: 200 len: 1309 microversion: 2.1 time: 0.134233 Apr 16 21:11:02.289365 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 667/1254] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:02 2022] GET /compute/v2.1/servers/524e8c67-957c-4856-a882-fc0a4befaedd => generated 1309 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:11:02.301825 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a3acd990-63f3-48fd-8c06-9279b2747231 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:02.302384 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a3acd990-63f3-48fd-8c06-9279b2747231 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 18557c2b-2ced-4cbc-998e-978ae82401e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:02.324566 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a3acd990-63f3-48fd-8c06-9279b2747231 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:02.325344 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a3acd990-63f3-48fd-8c06-9279b2747231 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:02.326378 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a3acd990-63f3-48fd-8c06-9279b2747231 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:02.327216 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a3acd990-63f3-48fd-8c06-9279b2747231 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:02.356199 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a3acd990-63f3-48fd-8c06-9279b2747231 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 18557c2b-2ced-4cbc-998e-978ae82401e7] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:11:02.528579 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-70737125-9e89-4471-946f-7eab363c957d tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17/action" status: 202 len: 0 microversion: 2.1 time: 0.406537 Apr 16 21:11:02.534612 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 588/1255] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:11:02 2022] POST /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17/action => generated 0 bytes in 414 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 16 21:11:02.541980 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b92c2017-9652-4c25-9e6c-ffe94d430add tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:02.543085 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b92c2017-9652-4c25-9e6c-ffe94d430add tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 88a6591a-336d-477a-8a77-d4e30a1bb0bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:02.550824 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b92c2017-9652-4c25-9e6c-ffe94d430add tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:02.551366 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b92c2017-9652-4c25-9e6c-ffe94d430add tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:02.552263 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b92c2017-9652-4c25-9e6c-ffe94d430add tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:02.552800 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b92c2017-9652-4c25-9e6c-ffe94d430add tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:02.646161 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b92c2017-9652-4c25-9e6c-ffe94d430add tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:02.655016 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b92c2017-9652-4c25-9e6c-ffe94d430add tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf" status: 200 len: 1274 microversion: 2.1 time: 0.117975 Apr 16 21:11:02.655964 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 589/1256] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:02 2022] GET /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf => generated 1274 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:02.666270 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-854a6e4a-778d-46f2-9226-7549d37421bb tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:02.667376 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-854a6e4a-778d-46f2-9226-7549d37421bb tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:02.673767 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-854a6e4a-778d-46f2-9226-7549d37421bb tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:02.674227 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-854a6e4a-778d-46f2-9226-7549d37421bb tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:02.675012 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-854a6e4a-778d-46f2-9226-7549d37421bb tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:02.680198 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-854a6e4a-778d-46f2-9226-7549d37421bb tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:02.709357 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-854a6e4a-778d-46f2-9226-7549d37421bb tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:02.709739 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-854a6e4a-778d-46f2-9226-7549d37421bb tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:02.710199 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-854a6e4a-778d-46f2-9226-7549d37421bb tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lazy-loading 'fault' on Instance uuid 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:11:02.731614 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a3acd990-63f3-48fd-8c06-9279b2747231 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "DELETE /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7" status: 204 len: 0 microversion: 2.1 time: 0.439608 Apr 16 21:11:02.733547 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 668/1257] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:11:02 2022] DELETE /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:11:02.741816 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b72d3fcd-1d9a-4fb2-aa2d-1eeff553dc01 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:02.742552 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b72d3fcd-1d9a-4fb2-aa2d-1eeff553dc01 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:02.748921 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b72d3fcd-1d9a-4fb2-aa2d-1eeff553dc01 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:02.749711 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b72d3fcd-1d9a-4fb2-aa2d-1eeff553dc01 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:02.750958 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b72d3fcd-1d9a-4fb2-aa2d-1eeff553dc01 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:02.752205 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b72d3fcd-1d9a-4fb2-aa2d-1eeff553dc01 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:02.950781 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b72d3fcd-1d9a-4fb2-aa2d-1eeff553dc01 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:02.960894 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b72d3fcd-1d9a-4fb2-aa2d-1eeff553dc01 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:02.962362 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b72d3fcd-1d9a-4fb2-aa2d-1eeff553dc01 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:02.963563 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b72d3fcd-1d9a-4fb2-aa2d-1eeff553dc01 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd" status: 200 len: 1646 microversion: 2.25 time: 0.228139 Apr 16 21:11:02.964122 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 669/1258] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:11:02 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd => generated 1646 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:11:02.968686 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-76501f00-278f-409a-bf73-addad1b5a7f1 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb96f758b0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:03.012021 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-76501f00-278f-409a-bf73-addad1b5a7f1 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430" status: 200 len: 1426 microversion: 2.1 time: 0.046639 Apr 16 21:11:03.012918 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 670/1259] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:11:02 2022] GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430 => generated 1426 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:03.017727 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8fa29aa1-fbb7-4701-877a-f2c9e6c0c8ad tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:03.018557 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8fa29aa1-fbb7-4701-877a-f2c9e6c0c8ad tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 18557c2b-2ced-4cbc-998e-978ae82401e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:03.024737 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8fa29aa1-fbb7-4701-877a-f2c9e6c0c8ad tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:03.025402 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8fa29aa1-fbb7-4701-877a-f2c9e6c0c8ad tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:03.026381 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8fa29aa1-fbb7-4701-877a-f2c9e6c0c8ad tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:03.026635 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8fa29aa1-fbb7-4701-877a-f2c9e6c0c8ad tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:03.029674 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-854a6e4a-778d-46f2-9226-7549d37421bb tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1598 microversion: 2.1 time: 0.372548 Apr 16 21:11:03.030347 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 590/1260] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:02 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1598 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:03.035594 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-465d493b-55c2-41b1-bc64-5e6416676608 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:03.036440 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-465d493b-55c2-41b1-bc64-5e6416676608 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:03.044399 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-465d493b-55c2-41b1-bc64-5e6416676608 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:03.044980 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-465d493b-55c2-41b1-bc64-5e6416676608 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:03.045847 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-465d493b-55c2-41b1-bc64-5e6416676608 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:03.046558 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-465d493b-55c2-41b1-bc64-5e6416676608 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:03.228532 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8fa29aa1-fbb7-4701-877a-f2c9e6c0c8ad tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7da58ce23242bd947bbd7387b80b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6395bf8972949f8837289679b58d151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:03.237317 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8fa29aa1-fbb7-4701-877a-f2c9e6c0c8ad tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "GET /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7" status: 200 len: 1710 microversion: 2.1 time: 0.223373 Apr 16 21:11:03.237902 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 671/1261] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:03 2022] GET /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7 => generated 1710 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:03.251496 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2dba9851-2372-4598-80d7-64c660b9f92c tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:11:03.252529 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2dba9851-2372-4598-80d7-64c660b9f92c tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:03.259129 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2dba9851-2372-4598-80d7-64c660b9f92c tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:03.259649 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2dba9851-2372-4598-80d7-64c660b9f92c tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:03.260561 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2dba9851-2372-4598-80d7-64c660b9f92c tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:03.261008 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2dba9851-2372-4598-80d7-64c660b9f92c tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:03.302047 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-465d493b-55c2-41b1-bc64-5e6416676608 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:03.310046 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-465d493b-55c2-41b1-bc64-5e6416676608 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1549 microversion: 2.1 time: 0.278722 Apr 16 21:11:03.310734 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 591/1262] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:03 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1549 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:03.315397 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4205b03d-7254-43d3-a50a-e53559d7a665 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:03.316095 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4205b03d-7254-43d3-a50a-e53559d7a665 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 524e8c67-957c-4856-a882-fc0a4befaedd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:03.321938 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4205b03d-7254-43d3-a50a-e53559d7a665 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:03.322475 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4205b03d-7254-43d3-a50a-e53559d7a665 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:03.323339 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4205b03d-7254-43d3-a50a-e53559d7a665 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:03.323868 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4205b03d-7254-43d3-a50a-e53559d7a665 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:03.339319 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-4205b03d-7254-43d3-a50a-e53559d7a665 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] HTTP exception thrown: Instance 524e8c67-957c-4856-a882-fc0a4befaedd could not be found. Apr 16 21:11:03.340159 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4205b03d-7254-43d3-a50a-e53559d7a665 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Returning 404 to user: Instance 524e8c67-957c-4856-a882-fc0a4befaedd could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:11:03.341103 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4205b03d-7254-43d3-a50a-e53559d7a665 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/524e8c67-957c-4856-a882-fc0a4befaedd" status: 404 len: 111 microversion: 2.1 time: 0.029241 Apr 16 21:11:03.341648 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 592/1263] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:03 2022] GET /compute/v2.1/servers/524e8c67-957c-4856-a882-fc0a4befaedd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:11:03.350386 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e53c1987-9113-424d-8ebd-cccae7343a6a tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:03.351181 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e53c1987-9113-424d-8ebd-cccae7343a6a tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 615ea5db-3cca-4736-b69a-cc7bdc8f0e6e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:03.357396 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e53c1987-9113-424d-8ebd-cccae7343a6a tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:03.357861 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e53c1987-9113-424d-8ebd-cccae7343a6a tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:03.358654 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e53c1987-9113-424d-8ebd-cccae7343a6a tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:03.359100 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e53c1987-9113-424d-8ebd-cccae7343a6a tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:03.386604 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e53c1987-9113-424d-8ebd-cccae7343a6a tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 615ea5db-3cca-4736-b69a-cc7bdc8f0e6e] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:11:03.630919 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2dba9851-2372-4598-80d7-64c660b9f92c tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17/action" status: 202 len: 0 microversion: 2.1 time: 0.382885 Apr 16 21:11:03.632265 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 672/1264] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:11:03 2022] POST /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17/action => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:11:03.638084 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f03f95df-66cb-4d44-97cc-ce9ea92a48c9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1086433363", "imageRef": "6ff4c0fd-ec61-491f-a0df-5f4c1c8e5bca", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "a0b7aa02-6b05-448c-853d-2f8d270d1d12"}], "security_groups": [{"name": "tempest-securitygroup--1349053431"}], "key_name": "tempest-keypair-1429791756", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:11:03.746410 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e53c1987-9113-424d-8ebd-cccae7343a6a tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "DELETE /compute/v2.1/servers/615ea5db-3cca-4736-b69a-cc7bdc8f0e6e" status: 204 len: 0 microversion: 2.1 time: 0.398881 Apr 16 21:11:03.747872 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 593/1265] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:11:03 2022] DELETE /compute/v2.1/servers/615ea5db-3cca-4736-b69a-cc7bdc8f0e6e => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 16 21:11:03.755825 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b878e777-362b-4504-a7e9-844ad868e165 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:03.759014 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b878e777-362b-4504-a7e9-844ad868e165 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:03.768840 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-f03f95df-66cb-4d44-97cc-ce9ea92a48c9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] validate_networks() for [('a0b7aa02-6b05-448c-853d-2f8d270d1d12', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:11:03.774522 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b878e777-362b-4504-a7e9-844ad868e165 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:03.775233 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b878e777-362b-4504-a7e9-844ad868e165 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:03.776212 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b878e777-362b-4504-a7e9-844ad868e165 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:03.784564 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b878e777-362b-4504-a7e9-844ad868e165 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:04.079769 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b878e777-362b-4504-a7e9-844ad868e165 tempest-ServersAdminTestJSON-592502469 tempest-ServersAdminTestJSON-592502469-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1615 microversion: 2.1 time: 0.329942 Apr 16 21:11:04.080365 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 594/1266] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:03 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1615 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:04.096460 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7d608fdd-eb22-432b-98da-81c558f3e571 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:04.098016 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7d608fdd-eb22-432b-98da-81c558f3e571 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 88a6591a-336d-477a-8a77-d4e30a1bb0bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:04.107632 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7d608fdd-eb22-432b-98da-81c558f3e571 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:04.108496 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7d608fdd-eb22-432b-98da-81c558f3e571 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:04.110206 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7d608fdd-eb22-432b-98da-81c558f3e571 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:04.111383 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7d608fdd-eb22-432b-98da-81c558f3e571 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:04.239396 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-f03f95df-66cb-4d44-97cc-ce9ea92a48c9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:11:04.240080 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-f03f95df-66cb-4d44-97cc-ce9ea92a48c9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:11:04.240706 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-f03f95df-66cb-4d44-97cc-ce9ea92a48c9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:11:04.241218 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-f03f95df-66cb-4d44-97cc-ce9ea92a48c9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:11:04.241885 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-f03f95df-66cb-4d44-97cc-ce9ea92a48c9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:11:04.253295 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f03f95df-66cb-4d44-97cc-ce9ea92a48c9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:04.253757 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f03f95df-66cb-4d44-97cc-ce9ea92a48c9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:04.254716 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f03f95df-66cb-4d44-97cc-ce9ea92a48c9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:04.258351 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f03f95df-66cb-4d44-97cc-ce9ea92a48c9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:04.272889 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-f03f95df-66cb-4d44-97cc-ce9ea92a48c9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Getting quotas for project 2dc15580ef8a449ca359a9d5b799e24d. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:11:04.278255 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-f03f95df-66cb-4d44-97cc-ce9ea92a48c9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Getting quotas for user 453306648f4e4da58ee344c3a51f8110 and project 2dc15580ef8a449ca359a9d5b799e24d. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:11:04.284554 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7d608fdd-eb22-432b-98da-81c558f3e571 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:04.292797 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f03f95df-66cb-4d44-97cc-ce9ea92a48c9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:11:04.294633 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7d608fdd-eb22-432b-98da-81c558f3e571 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf" status: 200 len: 1316 microversion: 2.1 time: 0.212824 Apr 16 21:11:04.295306 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f03f95df-66cb-4d44-97cc-ce9ea92a48c9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] [instance: cda4f042-eb49-4d90-ad5e-0e2b81dc0ede] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6ff4c0fd-ec61-491f-a0df-5f4c1c8e5bca',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:11:04.295542 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 595/1267] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:04 2022] GET /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf => generated 1316 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:04.311215 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f78fba4d-5078-4aee-aaa1-7dae960face7 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:04.312014 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f78fba4d-5078-4aee-aaa1-7dae960face7 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 615ea5db-3cca-4736-b69a-cc7bdc8f0e6e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:04.318308 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f78fba4d-5078-4aee-aaa1-7dae960face7 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:04.318773 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f78fba4d-5078-4aee-aaa1-7dae960face7 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:04.319590 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f78fba4d-5078-4aee-aaa1-7dae960face7 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:04.320036 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f78fba4d-5078-4aee-aaa1-7dae960face7 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:04.453840 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f03f95df-66cb-4d44-97cc-ce9ea92a48c9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.820306 Apr 16 21:11:04.455157 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 673/1268] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:11:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 822 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:11:04.464791 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1897a30f-92b0-4977-968a-dacfa4a1d692 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:04.465401 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1897a30f-92b0-4977-968a-dacfa4a1d692 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:04.472496 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1897a30f-92b0-4977-968a-dacfa4a1d692 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:04.472684 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1897a30f-92b0-4977-968a-dacfa4a1d692 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:04.473479 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1897a30f-92b0-4977-968a-dacfa4a1d692 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:04.473933 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1897a30f-92b0-4977-968a-dacfa4a1d692 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:04.555605 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f78fba4d-5078-4aee-aaa1-7dae960face7 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:04.566927 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f78fba4d-5078-4aee-aaa1-7dae960face7 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/615ea5db-3cca-4736-b69a-cc7bdc8f0e6e" status: 200 len: 1517 microversion: 2.1 time: 0.258772 Apr 16 21:11:04.567537 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 596/1269] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:04 2022] GET /compute/v2.1/servers/615ea5db-3cca-4736-b69a-cc7bdc8f0e6e => generated 1517 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:04.590518 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-499123b1-38ac-42cb-a915-156ac72b65db tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb96e64ca0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:04.643316 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1897a30f-92b0-4977-968a-dacfa4a1d692 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:04.654511 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-499123b1-38ac-42cb-a915-156ac72b65db tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430" status: 200 len: 1426 microversion: 2.1 time: 0.082770 Apr 16 21:11:04.660960 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 597/1270] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:11:04 2022] GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430 => generated 1426 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:04.667902 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-40cf1988-f57a-4f4d-9f24-9d3b6bcdcf29 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:04.668926 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-40cf1988-f57a-4f4d-9f24-9d3b6bcdcf29 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: de422b8c-d5d0-4730-92c4-f30877d0cf2b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:04.675194 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1897a30f-92b0-4977-968a-dacfa4a1d692 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:04.681894 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1897a30f-92b0-4977-968a-dacfa4a1d692 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:04.691451 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-40cf1988-f57a-4f4d-9f24-9d3b6bcdcf29 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:04.691920 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-40cf1988-f57a-4f4d-9f24-9d3b6bcdcf29 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:04.692750 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-40cf1988-f57a-4f4d-9f24-9d3b6bcdcf29 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:04.693198 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-40cf1988-f57a-4f4d-9f24-9d3b6bcdcf29 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:04.694618 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1897a30f-92b0-4977-968a-dacfa4a1d692 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd" status: 200 len: 1646 microversion: 2.25 time: 0.233463 Apr 16 21:11:04.695440 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 674/1271] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:11:04 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd => generated 1646 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:11:04.707850 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b2c8119f-2f89-478e-87d8-7e913a918e53 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:04.710173 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b2c8119f-2f89-478e-87d8-7e913a918e53 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 18557c2b-2ced-4cbc-998e-978ae82401e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:04.717477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b2c8119f-2f89-478e-87d8-7e913a918e53 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:04.717961 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b2c8119f-2f89-478e-87d8-7e913a918e53 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:04.718775 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b2c8119f-2f89-478e-87d8-7e913a918e53 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:04.719228 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b2c8119f-2f89-478e-87d8-7e913a918e53 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:04.744102 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-40cf1988-f57a-4f4d-9f24-9d3b6bcdcf29 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: de422b8c-d5d0-4730-92c4-f30877d0cf2b] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:11:04.861479 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b2c8119f-2f89-478e-87d8-7e913a918e53 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7da58ce23242bd947bbd7387b80b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6395bf8972949f8837289679b58d151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:04.869652 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b2c8119f-2f89-478e-87d8-7e913a918e53 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "GET /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7" status: 200 len: 1710 microversion: 2.1 time: 0.166131 Apr 16 21:11:04.870242 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 675/1272] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:04 2022] GET /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7 => generated 1710 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:04.874825 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f41ec18f-3a7b-48bb-b1ea-4412947f4abb tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:04.876800 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f41ec18f-3a7b-48bb-b1ea-4412947f4abb tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:04.882925 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f41ec18f-3a7b-48bb-b1ea-4412947f4abb tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:04.883392 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f41ec18f-3a7b-48bb-b1ea-4412947f4abb tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:04.884220 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f41ec18f-3a7b-48bb-b1ea-4412947f4abb tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:04.884654 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f41ec18f-3a7b-48bb-b1ea-4412947f4abb tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:05.022356 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f41ec18f-3a7b-48bb-b1ea-4412947f4abb tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:05.030628 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f41ec18f-3a7b-48bb-b1ea-4412947f4abb tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1549 microversion: 2.1 time: 0.159367 Apr 16 21:11:05.034684 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 676/1273] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:04 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1549 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:05.037177 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c561be68-a31a-4d86-bb01-3fc22495263c tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:05.037758 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c561be68-a31a-4d86-bb01-3fc22495263c tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] [instance: cda4f042-eb49-4d90-ad5e-0e2b81dc0ede] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:05.091404 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c561be68-a31a-4d86-bb01-3fc22495263c tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453306648f4e4da58ee344c3a51f8110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc15580ef8a449ca359a9d5b799e24d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:05.099250 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c561be68-a31a-4d86-bb01-3fc22495263c tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] 10.222.0.20 "GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede" status: 200 len: 1246 microversion: 2.1 time: 0.066859 Apr 16 21:11:05.099874 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 677/1274] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:05 2022] GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede => generated 1246 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:05.136330 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-40cf1988-f57a-4f4d-9f24-9d3b6bcdcf29 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "DELETE /compute/v2.1/servers/de422b8c-d5d0-4730-92c4-f30877d0cf2b" status: 204 len: 0 microversion: 2.1 time: 0.474022 Apr 16 21:11:05.137203 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 598/1275] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:11:04 2022] DELETE /compute/v2.1/servers/de422b8c-d5d0-4730-92c4-f30877d0cf2b => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:11:05.145678 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-617d0ed6-55ae-47b3-a546-9b7d6e35cacc tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:05.146365 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-617d0ed6-55ae-47b3-a546-9b7d6e35cacc tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: de422b8c-d5d0-4730-92c4-f30877d0cf2b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:05.154922 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-617d0ed6-55ae-47b3-a546-9b7d6e35cacc tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:05.155383 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-617d0ed6-55ae-47b3-a546-9b7d6e35cacc tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:05.156193 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-617d0ed6-55ae-47b3-a546-9b7d6e35cacc tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:05.156635 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-617d0ed6-55ae-47b3-a546-9b7d6e35cacc tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:05.249566 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-8cf9d313-2d06-4e95-823a-c5593688e6c4 req-99c6bff0-101b-4841-9ba0-f649265d53c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88a6591a-336d-477a-8a77-d4e30a1bb0bf", "tag": "90f9b920-0d64-4f52-b927-bb557bc71bb3"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:11:05.262053 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-8cf9d313-2d06-4e95-823a-c5593688e6c4 req-99c6bff0-101b-4841-9ba0-f649265d53c0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:05.262695 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-8cf9d313-2d06-4e95-823a-c5593688e6c4 req-99c6bff0-101b-4841-9ba0-f649265d53c0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:05.278282 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-8cf9d313-2d06-4e95-823a-c5593688e6c4 req-99c6bff0-101b-4841-9ba0-f649265d53c0 service nova] Creating event network-changed:90f9b920-0d64-4f52-b927-bb557bc71bb3 for instance 88a6591a-336d-477a-8a77-d4e30a1bb0bf on nch1-master-1 Apr 16 21:11:05.285559 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-8cf9d313-2d06-4e95-823a-c5593688e6c4 req-99c6bff0-101b-4841-9ba0-f649265d53c0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039017 Apr 16 21:11:05.286678 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 599/1276] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:11:05.308158 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-617d0ed6-55ae-47b3-a546-9b7d6e35cacc tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:05.313706 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cb0cae21-c8c4-43e1-af2d-feb50111acae tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:05.314447 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-cb0cae21-c8c4-43e1-af2d-feb50111acae tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 88a6591a-336d-477a-8a77-d4e30a1bb0bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:05.317091 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-617d0ed6-55ae-47b3-a546-9b7d6e35cacc tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/de422b8c-d5d0-4730-92c4-f30877d0cf2b" status: 200 len: 1468 microversion: 2.1 time: 0.175903 Apr 16 21:11:05.317683 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 678/1277] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:05 2022] GET /compute/v2.1/servers/de422b8c-d5d0-4730-92c4-f30877d0cf2b => generated 1468 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:05.320959 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cb0cae21-c8c4-43e1-af2d-feb50111acae tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:05.321586 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cb0cae21-c8c4-43e1-af2d-feb50111acae tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:05.322534 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cb0cae21-c8c4-43e1-af2d-feb50111acae tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:05.323324 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cb0cae21-c8c4-43e1-af2d-feb50111acae tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:05.488350 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cb0cae21-c8c4-43e1-af2d-feb50111acae tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:05.495930 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cb0cae21-c8c4-43e1-af2d-feb50111acae tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf" status: 200 len: 1316 microversion: 2.1 time: 0.186915 Apr 16 21:11:05.496645 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 600/1278] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:05 2022] GET /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf => generated 1316 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:11:05.584798 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bc0d1b6c-0a49-48b4-954c-6b3cffe2954b tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:05.585426 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-bc0d1b6c-0a49-48b4-954c-6b3cffe2954b tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 615ea5db-3cca-4736-b69a-cc7bdc8f0e6e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:05.592108 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bc0d1b6c-0a49-48b4-954c-6b3cffe2954b tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:05.592605 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bc0d1b6c-0a49-48b4-954c-6b3cffe2954b tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:05.593392 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bc0d1b6c-0a49-48b4-954c-6b3cffe2954b tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:05.593836 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bc0d1b6c-0a49-48b4-954c-6b3cffe2954b tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:05.673838 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5a82708a-e356-45f8-bd37-c7c97af6c855 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb96c42a60>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:05.721766 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5a82708a-e356-45f8-bd37-c7c97af6c855 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430" status: 200 len: 1426 microversion: 2.1 time: 0.051859 Apr 16 21:11:05.727515 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 601/1279] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:11:05 2022] GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430 => generated 1426 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:11:05.732401 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-bc0d1b6c-0a49-48b4-954c-6b3cffe2954b tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:05.732544 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-45e77214-103a-4d7d-9924-588380bdd403 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:05.738377 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-45e77214-103a-4d7d-9924-588380bdd403 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:05.739053 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-45e77214-103a-4d7d-9924-588380bdd403 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:05.739503 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-45e77214-103a-4d7d-9924-588380bdd403 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:05.740027 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-bc0d1b6c-0a49-48b4-954c-6b3cffe2954b tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/615ea5db-3cca-4736-b69a-cc7bdc8f0e6e" status: 200 len: 1517 microversion: 2.1 time: 0.159181 Apr 16 21:11:05.740308 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-45e77214-103a-4d7d-9924-588380bdd403 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:05.740843 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 679/1280] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:05 2022] GET /compute/v2.1/servers/615ea5db-3cca-4736-b69a-cc7bdc8f0e6e => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:05.740958 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-45e77214-103a-4d7d-9924-588380bdd403 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:05.869597 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-45e77214-103a-4d7d-9924-588380bdd403 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:05.878330 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-45e77214-103a-4d7d-9924-588380bdd403 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:05.879852 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-45e77214-103a-4d7d-9924-588380bdd403 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:05.881114 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-45e77214-103a-4d7d-9924-588380bdd403 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd" status: 200 len: 1646 microversion: 2.25 time: 0.152484 Apr 16 21:11:05.881674 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 602/1281] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:11:05 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd => generated 1646 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:11:05.888750 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a810bff3-82cc-4887-ae62-c7ea61bb9146 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:05.889377 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a810bff3-82cc-4887-ae62-c7ea61bb9146 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 18557c2b-2ced-4cbc-998e-978ae82401e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:05.895972 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a810bff3-82cc-4887-ae62-c7ea61bb9146 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:05.896471 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a810bff3-82cc-4887-ae62-c7ea61bb9146 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:05.897295 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a810bff3-82cc-4887-ae62-c7ea61bb9146 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:05.897740 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a810bff3-82cc-4887-ae62-c7ea61bb9146 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:06.048301 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9ac969d1-2972-4290-9a9a-a877802bcbdf tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:06.049072 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9ac969d1-2972-4290-9a9a-a877802bcbdf tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:06.055033 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9ac969d1-2972-4290-9a9a-a877802bcbdf tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:06.055492 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9ac969d1-2972-4290-9a9a-a877802bcbdf tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:06.056300 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9ac969d1-2972-4290-9a9a-a877802bcbdf tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:06.056744 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9ac969d1-2972-4290-9a9a-a877802bcbdf tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:06.117575 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a810bff3-82cc-4887-ae62-c7ea61bb9146 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7da58ce23242bd947bbd7387b80b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6395bf8972949f8837289679b58d151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:06.126290 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a810bff3-82cc-4887-ae62-c7ea61bb9146 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "GET /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7" status: 200 len: 1710 microversion: 2.1 time: 0.241278 Apr 16 21:11:06.127052 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 680/1282] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:05 2022] GET /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7 => generated 1710 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:06.131799 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7398c00a-1edc-4788-b82c-9d4f8be763ea tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:06.132459 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7398c00a-1edc-4788-b82c-9d4f8be763ea tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] [instance: cda4f042-eb49-4d90-ad5e-0e2b81dc0ede] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:06.138504 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7398c00a-1edc-4788-b82c-9d4f8be763ea tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:06.139011 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7398c00a-1edc-4788-b82c-9d4f8be763ea tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:06.139838 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7398c00a-1edc-4788-b82c-9d4f8be763ea tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:06.140400 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7398c00a-1edc-4788-b82c-9d4f8be763ea tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:06.210248 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7398c00a-1edc-4788-b82c-9d4f8be763ea tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453306648f4e4da58ee344c3a51f8110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc15580ef8a449ca359a9d5b799e24d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:06.220431 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9ac969d1-2972-4290-9a9a-a877802bcbdf tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:06.224665 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7398c00a-1edc-4788-b82c-9d4f8be763ea tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] 10.222.0.20 "GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede" status: 200 len: 1250 microversion: 2.1 time: 0.096373 Apr 16 21:11:06.225388 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 681/1283] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:06 2022] GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede => generated 1250 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:06.234011 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9ac969d1-2972-4290-9a9a-a877802bcbdf tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1549 microversion: 2.1 time: 0.184355 Apr 16 21:11:06.234011 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 603/1284] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:06 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1549 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:11:06.334421 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0b3a7b5e-6586-4603-ae82-b82736bf0c44 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:06.335137 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0b3a7b5e-6586-4603-ae82-b82736bf0c44 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: de422b8c-d5d0-4730-92c4-f30877d0cf2b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:06.342147 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0b3a7b5e-6586-4603-ae82-b82736bf0c44 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:06.342753 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0b3a7b5e-6586-4603-ae82-b82736bf0c44 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:06.343603 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0b3a7b5e-6586-4603-ae82-b82736bf0c44 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:06.344115 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0b3a7b5e-6586-4603-ae82-b82736bf0c44 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:06.514274 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f6a9402c-73c6-40df-95a4-a41bb54a2a56 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:06.515055 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f6a9402c-73c6-40df-95a4-a41bb54a2a56 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 88a6591a-336d-477a-8a77-d4e30a1bb0bf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:06.521667 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6a9402c-73c6-40df-95a4-a41bb54a2a56 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:06.522184 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6a9402c-73c6-40df-95a4-a41bb54a2a56 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:06.522986 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6a9402c-73c6-40df-95a4-a41bb54a2a56 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:06.523434 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6a9402c-73c6-40df-95a4-a41bb54a2a56 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:06.676303 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0b3a7b5e-6586-4603-ae82-b82736bf0c44 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:06.690037 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0b3a7b5e-6586-4603-ae82-b82736bf0c44 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/de422b8c-d5d0-4730-92c4-f30877d0cf2b" status: 200 len: 1468 microversion: 2.1 time: 0.357122 Apr 16 21:11:06.690922 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 604/1285] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:06 2022] GET /compute/v2.1/servers/de422b8c-d5d0-4730-92c4-f30877d0cf2b => generated 1468 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:06.735734 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f579d9e8-feeb-44d5-8c57-fe384be2f1b9 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb96f2e9d0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:06.788308 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f6a9402c-73c6-40df-95a4-a41bb54a2a56 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:06.799833 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f6a9402c-73c6-40df-95a4-a41bb54a2a56 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf" status: 200 len: 1316 microversion: 2.1 time: 0.289610 Apr 16 21:11:06.812351 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 682/1286] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:06 2022] GET /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf => generated 1316 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:11:06.818800 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f579d9e8-feeb-44d5-8c57-fe384be2f1b9 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430" status: 200 len: 1426 microversion: 2.1 time: 0.087169 Apr 16 21:11:06.821247 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 605/1287] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:11:06 2022] GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430 => generated 1426 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:06.827135 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-da564da5-a4b1-42c7-ac62-84537e8b7722 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:06.827135 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-da564da5-a4b1-42c7-ac62-84537e8b7722 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 615ea5db-3cca-4736-b69a-cc7bdc8f0e6e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:06.830458 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-da564da5-a4b1-42c7-ac62-84537e8b7722 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:06.831441 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-da564da5-a4b1-42c7-ac62-84537e8b7722 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:06.832388 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-da564da5-a4b1-42c7-ac62-84537e8b7722 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:06.832940 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-da564da5-a4b1-42c7-ac62-84537e8b7722 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:06.899869 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ffd93246-c513-4559-8654-c60339910434 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:06.900573 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ffd93246-c513-4559-8654-c60339910434 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:06.909136 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ffd93246-c513-4559-8654-c60339910434 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:06.912784 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ffd93246-c513-4559-8654-c60339910434 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:06.913877 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ffd93246-c513-4559-8654-c60339910434 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:06.914421 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ffd93246-c513-4559-8654-c60339910434 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:07.086279 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-da564da5-a4b1-42c7-ac62-84537e8b7722 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:07.097154 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-da564da5-a4b1-42c7-ac62-84537e8b7722 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/615ea5db-3cca-4736-b69a-cc7bdc8f0e6e" status: 200 len: 1517 microversion: 2.1 time: 0.281257 Apr 16 21:11:07.109981 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 683/1288] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:06 2022] GET /compute/v2.1/servers/615ea5db-3cca-4736-b69a-cc7bdc8f0e6e => generated 1517 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:07.115418 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-d2b9c1b1-6387-4d9c-9a13-92251d864f3a req-d807fab9-0ac5-4cfd-a4a7-5ffeaa7d7088 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18557c2b-2ced-4cbc-998e-978ae82401e7", "name": "network-vif-deleted", "tag": "e6de744b-54d0-45c6-a666-8fc2c4a831b1"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:11:07.125534 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-d2b9c1b1-6387-4d9c-9a13-92251d864f3a req-d807fab9-0ac5-4cfd-a4a7-5ffeaa7d7088 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:07.126936 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-d2b9c1b1-6387-4d9c-9a13-92251d864f3a req-d807fab9-0ac5-4cfd-a4a7-5ffeaa7d7088 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:07.142641 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-d2b9c1b1-6387-4d9c-9a13-92251d864f3a req-d807fab9-0ac5-4cfd-a4a7-5ffeaa7d7088 service nova] Creating event network-vif-deleted:e6de744b-54d0-45c6-a666-8fc2c4a831b1 for instance 18557c2b-2ced-4cbc-998e-978ae82401e7 on nch2-master-1 Apr 16 21:11:07.149526 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-d2b9c1b1-6387-4d9c-9a13-92251d864f3a req-d807fab9-0ac5-4cfd-a4a7-5ffeaa7d7088 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037728 Apr 16 21:11:07.151487 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 684/1289] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:11:07.158024 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-25c77d02-d8f5-4747-a589-b8fb217dca59 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:07.159541 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-25c77d02-d8f5-4747-a589-b8fb217dca59 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 18557c2b-2ced-4cbc-998e-978ae82401e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:07.168134 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-25c77d02-d8f5-4747-a589-b8fb217dca59 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:07.169081 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-25c77d02-d8f5-4747-a589-b8fb217dca59 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:07.170503 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-25c77d02-d8f5-4747-a589-b8fb217dca59 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:07.171456 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-25c77d02-d8f5-4747-a589-b8fb217dca59 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:07.249223 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-25c77d02-d8f5-4747-a589-b8fb217dca59 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7da58ce23242bd947bbd7387b80b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6395bf8972949f8837289679b58d151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:07.259023 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-25c77d02-d8f5-4747-a589-b8fb217dca59 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "GET /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7" status: 200 len: 1642 microversion: 2.1 time: 0.105957 Apr 16 21:11:07.259964 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 685/1290] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:07 2022] GET /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7 => generated 1642 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:07.264608 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0284a825-dad1-426d-8ee1-ae043f7d34b6 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:07.265321 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0284a825-dad1-426d-8ee1-ae043f7d34b6 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] [instance: cda4f042-eb49-4d90-ad5e-0e2b81dc0ede] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:07.272307 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0284a825-dad1-426d-8ee1-ae043f7d34b6 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:07.272867 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0284a825-dad1-426d-8ee1-ae043f7d34b6 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:07.273752 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0284a825-dad1-426d-8ee1-ae043f7d34b6 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:07.274260 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0284a825-dad1-426d-8ee1-ae043f7d34b6 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:07.352021 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0284a825-dad1-426d-8ee1-ae043f7d34b6 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453306648f4e4da58ee344c3a51f8110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc15580ef8a449ca359a9d5b799e24d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:07.367598 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0284a825-dad1-426d-8ee1-ae043f7d34b6 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] 10.222.0.20 "GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede" status: 200 len: 1298 microversion: 2.1 time: 0.106639 Apr 16 21:11:07.368641 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 686/1291] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:07 2022] GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede => generated 1298 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:07.373596 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4eb8d01e-20cd-4214-bc5b-1d477b5f23df tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:07.374358 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4eb8d01e-20cd-4214-bc5b-1d477b5f23df tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:07.381534 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4eb8d01e-20cd-4214-bc5b-1d477b5f23df tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:07.382116 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4eb8d01e-20cd-4214-bc5b-1d477b5f23df tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:07.383181 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4eb8d01e-20cd-4214-bc5b-1d477b5f23df tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:07.383747 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4eb8d01e-20cd-4214-bc5b-1d477b5f23df tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:07.596325 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4eb8d01e-20cd-4214-bc5b-1d477b5f23df tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:07.604503 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4eb8d01e-20cd-4214-bc5b-1d477b5f23df tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1549 microversion: 2.1 time: 0.234672 Apr 16 21:11:07.605292 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 687/1292] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:07 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1549 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:07.708435 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f850a922-508d-49ec-8a75-ca360e778025 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:07.709061 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f850a922-508d-49ec-8a75-ca360e778025 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: de422b8c-d5d0-4730-92c4-f30877d0cf2b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:07.715252 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f850a922-508d-49ec-8a75-ca360e778025 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:07.715643 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f850a922-508d-49ec-8a75-ca360e778025 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:07.716481 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f850a922-508d-49ec-8a75-ca360e778025 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:07.717050 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f850a922-508d-49ec-8a75-ca360e778025 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:07.855418 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ffd93246-c513-4559-8654-c60339910434 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:07.868064 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ffd93246-c513-4559-8654-c60339910434 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:07.870195 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ffd93246-c513-4559-8654-c60339910434 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:07.871630 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ffd93246-c513-4559-8654-c60339910434 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd" status: 200 len: 1646 microversion: 2.25 time: 0.976684 Apr 16 21:11:07.883505 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 606/1293] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:11:06 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd => generated 1646 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:11:07.888939 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-28eeb14e-02f2-4f5d-a009-a77e7913e43b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:07.889919 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-28eeb14e-02f2-4f5d-a009-a77e7913e43b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 88a6591a-336d-477a-8a77-d4e30a1bb0bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:07.897030 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-28eeb14e-02f2-4f5d-a009-a77e7913e43b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:07.897788 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-28eeb14e-02f2-4f5d-a009-a77e7913e43b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:07.902208 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-28eeb14e-02f2-4f5d-a009-a77e7913e43b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:07.902208 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-28eeb14e-02f2-4f5d-a009-a77e7913e43b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:07.904774 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f850a922-508d-49ec-8a75-ca360e778025 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:07.921705 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f850a922-508d-49ec-8a75-ca360e778025 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/de422b8c-d5d0-4730-92c4-f30877d0cf2b" status: 200 len: 1468 microversion: 2.1 time: 0.217834 Apr 16 21:11:07.931093 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 688/1294] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:07 2022] GET /compute/v2.1/servers/de422b8c-d5d0-4730-92c4-f30877d0cf2b => generated 1468 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:11:07.931093 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-25ddd691-e487-49a9-8023-e1d0951a6041 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb96bea310>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:08.003834 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-25ddd691-e487-49a9-8023-e1d0951a6041 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430" status: 200 len: 1426 microversion: 2.1 time: 0.080097 Apr 16 21:11:08.004669 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 689/1295] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:11:07 2022] GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430 => generated 1426 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:08.114922 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-19f94391-1f89-42de-84b5-3d22a7dbf373 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:08.118541 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-19f94391-1f89-42de-84b5-3d22a7dbf373 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 615ea5db-3cca-4736-b69a-cc7bdc8f0e6e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:08.123863 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-19f94391-1f89-42de-84b5-3d22a7dbf373 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:08.124381 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-19f94391-1f89-42de-84b5-3d22a7dbf373 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:08.125544 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-19f94391-1f89-42de-84b5-3d22a7dbf373 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:08.126175 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-19f94391-1f89-42de-84b5-3d22a7dbf373 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:08.385742 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-28eeb14e-02f2-4f5d-a009-a77e7913e43b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:08.393606 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-28eeb14e-02f2-4f5d-a009-a77e7913e43b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf" status: 200 len: 1316 microversion: 2.1 time: 0.505890 Apr 16 21:11:08.394225 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 607/1296] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:07 2022] GET /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf => generated 1316 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:08.407086 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f8dce173-6daf-4284-915b-ee938f6f537d tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:08.408409 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f8dce173-6daf-4284-915b-ee938f6f537d tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 18557c2b-2ced-4cbc-998e-978ae82401e7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:08.420458 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f8dce173-6daf-4284-915b-ee938f6f537d tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:08.420918 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f8dce173-6daf-4284-915b-ee938f6f537d tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:08.421708 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f8dce173-6daf-4284-915b-ee938f6f537d tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:08.434704 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f8dce173-6daf-4284-915b-ee938f6f537d tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:08.475803 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-19f94391-1f89-42de-84b5-3d22a7dbf373 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:08.487525 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-19f94391-1f89-42de-84b5-3d22a7dbf373 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/615ea5db-3cca-4736-b69a-cc7bdc8f0e6e" status: 200 len: 1517 microversion: 2.1 time: 0.376121 Apr 16 21:11:08.498760 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 690/1297] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:08 2022] GET /compute/v2.1/servers/615ea5db-3cca-4736-b69a-cc7bdc8f0e6e => generated 1517 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:08.505186 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ba594570-4e11-4f39-bcba-90cf4872fef5 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:08.505807 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ba594570-4e11-4f39-bcba-90cf4872fef5 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] [instance: cda4f042-eb49-4d90-ad5e-0e2b81dc0ede] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:08.508077 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f8dce173-6daf-4284-915b-ee938f6f537d tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:08.508785 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f8dce173-6daf-4284-915b-ee938f6f537d tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:08.509454 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-f8dce173-6daf-4284-915b-ee938f6f537d tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lazy-loading 'fault' on Instance uuid 18557c2b-2ced-4cbc-998e-978ae82401e7 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:11:08.526399 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ba594570-4e11-4f39-bcba-90cf4872fef5 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:08.526929 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ba594570-4e11-4f39-bcba-90cf4872fef5 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:08.527746 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ba594570-4e11-4f39-bcba-90cf4872fef5 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:08.528399 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ba594570-4e11-4f39-bcba-90cf4872fef5 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:08.596290 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f8dce173-6daf-4284-915b-ee938f6f537d tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa7da58ce23242bd947bbd7387b80b8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6395bf8972949f8837289679b58d151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:08.641668 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f8dce173-6daf-4284-915b-ee938f6f537d tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "GET /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7" status: 200 len: 1350 microversion: 2.1 time: 0.246167 Apr 16 21:11:08.651163 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 608/1298] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:08 2022] GET /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7 => generated 1350 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:08.664862 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ba594570-4e11-4f39-bcba-90cf4872fef5 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453306648f4e4da58ee344c3a51f8110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc15580ef8a449ca359a9d5b799e24d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:08.678767 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-35d12357-318b-411a-8bd5-40783ff18947 req-3d27118c-8158-48ed-9dff-67d5bdd5ec9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "615ea5db-3cca-4736-b69a-cc7bdc8f0e6e", "name": "network-vif-deleted", "tag": "f83d9a73-0d97-45bc-8f40-3dbeed933e20"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:11:08.694548 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ba594570-4e11-4f39-bcba-90cf4872fef5 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] 10.222.0.20 "GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede" status: 200 len: 1304 microversion: 2.1 time: 0.180922 Apr 16 21:11:08.694548 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 691/1299] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:08 2022] GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede => generated 1304 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:08.699623 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4ab66927-d9bb-4aad-b9c3-e73fab562601 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:08.700527 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4ab66927-d9bb-4aad-b9c3-e73fab562601 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:08.707768 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4ab66927-d9bb-4aad-b9c3-e73fab562601 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:08.709009 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4ab66927-d9bb-4aad-b9c3-e73fab562601 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:08.710367 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4ab66927-d9bb-4aad-b9c3-e73fab562601 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:08.711012 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4ab66927-d9bb-4aad-b9c3-e73fab562601 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:08.732878 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-35d12357-318b-411a-8bd5-40783ff18947 req-3d27118c-8158-48ed-9dff-67d5bdd5ec9a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:08.741445 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-35d12357-318b-411a-8bd5-40783ff18947 req-3d27118c-8158-48ed-9dff-67d5bdd5ec9a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:08.783004 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-35d12357-318b-411a-8bd5-40783ff18947 req-3d27118c-8158-48ed-9dff-67d5bdd5ec9a service nova] Creating event network-vif-deleted:f83d9a73-0d97-45bc-8f40-3dbeed933e20 for instance 615ea5db-3cca-4736-b69a-cc7bdc8f0e6e on nch2-master-1 Apr 16 21:11:08.803105 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-35d12357-318b-411a-8bd5-40783ff18947 req-3d27118c-8158-48ed-9dff-67d5bdd5ec9a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145643 Apr 16 21:11:08.807573 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 609/1300] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:11:08.894165 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-06c98994-2e56-4398-9e72-b9788fd087bd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:08.896125 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-06c98994-2e56-4398-9e72-b9788fd087bd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:08.912402 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-06c98994-2e56-4398-9e72-b9788fd087bd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:08.915046 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-06c98994-2e56-4398-9e72-b9788fd087bd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:08.917492 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-06c98994-2e56-4398-9e72-b9788fd087bd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:08.920898 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-06c98994-2e56-4398-9e72-b9788fd087bd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:09.459517 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4ab66927-d9bb-4aad-b9c3-e73fab562601 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:09.472159 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4ab66927-d9bb-4aad-b9c3-e73fab562601 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1549 microversion: 2.1 time: 0.784620 Apr 16 21:11:09.475169 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 692/1301] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:08 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1549 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:09.480999 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-182a0869-d396-4fdc-b154-4be4a271b731 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:09.481823 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-182a0869-d396-4fdc-b154-4be4a271b731 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: de422b8c-d5d0-4730-92c4-f30877d0cf2b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:09.499987 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-182a0869-d396-4fdc-b154-4be4a271b731 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:09.503719 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-182a0869-d396-4fdc-b154-4be4a271b731 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:09.507023 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-182a0869-d396-4fdc-b154-4be4a271b731 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:09.507874 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-182a0869-d396-4fdc-b154-4be4a271b731 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:09.576589 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-06c98994-2e56-4398-9e72-b9788fd087bd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:09.613612 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-06c98994-2e56-4398-9e72-b9788fd087bd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:09.615660 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-06c98994-2e56-4398-9e72-b9788fd087bd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:09.621732 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-06c98994-2e56-4398-9e72-b9788fd087bd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd" status: 200 len: 1636 microversion: 2.25 time: 0.734401 Apr 16 21:11:09.622755 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 610/1302] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:11:08 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd => generated 1636 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:11:09.638712 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d79d7135-b49a-4df4-9584-c617dbcfa8b8 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb96e64d30>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:09.653283 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-182a0869-d396-4fdc-b154-4be4a271b731 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:09.667257 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-182a0869-d396-4fdc-b154-4be4a271b731 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/de422b8c-d5d0-4730-92c4-f30877d0cf2b" status: 200 len: 1426 microversion: 2.1 time: 0.186366 Apr 16 21:11:09.668395 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 693/1303] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:09 2022] GET /compute/v2.1/servers/de422b8c-d5d0-4730-92c4-f30877d0cf2b => generated 1426 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:09.692526 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d79d7135-b49a-4df4-9584-c617dbcfa8b8 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430" status: 200 len: 1426 microversion: 2.1 time: 0.067211 Apr 16 21:11:09.693569 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 611/1304] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:11:09 2022] GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430 => generated 1426 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:09.698594 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c855f3fb-67da-4768-8540-a316e2e555fb tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:09.701701 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c855f3fb-67da-4768-8540-a316e2e555fb tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 88a6591a-336d-477a-8a77-d4e30a1bb0bf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:09.703173 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6fb64665-56ab-40b5-be1e-b803ab0f98d5 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:09.704327 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6fb64665-56ab-40b5-be1e-b803ab0f98d5 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 615ea5db-3cca-4736-b69a-cc7bdc8f0e6e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:09.714378 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c855f3fb-67da-4768-8540-a316e2e555fb tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:09.714791 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c855f3fb-67da-4768-8540-a316e2e555fb tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:09.715515 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6fb64665-56ab-40b5-be1e-b803ab0f98d5 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:09.715681 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c855f3fb-67da-4768-8540-a316e2e555fb tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:09.716233 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6fb64665-56ab-40b5-be1e-b803ab0f98d5 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:09.716637 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c855f3fb-67da-4768-8540-a316e2e555fb tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:09.724586 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6fb64665-56ab-40b5-be1e-b803ab0f98d5 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:09.725084 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6fb64665-56ab-40b5-be1e-b803ab0f98d5 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:09.777398 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6fb64665-56ab-40b5-be1e-b803ab0f98d5 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:09.777767 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6fb64665-56ab-40b5-be1e-b803ab0f98d5 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:09.778230 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-6fb64665-56ab-40b5-be1e-b803ab0f98d5 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lazy-loading 'fault' on Instance uuid 615ea5db-3cca-4736-b69a-cc7bdc8f0e6e {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:11:09.850127 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6fb64665-56ab-40b5-be1e-b803ab0f98d5 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:09.859739 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6fb64665-56ab-40b5-be1e-b803ab0f98d5 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/615ea5db-3cca-4736-b69a-cc7bdc8f0e6e" status: 200 len: 1310 microversion: 2.1 time: 0.164989 Apr 16 21:11:09.862668 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 612/1305] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:09 2022] GET /compute/v2.1/servers/615ea5db-3cca-4736-b69a-cc7bdc8f0e6e => generated 1310 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:09.870025 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-970a2f55-83c1-43f1-a0a2-4f2b413a4004 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Calling method '.version_select at 0x7fbb965881f0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:09.881659 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-970a2f55-83c1-43f1-a0a2-4f2b413a4004 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:09.882221 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-970a2f55-83c1-43f1-a0a2-4f2b413a4004 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:09.894275 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-970a2f55-83c1-43f1-a0a2-4f2b413a4004 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 3023 microversion: 2.25 time: 0.030505 Apr 16 21:11:09.896211 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 613/1306] 10.222.0.20 () {60 vars in 1183 bytes} [Sat Apr 16 21:11:09 2022] GET /compute/v2.1/os-migrations => generated 3023 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:11:09.902635 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4f938841-4874-4447-9743-176d49e78080 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:09.902635 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4f938841-4874-4447-9743-176d49e78080 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 18557c2b-2ced-4cbc-998e-978ae82401e7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:09.908155 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4f938841-4874-4447-9743-176d49e78080 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:09.909363 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4f938841-4874-4447-9743-176d49e78080 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:09.910905 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4f938841-4874-4447-9743-176d49e78080 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:09.911668 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4f938841-4874-4447-9743-176d49e78080 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:09.931877 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-4f938841-4874-4447-9743-176d49e78080 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] HTTP exception thrown: Instance 18557c2b-2ced-4cbc-998e-978ae82401e7 could not be found. Apr 16 21:11:09.937047 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4f938841-4874-4447-9743-176d49e78080 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Returning 404 to user: Instance 18557c2b-2ced-4cbc-998e-978ae82401e7 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:11:09.939891 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4f938841-4874-4447-9743-176d49e78080 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "GET /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7" status: 404 len: 111 microversion: 2.1 time: 0.041215 Apr 16 21:11:09.940961 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 614/1307] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:09 2022] GET /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:11:09.945902 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e9263c68-f023-4a34-b641-81d0b5121f4e tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:09.946720 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e9263c68-f023-4a34-b641-81d0b5121f4e tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] [instance: cda4f042-eb49-4d90-ad5e-0e2b81dc0ede] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:09.954613 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e9263c68-f023-4a34-b641-81d0b5121f4e tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:09.955331 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e9263c68-f023-4a34-b641-81d0b5121f4e tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:09.956332 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e9263c68-f023-4a34-b641-81d0b5121f4e tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:09.956956 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e9263c68-f023-4a34-b641-81d0b5121f4e tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:10.082492 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c855f3fb-67da-4768-8540-a316e2e555fb tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:10.094121 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c855f3fb-67da-4768-8540-a316e2e555fb tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf" status: 200 len: 1316 microversion: 2.1 time: 0.414537 Apr 16 21:11:10.095983 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 694/1308] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:09 2022] GET /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf => generated 1316 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:10.123591 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c6fa7e89-8638-4599-870a-2df4c2e82ef1 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:10.124653 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c6fa7e89-8638-4599-870a-2df4c2e82ef1 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:10.138387 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c6fa7e89-8638-4599-870a-2df4c2e82ef1 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:10.142596 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c6fa7e89-8638-4599-870a-2df4c2e82ef1 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:10.144318 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c6fa7e89-8638-4599-870a-2df4c2e82ef1 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:10.149008 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c6fa7e89-8638-4599-870a-2df4c2e82ef1 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:10.231501 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e9263c68-f023-4a34-b641-81d0b5121f4e tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453306648f4e4da58ee344c3a51f8110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc15580ef8a449ca359a9d5b799e24d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:10.241159 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e9263c68-f023-4a34-b641-81d0b5121f4e tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] 10.222.0.20 "GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede" status: 200 len: 1372 microversion: 2.1 time: 0.298922 Apr 16 21:11:10.242794 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 615/1309] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:09 2022] GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede => generated 1372 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:10.247665 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d2bd1a9a-7c71-472c-a0b1-4f2b442b7e2e tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:10.251843 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d2bd1a9a-7c71-472c-a0b1-4f2b442b7e2e tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 8d5cf7af-51b8-4392-a551-9d0d9b96a45d] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:10.261251 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d2bd1a9a-7c71-472c-a0b1-4f2b442b7e2e tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:10.261995 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d2bd1a9a-7c71-472c-a0b1-4f2b442b7e2e tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:10.271596 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d2bd1a9a-7c71-472c-a0b1-4f2b442b7e2e tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:10.272309 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d2bd1a9a-7c71-472c-a0b1-4f2b442b7e2e tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:10.293169 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-d2bd1a9a-7c71-472c-a0b1-4f2b442b7e2e tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] HTTP exception thrown: Instance 8d5cf7af-51b8-4392-a551-9d0d9b96a45d could not be found. Apr 16 21:11:10.293781 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d2bd1a9a-7c71-472c-a0b1-4f2b442b7e2e tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Returning 404 to user: Instance 8d5cf7af-51b8-4392-a551-9d0d9b96a45d could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:11:10.294800 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d2bd1a9a-7c71-472c-a0b1-4f2b442b7e2e tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8d5cf7af-51b8-4392-a551-9d0d9b96a45d" status: 404 len: 111 microversion: 2.1 time: 0.050940 Apr 16 21:11:10.299017 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 616/1310] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:11:10 2022] DELETE /compute/v2.1/servers/8d5cf7af-51b8-4392-a551-9d0d9b96a45d => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:11:10.300962 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-b328bb6f-3b4b-403b-82b4-596caa9330b5 req-88be92f6-cb8f-4873-a239-1593b580c242 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88", "name": "network-vif-plugged", "status": "completed", "tag": "b490e936-9731-4964-89b6-ba2e9e7ac544"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:11:10.310026 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-b328bb6f-3b4b-403b-82b4-596caa9330b5 req-88be92f6-cb8f-4873-a239-1593b580c242 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:10.310482 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-b328bb6f-3b4b-403b-82b4-596caa9330b5 req-88be92f6-cb8f-4873-a239-1593b580c242 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:10.326015 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-b328bb6f-3b4b-403b-82b4-596caa9330b5 req-88be92f6-cb8f-4873-a239-1593b580c242 service nova] Creating event network-vif-plugged:b490e936-9731-4964-89b6-ba2e9e7ac544 for instance 04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88 on nch2-master-1 Apr 16 21:11:10.332049 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-b328bb6f-3b4b-403b-82b4-596caa9330b5 req-88be92f6-cb8f-4873-a239-1593b580c242 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035278 Apr 16 21:11:10.333087 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 617/1311] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:11:10.339678 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6cb8dbf4-502d-42a4-99f7-b0fbdd3e1694 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:10.340715 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6cb8dbf4-502d-42a4-99f7-b0fbdd3e1694 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 8d5cf7af-51b8-4392-a551-9d0d9b96a45d] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:10.359431 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6cb8dbf4-502d-42a4-99f7-b0fbdd3e1694 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:10.359893 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6cb8dbf4-502d-42a4-99f7-b0fbdd3e1694 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:10.361443 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6cb8dbf4-502d-42a4-99f7-b0fbdd3e1694 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:10.362054 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6cb8dbf4-502d-42a4-99f7-b0fbdd3e1694 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:10.391456 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-6cb8dbf4-502d-42a4-99f7-b0fbdd3e1694 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] HTTP exception thrown: Instance 8d5cf7af-51b8-4392-a551-9d0d9b96a45d could not be found. Apr 16 21:11:10.391456 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6cb8dbf4-502d-42a4-99f7-b0fbdd3e1694 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Returning 404 to user: Instance 8d5cf7af-51b8-4392-a551-9d0d9b96a45d could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:11:10.391456 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6cb8dbf4-502d-42a4-99f7-b0fbdd3e1694 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "GET /compute/v2.1/servers/8d5cf7af-51b8-4392-a551-9d0d9b96a45d" status: 404 len: 111 microversion: 2.1 time: 0.052880 Apr 16 21:11:10.391456 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 618/1312] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:10 2022] GET /compute/v2.1/servers/8d5cf7af-51b8-4392-a551-9d0d9b96a45d => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:11:10.396571 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-c6fa7e89-8638-4599-870a-2df4c2e82ef1 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lazy-loading 'services' on Instance uuid a60c9986-12b3-4fc4-9bde-7bf7f34f90bd {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:11:10.404493 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cba921b2-c00c-430f-be0a-ea756f5a52c7 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Calling method '.version_select at 0x7fbb96328310>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:10.411788 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c6fa7e89-8638-4599-870a-2df4c2e82ef1 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd" status: 200 len: 2129 microversion: 2.25 time: 0.298110 Apr 16 21:11:10.425801 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 695/1313] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:11:10 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd => generated 2129 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:11:10.436055 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b6ad508f-39e2-43a5-b2fe-ef1e6d434c39 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:10.437838 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b6ad508f-39e2-43a5-b2fe-ef1e6d434c39 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:10.443486 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b6ad508f-39e2-43a5-b2fe-ef1e6d434c39 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:10.443944 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b6ad508f-39e2-43a5-b2fe-ef1e6d434c39 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:10.444786 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b6ad508f-39e2-43a5-b2fe-ef1e6d434c39 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:10.445247 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b6ad508f-39e2-43a5-b2fe-ef1e6d434c39 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:10.506491 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cba921b2-c00c-430f-be0a-ea756f5a52c7 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-491807199" status: 202 len: 0 microversion: 2.1 time: 0.113263 Apr 16 21:11:10.507387 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 619/1314] 10.222.0.20 () {58 vars in 1217 bytes} [Sat Apr 16 21:11:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-491807199 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:11:10.514318 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c020f2dc-14ed-49fa-bd17-61bf36970493 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:10.518165 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c020f2dc-14ed-49fa-bd17-61bf36970493 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:10.527433 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c020f2dc-14ed-49fa-bd17-61bf36970493 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:10.527899 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c020f2dc-14ed-49fa-bd17-61bf36970493 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:10.528736 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c020f2dc-14ed-49fa-bd17-61bf36970493 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:10.529178 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c020f2dc-14ed-49fa-bd17-61bf36970493 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:10.665441 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-b6ad508f-39e2-43a5-b2fe-ef1e6d434c39 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lazy-loading 'services' on Instance uuid a60c9986-12b3-4fc4-9bde-7bf7f34f90bd {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:11:10.681259 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b6ad508f-39e2-43a5-b2fe-ef1e6d434c39 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd" status: 200 len: 2129 microversion: 2.25 time: 0.254223 Apr 16 21:11:10.681857 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 696/1315] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:11:10 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd => generated 2129 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:11:10.692636 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-83b36773-844b-4d73-9e16-87069d17e941 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:10.692636 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-83b36773-844b-4d73-9e16-87069d17e941 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: de422b8c-d5d0-4730-92c4-f30877d0cf2b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:10.709531 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-83b36773-844b-4d73-9e16-87069d17e941 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:10.709989 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-83b36773-844b-4d73-9e16-87069d17e941 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:10.710811 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-83b36773-844b-4d73-9e16-87069d17e941 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:10.711257 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-83b36773-844b-4d73-9e16-87069d17e941 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:10.765332 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-83b36773-844b-4d73-9e16-87069d17e941 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:10.766080 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-83b36773-844b-4d73-9e16-87069d17e941 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:10.767334 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-83b36773-844b-4d73-9e16-87069d17e941 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lazy-loading 'fault' on Instance uuid de422b8c-d5d0-4730-92c4-f30877d0cf2b {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:11:10.810375 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c020f2dc-14ed-49fa-bd17-61bf36970493 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:10.818992 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c020f2dc-14ed-49fa-bd17-61bf36970493 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1549 microversion: 2.1 time: 0.310518 Apr 16 21:11:10.819599 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 620/1316] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:10 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1549 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:10.837069 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-eb8e0ef4-41b1-4464-89e6-1391c30ed1d8 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb96c42940>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:10.849445 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-83b36773-844b-4d73-9e16-87069d17e941 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:10.863824 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-83b36773-844b-4d73-9e16-87069d17e941 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/de422b8c-d5d0-4730-92c4-f30877d0cf2b" status: 200 len: 1302 microversion: 2.1 time: 0.174336 Apr 16 21:11:10.863824 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 697/1317] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:10 2022] GET /compute/v2.1/servers/de422b8c-d5d0-4730-92c4-f30877d0cf2b => generated 1302 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:10.877523 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ee3e0f03-2f96-4c3f-95a2-4ffdce94b020 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:10.878048 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ee3e0f03-2f96-4c3f-95a2-4ffdce94b020 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:10.884477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee3e0f03-2f96-4c3f-95a2-4ffdce94b020 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:10.884946 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee3e0f03-2f96-4c3f-95a2-4ffdce94b020 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:10.885735 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee3e0f03-2f96-4c3f-95a2-4ffdce94b020 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:10.886510 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee3e0f03-2f96-4c3f-95a2-4ffdce94b020 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:10.901805 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-eb8e0ef4-41b1-4464-89e6-1391c30ed1d8 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430" status: 200 len: 1426 microversion: 2.1 time: 0.080495 Apr 16 21:11:10.902396 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 621/1318] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:11:10 2022] GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430 => generated 1426 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:10.913473 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-21a99c24-e28b-487e-bb0d-a662192200e2 req-3bdbd63e-858d-4e6b-a755-ed5f965dcc48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de422b8c-d5d0-4730-92c4-f30877d0cf2b", "name": "network-vif-deleted", "tag": "aa28e0e4-5396-47b7-a21f-9f5effb36613"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:11:10.922288 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-21a99c24-e28b-487e-bb0d-a662192200e2 req-3bdbd63e-858d-4e6b-a755-ed5f965dcc48 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:10.923538 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-21a99c24-e28b-487e-bb0d-a662192200e2 req-3bdbd63e-858d-4e6b-a755-ed5f965dcc48 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:10.937079 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-21a99c24-e28b-487e-bb0d-a662192200e2 req-3bdbd63e-858d-4e6b-a755-ed5f965dcc48 service nova] Creating event network-vif-deleted:aa28e0e4-5396-47b7-a21f-9f5effb36613 for instance de422b8c-d5d0-4730-92c4-f30877d0cf2b on nch1-master-1 Apr 16 21:11:10.943194 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-21a99c24-e28b-487e-bb0d-a662192200e2 req-3bdbd63e-858d-4e6b-a755-ed5f965dcc48 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033367 Apr 16 21:11:10.944323 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 622/1319] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:11:10.951611 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2983235c-b2cb-4930-86ef-7003dac48c8b tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:10.952594 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2983235c-b2cb-4930-86ef-7003dac48c8b tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 615ea5db-3cca-4736-b69a-cc7bdc8f0e6e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:10.960608 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2983235c-b2cb-4930-86ef-7003dac48c8b tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:10.961456 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2983235c-b2cb-4930-86ef-7003dac48c8b tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:10.962751 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2983235c-b2cb-4930-86ef-7003dac48c8b tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:10.963602 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2983235c-b2cb-4930-86ef-7003dac48c8b tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:11.033352 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2983235c-b2cb-4930-86ef-7003dac48c8b tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:11.033820 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2983235c-b2cb-4930-86ef-7003dac48c8b tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:11.034334 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-2983235c-b2cb-4930-86ef-7003dac48c8b tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lazy-loading 'fault' on Instance uuid 615ea5db-3cca-4736-b69a-cc7bdc8f0e6e {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:11:11.096485 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-ee3e0f03-2f96-4c3f-95a2-4ffdce94b020 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lazy-loading 'services' on Instance uuid a60c9986-12b3-4fc4-9bde-7bf7f34f90bd {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:11:11.103070 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2983235c-b2cb-4930-86ef-7003dac48c8b tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:11.114967 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2983235c-b2cb-4930-86ef-7003dac48c8b tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/615ea5db-3cca-4736-b69a-cc7bdc8f0e6e" status: 200 len: 1310 microversion: 2.1 time: 0.169188 Apr 16 21:11:11.115566 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 623/1320] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:10 2022] GET /compute/v2.1/servers/615ea5db-3cca-4736-b69a-cc7bdc8f0e6e => generated 1310 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:11.130533 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e1324b1a-a8a7-4ec5-ad44-133d8facf388 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:11.131347 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e1324b1a-a8a7-4ec5-ad44-133d8facf388 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 88a6591a-336d-477a-8a77-d4e30a1bb0bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:11.139850 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e1324b1a-a8a7-4ec5-ad44-133d8facf388 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:11.140354 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e1324b1a-a8a7-4ec5-ad44-133d8facf388 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:11.141293 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e1324b1a-a8a7-4ec5-ad44-133d8facf388 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:11.143491 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e1324b1a-a8a7-4ec5-ad44-133d8facf388 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:11.341789 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e1324b1a-a8a7-4ec5-ad44-133d8facf388 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:11.346759 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e1324b1a-a8a7-4ec5-ad44-133d8facf388 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf" status: 200 len: 1316 microversion: 2.1 time: 0.225534 Apr 16 21:11:11.348681 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 624/1321] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:11 2022] GET /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf => generated 1316 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:11.358756 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e10738dc-162c-455c-9bca-9cb4b01d92d3 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:11.360409 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e10738dc-162c-455c-9bca-9cb4b01d92d3 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] [instance: cda4f042-eb49-4d90-ad5e-0e2b81dc0ede] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:11.371857 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e10738dc-162c-455c-9bca-9cb4b01d92d3 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:11.372467 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e10738dc-162c-455c-9bca-9cb4b01d92d3 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:11.373366 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e10738dc-162c-455c-9bca-9cb4b01d92d3 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:11.374053 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e10738dc-162c-455c-9bca-9cb4b01d92d3 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:11.414582 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ee3e0f03-2f96-4c3f-95a2-4ffdce94b020 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd/os-volume_attachments/a0bbd6c4-67eb-4f42-a9e2-e08052fd877f" status: 202 len: 0 microversion: 2.25 time: 0.553829 Apr 16 21:11:11.415203 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 698/1322] 10.222.0.20 () {60 vars in 1456 bytes} [Sat Apr 16 21:11:10 2022] DELETE /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd/os-volume_attachments/a0bbd6c4-67eb-4f42-a9e2-e08052fd877f => generated 0 bytes in 556 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:11:11.424625 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9b602454-3d7b-416f-a78a-0cd3d2c7d1c8 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:11.425708 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9b602454-3d7b-416f-a78a-0cd3d2c7d1c8 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:11.433428 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9b602454-3d7b-416f-a78a-0cd3d2c7d1c8 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:11.434381 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9b602454-3d7b-416f-a78a-0cd3d2c7d1c8 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:11.435274 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9b602454-3d7b-416f-a78a-0cd3d2c7d1c8 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:11.435630 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9b602454-3d7b-416f-a78a-0cd3d2c7d1c8 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:11.482310 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9b602454-3d7b-416f-a78a-0cd3d2c7d1c8 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.062588 Apr 16 21:11:11.500486 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 699/1323] 10.222.0.20 () {60 vars in 1342 bytes} [Sat Apr 16 21:11:11 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 16 21:11:11.659391 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e10738dc-162c-455c-9bca-9cb4b01d92d3 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453306648f4e4da58ee344c3a51f8110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc15580ef8a449ca359a9d5b799e24d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:11.694991 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e10738dc-162c-455c-9bca-9cb4b01d92d3 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] 10.222.0.20 "GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede" status: 200 len: 1372 microversion: 2.1 time: 0.345149 Apr 16 21:11:11.702079 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 625/1324] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:11 2022] GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede => generated 1372 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:11.839216 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-32f4292d-5cff-4d4b-962e-615c256534db tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:11.840530 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-32f4292d-5cff-4d4b-962e-615c256534db tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:11.847786 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-32f4292d-5cff-4d4b-962e-615c256534db tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:11.848440 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-32f4292d-5cff-4d4b-962e-615c256534db tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:11.849364 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-32f4292d-5cff-4d4b-962e-615c256534db tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:11.849858 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-32f4292d-5cff-4d4b-962e-615c256534db tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:11.880022 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-12669be2-42a0-4014-b281-431dbff57abb tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:11.881226 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-12669be2-42a0-4014-b281-431dbff57abb tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: de422b8c-d5d0-4730-92c4-f30877d0cf2b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:11.892345 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-12669be2-42a0-4014-b281-431dbff57abb tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:11.893156 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-12669be2-42a0-4014-b281-431dbff57abb tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:11.894229 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-12669be2-42a0-4014-b281-431dbff57abb tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:11.895596 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-12669be2-42a0-4014-b281-431dbff57abb tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:11.924630 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-12669be2-42a0-4014-b281-431dbff57abb tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] HTTP exception thrown: Instance de422b8c-d5d0-4730-92c4-f30877d0cf2b could not be found. Apr 16 21:11:11.925303 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-12669be2-42a0-4014-b281-431dbff57abb tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Returning 404 to user: Instance de422b8c-d5d0-4730-92c4-f30877d0cf2b could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:11:11.926084 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-12669be2-42a0-4014-b281-431dbff57abb tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/de422b8c-d5d0-4730-92c4-f30877d0cf2b" status: 404 len: 111 microversion: 2.1 time: 0.051007 Apr 16 21:11:11.926839 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 626/1325] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:11 2022] GET /compute/v2.1/servers/de422b8c-d5d0-4730-92c4-f30877d0cf2b => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:11:11.932732 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0409237c-0f06-4227-840e-37dc5f207e17 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb96328280>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:11.982947 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0409237c-0f06-4227-840e-37dc5f207e17 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430" status: 200 len: 1426 microversion: 2.1 time: 0.054790 Apr 16 21:11:11.983523 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 627/1326] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:11:11 2022] GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430 => generated 1426 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:11.990053 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c226644c-f38b-40c5-b54c-43864e5b6146 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:11.990627 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c226644c-f38b-40c5-b54c-43864e5b6146 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4196bcfc-2c28-485b-8c51-5b460fee70e2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:11.998539 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c226644c-f38b-40c5-b54c-43864e5b6146 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:11.999464 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c226644c-f38b-40c5-b54c-43864e5b6146 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:12.000507 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c226644c-f38b-40c5-b54c-43864e5b6146 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:12.001764 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c226644c-f38b-40c5-b54c-43864e5b6146 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:12.018192 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-32f4292d-5cff-4d4b-962e-615c256534db tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:12.027087 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-32f4292d-5cff-4d4b-962e-615c256534db tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1549 microversion: 2.1 time: 0.193051 Apr 16 21:11:12.031957 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c226644c-f38b-40c5-b54c-43864e5b6146 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4196bcfc-2c28-485b-8c51-5b460fee70e2] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:11:12.038834 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 700/1327] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:11 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1549 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:12.131780 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0520ea03-c9b7-46f4-a7ff-2716c4e83533 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:12.132663 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0520ea03-c9b7-46f4-a7ff-2716c4e83533 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 615ea5db-3cca-4736-b69a-cc7bdc8f0e6e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:12.140709 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0520ea03-c9b7-46f4-a7ff-2716c4e83533 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:12.141354 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0520ea03-c9b7-46f4-a7ff-2716c4e83533 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:12.142382 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0520ea03-c9b7-46f4-a7ff-2716c4e83533 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:12.142983 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0520ea03-c9b7-46f4-a7ff-2716c4e83533 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:12.209029 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0520ea03-c9b7-46f4-a7ff-2716c4e83533 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:12.209600 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0520ea03-c9b7-46f4-a7ff-2716c4e83533 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:12.210076 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-0520ea03-c9b7-46f4-a7ff-2716c4e83533 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lazy-loading 'fault' on Instance uuid 615ea5db-3cca-4736-b69a-cc7bdc8f0e6e {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:11:12.273313 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0520ea03-c9b7-46f4-a7ff-2716c4e83533 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:12.281270 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0520ea03-c9b7-46f4-a7ff-2716c4e83533 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/615ea5db-3cca-4736-b69a-cc7bdc8f0e6e" status: 200 len: 1310 microversion: 2.1 time: 0.153277 Apr 16 21:11:12.281857 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 701/1328] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:12 2022] GET /compute/v2.1/servers/615ea5db-3cca-4736-b69a-cc7bdc8f0e6e => generated 1310 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:12.288101 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-66b7d09e-68ad-4a12-9366-e3aa09b567f4 tempest-ServersWithSpecificFlavorTestJSON-117667926 tempest-ServersWithSpecificFlavorTestJSON-117667926-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:12.289116 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:11:12.289116 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:11:12.354010 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c226644c-f38b-40c5-b54c-43864e5b6146 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4196bcfc-2c28-485b-8c51-5b460fee70e2" status: 204 len: 0 microversion: 2.1 time: 0.368973 Apr 16 21:11:12.354880 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 628/1329] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:11:11 2022] DELETE /compute/v2.1/servers/4196bcfc-2c28-485b-8c51-5b460fee70e2 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:11:12.366842 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2c75258a-9130-42cc-bc86-24a57abfde37 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:12.367958 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2c75258a-9130-42cc-bc86-24a57abfde37 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 88a6591a-336d-477a-8a77-d4e30a1bb0bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:12.376222 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2c75258a-9130-42cc-bc86-24a57abfde37 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:12.380608 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2c75258a-9130-42cc-bc86-24a57abfde37 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:12.382928 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2c75258a-9130-42cc-bc86-24a57abfde37 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:12.383406 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2c75258a-9130-42cc-bc86-24a57abfde37 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:12.387974 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-66b7d09e-68ad-4a12-9366-e3aa09b567f4 tempest-ServersWithSpecificFlavorTestJSON-117667926 tempest-ServersWithSpecificFlavorTestJSON-117667926-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/59862996" status: 202 len: 0 microversion: 2.1 time: 0.104426 Apr 16 21:11:12.391277 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 702/1330] 10.222.0.20 () {58 vars in 1154 bytes} [Sat Apr 16 21:11:12 2022] DELETE /compute/v2.1/flavors/59862996 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:11:12.394841 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7d6f1dee-2976-42c4-b577-07d1ae776760 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:12.395766 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7d6f1dee-2976-42c4-b577-07d1ae776760 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4196bcfc-2c28-485b-8c51-5b460fee70e2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:12.410511 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7d6f1dee-2976-42c4-b577-07d1ae776760 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:12.414362 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7d6f1dee-2976-42c4-b577-07d1ae776760 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:12.416108 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7d6f1dee-2976-42c4-b577-07d1ae776760 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:12.417836 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7d6f1dee-2976-42c4-b577-07d1ae776760 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:12.604719 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2c75258a-9130-42cc-bc86-24a57abfde37 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:12.612390 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7d6f1dee-2976-42c4-b577-07d1ae776760 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:12.613760 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2c75258a-9130-42cc-bc86-24a57abfde37 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf" status: 200 len: 1316 microversion: 2.1 time: 0.252252 Apr 16 21:11:12.614513 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 629/1331] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:12 2022] GET /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf => generated 1316 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:12.622350 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-40e5707b-3a2d-4505-89d8-9a9b91ecb0bc tempest-ServersWithSpecificFlavorTestJSON-117667926 tempest-ServersWithSpecificFlavorTestJSON-117667926-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:12.629307 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7d6f1dee-2976-42c4-b577-07d1ae776760 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4196bcfc-2c28-485b-8c51-5b460fee70e2" status: 200 len: 1470 microversion: 2.1 time: 0.238859 Apr 16 21:11:12.629899 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 703/1332] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:12 2022] GET /compute/v2.1/servers/4196bcfc-2c28-485b-8c51-5b460fee70e2 => generated 1470 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:12.643902 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-57455d30-dbf7-494b-8d10-8c5f2c469001 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:12.643902 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-57455d30-dbf7-494b-8d10-8c5f2c469001 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:12.645195 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-57455d30-dbf7-494b-8d10-8c5f2c469001 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:12.645641 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-40e5707b-3a2d-4505-89d8-9a9b91ecb0bc tempest-ServersWithSpecificFlavorTestJSON-117667926 tempest-ServersWithSpecificFlavorTestJSON-117667926-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5403 microversion: 2.1 time: 0.029933 Apr 16 21:11:12.646023 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-57455d30-dbf7-494b-8d10-8c5f2c469001 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:12.648254 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 630/1333] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:11:12 2022] GET /compute/v2.1/flavors/detail => generated 5403 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:12.648420 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-57455d30-dbf7-494b-8d10-8c5f2c469001 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:12.648420 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-57455d30-dbf7-494b-8d10-8c5f2c469001 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:12.668604 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c43075c3-1095-4f61-924c-7511fe07bd49 tempest-ServersWithSpecificFlavorTestJSON-117667926 tempest-ServersWithSpecificFlavorTestJSON-117667926-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:12.669839 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:11:12.669839 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:11:12.680126 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-57455d30-dbf7-494b-8d10-8c5f2c469001 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.046687 Apr 16 21:11:12.680867 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 704/1334] 10.222.0.20 () {60 vars in 1342 bytes} [Sat Apr 16 21:11:12 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:11:12.718360 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2de796a5-05e0-469f-8085-6d0fb45ba0d1 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:12.718980 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2de796a5-05e0-469f-8085-6d0fb45ba0d1 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] [instance: cda4f042-eb49-4d90-ad5e-0e2b81dc0ede] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:12.725201 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2de796a5-05e0-469f-8085-6d0fb45ba0d1 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:12.725885 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2de796a5-05e0-469f-8085-6d0fb45ba0d1 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:12.727266 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2de796a5-05e0-469f-8085-6d0fb45ba0d1 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:12.727865 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2de796a5-05e0-469f-8085-6d0fb45ba0d1 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:12.754377 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c43075c3-1095-4f61-924c-7511fe07bd49 tempest-ServersWithSpecificFlavorTestJSON-117667926 tempest-ServersWithSpecificFlavorTestJSON-117667926-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/624056270" status: 202 len: 0 microversion: 2.1 time: 0.092906 Apr 16 21:11:12.755061 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 631/1335] 10.222.0.20 () {58 vars in 1157 bytes} [Sat Apr 16 21:11:12 2022] DELETE /compute/v2.1/flavors/624056270 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:11:12.768630 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d27b4009-be8a-459d-9a2d-382854fbd616 tempest-ServersWithSpecificFlavorTestJSON-117667926 tempest-ServersWithSpecificFlavorTestJSON-117667926-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:12.793763 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d27b4009-be8a-459d-9a2d-382854fbd616 tempest-ServersWithSpecificFlavorTestJSON-117667926 tempest-ServersWithSpecificFlavorTestJSON-117667926-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.033726 Apr 16 21:11:12.794366 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 632/1336] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:11:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:12.829944 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4767e8b5-7926-4224-a63b-97c87efdf72d tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:12.830701 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4767e8b5-7926-4224-a63b-97c87efdf72d tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 18557c2b-2ced-4cbc-998e-978ae82401e7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:12.837490 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4767e8b5-7926-4224-a63b-97c87efdf72d tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:12.838047 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4767e8b5-7926-4224-a63b-97c87efdf72d tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:12.838928 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4767e8b5-7926-4224-a63b-97c87efdf72d tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:12.839439 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4767e8b5-7926-4224-a63b-97c87efdf72d tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:12.858115 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-4767e8b5-7926-4224-a63b-97c87efdf72d tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] HTTP exception thrown: Instance 18557c2b-2ced-4cbc-998e-978ae82401e7 could not be found. Apr 16 21:11:12.860049 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4767e8b5-7926-4224-a63b-97c87efdf72d tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Returning 404 to user: Instance 18557c2b-2ced-4cbc-998e-978ae82401e7 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:11:12.860049 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4767e8b5-7926-4224-a63b-97c87efdf72d tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "DELETE /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7" status: 404 len: 111 microversion: 2.1 time: 0.033512 Apr 16 21:11:12.861009 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 633/1337] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:11:12 2022] DELETE /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:11:12.868392 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-07cdc7f8-9635-4000-82ac-e7a12110a6dd tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:12.869110 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-07cdc7f8-9635-4000-82ac-e7a12110a6dd tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 18557c2b-2ced-4cbc-998e-978ae82401e7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:12.892446 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-07cdc7f8-9635-4000-82ac-e7a12110a6dd tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:12.893191 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-07cdc7f8-9635-4000-82ac-e7a12110a6dd tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:12.894666 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-07cdc7f8-9635-4000-82ac-e7a12110a6dd tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:12.894666 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-07cdc7f8-9635-4000-82ac-e7a12110a6dd tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:12.911858 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-07cdc7f8-9635-4000-82ac-e7a12110a6dd tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] HTTP exception thrown: Instance 18557c2b-2ced-4cbc-998e-978ae82401e7 could not be found. Apr 16 21:11:12.912841 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-07cdc7f8-9635-4000-82ac-e7a12110a6dd tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Returning 404 to user: Instance 18557c2b-2ced-4cbc-998e-978ae82401e7 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:11:12.913823 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-07cdc7f8-9635-4000-82ac-e7a12110a6dd tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "GET /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7" status: 404 len: 111 microversion: 2.1 time: 0.049163 Apr 16 21:11:12.914786 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 634/1338] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:12 2022] GET /compute/v2.1/servers/18557c2b-2ced-4cbc-998e-978ae82401e7 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:11:12.928769 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-38595c99-dc4c-449a-a3ad-fa27d10e6e99 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:12.929349 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2de796a5-05e0-469f-8085-6d0fb45ba0d1 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453306648f4e4da58ee344c3a51f8110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc15580ef8a449ca359a9d5b799e24d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:12.929720 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-38595c99-dc4c-449a-a3ad-fa27d10e6e99 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 8d5cf7af-51b8-4392-a551-9d0d9b96a45d] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:12.935551 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-38595c99-dc4c-449a-a3ad-fa27d10e6e99 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:12.935998 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-38595c99-dc4c-449a-a3ad-fa27d10e6e99 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:12.936831 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-38595c99-dc4c-449a-a3ad-fa27d10e6e99 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:12.937007 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2de796a5-05e0-469f-8085-6d0fb45ba0d1 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] 10.222.0.20 "GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede" status: 200 len: 1372 microversion: 2.1 time: 0.227762 Apr 16 21:11:12.937270 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-38595c99-dc4c-449a-a3ad-fa27d10e6e99 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:12.937629 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 705/1339] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:12 2022] GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede => generated 1372 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:11:12.952425 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-38595c99-dc4c-449a-a3ad-fa27d10e6e99 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] HTTP exception thrown: Instance 8d5cf7af-51b8-4392-a551-9d0d9b96a45d could not be found. Apr 16 21:11:12.953112 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-38595c99-dc4c-449a-a3ad-fa27d10e6e99 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Returning 404 to user: Instance 8d5cf7af-51b8-4392-a551-9d0d9b96a45d could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:11:12.954068 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-38595c99-dc4c-449a-a3ad-fa27d10e6e99 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8d5cf7af-51b8-4392-a551-9d0d9b96a45d" status: 404 len: 111 microversion: 2.1 time: 0.035536 Apr 16 21:11:12.954972 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 635/1340] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:11:12 2022] DELETE /compute/v2.1/servers/8d5cf7af-51b8-4392-a551-9d0d9b96a45d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:11:12.962923 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bec32b48-d664-4074-811c-8c90dd793333 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:12.963586 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-bec32b48-d664-4074-811c-8c90dd793333 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] [instance: 8d5cf7af-51b8-4392-a551-9d0d9b96a45d] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:12.970279 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bec32b48-d664-4074-811c-8c90dd793333 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:12.970735 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bec32b48-d664-4074-811c-8c90dd793333 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:12.971517 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bec32b48-d664-4074-811c-8c90dd793333 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:12.971981 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bec32b48-d664-4074-811c-8c90dd793333 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:12.988595 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-bec32b48-d664-4074-811c-8c90dd793333 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] HTTP exception thrown: Instance 8d5cf7af-51b8-4392-a551-9d0d9b96a45d could not be found. Apr 16 21:11:12.989196 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bec32b48-d664-4074-811c-8c90dd793333 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] Returning 404 to user: Instance 8d5cf7af-51b8-4392-a551-9d0d9b96a45d could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:11:12.990036 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-bec32b48-d664-4074-811c-8c90dd793333 tempest-ServersWithSpecificFlavorTestJSON-1871427898 tempest-ServersWithSpecificFlavorTestJSON-1871427898-project] 10.222.0.20 "GET /compute/v2.1/servers/8d5cf7af-51b8-4392-a551-9d0d9b96a45d" status: 404 len: 111 microversion: 2.1 time: 0.030963 Apr 16 21:11:12.990583 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 706/1341] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:12 2022] GET /compute/v2.1/servers/8d5cf7af-51b8-4392-a551-9d0d9b96a45d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:11:13.000935 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-89b15265-7f58-4f96-8cb9-f6e1db09d009 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb96c429d0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:13.046866 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bddd05e0-f751-4ea6-bf6f-22273cbb1833 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:13.047478 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-bddd05e0-f751-4ea6-bf6f-22273cbb1833 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:13.056706 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bddd05e0-f751-4ea6-bf6f-22273cbb1833 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:13.057283 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bddd05e0-f751-4ea6-bf6f-22273cbb1833 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:13.058339 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bddd05e0-f751-4ea6-bf6f-22273cbb1833 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:13.058898 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bddd05e0-f751-4ea6-bf6f-22273cbb1833 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:13.061942 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-89b15265-7f58-4f96-8cb9-f6e1db09d009 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430" status: 200 len: 1426 microversion: 2.1 time: 0.064771 Apr 16 21:11:13.064221 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 636/1342] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:11:12 2022] GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430 => generated 1426 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:13.277329 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-bddd05e0-f751-4ea6-bf6f-22273cbb1833 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:13.290528 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-bddd05e0-f751-4ea6-bf6f-22273cbb1833 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1549 microversion: 2.1 time: 0.248307 Apr 16 21:11:13.292608 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 707/1343] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:13 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1549 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:11:13.305605 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5a461d6d-064a-4d19-ac17-66119d21eed8 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:13.307462 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5a461d6d-064a-4d19-ac17-66119d21eed8 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 615ea5db-3cca-4736-b69a-cc7bdc8f0e6e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:13.326661 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5a461d6d-064a-4d19-ac17-66119d21eed8 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:13.327291 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5a461d6d-064a-4d19-ac17-66119d21eed8 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:13.328223 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5a461d6d-064a-4d19-ac17-66119d21eed8 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:13.328783 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5a461d6d-064a-4d19-ac17-66119d21eed8 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:13.379048 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5a461d6d-064a-4d19-ac17-66119d21eed8 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:13.379678 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5a461d6d-064a-4d19-ac17-66119d21eed8 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:13.380291 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-5a461d6d-064a-4d19-ac17-66119d21eed8 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lazy-loading 'fault' on Instance uuid 615ea5db-3cca-4736-b69a-cc7bdc8f0e6e {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:11:13.440545 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5a461d6d-064a-4d19-ac17-66119d21eed8 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:13.450846 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5a461d6d-064a-4d19-ac17-66119d21eed8 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/615ea5db-3cca-4736-b69a-cc7bdc8f0e6e" status: 200 len: 1310 microversion: 2.1 time: 0.153664 Apr 16 21:11:13.452216 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 637/1344] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:13 2022] GET /compute/v2.1/servers/615ea5db-3cca-4736-b69a-cc7bdc8f0e6e => generated 1310 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:13.631927 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8e8b8f32-eb54-449b-aeaf-66d7159723a5 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:13.632690 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8e8b8f32-eb54-449b-aeaf-66d7159723a5 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 88a6591a-336d-477a-8a77-d4e30a1bb0bf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:13.638889 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8e8b8f32-eb54-449b-aeaf-66d7159723a5 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:13.639416 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8e8b8f32-eb54-449b-aeaf-66d7159723a5 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:13.640374 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8e8b8f32-eb54-449b-aeaf-66d7159723a5 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:13.640890 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8e8b8f32-eb54-449b-aeaf-66d7159723a5 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:13.651107 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-428ac15b-9de2-42d5-98ab-a39ba40d1802 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:13.651954 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-428ac15b-9de2-42d5-98ab-a39ba40d1802 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4196bcfc-2c28-485b-8c51-5b460fee70e2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:13.664895 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-428ac15b-9de2-42d5-98ab-a39ba40d1802 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:13.665504 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-428ac15b-9de2-42d5-98ab-a39ba40d1802 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:13.666393 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-428ac15b-9de2-42d5-98ab-a39ba40d1802 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:13.666942 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-428ac15b-9de2-42d5-98ab-a39ba40d1802 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:13.833460 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8e8b8f32-eb54-449b-aeaf-66d7159723a5 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:13.841136 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8e8b8f32-eb54-449b-aeaf-66d7159723a5 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf" status: 200 len: 1316 microversion: 2.1 time: 0.213431 Apr 16 21:11:13.850845 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 708/1345] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:13 2022] GET /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf => generated 1316 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:13.855888 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d2dee078-c546-492e-bc3d-275c81ab71c9 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:13.856942 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d2dee078-c546-492e-bc3d-275c81ab71c9 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:13.866347 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d2dee078-c546-492e-bc3d-275c81ab71c9 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:13.866347 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d2dee078-c546-492e-bc3d-275c81ab71c9 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:13.867196 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d2dee078-c546-492e-bc3d-275c81ab71c9 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:13.867642 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d2dee078-c546-492e-bc3d-275c81ab71c9 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:13.922297 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d2dee078-c546-492e-bc3d-275c81ab71c9 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.070271 Apr 16 21:11:13.927453 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 709/1346] 10.222.0.20 () {60 vars in 1342 bytes} [Sat Apr 16 21:11:13 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:11:13.955916 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-894822dc-a130-4389-a4ef-7b434c391fc9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:13.957623 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-894822dc-a130-4389-a4ef-7b434c391fc9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] [instance: cda4f042-eb49-4d90-ad5e-0e2b81dc0ede] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:13.963575 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-894822dc-a130-4389-a4ef-7b434c391fc9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:13.964027 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-894822dc-a130-4389-a4ef-7b434c391fc9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:13.964881 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-894822dc-a130-4389-a4ef-7b434c391fc9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:13.965323 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-894822dc-a130-4389-a4ef-7b434c391fc9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:13.967472 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-428ac15b-9de2-42d5-98ab-a39ba40d1802 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:13.975019 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-428ac15b-9de2-42d5-98ab-a39ba40d1802 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4196bcfc-2c28-485b-8c51-5b460fee70e2" status: 200 len: 1470 microversion: 2.1 time: 0.328014 Apr 16 21:11:13.978207 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 638/1347] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:13 2022] GET /compute/v2.1/servers/4196bcfc-2c28-485b-8c51-5b460fee70e2 => generated 1470 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:11:14.077569 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-911a452c-5061-4265-895c-f7e3a667ee96 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb962be1f0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:14.161357 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-911a452c-5061-4265-895c-f7e3a667ee96 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430" status: 200 len: 1426 microversion: 2.1 time: 0.085068 Apr 16 21:11:14.161357 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 639/1348] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:11:14 2022] GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430 => generated 1426 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:11:14.188243 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-894822dc-a130-4389-a4ef-7b434c391fc9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453306648f4e4da58ee344c3a51f8110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc15580ef8a449ca359a9d5b799e24d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:14.202111 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-894822dc-a130-4389-a4ef-7b434c391fc9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] 10.222.0.20 "GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede" status: 200 len: 1372 microversion: 2.1 time: 0.250768 Apr 16 21:11:14.203398 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 710/1349] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:13 2022] GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede => generated 1372 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:11:14.324975 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-234dd66f-3bba-49b4-afa6-654ecaf2a339 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:14.324975 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-234dd66f-3bba-49b4-afa6-654ecaf2a339 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:14.330150 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-234dd66f-3bba-49b4-afa6-654ecaf2a339 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:14.334723 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-234dd66f-3bba-49b4-afa6-654ecaf2a339 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:14.335722 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-234dd66f-3bba-49b4-afa6-654ecaf2a339 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:14.336275 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-234dd66f-3bba-49b4-afa6-654ecaf2a339 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:14.467957 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-052c755f-7363-4a6a-bd44-7726d7ffdc42 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:14.468632 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-052c755f-7363-4a6a-bd44-7726d7ffdc42 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 615ea5db-3cca-4736-b69a-cc7bdc8f0e6e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:14.475686 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-052c755f-7363-4a6a-bd44-7726d7ffdc42 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:14.476260 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-052c755f-7363-4a6a-bd44-7726d7ffdc42 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:14.476995 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-052c755f-7363-4a6a-bd44-7726d7ffdc42 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:14.477438 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-052c755f-7363-4a6a-bd44-7726d7ffdc42 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:14.512803 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-052c755f-7363-4a6a-bd44-7726d7ffdc42 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:14.513258 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-052c755f-7363-4a6a-bd44-7726d7ffdc42 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:14.513738 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-052c755f-7363-4a6a-bd44-7726d7ffdc42 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lazy-loading 'fault' on Instance uuid 615ea5db-3cca-4736-b69a-cc7bdc8f0e6e {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:11:14.563978 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-052c755f-7363-4a6a-bd44-7726d7ffdc42 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:14.573665 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-052c755f-7363-4a6a-bd44-7726d7ffdc42 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/615ea5db-3cca-4736-b69a-cc7bdc8f0e6e" status: 200 len: 1310 microversion: 2.1 time: 0.109437 Apr 16 21:11:14.585566 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 711/1350] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:14 2022] GET /compute/v2.1/servers/615ea5db-3cca-4736-b69a-cc7bdc8f0e6e => generated 1310 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:14.861494 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-63cfe6e5-2faa-4c80-b25f-50f488479818 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:14.862373 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-63cfe6e5-2faa-4c80-b25f-50f488479818 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 88a6591a-336d-477a-8a77-d4e30a1bb0bf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:14.880548 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-63cfe6e5-2faa-4c80-b25f-50f488479818 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:14.881795 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-63cfe6e5-2faa-4c80-b25f-50f488479818 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:14.882776 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-63cfe6e5-2faa-4c80-b25f-50f488479818 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:14.884028 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-63cfe6e5-2faa-4c80-b25f-50f488479818 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:14.928271 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-234dd66f-3bba-49b4-afa6-654ecaf2a339 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:14.941293 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-234dd66f-3bba-49b4-afa6-654ecaf2a339 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1549 microversion: 2.1 time: 0.635965 Apr 16 21:11:14.944627 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 640/1351] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:14 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1549 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:14.963049 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b4a6d766-9512-48b7-84e1-c23fe421fe3a tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:14.964977 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b4a6d766-9512-48b7-84e1-c23fe421fe3a tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:14.979084 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b4a6d766-9512-48b7-84e1-c23fe421fe3a tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:14.980867 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b4a6d766-9512-48b7-84e1-c23fe421fe3a tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:14.983262 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b4a6d766-9512-48b7-84e1-c23fe421fe3a tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:14.986886 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b4a6d766-9512-48b7-84e1-c23fe421fe3a tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:15.027642 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b4a6d766-9512-48b7-84e1-c23fe421fe3a tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.078369 Apr 16 21:11:15.029656 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 641/1352] 10.222.0.20 () {60 vars in 1342 bytes} [Sat Apr 16 21:11:14 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd/os-volume_attachments => generated 25 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:15.041262 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-27334ffc-8626-45c4-8ff7-1c521c1cffb9 req-e8fb30ea-6f75-4513-8b99-7f131b8c04a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88a6591a-336d-477a-8a77-d4e30a1bb0bf", "name": "network-vif-plugged", "status": "completed", "tag": "90f9b920-0d64-4f52-b927-bb557bc71bb3"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:11:15.065409 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-27334ffc-8626-45c4-8ff7-1c521c1cffb9 req-e8fb30ea-6f75-4513-8b99-7f131b8c04a6 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:15.066164 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-27334ffc-8626-45c4-8ff7-1c521c1cffb9 req-e8fb30ea-6f75-4513-8b99-7f131b8c04a6 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:15.085587 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-27334ffc-8626-45c4-8ff7-1c521c1cffb9 req-e8fb30ea-6f75-4513-8b99-7f131b8c04a6 service nova] Creating event network-vif-plugged:90f9b920-0d64-4f52-b927-bb557bc71bb3 for instance 88a6591a-336d-477a-8a77-d4e30a1bb0bf on nch1-master-1 Apr 16 21:11:15.099627 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-27334ffc-8626-45c4-8ff7-1c521c1cffb9 req-e8fb30ea-6f75-4513-8b99-7f131b8c04a6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068468 Apr 16 21:11:15.106547 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 642/1353] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:11:15.145440 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b5f1dbbd-c6f1-4fe3-a23b-ce47aa0bf3ae tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:15.149510 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b5f1dbbd-c6f1-4fe3-a23b-ce47aa0bf3ae tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4196bcfc-2c28-485b-8c51-5b460fee70e2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:15.161024 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b5f1dbbd-c6f1-4fe3-a23b-ce47aa0bf3ae tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:15.161500 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b5f1dbbd-c6f1-4fe3-a23b-ce47aa0bf3ae tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:15.162298 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b5f1dbbd-c6f1-4fe3-a23b-ce47aa0bf3ae tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:15.162936 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b5f1dbbd-c6f1-4fe3-a23b-ce47aa0bf3ae tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:15.199109 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-63cfe6e5-2faa-4c80-b25f-50f488479818 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:15.216761 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-63cfe6e5-2faa-4c80-b25f-50f488479818 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf" status: 200 len: 1316 microversion: 2.1 time: 0.357200 Apr 16 21:11:15.228391 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 712/1354] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:14 2022] GET /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf => generated 1316 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:15.243580 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3712d5f6-d364-4410-bfab-c13cc7eae165 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb965bd940>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:15.338251 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3712d5f6-d364-4410-bfab-c13cc7eae165 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430" status: 200 len: 1426 microversion: 2.1 time: 0.106516 Apr 16 21:11:15.338874 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 713/1355] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:11:15 2022] GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430 => generated 1426 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:15.349942 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c0537f0c-6c21-4b1c-a30c-099e9ba4a823 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:15.350621 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c0537f0c-6c21-4b1c-a30c-099e9ba4a823 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] [instance: cda4f042-eb49-4d90-ad5e-0e2b81dc0ede] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:15.359165 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c0537f0c-6c21-4b1c-a30c-099e9ba4a823 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:15.359165 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c0537f0c-6c21-4b1c-a30c-099e9ba4a823 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:15.365156 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c0537f0c-6c21-4b1c-a30c-099e9ba4a823 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:15.365156 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c0537f0c-6c21-4b1c-a30c-099e9ba4a823 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:15.691989 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c0537f0c-6c21-4b1c-a30c-099e9ba4a823 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453306648f4e4da58ee344c3a51f8110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc15580ef8a449ca359a9d5b799e24d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:15.707881 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c0537f0c-6c21-4b1c-a30c-099e9ba4a823 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] 10.222.0.20 "GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede" status: 200 len: 1372 microversion: 2.1 time: 0.359022 Apr 16 21:11:15.708561 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 714/1356] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:15 2022] GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede => generated 1372 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:15.719518 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cca308a5-e0f0-4a53-a2f0-273089ee1853 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:15.720164 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cca308a5-e0f0-4a53-a2f0-273089ee1853 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 615ea5db-3cca-4736-b69a-cc7bdc8f0e6e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:15.739502 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cca308a5-e0f0-4a53-a2f0-273089ee1853 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:15.739975 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cca308a5-e0f0-4a53-a2f0-273089ee1853 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:15.740836 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cca308a5-e0f0-4a53-a2f0-273089ee1853 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:15.741289 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cca308a5-e0f0-4a53-a2f0-273089ee1853 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:15.869426 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cca308a5-e0f0-4a53-a2f0-273089ee1853 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:15.876652 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cca308a5-e0f0-4a53-a2f0-273089ee1853 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:15.877078 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-cca308a5-e0f0-4a53-a2f0-273089ee1853 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lazy-loading 'fault' on Instance uuid 615ea5db-3cca-4736-b69a-cc7bdc8f0e6e {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:11:15.976349 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cca308a5-e0f0-4a53-a2f0-273089ee1853 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:15.990483 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cca308a5-e0f0-4a53-a2f0-273089ee1853 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/615ea5db-3cca-4736-b69a-cc7bdc8f0e6e" status: 200 len: 1310 microversion: 2.1 time: 0.278960 Apr 16 21:11:15.991915 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 715/1357] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:15 2022] GET /compute/v2.1/servers/615ea5db-3cca-4736-b69a-cc7bdc8f0e6e => generated 1310 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:15.997990 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d8564029-7402-4dd0-9214-317245198051 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:15.998847 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d8564029-7402-4dd0-9214-317245198051 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:16.007017 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d8564029-7402-4dd0-9214-317245198051 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:16.015687 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d8564029-7402-4dd0-9214-317245198051 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:16.015687 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d8564029-7402-4dd0-9214-317245198051 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:16.015687 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d8564029-7402-4dd0-9214-317245198051 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:16.136936 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b5f1dbbd-c6f1-4fe3-a23b-ce47aa0bf3ae tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:16.160949 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b5f1dbbd-c6f1-4fe3-a23b-ce47aa0bf3ae tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4196bcfc-2c28-485b-8c51-5b460fee70e2" status: 200 len: 1470 microversion: 2.1 time: 1.052993 Apr 16 21:11:16.161693 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 643/1358] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:15 2022] GET /compute/v2.1/servers/4196bcfc-2c28-485b-8c51-5b460fee70e2 => generated 1470 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:16.173925 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-0a923234-d964-47b4-a69b-3abfa3659ab1 req-f468802d-8f91-4279-9f90-8a18a2a8c2e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4196bcfc-2c28-485b-8c51-5b460fee70e2", "name": "network-vif-deleted", "tag": "2819bc63-5a3d-4aac-8273-b90dbce3d22d"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:11:16.183631 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-0a923234-d964-47b4-a69b-3abfa3659ab1 req-f468802d-8f91-4279-9f90-8a18a2a8c2e8 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:16.184435 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-0a923234-d964-47b4-a69b-3abfa3659ab1 req-f468802d-8f91-4279-9f90-8a18a2a8c2e8 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:16.216121 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-0a923234-d964-47b4-a69b-3abfa3659ab1 req-f468802d-8f91-4279-9f90-8a18a2a8c2e8 service nova] Creating event network-vif-deleted:2819bc63-5a3d-4aac-8273-b90dbce3d22d for instance 4196bcfc-2c28-485b-8c51-5b460fee70e2 on nch1-master-1 Apr 16 21:11:16.241624 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-0a923234-d964-47b4-a69b-3abfa3659ab1 req-f468802d-8f91-4279-9f90-8a18a2a8c2e8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078339 Apr 16 21:11:16.243203 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 644/1359] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:11:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:11:16.254259 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-606db4f3-103a-4857-bb6d-958fe2012465 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:16.260748 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-606db4f3-103a-4857-bb6d-958fe2012465 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 88a6591a-336d-477a-8a77-d4e30a1bb0bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:16.267507 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-606db4f3-103a-4857-bb6d-958fe2012465 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:16.268241 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-606db4f3-103a-4857-bb6d-958fe2012465 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:16.269212 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-606db4f3-103a-4857-bb6d-958fe2012465 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:16.269828 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-606db4f3-103a-4857-bb6d-958fe2012465 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:16.275691 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d8564029-7402-4dd0-9214-317245198051 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:16.286421 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d8564029-7402-4dd0-9214-317245198051 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1549 microversion: 2.1 time: 0.292902 Apr 16 21:11:16.296258 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 716/1360] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:15 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1549 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:16.354324 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3678ef77-1266-4919-aa49-d298e08873f0 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb9645db80>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:16.415700 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3678ef77-1266-4919-aa49-d298e08873f0 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430" status: 200 len: 1426 microversion: 2.1 time: 0.067499 Apr 16 21:11:16.417218 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 717/1361] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:11:16 2022] GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430 => generated 1426 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:11:16.549075 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-606db4f3-103a-4857-bb6d-958fe2012465 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:16.557043 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-606db4f3-103a-4857-bb6d-958fe2012465 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf" status: 200 len: 1316 microversion: 2.1 time: 0.312124 Apr 16 21:11:16.559560 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 645/1362] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:16 2022] GET /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf => generated 1316 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:16.726379 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5df14418-a439-4085-942d-b23ac57e3ab8 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:16.727003 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5df14418-a439-4085-942d-b23ac57e3ab8 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] [instance: cda4f042-eb49-4d90-ad5e-0e2b81dc0ede] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:16.748939 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5df14418-a439-4085-942d-b23ac57e3ab8 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:16.749408 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5df14418-a439-4085-942d-b23ac57e3ab8 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:16.750204 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5df14418-a439-4085-942d-b23ac57e3ab8 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:16.750680 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5df14418-a439-4085-942d-b23ac57e3ab8 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:17.010924 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8133d7a7-9b37-4f94-805d-bc01f1330269 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:17.011578 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8133d7a7-9b37-4f94-805d-bc01f1330269 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 615ea5db-3cca-4736-b69a-cc7bdc8f0e6e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:17.029043 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8133d7a7-9b37-4f94-805d-bc01f1330269 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:17.032844 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8133d7a7-9b37-4f94-805d-bc01f1330269 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:17.033908 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8133d7a7-9b37-4f94-805d-bc01f1330269 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:17.036817 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8133d7a7-9b37-4f94-805d-bc01f1330269 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:17.156855 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5df14418-a439-4085-942d-b23ac57e3ab8 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453306648f4e4da58ee344c3a51f8110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc15580ef8a449ca359a9d5b799e24d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:17.168300 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8133d7a7-9b37-4f94-805d-bc01f1330269 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:17.168300 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8133d7a7-9b37-4f94-805d-bc01f1330269 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:17.168300 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-8133d7a7-9b37-4f94-805d-bc01f1330269 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lazy-loading 'fault' on Instance uuid 615ea5db-3cca-4736-b69a-cc7bdc8f0e6e {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:11:17.173687 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5df14418-a439-4085-942d-b23ac57e3ab8 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] 10.222.0.20 "GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede" status: 200 len: 1372 microversion: 2.1 time: 0.448601 Apr 16 21:11:17.189602 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 718/1363] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:16 2022] GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede => generated 1372 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:17.202533 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2d7ce0f0-793a-4838-bee4-3419995530e7 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:17.203438 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2d7ce0f0-793a-4838-bee4-3419995530e7 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4196bcfc-2c28-485b-8c51-5b460fee70e2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:17.219186 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2d7ce0f0-793a-4838-bee4-3419995530e7 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:17.220030 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2d7ce0f0-793a-4838-bee4-3419995530e7 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:17.220994 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2d7ce0f0-793a-4838-bee4-3419995530e7 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:17.221532 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2d7ce0f0-793a-4838-bee4-3419995530e7 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:17.302160 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2d7ce0f0-793a-4838-bee4-3419995530e7 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:17.303408 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2d7ce0f0-793a-4838-bee4-3419995530e7 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:17.304140 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-2d7ce0f0-793a-4838-bee4-3419995530e7 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lazy-loading 'fault' on Instance uuid 4196bcfc-2c28-485b-8c51-5b460fee70e2 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:11:17.331718 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8133d7a7-9b37-4f94-805d-bc01f1330269 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:17.344518 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8133d7a7-9b37-4f94-805d-bc01f1330269 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/615ea5db-3cca-4736-b69a-cc7bdc8f0e6e" status: 200 len: 1310 microversion: 2.1 time: 0.339930 Apr 16 21:11:17.359080 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 646/1364] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:17 2022] GET /compute/v2.1/servers/615ea5db-3cca-4736-b69a-cc7bdc8f0e6e => generated 1310 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:17.382295 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e5a68619-41b0-4b1d-be35-5ff09caacbac tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:17.389140 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e5a68619-41b0-4b1d-be35-5ff09caacbac tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:17.407969 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e5a68619-41b0-4b1d-be35-5ff09caacbac tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:17.421900 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e5a68619-41b0-4b1d-be35-5ff09caacbac tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:17.424872 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e5a68619-41b0-4b1d-be35-5ff09caacbac tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:17.425669 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e5a68619-41b0-4b1d-be35-5ff09caacbac tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:17.528547 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2d7ce0f0-793a-4838-bee4-3419995530e7 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:17.552659 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2d7ce0f0-793a-4838-bee4-3419995530e7 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4196bcfc-2c28-485b-8c51-5b460fee70e2" status: 200 len: 1304 microversion: 2.1 time: 0.355476 Apr 16 21:11:17.552659 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 719/1365] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:17 2022] GET /compute/v2.1/servers/4196bcfc-2c28-485b-8c51-5b460fee70e2 => generated 1304 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:17.580565 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ad4b2fb4-7ed1-4abd-ad28-0b25baf01d15 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb9654b0d0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:17.680843 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ad4b2fb4-7ed1-4abd-ad28-0b25baf01d15 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430" status: 200 len: 1426 microversion: 2.1 time: 0.105985 Apr 16 21:11:17.680843 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 720/1366] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:11:17 2022] GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430 => generated 1426 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:17.692666 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-436ec1cf-09eb-4b1d-8c56-d773fa86e0dd tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:17.709335 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-436ec1cf-09eb-4b1d-8c56-d773fa86e0dd tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 88a6591a-336d-477a-8a77-d4e30a1bb0bf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:17.742164 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-436ec1cf-09eb-4b1d-8c56-d773fa86e0dd tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:17.744416 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-436ec1cf-09eb-4b1d-8c56-d773fa86e0dd tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:17.746710 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-436ec1cf-09eb-4b1d-8c56-d773fa86e0dd tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:17.747231 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-436ec1cf-09eb-4b1d-8c56-d773fa86e0dd tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:17.785652 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e5a68619-41b0-4b1d-be35-5ff09caacbac tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:17.795104 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e5a68619-41b0-4b1d-be35-5ff09caacbac tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1549 microversion: 2.1 time: 0.417022 Apr 16 21:11:17.809516 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 647/1367] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:17 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1549 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:18.220257 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-83ea85ad-2636-4518-bcce-f5d634bc4b0b tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:18.220257 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-83ea85ad-2636-4518-bcce-f5d634bc4b0b tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] [instance: cda4f042-eb49-4d90-ad5e-0e2b81dc0ede] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:18.221051 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-436ec1cf-09eb-4b1d-8c56-d773fa86e0dd tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:18.221172 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-83ea85ad-2636-4518-bcce-f5d634bc4b0b tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:18.225173 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-83ea85ad-2636-4518-bcce-f5d634bc4b0b tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:18.226067 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-83ea85ad-2636-4518-bcce-f5d634bc4b0b tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:18.226525 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-83ea85ad-2636-4518-bcce-f5d634bc4b0b tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:18.227254 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-436ec1cf-09eb-4b1d-8c56-d773fa86e0dd tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf" status: 200 len: 1316 microversion: 2.1 time: 0.550466 Apr 16 21:11:18.229608 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 721/1368] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:17 2022] GET /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf => generated 1316 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:18.365381 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f11cd4af-ffe4-4687-9ae2-5872eee54fc0 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:18.367006 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f11cd4af-ffe4-4687-9ae2-5872eee54fc0 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 615ea5db-3cca-4736-b69a-cc7bdc8f0e6e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:18.383313 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f11cd4af-ffe4-4687-9ae2-5872eee54fc0 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:18.389707 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f11cd4af-ffe4-4687-9ae2-5872eee54fc0 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:18.391760 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f11cd4af-ffe4-4687-9ae2-5872eee54fc0 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:18.394572 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f11cd4af-ffe4-4687-9ae2-5872eee54fc0 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:18.444040 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-f11cd4af-ffe4-4687-9ae2-5872eee54fc0 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] HTTP exception thrown: Instance 615ea5db-3cca-4736-b69a-cc7bdc8f0e6e could not be found. Apr 16 21:11:18.446925 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f11cd4af-ffe4-4687-9ae2-5872eee54fc0 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Returning 404 to user: Instance 615ea5db-3cca-4736-b69a-cc7bdc8f0e6e could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:11:18.450012 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f11cd4af-ffe4-4687-9ae2-5872eee54fc0 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/615ea5db-3cca-4736-b69a-cc7bdc8f0e6e" status: 404 len: 111 microversion: 2.1 time: 0.090198 Apr 16 21:11:18.457644 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 722/1369] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:18 2022] GET /compute/v2.1/servers/615ea5db-3cca-4736-b69a-cc7bdc8f0e6e => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:11:18.472147 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f6104778-01b6-4718-b944-ad3b828b9181 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:18.474273 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f6104778-01b6-4718-b944-ad3b828b9181 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 2b27c826-905d-4c1f-9daf-42150b1025a8] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:18.485087 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6104778-01b6-4718-b944-ad3b828b9181 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:18.496485 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6104778-01b6-4718-b944-ad3b828b9181 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:18.498023 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6104778-01b6-4718-b944-ad3b828b9181 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:18.500041 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6104778-01b6-4718-b944-ad3b828b9181 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:18.596207 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f6104778-01b6-4718-b944-ad3b828b9181 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 2b27c826-905d-4c1f-9daf-42150b1025a8] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:11:18.888826 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-83ea85ad-2636-4518-bcce-f5d634bc4b0b tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453306648f4e4da58ee344c3a51f8110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc15580ef8a449ca359a9d5b799e24d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:18.903662 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-83ea85ad-2636-4518-bcce-f5d634bc4b0b tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] 10.222.0.20 "GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede" status: 200 len: 1372 microversion: 2.1 time: 0.708154 Apr 16 21:11:18.903662 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 648/1370] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:18 2022] GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede => generated 1372 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:18.906263 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4fc05d6e-fd9b-45a2-b826-3db43184497a tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:18.906926 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4fc05d6e-fd9b-45a2-b826-3db43184497a tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4196bcfc-2c28-485b-8c51-5b460fee70e2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:18.913960 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4fc05d6e-fd9b-45a2-b826-3db43184497a tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:18.914670 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4fc05d6e-fd9b-45a2-b826-3db43184497a tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:18.915544 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4fc05d6e-fd9b-45a2-b826-3db43184497a tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:18.915992 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4fc05d6e-fd9b-45a2-b826-3db43184497a tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:18.931463 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-4fc05d6e-fd9b-45a2-b826-3db43184497a tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] HTTP exception thrown: Instance 4196bcfc-2c28-485b-8c51-5b460fee70e2 could not be found. Apr 16 21:11:18.932097 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4fc05d6e-fd9b-45a2-b826-3db43184497a tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Returning 404 to user: Instance 4196bcfc-2c28-485b-8c51-5b460fee70e2 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:11:18.932984 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4fc05d6e-fd9b-45a2-b826-3db43184497a tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4196bcfc-2c28-485b-8c51-5b460fee70e2" status: 404 len: 111 microversion: 2.1 time: 0.031426 Apr 16 21:11:18.933825 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 649/1371] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:18 2022] GET /compute/v2.1/servers/4196bcfc-2c28-485b-8c51-5b460fee70e2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:11:18.941131 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-466afe25-15dd-4f33-bfa4-46148e23d5d2 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb962ee160>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:19.343995 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-466afe25-15dd-4f33-bfa4-46148e23d5d2 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430" status: 200 len: 1426 microversion: 2.1 time: 0.408250 Apr 16 21:11:19.350941 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 650/1372] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:11:18 2022] GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430 => generated 1426 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:19.358995 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3b0b6a6b-18f3-4335-85c4-75947e2beed1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:19.360012 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3b0b6a6b-18f3-4335-85c4-75947e2beed1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:19.382803 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3b0b6a6b-18f3-4335-85c4-75947e2beed1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:19.383221 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3b0b6a6b-18f3-4335-85c4-75947e2beed1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:19.384053 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3b0b6a6b-18f3-4335-85c4-75947e2beed1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:19.384526 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3b0b6a6b-18f3-4335-85c4-75947e2beed1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:19.510926 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f6104778-01b6-4718-b944-ad3b828b9181 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8" status: 204 len: 0 microversion: 2.1 time: 1.048882 Apr 16 21:11:19.515649 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 723/1373] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:11:18 2022] DELETE /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8 => generated 0 bytes in 1051 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:11:19.521364 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5924e955-b81f-427e-b5e4-6ecda912e2f9 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:19.522537 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5924e955-b81f-427e-b5e4-6ecda912e2f9 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:19.529667 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5924e955-b81f-427e-b5e4-6ecda912e2f9 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:19.530398 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5924e955-b81f-427e-b5e4-6ecda912e2f9 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:19.531441 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5924e955-b81f-427e-b5e4-6ecda912e2f9 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:19.532158 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5924e955-b81f-427e-b5e4-6ecda912e2f9 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:19.575296 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5924e955-b81f-427e-b5e4-6ecda912e2f9 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:11:19.704919 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3b0b6a6b-18f3-4335-85c4-75947e2beed1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:19.711635 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3b0b6a6b-18f3-4335-85c4-75947e2beed1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1549 microversion: 2.1 time: 0.359078 Apr 16 21:11:19.712244 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 651/1374] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:19 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1549 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:19.720597 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c1f638c5-b383-4de7-b7fe-7d869305262c tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:19.721428 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c1f638c5-b383-4de7-b7fe-7d869305262c tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 88a6591a-336d-477a-8a77-d4e30a1bb0bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:19.727925 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c1f638c5-b383-4de7-b7fe-7d869305262c tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:19.728440 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c1f638c5-b383-4de7-b7fe-7d869305262c tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:19.729423 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c1f638c5-b383-4de7-b7fe-7d869305262c tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:19.730034 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c1f638c5-b383-4de7-b7fe-7d869305262c tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:19.978867 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c1f638c5-b383-4de7-b7fe-7d869305262c tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:19.995959 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c1f638c5-b383-4de7-b7fe-7d869305262c tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf" status: 200 len: 1466 microversion: 2.1 time: 0.282469 Apr 16 21:11:19.996577 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 652/1375] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:19 2022] GET /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf => generated 1466 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:20.002121 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-0abbef34-df24-4a98-87cd-896bb15095de req-67068218-cde9-4c2f-887a-ce4e8d0cb45e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cda4f042-eb49-4d90-ad5e-0e2b81dc0ede", "tag": "341f7886-de89-42fb-840b-8879233ec19f"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:11:20.028784 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-0abbef34-df24-4a98-87cd-896bb15095de req-67068218-cde9-4c2f-887a-ce4e8d0cb45e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:20.032601 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-0abbef34-df24-4a98-87cd-896bb15095de req-67068218-cde9-4c2f-887a-ce4e8d0cb45e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:20.071896 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-0abbef34-df24-4a98-87cd-896bb15095de req-67068218-cde9-4c2f-887a-ce4e8d0cb45e service nova] Creating event network-changed:341f7886-de89-42fb-840b-8879233ec19f for instance cda4f042-eb49-4d90-ad5e-0e2b81dc0ede on nch2-master-1 Apr 16 21:11:20.091526 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-0abbef34-df24-4a98-87cd-896bb15095de req-67068218-cde9-4c2f-887a-ce4e8d0cb45e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092958 Apr 16 21:11:20.092783 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 653/1376] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:11:20.102546 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4f8318e6-a944-45f1-a856-24ca4b2bfd5f tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:20.103798 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4f8318e6-a944-45f1-a856-24ca4b2bfd5f tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 2b27c826-905d-4c1f-9daf-42150b1025a8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:20.115030 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4f8318e6-a944-45f1-a856-24ca4b2bfd5f tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:20.115640 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4f8318e6-a944-45f1-a856-24ca4b2bfd5f tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:20.116930 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4f8318e6-a944-45f1-a856-24ca4b2bfd5f tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:20.117919 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4f8318e6-a944-45f1-a856-24ca4b2bfd5f tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:20.315841 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4f8318e6-a944-45f1-a856-24ca4b2bfd5f tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:20.325193 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4f8318e6-a944-45f1-a856-24ca4b2bfd5f tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8" status: 200 len: 1518 microversion: 2.1 time: 0.229583 Apr 16 21:11:20.343924 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 654/1377] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:20 2022] GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8 => generated 1518 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:20.350993 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5b4793be-8b4d-4f39-baa3-63f8d54fb7e0 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:20.353304 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5b4793be-8b4d-4f39-baa3-63f8d54fb7e0 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] [instance: cda4f042-eb49-4d90-ad5e-0e2b81dc0ede] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:20.362642 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5b4793be-8b4d-4f39-baa3-63f8d54fb7e0 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:20.363364 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5b4793be-8b4d-4f39-baa3-63f8d54fb7e0 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:20.364516 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5b4793be-8b4d-4f39-baa3-63f8d54fb7e0 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:20.365141 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5b4793be-8b4d-4f39-baa3-63f8d54fb7e0 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:20.516586 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5b4793be-8b4d-4f39-baa3-63f8d54fb7e0 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453306648f4e4da58ee344c3a51f8110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc15580ef8a449ca359a9d5b799e24d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:20.524465 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5b4793be-8b4d-4f39-baa3-63f8d54fb7e0 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] 10.222.0.20 "GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede" status: 200 len: 1372 microversion: 2.1 time: 0.178188 Apr 16 21:11:20.525048 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 655/1378] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:20 2022] GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede => generated 1372 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:20.539497 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-68d49ff1-0d4f-485c-a7a7-5c35af885865 tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:20.540392 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-68d49ff1-0d4f-485c-a7a7-5c35af885865 tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] [instance: 88a6591a-336d-477a-8a77-d4e30a1bb0bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:20.546350 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-68d49ff1-0d4f-485c-a7a7-5c35af885865 tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:20.546806 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-68d49ff1-0d4f-485c-a7a7-5c35af885865 tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:20.548165 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-68d49ff1-0d4f-485c-a7a7-5c35af885865 tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:20.548165 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-68d49ff1-0d4f-485c-a7a7-5c35af885865 tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:20.558839 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5924e955-b81f-427e-b5e4-6ecda912e2f9 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 204 len: 0 microversion: 2.1 time: 1.036391 Apr 16 21:11:20.558839 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 724/1379] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:11:19 2022] DELETE /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 0 bytes in 1039 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:11:20.562890 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-dc981012-73fe-4380-b766-f2fedbb7c02d tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb9645d5e0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:20.612966 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-dc981012-73fe-4380-b766-f2fedbb7c02d tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430" status: 200 len: 1426 microversion: 2.1 time: 0.057271 Apr 16 21:11:20.613557 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 725/1380] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:11:20 2022] GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430 => generated 1426 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:20.624064 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a151dddf-d7ee-42d8-b121-f161172ee5fa tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:20.624859 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a151dddf-d7ee-42d8-b121-f161172ee5fa tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:20.631621 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a151dddf-d7ee-42d8-b121-f161172ee5fa tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:20.632090 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a151dddf-d7ee-42d8-b121-f161172ee5fa tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:20.636994 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a151dddf-d7ee-42d8-b121-f161172ee5fa tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:20.636994 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a151dddf-d7ee-42d8-b121-f161172ee5fa tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:20.688817 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-68d49ff1-0d4f-485c-a7a7-5c35af885865 tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf" status: 200 len: 1617 microversion: 2.1 time: 0.153598 Apr 16 21:11:20.690654 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 656/1381] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:20 2022] GET /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf => generated 1617 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:20.731852 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-89d90889-a99a-4189-bdc4-e2844f30923a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:20.732762 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-89d90889-a99a-4189-bdc4-e2844f30923a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:20.742528 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-89d90889-a99a-4189-bdc4-e2844f30923a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:20.742993 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-89d90889-a99a-4189-bdc4-e2844f30923a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:20.743786 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-89d90889-a99a-4189-bdc4-e2844f30923a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:20.744344 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-89d90889-a99a-4189-bdc4-e2844f30923a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:20.832621 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a151dddf-d7ee-42d8-b121-f161172ee5fa tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:20.844126 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a151dddf-d7ee-42d8-b121-f161172ee5fa tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1470 microversion: 2.1 time: 0.224019 Apr 16 21:11:20.845896 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 726/1382] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:20 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1470 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:20.850667 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ee96f881-64a8-4372-bec9-224e0332f3d2 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-193069996", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "7b856a59-2a62-4edc-b448-430f778c7b2e"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:11:20.913658 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-ee96f881-64a8-4372-bec9-224e0332f3d2 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] validate_networks() for None {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:11:21.027862 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-89d90889-a99a-4189-bdc4-e2844f30923a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:21.039040 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-89d90889-a99a-4189-bdc4-e2844f30923a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1549 microversion: 2.1 time: 0.313661 Apr 16 21:11:21.043250 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 657/1383] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:20 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1549 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:21.217140 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-ee96f881-64a8-4372-bec9-224e0332f3d2 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:11:21.217957 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-ee96f881-64a8-4372-bec9-224e0332f3d2 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:11:21.218551 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-ee96f881-64a8-4372-bec9-224e0332f3d2 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:11:21.220161 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-ee96f881-64a8-4372-bec9-224e0332f3d2 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:11:21.221031 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-ee96f881-64a8-4372-bec9-224e0332f3d2 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:11:21.237064 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee96f881-64a8-4372-bec9-224e0332f3d2 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:21.237667 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee96f881-64a8-4372-bec9-224e0332f3d2 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:21.238719 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee96f881-64a8-4372-bec9-224e0332f3d2 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:21.239499 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee96f881-64a8-4372-bec9-224e0332f3d2 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:21.259068 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-ee96f881-64a8-4372-bec9-224e0332f3d2 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Getting quotas for project cd7c434915254744b7a0409ab8e6d33d. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:11:21.265322 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-ee96f881-64a8-4372-bec9-224e0332f3d2 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Getting quotas for user 79f97c1afe5442dc83319237d121c11f and project cd7c434915254744b7a0409ab8e6d33d. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:11:21.278875 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ee96f881-64a8-4372-bec9-224e0332f3d2 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:11:21.288782 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ee96f881-64a8-4372-bec9-224e0332f3d2 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: ba7afa3a-b83e-4837-82f1-4b8bbde7aa92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:11:21.341578 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b8cd9435-8e7b-426d-875f-4056157732fe tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:21.342223 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b8cd9435-8e7b-426d-875f-4056157732fe tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 2b27c826-905d-4c1f-9daf-42150b1025a8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:21.348883 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b8cd9435-8e7b-426d-875f-4056157732fe tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:21.349335 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b8cd9435-8e7b-426d-875f-4056157732fe tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:21.350127 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b8cd9435-8e7b-426d-875f-4056157732fe tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:21.350573 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b8cd9435-8e7b-426d-875f-4056157732fe tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:21.454150 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ee96f881-64a8-4372-bec9-224e0332f3d2 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.606404 Apr 16 21:11:21.459815 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 727/1384] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:11:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:11:21.477726 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-546ef24f-ff24-4e03-b9a3-f80dab0dcac5 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:21.479430 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-546ef24f-ff24-4e03-b9a3-f80dab0dcac5 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: ba7afa3a-b83e-4837-82f1-4b8bbde7aa92] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:21.561894 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-546ef24f-ff24-4e03-b9a3-f80dab0dcac5 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:21.587286 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-546ef24f-ff24-4e03-b9a3-f80dab0dcac5 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92" status: 200 len: 1216 microversion: 2.1 time: 0.120620 Apr 16 21:11:21.594922 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 728/1385] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:21 2022] GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92 => generated 1216 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:11:21.602651 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e3c8774d-e80d-4fef-92a5-ce760f1ef2ca tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:21.605558 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e3c8774d-e80d-4fef-92a5-ce760f1ef2ca tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] [instance: cda4f042-eb49-4d90-ad5e-0e2b81dc0ede] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:21.619818 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e3c8774d-e80d-4fef-92a5-ce760f1ef2ca tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:21.620320 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e3c8774d-e80d-4fef-92a5-ce760f1ef2ca tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:21.621130 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e3c8774d-e80d-4fef-92a5-ce760f1ef2ca tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:21.621607 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e3c8774d-e80d-4fef-92a5-ce760f1ef2ca tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:21.806167 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e3c8774d-e80d-4fef-92a5-ce760f1ef2ca tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453306648f4e4da58ee344c3a51f8110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc15580ef8a449ca359a9d5b799e24d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:21.806167 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e3c8774d-e80d-4fef-92a5-ce760f1ef2ca tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] 10.222.0.20 "GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede" status: 200 len: 1372 microversion: 2.1 time: 0.198514 Apr 16 21:11:21.806167 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 729/1386] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:21 2022] GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede => generated 1372 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:21.806167 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-dacde635-e982-4818-9f6a-029a195c02f6 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb964dce50>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:21.859715 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-dacde635-e982-4818-9f6a-029a195c02f6 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430" status: 200 len: 1426 microversion: 2.1 time: 0.063400 Apr 16 21:11:21.867163 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 730/1387] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:11:21 2022] GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430 => generated 1426 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:21.867163 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7e85545e-f1c9-4f0e-bedc-9761115d5f4d tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:21.867163 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7e85545e-f1c9-4f0e-bedc-9761115d5f4d tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:21.873700 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7e85545e-f1c9-4f0e-bedc-9761115d5f4d tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:21.874445 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7e85545e-f1c9-4f0e-bedc-9761115d5f4d tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:21.876384 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7e85545e-f1c9-4f0e-bedc-9761115d5f4d tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:21.877108 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7e85545e-f1c9-4f0e-bedc-9761115d5f4d tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:22.023754 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b8cd9435-8e7b-426d-875f-4056157732fe tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:22.035875 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b8cd9435-8e7b-426d-875f-4056157732fe tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8" status: 200 len: 1518 microversion: 2.1 time: 0.698073 Apr 16 21:11:22.037072 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 658/1388] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:21 2022] GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8 => generated 1518 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:22.061376 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-68faac4e-133e-4c69-8304-97434ca74a3d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:22.062023 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-68faac4e-133e-4c69-8304-97434ca74a3d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:22.086477 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-68faac4e-133e-4c69-8304-97434ca74a3d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:22.086477 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-68faac4e-133e-4c69-8304-97434ca74a3d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:22.086477 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-68faac4e-133e-4c69-8304-97434ca74a3d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:22.086477 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-68faac4e-133e-4c69-8304-97434ca74a3d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:22.091413 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7e85545e-f1c9-4f0e-bedc-9761115d5f4d tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:22.101859 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7e85545e-f1c9-4f0e-bedc-9761115d5f4d tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1470 microversion: 2.1 time: 0.239212 Apr 16 21:11:22.103293 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 731/1389] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:21 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1470 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:22.249733 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-68faac4e-133e-4c69-8304-97434ca74a3d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:22.258280 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-68faac4e-133e-4c69-8304-97434ca74a3d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1549 microversion: 2.1 time: 0.200751 Apr 16 21:11:22.258858 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 659/1390] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:22 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1549 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:11:22.605891 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-da70ae72-73f6-4583-83a9-e6caa1303c9f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:22.607238 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-da70ae72-73f6-4583-83a9-e6caa1303c9f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: ba7afa3a-b83e-4837-82f1-4b8bbde7aa92] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:22.615996 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-da70ae72-73f6-4583-83a9-e6caa1303c9f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:22.616721 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-da70ae72-73f6-4583-83a9-e6caa1303c9f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:22.617713 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-da70ae72-73f6-4583-83a9-e6caa1303c9f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:22.618233 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-da70ae72-73f6-4583-83a9-e6caa1303c9f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:22.787410 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-da70ae72-73f6-4583-83a9-e6caa1303c9f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:22.815060 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e26bbd5f-ec27-440d-a38d-26e77f3e521f tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:22.815993 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e26bbd5f-ec27-440d-a38d-26e77f3e521f tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] [instance: cda4f042-eb49-4d90-ad5e-0e2b81dc0ede] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:22.822480 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-da70ae72-73f6-4583-83a9-e6caa1303c9f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92" status: 200 len: 1220 microversion: 2.1 time: 0.219601 Apr 16 21:11:22.827586 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 732/1391] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:22 2022] GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92 => generated 1220 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:22.835114 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e26bbd5f-ec27-440d-a38d-26e77f3e521f tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:22.837524 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e26bbd5f-ec27-440d-a38d-26e77f3e521f tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:22.838838 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e26bbd5f-ec27-440d-a38d-26e77f3e521f tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:22.840377 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e26bbd5f-ec27-440d-a38d-26e77f3e521f tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:22.877173 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-20970ce8-643f-4b16-bda4-361b343b22c4 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb961448b0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:23.276001 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e26bbd5f-ec27-440d-a38d-26e77f3e521f tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453306648f4e4da58ee344c3a51f8110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc15580ef8a449ca359a9d5b799e24d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:23.304800 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e26bbd5f-ec27-440d-a38d-26e77f3e521f tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] 10.222.0.20 "GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede" status: 200 len: 1372 microversion: 2.1 time: 0.496211 Apr 16 21:11:23.305436 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 660/1392] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:22 2022] GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede => generated 1372 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:11:23.310908 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c15dee7a-08de-424d-bec6-2a56c7af6735 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:23.311792 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c15dee7a-08de-424d-bec6-2a56c7af6735 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 2b27c826-905d-4c1f-9daf-42150b1025a8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:23.321108 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c15dee7a-08de-424d-bec6-2a56c7af6735 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:23.321898 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c15dee7a-08de-424d-bec6-2a56c7af6735 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:23.322995 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c15dee7a-08de-424d-bec6-2a56c7af6735 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:23.323599 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c15dee7a-08de-424d-bec6-2a56c7af6735 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:23.709079 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c15dee7a-08de-424d-bec6-2a56c7af6735 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:23.717807 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c15dee7a-08de-424d-bec6-2a56c7af6735 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8" status: 200 len: 1518 microversion: 2.1 time: 0.411153 Apr 16 21:11:23.720859 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 661/1393] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:23 2022] GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8 => generated 1518 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:23.727344 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bcc89cc0-5c99-4c58-be0b-7587c3c1cf1f tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:23.732412 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bcc89cc0-5c99-4c58-be0b-7587c3c1cf1f tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:23.749990 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bcc89cc0-5c99-4c58-be0b-7587c3c1cf1f tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:23.750672 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bcc89cc0-5c99-4c58-be0b-7587c3c1cf1f tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:23.751495 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bcc89cc0-5c99-4c58-be0b-7587c3c1cf1f tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:23.751945 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bcc89cc0-5c99-4c58-be0b-7587c3c1cf1f tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:24.197102 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-bcc89cc0-5c99-4c58-be0b-7587c3c1cf1f tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fa9708327d54bbea48ed890d0506ea2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba3fef3234544544870ea9ee02d5b344', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:24.212734 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bcc89cc0-5c99-4c58-be0b-7587c3c1cf1f tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 200 len: 1428 microversion: 2.1 time: 0.482414 Apr 16 21:11:24.213827 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 662/1394] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:23 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 1428 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:24.227575 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-468afffe-2a03-47dc-88c5-4baf97b642b8 req-70d24bd3-985b-4134-a83f-fbb5eae8191a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dfc548c-fae5-47a4-bb2e-8a022ebf6c17", "name": "network-vif-deleted", "tag": "c0642788-5af8-4722-90dd-d3c3c1a8b4a7"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:11:24.259109 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-468afffe-2a03-47dc-88c5-4baf97b642b8 req-70d24bd3-985b-4134-a83f-fbb5eae8191a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:24.261332 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-468afffe-2a03-47dc-88c5-4baf97b642b8 req-70d24bd3-985b-4134-a83f-fbb5eae8191a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:24.286412 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-468afffe-2a03-47dc-88c5-4baf97b642b8 req-70d24bd3-985b-4134-a83f-fbb5eae8191a service nova] Creating event network-vif-deleted:c0642788-5af8-4722-90dd-d3c3c1a8b4a7 for instance 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 on nch1-master-1 Apr 16 21:11:24.303238 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-468afffe-2a03-47dc-88c5-4baf97b642b8 req-70d24bd3-985b-4134-a83f-fbb5eae8191a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087854 Apr 16 21:11:24.307006 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 663/1395] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:11:24.326813 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ebe1d736-877c-451e-835b-1dd0f553c38b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:24.345412 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ebe1d736-877c-451e-835b-1dd0f553c38b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:24.355838 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ebe1d736-877c-451e-835b-1dd0f553c38b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:24.359356 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ebe1d736-877c-451e-835b-1dd0f553c38b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:24.360945 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ebe1d736-877c-451e-835b-1dd0f553c38b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:24.367323 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ebe1d736-877c-451e-835b-1dd0f553c38b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:24.891836 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ebe1d736-877c-451e-835b-1dd0f553c38b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:24.903165 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ebe1d736-877c-451e-835b-1dd0f553c38b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1549 microversion: 2.1 time: 0.589977 Apr 16 21:11:24.905780 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 664/1396] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:24 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1549 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:24.912626 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-572dc6c9-d88a-4c46-af07-6deab8031d4a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:24.914051 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-572dc6c9-d88a-4c46-af07-6deab8031d4a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: ba7afa3a-b83e-4837-82f1-4b8bbde7aa92] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:24.923700 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-572dc6c9-d88a-4c46-af07-6deab8031d4a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:24.924456 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-572dc6c9-d88a-4c46-af07-6deab8031d4a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:24.925596 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-572dc6c9-d88a-4c46-af07-6deab8031d4a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:24.926608 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-572dc6c9-d88a-4c46-af07-6deab8031d4a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:25.098126 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-572dc6c9-d88a-4c46-af07-6deab8031d4a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:25.115201 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-572dc6c9-d88a-4c46-af07-6deab8031d4a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92" status: 200 len: 1286 microversion: 2.1 time: 0.204738 Apr 16 21:11:25.116126 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 665/1397] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:24 2022] GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92 => generated 1286 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:25.129269 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e1d2494b-a0fa-40ce-a4d4-b4d4c9e65d3b tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:25.132530 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e1d2494b-a0fa-40ce-a4d4-b4d4c9e65d3b tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] [instance: cda4f042-eb49-4d90-ad5e-0e2b81dc0ede] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:25.154541 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e1d2494b-a0fa-40ce-a4d4-b4d4c9e65d3b tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:25.155499 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e1d2494b-a0fa-40ce-a4d4-b4d4c9e65d3b tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:25.156755 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e1d2494b-a0fa-40ce-a4d4-b4d4c9e65d3b tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:25.157388 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e1d2494b-a0fa-40ce-a4d4-b4d4c9e65d3b tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:25.407237 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e1d2494b-a0fa-40ce-a4d4-b4d4c9e65d3b tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453306648f4e4da58ee344c3a51f8110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc15580ef8a449ca359a9d5b799e24d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:25.417383 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e1d2494b-a0fa-40ce-a4d4-b4d4c9e65d3b tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] 10.222.0.20 "GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede" status: 200 len: 1372 microversion: 2.1 time: 0.299967 Apr 16 21:11:25.418851 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 666/1398] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:25 2022] GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede => generated 1372 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:25.424627 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-588d3a0a-da74-4802-8cdb-2fc9d22f48af tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:25.425483 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-588d3a0a-da74-4802-8cdb-2fc9d22f48af tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 2b27c826-905d-4c1f-9daf-42150b1025a8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:25.449459 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-588d3a0a-da74-4802-8cdb-2fc9d22f48af tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:25.450110 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-588d3a0a-da74-4802-8cdb-2fc9d22f48af tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:25.454931 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-588d3a0a-da74-4802-8cdb-2fc9d22f48af tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:25.465128 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-588d3a0a-da74-4802-8cdb-2fc9d22f48af tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:25.642975 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-588d3a0a-da74-4802-8cdb-2fc9d22f48af tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:25.651757 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-588d3a0a-da74-4802-8cdb-2fc9d22f48af tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8" status: 200 len: 1476 microversion: 2.1 time: 0.231618 Apr 16 21:11:25.652890 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 667/1399] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:25 2022] GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8 => generated 1476 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:25.665434 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-618587eb-fda0-4e26-807d-a835c687b348 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:25.668558 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-618587eb-fda0-4e26-807d-a835c687b348 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] [instance: 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:25.688542 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-618587eb-fda0-4e26-807d-a835c687b348 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:25.689168 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-618587eb-fda0-4e26-807d-a835c687b348 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:25.690726 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-618587eb-fda0-4e26-807d-a835c687b348 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:25.691207 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-618587eb-fda0-4e26-807d-a835c687b348 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:25.723302 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-618587eb-fda0-4e26-807d-a835c687b348 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] HTTP exception thrown: Instance 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 could not be found. Apr 16 21:11:25.727058 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-618587eb-fda0-4e26-807d-a835c687b348 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] Returning 404 to user: Instance 4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:11:25.728375 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-618587eb-fda0-4e26-807d-a835c687b348 tempest-ServersAdminTestJSON-1890044091 tempest-ServersAdminTestJSON-1890044091-project] 10.222.0.20 "GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17" status: 404 len: 111 microversion: 2.1 time: 0.070830 Apr 16 21:11:25.730490 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 668/1400] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:25 2022] GET /compute/v2.1/servers/4dfc548c-fae5-47a4-bb2e-8a022ebf6c17 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:11:25.921105 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5f1fd3af-abfe-4d35-9b9f-832291bc27a2 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:25.922090 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5f1fd3af-abfe-4d35-9b9f-832291bc27a2 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:25.932277 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5f1fd3af-abfe-4d35-9b9f-832291bc27a2 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:25.936540 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5f1fd3af-abfe-4d35-9b9f-832291bc27a2 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:25.937781 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5f1fd3af-abfe-4d35-9b9f-832291bc27a2 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:25.945515 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5f1fd3af-abfe-4d35-9b9f-832291bc27a2 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:26.253435 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5f1fd3af-abfe-4d35-9b9f-832291bc27a2 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:26.263737 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5f1fd3af-abfe-4d35-9b9f-832291bc27a2 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1549 microversion: 2.1 time: 0.346512 Apr 16 21:11:26.264993 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 669/1401] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:25 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1549 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:26.283330 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d94390d5-d807-4d7a-be84-30d4b69655e3 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:26.285636 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d94390d5-d807-4d7a-be84-30d4b69655e3 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: ba7afa3a-b83e-4837-82f1-4b8bbde7aa92] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:26.296550 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d94390d5-d807-4d7a-be84-30d4b69655e3 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:26.297847 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d94390d5-d807-4d7a-be84-30d4b69655e3 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:26.298866 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d94390d5-d807-4d7a-be84-30d4b69655e3 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:26.299625 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d94390d5-d807-4d7a-be84-30d4b69655e3 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:26.467353 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d94390d5-d807-4d7a-be84-30d4b69655e3 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:26.491553 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d94390d5-d807-4d7a-be84-30d4b69655e3 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92" status: 200 len: 1286 microversion: 2.1 time: 0.224302 Apr 16 21:11:26.493294 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 670/1402] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:26 2022] GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92 => generated 1286 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:26.507399 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-243da877-75e7-4d61-aa71-305314543fc5 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:26.514501 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-243da877-75e7-4d61-aa71-305314543fc5 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] [instance: cda4f042-eb49-4d90-ad5e-0e2b81dc0ede] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:26.525490 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-243da877-75e7-4d61-aa71-305314543fc5 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:26.527946 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-243da877-75e7-4d61-aa71-305314543fc5 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:26.533553 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-243da877-75e7-4d61-aa71-305314543fc5 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:26.538133 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-243da877-75e7-4d61-aa71-305314543fc5 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:26.851178 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-243da877-75e7-4d61-aa71-305314543fc5 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453306648f4e4da58ee344c3a51f8110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc15580ef8a449ca359a9d5b799e24d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:26.898111 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-243da877-75e7-4d61-aa71-305314543fc5 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] 10.222.0.20 "GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede" status: 200 len: 1372 microversion: 2.1 time: 0.402698 Apr 16 21:11:26.905266 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 671/1403] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:26 2022] GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede => generated 1372 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:26.944414 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-93ef51d0-7124-4562-8fe8-8f4da82041fc req-501e5e2c-7c4d-40ba-ae9c-90b42f1a03ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b27c826-905d-4c1f-9daf-42150b1025a8", "name": "network-vif-deleted", "tag": "2c7070d9-a898-425b-bd50-ce8c757adf87"}, {"server_uuid": "d971969c-aa4b-4761-a632-23f88b833ec4", "name": "network-vif-unplugged", "status": "completed", "tag": "0e96d99c-8339-47c4-aadc-62a791ca4b9a"}, {"name": "network-changed", "server_uuid": "d971969c-aa4b-4761-a632-23f88b833ec4", "tag": "0e96d99c-8339-47c4-aadc-62a791ca4b9a"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:11:27.018927 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-93ef51d0-7124-4562-8fe8-8f4da82041fc req-501e5e2c-7c4d-40ba-ae9c-90b42f1a03ef service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:27.019033 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-93ef51d0-7124-4562-8fe8-8f4da82041fc req-501e5e2c-7c4d-40ba-ae9c-90b42f1a03ef service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:27.088880 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-93ef51d0-7124-4562-8fe8-8f4da82041fc req-501e5e2c-7c4d-40ba-ae9c-90b42f1a03ef service nova] Creating event network-vif-deleted:2c7070d9-a898-425b-bd50-ce8c757adf87 for instance 2b27c826-905d-4c1f-9daf-42150b1025a8 on nch2-master-1 Apr 16 21:11:27.089716 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-93ef51d0-7124-4562-8fe8-8f4da82041fc req-501e5e2c-7c4d-40ba-ae9c-90b42f1a03ef service nova] Creating event network-vif-unplugged:0e96d99c-8339-47c4-aadc-62a791ca4b9a for instance d971969c-aa4b-4761-a632-23f88b833ec4 on nch2-master-1 Apr 16 21:11:27.090251 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-93ef51d0-7124-4562-8fe8-8f4da82041fc req-501e5e2c-7c4d-40ba-ae9c-90b42f1a03ef service nova] Creating event network-changed:0e96d99c-8339-47c4-aadc-62a791ca4b9a for instance d971969c-aa4b-4761-a632-23f88b833ec4 on nch2-master-1 Apr 16 21:11:27.104518 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-93ef51d0-7124-4562-8fe8-8f4da82041fc req-501e5e2c-7c4d-40ba-ae9c-90b42f1a03ef service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 523 microversion: 2.1 time: 0.191148 Apr 16 21:11:27.105661 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 672/1404] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 523 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:11:27.115002 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0794e859-a420-4b8a-9fd0-852405668d3d tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:27.117338 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0794e859-a420-4b8a-9fd0-852405668d3d tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 2b27c826-905d-4c1f-9daf-42150b1025a8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:27.145960 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0794e859-a420-4b8a-9fd0-852405668d3d tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:27.146782 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0794e859-a420-4b8a-9fd0-852405668d3d tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:27.149263 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0794e859-a420-4b8a-9fd0-852405668d3d tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:27.150595 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0794e859-a420-4b8a-9fd0-852405668d3d tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:27.319783 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0794e859-a420-4b8a-9fd0-852405668d3d tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:27.334739 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0794e859-a420-4b8a-9fd0-852405668d3d tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8" status: 200 len: 1476 microversion: 2.1 time: 0.224922 Apr 16 21:11:27.335523 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 673/1405] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:27 2022] GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8 => generated 1476 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:27.341907 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-64b87626-c818-4381-a7f2-f83387f903d7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:27.342698 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-64b87626-c818-4381-a7f2-f83387f903d7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:27.359479 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-64b87626-c818-4381-a7f2-f83387f903d7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:27.359974 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-64b87626-c818-4381-a7f2-f83387f903d7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:27.360794 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-64b87626-c818-4381-a7f2-f83387f903d7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:27.361233 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-64b87626-c818-4381-a7f2-f83387f903d7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:27.734454 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-64b87626-c818-4381-a7f2-f83387f903d7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:27.744773 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-64b87626-c818-4381-a7f2-f83387f903d7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1549 microversion: 2.1 time: 0.406586 Apr 16 21:11:27.749251 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 674/1406] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:27 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1549 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:27.759162 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-36bdbce2-f5f0-4289-9221-e31a0197184f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:27.762078 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-36bdbce2-f5f0-4289-9221-e31a0197184f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: ba7afa3a-b83e-4837-82f1-4b8bbde7aa92] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:27.773853 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-36bdbce2-f5f0-4289-9221-e31a0197184f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:27.775977 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-36bdbce2-f5f0-4289-9221-e31a0197184f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:27.778952 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-36bdbce2-f5f0-4289-9221-e31a0197184f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:27.780545 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-36bdbce2-f5f0-4289-9221-e31a0197184f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:27.970153 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-36bdbce2-f5f0-4289-9221-e31a0197184f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:27.992346 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-36bdbce2-f5f0-4289-9221-e31a0197184f tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92" status: 200 len: 1274 microversion: 2.1 time: 0.233579 Apr 16 21:11:27.993792 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 675/1407] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:27 2022] GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92 => generated 1274 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:28.000056 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-21fe1ada-1be7-4014-bc44-474f3d8aefa8 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:28.001492 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-21fe1ada-1be7-4014-bc44-474f3d8aefa8 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] [instance: cda4f042-eb49-4d90-ad5e-0e2b81dc0ede] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:28.028319 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-21fe1ada-1be7-4014-bc44-474f3d8aefa8 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:28.032045 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-21fe1ada-1be7-4014-bc44-474f3d8aefa8 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:28.036488 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-21fe1ada-1be7-4014-bc44-474f3d8aefa8 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:28.037226 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-21fe1ada-1be7-4014-bc44-474f3d8aefa8 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:28.963681 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-21fe1ada-1be7-4014-bc44-474f3d8aefa8 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453306648f4e4da58ee344c3a51f8110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc15580ef8a449ca359a9d5b799e24d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:28.976425 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-21fe1ada-1be7-4014-bc44-474f3d8aefa8 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] 10.222.0.20 "GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede" status: 200 len: 1372 microversion: 2.1 time: 0.979650 Apr 16 21:11:28.977247 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 676/1408] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:27 2022] GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede => generated 1372 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:28.988164 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5adb2bbf-3708-4f7d-a064-c7c8c396b5c5 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:28.993976 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5adb2bbf-3708-4f7d-a064-c7c8c396b5c5 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 2b27c826-905d-4c1f-9daf-42150b1025a8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:29.003929 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5adb2bbf-3708-4f7d-a064-c7c8c396b5c5 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:29.007893 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5adb2bbf-3708-4f7d-a064-c7c8c396b5c5 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:29.008781 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5adb2bbf-3708-4f7d-a064-c7c8c396b5c5 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:29.009232 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5adb2bbf-3708-4f7d-a064-c7c8c396b5c5 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:29.084510 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5adb2bbf-3708-4f7d-a064-c7c8c396b5c5 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:29.085305 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5adb2bbf-3708-4f7d-a064-c7c8c396b5c5 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:29.085959 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-5adb2bbf-3708-4f7d-a064-c7c8c396b5c5 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lazy-loading 'fault' on Instance uuid 2b27c826-905d-4c1f-9daf-42150b1025a8 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:11:29.169751 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5adb2bbf-3708-4f7d-a064-c7c8c396b5c5 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0dbf714013674b60b34b2d775a15e722', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d26c031a97c437dad0a3eae0fe2ab8c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:29.187307 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5adb2bbf-3708-4f7d-a064-c7c8c396b5c5 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8" status: 200 len: 1311 microversion: 2.1 time: 0.208183 Apr 16 21:11:29.194046 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 677/1409] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:28 2022] GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8 => generated 1311 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:29.206992 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-47f2f9e8-6e74-46c2-b96d-a683d7a618c1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:29.215525 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-47f2f9e8-6e74-46c2-b96d-a683d7a618c1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:29.229840 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-47f2f9e8-6e74-46c2-b96d-a683d7a618c1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:29.230838 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-47f2f9e8-6e74-46c2-b96d-a683d7a618c1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:29.232272 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-47f2f9e8-6e74-46c2-b96d-a683d7a618c1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:29.233292 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-47f2f9e8-6e74-46c2-b96d-a683d7a618c1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:29.438154 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-47f2f9e8-6e74-46c2-b96d-a683d7a618c1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:29.447749 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-47f2f9e8-6e74-46c2-b96d-a683d7a618c1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1549 microversion: 2.1 time: 0.252201 Apr 16 21:11:29.449048 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 678/1410] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:29 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1549 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:29.462696 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a8eee3b7-bcd6-4c7a-a732-1f6150306764 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:29.464010 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a8eee3b7-bcd6-4c7a-a732-1f6150306764 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: ba7afa3a-b83e-4837-82f1-4b8bbde7aa92] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:29.474796 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a8eee3b7-bcd6-4c7a-a732-1f6150306764 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:29.475299 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a8eee3b7-bcd6-4c7a-a732-1f6150306764 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:29.475815 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a8eee3b7-bcd6-4c7a-a732-1f6150306764 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:29.476629 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a8eee3b7-bcd6-4c7a-a732-1f6150306764 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:29.684432 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a8eee3b7-bcd6-4c7a-a732-1f6150306764 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:29.697995 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a8eee3b7-bcd6-4c7a-a732-1f6150306764 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92" status: 200 len: 1316 microversion: 2.1 time: 0.246851 Apr 16 21:11:29.699457 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 679/1411] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:29 2022] GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92 => generated 1316 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:29.994790 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-86737e38-67ea-4476-843d-91aeda2ff238 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:29.995393 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-86737e38-67ea-4476-843d-91aeda2ff238 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] [instance: cda4f042-eb49-4d90-ad5e-0e2b81dc0ede] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:30.005752 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-86737e38-67ea-4476-843d-91aeda2ff238 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:30.008268 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-86737e38-67ea-4476-843d-91aeda2ff238 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:30.009124 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-86737e38-67ea-4476-843d-91aeda2ff238 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:30.009552 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-86737e38-67ea-4476-843d-91aeda2ff238 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:30.298550 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-86737e38-67ea-4476-843d-91aeda2ff238 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453306648f4e4da58ee344c3a51f8110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc15580ef8a449ca359a9d5b799e24d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:30.312397 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-86737e38-67ea-4476-843d-91aeda2ff238 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] 10.222.0.20 "GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede" status: 200 len: 1372 microversion: 2.1 time: 0.322123 Apr 16 21:11:30.312930 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 680/1412] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:29 2022] GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede => generated 1372 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:11:30.318513 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-155a2ca7-44f1-4af8-9cab-10a6c0a12879 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:30.319341 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-155a2ca7-44f1-4af8-9cab-10a6c0a12879 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] [instance: 2b27c826-905d-4c1f-9daf-42150b1025a8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:30.326044 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-155a2ca7-44f1-4af8-9cab-10a6c0a12879 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:30.327273 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-155a2ca7-44f1-4af8-9cab-10a6c0a12879 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:30.328395 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-155a2ca7-44f1-4af8-9cab-10a6c0a12879 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:30.329048 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-155a2ca7-44f1-4af8-9cab-10a6c0a12879 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:30.345917 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-155a2ca7-44f1-4af8-9cab-10a6c0a12879 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] HTTP exception thrown: Instance 2b27c826-905d-4c1f-9daf-42150b1025a8 could not be found. Apr 16 21:11:30.346825 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-155a2ca7-44f1-4af8-9cab-10a6c0a12879 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] Returning 404 to user: Instance 2b27c826-905d-4c1f-9daf-42150b1025a8 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:11:30.348467 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-155a2ca7-44f1-4af8-9cab-10a6c0a12879 tempest-ListServerFiltersTestJSON-1890000315 tempest-ListServerFiltersTestJSON-1890000315-project] 10.222.0.20 "GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8" status: 404 len: 111 microversion: 2.1 time: 0.034429 Apr 16 21:11:30.349840 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 681/1413] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:30 2022] GET /compute/v2.1/servers/2b27c826-905d-4c1f-9daf-42150b1025a8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:11:30.474124 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-71849d1a-9cfd-4a5d-86bf-3655bf09fb97 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:30.476349 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-71849d1a-9cfd-4a5d-86bf-3655bf09fb97 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:30.486591 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-71849d1a-9cfd-4a5d-86bf-3655bf09fb97 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:30.492889 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-71849d1a-9cfd-4a5d-86bf-3655bf09fb97 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:30.494029 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-71849d1a-9cfd-4a5d-86bf-3655bf09fb97 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:30.497569 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-71849d1a-9cfd-4a5d-86bf-3655bf09fb97 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:30.839881 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-71849d1a-9cfd-4a5d-86bf-3655bf09fb97 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:30.850365 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-71849d1a-9cfd-4a5d-86bf-3655bf09fb97 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1549 microversion: 2.1 time: 0.387380 Apr 16 21:11:30.865714 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 682/1414] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:30 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1549 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:30.865714 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-83fb9f06-867a-40cf-98ae-2dc8586ef3c5 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:30.867630 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-83fb9f06-867a-40cf-98ae-2dc8586ef3c5 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: ba7afa3a-b83e-4837-82f1-4b8bbde7aa92] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:30.881144 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-83fb9f06-867a-40cf-98ae-2dc8586ef3c5 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:30.881610 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-83fb9f06-867a-40cf-98ae-2dc8586ef3c5 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:30.882969 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-83fb9f06-867a-40cf-98ae-2dc8586ef3c5 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:30.883424 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-83fb9f06-867a-40cf-98ae-2dc8586ef3c5 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:31.186056 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-83fb9f06-867a-40cf-98ae-2dc8586ef3c5 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:31.199502 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-83fb9f06-867a-40cf-98ae-2dc8586ef3c5 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92" status: 200 len: 1316 microversion: 2.1 time: 0.340520 Apr 16 21:11:31.200675 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 683/1415] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:30 2022] GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92 => generated 1316 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:31.330219 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-26d1b9f3-1870-491e-98d4-b87d1437aa49 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:31.330987 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-26d1b9f3-1870-491e-98d4-b87d1437aa49 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] [instance: cda4f042-eb49-4d90-ad5e-0e2b81dc0ede] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:31.338520 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-26d1b9f3-1870-491e-98d4-b87d1437aa49 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:31.339272 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-26d1b9f3-1870-491e-98d4-b87d1437aa49 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:31.340268 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-26d1b9f3-1870-491e-98d4-b87d1437aa49 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:31.341160 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-26d1b9f3-1870-491e-98d4-b87d1437aa49 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:31.707320 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-26d1b9f3-1870-491e-98d4-b87d1437aa49 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453306648f4e4da58ee344c3a51f8110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc15580ef8a449ca359a9d5b799e24d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:31.719351 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-26d1b9f3-1870-491e-98d4-b87d1437aa49 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] 10.222.0.20 "GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede" status: 200 len: 1372 microversion: 2.1 time: 0.393612 Apr 16 21:11:31.724223 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 684/1416] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:31 2022] GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede => generated 1372 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:11:31.874279 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e2f114af-4994-4e03-8117-dcac5c366452 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:31.874836 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e2f114af-4994-4e03-8117-dcac5c366452 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:31.887261 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e2f114af-4994-4e03-8117-dcac5c366452 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:31.893711 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e2f114af-4994-4e03-8117-dcac5c366452 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:31.893711 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e2f114af-4994-4e03-8117-dcac5c366452 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:31.893711 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e2f114af-4994-4e03-8117-dcac5c366452 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:32.308840 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e2f114af-4994-4e03-8117-dcac5c366452 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:32.321153 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e2f114af-4994-4e03-8117-dcac5c366452 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1549 microversion: 2.1 time: 0.451386 Apr 16 21:11:32.322208 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 685/1417] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:31 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1549 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:11:32.338758 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7021257f-c8de-461b-9c3e-ea86321240e0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:32.339388 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7021257f-c8de-461b-9c3e-ea86321240e0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: ba7afa3a-b83e-4837-82f1-4b8bbde7aa92] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:32.368521 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7021257f-c8de-461b-9c3e-ea86321240e0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:32.369016 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7021257f-c8de-461b-9c3e-ea86321240e0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:32.369851 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7021257f-c8de-461b-9c3e-ea86321240e0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:32.376542 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7021257f-c8de-461b-9c3e-ea86321240e0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:32.714558 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7021257f-c8de-461b-9c3e-ea86321240e0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:32.733858 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7021257f-c8de-461b-9c3e-ea86321240e0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92" status: 200 len: 1316 microversion: 2.1 time: 0.410158 Apr 16 21:11:32.735141 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 686/1418] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:32 2022] GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92 => generated 1316 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:32.753237 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-22d262e4-6845-46e8-8b99-28e03e1afd99 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:32.754548 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-22d262e4-6845-46e8-8b99-28e03e1afd99 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] [instance: cda4f042-eb49-4d90-ad5e-0e2b81dc0ede] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:32.767110 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-22d262e4-6845-46e8-8b99-28e03e1afd99 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:32.767872 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-22d262e4-6845-46e8-8b99-28e03e1afd99 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:32.772087 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-22d262e4-6845-46e8-8b99-28e03e1afd99 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:32.772087 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-22d262e4-6845-46e8-8b99-28e03e1afd99 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:33.136132 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-22d262e4-6845-46e8-8b99-28e03e1afd99 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453306648f4e4da58ee344c3a51f8110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc15580ef8a449ca359a9d5b799e24d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:33.148278 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-22d262e4-6845-46e8-8b99-28e03e1afd99 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] 10.222.0.20 "GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede" status: 200 len: 1372 microversion: 2.1 time: 0.405462 Apr 16 21:11:33.169066 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 687/1419] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:32 2022] GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede => generated 1372 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:11:33.193001 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-92791088-e335-4ba2-8795-0c26c01c56ae req-5e806878-8c99-4fc0-b35d-669aedf2469e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba7afa3a-b83e-4837-82f1-4b8bbde7aa92", "tag": "01db81d7-89fe-4fec-82e4-50d8db8020e2"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:11:33.229322 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-92791088-e335-4ba2-8795-0c26c01c56ae req-5e806878-8c99-4fc0-b35d-669aedf2469e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:33.230875 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-92791088-e335-4ba2-8795-0c26c01c56ae req-5e806878-8c99-4fc0-b35d-669aedf2469e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:33.263189 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-92791088-e335-4ba2-8795-0c26c01c56ae req-5e806878-8c99-4fc0-b35d-669aedf2469e service nova] Creating event network-changed:01db81d7-89fe-4fec-82e4-50d8db8020e2 for instance ba7afa3a-b83e-4837-82f1-4b8bbde7aa92 on nch2-master-1 Apr 16 21:11:33.275808 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-92791088-e335-4ba2-8795-0c26c01c56ae req-5e806878-8c99-4fc0-b35d-669aedf2469e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084634 Apr 16 21:11:33.277095 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 688/1420] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:11:33.341202 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-36831aac-b4b1-4260-88b2-c7dbef205519 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:33.341963 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-36831aac-b4b1-4260-88b2-c7dbef205519 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:33.365659 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-36831aac-b4b1-4260-88b2-c7dbef205519 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:33.366931 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-36831aac-b4b1-4260-88b2-c7dbef205519 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:33.368424 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-36831aac-b4b1-4260-88b2-c7dbef205519 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:33.369322 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-36831aac-b4b1-4260-88b2-c7dbef205519 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:33.622243 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-36831aac-b4b1-4260-88b2-c7dbef205519 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:33.631974 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-36831aac-b4b1-4260-88b2-c7dbef205519 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1549 microversion: 2.1 time: 0.296751 Apr 16 21:11:33.633876 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 689/1421] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:33 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1549 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:11:33.758097 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ebeeaf8e-5c92-4101-aa66-a791e32f7a40 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:33.759745 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ebeeaf8e-5c92-4101-aa66-a791e32f7a40 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: ba7afa3a-b83e-4837-82f1-4b8bbde7aa92] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:33.773318 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ebeeaf8e-5c92-4101-aa66-a791e32f7a40 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:33.774074 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ebeeaf8e-5c92-4101-aa66-a791e32f7a40 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:33.775045 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ebeeaf8e-5c92-4101-aa66-a791e32f7a40 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:33.776231 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ebeeaf8e-5c92-4101-aa66-a791e32f7a40 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:33.947741 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ebeeaf8e-5c92-4101-aa66-a791e32f7a40 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:33.958453 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ebeeaf8e-5c92-4101-aa66-a791e32f7a40 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92" status: 200 len: 1316 microversion: 2.1 time: 0.204690 Apr 16 21:11:33.970646 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 690/1422] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:33 2022] GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92 => generated 1316 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:34.178267 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-54dcf424-7bf7-477b-98a6-a7b4730a2d66 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:34.179456 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-54dcf424-7bf7-477b-98a6-a7b4730a2d66 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] [instance: cda4f042-eb49-4d90-ad5e-0e2b81dc0ede] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:34.192639 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-54dcf424-7bf7-477b-98a6-a7b4730a2d66 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:34.195523 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-54dcf424-7bf7-477b-98a6-a7b4730a2d66 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:34.197460 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-54dcf424-7bf7-477b-98a6-a7b4730a2d66 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:34.197917 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-54dcf424-7bf7-477b-98a6-a7b4730a2d66 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:34.516462 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-54dcf424-7bf7-477b-98a6-a7b4730a2d66 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453306648f4e4da58ee344c3a51f8110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc15580ef8a449ca359a9d5b799e24d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:34.533114 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-54dcf424-7bf7-477b-98a6-a7b4730a2d66 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] 10.222.0.20 "GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede" status: 200 len: 1372 microversion: 2.1 time: 0.359855 Apr 16 21:11:34.541816 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 691/1423] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:34 2022] GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede => generated 1372 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:11:34.563262 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-ab385b56-7fd4-4bec-b32d-c64779a73845 req-10493d2a-0764-40ae-a88c-39f134c2e471 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cda4f042-eb49-4d90-ad5e-0e2b81dc0ede", "name": "network-vif-plugged", "status": "completed", "tag": "341f7886-de89-42fb-840b-8879233ec19f"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:11:34.595084 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-ab385b56-7fd4-4bec-b32d-c64779a73845 req-10493d2a-0764-40ae-a88c-39f134c2e471 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:34.611631 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-ab385b56-7fd4-4bec-b32d-c64779a73845 req-10493d2a-0764-40ae-a88c-39f134c2e471 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:34.652386 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-ab385b56-7fd4-4bec-b32d-c64779a73845 req-10493d2a-0764-40ae-a88c-39f134c2e471 service nova] Creating event network-vif-plugged:341f7886-de89-42fb-840b-8879233ec19f for instance cda4f042-eb49-4d90-ad5e-0e2b81dc0ede on nch2-master-1 Apr 16 21:11:34.660387 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-ab385b56-7fd4-4bec-b32d-c64779a73845 req-10493d2a-0764-40ae-a88c-39f134c2e471 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114626 Apr 16 21:11:34.661643 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 692/1424] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:11:34.669238 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2e9d747f-8624-413c-ac79-3bf34e5ef832 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:34.670250 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2e9d747f-8624-413c-ac79-3bf34e5ef832 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:34.678616 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2e9d747f-8624-413c-ac79-3bf34e5ef832 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:34.688440 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2e9d747f-8624-413c-ac79-3bf34e5ef832 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:34.688440 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2e9d747f-8624-413c-ac79-3bf34e5ef832 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:34.688440 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2e9d747f-8624-413c-ac79-3bf34e5ef832 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:35.168698 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2e9d747f-8624-413c-ac79-3bf34e5ef832 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:35.177531 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2e9d747f-8624-413c-ac79-3bf34e5ef832 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1549 microversion: 2.1 time: 0.513967 Apr 16 21:11:35.187641 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 693/1425] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:34 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1549 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:35.187641 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-07013a81-4ff5-40d3-9f94-80f4b0f9b80b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:35.192350 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-07013a81-4ff5-40d3-9f94-80f4b0f9b80b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: ba7afa3a-b83e-4837-82f1-4b8bbde7aa92] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:35.211525 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-07013a81-4ff5-40d3-9f94-80f4b0f9b80b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:35.212053 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-07013a81-4ff5-40d3-9f94-80f4b0f9b80b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:35.212922 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-07013a81-4ff5-40d3-9f94-80f4b0f9b80b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:35.213407 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-07013a81-4ff5-40d3-9f94-80f4b0f9b80b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:35.416774 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-07013a81-4ff5-40d3-9f94-80f4b0f9b80b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:35.426578 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-07013a81-4ff5-40d3-9f94-80f4b0f9b80b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92" status: 200 len: 1316 microversion: 2.1 time: 0.244728 Apr 16 21:11:35.442709 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 694/1426] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:35 2022] GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92 => generated 1316 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:35.820194 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-766e785a-9a9b-4b68-ae40-787503e6beb0 tempest-ServicesAdminNegativeTestJSON-372374819 tempest-ServicesAdminNegativeTestJSON-372374819-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:35.822023 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:11:35.822023 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:11:35.823503 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-766e785a-9a9b-4b68-ae40-787503e6beb0 tempest-ServicesAdminNegativeTestJSON-372374819 tempest-ServicesAdminNegativeTestJSON-372374819-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:35.824071 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-766e785a-9a9b-4b68-ae40-787503e6beb0 tempest-ServicesAdminNegativeTestJSON-372374819 tempest-ServicesAdminNegativeTestJSON-372374819-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:35.829801 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-766e785a-9a9b-4b68-ae40-787503e6beb0 tempest-ServicesAdminNegativeTestJSON-372374819 tempest-ServicesAdminNegativeTestJSON-372374819-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:35.830375 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-766e785a-9a9b-4b68-ae40-787503e6beb0 tempest-ServicesAdminNegativeTestJSON-372374819 tempest-ServicesAdminNegativeTestJSON-372374819-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:35.858106 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-766e785a-9a9b-4b68-ae40-787503e6beb0 tempest-ServicesAdminNegativeTestJSON-372374819 tempest-ServicesAdminNegativeTestJSON-372374819-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.409741 Apr 16 21:11:35.862024 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 695/1427] 10.222.0.20 () {58 vars in 1136 bytes} [Sat Apr 16 21:11:35 2022] GET /compute/v2.1/os-services => generated 947 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:11:35.868987 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-495cb98b-40f3-4230-9e4c-2b27310bf848 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:35.869660 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-495cb98b-40f3-4230-9e4c-2b27310bf848 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] [instance: cda4f042-eb49-4d90-ad5e-0e2b81dc0ede] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:35.881264 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-495cb98b-40f3-4230-9e4c-2b27310bf848 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:35.881718 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-495cb98b-40f3-4230-9e4c-2b27310bf848 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:35.898419 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-495cb98b-40f3-4230-9e4c-2b27310bf848 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:35.898419 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-495cb98b-40f3-4230-9e4c-2b27310bf848 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:36.054515 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-495cb98b-40f3-4230-9e4c-2b27310bf848 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453306648f4e4da58ee344c3a51f8110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc15580ef8a449ca359a9d5b799e24d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:36.064721 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-495cb98b-40f3-4230-9e4c-2b27310bf848 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] 10.222.0.20 "GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede" status: 200 len: 1372 microversion: 2.1 time: 0.201437 Apr 16 21:11:36.065305 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 696/1428] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:35 2022] GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede => generated 1372 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:36.079799 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-365af74f-cc9d-4d9f-9eb9-1580f6f61020 tempest-ServicesAdminNegativeTestJSON-372374819 tempest-ServicesAdminNegativeTestJSON-372374819-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:36.081237 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:11:36.081237 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:11:36.082862 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-365af74f-cc9d-4d9f-9eb9-1580f6f61020 tempest-ServicesAdminNegativeTestJSON-372374819 tempest-ServicesAdminNegativeTestJSON-372374819-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:36.083326 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-365af74f-cc9d-4d9f-9eb9-1580f6f61020 tempest-ServicesAdminNegativeTestJSON-372374819 tempest-ServicesAdminNegativeTestJSON-372374819-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:36.084158 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-365af74f-cc9d-4d9f-9eb9-1580f6f61020 tempest-ServicesAdminNegativeTestJSON-372374819 tempest-ServicesAdminNegativeTestJSON-372374819-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:36.084639 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-365af74f-cc9d-4d9f-9eb9-1580f6f61020 tempest-ServicesAdminNegativeTestJSON-372374819 tempest-ServicesAdminNegativeTestJSON-372374819-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:36.108088 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-365af74f-cc9d-4d9f-9eb9-1580f6f61020 tempest-ServicesAdminNegativeTestJSON-372374819 tempest-ServicesAdminNegativeTestJSON-372374819-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.032695 Apr 16 21:11:36.108717 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 697/1429] 10.222.0.20 () {58 vars in 1169 bytes} [Sat Apr 16 21:11:36 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 947 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:11:36.119554 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-31a54507-fb9c-4b8c-ab14-7c667a9c1325 tempest-ServicesAdminNegativeTestJSON-372374819 tempest-ServicesAdminNegativeTestJSON-372374819-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:36.120775 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:11:36.120775 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:11:36.122052 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-31a54507-fb9c-4b8c-ab14-7c667a9c1325 tempest-ServicesAdminNegativeTestJSON-372374819 tempest-ServicesAdminNegativeTestJSON-372374819-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:36.122539 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-31a54507-fb9c-4b8c-ab14-7c667a9c1325 tempest-ServicesAdminNegativeTestJSON-372374819 tempest-ServicesAdminNegativeTestJSON-372374819-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:36.123388 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-31a54507-fb9c-4b8c-ab14-7c667a9c1325 tempest-ServicesAdminNegativeTestJSON-372374819 tempest-ServicesAdminNegativeTestJSON-372374819-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:36.123839 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-31a54507-fb9c-4b8c-ab14-7c667a9c1325 tempest-ServicesAdminNegativeTestJSON-372374819 tempest-ServicesAdminNegativeTestJSON-372374819-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:36.148455 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-31a54507-fb9c-4b8c-ab14-7c667a9c1325 tempest-ServicesAdminNegativeTestJSON-372374819 tempest-ServicesAdminNegativeTestJSON-372374819-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.032260 Apr 16 21:11:36.149055 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 698/1430] 10.222.0.20 () {58 vars in 1136 bytes} [Sat Apr 16 21:11:36 2022] GET /compute/v2.1/os-services => generated 947 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:11:36.160452 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-21ac2c63-623d-4ca8-aeff-33a9caf99bb3 tempest-ServicesAdminNegativeTestJSON-372374819 tempest-ServicesAdminNegativeTestJSON-372374819-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:36.161745 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:11:36.161745 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:11:36.162958 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-21ac2c63-623d-4ca8-aeff-33a9caf99bb3 tempest-ServicesAdminNegativeTestJSON-372374819 tempest-ServicesAdminNegativeTestJSON-372374819-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:36.163422 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-21ac2c63-623d-4ca8-aeff-33a9caf99bb3 tempest-ServicesAdminNegativeTestJSON-372374819 tempest-ServicesAdminNegativeTestJSON-372374819-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:36.164291 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-21ac2c63-623d-4ca8-aeff-33a9caf99bb3 tempest-ServicesAdminNegativeTestJSON-372374819 tempest-ServicesAdminNegativeTestJSON-372374819-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:36.164747 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-21ac2c63-623d-4ca8-aeff-33a9caf99bb3 tempest-ServicesAdminNegativeTestJSON-372374819 tempest-ServicesAdminNegativeTestJSON-372374819-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:36.188548 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-21ac2c63-623d-4ca8-aeff-33a9caf99bb3 tempest-ServicesAdminNegativeTestJSON-372374819 tempest-ServicesAdminNegativeTestJSON-372374819-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.032635 Apr 16 21:11:36.189221 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 699/1431] 10.222.0.20 () {58 vars in 1195 bytes} [Sat Apr 16 21:11:36 2022] GET /compute/v2.1/os-services?host=ncdv-master-1&binary=xxx => generated 16 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 16 21:11:36.198957 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4de3da32-9c2d-433a-9fa3-0d8bb30202c6 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:36.199624 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4de3da32-9c2d-433a-9fa3-0d8bb30202c6 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:36.207149 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4de3da32-9c2d-433a-9fa3-0d8bb30202c6 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:36.210695 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4de3da32-9c2d-433a-9fa3-0d8bb30202c6 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:36.210695 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4de3da32-9c2d-433a-9fa3-0d8bb30202c6 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:36.210695 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4de3da32-9c2d-433a-9fa3-0d8bb30202c6 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:36.372868 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4de3da32-9c2d-433a-9fa3-0d8bb30202c6 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:36.385310 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4de3da32-9c2d-433a-9fa3-0d8bb30202c6 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1549 microversion: 2.1 time: 0.190128 Apr 16 21:11:36.395865 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 700/1432] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:36 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1549 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:36.401450 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-76e00d6d-c2b5-486c-98e1-5c554dc8f466 tempest-ServicesAdminNegativeTestJSON-372374819 tempest-ServicesAdminNegativeTestJSON-372374819-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:36.402690 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:11:36.402690 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:11:36.403914 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-76e00d6d-c2b5-486c-98e1-5c554dc8f466 tempest-ServicesAdminNegativeTestJSON-372374819 tempest-ServicesAdminNegativeTestJSON-372374819-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:36.404430 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-76e00d6d-c2b5-486c-98e1-5c554dc8f466 tempest-ServicesAdminNegativeTestJSON-372374819 tempest-ServicesAdminNegativeTestJSON-372374819-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:36.405247 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-76e00d6d-c2b5-486c-98e1-5c554dc8f466 tempest-ServicesAdminNegativeTestJSON-372374819 tempest-ServicesAdminNegativeTestJSON-372374819-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:36.405687 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-76e00d6d-c2b5-486c-98e1-5c554dc8f466 tempest-ServicesAdminNegativeTestJSON-372374819 tempest-ServicesAdminNegativeTestJSON-372374819-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:36.429217 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-76e00d6d-c2b5-486c-98e1-5c554dc8f466 tempest-ServicesAdminNegativeTestJSON-372374819 tempest-ServicesAdminNegativeTestJSON-372374819-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 947 microversion: 2.1 time: 0.031915 Apr 16 21:11:36.429822 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 701/1433] 10.222.0.20 () {58 vars in 1136 bytes} [Sat Apr 16 21:11:36 2022] GET /compute/v2.1/os-services => generated 947 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:11:36.445101 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-aff8213a-6c7d-4500-9812-b5937f742e69 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:36.445718 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-aff8213a-6c7d-4500-9812-b5937f742e69 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: ba7afa3a-b83e-4837-82f1-4b8bbde7aa92] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:36.451779 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aff8213a-6c7d-4500-9812-b5937f742e69 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:36.452267 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aff8213a-6c7d-4500-9812-b5937f742e69 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:36.453047 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aff8213a-6c7d-4500-9812-b5937f742e69 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:36.454105 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aff8213a-6c7d-4500-9812-b5937f742e69 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:36.601946 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-aff8213a-6c7d-4500-9812-b5937f742e69 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:36.610288 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-aff8213a-6c7d-4500-9812-b5937f742e69 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92" status: 200 len: 1316 microversion: 2.1 time: 0.169283 Apr 16 21:11:36.611111 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 702/1434] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:36 2022] GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92 => generated 1316 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:36.616614 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3035d456-3add-4f6d-8d5a-9c6a84893a09 tempest-ServicesAdminNegativeTestJSON-372374819 tempest-ServicesAdminNegativeTestJSON-372374819-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:36.618081 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:11:36.618081 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:11:36.619468 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3035d456-3add-4f6d-8d5a-9c6a84893a09 tempest-ServicesAdminNegativeTestJSON-372374819 tempest-ServicesAdminNegativeTestJSON-372374819-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:36.619920 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3035d456-3add-4f6d-8d5a-9c6a84893a09 tempest-ServicesAdminNegativeTestJSON-372374819 tempest-ServicesAdminNegativeTestJSON-372374819-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:36.620790 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3035d456-3add-4f6d-8d5a-9c6a84893a09 tempest-ServicesAdminNegativeTestJSON-372374819 tempest-ServicesAdminNegativeTestJSON-372374819-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:36.621225 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3035d456-3add-4f6d-8d5a-9c6a84893a09 tempest-ServicesAdminNegativeTestJSON-372374819 tempest-ServicesAdminNegativeTestJSON-372374819-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:36.651379 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3035d456-3add-4f6d-8d5a-9c6a84893a09 tempest-ServicesAdminNegativeTestJSON-372374819 tempest-ServicesAdminNegativeTestJSON-372374819-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.039033 Apr 16 21:11:36.652625 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 703/1435] 10.222.0.20 () {58 vars in 1197 bytes} [Sat Apr 16 21:11:36 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:11:37.273817 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c3af48df-e6cb-4146-aba0-f36f86a00c4e tempest-ServicesAdminNegativeTestJSON-185032056 tempest-ServicesAdminNegativeTestJSON-185032056-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:37.275208 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:11:37.275208 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:11:37.276766 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c3af48df-e6cb-4146-aba0-f36f86a00c4e tempest-ServicesAdminNegativeTestJSON-185032056 tempest-ServicesAdminNegativeTestJSON-185032056-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '84339fb28170451bb2eab0f8f5778db7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd68ef61896714abeb33dbfe09c891906', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:37.277430 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c3af48df-e6cb-4146-aba0-f36f86a00c4e tempest-ServicesAdminNegativeTestJSON-185032056 tempest-ServicesAdminNegativeTestJSON-185032056-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:11:37.278700 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c3af48df-e6cb-4146-aba0-f36f86a00c4e tempest-ServicesAdminNegativeTestJSON-185032056 tempest-ServicesAdminNegativeTestJSON-185032056-project] 10.222.0.20 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.617781 Apr 16 21:11:37.279768 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 704/1436] 10.222.0.20 () {58 vars in 1136 bytes} [Sat Apr 16 21:11:36 2022] GET /compute/v2.1/os-services => generated 112 bytes in 619 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:11:37.292611 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f140dfb8-f573-48cf-bd50-d6a7b0988f99 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:37.294744 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f140dfb8-f573-48cf-bd50-d6a7b0988f99 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] [instance: cda4f042-eb49-4d90-ad5e-0e2b81dc0ede] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:37.303253 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f140dfb8-f573-48cf-bd50-d6a7b0988f99 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:37.304045 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f140dfb8-f573-48cf-bd50-d6a7b0988f99 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:37.305091 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f140dfb8-f573-48cf-bd50-d6a7b0988f99 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:37.306078 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f140dfb8-f573-48cf-bd50-d6a7b0988f99 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:37.474868 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-20970ce8-643f-4b16-bda4-361b343b22c4 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430" status: 200 len: 1426 microversion: 2.1 time: 14.603585 Apr 16 21:11:37.476464 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 733/1437] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:11:22 2022] GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430 => generated 1426 bytes in 14606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:11:37.483128 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-86a3ed1b-5e4d-445e-beef-a08741aa3d5c tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:37.483995 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-86a3ed1b-5e4d-445e-beef-a08741aa3d5c tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:37.490756 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-86a3ed1b-5e4d-445e-beef-a08741aa3d5c tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:37.491601 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-86a3ed1b-5e4d-445e-beef-a08741aa3d5c tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:37.492693 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-86a3ed1b-5e4d-445e-beef-a08741aa3d5c tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:37.493458 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-86a3ed1b-5e4d-445e-beef-a08741aa3d5c tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:37.586619 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f140dfb8-f573-48cf-bd50-d6a7b0988f99 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453306648f4e4da58ee344c3a51f8110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc15580ef8a449ca359a9d5b799e24d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:37.600093 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f140dfb8-f573-48cf-bd50-d6a7b0988f99 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] 10.222.0.20 "GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede" status: 200 len: 1372 microversion: 2.1 time: 0.318780 Apr 16 21:11:37.603970 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 705/1438] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:37 2022] GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede => generated 1372 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:37.636383 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6c71e15a-eee7-4f55-a820-6235c1b67401 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:37.636383 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6c71e15a-eee7-4f55-a820-6235c1b67401 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: ba7afa3a-b83e-4837-82f1-4b8bbde7aa92] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:37.636383 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6c71e15a-eee7-4f55-a820-6235c1b67401 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:37.642591 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6c71e15a-eee7-4f55-a820-6235c1b67401 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:37.643588 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6c71e15a-eee7-4f55-a820-6235c1b67401 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:37.644244 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6c71e15a-eee7-4f55-a820-6235c1b67401 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:37.751385 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-86a3ed1b-5e4d-445e-beef-a08741aa3d5c tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:37.757804 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-86a3ed1b-5e4d-445e-beef-a08741aa3d5c tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1549 microversion: 2.1 time: 0.279833 Apr 16 21:11:37.758388 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 734/1439] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:37 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1549 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:37.870390 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6c71e15a-eee7-4f55-a820-6235c1b67401 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:37.880330 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6c71e15a-eee7-4f55-a820-6235c1b67401 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92" status: 200 len: 1316 microversion: 2.1 time: 0.256915 Apr 16 21:11:37.881512 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 706/1440] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:37 2022] GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92 => generated 1316 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:11:38.489850 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-72aca183-9199-4356-8e33-493df093dace tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb9654bd30>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:38.564056 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-72aca183-9199-4356-8e33-493df093dace tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430" status: 200 len: 1426 microversion: 2.1 time: 0.072968 Apr 16 21:11:38.567504 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 735/1441] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:11:38 2022] GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430 => generated 1426 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:38.617636 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-773e023a-b016-4c40-9a0b-f713a25c99fa tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:38.618857 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-773e023a-b016-4c40-9a0b-f713a25c99fa tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] [instance: cda4f042-eb49-4d90-ad5e-0e2b81dc0ede] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:38.627306 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-773e023a-b016-4c40-9a0b-f713a25c99fa tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:38.627978 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-773e023a-b016-4c40-9a0b-f713a25c99fa tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:38.628999 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-773e023a-b016-4c40-9a0b-f713a25c99fa tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:38.629756 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-773e023a-b016-4c40-9a0b-f713a25c99fa tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:38.775671 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fb4bf75b-baed-4967-bc13-3008afa1b0ad tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:38.775956 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fb4bf75b-baed-4967-bc13-3008afa1b0ad tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:38.787616 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fb4bf75b-baed-4967-bc13-3008afa1b0ad tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:38.795680 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fb4bf75b-baed-4967-bc13-3008afa1b0ad tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:38.800731 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fb4bf75b-baed-4967-bc13-3008afa1b0ad tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:38.800731 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fb4bf75b-baed-4967-bc13-3008afa1b0ad tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:38.961109 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-773e023a-b016-4c40-9a0b-f713a25c99fa tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453306648f4e4da58ee344c3a51f8110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc15580ef8a449ca359a9d5b799e24d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:38.976721 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-773e023a-b016-4c40-9a0b-f713a25c99fa tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] 10.222.0.20 "GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede" status: 200 len: 1372 microversion: 2.1 time: 0.356228 Apr 16 21:11:38.984697 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 707/1442] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:38 2022] GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede => generated 1372 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:39.009497 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-207d84cb-f697-4688-a998-3ace0267853a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:39.021246 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-207d84cb-f697-4688-a998-3ace0267853a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: ba7afa3a-b83e-4837-82f1-4b8bbde7aa92] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:39.056736 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-207d84cb-f697-4688-a998-3ace0267853a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:39.061214 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-207d84cb-f697-4688-a998-3ace0267853a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:39.064428 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-207d84cb-f697-4688-a998-3ace0267853a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:39.064910 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-207d84cb-f697-4688-a998-3ace0267853a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:39.149455 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fb4bf75b-baed-4967-bc13-3008afa1b0ad tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:39.163503 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fb4bf75b-baed-4967-bc13-3008afa1b0ad tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1549 microversion: 2.1 time: 0.391069 Apr 16 21:11:39.176203 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 736/1443] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:38 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1549 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:39.576785 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-83dfcf95-e17c-4fa1-b1b3-c8536a0c4ca9 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb96144040>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:39.649712 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-83dfcf95-e17c-4fa1-b1b3-c8536a0c4ca9 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430" status: 200 len: 1426 microversion: 2.1 time: 0.076819 Apr 16 21:11:39.656063 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 737/1444] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:11:39 2022] GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430 => generated 1426 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:11:39.673790 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-207d84cb-f697-4688-a998-3ace0267853a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:39.681931 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-207d84cb-f697-4688-a998-3ace0267853a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92" status: 200 len: 1316 microversion: 2.1 time: 0.695806 Apr 16 21:11:39.682954 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 708/1445] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:38 2022] GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92 => generated 1316 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:39.997592 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-61215d1c-93cf-45bd-b062-96dd769e88e2 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:39.998679 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-61215d1c-93cf-45bd-b062-96dd769e88e2 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] [instance: cda4f042-eb49-4d90-ad5e-0e2b81dc0ede] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:40.013567 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-61215d1c-93cf-45bd-b062-96dd769e88e2 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:40.018607 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-61215d1c-93cf-45bd-b062-96dd769e88e2 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:40.020514 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-61215d1c-93cf-45bd-b062-96dd769e88e2 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:40.024357 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-61215d1c-93cf-45bd-b062-96dd769e88e2 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:40.181464 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-226a51a7-78ad-4438-b348-f4ed70c229ee tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:40.182723 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-226a51a7-78ad-4438-b348-f4ed70c229ee tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:40.196597 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-226a51a7-78ad-4438-b348-f4ed70c229ee tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:40.216298 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-226a51a7-78ad-4438-b348-f4ed70c229ee tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:40.216298 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-226a51a7-78ad-4438-b348-f4ed70c229ee tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:40.216298 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-226a51a7-78ad-4438-b348-f4ed70c229ee tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:40.266678 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-61215d1c-93cf-45bd-b062-96dd769e88e2 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453306648f4e4da58ee344c3a51f8110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc15580ef8a449ca359a9d5b799e24d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:40.295932 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-61215d1c-93cf-45bd-b062-96dd769e88e2 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] 10.222.0.20 "GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede" status: 200 len: 1558 microversion: 2.1 time: 0.295033 Apr 16 21:11:40.295932 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 738/1446] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:39 2022] GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede => generated 1558 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:40.308460 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-161badf7-afb9-4b55-b4bf-19fd74b7629a tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:40.309276 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-161badf7-afb9-4b55-b4bf-19fd74b7629a tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] [instance: cda4f042-eb49-4d90-ad5e-0e2b81dc0ede] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:40.320096 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-161badf7-afb9-4b55-b4bf-19fd74b7629a tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:40.322788 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-161badf7-afb9-4b55-b4bf-19fd74b7629a tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:40.326444 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-161badf7-afb9-4b55-b4bf-19fd74b7629a tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:40.327107 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-161badf7-afb9-4b55-b4bf-19fd74b7629a tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:40.492347 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-161badf7-afb9-4b55-b4bf-19fd74b7629a tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] 10.222.0.20 "GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.188402 Apr 16 21:11:40.494484 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 739/1447] 10.222.0.20 () {58 vars in 1274 bytes} [Sat Apr 16 21:11:40 2022] GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede/os-interface => generated 284 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:11:40.664877 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-40e3368e-8bc6-43c0-b4fa-936379a39b07 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb9654b160>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:40.758052 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-40e3368e-8bc6-43c0-b4fa-936379a39b07 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430" status: 200 len: 1426 microversion: 2.1 time: 0.098705 Apr 16 21:11:40.764456 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 740/1448] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:11:40 2022] GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430 => generated 1426 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:40.779428 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9da91abe-f4aa-47e9-b0ff-d3f95b2c93fd tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:40.780281 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9da91abe-f4aa-47e9-b0ff-d3f95b2c93fd tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: ba7afa3a-b83e-4837-82f1-4b8bbde7aa92] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:40.788327 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9da91abe-f4aa-47e9-b0ff-d3f95b2c93fd tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:40.789099 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9da91abe-f4aa-47e9-b0ff-d3f95b2c93fd tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:40.790100 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9da91abe-f4aa-47e9-b0ff-d3f95b2c93fd tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:40.790710 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9da91abe-f4aa-47e9-b0ff-d3f95b2c93fd tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:41.214318 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-226a51a7-78ad-4438-b348-f4ed70c229ee tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:41.225058 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-226a51a7-78ad-4438-b348-f4ed70c229ee tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1549 microversion: 2.1 time: 1.047657 Apr 16 21:11:41.230634 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 709/1449] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:40 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1549 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:11:41.520705 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9da91abe-f4aa-47e9-b0ff-d3f95b2c93fd tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:41.537570 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2d775c6f-0807-4349-bf03-0e3fb25665d6 tempest-HostsAdminTestJSON-324195696 tempest-HostsAdminTestJSON-324195696-project-admin] Calling method '.version_select at 0x7fbb962ef160>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:41.538818 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:11:41.538818 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:11:41.540784 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2d775c6f-0807-4349-bf03-0e3fb25665d6 tempest-HostsAdminTestJSON-324195696 tempest-HostsAdminTestJSON-324195696-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:41.541446 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2d775c6f-0807-4349-bf03-0e3fb25665d6 tempest-HostsAdminTestJSON-324195696 tempest-HostsAdminTestJSON-324195696-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:41.542434 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2d775c6f-0807-4349-bf03-0e3fb25665d6 tempest-HostsAdminTestJSON-324195696 tempest-HostsAdminTestJSON-324195696-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:41.543961 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9da91abe-f4aa-47e9-b0ff-d3f95b2c93fd tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92" status: 200 len: 1316 microversion: 2.1 time: 0.776658 Apr 16 21:11:41.544935 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2d775c6f-0807-4349-bf03-0e3fb25665d6 tempest-HostsAdminTestJSON-324195696 tempest-HostsAdminTestJSON-324195696-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:41.545908 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 741/1450] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:40 2022] GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92 => generated 1316 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:41.653531 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2d775c6f-0807-4349-bf03-0e3fb25665d6 tempest-HostsAdminTestJSON-324195696 tempest-HostsAdminTestJSON-324195696-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.371622 Apr 16 21:11:41.658446 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 710/1451] 10.222.0.20 () {58 vars in 1127 bytes} [Sat Apr 16 21:11:41 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:11:41.675390 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b69b6b47-a46b-4bc3-90aa-a58a8e268de8 tempest-HostsAdminTestJSON-324195696 tempest-HostsAdminTestJSON-324195696-project-admin] Calling method '.version_select at 0x7fbb96144280>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:41.675390 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:11:41.675390 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:11:41.675390 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b69b6b47-a46b-4bc3-90aa-a58a8e268de8 tempest-HostsAdminTestJSON-324195696 tempest-HostsAdminTestJSON-324195696-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:41.675390 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b69b6b47-a46b-4bc3-90aa-a58a8e268de8 tempest-HostsAdminTestJSON-324195696 tempest-HostsAdminTestJSON-324195696-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:41.676244 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b69b6b47-a46b-4bc3-90aa-a58a8e268de8 tempest-HostsAdminTestJSON-324195696 tempest-HostsAdminTestJSON-324195696-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:41.676366 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b69b6b47-a46b-4bc3-90aa-a58a8e268de8 tempest-HostsAdminTestJSON-324195696 tempest-HostsAdminTestJSON-324195696-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:41.747512 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b69b6b47-a46b-4bc3-90aa-a58a8e268de8 tempest-HostsAdminTestJSON-324195696 tempest-HostsAdminTestJSON-324195696-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 379 microversion: 2.1 time: 0.082194 Apr 16 21:11:41.755216 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 742/1452] 10.222.0.20 () {58 vars in 1138 bytes} [Sat Apr 16 21:11:41 2022] GET /compute/v2.1/os-hosts?zone= => generated 379 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:11:41.762676 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-81f4b854-165b-4bf4-b557-fe5fd2cae326 tempest-HostsAdminTestJSON-324195696 tempest-HostsAdminTestJSON-324195696-project-admin] Calling method '.version_select at 0x7fbb96489670>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:41.767358 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:11:41.767358 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:11:41.767358 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-81f4b854-165b-4bf4-b557-fe5fd2cae326 tempest-HostsAdminTestJSON-324195696 tempest-HostsAdminTestJSON-324195696-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:41.767358 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-81f4b854-165b-4bf4-b557-fe5fd2cae326 tempest-HostsAdminTestJSON-324195696 tempest-HostsAdminTestJSON-324195696-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:41.767358 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-81f4b854-165b-4bf4-b557-fe5fd2cae326 tempest-HostsAdminTestJSON-324195696 tempest-HostsAdminTestJSON-324195696-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:41.770145 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-81f4b854-165b-4bf4-b557-fe5fd2cae326 tempest-HostsAdminTestJSON-324195696 tempest-HostsAdminTestJSON-324195696-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:41.773620 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-031e9203-9b98-491c-9482-9703bb6e9ca2 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb9654b280>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:41.847466 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-81f4b854-165b-4bf4-b557-fe5fd2cae326 tempest-HostsAdminTestJSON-324195696 tempest-HostsAdminTestJSON-324195696-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.090861 Apr 16 21:11:41.852961 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-031e9203-9b98-491c-9482-9703bb6e9ca2 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430" status: 200 len: 1426 microversion: 2.1 time: 0.083610 Apr 16 21:11:41.855173 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 711/1453] 10.222.0.20 () {58 vars in 1144 bytes} [Sat Apr 16 21:11:41 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:11:41.860842 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 743/1454] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:11:41 2022] GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430 => generated 1426 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:41.868364 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-92eeafdf-c3bc-4b17-b9a5-ced604c673a4 tempest-HostsAdminTestJSON-324195696 tempest-HostsAdminTestJSON-324195696-project-admin] Calling method '.version_select at 0x7fbb9627eca0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:41.871431 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:11:41.871431 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:11:41.876280 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-92eeafdf-c3bc-4b17-b9a5-ced604c673a4 tempest-HostsAdminTestJSON-324195696 tempest-HostsAdminTestJSON-324195696-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:41.881176 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-92eeafdf-c3bc-4b17-b9a5-ced604c673a4 tempest-HostsAdminTestJSON-324195696 tempest-HostsAdminTestJSON-324195696-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:41.882597 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-92eeafdf-c3bc-4b17-b9a5-ced604c673a4 tempest-HostsAdminTestJSON-324195696 tempest-HostsAdminTestJSON-324195696-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:41.883299 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-92eeafdf-c3bc-4b17-b9a5-ced604c673a4 tempest-HostsAdminTestJSON-324195696 tempest-HostsAdminTestJSON-324195696-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:41.940398 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-92eeafdf-c3bc-4b17-b9a5-ced604c673a4 tempest-HostsAdminTestJSON-324195696 tempest-HostsAdminTestJSON-324195696-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.078017 Apr 16 21:11:41.950196 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 712/1455] 10.222.0.20 () {58 vars in 1127 bytes} [Sat Apr 16 21:11:41 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:11:41.961785 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9a157f3c-0746-49d8-899a-40b1321e802b tempest-HostsAdminTestJSON-324195696 tempest-HostsAdminTestJSON-324195696-project-admin] Calling method '.version_select at 0x7fbb96144790>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:41.964500 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:11:41.964500 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:11:41.964500 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a157f3c-0746-49d8-899a-40b1321e802b tempest-HostsAdminTestJSON-324195696 tempest-HostsAdminTestJSON-324195696-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:41.964884 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a157f3c-0746-49d8-899a-40b1321e802b tempest-HostsAdminTestJSON-324195696 tempest-HostsAdminTestJSON-324195696-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:41.965608 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a157f3c-0746-49d8-899a-40b1321e802b tempest-HostsAdminTestJSON-324195696 tempest-HostsAdminTestJSON-324195696-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:41.966047 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a157f3c-0746-49d8-899a-40b1321e802b tempest-HostsAdminTestJSON-324195696 tempest-HostsAdminTestJSON-324195696-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:41.976569 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-32ef75a0-8595-43d9-8ac9-4d83d764d104 req-4921f18b-f05d-4957-951b-1f0dff6e8dd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba7afa3a-b83e-4837-82f1-4b8bbde7aa92", "name": "network-vif-plugged", "status": "completed", "tag": "01db81d7-89fe-4fec-82e4-50d8db8020e2"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:11:41.992737 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-32ef75a0-8595-43d9-8ac9-4d83d764d104 req-4921f18b-f05d-4957-951b-1f0dff6e8dd0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:41.993563 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-32ef75a0-8595-43d9-8ac9-4d83d764d104 req-4921f18b-f05d-4957-951b-1f0dff6e8dd0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:42.022846 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-32ef75a0-8595-43d9-8ac9-4d83d764d104 req-4921f18b-f05d-4957-951b-1f0dff6e8dd0 service nova] Creating event network-vif-plugged:01db81d7-89fe-4fec-82e4-50d8db8020e2 for instance ba7afa3a-b83e-4837-82f1-4b8bbde7aa92 on nch2-master-1 Apr 16 21:11:42.026486 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9a157f3c-0746-49d8-899a-40b1321e802b tempest-HostsAdminTestJSON-324195696 tempest-HostsAdminTestJSON-324195696-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.068046 Apr 16 21:11:42.030229 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-32ef75a0-8595-43d9-8ac9-4d83d764d104 req-4921f18b-f05d-4957-951b-1f0dff6e8dd0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057746 Apr 16 21:11:42.040392 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 713/1456] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:11:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:11:42.040927 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 744/1457] 10.222.0.20 () {58 vars in 1154 bytes} [Sat Apr 16 21:11:41 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:11:42.061191 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-21a09cd6-286e-42cc-9079-da93750412b9 tempest-HostsAdminTestJSON-324195696 tempest-HostsAdminTestJSON-324195696-project-admin] Calling method '.version_select at 0x7fbb96489940>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:42.082433 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:11:42.082433 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:11:42.083818 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-21a09cd6-286e-42cc-9079-da93750412b9 tempest-HostsAdminTestJSON-324195696 tempest-HostsAdminTestJSON-324195696-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:42.084309 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-21a09cd6-286e-42cc-9079-da93750412b9 tempest-HostsAdminTestJSON-324195696 tempest-HostsAdminTestJSON-324195696-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:42.085118 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-21a09cd6-286e-42cc-9079-da93750412b9 tempest-HostsAdminTestJSON-324195696 tempest-HostsAdminTestJSON-324195696-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:42.086658 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-21a09cd6-286e-42cc-9079-da93750412b9 tempest-HostsAdminTestJSON-324195696 tempest-HostsAdminTestJSON-324195696-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:42.164512 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-21a09cd6-286e-42cc-9079-da93750412b9 tempest-HostsAdminTestJSON-324195696 tempest-HostsAdminTestJSON-324195696-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts" status: 200 len: 379 microversion: 2.1 time: 0.116409 Apr 16 21:11:42.170035 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 714/1458] 10.222.0.20 () {58 vars in 1127 bytes} [Sat Apr 16 21:11:42 2022] GET /compute/v2.1/os-hosts => generated 379 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:11:42.180465 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2f84a1b6-d4ba-4d6d-87e2-6f71d2b3af19 tempest-HostsAdminTestJSON-324195696 tempest-HostsAdminTestJSON-324195696-project-admin] Calling method '.version_select at 0x7fbb964dc310>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:42.181500 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:11:42.181500 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:11:42.191149 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2f84a1b6-d4ba-4d6d-87e2-6f71d2b3af19 tempest-HostsAdminTestJSON-324195696 tempest-HostsAdminTestJSON-324195696-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:42.193739 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2f84a1b6-d4ba-4d6d-87e2-6f71d2b3af19 tempest-HostsAdminTestJSON-324195696 tempest-HostsAdminTestJSON-324195696-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:42.211605 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2f84a1b6-d4ba-4d6d-87e2-6f71d2b3af19 tempest-HostsAdminTestJSON-324195696 tempest-HostsAdminTestJSON-324195696-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:42.212061 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2f84a1b6-d4ba-4d6d-87e2-6f71d2b3af19 tempest-HostsAdminTestJSON-324195696 tempest-HostsAdminTestJSON-324195696-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:42.246720 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a25aef63-37ce-43ec-8d66-2291f2d274d4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:42.248212 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a25aef63-37ce-43ec-8d66-2291f2d274d4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:42.256433 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a25aef63-37ce-43ec-8d66-2291f2d274d4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:42.259689 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a25aef63-37ce-43ec-8d66-2291f2d274d4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:42.260740 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a25aef63-37ce-43ec-8d66-2291f2d274d4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:42.265697 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a25aef63-37ce-43ec-8d66-2291f2d274d4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:42.303286 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2f84a1b6-d4ba-4d6d-87e2-6f71d2b3af19 tempest-HostsAdminTestJSON-324195696 tempest-HostsAdminTestJSON-324195696-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/nch1-master-1" status: 200 len: 732 microversion: 2.1 time: 0.128446 Apr 16 21:11:42.307312 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 745/1459] 10.222.0.20 () {58 vars in 1169 bytes} [Sat Apr 16 21:11:42 2022] GET /compute/v2.1/os-hosts/nch1-master-1 => generated 732 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:11:42.315902 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9f9cbd8a-9136-429b-8d9d-18645aa0c2b7 tempest-HostsAdminTestJSON-324195696 tempest-HostsAdminTestJSON-324195696-project-admin] Calling method '.version_select at 0x7fbb964dc280>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:42.322312 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:11:42.322312 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:11:42.339900 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9f9cbd8a-9136-429b-8d9d-18645aa0c2b7 tempest-HostsAdminTestJSON-324195696 tempest-HostsAdminTestJSON-324195696-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:42.340713 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9f9cbd8a-9136-429b-8d9d-18645aa0c2b7 tempest-HostsAdminTestJSON-324195696 tempest-HostsAdminTestJSON-324195696-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:42.369326 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9f9cbd8a-9136-429b-8d9d-18645aa0c2b7 tempest-HostsAdminTestJSON-324195696 tempest-HostsAdminTestJSON-324195696-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:42.371816 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9f9cbd8a-9136-429b-8d9d-18645aa0c2b7 tempest-HostsAdminTestJSON-324195696 tempest-HostsAdminTestJSON-324195696-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:42.437992 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9f9cbd8a-9136-429b-8d9d-18645aa0c2b7 tempest-HostsAdminTestJSON-324195696 tempest-HostsAdminTestJSON-324195696-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hosts/nch2-master-1" status: 200 len: 860 microversion: 2.1 time: 0.125779 Apr 16 21:11:42.440916 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 746/1460] 10.222.0.20 () {58 vars in 1169 bytes} [Sat Apr 16 21:11:42 2022] GET /compute/v2.1/os-hosts/nch2-master-1 => generated 860 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:11:42.573210 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9817edd2-fbf0-4470-83d2-222c6211f42b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:42.574201 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9817edd2-fbf0-4470-83d2-222c6211f42b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: ba7afa3a-b83e-4837-82f1-4b8bbde7aa92] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:42.588095 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9817edd2-fbf0-4470-83d2-222c6211f42b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:42.615502 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9817edd2-fbf0-4470-83d2-222c6211f42b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:42.615502 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9817edd2-fbf0-4470-83d2-222c6211f42b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:42.615502 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9817edd2-fbf0-4470-83d2-222c6211f42b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:42.837548 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a25aef63-37ce-43ec-8d66-2291f2d274d4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:42.847459 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a25aef63-37ce-43ec-8d66-2291f2d274d4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1549 microversion: 2.1 time: 0.604417 Apr 16 21:11:42.848727 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 715/1461] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:42 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1549 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:11:42.870185 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cf3c35d2-5bdb-4850-9972-9e36114c1e75 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb96297280>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:42.939699 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cf3c35d2-5bdb-4850-9972-9e36114c1e75 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430" status: 200 len: 1426 microversion: 2.1 time: 0.073299 Apr 16 21:11:42.940304 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 716/1462] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:11:42 2022] GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430 => generated 1426 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:42.978547 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9817edd2-fbf0-4470-83d2-222c6211f42b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:42.988833 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9817edd2-fbf0-4470-83d2-222c6211f42b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92" status: 200 len: 1316 microversion: 2.1 time: 0.427713 Apr 16 21:11:42.989803 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 747/1463] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:42 2022] GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92 => generated 1316 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:11:43.012534 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-6000bec7-311e-4607-8e9b-f760d0632e4f req-10a0c3e4-f8b9-4a5d-b7b0-a0aa13212f3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cda4f042-eb49-4d90-ad5e-0e2b81dc0ede", "tag": "341f7886-de89-42fb-840b-8879233ec19f"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:11:43.036353 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-6000bec7-311e-4607-8e9b-f760d0632e4f req-10a0c3e4-f8b9-4a5d-b7b0-a0aa13212f3c service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:43.036353 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-6000bec7-311e-4607-8e9b-f760d0632e4f req-10a0c3e4-f8b9-4a5d-b7b0-a0aa13212f3c service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:43.088571 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-6000bec7-311e-4607-8e9b-f760d0632e4f req-10a0c3e4-f8b9-4a5d-b7b0-a0aa13212f3c service nova] Creating event network-changed:341f7886-de89-42fb-840b-8879233ec19f for instance cda4f042-eb49-4d90-ad5e-0e2b81dc0ede on nch2-master-1 Apr 16 21:11:43.104362 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-6000bec7-311e-4607-8e9b-f760d0632e4f req-10a0c3e4-f8b9-4a5d-b7b0-a0aa13212f3c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095767 Apr 16 21:11:43.104987 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 717/1464] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:11:43.869928 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2a3cd9dd-00f4-4abf-b354-db8a3954332a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:43.871682 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2a3cd9dd-00f4-4abf-b354-db8a3954332a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:43.882151 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2a3cd9dd-00f4-4abf-b354-db8a3954332a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:43.882864 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2a3cd9dd-00f4-4abf-b354-db8a3954332a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:43.883826 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2a3cd9dd-00f4-4abf-b354-db8a3954332a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:43.884805 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2a3cd9dd-00f4-4abf-b354-db8a3954332a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:43.949406 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1406509267", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "ee17ff26-4aa4-479d-a168-27afd2ba69a4"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:11:44.068721 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] validate_networks() for [('ee17ff26-4aa4-479d-a168-27afd2ba69a4', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:11:44.484848 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2a3cd9dd-00f4-4abf-b354-db8a3954332a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:44.498960 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2a3cd9dd-00f4-4abf-b354-db8a3954332a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1539 microversion: 2.1 time: 0.636368 Apr 16 21:11:44.501457 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 718/1465] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:43 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1539 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:44.508483 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-34ca941f-0f90-489c-9aa3-0240b861df77 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb9626de50>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:44.586620 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-34ca941f-0f90-489c-9aa3-0240b861df77 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430" status: 200 len: 1426 microversion: 2.1 time: 0.083625 Apr 16 21:11:44.587501 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 719/1466] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:11:44 2022] GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430 => generated 1426 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:44.599700 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6e749598-98ee-4ecd-be60-3c57a9a2e287 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:44.600744 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6e749598-98ee-4ecd-be60-3c57a9a2e287 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: ba7afa3a-b83e-4837-82f1-4b8bbde7aa92] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:44.633482 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6e749598-98ee-4ecd-be60-3c57a9a2e287 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:44.634667 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6e749598-98ee-4ecd-be60-3c57a9a2e287 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:44.638618 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6e749598-98ee-4ecd-be60-3c57a9a2e287 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:44.639566 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6e749598-98ee-4ecd-be60-3c57a9a2e287 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:44.977883 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:11:44.995205 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:11:44.995205 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:11:44.995205 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:11:44.995205 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:11:44.996517 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:44.996915 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:45.002199 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:45.002747 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:45.033576 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Getting quotas for project 2e9cccbcf0e7456ab8b7c7992372784b. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:11:45.039761 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Getting quotas for user 14b5365affd1481db288841b9ffbf5cb and project 2e9cccbcf0e7456ab8b7c7992372784b. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:11:45.053831 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Going to run 3 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:11:45.056493 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: 8fed9e31-a940-4555-8877-e98e33e6524f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:11:45.119972 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6e749598-98ee-4ecd-be60-3c57a9a2e287 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:45.130705 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6e749598-98ee-4ecd-be60-3c57a9a2e287 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92" status: 200 len: 1466 microversion: 2.1 time: 0.540411 Apr 16 21:11:45.131805 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 720/1467] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:44 2022] GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92 => generated 1466 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:45.137401 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-29489336-48d3-424e-a99b-657d3ea50e0f tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Calling method '.version_select at 0x7fbb962a6550>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:45.140018 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-29489336-48d3-424e-a99b-657d3ea50e0f tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:45.140544 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-29489336-48d3-424e-a99b-657d3ea50e0f tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:45.151943 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-29489336-48d3-424e-a99b-657d3ea50e0f tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 2318 microversion: 2.1 time: 0.018575 Apr 16 21:11:45.152813 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 721/1468] 10.222.0.20 () {58 vars in 1142 bytes} [Sat Apr 16 21:11:45 2022] GET /compute/v2.1/os-migrations => generated 2318 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:45.210264 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: 80bcd5fb-6cbf-49ce-b126-1a95b55ba451] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=8fed9e31-a940-4555-8877-e98e33e6524f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:11:45.291458 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-06412de5-289a-4789-8cfd-c1ede06c48de tempest-FlavorsV2TestJSON-1507474352 tempest-FlavorsV2TestJSON-1507474352-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:45.301095 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-06412de5-289a-4789-8cfd-c1ede06c48de tempest-FlavorsV2TestJSON-1507474352 tempest-FlavorsV2TestJSON-1507474352-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.146894 Apr 16 21:11:45.309402 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 722/1469] 10.222.0.20 () {58 vars in 1136 bytes} [Sat Apr 16 21:11:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:11:45.326234 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-25b22a02-f403-49b4-8e15-e18cafe434f1 tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:45.326841 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-25b22a02-f403-49b4-8e15-e18cafe434f1 tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] [instance: ba7afa3a-b83e-4837-82f1-4b8bbde7aa92] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:45.343922 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-25b22a02-f403-49b4-8e15-e18cafe434f1 tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:45.344421 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-25b22a02-f403-49b4-8e15-e18cafe434f1 tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:45.345216 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-25b22a02-f403-49b4-8e15-e18cafe434f1 tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:45.345662 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-25b22a02-f403-49b4-8e15-e18cafe434f1 tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:45.353989 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: e1c88ea7-2311-4b05-94ba-6e641159d41a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=80bcd5fb-6cbf-49ce-b126-1a95b55ba451,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:11:45.533566 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ee30c45a-88bd-41dc-8798-07d687e4e88a tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.799107 Apr 16 21:11:45.534953 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 748/1470] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:11:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:11:45.545010 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cb210257-b31c-4c73-80c4-5237113b633b tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:45.551868 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cb210257-b31c-4c73-80c4-5237113b633b tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:45.558728 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cb210257-b31c-4c73-80c4-5237113b633b tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:45.562040 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cb210257-b31c-4c73-80c4-5237113b633b tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:45.573585 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cb210257-b31c-4c73-80c4-5237113b633b tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:45.574136 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cb210257-b31c-4c73-80c4-5237113b633b tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:45.654377 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-25b22a02-f403-49b4-8e15-e18cafe434f1 tempest-ServersOnMultiNodesTest-2008389223 tempest-ServersOnMultiNodesTest-2008389223-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92" status: 200 len: 1617 microversion: 2.1 time: 0.343878 Apr 16 21:11:45.673458 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 723/1471] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:45 2022] GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92 => generated 1617 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:45.700494 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-afcd0105-055f-40ee-ac26-2542378c4184 tempest-FlavorsV2TestJSON-1507474352 tempest-FlavorsV2TestJSON-1507474352-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:45.727829 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-afcd0105-055f-40ee-ac26-2542378c4184 tempest-FlavorsV2TestJSON-1507474352 tempest-FlavorsV2TestJSON-1507474352-project] 10.222.0.20 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.053141 Apr 16 21:11:45.736968 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 724/1472] 10.222.0.20 () {58 vars in 1124 bytes} [Sat Apr 16 21:11:45 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:45.742430 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4b1c1999-a305-4811-bc71-4d557a515cd7 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:45.746950 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4b1c1999-a305-4811-bc71-4d557a515cd7 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '14b5365affd1481db288841b9ffbf5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:45.747836 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4b1c1999-a305-4811-bc71-4d557a515cd7 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Searching by: {'deleted': False, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b'} {{(pid=137409) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:11:45.773348 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4b1c1999-a305-4811-bc71-4d557a515cd7 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:45.773872 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4b1c1999-a305-4811-bc71-4d557a515cd7 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:45.774754 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4b1c1999-a305-4811-bc71-4d557a515cd7 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:45.775212 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4b1c1999-a305-4811-bc71-4d557a515cd7 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:45.803324 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4b1c1999-a305-4811-bc71-4d557a515cd7 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.065113 Apr 16 21:11:45.804251 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 725/1473] 10.222.0.20 () {58 vars in 1124 bytes} [Sat Apr 16 21:11:45 2022] GET /compute/v2.1/servers => generated 1018 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:45.813045 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b5db83f7-93c2-4417-89bf-930224a057cc tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb962a61f0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:45.870745 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b5db83f7-93c2-4417-89bf-930224a057cc tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430" status: 200 len: 1435 microversion: 2.1 time: 0.064852 Apr 16 21:11:45.871899 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 726/1474] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:11:45 2022] GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430 => generated 1435 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:45.877832 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-366b7388-c088-4d02-a65d-44bed191aeee tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:45.895079 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-366b7388-c088-4d02-a65d-44bed191aeee tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: ba7afa3a-b83e-4837-82f1-4b8bbde7aa92] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:45.905632 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cb210257-b31c-4c73-80c4-5237113b633b tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1690 microversion: 2.1 time: 0.346101 Apr 16 21:11:45.905632 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 749/1475] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:45 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1690 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:45.906514 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-366b7388-c088-4d02-a65d-44bed191aeee tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:45.906514 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-366b7388-c088-4d02-a65d-44bed191aeee tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:45.906514 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-366b7388-c088-4d02-a65d-44bed191aeee tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:45.906514 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-366b7388-c088-4d02-a65d-44bed191aeee tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:45.906910 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7832264f-49ea-44eb-94ac-65de67b3eee6 tempest-FlavorsV2TestJSON-1507474352 tempest-FlavorsV2TestJSON-1507474352-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:45.906910 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7832264f-49ea-44eb-94ac-65de67b3eee6 tempest-FlavorsV2TestJSON-1507474352 tempest-FlavorsV2TestJSON-1507474352-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014440 Apr 16 21:11:45.906910 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 750/1476] 10.222.0.20 () {58 vars in 1136 bytes} [Sat Apr 16 21:11:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:11:45.906910 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1f30c092-c53d-4226-b717-dce1527e2ef2 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:45.906910 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1f30c092-c53d-4226-b717-dce1527e2ef2 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: e1c88ea7-2311-4b05-94ba-6e641159d41a] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:45.921276 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-366b7388-c088-4d02-a65d-44bed191aeee tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: ba7afa3a-b83e-4837-82f1-4b8bbde7aa92] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:11:45.986025 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1f30c092-c53d-4226-b717-dce1527e2ef2 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b5365affd1481db288841b9ffbf5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:45.997950 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1f30c092-c53d-4226-b717-dce1527e2ef2 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c88ea7-2311-4b05-94ba-6e641159d41a" status: 200 len: 1223 microversion: 2.1 time: 0.096847 Apr 16 21:11:45.999153 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 751/1477] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:45 2022] GET /compute/v2.1/servers/e1c88ea7-2311-4b05-94ba-6e641159d41a => generated 1223 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:46.006247 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-033f63aa-dc7c-4206-8385-f4053ad6d01a tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb96c1b8b0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:46.092483 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-033f63aa-dc7c-4206-8385-f4053ad6d01a tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430" status: 200 len: 1435 microversion: 2.1 time: 0.091368 Apr 16 21:11:46.093932 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 752/1478] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:11:45 2022] GET /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430 => generated 1435 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:46.098556 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1ece769b-1b6d-443b-9e76-e90200a00096 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:46.099377 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1ece769b-1b6d-443b-9e76-e90200a00096 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:46.107398 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1ece769b-1b6d-443b-9e76-e90200a00096 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:46.110457 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1ece769b-1b6d-443b-9e76-e90200a00096 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:46.110457 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1ece769b-1b6d-443b-9e76-e90200a00096 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:46.110457 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1ece769b-1b6d-443b-9e76-e90200a00096 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:46.291800 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1ece769b-1b6d-443b-9e76-e90200a00096 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1690 microversion: 2.1 time: 0.196538 Apr 16 21:11:46.294296 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 753/1479] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:46 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1690 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:46.301337 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7b3ed29d-0576-4b36-bd56-d3713b0eae25 tempest-FlavorsV2TestJSON-1507474352 tempest-FlavorsV2TestJSON-1507474352-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:46.310663 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7b3ed29d-0576-4b36-bd56-d3713b0eae25 tempest-FlavorsV2TestJSON-1507474352 tempest-FlavorsV2TestJSON-1507474352-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013023 Apr 16 21:11:46.311618 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 754/1480] 10.222.0.20 () {58 vars in 1136 bytes} [Sat Apr 16 21:11:46 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:11:46.320427 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b5af4229-0197-4491-a891-c293781bbc92 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:46.321778 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b5af4229-0197-4491-a891-c293781bbc92 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] [instance: 04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:46.329875 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5af4229-0197-4491-a891-c293781bbc92 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:46.330543 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5af4229-0197-4491-a891-c293781bbc92 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:46.331552 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-366b7388-c088-4d02-a65d-44bed191aeee tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92" status: 204 len: 0 microversion: 2.1 time: 0.458336 Apr 16 21:11:46.332325 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 727/1481] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:11:45 2022] DELETE /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:11:46.332887 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5af4229-0197-4491-a891-c293781bbc92 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:46.333512 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5af4229-0197-4491-a891-c293781bbc92 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:46.338388 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b734cb14-224d-46a5-998c-4139b2a7375b tempest-FlavorsV2TestJSON-1507474352 tempest-FlavorsV2TestJSON-1507474352-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:46.390415 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b734cb14-224d-46a5-998c-4139b2a7375b tempest-FlavorsV2TestJSON-1507474352 tempest-FlavorsV2TestJSON-1507474352-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.056566 Apr 16 21:11:46.401326 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 728/1482] 10.222.0.20 () {58 vars in 1164 bytes} [Sat Apr 16 21:11:46 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:46.405861 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-84fbc5f2-8ad0-4b0a-9c10-500aa782c269 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:46.408107 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-84fbc5f2-8ad0-4b0a-9c10-500aa782c269 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: ba7afa3a-b83e-4837-82f1-4b8bbde7aa92] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:46.416838 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-84fbc5f2-8ad0-4b0a-9c10-500aa782c269 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:46.417591 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-84fbc5f2-8ad0-4b0a-9c10-500aa782c269 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:46.418609 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-84fbc5f2-8ad0-4b0a-9c10-500aa782c269 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:46.420085 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-84fbc5f2-8ad0-4b0a-9c10-500aa782c269 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:46.530723 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b5af4229-0197-4491-a891-c293781bbc92 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db9403ce44e460a8165587ae22f0ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2a21b6df375491fb09fc22109fb4a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:46.541014 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b5af4229-0197-4491-a891-c293781bbc92 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88" status: 200 len: 1467 microversion: 2.1 time: 0.227481 Apr 16 21:11:46.543741 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 755/1483] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:46 2022] GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88 => generated 1467 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:46.548365 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fda3f376-92f6-4894-924d-3dbbb866f637 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:46.549146 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fda3f376-92f6-4894-924d-3dbbb866f637 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:46.558772 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fda3f376-92f6-4894-924d-3dbbb866f637 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:46.559441 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fda3f376-92f6-4894-924d-3dbbb866f637 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:46.560459 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fda3f376-92f6-4894-924d-3dbbb866f637 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:46.560904 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fda3f376-92f6-4894-924d-3dbbb866f637 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:46.636952 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-84fbc5f2-8ad0-4b0a-9c10-500aa782c269 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:46.647376 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-84fbc5f2-8ad0-4b0a-9c10-500aa782c269 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92" status: 200 len: 1472 microversion: 2.1 time: 0.248440 Apr 16 21:11:46.649341 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 729/1484] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:46 2022] GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92 => generated 1472 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:46.655443 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3ac7875c-e169-4660-9702-71fbf0e86e2f tempest-FlavorsV2TestJSON-1507474352 tempest-FlavorsV2TestJSON-1507474352-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:46.667910 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3ac7875c-e169-4660-9702-71fbf0e86e2f tempest-FlavorsV2TestJSON-1507474352 tempest-FlavorsV2TestJSON-1507474352-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016488 Apr 16 21:11:46.668957 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 730/1485] 10.222.0.20 () {58 vars in 1136 bytes} [Sat Apr 16 21:11:46 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:11:46.681484 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-499b72ff-118f-47f0-b769-6a5c8fd106bf tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb9626da60>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:46.710241 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-fda3f376-92f6-4894-924d-3dbbb866f637 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lazy-loading 'services' on Instance uuid d971969c-aa4b-4761-a632-23f88b833ec4 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:11:46.974151 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fda3f376-92f6-4894-924d-3dbbb866f637 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4/os-volume_attachments/47811ce7-10e6-4421-b54d-89b4bcfc2df7" status: 202 len: 0 microversion: 2.1 time: 0.430864 Apr 16 21:11:46.975040 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 756/1486] 10.222.0.20 () {58 vars in 1415 bytes} [Sat Apr 16 21:11:46 2022] DELETE /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4/os-volume_attachments/47811ce7-10e6-4421-b54d-89b4bcfc2df7 => generated 0 bytes in 432 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:11:46.990106 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e4907777-c187-4717-a053-1382fb4a4ef2 tempest-FlavorsV2TestJSON-1507474352 tempest-FlavorsV2TestJSON-1507474352-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:47.016319 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e4907777-c187-4717-a053-1382fb4a4ef2 tempest-FlavorsV2TestJSON-1507474352 tempest-FlavorsV2TestJSON-1507474352-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.039026 Apr 16 21:11:47.017339 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 757/1487] 10.222.0.20 () {58 vars in 1168 bytes} [Sat Apr 16 21:11:46 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:47.022619 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-84f52ba7-6564-44e2-aa62-854ec6f521c1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:47.023870 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-84f52ba7-6564-44e2-aa62-854ec6f521c1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:47.032350 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-84f52ba7-6564-44e2-aa62-854ec6f521c1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:47.032350 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-84f52ba7-6564-44e2-aa62-854ec6f521c1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:47.032950 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-84f52ba7-6564-44e2-aa62-854ec6f521c1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:47.033465 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-84f52ba7-6564-44e2-aa62-854ec6f521c1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:47.064100 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-84f52ba7-6564-44e2-aa62-854ec6f521c1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045519 Apr 16 21:11:47.064768 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 758/1488] 10.222.0.20 () {58 vars in 1301 bytes} [Sat Apr 16 21:11:47 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:11:47.069612 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2a1a0a8d-cc94-4794-ba2e-d241cf5d1e50 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:47.070447 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2a1a0a8d-cc94-4794-ba2e-d241cf5d1e50 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: e1c88ea7-2311-4b05-94ba-6e641159d41a] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:47.152609 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2a1a0a8d-cc94-4794-ba2e-d241cf5d1e50 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b5365affd1481db288841b9ffbf5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:47.163732 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2a1a0a8d-cc94-4794-ba2e-d241cf5d1e50 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c88ea7-2311-4b05-94ba-6e641159d41a" status: 200 len: 1223 microversion: 2.1 time: 0.097588 Apr 16 21:11:47.166644 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 759/1489] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:47 2022] GET /compute/v2.1/servers/e1c88ea7-2311-4b05-94ba-6e641159d41a => generated 1223 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:47.181538 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-918039f6-5a3b-481b-a891-ce854d7456ce tempest-FlavorsV2TestJSON-1507474352 tempest-FlavorsV2TestJSON-1507474352-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:47.204668 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-918039f6-5a3b-481b-a891-ce854d7456ce tempest-FlavorsV2TestJSON-1507474352 tempest-FlavorsV2TestJSON-1507474352-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.026901 Apr 16 21:11:47.205286 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 760/1490] 10.222.0.20 () {58 vars in 1160 bytes} [Sat Apr 16 21:11:47 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:11:47.217215 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6b9e01d6-0111-46e0-a57b-85ff05fa6c36 tempest-FlavorsV2TestJSON-1507474352 tempest-FlavorsV2TestJSON-1507474352-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:47.226502 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6b9e01d6-0111-46e0-a57b-85ff05fa6c36 tempest-FlavorsV2TestJSON-1507474352 tempest-FlavorsV2TestJSON-1507474352-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013096 Apr 16 21:11:47.227175 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 761/1491] 10.222.0.20 () {58 vars in 1136 bytes} [Sat Apr 16 21:11:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:11:47.239944 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b56342f5-3e39-472d-8dc8-32d0907c44fc tempest-FlavorsV2TestJSON-1507474352 tempest-FlavorsV2TestJSON-1507474352-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:47.285572 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b56342f5-3e39-472d-8dc8-32d0907c44fc tempest-FlavorsV2TestJSON-1507474352 tempest-FlavorsV2TestJSON-1507474352-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.049689 Apr 16 21:11:47.286173 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 762/1492] 10.222.0.20 () {58 vars in 1166 bytes} [Sat Apr 16 21:11:47 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:11:47.300123 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-16c2a9b6-1f3f-4318-924f-17e4de841673 tempest-FlavorsV2TestJSON-1507474352 tempest-FlavorsV2TestJSON-1507474352-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:47.309760 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-16c2a9b6-1f3f-4318-924f-17e4de841673 tempest-FlavorsV2TestJSON-1507474352 tempest-FlavorsV2TestJSON-1507474352-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013480 Apr 16 21:11:47.316787 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 763/1493] 10.222.0.20 () {58 vars in 1136 bytes} [Sat Apr 16 21:11:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:11:47.321750 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-402b06a5-d383-4266-bc44-b1d1026c5128 tempest-FlavorsV2TestJSON-1507474352 tempest-FlavorsV2TestJSON-1507474352-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:47.355540 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-402b06a5-d383-4266-bc44-b1d1026c5128 tempest-FlavorsV2TestJSON-1507474352 tempest-FlavorsV2TestJSON-1507474352-project] 10.222.0.20 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.037551 Apr 16 21:11:47.356130 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 764/1494] 10.222.0.20 () {58 vars in 1143 bytes} [Sat Apr 16 21:11:47 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:47.371078 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e1c14427-13ea-4c7d-85f3-6f7e4adab1e9 tempest-FlavorsV2TestJSON-1507474352 tempest-FlavorsV2TestJSON-1507474352-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:47.383122 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e1c14427-13ea-4c7d-85f3-6f7e4adab1e9 tempest-FlavorsV2TestJSON-1507474352 tempest-FlavorsV2TestJSON-1507474352-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017394 Apr 16 21:11:47.388691 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 765/1495] 10.222.0.20 () {58 vars in 1136 bytes} [Sat Apr 16 21:11:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:11:47.404386 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d9ad7f71-5d8f-485b-9f70-1c26af070adc tempest-FlavorsV2TestJSON-1507474352 tempest-FlavorsV2TestJSON-1507474352-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:47.443076 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d9ad7f71-5d8f-485b-9f70-1c26af070adc tempest-FlavorsV2TestJSON-1507474352 tempest-FlavorsV2TestJSON-1507474352-project] 10.222.0.20 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.045660 Apr 16 21:11:47.443768 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 766/1496] 10.222.0.20 () {58 vars in 1147 bytes} [Sat Apr 16 21:11:47 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:47.457166 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-98aefe1a-c04b-4d19-b0a5-7bbedbf0e1c7 tempest-FlavorsV2TestJSON-1507474352 tempest-FlavorsV2TestJSON-1507474352-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:47.469209 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-98aefe1a-c04b-4d19-b0a5-7bbedbf0e1c7 tempest-FlavorsV2TestJSON-1507474352 tempest-FlavorsV2TestJSON-1507474352-project] 10.222.0.20 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.015399 Apr 16 21:11:47.469789 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 767/1497] 10.222.0.20 () {58 vars in 1139 bytes} [Sat Apr 16 21:11:47 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:11:47.481474 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7e343ddf-c8ae-4a63-bb97-5aff512a578b tempest-FlavorsV2TestJSON-1507474352 tempest-FlavorsV2TestJSON-1507474352-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:47.490186 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7e343ddf-c8ae-4a63-bb97-5aff512a578b tempest-FlavorsV2TestJSON-1507474352 tempest-FlavorsV2TestJSON-1507474352-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012405 Apr 16 21:11:47.490831 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 768/1498] 10.222.0.20 () {58 vars in 1136 bytes} [Sat Apr 16 21:11:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:11:47.502300 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0d8d07be-04cc-41c7-833a-3e62f80fd514 tempest-FlavorsV2TestJSON-1507474352 tempest-FlavorsV2TestJSON-1507474352-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:47.523790 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0d8d07be-04cc-41c7-833a-3e62f80fd514 tempest-FlavorsV2TestJSON-1507474352 tempest-FlavorsV2TestJSON-1507474352-project] 10.222.0.20 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.026267 Apr 16 21:11:47.524706 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 769/1499] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:11:47 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:47.540124 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e7445040-5e3c-41ff-9415-9dfc525e52d0 tempest-FlavorsV2TestJSON-1507474352 tempest-FlavorsV2TestJSON-1507474352-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:47.572778 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e7445040-5e3c-41ff-9415-9dfc525e52d0 tempest-FlavorsV2TestJSON-1507474352 tempest-FlavorsV2TestJSON-1507474352-project] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038368 Apr 16 21:11:47.573902 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 770/1500] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:11:47 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:11:47.589294 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-701efbe8-1408-45eb-a994-723d6b4042d8 tempest-FlavorsV2TestJSON-1507474352 tempest-FlavorsV2TestJSON-1507474352-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:47.599908 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-701efbe8-1408-45eb-a994-723d6b4042d8 tempest-FlavorsV2TestJSON-1507474352 tempest-FlavorsV2TestJSON-1507474352-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015509 Apr 16 21:11:47.602278 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 771/1501] 10.222.0.20 () {58 vars in 1136 bytes} [Sat Apr 16 21:11:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:11:47.667988 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6eb2a253-c187-4f34-b785-5ce1ffa8e697 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:47.680770 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6eb2a253-c187-4f34-b785-5ce1ffa8e697 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: ba7afa3a-b83e-4837-82f1-4b8bbde7aa92] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:47.691424 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6eb2a253-c187-4f34-b785-5ce1ffa8e697 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:47.691884 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6eb2a253-c187-4f34-b785-5ce1ffa8e697 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:47.692998 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6eb2a253-c187-4f34-b785-5ce1ffa8e697 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:47.693442 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6eb2a253-c187-4f34-b785-5ce1ffa8e697 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:47.842713 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6eb2a253-c187-4f34-b785-5ce1ffa8e697 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:47.850889 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6eb2a253-c187-4f34-b785-5ce1ffa8e697 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92" status: 200 len: 1472 microversion: 2.1 time: 0.189213 Apr 16 21:11:47.851895 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 772/1502] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:47 2022] GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92 => generated 1472 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:11:48.075908 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c48c4c9d-2e99-4535-9762-2498f952e680 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:48.077379 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c48c4c9d-2e99-4535-9762-2498f952e680 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:48.088864 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c48c4c9d-2e99-4535-9762-2498f952e680 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:48.091195 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c48c4c9d-2e99-4535-9762-2498f952e680 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:48.092250 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c48c4c9d-2e99-4535-9762-2498f952e680 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:48.094106 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c48c4c9d-2e99-4535-9762-2498f952e680 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:48.165456 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c48c4c9d-2e99-4535-9762-2498f952e680 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094003 Apr 16 21:11:48.166057 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 773/1503] 10.222.0.20 () {58 vars in 1301 bytes} [Sat Apr 16 21:11:48 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:11:48.194445 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ffecaab0-0c88-4421-b766-a2f39b6438ca tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:48.195370 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ffecaab0-0c88-4421-b766-a2f39b6438ca tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: e1c88ea7-2311-4b05-94ba-6e641159d41a] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:48.298275 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ffecaab0-0c88-4421-b766-a2f39b6438ca tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b5365affd1481db288841b9ffbf5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:48.306722 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ffecaab0-0c88-4421-b766-a2f39b6438ca tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c88ea7-2311-4b05-94ba-6e641159d41a" status: 200 len: 1223 microversion: 2.1 time: 0.126459 Apr 16 21:11:48.319759 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 774/1504] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:48 2022] GET /compute/v2.1/servers/e1c88ea7-2311-4b05-94ba-6e641159d41a => generated 1223 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:48.608696 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-499b72ff-118f-47f0-b769-6a5c8fd106bf tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "DELETE /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430" status: 204 len: 0 microversion: 2.1 time: 1.938193 Apr 16 21:11:48.611015 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 731/1505] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:46 2022] DELETE /compute/v2.1/images/3d86ef4a-9637-4aa9-a404-8e041fbf0430 => generated 0 bytes in 1941 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:11:48.628447 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-237eac4e-8921-4742-8ff6-2dbca467fce5 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '.version_select at 0x7fbb961423a0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:48.745087 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-237eac4e-8921-4742-8ff6-2dbca467fce5 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] HTTP exception thrown: Image not found. Apr 16 21:11:48.745087 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-237eac4e-8921-4742-8ff6-2dbca467fce5 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Returning 404 to user: Image not found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:11:48.745280 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-237eac4e-8921-4742-8ff6-2dbca467fce5 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "DELETE /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef" status: 404 len: 62 microversion: 2.1 time: 0.125744 Apr 16 21:11:48.748749 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 775/1506] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:48 2022] DELETE /compute/v2.1/images/ec1dfed2-08a8-4515-aa89-cc576d01c3ef => generated 62 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Apr 16 21:11:48.754994 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a2bec39e-8bf5-4699-b15e-91ccdcca2295 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:48.756085 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a2bec39e-8bf5-4699-b15e-91ccdcca2295 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] [instance: 04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:48.773168 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a2bec39e-8bf5-4699-b15e-91ccdcca2295 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:48.773168 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a2bec39e-8bf5-4699-b15e-91ccdcca2295 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:48.773168 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a2bec39e-8bf5-4699-b15e-91ccdcca2295 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:48.773168 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a2bec39e-8bf5-4699-b15e-91ccdcca2295 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:48.863995 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-1f31663f-51a1-4a8d-88d9-52b43361ae8d req-8a9ee614-c65a-4b0b-b3aa-bf952174c15e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba7afa3a-b83e-4837-82f1-4b8bbde7aa92", "name": "network-vif-deleted", "tag": "01db81d7-89fe-4fec-82e4-50d8db8020e2"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:11:48.869008 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a2bec39e-8bf5-4699-b15e-91ccdcca2295 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] [instance: 04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:11:48.879950 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-1f31663f-51a1-4a8d-88d9-52b43361ae8d req-8a9ee614-c65a-4b0b-b3aa-bf952174c15e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:48.885117 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-1f31663f-51a1-4a8d-88d9-52b43361ae8d req-8a9ee614-c65a-4b0b-b3aa-bf952174c15e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:48.915048 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-1f31663f-51a1-4a8d-88d9-52b43361ae8d req-8a9ee614-c65a-4b0b-b3aa-bf952174c15e service nova] Creating event network-vif-deleted:01db81d7-89fe-4fec-82e4-50d8db8020e2 for instance ba7afa3a-b83e-4837-82f1-4b8bbde7aa92 on nch2-master-1 Apr 16 21:11:48.936090 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-1f31663f-51a1-4a8d-88d9-52b43361ae8d req-8a9ee614-c65a-4b0b-b3aa-bf952174c15e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077355 Apr 16 21:11:48.990865 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 776/1507] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:11:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:11:48.990865 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-20371359-2c51-4aaa-900f-17a5876835f8 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:48.990865 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-20371359-2c51-4aaa-900f-17a5876835f8 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: ba7afa3a-b83e-4837-82f1-4b8bbde7aa92] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:48.990865 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-20371359-2c51-4aaa-900f-17a5876835f8 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:48.993056 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-20371359-2c51-4aaa-900f-17a5876835f8 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:48.994054 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-20371359-2c51-4aaa-900f-17a5876835f8 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:48.994513 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-20371359-2c51-4aaa-900f-17a5876835f8 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:49.116603 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-20371359-2c51-4aaa-900f-17a5876835f8 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:49.127279 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-20371359-2c51-4aaa-900f-17a5876835f8 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92" status: 200 len: 1430 microversion: 2.1 time: 0.182965 Apr 16 21:11:49.210139 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 777/1508] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:48 2022] GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92 => generated 1430 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:49.210139 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bf65ab64-cec1-49ea-8db9-031500eb7955 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:49.210139 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-bf65ab64-cec1-49ea-8db9-031500eb7955 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:49.210139 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bf65ab64-cec1-49ea-8db9-031500eb7955 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:49.210139 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bf65ab64-cec1-49ea-8db9-031500eb7955 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:49.210580 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bf65ab64-cec1-49ea-8db9-031500eb7955 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:49.210580 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bf65ab64-cec1-49ea-8db9-031500eb7955 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:49.221897 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-bf65ab64-cec1-49ea-8db9-031500eb7955 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049312 Apr 16 21:11:49.223196 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 778/1509] 10.222.0.20 () {58 vars in 1301 bytes} [Sat Apr 16 21:11:49 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 16 21:11:49.331726 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5113f257-9a93-45d3-b6e0-070ca9e84532 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:49.333303 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5113f257-9a93-45d3-b6e0-070ca9e84532 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: e1c88ea7-2311-4b05-94ba-6e641159d41a] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:49.407031 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5113f257-9a93-45d3-b6e0-070ca9e84532 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b5365affd1481db288841b9ffbf5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:49.416334 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5113f257-9a93-45d3-b6e0-070ca9e84532 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c88ea7-2311-4b05-94ba-6e641159d41a" status: 200 len: 1223 microversion: 2.1 time: 0.093063 Apr 16 21:11:49.416940 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 779/1510] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:49 2022] GET /compute/v2.1/servers/e1c88ea7-2311-4b05-94ba-6e641159d41a => generated 1223 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:49.967030 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-bea50963-c73c-49a9-97d2-5d1db1203c92 req-47501116-de88-4168-84db-7fcfbd3a499d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88", "name": "network-vif-unplugged", "status": "completed", "tag": "b490e936-9731-4964-89b6-ba2e9e7ac544"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:11:49.967030 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-bea50963-c73c-49a9-97d2-5d1db1203c92 req-47501116-de88-4168-84db-7fcfbd3a499d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:49.967030 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-bea50963-c73c-49a9-97d2-5d1db1203c92 req-47501116-de88-4168-84db-7fcfbd3a499d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:49.967030 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-bea50963-c73c-49a9-97d2-5d1db1203c92 req-47501116-de88-4168-84db-7fcfbd3a499d service nova] Creating event network-vif-unplugged:b490e936-9731-4964-89b6-ba2e9e7ac544 for instance 04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88 on nch2-master-1 Apr 16 21:11:50.049589 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-bea50963-c73c-49a9-97d2-5d1db1203c92 req-47501116-de88-4168-84db-7fcfbd3a499d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030327 Apr 16 21:11:50.049589 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 780/1511] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:11:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:11:50.254698 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ba288439-7c20-48dc-b951-2c91e14fe579 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:50.255322 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ba288439-7c20-48dc-b951-2c91e14fe579 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: ba7afa3a-b83e-4837-82f1-4b8bbde7aa92] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:50.261538 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ba288439-7c20-48dc-b951-2c91e14fe579 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:50.261994 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ba288439-7c20-48dc-b951-2c91e14fe579 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:50.262756 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ba288439-7c20-48dc-b951-2c91e14fe579 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:50.263196 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ba288439-7c20-48dc-b951-2c91e14fe579 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:50.325482 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ba288439-7c20-48dc-b951-2c91e14fe579 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:50.333016 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ba288439-7c20-48dc-b951-2c91e14fe579 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92" status: 200 len: 1430 microversion: 2.1 time: 0.083966 Apr 16 21:11:50.333902 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 781/1512] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:50 2022] GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92 => generated 1430 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:11:50.434790 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2d3fe3fa-2845-4e73-9875-b061c5dda0e5 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:50.435469 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2d3fe3fa-2845-4e73-9875-b061c5dda0e5 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: e1c88ea7-2311-4b05-94ba-6e641159d41a] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:50.489940 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2d3fe3fa-2845-4e73-9875-b061c5dda0e5 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b5365affd1481db288841b9ffbf5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:50.496594 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2d3fe3fa-2845-4e73-9875-b061c5dda0e5 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c88ea7-2311-4b05-94ba-6e641159d41a" status: 200 len: 1223 microversion: 2.1 time: 0.065653 Apr 16 21:11:50.497152 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 782/1513] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:50 2022] GET /compute/v2.1/servers/e1c88ea7-2311-4b05-94ba-6e641159d41a => generated 1223 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:11:51.350003 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-29831499-8f8d-42d1-bcee-fd13643c5683 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:51.350672 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-29831499-8f8d-42d1-bcee-fd13643c5683 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: ba7afa3a-b83e-4837-82f1-4b8bbde7aa92] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:51.358106 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-29831499-8f8d-42d1-bcee-fd13643c5683 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:51.358565 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-29831499-8f8d-42d1-bcee-fd13643c5683 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:51.359342 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-29831499-8f8d-42d1-bcee-fd13643c5683 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:51.359783 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-29831499-8f8d-42d1-bcee-fd13643c5683 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:51.480438 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-29831499-8f8d-42d1-bcee-fd13643c5683 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:51.491284 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-29831499-8f8d-42d1-bcee-fd13643c5683 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92" status: 200 len: 1430 microversion: 2.1 time: 0.144897 Apr 16 21:11:51.492655 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 783/1514] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:51 2022] GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92 => generated 1430 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:11:51.513344 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1c3f7336-3670-4fdc-9ae7-77f52d68a4c7 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:51.513972 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1c3f7336-3670-4fdc-9ae7-77f52d68a4c7 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: e1c88ea7-2311-4b05-94ba-6e641159d41a] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:51.565592 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1c3f7336-3670-4fdc-9ae7-77f52d68a4c7 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b5365affd1481db288841b9ffbf5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:51.575199 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1c3f7336-3670-4fdc-9ae7-77f52d68a4c7 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c88ea7-2311-4b05-94ba-6e641159d41a" status: 200 len: 1223 microversion: 2.1 time: 0.065795 Apr 16 21:11:51.575777 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 784/1515] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:51 2022] GET /compute/v2.1/servers/e1c88ea7-2311-4b05-94ba-6e641159d41a => generated 1223 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:52.432514 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a2bec39e-8bf5-4699-b15e-91ccdcca2295 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "DELETE /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88" status: 204 len: 0 microversion: 2.1 time: 3.680759 Apr 16 21:11:52.434063 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 732/1516] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:11:48 2022] DELETE /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88 => generated 0 bytes in 3684 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:11:52.442350 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1cbbfa92-84c6-49b2-ae1c-e7bb98d617e5 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:52.442876 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1cbbfa92-84c6-49b2-ae1c-e7bb98d617e5 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] [instance: 04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:52.450975 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1cbbfa92-84c6-49b2-ae1c-e7bb98d617e5 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:52.451516 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1cbbfa92-84c6-49b2-ae1c-e7bb98d617e5 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:52.452575 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1cbbfa92-84c6-49b2-ae1c-e7bb98d617e5 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:52.453096 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1cbbfa92-84c6-49b2-ae1c-e7bb98d617e5 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:52.510304 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1b12bd7d-672f-4f3b-adc4-8bf0c38f8851 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:52.512402 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1b12bd7d-672f-4f3b-adc4-8bf0c38f8851 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: ba7afa3a-b83e-4837-82f1-4b8bbde7aa92] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:52.517989 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1b12bd7d-672f-4f3b-adc4-8bf0c38f8851 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:52.519024 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1b12bd7d-672f-4f3b-adc4-8bf0c38f8851 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:52.520035 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1b12bd7d-672f-4f3b-adc4-8bf0c38f8851 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:52.520589 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1b12bd7d-672f-4f3b-adc4-8bf0c38f8851 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:52.557821 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1b12bd7d-672f-4f3b-adc4-8bf0c38f8851 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:52.558648 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1b12bd7d-672f-4f3b-adc4-8bf0c38f8851 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:52.559267 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-1b12bd7d-672f-4f3b-adc4-8bf0c38f8851 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lazy-loading 'fault' on Instance uuid ba7afa3a-b83e-4837-82f1-4b8bbde7aa92 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:11:52.612837 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1b12bd7d-672f-4f3b-adc4-8bf0c38f8851 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:52.620631 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1b12bd7d-672f-4f3b-adc4-8bf0c38f8851 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92" status: 200 len: 1306 microversion: 2.1 time: 0.114275 Apr 16 21:11:52.621777 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 733/1517] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:52 2022] GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92 => generated 1306 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:11:52.628533 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ae45a996-6efa-404a-9453-6b61fe009877 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:52.631217 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ae45a996-6efa-404a-9453-6b61fe009877 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: e1c88ea7-2311-4b05-94ba-6e641159d41a] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:52.636706 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1cbbfa92-84c6-49b2-ae1c-e7bb98d617e5 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db9403ce44e460a8165587ae22f0ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2a21b6df375491fb09fc22109fb4a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:52.638230 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ae45a996-6efa-404a-9453-6b61fe009877 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:52.638804 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ae45a996-6efa-404a-9453-6b61fe009877 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:52.639726 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ae45a996-6efa-404a-9453-6b61fe009877 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:52.640310 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ae45a996-6efa-404a-9453-6b61fe009877 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:52.646547 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1cbbfa92-84c6-49b2-ae1c-e7bb98d617e5 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88" status: 200 len: 1473 microversion: 2.1 time: 0.208550 Apr 16 21:11:52.647142 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 785/1518] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:52 2022] GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88 => generated 1473 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:52.729104 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ae45a996-6efa-404a-9453-6b61fe009877 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b5365affd1481db288841b9ffbf5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:52.739681 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ae45a996-6efa-404a-9453-6b61fe009877 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c88ea7-2311-4b05-94ba-6e641159d41a" status: 200 len: 1227 microversion: 2.1 time: 0.116586 Apr 16 21:11:52.740482 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 734/1519] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:52 2022] GET /compute/v2.1/servers/e1c88ea7-2311-4b05-94ba-6e641159d41a => generated 1227 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:52.958215 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-957f25b2-2047-41e7-9df7-13b9413727d0 tempest-KeyPairsV210TestJSON-128636297 tempest-KeyPairsV210TestJSON-128636297-project-admin] Action: 'create', calling method: .version_select at 0x7fbb961ec280>, body: {"keypair": {"name": "tempest-keypair-1365903847", "type": "ssh", "user_id": "d8788a706c644642b1896669c1eb4b68"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:11:52.973788 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-957f25b2-2047-41e7-9df7-13b9413727d0 tempest-KeyPairsV210TestJSON-128636297 tempest-KeyPairsV210TestJSON-128636297-project-admin] Getting quotas for project 5e32beb2a56b445eae9fa025c82a503c. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:11:52.979107 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-957f25b2-2047-41e7-9df7-13b9413727d0 tempest-KeyPairsV210TestJSON-128636297 tempest-KeyPairsV210TestJSON-128636297-project-admin] Getting quotas for user 0d9a83c0bdd84477a8110009540f5b05 and project 5e32beb2a56b445eae9fa025c82a503c. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:11:53.237748 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-957f25b2-2047-41e7-9df7-13b9413727d0 tempest-KeyPairsV210TestJSON-128636297 tempest-KeyPairsV210TestJSON-128636297-project-admin] Getting quotas for project 5e32beb2a56b445eae9fa025c82a503c. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:11:53.247148 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-957f25b2-2047-41e7-9df7-13b9413727d0 tempest-KeyPairsV210TestJSON-128636297 tempest-KeyPairsV210TestJSON-128636297-project-admin] Getting quotas for user 0d9a83c0bdd84477a8110009540f5b05 and project 5e32beb2a56b445eae9fa025c82a503c. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:11:53.264704 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-957f25b2-2047-41e7-9df7-13b9413727d0 tempest-KeyPairsV210TestJSON-128636297 tempest-KeyPairsV210TestJSON-128636297-project-admin] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.10 time: 0.616420 Apr 16 21:11:53.265312 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 786/1520] 10.222.0.20 () {62 vars in 1199 bytes} [Sat Apr 16 21:11:52 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 618 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 16 21:11:53.275069 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-599915a0-6da8-4029-8896-52fee4401292 tempest-KeyPairsV210TestJSON-128636297 tempest-KeyPairsV210TestJSON-128636297-project-admin] Action: 'create', calling method: .version_select at 0x7fbb962ee280>, body: {"keypair": {"name": "tempest-keypair-1534388163", "type": "ssh", "user_id": "d8788a706c644642b1896669c1eb4b68"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:11:53.289261 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-599915a0-6da8-4029-8896-52fee4401292 tempest-KeyPairsV210TestJSON-128636297 tempest-KeyPairsV210TestJSON-128636297-project-admin] Getting quotas for project 5e32beb2a56b445eae9fa025c82a503c. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:11:53.294501 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-599915a0-6da8-4029-8896-52fee4401292 tempest-KeyPairsV210TestJSON-128636297 tempest-KeyPairsV210TestJSON-128636297-project-admin] Getting quotas for user 0d9a83c0bdd84477a8110009540f5b05 and project 5e32beb2a56b445eae9fa025c82a503c. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:11:53.596484 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-599915a0-6da8-4029-8896-52fee4401292 tempest-KeyPairsV210TestJSON-128636297 tempest-KeyPairsV210TestJSON-128636297-project-admin] Getting quotas for project 5e32beb2a56b445eae9fa025c82a503c. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:11:53.602528 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-599915a0-6da8-4029-8896-52fee4401292 tempest-KeyPairsV210TestJSON-128636297 tempest-KeyPairsV210TestJSON-128636297-project-admin] Getting quotas for user 0d9a83c0bdd84477a8110009540f5b05 and project 5e32beb2a56b445eae9fa025c82a503c. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:11:53.618453 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-599915a0-6da8-4029-8896-52fee4401292 tempest-KeyPairsV210TestJSON-128636297 tempest-KeyPairsV210TestJSON-128636297-project-admin] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.10 time: 0.347038 Apr 16 21:11:53.619374 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 735/1521] 10.222.0.20 () {62 vars in 1199 bytes} [Sat Apr 16 21:11:53 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 349 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 16 21:11:53.630302 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-523a4333-ccd2-4d6f-bbdc-7888836fcc77 tempest-KeyPairsV210TestJSON-128636297 tempest-KeyPairsV210TestJSON-128636297-project-admin] Calling method '.version_select at 0x7fbb96142e50>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:53.642377 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-523a4333-ccd2-4d6f-bbdc-7888836fcc77 tempest-KeyPairsV210TestJSON-128636297 tempest-KeyPairsV210TestJSON-128636297-project-admin] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-1365903847?user_id=d8788a706c644642b1896669c1eb4b68" status: 200 len: 707 microversion: 2.10 time: 0.016335 Apr 16 21:11:53.643108 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-89ec4a59-6186-4d42-8ec6-635f039e730e tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:53.643346 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 787/1522] 10.222.0.20 () {60 vars in 1339 bytes} [Sat Apr 16 21:11:53 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1365903847?user_id=d8788a706c644642b1896669c1eb4b68 => generated 707 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:11:53.653063 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-89ec4a59-6186-4d42-8ec6-635f039e730e tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: ba7afa3a-b83e-4837-82f1-4b8bbde7aa92] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:53.655699 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-89ec4a59-6186-4d42-8ec6-635f039e730e tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:53.656278 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d0f63347-09c4-4d16-842c-98245914e6a8 tempest-KeyPairsV210TestJSON-128636297 tempest-KeyPairsV210TestJSON-128636297-project-admin] Action: 'create', calling method: .version_select at 0x7fbb9645d940>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1641493877", "type": "ssh"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:11:53.656911 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-89ec4a59-6186-4d42-8ec6-635f039e730e tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:53.657638 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-89ec4a59-6186-4d42-8ec6-635f039e730e tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:53.658087 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-89ec4a59-6186-4d42-8ec6-635f039e730e tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:53.676566 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-d0f63347-09c4-4d16-842c-98245914e6a8 tempest-KeyPairsV210TestJSON-128636297 tempest-KeyPairsV210TestJSON-128636297-project-admin] Getting quotas for project 5e32beb2a56b445eae9fa025c82a503c. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:11:53.691623 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-d0f63347-09c4-4d16-842c-98245914e6a8 tempest-KeyPairsV210TestJSON-128636297 tempest-KeyPairsV210TestJSON-128636297-project-admin] Getting quotas for user 0d9a83c0bdd84477a8110009540f5b05 and project 5e32beb2a56b445eae9fa025c82a503c. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:11:53.713692 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-89ec4a59-6186-4d42-8ec6-635f039e730e tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:53.714352 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-89ec4a59-6186-4d42-8ec6-635f039e730e tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:53.715130 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-89ec4a59-6186-4d42-8ec6-635f039e730e tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lazy-loading 'fault' on Instance uuid ba7afa3a-b83e-4837-82f1-4b8bbde7aa92 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:11:53.758887 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-89ec4a59-6186-4d42-8ec6-635f039e730e tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:53.767411 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-89ec4a59-6186-4d42-8ec6-635f039e730e tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92" status: 200 len: 1306 microversion: 2.1 time: 0.131485 Apr 16 21:11:53.768157 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 736/1523] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:53 2022] GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92 => generated 1306 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:53.772691 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f5e20241-2ef0-487e-a935-4f15b5bcc501 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:53.773292 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f5e20241-2ef0-487e-a935-4f15b5bcc501 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] [instance: 04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:53.779222 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f5e20241-2ef0-487e-a935-4f15b5bcc501 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:53.779681 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f5e20241-2ef0-487e-a935-4f15b5bcc501 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:53.780727 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f5e20241-2ef0-487e-a935-4f15b5bcc501 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:53.780896 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f5e20241-2ef0-487e-a935-4f15b5bcc501 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:54.017431 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f5e20241-2ef0-487e-a935-4f15b5bcc501 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db9403ce44e460a8165587ae22f0ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2a21b6df375491fb09fc22109fb4a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:54.024832 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f5e20241-2ef0-487e-a935-4f15b5bcc501 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88" status: 200 len: 1473 microversion: 2.1 time: 0.255784 Apr 16 21:11:54.025417 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 737/1524] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:53 2022] GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88 => generated 1473 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:54.029814 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ee4b5dce-2c23-4866-9969-d1216466344e tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:54.030677 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ee4b5dce-2c23-4866-9969-d1216466344e tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: e1c88ea7-2311-4b05-94ba-6e641159d41a] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:54.037096 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ee4b5dce-2c23-4866-9969-d1216466344e tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:54.037852 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ee4b5dce-2c23-4866-9969-d1216466344e tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:54.038652 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ee4b5dce-2c23-4866-9969-d1216466344e tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:54.039100 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ee4b5dce-2c23-4866-9969-d1216466344e tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:54.116228 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ee4b5dce-2c23-4866-9969-d1216466344e tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b5365affd1481db288841b9ffbf5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:54.127371 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ee4b5dce-2c23-4866-9969-d1216466344e tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c88ea7-2311-4b05-94ba-6e641159d41a" status: 200 len: 1227 microversion: 2.1 time: 0.098404 Apr 16 21:11:54.135246 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 738/1525] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:54 2022] GET /compute/v2.1/servers/e1c88ea7-2311-4b05-94ba-6e641159d41a => generated 1227 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:54.182478 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-d0f63347-09c4-4d16-842c-98245914e6a8 tempest-KeyPairsV210TestJSON-128636297 tempest-KeyPairsV210TestJSON-128636297-project-admin] Getting quotas for project 5e32beb2a56b445eae9fa025c82a503c. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:11:54.188270 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-d0f63347-09c4-4d16-842c-98245914e6a8 tempest-KeyPairsV210TestJSON-128636297 tempest-KeyPairsV210TestJSON-128636297-project-admin] Getting quotas for user 0d9a83c0bdd84477a8110009540f5b05 and project 5e32beb2a56b445eae9fa025c82a503c. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:11:54.204006 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d0f63347-09c4-4d16-842c-98245914e6a8 tempest-KeyPairsV210TestJSON-128636297 tempest-KeyPairsV210TestJSON-128636297-project-admin] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 2341 microversion: 2.10 time: 0.552196 Apr 16 21:11:54.204918 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 788/1526] 10.222.0.20 () {62 vars in 1198 bytes} [Sat Apr 16 21:11:53 2022] POST /compute/v2.1/os-keypairs => generated 2341 bytes in 554 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 16 21:11:54.214976 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-189fb0c9-90b7-42ef-8e34-1127dbd90d2a tempest-KeyPairsV210TestJSON-128636297 tempest-KeyPairsV210TestJSON-128636297-project-admin] Calling method '.version_select at 0x7fbb9622b700>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:54.217694 ncdv-master-1 devstack@n-api.service[137409]: WARNING oslo_db.sqlalchemy.utils [None req-189fb0c9-90b7-42ef-8e34-1127dbd90d2a tempest-KeyPairsV210TestJSON-128636297 tempest-KeyPairsV210TestJSON-128636297-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Apr 16 21:11:54.223704 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-189fb0c9-90b7-42ef-8e34-1127dbd90d2a tempest-KeyPairsV210TestJSON-128636297 tempest-KeyPairsV210TestJSON-128636297-project-admin] 10.222.0.20 "GET /compute/v2.1/os-keypairs?user_id=d8788a706c644642b1896669c1eb4b68" status: 200 len: 1114 microversion: 2.10 time: 0.012573 Apr 16 21:11:54.224465 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 739/1527] 10.222.0.20 () {60 vars in 1258 bytes} [Sat Apr 16 21:11:54 2022] GET /compute/v2.1/os-keypairs?user_id=d8788a706c644642b1896669c1eb4b68 => generated 1114 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:11:54.234272 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f8cfef9b-b416-4caf-93f7-7464f7db2f89 tempest-KeyPairsV210TestJSON-128636297 tempest-KeyPairsV210TestJSON-128636297-project-admin] Calling method '.version_select at 0x7fbb96142f70>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:54.317304 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f8cfef9b-b416-4caf-93f7-7464f7db2f89 tempest-KeyPairsV210TestJSON-128636297 tempest-KeyPairsV210TestJSON-128636297-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1641493877" status: 204 len: 0 microversion: 2.10 time: 0.086809 Apr 16 21:11:54.318078 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 789/1528] 10.222.0.20 () {60 vars in 1324 bytes} [Sat Apr 16 21:11:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1641493877 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 16 21:11:54.326353 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2dc38a12-b856-4dad-92b1-a68167f49129 tempest-KeyPairsV210TestJSON-128636297 tempest-KeyPairsV210TestJSON-128636297-project-admin] Calling method '.version_select at 0x7fbb9626d040>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:54.404862 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2dc38a12-b856-4dad-92b1-a68167f49129 tempest-KeyPairsV210TestJSON-128636297 tempest-KeyPairsV210TestJSON-128636297-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1534388163?user_id=d8788a706c644642b1896669c1eb4b68" status: 204 len: 0 microversion: 2.10 time: 0.081235 Apr 16 21:11:54.407211 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 740/1529] 10.222.0.20 () {60 vars in 1342 bytes} [Sat Apr 16 21:11:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1534388163?user_id=d8788a706c644642b1896669c1eb4b68 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 16 21:11:54.418345 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d5863694-23da-4085-a2c8-da816001fd99 tempest-KeyPairsV210TestJSON-128636297 tempest-KeyPairsV210TestJSON-128636297-project-admin] Calling method '.version_select at 0x7fbb9654b3a0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:54.520076 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d5863694-23da-4085-a2c8-da816001fd99 tempest-KeyPairsV210TestJSON-128636297 tempest-KeyPairsV210TestJSON-128636297-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1365903847?user_id=d8788a706c644642b1896669c1eb4b68" status: 204 len: 0 microversion: 2.10 time: 0.107792 Apr 16 21:11:54.520989 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 790/1530] 10.222.0.20 () {60 vars in 1342 bytes} [Sat Apr 16 21:11:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1365903847?user_id=d8788a706c644642b1896669c1eb4b68 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 16 21:11:54.787982 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6613a227-2f8d-4ea7-bda4-58d47a611df7 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:54.788804 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6613a227-2f8d-4ea7-bda4-58d47a611df7 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: ba7afa3a-b83e-4837-82f1-4b8bbde7aa92] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:54.796154 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6613a227-2f8d-4ea7-bda4-58d47a611df7 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:54.796642 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6613a227-2f8d-4ea7-bda4-58d47a611df7 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:54.797484 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6613a227-2f8d-4ea7-bda4-58d47a611df7 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:54.797937 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6613a227-2f8d-4ea7-bda4-58d47a611df7 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:54.827293 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6613a227-2f8d-4ea7-bda4-58d47a611df7 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:54.827763 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6613a227-2f8d-4ea7-bda4-58d47a611df7 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:54.828747 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-6613a227-2f8d-4ea7-bda4-58d47a611df7 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lazy-loading 'fault' on Instance uuid ba7afa3a-b83e-4837-82f1-4b8bbde7aa92 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:11:54.930899 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6613a227-2f8d-4ea7-bda4-58d47a611df7 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:54.940599 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6613a227-2f8d-4ea7-bda4-58d47a611df7 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92" status: 200 len: 1306 microversion: 2.1 time: 0.157796 Apr 16 21:11:54.941360 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 741/1531] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:54 2022] GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92 => generated 1306 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:55.043420 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fd096bb7-03e3-4cac-b95e-9534efb5727f tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:55.044311 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fd096bb7-03e3-4cac-b95e-9534efb5727f tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] [instance: 04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:55.061034 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fd096bb7-03e3-4cac-b95e-9534efb5727f tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:55.061806 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fd096bb7-03e3-4cac-b95e-9534efb5727f tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:55.065731 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fd096bb7-03e3-4cac-b95e-9534efb5727f tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:55.066603 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fd096bb7-03e3-4cac-b95e-9534efb5727f tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:55.143165 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-22ae4665-53b9-4f3c-9318-96e38c58711e tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:55.144072 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-22ae4665-53b9-4f3c-9318-96e38c58711e tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: e1c88ea7-2311-4b05-94ba-6e641159d41a] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:55.150829 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-22ae4665-53b9-4f3c-9318-96e38c58711e tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:55.151547 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-22ae4665-53b9-4f3c-9318-96e38c58711e tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:55.152651 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-22ae4665-53b9-4f3c-9318-96e38c58711e tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:55.153454 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-22ae4665-53b9-4f3c-9318-96e38c58711e tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:55.263955 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-22ae4665-53b9-4f3c-9318-96e38c58711e tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b5365affd1481db288841b9ffbf5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:55.277857 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-22ae4665-53b9-4f3c-9318-96e38c58711e tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c88ea7-2311-4b05-94ba-6e641159d41a" status: 200 len: 1219 microversion: 2.1 time: 0.135660 Apr 16 21:11:55.277857 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 742/1532] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:55 2022] GET /compute/v2.1/servers/e1c88ea7-2311-4b05-94ba-6e641159d41a => generated 1219 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:11:55.631129 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fd096bb7-03e3-4cac-b95e-9534efb5727f tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db9403ce44e460a8165587ae22f0ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2a21b6df375491fb09fc22109fb4a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:55.651313 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fd096bb7-03e3-4cac-b95e-9534efb5727f tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88" status: 200 len: 1473 microversion: 2.1 time: 0.612032 Apr 16 21:11:55.653020 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 791/1533] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:55 2022] GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88 => generated 1473 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:55.963942 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b2243a57-ce37-4d7e-852a-d97d48f0cb93 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:55.974038 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b2243a57-ce37-4d7e-852a-d97d48f0cb93 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: ba7afa3a-b83e-4837-82f1-4b8bbde7aa92] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:55.999572 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b2243a57-ce37-4d7e-852a-d97d48f0cb93 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:56.000118 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b2243a57-ce37-4d7e-852a-d97d48f0cb93 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:56.000994 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b2243a57-ce37-4d7e-852a-d97d48f0cb93 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:56.001444 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b2243a57-ce37-4d7e-852a-d97d48f0cb93 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:56.035464 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-b2243a57-ce37-4d7e-852a-d97d48f0cb93 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] HTTP exception thrown: Instance ba7afa3a-b83e-4837-82f1-4b8bbde7aa92 could not be found. Apr 16 21:11:56.036132 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b2243a57-ce37-4d7e-852a-d97d48f0cb93 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Returning 404 to user: Instance ba7afa3a-b83e-4837-82f1-4b8bbde7aa92 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:11:56.038391 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b2243a57-ce37-4d7e-852a-d97d48f0cb93 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92" status: 404 len: 111 microversion: 2.1 time: 0.080378 Apr 16 21:11:56.040433 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 743/1534] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:55 2022] GET /compute/v2.1/servers/ba7afa3a-b83e-4837-82f1-4b8bbde7aa92 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:11:56.057519 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9975b371-f2bd-479a-9e46-0b65fba77c3c tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:56.057519 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9975b371-f2bd-479a-9e46-0b65fba77c3c tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 88a6591a-336d-477a-8a77-d4e30a1bb0bf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:56.061702 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9975b371-f2bd-479a-9e46-0b65fba77c3c tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:56.062428 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9975b371-f2bd-479a-9e46-0b65fba77c3c tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:56.063944 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9975b371-f2bd-479a-9e46-0b65fba77c3c tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:56.064619 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9975b371-f2bd-479a-9e46-0b65fba77c3c tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:56.126862 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9975b371-f2bd-479a-9e46-0b65fba77c3c tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 88a6591a-336d-477a-8a77-d4e30a1bb0bf] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:11:56.179481 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-e342a23c-c76c-40e1-bcd8-47c68f533f26 req-7e2a6729-a3c5-40be-8091-6751097bf0f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88", "name": "network-vif-deleted", "tag": "b490e936-9731-4964-89b6-ba2e9e7ac544"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:11:56.237851 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-e342a23c-c76c-40e1-bcd8-47c68f533f26 req-7e2a6729-a3c5-40be-8091-6751097bf0f1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:56.238599 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-e342a23c-c76c-40e1-bcd8-47c68f533f26 req-7e2a6729-a3c5-40be-8091-6751097bf0f1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:56.261162 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-e342a23c-c76c-40e1-bcd8-47c68f533f26 req-7e2a6729-a3c5-40be-8091-6751097bf0f1 service nova] Creating event network-vif-deleted:b490e936-9731-4964-89b6-ba2e9e7ac544 for instance 04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88 on nch2-master-1 Apr 16 21:11:56.270124 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-e342a23c-c76c-40e1-bcd8-47c68f533f26 req-7e2a6729-a3c5-40be-8091-6751097bf0f1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100682 Apr 16 21:11:56.271142 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 744/1535] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:11:56.300691 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fc4ebdc2-0423-4aa4-b5ec-32ffe9562523 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:56.301578 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-fc4ebdc2-0423-4aa4-b5ec-32ffe9562523 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: e1c88ea7-2311-4b05-94ba-6e641159d41a] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:56.311317 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fc4ebdc2-0423-4aa4-b5ec-32ffe9562523 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:56.312145 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fc4ebdc2-0423-4aa4-b5ec-32ffe9562523 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:56.313364 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fc4ebdc2-0423-4aa4-b5ec-32ffe9562523 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:56.314241 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fc4ebdc2-0423-4aa4-b5ec-32ffe9562523 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:56.517563 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-fc4ebdc2-0423-4aa4-b5ec-32ffe9562523 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b5365affd1481db288841b9ffbf5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:56.526337 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fc4ebdc2-0423-4aa4-b5ec-32ffe9562523 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c88ea7-2311-4b05-94ba-6e641159d41a" status: 200 len: 1293 microversion: 2.1 time: 0.233881 Apr 16 21:11:56.532659 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 745/1536] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:56 2022] GET /compute/v2.1/servers/e1c88ea7-2311-4b05-94ba-6e641159d41a => generated 1293 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:56.675635 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ad62df7a-15f9-4c70-989d-0066c0906869 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:56.677363 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ad62df7a-15f9-4c70-989d-0066c0906869 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] [instance: 04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:56.685869 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ad62df7a-15f9-4c70-989d-0066c0906869 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:56.688223 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ad62df7a-15f9-4c70-989d-0066c0906869 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:56.689865 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ad62df7a-15f9-4c70-989d-0066c0906869 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:56.697163 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ad62df7a-15f9-4c70-989d-0066c0906869 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:56.738820 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ad62df7a-15f9-4c70-989d-0066c0906869 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:56.739278 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ad62df7a-15f9-4c70-989d-0066c0906869 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:56.739746 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-ad62df7a-15f9-4c70-989d-0066c0906869 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lazy-loading 'fault' on Instance uuid 04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:11:56.748724 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9975b371-f2bd-479a-9e46-0b65fba77c3c tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "DELETE /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf" status: 204 len: 0 microversion: 2.1 time: 0.702382 Apr 16 21:11:56.754846 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 792/1537] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:11:56 2022] DELETE /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf => generated 0 bytes in 705 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:11:56.759192 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-41b90097-0923-44de-8b53-8ed7f2ab7e81 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:56.759895 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-41b90097-0923-44de-8b53-8ed7f2ab7e81 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 88a6591a-336d-477a-8a77-d4e30a1bb0bf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:56.766939 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-41b90097-0923-44de-8b53-8ed7f2ab7e81 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:56.767545 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-41b90097-0923-44de-8b53-8ed7f2ab7e81 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:56.768498 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-41b90097-0923-44de-8b53-8ed7f2ab7e81 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:56.769239 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-41b90097-0923-44de-8b53-8ed7f2ab7e81 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:56.908014 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ad62df7a-15f9-4c70-989d-0066c0906869 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2db9403ce44e460a8165587ae22f0ad2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2a21b6df375491fb09fc22109fb4a5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:56.916764 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ad62df7a-15f9-4c70-989d-0066c0906869 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88" status: 200 len: 1307 microversion: 2.1 time: 0.250197 Apr 16 21:11:56.919153 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 746/1538] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:56 2022] GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88 => generated 1307 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:56.954904 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-41b90097-0923-44de-8b53-8ed7f2ab7e81 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:56.968763 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-41b90097-0923-44de-8b53-8ed7f2ab7e81 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf" status: 200 len: 1472 microversion: 2.1 time: 0.212183 Apr 16 21:11:56.980541 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 793/1539] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:56 2022] GET /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf => generated 1472 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:57.033675 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-18bebf40-3dc6-465c-b581-5ac28b3b0ab3 req-65406fb2-45c2-4db7-997e-c238b1deb426 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "80bcd5fb-6cbf-49ce-b126-1a95b55ba451", "tag": "96a1cc71-d1de-4f33-ad30-0d9143131754"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:11:57.044805 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-18bebf40-3dc6-465c-b581-5ac28b3b0ab3 req-65406fb2-45c2-4db7-997e-c238b1deb426 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:57.050134 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-18bebf40-3dc6-465c-b581-5ac28b3b0ab3 req-65406fb2-45c2-4db7-997e-c238b1deb426 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:57.057954 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-18bebf40-3dc6-465c-b581-5ac28b3b0ab3 req-65406fb2-45c2-4db7-997e-c238b1deb426 service nova] Creating event network-changed:96a1cc71-d1de-4f33-ad30-0d9143131754 for instance 80bcd5fb-6cbf-49ce-b126-1a95b55ba451 on nch1-master-1 Apr 16 21:11:57.064610 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-18bebf40-3dc6-465c-b581-5ac28b3b0ab3 req-65406fb2-45c2-4db7-997e-c238b1deb426 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035318 Apr 16 21:11:57.065235 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 747/1540] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:11:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:11:57.544368 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ba14b70d-6814-40ef-adbe-8c40d8bda7f9 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:57.546304 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ba14b70d-6814-40ef-adbe-8c40d8bda7f9 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: e1c88ea7-2311-4b05-94ba-6e641159d41a] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:57.555729 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ba14b70d-6814-40ef-adbe-8c40d8bda7f9 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:57.556250 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ba14b70d-6814-40ef-adbe-8c40d8bda7f9 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:57.558218 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ba14b70d-6814-40ef-adbe-8c40d8bda7f9 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:57.558912 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ba14b70d-6814-40ef-adbe-8c40d8bda7f9 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:57.712909 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ba14b70d-6814-40ef-adbe-8c40d8bda7f9 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b5365affd1481db288841b9ffbf5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:57.722694 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ba14b70d-6814-40ef-adbe-8c40d8bda7f9 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c88ea7-2311-4b05-94ba-6e641159d41a" status: 200 len: 1281 microversion: 2.1 time: 0.182975 Apr 16 21:11:57.723756 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 794/1541] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:57 2022] GET /compute/v2.1/servers/e1c88ea7-2311-4b05-94ba-6e641159d41a => generated 1281 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:57.940059 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-74368ec7-1a66-4d39-bf1d-c895c87f44e1 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:57.940865 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-74368ec7-1a66-4d39-bf1d-c895c87f44e1 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] [instance: 04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:57.950884 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-74368ec7-1a66-4d39-bf1d-c895c87f44e1 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:57.951613 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-74368ec7-1a66-4d39-bf1d-c895c87f44e1 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:57.952711 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-74368ec7-1a66-4d39-bf1d-c895c87f44e1 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:57.953088 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-74368ec7-1a66-4d39-bf1d-c895c87f44e1 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:57.970662 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-74368ec7-1a66-4d39-bf1d-c895c87f44e1 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] HTTP exception thrown: Instance 04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88 could not be found. Apr 16 21:11:57.971407 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-74368ec7-1a66-4d39-bf1d-c895c87f44e1 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] Returning 404 to user: Instance 04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:11:57.972438 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-74368ec7-1a66-4d39-bf1d-c895c87f44e1 tempest-ImagesOneServerTestJSON-274157182 tempest-ImagesOneServerTestJSON-274157182-project] 10.222.0.20 "GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88" status: 404 len: 111 microversion: 2.1 time: 0.039629 Apr 16 21:11:57.973227 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 748/1542] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:57 2022] GET /compute/v2.1/servers/04c0a2c3-ac53-45ae-a0f6-d9ec353e2e88 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:11:57.993708 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-53ccc7c3-aad7-4b45-83e3-61c6dd5b6e6a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:57.994840 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-53ccc7c3-aad7-4b45-83e3-61c6dd5b6e6a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 88a6591a-336d-477a-8a77-d4e30a1bb0bf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:58.012451 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-53ccc7c3-aad7-4b45-83e3-61c6dd5b6e6a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:58.015656 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-53ccc7c3-aad7-4b45-83e3-61c6dd5b6e6a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:58.015656 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-53ccc7c3-aad7-4b45-83e3-61c6dd5b6e6a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:58.015656 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-53ccc7c3-aad7-4b45-83e3-61c6dd5b6e6a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:58.413599 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-53ccc7c3-aad7-4b45-83e3-61c6dd5b6e6a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:58.421374 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-53ccc7c3-aad7-4b45-83e3-61c6dd5b6e6a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf" status: 200 len: 1472 microversion: 2.1 time: 0.438216 Apr 16 21:11:58.422063 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 795/1543] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:57 2022] GET /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf => generated 1472 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:11:58.743329 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-29ffbd90-37e7-4ce7-bb66-f9b18475520c tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:58.744105 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-29ffbd90-37e7-4ce7-bb66-f9b18475520c tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: e1c88ea7-2311-4b05-94ba-6e641159d41a] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:58.752801 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-29ffbd90-37e7-4ce7-bb66-f9b18475520c tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:58.753752 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-29ffbd90-37e7-4ce7-bb66-f9b18475520c tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:58.756030 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-29ffbd90-37e7-4ce7-bb66-f9b18475520c tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:58.756857 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-29ffbd90-37e7-4ce7-bb66-f9b18475520c tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:59.439360 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e6af3ac3-ba45-4db2-9527-039c9c0c255d tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:11:59.440268 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e6af3ac3-ba45-4db2-9527-039c9c0c255d tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 88a6591a-336d-477a-8a77-d4e30a1bb0bf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:11:59.450935 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e6af3ac3-ba45-4db2-9527-039c9c0c255d tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:59.451396 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e6af3ac3-ba45-4db2-9527-039c9c0c255d tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:59.452211 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e6af3ac3-ba45-4db2-9527-039c9c0c255d tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:59.452670 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e6af3ac3-ba45-4db2-9527-039c9c0c255d tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:59.670417 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e6af3ac3-ba45-4db2-9527-039c9c0c255d tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:59.722332 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e6af3ac3-ba45-4db2-9527-039c9c0c255d tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf" status: 200 len: 1472 microversion: 2.1 time: 0.272915 Apr 16 21:11:59.726269 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 796/1544] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:59 2022] GET /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf => generated 1472 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:11:59.750063 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-2416b7aa-3d2b-4775-8edc-f1df5bc6af96 req-ab3b5b0c-d0a2-4424-ad56-77380c934fa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1c88ea7-2311-4b05-94ba-6e641159d41a", "tag": "be39f056-864d-4773-9608-d25a97235273"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:11:59.767957 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-2416b7aa-3d2b-4775-8edc-f1df5bc6af96 req-ab3b5b0c-d0a2-4424-ad56-77380c934fa8 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:11:59.770753 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-2416b7aa-3d2b-4775-8edc-f1df5bc6af96 req-ab3b5b0c-d0a2-4424-ad56-77380c934fa8 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:11:59.788717 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-2416b7aa-3d2b-4775-8edc-f1df5bc6af96 req-ab3b5b0c-d0a2-4424-ad56-77380c934fa8 service nova] Creating event network-changed:be39f056-864d-4773-9608-d25a97235273 for instance e1c88ea7-2311-4b05-94ba-6e641159d41a on nch2-master-1 Apr 16 21:11:59.794092 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-2416b7aa-3d2b-4775-8edc-f1df5bc6af96 req-ab3b5b0c-d0a2-4424-ad56-77380c934fa8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062786 Apr 16 21:11:59.799083 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 797/1545] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:11:59.872816 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-29ffbd90-37e7-4ce7-bb66-f9b18475520c tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b5365affd1481db288841b9ffbf5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:11:59.881552 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-29ffbd90-37e7-4ce7-bb66-f9b18475520c tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c88ea7-2311-4b05-94ba-6e641159d41a" status: 200 len: 1323 microversion: 2.1 time: 1.142339 Apr 16 21:11:59.891051 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 749/1546] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:11:58 2022] GET /compute/v2.1/servers/e1c88ea7-2311-4b05-94ba-6e641159d41a => generated 1323 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:00.479222 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-83358cdc-ae26-4d39-8782-03d474e1b303 req-6f87d4a6-330e-4396-9124-82e5c37b70d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88a6591a-336d-477a-8a77-d4e30a1bb0bf", "name": "network-vif-deleted", "tag": "90f9b920-0d64-4f52-b927-bb557bc71bb3"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:12:00.503706 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-83358cdc-ae26-4d39-8782-03d474e1b303 req-6f87d4a6-330e-4396-9124-82e5c37b70d9 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:00.504184 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-83358cdc-ae26-4d39-8782-03d474e1b303 req-6f87d4a6-330e-4396-9124-82e5c37b70d9 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:00.532467 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-83358cdc-ae26-4d39-8782-03d474e1b303 req-6f87d4a6-330e-4396-9124-82e5c37b70d9 service nova] Creating event network-vif-deleted:90f9b920-0d64-4f52-b927-bb557bc71bb3 for instance 88a6591a-336d-477a-8a77-d4e30a1bb0bf on nch1-master-1 Apr 16 21:12:00.548008 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-83358cdc-ae26-4d39-8782-03d474e1b303 req-6f87d4a6-330e-4396-9124-82e5c37b70d9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073469 Apr 16 21:12:00.548686 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 798/1547] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:12:00.746938 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fccfc494-ace4-4b53-b068-a1b1107d879d tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:00.754129 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-fccfc494-ace4-4b53-b068-a1b1107d879d tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 88a6591a-336d-477a-8a77-d4e30a1bb0bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:00.759517 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fccfc494-ace4-4b53-b068-a1b1107d879d tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:00.760071 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fccfc494-ace4-4b53-b068-a1b1107d879d tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:00.761143 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fccfc494-ace4-4b53-b068-a1b1107d879d tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:00.761743 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fccfc494-ace4-4b53-b068-a1b1107d879d tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:00.900035 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1ace36ff-7d48-418c-abb1-3a51906476fd tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:00.901232 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1ace36ff-7d48-418c-abb1-3a51906476fd tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: e1c88ea7-2311-4b05-94ba-6e641159d41a] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:00.929599 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1ace36ff-7d48-418c-abb1-3a51906476fd tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:00.931266 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1ace36ff-7d48-418c-abb1-3a51906476fd tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:00.932694 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1ace36ff-7d48-418c-abb1-3a51906476fd tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:00.933500 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1ace36ff-7d48-418c-abb1-3a51906476fd tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:00.979729 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-fccfc494-ace4-4b53-b068-a1b1107d879d tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:00.990279 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fccfc494-ace4-4b53-b068-a1b1107d879d tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf" status: 200 len: 1301 microversion: 2.1 time: 0.249154 Apr 16 21:12:01.003325 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 750/1548] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:00 2022] GET /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf => generated 1301 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:01.171367 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1ace36ff-7d48-418c-abb1-3a51906476fd tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b5365affd1481db288841b9ffbf5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:01.176209 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1ace36ff-7d48-418c-abb1-3a51906476fd tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c88ea7-2311-4b05-94ba-6e641159d41a" status: 200 len: 1323 microversion: 2.1 time: 0.281163 Apr 16 21:12:01.176882 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 799/1549] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:00 2022] GET /compute/v2.1/servers/e1c88ea7-2311-4b05-94ba-6e641159d41a => generated 1323 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:02.010308 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-641457aa-fcfd-4085-8564-3ea43a7c9838 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:02.011015 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-641457aa-fcfd-4085-8564-3ea43a7c9838 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 88a6591a-336d-477a-8a77-d4e30a1bb0bf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:02.018314 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-641457aa-fcfd-4085-8564-3ea43a7c9838 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:02.019912 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-641457aa-fcfd-4085-8564-3ea43a7c9838 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:02.020994 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-641457aa-fcfd-4085-8564-3ea43a7c9838 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:02.022094 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-641457aa-fcfd-4085-8564-3ea43a7c9838 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:02.056551 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-641457aa-fcfd-4085-8564-3ea43a7c9838 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:02.057139 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-641457aa-fcfd-4085-8564-3ea43a7c9838 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:02.057718 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-641457aa-fcfd-4085-8564-3ea43a7c9838 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lazy-loading 'fault' on Instance uuid 88a6591a-336d-477a-8a77-d4e30a1bb0bf {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:12:02.088852 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-be8d65ae-d941-4dce-8879-12eaffa287a0 tempest-QuotasAdminTestV236-239397276 tempest-QuotasAdminTestV236-239397276-project-admin] Action: 'update', calling method: .version_select at 0x7fbb962279d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:12:02.108247 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-641457aa-fcfd-4085-8564-3ea43a7c9838 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:02.117333 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-641457aa-fcfd-4085-8564-3ea43a7c9838 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf" status: 200 len: 1306 microversion: 2.1 time: 0.110447 Apr 16 21:12:02.119111 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 800/1550] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:02 2022] GET /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf => generated 1306 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:02.186487 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-be8d65ae-d941-4dce-8879-12eaffa287a0 tempest-QuotasAdminTestV236-239397276 tempest-QuotasAdminTestV236-239397276-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:02.189679 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-be8d65ae-d941-4dce-8879-12eaffa287a0 tempest-QuotasAdminTestV236-239397276 tempest-QuotasAdminTestV236-239397276-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:02.190542 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-be8d65ae-d941-4dce-8879-12eaffa287a0 tempest-QuotasAdminTestV236-239397276 tempest-QuotasAdminTestV236-239397276-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:02.190997 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-be8d65ae-d941-4dce-8879-12eaffa287a0 tempest-QuotasAdminTestV236-239397276 tempest-QuotasAdminTestV236-239397276-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:02.196752 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-16fb095a-6789-4bf6-8ebf-feae7f11fdce tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:02.197559 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-16fb095a-6789-4bf6-8ebf-feae7f11fdce tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: e1c88ea7-2311-4b05-94ba-6e641159d41a] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:02.209098 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-16fb095a-6789-4bf6-8ebf-feae7f11fdce tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:02.210201 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-16fb095a-6789-4bf6-8ebf-feae7f11fdce tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:02.211669 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-16fb095a-6789-4bf6-8ebf-feae7f11fdce tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:02.212872 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-16fb095a-6789-4bf6-8ebf-feae7f11fdce tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:02.348636 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-be8d65ae-d941-4dce-8879-12eaffa287a0 tempest-QuotasAdminTestV236-239397276 tempest-QuotasAdminTestV236-239397276-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/088e8b6ad6574809a19b162d0e593f94" status: 200 len: 240 microversion: 2.36 time: 0.403963 Apr 16 21:12:02.349664 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 751/1551] 10.222.0.20 () {62 vars in 1302 bytes} [Sat Apr 16 21:12:01 2022] PUT /compute/v2.1/os-quota-sets/088e8b6ad6574809a19b162d0e593f94 => generated 240 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:12:02.360232 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fc503f6e-972c-4fc0-80cc-50a82fcdc799 tempest-QuotasAdminTestV236-239397276 tempest-QuotasAdminTestV236-239397276-project-admin] Calling method '.version_select at 0x7fbb96274ee0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:02.431338 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fc503f6e-972c-4fc0-80cc-50a82fcdc799 tempest-QuotasAdminTestV236-239397276 tempest-QuotasAdminTestV236-239397276-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:02.432118 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fc503f6e-972c-4fc0-80cc-50a82fcdc799 tempest-QuotasAdminTestV236-239397276 tempest-QuotasAdminTestV236-239397276-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:02.433172 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fc503f6e-972c-4fc0-80cc-50a82fcdc799 tempest-QuotasAdminTestV236-239397276 tempest-QuotasAdminTestV236-239397276-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:02.433367 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fc503f6e-972c-4fc0-80cc-50a82fcdc799 tempest-QuotasAdminTestV236-239397276 tempest-QuotasAdminTestV236-239397276-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:02.464255 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fc503f6e-972c-4fc0-80cc-50a82fcdc799 tempest-QuotasAdminTestV236-239397276 tempest-QuotasAdminTestV236-239397276-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/088e8b6ad6574809a19b162d0e593f94/detail" status: 200 len: 672 microversion: 2.36 time: 0.097503 Apr 16 21:12:02.472227 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 752/1552] 10.222.0.20 () {60 vars in 1303 bytes} [Sat Apr 16 21:12:02 2022] GET /compute/v2.1/os-quota-sets/088e8b6ad6574809a19b162d0e593f94/detail => generated 672 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:12:02.529882 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-16fb095a-6789-4bf6-8ebf-feae7f11fdce tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b5365affd1481db288841b9ffbf5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:02.540117 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-16fb095a-6789-4bf6-8ebf-feae7f11fdce tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c88ea7-2311-4b05-94ba-6e641159d41a" status: 200 len: 1323 microversion: 2.1 time: 0.349166 Apr 16 21:12:02.541283 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 801/1553] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:02 2022] GET /compute/v2.1/servers/e1c88ea7-2311-4b05-94ba-6e641159d41a => generated 1323 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:12:02.606821 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-c45ec68c-665d-4d36-9ea0-3b31b221480a req-e2e6db7b-11da-48c5-9821-ae9e7fe7f42c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fed9e31-a940-4555-8877-e98e33e6524f", "tag": "a2e2efb4-66f3-4f0e-9ba5-a1ce7dfbe99f"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:12:02.615747 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-c45ec68c-665d-4d36-9ea0-3b31b221480a req-e2e6db7b-11da-48c5-9821-ae9e7fe7f42c service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:02.616254 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-c45ec68c-665d-4d36-9ea0-3b31b221480a req-e2e6db7b-11da-48c5-9821-ae9e7fe7f42c service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:02.630287 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-c45ec68c-665d-4d36-9ea0-3b31b221480a req-e2e6db7b-11da-48c5-9821-ae9e7fe7f42c service nova] Creating event network-changed:a2e2efb4-66f3-4f0e-9ba5-a1ce7dfbe99f for instance 8fed9e31-a940-4555-8877-e98e33e6524f on nch2-master-1 Apr 16 21:12:02.652062 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-c45ec68c-665d-4d36-9ea0-3b31b221480a req-e2e6db7b-11da-48c5-9821-ae9e7fe7f42c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046722 Apr 16 21:12:02.653871 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 753/1554] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:12:02.693480 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-dce26541-dbf2-4f63-b0b6-30caa6385b0b tempest-QuotasAdminTestV236-239397276 tempest-QuotasAdminTestV236-239397276-project-admin] Action: 'update', calling method: .version_select at 0x7fbb9645d4c0>, body: {"quota_set": {"ram": "2048"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:12:02.797347 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dce26541-dbf2-4f63-b0b6-30caa6385b0b tempest-QuotasAdminTestV236-239397276 tempest-QuotasAdminTestV236-239397276-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:02.797801 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dce26541-dbf2-4f63-b0b6-30caa6385b0b tempest-QuotasAdminTestV236-239397276 tempest-QuotasAdminTestV236-239397276-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:02.798607 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dce26541-dbf2-4f63-b0b6-30caa6385b0b tempest-QuotasAdminTestV236-239397276 tempest-QuotasAdminTestV236-239397276-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:02.799187 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dce26541-dbf2-4f63-b0b6-30caa6385b0b tempest-QuotasAdminTestV236-239397276 tempest-QuotasAdminTestV236-239397276-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:02.835201 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dce26541-dbf2-4f63-b0b6-30caa6385b0b tempest-QuotasAdminTestV236-239397276 tempest-QuotasAdminTestV236-239397276-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:02.835429 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dce26541-dbf2-4f63-b0b6-30caa6385b0b tempest-QuotasAdminTestV236-239397276 tempest-QuotasAdminTestV236-239397276-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:02.836294 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dce26541-dbf2-4f63-b0b6-30caa6385b0b tempest-QuotasAdminTestV236-239397276 tempest-QuotasAdminTestV236-239397276-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:02.836739 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dce26541-dbf2-4f63-b0b6-30caa6385b0b tempest-QuotasAdminTestV236-239397276 tempest-QuotasAdminTestV236-239397276-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:03.090982 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-dce26541-dbf2-4f63-b0b6-30caa6385b0b tempest-QuotasAdminTestV236-239397276 tempest-QuotasAdminTestV236-239397276-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/088e8b6ad6574809a19b162d0e593f94?user_id=e41c6cc3b0f44959b0867e319172ea35" status: 200 len: 240 microversion: 2.36 time: 0.405005 Apr 16 21:12:03.092759 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 802/1555] 10.222.0.20 () {62 vars in 1383 bytes} [Sat Apr 16 21:12:02 2022] PUT /compute/v2.1/os-quota-sets/088e8b6ad6574809a19b162d0e593f94?user_id=e41c6cc3b0f44959b0867e319172ea35 => generated 240 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 16 21:12:03.108537 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-50e2998a-f500-4f7b-bc36-e24c0f1d79f8 tempest-QuotasAdminTestV236-239397276 tempest-QuotasAdminTestV236-239397276-project-admin] Calling method '.version_select at 0x7fbb9627ad30>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:03.136639 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f6971131-2153-4938-9404-dca7a5802277 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:03.137258 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f6971131-2153-4938-9404-dca7a5802277 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 88a6591a-336d-477a-8a77-d4e30a1bb0bf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:03.150049 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6971131-2153-4938-9404-dca7a5802277 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:03.150720 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6971131-2153-4938-9404-dca7a5802277 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:03.152407 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6971131-2153-4938-9404-dca7a5802277 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:03.152873 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6971131-2153-4938-9404-dca7a5802277 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:03.168769 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-f6971131-2153-4938-9404-dca7a5802277 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] HTTP exception thrown: Instance 88a6591a-336d-477a-8a77-d4e30a1bb0bf could not be found. Apr 16 21:12:03.169387 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f6971131-2153-4938-9404-dca7a5802277 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Returning 404 to user: Instance 88a6591a-336d-477a-8a77-d4e30a1bb0bf could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:12:03.174006 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f6971131-2153-4938-9404-dca7a5802277 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf" status: 404 len: 111 microversion: 2.1 time: 0.037831 Apr 16 21:12:03.174006 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 803/1556] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:03 2022] GET /compute/v2.1/servers/88a6591a-336d-477a-8a77-d4e30a1bb0bf => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:12:03.180206 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-02d83adf-7822-4e2c-81ad-cd4276caa1ae tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:03.180892 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-02d83adf-7822-4e2c-81ad-cd4276caa1ae tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: a1064818-2a5f-42f7-9566-57a10ea5eb57] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:03.193214 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-02d83adf-7822-4e2c-81ad-cd4276caa1ae tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:03.194059 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-02d83adf-7822-4e2c-81ad-cd4276caa1ae tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:03.195285 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-02d83adf-7822-4e2c-81ad-cd4276caa1ae tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:03.196118 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-02d83adf-7822-4e2c-81ad-cd4276caa1ae tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:03.221032 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-50e2998a-f500-4f7b-bc36-e24c0f1d79f8 tempest-QuotasAdminTestV236-239397276 tempest-QuotasAdminTestV236-239397276-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/088e8b6ad6574809a19b162d0e593f94?user_id=e41c6cc3b0f44959b0867e319172ea35" status: 200 len: 282 microversion: 2.36 time: 0.119280 Apr 16 21:12:03.221613 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 754/1557] 10.222.0.20 () {60 vars in 1363 bytes} [Sat Apr 16 21:12:03 2022] GET /compute/v2.1/os-quota-sets/088e8b6ad6574809a19b162d0e593f94?user_id=e41c6cc3b0f44959b0867e319172ea35 => generated 282 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:12:03.229837 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-02d83adf-7822-4e2c-81ad-cd4276caa1ae tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: a1064818-2a5f-42f7-9566-57a10ea5eb57] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:12:03.558617 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ace5bd86-fdc2-4450-857e-e673d885299f tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:03.559455 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ace5bd86-fdc2-4450-857e-e673d885299f tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: e1c88ea7-2311-4b05-94ba-6e641159d41a] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:03.572043 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ace5bd86-fdc2-4450-857e-e673d885299f tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:03.574751 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ace5bd86-fdc2-4450-857e-e673d885299f tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:03.576337 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ace5bd86-fdc2-4450-857e-e673d885299f tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:03.578654 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ace5bd86-fdc2-4450-857e-e673d885299f tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:03.688156 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-02d83adf-7822-4e2c-81ad-cd4276caa1ae tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a1064818-2a5f-42f7-9566-57a10ea5eb57" status: 204 len: 0 microversion: 2.1 time: 0.511508 Apr 16 21:12:03.692579 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 804/1558] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:12:03 2022] DELETE /compute/v2.1/servers/a1064818-2a5f-42f7-9566-57a10ea5eb57 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:12:03.701606 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-01f7b232-346e-496c-8e49-ce341c9d6037 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:03.702670 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-01f7b232-346e-496c-8e49-ce341c9d6037 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: a1064818-2a5f-42f7-9566-57a10ea5eb57] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:03.711589 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-01f7b232-346e-496c-8e49-ce341c9d6037 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:03.712387 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-01f7b232-346e-496c-8e49-ce341c9d6037 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:03.713823 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-01f7b232-346e-496c-8e49-ce341c9d6037 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:03.714484 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-01f7b232-346e-496c-8e49-ce341c9d6037 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:03.914381 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ace5bd86-fdc2-4450-857e-e673d885299f tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b5365affd1481db288841b9ffbf5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:03.926501 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ace5bd86-fdc2-4450-857e-e673d885299f tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c88ea7-2311-4b05-94ba-6e641159d41a" status: 200 len: 1323 microversion: 2.1 time: 0.371827 Apr 16 21:12:03.927810 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 755/1559] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:03 2022] GET /compute/v2.1/servers/e1c88ea7-2311-4b05-94ba-6e641159d41a => generated 1323 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:04.022783 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-01f7b232-346e-496c-8e49-ce341c9d6037 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:04.032239 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-01f7b232-346e-496c-8e49-ce341c9d6037 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/a1064818-2a5f-42f7-9566-57a10ea5eb57" status: 200 len: 1472 microversion: 2.1 time: 0.335243 Apr 16 21:12:04.032824 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 805/1560] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:03 2022] GET /compute/v2.1/servers/a1064818-2a5f-42f7-9566-57a10ea5eb57 => generated 1472 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:04.945980 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a4e03dec-1a71-489a-a2fc-ce73f6cef804 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:04.946774 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a4e03dec-1a71-489a-a2fc-ce73f6cef804 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: e1c88ea7-2311-4b05-94ba-6e641159d41a] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:04.961069 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a4e03dec-1a71-489a-a2fc-ce73f6cef804 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:04.963386 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a4e03dec-1a71-489a-a2fc-ce73f6cef804 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:04.966234 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a4e03dec-1a71-489a-a2fc-ce73f6cef804 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:04.967734 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a4e03dec-1a71-489a-a2fc-ce73f6cef804 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:05.051484 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-09ff67dd-a2a2-413e-a368-dd16f08bd0c0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:05.052110 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-09ff67dd-a2a2-413e-a368-dd16f08bd0c0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: a1064818-2a5f-42f7-9566-57a10ea5eb57] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:05.065034 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-09ff67dd-a2a2-413e-a368-dd16f08bd0c0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:05.068783 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-09ff67dd-a2a2-413e-a368-dd16f08bd0c0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:05.069987 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-09ff67dd-a2a2-413e-a368-dd16f08bd0c0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:05.072144 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-09ff67dd-a2a2-413e-a368-dd16f08bd0c0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:05.281927 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-09ff67dd-a2a2-413e-a368-dd16f08bd0c0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:05.304567 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-09ff67dd-a2a2-413e-a368-dd16f08bd0c0 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/a1064818-2a5f-42f7-9566-57a10ea5eb57" status: 200 len: 1472 microversion: 2.1 time: 0.255323 Apr 16 21:12:05.306082 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 806/1561] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:05 2022] GET /compute/v2.1/servers/a1064818-2a5f-42f7-9566-57a10ea5eb57 => generated 1472 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:12:05.498811 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-898e2715-3e6d-4742-a6c8-2b14a52b31c6 tempest-FloatingIPDetailsTestJSON-1719300607 tempest-FloatingIPDetailsTestJSON-1719300607-project] Action: 'create', calling method: .version_select at 0x7fbb9645d550>, body: {"pool": null} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:12:05.747530 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a4e03dec-1a71-489a-a2fc-ce73f6cef804 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b5365affd1481db288841b9ffbf5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:05.760585 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a4e03dec-1a71-489a-a2fc-ce73f6cef804 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c88ea7-2311-4b05-94ba-6e641159d41a" status: 200 len: 1323 microversion: 2.1 time: 0.818573 Apr 16 21:12:05.770408 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 756/1562] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:04 2022] GET /compute/v2.1/servers/e1c88ea7-2311-4b05-94ba-6e641159d41a => generated 1323 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:06.322529 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f1e45181-cdea-4cc6-ab31-44fefa479740 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:06.323862 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f1e45181-cdea-4cc6-ab31-44fefa479740 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: a1064818-2a5f-42f7-9566-57a10ea5eb57] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:06.331082 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f1e45181-cdea-4cc6-ab31-44fefa479740 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:06.338109 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f1e45181-cdea-4cc6-ab31-44fefa479740 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:06.339133 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f1e45181-cdea-4cc6-ab31-44fefa479740 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:06.341377 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f1e45181-cdea-4cc6-ab31-44fefa479740 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:06.656910 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f1e45181-cdea-4cc6-ab31-44fefa479740 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:06.691242 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f1e45181-cdea-4cc6-ab31-44fefa479740 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/a1064818-2a5f-42f7-9566-57a10ea5eb57" status: 200 len: 1472 microversion: 2.1 time: 0.366956 Apr 16 21:12:06.691242 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 757/1563] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:06 2022] GET /compute/v2.1/servers/a1064818-2a5f-42f7-9566-57a10ea5eb57 => generated 1472 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:12:06.692490 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-4297bd76-b90a-4a83-be27-655a5a109cc5 req-e00f4f6e-b0e3-4913-bfcd-5b300bc892a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a1064818-2a5f-42f7-9566-57a10ea5eb57", "name": "network-vif-deleted", "tag": "214939ad-5504-4c41-a66d-6940e76ded8b"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:12:06.714244 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-4297bd76-b90a-4a83-be27-655a5a109cc5 req-e00f4f6e-b0e3-4913-bfcd-5b300bc892a1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:06.714375 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-4297bd76-b90a-4a83-be27-655a5a109cc5 req-e00f4f6e-b0e3-4913-bfcd-5b300bc892a1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:06.726485 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-4297bd76-b90a-4a83-be27-655a5a109cc5 req-e00f4f6e-b0e3-4913-bfcd-5b300bc892a1 service nova] Creating event network-vif-deleted:214939ad-5504-4c41-a66d-6940e76ded8b for instance a1064818-2a5f-42f7-9566-57a10ea5eb57 on nch1-master-1 Apr 16 21:12:06.732853 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-4297bd76-b90a-4a83-be27-655a5a109cc5 req-e00f4f6e-b0e3-4913-bfcd-5b300bc892a1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045017 Apr 16 21:12:06.739425 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 758/1564] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:12:06.795694 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6a22dfa1-c2b7-4212-b41c-1819663221dd tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:06.800318 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6a22dfa1-c2b7-4212-b41c-1819663221dd tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: e1c88ea7-2311-4b05-94ba-6e641159d41a] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:06.808520 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6a22dfa1-c2b7-4212-b41c-1819663221dd tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:06.809557 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6a22dfa1-c2b7-4212-b41c-1819663221dd tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:06.813335 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6a22dfa1-c2b7-4212-b41c-1819663221dd tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:06.814031 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6a22dfa1-c2b7-4212-b41c-1819663221dd tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:07.379545 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6a22dfa1-c2b7-4212-b41c-1819663221dd tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b5365affd1481db288841b9ffbf5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:07.389466 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6a22dfa1-c2b7-4212-b41c-1819663221dd tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c88ea7-2311-4b05-94ba-6e641159d41a" status: 200 len: 1323 microversion: 2.1 time: 0.615771 Apr 16 21:12:07.391338 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 759/1565] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:06 2022] GET /compute/v2.1/servers/e1c88ea7-2311-4b05-94ba-6e641159d41a => generated 1323 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:07.709907 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9c89ed31-7995-4ade-978b-b0d4724d20f7 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:07.716338 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9c89ed31-7995-4ade-978b-b0d4724d20f7 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: a1064818-2a5f-42f7-9566-57a10ea5eb57] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:07.730050 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9c89ed31-7995-4ade-978b-b0d4724d20f7 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:07.730719 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9c89ed31-7995-4ade-978b-b0d4724d20f7 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:07.731754 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9c89ed31-7995-4ade-978b-b0d4724d20f7 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:07.747295 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9c89ed31-7995-4ade-978b-b0d4724d20f7 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:07.868868 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9c89ed31-7995-4ade-978b-b0d4724d20f7 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:07.875412 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9c89ed31-7995-4ade-978b-b0d4724d20f7 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:07.875412 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-9c89ed31-7995-4ade-978b-b0d4724d20f7 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lazy-loading 'fault' on Instance uuid a1064818-2a5f-42f7-9566-57a10ea5eb57 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:12:07.988763 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9c89ed31-7995-4ade-978b-b0d4724d20f7 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:08.001800 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9c89ed31-7995-4ade-978b-b0d4724d20f7 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/a1064818-2a5f-42f7-9566-57a10ea5eb57" status: 200 len: 1306 microversion: 2.1 time: 0.300689 Apr 16 21:12:08.003351 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 760/1566] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:07 2022] GET /compute/v2.1/servers/a1064818-2a5f-42f7-9566-57a10ea5eb57 => generated 1306 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:08.407317 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1d95ddb8-c87e-49f2-b646-0f1fad660cf2 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:08.407956 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1d95ddb8-c87e-49f2-b646-0f1fad660cf2 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: e1c88ea7-2311-4b05-94ba-6e641159d41a] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:08.448897 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1d95ddb8-c87e-49f2-b646-0f1fad660cf2 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:08.449683 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1d95ddb8-c87e-49f2-b646-0f1fad660cf2 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:08.451206 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1d95ddb8-c87e-49f2-b646-0f1fad660cf2 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:08.452431 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1d95ddb8-c87e-49f2-b646-0f1fad660cf2 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:08.751244 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1d95ddb8-c87e-49f2-b646-0f1fad660cf2 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b5365affd1481db288841b9ffbf5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:08.760727 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1d95ddb8-c87e-49f2-b646-0f1fad660cf2 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c88ea7-2311-4b05-94ba-6e641159d41a" status: 200 len: 1323 microversion: 2.1 time: 0.357601 Apr 16 21:12:08.771030 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 761/1567] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:08 2022] GET /compute/v2.1/servers/e1c88ea7-2311-4b05-94ba-6e641159d41a => generated 1323 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:12:08.776105 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-0cd35515-21a2-4f2e-bc86-6a71da82e86e req-d65ee25f-269c-4bb5-9f2f-5d08e92b9a93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80bcd5fb-6cbf-49ce-b126-1a95b55ba451", "name": "network-vif-plugged", "status": "completed", "tag": "96a1cc71-d1de-4f33-ad30-0d9143131754"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:12:08.785036 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-0cd35515-21a2-4f2e-bc86-6a71da82e86e req-d65ee25f-269c-4bb5-9f2f-5d08e92b9a93 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:08.785690 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-0cd35515-21a2-4f2e-bc86-6a71da82e86e req-d65ee25f-269c-4bb5-9f2f-5d08e92b9a93 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:08.800408 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-0cd35515-21a2-4f2e-bc86-6a71da82e86e req-d65ee25f-269c-4bb5-9f2f-5d08e92b9a93 service nova] Creating event network-vif-plugged:96a1cc71-d1de-4f33-ad30-0d9143131754 for instance 80bcd5fb-6cbf-49ce-b126-1a95b55ba451 on nch1-master-1 Apr 16 21:12:08.805803 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-0cd35515-21a2-4f2e-bc86-6a71da82e86e req-d65ee25f-269c-4bb5-9f2f-5d08e92b9a93 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033408 Apr 16 21:12:08.806551 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 762/1568] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:12:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:12:09.022543 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-178acf62-a9e1-4f83-b996-e5643c5e60ea tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:09.023426 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-178acf62-a9e1-4f83-b996-e5643c5e60ea tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: a1064818-2a5f-42f7-9566-57a10ea5eb57] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:09.050762 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-178acf62-a9e1-4f83-b996-e5643c5e60ea tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:09.052717 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-178acf62-a9e1-4f83-b996-e5643c5e60ea tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:09.054203 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-178acf62-a9e1-4f83-b996-e5643c5e60ea tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:09.055038 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-178acf62-a9e1-4f83-b996-e5643c5e60ea tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:09.085224 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-178acf62-a9e1-4f83-b996-e5643c5e60ea tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] HTTP exception thrown: Instance a1064818-2a5f-42f7-9566-57a10ea5eb57 could not be found. Apr 16 21:12:09.097881 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-178acf62-a9e1-4f83-b996-e5643c5e60ea tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Returning 404 to user: Instance a1064818-2a5f-42f7-9566-57a10ea5eb57 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:12:09.105021 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-178acf62-a9e1-4f83-b996-e5643c5e60ea tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/a1064818-2a5f-42f7-9566-57a10ea5eb57" status: 404 len: 111 microversion: 2.1 time: 0.080961 Apr 16 21:12:09.105021 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 763/1569] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:09 2022] GET /compute/v2.1/servers/a1064818-2a5f-42f7-9566-57a10ea5eb57 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:12:09.114458 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5785a7e2-5850-4658-a9b5-ed1eaf7bc1d3 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:09.115147 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5785a7e2-5850-4658-a9b5-ed1eaf7bc1d3 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 970fc2c2-b7bc-496e-bbf5-be24bc6cf248] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:09.135744 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5785a7e2-5850-4658-a9b5-ed1eaf7bc1d3 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:09.137497 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5785a7e2-5850-4658-a9b5-ed1eaf7bc1d3 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:09.139792 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5785a7e2-5850-4658-a9b5-ed1eaf7bc1d3 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:09.141961 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5785a7e2-5850-4658-a9b5-ed1eaf7bc1d3 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:09.188629 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-898e2715-3e6d-4742-a6c8-2b14a52b31c6 tempest-FloatingIPDetailsTestJSON-1719300607 tempest-FloatingIPDetailsTestJSON-1719300607-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.874064 Apr 16 21:12:09.190972 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 807/1570] 10.222.0.20 () {60 vars in 1169 bytes} [Sat Apr 16 21:12:05 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3884 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:12:09.209850 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cda1db40-d82c-41c1-a73c-9957909aa083 tempest-FloatingIPDetailsTestJSON-1719300607 tempest-FloatingIPDetailsTestJSON-1719300607-project] Action: 'create', calling method: .version_select at 0x7fbba0070040>, body: {"pool": null} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:12:09.218074 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5785a7e2-5850-4658-a9b5-ed1eaf7bc1d3 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 970fc2c2-b7bc-496e-bbf5-be24bc6cf248] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:12:09.743402 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5785a7e2-5850-4658-a9b5-ed1eaf7bc1d3 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "DELETE /compute/v2.1/servers/970fc2c2-b7bc-496e-bbf5-be24bc6cf248" status: 204 len: 0 microversion: 2.1 time: 0.635018 Apr 16 21:12:09.747394 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 764/1571] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:12:09 2022] DELETE /compute/v2.1/servers/970fc2c2-b7bc-496e-bbf5-be24bc6cf248 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:12:09.760194 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6aa07d9f-a782-493a-922e-050444dec10a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:09.761323 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6aa07d9f-a782-493a-922e-050444dec10a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 8255008b-aaf4-444d-bdcd-6746d42c267b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:09.771126 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6aa07d9f-a782-493a-922e-050444dec10a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:09.772233 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6aa07d9f-a782-493a-922e-050444dec10a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:09.773338 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6aa07d9f-a782-493a-922e-050444dec10a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:09.774088 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6aa07d9f-a782-493a-922e-050444dec10a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:09.848725 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6aa07d9f-a782-493a-922e-050444dec10a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 8255008b-aaf4-444d-bdcd-6746d42c267b] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:12:10.285261 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6aa07d9f-a782-493a-922e-050444dec10a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8255008b-aaf4-444d-bdcd-6746d42c267b" status: 204 len: 0 microversion: 2.1 time: 0.531397 Apr 16 21:12:10.285848 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 765/1572] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:12:09 2022] DELETE /compute/v2.1/servers/8255008b-aaf4-444d-bdcd-6746d42c267b => generated 0 bytes in 534 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 16 21:12:10.291590 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b4d2dddb-8c94-4f93-8805-b14055df1538 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:10.292474 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b4d2dddb-8c94-4f93-8805-b14055df1538 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: e1c88ea7-2311-4b05-94ba-6e641159d41a] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:10.300861 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b4d2dddb-8c94-4f93-8805-b14055df1538 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:10.301564 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b4d2dddb-8c94-4f93-8805-b14055df1538 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:10.302617 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b4d2dddb-8c94-4f93-8805-b14055df1538 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:10.303282 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b4d2dddb-8c94-4f93-8805-b14055df1538 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:10.879242 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b4d2dddb-8c94-4f93-8805-b14055df1538 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b5365affd1481db288841b9ffbf5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:10.889467 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b4d2dddb-8c94-4f93-8805-b14055df1538 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c88ea7-2311-4b05-94ba-6e641159d41a" status: 200 len: 1323 microversion: 2.1 time: 0.602354 Apr 16 21:12:10.891447 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 766/1573] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:10 2022] GET /compute/v2.1/servers/e1c88ea7-2311-4b05-94ba-6e641159d41a => generated 1323 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:10.896709 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c00414e8-6941-4705-8d4c-9f0e1987742a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:10.898297 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c00414e8-6941-4705-8d4c-9f0e1987742a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 970fc2c2-b7bc-496e-bbf5-be24bc6cf248] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:10.905623 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c00414e8-6941-4705-8d4c-9f0e1987742a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:10.907060 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c00414e8-6941-4705-8d4c-9f0e1987742a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:10.908471 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c00414e8-6941-4705-8d4c-9f0e1987742a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:10.909529 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c00414e8-6941-4705-8d4c-9f0e1987742a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:11.440828 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c00414e8-6941-4705-8d4c-9f0e1987742a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:11.449333 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c00414e8-6941-4705-8d4c-9f0e1987742a tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/970fc2c2-b7bc-496e-bbf5-be24bc6cf248" status: 200 len: 1474 microversion: 2.1 time: 0.556623 Apr 16 21:12:11.452148 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 767/1574] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:10 2022] GET /compute/v2.1/servers/970fc2c2-b7bc-496e-bbf5-be24bc6cf248 => generated 1474 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:11.460429 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-833abe98-c22b-4ac5-961b-aa28dfce7d72 req-31703e30-4bcd-4adc-8278-a37038870578 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c88ea7-2311-4b05-94ba-6e641159d41a", "name": "network-vif-plugged", "status": "completed", "tag": "be39f056-864d-4773-9608-d25a97235273"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:12:11.475419 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-833abe98-c22b-4ac5-961b-aa28dfce7d72 req-31703e30-4bcd-4adc-8278-a37038870578 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:11.476332 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-833abe98-c22b-4ac5-961b-aa28dfce7d72 req-31703e30-4bcd-4adc-8278-a37038870578 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:11.489317 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-833abe98-c22b-4ac5-961b-aa28dfce7d72 req-31703e30-4bcd-4adc-8278-a37038870578 service nova] Creating event network-vif-plugged:be39f056-864d-4773-9608-d25a97235273 for instance e1c88ea7-2311-4b05-94ba-6e641159d41a on nch2-master-1 Apr 16 21:12:11.495804 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-833abe98-c22b-4ac5-961b-aa28dfce7d72 req-31703e30-4bcd-4adc-8278-a37038870578 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040658 Apr 16 21:12:11.496722 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 768/1575] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:12:11.955944 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cda1db40-d82c-41c1-a73c-9957909aa083 tempest-FloatingIPDetailsTestJSON-1719300607 tempest-FloatingIPDetailsTestJSON-1719300607-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.758494 Apr 16 21:12:11.956896 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 808/1576] 10.222.0.20 () {60 vars in 1169 bytes} [Sat Apr 16 21:12:09 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2760 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:12:11.963890 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-43ca9e61-0341-4794-a73f-abcb7a920a6c tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:11.964548 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-43ca9e61-0341-4794-a73f-abcb7a920a6c tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: e1c88ea7-2311-4b05-94ba-6e641159d41a] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:11.971629 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-43ca9e61-0341-4794-a73f-abcb7a920a6c tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:11.972378 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-43ca9e61-0341-4794-a73f-abcb7a920a6c tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:11.974206 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-43ca9e61-0341-4794-a73f-abcb7a920a6c tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:11.974980 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-43ca9e61-0341-4794-a73f-abcb7a920a6c tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:11.983221 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4ca12118-54f1-476d-8e8b-4e8de37ff10c tempest-QuotasAdminNegativeTest-1605922124 tempest-QuotasAdminNegativeTest-1605922124-project-admin] Calling method '.version_select at 0x7fbb962528b0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:12.090976 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4ca12118-54f1-476d-8e8b-4e8de37ff10c tempest-QuotasAdminNegativeTest-1605922124 tempest-QuotasAdminNegativeTest-1605922124-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/f9a47e755547403d9597a177ee6ef95b" status: 200 len: 371 microversion: 2.1 time: 0.322963 Apr 16 21:12:12.097854 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 769/1577] 10.222.0.20 () {58 vars in 1241 bytes} [Sat Apr 16 21:12:11 2022] GET /compute/v2.1/os-quota-sets/f9a47e755547403d9597a177ee6ef95b => generated 371 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:12:12.104115 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4ed3788d-8ff8-468f-9058-e399f5b469ef tempest-FloatingIPDetailsTestJSON-1719300607 tempest-FloatingIPDetailsTestJSON-1719300607-project] Action: 'create', calling method: .version_select at 0x7fbb962270d0>, body: {"pool": null} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:12:12.189971 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-43ca9e61-0341-4794-a73f-abcb7a920a6c tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b5365affd1481db288841b9ffbf5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:12.200750 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-43ca9e61-0341-4794-a73f-abcb7a920a6c tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c88ea7-2311-4b05-94ba-6e641159d41a" status: 200 len: 1323 microversion: 2.1 time: 0.242461 Apr 16 21:12:12.201577 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 809/1578] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:11 2022] GET /compute/v2.1/servers/e1c88ea7-2311-4b05-94ba-6e641159d41a => generated 1323 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:12.210128 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5d2bbbce-2faf-4e06-85ab-f872f6969367 tempest-QuotasAdminNegativeTest-1605922124 tempest-QuotasAdminNegativeTest-1605922124-project-admin] Action: 'update', calling method: .version_select at 0x7fbb96142ee0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:12:12.305039 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5d2bbbce-2faf-4e06-85ab-f872f6969367 tempest-QuotasAdminNegativeTest-1605922124 tempest-QuotasAdminNegativeTest-1605922124-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:12.305759 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5d2bbbce-2faf-4e06-85ab-f872f6969367 tempest-QuotasAdminNegativeTest-1605922124 tempest-QuotasAdminNegativeTest-1605922124-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:12.307577 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5d2bbbce-2faf-4e06-85ab-f872f6969367 tempest-QuotasAdminNegativeTest-1605922124 tempest-QuotasAdminNegativeTest-1605922124-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:12.308482 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5d2bbbce-2faf-4e06-85ab-f872f6969367 tempest-QuotasAdminNegativeTest-1605922124 tempest-QuotasAdminNegativeTest-1605922124-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:12.559065 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5d2bbbce-2faf-4e06-85ab-f872f6969367 tempest-QuotasAdminNegativeTest-1605922124 tempest-QuotasAdminNegativeTest-1605922124-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/f9a47e755547403d9597a177ee6ef95b" status: 200 len: 328 microversion: 2.1 time: 0.353587 Apr 16 21:12:12.568433 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 810/1579] 10.222.0.20 () {60 vars in 1261 bytes} [Sat Apr 16 21:12:12 2022] PUT /compute/v2.1/os-quota-sets/f9a47e755547403d9597a177ee6ef95b => generated 328 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:12:12.580629 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6bc31d20-0693-4148-9a66-fdecc8c250b6 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:12.581278 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6bc31d20-0693-4148-9a66-fdecc8c250b6 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 970fc2c2-b7bc-496e-bbf5-be24bc6cf248] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:12.599905 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6bc31d20-0693-4148-9a66-fdecc8c250b6 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:12.600356 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6bc31d20-0693-4148-9a66-fdecc8c250b6 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:12.602118 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6bc31d20-0693-4148-9a66-fdecc8c250b6 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:12.602590 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6bc31d20-0693-4148-9a66-fdecc8c250b6 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:12.825174 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6bc31d20-0693-4148-9a66-fdecc8c250b6 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:12.844560 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6bc31d20-0693-4148-9a66-fdecc8c250b6 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/970fc2c2-b7bc-496e-bbf5-be24bc6cf248" status: 200 len: 1474 microversion: 2.1 time: 0.269292 Apr 16 21:12:12.845252 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 811/1580] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:12 2022] GET /compute/v2.1/servers/970fc2c2-b7bc-496e-bbf5-be24bc6cf248 => generated 1474 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:12.970836 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b8dfb5c7-534a-4ac1-a673-02e563c2e4e8 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-738682300", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:12:13.062679 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-b8dfb5c7-534a-4ac1-a673-02e563c2e4e8 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] validate_networks() for None {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:12:13.484730 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-b8dfb5c7-534a-4ac1-a673-02e563c2e4e8 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:12:13.485547 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-b8dfb5c7-534a-4ac1-a673-02e563c2e4e8 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:12:13.486076 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-b8dfb5c7-534a-4ac1-a673-02e563c2e4e8 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:12:13.486519 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-b8dfb5c7-534a-4ac1-a673-02e563c2e4e8 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:12:13.486945 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-b8dfb5c7-534a-4ac1-a673-02e563c2e4e8 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:12:13.533569 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b8dfb5c7-534a-4ac1-a673-02e563c2e4e8 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:13.534293 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b8dfb5c7-534a-4ac1-a673-02e563c2e4e8 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:13.539700 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b8dfb5c7-534a-4ac1-a673-02e563c2e4e8 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:13.540208 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b8dfb5c7-534a-4ac1-a673-02e563c2e4e8 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:13.610402 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-b8dfb5c7-534a-4ac1-a673-02e563c2e4e8 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] Getting quotas for project f9a47e755547403d9597a177ee6ef95b. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:12:13.620676 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-b8dfb5c7-534a-4ac1-a673-02e563c2e4e8 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] Getting quotas for user 9a87cb3156424042a4eca264c6c084da and project f9a47e755547403d9597a177ee6ef95b. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:12:13.653339 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.utils [None req-b8dfb5c7-534a-4ac1-a673-02e563c2e4e8 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] cores quota exceeded for f9a47e755547403d9597a177ee6ef95b, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=137408) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Apr 16 21:12:13.655056 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-b8dfb5c7-534a-4ac1-a673-02e563c2e4e8 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Apr 16 21:12:13.657084 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b8dfb5c7-534a-4ac1-a673-02e563c2e4e8 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:12:13.657447 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b8dfb5c7-534a-4ac1-a673-02e563c2e4e8 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 0.809681 Apr 16 21:12:13.658035 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 812/1581] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:12:12 2022] POST /compute/v2.1/servers => generated 111 bytes in 812 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:12:13.663691 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-1240ed9e-d1c1-4bed-8df4-116c2dade3c2 req-60f83b72-38ce-42ca-91f9-de31994b1212 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8255008b-aaf4-444d-bdcd-6746d42c267b", "name": "network-vif-deleted", "tag": "259c9f9f-e7b7-4e10-9e05-3056d94db8ff"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:12:13.692227 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-1240ed9e-d1c1-4bed-8df4-116c2dade3c2 req-60f83b72-38ce-42ca-91f9-de31994b1212 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:13.692887 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-1240ed9e-d1c1-4bed-8df4-116c2dade3c2 req-60f83b72-38ce-42ca-91f9-de31994b1212 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:13.705881 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-1240ed9e-d1c1-4bed-8df4-116c2dade3c2 req-60f83b72-38ce-42ca-91f9-de31994b1212 service nova] Creating event network-vif-deleted:259c9f9f-e7b7-4e10-9e05-3056d94db8ff for instance 8255008b-aaf4-444d-bdcd-6746d42c267b on nch2-master-1 Apr 16 21:12:13.711951 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-1240ed9e-d1c1-4bed-8df4-116c2dade3c2 req-60f83b72-38ce-42ca-91f9-de31994b1212 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052135 Apr 16 21:12:13.713880 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 813/1582] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:12:13.720271 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-a501402e-d8f5-433e-97bd-7067ae7103b7 req-f0fae585-c1df-4afa-a2d6-bb2a169ebec9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "970fc2c2-b7bc-496e-bbf5-be24bc6cf248", "name": "network-vif-deleted", "tag": "e4213a8a-25d6-4171-9e1d-b2165b7b93f4"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:12:13.740050 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-a501402e-d8f5-433e-97bd-7067ae7103b7 req-f0fae585-c1df-4afa-a2d6-bb2a169ebec9 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:13.740627 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-a501402e-d8f5-433e-97bd-7067ae7103b7 req-f0fae585-c1df-4afa-a2d6-bb2a169ebec9 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:13.771687 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-a501402e-d8f5-433e-97bd-7067ae7103b7 req-f0fae585-c1df-4afa-a2d6-bb2a169ebec9 service nova] Creating event network-vif-deleted:e4213a8a-25d6-4171-9e1d-b2165b7b93f4 for instance 970fc2c2-b7bc-496e-bbf5-be24bc6cf248 on nch1-master-1 Apr 16 21:12:13.784382 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-a501402e-d8f5-433e-97bd-7067ae7103b7 req-f0fae585-c1df-4afa-a2d6-bb2a169ebec9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066115 Apr 16 21:12:13.785225 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 814/1583] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:12:13.800577 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a775f578-dc53-40aa-89e8-abb7b3ae9604 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:13.801231 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a775f578-dc53-40aa-89e8-abb7b3ae9604 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: e1c88ea7-2311-4b05-94ba-6e641159d41a] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:13.808984 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a775f578-dc53-40aa-89e8-abb7b3ae9604 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:13.809181 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a775f578-dc53-40aa-89e8-abb7b3ae9604 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:13.810336 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a775f578-dc53-40aa-89e8-abb7b3ae9604 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:13.811234 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a775f578-dc53-40aa-89e8-abb7b3ae9604 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:14.093032 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a775f578-dc53-40aa-89e8-abb7b3ae9604 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b5365affd1481db288841b9ffbf5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:14.111241 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a775f578-dc53-40aa-89e8-abb7b3ae9604 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c88ea7-2311-4b05-94ba-6e641159d41a" status: 200 len: 1323 microversion: 2.1 time: 0.322045 Apr 16 21:12:14.123357 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 815/1584] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:13 2022] GET /compute/v2.1/servers/e1c88ea7-2311-4b05-94ba-6e641159d41a => generated 1323 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:14.131252 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-646a478b-c13c-4346-a5d9-15b17b905c04 tempest-QuotasAdminNegativeTest-1605922124 tempest-QuotasAdminNegativeTest-1605922124-project-admin] Action: 'update', calling method: .version_select at 0x7fbba0096ee0>, body: {"quota_set": {"cores": 20}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:12:14.487237 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-646a478b-c13c-4346-a5d9-15b17b905c04 tempest-QuotasAdminNegativeTest-1605922124 tempest-QuotasAdminNegativeTest-1605922124-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:14.487701 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-646a478b-c13c-4346-a5d9-15b17b905c04 tempest-QuotasAdminNegativeTest-1605922124 tempest-QuotasAdminNegativeTest-1605922124-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:14.488598 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-646a478b-c13c-4346-a5d9-15b17b905c04 tempest-QuotasAdminNegativeTest-1605922124 tempest-QuotasAdminNegativeTest-1605922124-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:14.489048 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-646a478b-c13c-4346-a5d9-15b17b905c04 tempest-QuotasAdminNegativeTest-1605922124 tempest-QuotasAdminNegativeTest-1605922124-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:14.803635 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-646a478b-c13c-4346-a5d9-15b17b905c04 tempest-QuotasAdminNegativeTest-1605922124 tempest-QuotasAdminNegativeTest-1605922124-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/f9a47e755547403d9597a177ee6ef95b" status: 200 len: 329 microversion: 2.1 time: 0.677707 Apr 16 21:12:14.804774 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 816/1585] 10.222.0.20 () {60 vars in 1261 bytes} [Sat Apr 16 21:12:14 2022] PUT /compute/v2.1/os-quota-sets/f9a47e755547403d9597a177ee6ef95b => generated 329 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:12:14.809716 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f72b5749-cf6c-4fe2-9373-4324f51c2756 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:14.810329 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f72b5749-cf6c-4fe2-9373-4324f51c2756 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 970fc2c2-b7bc-496e-bbf5-be24bc6cf248] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:14.819762 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f72b5749-cf6c-4fe2-9373-4324f51c2756 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:14.820245 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f72b5749-cf6c-4fe2-9373-4324f51c2756 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:14.821705 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f72b5749-cf6c-4fe2-9373-4324f51c2756 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:14.821705 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f72b5749-cf6c-4fe2-9373-4324f51c2756 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:14.841242 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-f72b5749-cf6c-4fe2-9373-4324f51c2756 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] HTTP exception thrown: Instance 970fc2c2-b7bc-496e-bbf5-be24bc6cf248 could not be found. Apr 16 21:12:14.841242 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f72b5749-cf6c-4fe2-9373-4324f51c2756 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Returning 404 to user: Instance 970fc2c2-b7bc-496e-bbf5-be24bc6cf248 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:12:14.841798 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f72b5749-cf6c-4fe2-9373-4324f51c2756 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/970fc2c2-b7bc-496e-bbf5-be24bc6cf248" status: 404 len: 111 microversion: 2.1 time: 0.035885 Apr 16 21:12:14.844299 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 817/1586] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:14 2022] GET /compute/v2.1/servers/970fc2c2-b7bc-496e-bbf5-be24bc6cf248 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:12:14.849577 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-084bc6da-9de5-4623-8380-07316db701a9 req-2194a38b-e853-4eda-947b-04bff1c7678f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fed9e31-a940-4555-8877-e98e33e6524f", "name": "network-vif-plugged", "status": "completed", "tag": "a2e2efb4-66f3-4f0e-9ba5-a1ce7dfbe99f"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:12:14.858100 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-084bc6da-9de5-4623-8380-07316db701a9 req-2194a38b-e853-4eda-947b-04bff1c7678f service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:14.860231 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-084bc6da-9de5-4623-8380-07316db701a9 req-2194a38b-e853-4eda-947b-04bff1c7678f service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:14.870755 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-084bc6da-9de5-4623-8380-07316db701a9 req-2194a38b-e853-4eda-947b-04bff1c7678f service nova] Creating event network-vif-plugged:a2e2efb4-66f3-4f0e-9ba5-a1ce7dfbe99f for instance 8fed9e31-a940-4555-8877-e98e33e6524f on nch2-master-1 Apr 16 21:12:14.876295 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-084bc6da-9de5-4623-8380-07316db701a9 req-2194a38b-e853-4eda-947b-04bff1c7678f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030411 Apr 16 21:12:14.880311 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 818/1587] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:12:14.885757 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-24d02c2b-debb-470b-8aa6-fe378ff04178 tempest-QuotasAdminNegativeTest-1605922124 tempest-QuotasAdminNegativeTest-1605922124-project-admin] Calling method '.version_select at 0x7fbb96144e50>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:15.109926 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-24d02c2b-debb-470b-8aa6-fe378ff04178 tempest-QuotasAdminNegativeTest-1605922124 tempest-QuotasAdminNegativeTest-1605922124-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/f9a47e755547403d9597a177ee6ef95b" status: 200 len: 371 microversion: 2.1 time: 0.228332 Apr 16 21:12:15.110543 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 819/1588] 10.222.0.20 () {58 vars in 1241 bytes} [Sat Apr 16 21:12:14 2022] GET /compute/v2.1/os-quota-sets/f9a47e755547403d9597a177ee6ef95b => generated 371 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:12:15.115170 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-23dd54f8-18d2-4510-88ab-a8c2b95a0467 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:15.116423 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-23dd54f8-18d2-4510-88ab-a8c2b95a0467 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 8255008b-aaf4-444d-bdcd-6746d42c267b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:15.122775 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-23dd54f8-18d2-4510-88ab-a8c2b95a0467 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:15.123240 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-23dd54f8-18d2-4510-88ab-a8c2b95a0467 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:15.125283 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-23dd54f8-18d2-4510-88ab-a8c2b95a0467 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:15.125743 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-23dd54f8-18d2-4510-88ab-a8c2b95a0467 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:15.140343 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-23dd54f8-18d2-4510-88ab-a8c2b95a0467 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] HTTP exception thrown: Instance 8255008b-aaf4-444d-bdcd-6746d42c267b could not be found. Apr 16 21:12:15.141303 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-23dd54f8-18d2-4510-88ab-a8c2b95a0467 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Returning 404 to user: Instance 8255008b-aaf4-444d-bdcd-6746d42c267b could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:12:15.142399 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-23dd54f8-18d2-4510-88ab-a8c2b95a0467 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/8255008b-aaf4-444d-bdcd-6746d42c267b" status: 404 len: 111 microversion: 2.1 time: 0.030971 Apr 16 21:12:15.143172 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 820/1589] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:15 2022] GET /compute/v2.1/servers/8255008b-aaf4-444d-bdcd-6746d42c267b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:12:15.149717 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3817d851-2da3-4893-8895-d47c64bdb177 tempest-QuotasAdminNegativeTest-1605922124 tempest-QuotasAdminNegativeTest-1605922124-project-admin] Action: 'update', calling method: .version_select at 0x7fbb9654b550>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:12:15.217301 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4ed3788d-8ff8-468f-9058-e399f5b469ef tempest-FloatingIPDetailsTestJSON-1719300607 tempest-FloatingIPDetailsTestJSON-1719300607-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.117169 Apr 16 21:12:15.217843 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 770/1590] 10.222.0.20 () {60 vars in 1169 bytes} [Sat Apr 16 21:12:12 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:12:15.217927 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3817d851-2da3-4893-8895-d47c64bdb177 tempest-QuotasAdminNegativeTest-1605922124 tempest-QuotasAdminNegativeTest-1605922124-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:15.218964 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3817d851-2da3-4893-8895-d47c64bdb177 tempest-QuotasAdminNegativeTest-1605922124 tempest-QuotasAdminNegativeTest-1605922124-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:15.219980 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3817d851-2da3-4893-8895-d47c64bdb177 tempest-QuotasAdminNegativeTest-1605922124 tempest-QuotasAdminNegativeTest-1605922124-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:15.220603 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3817d851-2da3-4893-8895-d47c64bdb177 tempest-QuotasAdminNegativeTest-1605922124 tempest-QuotasAdminNegativeTest-1605922124-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:15.222581 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7086ced7-9ea3-4522-a7eb-62dfdf4d2b38 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:15.223311 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7086ced7-9ea3-4522-a7eb-62dfdf4d2b38 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: e1c88ea7-2311-4b05-94ba-6e641159d41a] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:15.230139 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7086ced7-9ea3-4522-a7eb-62dfdf4d2b38 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:15.230652 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7086ced7-9ea3-4522-a7eb-62dfdf4d2b38 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:15.231482 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7086ced7-9ea3-4522-a7eb-62dfdf4d2b38 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:15.231919 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7086ced7-9ea3-4522-a7eb-62dfdf4d2b38 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:15.391785 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3817d851-2da3-4893-8895-d47c64bdb177 tempest-QuotasAdminNegativeTest-1605922124 tempest-QuotasAdminNegativeTest-1605922124-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/f9a47e755547403d9597a177ee6ef95b" status: 200 len: 328 microversion: 2.1 time: 0.247312 Apr 16 21:12:15.404931 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 821/1591] 10.222.0.20 () {60 vars in 1261 bytes} [Sat Apr 16 21:12:15 2022] PUT /compute/v2.1/os-quota-sets/f9a47e755547403d9597a177ee6ef95b => generated 328 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:12:15.412263 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c9b10760-6fda-48f3-bdab-4f579fc85a68 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:15.451744 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7086ced7-9ea3-4522-a7eb-62dfdf4d2b38 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b5365affd1481db288841b9ffbf5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:15.466806 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7086ced7-9ea3-4522-a7eb-62dfdf4d2b38 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c88ea7-2311-4b05-94ba-6e641159d41a" status: 200 len: 1517 microversion: 2.1 time: 0.248333 Apr 16 21:12:15.470166 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 771/1592] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:15 2022] GET /compute/v2.1/servers/e1c88ea7-2311-4b05-94ba-6e641159d41a => generated 1517 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:15.477984 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-34509c37-6f53-4943-8a22-3c3892d5fb78 tempest-FloatingIPDetailsTestJSON-1719300607 tempest-FloatingIPDetailsTestJSON-1719300607-project] Action: 'create', calling method: .version_select at 0x7fbb9626d0d0>, body: {"pool": null} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:12:15.623802 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c9b10760-6fda-48f3-bdab-4f579fc85a68 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/f04e9963-900e-472a-990e-34003d968b06" status: 204 len: 0 microversion: 2.1 time: 0.217588 Apr 16 21:12:15.625456 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 822/1593] 10.222.0.20 () {58 vars in 1265 bytes} [Sat Apr 16 21:12:15 2022] DELETE /compute/v2.1/os-server-groups/f04e9963-900e-472a-990e-34003d968b06 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:12:15.634134 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bef30606-a11e-4ee5-bae9-d169124b4680 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:15.635073 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-bef30606-a11e-4ee5-bae9-d169124b4680 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: 80bcd5fb-6cbf-49ce-b126-1a95b55ba451] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:15.641959 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bef30606-a11e-4ee5-bae9-d169124b4680 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:15.642472 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bef30606-a11e-4ee5-bae9-d169124b4680 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:15.643322 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bef30606-a11e-4ee5-bae9-d169124b4680 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:15.643937 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bef30606-a11e-4ee5-bae9-d169124b4680 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:15.792288 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-bef30606-a11e-4ee5-bae9-d169124b4680 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b5365affd1481db288841b9ffbf5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:15.799724 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-bef30606-a11e-4ee5-bae9-d169124b4680 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "GET /compute/v2.1/servers/80bcd5fb-6cbf-49ce-b126-1a95b55ba451" status: 200 len: 1517 microversion: 2.1 time: 0.172684 Apr 16 21:12:15.800644 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 823/1594] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:15 2022] GET /compute/v2.1/servers/80bcd5fb-6cbf-49ce-b126-1a95b55ba451 => generated 1517 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:15.805244 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5bdf3df4-e098-4ff7-b0df-49d06eab2157 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-476158245", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:12:15.865287 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-5bdf3df4-e098-4ff7-b0df-49d06eab2157 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] validate_networks() for None {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:12:16.079952 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-5bdf3df4-e098-4ff7-b0df-49d06eab2157 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:12:16.080809 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-5bdf3df4-e098-4ff7-b0df-49d06eab2157 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:12:16.081554 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-5bdf3df4-e098-4ff7-b0df-49d06eab2157 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:12:16.082203 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-5bdf3df4-e098-4ff7-b0df-49d06eab2157 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:12:16.083020 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-5bdf3df4-e098-4ff7-b0df-49d06eab2157 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:12:16.095855 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5bdf3df4-e098-4ff7-b0df-49d06eab2157 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:16.097230 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5bdf3df4-e098-4ff7-b0df-49d06eab2157 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:16.098364 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5bdf3df4-e098-4ff7-b0df-49d06eab2157 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:16.099223 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5bdf3df4-e098-4ff7-b0df-49d06eab2157 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:16.136379 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-5bdf3df4-e098-4ff7-b0df-49d06eab2157 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] Getting quotas for project f9a47e755547403d9597a177ee6ef95b. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:12:16.142334 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-5bdf3df4-e098-4ff7-b0df-49d06eab2157 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] Getting quotas for user 9a87cb3156424042a4eca264c6c084da and project f9a47e755547403d9597a177ee6ef95b. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:12:16.158350 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.utils [None req-5bdf3df4-e098-4ff7-b0df-49d06eab2157 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] instances quota exceeded for f9a47e755547403d9597a177ee6ef95b, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=137408) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Apr 16 21:12:16.159183 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-5bdf3df4-e098-4ff7-b0df-49d06eab2157 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Apr 16 21:12:16.163182 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5bdf3df4-e098-4ff7-b0df-49d06eab2157 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:12:16.163182 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5bdf3df4-e098-4ff7-b0df-49d06eab2157 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.359769 Apr 16 21:12:16.165955 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 824/1595] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:12:15 2022] POST /compute/v2.1/servers => generated 119 bytes in 365 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:12:16.179776 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-db8b0ac6-a0ce-4b64-b7fa-2b70a2ee5f9b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:16.180657 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-db8b0ac6-a0ce-4b64-b7fa-2b70a2ee5f9b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: e26a3424-8bc8-454c-a7e3-507bb1c71c03] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:16.187734 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-db8b0ac6-a0ce-4b64-b7fa-2b70a2ee5f9b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:16.188233 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-db8b0ac6-a0ce-4b64-b7fa-2b70a2ee5f9b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:16.189140 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-db8b0ac6-a0ce-4b64-b7fa-2b70a2ee5f9b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:16.189580 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-db8b0ac6-a0ce-4b64-b7fa-2b70a2ee5f9b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:16.215658 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-db8b0ac6-a0ce-4b64-b7fa-2b70a2ee5f9b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: e26a3424-8bc8-454c-a7e3-507bb1c71c03] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:12:16.664673 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-db8b0ac6-a0ce-4b64-b7fa-2b70a2ee5f9b tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e26a3424-8bc8-454c-a7e3-507bb1c71c03" status: 204 len: 0 microversion: 2.1 time: 0.496807 Apr 16 21:12:16.665568 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 825/1596] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:12:16 2022] DELETE /compute/v2.1/servers/e26a3424-8bc8-454c-a7e3-507bb1c71c03 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:12:16.671197 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-56e02ac1-03e6-41e0-8e9c-c1050a37cd79 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:16.672245 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-56e02ac1-03e6-41e0-8e9c-c1050a37cd79 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: 8fed9e31-a940-4555-8877-e98e33e6524f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:16.679128 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-56e02ac1-03e6-41e0-8e9c-c1050a37cd79 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:16.679711 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-56e02ac1-03e6-41e0-8e9c-c1050a37cd79 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:16.680965 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-56e02ac1-03e6-41e0-8e9c-c1050a37cd79 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:16.681754 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-56e02ac1-03e6-41e0-8e9c-c1050a37cd79 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:16.857209 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-56e02ac1-03e6-41e0-8e9c-c1050a37cd79 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b5365affd1481db288841b9ffbf5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:16.871916 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-56e02ac1-03e6-41e0-8e9c-c1050a37cd79 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "GET /compute/v2.1/servers/8fed9e31-a940-4555-8877-e98e33e6524f" status: 200 len: 1323 microversion: 2.1 time: 0.205171 Apr 16 21:12:16.882667 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 826/1597] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:16 2022] GET /compute/v2.1/servers/8fed9e31-a940-4555-8877-e98e33e6524f => generated 1323 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:16.888690 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-40036fc4-c2b4-4d78-9e58-b35bedd19a9e tempest-QuotasAdminNegativeTest-1605922124 tempest-QuotasAdminNegativeTest-1605922124-project-admin] Action: 'update', calling method: .version_select at 0x7fbba00a5dc0>, body: {"quota_set": {"instances": 10}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:12:16.979331 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40036fc4-c2b4-4d78-9e58-b35bedd19a9e tempest-QuotasAdminNegativeTest-1605922124 tempest-QuotasAdminNegativeTest-1605922124-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:16.980036 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40036fc4-c2b4-4d78-9e58-b35bedd19a9e tempest-QuotasAdminNegativeTest-1605922124 tempest-QuotasAdminNegativeTest-1605922124-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:16.981077 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40036fc4-c2b4-4d78-9e58-b35bedd19a9e tempest-QuotasAdminNegativeTest-1605922124 tempest-QuotasAdminNegativeTest-1605922124-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:16.981767 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40036fc4-c2b4-4d78-9e58-b35bedd19a9e tempest-QuotasAdminNegativeTest-1605922124 tempest-QuotasAdminNegativeTest-1605922124-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:17.204497 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-40036fc4-c2b4-4d78-9e58-b35bedd19a9e tempest-QuotasAdminNegativeTest-1605922124 tempest-QuotasAdminNegativeTest-1605922124-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/f9a47e755547403d9597a177ee6ef95b" status: 200 len: 329 microversion: 2.1 time: 0.319784 Apr 16 21:12:17.205902 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 827/1598] 10.222.0.20 () {60 vars in 1261 bytes} [Sat Apr 16 21:12:16 2022] PUT /compute/v2.1/os-quota-sets/f9a47e755547403d9597a177ee6ef95b => generated 329 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:12:17.216562 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cc8f1653-f186-4037-92a5-3c4e2c778591 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:17.217145 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cc8f1653-f186-4037-92a5-3c4e2c778591 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 728c68c3-5252-4e9a-b1d0-c3afdfc8ba35] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:17.226449 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cc8f1653-f186-4037-92a5-3c4e2c778591 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:17.228218 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cc8f1653-f186-4037-92a5-3c4e2c778591 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:17.228913 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cc8f1653-f186-4037-92a5-3c4e2c778591 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:17.229987 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cc8f1653-f186-4037-92a5-3c4e2c778591 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:17.255589 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cc8f1653-f186-4037-92a5-3c4e2c778591 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 728c68c3-5252-4e9a-b1d0-c3afdfc8ba35] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:12:17.682857 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cc8f1653-f186-4037-92a5-3c4e2c778591 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "DELETE /compute/v2.1/servers/728c68c3-5252-4e9a-b1d0-c3afdfc8ba35" status: 204 len: 0 microversion: 2.1 time: 0.469617 Apr 16 21:12:17.682857 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 828/1599] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:12:17 2022] DELETE /compute/v2.1/servers/728c68c3-5252-4e9a-b1d0-c3afdfc8ba35 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:12:17.694246 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f1bc340c-ec72-4e12-993f-4a8c2d52c871 tempest-QuotasAdminNegativeTest-1605922124 tempest-QuotasAdminNegativeTest-1605922124-project-admin] Calling method '.version_select at 0x7fbba0070280>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:17.822748 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f1bc340c-ec72-4e12-993f-4a8c2d52c871 tempest-QuotasAdminNegativeTest-1605922124 tempest-QuotasAdminNegativeTest-1605922124-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/f9a47e755547403d9597a177ee6ef95b" status: 200 len: 371 microversion: 2.1 time: 0.139895 Apr 16 21:12:17.823388 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 829/1600] 10.222.0.20 () {58 vars in 1241 bytes} [Sat Apr 16 21:12:17 2022] GET /compute/v2.1/os-quota-sets/f9a47e755547403d9597a177ee6ef95b => generated 371 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:12:17.836982 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c3395f49-c483-4aae-9b35-f5f2106e5d60 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:17.840856 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c3395f49-c483-4aae-9b35-f5f2106e5d60 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: e26a3424-8bc8-454c-a7e3-507bb1c71c03] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:17.856334 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3395f49-c483-4aae-9b35-f5f2106e5d60 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:17.856812 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3395f49-c483-4aae-9b35-f5f2106e5d60 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:17.857625 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3395f49-c483-4aae-9b35-f5f2106e5d60 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:17.859868 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3395f49-c483-4aae-9b35-f5f2106e5d60 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:18.108377 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c3395f49-c483-4aae-9b35-f5f2106e5d60 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:18.118608 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c3395f49-c483-4aae-9b35-f5f2106e5d60 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/e26a3424-8bc8-454c-a7e3-507bb1c71c03" status: 200 len: 1475 microversion: 2.1 time: 0.291732 Apr 16 21:12:18.129954 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 830/1601] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:17 2022] GET /compute/v2.1/servers/e26a3424-8bc8-454c-a7e3-507bb1c71c03 => generated 1475 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:18.135270 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d6414d2e-ba45-4e77-9ed6-234610295779 tempest-QuotasAdminNegativeTest-1605922124 tempest-QuotasAdminNegativeTest-1605922124-project-admin] Action: 'update', calling method: .version_select at 0x7fbb9615f820>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:12:18.250580 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-34509c37-6f53-4943-8a22-3c3892d5fb78 tempest-FloatingIPDetailsTestJSON-1719300607 tempest-FloatingIPDetailsTestJSON-1719300607-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.779101 Apr 16 21:12:18.251827 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 772/1602] 10.222.0.20 () {60 vars in 1169 bytes} [Sat Apr 16 21:12:15 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2781 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:12:18.264586 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-28c3ffff-bebc-47fd-8232-41f2e8e75141 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:18.264586 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-28c3ffff-bebc-47fd-8232-41f2e8e75141 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: 8fed9e31-a940-4555-8877-e98e33e6524f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:18.271422 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d6414d2e-ba45-4e77-9ed6-234610295779 tempest-QuotasAdminNegativeTest-1605922124 tempest-QuotasAdminNegativeTest-1605922124-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:18.271969 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d6414d2e-ba45-4e77-9ed6-234610295779 tempest-QuotasAdminNegativeTest-1605922124 tempest-QuotasAdminNegativeTest-1605922124-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:18.273531 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d6414d2e-ba45-4e77-9ed6-234610295779 tempest-QuotasAdminNegativeTest-1605922124 tempest-QuotasAdminNegativeTest-1605922124-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:18.273989 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d6414d2e-ba45-4e77-9ed6-234610295779 tempest-QuotasAdminNegativeTest-1605922124 tempest-QuotasAdminNegativeTest-1605922124-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:18.277929 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-28c3ffff-bebc-47fd-8232-41f2e8e75141 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:18.278460 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-28c3ffff-bebc-47fd-8232-41f2e8e75141 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:18.279263 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-28c3ffff-bebc-47fd-8232-41f2e8e75141 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:18.279708 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-28c3ffff-bebc-47fd-8232-41f2e8e75141 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:18.424751 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d6414d2e-ba45-4e77-9ed6-234610295779 tempest-QuotasAdminNegativeTest-1605922124 tempest-QuotasAdminNegativeTest-1605922124-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/f9a47e755547403d9597a177ee6ef95b" status: 200 len: 325 microversion: 2.1 time: 0.293504 Apr 16 21:12:18.425404 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 831/1603] 10.222.0.20 () {60 vars in 1261 bytes} [Sat Apr 16 21:12:18 2022] PUT /compute/v2.1/os-quota-sets/f9a47e755547403d9597a177ee6ef95b => generated 325 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:12:18.461037 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-60f68209-e252-4733-bd74-8ffc62144ef5 tempest-FloatingIPDetailsTestJSON-1719300607 tempest-FloatingIPDetailsTestJSON-1719300607-project] Calling method '.version_select at 0x7fbb9645dd30>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:18.681408 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-28c3ffff-bebc-47fd-8232-41f2e8e75141 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b5365affd1481db288841b9ffbf5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:18.692016 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-28c3ffff-bebc-47fd-8232-41f2e8e75141 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "GET /compute/v2.1/servers/8fed9e31-a940-4555-8877-e98e33e6524f" status: 200 len: 1516 microversion: 2.1 time: 0.438439 Apr 16 21:12:18.692714 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 773/1604] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:18 2022] GET /compute/v2.1/servers/8fed9e31-a940-4555-8877-e98e33e6524f => generated 1516 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:18.698683 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-feaf1ec1-d1f0-4d6b-9355-73c7423da020 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1374556033", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:12:18.750138 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-60f68209-e252-4733-bd74-8ffc62144ef5 tempest-FloatingIPDetailsTestJSON-1719300607 tempest-FloatingIPDetailsTestJSON-1719300607-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/97c2b964-45b2-4ca1-a2d4-99a1a3bcb8b5" status: 200 len: 141 microversion: 2.1 time: 0.322965 Apr 16 21:12:18.751256 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 832/1605] 10.222.0.20 () {58 vars in 1259 bytes} [Sat Apr 16 21:12:18 2022] GET /compute/v2.1/os-floating-ips/97c2b964-45b2-4ca1-a2d4-99a1a3bcb8b5 => generated 141 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:12:18.757786 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0439e028-debc-46fb-8b5a-ca825f222062 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:18.759322 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0439e028-debc-46fb-8b5a-ca825f222062 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: 8fed9e31-a940-4555-8877-e98e33e6524f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:18.776670 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0439e028-debc-46fb-8b5a-ca825f222062 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:18.777411 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0439e028-debc-46fb-8b5a-ca825f222062 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:18.778295 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-feaf1ec1-d1f0-4d6b-9355-73c7423da020 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] validate_networks() for None {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:12:18.778703 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0439e028-debc-46fb-8b5a-ca825f222062 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:18.779345 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0439e028-debc-46fb-8b5a-ca825f222062 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:18.809208 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0439e028-debc-46fb-8b5a-ca825f222062 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: 8fed9e31-a940-4555-8877-e98e33e6524f] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:12:19.145516 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-feaf1ec1-d1f0-4d6b-9355-73c7423da020 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:12:19.145942 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-feaf1ec1-d1f0-4d6b-9355-73c7423da020 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:12:19.146597 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-feaf1ec1-d1f0-4d6b-9355-73c7423da020 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:12:19.153173 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-feaf1ec1-d1f0-4d6b-9355-73c7423da020 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:12:19.153993 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-feaf1ec1-d1f0-4d6b-9355-73c7423da020 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:12:19.164984 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-feaf1ec1-d1f0-4d6b-9355-73c7423da020 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:19.166125 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-feaf1ec1-d1f0-4d6b-9355-73c7423da020 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:19.167177 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-feaf1ec1-d1f0-4d6b-9355-73c7423da020 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:19.167784 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-feaf1ec1-d1f0-4d6b-9355-73c7423da020 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:19.196896 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-feaf1ec1-d1f0-4d6b-9355-73c7423da020 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] Getting quotas for project f9a47e755547403d9597a177ee6ef95b. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:12:19.206063 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-feaf1ec1-d1f0-4d6b-9355-73c7423da020 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] Getting quotas for user 9a87cb3156424042a4eca264c6c084da and project f9a47e755547403d9597a177ee6ef95b. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:12:19.221206 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.utils [None req-feaf1ec1-d1f0-4d6b-9355-73c7423da020 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] ram quota exceeded for f9a47e755547403d9597a177ee6ef95b, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=137409) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Apr 16 21:12:19.222387 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-feaf1ec1-d1f0-4d6b-9355-73c7423da020 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Apr 16 21:12:19.223062 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-feaf1ec1-d1f0-4d6b-9355-73c7423da020 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:12:19.224133 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-feaf1ec1-d1f0-4d6b-9355-73c7423da020 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.530492 Apr 16 21:12:19.230731 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0439e028-debc-46fb-8b5a-ca825f222062 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8fed9e31-a940-4555-8877-e98e33e6524f" status: 204 len: 0 microversion: 2.1 time: 0.478087 Apr 16 21:12:19.231793 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 833/1606] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:12:18 2022] DELETE /compute/v2.1/servers/8fed9e31-a940-4555-8877-e98e33e6524f => generated 0 bytes in 480 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:12:19.232347 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 774/1607] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:12:18 2022] POST /compute/v2.1/servers => generated 110 bytes in 539 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:12:19.239653 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-74fa79b1-1f89-484e-893d-f16efeb332b6 tempest-FloatingIPDetailsTestJSON-1719300607 tempest-FloatingIPDetailsTestJSON-1719300607-project] Calling method '.version_select at 0x7fbb9ffeb160>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:19.241170 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-58708017-d3b8-40e6-85d3-add1d0cb7a00 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:19.242084 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-58708017-d3b8-40e6-85d3-add1d0cb7a00 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: e26a3424-8bc8-454c-a7e3-507bb1c71c03] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:19.265596 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-58708017-d3b8-40e6-85d3-add1d0cb7a00 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:19.266768 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-58708017-d3b8-40e6-85d3-add1d0cb7a00 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:19.267900 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-58708017-d3b8-40e6-85d3-add1d0cb7a00 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:19.268557 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-58708017-d3b8-40e6-85d3-add1d0cb7a00 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:19.952238 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-58708017-d3b8-40e6-85d3-add1d0cb7a00 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:19.976925 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-58708017-d3b8-40e6-85d3-add1d0cb7a00 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/e26a3424-8bc8-454c-a7e3-507bb1c71c03" status: 200 len: 1475 microversion: 2.1 time: 0.743111 Apr 16 21:12:19.979275 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 775/1608] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:19 2022] GET /compute/v2.1/servers/e26a3424-8bc8-454c-a7e3-507bb1c71c03 => generated 1475 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:19.994007 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b9d5bf7d-f7f1-45eb-9229-ba62a4b4c89b tempest-QuotasAdminNegativeTest-1605922124 tempest-QuotasAdminNegativeTest-1605922124-project-admin] Action: 'update', calling method: .version_select at 0x7fbb961e25e0>, body: {"quota_set": {"ram": 51200}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:12:20.121493 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b9d5bf7d-f7f1-45eb-9229-ba62a4b4c89b tempest-QuotasAdminNegativeTest-1605922124 tempest-QuotasAdminNegativeTest-1605922124-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:20.122352 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b9d5bf7d-f7f1-45eb-9229-ba62a4b4c89b tempest-QuotasAdminNegativeTest-1605922124 tempest-QuotasAdminNegativeTest-1605922124-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:20.123666 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b9d5bf7d-f7f1-45eb-9229-ba62a4b4c89b tempest-QuotasAdminNegativeTest-1605922124 tempest-QuotasAdminNegativeTest-1605922124-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:20.124890 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b9d5bf7d-f7f1-45eb-9229-ba62a4b4c89b tempest-QuotasAdminNegativeTest-1605922124 tempest-QuotasAdminNegativeTest-1605922124-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:20.386308 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b9d5bf7d-f7f1-45eb-9229-ba62a4b4c89b tempest-QuotasAdminNegativeTest-1605922124 tempest-QuotasAdminNegativeTest-1605922124-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/f9a47e755547403d9597a177ee6ef95b" status: 200 len: 329 microversion: 2.1 time: 0.400069 Apr 16 21:12:20.386969 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 776/1609] 10.222.0.20 () {60 vars in 1261 bytes} [Sat Apr 16 21:12:19 2022] PUT /compute/v2.1/os-quota-sets/f9a47e755547403d9597a177ee6ef95b => generated 329 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:12:20.394922 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-74fa79b1-1f89-484e-893d-f16efeb332b6 tempest-FloatingIPDetailsTestJSON-1719300607 tempest-FloatingIPDetailsTestJSON-1719300607-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/97c2b964-45b2-4ca1-a2d4-99a1a3bcb8b5" status: 202 len: 0 microversion: 2.1 time: 1.155813 Apr 16 21:12:20.394922 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 834/1610] 10.222.0.20 () {58 vars in 1262 bytes} [Sat Apr 16 21:12:19 2022] DELETE /compute/v2.1/os-floating-ips/97c2b964-45b2-4ca1-a2d4-99a1a3bcb8b5 => generated 0 bytes in 1158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:12:20.395921 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ff823f59-e6c3-4f6d-8174-ccc575f7cfa9 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:20.395921 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ff823f59-e6c3-4f6d-8174-ccc575f7cfa9 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: 8fed9e31-a940-4555-8877-e98e33e6524f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:20.403566 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-79f11ed9-7011-485c-a5e5-dd2bec34a872 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] Action: 'update', calling method: .version_select at 0x7fbb96144700>, body: {"quota_set": {"ram": 0}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:12:20.407645 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-79f11ed9-7011-485c-a5e5-dd2bec34a872 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '9a87cb3156424042a4eca264c6c084da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9a47e755547403d9597a177ee6ef95b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:20.408371 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-79f11ed9-7011-485c-a5e5-dd2bec34a872 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:12:20.410036 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-79f11ed9-7011-485c-a5e5-dd2bec34a872 tempest-QuotasAdminNegativeTest-553963535 tempest-QuotasAdminNegativeTest-553963535-project] 10.222.0.20 "PUT /compute/v2.1/os-quota-sets/f9a47e755547403d9597a177ee6ef95b" status: 403 len: 116 microversion: 2.1 time: 0.015289 Apr 16 21:12:20.410168 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ff823f59-e6c3-4f6d-8174-ccc575f7cfa9 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:20.410510 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ff823f59-e6c3-4f6d-8174-ccc575f7cfa9 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:20.411488 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ff823f59-e6c3-4f6d-8174-ccc575f7cfa9 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:20.411920 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 835/1611] 10.222.0.20 () {60 vars in 1261 bytes} [Sat Apr 16 21:12:20 2022] PUT /compute/v2.1/os-quota-sets/f9a47e755547403d9597a177ee6ef95b => generated 116 bytes in 17 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:12:20.412307 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ff823f59-e6c3-4f6d-8174-ccc575f7cfa9 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:20.418327 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-55c78d38-4e88-4cd9-beb0-07497120dfe7 tempest-FloatingIPDetailsTestJSON-1719300607 tempest-FloatingIPDetailsTestJSON-1719300607-project] Calling method '.version_select at 0x7fbba0002790>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:20.809322 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ff823f59-e6c3-4f6d-8174-ccc575f7cfa9 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b5365affd1481db288841b9ffbf5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:20.824055 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ff823f59-e6c3-4f6d-8174-ccc575f7cfa9 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "GET /compute/v2.1/servers/8fed9e31-a940-4555-8877-e98e33e6524f" status: 200 len: 1522 microversion: 2.1 time: 0.434575 Apr 16 21:12:20.839569 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 777/1612] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:20 2022] GET /compute/v2.1/servers/8fed9e31-a940-4555-8877-e98e33e6524f => generated 1522 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:20.846110 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-d6b17cc3-7de2-4932-95fd-0b28cc264afb req-cd025aec-434b-46a4-b6c8-65a1b0a9f406 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e26a3424-8bc8-454c-a7e3-507bb1c71c03", "name": "network-vif-deleted", "tag": "b1f2adf4-34d0-4e59-9590-bd8f2631ee09"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:12:20.858406 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-d6b17cc3-7de2-4932-95fd-0b28cc264afb req-cd025aec-434b-46a4-b6c8-65a1b0a9f406 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:20.860869 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-d6b17cc3-7de2-4932-95fd-0b28cc264afb req-cd025aec-434b-46a4-b6c8-65a1b0a9f406 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:20.877891 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-d6b17cc3-7de2-4932-95fd-0b28cc264afb req-cd025aec-434b-46a4-b6c8-65a1b0a9f406 service nova] Creating event network-vif-deleted:b1f2adf4-34d0-4e59-9590-bd8f2631ee09 for instance e26a3424-8bc8-454c-a7e3-507bb1c71c03 on nch1-master-1 Apr 16 21:12:20.892384 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-d6b17cc3-7de2-4932-95fd-0b28cc264afb req-cd025aec-434b-46a4-b6c8-65a1b0a9f406 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048892 Apr 16 21:12:20.893280 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 778/1613] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:12:20.995513 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-32ce3901-7be9-4d99-8ad5-9ed173f27fb8 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:20.996269 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-32ce3901-7be9-4d99-8ad5-9ed173f27fb8 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: e26a3424-8bc8-454c-a7e3-507bb1c71c03] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:21.036301 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-32ce3901-7be9-4d99-8ad5-9ed173f27fb8 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:21.046927 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-32ce3901-7be9-4d99-8ad5-9ed173f27fb8 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:21.046927 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-32ce3901-7be9-4d99-8ad5-9ed173f27fb8 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:21.052765 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-32ce3901-7be9-4d99-8ad5-9ed173f27fb8 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:21.134714 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-55c78d38-4e88-4cd9-beb0-07497120dfe7 tempest-FloatingIPDetailsTestJSON-1719300607 tempest-FloatingIPDetailsTestJSON-1719300607-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.721537 Apr 16 21:12:21.140679 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 836/1614] 10.222.0.20 () {58 vars in 1163 bytes} [Sat Apr 16 21:12:20 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:12:21.159714 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-89e1ac14-084c-4672-a53b-e1d8c4e64fc7 tempest-FloatingIPDetailsTestJSON-1719300607 tempest-FloatingIPDetailsTestJSON-1719300607-project] Calling method '.version_select at 0x7fbb9645d940>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:21.177039 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-32ce3901-7be9-4d99-8ad5-9ed173f27fb8 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:21.178146 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-32ce3901-7be9-4d99-8ad5-9ed173f27fb8 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:21.178839 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-32ce3901-7be9-4d99-8ad5-9ed173f27fb8 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lazy-loading 'fault' on Instance uuid e26a3424-8bc8-454c-a7e3-507bb1c71c03 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:12:21.255789 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-32ce3901-7be9-4d99-8ad5-9ed173f27fb8 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:21.263920 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-32ce3901-7be9-4d99-8ad5-9ed173f27fb8 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/e26a3424-8bc8-454c-a7e3-507bb1c71c03" status: 200 len: 1309 microversion: 2.1 time: 0.272911 Apr 16 21:12:21.273758 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 779/1615] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:20 2022] GET /compute/v2.1/servers/e26a3424-8bc8-454c-a7e3-507bb1c71c03 => generated 1309 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:12:21.568833 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-89e1ac14-084c-4672-a53b-e1d8c4e64fc7 tempest-FloatingIPDetailsTestJSON-1719300607 tempest-FloatingIPDetailsTestJSON-1719300607-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips" status: 200 len: 399 microversion: 2.1 time: 0.418414 Apr 16 21:12:21.569728 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 837/1616] 10.222.0.20 () {58 vars in 1148 bytes} [Sat Apr 16 21:12:21 2022] GET /compute/v2.1/os-floating-ips => generated 399 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:12:21.583241 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4e70cc8f-4e54-4e28-a629-54d3f1520ca0 tempest-FloatingIPDetailsTestJSON-1719300607 tempest-FloatingIPDetailsTestJSON-1719300607-project] Calling method '.version_select at 0x7fbba00b2160>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:21.846782 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2eef1c78-57c0-4e9c-accd-e28fcee608f6 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:21.847822 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2eef1c78-57c0-4e9c-accd-e28fcee608f6 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: 8fed9e31-a940-4555-8877-e98e33e6524f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:21.855028 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2eef1c78-57c0-4e9c-accd-e28fcee608f6 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:21.855745 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2eef1c78-57c0-4e9c-accd-e28fcee608f6 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:21.856593 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2eef1c78-57c0-4e9c-accd-e28fcee608f6 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:21.857046 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2eef1c78-57c0-4e9c-accd-e28fcee608f6 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:22.088663 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2eef1c78-57c0-4e9c-accd-e28fcee608f6 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b5365affd1481db288841b9ffbf5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:22.098827 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2eef1c78-57c0-4e9c-accd-e28fcee608f6 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "GET /compute/v2.1/servers/8fed9e31-a940-4555-8877-e98e33e6524f" status: 200 len: 1522 microversion: 2.1 time: 0.257402 Apr 16 21:12:22.100652 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 838/1617] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:21 2022] GET /compute/v2.1/servers/8fed9e31-a940-4555-8877-e98e33e6524f => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:22.285414 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5da2e16a-c812-4b91-837a-7ccbe95496eb tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:22.286166 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5da2e16a-c812-4b91-837a-7ccbe95496eb tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: e26a3424-8bc8-454c-a7e3-507bb1c71c03] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:22.321517 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5da2e16a-c812-4b91-837a-7ccbe95496eb tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:22.322752 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5da2e16a-c812-4b91-837a-7ccbe95496eb tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:22.328568 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5da2e16a-c812-4b91-837a-7ccbe95496eb tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:22.329843 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5da2e16a-c812-4b91-837a-7ccbe95496eb tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:22.379075 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-5da2e16a-c812-4b91-837a-7ccbe95496eb tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] HTTP exception thrown: Instance e26a3424-8bc8-454c-a7e3-507bb1c71c03 could not be found. Apr 16 21:12:22.380941 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5da2e16a-c812-4b91-837a-7ccbe95496eb tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Returning 404 to user: Instance e26a3424-8bc8-454c-a7e3-507bb1c71c03 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:12:22.384569 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5da2e16a-c812-4b91-837a-7ccbe95496eb tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/e26a3424-8bc8-454c-a7e3-507bb1c71c03" status: 404 len: 111 microversion: 2.1 time: 0.106585 Apr 16 21:12:22.389321 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 839/1618] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:22 2022] GET /compute/v2.1/servers/e26a3424-8bc8-454c-a7e3-507bb1c71c03 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:12:22.396742 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-f16a193e-8b4e-42ff-924f-1702bdcf5701 req-7892b89f-fb28-4821-a142-bdd9f524f122 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fed9e31-a940-4555-8877-e98e33e6524f", "name": "network-vif-deleted", "tag": "a2e2efb4-66f3-4f0e-9ba5-a1ce7dfbe99f"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:12:22.407405 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-f16a193e-8b4e-42ff-924f-1702bdcf5701 req-7892b89f-fb28-4821-a142-bdd9f524f122 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:22.407860 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-f16a193e-8b4e-42ff-924f-1702bdcf5701 req-7892b89f-fb28-4821-a142-bdd9f524f122 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:22.420471 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-f16a193e-8b4e-42ff-924f-1702bdcf5701 req-7892b89f-fb28-4821-a142-bdd9f524f122 service nova] Creating event network-vif-deleted:a2e2efb4-66f3-4f0e-9ba5-a1ce7dfbe99f for instance 8fed9e31-a940-4555-8877-e98e33e6524f on nch2-master-1 Apr 16 21:12:22.425952 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-f16a193e-8b4e-42ff-924f-1702bdcf5701 req-7892b89f-fb28-4821-a142-bdd9f524f122 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038186 Apr 16 21:12:22.426918 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 840/1619] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:12:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:12:22.431947 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c6c36e9e-f42e-4d32-a9b4-39c4c1d6c4e8 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:22.432901 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c6c36e9e-f42e-4d32-a9b4-39c4c1d6c4e8 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 728c68c3-5252-4e9a-b1d0-c3afdfc8ba35] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:22.445557 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c6c36e9e-f42e-4d32-a9b4-39c4c1d6c4e8 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:22.446565 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c6c36e9e-f42e-4d32-a9b4-39c4c1d6c4e8 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:22.447610 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c6c36e9e-f42e-4d32-a9b4-39c4c1d6c4e8 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:22.448347 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c6c36e9e-f42e-4d32-a9b4-39c4c1d6c4e8 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:22.466483 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-c6c36e9e-f42e-4d32-a9b4-39c4c1d6c4e8 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] HTTP exception thrown: Instance 728c68c3-5252-4e9a-b1d0-c3afdfc8ba35 could not be found. Apr 16 21:12:22.467344 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c6c36e9e-f42e-4d32-a9b4-39c4c1d6c4e8 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Returning 404 to user: Instance 728c68c3-5252-4e9a-b1d0-c3afdfc8ba35 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:12:22.468294 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c6c36e9e-f42e-4d32-a9b4-39c4c1d6c4e8 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/728c68c3-5252-4e9a-b1d0-c3afdfc8ba35" status: 404 len: 111 microversion: 2.1 time: 0.039999 Apr 16 21:12:22.471692 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 841/1620] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:22 2022] GET /compute/v2.1/servers/728c68c3-5252-4e9a-b1d0-c3afdfc8ba35 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:12:22.477584 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6cbcf5ec-0864-4398-b8b4-25929bac856c tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:22.647237 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6cbcf5ec-0864-4398-b8b4-25929bac856c tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/4627cf89-35ca-4dbd-84b8-c29fcd53e795" status: 204 len: 0 microversion: 2.1 time: 0.173286 Apr 16 21:12:22.648271 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 842/1621] 10.222.0.20 () {58 vars in 1265 bytes} [Sat Apr 16 21:12:22 2022] DELETE /compute/v2.1/os-server-groups/4627cf89-35ca-4dbd-84b8-c29fcd53e795 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:12:22.677028 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-081c20d2-a2b3-49da-a99e-d98ec0a7be54 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:22.678677 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-081c20d2-a2b3-49da-a99e-d98ec0a7be54 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 7b856a59-2a62-4edc-b448-430f778c7b2e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:22.720815 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-081c20d2-a2b3-49da-a99e-d98ec0a7be54 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:22.721581 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-081c20d2-a2b3-49da-a99e-d98ec0a7be54 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:22.722568 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-081c20d2-a2b3-49da-a99e-d98ec0a7be54 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:22.723232 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-081c20d2-a2b3-49da-a99e-d98ec0a7be54 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:22.771976 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-081c20d2-a2b3-49da-a99e-d98ec0a7be54 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 7b856a59-2a62-4edc-b448-430f778c7b2e] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:12:23.005269 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4e70cc8f-4e54-4e28-a629-54d3f1520ca0 tempest-FloatingIPDetailsTestJSON-1719300607 tempest-FloatingIPDetailsTestJSON-1719300607-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/e31e8ab9-fee6-4edc-b284-63ac85d83ce4" status: 202 len: 0 microversion: 2.1 time: 1.426896 Apr 16 21:12:23.007131 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 780/1622] 10.222.0.20 () {58 vars in 1262 bytes} [Sat Apr 16 21:12:21 2022] DELETE /compute/v2.1/os-floating-ips/e31e8ab9-fee6-4edc-b284-63ac85d83ce4 => generated 0 bytes in 1430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:12:23.019295 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bd070541-a894-4971-8c96-62bb2c49fddf tempest-FloatingIPDetailsTestJSON-1719300607 tempest-FloatingIPDetailsTestJSON-1719300607-project] Calling method '.version_select at 0x7fbb961f6dc0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:23.188870 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-081c20d2-a2b3-49da-a99e-d98ec0a7be54 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7b856a59-2a62-4edc-b448-430f778c7b2e" status: 204 len: 0 microversion: 2.1 time: 0.534739 Apr 16 21:12:23.189764 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 843/1623] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:12:22 2022] DELETE /compute/v2.1/servers/7b856a59-2a62-4edc-b448-430f778c7b2e => generated 0 bytes in 537 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:12:23.196583 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-fa0c24d0-8244-4426-92dd-a715dac013de req-3547ba93-f1e2-40ac-a69a-0c4e70887517 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "728c68c3-5252-4e9a-b1d0-c3afdfc8ba35", "name": "network-vif-deleted", "tag": "60d57b69-5719-4183-b383-e1c20b54b232"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:12:23.208785 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-fa0c24d0-8244-4426-92dd-a715dac013de req-3547ba93-f1e2-40ac-a69a-0c4e70887517 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:23.209540 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-fa0c24d0-8244-4426-92dd-a715dac013de req-3547ba93-f1e2-40ac-a69a-0c4e70887517 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:23.222604 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-fa0c24d0-8244-4426-92dd-a715dac013de req-3547ba93-f1e2-40ac-a69a-0c4e70887517 service nova] Creating event network-vif-deleted:60d57b69-5719-4183-b383-e1c20b54b232 for instance 728c68c3-5252-4e9a-b1d0-c3afdfc8ba35 on nch1-master-1 Apr 16 21:12:23.228063 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-fa0c24d0-8244-4426-92dd-a715dac013de req-3547ba93-f1e2-40ac-a69a-0c4e70887517 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036632 Apr 16 21:12:23.233355 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 844/1624] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:12:23.256989 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2b3cc6de-ac75-4c6d-bfa6-033498518603 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:23.257758 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2b3cc6de-ac75-4c6d-bfa6-033498518603 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: 8fed9e31-a940-4555-8877-e98e33e6524f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:23.272201 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b3cc6de-ac75-4c6d-bfa6-033498518603 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:23.274912 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b3cc6de-ac75-4c6d-bfa6-033498518603 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:23.277082 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b3cc6de-ac75-4c6d-bfa6-033498518603 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:23.277559 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b3cc6de-ac75-4c6d-bfa6-033498518603 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:23.339665 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b3cc6de-ac75-4c6d-bfa6-033498518603 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:23.340545 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b3cc6de-ac75-4c6d-bfa6-033498518603 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:23.341488 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-2b3cc6de-ac75-4c6d-bfa6-033498518603 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lazy-loading 'fault' on Instance uuid 8fed9e31-a940-4555-8877-e98e33e6524f {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:12:23.430495 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2b3cc6de-ac75-4c6d-bfa6-033498518603 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b5365affd1481db288841b9ffbf5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:23.438618 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2b3cc6de-ac75-4c6d-bfa6-033498518603 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "GET /compute/v2.1/servers/8fed9e31-a940-4555-8877-e98e33e6524f" status: 200 len: 1313 microversion: 2.1 time: 0.191689 Apr 16 21:12:23.439196 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 845/1625] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:23 2022] GET /compute/v2.1/servers/8fed9e31-a940-4555-8877-e98e33e6524f => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:23.444121 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d108d625-3efb-4043-acb7-f409bf22ca3e tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:23.444778 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d108d625-3efb-4043-acb7-f409bf22ca3e tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 7b856a59-2a62-4edc-b448-430f778c7b2e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:23.450513 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d108d625-3efb-4043-acb7-f409bf22ca3e tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:23.451168 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d108d625-3efb-4043-acb7-f409bf22ca3e tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:23.451939 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d108d625-3efb-4043-acb7-f409bf22ca3e tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:23.452494 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d108d625-3efb-4043-acb7-f409bf22ca3e tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:23.697625 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d108d625-3efb-4043-acb7-f409bf22ca3e tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:23.705733 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d108d625-3efb-4043-acb7-f409bf22ca3e tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/7b856a59-2a62-4edc-b448-430f778c7b2e" status: 200 len: 1472 microversion: 2.1 time: 0.265116 Apr 16 21:12:23.715896 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 846/1626] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:23 2022] GET /compute/v2.1/servers/7b856a59-2a62-4edc-b448-430f778c7b2e => generated 1472 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:24.179690 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bd070541-a894-4971-8c96-62bb2c49fddf tempest-FloatingIPDetailsTestJSON-1719300607 tempest-FloatingIPDetailsTestJSON-1719300607-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/d224d28e-157a-4b1e-a580-339b5b399661" status: 202 len: 0 microversion: 2.1 time: 1.168424 Apr 16 21:12:24.180293 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 781/1627] 10.222.0.20 () {58 vars in 1262 bytes} [Sat Apr 16 21:12:23 2022] DELETE /compute/v2.1/os-floating-ips/d224d28e-157a-4b1e-a580-339b5b399661 => generated 0 bytes in 1170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 16 21:12:24.188628 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-19de25e4-4ca7-4070-a524-5c604cdb1b86 tempest-FloatingIPDetailsTestJSON-1719300607 tempest-FloatingIPDetailsTestJSON-1719300607-project] Calling method '.version_select at 0x7fbba0002040>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:24.462967 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-57bdc6f0-8589-4b4a-8589-bed1695623aa tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:24.462967 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-57bdc6f0-8589-4b4a-8589-bed1695623aa tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: 8fed9e31-a940-4555-8877-e98e33e6524f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:24.466368 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-57bdc6f0-8589-4b4a-8589-bed1695623aa tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:24.466846 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-57bdc6f0-8589-4b4a-8589-bed1695623aa tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:24.467645 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-57bdc6f0-8589-4b4a-8589-bed1695623aa tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:24.468226 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-57bdc6f0-8589-4b4a-8589-bed1695623aa tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:24.502009 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-57bdc6f0-8589-4b4a-8589-bed1695623aa tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:24.502666 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-57bdc6f0-8589-4b4a-8589-bed1695623aa tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:24.503321 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-57bdc6f0-8589-4b4a-8589-bed1695623aa tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lazy-loading 'fault' on Instance uuid 8fed9e31-a940-4555-8877-e98e33e6524f {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:12:24.597342 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-57bdc6f0-8589-4b4a-8589-bed1695623aa tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b5365affd1481db288841b9ffbf5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:24.611204 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-57bdc6f0-8589-4b4a-8589-bed1695623aa tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "GET /compute/v2.1/servers/8fed9e31-a940-4555-8877-e98e33e6524f" status: 200 len: 1313 microversion: 2.1 time: 0.160048 Apr 16 21:12:24.614254 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 782/1628] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:24 2022] GET /compute/v2.1/servers/8fed9e31-a940-4555-8877-e98e33e6524f => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:12:24.723334 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9c659c55-5cdd-481f-abcc-4fd8f6435022 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:24.724385 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9c659c55-5cdd-481f-abcc-4fd8f6435022 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 7b856a59-2a62-4edc-b448-430f778c7b2e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:24.731030 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9c659c55-5cdd-481f-abcc-4fd8f6435022 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:24.731491 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9c659c55-5cdd-481f-abcc-4fd8f6435022 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:24.732342 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9c659c55-5cdd-481f-abcc-4fd8f6435022 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:24.732793 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9c659c55-5cdd-481f-abcc-4fd8f6435022 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:24.935262 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9c659c55-5cdd-481f-abcc-4fd8f6435022 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:24.944666 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9c659c55-5cdd-481f-abcc-4fd8f6435022 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/7b856a59-2a62-4edc-b448-430f778c7b2e" status: 200 len: 1472 microversion: 2.1 time: 0.225566 Apr 16 21:12:24.945905 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 783/1629] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:24 2022] GET /compute/v2.1/servers/7b856a59-2a62-4edc-b448-430f778c7b2e => generated 1472 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:25.644006 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3bbef04b-5c31-4b5f-a401-612026603d94 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:25.644793 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3bbef04b-5c31-4b5f-a401-612026603d94 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: 8fed9e31-a940-4555-8877-e98e33e6524f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:25.655950 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3bbef04b-5c31-4b5f-a401-612026603d94 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:25.659320 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3bbef04b-5c31-4b5f-a401-612026603d94 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:25.667861 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3bbef04b-5c31-4b5f-a401-612026603d94 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:25.668361 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3bbef04b-5c31-4b5f-a401-612026603d94 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:25.699278 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-3bbef04b-5c31-4b5f-a401-612026603d94 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] HTTP exception thrown: Instance 8fed9e31-a940-4555-8877-e98e33e6524f could not be found. Apr 16 21:12:25.699943 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3bbef04b-5c31-4b5f-a401-612026603d94 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Returning 404 to user: Instance 8fed9e31-a940-4555-8877-e98e33e6524f could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:12:25.700883 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3bbef04b-5c31-4b5f-a401-612026603d94 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "GET /compute/v2.1/servers/8fed9e31-a940-4555-8877-e98e33e6524f" status: 404 len: 111 microversion: 2.1 time: 0.074572 Apr 16 21:12:25.701777 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 784/1630] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:25 2022] GET /compute/v2.1/servers/8fed9e31-a940-4555-8877-e98e33e6524f => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:12:25.711189 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-76fb5a4d-4bcc-449d-952f-cef43c41c27f tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:25.717574 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-76fb5a4d-4bcc-449d-952f-cef43c41c27f tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '14b5365affd1481db288841b9ffbf5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:25.717574 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-76fb5a4d-4bcc-449d-952f-cef43c41c27f tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b'} {{(pid=137409) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:12:25.723354 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-76fb5a4d-4bcc-449d-952f-cef43c41c27f tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:25.723911 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-76fb5a4d-4bcc-449d-952f-cef43c41c27f tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:25.724866 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-76fb5a4d-4bcc-449d-952f-cef43c41c27f tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:25.725309 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-76fb5a4d-4bcc-449d-952f-cef43c41c27f tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:25.834697 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-76fb5a4d-4bcc-449d-952f-cef43c41c27f tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.127060 Apr 16 21:12:25.836146 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 785/1631] 10.222.0.20 () {58 vars in 1229 bytes} [Sat Apr 16 21:12:25 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 16 21:12:25.852709 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-73928560-e939-45d3-ba86-5c6c4d4227d2 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:25.859200 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-73928560-e939-45d3-ba86-5c6c4d4227d2 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:12:25.860117 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-73928560-e939-45d3-ba86-5c6c4d4227d2 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.016440 Apr 16 21:12:25.860728 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 786/1632] 10.222.0.20 () {58 vars in 1181 bytes} [Sat Apr 16 21:12:25 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:12:25.883252 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f01d1af9-d28f-4297-9433-18ecabef1191 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:25.883252 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f01d1af9-d28f-4297-9433-18ecabef1191 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '14b5365affd1481db288841b9ffbf5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:25.883252 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f01d1af9-d28f-4297-9433-18ecabef1191 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Searching by: {'deleted': False, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b'} {{(pid=137409) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:12:25.898071 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f01d1af9-d28f-4297-9433-18ecabef1191 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:25.898556 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f01d1af9-d28f-4297-9433-18ecabef1191 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:25.899463 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f01d1af9-d28f-4297-9433-18ecabef1191 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:25.899916 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f01d1af9-d28f-4297-9433-18ecabef1191 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:25.952933 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.multi_cell_list [None req-f01d1af9-d28f-4297-9433-18ecabef1191 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=137409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 16 21:12:25.993543 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f01d1af9-d28f-4297-9433-18ecabef1191 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.124633 Apr 16 21:12:26.005510 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 787/1633] 10.222.0.20 () {58 vars in 1124 bytes} [Sat Apr 16 21:12:25 2022] GET /compute/v2.1/servers => generated 683 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:12:26.008779 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c2f41c5f-abff-4eed-a53b-848e48974f60 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:26.011167 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c2f41c5f-abff-4eed-a53b-848e48974f60 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 7b856a59-2a62-4edc-b448-430f778c7b2e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:26.020203 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c2f41c5f-abff-4eed-a53b-848e48974f60 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:26.021343 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c2f41c5f-abff-4eed-a53b-848e48974f60 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:26.022599 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c2f41c5f-abff-4eed-a53b-848e48974f60 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:26.023312 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c2f41c5f-abff-4eed-a53b-848e48974f60 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:26.108294 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c2f41c5f-abff-4eed-a53b-848e48974f60 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:26.117590 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c2f41c5f-abff-4eed-a53b-848e48974f60 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/7b856a59-2a62-4edc-b448-430f778c7b2e" status: 200 len: 1430 microversion: 2.1 time: 0.119481 Apr 16 21:12:26.118173 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 788/1634] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:25 2022] GET /compute/v2.1/servers/7b856a59-2a62-4edc-b448-430f778c7b2e => generated 1430 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:26.123477 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8f3d4292-9d31-4d25-b829-2dadcdab985d tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:26.127788 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8f3d4292-9d31-4d25-b829-2dadcdab985d tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '14b5365affd1481db288841b9ffbf5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:26.128445 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.compute.servers [None req-8f3d4292-9d31-4d25-b829-2dadcdab985d tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Removing options 'limit' from query {{(pid=137409) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Apr 16 21:12:26.129350 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8f3d4292-9d31-4d25-b829-2dadcdab985d tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Searching by: {'deleted': False, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b'} {{(pid=137409) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:12:26.135125 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8f3d4292-9d31-4d25-b829-2dadcdab985d tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:26.135584 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8f3d4292-9d31-4d25-b829-2dadcdab985d tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:26.136430 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8f3d4292-9d31-4d25-b829-2dadcdab985d tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:26.137044 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8f3d4292-9d31-4d25-b829-2dadcdab985d tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:26.169742 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.multi_cell_list [None req-8f3d4292-9d31-4d25-b829-2dadcdab985d tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=137409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 16 21:12:26.201707 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8f3d4292-9d31-4d25-b829-2dadcdab985d tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.082088 Apr 16 21:12:26.207605 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 789/1635] 10.222.0.20 () {58 vars in 1143 bytes} [Sat Apr 16 21:12:26 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:12:26.214430 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b139c300-24b0-4301-9810-23cd17e48b00 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:26.215932 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b139c300-24b0-4301-9810-23cd17e48b00 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:12:26.216813 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b139c300-24b0-4301-9810-23cd17e48b00 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.006437 Apr 16 21:12:26.217844 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 790/1636] 10.222.0.20 () {58 vars in 1141 bytes} [Sat Apr 16 21:12:26 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:12:26.230624 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-581bdeb3-2255-4d5d-a9c5-57315ae60102 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:26.230624 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-581bdeb3-2255-4d5d-a9c5-57315ae60102 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:12:26.230624 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-581bdeb3-2255-4d5d-a9c5-57315ae60102 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.006881 Apr 16 21:12:26.231485 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 791/1637] 10.222.0.20 () {58 vars in 1151 bytes} [Sat Apr 16 21:12:26 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 16 21:12:26.243323 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b2229f0c-f1d5-4124-8610-e4c3fc62463d tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:26.248395 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b2229f0c-f1d5-4124-8610-e4c3fc62463d tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '14b5365affd1481db288841b9ffbf5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:26.258553 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b2229f0c-f1d5-4124-8610-e4c3fc62463d tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b'} {{(pid=137409) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:12:26.258553 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.compute.servers [None req-b2229f0c-f1d5-4124-8610-e4c3fc62463d tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Flavor 'non_existing_flavor' could not be found {{(pid=137409) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Apr 16 21:12:26.258553 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b2229f0c-f1d5-4124-8610-e4c3fc62463d tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.021286 Apr 16 21:12:26.265347 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 792/1638] 10.222.0.20 () {58 vars in 1177 bytes} [Sat Apr 16 21:12:26 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 16 21:12:26.271752 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1c327342-8e65-4979-8f9e-703692de2b5e tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:26.276197 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1c327342-8e65-4979-8f9e-703692de2b5e tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '14b5365affd1481db288841b9ffbf5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:26.281554 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1c327342-8e65-4979-8f9e-703692de2b5e tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b'} {{(pid=137409) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:12:26.285108 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1c327342-8e65-4979-8f9e-703692de2b5e tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:26.286532 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1c327342-8e65-4979-8f9e-703692de2b5e tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:26.288739 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1c327342-8e65-4979-8f9e-703692de2b5e tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:26.292697 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1c327342-8e65-4979-8f9e-703692de2b5e tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:26.383411 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1c327342-8e65-4979-8f9e-703692de2b5e tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.116269 Apr 16 21:12:26.384025 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 793/1639] 10.222.0.20 () {58 vars in 1173 bytes} [Sat Apr 16 21:12:26 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:12:26.395377 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3b32043d-e62d-443d-bd1d-d871e63f1bfb tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:26.400383 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3b32043d-e62d-443d-bd1d-d871e63f1bfb tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '14b5365affd1481db288841b9ffbf5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:26.402321 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3b32043d-e62d-443d-bd1d-d871e63f1bfb tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b'} {{(pid=137409) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:12:26.408120 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3b32043d-e62d-443d-bd1d-d871e63f1bfb tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:26.408610 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3b32043d-e62d-443d-bd1d-d871e63f1bfb tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:26.409701 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3b32043d-e62d-443d-bd1d-d871e63f1bfb tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:26.410111 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3b32043d-e62d-443d-bd1d-d871e63f1bfb tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:26.515370 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3b32043d-e62d-443d-bd1d-d871e63f1bfb tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.123048 Apr 16 21:12:26.516134 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 794/1640] 10.222.0.20 () {58 vars in 1183 bytes} [Sat Apr 16 21:12:26 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:12:26.532043 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-90888624-f9e0-455b-aba6-ab1b54bbc013 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:26.536126 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-90888624-f9e0-455b-aba6-ab1b54bbc013 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '14b5365affd1481db288841b9ffbf5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:26.536907 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-90888624-f9e0-455b-aba6-ab1b54bbc013 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Searching by: {'deleted': False, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b'} {{(pid=137409) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:12:26.548119 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-90888624-f9e0-455b-aba6-ab1b54bbc013 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:26.548119 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-90888624-f9e0-455b-aba6-ab1b54bbc013 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:26.548941 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-90888624-f9e0-455b-aba6-ab1b54bbc013 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:26.549464 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-90888624-f9e0-455b-aba6-ab1b54bbc013 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:26.609362 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-19de25e4-4ca7-4070-a524-5c604cdb1b86 tempest-FloatingIPDetailsTestJSON-1719300607 tempest-FloatingIPDetailsTestJSON-1719300607-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/13a20bcb-0998-4349-a5da-cd0f36ef8db7" status: 202 len: 0 microversion: 2.1 time: 2.424869 Apr 16 21:12:26.609955 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 847/1641] 10.222.0.20 () {58 vars in 1262 bytes} [Sat Apr 16 21:12:24 2022] DELETE /compute/v2.1/os-floating-ips/13a20bcb-0998-4349-a5da-cd0f36ef8db7 => generated 0 bytes in 2426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:12:26.624727 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-e43fcebd-7195-42bc-8c33-b80ecaee9dc7 req-844e01ce-78b9-4307-9e1c-d571a78e1380 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b856a59-2a62-4edc-b448-430f778c7b2e", "name": "network-vif-deleted", "tag": "74297eec-fea7-4f18-9edd-1a7bb09d6fd5"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:12:26.642955 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.multi_cell_list [None req-90888624-f9e0-455b-aba6-ab1b54bbc013 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=137409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 16 21:12:26.650748 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-e43fcebd-7195-42bc-8c33-b80ecaee9dc7 req-844e01ce-78b9-4307-9e1c-d571a78e1380 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:26.668629 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-e43fcebd-7195-42bc-8c33-b80ecaee9dc7 req-844e01ce-78b9-4307-9e1c-d571a78e1380 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:26.684687 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-e43fcebd-7195-42bc-8c33-b80ecaee9dc7 req-844e01ce-78b9-4307-9e1c-d571a78e1380 service nova] Creating event network-vif-deleted:74297eec-fea7-4f18-9edd-1a7bb09d6fd5 for instance 7b856a59-2a62-4edc-b448-430f778c7b2e on nch2-master-1 Apr 16 21:12:26.691346 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-e43fcebd-7195-42bc-8c33-b80ecaee9dc7 req-844e01ce-78b9-4307-9e1c-d571a78e1380 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080128 Apr 16 21:12:26.693997 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 848/1642] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:12:26.745373 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-90888624-f9e0-455b-aba6-ab1b54bbc013 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b5365affd1481db288841b9ffbf5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:26.755254 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-90888624-f9e0-455b-aba6-ab1b54bbc013 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:26.755726 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-90888624-f9e0-455b-aba6-ab1b54bbc013 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:26.956133 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-90888624-f9e0-455b-aba6-ab1b54bbc013 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 3027 microversion: 2.1 time: 0.428010 Apr 16 21:12:26.957297 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 795/1643] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:12:26 2022] GET /compute/v2.1/servers/detail => generated 3027 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:26.977874 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ee83d539-bdd6-47be-99ce-edddc1e7eebd tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:26.982914 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ee83d539-bdd6-47be-99ce-edddc1e7eebd tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '14b5365affd1481db288841b9ffbf5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:26.985819 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ee83d539-bdd6-47be-99ce-edddc1e7eebd tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.012325 Apr 16 21:12:27.000286 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a6a551c9-2264-41a8-a0bb-d198c704319d tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:27.004727 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a6a551c9-2264-41a8-a0bb-d198c704319d tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '14b5365affd1481db288841b9ffbf5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:27.005218 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 849/1644] 10.222.0.20 () {58 vars in 1177 bytes} [Sat Apr 16 21:12:26 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:12:27.006042 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a6a551c9-2264-41a8-a0bb-d198c704319d tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Searching by: {'deleted': False, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b'} {{(pid=137409) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:12:27.012003 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a6a551c9-2264-41a8-a0bb-d198c704319d tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:27.014080 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a6a551c9-2264-41a8-a0bb-d198c704319d tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:27.014389 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a6a551c9-2264-41a8-a0bb-d198c704319d tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:27.014984 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a6a551c9-2264-41a8-a0bb-d198c704319d tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:27.072910 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.multi_cell_list [None req-a6a551c9-2264-41a8-a0bb-d198c704319d tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=137409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 16 21:12:27.132308 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a6a551c9-2264-41a8-a0bb-d198c704319d tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.136611 Apr 16 21:12:27.137543 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 796/1645] 10.222.0.20 () {58 vars in 1124 bytes} [Sat Apr 16 21:12:26 2022] GET /compute/v2.1/servers => generated 683 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:12:27.140316 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-364a5198-7f11-49ff-a316-ab1c9bff77b7 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:27.141154 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-364a5198-7f11-49ff-a316-ab1c9bff77b7 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 7b856a59-2a62-4edc-b448-430f778c7b2e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:27.150739 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-301dd3c4-153a-4c58-ab9e-3b8ef93efa6f tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:27.152367 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-301dd3c4-153a-4c58-ab9e-3b8ef93efa6f tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: 8fed9e31-a940-4555-8877-e98e33e6524f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:27.158397 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-364a5198-7f11-49ff-a316-ab1c9bff77b7 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:27.160951 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-301dd3c4-153a-4c58-ab9e-3b8ef93efa6f tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:27.162459 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-301dd3c4-153a-4c58-ab9e-3b8ef93efa6f tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:27.163132 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-364a5198-7f11-49ff-a316-ab1c9bff77b7 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:27.163682 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-301dd3c4-153a-4c58-ab9e-3b8ef93efa6f tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:27.164310 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-301dd3c4-153a-4c58-ab9e-3b8ef93efa6f tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:27.164816 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-364a5198-7f11-49ff-a316-ab1c9bff77b7 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:27.167512 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-364a5198-7f11-49ff-a316-ab1c9bff77b7 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:27.194936 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-301dd3c4-153a-4c58-ab9e-3b8ef93efa6f tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] HTTP exception thrown: Instance 8fed9e31-a940-4555-8877-e98e33e6524f could not be found. Apr 16 21:12:27.197478 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-301dd3c4-153a-4c58-ab9e-3b8ef93efa6f tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Returning 404 to user: Instance 8fed9e31-a940-4555-8877-e98e33e6524f could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:12:27.199342 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-301dd3c4-153a-4c58-ab9e-3b8ef93efa6f tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8fed9e31-a940-4555-8877-e98e33e6524f" status: 404 len: 111 microversion: 2.1 time: 0.057335 Apr 16 21:12:27.206273 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 797/1646] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:12:27 2022] DELETE /compute/v2.1/servers/8fed9e31-a940-4555-8877-e98e33e6524f => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:12:27.219080 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-08ca9ccd-4559-4eb6-abe4-28ba174d309f tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:27.224908 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-08ca9ccd-4559-4eb6-abe4-28ba174d309f tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: 80bcd5fb-6cbf-49ce-b126-1a95b55ba451] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:27.232135 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-08ca9ccd-4559-4eb6-abe4-28ba174d309f tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:27.232624 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-08ca9ccd-4559-4eb6-abe4-28ba174d309f tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:27.233543 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-08ca9ccd-4559-4eb6-abe4-28ba174d309f tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:27.234485 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-08ca9ccd-4559-4eb6-abe4-28ba174d309f tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:27.240627 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-364a5198-7f11-49ff-a316-ab1c9bff77b7 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:27.242268 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-364a5198-7f11-49ff-a316-ab1c9bff77b7 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:27.242861 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-364a5198-7f11-49ff-a316-ab1c9bff77b7 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lazy-loading 'fault' on Instance uuid 7b856a59-2a62-4edc-b448-430f778c7b2e {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:12:27.305763 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-08ca9ccd-4559-4eb6-abe4-28ba174d309f tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: 80bcd5fb-6cbf-49ce-b126-1a95b55ba451] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:12:27.352455 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-364a5198-7f11-49ff-a316-ab1c9bff77b7 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f97c1afe5442dc83319237d121c11f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd7c434915254744b7a0409ab8e6d33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:27.361757 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-364a5198-7f11-49ff-a316-ab1c9bff77b7 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/7b856a59-2a62-4edc-b448-430f778c7b2e" status: 200 len: 1306 microversion: 2.1 time: 0.229697 Apr 16 21:12:27.368075 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 850/1647] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:27 2022] GET /compute/v2.1/servers/7b856a59-2a62-4edc-b448-430f778c7b2e => generated 1306 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:12:27.716722 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-acee2639-45de-4657-830d-fae52f835a29 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1975042583", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:12:27.765797 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-08ca9ccd-4559-4eb6-abe4-28ba174d309f tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "DELETE /compute/v2.1/servers/80bcd5fb-6cbf-49ce-b126-1a95b55ba451" status: 204 len: 0 microversion: 2.1 time: 0.556562 Apr 16 21:12:27.767257 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 798/1648] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:12:27 2022] DELETE /compute/v2.1/servers/80bcd5fb-6cbf-49ce-b126-1a95b55ba451 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:12:27.775510 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-364de0e0-af15-4347-aa5b-e7ddd1d3d45f tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:27.776513 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-364de0e0-af15-4347-aa5b-e7ddd1d3d45f tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: e1c88ea7-2311-4b05-94ba-6e641159d41a] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:27.789861 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-364de0e0-af15-4347-aa5b-e7ddd1d3d45f tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:27.791511 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-364de0e0-af15-4347-aa5b-e7ddd1d3d45f tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:27.793787 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-364de0e0-af15-4347-aa5b-e7ddd1d3d45f tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:27.795600 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-364de0e0-af15-4347-aa5b-e7ddd1d3d45f tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:27.843919 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-acee2639-45de-4657-830d-fae52f835a29 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] validate_networks() for None {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:12:27.848163 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-364de0e0-af15-4347-aa5b-e7ddd1d3d45f tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: e1c88ea7-2311-4b05-94ba-6e641159d41a] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:12:28.142739 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-acee2639-45de-4657-830d-fae52f835a29 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:12:28.143559 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-acee2639-45de-4657-830d-fae52f835a29 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:12:28.144273 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-acee2639-45de-4657-830d-fae52f835a29 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:12:28.144877 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-acee2639-45de-4657-830d-fae52f835a29 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:12:28.145501 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-acee2639-45de-4657-830d-fae52f835a29 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:12:28.163427 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-acee2639-45de-4657-830d-fae52f835a29 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:28.164620 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-acee2639-45de-4657-830d-fae52f835a29 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:28.165650 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-acee2639-45de-4657-830d-fae52f835a29 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:28.166326 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-acee2639-45de-4657-830d-fae52f835a29 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:28.213828 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-acee2639-45de-4657-830d-fae52f835a29 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Getting quotas for project 1bc88cb7a1504053928ac23280b2b6a3. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:12:28.222426 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-acee2639-45de-4657-830d-fae52f835a29 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Getting quotas for user 5bb428513dc444a29288a38ca3e49a6f and project 1bc88cb7a1504053928ac23280b2b6a3. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:12:28.253669 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-acee2639-45de-4657-830d-fae52f835a29 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:12:28.256075 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-acee2639-45de-4657-830d-fae52f835a29 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] [instance: 44880d34-adb1-4de6-ada6-dc4f7e4f0527] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:12:28.456982 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-364de0e0-af15-4347-aa5b-e7ddd1d3d45f tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e1c88ea7-2311-4b05-94ba-6e641159d41a" status: 204 len: 0 microversion: 2.1 time: 0.683359 Apr 16 21:12:28.459169 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 799/1649] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:12:27 2022] DELETE /compute/v2.1/servers/e1c88ea7-2311-4b05-94ba-6e641159d41a => generated 0 bytes in 688 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:12:28.466350 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2f8bae4e-776d-4a33-87a3-b7772c43b240 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:28.469641 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2f8bae4e-776d-4a33-87a3-b7772c43b240 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] [instance: 7b856a59-2a62-4edc-b448-430f778c7b2e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:28.471557 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-acee2639-45de-4657-830d-fae52f835a29 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.988065 Apr 16 21:12:28.477143 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 851/1650] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:12:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:12:28.486297 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c1d8b958-58e9-4137-869b-4f17e0c8c338 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:28.487322 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2f8bae4e-776d-4a33-87a3-b7772c43b240 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:28.487804 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2f8bae4e-776d-4a33-87a3-b7772c43b240 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:28.491311 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2f8bae4e-776d-4a33-87a3-b7772c43b240 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:28.491696 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c1d8b958-58e9-4137-869b-4f17e0c8c338 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: 8fed9e31-a940-4555-8877-e98e33e6524f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:28.491855 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2f8bae4e-776d-4a33-87a3-b7772c43b240 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:28.510640 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c1d8b958-58e9-4137-869b-4f17e0c8c338 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:28.511313 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c1d8b958-58e9-4137-869b-4f17e0c8c338 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:28.512305 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c1d8b958-58e9-4137-869b-4f17e0c8c338 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:28.513704 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c1d8b958-58e9-4137-869b-4f17e0c8c338 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:28.523029 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-2f8bae4e-776d-4a33-87a3-b7772c43b240 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] HTTP exception thrown: Instance 7b856a59-2a62-4edc-b448-430f778c7b2e could not be found. Apr 16 21:12:28.523742 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2f8bae4e-776d-4a33-87a3-b7772c43b240 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] Returning 404 to user: Instance 7b856a59-2a62-4edc-b448-430f778c7b2e could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:12:28.529173 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2f8bae4e-776d-4a33-87a3-b7772c43b240 tempest-ServersOnMultiNodesTest-1618493866 tempest-ServersOnMultiNodesTest-1618493866-project] 10.222.0.20 "GET /compute/v2.1/servers/7b856a59-2a62-4edc-b448-430f778c7b2e" status: 404 len: 111 microversion: 2.1 time: 0.064135 Apr 16 21:12:28.532902 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 800/1651] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:28 2022] GET /compute/v2.1/servers/7b856a59-2a62-4edc-b448-430f778c7b2e => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:12:28.558612 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-004ffbfd-ac76-4ad7-af46-bb80d89a1d9a tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:28.559256 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-004ffbfd-ac76-4ad7-af46-bb80d89a1d9a tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] [instance: 44880d34-adb1-4de6-ada6-dc4f7e4f0527] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:28.567768 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-c1d8b958-58e9-4137-869b-4f17e0c8c338 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] HTTP exception thrown: Instance 8fed9e31-a940-4555-8877-e98e33e6524f could not be found. Apr 16 21:12:28.568730 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c1d8b958-58e9-4137-869b-4f17e0c8c338 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Returning 404 to user: Instance 8fed9e31-a940-4555-8877-e98e33e6524f could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:12:28.572594 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c1d8b958-58e9-4137-869b-4f17e0c8c338 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "GET /compute/v2.1/servers/8fed9e31-a940-4555-8877-e98e33e6524f" status: 404 len: 111 microversion: 2.1 time: 0.094368 Apr 16 21:12:28.573401 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 852/1652] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:28 2022] GET /compute/v2.1/servers/8fed9e31-a940-4555-8877-e98e33e6524f => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:12:28.587707 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e6de2e83-f309-4ebe-bb59-5d6446aec64f tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:28.589824 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e6de2e83-f309-4ebe-bb59-5d6446aec64f tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: 80bcd5fb-6cbf-49ce-b126-1a95b55ba451] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:28.601517 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e6de2e83-f309-4ebe-bb59-5d6446aec64f tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:28.601845 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e6de2e83-f309-4ebe-bb59-5d6446aec64f tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:28.602644 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e6de2e83-f309-4ebe-bb59-5d6446aec64f tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:28.603092 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e6de2e83-f309-4ebe-bb59-5d6446aec64f tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:28.757249 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-004ffbfd-ac76-4ad7-af46-bb80d89a1d9a tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb428513dc444a29288a38ca3e49a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc88cb7a1504053928ac23280b2b6a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:28.770758 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-004ffbfd-ac76-4ad7-af46-bb80d89a1d9a tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] 10.222.0.20 "GET /compute/v2.1/servers/44880d34-adb1-4de6-ada6-dc4f7e4f0527" status: 200 len: 1214 microversion: 2.1 time: 0.238547 Apr 16 21:12:28.775631 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 801/1653] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:28 2022] GET /compute/v2.1/servers/44880d34-adb1-4de6-ada6-dc4f7e4f0527 => generated 1214 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:28.954136 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e6de2e83-f309-4ebe-bb59-5d6446aec64f tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b5365affd1481db288841b9ffbf5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:28.963969 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e6de2e83-f309-4ebe-bb59-5d6446aec64f tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "GET /compute/v2.1/servers/80bcd5fb-6cbf-49ce-b126-1a95b55ba451" status: 200 len: 1523 microversion: 2.1 time: 0.386180 Apr 16 21:12:28.966087 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 853/1654] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:28 2022] GET /compute/v2.1/servers/80bcd5fb-6cbf-49ce-b126-1a95b55ba451 => generated 1523 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:29.789772 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3ffdd57b-62a0-4641-bc3e-7bbe3eddeb14 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:29.790591 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3ffdd57b-62a0-4641-bc3e-7bbe3eddeb14 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] [instance: 44880d34-adb1-4de6-ada6-dc4f7e4f0527] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:29.947956 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3ffdd57b-62a0-4641-bc3e-7bbe3eddeb14 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb428513dc444a29288a38ca3e49a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc88cb7a1504053928ac23280b2b6a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:29.984985 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9d3e89a7-6430-42d9-be4e-3a21dba5e229 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:29.985659 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9d3e89a7-6430-42d9-be4e-3a21dba5e229 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: 80bcd5fb-6cbf-49ce-b126-1a95b55ba451] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:30.004466 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3ffdd57b-62a0-4641-bc3e-7bbe3eddeb14 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] 10.222.0.20 "GET /compute/v2.1/servers/44880d34-adb1-4de6-ada6-dc4f7e4f0527" status: 200 len: 1214 microversion: 2.1 time: 0.218470 Apr 16 21:12:30.005076 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 802/1655] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:29 2022] GET /compute/v2.1/servers/44880d34-adb1-4de6-ada6-dc4f7e4f0527 => generated 1214 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:30.017437 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9d3e89a7-6430-42d9-be4e-3a21dba5e229 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:30.020959 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9d3e89a7-6430-42d9-be4e-3a21dba5e229 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:30.026130 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9d3e89a7-6430-42d9-be4e-3a21dba5e229 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:30.026712 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9d3e89a7-6430-42d9-be4e-3a21dba5e229 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:30.433852 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9d3e89a7-6430-42d9-be4e-3a21dba5e229 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b5365affd1481db288841b9ffbf5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:30.443778 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9d3e89a7-6430-42d9-be4e-3a21dba5e229 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "GET /compute/v2.1/servers/80bcd5fb-6cbf-49ce-b126-1a95b55ba451" status: 200 len: 1523 microversion: 2.1 time: 0.466444 Apr 16 21:12:30.459700 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 854/1656] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:29 2022] GET /compute/v2.1/servers/80bcd5fb-6cbf-49ce-b126-1a95b55ba451 => generated 1523 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:30.819781 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-1fea5454-563b-4cef-a7f5-3287d48bd19e req-659e3312-593f-46a4-ba5d-e4cdf3918997 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "80bcd5fb-6cbf-49ce-b126-1a95b55ba451", "name": "network-vif-deleted", "tag": "96a1cc71-d1de-4f33-ad30-0d9143131754"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:12:30.828347 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-1fea5454-563b-4cef-a7f5-3287d48bd19e req-659e3312-593f-46a4-ba5d-e4cdf3918997 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:30.828799 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-1fea5454-563b-4cef-a7f5-3287d48bd19e req-659e3312-593f-46a4-ba5d-e4cdf3918997 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:30.841293 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-1fea5454-563b-4cef-a7f5-3287d48bd19e req-659e3312-593f-46a4-ba5d-e4cdf3918997 service nova] Creating event network-vif-deleted:96a1cc71-d1de-4f33-ad30-0d9143131754 for instance 80bcd5fb-6cbf-49ce-b126-1a95b55ba451 on nch1-master-1 Apr 16 21:12:30.849004 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-1fea5454-563b-4cef-a7f5-3287d48bd19e req-659e3312-593f-46a4-ba5d-e4cdf3918997 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.251180 Apr 16 21:12:30.849916 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 803/1657] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:12:31.010039 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-d86dcba2-610f-4d6e-8e11-bdfef20f6846 req-75ba1639-0d08-4081-8d4a-60f0800ed568 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1c88ea7-2311-4b05-94ba-6e641159d41a", "name": "network-vif-deleted", "tag": "be39f056-864d-4773-9608-d25a97235273"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:12:31.022201 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e7749634-37e6-4918-ae29-4296674bced4 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:31.022906 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e7749634-37e6-4918-ae29-4296674bced4 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] [instance: 44880d34-adb1-4de6-ada6-dc4f7e4f0527] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:31.029449 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e7749634-37e6-4918-ae29-4296674bced4 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:31.030959 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e7749634-37e6-4918-ae29-4296674bced4 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:31.031925 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e7749634-37e6-4918-ae29-4296674bced4 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:31.033175 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e7749634-37e6-4918-ae29-4296674bced4 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:31.049262 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-d86dcba2-610f-4d6e-8e11-bdfef20f6846 req-75ba1639-0d08-4081-8d4a-60f0800ed568 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:31.050036 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-d86dcba2-610f-4d6e-8e11-bdfef20f6846 req-75ba1639-0d08-4081-8d4a-60f0800ed568 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:31.062191 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-d86dcba2-610f-4d6e-8e11-bdfef20f6846 req-75ba1639-0d08-4081-8d4a-60f0800ed568 service nova] Creating event network-vif-deleted:be39f056-864d-4773-9608-d25a97235273 for instance e1c88ea7-2311-4b05-94ba-6e641159d41a on nch2-master-1 Apr 16 21:12:31.075270 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-d86dcba2-610f-4d6e-8e11-bdfef20f6846 req-75ba1639-0d08-4081-8d4a-60f0800ed568 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068066 Apr 16 21:12:31.076835 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 855/1658] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:12:31.151552 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e7749634-37e6-4918-ae29-4296674bced4 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb428513dc444a29288a38ca3e49a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc88cb7a1504053928ac23280b2b6a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:31.161331 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e7749634-37e6-4918-ae29-4296674bced4 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] 10.222.0.20 "GET /compute/v2.1/servers/44880d34-adb1-4de6-ada6-dc4f7e4f0527" status: 200 len: 1218 microversion: 2.1 time: 0.143425 Apr 16 21:12:31.162174 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 804/1659] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:31 2022] GET /compute/v2.1/servers/44880d34-adb1-4de6-ada6-dc4f7e4f0527 => generated 1218 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:12:31.476203 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d887816c-82b8-4ee7-a6fc-6b9996620de8 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:31.477121 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d887816c-82b8-4ee7-a6fc-6b9996620de8 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: 80bcd5fb-6cbf-49ce-b126-1a95b55ba451] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:31.484703 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d887816c-82b8-4ee7-a6fc-6b9996620de8 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:31.485461 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d887816c-82b8-4ee7-a6fc-6b9996620de8 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:31.486646 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d887816c-82b8-4ee7-a6fc-6b9996620de8 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:31.487269 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d887816c-82b8-4ee7-a6fc-6b9996620de8 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:31.562390 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d887816c-82b8-4ee7-a6fc-6b9996620de8 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:31.563042 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d887816c-82b8-4ee7-a6fc-6b9996620de8 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:31.564066 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-d887816c-82b8-4ee7-a6fc-6b9996620de8 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lazy-loading 'fault' on Instance uuid 80bcd5fb-6cbf-49ce-b126-1a95b55ba451 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:12:31.629524 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d887816c-82b8-4ee7-a6fc-6b9996620de8 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14b5365affd1481db288841b9ffbf5cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e9cccbcf0e7456ab8b7c7992372784b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:31.637392 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d887816c-82b8-4ee7-a6fc-6b9996620de8 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "GET /compute/v2.1/servers/80bcd5fb-6cbf-49ce-b126-1a95b55ba451" status: 200 len: 1313 microversion: 2.1 time: 0.166524 Apr 16 21:12:31.637910 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 856/1660] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:31 2022] GET /compute/v2.1/servers/80bcd5fb-6cbf-49ce-b126-1a95b55ba451 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:32.178506 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8af10898-1fb8-44b8-8564-5b5dfca78df6 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:32.179754 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8af10898-1fb8-44b8-8564-5b5dfca78df6 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] [instance: 44880d34-adb1-4de6-ada6-dc4f7e4f0527] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:32.190844 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8af10898-1fb8-44b8-8564-5b5dfca78df6 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:32.191299 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8af10898-1fb8-44b8-8564-5b5dfca78df6 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:32.205400 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8af10898-1fb8-44b8-8564-5b5dfca78df6 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:32.205879 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8af10898-1fb8-44b8-8564-5b5dfca78df6 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:32.381383 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8af10898-1fb8-44b8-8564-5b5dfca78df6 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb428513dc444a29288a38ca3e49a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc88cb7a1504053928ac23280b2b6a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:32.394669 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8af10898-1fb8-44b8-8564-5b5dfca78df6 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] 10.222.0.20 "GET /compute/v2.1/servers/44880d34-adb1-4de6-ada6-dc4f7e4f0527" status: 200 len: 1266 microversion: 2.1 time: 0.220208 Apr 16 21:12:32.406263 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 805/1661] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:32 2022] GET /compute/v2.1/servers/44880d34-adb1-4de6-ada6-dc4f7e4f0527 => generated 1266 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:32.657418 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-895412df-02a9-4862-8573-be759347e3fc tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:32.658955 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-895412df-02a9-4862-8573-be759347e3fc tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: 80bcd5fb-6cbf-49ce-b126-1a95b55ba451] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:32.666145 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-895412df-02a9-4862-8573-be759347e3fc tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:32.666667 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-895412df-02a9-4862-8573-be759347e3fc tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:32.667400 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-895412df-02a9-4862-8573-be759347e3fc tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:32.668009 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-895412df-02a9-4862-8573-be759347e3fc tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:32.693617 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-895412df-02a9-4862-8573-be759347e3fc tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] HTTP exception thrown: Instance 80bcd5fb-6cbf-49ce-b126-1a95b55ba451 could not be found. Apr 16 21:12:32.693617 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-895412df-02a9-4862-8573-be759347e3fc tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Returning 404 to user: Instance 80bcd5fb-6cbf-49ce-b126-1a95b55ba451 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:12:32.693617 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-895412df-02a9-4862-8573-be759347e3fc tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "GET /compute/v2.1/servers/80bcd5fb-6cbf-49ce-b126-1a95b55ba451" status: 404 len: 111 microversion: 2.1 time: 0.039902 Apr 16 21:12:32.694085 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 857/1662] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:32 2022] GET /compute/v2.1/servers/80bcd5fb-6cbf-49ce-b126-1a95b55ba451 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:12:32.708686 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ab481d10-efc8-439c-82d2-251ab441f2d8 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:32.710972 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ab481d10-efc8-439c-82d2-251ab441f2d8 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] [instance: e1c88ea7-2311-4b05-94ba-6e641159d41a] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:32.718971 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ab481d10-efc8-439c-82d2-251ab441f2d8 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:32.721199 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ab481d10-efc8-439c-82d2-251ab441f2d8 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:32.722140 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ab481d10-efc8-439c-82d2-251ab441f2d8 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:32.724721 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ab481d10-efc8-439c-82d2-251ab441f2d8 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:32.757380 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-ab481d10-efc8-439c-82d2-251ab441f2d8 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] HTTP exception thrown: Instance e1c88ea7-2311-4b05-94ba-6e641159d41a could not be found. Apr 16 21:12:32.762099 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ab481d10-efc8-439c-82d2-251ab441f2d8 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] Returning 404 to user: Instance e1c88ea7-2311-4b05-94ba-6e641159d41a could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:12:32.762099 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ab481d10-efc8-439c-82d2-251ab441f2d8 tempest-ListServersNegativeTestJSON-826022182 tempest-ListServersNegativeTestJSON-826022182-project] 10.222.0.20 "GET /compute/v2.1/servers/e1c88ea7-2311-4b05-94ba-6e641159d41a" status: 404 len: 111 microversion: 2.1 time: 0.060012 Apr 16 21:12:32.762099 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 806/1663] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:32 2022] GET /compute/v2.1/servers/e1c88ea7-2311-4b05-94ba-6e641159d41a => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:12:33.412437 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4e2b2a06-ae54-41ab-884f-ceb50e891598 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:33.413049 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4e2b2a06-ae54-41ab-884f-ceb50e891598 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] [instance: 44880d34-adb1-4de6-ada6-dc4f7e4f0527] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:33.421762 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4e2b2a06-ae54-41ab-884f-ceb50e891598 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:33.426337 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4e2b2a06-ae54-41ab-884f-ceb50e891598 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:33.427294 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4e2b2a06-ae54-41ab-884f-ceb50e891598 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:33.427760 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4e2b2a06-ae54-41ab-884f-ceb50e891598 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:33.521253 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4e2b2a06-ae54-41ab-884f-ceb50e891598 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb428513dc444a29288a38ca3e49a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc88cb7a1504053928ac23280b2b6a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:33.534928 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4e2b2a06-ae54-41ab-884f-ceb50e891598 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] 10.222.0.20 "GET /compute/v2.1/servers/44880d34-adb1-4de6-ada6-dc4f7e4f0527" status: 200 len: 1272 microversion: 2.1 time: 0.126597 Apr 16 21:12:33.535510 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 858/1664] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:33 2022] GET /compute/v2.1/servers/44880d34-adb1-4de6-ada6-dc4f7e4f0527 => generated 1272 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:34.552153 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2a2dbf73-ed85-4768-83c9-d639a294d4ad tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:34.552786 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2a2dbf73-ed85-4768-83c9-d639a294d4ad tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] [instance: 44880d34-adb1-4de6-ada6-dc4f7e4f0527] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:34.560996 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2a2dbf73-ed85-4768-83c9-d639a294d4ad tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:34.562226 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2a2dbf73-ed85-4768-83c9-d639a294d4ad tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:34.563335 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2a2dbf73-ed85-4768-83c9-d639a294d4ad tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:34.563623 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2a2dbf73-ed85-4768-83c9-d639a294d4ad tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:34.790293 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2a2dbf73-ed85-4768-83c9-d639a294d4ad tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb428513dc444a29288a38ca3e49a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc88cb7a1504053928ac23280b2b6a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:34.803443 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2a2dbf73-ed85-4768-83c9-d639a294d4ad tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] 10.222.0.20 "GET /compute/v2.1/servers/44880d34-adb1-4de6-ada6-dc4f7e4f0527" status: 200 len: 1314 microversion: 2.1 time: 0.254926 Apr 16 21:12:34.804039 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 807/1665] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:34 2022] GET /compute/v2.1/servers/44880d34-adb1-4de6-ada6-dc4f7e4f0527 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:35.437039 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-14d78613-476e-4174-ad9e-c3f949049746 req-fa6f8227-3e39-4045-9063-d08b6760df3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44880d34-adb1-4de6-ada6-dc4f7e4f0527", "tag": "98e4611b-6394-423f-af47-8583fcc1b4f5"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:12:35.462073 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-14d78613-476e-4174-ad9e-c3f949049746 req-fa6f8227-3e39-4045-9063-d08b6760df3b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:35.477430 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-14d78613-476e-4174-ad9e-c3f949049746 req-fa6f8227-3e39-4045-9063-d08b6760df3b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:35.511158 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-14d78613-476e-4174-ad9e-c3f949049746 req-fa6f8227-3e39-4045-9063-d08b6760df3b service nova] Creating event network-changed:98e4611b-6394-423f-af47-8583fcc1b4f5 for instance 44880d34-adb1-4de6-ada6-dc4f7e4f0527 on nch2-master-1 Apr 16 21:12:35.519886 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-14d78613-476e-4174-ad9e-c3f949049746 req-fa6f8227-3e39-4045-9063-d08b6760df3b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088462 Apr 16 21:12:35.521744 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 859/1666] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:12:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:12:35.825712 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-80d122b4-9aed-43a0-87a7-fa41a61c7c37 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:35.825712 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-80d122b4-9aed-43a0-87a7-fa41a61c7c37 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] [instance: 44880d34-adb1-4de6-ada6-dc4f7e4f0527] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:35.847265 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-80d122b4-9aed-43a0-87a7-fa41a61c7c37 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:35.847945 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-80d122b4-9aed-43a0-87a7-fa41a61c7c37 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:35.848947 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-80d122b4-9aed-43a0-87a7-fa41a61c7c37 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:35.849634 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-80d122b4-9aed-43a0-87a7-fa41a61c7c37 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:36.050904 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-80d122b4-9aed-43a0-87a7-fa41a61c7c37 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb428513dc444a29288a38ca3e49a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc88cb7a1504053928ac23280b2b6a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:36.063842 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-80d122b4-9aed-43a0-87a7-fa41a61c7c37 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] 10.222.0.20 "GET /compute/v2.1/servers/44880d34-adb1-4de6-ada6-dc4f7e4f0527" status: 200 len: 1314 microversion: 2.1 time: 0.246760 Apr 16 21:12:36.064899 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 808/1667] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:35 2022] GET /compute/v2.1/servers/44880d34-adb1-4de6-ada6-dc4f7e4f0527 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:37.081272 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f87c2652-156f-41e4-935c-6c399c1cf548 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:37.085533 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f87c2652-156f-41e4-935c-6c399c1cf548 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] [instance: 44880d34-adb1-4de6-ada6-dc4f7e4f0527] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:37.089325 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f87c2652-156f-41e4-935c-6c399c1cf548 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:37.089796 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f87c2652-156f-41e4-935c-6c399c1cf548 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:37.090745 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f87c2652-156f-41e4-935c-6c399c1cf548 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:37.091201 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f87c2652-156f-41e4-935c-6c399c1cf548 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:37.458691 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f87c2652-156f-41e4-935c-6c399c1cf548 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb428513dc444a29288a38ca3e49a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc88cb7a1504053928ac23280b2b6a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:37.466315 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f87c2652-156f-41e4-935c-6c399c1cf548 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] 10.222.0.20 "GET /compute/v2.1/servers/44880d34-adb1-4de6-ada6-dc4f7e4f0527" status: 200 len: 1314 microversion: 2.1 time: 0.389213 Apr 16 21:12:37.467162 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 860/1668] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:37 2022] GET /compute/v2.1/servers/44880d34-adb1-4de6-ada6-dc4f7e4f0527 => generated 1314 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:38.483709 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ac3f6acd-524a-493a-9aab-6d8c441b3b08 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:38.486828 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ac3f6acd-524a-493a-9aab-6d8c441b3b08 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] [instance: 44880d34-adb1-4de6-ada6-dc4f7e4f0527] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:38.500808 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ac3f6acd-524a-493a-9aab-6d8c441b3b08 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:38.501422 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ac3f6acd-524a-493a-9aab-6d8c441b3b08 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:38.502241 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ac3f6acd-524a-493a-9aab-6d8c441b3b08 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:38.502693 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ac3f6acd-524a-493a-9aab-6d8c441b3b08 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:38.829559 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ea94ff50-d6cf-42df-98a7-dbb038eab626 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-2052386018", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "769f0aad-9fdd-4679-bf9a-69cbe3356918"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:12:38.892769 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-ea94ff50-d6cf-42df-98a7-dbb038eab626 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] validate_networks() for [('769f0aad-9fdd-4679-bf9a-69cbe3356918', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:12:38.972991 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ac3f6acd-524a-493a-9aab-6d8c441b3b08 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb428513dc444a29288a38ca3e49a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc88cb7a1504053928ac23280b2b6a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:38.982247 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ac3f6acd-524a-493a-9aab-6d8c441b3b08 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] 10.222.0.20 "GET /compute/v2.1/servers/44880d34-adb1-4de6-ada6-dc4f7e4f0527" status: 200 len: 1314 microversion: 2.1 time: 0.502940 Apr 16 21:12:38.983675 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 809/1669] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:38 2022] GET /compute/v2.1/servers/44880d34-adb1-4de6-ada6-dc4f7e4f0527 => generated 1314 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:39.557597 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-ea94ff50-d6cf-42df-98a7-dbb038eab626 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:12:39.558915 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-ea94ff50-d6cf-42df-98a7-dbb038eab626 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:12:39.560027 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-ea94ff50-d6cf-42df-98a7-dbb038eab626 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:12:39.560690 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-ea94ff50-d6cf-42df-98a7-dbb038eab626 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:12:39.562010 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-ea94ff50-d6cf-42df-98a7-dbb038eab626 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:12:39.573133 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ea94ff50-d6cf-42df-98a7-dbb038eab626 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:39.574035 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ea94ff50-d6cf-42df-98a7-dbb038eab626 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:39.575036 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ea94ff50-d6cf-42df-98a7-dbb038eab626 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:39.576017 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ea94ff50-d6cf-42df-98a7-dbb038eab626 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:39.606490 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-ea94ff50-d6cf-42df-98a7-dbb038eab626 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Getting quotas for project f95103d3663146e9ba6ffb49a05196b4. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:12:39.617652 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-ea94ff50-d6cf-42df-98a7-dbb038eab626 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Getting quotas for user 3ad32f0114a44a3bac0c966003e312df and project f95103d3663146e9ba6ffb49a05196b4. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:12:39.656604 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ea94ff50-d6cf-42df-98a7-dbb038eab626 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:12:39.659574 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ea94ff50-d6cf-42df-98a7-dbb038eab626 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9ea94c91-140c-428c-8831-03efc8c571f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:12:39.889753 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ea94ff50-d6cf-42df-98a7-dbb038eab626 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.295326 Apr 16 21:12:39.896225 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 861/1670] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:12:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1303 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 16 21:12:39.904812 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-78fa993a-33a5-4308-a899-c3272d9c98f5 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:39.906016 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-78fa993a-33a5-4308-a899-c3272d9c98f5 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9ea94c91-140c-428c-8831-03efc8c571f6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:40.000196 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-26a36c68-5cce-49b8-a090-76782ccb39e8 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:40.000966 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-26a36c68-5cce-49b8-a090-76782ccb39e8 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] [instance: 44880d34-adb1-4de6-ada6-dc4f7e4f0527] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:40.012031 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-26a36c68-5cce-49b8-a090-76782ccb39e8 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:40.014477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-26a36c68-5cce-49b8-a090-76782ccb39e8 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:40.016208 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-26a36c68-5cce-49b8-a090-76782ccb39e8 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:40.016208 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-26a36c68-5cce-49b8-a090-76782ccb39e8 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:40.043494 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-78fa993a-33a5-4308-a899-c3272d9c98f5 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:40.052122 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-78fa993a-33a5-4308-a899-c3272d9c98f5 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9ea94c91-140c-428c-8831-03efc8c571f6" status: 200 len: 1208 microversion: 2.1 time: 0.154652 Apr 16 21:12:40.064753 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 810/1671] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:39 2022] GET /compute/v2.1/servers/9ea94c91-140c-428c-8831-03efc8c571f6 => generated 1208 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:12:40.423992 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-26a36c68-5cce-49b8-a090-76782ccb39e8 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb428513dc444a29288a38ca3e49a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc88cb7a1504053928ac23280b2b6a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:40.444075 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-26a36c68-5cce-49b8-a090-76782ccb39e8 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] 10.222.0.20 "GET /compute/v2.1/servers/44880d34-adb1-4de6-ada6-dc4f7e4f0527" status: 200 len: 1314 microversion: 2.1 time: 0.448983 Apr 16 21:12:40.449596 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 862/1672] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:39 2022] GET /compute/v2.1/servers/44880d34-adb1-4de6-ada6-dc4f7e4f0527 => generated 1314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:12:41.072594 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-20e6bce8-9bf7-4795-a432-ad52119dca32 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:41.080212 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-20e6bce8-9bf7-4795-a432-ad52119dca32 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9ea94c91-140c-428c-8831-03efc8c571f6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:41.183038 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-20e6bce8-9bf7-4795-a432-ad52119dca32 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:41.194857 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-20e6bce8-9bf7-4795-a432-ad52119dca32 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9ea94c91-140c-428c-8831-03efc8c571f6" status: 200 len: 1208 microversion: 2.1 time: 0.126183 Apr 16 21:12:41.196514 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 811/1673] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:41 2022] GET /compute/v2.1/servers/9ea94c91-140c-428c-8831-03efc8c571f6 => generated 1208 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:41.463989 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b722e2dd-9378-48ca-8d50-c53fa2658863 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:41.464828 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b722e2dd-9378-48ca-8d50-c53fa2658863 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] [instance: 44880d34-adb1-4de6-ada6-dc4f7e4f0527] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:41.484766 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b722e2dd-9378-48ca-8d50-c53fa2658863 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:41.485644 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b722e2dd-9378-48ca-8d50-c53fa2658863 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:41.487467 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b722e2dd-9378-48ca-8d50-c53fa2658863 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:41.488237 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b722e2dd-9378-48ca-8d50-c53fa2658863 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:41.794813 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b722e2dd-9378-48ca-8d50-c53fa2658863 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb428513dc444a29288a38ca3e49a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc88cb7a1504053928ac23280b2b6a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:41.804803 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b722e2dd-9378-48ca-8d50-c53fa2658863 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] 10.222.0.20 "GET /compute/v2.1/servers/44880d34-adb1-4de6-ada6-dc4f7e4f0527" status: 200 len: 1314 microversion: 2.1 time: 0.347183 Apr 16 21:12:41.811309 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 863/1674] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:41 2022] GET /compute/v2.1/servers/44880d34-adb1-4de6-ada6-dc4f7e4f0527 => generated 1314 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:42.223509 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e75fe4cb-25c8-4ed8-a90a-a5bc99d8baac tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:42.223509 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e75fe4cb-25c8-4ed8-a90a-a5bc99d8baac tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9ea94c91-140c-428c-8831-03efc8c571f6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:42.239119 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e75fe4cb-25c8-4ed8-a90a-a5bc99d8baac tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:42.239590 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e75fe4cb-25c8-4ed8-a90a-a5bc99d8baac tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:42.240426 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e75fe4cb-25c8-4ed8-a90a-a5bc99d8baac tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:42.240875 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e75fe4cb-25c8-4ed8-a90a-a5bc99d8baac tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:42.379464 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e75fe4cb-25c8-4ed8-a90a-a5bc99d8baac tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:42.393852 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e75fe4cb-25c8-4ed8-a90a-a5bc99d8baac tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9ea94c91-140c-428c-8831-03efc8c571f6" status: 200 len: 1260 microversion: 2.1 time: 0.184926 Apr 16 21:12:42.399042 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 812/1675] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:42 2022] GET /compute/v2.1/servers/9ea94c91-140c-428c-8831-03efc8c571f6 => generated 1260 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:42.829519 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-68352a6b-1f73-49e0-85c6-6a093707ddb7 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:42.830771 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-68352a6b-1f73-49e0-85c6-6a093707ddb7 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] [instance: 44880d34-adb1-4de6-ada6-dc4f7e4f0527] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:42.844720 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-68352a6b-1f73-49e0-85c6-6a093707ddb7 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:42.845366 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-68352a6b-1f73-49e0-85c6-6a093707ddb7 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:42.846347 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-68352a6b-1f73-49e0-85c6-6a093707ddb7 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:42.846952 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-68352a6b-1f73-49e0-85c6-6a093707ddb7 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:43.414049 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f6103213-39ec-4d01-9bf9-f539732e532b tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:43.414631 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f6103213-39ec-4d01-9bf9-f539732e532b tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9ea94c91-140c-428c-8831-03efc8c571f6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:43.428620 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f6103213-39ec-4d01-9bf9-f539732e532b tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:43.429389 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f6103213-39ec-4d01-9bf9-f539732e532b tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:43.440883 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f6103213-39ec-4d01-9bf9-f539732e532b tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:43.441362 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f6103213-39ec-4d01-9bf9-f539732e532b tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:43.457025 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-68352a6b-1f73-49e0-85c6-6a093707ddb7 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb428513dc444a29288a38ca3e49a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc88cb7a1504053928ac23280b2b6a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:43.466397 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-68352a6b-1f73-49e0-85c6-6a093707ddb7 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] 10.222.0.20 "GET /compute/v2.1/servers/44880d34-adb1-4de6-ada6-dc4f7e4f0527" status: 200 len: 1314 microversion: 2.1 time: 0.642454 Apr 16 21:12:43.470093 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 864/1676] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:42 2022] GET /compute/v2.1/servers/44880d34-adb1-4de6-ada6-dc4f7e4f0527 => generated 1314 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:43.574478 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f6103213-39ec-4d01-9bf9-f539732e532b tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:43.583951 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f6103213-39ec-4d01-9bf9-f539732e532b tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9ea94c91-140c-428c-8831-03efc8c571f6" status: 200 len: 1266 microversion: 2.1 time: 0.172453 Apr 16 21:12:43.588229 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 813/1677] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:43 2022] GET /compute/v2.1/servers/9ea94c91-140c-428c-8831-03efc8c571f6 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:12:43.730164 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3e61410b-1981-413c-9f57-82906a1f6449 tempest-FloatingIPsNegativeTestJSON-2043461616 tempest-FloatingIPsNegativeTestJSON-2043461616-project] Calling method '.version_select at 0x7fbb9ffb6b80>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:43.784755 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3e61410b-1981-413c-9f57-82906a1f6449 tempest-FloatingIPsNegativeTestJSON-2043461616 tempest-FloatingIPsNegativeTestJSON-2043461616-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.142100 Apr 16 21:12:43.792785 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 865/1678] 10.222.0.20 () {58 vars in 1148 bytes} [Sat Apr 16 21:12:43 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:12:43.799295 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4b754601-2bcd-4111-be56-49bc38307205 tempest-FloatingIPsNegativeTestJSON-2043461616 tempest-FloatingIPsNegativeTestJSON-2043461616-project] Action: 'create', calling method: .version_select at 0x7fbba0002310>, body: {"pool": "non_exist_pool"} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:12:43.831918 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-4b754601-2bcd-4111-be56-49bc38307205 tempest-FloatingIPsNegativeTestJSON-2043461616 tempest-FloatingIPsNegativeTestJSON-2043461616-project] HTTP exception thrown: Floating IP pool not found. Apr 16 21:12:43.832654 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4b754601-2bcd-4111-be56-49bc38307205 tempest-FloatingIPsNegativeTestJSON-2043461616 tempest-FloatingIPsNegativeTestJSON-2043461616-project] Returning 404 to user: Floating IP pool not found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:12:43.833961 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4b754601-2bcd-4111-be56-49bc38307205 tempest-FloatingIPsNegativeTestJSON-2043461616 tempest-FloatingIPsNegativeTestJSON-2043461616-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.039515 Apr 16 21:12:43.839479 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 866/1679] 10.222.0.20 () {60 vars in 1169 bytes} [Sat Apr 16 21:12:43 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:12:43.847425 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e0c71467-dee6-47e3-931e-df3c573d3814 tempest-FloatingIPsNegativeTestJSON-2043461616 tempest-FloatingIPsNegativeTestJSON-2043461616-project] Calling method '.version_select at 0x7fbba00e7280>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:43.955446 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-f1ff8cb8-429e-465b-b061-5413db7cb4c4 req-a0d6ebb4-3289-4ccf-9e60-141bd2d4b934 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44880d34-adb1-4de6-ada6-dc4f7e4f0527", "name": "network-vif-plugged", "status": "completed", "tag": "98e4611b-6394-423f-af47-8583fcc1b4f5"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:12:43.965587 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-f1ff8cb8-429e-465b-b061-5413db7cb4c4 req-a0d6ebb4-3289-4ccf-9e60-141bd2d4b934 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:43.966310 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-f1ff8cb8-429e-465b-b061-5413db7cb4c4 req-a0d6ebb4-3289-4ccf-9e60-141bd2d4b934 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:43.993297 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-f1ff8cb8-429e-465b-b061-5413db7cb4c4 req-a0d6ebb4-3289-4ccf-9e60-141bd2d4b934 service nova] Creating event network-vif-plugged:98e4611b-6394-423f-af47-8583fcc1b4f5 for instance 44880d34-adb1-4de6-ada6-dc4f7e4f0527 on nch2-master-1 Apr 16 21:12:43.994821 ncdv-master-1 devstack@n-api.service[137408]: DEBUG neutronclient.v2_0.client [None req-e0c71467-dee6-47e3-931e-df3c573d3814 tempest-FloatingIPsNegativeTestJSON-2043461616 tempest-FloatingIPsNegativeTestJSON-2043461616-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 6ff129fd-9e74-495d-81f8-a4c54b0ef488 could not be found", "detail": ""}} {{(pid=137408) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 16 21:12:43.995776 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-e0c71467-dee6-47e3-931e-df3c573d3814 tempest-FloatingIPsNegativeTestJSON-2043461616 tempest-FloatingIPsNegativeTestJSON-2043461616-project] HTTP exception thrown: Floating IP not found for ID 6ff129fd-9e74-495d-81f8-a4c54b0ef488 Apr 16 21:12:43.996480 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e0c71467-dee6-47e3-931e-df3c573d3814 tempest-FloatingIPsNegativeTestJSON-2043461616 tempest-FloatingIPsNegativeTestJSON-2043461616-project] Returning 404 to user: Floating IP not found for ID 6ff129fd-9e74-495d-81f8-a4c54b0ef488 {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:12:43.997386 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e0c71467-dee6-47e3-931e-df3c573d3814 tempest-FloatingIPsNegativeTestJSON-2043461616 tempest-FloatingIPsNegativeTestJSON-2043461616-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/6ff129fd-9e74-495d-81f8-a4c54b0ef488" status: 404 len: 111 microversion: 2.1 time: 0.156647 Apr 16 21:12:44.004044 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 867/1680] 10.222.0.20 () {58 vars in 1262 bytes} [Sat Apr 16 21:12:43 2022] DELETE /compute/v2.1/os-floating-ips/6ff129fd-9e74-495d-81f8-a4c54b0ef488 => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:12:44.009418 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-f1ff8cb8-429e-465b-b061-5413db7cb4c4 req-a0d6ebb4-3289-4ccf-9e60-141bd2d4b934 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.239117 Apr 16 21:12:44.015745 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 814/1681] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:12:44.499732 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e7f143c0-e2a9-4c59-bce3-264453fba37e tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:44.502947 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e7f143c0-e2a9-4c59-bce3-264453fba37e tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] [instance: 44880d34-adb1-4de6-ada6-dc4f7e4f0527] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:44.521599 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e7f143c0-e2a9-4c59-bce3-264453fba37e tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:44.522763 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e7f143c0-e2a9-4c59-bce3-264453fba37e tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:44.524477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e7f143c0-e2a9-4c59-bce3-264453fba37e tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:44.525524 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e7f143c0-e2a9-4c59-bce3-264453fba37e tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:44.625364 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0b2145c1-e909-45f7-9847-0fe03356a9c3 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:44.627378 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0b2145c1-e909-45f7-9847-0fe03356a9c3 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9ea94c91-140c-428c-8831-03efc8c571f6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:44.647387 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0b2145c1-e909-45f7-9847-0fe03356a9c3 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:44.649651 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0b2145c1-e909-45f7-9847-0fe03356a9c3 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:44.655503 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0b2145c1-e909-45f7-9847-0fe03356a9c3 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:44.655503 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0b2145c1-e909-45f7-9847-0fe03356a9c3 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:45.079097 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e7f143c0-e2a9-4c59-bce3-264453fba37e tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb428513dc444a29288a38ca3e49a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc88cb7a1504053928ac23280b2b6a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:45.087908 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e7f143c0-e2a9-4c59-bce3-264453fba37e tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] 10.222.0.20 "GET /compute/v2.1/servers/44880d34-adb1-4de6-ada6-dc4f7e4f0527" status: 200 len: 1314 microversion: 2.1 time: 0.602471 Apr 16 21:12:45.088580 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 868/1682] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:44 2022] GET /compute/v2.1/servers/44880d34-adb1-4de6-ada6-dc4f7e4f0527 => generated 1314 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:45.139122 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0b2145c1-e909-45f7-9847-0fe03356a9c3 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:45.152472 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0b2145c1-e909-45f7-9847-0fe03356a9c3 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9ea94c91-140c-428c-8831-03efc8c571f6" status: 200 len: 1308 microversion: 2.1 time: 0.548621 Apr 16 21:12:45.153731 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 815/1683] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:44 2022] GET /compute/v2.1/servers/9ea94c91-140c-428c-8831-03efc8c571f6 => generated 1308 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:45.881106 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-414e1191-2f32-4ab7-ab15-616aa9e56cac tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Action: 'create', calling method: .version_select at 0x7fbb9ffb6310>, body: {"keypair": {"name": "tempest-keypair-1466075469"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:12:45.912641 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-414e1191-2f32-4ab7-ab15-616aa9e56cac tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Getting quotas for project ceac90e6c7024b4ea350bfa95e1b5249. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:12:45.921806 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-414e1191-2f32-4ab7-ab15-616aa9e56cac tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Getting quotas for user 6bb1c0cdf6274f118ebbe97829ddad65 and project ceac90e6c7024b4ea350bfa95e1b5249. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:12:46.106749 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-68752914-ba23-47f9-acb0-917490852362 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:46.108771 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-68752914-ba23-47f9-acb0-917490852362 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] [instance: 44880d34-adb1-4de6-ada6-dc4f7e4f0527] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:46.139179 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-68752914-ba23-47f9-acb0-917490852362 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:46.139641 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-68752914-ba23-47f9-acb0-917490852362 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:46.147536 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-68752914-ba23-47f9-acb0-917490852362 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:46.148259 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-68752914-ba23-47f9-acb0-917490852362 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:46.816341 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-68752914-ba23-47f9-acb0-917490852362 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb428513dc444a29288a38ca3e49a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc88cb7a1504053928ac23280b2b6a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:46.825553 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-68752914-ba23-47f9-acb0-917490852362 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] 10.222.0.20 "GET /compute/v2.1/servers/44880d34-adb1-4de6-ada6-dc4f7e4f0527" status: 200 len: 1462 microversion: 2.1 time: 0.724620 Apr 16 21:12:46.832287 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 816/1684] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:46 2022] GET /compute/v2.1/servers/44880d34-adb1-4de6-ada6-dc4f7e4f0527 => generated 1462 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:46.842320 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a3cffef7-acd5-408b-90e7-26d384979a94 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:46.842940 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a3cffef7-acd5-408b-90e7-26d384979a94 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9ea94c91-140c-428c-8831-03efc8c571f6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:46.862829 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a3cffef7-acd5-408b-90e7-26d384979a94 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:46.863304 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a3cffef7-acd5-408b-90e7-26d384979a94 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:46.868764 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a3cffef7-acd5-408b-90e7-26d384979a94 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:46.869231 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a3cffef7-acd5-408b-90e7-26d384979a94 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:47.343539 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-414e1191-2f32-4ab7-ab15-616aa9e56cac tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Getting quotas for project ceac90e6c7024b4ea350bfa95e1b5249. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:12:47.382100 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-414e1191-2f32-4ab7-ab15-616aa9e56cac tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Getting quotas for user 6bb1c0cdf6274f118ebbe97829ddad65 and project ceac90e6c7024b4ea350bfa95e1b5249. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:12:47.422267 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-414e1191-2f32-4ab7-ab15-616aa9e56cac tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.651504 Apr 16 21:12:47.425751 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 869/1685] 10.222.0.20 () {60 vars in 1157 bytes} [Sat Apr 16 21:12:45 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:47.591273 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a3cffef7-acd5-408b-90e7-26d384979a94 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:47.604742 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a3cffef7-acd5-408b-90e7-26d384979a94 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9ea94c91-140c-428c-8831-03efc8c571f6" status: 200 len: 1308 microversion: 2.1 time: 0.769815 Apr 16 21:12:47.605956 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 817/1686] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:46 2022] GET /compute/v2.1/servers/9ea94c91-140c-428c-8831-03efc8c571f6 => generated 1308 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:47.619641 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-961ba821-10a5-48a4-a693-7d3ceb0d72a8 req-98b2ad85-e281-4277-9750-134c37dc961e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ea94c91-140c-428c-8831-03efc8c571f6", "tag": "92e3c39d-5eff-4b35-945a-25de4f5dce4b"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:12:47.631846 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-934d6d37-d434-437a-b8f5-fbddd6499fe6 tempest-TenantUsagesTestJSON-2115196932 tempest-TenantUsagesTestJSON-2115196932-project-admin] Calling method '.version_select at 0x7fbb9654b820>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:47.643415 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-934d6d37-d434-437a-b8f5-fbddd6499fe6 tempest-TenantUsagesTestJSON-2115196932 tempest-TenantUsagesTestJSON-2115196932-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:47.644190 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-934d6d37-d434-437a-b8f5-fbddd6499fe6 tempest-TenantUsagesTestJSON-2115196932 tempest-TenantUsagesTestJSON-2115196932-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:47.645513 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-961ba821-10a5-48a4-a693-7d3ceb0d72a8 req-98b2ad85-e281-4277-9750-134c37dc961e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:47.645995 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-961ba821-10a5-48a4-a693-7d3ceb0d72a8 req-98b2ad85-e281-4277-9750-134c37dc961e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:47.680324 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-961ba821-10a5-48a4-a693-7d3ceb0d72a8 req-98b2ad85-e281-4277-9750-134c37dc961e service nova] Creating event network-changed:92e3c39d-5eff-4b35-945a-25de4f5dce4b for instance 9ea94c91-140c-428c-8831-03efc8c571f6 on nch1-master-1 Apr 16 21:12:47.688649 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-934d6d37-d434-437a-b8f5-fbddd6499fe6 tempest-TenantUsagesTestJSON-2115196932 tempest-TenantUsagesTestJSON-2115196932-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:47.689337 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-934d6d37-d434-437a-b8f5-fbddd6499fe6 tempest-TenantUsagesTestJSON-2115196932 tempest-TenantUsagesTestJSON-2115196932-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:47.696016 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-961ba821-10a5-48a4-a693-7d3ceb0d72a8 req-98b2ad85-e281-4277-9750-134c37dc961e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086474 Apr 16 21:12:47.697348 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 818/1687] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:12:47.713263 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-934d6d37-d434-437a-b8f5-fbddd6499fe6 tempest-TenantUsagesTestJSON-2115196932 tempest-TenantUsagesTestJSON-2115196932-project-admin] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage/1bc88cb7a1504053928ac23280b2b6a3?start=2022-04-15T21%3A12%3A46.840982&end=2022-04-17T21%3A12%3A46.840982" status: 200 len: 695 microversion: 2.1 time: 0.287093 Apr 16 21:12:47.719221 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 870/1688] 10.222.0.20 () {58 vars in 1411 bytes} [Sat Apr 16 21:12:47 2022] GET /compute/v2.1/os-simple-tenant-usage/1bc88cb7a1504053928ac23280b2b6a3?start=2022-04-15T21%3A12%3A46.840982&end=2022-04-17T21%3A12%3A46.840982 => generated 695 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:12:47.729259 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-60730121-9584-46c1-9818-45e743c33485 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Calling method '.version_select at 0x7fbb9ff730d0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:47.742010 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-60730121-9584-46c1-9818-45e743c33485 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:47.742513 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-60730121-9584-46c1-9818-45e743c33485 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:47.773228 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-60730121-9584-46c1-9818-45e743c33485 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:47.774022 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-60730121-9584-46c1-9818-45e743c33485 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:47.806150 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-60730121-9584-46c1-9818-45e743c33485 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage/1bc88cb7a1504053928ac23280b2b6a3?start=2022-04-15T21%3A12%3A46.840982&end=2022-04-17T21%3A12%3A46.840982" status: 200 len: 695 microversion: 2.1 time: 0.081437 Apr 16 21:12:47.807452 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 819/1689] 10.222.0.20 () {58 vars in 1411 bytes} [Sat Apr 16 21:12:47 2022] GET /compute/v2.1/os-simple-tenant-usage/1bc88cb7a1504053928ac23280b2b6a3?start=2022-04-15T21%3A12%3A46.840982&end=2022-04-17T21%3A12%3A46.840982 => generated 695 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:12:47.821273 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-40da4cb8-f82c-47c2-813a-17ea43778f9f tempest-TenantUsagesTestJSON-2115196932 tempest-TenantUsagesTestJSON-2115196932-project-admin] Calling method '.version_select at 0x7fbb9ffebc10>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:47.831038 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40da4cb8-f82c-47c2-813a-17ea43778f9f tempest-TenantUsagesTestJSON-2115196932 tempest-TenantUsagesTestJSON-2115196932-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:47.832067 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40da4cb8-f82c-47c2-813a-17ea43778f9f tempest-TenantUsagesTestJSON-2115196932 tempest-TenantUsagesTestJSON-2115196932-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:47.861547 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40da4cb8-f82c-47c2-813a-17ea43778f9f tempest-TenantUsagesTestJSON-2115196932 tempest-TenantUsagesTestJSON-2115196932-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:47.862226 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40da4cb8-f82c-47c2-813a-17ea43778f9f tempest-TenantUsagesTestJSON-2115196932 tempest-TenantUsagesTestJSON-2115196932-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:47.957211 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-40da4cb8-f82c-47c2-813a-17ea43778f9f tempest-TenantUsagesTestJSON-2115196932 tempest-TenantUsagesTestJSON-2115196932-project-admin] 10.222.0.20 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-04-15T21%3A12%3A46.840982&end=2022-04-17T21%3A12%3A46.840982&detailed=1" status: 200 len: 19335 microversion: 2.1 time: 0.139581 Apr 16 21:12:47.958202 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 871/1690] 10.222.0.20 () {58 vars in 1334 bytes} [Sat Apr 16 21:12:47 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-04-15T21%3A12%3A46.840982&end=2022-04-17T21%3A12%3A46.840982&detailed=1 => generated 19335 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:12:47.989269 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f9bbb04b-076d-4381-a3cf-edf8ceb286ad tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:47.989269 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f9bbb04b-076d-4381-a3cf-edf8ceb286ad tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] [instance: 44880d34-adb1-4de6-ada6-dc4f7e4f0527] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:47.998930 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f9bbb04b-076d-4381-a3cf-edf8ceb286ad tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:47.999859 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f9bbb04b-076d-4381-a3cf-edf8ceb286ad tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:48.000941 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f9bbb04b-076d-4381-a3cf-edf8ceb286ad tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:48.003788 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f9bbb04b-076d-4381-a3cf-edf8ceb286ad tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:48.041264 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f9bbb04b-076d-4381-a3cf-edf8ceb286ad tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] [instance: 44880d34-adb1-4de6-ada6-dc4f7e4f0527] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:12:48.490289 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f9bbb04b-076d-4381-a3cf-edf8ceb286ad tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] 10.222.0.20 "DELETE /compute/v2.1/servers/44880d34-adb1-4de6-ada6-dc4f7e4f0527" status: 204 len: 0 microversion: 2.1 time: 0.509107 Apr 16 21:12:48.491178 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 820/1691] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:12:47 2022] DELETE /compute/v2.1/servers/44880d34-adb1-4de6-ada6-dc4f7e4f0527 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:12:48.499789 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a29c5f17-fe75-43fd-82e3-1dc77363507c tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:48.534120 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a29c5f17-fe75-43fd-82e3-1dc77363507c tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] [instance: 44880d34-adb1-4de6-ada6-dc4f7e4f0527] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:48.534120 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a29c5f17-fe75-43fd-82e3-1dc77363507c tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:48.534120 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a29c5f17-fe75-43fd-82e3-1dc77363507c tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:48.534120 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a29c5f17-fe75-43fd-82e3-1dc77363507c tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:48.535305 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a29c5f17-fe75-43fd-82e3-1dc77363507c tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:48.624276 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-111faefc-f721-4d85-9923-41dd85c98890 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:48.625327 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-111faefc-f721-4d85-9923-41dd85c98890 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9ea94c91-140c-428c-8831-03efc8c571f6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:48.633666 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-111faefc-f721-4d85-9923-41dd85c98890 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:48.634366 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-111faefc-f721-4d85-9923-41dd85c98890 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:48.635235 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-111faefc-f721-4d85-9923-41dd85c98890 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:48.635726 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-111faefc-f721-4d85-9923-41dd85c98890 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:48.744653 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a29c5f17-fe75-43fd-82e3-1dc77363507c tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb428513dc444a29288a38ca3e49a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc88cb7a1504053928ac23280b2b6a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:48.752580 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a29c5f17-fe75-43fd-82e3-1dc77363507c tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] 10.222.0.20 "GET /compute/v2.1/servers/44880d34-adb1-4de6-ada6-dc4f7e4f0527" status: 200 len: 1468 microversion: 2.1 time: 0.257208 Apr 16 21:12:48.761849 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 872/1692] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:48 2022] GET /compute/v2.1/servers/44880d34-adb1-4de6-ada6-dc4f7e4f0527 => generated 1468 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:48.806935 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-111faefc-f721-4d85-9923-41dd85c98890 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:48.817676 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-111faefc-f721-4d85-9923-41dd85c98890 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9ea94c91-140c-428c-8831-03efc8c571f6" status: 200 len: 1308 microversion: 2.1 time: 0.198280 Apr 16 21:12:48.819278 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 821/1693] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:48 2022] GET /compute/v2.1/servers/9ea94c91-140c-428c-8831-03efc8c571f6 => generated 1308 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:49.768846 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-581887d1-dfcd-45bc-955a-b1f3ffffd756 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:49.769462 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-581887d1-dfcd-45bc-955a-b1f3ffffd756 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] [instance: 44880d34-adb1-4de6-ada6-dc4f7e4f0527] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:49.777402 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-581887d1-dfcd-45bc-955a-b1f3ffffd756 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:49.778607 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-581887d1-dfcd-45bc-955a-b1f3ffffd756 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:49.779307 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-581887d1-dfcd-45bc-955a-b1f3ffffd756 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:49.780625 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-581887d1-dfcd-45bc-955a-b1f3ffffd756 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:49.835943 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c6d36c6e-bff6-4d98-8288-19b3d3f0d35a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:49.837192 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c6d36c6e-bff6-4d98-8288-19b3d3f0d35a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9ea94c91-140c-428c-8831-03efc8c571f6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:49.844822 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c6d36c6e-bff6-4d98-8288-19b3d3f0d35a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:49.845280 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c6d36c6e-bff6-4d98-8288-19b3d3f0d35a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:49.846274 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c6d36c6e-bff6-4d98-8288-19b3d3f0d35a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:49.846789 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c6d36c6e-bff6-4d98-8288-19b3d3f0d35a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:50.314165 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c6d36c6e-bff6-4d98-8288-19b3d3f0d35a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:50.321877 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c6d36c6e-bff6-4d98-8288-19b3d3f0d35a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9ea94c91-140c-428c-8831-03efc8c571f6" status: 200 len: 1308 microversion: 2.1 time: 0.490797 Apr 16 21:12:50.322472 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 822/1694] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:49 2022] GET /compute/v2.1/servers/9ea94c91-140c-428c-8831-03efc8c571f6 => generated 1308 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:50.618094 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-581887d1-dfcd-45bc-955a-b1f3ffffd756 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb428513dc444a29288a38ca3e49a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc88cb7a1504053928ac23280b2b6a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:50.628130 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-581887d1-dfcd-45bc-955a-b1f3ffffd756 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] 10.222.0.20 "GET /compute/v2.1/servers/44880d34-adb1-4de6-ada6-dc4f7e4f0527" status: 200 len: 1468 microversion: 2.1 time: 0.863512 Apr 16 21:12:50.630642 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 873/1695] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:49 2022] GET /compute/v2.1/servers/44880d34-adb1-4de6-ada6-dc4f7e4f0527 => generated 1468 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:51.338961 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-51aeb289-9b22-41af-a51b-46a908a7fb21 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:51.339582 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-51aeb289-9b22-41af-a51b-46a908a7fb21 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9ea94c91-140c-428c-8831-03efc8c571f6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:51.348013 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-51aeb289-9b22-41af-a51b-46a908a7fb21 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:51.356749 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-51aeb289-9b22-41af-a51b-46a908a7fb21 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:51.356749 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-51aeb289-9b22-41af-a51b-46a908a7fb21 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:51.356749 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-51aeb289-9b22-41af-a51b-46a908a7fb21 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:51.621124 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-51aeb289-9b22-41af-a51b-46a908a7fb21 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:51.630444 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-51aeb289-9b22-41af-a51b-46a908a7fb21 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9ea94c91-140c-428c-8831-03efc8c571f6" status: 200 len: 1308 microversion: 2.1 time: 0.294208 Apr 16 21:12:51.631526 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 823/1696] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:51 2022] GET /compute/v2.1/servers/9ea94c91-140c-428c-8831-03efc8c571f6 => generated 1308 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:51.653699 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1ac7d8bd-00a9-4c40-a1c9-587d72e8afcf tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:51.655589 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1ac7d8bd-00a9-4c40-a1c9-587d72e8afcf tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] [instance: 44880d34-adb1-4de6-ada6-dc4f7e4f0527] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:51.674902 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1ac7d8bd-00a9-4c40-a1c9-587d72e8afcf tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:51.675669 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1ac7d8bd-00a9-4c40-a1c9-587d72e8afcf tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:51.676711 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1ac7d8bd-00a9-4c40-a1c9-587d72e8afcf tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:51.677350 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1ac7d8bd-00a9-4c40-a1c9-587d72e8afcf tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:51.905878 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1ac7d8bd-00a9-4c40-a1c9-587d72e8afcf tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bb428513dc444a29288a38ca3e49a6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1bc88cb7a1504053928ac23280b2b6a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:51.910405 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-f6830f4a-20ea-4d8b-bd62-ec252803c596 req-2753ccdf-8c47-4ee3-b62c-068e4217a045 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44880d34-adb1-4de6-ada6-dc4f7e4f0527", "name": "network-vif-deleted", "tag": "98e4611b-6394-423f-af47-8583fcc1b4f5"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:12:51.919839 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1ac7d8bd-00a9-4c40-a1c9-587d72e8afcf tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] 10.222.0.20 "GET /compute/v2.1/servers/44880d34-adb1-4de6-ada6-dc4f7e4f0527" status: 200 len: 1426 microversion: 2.1 time: 0.270612 Apr 16 21:12:51.924714 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-f6830f4a-20ea-4d8b-bd62-ec252803c596 req-2753ccdf-8c47-4ee3-b62c-068e4217a045 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:51.929849 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 874/1697] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:51 2022] GET /compute/v2.1/servers/44880d34-adb1-4de6-ada6-dc4f7e4f0527 => generated 1426 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:51.930462 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-f6830f4a-20ea-4d8b-bd62-ec252803c596 req-2753ccdf-8c47-4ee3-b62c-068e4217a045 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:51.963994 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-f6830f4a-20ea-4d8b-bd62-ec252803c596 req-2753ccdf-8c47-4ee3-b62c-068e4217a045 service nova] Creating event network-vif-deleted:98e4611b-6394-423f-af47-8583fcc1b4f5 for instance 44880d34-adb1-4de6-ada6-dc4f7e4f0527 on nch2-master-1 Apr 16 21:12:52.005433 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-f6830f4a-20ea-4d8b-bd62-ec252803c596 req-2753ccdf-8c47-4ee3-b62c-068e4217a045 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105695 Apr 16 21:12:52.005979 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 824/1698] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:12:52.107116 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3d39dc7b-036a-40d7-9cad-ab196e62ffa3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1550230008", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f9e642b5-0144-4768-b572-192069e5751e"}], "security_groups": [{"name": "tempest-securitygroup--1069131242"}], "key_name": "tempest-keypair-1466075469", "user_data": "}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:12:52.228996 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-3d39dc7b-036a-40d7-9cad-ab196e62ffa3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] validate_networks() for [('f9e642b5-0144-4768-b572-192069e5751e', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:12:52.669684 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5a9bef60-89cd-4d6b-a0e0-cf39bb5073de tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:52.674755 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5a9bef60-89cd-4d6b-a0e0-cf39bb5073de tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9ea94c91-140c-428c-8831-03efc8c571f6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:52.692452 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5a9bef60-89cd-4d6b-a0e0-cf39bb5073de tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:52.693135 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5a9bef60-89cd-4d6b-a0e0-cf39bb5073de tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:52.694304 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5a9bef60-89cd-4d6b-a0e0-cf39bb5073de tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:52.695140 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5a9bef60-89cd-4d6b-a0e0-cf39bb5073de tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:52.934477 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5a9bef60-89cd-4d6b-a0e0-cf39bb5073de tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:52.943130 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5a9bef60-89cd-4d6b-a0e0-cf39bb5073de tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9ea94c91-140c-428c-8831-03efc8c571f6" status: 200 len: 1308 microversion: 2.1 time: 0.296357 Apr 16 21:12:52.944362 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 825/1699] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:52 2022] GET /compute/v2.1/servers/9ea94c91-140c-428c-8831-03efc8c571f6 => generated 1308 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:52.967165 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-19b9073c-496c-4515-a9dd-e8f079efda55 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:52.967786 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-19b9073c-496c-4515-a9dd-e8f079efda55 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] [instance: 44880d34-adb1-4de6-ada6-dc4f7e4f0527] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:52.975050 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-19b9073c-496c-4515-a9dd-e8f079efda55 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:52.975515 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-19b9073c-496c-4515-a9dd-e8f079efda55 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:52.976349 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-19b9073c-496c-4515-a9dd-e8f079efda55 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:52.976799 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-19b9073c-496c-4515-a9dd-e8f079efda55 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:52.998933 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-19b9073c-496c-4515-a9dd-e8f079efda55 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] HTTP exception thrown: Instance 44880d34-adb1-4de6-ada6-dc4f7e4f0527 could not be found. Apr 16 21:12:52.999734 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-19b9073c-496c-4515-a9dd-e8f079efda55 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] Returning 404 to user: Instance 44880d34-adb1-4de6-ada6-dc4f7e4f0527 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:12:53.000812 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-19b9073c-496c-4515-a9dd-e8f079efda55 tempest-TenantUsagesTestJSON-650938667 tempest-TenantUsagesTestJSON-650938667-project] 10.222.0.20 "GET /compute/v2.1/servers/44880d34-adb1-4de6-ada6-dc4f7e4f0527" status: 404 len: 111 microversion: 2.1 time: 0.043334 Apr 16 21:12:53.004928 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 826/1700] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:52 2022] GET /compute/v2.1/servers/44880d34-adb1-4de6-ada6-dc4f7e4f0527 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:12:53.040468 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-3d39dc7b-036a-40d7-9cad-ab196e62ffa3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:12:53.041883 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-3d39dc7b-036a-40d7-9cad-ab196e62ffa3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:12:53.042880 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-3d39dc7b-036a-40d7-9cad-ab196e62ffa3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:12:53.043710 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-3d39dc7b-036a-40d7-9cad-ab196e62ffa3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:12:53.045308 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-3d39dc7b-036a-40d7-9cad-ab196e62ffa3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:12:53.057459 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d39dc7b-036a-40d7-9cad-ab196e62ffa3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:53.058033 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d39dc7b-036a-40d7-9cad-ab196e62ffa3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:53.059196 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d39dc7b-036a-40d7-9cad-ab196e62ffa3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:53.060056 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d39dc7b-036a-40d7-9cad-ab196e62ffa3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:53.079844 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-3d39dc7b-036a-40d7-9cad-ab196e62ffa3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Getting quotas for project ceac90e6c7024b4ea350bfa95e1b5249. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:12:53.086214 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-3d39dc7b-036a-40d7-9cad-ab196e62ffa3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Getting quotas for user 6bb1c0cdf6274f118ebbe97829ddad65 and project ceac90e6c7024b4ea350bfa95e1b5249. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:12:53.106273 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3d39dc7b-036a-40d7-9cad-ab196e62ffa3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:12:53.109400 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3d39dc7b-036a-40d7-9cad-ab196e62ffa3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:12:53.574276 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3d39dc7b-036a-40d7-9cad-ab196e62ffa3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.473332 Apr 16 21:12:53.579963 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 875/1701] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:12:52 2022] POST /compute/v2.1/servers => generated 409 bytes in 1480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:12:53.585031 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a3202269-ad8c-47eb-8319-7d493fec0464 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:53.586349 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a3202269-ad8c-47eb-8319-7d493fec0464 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:53.650504 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a3202269-ad8c-47eb-8319-7d493fec0464 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:53.660223 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a3202269-ad8c-47eb-8319-7d493fec0464 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1239 microversion: 2.1 time: 0.078669 Apr 16 21:12:53.661170 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 827/1702] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:53 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1239 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:12:53.868597 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-cff16978-fae5-4652-8c4a-7c43449e6474 req-356e4ca5-77f6-4ef1-9e8d-59fa1b55a3cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ea94c91-140c-428c-8831-03efc8c571f6", "name": "network-vif-plugged", "status": "completed", "tag": "92e3c39d-5eff-4b35-945a-25de4f5dce4b"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:12:53.878491 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-cff16978-fae5-4652-8c4a-7c43449e6474 req-356e4ca5-77f6-4ef1-9e8d-59fa1b55a3cf service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:53.878944 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-cff16978-fae5-4652-8c4a-7c43449e6474 req-356e4ca5-77f6-4ef1-9e8d-59fa1b55a3cf service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:53.897377 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-cff16978-fae5-4652-8c4a-7c43449e6474 req-356e4ca5-77f6-4ef1-9e8d-59fa1b55a3cf service nova] Creating event network-vif-plugged:92e3c39d-5eff-4b35-945a-25de4f5dce4b for instance 9ea94c91-140c-428c-8831-03efc8c571f6 on nch1-master-1 Apr 16 21:12:53.912327 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-cff16978-fae5-4652-8c4a-7c43449e6474 req-356e4ca5-77f6-4ef1-9e8d-59fa1b55a3cf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041381 Apr 16 21:12:53.912327 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 876/1703] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:12:53.962240 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a392ba89-bbe0-447a-91cb-8b1e7fdac2f4 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:53.962943 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a392ba89-bbe0-447a-91cb-8b1e7fdac2f4 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9ea94c91-140c-428c-8831-03efc8c571f6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:53.973701 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a392ba89-bbe0-447a-91cb-8b1e7fdac2f4 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:53.974214 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a392ba89-bbe0-447a-91cb-8b1e7fdac2f4 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:53.975296 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a392ba89-bbe0-447a-91cb-8b1e7fdac2f4 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:53.975746 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a392ba89-bbe0-447a-91cb-8b1e7fdac2f4 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:54.253201 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a392ba89-bbe0-447a-91cb-8b1e7fdac2f4 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:54.260929 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a392ba89-bbe0-447a-91cb-8b1e7fdac2f4 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9ea94c91-140c-428c-8831-03efc8c571f6" status: 200 len: 1308 microversion: 2.1 time: 0.303303 Apr 16 21:12:54.262043 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 828/1704] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:53 2022] GET /compute/v2.1/servers/9ea94c91-140c-428c-8831-03efc8c571f6 => generated 1308 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:54.678459 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-750698bc-4840-4013-82fb-3a5bfff4fd30 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:54.679480 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-750698bc-4840-4013-82fb-3a5bfff4fd30 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:54.757664 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-750698bc-4840-4013-82fb-3a5bfff4fd30 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:54.764326 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-750698bc-4840-4013-82fb-3a5bfff4fd30 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1239 microversion: 2.1 time: 0.091017 Apr 16 21:12:54.764893 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 877/1705] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:54 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1239 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:55.278571 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-339a521e-f58e-4c33-9395-76a08d3920c6 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:55.279261 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-339a521e-f58e-4c33-9395-76a08d3920c6 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9ea94c91-140c-428c-8831-03efc8c571f6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:55.287393 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-339a521e-f58e-4c33-9395-76a08d3920c6 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:55.288067 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-339a521e-f58e-4c33-9395-76a08d3920c6 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:55.288942 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-339a521e-f58e-4c33-9395-76a08d3920c6 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:55.289355 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-339a521e-f58e-4c33-9395-76a08d3920c6 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:55.484229 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-339a521e-f58e-4c33-9395-76a08d3920c6 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:55.492108 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-339a521e-f58e-4c33-9395-76a08d3920c6 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9ea94c91-140c-428c-8831-03efc8c571f6" status: 200 len: 1308 microversion: 2.1 time: 0.217610 Apr 16 21:12:55.502775 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 829/1706] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:55 2022] GET /compute/v2.1/servers/9ea94c91-140c-428c-8831-03efc8c571f6 => generated 1308 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:55.541316 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5a90535a-ab0a-42c5-b1d1-427cc44a8e5f tempest-SecurityGroupsNegativeTestJSON-354880518 tempest-SecurityGroupsNegativeTestJSON-354880518-project] Calling method '.version_select at 0x7fbba000f040>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:55.563532 ncdv-master-1 devstack@n-api.service[137408]: DEBUG neutronclient.v2_0.client [None req-5a90535a-ab0a-42c5-b1d1-427cc44a8e5f tempest-SecurityGroupsNegativeTestJSON-354880518 tempest-SecurityGroupsNegativeTestJSON-354880518-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c4ed2ac6-5c60-426b-b0ef-3ac005ea81eb does not exist", "detail": ""}} {{(pid=137408) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 16 21:12:55.564289 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.security_group_api [None req-5a90535a-ab0a-42c5-b1d1-427cc44a8e5f tempest-SecurityGroupsNegativeTestJSON-354880518 tempest-SecurityGroupsNegativeTestJSON-354880518-project] Neutron security group c4ed2ac6-5c60-426b-b0ef-3ac005ea81eb not found {{(pid=137408) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 16 21:12:55.564830 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-5a90535a-ab0a-42c5-b1d1-427cc44a8e5f tempest-SecurityGroupsNegativeTestJSON-354880518 tempest-SecurityGroupsNegativeTestJSON-354880518-project] HTTP exception thrown: Security group c4ed2ac6-5c60-426b-b0ef-3ac005ea81eb does not exist Apr 16 21:12:55.564830 ncdv-master-1 devstack@n-api.service[137408]: Neutron server returns request_ids: ['req-15e129fd-a008-4a96-b297-3dea4fed7868'] Apr 16 21:12:55.565430 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5a90535a-ab0a-42c5-b1d1-427cc44a8e5f tempest-SecurityGroupsNegativeTestJSON-354880518 tempest-SecurityGroupsNegativeTestJSON-354880518-project] Returning 404 to user: Security group c4ed2ac6-5c60-426b-b0ef-3ac005ea81eb does not exist Apr 16 21:12:55.565430 ncdv-master-1 devstack@n-api.service[137408]: Neutron server returns request_ids: ['req-15e129fd-a008-4a96-b297-3dea4fed7868'] {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:12:55.566270 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5a90535a-ab0a-42c5-b1d1-427cc44a8e5f tempest-SecurityGroupsNegativeTestJSON-354880518 tempest-SecurityGroupsNegativeTestJSON-354880518-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/c4ed2ac6-5c60-426b-b0ef-3ac005ea81eb" status: 404 len: 194 microversion: 2.1 time: 0.288738 Apr 16 21:12:55.566858 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 878/1707] 10.222.0.20 () {58 vars in 1271 bytes} [Sat Apr 16 21:12:55 2022] DELETE /compute/v2.1/os-security-groups/c4ed2ac6-5c60-426b-b0ef-3ac005ea81eb => generated 194 bytes in 290 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:12:55.576376 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8c5eaf95-4dcc-4b9d-ac13-c514a7a20e74 tempest-SecurityGroupsNegativeTestJSON-354880518 tempest-SecurityGroupsNegativeTestJSON-354880518-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.003844 Apr 16 21:12:55.578414 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 830/1708] 10.222.0.20 () {58 vars in 1163 bytes} [Sat Apr 16 21:12:55 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 16 21:12:55.587120 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f065186a-8ec5-47b2-b2fe-b5cb52b7464f tempest-SecurityGroupsNegativeTestJSON-354880518 tempest-SecurityGroupsNegativeTestJSON-354880518-project] Calling method '.version_select at 0x7fbba000f040>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:55.753316 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f065186a-8ec5-47b2-b2fe-b5cb52b7464f tempest-SecurityGroupsNegativeTestJSON-354880518 tempest-SecurityGroupsNegativeTestJSON-354880518-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.171262 Apr 16 21:12:55.753945 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 879/1709] 10.222.0.20 () {58 vars in 1157 bytes} [Sat Apr 16 21:12:55 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:12:55.765545 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6a1969eb-5de7-4faa-9597-f7abaa718b15 tempest-SecurityGroupsNegativeTestJSON-354880518 tempest-SecurityGroupsNegativeTestJSON-354880518-project] Calling method '.version_select at 0x7fbb9ffa14c0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:55.783591 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3fcf6079-38d7-4e99-a740-617367def87a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:55.792366 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3fcf6079-38d7-4e99-a740-617367def87a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:55.814143 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3fcf6079-38d7-4e99-a740-617367def87a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:55.814686 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3fcf6079-38d7-4e99-a740-617367def87a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:55.815530 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3fcf6079-38d7-4e99-a740-617367def87a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:55.816264 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3fcf6079-38d7-4e99-a740-617367def87a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:55.887104 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3fcf6079-38d7-4e99-a740-617367def87a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:55.895193 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3fcf6079-38d7-4e99-a740-617367def87a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1235 microversion: 2.1 time: 0.117967 Apr 16 21:12:55.895767 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 880/1710] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:55 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1235 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:55.899357 ncdv-master-1 devstack@n-api.service[137409]: DEBUG neutronclient.v2_0.client [None req-6a1969eb-5de7-4faa-9597-f7abaa718b15 tempest-SecurityGroupsNegativeTestJSON-354880518 tempest-SecurityGroupsNegativeTestJSON-354880518-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=137409) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 16 21:12:55.900495 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-6a1969eb-5de7-4faa-9597-f7abaa718b15 tempest-SecurityGroupsNegativeTestJSON-354880518 tempest-SecurityGroupsNegativeTestJSON-354880518-project] HTTP exception thrown: Insufficient rights for removing default security group. Apr 16 21:12:55.900495 ncdv-master-1 devstack@n-api.service[137409]: Neutron server returns request_ids: ['req-d64e1669-3d47-4d61-8f02-20a5ca66d195'] Apr 16 21:12:55.901100 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6a1969eb-5de7-4faa-9597-f7abaa718b15 tempest-SecurityGroupsNegativeTestJSON-354880518 tempest-SecurityGroupsNegativeTestJSON-354880518-project] Returning 400 to user: Insufficient rights for removing default security group. Apr 16 21:12:55.901100 ncdv-master-1 devstack@n-api.service[137409]: Neutron server returns request_ids: ['req-d64e1669-3d47-4d61-8f02-20a5ca66d195'] {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:12:55.902120 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6a1969eb-5de7-4faa-9597-f7abaa718b15 tempest-SecurityGroupsNegativeTestJSON-354880518 tempest-SecurityGroupsNegativeTestJSON-354880518-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/052cbe43-1107-403a-b2d1-a1ad566d297f" status: 400 len: 182 microversion: 2.1 time: 0.140579 Apr 16 21:12:55.902714 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 831/1711] 10.222.0.20 () {58 vars in 1271 bytes} [Sat Apr 16 21:12:55 2022] DELETE /compute/v2.1/os-security-groups/052cbe43-1107-403a-b2d1-a1ad566d297f => generated 182 bytes in 142 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:12:55.923669 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fabe722c-92a5-438d-b3d0-2bdc4ed8f751 tempest-SecurityGroupsNegativeTestJSON-354880518 tempest-SecurityGroupsNegativeTestJSON-354880518-project] Calling method '.version_select at 0x7fbba000f0d0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:55.945319 ncdv-master-1 devstack@n-api.service[137408]: DEBUG neutronclient.v2_0.client [None req-fabe722c-92a5-438d-b3d0-2bdc4ed8f751 tempest-SecurityGroupsNegativeTestJSON-354880518 tempest-SecurityGroupsNegativeTestJSON-354880518-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3bf4a341-9224-41bd-ac00-6f5eeab1888a does not exist", "detail": ""}} {{(pid=137408) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 16 21:12:55.945952 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.security_group_api [None req-fabe722c-92a5-438d-b3d0-2bdc4ed8f751 tempest-SecurityGroupsNegativeTestJSON-354880518 tempest-SecurityGroupsNegativeTestJSON-354880518-project] Neutron security group 3bf4a341-9224-41bd-ac00-6f5eeab1888a not found {{(pid=137408) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 16 21:12:55.946482 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-fabe722c-92a5-438d-b3d0-2bdc4ed8f751 tempest-SecurityGroupsNegativeTestJSON-354880518 tempest-SecurityGroupsNegativeTestJSON-354880518-project] HTTP exception thrown: Security group 3bf4a341-9224-41bd-ac00-6f5eeab1888a does not exist Apr 16 21:12:55.946482 ncdv-master-1 devstack@n-api.service[137408]: Neutron server returns request_ids: ['req-4af4b78b-9ac7-4c14-be20-8993c47d52a1'] Apr 16 21:12:55.947077 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fabe722c-92a5-438d-b3d0-2bdc4ed8f751 tempest-SecurityGroupsNegativeTestJSON-354880518 tempest-SecurityGroupsNegativeTestJSON-354880518-project] Returning 404 to user: Security group 3bf4a341-9224-41bd-ac00-6f5eeab1888a does not exist Apr 16 21:12:55.947077 ncdv-master-1 devstack@n-api.service[137408]: Neutron server returns request_ids: ['req-4af4b78b-9ac7-4c14-be20-8993c47d52a1'] {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:12:55.947913 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fabe722c-92a5-438d-b3d0-2bdc4ed8f751 tempest-SecurityGroupsNegativeTestJSON-354880518 tempest-SecurityGroupsNegativeTestJSON-354880518-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/3bf4a341-9224-41bd-ac00-6f5eeab1888a" status: 404 len: 194 microversion: 2.1 time: 0.028786 Apr 16 21:12:55.948568 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 881/1712] 10.222.0.20 () {58 vars in 1268 bytes} [Sat Apr 16 21:12:55 2022] GET /compute/v2.1/os-security-groups/3bf4a341-9224-41bd-ac00-6f5eeab1888a => generated 194 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:12:55.958704 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-710b7b30-10af-4972-b9a8-89865b60b052 tempest-SecurityGroupsNegativeTestJSON-354880518 tempest-SecurityGroupsNegativeTestJSON-354880518-project] Action: 'update', calling method: .version_select at 0x7fbb9ffa1e50>, body: {"security_group": {"name": "tempest-sg-1088753371", "description": "tempest-description-657429491"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:12:55.987618 ncdv-master-1 devstack@n-api.service[137409]: DEBUG neutronclient.v2_0.client [None req-710b7b30-10af-4972-b9a8-89865b60b052 tempest-SecurityGroupsNegativeTestJSON-354880518 tempest-SecurityGroupsNegativeTestJSON-354880518-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d2e5478b-5dca-4914-be6f-473c5a3c3ec4 does not exist", "detail": ""}} {{(pid=137409) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 16 21:12:55.988396 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.security_group_api [None req-710b7b30-10af-4972-b9a8-89865b60b052 tempest-SecurityGroupsNegativeTestJSON-354880518 tempest-SecurityGroupsNegativeTestJSON-354880518-project] Neutron security group d2e5478b-5dca-4914-be6f-473c5a3c3ec4 not found {{(pid=137409) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 16 21:12:55.988927 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-710b7b30-10af-4972-b9a8-89865b60b052 tempest-SecurityGroupsNegativeTestJSON-354880518 tempest-SecurityGroupsNegativeTestJSON-354880518-project] HTTP exception thrown: Security group d2e5478b-5dca-4914-be6f-473c5a3c3ec4 does not exist Apr 16 21:12:55.988927 ncdv-master-1 devstack@n-api.service[137409]: Neutron server returns request_ids: ['req-902ceef9-ed9a-457c-94f9-b0be7f8bb3d6'] Apr 16 21:12:55.989521 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-710b7b30-10af-4972-b9a8-89865b60b052 tempest-SecurityGroupsNegativeTestJSON-354880518 tempest-SecurityGroupsNegativeTestJSON-354880518-project] Returning 404 to user: Security group d2e5478b-5dca-4914-be6f-473c5a3c3ec4 does not exist Apr 16 21:12:55.989521 ncdv-master-1 devstack@n-api.service[137409]: Neutron server returns request_ids: ['req-902ceef9-ed9a-457c-94f9-b0be7f8bb3d6'] {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:12:55.991073 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-710b7b30-10af-4972-b9a8-89865b60b052 tempest-SecurityGroupsNegativeTestJSON-354880518 tempest-SecurityGroupsNegativeTestJSON-354880518-project] 10.222.0.20 "PUT /compute/v2.1/os-security-groups/d2e5478b-5dca-4914-be6f-473c5a3c3ec4" status: 404 len: 194 microversion: 2.1 time: 0.036093 Apr 16 21:12:55.991668 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 832/1713] 10.222.0.20 () {60 vars in 1289 bytes} [Sat Apr 16 21:12:55 2022] PUT /compute/v2.1/os-security-groups/d2e5478b-5dca-4914-be6f-473c5a3c3ec4 => generated 194 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:12:56.511191 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-71e57e5c-407e-4de5-9606-73917e417bae tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:56.512487 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-71e57e5c-407e-4de5-9606-73917e417bae tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9ea94c91-140c-428c-8831-03efc8c571f6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:56.519455 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-71e57e5c-407e-4de5-9606-73917e417bae tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:56.519989 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-71e57e5c-407e-4de5-9606-73917e417bae tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:56.520908 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-71e57e5c-407e-4de5-9606-73917e417bae tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:56.521422 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-71e57e5c-407e-4de5-9606-73917e417bae tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:56.833965 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-71e57e5c-407e-4de5-9606-73917e417bae tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:56.842196 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-71e57e5c-407e-4de5-9606-73917e417bae tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9ea94c91-140c-428c-8831-03efc8c571f6" status: 200 len: 1487 microversion: 2.1 time: 0.335945 Apr 16 21:12:56.843093 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 882/1714] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:56 2022] GET /compute/v2.1/servers/9ea94c91-140c-428c-8831-03efc8c571f6 => generated 1487 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:56.861046 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5bf17b1d-b292-4888-b6a9-82c11496145f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:12:56.862195 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5bf17b1d-b292-4888-b6a9-82c11496145f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9ea94c91-140c-428c-8831-03efc8c571f6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:56.870338 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5bf17b1d-b292-4888-b6a9-82c11496145f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:56.871478 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5bf17b1d-b292-4888-b6a9-82c11496145f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:56.872682 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5bf17b1d-b292-4888-b6a9-82c11496145f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:56.874042 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5bf17b1d-b292-4888-b6a9-82c11496145f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:56.914545 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b9c43467-5641-4465-b5f9-ab6c3b8f4951 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:56.921511 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b9c43467-5641-4465-b5f9-ab6c3b8f4951 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:56.925361 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b9c43467-5641-4465-b5f9-ab6c3b8f4951 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:56.926459 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b9c43467-5641-4465-b5f9-ab6c3b8f4951 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:56.927714 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b9c43467-5641-4465-b5f9-ab6c3b8f4951 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:56.928538 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b9c43467-5641-4465-b5f9-ab6c3b8f4951 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:57.047420 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b9c43467-5641-4465-b5f9-ab6c3b8f4951 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:57.062572 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b9c43467-5641-4465-b5f9-ab6c3b8f4951 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1309 microversion: 2.1 time: 0.153073 Apr 16 21:12:57.073171 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 883/1715] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:56 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1309 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:12:57.079776 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-68929ba6-d6b8-4fa7-b226-756aadfa6402 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1062985914", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "341a7a54-447f-4bb3-9bb9-2193e32a0929"}], "block_device_mapping_v2": [{"uuid": "548a92a5-efad-482f-97c9-7684e6c4b453", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:12:57.142714 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-68929ba6-d6b8-4fa7-b226-756aadfa6402 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] validate_networks() for [('341a7a54-447f-4bb3-9bb9-2193e32a0929', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:12:57.244131 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5bf17b1d-b292-4888-b6a9-82c11496145f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "POST /compute/v2.1/servers/9ea94c91-140c-428c-8831-03efc8c571f6/action" status: 202 len: 0 microversion: 2.1 time: 0.388636 Apr 16 21:12:57.249016 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 833/1716] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:12:56 2022] POST /compute/v2.1/servers/9ea94c91-140c-428c-8831-03efc8c571f6/action => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:12:57.260315 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-849d8f82-f7d0-45df-bec5-9d8e913eca04 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:57.264601 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-849d8f82-f7d0-45df-bec5-9d8e913eca04 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9ea94c91-140c-428c-8831-03efc8c571f6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:57.271123 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-849d8f82-f7d0-45df-bec5-9d8e913eca04 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:57.272487 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-849d8f82-f7d0-45df-bec5-9d8e913eca04 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:57.274291 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-849d8f82-f7d0-45df-bec5-9d8e913eca04 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:57.274892 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-849d8f82-f7d0-45df-bec5-9d8e913eca04 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:57.416431 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-849d8f82-f7d0-45df-bec5-9d8e913eca04 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:57.433502 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-849d8f82-f7d0-45df-bec5-9d8e913eca04 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9ea94c91-140c-428c-8831-03efc8c571f6" status: 200 len: 1492 microversion: 2.1 time: 0.167848 Apr 16 21:12:57.433502 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 834/1717] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:57 2022] GET /compute/v2.1/servers/9ea94c91-140c-428c-8831-03efc8c571f6 => generated 1492 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:57.716266 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e1ce2400-f80c-4307-a60f-59df776e5208 tempest-FlavorsV2NegativeTest-1544759427 tempest-FlavorsV2NegativeTest-1544759427-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:57.724280 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e1ce2400-f80c-4307-a60f-59df776e5208 tempest-FlavorsV2NegativeTest-1544759427 tempest-FlavorsV2NegativeTest-1544759427-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.298548 Apr 16 21:12:57.724841 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 835/1718] 10.222.0.20 () {58 vars in 1136 bytes} [Sat Apr 16 21:12:57 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:12:57.766848 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-68929ba6-d6b8-4fa7-b226-756aadfa6402 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:12:57.767272 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-68929ba6-d6b8-4fa7-b226-756aadfa6402 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:12:57.767944 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-68929ba6-d6b8-4fa7-b226-756aadfa6402 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:12:57.768576 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-68929ba6-d6b8-4fa7-b226-756aadfa6402 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:12:57.769370 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-68929ba6-d6b8-4fa7-b226-756aadfa6402 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:12:57.779188 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-68929ba6-d6b8-4fa7-b226-756aadfa6402 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:57.779877 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-68929ba6-d6b8-4fa7-b226-756aadfa6402 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:57.781018 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-68929ba6-d6b8-4fa7-b226-756aadfa6402 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:57.781650 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-68929ba6-d6b8-4fa7-b226-756aadfa6402 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:57.809145 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-68929ba6-d6b8-4fa7-b226-756aadfa6402 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Getting quotas for project 68af3300a0d149adbbf934b4ff1f87d8. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:12:57.816072 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-68929ba6-d6b8-4fa7-b226-756aadfa6402 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Getting quotas for user 53d5464685cc40d9a1d891c6ae39a80f and project 68af3300a0d149adbbf934b4ff1f87d8. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:12:57.879086 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-68929ba6-d6b8-4fa7-b226-756aadfa6402 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:12:57.881191 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-68929ba6-d6b8-4fa7-b226-756aadfa6402 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d9673504-31ed-4a93-abbd-67a338294f1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='548a92a5-efad-482f-97c9-7684e6c4b453',volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:12:58.079991 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a5182c59-6553-4661-9707-b606a5a0a089 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:58.081478 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a5182c59-6553-4661-9707-b606a5a0a089 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:58.089557 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a5182c59-6553-4661-9707-b606a5a0a089 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:58.090133 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a5182c59-6553-4661-9707-b606a5a0a089 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:58.092064 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a5182c59-6553-4661-9707-b606a5a0a089 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:58.092064 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a5182c59-6553-4661-9707-b606a5a0a089 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:58.325157 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a5182c59-6553-4661-9707-b606a5a0a089 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:58.335683 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a5182c59-6553-4661-9707-b606a5a0a089 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1365 microversion: 2.1 time: 0.260434 Apr 16 21:12:58.336647 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 836/1719] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:58 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1365 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:12:58.441183 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-56d2f1df-03fd-4189-95ff-d3b55c762515 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:58.441801 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-56d2f1df-03fd-4189-95ff-d3b55c762515 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9ea94c91-140c-428c-8831-03efc8c571f6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:58.450023 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-56d2f1df-03fd-4189-95ff-d3b55c762515 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:58.450486 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-56d2f1df-03fd-4189-95ff-d3b55c762515 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:58.451812 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-56d2f1df-03fd-4189-95ff-d3b55c762515 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:58.452289 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-56d2f1df-03fd-4189-95ff-d3b55c762515 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:58.500051 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-68929ba6-d6b8-4fa7-b226-756aadfa6402 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 1.411027 Apr 16 21:12:58.502279 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 884/1720] 10.222.0.20 () {62 vars in 1187 bytes} [Sat Apr 16 21:12:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1428 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 16 21:12:58.515388 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d79feae8-f3ac-44eb-b5eb-7eb0dbb69c9e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:58.516324 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d79feae8-f3ac-44eb-b5eb-7eb0dbb69c9e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d9673504-31ed-4a93-abbd-67a338294f1f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:58.598924 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d79feae8-f3ac-44eb-b5eb-7eb0dbb69c9e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:58.606551 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d79feae8-f3ac-44eb-b5eb-7eb0dbb69c9e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:58.617354 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d79feae8-f3ac-44eb-b5eb-7eb0dbb69c9e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:58.618547 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d79feae8-f3ac-44eb-b5eb-7eb0dbb69c9e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f" status: 200 len: 1104 microversion: 2.25 time: 0.109793 Apr 16 21:12:58.619129 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 885/1721] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:12:58 2022] GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f => generated 1104 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:12:58.643764 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-56d2f1df-03fd-4189-95ff-d3b55c762515 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:58.652936 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-56d2f1df-03fd-4189-95ff-d3b55c762515 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9ea94c91-140c-428c-8831-03efc8c571f6" status: 200 len: 1472 microversion: 2.1 time: 0.215680 Apr 16 21:12:58.653915 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 837/1722] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:58 2022] GET /compute/v2.1/servers/9ea94c91-140c-428c-8831-03efc8c571f6 => generated 1472 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:12:58.672395 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ea8c64b8-d7c2-45e5-8cbd-d5035d8d731a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1657108113"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:12:58.674015 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ea8c64b8-d7c2-45e5-8cbd-d5035d8d731a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9ea94c91-140c-428c-8831-03efc8c571f6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:58.681040 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ea8c64b8-d7c2-45e5-8cbd-d5035d8d731a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:58.681550 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ea8c64b8-d7c2-45e5-8cbd-d5035d8d731a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:58.682337 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ea8c64b8-d7c2-45e5-8cbd-d5035d8d731a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:58.683299 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ea8c64b8-d7c2-45e5-8cbd-d5035d8d731a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:59.062425 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-aaeee39c-5613-4e57-84f3-a114ce692a67 tempest-FlavorsV2NegativeTest-1544759427 tempest-FlavorsV2NegativeTest-1544759427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-899947198", "imageRef": "c03628ad-d856-426f-bc27-43af2f78279b", "flavorRef": "452"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:12:59.178492 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-aaeee39c-5613-4e57-84f3-a114ce692a67 tempest-FlavorsV2NegativeTest-1544759427 tempest-FlavorsV2NegativeTest-1544759427-project] validate_networks() for None {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:12:59.343958 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ea8c64b8-d7c2-45e5-8cbd-d5035d8d731a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "POST /compute/v2.1/servers/9ea94c91-140c-428c-8831-03efc8c571f6/action" status: 202 len: 0 microversion: 2.1 time: 0.676666 Apr 16 21:12:59.345240 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 886/1723] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:12:58 2022] POST /compute/v2.1/servers/9ea94c91-140c-428c-8831-03efc8c571f6/action => generated 0 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 16 21:12:59.363032 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-074c6e92-1432-4537-aee5-5a03726ef94e req-8e806964-98c2-45a5-86fe-fe4fc081bd9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98ca4f4e-246a-449b-b9fd-e1c17e119faa", "tag": "9bc5b971-3aa6-49d0-8b96-ab0e7cb12588"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:12:59.383559 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-074c6e92-1432-4537-aee5-5a03726ef94e req-8e806964-98c2-45a5-86fe-fe4fc081bd9c service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:59.384087 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-074c6e92-1432-4537-aee5-5a03726ef94e req-8e806964-98c2-45a5-86fe-fe4fc081bd9c service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:59.396930 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-074c6e92-1432-4537-aee5-5a03726ef94e req-8e806964-98c2-45a5-86fe-fe4fc081bd9c service nova] Creating event network-changed:9bc5b971-3aa6-49d0-8b96-ab0e7cb12588 for instance 98ca4f4e-246a-449b-b9fd-e1c17e119faa on nch2-master-1 Apr 16 21:12:59.402141 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-074c6e92-1432-4537-aee5-5a03726ef94e req-8e806964-98c2-45a5-86fe-fe4fc081bd9c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052386 Apr 16 21:12:59.406752 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 887/1724] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:12:59.418932 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-551e73cc-af43-4e99-b06e-26f547b25aca tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbba00965e0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:59.471102 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-551e73cc-af43-4e99-b06e-26f547b25aca tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/d631a0d5-6e5b-4edc-b753-706449e6c1ef" status: 200 len: 1412 microversion: 2.1 time: 0.065118 Apr 16 21:12:59.471102 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 888/1725] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:12:59 2022] GET /compute/v2.1/images/d631a0d5-6e5b-4edc-b753-706449e6c1ef => generated 1412 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:12:59.475017 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2df424b8-0c8b-433c-90cc-339c7e394978 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:59.476350 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2df424b8-0c8b-433c-90cc-339c7e394978 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:59.483308 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2df424b8-0c8b-433c-90cc-339c7e394978 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:59.483844 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2df424b8-0c8b-433c-90cc-339c7e394978 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:59.484759 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2df424b8-0c8b-433c-90cc-339c7e394978 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:12:59.485209 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2df424b8-0c8b-433c-90cc-339c7e394978 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:12:59.538630 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-aaeee39c-5613-4e57-84f3-a114ce692a67 tempest-FlavorsV2NegativeTest-1544759427 tempest-FlavorsV2NegativeTest-1544759427-project] HTTP exception thrown: Flavor's memory is too small for requested image. Apr 16 21:12:59.539598 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-aaeee39c-5613-4e57-84f3-a114ce692a67 tempest-FlavorsV2NegativeTest-1544759427 tempest-FlavorsV2NegativeTest-1544759427-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:12:59.540782 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-aaeee39c-5613-4e57-84f3-a114ce692a67 tempest-FlavorsV2NegativeTest-1544759427 tempest-FlavorsV2NegativeTest-1544759427-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.483472 Apr 16 21:12:59.541343 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 838/1726] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:12:59 2022] POST /compute/v2.1/servers => generated 93 bytes in 485 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Apr 16 21:12:59.637769 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-09de116b-e7e1-440b-8cb8-8e639a70cd20 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:12:59.638252 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-09de116b-e7e1-440b-8cb8-8e639a70cd20 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d9673504-31ed-4a93-abbd-67a338294f1f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:12:59.708202 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-09de116b-e7e1-440b-8cb8-8e639a70cd20 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:59.716598 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-09de116b-e7e1-440b-8cb8-8e639a70cd20 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:59.719136 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-09de116b-e7e1-440b-8cb8-8e639a70cd20 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:59.720363 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-09de116b-e7e1-440b-8cb8-8e639a70cd20 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f" status: 200 len: 1104 microversion: 2.25 time: 0.086601 Apr 16 21:12:59.721181 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 839/1727] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:12:59 2022] GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f => generated 1104 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:12:59.794321 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2df424b8-0c8b-433c-90cc-339c7e394978 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:12:59.821024 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2df424b8-0c8b-433c-90cc-339c7e394978 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1365 microversion: 2.1 time: 0.345567 Apr 16 21:12:59.823589 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 889/1728] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:12:59 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1365 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:00.491141 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ed5371ad-218e-40d1-b59c-058290e276de tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb961f61f0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:00.554144 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ed5371ad-218e-40d1-b59c-058290e276de tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/d631a0d5-6e5b-4edc-b753-706449e6c1ef" status: 200 len: 1412 microversion: 2.1 time: 0.074449 Apr 16 21:13:00.554710 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 840/1729] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:13:00 2022] GET /compute/v2.1/images/d631a0d5-6e5b-4edc-b753-706449e6c1ef => generated 1412 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:13:00.739708 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-616a78ae-5702-4226-bad5-ebc770fe2e9c tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:00.740416 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-616a78ae-5702-4226-bad5-ebc770fe2e9c tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d9673504-31ed-4a93-abbd-67a338294f1f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:00.751104 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-616a78ae-5702-4226-bad5-ebc770fe2e9c tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:00.752829 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-616a78ae-5702-4226-bad5-ebc770fe2e9c tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:00.754348 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-616a78ae-5702-4226-bad5-ebc770fe2e9c tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:00.755402 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-616a78ae-5702-4226-bad5-ebc770fe2e9c tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:00.828722 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-616a78ae-5702-4226-bad5-ebc770fe2e9c tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:00.836979 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-616a78ae-5702-4226-bad5-ebc770fe2e9c tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:00.839013 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-616a78ae-5702-4226-bad5-ebc770fe2e9c tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:00.840152 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-616a78ae-5702-4226-bad5-ebc770fe2e9c tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f" status: 200 len: 1233 microversion: 2.25 time: 0.104646 Apr 16 21:13:00.840476 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7099055c-47d3-4ac0-a3c3-073fa7a1ef0a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:00.840862 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 890/1730] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:13:00 2022] GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f => generated 1233 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:13:00.841244 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7099055c-47d3-4ac0-a3c3-073fa7a1ef0a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:00.847607 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7099055c-47d3-4ac0-a3c3-073fa7a1ef0a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:00.848236 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7099055c-47d3-4ac0-a3c3-073fa7a1ef0a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:00.849153 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7099055c-47d3-4ac0-a3c3-073fa7a1ef0a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:00.849602 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7099055c-47d3-4ac0-a3c3-073fa7a1ef0a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:01.040663 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7099055c-47d3-4ac0-a3c3-073fa7a1ef0a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:01.049682 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7099055c-47d3-4ac0-a3c3-073fa7a1ef0a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1365 microversion: 2.1 time: 0.213205 Apr 16 21:13:01.050348 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 841/1731] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:00 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1365 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:13:01.570669 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d14d4ce1-783e-4efe-860b-032b7248a43d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbba001daf0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:01.626316 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d14d4ce1-783e-4efe-860b-032b7248a43d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/d631a0d5-6e5b-4edc-b753-706449e6c1ef" status: 200 len: 1412 microversion: 2.1 time: 0.063185 Apr 16 21:13:01.632762 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 891/1732] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:13:01 2022] GET /compute/v2.1/images/d631a0d5-6e5b-4edc-b753-706449e6c1ef => generated 1412 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:01.860125 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-dc348c9d-6ff4-460b-a695-5b9849319d29 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:01.863431 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-dc348c9d-6ff4-460b-a695-5b9849319d29 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d9673504-31ed-4a93-abbd-67a338294f1f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:01.869630 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dc348c9d-6ff4-460b-a695-5b9849319d29 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:01.870147 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dc348c9d-6ff4-460b-a695-5b9849319d29 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:01.870943 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dc348c9d-6ff4-460b-a695-5b9849319d29 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:01.871391 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dc348c9d-6ff4-460b-a695-5b9849319d29 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:01.947897 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-dc348c9d-6ff4-460b-a695-5b9849319d29 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:01.957332 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-dc348c9d-6ff4-460b-a695-5b9849319d29 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:01.958865 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-dc348c9d-6ff4-460b-a695-5b9849319d29 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:01.960424 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-dc348c9d-6ff4-460b-a695-5b9849319d29 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f" status: 200 len: 1233 microversion: 2.25 time: 0.104534 Apr 16 21:13:01.971002 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 842/1733] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:13:01 2022] GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f => generated 1233 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:13:02.067498 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fa889c2d-145f-461c-b439-67936d0fbfe4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:02.069287 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fa889c2d-145f-461c-b439-67936d0fbfe4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:02.081616 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fa889c2d-145f-461c-b439-67936d0fbfe4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:02.082078 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fa889c2d-145f-461c-b439-67936d0fbfe4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:02.082870 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fa889c2d-145f-461c-b439-67936d0fbfe4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:02.083317 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fa889c2d-145f-461c-b439-67936d0fbfe4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:02.353542 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fa889c2d-145f-461c-b439-67936d0fbfe4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:02.361078 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fa889c2d-145f-461c-b439-67936d0fbfe4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1365 microversion: 2.1 time: 0.298383 Apr 16 21:13:02.361646 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 892/1734] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:02 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1365 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:02.640201 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0eb38a06-f11e-478e-b8a6-42597e3d7412 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbba001daf0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:02.723423 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0eb38a06-f11e-478e-b8a6-42597e3d7412 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/d631a0d5-6e5b-4edc-b753-706449e6c1ef" status: 200 len: 1412 microversion: 2.1 time: 0.087550 Apr 16 21:13:02.724306 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 893/1735] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:13:02 2022] GET /compute/v2.1/images/d631a0d5-6e5b-4edc-b753-706449e6c1ef => generated 1412 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:02.765906 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b09c95ad-83ec-4b1c-846b-3d83367d4a6a tempest-ListImagesTestJSON-1095729137 tempest-ListImagesTestJSON-1095729137-project] Calling method '.version_select at 0x7fbb961f6d30>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:02.811186 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b09c95ad-83ec-4b1c-846b-3d83367d4a6a tempest-ListImagesTestJSON-1095729137 tempest-ListImagesTestJSON-1095729137-project] 10.222.0.20 "GET /compute/v2.1/images/88bbe9a7-19d2-4102-9634-058b7c590848" status: 200 len: 784 microversion: 2.1 time: 0.235609 Apr 16 21:13:02.811905 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 843/1736] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:13:02 2022] GET /compute/v2.1/images/88bbe9a7-19d2-4102-9634-058b7c590848 => generated 784 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:13:02.824701 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d91f5677-d157-42ee-b507-73ab70b434a4 tempest-ListImagesTestJSON-1095729137 tempest-ListImagesTestJSON-1095729137-project] Calling method '.version_select at 0x7fbba004a310>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:02.930335 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d91f5677-d157-42ee-b507-73ab70b434a4 tempest-ListImagesTestJSON-1095729137 tempest-ListImagesTestJSON-1095729137-project] 10.222.0.20 "GET /compute/v2.1/images" status: 200 len: 871 microversion: 2.1 time: 0.109420 Apr 16 21:13:02.937656 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 894/1737] 10.222.0.20 () {58 vars in 1121 bytes} [Sat Apr 16 21:13:02 2022] GET /compute/v2.1/images => generated 871 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:13:02.945889 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ed27fb7a-c76c-40fb-bf55-03e3b2367e99 tempest-ListImagesTestJSON-1095729137 tempest-ListImagesTestJSON-1095729137-project] Calling method '.version_select at 0x7fbb96252670>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:02.978339 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cdc82a52-587e-40bf-949b-e1f39b1c6c85 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:02.978963 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cdc82a52-587e-40bf-949b-e1f39b1c6c85 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d9673504-31ed-4a93-abbd-67a338294f1f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:02.985804 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cdc82a52-587e-40bf-949b-e1f39b1c6c85 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:02.986423 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cdc82a52-587e-40bf-949b-e1f39b1c6c85 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:02.987149 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cdc82a52-587e-40bf-949b-e1f39b1c6c85 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:02.987642 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cdc82a52-587e-40bf-949b-e1f39b1c6c85 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:03.047805 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ed27fb7a-c76c-40fb-bf55-03e3b2367e99 tempest-ListImagesTestJSON-1095729137 tempest-ListImagesTestJSON-1095729137-project] 10.222.0.20 "GET /compute/v2.1/images/detail" status: 200 len: 1475 microversion: 2.1 time: 0.108231 Apr 16 21:13:03.048736 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 844/1738] 10.222.0.20 () {58 vars in 1142 bytes} [Sat Apr 16 21:13:02 2022] GET /compute/v2.1/images/detail => generated 1475 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:03.078777 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cdc82a52-587e-40bf-949b-e1f39b1c6c85 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:03.090449 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cdc82a52-587e-40bf-949b-e1f39b1c6c85 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:03.093202 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cdc82a52-587e-40bf-949b-e1f39b1c6c85 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:03.094491 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cdc82a52-587e-40bf-949b-e1f39b1c6c85 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f" status: 200 len: 1233 microversion: 2.25 time: 0.120314 Apr 16 21:13:03.095168 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 895/1739] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:13:02 2022] GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f => generated 1233 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:13:03.379491 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7b28f194-1955-401d-9746-ca24e964477a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:03.388608 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7b28f194-1955-401d-9746-ca24e964477a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:03.394561 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7b28f194-1955-401d-9746-ca24e964477a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:03.394561 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7b28f194-1955-401d-9746-ca24e964477a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:03.394561 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7b28f194-1955-401d-9746-ca24e964477a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:03.394561 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7b28f194-1955-401d-9746-ca24e964477a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:03.662091 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7b28f194-1955-401d-9746-ca24e964477a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:03.678991 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7b28f194-1955-401d-9746-ca24e964477a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1365 microversion: 2.1 time: 0.304080 Apr 16 21:13:03.681823 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 845/1740] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:03 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1365 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:03.737222 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b8e30298-7900-4f8c-959b-dd5220285943 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbba001d9d0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:03.779460 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-93031bbc-281a-42d4-a1b6-4b25573f28e0 req-3f440b1a-cff9-44ee-8172-015f54b9ae60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ea94c91-140c-428c-8831-03efc8c571f6", "name": "network-vif-plugged", "status": "completed", "tag": "92e3c39d-5eff-4b35-945a-25de4f5dce4b"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:13:03.800639 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-93031bbc-281a-42d4-a1b6-4b25573f28e0 req-3f440b1a-cff9-44ee-8172-015f54b9ae60 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:03.801165 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-93031bbc-281a-42d4-a1b6-4b25573f28e0 req-3f440b1a-cff9-44ee-8172-015f54b9ae60 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:03.808837 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b8e30298-7900-4f8c-959b-dd5220285943 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/d631a0d5-6e5b-4edc-b753-706449e6c1ef" status: 200 len: 1412 microversion: 2.1 time: 0.075360 Apr 16 21:13:03.809666 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 896/1741] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:13:03 2022] GET /compute/v2.1/images/d631a0d5-6e5b-4edc-b753-706449e6c1ef => generated 1412 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:03.832653 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-93031bbc-281a-42d4-a1b6-4b25573f28e0 req-3f440b1a-cff9-44ee-8172-015f54b9ae60 service nova] Creating event network-vif-plugged:92e3c39d-5eff-4b35-945a-25de4f5dce4b for instance 9ea94c91-140c-428c-8831-03efc8c571f6 on nch1-master-1 Apr 16 21:13:03.843681 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-93031bbc-281a-42d4-a1b6-4b25573f28e0 req-3f440b1a-cff9-44ee-8172-015f54b9ae60 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068325 Apr 16 21:13:03.848968 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 846/1742] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:13:04.124494 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-19552ed5-5340-4592-9f99-982bfd993e2d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:04.127909 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-19552ed5-5340-4592-9f99-982bfd993e2d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d9673504-31ed-4a93-abbd-67a338294f1f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:04.159698 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-19552ed5-5340-4592-9f99-982bfd993e2d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:04.167329 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-19552ed5-5340-4592-9f99-982bfd993e2d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:04.176140 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-19552ed5-5340-4592-9f99-982bfd993e2d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:04.177910 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-19552ed5-5340-4592-9f99-982bfd993e2d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:04.338746 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-03631e84-276b-43f5-b658-357c8103f91d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-838895591", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "8cfbbf93-9e15-4e76-bfe0-e69ff753f337"}], "block_device_mapping_v2": [{"uuid": "e18c96ab-5353-4ef3-b372-c892883f3711", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:13:04.643448 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-19552ed5-5340-4592-9f99-982bfd993e2d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:04.659352 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-19552ed5-5340-4592-9f99-982bfd993e2d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:04.661481 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-19552ed5-5340-4592-9f99-982bfd993e2d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:04.678835 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-19552ed5-5340-4592-9f99-982bfd993e2d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f" status: 200 len: 1251 microversion: 2.25 time: 0.569951 Apr 16 21:13:04.679425 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 897/1743] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:13:04 2022] GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f => generated 1251 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:13:04.690154 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-03631e84-276b-43f5-b658-357c8103f91d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] validate_networks() for [('8cfbbf93-9e15-4e76-bfe0-e69ff753f337', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:13:04.694871 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a5ef21c8-6598-439d-a506-a4d660f06298 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "002930a9-0d49-4ea7-9335-6d515d356336"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:13:04.696034 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a5ef21c8-6598-439d-a506-a4d660f06298 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] [instance: cda4f042-eb49-4d90-ad5e-0e2b81dc0ede] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:04.711619 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a5ef21c8-6598-439d-a506-a4d660f06298 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:04.712387 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a5ef21c8-6598-439d-a506-a4d660f06298 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:04.712892 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a5ef21c8-6598-439d-a506-a4d660f06298 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:04.713350 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a5ef21c8-6598-439d-a506-a4d660f06298 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:05.609100 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-03631e84-276b-43f5-b658-357c8103f91d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:13:05.609579 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-03631e84-276b-43f5-b658-357c8103f91d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:13:05.610058 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-03631e84-276b-43f5-b658-357c8103f91d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:13:05.610509 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-03631e84-276b-43f5-b658-357c8103f91d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:13:05.610940 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-03631e84-276b-43f5-b658-357c8103f91d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:13:05.640806 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-03631e84-276b-43f5-b658-357c8103f91d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:05.641357 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-03631e84-276b-43f5-b658-357c8103f91d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:05.642317 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-03631e84-276b-43f5-b658-357c8103f91d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:05.655580 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-03631e84-276b-43f5-b658-357c8103f91d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:05.738350 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-03631e84-276b-43f5-b658-357c8103f91d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Getting quotas for project b18530cc69c44e6f8a46ca966b3e3a7f. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:13:05.751622 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-03631e84-276b-43f5-b658-357c8103f91d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Getting quotas for user 547d9f3aa3a54867971074b795d83b81 and project b18530cc69c44e6f8a46ca966b3e3a7f. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:13:05.871214 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a5ef21c8-6598-439d-a506-a4d660f06298 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] 10.222.0.20 "POST /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.190467 Apr 16 21:13:05.879320 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 898/1744] 10.222.0.20 () {60 vars in 1322 bytes} [Sat Apr 16 21:13:04 2022] POST /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede/os-volume_attachments => generated 194 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:13:05.891955 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5b2dec3a-da27-42f3-b609-6bf6b933fc4d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:05.892894 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5b2dec3a-da27-42f3-b609-6bf6b933fc4d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:05.920623 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5b2dec3a-da27-42f3-b609-6bf6b933fc4d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:05.920623 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5b2dec3a-da27-42f3-b609-6bf6b933fc4d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:05.925057 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5b2dec3a-da27-42f3-b609-6bf6b933fc4d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:05.926028 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5b2dec3a-da27-42f3-b609-6bf6b933fc4d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:06.254673 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5b2dec3a-da27-42f3-b609-6bf6b933fc4d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:06.266268 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5b2dec3a-da27-42f3-b609-6bf6b933fc4d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1365 microversion: 2.1 time: 0.388737 Apr 16 21:13:06.267094 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 899/1745] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:05 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1365 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:06.281315 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7e9e6c5b-2bb1-46aa-b29e-40b938b2b948 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbba004aa60>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:06.406109 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7e9e6c5b-2bb1-46aa-b29e-40b938b2b948 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/d631a0d5-6e5b-4edc-b753-706449e6c1ef" status: 200 len: 1412 microversion: 2.1 time: 0.137578 Apr 16 21:13:06.410239 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 900/1746] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:13:06 2022] GET /compute/v2.1/images/d631a0d5-6e5b-4edc-b753-706449e6c1ef => generated 1412 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:06.426543 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0c56306b-1793-49c4-95f0-f0192b41ae29 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:06.431591 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0c56306b-1793-49c4-95f0-f0192b41ae29 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d9673504-31ed-4a93-abbd-67a338294f1f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:06.453119 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0c56306b-1793-49c4-95f0-f0192b41ae29 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:06.454362 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0c56306b-1793-49c4-95f0-f0192b41ae29 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:06.460088 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0c56306b-1793-49c4-95f0-f0192b41ae29 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:06.462253 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0c56306b-1793-49c4-95f0-f0192b41ae29 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:06.533730 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-03631e84-276b-43f5-b658-357c8103f91d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:13:06.536248 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-03631e84-276b-43f5-b658-357c8103f91d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e18c96ab-5353-4ef3-b372-c892883f3711',volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:13:07.253676 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0c56306b-1793-49c4-95f0-f0192b41ae29 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:07.263409 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0c56306b-1793-49c4-95f0-f0192b41ae29 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:07.267927 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0c56306b-1793-49c4-95f0-f0192b41ae29 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:07.272419 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0c56306b-1793-49c4-95f0-f0192b41ae29 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f" status: 200 len: 1293 microversion: 2.25 time: 0.859281 Apr 16 21:13:07.275843 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 901/1747] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:13:06 2022] GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f => generated 1293 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:13:07.284629 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7e823342-effb-4930-8521-5b201129eacd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:07.287269 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7e823342-effb-4930-8521-5b201129eacd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:07.300642 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7e823342-effb-4930-8521-5b201129eacd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:07.301692 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7e823342-effb-4930-8521-5b201129eacd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:07.303936 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7e823342-effb-4930-8521-5b201129eacd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:07.307420 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7e823342-effb-4930-8521-5b201129eacd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:07.364410 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-03631e84-276b-43f5-b658-357c8103f91d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.032874 Apr 16 21:13:07.366938 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 847/1748] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:13:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 3036 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:13:07.379673 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-06a29a03-6b6f-4d9b-82b7-18632c164d6a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:07.383423 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-06a29a03-6b6f-4d9b-82b7-18632c164d6a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:07.745732 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-06a29a03-6b6f-4d9b-82b7-18632c164d6a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:07.758713 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-06a29a03-6b6f-4d9b-82b7-18632c164d6a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1052 microversion: 2.1 time: 0.384241 Apr 16 21:13:07.771017 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 848/1749] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:07 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1052 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:07.774617 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3557e510-a7e5-4455-8b9e-8f4cc6217713 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb9ff463a0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:07.887896 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7e823342-effb-4930-8521-5b201129eacd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:07.898764 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7e823342-effb-4930-8521-5b201129eacd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1365 microversion: 2.1 time: 0.619376 Apr 16 21:13:07.908512 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 902/1750] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:07 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1365 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:13:07.909272 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3557e510-a7e5-4455-8b9e-8f4cc6217713 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/d631a0d5-6e5b-4edc-b753-706449e6c1ef" status: 200 len: 1412 microversion: 2.1 time: 0.137340 Apr 16 21:13:07.910364 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 849/1751] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:13:07 2022] GET /compute/v2.1/images/d631a0d5-6e5b-4edc-b753-706449e6c1ef => generated 1412 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:08.297770 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-02658cca-197c-41d2-91d7-d404f6d34d4b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:08.301101 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-02658cca-197c-41d2-91d7-d404f6d34d4b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d9673504-31ed-4a93-abbd-67a338294f1f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:08.320499 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-347da3f0-e92d-48a0-9068-4daf8a01466a tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] Action: 'create', calling method: .version_select at 0x7fbb9ffeb820>, body: {"keypair": {"name": "tempest-keypair-260280946"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:13:08.332853 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-02658cca-197c-41d2-91d7-d404f6d34d4b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:08.333504 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-02658cca-197c-41d2-91d7-d404f6d34d4b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:08.339921 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-02658cca-197c-41d2-91d7-d404f6d34d4b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:08.340675 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-02658cca-197c-41d2-91d7-d404f6d34d4b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:08.365576 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-347da3f0-e92d-48a0-9068-4daf8a01466a tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] Getting quotas for project e9725920e218432ab1339c0dffc5ff94. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:13:08.389263 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-347da3f0-e92d-48a0-9068-4daf8a01466a tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] Getting quotas for user 59d772edd3b04b9d839823bf0e1417fc and project e9725920e218432ab1339c0dffc5ff94. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:13:08.663825 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-02658cca-197c-41d2-91d7-d404f6d34d4b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:08.683782 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-02658cca-197c-41d2-91d7-d404f6d34d4b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:08.688477 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-02658cca-197c-41d2-91d7-d404f6d34d4b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:08.693717 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-02658cca-197c-41d2-91d7-d404f6d34d4b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f" status: 200 len: 1281 microversion: 2.25 time: 0.401781 Apr 16 21:13:08.710177 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 850/1752] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:13:08 2022] GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f => generated 1281 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:13:08.730557 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-771472e4-8d5f-4a8f-ad15-b6f576556d67 req-4551425b-c8f9-4aa8-a01d-1892e1cf822d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9673504-31ed-4a93-abbd-67a338294f1f", "tag": "5d34bb81-13df-419f-85d3-8e3a86be7e32"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:13:08.762197 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-771472e4-8d5f-4a8f-ad15-b6f576556d67 req-4551425b-c8f9-4aa8-a01d-1892e1cf822d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:08.763795 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-771472e4-8d5f-4a8f-ad15-b6f576556d67 req-4551425b-c8f9-4aa8-a01d-1892e1cf822d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:08.790742 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-771472e4-8d5f-4a8f-ad15-b6f576556d67 req-4551425b-c8f9-4aa8-a01d-1892e1cf822d service nova] Creating event network-changed:5d34bb81-13df-419f-85d3-8e3a86be7e32 for instance d9673504-31ed-4a93-abbd-67a338294f1f on nch2-master-1 Apr 16 21:13:08.797206 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-771472e4-8d5f-4a8f-ad15-b6f576556d67 req-4551425b-c8f9-4aa8-a01d-1892e1cf822d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085449 Apr 16 21:13:08.798614 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 851/1753] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:13:08.804798 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-99a1c96c-1fe2-414b-8e37-d4dc29ff9e49 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:08.809069 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-99a1c96c-1fe2-414b-8e37-d4dc29ff9e49 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:08.878391 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-99a1c96c-1fe2-414b-8e37-d4dc29ff9e49 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:08.883588 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-99a1c96c-1fe2-414b-8e37-d4dc29ff9e49 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1052 microversion: 2.1 time: 0.083332 Apr 16 21:13:08.887106 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 852/1754] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:08 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1052 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:08.923149 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-83b52103-7b3a-4f1d-a9b7-62f7cae63540 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb9ff46b80>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:09.023611 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-83b52103-7b3a-4f1d-a9b7-62f7cae63540 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/d631a0d5-6e5b-4edc-b753-706449e6c1ef" status: 200 len: 1412 microversion: 2.1 time: 0.104447 Apr 16 21:13:09.025400 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 853/1755] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:13:08 2022] GET /compute/v2.1/images/d631a0d5-6e5b-4edc-b753-706449e6c1ef => generated 1412 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:09.030331 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a637a95f-8a8d-41f8-8e03-768579663f28 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:09.040879 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a637a95f-8a8d-41f8-8e03-768579663f28 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:09.054833 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a637a95f-8a8d-41f8-8e03-768579663f28 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:09.056081 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a637a95f-8a8d-41f8-8e03-768579663f28 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:09.057440 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a637a95f-8a8d-41f8-8e03-768579663f28 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:09.058058 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a637a95f-8a8d-41f8-8e03-768579663f28 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:09.210695 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-347da3f0-e92d-48a0-9068-4daf8a01466a tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] Getting quotas for project e9725920e218432ab1339c0dffc5ff94. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:13:09.225481 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-347da3f0-e92d-48a0-9068-4daf8a01466a tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] Getting quotas for user 59d772edd3b04b9d839823bf0e1417fc and project e9725920e218432ab1339c0dffc5ff94. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:13:09.280033 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-347da3f0-e92d-48a0-9068-4daf8a01466a tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 1.379049 Apr 16 21:13:09.293137 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 903/1756] 10.222.0.20 () {60 vars in 1157 bytes} [Sat Apr 16 21:13:07 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:09.298163 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-9cc263d2-88c0-4e5a-b1cb-61e4b97bddbc req-cfa56e29-f94e-4565-8108-aefb6f135081 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98ca4f4e-246a-449b-b9fd-e1c17e119faa", "name": "network-vif-plugged", "status": "completed", "tag": "9bc5b971-3aa6-49d0-8b96-ab0e7cb12588"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:13:09.343427 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-9cc263d2-88c0-4e5a-b1cb-61e4b97bddbc req-cfa56e29-f94e-4565-8108-aefb6f135081 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:09.344793 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-9cc263d2-88c0-4e5a-b1cb-61e4b97bddbc req-cfa56e29-f94e-4565-8108-aefb6f135081 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:09.379487 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-9cc263d2-88c0-4e5a-b1cb-61e4b97bddbc req-cfa56e29-f94e-4565-8108-aefb6f135081 service nova] Creating event network-vif-plugged:9bc5b971-3aa6-49d0-8b96-ab0e7cb12588 for instance 98ca4f4e-246a-449b-b9fd-e1c17e119faa on nch2-master-1 Apr 16 21:13:09.396017 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-9cc263d2-88c0-4e5a-b1cb-61e4b97bddbc req-cfa56e29-f94e-4565-8108-aefb6f135081 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106397 Apr 16 21:13:09.398771 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 904/1757] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:13:09.424517 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-508d9b07-4965-418c-a7a0-6f46d28cebec tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] Calling method '.version_select at 0x7fbb9ffb6790>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:09.458986 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-508d9b07-4965-418c-a7a0-6f46d28cebec tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs/tempest-keypair-260280946" status: 200 len: 691 microversion: 2.1 time: 0.056102 Apr 16 21:13:09.465347 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 905/1758] 10.222.0.20 () {58 vars in 1214 bytes} [Sat Apr 16 21:13:09 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-260280946 => generated 691 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:13:09.480114 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5d655104-cbd6-45d3-9e88-6bdaa8480db3 tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] Calling method '.version_select at 0x7fbba004a1f0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:09.556148 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a637a95f-8a8d-41f8-8e03-768579663f28 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:09.556148 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a637a95f-8a8d-41f8-8e03-768579663f28 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1365 microversion: 2.1 time: 0.519534 Apr 16 21:13:09.556148 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 854/1759] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:09 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1365 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:09.648758 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5d655104-cbd6-45d3-9e88-6bdaa8480db3 tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-260280946" status: 202 len: 0 microversion: 2.1 time: 0.181606 Apr 16 21:13:09.650333 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 906/1760] 10.222.0.20 () {58 vars in 1217 bytes} [Sat Apr 16 21:13:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-260280946 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:13:09.667962 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d368197b-1696-4bc9-bd78-7c1eb5c641e8 tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] Action: 'create', calling method: .version_select at 0x7fbb9ffe78b0>, body: {"keypair": {"name": "tempest-keypair-1352734777"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:13:09.714498 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-d368197b-1696-4bc9-bd78-7c1eb5c641e8 tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] Getting quotas for project e9725920e218432ab1339c0dffc5ff94. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:13:09.721262 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-d368197b-1696-4bc9-bd78-7c1eb5c641e8 tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] Getting quotas for user 59d772edd3b04b9d839823bf0e1417fc and project e9725920e218432ab1339c0dffc5ff94. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:13:09.722557 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5ec440d3-12f1-4f00-bf3a-300bf7306264 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:09.723523 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5ec440d3-12f1-4f00-bf3a-300bf7306264 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d9673504-31ed-4a93-abbd-67a338294f1f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:09.736940 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5ec440d3-12f1-4f00-bf3a-300bf7306264 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:09.740326 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5ec440d3-12f1-4f00-bf3a-300bf7306264 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:09.740326 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5ec440d3-12f1-4f00-bf3a-300bf7306264 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:09.743806 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5ec440d3-12f1-4f00-bf3a-300bf7306264 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:09.985392 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5ec440d3-12f1-4f00-bf3a-300bf7306264 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:09.996500 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5ec440d3-12f1-4f00-bf3a-300bf7306264 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:09.998488 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5ec440d3-12f1-4f00-bf3a-300bf7306264 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:10.000311 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5ec440d3-12f1-4f00-bf3a-300bf7306264 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f" status: 200 len: 1281 microversion: 2.25 time: 0.282480 Apr 16 21:13:10.001124 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 907/1761] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:13:09 2022] GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f => generated 1281 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:13:10.018086 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d37dc0a7-26b2-47cd-adaa-736fd854c296 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:10.019035 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d37dc0a7-26b2-47cd-adaa-736fd854c296 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:10.027303 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d37dc0a7-26b2-47cd-adaa-736fd854c296 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:10.028142 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d37dc0a7-26b2-47cd-adaa-736fd854c296 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:10.029865 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d37dc0a7-26b2-47cd-adaa-736fd854c296 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:10.031979 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d37dc0a7-26b2-47cd-adaa-736fd854c296 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:10.137925 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d37dc0a7-26b2-47cd-adaa-736fd854c296 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:10.153196 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d37dc0a7-26b2-47cd-adaa-736fd854c296 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1094 microversion: 2.1 time: 0.138945 Apr 16 21:13:10.155751 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 908/1762] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:10 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1094 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:10.172281 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1976cba7-e56b-4a92-9c47-983c2b3e0d3e tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb9ff3bd30>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:10.214125 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-d368197b-1696-4bc9-bd78-7c1eb5c641e8 tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] Getting quotas for project e9725920e218432ab1339c0dffc5ff94. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:13:10.241634 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-d368197b-1696-4bc9-bd78-7c1eb5c641e8 tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] Getting quotas for user 59d772edd3b04b9d839823bf0e1417fc and project e9725920e218432ab1339c0dffc5ff94. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:13:10.275381 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1976cba7-e56b-4a92-9c47-983c2b3e0d3e tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/d631a0d5-6e5b-4edc-b753-706449e6c1ef" status: 200 len: 1412 microversion: 2.1 time: 0.100731 Apr 16 21:13:10.283304 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 909/1763] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:13:10 2022] GET /compute/v2.1/images/d631a0d5-6e5b-4edc-b753-706449e6c1ef => generated 1412 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:10.287150 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d368197b-1696-4bc9-bd78-7c1eb5c641e8 tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.628844 Apr 16 21:13:10.287774 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 855/1764] 10.222.0.20 () {60 vars in 1157 bytes} [Sat Apr 16 21:13:09 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:13:10.300829 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-be61f83f-96b0-4ad8-97af-4f744b163978 tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] Calling method '.version_select at 0x7fbba004aaf0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:10.459341 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-be61f83f-96b0-4ad8-97af-4f744b163978 tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1352734777" status: 202 len: 0 microversion: 2.1 time: 0.165186 Apr 16 21:13:10.462551 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 910/1765] 10.222.0.20 () {58 vars in 1220 bytes} [Sat Apr 16 21:13:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1352734777 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:13:10.472232 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-60928090-4153-4a41-b304-4e5488204387 tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] Action: 'create', calling method: .version_select at 0x7fbba00b2e50>, body: {"keypair": {"name": "tempest-keypair-289360940", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:13:10.512810 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-60928090-4153-4a41-b304-4e5488204387 tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] Getting quotas for project e9725920e218432ab1339c0dffc5ff94. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:13:10.521537 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-60928090-4153-4a41-b304-4e5488204387 tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] Getting quotas for user 59d772edd3b04b9d839823bf0e1417fc and project e9725920e218432ab1339c0dffc5ff94. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:13:10.566981 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2c24d9ed-c919-43c0-b1e6-c26638f4a347 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:10.569538 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2c24d9ed-c919-43c0-b1e6-c26638f4a347 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:10.589509 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2c24d9ed-c919-43c0-b1e6-c26638f4a347 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:10.591654 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2c24d9ed-c919-43c0-b1e6-c26638f4a347 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:10.592701 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2c24d9ed-c919-43c0-b1e6-c26638f4a347 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:10.593158 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2c24d9ed-c919-43c0-b1e6-c26638f4a347 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:10.648883 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-60928090-4153-4a41-b304-4e5488204387 tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.181430 Apr 16 21:13:10.650630 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 856/1766] 10.222.0.20 () {60 vars in 1158 bytes} [Sat Apr 16 21:13:10 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:13:10.663644 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-82458f75-039b-490a-a553-c0da9ac7f626 tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] Calling method '.version_select at 0x7fbba00b2040>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:10.771558 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-82458f75-039b-490a-a553-c0da9ac7f626 tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-289360940" status: 202 len: 0 microversion: 2.1 time: 0.114065 Apr 16 21:13:10.773208 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 857/1767] 10.222.0.20 () {58 vars in 1217 bytes} [Sat Apr 16 21:13:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-289360940 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:13:10.786460 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-28233ddf-d2a8-4f5c-87dc-9c448bed22d8 tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] Action: 'create', calling method: .version_select at 0x7fbb9ff564c0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1412770395"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:13:10.837252 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-28233ddf-d2a8-4f5c-87dc-9c448bed22d8 tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] Getting quotas for project e9725920e218432ab1339c0dffc5ff94. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:13:10.844475 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-28233ddf-d2a8-4f5c-87dc-9c448bed22d8 tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] Getting quotas for user 59d772edd3b04b9d839823bf0e1417fc and project e9725920e218432ab1339c0dffc5ff94. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:13:10.857340 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2c24d9ed-c919-43c0-b1e6-c26638f4a347 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:10.866148 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2c24d9ed-c919-43c0-b1e6-c26638f4a347 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1365 microversion: 2.1 time: 0.303715 Apr 16 21:13:10.866737 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 911/1768] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:10 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1365 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:13:11.019915 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0476caf1-8b34-42b6-aa0c-d9b6e3339739 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:11.021373 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0476caf1-8b34-42b6-aa0c-d9b6e3339739 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d9673504-31ed-4a93-abbd-67a338294f1f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:11.034660 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0476caf1-8b34-42b6-aa0c-d9b6e3339739 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:11.035136 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0476caf1-8b34-42b6-aa0c-d9b6e3339739 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:11.049428 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0476caf1-8b34-42b6-aa0c-d9b6e3339739 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:11.050349 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0476caf1-8b34-42b6-aa0c-d9b6e3339739 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:11.729138 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0476caf1-8b34-42b6-aa0c-d9b6e3339739 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:11.743621 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0476caf1-8b34-42b6-aa0c-d9b6e3339739 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:11.748608 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0476caf1-8b34-42b6-aa0c-d9b6e3339739 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:11.755453 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0476caf1-8b34-42b6-aa0c-d9b6e3339739 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f" status: 200 len: 1281 microversion: 2.25 time: 0.737072 Apr 16 21:13:11.767919 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 912/1769] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:13:11 2022] GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f => generated 1281 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:13:11.767919 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1eb4a1e4-6455-42e8-9491-a46083c9847b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:11.767919 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1eb4a1e4-6455-42e8-9491-a46083c9847b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:11.782485 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1eb4a1e4-6455-42e8-9491-a46083c9847b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:11.784641 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1eb4a1e4-6455-42e8-9491-a46083c9847b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:11.785990 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1eb4a1e4-6455-42e8-9491-a46083c9847b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:11.790606 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1eb4a1e4-6455-42e8-9491-a46083c9847b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:11.939307 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1eb4a1e4-6455-42e8-9491-a46083c9847b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:11.959727 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-28233ddf-d2a8-4f5c-87dc-9c448bed22d8 tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] Getting quotas for project e9725920e218432ab1339c0dffc5ff94. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:13:11.960285 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1eb4a1e4-6455-42e8-9491-a46083c9847b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1168 microversion: 2.1 time: 0.198624 Apr 16 21:13:11.963060 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 913/1770] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:11 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1168 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:11.977032 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ee9ed2a5-fed0-4857-99b5-caa4c7dfe07f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb9ff4de50>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:11.985331 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-28233ddf-d2a8-4f5c-87dc-9c448bed22d8 tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] Getting quotas for user 59d772edd3b04b9d839823bf0e1417fc and project e9725920e218432ab1339c0dffc5ff94. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:13:12.025217 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-28233ddf-d2a8-4f5c-87dc-9c448bed22d8 tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2320 microversion: 2.1 time: 1.245879 Apr 16 21:13:12.033540 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 858/1771] 10.222.0.20 () {60 vars in 1157 bytes} [Sat Apr 16 21:13:10 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:12.039389 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-85c9ed5b-86ca-4dba-9842-7db198afd129 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:12.040016 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-85c9ed5b-86ca-4dba-9842-7db198afd129 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:12.056482 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ee9ed2a5-fed0-4857-99b5-caa4c7dfe07f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/d631a0d5-6e5b-4edc-b753-706449e6c1ef" status: 200 len: 1412 microversion: 2.1 time: 0.091068 Apr 16 21:13:12.057298 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 914/1772] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:13:11 2022] GET /compute/v2.1/images/d631a0d5-6e5b-4edc-b753-706449e6c1ef => generated 1412 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:12.069159 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-040bd25a-86ba-4763-9f26-c427ca10f73e tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] Action: 'create', calling method: .version_select at 0x7fbb961449d0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1983644557"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:13:12.095924 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-040bd25a-86ba-4763-9f26-c427ca10f73e tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] Getting quotas for project e9725920e218432ab1339c0dffc5ff94. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:13:12.102575 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-040bd25a-86ba-4763-9f26-c427ca10f73e tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] Getting quotas for user 59d772edd3b04b9d839823bf0e1417fc and project e9725920e218432ab1339c0dffc5ff94. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:13:12.126453 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-85c9ed5b-86ca-4dba-9842-7db198afd129 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:12.129395 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-85c9ed5b-86ca-4dba-9842-7db198afd129 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:12.130545 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-85c9ed5b-86ca-4dba-9842-7db198afd129 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:12.132758 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-85c9ed5b-86ca-4dba-9842-7db198afd129 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:12.667484 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-85c9ed5b-86ca-4dba-9842-7db198afd129 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:12.679249 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-85c9ed5b-86ca-4dba-9842-7db198afd129 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1365 microversion: 2.1 time: 0.644455 Apr 16 21:13:12.679841 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 859/1773] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:12 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1365 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:12.731552 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-040bd25a-86ba-4763-9f26-c427ca10f73e tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] Getting quotas for project e9725920e218432ab1339c0dffc5ff94. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:13:12.745606 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-040bd25a-86ba-4763-9f26-c427ca10f73e tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] Getting quotas for user 59d772edd3b04b9d839823bf0e1417fc and project e9725920e218432ab1339c0dffc5ff94. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:13:12.800235 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-040bd25a-86ba-4763-9f26-c427ca10f73e tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2324 microversion: 2.1 time: 0.741707 Apr 16 21:13:12.808288 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 915/1774] 10.222.0.20 () {60 vars in 1157 bytes} [Sat Apr 16 21:13:12 2022] POST /compute/v2.1/os-keypairs => generated 2324 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:12.816610 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ace557ce-aa4b-4bc8-8d64-ef308bdd2c10 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:12.818068 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ace557ce-aa4b-4bc8-8d64-ef308bdd2c10 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d9673504-31ed-4a93-abbd-67a338294f1f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:12.829825 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ace557ce-aa4b-4bc8-8d64-ef308bdd2c10 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:12.830564 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ace557ce-aa4b-4bc8-8d64-ef308bdd2c10 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:12.832196 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ace557ce-aa4b-4bc8-8d64-ef308bdd2c10 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:12.832822 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ace557ce-aa4b-4bc8-8d64-ef308bdd2c10 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:12.920496 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0a6939e0-b129-4879-b858-3fe98d48cb03 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Action: 'create', calling method: .version_select at 0x7fbb962275e0>, body: {"keypair": {"name": "tempest-keypair-1500824956"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:13:12.937469 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-0a6939e0-b129-4879-b858-3fe98d48cb03 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Getting quotas for project 840fd4cbe2fd414bb97f14898bf9647d. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:13:12.960426 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-0a6939e0-b129-4879-b858-3fe98d48cb03 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Getting quotas for user 1a6ff623974d4156a05a7bd3e3b3ed5e and project 840fd4cbe2fd414bb97f14898bf9647d. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:13:13.083522 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ace557ce-aa4b-4bc8-8d64-ef308bdd2c10 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:13.128396 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ace557ce-aa4b-4bc8-8d64-ef308bdd2c10 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:13.149237 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ace557ce-aa4b-4bc8-8d64-ef308bdd2c10 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:13.151318 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ace557ce-aa4b-4bc8-8d64-ef308bdd2c10 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f" status: 200 len: 1281 microversion: 2.25 time: 0.341080 Apr 16 21:13:13.153494 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 916/1775] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:13:12 2022] GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f => generated 1281 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:13:13.178654 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8262a3be-0de7-41b9-92bc-a90628e60fea tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] Action: 'create', calling method: .version_select at 0x7fbb96144310>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-404337422"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:13:13.258210 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-8262a3be-0de7-41b9-92bc-a90628e60fea tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] Getting quotas for project e9725920e218432ab1339c0dffc5ff94. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:13:13.278605 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-8262a3be-0de7-41b9-92bc-a90628e60fea tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] Getting quotas for user 59d772edd3b04b9d839823bf0e1417fc and project e9725920e218432ab1339c0dffc5ff94. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:13:13.419328 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-0a6939e0-b129-4879-b858-3fe98d48cb03 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Getting quotas for project 840fd4cbe2fd414bb97f14898bf9647d. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:13:13.465084 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-0a6939e0-b129-4879-b858-3fe98d48cb03 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Getting quotas for user 1a6ff623974d4156a05a7bd3e3b3ed5e and project 840fd4cbe2fd414bb97f14898bf9647d. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:13:13.557453 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0a6939e0-b129-4879-b858-3fe98d48cb03 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.801185 Apr 16 21:13:13.566079 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 860/1776] 10.222.0.20 () {60 vars in 1157 bytes} [Sat Apr 16 21:13:12 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:13.578947 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f483b03c-0314-4316-af13-29cb9b765118 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:13.581164 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f483b03c-0314-4316-af13-29cb9b765118 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:13.589887 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f483b03c-0314-4316-af13-29cb9b765118 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:13.591028 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f483b03c-0314-4316-af13-29cb9b765118 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:13.592679 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f483b03c-0314-4316-af13-29cb9b765118 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:13.593201 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f483b03c-0314-4316-af13-29cb9b765118 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:13.745079 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-8262a3be-0de7-41b9-92bc-a90628e60fea tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] Getting quotas for project e9725920e218432ab1339c0dffc5ff94. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:13:13.786784 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-8262a3be-0de7-41b9-92bc-a90628e60fea tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] Getting quotas for user 59d772edd3b04b9d839823bf0e1417fc and project e9725920e218432ab1339c0dffc5ff94. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:13:13.827013 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8262a3be-0de7-41b9-92bc-a90628e60fea tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.655964 Apr 16 21:13:13.828410 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 917/1777] 10.222.0.20 () {60 vars in 1157 bytes} [Sat Apr 16 21:13:13 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:13.838631 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b85cb3cf-b23d-4bbe-b9f7-bde6cf59b7e3 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb96142dc0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:13.896476 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b85cb3cf-b23d-4bbe-b9f7-bde6cf59b7e3 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/d631a0d5-6e5b-4edc-b753-706449e6c1ef" status: 200 len: 1412 microversion: 2.1 time: 0.066529 Apr 16 21:13:13.912408 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 918/1778] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:13:13 2022] GET /compute/v2.1/images/d631a0d5-6e5b-4edc-b753-706449e6c1ef => generated 1412 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:13.923251 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8b3c607c-d151-40f9-b2bc-accd16c0772d tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:13.924859 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8b3c607c-d151-40f9-b2bc-accd16c0772d tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] [instance: cda4f042-eb49-4d90-ad5e-0e2b81dc0ede] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:13.933227 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8b3c607c-d151-40f9-b2bc-accd16c0772d tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:13.934022 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8b3c607c-d151-40f9-b2bc-accd16c0772d tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:13.935622 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8b3c607c-d151-40f9-b2bc-accd16c0772d tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:13.936323 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8b3c607c-d151-40f9-b2bc-accd16c0772d tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:14.021463 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8b3c607c-d151-40f9-b2bc-accd16c0772d tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] 10.222.0.20 "GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106677 Apr 16 21:13:14.041773 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 919/1779] 10.222.0.20 () {58 vars in 1301 bytes} [Sat Apr 16 21:13:13 2022] GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:13:14.062249 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9f4f69ba-4fd5-4133-a928-87e6b975f8f2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:14.065240 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9f4f69ba-4fd5-4133-a928-87e6b975f8f2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:14.088897 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9f4f69ba-4fd5-4133-a928-87e6b975f8f2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:14.089389 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9f4f69ba-4fd5-4133-a928-87e6b975f8f2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:14.090237 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9f4f69ba-4fd5-4133-a928-87e6b975f8f2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:14.090730 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9f4f69ba-4fd5-4133-a928-87e6b975f8f2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:14.147561 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f483b03c-0314-4316-af13-29cb9b765118 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:14.161909 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f483b03c-0314-4316-af13-29cb9b765118 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1210 microversion: 2.1 time: 0.595489 Apr 16 21:13:14.166357 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 861/1780] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:13 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1210 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:14.178157 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-dcffc14f-0fc7-4ecc-8729-4e3b0532c6b2 tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] Calling method '.version_select at 0x7fbb9ffa6b80>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:14.182745 ncdv-master-1 devstack@n-api.service[137409]: WARNING oslo_db.sqlalchemy.utils [None req-dcffc14f-0fc7-4ecc-8729-4e3b0532c6b2 tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] Unique keys not in sort_keys. The sorting order may be unstable. Apr 16 21:13:14.198803 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-dcffc14f-0fc7-4ecc-8729-4e3b0532c6b2 tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 1675 microversion: 2.1 time: 0.030302 Apr 16 21:13:14.207216 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 862/1781] 10.222.0.20 () {58 vars in 1136 bytes} [Sat Apr 16 21:13:14 2022] GET /compute/v2.1/os-keypairs => generated 1675 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:14.213684 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-753e843c-bb55-40bc-8564-8b99840b692e tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:14.214742 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-753e843c-bb55-40bc-8564-8b99840b692e tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] [instance: cda4f042-eb49-4d90-ad5e-0e2b81dc0ede] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:14.228522 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-753e843c-bb55-40bc-8564-8b99840b692e tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:14.229254 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-753e843c-bb55-40bc-8564-8b99840b692e tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:14.230425 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-753e843c-bb55-40bc-8564-8b99840b692e tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:14.231037 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-753e843c-bb55-40bc-8564-8b99840b692e tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:14.459686 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9f4f69ba-4fd5-4133-a928-87e6b975f8f2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:14.468664 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9f4f69ba-4fd5-4133-a928-87e6b975f8f2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1552 microversion: 2.1 time: 0.425941 Apr 16 21:13:14.490795 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 920/1782] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:14 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1552 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:14.512730 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-27b5e2db-55e5-4052-b06b-4625e8976805 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:14.514658 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-27b5e2db-55e5-4052-b06b-4625e8976805 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d9673504-31ed-4a93-abbd-67a338294f1f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:14.528064 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-27b5e2db-55e5-4052-b06b-4625e8976805 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:14.531810 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-27b5e2db-55e5-4052-b06b-4625e8976805 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:14.535410 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-27b5e2db-55e5-4052-b06b-4625e8976805 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:14.536007 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-27b5e2db-55e5-4052-b06b-4625e8976805 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:14.583350 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-753e843c-bb55-40bc-8564-8b99840b692e tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lazy-loading 'services' on Instance uuid cda4f042-eb49-4d90-ad5e-0e2b81dc0ede {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:13:14.954908 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-27b5e2db-55e5-4052-b06b-4625e8976805 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:14.963650 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-27b5e2db-55e5-4052-b06b-4625e8976805 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:14.974097 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-27b5e2db-55e5-4052-b06b-4625e8976805 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:14.984802 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-27b5e2db-55e5-4052-b06b-4625e8976805 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f" status: 200 len: 1281 microversion: 2.25 time: 0.494547 Apr 16 21:13:14.985642 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 921/1783] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:13:14 2022] GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f => generated 1281 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:13:14.990578 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3345fd7e-7760-4f62-8d8f-c8335ac8bd3d tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] Calling method '.version_select at 0x7fbb9ffd4a60>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:15.040743 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-753e843c-bb55-40bc-8564-8b99840b692e tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede/os-volume_attachments/002930a9-0d49-4ea7-9335-6d515d356336" status: 202 len: 0 microversion: 2.1 time: 0.831082 Apr 16 21:13:15.041877 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 863/1784] 10.222.0.20 () {58 vars in 1415 bytes} [Sat Apr 16 21:13:14 2022] DELETE /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede/os-volume_attachments/002930a9-0d49-4ea7-9335-6d515d356336 => generated 0 bytes in 833 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:13:15.099934 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-decb6141-4e38-4694-9f69-0f2bddcecf06 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:15.106165 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-decb6141-4e38-4694-9f69-0f2bddcecf06 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:15.136203 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-decb6141-4e38-4694-9f69-0f2bddcecf06 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:15.137431 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-decb6141-4e38-4694-9f69-0f2bddcecf06 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:15.143013 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-decb6141-4e38-4694-9f69-0f2bddcecf06 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:15.144124 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-decb6141-4e38-4694-9f69-0f2bddcecf06 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:15.166741 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3345fd7e-7760-4f62-8d8f-c8335ac8bd3d tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-404337422" status: 202 len: 0 microversion: 2.1 time: 0.174934 Apr 16 21:13:15.166741 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 922/1785] 10.222.0.20 () {58 vars in 1274 bytes} [Sat Apr 16 21:13:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-404337422 => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:13:15.169585 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-60947e38-725a-4a6d-a61c-10bf5b93d0e8 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb9ff3b700>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:15.265894 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-60947e38-725a-4a6d-a61c-10bf5b93d0e8 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/d631a0d5-6e5b-4edc-b753-706449e6c1ef" status: 200 len: 1412 microversion: 2.1 time: 0.092949 Apr 16 21:13:15.266826 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 923/1786] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:13:15 2022] GET /compute/v2.1/images/d631a0d5-6e5b-4edc-b753-706449e6c1ef => generated 1412 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:15.289285 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-13050cdf-71d9-4c66-96d9-85cbc22973fb tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] Calling method '.version_select at 0x7fbba00028b0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:15.295094 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-decb6141-4e38-4694-9f69-0f2bddcecf06 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.251066 Apr 16 21:13:15.302868 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 864/1787] 10.222.0.20 () {58 vars in 1274 bytes} [Sat Apr 16 21:13:15 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa/os-interface => generated 285 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:13:15.312840 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d95cc363-9e06-4cba-8836-27edb7feb100 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:15.313462 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d95cc363-9e06-4cba-8836-27edb7feb100 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:15.346024 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d95cc363-9e06-4cba-8836-27edb7feb100 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:15.347352 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d95cc363-9e06-4cba-8836-27edb7feb100 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:15.349698 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d95cc363-9e06-4cba-8836-27edb7feb100 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:15.350381 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d95cc363-9e06-4cba-8836-27edb7feb100 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:15.501975 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-13050cdf-71d9-4c66-96d9-85cbc22973fb tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1983644557" status: 202 len: 0 microversion: 2.1 time: 0.233856 Apr 16 21:13:15.506634 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 924/1788] 10.222.0.20 () {58 vars in 1277 bytes} [Sat Apr 16 21:13:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1983644557 => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:13:15.512890 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f4f4d3e7-e9f9-44c1-be5a-1b3118e2f673 tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] Calling method '.version_select at 0x7fbba004a310>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:15.625393 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f4f4d3e7-e9f9-44c1-be5a-1b3118e2f673 tempest-KeyPairsV2TestJSON-1792010714 tempest-KeyPairsV2TestJSON-1792010714-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1412770395" status: 202 len: 0 microversion: 2.1 time: 0.117469 Apr 16 21:13:15.632061 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 925/1789] 10.222.0.20 () {58 vars in 1277 bytes} [Sat Apr 16 21:13:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1412770395 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:13:15.815223 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d95cc363-9e06-4cba-8836-27edb7feb100 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:15.830574 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d95cc363-9e06-4cba-8836-27edb7feb100 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1198 microversion: 2.1 time: 0.519964 Apr 16 21:13:15.845876 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 865/1790] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:15 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1198 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:16.005228 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-82283676-49c2-4625-b13a-32c915815f7e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:16.006647 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-82283676-49c2-4625-b13a-32c915815f7e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d9673504-31ed-4a93-abbd-67a338294f1f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:16.029482 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-82283676-49c2-4625-b13a-32c915815f7e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:16.031988 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-82283676-49c2-4625-b13a-32c915815f7e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:16.037765 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-82283676-49c2-4625-b13a-32c915815f7e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:16.043415 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-82283676-49c2-4625-b13a-32c915815f7e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:16.281085 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-69109ba3-cacb-4ae7-bf10-2b12e8b20e7e tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb961f6040>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:16.419321 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-69109ba3-cacb-4ae7-bf10-2b12e8b20e7e tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/d631a0d5-6e5b-4edc-b753-706449e6c1ef" status: 200 len: 1412 microversion: 2.1 time: 0.143088 Apr 16 21:13:16.429581 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 866/1791] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:13:16 2022] GET /compute/v2.1/images/d631a0d5-6e5b-4edc-b753-706449e6c1ef => generated 1412 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:13:16.849981 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c054a1da-37d0-44d7-9aec-8d9b7c8ab5df tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:16.853070 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c054a1da-37d0-44d7-9aec-8d9b7c8ab5df tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:16.862584 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c054a1da-37d0-44d7-9aec-8d9b7c8ab5df tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:16.863050 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c054a1da-37d0-44d7-9aec-8d9b7c8ab5df tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:16.863867 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c054a1da-37d0-44d7-9aec-8d9b7c8ab5df tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:16.864342 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c054a1da-37d0-44d7-9aec-8d9b7c8ab5df tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:18.176847 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-82283676-49c2-4625-b13a-32c915815f7e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:18.193385 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-82283676-49c2-4625-b13a-32c915815f7e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:18.202251 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-82283676-49c2-4625-b13a-32c915815f7e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:18.203969 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-82283676-49c2-4625-b13a-32c915815f7e tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f" status: 200 len: 1281 microversion: 2.25 time: 2.204377 Apr 16 21:13:18.206996 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 926/1792] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:13:15 2022] GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f => generated 1281 bytes in 2207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:13:18.224110 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-41bda12f-2c8b-4a14-9b88-3d773e0b5a8b req-141c18f5-3617-44ce-83bc-0f1d9c7f25c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39df3a82-5cde-4311-8bec-5ce2d111d59e", "tag": "e220556c-73e1-42e1-a291-a4168a2b6289"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:13:18.247134 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c054a1da-37d0-44d7-9aec-8d9b7c8ab5df tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:18.252408 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-41bda12f-2c8b-4a14-9b88-3d773e0b5a8b req-141c18f5-3617-44ce-83bc-0f1d9c7f25c0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:18.252890 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-41bda12f-2c8b-4a14-9b88-3d773e0b5a8b req-141c18f5-3617-44ce-83bc-0f1d9c7f25c0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:18.261517 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c054a1da-37d0-44d7-9aec-8d9b7c8ab5df tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1198 microversion: 2.1 time: 1.413960 Apr 16 21:13:18.262878 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 867/1793] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:16 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1198 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:13:18.274766 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-18deab53-53f1-4c44-b3bb-b65fb775d901 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb96227ee0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:18.285807 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-41bda12f-2c8b-4a14-9b88-3d773e0b5a8b req-141c18f5-3617-44ce-83bc-0f1d9c7f25c0 service nova] Creating event network-changed:e220556c-73e1-42e1-a291-a4168a2b6289 for instance 39df3a82-5cde-4311-8bec-5ce2d111d59e on nch1-master-1 Apr 16 21:13:18.316775 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-41bda12f-2c8b-4a14-9b88-3d773e0b5a8b req-141c18f5-3617-44ce-83bc-0f1d9c7f25c0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108027 Apr 16 21:13:18.317394 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 927/1794] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:13:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:13:18.346062 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-36aab63f-7674-43cb-99c7-843bc0a2efb7 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:18.358200 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-36aab63f-7674-43cb-99c7-843bc0a2efb7 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] [instance: cda4f042-eb49-4d90-ad5e-0e2b81dc0ede] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:18.370423 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-36aab63f-7674-43cb-99c7-843bc0a2efb7 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:18.370626 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-36aab63f-7674-43cb-99c7-843bc0a2efb7 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:18.378874 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-36aab63f-7674-43cb-99c7-843bc0a2efb7 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:18.380196 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-36aab63f-7674-43cb-99c7-843bc0a2efb7 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:18.382883 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-18deab53-53f1-4c44-b3bb-b65fb775d901 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/d631a0d5-6e5b-4edc-b753-706449e6c1ef" status: 200 len: 1412 microversion: 2.1 time: 0.117210 Apr 16 21:13:18.383439 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 868/1795] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:13:18 2022] GET /compute/v2.1/images/d631a0d5-6e5b-4edc-b753-706449e6c1ef => generated 1412 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:18.450256 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-36aab63f-7674-43cb-99c7-843bc0a2efb7 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] 10.222.0.20 "GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.123135 Apr 16 21:13:18.468020 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 928/1796] 10.222.0.20 () {58 vars in 1301 bytes} [Sat Apr 16 21:13:18 2022] GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede/os-volume_attachments => generated 25 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:13:18.546923 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-467a9105-4946-4316-96ce-494c9c5a54b6 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:18.548889 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-467a9105-4946-4316-96ce-494c9c5a54b6 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] [instance: cda4f042-eb49-4d90-ad5e-0e2b81dc0ede] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:18.566488 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-467a9105-4946-4316-96ce-494c9c5a54b6 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:18.567268 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-467a9105-4946-4316-96ce-494c9c5a54b6 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:18.570224 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-467a9105-4946-4316-96ce-494c9c5a54b6 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:18.571051 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-467a9105-4946-4316-96ce-494c9c5a54b6 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:18.645351 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-467a9105-4946-4316-96ce-494c9c5a54b6 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] 10.222.0.20 "GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.104906 Apr 16 21:13:18.646083 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 869/1797] 10.222.0.20 () {58 vars in 1301 bytes} [Sat Apr 16 21:13:18 2022] GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede/os-volume_attachments => generated 25 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:13:18.744121 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f17d396b-c7a9-4b01-acdf-ce6296acf51f tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:18.744665 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f17d396b-c7a9-4b01-acdf-ce6296acf51f tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] [instance: cda4f042-eb49-4d90-ad5e-0e2b81dc0ede] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:18.753695 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f17d396b-c7a9-4b01-acdf-ce6296acf51f tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:18.754491 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f17d396b-c7a9-4b01-acdf-ce6296acf51f tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:18.755467 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f17d396b-c7a9-4b01-acdf-ce6296acf51f tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:18.759796 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f17d396b-c7a9-4b01-acdf-ce6296acf51f tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:18.873708 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f17d396b-c7a9-4b01-acdf-ce6296acf51f tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] [instance: cda4f042-eb49-4d90-ad5e-0e2b81dc0ede] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:13:19.223747 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d771e0d2-c90d-4a50-88a4-97f7468cf8aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:19.225131 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d771e0d2-c90d-4a50-88a4-97f7468cf8aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d9673504-31ed-4a93-abbd-67a338294f1f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:19.239422 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d771e0d2-c90d-4a50-88a4-97f7468cf8aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:19.242891 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d771e0d2-c90d-4a50-88a4-97f7468cf8aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:19.250174 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d771e0d2-c90d-4a50-88a4-97f7468cf8aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:19.253677 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d771e0d2-c90d-4a50-88a4-97f7468cf8aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:19.425817 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f17d396b-c7a9-4b01-acdf-ce6296acf51f tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede" status: 204 len: 0 microversion: 2.1 time: 0.685406 Apr 16 21:13:19.427216 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 929/1798] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:13:18 2022] DELETE /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede => generated 0 bytes in 688 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:13:19.433399 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-663049f0-b8ae-4767-91c6-11f8a2bf7505 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:19.434189 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-663049f0-b8ae-4767-91c6-11f8a2bf7505 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:19.462198 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-663049f0-b8ae-4767-91c6-11f8a2bf7505 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:19.462714 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-663049f0-b8ae-4767-91c6-11f8a2bf7505 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:19.472738 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-663049f0-b8ae-4767-91c6-11f8a2bf7505 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:19.473266 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-663049f0-b8ae-4767-91c6-11f8a2bf7505 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:19.987551 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d771e0d2-c90d-4a50-88a4-97f7468cf8aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:20.014869 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d771e0d2-c90d-4a50-88a4-97f7468cf8aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:20.024747 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d771e0d2-c90d-4a50-88a4-97f7468cf8aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:20.025969 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d771e0d2-c90d-4a50-88a4-97f7468cf8aa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f" status: 200 len: 1281 microversion: 2.25 time: 0.806791 Apr 16 21:13:20.026670 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 870/1799] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:13:19 2022] GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f => generated 1281 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:13:20.048539 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-282b803b-80e8-4ef7-8912-9ec7cd765002 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb961e7310>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:20.163643 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-282b803b-80e8-4ef7-8912-9ec7cd765002 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/d631a0d5-6e5b-4edc-b753-706449e6c1ef" status: 200 len: 1412 microversion: 2.1 time: 0.122525 Apr 16 21:13:20.166537 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 871/1800] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:13:20 2022] GET /compute/v2.1/images/d631a0d5-6e5b-4edc-b753-706449e6c1ef => generated 1412 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:20.176045 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-02ee7df3-2a7d-475e-8771-39a5e1e042f9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:20.176704 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-02ee7df3-2a7d-475e-8771-39a5e1e042f9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] [instance: cda4f042-eb49-4d90-ad5e-0e2b81dc0ede] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:20.213559 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-02ee7df3-2a7d-475e-8771-39a5e1e042f9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:20.214050 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-02ee7df3-2a7d-475e-8771-39a5e1e042f9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:20.217955 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-02ee7df3-2a7d-475e-8771-39a5e1e042f9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:20.218824 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-02ee7df3-2a7d-475e-8771-39a5e1e042f9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:20.346918 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-663049f0-b8ae-4767-91c6-11f8a2bf7505 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:20.356857 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-663049f0-b8ae-4767-91c6-11f8a2bf7505 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1198 microversion: 2.1 time: 0.927860 Apr 16 21:13:20.358924 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 930/1801] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:19 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1198 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:20.497184 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-02ee7df3-2a7d-475e-8771-39a5e1e042f9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453306648f4e4da58ee344c3a51f8110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc15580ef8a449ca359a9d5b799e24d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:20.510728 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-02ee7df3-2a7d-475e-8771-39a5e1e042f9 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] 10.222.0.20 "GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede" status: 200 len: 1683 microversion: 2.1 time: 0.340338 Apr 16 21:13:20.514450 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 872/1802] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:20 2022] GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede => generated 1683 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:20.933162 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-28a98120-51a6-4c64-b5c8-86886999c1d2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:20.933874 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-28a98120-51a6-4c64-b5c8-86886999c1d2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:20.957935 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-28a98120-51a6-4c64-b5c8-86886999c1d2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:20.959638 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-28a98120-51a6-4c64-b5c8-86886999c1d2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:20.961310 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-28a98120-51a6-4c64-b5c8-86886999c1d2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:20.962311 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-28a98120-51a6-4c64-b5c8-86886999c1d2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:21.278665 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-c3d9df32-6fad-484f-a616-33306264f9cf req-10c0da6f-d3d0-4aef-b745-58e126d3d503 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98ca4f4e-246a-449b-b9fd-e1c17e119faa", "tag": "9bc5b971-3aa6-49d0-8b96-ab0e7cb12588"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:13:21.294363 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-c3d9df32-6fad-484f-a616-33306264f9cf req-10c0da6f-d3d0-4aef-b745-58e126d3d503 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:21.299467 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-c3d9df32-6fad-484f-a616-33306264f9cf req-10c0da6f-d3d0-4aef-b745-58e126d3d503 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:21.360082 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-c3d9df32-6fad-484f-a616-33306264f9cf req-10c0da6f-d3d0-4aef-b745-58e126d3d503 service nova] Creating event network-changed:9bc5b971-3aa6-49d0-8b96-ab0e7cb12588 for instance 98ca4f4e-246a-449b-b9fd-e1c17e119faa on nch2-master-1 Apr 16 21:13:21.381411 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-c3d9df32-6fad-484f-a616-33306264f9cf req-10c0da6f-d3d0-4aef-b745-58e126d3d503 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.439618 Apr 16 21:13:21.382395 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 873/1803] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:13:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:13:21.391601 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-e3128d1e-6cf6-4907-8804-ebc3a6c101e5 req-51739e68-5ca9-4cb8-bebd-a90a5311154a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9673504-31ed-4a93-abbd-67a338294f1f", "name": "network-vif-plugged", "status": "completed", "tag": "5d34bb81-13df-419f-85d3-8e3a86be7e32"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:13:21.416276 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-e3128d1e-6cf6-4907-8804-ebc3a6c101e5 req-51739e68-5ca9-4cb8-bebd-a90a5311154a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:21.417093 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-e3128d1e-6cf6-4907-8804-ebc3a6c101e5 req-51739e68-5ca9-4cb8-bebd-a90a5311154a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:21.486449 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-e3128d1e-6cf6-4907-8804-ebc3a6c101e5 req-51739e68-5ca9-4cb8-bebd-a90a5311154a service nova] Creating event network-vif-plugged:5d34bb81-13df-419f-85d3-8e3a86be7e32 for instance d9673504-31ed-4a93-abbd-67a338294f1f on nch2-master-1 Apr 16 21:13:21.496828 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-e3128d1e-6cf6-4907-8804-ebc3a6c101e5 req-51739e68-5ca9-4cb8-bebd-a90a5311154a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112686 Apr 16 21:13:21.498321 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 874/1804] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:13:21.529499 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-71dc89cc-4696-479a-8906-a36def9ab6e9 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:21.537372 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-71dc89cc-4696-479a-8906-a36def9ab6e9 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d9673504-31ed-4a93-abbd-67a338294f1f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:21.574805 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-71dc89cc-4696-479a-8906-a36def9ab6e9 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:21.578645 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-71dc89cc-4696-479a-8906-a36def9ab6e9 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:21.581057 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-71dc89cc-4696-479a-8906-a36def9ab6e9 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:21.583827 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-71dc89cc-4696-479a-8906-a36def9ab6e9 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:21.840900 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-28a98120-51a6-4c64-b5c8-86886999c1d2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:21.866621 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-28a98120-51a6-4c64-b5c8-86886999c1d2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1552 microversion: 2.1 time: 0.940017 Apr 16 21:13:21.869824 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 931/1805] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:20 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1552 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:21.878880 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b6631a62-e033-4c16-9801-cdcd03c3512b tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb9ffb6280>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:22.043420 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b6631a62-e033-4c16-9801-cdcd03c3512b tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/d631a0d5-6e5b-4edc-b753-706449e6c1ef" status: 200 len: 1412 microversion: 2.1 time: 0.170791 Apr 16 21:13:22.057282 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 932/1806] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:13:21 2022] GET /compute/v2.1/images/d631a0d5-6e5b-4edc-b753-706449e6c1ef => generated 1412 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:22.066657 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fb5445fd-bb0b-41fb-83cd-21b9fddadbb8 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:22.073797 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fb5445fd-bb0b-41fb-83cd-21b9fddadbb8 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:22.105828 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fb5445fd-bb0b-41fb-83cd-21b9fddadbb8 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:22.111097 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fb5445fd-bb0b-41fb-83cd-21b9fddadbb8 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:22.112045 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fb5445fd-bb0b-41fb-83cd-21b9fddadbb8 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:22.114170 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fb5445fd-bb0b-41fb-83cd-21b9fddadbb8 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:22.508922 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-71dc89cc-4696-479a-8906-a36def9ab6e9 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:22.518296 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-71dc89cc-4696-479a-8906-a36def9ab6e9 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:22.519803 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-71dc89cc-4696-479a-8906-a36def9ab6e9 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:22.522679 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fb5445fd-bb0b-41fb-83cd-21b9fddadbb8 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:22.524922 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-71dc89cc-4696-479a-8906-a36def9ab6e9 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f" status: 200 len: 1281 microversion: 2.25 time: 1.024696 Apr 16 21:13:22.531204 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 875/1807] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:13:21 2022] GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f => generated 1281 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:13:22.548349 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-67c821ed-f641-40d1-a373-690231f26d3e tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:22.549731 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-67c821ed-f641-40d1-a373-690231f26d3e tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] [instance: cda4f042-eb49-4d90-ad5e-0e2b81dc0ede] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:22.559536 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-67c821ed-f641-40d1-a373-690231f26d3e tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:22.560270 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fb5445fd-bb0b-41fb-83cd-21b9fddadbb8 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1198 microversion: 2.1 time: 0.499517 Apr 16 21:13:22.561104 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 933/1808] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:22 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1198 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:22.570232 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-67c821ed-f641-40d1-a373-690231f26d3e tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:22.570232 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-67c821ed-f641-40d1-a373-690231f26d3e tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:22.570232 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-67c821ed-f641-40d1-a373-690231f26d3e tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:22.579677 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-51c291e0-d0ed-4f5a-ad55-169180d101ea tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:22.580620 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-51c291e0-d0ed-4f5a-ad55-169180d101ea tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:22.589028 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-51c291e0-d0ed-4f5a-ad55-169180d101ea tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:22.589777 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-51c291e0-d0ed-4f5a-ad55-169180d101ea tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:22.590769 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-51c291e0-d0ed-4f5a-ad55-169180d101ea tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:22.593107 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-51c291e0-d0ed-4f5a-ad55-169180d101ea tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:23.028468 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-67c821ed-f641-40d1-a373-690231f26d3e tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453306648f4e4da58ee344c3a51f8110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc15580ef8a449ca359a9d5b799e24d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:23.039418 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-67c821ed-f641-40d1-a373-690231f26d3e tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] 10.222.0.20 "GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede" status: 200 len: 1683 microversion: 2.1 time: 0.506832 Apr 16 21:13:23.047459 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 876/1809] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:22 2022] GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede => generated 1683 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:23.062509 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-69b2767b-4938-40b5-9e0e-4e0a0bb4bc1c tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb9ff4b9d0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:23.163290 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-51c291e0-d0ed-4f5a-ad55-169180d101ea tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:23.177598 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-51c291e0-d0ed-4f5a-ad55-169180d101ea tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1552 microversion: 2.1 time: 0.601341 Apr 16 21:13:23.178214 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 934/1810] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:22 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1552 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:23.247374 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-69b2767b-4938-40b5-9e0e-4e0a0bb4bc1c tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/d631a0d5-6e5b-4edc-b753-706449e6c1ef" status: 200 len: 1412 microversion: 2.1 time: 0.189666 Apr 16 21:13:23.249576 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 877/1811] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:13:23 2022] GET /compute/v2.1/images/d631a0d5-6e5b-4edc-b753-706449e6c1ef => generated 1412 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:23.299508 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ba859e03-3678-4ad5-a478-30d3475e6051 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Action: 'create', calling method: .version_select at 0x7fbb9ff433a0>, body: {"keypair": {"name": "tempest-keypair-1036026036"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:13:23.338046 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-ba859e03-3678-4ad5-a478-30d3475e6051 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Getting quotas for project ce47d3657e50419183b9ee9cee309667. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:13:23.355204 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-ba859e03-3678-4ad5-a478-30d3475e6051 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Getting quotas for user 2420585eb37e469da0dab780bf553c2d and project ce47d3657e50419183b9ee9cee309667. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:13:23.550097 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-357792f4-2192-4dfa-be78-e6fd58ba0e25 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:23.556686 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-357792f4-2192-4dfa-be78-e6fd58ba0e25 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d9673504-31ed-4a93-abbd-67a338294f1f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:23.566837 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-357792f4-2192-4dfa-be78-e6fd58ba0e25 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:23.572482 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-357792f4-2192-4dfa-be78-e6fd58ba0e25 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:23.574863 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-357792f4-2192-4dfa-be78-e6fd58ba0e25 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:23.576970 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-357792f4-2192-4dfa-be78-e6fd58ba0e25 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:23.708282 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-ba859e03-3678-4ad5-a478-30d3475e6051 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Getting quotas for project ce47d3657e50419183b9ee9cee309667. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:13:23.724905 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-ba859e03-3678-4ad5-a478-30d3475e6051 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Getting quotas for user 2420585eb37e469da0dab780bf553c2d and project ce47d3657e50419183b9ee9cee309667. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:13:23.765327 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ba859e03-3678-4ad5-a478-30d3475e6051 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.32 time: 0.469151 Apr 16 21:13:23.771152 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 935/1812] 10.222.0.20 () {62 vars in 1198 bytes} [Sat Apr 16 21:13:23 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 478 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 16 21:13:23.771152 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d4a44d3c-b3f8-4263-8da9-1b0d94786dfd tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:23.771884 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d4a44d3c-b3f8-4263-8da9-1b0d94786dfd tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:23.789647 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d4a44d3c-b3f8-4263-8da9-1b0d94786dfd tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:23.790363 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d4a44d3c-b3f8-4263-8da9-1b0d94786dfd tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:23.791352 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d4a44d3c-b3f8-4263-8da9-1b0d94786dfd tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:23.798775 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d4a44d3c-b3f8-4263-8da9-1b0d94786dfd tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:24.128398 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-357792f4-2192-4dfa-be78-e6fd58ba0e25 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:24.150844 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-357792f4-2192-4dfa-be78-e6fd58ba0e25 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:24.152488 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-357792f4-2192-4dfa-be78-e6fd58ba0e25 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:24.154215 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-357792f4-2192-4dfa-be78-e6fd58ba0e25 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f" status: 200 len: 1281 microversion: 2.25 time: 0.608174 Apr 16 21:13:24.162195 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 878/1813] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:13:23 2022] GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f => generated 1281 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:13:24.174499 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3da5826d-3b36-4178-8dc1-3715eb3eeb45 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:24.175236 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3da5826d-3b36-4178-8dc1-3715eb3eeb45 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] [instance: cda4f042-eb49-4d90-ad5e-0e2b81dc0ede] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:24.183289 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d4a44d3c-b3f8-4263-8da9-1b0d94786dfd tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:24.194891 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3da5826d-3b36-4178-8dc1-3715eb3eeb45 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:24.196879 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d4a44d3c-b3f8-4263-8da9-1b0d94786dfd tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1198 microversion: 2.1 time: 0.429404 Apr 16 21:13:24.197833 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 936/1814] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:23 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1198 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:24.198026 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3da5826d-3b36-4178-8dc1-3715eb3eeb45 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:24.199174 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3da5826d-3b36-4178-8dc1-3715eb3eeb45 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:24.199646 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3da5826d-3b36-4178-8dc1-3715eb3eeb45 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:24.204444 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bc01c5a4-da73-43ef-931d-8a24c59c327d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:24.207461 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-bc01c5a4-da73-43ef-931d-8a24c59c327d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:24.224372 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bc01c5a4-da73-43ef-931d-8a24c59c327d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:24.224806 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bc01c5a4-da73-43ef-931d-8a24c59c327d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:24.227969 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bc01c5a4-da73-43ef-931d-8a24c59c327d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:24.228449 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bc01c5a4-da73-43ef-931d-8a24c59c327d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:24.514777 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3da5826d-3b36-4178-8dc1-3715eb3eeb45 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453306648f4e4da58ee344c3a51f8110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc15580ef8a449ca359a9d5b799e24d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:24.528897 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3da5826d-3b36-4178-8dc1-3715eb3eeb45 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] 10.222.0.20 "GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede" status: 200 len: 1615 microversion: 2.1 time: 0.366363 Apr 16 21:13:24.530885 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 879/1815] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:24 2022] GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede => generated 1615 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:24.543717 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d98ba1db-d8e1-4d5c-9f0a-a95e1a3e99e5 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb9feaa160>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:24.644527 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d98ba1db-d8e1-4d5c-9f0a-a95e1a3e99e5 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/d631a0d5-6e5b-4edc-b753-706449e6c1ef" status: 200 len: 1412 microversion: 2.1 time: 0.103299 Apr 16 21:13:24.645312 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 880/1816] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:13:24 2022] GET /compute/v2.1/images/d631a0d5-6e5b-4edc-b753-706449e6c1ef => generated 1412 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:24.995946 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-bc01c5a4-da73-43ef-931d-8a24c59c327d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:25.014712 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-bc01c5a4-da73-43ef-931d-8a24c59c327d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.815488 Apr 16 21:13:25.021077 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 937/1817] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:24 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:25.032281 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2291159e-ec7b-4e28-a73c-37fb7a3decf5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:25.033674 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2291159e-ec7b-4e28-a73c-37fb7a3decf5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:25.045818 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-63d69100-5a15-4e7f-92e5-3990c9ac07f5 req-156821b8-6a22-4ccf-8ae8-a584bba9e5bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cda4f042-eb49-4d90-ad5e-0e2b81dc0ede", "name": "network-vif-deleted", "tag": "341f7886-de89-42fb-840b-8879233ec19f"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:13:25.051632 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2291159e-ec7b-4e28-a73c-37fb7a3decf5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:25.052102 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2291159e-ec7b-4e28-a73c-37fb7a3decf5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:25.052936 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2291159e-ec7b-4e28-a73c-37fb7a3decf5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:25.053383 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2291159e-ec7b-4e28-a73c-37fb7a3decf5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:25.067795 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-63d69100-5a15-4e7f-92e5-3990c9ac07f5 req-156821b8-6a22-4ccf-8ae8-a584bba9e5bd service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:25.070416 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-63d69100-5a15-4e7f-92e5-3990c9ac07f5 req-156821b8-6a22-4ccf-8ae8-a584bba9e5bd service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:25.096300 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-63d69100-5a15-4e7f-92e5-3990c9ac07f5 req-156821b8-6a22-4ccf-8ae8-a584bba9e5bd service nova] Creating event network-vif-deleted:341f7886-de89-42fb-840b-8879233ec19f for instance cda4f042-eb49-4d90-ad5e-0e2b81dc0ede on nch2-master-1 Apr 16 21:13:25.103501 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-63d69100-5a15-4e7f-92e5-3990c9ac07f5 req-156821b8-6a22-4ccf-8ae8-a584bba9e5bd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061845 Apr 16 21:13:25.109800 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 938/1818] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:13:25.185770 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-432b3eb8-aee8-4790-a889-0083ccb432bd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:25.186486 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-432b3eb8-aee8-4790-a889-0083ccb432bd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d9673504-31ed-4a93-abbd-67a338294f1f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:25.211215 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-432b3eb8-aee8-4790-a889-0083ccb432bd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:25.212343 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-432b3eb8-aee8-4790-a889-0083ccb432bd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:25.217443 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-432b3eb8-aee8-4790-a889-0083ccb432bd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:25.217443 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-432b3eb8-aee8-4790-a889-0083ccb432bd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:25.587379 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-432b3eb8-aee8-4790-a889-0083ccb432bd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:25.599697 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-432b3eb8-aee8-4790-a889-0083ccb432bd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:25.604624 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-432b3eb8-aee8-4790-a889-0083ccb432bd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:25.605649 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-432b3eb8-aee8-4790-a889-0083ccb432bd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f" status: 200 len: 1477 microversion: 2.25 time: 0.431890 Apr 16 21:13:25.624707 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 939/1819] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:13:25 2022] GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f => generated 1477 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:13:25.631772 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-496f4489-1272-4b57-a0fc-be675ccc47d7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:25.633371 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-496f4489-1272-4b57-a0fc-be675ccc47d7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:25.653188 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-496f4489-1272-4b57-a0fc-be675ccc47d7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:25.653920 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-496f4489-1272-4b57-a0fc-be675ccc47d7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:25.654929 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-496f4489-1272-4b57-a0fc-be675ccc47d7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:25.655556 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-496f4489-1272-4b57-a0fc-be675ccc47d7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:26.034231 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2291159e-ec7b-4e28-a73c-37fb7a3decf5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:26.037433 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-496f4489-1272-4b57-a0fc-be675ccc47d7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:26.046381 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2291159e-ec7b-4e28-a73c-37fb7a3decf5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 1.015833 Apr 16 21:13:26.048822 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 881/1820] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:25 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:26.049483 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-496f4489-1272-4b57-a0fc-be675ccc47d7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1198 microversion: 2.1 time: 0.420212 Apr 16 21:13:26.050367 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 940/1821] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:25 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1198 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:26.070597 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8c774576-39cd-4c23-b8b6-b54fa4f04424 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:26.070597 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8c774576-39cd-4c23-b8b6-b54fa4f04424 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] [instance: cda4f042-eb49-4d90-ad5e-0e2b81dc0ede] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:26.084353 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8c774576-39cd-4c23-b8b6-b54fa4f04424 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:26.085014 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8c774576-39cd-4c23-b8b6-b54fa4f04424 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:26.085941 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8c774576-39cd-4c23-b8b6-b54fa4f04424 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:26.086451 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8c774576-39cd-4c23-b8b6-b54fa4f04424 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:26.149950 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8c774576-39cd-4c23-b8b6-b54fa4f04424 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:26.151100 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8c774576-39cd-4c23-b8b6-b54fa4f04424 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:26.151760 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-8c774576-39cd-4c23-b8b6-b54fa4f04424 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lazy-loading 'fault' on Instance uuid cda4f042-eb49-4d90-ad5e-0e2b81dc0ede {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:13:26.284649 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8c774576-39cd-4c23-b8b6-b54fa4f04424 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '453306648f4e4da58ee344c3a51f8110', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dc15580ef8a449ca359a9d5b799e24d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:26.305284 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8c774576-39cd-4c23-b8b6-b54fa4f04424 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] 10.222.0.20 "GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede" status: 200 len: 1332 microversion: 2.1 time: 0.250960 Apr 16 21:13:26.307077 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 882/1822] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:26 2022] GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede => generated 1332 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:26.331002 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-084b6719-f441-4a51-b93e-110ebd0a2237 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb95c870d0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:26.412058 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e202d25e-272d-4460-b67e-19d7e9a19162 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:26.413407 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e202d25e-272d-4460-b67e-19d7e9a19162 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] [instance: d9673504-31ed-4a93-abbd-67a338294f1f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:26.424393 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-084b6719-f441-4a51-b93e-110ebd0a2237 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/d631a0d5-6e5b-4edc-b753-706449e6c1ef" status: 200 len: 1412 microversion: 2.1 time: 0.115129 Apr 16 21:13:26.426927 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 883/1823] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:13:26 2022] GET /compute/v2.1/images/d631a0d5-6e5b-4edc-b753-706449e6c1ef => generated 1412 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:26.431599 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e202d25e-272d-4460-b67e-19d7e9a19162 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:26.432949 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e202d25e-272d-4460-b67e-19d7e9a19162 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:26.436812 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e202d25e-272d-4460-b67e-19d7e9a19162 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:26.437516 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e202d25e-272d-4460-b67e-19d7e9a19162 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:26.438831 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-15b901e5-73f0-4421-9aea-cf74f4ac6c3a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1710287208"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:13:26.446470 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-15b901e5-73f0-4421-9aea-cf74f4ac6c3a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:26.464699 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-15b901e5-73f0-4421-9aea-cf74f4ac6c3a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:26.465457 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-15b901e5-73f0-4421-9aea-cf74f4ac6c3a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:26.467293 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-15b901e5-73f0-4421-9aea-cf74f4ac6c3a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:26.467905 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-15b901e5-73f0-4421-9aea-cf74f4ac6c3a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:26.736494 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-e202d25e-272d-4460-b67e-19d7e9a19162 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lazy-loading 'services' on Instance uuid d9673504-31ed-4a93-abbd-67a338294f1f {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:13:26.766994 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e202d25e-272d-4460-b67e-19d7e9a19162 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f" status: 200 len: 1970 microversion: 2.25 time: 0.713753 Apr 16 21:13:26.767898 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 941/1824] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:13:26 2022] GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f => generated 1970 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:13:26.877571 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-33171b85-dc35-4db2-8b93-841b0077f0fe tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Action: 'create', calling method: .version_select at 0x7fbba001d9d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2012318941", "description": "tempest-description-179136879"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:13:27.195711 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-15b901e5-73f0-4421-9aea-cf74f4ac6c3a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "POST /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa/action" status: 202 len: 0 microversion: 2.1 time: 0.764656 Apr 16 21:13:27.196436 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 884/1825] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:13:26 2022] POST /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa/action => generated 0 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Apr 16 21:13:27.204909 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-01167a3a-61a3-45e8-90be-f2fbbf57fc43 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:27.205862 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-01167a3a-61a3-45e8-90be-f2fbbf57fc43 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] [instance: d9673504-31ed-4a93-abbd-67a338294f1f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:27.213423 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-01167a3a-61a3-45e8-90be-f2fbbf57fc43 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:27.219889 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-01167a3a-61a3-45e8-90be-f2fbbf57fc43 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:27.219889 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-01167a3a-61a3-45e8-90be-f2fbbf57fc43 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:27.219889 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-01167a3a-61a3-45e8-90be-f2fbbf57fc43 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:27.384796 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-01167a3a-61a3-45e8-90be-f2fbbf57fc43 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lazy-loading 'services' on Instance uuid d9673504-31ed-4a93-abbd-67a338294f1f {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:13:27.405055 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-01167a3a-61a3-45e8-90be-f2fbbf57fc43 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f" status: 200 len: 1970 microversion: 2.25 time: 0.207168 Apr 16 21:13:27.414089 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 885/1826] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:13:27 2022] GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f => generated 1970 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:13:27.414089 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9fb0b68e-3d52-46bb-bdd2-3ca7564f458a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:27.414089 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9fb0b68e-3d52-46bb-bdd2-3ca7564f458a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:27.419577 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9fb0b68e-3d52-46bb-bdd2-3ca7564f458a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:27.420370 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9fb0b68e-3d52-46bb-bdd2-3ca7564f458a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:27.421378 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9fb0b68e-3d52-46bb-bdd2-3ca7564f458a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:27.421992 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9fb0b68e-3d52-46bb-bdd2-3ca7564f458a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:27.596467 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9fb0b68e-3d52-46bb-bdd2-3ca7564f458a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:27.606954 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9fb0b68e-3d52-46bb-bdd2-3ca7564f458a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1198 microversion: 2.1 time: 0.197757 Apr 16 21:13:27.619341 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 886/1827] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:27 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1198 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:27.623336 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-96e08db0-5b98-472f-8c34-3d0fcdd4f373 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:27.623971 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-96e08db0-5b98-472f-8c34-3d0fcdd4f373 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] [instance: cda4f042-eb49-4d90-ad5e-0e2b81dc0ede] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:27.632436 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-96e08db0-5b98-472f-8c34-3d0fcdd4f373 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:27.633648 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-96e08db0-5b98-472f-8c34-3d0fcdd4f373 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:27.633900 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-96e08db0-5b98-472f-8c34-3d0fcdd4f373 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:27.634467 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-96e08db0-5b98-472f-8c34-3d0fcdd4f373 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:27.652050 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-96e08db0-5b98-472f-8c34-3d0fcdd4f373 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] HTTP exception thrown: Instance cda4f042-eb49-4d90-ad5e-0e2b81dc0ede could not be found. Apr 16 21:13:27.652883 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-96e08db0-5b98-472f-8c34-3d0fcdd4f373 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Returning 404 to user: Instance cda4f042-eb49-4d90-ad5e-0e2b81dc0ede could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:13:27.653790 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-96e08db0-5b98-472f-8c34-3d0fcdd4f373 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] 10.222.0.20 "GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede" status: 404 len: 111 microversion: 2.1 time: 0.035019 Apr 16 21:13:27.654678 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 887/1828] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:27 2022] GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:13:27.662700 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3f53e30c-0a24-44e6-ab00-6d0b605e1c6e tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:27.666520 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:13:27.666520 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:13:27.666520 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3f53e30c-0a24-44e6-ab00-6d0b605e1c6e tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:27.666520 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3f53e30c-0a24-44e6-ab00-6d0b605e1c6e tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:27.667374 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3f53e30c-0a24-44e6-ab00-6d0b605e1c6e tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:27.667374 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3f53e30c-0a24-44e6-ab00-6d0b605e1c6e tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:27.722573 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3f53e30c-0a24-44e6-ab00-6d0b605e1c6e tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.066765 Apr 16 21:13:27.730387 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 888/1829] 10.222.0.20 () {60 vars in 1216 bytes} [Sat Apr 16 21:13:27 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:13:27.736093 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1a560b2b-4403-44c3-812a-72686f78bbe0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb95c87040>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:27.789285 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1a560b2b-4403-44c3-812a-72686f78bbe0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/d631a0d5-6e5b-4edc-b753-706449e6c1ef" status: 200 len: 1412 microversion: 2.1 time: 0.057590 Apr 16 21:13:27.790295 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 889/1830] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:13:27 2022] GET /compute/v2.1/images/d631a0d5-6e5b-4edc-b753-706449e6c1ef => generated 1412 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:27.797922 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d8d92436-62dd-4faf-abbb-a7ae0cf2c8ea tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Calling method '.version_select at 0x7fbb9feaa700>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:27.857610 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-33171b85-dc35-4db2-8b93-841b0077f0fe tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.087612 Apr 16 21:13:27.859155 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 942/1831] 10.222.0.20 () {60 vars in 1179 bytes} [Sat Apr 16 21:13:26 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:13:27.869180 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-85ec2f90-2c14-49d1-b3ca-85327593a286 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch1-master-1", "block_migration": "auto"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:13:27.870689 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-85ec2f90-2c14-49d1-b3ca-85327593a286 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] [instance: d9673504-31ed-4a93-abbd-67a338294f1f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:27.882250 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-85ec2f90-2c14-49d1-b3ca-85327593a286 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:27.882722 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-85ec2f90-2c14-49d1-b3ca-85327593a286 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:27.883531 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-85ec2f90-2c14-49d1-b3ca-85327593a286 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:27.884219 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-85ec2f90-2c14-49d1-b3ca-85327593a286 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:27.911469 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d8d92436-62dd-4faf-abbb-a7ae0cf2c8ea tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1429791756" status: 202 len: 0 microversion: 2.1 time: 0.119694 Apr 16 21:13:27.912075 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 890/1832] 10.222.0.20 () {58 vars in 1220 bytes} [Sat Apr 16 21:13:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1429791756 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:13:27.921139 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-275862d2-9f81-4e9a-97fb-a283aad61b11 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Action: 'create', calling method: .version_select at 0x7fbb9ffa1ee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-133179858", "description": "tempest-description-1054084327"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:13:27.926354 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-85ec2f90-2c14-49d1-b3ca-85327593a286 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lazy-loading 'flavor' on Instance uuid d9673504-31ed-4a93-abbd-67a338294f1f {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:13:27.964622 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-85ec2f90-2c14-49d1-b3ca-85327593a286 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] [instance: d9673504-31ed-4a93-abbd-67a338294f1f] Going to try to live migrate instance to nch1-master-1 {{(pid=137408) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Apr 16 21:13:28.339402 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-275862d2-9f81-4e9a-97fb-a283aad61b11 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.425997 Apr 16 21:13:28.340090 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 891/1833] 10.222.0.20 () {60 vars in 1179 bytes} [Sat Apr 16 21:13:27 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:13:28.348490 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-03614070-d7b6-4618-b210-fa5b58cf9c13 req-ffabe985-46a8-4dfc-8288-9e9e566e25a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39df3a82-5cde-4311-8bec-5ce2d111d59e", "name": "network-vif-plugged", "status": "completed", "tag": "e220556c-73e1-42e1-a291-a4168a2b6289"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:13:28.365734 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-03614070-d7b6-4618-b210-fa5b58cf9c13 req-ffabe985-46a8-4dfc-8288-9e9e566e25a5 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:28.368822 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-03614070-d7b6-4618-b210-fa5b58cf9c13 req-ffabe985-46a8-4dfc-8288-9e9e566e25a5 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:28.392777 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-03614070-d7b6-4618-b210-fa5b58cf9c13 req-ffabe985-46a8-4dfc-8288-9e9e566e25a5 service nova] Creating event network-vif-plugged:e220556c-73e1-42e1-a291-a4168a2b6289 for instance 39df3a82-5cde-4311-8bec-5ce2d111d59e on nch1-master-1 Apr 16 21:13:28.400850 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-03614070-d7b6-4618-b210-fa5b58cf9c13 req-ffabe985-46a8-4dfc-8288-9e9e566e25a5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059418 Apr 16 21:13:28.404689 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 892/1834] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:13:28.410618 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f0761981-c7a4-4281-bcab-c44d4caa6650 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-2123586094", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "39451244-1104-46d3-8155-9d8d7ddc9546"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:13:28.606011 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-f0761981-c7a4-4281-bcab-c44d4caa6650 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] validate_networks() for [('39451244-1104-46d3-8155-9d8d7ddc9546', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:13:29.089644 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-f0761981-c7a4-4281-bcab-c44d4caa6650 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:13:29.094688 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-f0761981-c7a4-4281-bcab-c44d4caa6650 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:13:29.094688 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-f0761981-c7a4-4281-bcab-c44d4caa6650 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:13:29.094688 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-f0761981-c7a4-4281-bcab-c44d4caa6650 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:13:29.094688 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-f0761981-c7a4-4281-bcab-c44d4caa6650 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:13:29.101703 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f0761981-c7a4-4281-bcab-c44d4caa6650 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:29.102154 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f0761981-c7a4-4281-bcab-c44d4caa6650 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:29.102968 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f0761981-c7a4-4281-bcab-c44d4caa6650 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:29.103410 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f0761981-c7a4-4281-bcab-c44d4caa6650 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:29.122709 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-f0761981-c7a4-4281-bcab-c44d4caa6650 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Getting quotas for project fe50d9e0841749f094948101efdc3d92. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:13:29.129404 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-f0761981-c7a4-4281-bcab-c44d4caa6650 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Getting quotas for user c87e2c1601764f23ac7530b6ad66b3fd and project fe50d9e0841749f094948101efdc3d92. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:13:29.158903 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f0761981-c7a4-4281-bcab-c44d4caa6650 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:13:29.161512 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f0761981-c7a4-4281-bcab-c44d4caa6650 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 3f88efa6-8671-4565-aa09-bfbafc6ec242] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:13:29.339958 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f0761981-c7a4-4281-bcab-c44d4caa6650 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.933962 Apr 16 21:13:29.344409 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 893/1835] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:13:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 939 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:13:29.358426 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e0ba373e-bc4a-4744-b911-2013d49a078d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:29.359351 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e0ba373e-bc4a-4744-b911-2013d49a078d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:29.391319 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e0ba373e-bc4a-4744-b911-2013d49a078d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:29.396894 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e0ba373e-bc4a-4744-b911-2013d49a078d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:29.403163 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e0ba373e-bc4a-4744-b911-2013d49a078d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:29.403163 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e0ba373e-bc4a-4744-b911-2013d49a078d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:29.564832 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e0ba373e-bc4a-4744-b911-2013d49a078d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:29.572123 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e0ba373e-bc4a-4744-b911-2013d49a078d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1198 microversion: 2.1 time: 0.226402 Apr 16 21:13:29.572950 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 894/1836] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:29 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1198 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:29.578675 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-078dab7b-48df-4234-ae15-863b45ac4568 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb9ff4b700>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:30.358078 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-078dab7b-48df-4234-ae15-863b45ac4568 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/d631a0d5-6e5b-4edc-b753-706449e6c1ef" status: 200 len: 1421 microversion: 2.1 time: 0.784328 Apr 16 21:13:30.358671 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 895/1837] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:13:29 2022] GET /compute/v2.1/images/d631a0d5-6e5b-4edc-b753-706449e6c1ef => generated 1421 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:30.363429 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-02183253-9d49-4c46-a1d6-5a08500adde2 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1521223799", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "9ac8618f-14fb-4e3b-a70e-311a9f851d3d"}, {"port": "973da309-126f-4308-a6f4-32352abab6e7", "tag": "port-1"}, {"port": "b6827444-dd7b-4b83-a82d-0112e07ad27f", "tag": "port-2"}, {"uuid": "2a1311c2-594d-49ff-bcbd-69e881faa649", "tag": "net-1"}, {"uuid": "2a1311c2-594d-49ff-bcbd-69e881faa649"}, {"uuid": "84e05a77-422a-4fe5-a7de-668bfb04f621", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "84e05a77-422a-4fe5-a7de-668bfb04f621", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "00e6b7b1-560b-4bbb-b8e6-499709f33b8f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "743c3f5e-43a6-4c29-bbca-fd48d7b20968", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "7aad57cb-6f75-4d84-a883-22ddddb6aad5", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--56690772"}], "key_name": "tempest-keypair-1036026036", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:13:30.474258 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-02183253-9d49-4c46-a1d6-5a08500adde2 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] validate_networks() for [('9ac8618f-14fb-4e3b-a70e-311a9f851d3d', None, None, None, None, None), (None, None, '973da309-126f-4308-a6f4-32352abab6e7', None, None, None), (None, None, 'b6827444-dd7b-4b83-a82d-0112e07ad27f', None, None, None), ('2a1311c2-594d-49ff-bcbd-69e881faa649', None, None, None, None, None), ('2a1311c2-594d-49ff-bcbd-69e881faa649', None, None, None, None, None), ('84e05a77-422a-4fe5-a7de-668bfb04f621', '10.2.2.100', None, None, None, None), ('84e05a77-422a-4fe5-a7de-668bfb04f621', '10.2.2.200', None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:13:31.641410 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-85ec2f90-2c14-49d1-b3ca-85327593a286 tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f/action" status: 202 len: 0 microversion: 2.25 time: 3.780642 Apr 16 21:13:31.647057 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 943/1838] 10.222.0.20 () {62 vars in 1318 bytes} [Sat Apr 16 21:13:27 2022] POST /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f/action => generated 0 bytes in 3782 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:13:31.651149 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-117958e7-583d-4133-aedc-7127ae571401 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:31.651960 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-117958e7-583d-4133-aedc-7127ae571401 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 3f88efa6-8671-4565-aa09-bfbafc6ec242] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:31.659626 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-117958e7-583d-4133-aedc-7127ae571401 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:31.660097 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-117958e7-583d-4133-aedc-7127ae571401 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:31.660931 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-117958e7-583d-4133-aedc-7127ae571401 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:31.661386 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-117958e7-583d-4133-aedc-7127ae571401 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:31.737703 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-117958e7-583d-4133-aedc-7127ae571401 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87e2c1601764f23ac7530b6ad66b3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe50d9e0841749f094948101efdc3d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:31.745949 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-117958e7-583d-4133-aedc-7127ae571401 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "GET /compute/v2.1/servers/3f88efa6-8671-4565-aa09-bfbafc6ec242" status: 200 len: 1268 microversion: 2.1 time: 0.101286 Apr 16 21:13:31.746612 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 944/1839] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:31 2022] GET /compute/v2.1/servers/3f88efa6-8671-4565-aa09-bfbafc6ec242 => generated 1268 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:31.751925 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-424e6175-22f6-42d8-bdb8-c912952457b4 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbba001de50>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:31.809917 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-424e6175-22f6-42d8-bdb8-c912952457b4 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/d631a0d5-6e5b-4edc-b753-706449e6c1ef" status: 200 len: 1421 microversion: 2.1 time: 0.061567 Apr 16 21:13:31.816399 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 945/1840] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:13:31 2022] GET /compute/v2.1/images/d631a0d5-6e5b-4edc-b753-706449e6c1ef => generated 1421 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:31.821808 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c269656b-c5a5-4fd5-9129-f0982515ed0a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:31.822470 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c269656b-c5a5-4fd5-9129-f0982515ed0a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:31.828639 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c269656b-c5a5-4fd5-9129-f0982515ed0a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:31.829098 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c269656b-c5a5-4fd5-9129-f0982515ed0a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:31.829887 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c269656b-c5a5-4fd5-9129-f0982515ed0a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:31.830436 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c269656b-c5a5-4fd5-9129-f0982515ed0a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:31.986766 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c269656b-c5a5-4fd5-9129-f0982515ed0a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:32.000003 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c269656b-c5a5-4fd5-9129-f0982515ed0a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1382 microversion: 2.1 time: 0.182086 Apr 16 21:13:32.001240 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 946/1841] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:31 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1382 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:32.007094 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3119cf96-c92c-47d1-9c3f-f5fad3a0f140 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-336011179", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "b5f78b9b-3fd5-4910-aed9-d569c9b4e83c"}], "security_groups": [{"name": "tempest-securitygroup--71424604"}], "key_name": "tempest-keypair-1500824956", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "1706c0a9-c59e-4441-98fb-6e924e9769cf", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:13:32.123816 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-3119cf96-c92c-47d1-9c3f-f5fad3a0f140 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] validate_networks() for [('b5f78b9b-3fd5-4910-aed9-d569c9b4e83c', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:13:32.519346 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-3119cf96-c92c-47d1-9c3f-f5fad3a0f140 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Getting quotas for project 840fd4cbe2fd414bb97f14898bf9647d. Resources: dict_keys(['metadata_items']) {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:13:32.531111 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-3119cf96-c92c-47d1-9c3f-f5fad3a0f140 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Getting quotas for user 1a6ff623974d4156a05a7bd3e3b3ed5e and project 840fd4cbe2fd414bb97f14898bf9647d. Resources: dict_keys(['metadata_items']) {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:13:32.549153 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-3119cf96-c92c-47d1-9c3f-f5fad3a0f140 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:13:32.549591 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-3119cf96-c92c-47d1-9c3f-f5fad3a0f140 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:13:32.550078 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-3119cf96-c92c-47d1-9c3f-f5fad3a0f140 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:13:32.550497 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-3119cf96-c92c-47d1-9c3f-f5fad3a0f140 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:13:32.551179 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-3119cf96-c92c-47d1-9c3f-f5fad3a0f140 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:13:32.561392 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3119cf96-c92c-47d1-9c3f-f5fad3a0f140 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:32.562188 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3119cf96-c92c-47d1-9c3f-f5fad3a0f140 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:32.563243 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3119cf96-c92c-47d1-9c3f-f5fad3a0f140 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:32.564482 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3119cf96-c92c-47d1-9c3f-f5fad3a0f140 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:32.583164 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-3119cf96-c92c-47d1-9c3f-f5fad3a0f140 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Getting quotas for project 840fd4cbe2fd414bb97f14898bf9647d. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:13:32.589842 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-3119cf96-c92c-47d1-9c3f-f5fad3a0f140 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Getting quotas for user 1a6ff623974d4156a05a7bd3e3b3ed5e and project 840fd4cbe2fd414bb97f14898bf9647d. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:13:32.657276 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3119cf96-c92c-47d1-9c3f-f5fad3a0f140 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:13:32.660410 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3119cf96-c92c-47d1-9c3f-f5fad3a0f140 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] [instance: 58b86589-e35e-4b91-b192-9f744516f66f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1706c0a9-c59e-4441-98fb-6e924e9769cf',volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:13:33.107069 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3119cf96-c92c-47d1-9c3f-f5fad3a0f140 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.104524 Apr 16 21:13:33.113190 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 947/1842] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:13:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 1111 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:13:33.119071 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5df0a55f-0639-4949-a633-06619ca2e726 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:33.119904 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5df0a55f-0639-4949-a633-06619ca2e726 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d9673504-31ed-4a93-abbd-67a338294f1f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:33.128060 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5df0a55f-0639-4949-a633-06619ca2e726 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:33.129615 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5df0a55f-0639-4949-a633-06619ca2e726 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:33.131531 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5df0a55f-0639-4949-a633-06619ca2e726 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:33.132446 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5df0a55f-0639-4949-a633-06619ca2e726 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:33.254759 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-02183253-9d49-4c46-a1d6-5a08500adde2 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:13:33.255352 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-02183253-9d49-4c46-a1d6-5a08500adde2 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:13:33.255702 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-02183253-9d49-4c46-a1d6-5a08500adde2 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:13:33.256354 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-02183253-9d49-4c46-a1d6-5a08500adde2 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:13:33.256973 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-02183253-9d49-4c46-a1d6-5a08500adde2 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:13:33.273853 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-02183253-9d49-4c46-a1d6-5a08500adde2 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:33.274445 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-02183253-9d49-4c46-a1d6-5a08500adde2 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:33.275346 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-02183253-9d49-4c46-a1d6-5a08500adde2 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:33.276014 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-02183253-9d49-4c46-a1d6-5a08500adde2 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:33.297604 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5df0a55f-0639-4949-a633-06619ca2e726 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:33.299574 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-02183253-9d49-4c46-a1d6-5a08500adde2 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Getting quotas for project ce47d3657e50419183b9ee9cee309667. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:13:33.306170 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-02183253-9d49-4c46-a1d6-5a08500adde2 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Getting quotas for user 2420585eb37e469da0dab780bf553c2d and project ce47d3657e50419183b9ee9cee309667. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:13:33.311511 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5df0a55f-0639-4949-a633-06619ca2e726 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:33.313895 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5df0a55f-0639-4949-a633-06619ca2e726 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:33.315342 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5df0a55f-0639-4949-a633-06619ca2e726 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f" status: 200 len: 1487 microversion: 2.25 time: 0.200552 Apr 16 21:13:33.328377 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 948/1843] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:13:33 2022] GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f => generated 1487 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:13:33.338180 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a0cd7c63-8ca0-4f03-b116-3d6bb8e00b43 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb961440d0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:33.516508 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-02183253-9d49-4c46-a1d6-5a08500adde2 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:13:33.516641 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-02183253-9d49-4c46-a1d6-5a08500adde2 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='00e6b7b1-560b-4bbb-b8e6-499709f33b8f',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='743c3f5e-43a6-4c29-bbca-fd48d7b20968',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7aad57cb-6f75-4d84-a883-22ddddb6aad5',volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:13:34.778164 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a0cd7c63-8ca0-4f03-b116-3d6bb8e00b43 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "DELETE /compute/v2.1/images/d631a0d5-6e5b-4edc-b753-706449e6c1ef" status: 204 len: 0 microversion: 2.1 time: 1.448514 Apr 16 21:13:34.778799 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 949/1844] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:33 2022] DELETE /compute/v2.1/images/d631a0d5-6e5b-4edc-b753-706449e6c1ef => generated 0 bytes in 1450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:13:34.788058 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-728d24a0-fd58-4fd5-838c-322e915ef4c5 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:34.788058 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-728d24a0-fd58-4fd5-838c-322e915ef4c5 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:34.791593 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-728d24a0-fd58-4fd5-838c-322e915ef4c5 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:34.792056 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-728d24a0-fd58-4fd5-838c-322e915ef4c5 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:34.792916 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-728d24a0-fd58-4fd5-838c-322e915ef4c5 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:34.793624 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-728d24a0-fd58-4fd5-838c-322e915ef4c5 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:34.938586 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-728d24a0-fd58-4fd5-838c-322e915ef4c5 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1533 microversion: 2.1 time: 0.158412 Apr 16 21:13:34.941001 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 950/1845] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:34 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1533 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:34.948046 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-94933d8c-e83e-490a-8004-50474d7844d0 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:34.948915 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-94933d8c-e83e-490a-8004-50474d7844d0 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 3f88efa6-8671-4565-aa09-bfbafc6ec242] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:34.957127 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-94933d8c-e83e-490a-8004-50474d7844d0 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:34.957127 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-94933d8c-e83e-490a-8004-50474d7844d0 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:34.957702 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-94933d8c-e83e-490a-8004-50474d7844d0 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:34.958229 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-94933d8c-e83e-490a-8004-50474d7844d0 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:35.007085 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-02183253-9d49-4c46-a1d6-5a08500adde2 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.32 time: 4.647307 Apr 16 21:13:35.013286 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 896/1846] 10.222.0.20 () {62 vars in 1188 bytes} [Sat Apr 16 21:13:30 2022] POST /compute/v2.1/servers => generated 404 bytes in 4649 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 16 21:13:35.015389 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-89893046-8c58-428d-a9d8-d89efd45da1f tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:35.015389 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-89893046-8c58-428d-a9d8-d89efd45da1f tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] [instance: 58b86589-e35e-4b91-b192-9f744516f66f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:35.024210 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-89893046-8c58-428d-a9d8-d89efd45da1f tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:35.024690 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-89893046-8c58-428d-a9d8-d89efd45da1f tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:35.026729 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-89893046-8c58-428d-a9d8-d89efd45da1f tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:35.027372 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-89893046-8c58-428d-a9d8-d89efd45da1f tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:35.109838 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-89893046-8c58-428d-a9d8-d89efd45da1f tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a6ff623974d4156a05a7bd3e3b3ed5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840fd4cbe2fd414bb97f14898bf9647d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:35.120116 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-89893046-8c58-428d-a9d8-d89efd45da1f tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] 10.222.0.20 "GET /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f" status: 200 len: 1171 microversion: 2.1 time: 0.110732 Apr 16 21:13:35.122579 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 897/1847] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:35 2022] GET /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f => generated 1171 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:35.127811 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-06599e0c-dcb9-49bb-b2ed-d2a4e1fba030 req-96c55fab-4ee9-4819-95dc-5ca6d669f4cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ea94c91-140c-428c-8831-03efc8c571f6", "name": "network-vif-unplugged", "status": "completed", "tag": "92e3c39d-5eff-4b35-945a-25de4f5dce4b"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:13:35.138572 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-06599e0c-dcb9-49bb-b2ed-d2a4e1fba030 req-96c55fab-4ee9-4819-95dc-5ca6d669f4cf service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:35.139218 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-06599e0c-dcb9-49bb-b2ed-d2a4e1fba030 req-96c55fab-4ee9-4819-95dc-5ca6d669f4cf service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:35.154600 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-06599e0c-dcb9-49bb-b2ed-d2a4e1fba030 req-96c55fab-4ee9-4819-95dc-5ca6d669f4cf service nova] Creating event network-vif-unplugged:92e3c39d-5eff-4b35-945a-25de4f5dce4b for instance 9ea94c91-140c-428c-8831-03efc8c571f6 on nch1-master-1 Apr 16 21:13:35.162146 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-06599e0c-dcb9-49bb-b2ed-d2a4e1fba030 req-96c55fab-4ee9-4819-95dc-5ca6d669f4cf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037426 Apr 16 21:13:35.166992 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 898/1848] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:13:35.172901 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-94933d8c-e83e-490a-8004-50474d7844d0 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87e2c1601764f23ac7530b6ad66b3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe50d9e0841749f094948101efdc3d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:35.174106 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c6427822-17d9-460b-8d12-f370b7d2df35 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:35.175147 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c6427822-17d9-460b-8d12-f370b7d2df35 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d9673504-31ed-4a93-abbd-67a338294f1f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:35.186492 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c6427822-17d9-460b-8d12-f370b7d2df35 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:35.187333 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c6427822-17d9-460b-8d12-f370b7d2df35 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:35.187961 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-94933d8c-e83e-490a-8004-50474d7844d0 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "GET /compute/v2.1/servers/3f88efa6-8671-4565-aa09-bfbafc6ec242" status: 200 len: 1316 microversion: 2.1 time: 0.244779 Apr 16 21:13:35.188132 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c6427822-17d9-460b-8d12-f370b7d2df35 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:35.188772 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c6427822-17d9-460b-8d12-f370b7d2df35 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:35.189884 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 951/1849] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:34 2022] GET /compute/v2.1/servers/3f88efa6-8671-4565-aa09-bfbafc6ec242 => generated 1316 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:35.200327 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e75887f0-0bb3-4573-99d4-8c367f891007 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:35.202655 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e75887f0-0bb3-4573-99d4-8c367f891007 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9ea94c91-140c-428c-8831-03efc8c571f6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:35.217432 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e75887f0-0bb3-4573-99d4-8c367f891007 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:35.218098 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e75887f0-0bb3-4573-99d4-8c367f891007 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:35.219214 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e75887f0-0bb3-4573-99d4-8c367f891007 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:35.219932 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e75887f0-0bb3-4573-99d4-8c367f891007 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:35.250585 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e75887f0-0bb3-4573-99d4-8c367f891007 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9ea94c91-140c-428c-8831-03efc8c571f6] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:13:35.557897 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c6427822-17d9-460b-8d12-f370b7d2df35 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:35.570694 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c6427822-17d9-460b-8d12-f370b7d2df35 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:35.572391 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c6427822-17d9-460b-8d12-f370b7d2df35 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:35.573638 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c6427822-17d9-460b-8d12-f370b7d2df35 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f" status: 200 len: 1487 microversion: 2.25 time: 0.405277 Apr 16 21:13:35.574222 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 899/1850] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:13:35 2022] GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f => generated 1487 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:13:35.579222 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8d2c0368-e67a-483f-8b80-490bfcf73167 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:35.580203 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8d2c0368-e67a-483f-8b80-490bfcf73167 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:35.586647 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8d2c0368-e67a-483f-8b80-490bfcf73167 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:35.593632 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8d2c0368-e67a-483f-8b80-490bfcf73167 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:35.593632 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8d2c0368-e67a-483f-8b80-490bfcf73167 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:35.593632 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8d2c0368-e67a-483f-8b80-490bfcf73167 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:35.611939 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e75887f0-0bb3-4573-99d4-8c367f891007 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9ea94c91-140c-428c-8831-03efc8c571f6" status: 204 len: 0 microversion: 2.1 time: 0.420309 Apr 16 21:13:35.614862 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 952/1851] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:13:35 2022] DELETE /compute/v2.1/servers/9ea94c91-140c-428c-8831-03efc8c571f6 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:13:35.618275 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-1143adee-f0a9-49dc-a6a1-d01641b2ccdf req-a42c2b18-8c03-4817-8982-886ea0ce220c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f88efa6-8671-4565-aa09-bfbafc6ec242", "tag": "b97b89d8-fa8f-4e4a-ac51-14adc4d9a0d3"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:13:35.637151 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-1143adee-f0a9-49dc-a6a1-d01641b2ccdf req-a42c2b18-8c03-4817-8982-886ea0ce220c service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:35.638680 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-1143adee-f0a9-49dc-a6a1-d01641b2ccdf req-a42c2b18-8c03-4817-8982-886ea0ce220c service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:35.674122 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-1143adee-f0a9-49dc-a6a1-d01641b2ccdf req-a42c2b18-8c03-4817-8982-886ea0ce220c service nova] Creating event network-changed:b97b89d8-fa8f-4e4a-ac51-14adc4d9a0d3 for instance 3f88efa6-8671-4565-aa09-bfbafc6ec242 on nch2-master-1 Apr 16 21:13:35.688133 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-1143adee-f0a9-49dc-a6a1-d01641b2ccdf req-a42c2b18-8c03-4817-8982-886ea0ce220c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074075 Apr 16 21:13:35.692159 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 953/1852] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:13:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:13:35.704009 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fc8604eb-5c6c-46cd-9f14-d92145fa59dc tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:35.705262 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fc8604eb-5c6c-46cd-9f14-d92145fa59dc tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:35.805591 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fc8604eb-5c6c-46cd-9f14-d92145fa59dc tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:35.815064 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fc8604eb-5c6c-46cd-9f14-d92145fa59dc tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:35.816756 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fc8604eb-5c6c-46cd-9f14-d92145fa59dc tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:35.817930 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fc8604eb-5c6c-46cd-9f14-d92145fa59dc tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1286 microversion: 2.32 time: 0.124436 Apr 16 21:13:35.818973 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 954/1853] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:13:35 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1286 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:13:35.824397 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c6855592-ff4e-4863-a02d-83c56536d5cf tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1496135311", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "769f0aad-9fdd-4679-bf9a-69cbe3356918"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:13:35.934748 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-c6855592-ff4e-4863-a02d-83c56536d5cf tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] validate_networks() for [('769f0aad-9fdd-4679-bf9a-69cbe3356918', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:13:35.967811 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8d2c0368-e67a-483f-8b80-490bfcf73167 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1533 microversion: 2.1 time: 0.391802 Apr 16 21:13:35.976918 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 900/1854] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:35 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1533 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:35.987656 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a73c5ec3-1352-48ff-9ae4-b1178053c14d tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:35.989801 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:13:35.989801 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:13:35.993707 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a73c5ec3-1352-48ff-9ae4-b1178053c14d tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:35.995627 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a73c5ec3-1352-48ff-9ae4-b1178053c14d tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:35.997289 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a73c5ec3-1352-48ff-9ae4-b1178053c14d tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:35.998304 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a73c5ec3-1352-48ff-9ae4-b1178053c14d tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:36.025152 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a73c5ec3-1352-48ff-9ae4-b1178053c14d tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.044973 Apr 16 21:13:36.033952 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 901/1855] 10.222.0.20 () {58 vars in 1175 bytes} [Sat Apr 16 21:13:35 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:13:36.044151 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0acce37b-e3d4-4cd2-962b-6a3aa44f513e tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "nch2-master-1", "block_migration": false, "disk_over_commit": false}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:13:36.045735 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0acce37b-e3d4-4cd2-962b-6a3aa44f513e tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:36.053061 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0acce37b-e3d4-4cd2-962b-6a3aa44f513e tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:36.053521 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0acce37b-e3d4-4cd2-962b-6a3aa44f513e tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:36.054554 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0acce37b-e3d4-4cd2-962b-6a3aa44f513e tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:36.055222 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0acce37b-e3d4-4cd2-962b-6a3aa44f513e tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:36.116120 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-0acce37b-e3d4-4cd2-962b-6a3aa44f513e tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lazy-loading 'flavor' on Instance uuid 39df3a82-5cde-4311-8bec-5ce2d111d59e {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:13:36.136520 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0acce37b-e3d4-4cd2-962b-6a3aa44f513e tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Going to try to live migrate instance to nch2-master-1 {{(pid=137409) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Apr 16 21:13:36.524227 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-c6855592-ff4e-4863-a02d-83c56536d5cf tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:13:36.525092 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-c6855592-ff4e-4863-a02d-83c56536d5cf tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:13:36.525682 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-c6855592-ff4e-4863-a02d-83c56536d5cf tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:13:36.526330 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-c6855592-ff4e-4863-a02d-83c56536d5cf tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:13:36.526983 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-c6855592-ff4e-4863-a02d-83c56536d5cf tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:13:36.537122 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c6855592-ff4e-4863-a02d-83c56536d5cf tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:36.538170 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c6855592-ff4e-4863-a02d-83c56536d5cf tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:36.540044 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c6855592-ff4e-4863-a02d-83c56536d5cf tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:36.541909 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c6855592-ff4e-4863-a02d-83c56536d5cf tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:36.565309 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-c6855592-ff4e-4863-a02d-83c56536d5cf tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Getting quotas for project f95103d3663146e9ba6ffb49a05196b4. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:13:36.571590 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-c6855592-ff4e-4863-a02d-83c56536d5cf tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Getting quotas for user 3ad32f0114a44a3bac0c966003e312df and project f95103d3663146e9ba6ffb49a05196b4. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:13:36.601442 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c6855592-ff4e-4863-a02d-83c56536d5cf tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:13:36.604776 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c6855592-ff4e-4863-a02d-83c56536d5cf tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:13:36.753393 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c6855592-ff4e-4863-a02d-83c56536d5cf tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.933262 Apr 16 21:13:36.754633 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 955/1856] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:13:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:13:36.765682 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3660e749-64b7-4662-a11d-fb54b21f127b tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:36.768563 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3660e749-64b7-4662-a11d-fb54b21f127b tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] [instance: 58b86589-e35e-4b91-b192-9f744516f66f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:36.775261 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3660e749-64b7-4662-a11d-fb54b21f127b tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:36.776057 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3660e749-64b7-4662-a11d-fb54b21f127b tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:36.777128 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3660e749-64b7-4662-a11d-fb54b21f127b tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:36.777764 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3660e749-64b7-4662-a11d-fb54b21f127b tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:36.874928 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3660e749-64b7-4662-a11d-fb54b21f127b tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a6ff623974d4156a05a7bd3e3b3ed5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840fd4cbe2fd414bb97f14898bf9647d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:36.886319 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3660e749-64b7-4662-a11d-fb54b21f127b tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] 10.222.0.20 "GET /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f" status: 200 len: 1219 microversion: 2.1 time: 0.129775 Apr 16 21:13:36.888601 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 956/1857] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:36 2022] GET /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f => generated 1219 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:36.899103 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-efa14497-7b96-4cf5-8ec3-42b94ddbda9e tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:36.900003 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-efa14497-7b96-4cf5-8ec3-42b94ddbda9e tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 3f88efa6-8671-4565-aa09-bfbafc6ec242] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:36.922785 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-efa14497-7b96-4cf5-8ec3-42b94ddbda9e tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:36.923605 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-efa14497-7b96-4cf5-8ec3-42b94ddbda9e tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:36.924050 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-efa14497-7b96-4cf5-8ec3-42b94ddbda9e tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:36.926311 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-efa14497-7b96-4cf5-8ec3-42b94ddbda9e tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:37.159610 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-efa14497-7b96-4cf5-8ec3-42b94ddbda9e tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87e2c1601764f23ac7530b6ad66b3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe50d9e0841749f094948101efdc3d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:37.172825 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-efa14497-7b96-4cf5-8ec3-42b94ddbda9e tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "GET /compute/v2.1/servers/3f88efa6-8671-4565-aa09-bfbafc6ec242" status: 200 len: 1316 microversion: 2.1 time: 0.278637 Apr 16 21:13:37.178887 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 957/1858] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:36 2022] GET /compute/v2.1/servers/3f88efa6-8671-4565-aa09-bfbafc6ec242 => generated 1316 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:37.184784 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a23a1315-1979-4842-8a72-eba7b5756a93 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:37.185410 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a23a1315-1979-4842-8a72-eba7b5756a93 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d9673504-31ed-4a93-abbd-67a338294f1f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:37.193193 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a23a1315-1979-4842-8a72-eba7b5756a93 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:37.195819 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a23a1315-1979-4842-8a72-eba7b5756a93 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:37.195819 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a23a1315-1979-4842-8a72-eba7b5756a93 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:37.195819 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a23a1315-1979-4842-8a72-eba7b5756a93 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:37.356640 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a23a1315-1979-4842-8a72-eba7b5756a93 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:37.368650 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a23a1315-1979-4842-8a72-eba7b5756a93 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:37.370863 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a23a1315-1979-4842-8a72-eba7b5756a93 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:37.372610 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a23a1315-1979-4842-8a72-eba7b5756a93 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f" status: 200 len: 1487 microversion: 2.25 time: 0.192162 Apr 16 21:13:37.373588 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 958/1859] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:13:37 2022] GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f => generated 1487 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:13:37.382123 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4ef66c2d-d2d6-4735-8088-6e0e2c71c7c0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:37.382960 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4ef66c2d-d2d6-4735-8088-6e0e2c71c7c0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:37.455518 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4ef66c2d-d2d6-4735-8088-6e0e2c71c7c0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:37.462728 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4ef66c2d-d2d6-4735-8088-6e0e2c71c7c0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1208 microversion: 2.1 time: 0.085076 Apr 16 21:13:37.464447 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 959/1860] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:37 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1208 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:37.486503 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c3289a08-3e52-4f6a-bc18-8c1345003c14 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:37.491970 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c3289a08-3e52-4f6a-bc18-8c1345003c14 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:37.498363 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3289a08-3e52-4f6a-bc18-8c1345003c14 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:37.498925 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3289a08-3e52-4f6a-bc18-8c1345003c14 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:37.500094 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3289a08-3e52-4f6a-bc18-8c1345003c14 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:37.500782 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3289a08-3e52-4f6a-bc18-8c1345003c14 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:37.631720 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c3289a08-3e52-4f6a-bc18-8c1345003c14 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:37.645399 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c3289a08-3e52-4f6a-bc18-8c1345003c14 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:37.647056 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c3289a08-3e52-4f6a-bc18-8c1345003c14 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:37.648486 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c3289a08-3e52-4f6a-bc18-8c1345003c14 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1528 microversion: 2.32 time: 0.182693 Apr 16 21:13:37.661321 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 960/1861] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:13:37 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1528 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:13:37.666397 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b057dd72-2ad1-4096-9ed6-a2cee5136334 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:37.666906 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b057dd72-2ad1-4096-9ed6-a2cee5136334 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] [instance: cda4f042-eb49-4d90-ad5e-0e2b81dc0ede] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:37.682764 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b057dd72-2ad1-4096-9ed6-a2cee5136334 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:37.683228 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b057dd72-2ad1-4096-9ed6-a2cee5136334 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:37.684033 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b057dd72-2ad1-4096-9ed6-a2cee5136334 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:37.685042 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b057dd72-2ad1-4096-9ed6-a2cee5136334 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:37.704953 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-b057dd72-2ad1-4096-9ed6-a2cee5136334 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] HTTP exception thrown: Instance cda4f042-eb49-4d90-ad5e-0e2b81dc0ede could not be found. Apr 16 21:13:37.705610 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b057dd72-2ad1-4096-9ed6-a2cee5136334 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Returning 404 to user: Instance cda4f042-eb49-4d90-ad5e-0e2b81dc0ede could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:13:37.706475 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b057dd72-2ad1-4096-9ed6-a2cee5136334 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede" status: 404 len: 111 microversion: 2.1 time: 0.044114 Apr 16 21:13:37.707190 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 961/1862] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:13:37 2022] DELETE /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:13:37.714834 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-9fb3c367-5d0d-4fa1-aea0-b527c907cc75 req-9d48f8aa-ab44-4b5c-9278-84bdb9b54ec1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98ca4f4e-246a-449b-b9fd-e1c17e119faa", "name": "network-vif-plugged", "status": "completed", "tag": "9bc5b971-3aa6-49d0-8b96-ab0e7cb12588"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:13:37.724232 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-9fb3c367-5d0d-4fa1-aea0-b527c907cc75 req-9d48f8aa-ab44-4b5c-9278-84bdb9b54ec1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:37.724961 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-9fb3c367-5d0d-4fa1-aea0-b527c907cc75 req-9d48f8aa-ab44-4b5c-9278-84bdb9b54ec1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:37.738520 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-9fb3c367-5d0d-4fa1-aea0-b527c907cc75 req-9d48f8aa-ab44-4b5c-9278-84bdb9b54ec1 service nova] Creating event network-vif-plugged:9bc5b971-3aa6-49d0-8b96-ab0e7cb12588 for instance 98ca4f4e-246a-449b-b9fd-e1c17e119faa on nch2-master-1 Apr 16 21:13:37.744047 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-9fb3c367-5d0d-4fa1-aea0-b527c907cc75 req-9d48f8aa-ab44-4b5c-9278-84bdb9b54ec1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035261 Apr 16 21:13:37.744906 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 962/1863] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:13:37.750735 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5d941555-9e2a-4742-a5f8-396e2a15c505 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:37.751385 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5d941555-9e2a-4742-a5f8-396e2a15c505 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] [instance: cda4f042-eb49-4d90-ad5e-0e2b81dc0ede] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:37.758101 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5d941555-9e2a-4742-a5f8-396e2a15c505 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:37.758604 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5d941555-9e2a-4742-a5f8-396e2a15c505 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:37.759468 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5d941555-9e2a-4742-a5f8-396e2a15c505 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:37.759931 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5d941555-9e2a-4742-a5f8-396e2a15c505 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:37.775544 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-5d941555-9e2a-4742-a5f8-396e2a15c505 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] HTTP exception thrown: Instance cda4f042-eb49-4d90-ad5e-0e2b81dc0ede could not be found. Apr 16 21:13:37.776295 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5d941555-9e2a-4742-a5f8-396e2a15c505 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] Returning 404 to user: Instance cda4f042-eb49-4d90-ad5e-0e2b81dc0ede could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:13:37.777196 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5d941555-9e2a-4742-a5f8-396e2a15c505 tempest-AttachSCSIVolumeTestJSON-1617782912 tempest-AttachSCSIVolumeTestJSON-1617782912-project] 10.222.0.20 "GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede" status: 404 len: 111 microversion: 2.1 time: 0.031144 Apr 16 21:13:37.778119 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 963/1864] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:37 2022] GET /compute/v2.1/servers/cda4f042-eb49-4d90-ad5e-0e2b81dc0ede => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:13:37.908649 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-251372f3-d58f-468b-b7ff-665e8ef73dd9 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:37.910477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-251372f3-d58f-468b-b7ff-665e8ef73dd9 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] [instance: 58b86589-e35e-4b91-b192-9f744516f66f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:37.918415 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-251372f3-d58f-468b-b7ff-665e8ef73dd9 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:37.918914 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-251372f3-d58f-468b-b7ff-665e8ef73dd9 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:37.919943 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-251372f3-d58f-468b-b7ff-665e8ef73dd9 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:37.920437 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-251372f3-d58f-468b-b7ff-665e8ef73dd9 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:38.018831 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-251372f3-d58f-468b-b7ff-665e8ef73dd9 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a6ff623974d4156a05a7bd3e3b3ed5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840fd4cbe2fd414bb97f14898bf9647d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:38.028512 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-251372f3-d58f-468b-b7ff-665e8ef73dd9 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] 10.222.0.20 "GET /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f" status: 200 len: 1227 microversion: 2.1 time: 0.126476 Apr 16 21:13:38.039308 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 964/1865] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:37 2022] GET /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f => generated 1227 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:13:38.193301 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d40ab4ca-1ddb-4918-838b-8ec7ff467905 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:38.194940 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d40ab4ca-1ddb-4918-838b-8ec7ff467905 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 3f88efa6-8671-4565-aa09-bfbafc6ec242] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:38.211227 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d40ab4ca-1ddb-4918-838b-8ec7ff467905 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:38.211976 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d40ab4ca-1ddb-4918-838b-8ec7ff467905 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:38.214394 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d40ab4ca-1ddb-4918-838b-8ec7ff467905 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:38.217316 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d40ab4ca-1ddb-4918-838b-8ec7ff467905 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:38.440439 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d40ab4ca-1ddb-4918-838b-8ec7ff467905 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87e2c1601764f23ac7530b6ad66b3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe50d9e0841749f094948101efdc3d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:38.454018 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d40ab4ca-1ddb-4918-838b-8ec7ff467905 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "GET /compute/v2.1/servers/3f88efa6-8671-4565-aa09-bfbafc6ec242" status: 200 len: 1316 microversion: 2.1 time: 0.271081 Apr 16 21:13:38.455993 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 965/1866] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:38 2022] GET /compute/v2.1/servers/3f88efa6-8671-4565-aa09-bfbafc6ec242 => generated 1316 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:13:38.476333 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cf170526-937c-4ad1-95c5-add050c15f56 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:38.477418 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cf170526-937c-4ad1-95c5-add050c15f56 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d9673504-31ed-4a93-abbd-67a338294f1f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:38.487440 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cf170526-937c-4ad1-95c5-add050c15f56 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:38.489091 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cf170526-937c-4ad1-95c5-add050c15f56 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:38.490884 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cf170526-937c-4ad1-95c5-add050c15f56 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:38.495032 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cf170526-937c-4ad1-95c5-add050c15f56 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:38.770434 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cf170526-937c-4ad1-95c5-add050c15f56 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:38.786882 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cf170526-937c-4ad1-95c5-add050c15f56 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:38.791598 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cf170526-937c-4ad1-95c5-add050c15f56 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:38.793500 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cf170526-937c-4ad1-95c5-add050c15f56 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f" status: 200 len: 1487 microversion: 2.25 time: 0.335875 Apr 16 21:13:38.796020 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 966/1867] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:13:38 2022] GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f => generated 1487 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:13:38.801993 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-675eba8d-1f48-45d5-9470-e0e8d788d3c9 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:38.802871 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-675eba8d-1f48-45d5-9470-e0e8d788d3c9 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:38.813930 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-675eba8d-1f48-45d5-9470-e0e8d788d3c9 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:38.815985 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-675eba8d-1f48-45d5-9470-e0e8d788d3c9 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:38.817917 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-675eba8d-1f48-45d5-9470-e0e8d788d3c9 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:38.827750 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-675eba8d-1f48-45d5-9470-e0e8d788d3c9 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:39.005365 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-675eba8d-1f48-45d5-9470-e0e8d788d3c9 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:39.016616 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-675eba8d-1f48-45d5-9470-e0e8d788d3c9 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1204 microversion: 2.1 time: 0.219253 Apr 16 21:13:39.017558 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 967/1868] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:38 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1204 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:39.031983 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e334c1dd-9229-4c50-b3c4-f8272b84fa8c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:39.033132 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e334c1dd-9229-4c50-b3c4-f8272b84fa8c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:39.044565 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e334c1dd-9229-4c50-b3c4-f8272b84fa8c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:39.049431 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e334c1dd-9229-4c50-b3c4-f8272b84fa8c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:39.066219 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e334c1dd-9229-4c50-b3c4-f8272b84fa8c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:39.069301 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e334c1dd-9229-4c50-b3c4-f8272b84fa8c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:39.146782 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e334c1dd-9229-4c50-b3c4-f8272b84fa8c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:39.159568 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e334c1dd-9229-4c50-b3c4-f8272b84fa8c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:39.161390 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e334c1dd-9229-4c50-b3c4-f8272b84fa8c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:39.162796 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e334c1dd-9229-4c50-b3c4-f8272b84fa8c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1520 microversion: 2.32 time: 0.144228 Apr 16 21:13:39.164009 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 968/1869] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:13:39 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1520 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:13:39.169413 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-40506bc3-2f51-4e04-a09d-8600d236368d tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:39.170250 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-40506bc3-2f51-4e04-a09d-8600d236368d tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] [instance: 58b86589-e35e-4b91-b192-9f744516f66f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:39.179809 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40506bc3-2f51-4e04-a09d-8600d236368d tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:39.180408 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40506bc3-2f51-4e04-a09d-8600d236368d tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:39.181272 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40506bc3-2f51-4e04-a09d-8600d236368d tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:39.181784 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40506bc3-2f51-4e04-a09d-8600d236368d tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:39.315139 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-40506bc3-2f51-4e04-a09d-8600d236368d tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a6ff623974d4156a05a7bd3e3b3ed5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840fd4cbe2fd414bb97f14898bf9647d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:39.324320 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-40506bc3-2f51-4e04-a09d-8600d236368d tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] 10.222.0.20 "GET /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f" status: 200 len: 1237 microversion: 2.1 time: 0.158902 Apr 16 21:13:39.324911 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 969/1870] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:39 2022] GET /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f => generated 1237 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:39.473277 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a0d24a04-1831-41bf-9758-547e9694d49c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:39.473899 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a0d24a04-1831-41bf-9758-547e9694d49c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 3f88efa6-8671-4565-aa09-bfbafc6ec242] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:39.525544 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a0d24a04-1831-41bf-9758-547e9694d49c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:39.526225 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a0d24a04-1831-41bf-9758-547e9694d49c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:39.532350 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a0d24a04-1831-41bf-9758-547e9694d49c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:39.533878 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a0d24a04-1831-41bf-9758-547e9694d49c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:39.869839 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a0d24a04-1831-41bf-9758-547e9694d49c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87e2c1601764f23ac7530b6ad66b3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe50d9e0841749f094948101efdc3d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:39.881689 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a0d24a04-1831-41bf-9758-547e9694d49c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "GET /compute/v2.1/servers/3f88efa6-8671-4565-aa09-bfbafc6ec242" status: 200 len: 1316 microversion: 2.1 time: 0.411815 Apr 16 21:13:39.892804 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 970/1871] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:39 2022] GET /compute/v2.1/servers/3f88efa6-8671-4565-aa09-bfbafc6ec242 => generated 1316 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:39.897872 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-54a00de4-e06d-4339-a951-9f8d25ee46a8 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:39.898490 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-54a00de4-e06d-4339-a951-9f8d25ee46a8 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d9673504-31ed-4a93-abbd-67a338294f1f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:39.907527 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-54a00de4-e06d-4339-a951-9f8d25ee46a8 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:39.908520 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-54a00de4-e06d-4339-a951-9f8d25ee46a8 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:39.909471 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-54a00de4-e06d-4339-a951-9f8d25ee46a8 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:39.910139 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-54a00de4-e06d-4339-a951-9f8d25ee46a8 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:40.133056 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-54a00de4-e06d-4339-a951-9f8d25ee46a8 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:40.144676 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-54a00de4-e06d-4339-a951-9f8d25ee46a8 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:40.146844 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-54a00de4-e06d-4339-a951-9f8d25ee46a8 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:40.147936 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-54a00de4-e06d-4339-a951-9f8d25ee46a8 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f" status: 200 len: 1487 microversion: 2.25 time: 0.253955 Apr 16 21:13:40.148988 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 971/1872] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:13:39 2022] GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f => generated 1487 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:13:40.159300 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0f91c183-20bd-4cf3-9727-afd8e9d3562a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:40.160037 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0f91c183-20bd-4cf3-9727-afd8e9d3562a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:40.166608 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0f91c183-20bd-4cf3-9727-afd8e9d3562a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:40.167173 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0f91c183-20bd-4cf3-9727-afd8e9d3562a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:40.168086 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0f91c183-20bd-4cf3-9727-afd8e9d3562a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:40.168651 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0f91c183-20bd-4cf3-9727-afd8e9d3562a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:40.268842 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0f91c183-20bd-4cf3-9727-afd8e9d3562a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:40.280450 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0f91c183-20bd-4cf3-9727-afd8e9d3562a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1268 microversion: 2.1 time: 0.125713 Apr 16 21:13:40.281076 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 972/1873] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:40 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1268 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:40.290075 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b3484951-d959-4dd6-84a6-29c30cbee8a5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:40.291686 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b3484951-d959-4dd6-84a6-29c30cbee8a5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:40.303290 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b3484951-d959-4dd6-84a6-29c30cbee8a5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:40.303757 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b3484951-d959-4dd6-84a6-29c30cbee8a5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:40.304614 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b3484951-d959-4dd6-84a6-29c30cbee8a5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:40.305037 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b3484951-d959-4dd6-84a6-29c30cbee8a5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:40.479003 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b3484951-d959-4dd6-84a6-29c30cbee8a5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:40.493510 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b3484951-d959-4dd6-84a6-29c30cbee8a5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:40.495130 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b3484951-d959-4dd6-84a6-29c30cbee8a5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:40.496327 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b3484951-d959-4dd6-84a6-29c30cbee8a5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1576 microversion: 2.32 time: 0.214267 Apr 16 21:13:40.509443 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 973/1874] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:13:40 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1576 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:13:40.509443 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-9340a193-35a7-4a31-888b-9593f4d1f8a7 req-430dd27d-8a00-4aa0-963e-c9b1265e6373 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9673504-31ed-4a93-abbd-67a338294f1f", "name": "network-vif-unplugged", "status": "completed", "tag": "5d34bb81-13df-419f-85d3-8e3a86be7e32"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:13:40.517437 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-9340a193-35a7-4a31-888b-9593f4d1f8a7 req-430dd27d-8a00-4aa0-963e-c9b1265e6373 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:40.517573 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-9340a193-35a7-4a31-888b-9593f4d1f8a7 req-430dd27d-8a00-4aa0-963e-c9b1265e6373 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:40.548639 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-9340a193-35a7-4a31-888b-9593f4d1f8a7 req-430dd27d-8a00-4aa0-963e-c9b1265e6373 service nova] Creating event network-vif-unplugged:5d34bb81-13df-419f-85d3-8e3a86be7e32 for instance d9673504-31ed-4a93-abbd-67a338294f1f on nch2-master-1 Apr 16 21:13:40.556810 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0acce37b-e3d4-4cd2-962b-6a3aa44f513e tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e/action" status: 202 len: 0 microversion: 2.1 time: 4.521233 Apr 16 21:13:40.561275 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 902/1875] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:13:36 2022] POST /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e/action => generated 0 bytes in 4526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:13:40.569534 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-99e3732c-3cfc-408d-a65c-553bb34b7e7a tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:40.576473 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-99e3732c-3cfc-408d-a65c-553bb34b7e7a tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] [instance: 58b86589-e35e-4b91-b192-9f744516f66f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:40.588661 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-9340a193-35a7-4a31-888b-9593f4d1f8a7 req-430dd27d-8a00-4aa0-963e-c9b1265e6373 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088901 Apr 16 21:13:40.589507 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 974/1876] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:13:40.600449 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-99e3732c-3cfc-408d-a65c-553bb34b7e7a tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:40.600906 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-99e3732c-3cfc-408d-a65c-553bb34b7e7a tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:40.601707 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-99e3732c-3cfc-408d-a65c-553bb34b7e7a tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:40.602150 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-99e3732c-3cfc-408d-a65c-553bb34b7e7a tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:40.880466 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ea80f9a7-9c5c-4dbf-a2c2-f8c3f4e33aea tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:40.881189 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ea80f9a7-9c5c-4dbf-a2c2-f8c3f4e33aea tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:40.894466 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ea80f9a7-9c5c-4dbf-a2c2-f8c3f4e33aea tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:40.895318 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ea80f9a7-9c5c-4dbf-a2c2-f8c3f4e33aea tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:40.923857 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ea80f9a7-9c5c-4dbf-a2c2-f8c3f4e33aea tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:40.924528 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ea80f9a7-9c5c-4dbf-a2c2-f8c3f4e33aea tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:41.007025 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-99e3732c-3cfc-408d-a65c-553bb34b7e7a tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a6ff623974d4156a05a7bd3e3b3ed5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840fd4cbe2fd414bb97f14898bf9647d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:41.016662 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-99e3732c-3cfc-408d-a65c-553bb34b7e7a tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] 10.222.0.20 "GET /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f" status: 200 len: 1237 microversion: 2.1 time: 0.454217 Apr 16 21:13:41.024715 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 903/1877] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:40 2022] GET /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f => generated 1237 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:41.040841 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-10d849ba-09cb-4d2c-8114-6cfa681604ec tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:41.041818 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-10d849ba-09cb-4d2c-8114-6cfa681604ec tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 3f88efa6-8671-4565-aa09-bfbafc6ec242] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:41.048542 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-10d849ba-09cb-4d2c-8114-6cfa681604ec tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:41.049330 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-10d849ba-09cb-4d2c-8114-6cfa681604ec tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:41.050352 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-10d849ba-09cb-4d2c-8114-6cfa681604ec tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:41.051024 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-10d849ba-09cb-4d2c-8114-6cfa681604ec tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:41.296775 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ea80f9a7-9c5c-4dbf-a2c2-f8c3f4e33aea tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:41.316609 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ea80f9a7-9c5c-4dbf-a2c2-f8c3f4e33aea tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1392 microversion: 2.1 time: 0.726075 Apr 16 21:13:41.321376 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 975/1878] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:40 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1392 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:41.335124 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-41b86d29-22b1-44d3-ab21-2b5f154d8c06 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:41.336051 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-41b86d29-22b1-44d3-ab21-2b5f154d8c06 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d9673504-31ed-4a93-abbd-67a338294f1f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:41.344037 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-41b86d29-22b1-44d3-ab21-2b5f154d8c06 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:41.351679 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-41b86d29-22b1-44d3-ab21-2b5f154d8c06 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:41.352928 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-41b86d29-22b1-44d3-ab21-2b5f154d8c06 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:41.354335 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-41b86d29-22b1-44d3-ab21-2b5f154d8c06 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:42.340798 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-41b86d29-22b1-44d3-ab21-2b5f154d8c06 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:42.366659 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-41b86d29-22b1-44d3-ab21-2b5f154d8c06 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:42.375482 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-41b86d29-22b1-44d3-ab21-2b5f154d8c06 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:42.376861 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-41b86d29-22b1-44d3-ab21-2b5f154d8c06 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f" status: 200 len: 1487 microversion: 2.25 time: 1.054322 Apr 16 21:13:42.379646 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 976/1879] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:13:41 2022] GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f => generated 1487 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:13:42.405256 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2cfb3d4d-6613-4b72-848c-52c235175b9d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:42.409920 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2cfb3d4d-6613-4b72-848c-52c235175b9d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:42.421960 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2cfb3d4d-6613-4b72-848c-52c235175b9d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:42.422798 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2cfb3d4d-6613-4b72-848c-52c235175b9d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:42.426324 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2cfb3d4d-6613-4b72-848c-52c235175b9d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:42.427068 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2cfb3d4d-6613-4b72-848c-52c235175b9d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:42.573822 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-10d849ba-09cb-4d2c-8114-6cfa681604ec tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87e2c1601764f23ac7530b6ad66b3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe50d9e0841749f094948101efdc3d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:42.586068 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-10d849ba-09cb-4d2c-8114-6cfa681604ec tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "GET /compute/v2.1/servers/3f88efa6-8671-4565-aa09-bfbafc6ec242" status: 200 len: 1316 microversion: 2.1 time: 1.548778 Apr 16 21:13:42.600559 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 904/1880] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:41 2022] GET /compute/v2.1/servers/3f88efa6-8671-4565-aa09-bfbafc6ec242 => generated 1316 bytes in 1575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:42.612741 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bf30fbe1-e369-4858-b75c-fcf5ce369c3e tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:42.616767 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bf30fbe1-e369-4858-b75c-fcf5ce369c3e tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:42.635420 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bf30fbe1-e369-4858-b75c-fcf5ce369c3e tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:42.637766 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bf30fbe1-e369-4858-b75c-fcf5ce369c3e tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:42.639810 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bf30fbe1-e369-4858-b75c-fcf5ce369c3e tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:42.640546 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bf30fbe1-e369-4858-b75c-fcf5ce369c3e tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:43.110425 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-bf30fbe1-e369-4858-b75c-fcf5ce369c3e tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:43.129960 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-bf30fbe1-e369-4858-b75c-fcf5ce369c3e tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:43.135161 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-bf30fbe1-e369-4858-b75c-fcf5ce369c3e tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:43.137617 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bf30fbe1-e369-4858-b75c-fcf5ce369c3e tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1594 microversion: 2.32 time: 0.533805 Apr 16 21:13:43.141094 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 905/1881] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:13:42 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1594 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:13:43.152482 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-82fec0a5-2a0b-4a71-86cd-e36066bb8cd9 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:43.164062 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-82fec0a5-2a0b-4a71-86cd-e36066bb8cd9 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] [instance: 58b86589-e35e-4b91-b192-9f744516f66f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:43.175171 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-82fec0a5-2a0b-4a71-86cd-e36066bb8cd9 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:43.176805 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-82fec0a5-2a0b-4a71-86cd-e36066bb8cd9 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:43.177791 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-82fec0a5-2a0b-4a71-86cd-e36066bb8cd9 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:43.180401 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-82fec0a5-2a0b-4a71-86cd-e36066bb8cd9 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:43.311017 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2cfb3d4d-6613-4b72-848c-52c235175b9d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:43.323825 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2cfb3d4d-6613-4b72-848c-52c235175b9d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1308 microversion: 2.1 time: 0.930953 Apr 16 21:13:43.327755 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 977/1882] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:42 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1308 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:43.338747 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-38edb0f1-4aa8-463f-85db-949f67ec413a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:43.339705 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-38edb0f1-4aa8-463f-85db-949f67ec413a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:43.359504 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-38edb0f1-4aa8-463f-85db-949f67ec413a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:43.362272 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-38edb0f1-4aa8-463f-85db-949f67ec413a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:43.363488 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-38edb0f1-4aa8-463f-85db-949f67ec413a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:43.367078 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-38edb0f1-4aa8-463f-85db-949f67ec413a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:44.126441 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-82fec0a5-2a0b-4a71-86cd-e36066bb8cd9 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a6ff623974d4156a05a7bd3e3b3ed5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840fd4cbe2fd414bb97f14898bf9647d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:44.136972 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-82fec0a5-2a0b-4a71-86cd-e36066bb8cd9 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] 10.222.0.20 "GET /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f" status: 200 len: 1291 microversion: 2.1 time: 0.990780 Apr 16 21:13:44.140049 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 906/1883] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:43 2022] GET /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f => generated 1291 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:44.152069 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-38800df7-aee4-4255-8bb1-63afd90134e7 req-37407e78-b81d-4dec-a0fb-74333e2c05eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ea94c91-140c-428c-8831-03efc8c571f6", "name": "network-vif-deleted", "tag": "92e3c39d-5eff-4b35-945a-25de4f5dce4b"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:13:44.179993 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-38800df7-aee4-4255-8bb1-63afd90134e7 req-37407e78-b81d-4dec-a0fb-74333e2c05eb service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:44.180476 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-38800df7-aee4-4255-8bb1-63afd90134e7 req-37407e78-b81d-4dec-a0fb-74333e2c05eb service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:44.203738 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-38800df7-aee4-4255-8bb1-63afd90134e7 req-37407e78-b81d-4dec-a0fb-74333e2c05eb service nova] Creating event network-vif-deleted:92e3c39d-5eff-4b35-945a-25de4f5dce4b for instance 9ea94c91-140c-428c-8831-03efc8c571f6 on nch1-master-1 Apr 16 21:13:44.211069 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-38800df7-aee4-4255-8bb1-63afd90134e7 req-37407e78-b81d-4dec-a0fb-74333e2c05eb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068626 Apr 16 21:13:44.214326 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 907/1884] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:13:44.226260 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-63ac9cfd-d1b9-49a0-8d93-4375836086fd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:44.226992 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-63ac9cfd-d1b9-49a0-8d93-4375836086fd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d9673504-31ed-4a93-abbd-67a338294f1f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:44.233394 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-63ac9cfd-d1b9-49a0-8d93-4375836086fd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:44.233863 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-63ac9cfd-d1b9-49a0-8d93-4375836086fd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:44.234659 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-63ac9cfd-d1b9-49a0-8d93-4375836086fd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:44.235100 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-63ac9cfd-d1b9-49a0-8d93-4375836086fd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:44.575744 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-38edb0f1-4aa8-463f-85db-949f67ec413a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:44.587880 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-38edb0f1-4aa8-463f-85db-949f67ec413a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1392 microversion: 2.1 time: 1.257697 Apr 16 21:13:44.588565 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 978/1885] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:43 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1392 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:44.595976 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-63ac9cfd-d1b9-49a0-8d93-4375836086fd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:44.607300 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-63ac9cfd-d1b9-49a0-8d93-4375836086fd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:44.610961 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6edf9291-9b4a-4268-9dfd-ca66f454b95c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:44.612461 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-63ac9cfd-d1b9-49a0-8d93-4375836086fd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:44.613679 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6edf9291-9b4a-4268-9dfd-ca66f454b95c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 3f88efa6-8671-4565-aa09-bfbafc6ec242] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:44.614221 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-63ac9cfd-d1b9-49a0-8d93-4375836086fd tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f" status: 200 len: 1487 microversion: 2.25 time: 0.395339 Apr 16 21:13:44.625383 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6edf9291-9b4a-4268-9dfd-ca66f454b95c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:44.626907 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 908/1886] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:13:44 2022] GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f => generated 1487 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:13:44.627804 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6edf9291-9b4a-4268-9dfd-ca66f454b95c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:44.629884 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6edf9291-9b4a-4268-9dfd-ca66f454b95c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:44.631567 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6edf9291-9b4a-4268-9dfd-ca66f454b95c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:44.632853 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-24843398-d8ca-4b0a-9f53-6405387643c0 req-69e6b13e-f2ca-4f3c-903e-052546a83201 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f88efa6-8671-4565-aa09-bfbafc6ec242", "name": "network-vif-plugged", "status": "completed", "tag": "b97b89d8-fa8f-4e4a-ac51-14adc4d9a0d3"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:13:44.642428 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-24843398-d8ca-4b0a-9f53-6405387643c0 req-69e6b13e-f2ca-4f3c-903e-052546a83201 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:44.643258 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-24843398-d8ca-4b0a-9f53-6405387643c0 req-69e6b13e-f2ca-4f3c-903e-052546a83201 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:44.659975 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-24843398-d8ca-4b0a-9f53-6405387643c0 req-69e6b13e-f2ca-4f3c-903e-052546a83201 service nova] Creating event network-vif-plugged:b97b89d8-fa8f-4e4a-ac51-14adc4d9a0d3 for instance 3f88efa6-8671-4565-aa09-bfbafc6ec242 on nch2-master-1 Apr 16 21:13:44.673326 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-24843398-d8ca-4b0a-9f53-6405387643c0 req-69e6b13e-f2ca-4f3c-903e-052546a83201 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044771 Apr 16 21:13:44.674318 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 909/1887] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:13:44.685286 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-59823ee9-0554-4e73-aeb1-941d06a4e6ce tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:44.686326 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-59823ee9-0554-4e73-aeb1-941d06a4e6ce tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:44.694843 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-59823ee9-0554-4e73-aeb1-941d06a4e6ce tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:44.695719 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-59823ee9-0554-4e73-aeb1-941d06a4e6ce tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:44.697114 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-59823ee9-0554-4e73-aeb1-941d06a4e6ce tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:44.698646 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-59823ee9-0554-4e73-aeb1-941d06a4e6ce tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:45.172934 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6edf9291-9b4a-4268-9dfd-ca66f454b95c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87e2c1601764f23ac7530b6ad66b3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe50d9e0841749f094948101efdc3d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:45.186656 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6edf9291-9b4a-4268-9dfd-ca66f454b95c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "GET /compute/v2.1/servers/3f88efa6-8671-4565-aa09-bfbafc6ec242" status: 200 len: 1316 microversion: 2.1 time: 0.584351 Apr 16 21:13:45.188705 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 979/1888] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:44 2022] GET /compute/v2.1/servers/3f88efa6-8671-4565-aa09-bfbafc6ec242 => generated 1316 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:45.204213 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-caa3d92c-b809-4572-8889-d5fab9a505dc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:45.207763 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-caa3d92c-b809-4572-8889-d5fab9a505dc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:45.224194 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-caa3d92c-b809-4572-8889-d5fab9a505dc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:45.228290 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-caa3d92c-b809-4572-8889-d5fab9a505dc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:45.229800 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-caa3d92c-b809-4572-8889-d5fab9a505dc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:45.231562 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-caa3d92c-b809-4572-8889-d5fab9a505dc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:45.682337 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-59823ee9-0554-4e73-aeb1-941d06a4e6ce tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:45.696362 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-59823ee9-0554-4e73-aeb1-941d06a4e6ce tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:45.698127 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-59823ee9-0554-4e73-aeb1-941d06a4e6ce tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:45.701905 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-59823ee9-0554-4e73-aeb1-941d06a4e6ce tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1660 microversion: 2.32 time: 1.021591 Apr 16 21:13:45.704814 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 910/1889] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:13:44 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1660 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:13:45.723482 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-45ca1f88-0ad9-4e85-a1c5-62ae51717523 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:45.724676 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-45ca1f88-0ad9-4e85-a1c5-62ae51717523 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] [instance: 58b86589-e35e-4b91-b192-9f744516f66f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:45.736052 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-45ca1f88-0ad9-4e85-a1c5-62ae51717523 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:45.738876 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-45ca1f88-0ad9-4e85-a1c5-62ae51717523 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:45.739921 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-45ca1f88-0ad9-4e85-a1c5-62ae51717523 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:45.743812 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-45ca1f88-0ad9-4e85-a1c5-62ae51717523 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:46.104471 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-45ca1f88-0ad9-4e85-a1c5-62ae51717523 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a6ff623974d4156a05a7bd3e3b3ed5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840fd4cbe2fd414bb97f14898bf9647d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:46.115043 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-45ca1f88-0ad9-4e85-a1c5-62ae51717523 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] 10.222.0.20 "GET /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f" status: 200 len: 1291 microversion: 2.1 time: 0.403250 Apr 16 21:13:46.118236 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 911/1890] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:45 2022] GET /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f => generated 1291 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:46.128647 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3b4fe085-a168-49e4-a344-946933d62cf1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:46.129728 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3b4fe085-a168-49e4-a344-946933d62cf1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:46.153010 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3b4fe085-a168-49e4-a344-946933d62cf1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:46.154329 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3b4fe085-a168-49e4-a344-946933d62cf1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:46.156022 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3b4fe085-a168-49e4-a344-946933d62cf1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:46.156768 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3b4fe085-a168-49e4-a344-946933d62cf1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:46.573893 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3b4fe085-a168-49e4-a344-946933d62cf1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:46.573893 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3b4fe085-a168-49e4-a344-946933d62cf1 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1392 microversion: 2.1 time: 0.360948 Apr 16 21:13:46.573893 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 912/1891] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:46 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1392 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:46.574382 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-caa3d92c-b809-4572-8889-d5fab9a505dc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:46.575953 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d35f3f9d-7733-4fb1-be4a-6e674a34092d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:46.575953 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d35f3f9d-7733-4fb1-be4a-6e674a34092d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d9673504-31ed-4a93-abbd-67a338294f1f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:46.576297 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-caa3d92c-b809-4572-8889-d5fab9a505dc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1308 microversion: 2.1 time: 1.315294 Apr 16 21:13:46.576524 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d35f3f9d-7733-4fb1-be4a-6e674a34092d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:46.576524 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d35f3f9d-7733-4fb1-be4a-6e674a34092d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:46.576960 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 980/1892] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:45 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1308 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:46.577290 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d35f3f9d-7733-4fb1-be4a-6e674a34092d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:46.577290 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d35f3f9d-7733-4fb1-be4a-6e674a34092d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:46.577508 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-914f6ebe-9c9b-4d50-8e99-dfbe3985d79c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:46.577508 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-914f6ebe-9c9b-4d50-8e99-dfbe3985d79c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 3f88efa6-8671-4565-aa09-bfbafc6ec242] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:46.577508 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-914f6ebe-9c9b-4d50-8e99-dfbe3985d79c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:46.577508 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-914f6ebe-9c9b-4d50-8e99-dfbe3985d79c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:46.577887 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-914f6ebe-9c9b-4d50-8e99-dfbe3985d79c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:46.583512 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-914f6ebe-9c9b-4d50-8e99-dfbe3985d79c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:46.854206 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d35f3f9d-7733-4fb1-be4a-6e674a34092d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:46.895806 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d35f3f9d-7733-4fb1-be4a-6e674a34092d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:46.913676 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d35f3f9d-7733-4fb1-be4a-6e674a34092d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:46.918828 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d35f3f9d-7733-4fb1-be4a-6e674a34092d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f" status: 200 len: 1487 microversion: 2.25 time: 0.431920 Apr 16 21:13:46.920895 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 913/1893] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:13:46 2022] GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f => generated 1487 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:13:46.937741 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-d7bc087a-3c35-4205-bf67-5c7e7dbba540 req-b069714e-c156-424b-93d2-4b515f9c0558 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9673504-31ed-4a93-abbd-67a338294f1f", "tag": "5d34bb81-13df-419f-85d3-8e3a86be7e32"}, {"name": "network-changed", "server_uuid": "58b86589-e35e-4b91-b192-9f744516f66f", "tag": "3a37d159-26e4-4121-9cef-bb552002481b"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:13:46.976330 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-d7bc087a-3c35-4205-bf67-5c7e7dbba540 req-b069714e-c156-424b-93d2-4b515f9c0558 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:46.977069 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-d7bc087a-3c35-4205-bf67-5c7e7dbba540 req-b069714e-c156-424b-93d2-4b515f9c0558 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:47.010829 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-d7bc087a-3c35-4205-bf67-5c7e7dbba540 req-b069714e-c156-424b-93d2-4b515f9c0558 service nova] Creating event network-changed:5d34bb81-13df-419f-85d3-8e3a86be7e32 for instance d9673504-31ed-4a93-abbd-67a338294f1f on nch2-master-1 Apr 16 21:13:47.011540 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-d7bc087a-3c35-4205-bf67-5c7e7dbba540 req-b069714e-c156-424b-93d2-4b515f9c0558 service nova] Creating event network-changed:3a37d159-26e4-4121-9cef-bb552002481b for instance 58b86589-e35e-4b91-b192-9f744516f66f on nch1-master-1 Apr 16 21:13:47.024362 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-d7bc087a-3c35-4205-bf67-5c7e7dbba540 req-b069714e-c156-424b-93d2-4b515f9c0558 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.099034 Apr 16 21:13:47.024362 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 914/1894] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:13:47.030607 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-566ec58d-f185-4738-b43d-50789a68e55f tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:47.034143 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-566ec58d-f185-4738-b43d-50789a68e55f tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:47.042507 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-566ec58d-f185-4738-b43d-50789a68e55f tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:47.043424 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-566ec58d-f185-4738-b43d-50789a68e55f tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:47.044924 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-566ec58d-f185-4738-b43d-50789a68e55f tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:47.045531 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-566ec58d-f185-4738-b43d-50789a68e55f tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:47.339590 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-566ec58d-f185-4738-b43d-50789a68e55f tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:47.359605 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-566ec58d-f185-4738-b43d-50789a68e55f tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:47.366441 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-566ec58d-f185-4738-b43d-50789a68e55f tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:47.367941 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-566ec58d-f185-4738-b43d-50789a68e55f tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1660 microversion: 2.32 time: 0.343593 Apr 16 21:13:47.370247 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 915/1895] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:13:47 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1660 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:13:47.389058 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7dd3a635-3658-4291-973b-dbbbd8f03625 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:47.390645 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7dd3a635-3658-4291-973b-dbbbd8f03625 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] [instance: 58b86589-e35e-4b91-b192-9f744516f66f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:47.490370 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7dd3a635-3658-4291-973b-dbbbd8f03625 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:47.492438 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7dd3a635-3658-4291-973b-dbbbd8f03625 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:47.494166 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7dd3a635-3658-4291-973b-dbbbd8f03625 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:47.501131 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7dd3a635-3658-4291-973b-dbbbd8f03625 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:47.557785 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-914f6ebe-9c9b-4d50-8e99-dfbe3985d79c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87e2c1601764f23ac7530b6ad66b3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe50d9e0841749f094948101efdc3d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:47.584918 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-914f6ebe-9c9b-4d50-8e99-dfbe3985d79c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "GET /compute/v2.1/servers/3f88efa6-8671-4565-aa09-bfbafc6ec242" status: 200 len: 1316 microversion: 2.1 time: 1.049950 Apr 16 21:13:47.592538 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 981/1896] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:46 2022] GET /compute/v2.1/servers/3f88efa6-8671-4565-aa09-bfbafc6ec242 => generated 1316 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:47.615023 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d93e59a1-8ce8-4763-955d-8cb8b6fa5f98 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:47.618095 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d93e59a1-8ce8-4763-955d-8cb8b6fa5f98 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:47.643506 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d93e59a1-8ce8-4763-955d-8cb8b6fa5f98 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:47.645242 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d93e59a1-8ce8-4763-955d-8cb8b6fa5f98 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:47.647898 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d93e59a1-8ce8-4763-955d-8cb8b6fa5f98 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:47.649489 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d93e59a1-8ce8-4763-955d-8cb8b6fa5f98 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:48.227072 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7dd3a635-3658-4291-973b-dbbbd8f03625 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a6ff623974d4156a05a7bd3e3b3ed5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840fd4cbe2fd414bb97f14898bf9647d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:48.235596 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7dd3a635-3658-4291-973b-dbbbd8f03625 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] 10.222.0.20 "GET /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f" status: 200 len: 1291 microversion: 2.1 time: 0.863990 Apr 16 21:13:48.236686 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 916/1897] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:47 2022] GET /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f => generated 1291 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:48.242687 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-97f7bb6d-9819-495f-a22b-59f196276d49 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:48.243641 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-97f7bb6d-9819-495f-a22b-59f196276d49 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:48.251868 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-97f7bb6d-9819-495f-a22b-59f196276d49 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:48.252698 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-97f7bb6d-9819-495f-a22b-59f196276d49 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:48.254376 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-97f7bb6d-9819-495f-a22b-59f196276d49 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:48.256667 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-97f7bb6d-9819-495f-a22b-59f196276d49 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:48.443410 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d93e59a1-8ce8-4763-955d-8cb8b6fa5f98 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:48.456630 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d93e59a1-8ce8-4763-955d-8cb8b6fa5f98 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1392 microversion: 2.1 time: 0.861596 Apr 16 21:13:48.457937 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 982/1898] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:47 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1392 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:48.467528 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-97f7bb6d-9819-495f-a22b-59f196276d49 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:48.473942 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-600e067c-3a38-4ca9-8f2c-3fd20cfab281 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:48.475753 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-600e067c-3a38-4ca9-8f2c-3fd20cfab281 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d9673504-31ed-4a93-abbd-67a338294f1f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:48.483697 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-97f7bb6d-9819-495f-a22b-59f196276d49 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1308 microversion: 2.1 time: 0.245304 Apr 16 21:13:48.487182 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 917/1899] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:48 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1308 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:48.492461 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-600e067c-3a38-4ca9-8f2c-3fd20cfab281 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:48.493545 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-600e067c-3a38-4ca9-8f2c-3fd20cfab281 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:48.494547 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-600e067c-3a38-4ca9-8f2c-3fd20cfab281 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:48.497069 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0a1631bc-2c28-4aba-91c9-be45c667c4d5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:48.497584 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0a1631bc-2c28-4aba-91c9-be45c667c4d5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:48.498177 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-600e067c-3a38-4ca9-8f2c-3fd20cfab281 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:48.518548 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0a1631bc-2c28-4aba-91c9-be45c667c4d5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:48.519106 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0a1631bc-2c28-4aba-91c9-be45c667c4d5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:48.519953 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0a1631bc-2c28-4aba-91c9-be45c667c4d5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:48.520429 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0a1631bc-2c28-4aba-91c9-be45c667c4d5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:48.960567 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-600e067c-3a38-4ca9-8f2c-3fd20cfab281 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:48.999352 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-600e067c-3a38-4ca9-8f2c-3fd20cfab281 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:49.018537 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-600e067c-3a38-4ca9-8f2c-3fd20cfab281 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:49.025377 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-600e067c-3a38-4ca9-8f2c-3fd20cfab281 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f" status: 200 len: 1487 microversion: 2.25 time: 0.563211 Apr 16 21:13:49.043309 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 983/1900] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:13:48 2022] GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f => generated 1487 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:13:49.074674 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-388f5aea-5e1e-4997-86f8-32f1afad0a62 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:49.075821 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-388f5aea-5e1e-4997-86f8-32f1afad0a62 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 3f88efa6-8671-4565-aa09-bfbafc6ec242] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:49.096860 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-388f5aea-5e1e-4997-86f8-32f1afad0a62 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:49.100621 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-388f5aea-5e1e-4997-86f8-32f1afad0a62 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:49.105263 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-388f5aea-5e1e-4997-86f8-32f1afad0a62 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:49.124463 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-388f5aea-5e1e-4997-86f8-32f1afad0a62 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:49.276911 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0a1631bc-2c28-4aba-91c9-be45c667c4d5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:49.302929 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0a1631bc-2c28-4aba-91c9-be45c667c4d5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:49.306267 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0a1631bc-2c28-4aba-91c9-be45c667c4d5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:49.308160 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0a1631bc-2c28-4aba-91c9-be45c667c4d5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1660 microversion: 2.32 time: 0.819624 Apr 16 21:13:49.310207 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 918/1901] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:13:48 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1660 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:13:49.334042 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-409094af-961a-4c90-8390-acd9b3ee5339 req-b7ef3035-6553-432a-9046-60d3e04ad529 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e98c6a8-a1a1-4e8d-98bf-18f5967003ef", "tag": "7f99c127-cfc6-412e-914a-153d34cbba61"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:13:49.353383 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-409094af-961a-4c90-8390-acd9b3ee5339 req-b7ef3035-6553-432a-9046-60d3e04ad529 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:49.354137 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-409094af-961a-4c90-8390-acd9b3ee5339 req-b7ef3035-6553-432a-9046-60d3e04ad529 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:49.370390 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-409094af-961a-4c90-8390-acd9b3ee5339 req-b7ef3035-6553-432a-9046-60d3e04ad529 service nova] Creating event network-changed:7f99c127-cfc6-412e-914a-153d34cbba61 for instance 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef on nch2-master-1 Apr 16 21:13:49.382631 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-409094af-961a-4c90-8390-acd9b3ee5339 req-b7ef3035-6553-432a-9046-60d3e04ad529 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070995 Apr 16 21:13:49.384526 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 919/1902] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:13:49.391764 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-236a6d1a-abbd-441b-8b45-1d00e2e0671b tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:49.392945 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-236a6d1a-abbd-441b-8b45-1d00e2e0671b tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] [instance: 58b86589-e35e-4b91-b192-9f744516f66f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:49.408300 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-236a6d1a-abbd-441b-8b45-1d00e2e0671b tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:49.409213 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-236a6d1a-abbd-441b-8b45-1d00e2e0671b tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:49.410628 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-236a6d1a-abbd-441b-8b45-1d00e2e0671b tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:49.414688 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-236a6d1a-abbd-441b-8b45-1d00e2e0671b tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:49.881284 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-236a6d1a-abbd-441b-8b45-1d00e2e0671b tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a6ff623974d4156a05a7bd3e3b3ed5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840fd4cbe2fd414bb97f14898bf9647d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:49.889505 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-236a6d1a-abbd-441b-8b45-1d00e2e0671b tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] 10.222.0.20 "GET /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f" status: 200 len: 1291 microversion: 2.1 time: 0.503426 Apr 16 21:13:49.890089 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 920/1903] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:49 2022] GET /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f => generated 1291 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:49.895070 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5dd3c5ad-7f91-4902-951c-15da7b5b2ed3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:49.895704 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5dd3c5ad-7f91-4902-951c-15da7b5b2ed3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:49.905580 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5dd3c5ad-7f91-4902-951c-15da7b5b2ed3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:49.906038 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5dd3c5ad-7f91-4902-951c-15da7b5b2ed3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:49.906882 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5dd3c5ad-7f91-4902-951c-15da7b5b2ed3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:49.907402 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5dd3c5ad-7f91-4902-951c-15da7b5b2ed3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:50.069177 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-388f5aea-5e1e-4997-86f8-32f1afad0a62 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87e2c1601764f23ac7530b6ad66b3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe50d9e0841749f094948101efdc3d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:50.081478 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-388f5aea-5e1e-4997-86f8-32f1afad0a62 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "GET /compute/v2.1/servers/3f88efa6-8671-4565-aa09-bfbafc6ec242" status: 200 len: 1505 microversion: 2.1 time: 1.032125 Apr 16 21:13:50.082127 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 984/1904] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:49 2022] GET /compute/v2.1/servers/3f88efa6-8671-4565-aa09-bfbafc6ec242 => generated 1505 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:50.100873 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5dd3c5ad-7f91-4902-951c-15da7b5b2ed3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:50.103131 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8e9fd1cd-08ac-4e6e-887f-2afa186ac7c5 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:50.105031 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8e9fd1cd-08ac-4e6e-887f-2afa186ac7c5 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:50.109209 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5dd3c5ad-7f91-4902-951c-15da7b5b2ed3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1392 microversion: 2.1 time: 0.218033 Apr 16 21:13:50.109714 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 921/1905] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:49 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1392 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:50.118096 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8bdda146-3342-4919-a372-24ea751902ba tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:50.118096 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8bdda146-3342-4919-a372-24ea751902ba tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d9673504-31ed-4a93-abbd-67a338294f1f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:50.129915 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8e9fd1cd-08ac-4e6e-887f-2afa186ac7c5 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:50.130382 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8e9fd1cd-08ac-4e6e-887f-2afa186ac7c5 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:50.131190 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8e9fd1cd-08ac-4e6e-887f-2afa186ac7c5 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:50.131651 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8e9fd1cd-08ac-4e6e-887f-2afa186ac7c5 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:50.134259 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8bdda146-3342-4919-a372-24ea751902ba tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:50.134736 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8bdda146-3342-4919-a372-24ea751902ba tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:50.135500 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8bdda146-3342-4919-a372-24ea751902ba tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:50.135943 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8bdda146-3342-4919-a372-24ea751902ba tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:50.404539 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8e9fd1cd-08ac-4e6e-887f-2afa186ac7c5 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:50.416638 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8e9fd1cd-08ac-4e6e-887f-2afa186ac7c5 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1308 microversion: 2.1 time: 0.322731 Apr 16 21:13:50.427611 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 985/1906] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:50 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1308 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:50.432634 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-823fe850-1748-41c2-91b9-1347aab74a5c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2012318941"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:13:50.433194 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-823fe850-1748-41c2-91b9-1347aab74a5c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 3f88efa6-8671-4565-aa09-bfbafc6ec242] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:50.441462 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-823fe850-1748-41c2-91b9-1347aab74a5c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:50.441925 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-823fe850-1748-41c2-91b9-1347aab74a5c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:50.442727 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-823fe850-1748-41c2-91b9-1347aab74a5c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:50.443376 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-823fe850-1748-41c2-91b9-1347aab74a5c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:50.589156 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8bdda146-3342-4919-a372-24ea751902ba tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:50.606277 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8bdda146-3342-4919-a372-24ea751902ba tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:50.611959 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8bdda146-3342-4919-a372-24ea751902ba tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:50.614980 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8bdda146-3342-4919-a372-24ea751902ba tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f" status: 200 len: 1487 microversion: 2.25 time: 0.501619 Apr 16 21:13:50.617382 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 922/1907] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:13:50 2022] GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f => generated 1487 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:13:50.623935 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bebebe12-d832-4631-84d1-39bff46a23a6 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:50.626287 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bebebe12-d832-4631-84d1-39bff46a23a6 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:50.635731 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bebebe12-d832-4631-84d1-39bff46a23a6 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:50.636489 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bebebe12-d832-4631-84d1-39bff46a23a6 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:50.637636 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bebebe12-d832-4631-84d1-39bff46a23a6 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:50.639028 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bebebe12-d832-4631-84d1-39bff46a23a6 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:51.063700 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.network.security_group_api [None req-823fe850-1748-41c2-91b9-1347aab74a5c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Adding security group dac9affa-3ddd-4873-99d7-c742d8e50a0d to port b97b89d8-fa8f-4e4a-ac51-14adc4d9a0d3 Apr 16 21:13:51.078530 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-bebebe12-d832-4631-84d1-39bff46a23a6 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:51.090359 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-bebebe12-d832-4631-84d1-39bff46a23a6 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:51.099224 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-bebebe12-d832-4631-84d1-39bff46a23a6 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:51.104712 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bebebe12-d832-4631-84d1-39bff46a23a6 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1693 microversion: 2.32 time: 0.485737 Apr 16 21:13:51.106246 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 923/1908] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:13:50 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1693 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:13:51.118205 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-79c49281-dc20-4853-b955-9f332ea4ce4d tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:51.119182 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-79c49281-dc20-4853-b955-9f332ea4ce4d tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] [instance: 58b86589-e35e-4b91-b192-9f744516f66f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:51.134940 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-79c49281-dc20-4853-b955-9f332ea4ce4d tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:51.137743 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-79c49281-dc20-4853-b955-9f332ea4ce4d tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:51.143857 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-79c49281-dc20-4853-b955-9f332ea4ce4d tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:51.143857 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-79c49281-dc20-4853-b955-9f332ea4ce4d tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:51.606856 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-79c49281-dc20-4853-b955-9f332ea4ce4d tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a6ff623974d4156a05a7bd3e3b3ed5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840fd4cbe2fd414bb97f14898bf9647d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:51.614589 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-79c49281-dc20-4853-b955-9f332ea4ce4d tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] 10.222.0.20 "GET /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f" status: 200 len: 1291 microversion: 2.1 time: 0.507013 Apr 16 21:13:51.616293 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 924/1909] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:51 2022] GET /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f => generated 1291 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:51.621043 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a6e5afae-0581-4a89-b359-c5bb2404cc47 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:51.622422 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a6e5afae-0581-4a89-b359-c5bb2404cc47 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:51.636979 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a6e5afae-0581-4a89-b359-c5bb2404cc47 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:51.638297 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a6e5afae-0581-4a89-b359-c5bb2404cc47 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:51.639306 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a6e5afae-0581-4a89-b359-c5bb2404cc47 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:51.640383 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a6e5afae-0581-4a89-b359-c5bb2404cc47 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:51.994807 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a6e5afae-0581-4a89-b359-c5bb2404cc47 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:52.005817 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a6e5afae-0581-4a89-b359-c5bb2404cc47 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1392 microversion: 2.1 time: 0.388256 Apr 16 21:13:52.012646 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 925/1910] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:51 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1392 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:52.026289 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b1229156-467a-4dbb-a7c3-5044fda11e3d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:52.027199 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b1229156-467a-4dbb-a7c3-5044fda11e3d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:52.034092 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b1229156-467a-4dbb-a7c3-5044fda11e3d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:52.040932 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b1229156-467a-4dbb-a7c3-5044fda11e3d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:52.042046 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b1229156-467a-4dbb-a7c3-5044fda11e3d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:52.042687 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b1229156-467a-4dbb-a7c3-5044fda11e3d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:52.452324 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b1229156-467a-4dbb-a7c3-5044fda11e3d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:52.460081 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b1229156-467a-4dbb-a7c3-5044fda11e3d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1308 microversion: 2.1 time: 0.446105 Apr 16 21:13:52.464308 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 926/1911] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:52 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1308 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:52.469551 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-dcad15cc-e137-41ba-9039-d7685c973818 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:52.487043 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-dcad15cc-e137-41ba-9039-d7685c973818 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d9673504-31ed-4a93-abbd-67a338294f1f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:52.492053 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dcad15cc-e137-41ba-9039-d7685c973818 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:52.492533 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dcad15cc-e137-41ba-9039-d7685c973818 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:52.493335 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dcad15cc-e137-41ba-9039-d7685c973818 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:52.493790 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dcad15cc-e137-41ba-9039-d7685c973818 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:52.667449 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-823fe850-1748-41c2-91b9-1347aab74a5c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "POST /compute/v2.1/servers/3f88efa6-8671-4565-aa09-bfbafc6ec242/action" status: 202 len: 0 microversion: 2.1 time: 2.238712 Apr 16 21:13:52.669406 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 986/1912] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:13:50 2022] POST /compute/v2.1/servers/3f88efa6-8671-4565-aa09-bfbafc6ec242/action => generated 0 bytes in 2241 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:13:52.678029 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-107a3f60-d8d5-4734-b73e-7c43b8ad7d91 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:52.678029 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-107a3f60-d8d5-4734-b73e-7c43b8ad7d91 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:52.686938 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-107a3f60-d8d5-4734-b73e-7c43b8ad7d91 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:52.687845 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-107a3f60-d8d5-4734-b73e-7c43b8ad7d91 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:52.695032 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-107a3f60-d8d5-4734-b73e-7c43b8ad7d91 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:52.695032 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-107a3f60-d8d5-4734-b73e-7c43b8ad7d91 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:53.047831 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-dcad15cc-e137-41ba-9039-d7685c973818 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:53.056366 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-dcad15cc-e137-41ba-9039-d7685c973818 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:53.069446 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-dcad15cc-e137-41ba-9039-d7685c973818 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:53.070692 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-dcad15cc-e137-41ba-9039-d7685c973818 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f" status: 200 len: 1487 microversion: 2.25 time: 0.604937 Apr 16 21:13:53.085537 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 927/1913] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:13:52 2022] GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f => generated 1487 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:13:53.097318 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a8dd5ef4-387a-4014-8cc5-756e07a48dd1 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:53.103868 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a8dd5ef4-387a-4014-8cc5-756e07a48dd1 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] [instance: 58b86589-e35e-4b91-b192-9f744516f66f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:53.115249 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a8dd5ef4-387a-4014-8cc5-756e07a48dd1 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:53.122451 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a8dd5ef4-387a-4014-8cc5-756e07a48dd1 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:53.123615 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a8dd5ef4-387a-4014-8cc5-756e07a48dd1 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:53.124455 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a8dd5ef4-387a-4014-8cc5-756e07a48dd1 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:53.223583 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-107a3f60-d8d5-4734-b73e-7c43b8ad7d91 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:53.242407 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-107a3f60-d8d5-4734-b73e-7c43b8ad7d91 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:53.248957 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-107a3f60-d8d5-4734-b73e-7c43b8ad7d91 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:53.255366 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-107a3f60-d8d5-4734-b73e-7c43b8ad7d91 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1738 microversion: 2.32 time: 0.583562 Apr 16 21:13:53.284580 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 987/1914] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:13:52 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1738 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:13:53.307573 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9b264293-e16f-48ce-864d-578c1e792d8d tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-133179858"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:13:53.311256 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9b264293-e16f-48ce-864d-578c1e792d8d tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 3f88efa6-8671-4565-aa09-bfbafc6ec242] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:53.324346 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9b264293-e16f-48ce-864d-578c1e792d8d tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:53.329636 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9b264293-e16f-48ce-864d-578c1e792d8d tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:53.329636 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9b264293-e16f-48ce-864d-578c1e792d8d tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:53.332483 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9b264293-e16f-48ce-864d-578c1e792d8d tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:53.550626 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a8dd5ef4-387a-4014-8cc5-756e07a48dd1 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a6ff623974d4156a05a7bd3e3b3ed5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840fd4cbe2fd414bb97f14898bf9647d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:53.559716 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a8dd5ef4-387a-4014-8cc5-756e07a48dd1 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] 10.222.0.20 "GET /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f" status: 200 len: 1291 microversion: 2.1 time: 0.472721 Apr 16 21:13:53.572508 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 928/1915] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:53 2022] GET /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f => generated 1291 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:53.587150 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-a9263200-9c87-46c7-8f91-c4ef8f49bb72 req-413ef7b5-7c22-4893-a13d-b97955025b7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f88efa6-8671-4565-aa09-bfbafc6ec242", "tag": "b97b89d8-fa8f-4e4a-ac51-14adc4d9a0d3"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:13:53.599052 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-a9263200-9c87-46c7-8f91-c4ef8f49bb72 req-413ef7b5-7c22-4893-a13d-b97955025b7c service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:53.611134 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-a9263200-9c87-46c7-8f91-c4ef8f49bb72 req-413ef7b5-7c22-4893-a13d-b97955025b7c service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:53.620326 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.network.security_group_api [None req-9b264293-e16f-48ce-864d-578c1e792d8d tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Adding security group cc0980eb-3522-4c74-bc5f-db8b84d66c49 to port b97b89d8-fa8f-4e4a-ac51-14adc4d9a0d3 Apr 16 21:13:53.635749 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-a9263200-9c87-46c7-8f91-c4ef8f49bb72 req-413ef7b5-7c22-4893-a13d-b97955025b7c service nova] Creating event network-changed:b97b89d8-fa8f-4e4a-ac51-14adc4d9a0d3 for instance 3f88efa6-8671-4565-aa09-bfbafc6ec242 on nch2-master-1 Apr 16 21:13:53.644931 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-a9263200-9c87-46c7-8f91-c4ef8f49bb72 req-413ef7b5-7c22-4893-a13d-b97955025b7c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070750 Apr 16 21:13:53.649280 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 929/1916] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:13:53.665189 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-b7acf405-2fdd-451e-8540-f00c6584efec req-4a2cc396-b5fe-4a2f-a573-5aa3c681e3b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39df3a82-5cde-4311-8bec-5ce2d111d59e", "name": "network-vif-unplugged", "status": "completed", "tag": "e220556c-73e1-42e1-a291-a4168a2b6289"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:13:53.686561 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-b7acf405-2fdd-451e-8540-f00c6584efec req-4a2cc396-b5fe-4a2f-a573-5aa3c681e3b3 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:53.687313 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-b7acf405-2fdd-451e-8540-f00c6584efec req-4a2cc396-b5fe-4a2f-a573-5aa3c681e3b3 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:53.717184 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-b7acf405-2fdd-451e-8540-f00c6584efec req-4a2cc396-b5fe-4a2f-a573-5aa3c681e3b3 service nova] Creating event network-vif-unplugged:e220556c-73e1-42e1-a291-a4168a2b6289 for instance 39df3a82-5cde-4311-8bec-5ce2d111d59e on nch1-master-1 Apr 16 21:13:53.736244 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-b7acf405-2fdd-451e-8540-f00c6584efec req-4a2cc396-b5fe-4a2f-a573-5aa3c681e3b3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.075070 Apr 16 21:13:53.740523 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 930/1917] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:13:53.745976 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-dd23a05a-7cc7-44d4-817a-37faaaaa5022 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:53.746716 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-dd23a05a-7cc7-44d4-817a-37faaaaa5022 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:53.764715 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dd23a05a-7cc7-44d4-817a-37faaaaa5022 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:53.765170 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dd23a05a-7cc7-44d4-817a-37faaaaa5022 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:53.766032 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dd23a05a-7cc7-44d4-817a-37faaaaa5022 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:53.766479 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dd23a05a-7cc7-44d4-817a-37faaaaa5022 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:53.999886 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-dd23a05a-7cc7-44d4-817a-37faaaaa5022 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:54.016212 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-dd23a05a-7cc7-44d4-817a-37faaaaa5022 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1392 microversion: 2.1 time: 0.273227 Apr 16 21:13:54.031215 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 931/1918] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:53 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1392 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:54.056117 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9e61c4d6-39dc-4195-9875-65bbf8a2544d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:54.057738 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9e61c4d6-39dc-4195-9875-65bbf8a2544d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:54.083040 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9e61c4d6-39dc-4195-9875-65bbf8a2544d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:54.084002 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9e61c4d6-39dc-4195-9875-65bbf8a2544d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:54.085017 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9e61c4d6-39dc-4195-9875-65bbf8a2544d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:54.085714 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9e61c4d6-39dc-4195-9875-65bbf8a2544d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:54.356917 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9e61c4d6-39dc-4195-9875-65bbf8a2544d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:54.367790 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9e61c4d6-39dc-4195-9875-65bbf8a2544d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1308 microversion: 2.1 time: 0.335013 Apr 16 21:13:54.371884 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 932/1919] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:54 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1308 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:54.376312 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1daf353c-435e-48cb-8fe0-688860ba1bcc tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:54.378290 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1daf353c-435e-48cb-8fe0-688860ba1bcc tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d9673504-31ed-4a93-abbd-67a338294f1f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:54.386596 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1daf353c-435e-48cb-8fe0-688860ba1bcc tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:54.387960 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1daf353c-435e-48cb-8fe0-688860ba1bcc tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:54.389033 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1daf353c-435e-48cb-8fe0-688860ba1bcc tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:54.389657 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1daf353c-435e-48cb-8fe0-688860ba1bcc tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:54.679925 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1daf353c-435e-48cb-8fe0-688860ba1bcc tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:54.690666 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1daf353c-435e-48cb-8fe0-688860ba1bcc tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:54.692471 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1daf353c-435e-48cb-8fe0-688860ba1bcc tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:54.693493 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1daf353c-435e-48cb-8fe0-688860ba1bcc tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f" status: 200 len: 1487 microversion: 2.25 time: 0.323780 Apr 16 21:13:54.697007 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 933/1920] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:13:54 2022] GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f => generated 1487 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:13:54.710049 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-df522b01-2f80-404d-89a6-b1ebd5bbab5e tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:54.711252 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-df522b01-2f80-404d-89a6-b1ebd5bbab5e tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:54.721502 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-df522b01-2f80-404d-89a6-b1ebd5bbab5e tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:54.723106 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-df522b01-2f80-404d-89a6-b1ebd5bbab5e tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:54.724282 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-df522b01-2f80-404d-89a6-b1ebd5bbab5e tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:54.725010 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-df522b01-2f80-404d-89a6-b1ebd5bbab5e tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:55.405113 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-df522b01-2f80-404d-89a6-b1ebd5bbab5e tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:55.427288 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-df522b01-2f80-404d-89a6-b1ebd5bbab5e tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:55.428594 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-df522b01-2f80-404d-89a6-b1ebd5bbab5e tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:55.429989 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-df522b01-2f80-404d-89a6-b1ebd5bbab5e tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1738 microversion: 2.32 time: 0.731498 Apr 16 21:13:55.432490 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 934/1921] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:13:54 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1738 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:13:55.439094 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3dc63acc-5ba1-4810-848f-211957a5931b tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:55.454189 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3dc63acc-5ba1-4810-848f-211957a5931b tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] [instance: 58b86589-e35e-4b91-b192-9f744516f66f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:55.456478 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3dc63acc-5ba1-4810-848f-211957a5931b tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:55.468939 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3dc63acc-5ba1-4810-848f-211957a5931b tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:55.470198 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3dc63acc-5ba1-4810-848f-211957a5931b tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:55.470891 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3dc63acc-5ba1-4810-848f-211957a5931b tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:55.587140 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9b264293-e16f-48ce-864d-578c1e792d8d tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "POST /compute/v2.1/servers/3f88efa6-8671-4565-aa09-bfbafc6ec242/action" status: 202 len: 0 microversion: 2.1 time: 2.296931 Apr 16 21:13:55.590981 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 988/1922] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:13:53 2022] POST /compute/v2.1/servers/3f88efa6-8671-4565-aa09-bfbafc6ec242/action => generated 0 bytes in 2304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:13:55.596328 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-571c7d90-b3be-45f4-94a5-265552a345ca tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:55.596957 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-571c7d90-b3be-45f4-94a5-265552a345ca tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:55.611247 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-571c7d90-b3be-45f4-94a5-265552a345ca tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:55.611712 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-571c7d90-b3be-45f4-94a5-265552a345ca tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:55.612550 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-571c7d90-b3be-45f4-94a5-265552a345ca tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:55.612998 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-571c7d90-b3be-45f4-94a5-265552a345ca tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:55.775744 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3dc63acc-5ba1-4810-848f-211957a5931b tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a6ff623974d4156a05a7bd3e3b3ed5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840fd4cbe2fd414bb97f14898bf9647d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:55.786359 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3dc63acc-5ba1-4810-848f-211957a5931b tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] 10.222.0.20 "GET /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f" status: 200 len: 1291 microversion: 2.1 time: 0.352536 Apr 16 21:13:55.801944 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 935/1923] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:55 2022] GET /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f => generated 1291 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:55.812681 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d8d3cd18-323d-4fe6-ab60-c1a65a8b0317 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:55.816979 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d8d3cd18-323d-4fe6-ab60-c1a65a8b0317 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:55.829799 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d8d3cd18-323d-4fe6-ab60-c1a65a8b0317 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:55.830263 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d8d3cd18-323d-4fe6-ab60-c1a65a8b0317 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:55.837034 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d8d3cd18-323d-4fe6-ab60-c1a65a8b0317 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:55.838027 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d8d3cd18-323d-4fe6-ab60-c1a65a8b0317 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:56.046814 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-571c7d90-b3be-45f4-94a5-265552a345ca tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:56.070835 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-571c7d90-b3be-45f4-94a5-265552a345ca tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1392 microversion: 2.1 time: 0.478507 Apr 16 21:13:56.077682 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 989/1924] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:55 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1392 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:56.091262 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-34f13cfc-c21c-4ccb-a747-a48cd3a7a99a tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:56.091856 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-34f13cfc-c21c-4ccb-a747-a48cd3a7a99a tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 3f88efa6-8671-4565-aa09-bfbafc6ec242] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:56.101342 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-34f13cfc-c21c-4ccb-a747-a48cd3a7a99a tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:56.102053 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-34f13cfc-c21c-4ccb-a747-a48cd3a7a99a tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:56.103042 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-34f13cfc-c21c-4ccb-a747-a48cd3a7a99a tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:56.104103 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-34f13cfc-c21c-4ccb-a747-a48cd3a7a99a tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:56.163347 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d8d3cd18-323d-4fe6-ab60-c1a65a8b0317 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:56.172894 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d8d3cd18-323d-4fe6-ab60-c1a65a8b0317 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1308 microversion: 2.1 time: 0.368836 Apr 16 21:13:56.173940 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 936/1925] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:55 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1308 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:56.179065 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-864317b1-51e0-4f4f-9e49-c28590a24057 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:56.179954 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-864317b1-51e0-4f4f-9e49-c28590a24057 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d9673504-31ed-4a93-abbd-67a338294f1f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:56.188082 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-864317b1-51e0-4f4f-9e49-c28590a24057 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:56.188660 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-864317b1-51e0-4f4f-9e49-c28590a24057 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:56.189734 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-864317b1-51e0-4f4f-9e49-c28590a24057 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:56.190385 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-864317b1-51e0-4f4f-9e49-c28590a24057 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:56.427981 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-864317b1-51e0-4f4f-9e49-c28590a24057 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:56.438831 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-864317b1-51e0-4f4f-9e49-c28590a24057 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:56.440535 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-864317b1-51e0-4f4f-9e49-c28590a24057 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:56.441764 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-864317b1-51e0-4f4f-9e49-c28590a24057 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f" status: 200 len: 1477 microversion: 2.25 time: 0.266641 Apr 16 21:13:56.442326 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 937/1926] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:13:56 2022] GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f => generated 1477 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:13:56.457689 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-8d38f86b-af15-4f12-890d-6dceb767f997 req-f44b7706-595c-4ff4-b093-0c111ee315ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f88efa6-8671-4565-aa09-bfbafc6ec242", "tag": "b97b89d8-fa8f-4e4a-ac51-14adc4d9a0d3"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:13:56.466598 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-8d38f86b-af15-4f12-890d-6dceb767f997 req-f44b7706-595c-4ff4-b093-0c111ee315ff service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:56.467051 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-8d38f86b-af15-4f12-890d-6dceb767f997 req-f44b7706-595c-4ff4-b093-0c111ee315ff service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:56.479615 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-8d38f86b-af15-4f12-890d-6dceb767f997 req-f44b7706-595c-4ff4-b093-0c111ee315ff service nova] Creating event network-changed:b97b89d8-fa8f-4e4a-ac51-14adc4d9a0d3 for instance 3f88efa6-8671-4565-aa09-bfbafc6ec242 on nch2-master-1 Apr 16 21:13:56.485042 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-8d38f86b-af15-4f12-890d-6dceb767f997 req-f44b7706-595c-4ff4-b093-0c111ee315ff service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030772 Apr 16 21:13:56.486314 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 938/1927] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:13:56.491753 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-6ab9db96-6e7b-4e56-b906-d1dc4dd7a533 req-5944574b-3db2-43e3-af45-faa4a9e657f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39df3a82-5cde-4311-8bec-5ce2d111d59e", "tag": "e220556c-73e1-42e1-a291-a4168a2b6289"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:13:56.501992 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-6ab9db96-6e7b-4e56-b906-d1dc4dd7a533 req-5944574b-3db2-43e3-af45-faa4a9e657f8 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:56.502854 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-6ab9db96-6e7b-4e56-b906-d1dc4dd7a533 req-5944574b-3db2-43e3-af45-faa4a9e657f8 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:56.516143 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-6ab9db96-6e7b-4e56-b906-d1dc4dd7a533 req-5944574b-3db2-43e3-af45-faa4a9e657f8 service nova] Creating event network-changed:e220556c-73e1-42e1-a291-a4168a2b6289 for instance 39df3a82-5cde-4311-8bec-5ce2d111d59e on nch1-master-1 Apr 16 21:13:56.521024 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-6ab9db96-6e7b-4e56-b906-d1dc4dd7a533 req-5944574b-3db2-43e3-af45-faa4a9e657f8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033264 Apr 16 21:13:56.521991 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 939/1928] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:13:56.528612 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-5d849c02-a0f7-4793-81af-1e323bdcd097 req-a66294bb-9392-4905-97f8-f981b7d25a86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58b86589-e35e-4b91-b192-9f744516f66f", "name": "network-vif-plugged", "status": "completed", "tag": "3a37d159-26e4-4121-9cef-bb552002481b"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:13:56.538634 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-5d849c02-a0f7-4793-81af-1e323bdcd097 req-a66294bb-9392-4905-97f8-f981b7d25a86 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:56.539104 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-5d849c02-a0f7-4793-81af-1e323bdcd097 req-a66294bb-9392-4905-97f8-f981b7d25a86 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:56.551912 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-5d849c02-a0f7-4793-81af-1e323bdcd097 req-a66294bb-9392-4905-97f8-f981b7d25a86 service nova] Creating event network-vif-plugged:3a37d159-26e4-4121-9cef-bb552002481b for instance 58b86589-e35e-4b91-b192-9f744516f66f on nch1-master-1 Apr 16 21:13:56.560070 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-5d849c02-a0f7-4793-81af-1e323bdcd097 req-a66294bb-9392-4905-97f8-f981b7d25a86 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035539 Apr 16 21:13:56.561717 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 940/1929] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:13:56.568688 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ba56bddf-18d1-4d39-9e9c-0bb1a2d45966 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:56.569769 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ba56bddf-18d1-4d39-9e9c-0bb1a2d45966 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:56.608190 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ba56bddf-18d1-4d39-9e9c-0bb1a2d45966 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:56.612490 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ba56bddf-18d1-4d39-9e9c-0bb1a2d45966 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:56.614153 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ba56bddf-18d1-4d39-9e9c-0bb1a2d45966 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:56.614794 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ba56bddf-18d1-4d39-9e9c-0bb1a2d45966 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:56.668851 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-34f13cfc-c21c-4ccb-a747-a48cd3a7a99a tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "GET /compute/v2.1/servers/3f88efa6-8671-4565-aa09-bfbafc6ec242/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.588174 Apr 16 21:13:56.671159 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 990/1930] 10.222.0.20 () {58 vars in 1292 bytes} [Sat Apr 16 21:13:56 2022] GET /compute/v2.1/servers/3f88efa6-8671-4565-aa09-bfbafc6ec242/os-security-groups => generated 1157 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:56.690301 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b7f418dc-f8a7-4816-b50f-ded018c172df tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Calling method '.version_select at 0x7fbb9fe7b280>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:56.694128 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b7f418dc-f8a7-4816-b50f-ded018c172df tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:56.694790 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b7f418dc-f8a7-4816-b50f-ded018c172df tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:56.708355 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b7f418dc-f8a7-4816-b50f-ded018c172df tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 3864 microversion: 2.25 time: 0.030306 Apr 16 21:13:56.709290 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 991/1931] 10.222.0.20 () {60 vars in 1183 bytes} [Sat Apr 16 21:13:56 2022] GET /compute/v2.1/os-migrations => generated 3864 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:13:56.719351 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7357b816-1dbe-4851-90ae-f8027620bb57 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Action: 'create', calling method: .version_select at 0x7fbb9fe8a940>, body: {"security_group": {"name": " tempest-securitygroup -1547425905 ", "description": "tempest-description-1806767493"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:13:57.027327 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ba56bddf-18d1-4d39-9e9c-0bb1a2d45966 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:57.043591 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ba56bddf-18d1-4d39-9e9c-0bb1a2d45966 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:57.047210 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ba56bddf-18d1-4d39-9e9c-0bb1a2d45966 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:57.052824 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ba56bddf-18d1-4d39-9e9c-0bb1a2d45966 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1738 microversion: 2.32 time: 0.489124 Apr 16 21:13:57.072920 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 941/1932] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:13:56 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1738 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:13:57.078456 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-61b89ec4-410c-40d3-ab36-7f329ca952ac tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:57.081812 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-61b89ec4-410c-40d3-ab36-7f329ca952ac tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] [instance: d9673504-31ed-4a93-abbd-67a338294f1f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:57.086011 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-61b89ec4-410c-40d3-ab36-7f329ca952ac tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:57.086939 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-61b89ec4-410c-40d3-ab36-7f329ca952ac tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:57.087755 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-61b89ec4-410c-40d3-ab36-7f329ca952ac tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:57.088265 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-61b89ec4-410c-40d3-ab36-7f329ca952ac tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:57.239385 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-61b89ec4-410c-40d3-ab36-7f329ca952ac tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] Lazy-loading 'services' on Instance uuid d9673504-31ed-4a93-abbd-67a338294f1f {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:13:57.255680 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-61b89ec4-410c-40d3-ab36-7f329ca952ac tempest-LiveAutoBlockMigrationV225Test-809890570 tempest-LiveAutoBlockMigrationV225Test-809890570-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f" status: 200 len: 1970 microversion: 2.25 time: 0.179824 Apr 16 21:13:57.264790 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 942/1933] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:13:57 2022] GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f => generated 1970 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:13:57.280696 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-68a76258-e9a7-48da-8ffc-24ef8a65954f tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:57.280696 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-68a76258-e9a7-48da-8ffc-24ef8a65954f tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] [instance: 58b86589-e35e-4b91-b192-9f744516f66f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:57.293537 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-68a76258-e9a7-48da-8ffc-24ef8a65954f tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:57.293537 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-68a76258-e9a7-48da-8ffc-24ef8a65954f tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:57.293537 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-68a76258-e9a7-48da-8ffc-24ef8a65954f tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:57.293537 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-68a76258-e9a7-48da-8ffc-24ef8a65954f tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:57.578849 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7357b816-1dbe-4851-90ae-f8027620bb57 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 0.864884 Apr 16 21:13:57.584009 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 992/1934] 10.222.0.20 () {60 vars in 1179 bytes} [Sat Apr 16 21:13:56 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:13:57.597809 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-88b22fb4-57d7-44dd-bb06-3bdfee8e75b7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:57.602821 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-88b22fb4-57d7-44dd-bb06-3bdfee8e75b7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:57.629732 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-88b22fb4-57d7-44dd-bb06-3bdfee8e75b7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:57.631001 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-88b22fb4-57d7-44dd-bb06-3bdfee8e75b7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:57.632611 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-88b22fb4-57d7-44dd-bb06-3bdfee8e75b7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:57.633402 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-88b22fb4-57d7-44dd-bb06-3bdfee8e75b7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:57.765768 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-68a76258-e9a7-48da-8ffc-24ef8a65954f tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a6ff623974d4156a05a7bd3e3b3ed5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840fd4cbe2fd414bb97f14898bf9647d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:57.776207 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-68a76258-e9a7-48da-8ffc-24ef8a65954f tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] 10.222.0.20 "GET /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f" status: 200 len: 1291 microversion: 2.1 time: 0.509980 Apr 16 21:13:57.777237 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 943/1935] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:57 2022] GET /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f => generated 1291 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:57.785492 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ce44019f-1ec2-44e7-83e0-800d783a0ee1 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:57.786662 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ce44019f-1ec2-44e7-83e0-800d783a0ee1 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:57.796649 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ce44019f-1ec2-44e7-83e0-800d783a0ee1 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:57.797142 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ce44019f-1ec2-44e7-83e0-800d783a0ee1 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:57.798232 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ce44019f-1ec2-44e7-83e0-800d783a0ee1 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:57.798681 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ce44019f-1ec2-44e7-83e0-800d783a0ee1 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:57.971681 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ce44019f-1ec2-44e7-83e0-800d783a0ee1 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:57.983480 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ce44019f-1ec2-44e7-83e0-800d783a0ee1 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1308 microversion: 2.1 time: 0.202505 Apr 16 21:13:57.983480 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 944/1936] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:57 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1308 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:57.987491 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-71bfbadf-33d1-4d85-abe5-04c58af464d8 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:57.988001 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-71bfbadf-33d1-4d85-abe5-04c58af464d8 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d9673504-31ed-4a93-abbd-67a338294f1f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:57.994360 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-71bfbadf-33d1-4d85-abe5-04c58af464d8 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:57.995192 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-71bfbadf-33d1-4d85-abe5-04c58af464d8 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:57.995817 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-71bfbadf-33d1-4d85-abe5-04c58af464d8 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:57.996812 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-71bfbadf-33d1-4d85-abe5-04c58af464d8 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:58.025817 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-71bfbadf-33d1-4d85-abe5-04c58af464d8 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d9673504-31ed-4a93-abbd-67a338294f1f] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:13:58.377308 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-71bfbadf-33d1-4d85-abe5-04c58af464d8 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f" status: 204 len: 0 microversion: 2.25 time: 0.393275 Apr 16 21:13:58.378439 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 945/1937] 10.222.0.20 () {60 vars in 1279 bytes} [Sat Apr 16 21:13:57 2022] DELETE /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 16 21:13:58.386452 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5c9a60d9-6d4e-40fd-a01d-99382ed98c90 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:58.387392 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5c9a60d9-6d4e-40fd-a01d-99382ed98c90 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:58.394528 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5c9a60d9-6d4e-40fd-a01d-99382ed98c90 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:58.394989 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5c9a60d9-6d4e-40fd-a01d-99382ed98c90 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:58.395773 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5c9a60d9-6d4e-40fd-a01d-99382ed98c90 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:58.396255 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5c9a60d9-6d4e-40fd-a01d-99382ed98c90 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:58.477782 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-88b22fb4-57d7-44dd-bb06-3bdfee8e75b7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:58.487167 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-88b22fb4-57d7-44dd-bb06-3bdfee8e75b7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1392 microversion: 2.1 time: 0.901660 Apr 16 21:13:58.489828 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 993/1938] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:57 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1392 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:58.503174 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b7f5a555-7364-4b00-8a93-4e44dc186510 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '.version_select at 0x7fbb9fe7b4c0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:58.534211 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5c9a60d9-6d4e-40fd-a01d-99382ed98c90 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:58.541922 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5c9a60d9-6d4e-40fd-a01d-99382ed98c90 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.161758 Apr 16 21:13:58.542485 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 946/1939] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:58 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:58.548015 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c2cc72d8-e836-4030-bb86-2148c372d83d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:58.549112 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c2cc72d8-e836-4030-bb86-2148c372d83d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:58.556760 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c2cc72d8-e836-4030-bb86-2148c372d83d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:58.557232 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c2cc72d8-e836-4030-bb86-2148c372d83d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:58.558033 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c2cc72d8-e836-4030-bb86-2148c372d83d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:58.558473 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c2cc72d8-e836-4030-bb86-2148c372d83d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:58.720980 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b7f5a555-7364-4b00-8a93-4e44dc186510 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/27a230fc-be9d-4889-8a58-24a402effdaa" status: 200 len: 224 microversion: 2.1 time: 0.231375 Apr 16 21:13:58.722152 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 994/1940] 10.222.0.20 () {58 vars in 1268 bytes} [Sat Apr 16 21:13:58 2022] GET /compute/v2.1/os-security-groups/27a230fc-be9d-4889-8a58-24a402effdaa => generated 224 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:13:58.724857 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c2cc72d8-e836-4030-bb86-2148c372d83d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:58.735112 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a6f2733c-67c7-421e-80a7-bece5a46ed31 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:58.735866 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a6f2733c-67c7-421e-80a7-bece5a46ed31 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d9673504-31ed-4a93-abbd-67a338294f1f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:58.736128 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c2cc72d8-e836-4030-bb86-2148c372d83d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:58.737698 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c2cc72d8-e836-4030-bb86-2148c372d83d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:58.738931 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c2cc72d8-e836-4030-bb86-2148c372d83d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1783 microversion: 2.32 time: 0.195029 Apr 16 21:13:58.739480 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 947/1941] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:13:58 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1783 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:13:58.744482 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a6f2733c-67c7-421e-80a7-bece5a46ed31 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:58.744992 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0c0e21f0-6cad-4655-9563-1e6b5b3c5223 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-228723449"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:13:58.745583 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a6f2733c-67c7-421e-80a7-bece5a46ed31 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:58.746154 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0c0e21f0-6cad-4655-9563-1e6b5b3c5223 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:58.746959 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a6f2733c-67c7-421e-80a7-bece5a46ed31 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:58.747632 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a6f2733c-67c7-421e-80a7-bece5a46ed31 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:58.752942 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0c0e21f0-6cad-4655-9563-1e6b5b3c5223 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:58.757720 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0c0e21f0-6cad-4655-9563-1e6b5b3c5223 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:58.757720 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0c0e21f0-6cad-4655-9563-1e6b5b3c5223 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:58.757720 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0c0e21f0-6cad-4655-9563-1e6b5b3c5223 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:59.134963 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a6f2733c-67c7-421e-80a7-bece5a46ed31 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:59.147460 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a6f2733c-67c7-421e-80a7-bece5a46ed31 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:59.149433 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a6f2733c-67c7-421e-80a7-bece5a46ed31 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:59.150657 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a6f2733c-67c7-421e-80a7-bece5a46ed31 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f" status: 200 len: 1483 microversion: 2.25 time: 0.420108 Apr 16 21:13:59.151781 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 995/1942] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:13:58 2022] GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f => generated 1483 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:13:59.159083 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0101942d-a213-4a23-ab1f-b85eed0ab280 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '.version_select at 0x7fbb9fee0790>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:59.364941 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0c0e21f0-6cad-4655-9563-1e6b5b3c5223 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "POST /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa/action" status: 202 len: 0 microversion: 2.1 time: 0.624152 Apr 16 21:13:59.369565 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 948/1943] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:13:58 2022] POST /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa/action => generated 0 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Apr 16 21:13:59.399329 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-05dc47e2-0a0e-4693-bd25-f1dbf5bed44d tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:59.400046 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-05dc47e2-0a0e-4693-bd25-f1dbf5bed44d tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] [instance: 58b86589-e35e-4b91-b192-9f744516f66f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:59.442883 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-05dc47e2-0a0e-4693-bd25-f1dbf5bed44d tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:59.442883 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-05dc47e2-0a0e-4693-bd25-f1dbf5bed44d tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:59.442883 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-05dc47e2-0a0e-4693-bd25-f1dbf5bed44d tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:59.442883 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-05dc47e2-0a0e-4693-bd25-f1dbf5bed44d tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:59.790278 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-05dc47e2-0a0e-4693-bd25-f1dbf5bed44d tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a6ff623974d4156a05a7bd3e3b3ed5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840fd4cbe2fd414bb97f14898bf9647d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:13:59.807525 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-05dc47e2-0a0e-4693-bd25-f1dbf5bed44d tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] 10.222.0.20 "GET /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f" status: 200 len: 1482 microversion: 2.1 time: 0.436290 Apr 16 21:13:59.810851 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 949/1944] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:59 2022] GET /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f => generated 1482 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:13:59.820942 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7034afcd-9323-4837-8342-6e54fbaed747 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:59.823129 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7034afcd-9323-4837-8342-6e54fbaed747 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:59.823925 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0101942d-a213-4a23-ab1f-b85eed0ab280 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/27a230fc-be9d-4889-8a58-24a402effdaa" status: 202 len: 0 microversion: 2.1 time: 0.670008 Apr 16 21:13:59.825099 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 996/1945] 10.222.0.20 () {58 vars in 1271 bytes} [Sat Apr 16 21:13:59 2022] DELETE /compute/v2.1/os-security-groups/27a230fc-be9d-4889-8a58-24a402effdaa => generated 0 bytes in 673 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:13:59.834270 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-45bd690c-b343-4dba-94b1-243403c55be0 req-7ae6fd85-844a-4f49-bece-0c58973bc19a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e98c6a8-a1a1-4e8d-98bf-18f5967003ef", "name": "network-vif-plugged", "status": "completed", "tag": "7f99c127-cfc6-412e-914a-153d34cbba61"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:13:59.851360 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7034afcd-9323-4837-8342-6e54fbaed747 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:59.852424 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7034afcd-9323-4837-8342-6e54fbaed747 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:59.854509 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7034afcd-9323-4837-8342-6e54fbaed747 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:59.856707 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-45bd690c-b343-4dba-94b1-243403c55be0 req-7ae6fd85-844a-4f49-bece-0c58973bc19a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:59.857894 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7034afcd-9323-4837-8342-6e54fbaed747 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:59.861380 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-45bd690c-b343-4dba-94b1-243403c55be0 req-7ae6fd85-844a-4f49-bece-0c58973bc19a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:59.896979 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-45bd690c-b343-4dba-94b1-243403c55be0 req-7ae6fd85-844a-4f49-bece-0c58973bc19a service nova] Creating event network-vif-plugged:7f99c127-cfc6-412e-914a-153d34cbba61 for instance 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef on nch2-master-1 Apr 16 21:13:59.912636 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-45bd690c-b343-4dba-94b1-243403c55be0 req-7ae6fd85-844a-4f49-bece-0c58973bc19a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085708 Apr 16 21:13:59.916824 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 997/1946] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:13:59.945588 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fd5a269b-6a8c-4139-9c2e-c9b8d4d28c13 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:13:59.949123 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fd5a269b-6a8c-4139-9c2e-c9b8d4d28c13 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:13:59.967849 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fd5a269b-6a8c-4139-9c2e-c9b8d4d28c13 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:59.968891 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fd5a269b-6a8c-4139-9c2e-c9b8d4d28c13 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:13:59.969932 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fd5a269b-6a8c-4139-9c2e-c9b8d4d28c13 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:13:59.970558 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fd5a269b-6a8c-4139-9c2e-c9b8d4d28c13 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:00.251141 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7034afcd-9323-4837-8342-6e54fbaed747 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:00.267497 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7034afcd-9323-4837-8342-6e54fbaed747 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1308 microversion: 2.1 time: 0.454973 Apr 16 21:14:00.270185 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 950/1947] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:59 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1308 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:00.277014 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ad26fe2e-14b8-4b0f-a501-5785a3f5ea6c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:00.278578 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ad26fe2e-14b8-4b0f-a501-5785a3f5ea6c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:00.287317 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ad26fe2e-14b8-4b0f-a501-5785a3f5ea6c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:00.289244 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ad26fe2e-14b8-4b0f-a501-5785a3f5ea6c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:00.291366 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ad26fe2e-14b8-4b0f-a501-5785a3f5ea6c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:00.291997 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ad26fe2e-14b8-4b0f-a501-5785a3f5ea6c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:00.382682 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fd5a269b-6a8c-4139-9c2e-c9b8d4d28c13 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:00.391268 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fd5a269b-6a8c-4139-9c2e-c9b8d4d28c13 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1392 microversion: 2.1 time: 0.472930 Apr 16 21:14:00.392437 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 998/1948] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:13:59 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1392 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:00.410871 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-09377a91-69a9-4ba4-84f4-b25fdf93da21 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:00.410871 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-09377a91-69a9-4ba4-84f4-b25fdf93da21 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] [instance: 58b86589-e35e-4b91-b192-9f744516f66f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:00.426785 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-09377a91-69a9-4ba4-84f4-b25fdf93da21 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:00.428068 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-09377a91-69a9-4ba4-84f4-b25fdf93da21 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:00.430921 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-09377a91-69a9-4ba4-84f4-b25fdf93da21 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:00.431489 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-09377a91-69a9-4ba4-84f4-b25fdf93da21 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:00.616895 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ad26fe2e-14b8-4b0f-a501-5785a3f5ea6c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:00.626784 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ad26fe2e-14b8-4b0f-a501-5785a3f5ea6c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:00.629622 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ad26fe2e-14b8-4b0f-a501-5785a3f5ea6c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:00.635060 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ad26fe2e-14b8-4b0f-a501-5785a3f5ea6c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1828 microversion: 2.32 time: 0.361135 Apr 16 21:14:00.635060 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 951/1949] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:00 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1828 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:14:00.640157 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bba0ca9a-17f9-40ee-8ed1-7c2ede751f77 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '.version_select at 0x7fbb95bee9d0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:00.673334 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-09377a91-69a9-4ba4-84f4-b25fdf93da21 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] 10.222.0.20 "GET /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.279509 Apr 16 21:14:00.674561 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 999/1950] 10.222.0.20 () {58 vars in 1274 bytes} [Sat Apr 16 21:14:00 2022] GET /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f/os-interface => generated 285 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:14:00.679639 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-95531d54-4e04-4997-8c54-baaed3429d51 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:00.682564 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-95531d54-4e04-4997-8c54-baaed3429d51 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d9673504-31ed-4a93-abbd-67a338294f1f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:00.684975 ncdv-master-1 devstack@n-api.service[137409]: DEBUG neutronclient.v2_0.client [None req-bba0ca9a-17f9-40ee-8ed1-7c2ede751f77 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 27a230fc-be9d-4889-8a58-24a402effdaa does not exist", "detail": ""}} {{(pid=137409) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 16 21:14:00.686520 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.security_group_api [None req-bba0ca9a-17f9-40ee-8ed1-7c2ede751f77 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Neutron security group 27a230fc-be9d-4889-8a58-24a402effdaa not found {{(pid=137409) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 16 21:14:00.687187 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-bba0ca9a-17f9-40ee-8ed1-7c2ede751f77 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] HTTP exception thrown: Security group 27a230fc-be9d-4889-8a58-24a402effdaa does not exist Apr 16 21:14:00.687187 ncdv-master-1 devstack@n-api.service[137409]: Neutron server returns request_ids: ['req-83a4b8f4-3665-41f6-9516-6cd0dc42b2c3'] Apr 16 21:14:00.688138 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bba0ca9a-17f9-40ee-8ed1-7c2ede751f77 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Returning 404 to user: Security group 27a230fc-be9d-4889-8a58-24a402effdaa does not exist Apr 16 21:14:00.688138 ncdv-master-1 devstack@n-api.service[137409]: Neutron server returns request_ids: ['req-83a4b8f4-3665-41f6-9516-6cd0dc42b2c3'] {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:14:00.689398 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bba0ca9a-17f9-40ee-8ed1-7c2ede751f77 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/27a230fc-be9d-4889-8a58-24a402effdaa" status: 404 len: 194 microversion: 2.1 time: 0.054833 Apr 16 21:14:00.690327 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 952/1951] 10.222.0.20 () {58 vars in 1268 bytes} [Sat Apr 16 21:14:00 2022] GET /compute/v2.1/os-security-groups/27a230fc-be9d-4889-8a58-24a402effdaa => generated 194 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:14:00.695576 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-95531d54-4e04-4997-8c54-baaed3429d51 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:00.700843 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-2cd30f74-e955-4190-b122-48a3063b5b83 req-13bb8bb7-48c6-46d2-b9d1-726906addd0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9673504-31ed-4a93-abbd-67a338294f1f", "name": "network-vif-deleted", "tag": "5d34bb81-13df-419f-85d3-8e3a86be7e32"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:00.701730 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-95531d54-4e04-4997-8c54-baaed3429d51 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:00.702755 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-95531d54-4e04-4997-8c54-baaed3429d51 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:00.703426 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-95531d54-4e04-4997-8c54-baaed3429d51 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:00.715495 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-2cd30f74-e955-4190-b122-48a3063b5b83 req-13bb8bb7-48c6-46d2-b9d1-726906addd0e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:00.716238 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-2cd30f74-e955-4190-b122-48a3063b5b83 req-13bb8bb7-48c6-46d2-b9d1-726906addd0e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:00.752312 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-2cd30f74-e955-4190-b122-48a3063b5b83 req-13bb8bb7-48c6-46d2-b9d1-726906addd0e service nova] Creating event network-vif-deleted:5d34bb81-13df-419f-85d3-8e3a86be7e32 for instance d9673504-31ed-4a93-abbd-67a338294f1f on nch1-master-1 Apr 16 21:14:00.765156 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-2cd30f74-e955-4190-b122-48a3063b5b83 req-13bb8bb7-48c6-46d2-b9d1-726906addd0e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072316 Apr 16 21:14:00.766967 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 953/1952] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:14:00.794291 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b28615e4-2c65-4e91-97da-d090694794e5 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Action: 'create', calling method: .version_select at 0x7fbb9ff56e50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-2104533065", "description": "tempest-description-35410685"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:00.881031 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-95531d54-4e04-4997-8c54-baaed3429d51 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:00.889669 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-95531d54-4e04-4997-8c54-baaed3429d51 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:00.891580 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-95531d54-4e04-4997-8c54-baaed3429d51 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:00.892988 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-95531d54-4e04-4997-8c54-baaed3429d51 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f" status: 200 len: 1266 microversion: 2.25 time: 0.217157 Apr 16 21:14:00.893521 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1000/1953] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:00 2022] GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:14:01.289634 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c52a2870-ce19-48ee-bb72-940a4a499f56 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:01.290220 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c52a2870-ce19-48ee-bb72-940a4a499f56 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:01.297542 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c52a2870-ce19-48ee-bb72-940a4a499f56 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:01.298388 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c52a2870-ce19-48ee-bb72-940a4a499f56 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:01.299483 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c52a2870-ce19-48ee-bb72-940a4a499f56 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:01.300275 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c52a2870-ce19-48ee-bb72-940a4a499f56 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:01.581153 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c52a2870-ce19-48ee-bb72-940a4a499f56 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:01.588613 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c52a2870-ce19-48ee-bb72-940a4a499f56 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1308 microversion: 2.1 time: 0.308012 Apr 16 21:14:01.589229 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1001/1954] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:01 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1308 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:01.593669 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-37646e83-5ff4-4380-bc0f-85acdc67979b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:01.594278 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-37646e83-5ff4-4380-bc0f-85acdc67979b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:01.599816 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-37646e83-5ff4-4380-bc0f-85acdc67979b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:01.600309 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-37646e83-5ff4-4380-bc0f-85acdc67979b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:01.601080 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-37646e83-5ff4-4380-bc0f-85acdc67979b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:01.601517 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-37646e83-5ff4-4380-bc0f-85acdc67979b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:01.733027 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-37646e83-5ff4-4380-bc0f-85acdc67979b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:01.740489 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-37646e83-5ff4-4380-bc0f-85acdc67979b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1392 microversion: 2.1 time: 0.150239 Apr 16 21:14:01.741055 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1002/1955] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:01 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1392 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:01.745550 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-953d5046-83d3-409f-a089-196e0d5fab0c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:01.746245 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-953d5046-83d3-409f-a089-196e0d5fab0c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:01.751808 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-953d5046-83d3-409f-a089-196e0d5fab0c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:01.752335 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-953d5046-83d3-409f-a089-196e0d5fab0c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:01.761807 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-953d5046-83d3-409f-a089-196e0d5fab0c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:01.761807 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-953d5046-83d3-409f-a089-196e0d5fab0c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:01.869024 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b28615e4-2c65-4e91-97da-d090694794e5 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.100715 Apr 16 21:14:01.875484 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 954/1956] 10.222.0.20 () {60 vars in 1179 bytes} [Sat Apr 16 21:14:00 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:14:01.884068 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ddf6d799-5a00-42df-8f89-767b2ed0ec0f tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Action: 'create', calling method: .version_select at 0x7fbb95c74160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-824930380", "description": "tempest-description-1893464984"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:02.095417 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-953d5046-83d3-409f-a089-196e0d5fab0c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:02.114421 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-953d5046-83d3-409f-a089-196e0d5fab0c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:02.116427 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-953d5046-83d3-409f-a089-196e0d5fab0c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:02.118548 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-953d5046-83d3-409f-a089-196e0d5fab0c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1828 microversion: 2.32 time: 0.376193 Apr 16 21:14:02.131310 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1003/1957] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:01 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1828 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:14:02.157839 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-178196e1-2389-4cba-af87-bca9cbc0586a tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:02.157839 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-178196e1-2389-4cba-af87-bca9cbc0586a tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d9673504-31ed-4a93-abbd-67a338294f1f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:02.162324 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-178196e1-2389-4cba-af87-bca9cbc0586a tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:02.163036 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-178196e1-2389-4cba-af87-bca9cbc0586a tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:02.164096 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-178196e1-2389-4cba-af87-bca9cbc0586a tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:02.164757 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-178196e1-2389-4cba-af87-bca9cbc0586a tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:02.181403 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-178196e1-2389-4cba-af87-bca9cbc0586a tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] HTTP exception thrown: Instance d9673504-31ed-4a93-abbd-67a338294f1f could not be found. Apr 16 21:14:02.185742 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-178196e1-2389-4cba-af87-bca9cbc0586a tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Returning 404 to user: Instance d9673504-31ed-4a93-abbd-67a338294f1f could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:14:02.185742 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-178196e1-2389-4cba-af87-bca9cbc0586a tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f" status: 404 len: 111 microversion: 2.25 time: 0.045277 Apr 16 21:14:02.185742 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1004/1958] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:02 2022] GET /compute/v2.1/servers/d9673504-31ed-4a93-abbd-67a338294f1f => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:14:02.191410 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-3fa126c7-dcd9-4bf6-8aec-8e08a9f8ee1b req-1dac5c0b-1f25-4be1-a5e7-c1f17c7d8a1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98ca4f4e-246a-449b-b9fd-e1c17e119faa", "name": "network-vif-unplugged", "status": "completed", "tag": "9bc5b971-3aa6-49d0-8b96-ab0e7cb12588"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:02.199797 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-3fa126c7-dcd9-4bf6-8aec-8e08a9f8ee1b req-1dac5c0b-1f25-4be1-a5e7-c1f17c7d8a1d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:02.200282 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-3fa126c7-dcd9-4bf6-8aec-8e08a9f8ee1b req-1dac5c0b-1f25-4be1-a5e7-c1f17c7d8a1d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:02.214337 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-3fa126c7-dcd9-4bf6-8aec-8e08a9f8ee1b req-1dac5c0b-1f25-4be1-a5e7-c1f17c7d8a1d service nova] Creating event network-vif-unplugged:9bc5b971-3aa6-49d0-8b96-ab0e7cb12588 for instance 98ca4f4e-246a-449b-b9fd-e1c17e119faa on nch2-master-1 Apr 16 21:14:02.219332 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-3fa126c7-dcd9-4bf6-8aec-8e08a9f8ee1b req-1dac5c0b-1f25-4be1-a5e7-c1f17c7d8a1d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031838 Apr 16 21:14:02.220396 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1005/1959] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:14:02.370789 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-b63c57b0-7bac-43e6-847d-aeb1a43a1146 req-97a84c88-3c83-45fa-ae39-671a3500e7d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf669403-03eb-40c7-9a11-3d0422f708c7", "tag": "90479900-4d72-46a0-92ee-feff9e50d619"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:02.390496 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-b63c57b0-7bac-43e6-847d-aeb1a43a1146 req-97a84c88-3c83-45fa-ae39-671a3500e7d0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:02.390496 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-b63c57b0-7bac-43e6-847d-aeb1a43a1146 req-97a84c88-3c83-45fa-ae39-671a3500e7d0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:02.409439 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-b63c57b0-7bac-43e6-847d-aeb1a43a1146 req-97a84c88-3c83-45fa-ae39-671a3500e7d0 service nova] Creating event network-changed:90479900-4d72-46a0-92ee-feff9e50d619 for instance cf669403-03eb-40c7-9a11-3d0422f708c7 on nch2-master-1 Apr 16 21:14:02.416848 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-b63c57b0-7bac-43e6-847d-aeb1a43a1146 req-97a84c88-3c83-45fa-ae39-671a3500e7d0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054167 Apr 16 21:14:02.429338 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1006/1960] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:14:02.610550 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c65469e3-44f9-492d-92af-6f00372b9146 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:02.611406 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c65469e3-44f9-492d-92af-6f00372b9146 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:02.619274 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c65469e3-44f9-492d-92af-6f00372b9146 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:02.620826 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c65469e3-44f9-492d-92af-6f00372b9146 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:02.621794 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c65469e3-44f9-492d-92af-6f00372b9146 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:02.622373 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c65469e3-44f9-492d-92af-6f00372b9146 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:02.760266 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c65469e3-44f9-492d-92af-6f00372b9146 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:02.767808 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c65469e3-44f9-492d-92af-6f00372b9146 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1308 microversion: 2.1 time: 0.164939 Apr 16 21:14:02.768452 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1007/1961] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:02 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1308 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:14:02.773097 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-80c55d2b-b70b-496d-af84-209514a6009d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:02.773960 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-80c55d2b-b70b-496d-af84-209514a6009d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:02.780731 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-80c55d2b-b70b-496d-af84-209514a6009d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:02.781192 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-80c55d2b-b70b-496d-af84-209514a6009d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:02.781977 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-80c55d2b-b70b-496d-af84-209514a6009d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:02.785442 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-80c55d2b-b70b-496d-af84-209514a6009d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:02.919180 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-80c55d2b-b70b-496d-af84-209514a6009d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:02.927561 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-80c55d2b-b70b-496d-af84-209514a6009d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1392 microversion: 2.1 time: 0.157321 Apr 16 21:14:02.928206 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1008/1962] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:02 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:03.123023 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ddf6d799-5a00-42df-8f89-767b2ed0ec0f tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.245150 Apr 16 21:14:03.123631 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 955/1963] 10.222.0.20 () {60 vars in 1179 bytes} [Sat Apr 16 21:14:01 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:14:03.136130 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ddeb2218-2d77-4e30-bd67-fdc7103a119e tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Action: 'create', calling method: .version_select at 0x7fbb9fee0e50>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-479348699", "description": "tempest-description-1830508872"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:03.143487 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cc7f5b0e-73a5-4dc5-818f-c0e4e75dc9b0 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:03.144264 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-cc7f5b0e-73a5-4dc5-818f-c0e4e75dc9b0 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:03.160855 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cc7f5b0e-73a5-4dc5-818f-c0e4e75dc9b0 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:03.161405 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cc7f5b0e-73a5-4dc5-818f-c0e4e75dc9b0 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:03.162418 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cc7f5b0e-73a5-4dc5-818f-c0e4e75dc9b0 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:03.164394 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cc7f5b0e-73a5-4dc5-818f-c0e4e75dc9b0 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:03.357286 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cc7f5b0e-73a5-4dc5-818f-c0e4e75dc9b0 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:03.374952 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cc7f5b0e-73a5-4dc5-818f-c0e4e75dc9b0 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:03.378211 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cc7f5b0e-73a5-4dc5-818f-c0e4e75dc9b0 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:03.379568 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cc7f5b0e-73a5-4dc5-818f-c0e4e75dc9b0 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1828 microversion: 2.32 time: 0.241670 Apr 16 21:14:03.380341 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 956/1964] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:03 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1828 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:14:03.389083 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-83623b3b-8768-4aa3-ab64-1b87972667d2 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:03.389448 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-83623b3b-8768-4aa3-ab64-1b87972667d2 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] [instance: 58b86589-e35e-4b91-b192-9f744516f66f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:03.397145 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-83623b3b-8768-4aa3-ab64-1b87972667d2 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:03.404217 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-83623b3b-8768-4aa3-ab64-1b87972667d2 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:03.404217 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-83623b3b-8768-4aa3-ab64-1b87972667d2 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:03.404217 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-83623b3b-8768-4aa3-ab64-1b87972667d2 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:03.552868 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-83623b3b-8768-4aa3-ab64-1b87972667d2 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a6ff623974d4156a05a7bd3e3b3ed5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840fd4cbe2fd414bb97f14898bf9647d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:03.565747 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ddeb2218-2d77-4e30-bd67-fdc7103a119e tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.434855 Apr 16 21:14:03.566469 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1009/1965] 10.222.0.20 () {60 vars in 1179 bytes} [Sat Apr 16 21:14:03 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:14:03.571915 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-ea8d729b-1a86-4293-8053-a3c8a6636f63 req-4ab82d37-461b-4ff3-a3c7-97ac5faa6c4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58b86589-e35e-4b91-b192-9f744516f66f", "tag": "3a37d159-26e4-4121-9cef-bb552002481b"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:03.574945 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-83623b3b-8768-4aa3-ab64-1b87972667d2 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] 10.222.0.20 "GET /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f" status: 200 len: 1482 microversion: 2.1 time: 0.192695 Apr 16 21:14:03.578742 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 957/1966] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:03 2022] GET /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f => generated 1482 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:03.582754 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-ea8d729b-1a86-4293-8053-a3c8a6636f63 req-4ab82d37-461b-4ff3-a3c7-97ac5faa6c4e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:03.583549 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-ea8d729b-1a86-4293-8053-a3c8a6636f63 req-4ab82d37-461b-4ff3-a3c7-97ac5faa6c4e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:03.584107 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5e4cdbba-d0e5-455e-8416-880379d3c568 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '.version_select at 0x7fbb961e2ee0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:03.601057 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-ea8d729b-1a86-4293-8053-a3c8a6636f63 req-4ab82d37-461b-4ff3-a3c7-97ac5faa6c4e service nova] Creating event network-changed:3a37d159-26e4-4121-9cef-bb552002481b for instance 58b86589-e35e-4b91-b192-9f744516f66f on nch1-master-1 Apr 16 21:14:03.613942 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-ea8d729b-1a86-4293-8053-a3c8a6636f63 req-4ab82d37-461b-4ff3-a3c7-97ac5faa6c4e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045449 Apr 16 21:14:03.614810 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1010/1967] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:14:03.797197 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-dfd60b9d-ae8f-4c41-867b-b3968e9f092e tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:03.799226 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-dfd60b9d-ae8f-4c41-867b-b3968e9f092e tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:03.810556 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dfd60b9d-ae8f-4c41-867b-b3968e9f092e tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:03.811396 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dfd60b9d-ae8f-4c41-867b-b3968e9f092e tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:03.812775 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dfd60b9d-ae8f-4c41-867b-b3968e9f092e tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:03.813388 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dfd60b9d-ae8f-4c41-867b-b3968e9f092e tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:04.022788 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5e4cdbba-d0e5-455e-8416-880379d3c568 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups" status: 200 len: 1831 microversion: 2.1 time: 0.442856 Apr 16 21:14:04.037597 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 958/1968] 10.222.0.20 () {58 vars in 1157 bytes} [Sat Apr 16 21:14:03 2022] GET /compute/v2.1/os-security-groups => generated 1831 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:04.037597 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-dc0f34aa-60f7-4d0b-9ea6-8c39069bc176 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:04.037597 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-dc0f34aa-60f7-4d0b-9ea6-8c39069bc176 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:04.040697 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-dfd60b9d-ae8f-4c41-867b-b3968e9f092e tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:04.050827 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dc0f34aa-60f7-4d0b-9ea6-8c39069bc176 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:04.051372 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dc0f34aa-60f7-4d0b-9ea6-8c39069bc176 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:04.051553 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-dfd60b9d-ae8f-4c41-867b-b3968e9f092e tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1308 microversion: 2.1 time: 0.263056 Apr 16 21:14:04.052359 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dc0f34aa-60f7-4d0b-9ea6-8c39069bc176 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:04.052891 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dc0f34aa-60f7-4d0b-9ea6-8c39069bc176 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:04.053328 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1011/1969] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:03 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1308 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:04.058394 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-58455792-da55-4ca8-a9a3-256a726f5fd6 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '.version_select at 0x7fbb9ff4d820>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:04.294235 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-dc0f34aa-60f7-4d0b-9ea6-8c39069bc176 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:04.301980 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-dc0f34aa-60f7-4d0b-9ea6-8c39069bc176 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1392 microversion: 2.1 time: 0.277037 Apr 16 21:14:04.302819 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 959/1970] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:04 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1392 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:04.368519 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-58455792-da55-4ca8-a9a3-256a726f5fd6 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/ffaddd03-3213-4dbd-a7e6-f2f52d73f0c2" status: 202 len: 0 microversion: 2.1 time: 0.313806 Apr 16 21:14:04.369239 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1012/1971] 10.222.0.20 () {58 vars in 1271 bytes} [Sat Apr 16 21:14:04 2022] DELETE /compute/v2.1/os-security-groups/ffaddd03-3213-4dbd-a7e6-f2f52d73f0c2 => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:14:04.377456 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4ec4cce6-7bf0-4936-804c-16e2931db2dc tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '.version_select at 0x7fbb961e23a0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:04.399191 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2d7d931d-0bef-4d05-aa25-f23889dfbe38 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:04.400647 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2d7d931d-0bef-4d05-aa25-f23889dfbe38 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:04.408775 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2d7d931d-0bef-4d05-aa25-f23889dfbe38 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:04.409930 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2d7d931d-0bef-4d05-aa25-f23889dfbe38 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:04.411067 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2d7d931d-0bef-4d05-aa25-f23889dfbe38 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:04.411380 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2d7d931d-0bef-4d05-aa25-f23889dfbe38 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:04.414367 ncdv-master-1 devstack@n-api.service[137409]: DEBUG neutronclient.v2_0.client [None req-4ec4cce6-7bf0-4936-804c-16e2931db2dc tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ffaddd03-3213-4dbd-a7e6-f2f52d73f0c2 does not exist", "detail": ""}} {{(pid=137409) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 16 21:14:04.414991 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.security_group_api [None req-4ec4cce6-7bf0-4936-804c-16e2931db2dc tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Neutron security group ffaddd03-3213-4dbd-a7e6-f2f52d73f0c2 not found {{(pid=137409) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 16 21:14:04.415704 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-4ec4cce6-7bf0-4936-804c-16e2931db2dc tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] HTTP exception thrown: Security group ffaddd03-3213-4dbd-a7e6-f2f52d73f0c2 does not exist Apr 16 21:14:04.415704 ncdv-master-1 devstack@n-api.service[137409]: Neutron server returns request_ids: ['req-b9dc1c73-8ea4-4caa-a270-87825ad93115'] Apr 16 21:14:04.416343 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4ec4cce6-7bf0-4936-804c-16e2931db2dc tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Returning 404 to user: Security group ffaddd03-3213-4dbd-a7e6-f2f52d73f0c2 does not exist Apr 16 21:14:04.416343 ncdv-master-1 devstack@n-api.service[137409]: Neutron server returns request_ids: ['req-b9dc1c73-8ea4-4caa-a270-87825ad93115'] {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:14:04.417380 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4ec4cce6-7bf0-4936-804c-16e2931db2dc tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/ffaddd03-3213-4dbd-a7e6-f2f52d73f0c2" status: 404 len: 194 microversion: 2.1 time: 0.043663 Apr 16 21:14:04.423848 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 960/1972] 10.222.0.20 () {58 vars in 1268 bytes} [Sat Apr 16 21:14:04 2022] GET /compute/v2.1/os-security-groups/ffaddd03-3213-4dbd-a7e6-f2f52d73f0c2 => generated 194 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:14:04.426434 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9b247205-7630-49ad-bdd1-d235db702459 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '.version_select at 0x7fbb95b85f70>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:04.631937 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2d7d931d-0bef-4d05-aa25-f23889dfbe38 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:04.641973 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2d7d931d-0bef-4d05-aa25-f23889dfbe38 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:04.643501 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2d7d931d-0bef-4d05-aa25-f23889dfbe38 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:04.645021 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2d7d931d-0bef-4d05-aa25-f23889dfbe38 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1828 microversion: 2.32 time: 0.249493 Apr 16 21:14:04.645604 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1013/1973] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:04 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1828 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:14:04.827553 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9b247205-7630-49ad-bdd1-d235db702459 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/2dca06f2-dc9f-4be6-bd47-c610f9f7731a" status: 202 len: 0 microversion: 2.1 time: 0.405262 Apr 16 21:14:04.832861 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 961/1974] 10.222.0.20 () {58 vars in 1271 bytes} [Sat Apr 16 21:14:04 2022] DELETE /compute/v2.1/os-security-groups/2dca06f2-dc9f-4be6-bd47-c610f9f7731a => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:14:04.839953 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6decbcb8-34c2-4a74-89ac-1ddf5770482d tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '.version_select at 0x7fbb9fe7bdc0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:04.865339 ncdv-master-1 devstack@n-api.service[137408]: DEBUG neutronclient.v2_0.client [None req-6decbcb8-34c2-4a74-89ac-1ddf5770482d tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2dca06f2-dc9f-4be6-bd47-c610f9f7731a does not exist", "detail": ""}} {{(pid=137408) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 16 21:14:04.866245 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.security_group_api [None req-6decbcb8-34c2-4a74-89ac-1ddf5770482d tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Neutron security group 2dca06f2-dc9f-4be6-bd47-c610f9f7731a not found {{(pid=137408) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 16 21:14:04.866779 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-6decbcb8-34c2-4a74-89ac-1ddf5770482d tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] HTTP exception thrown: Security group 2dca06f2-dc9f-4be6-bd47-c610f9f7731a does not exist Apr 16 21:14:04.866779 ncdv-master-1 devstack@n-api.service[137408]: Neutron server returns request_ids: ['req-d3cffab6-1385-4b26-9bdd-f0998c14ece8'] Apr 16 21:14:04.867386 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6decbcb8-34c2-4a74-89ac-1ddf5770482d tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Returning 404 to user: Security group 2dca06f2-dc9f-4be6-bd47-c610f9f7731a does not exist Apr 16 21:14:04.867386 ncdv-master-1 devstack@n-api.service[137408]: Neutron server returns request_ids: ['req-d3cffab6-1385-4b26-9bdd-f0998c14ece8'] {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:14:04.868322 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6decbcb8-34c2-4a74-89ac-1ddf5770482d tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/2dca06f2-dc9f-4be6-bd47-c610f9f7731a" status: 404 len: 194 microversion: 2.1 time: 0.034172 Apr 16 21:14:04.868894 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1014/1975] 10.222.0.20 () {58 vars in 1268 bytes} [Sat Apr 16 21:14:04 2022] GET /compute/v2.1/os-security-groups/2dca06f2-dc9f-4be6-bd47-c610f9f7731a => generated 194 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:14:04.877687 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b7a47792-c271-4aa4-97ae-e5f439bddd5c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '.version_select at 0x7fbb95bf9820>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:05.069361 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f953c19f-e68d-4a74-be23-6212cd500166 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:05.069976 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f953c19f-e68d-4a74-be23-6212cd500166 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:05.082589 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f953c19f-e68d-4a74-be23-6212cd500166 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:05.083151 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f953c19f-e68d-4a74-be23-6212cd500166 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:05.084082 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f953c19f-e68d-4a74-be23-6212cd500166 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:05.084795 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f953c19f-e68d-4a74-be23-6212cd500166 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:05.221909 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f953c19f-e68d-4a74-be23-6212cd500166 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:05.238890 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b7a47792-c271-4aa4-97ae-e5f439bddd5c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/c85e969c-7391-4467-af36-6d1d63595acc" status: 202 len: 0 microversion: 2.1 time: 0.365043 Apr 16 21:14:05.241475 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 962/1976] 10.222.0.20 () {58 vars in 1271 bytes} [Sat Apr 16 21:14:04 2022] DELETE /compute/v2.1/os-security-groups/c85e969c-7391-4467-af36-6d1d63595acc => generated 0 bytes in 368 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 16 21:14:05.245853 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f953c19f-e68d-4a74-be23-6212cd500166 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1308 microversion: 2.1 time: 0.180329 Apr 16 21:14:05.247593 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1015/1977] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:05 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1308 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:05.263482 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8daa4919-e58e-4a46-b35d-861def5bf944 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '.version_select at 0x7fbb95bf94c0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:05.287536 ncdv-master-1 devstack@n-api.service[137409]: DEBUG neutronclient.v2_0.client [None req-8daa4919-e58e-4a46-b35d-861def5bf944 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c85e969c-7391-4467-af36-6d1d63595acc does not exist", "detail": ""}} {{(pid=137409) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 16 21:14:05.288268 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.security_group_api [None req-8daa4919-e58e-4a46-b35d-861def5bf944 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Neutron security group c85e969c-7391-4467-af36-6d1d63595acc not found {{(pid=137409) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 16 21:14:05.288801 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-8daa4919-e58e-4a46-b35d-861def5bf944 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] HTTP exception thrown: Security group c85e969c-7391-4467-af36-6d1d63595acc does not exist Apr 16 21:14:05.288801 ncdv-master-1 devstack@n-api.service[137409]: Neutron server returns request_ids: ['req-ce98c7cf-9389-4258-a902-494442809ce5'] Apr 16 21:14:05.289455 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8daa4919-e58e-4a46-b35d-861def5bf944 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Returning 404 to user: Security group c85e969c-7391-4467-af36-6d1d63595acc does not exist Apr 16 21:14:05.289455 ncdv-master-1 devstack@n-api.service[137409]: Neutron server returns request_ids: ['req-ce98c7cf-9389-4258-a902-494442809ce5'] {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:14:05.290296 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8daa4919-e58e-4a46-b35d-861def5bf944 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/c85e969c-7391-4467-af36-6d1d63595acc" status: 404 len: 194 microversion: 2.1 time: 0.045326 Apr 16 21:14:05.291028 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 963/1978] 10.222.0.20 () {58 vars in 1268 bytes} [Sat Apr 16 21:14:05 2022] GET /compute/v2.1/os-security-groups/c85e969c-7391-4467-af36-6d1d63595acc => generated 194 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:14:05.299148 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0c8e07fb-91f5-4cf0-b434-25faa80c7cb5 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '.version_select at 0x7fbb965e71f0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:05.319149 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-23c247bd-5ea7-448e-b98e-e5ef9e6850a4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:05.319778 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-23c247bd-5ea7-448e-b98e-e5ef9e6850a4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:05.327307 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-23c247bd-5ea7-448e-b98e-e5ef9e6850a4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:05.327776 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-23c247bd-5ea7-448e-b98e-e5ef9e6850a4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:05.330003 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-23c247bd-5ea7-448e-b98e-e5ef9e6850a4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:05.330650 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-23c247bd-5ea7-448e-b98e-e5ef9e6850a4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:05.481647 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-23c247bd-5ea7-448e-b98e-e5ef9e6850a4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:05.488637 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0c8e07fb-91f5-4cf0-b434-25faa80c7cb5 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups" status: 200 len: 1157 microversion: 2.1 time: 0.193188 Apr 16 21:14:05.489560 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1016/1979] 10.222.0.20 () {58 vars in 1157 bytes} [Sat Apr 16 21:14:05 2022] GET /compute/v2.1/os-security-groups => generated 1157 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:05.500897 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-23c247bd-5ea7-448e-b98e-e5ef9e6850a4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1392 microversion: 2.1 time: 0.185636 Apr 16 21:14:05.504573 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a1a1b3f7-5aa9-4f98-b063-450a7f307061 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Action: 'create', calling method: .version_select at 0x7fbba00a5ca0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-860618409", "description": "tempest-description-1870033524"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:05.507876 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 964/1980] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:05 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1392 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:14:05.672406 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-60fcb440-d08b-4248-a9c3-5fbd5d029456 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:05.673034 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-60fcb440-d08b-4248-a9c3-5fbd5d029456 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:05.682805 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-60fcb440-d08b-4248-a9c3-5fbd5d029456 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:05.682805 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-60fcb440-d08b-4248-a9c3-5fbd5d029456 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:05.682805 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-60fcb440-d08b-4248-a9c3-5fbd5d029456 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:05.682805 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-60fcb440-d08b-4248-a9c3-5fbd5d029456 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:05.883491 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-60fcb440-d08b-4248-a9c3-5fbd5d029456 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:05.893946 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-60fcb440-d08b-4248-a9c3-5fbd5d029456 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:05.895728 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-60fcb440-d08b-4248-a9c3-5fbd5d029456 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:05.897158 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-60fcb440-d08b-4248-a9c3-5fbd5d029456 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1828 microversion: 2.32 time: 0.237844 Apr 16 21:14:05.897726 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 965/1981] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:05 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1828 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:14:06.093378 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a1a1b3f7-5aa9-4f98-b063-450a7f307061 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.593526 Apr 16 21:14:06.094574 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1017/1982] 10.222.0.20 () {60 vars in 1179 bytes} [Sat Apr 16 21:14:05 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:14:06.104931 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-752d6fc7-61f9-4ce1-9061-2d3f6b89b159 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Action: 'create', calling method: .version_select at 0x7fbb95b85550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1004708674", "description": "tempest-description-1502275484"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:06.268668 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b59e7292-b6be-4428-b4e5-0e6eb563bd5e tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:06.269429 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b59e7292-b6be-4428-b4e5-0e6eb563bd5e tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:06.276872 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b59e7292-b6be-4428-b4e5-0e6eb563bd5e tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:06.277953 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b59e7292-b6be-4428-b4e5-0e6eb563bd5e tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:06.278857 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b59e7292-b6be-4428-b4e5-0e6eb563bd5e tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:06.279597 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b59e7292-b6be-4428-b4e5-0e6eb563bd5e tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:06.529597 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b59e7292-b6be-4428-b4e5-0e6eb563bd5e tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:06.537489 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b59e7292-b6be-4428-b4e5-0e6eb563bd5e tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1308 microversion: 2.1 time: 0.272953 Apr 16 21:14:06.547317 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1018/1983] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:06 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1308 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:14:06.548186 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2633b0b9-ba33-4a1f-93b8-9d3df1c80ff7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:06.548970 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2633b0b9-ba33-4a1f-93b8-9d3df1c80ff7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:06.555392 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2633b0b9-ba33-4a1f-93b8-9d3df1c80ff7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:06.555979 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2633b0b9-ba33-4a1f-93b8-9d3df1c80ff7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:06.556929 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2633b0b9-ba33-4a1f-93b8-9d3df1c80ff7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:06.557625 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2633b0b9-ba33-4a1f-93b8-9d3df1c80ff7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:06.704446 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-752d6fc7-61f9-4ce1-9061-2d3f6b89b159 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.603166 Apr 16 21:14:06.705050 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 966/1984] 10.222.0.20 () {60 vars in 1179 bytes} [Sat Apr 16 21:14:06 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:14:06.723655 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2633b0b9-ba33-4a1f-93b8-9d3df1c80ff7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:06.732191 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2633b0b9-ba33-4a1f-93b8-9d3df1c80ff7 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1392 microversion: 2.1 time: 0.190547 Apr 16 21:14:06.732763 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1019/1985] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:06 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1392 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:06.843076 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0579757d-042c-49f5-a05a-a4f82bab1b79 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-727630345", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "39451244-1104-46d3-8155-9d8d7ddc9546"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:06.921149 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4d69cfb7-db63-42a7-9c97-e72057a0b79d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:06.921969 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4d69cfb7-db63-42a7-9c97-e72057a0b79d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:06.929476 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-0579757d-042c-49f5-a05a-a4f82bab1b79 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] validate_networks() for [('39451244-1104-46d3-8155-9d8d7ddc9546', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:14:06.933096 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4d69cfb7-db63-42a7-9c97-e72057a0b79d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:06.933881 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4d69cfb7-db63-42a7-9c97-e72057a0b79d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:06.937797 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4d69cfb7-db63-42a7-9c97-e72057a0b79d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:06.938824 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4d69cfb7-db63-42a7-9c97-e72057a0b79d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:07.204687 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4d69cfb7-db63-42a7-9c97-e72057a0b79d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:07.218413 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4d69cfb7-db63-42a7-9c97-e72057a0b79d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:07.220916 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4d69cfb7-db63-42a7-9c97-e72057a0b79d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:07.222441 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4d69cfb7-db63-42a7-9c97-e72057a0b79d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1849 microversion: 2.32 time: 0.310104 Apr 16 21:14:07.224244 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1020/1986] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:06 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1849 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:14:07.320768 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-b1f6d09a-1c5e-446f-a157-d83e50bad524 req-16779ff0-225f-409b-b33e-4b845d02a01d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf669403-03eb-40c7-9a11-3d0422f708c7", "tag": "973da309-126f-4308-a6f4-32352abab6e7"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:07.340368 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-b1f6d09a-1c5e-446f-a157-d83e50bad524 req-16779ff0-225f-409b-b33e-4b845d02a01d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:07.340851 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-b1f6d09a-1c5e-446f-a157-d83e50bad524 req-16779ff0-225f-409b-b33e-4b845d02a01d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:07.369402 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-b1f6d09a-1c5e-446f-a157-d83e50bad524 req-16779ff0-225f-409b-b33e-4b845d02a01d service nova] Creating event network-changed:973da309-126f-4308-a6f4-32352abab6e7 for instance cf669403-03eb-40c7-9a11-3d0422f708c7 on nch2-master-1 Apr 16 21:14:07.376082 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-b1f6d09a-1c5e-446f-a157-d83e50bad524 req-16779ff0-225f-409b-b33e-4b845d02a01d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059910 Apr 16 21:14:07.377412 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1021/1987] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:14:07.384551 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-81337465-7530-4ace-8f9a-28e1937d30b4 req-9e387470-6d7a-4fe2-ae0b-e4c73dd972fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98ca4f4e-246a-449b-b9fd-e1c17e119faa", "name": "network-vif-plugged", "status": "completed", "tag": "9bc5b971-3aa6-49d0-8b96-ab0e7cb12588"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:07.394828 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-81337465-7530-4ace-8f9a-28e1937d30b4 req-9e387470-6d7a-4fe2-ae0b-e4c73dd972fa service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:07.396102 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-81337465-7530-4ace-8f9a-28e1937d30b4 req-9e387470-6d7a-4fe2-ae0b-e4c73dd972fa service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:07.410613 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-81337465-7530-4ace-8f9a-28e1937d30b4 req-9e387470-6d7a-4fe2-ae0b-e4c73dd972fa service nova] Creating event network-vif-plugged:9bc5b971-3aa6-49d0-8b96-ab0e7cb12588 for instance 98ca4f4e-246a-449b-b9fd-e1c17e119faa on nch2-master-1 Apr 16 21:14:07.427218 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-81337465-7530-4ace-8f9a-28e1937d30b4 req-9e387470-6d7a-4fe2-ae0b-e4c73dd972fa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048020 Apr 16 21:14:07.428569 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1022/1988] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:14:07.556613 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-0579757d-042c-49f5-a05a-a4f82bab1b79 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:14:07.557629 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3cb2ada2-7cfe-4204-b299-2ed381b534f9 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:07.558847 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-0579757d-042c-49f5-a05a-a4f82bab1b79 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:14:07.558973 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3cb2ada2-7cfe-4204-b299-2ed381b534f9 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:07.559328 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-0579757d-042c-49f5-a05a-a4f82bab1b79 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:14:07.559924 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-0579757d-042c-49f5-a05a-a4f82bab1b79 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:14:07.560599 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-0579757d-042c-49f5-a05a-a4f82bab1b79 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:14:07.571860 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0579757d-042c-49f5-a05a-a4f82bab1b79 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:07.572552 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0579757d-042c-49f5-a05a-a4f82bab1b79 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:07.573525 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0579757d-042c-49f5-a05a-a4f82bab1b79 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:07.575142 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0579757d-042c-49f5-a05a-a4f82bab1b79 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:07.575974 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3cb2ada2-7cfe-4204-b299-2ed381b534f9 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:07.579027 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3cb2ada2-7cfe-4204-b299-2ed381b534f9 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:07.581041 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3cb2ada2-7cfe-4204-b299-2ed381b534f9 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:07.582374 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3cb2ada2-7cfe-4204-b299-2ed381b534f9 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:07.598340 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-0579757d-042c-49f5-a05a-a4f82bab1b79 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Getting quotas for project fe50d9e0841749f094948101efdc3d92. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:14:07.606275 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-0579757d-042c-49f5-a05a-a4f82bab1b79 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Getting quotas for user c87e2c1601764f23ac7530b6ad66b3fd and project fe50d9e0841749f094948101efdc3d92. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:14:07.620032 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0579757d-042c-49f5-a05a-a4f82bab1b79 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:14:07.626555 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0579757d-042c-49f5-a05a-a4f82bab1b79 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 65449361-cc88-4caa-aeff-800337a2fbb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:14:07.776473 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0579757d-042c-49f5-a05a-a4f82bab1b79 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.937409 Apr 16 21:14:07.780916 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 967/1989] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:14:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 943 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:14:07.793961 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c85667ae-85ea-4cbb-9276-7a29dfd74544 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:07.801017 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c85667ae-85ea-4cbb-9276-7a29dfd74544 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:07.813727 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c85667ae-85ea-4cbb-9276-7a29dfd74544 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:07.816745 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c85667ae-85ea-4cbb-9276-7a29dfd74544 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:07.816745 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c85667ae-85ea-4cbb-9276-7a29dfd74544 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:07.816745 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c85667ae-85ea-4cbb-9276-7a29dfd74544 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:08.002627 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c85667ae-85ea-4cbb-9276-7a29dfd74544 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:08.011284 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c85667ae-85ea-4cbb-9276-7a29dfd74544 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1382 microversion: 2.1 time: 0.226064 Apr 16 21:14:08.012369 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 968/1990] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:07 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1382 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:08.020210 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-637f749b-1227-43c0-8415-9be11cfbceb0 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:08.022568 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-637f749b-1227-43c0-8415-9be11cfbceb0 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 65449361-cc88-4caa-aeff-800337a2fbb0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:08.105892 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-637f749b-1227-43c0-8415-9be11cfbceb0 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87e2c1601764f23ac7530b6ad66b3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe50d9e0841749f094948101efdc3d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:08.114523 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-637f749b-1227-43c0-8415-9be11cfbceb0 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "GET /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0" status: 200 len: 1215 microversion: 2.1 time: 0.099965 Apr 16 21:14:08.115707 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 969/1991] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:08 2022] GET /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0 => generated 1215 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:08.121952 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b4d0f7c5-31f1-46e0-97fc-bfb107b63938 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Calling method '.version_select at 0x7fbb9ff4b310>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:08.125581 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b4d0f7c5-31f1-46e0-97fc-bfb107b63938 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:08.128825 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b4d0f7c5-31f1-46e0-97fc-bfb107b63938 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:08.140593 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b4d0f7c5-31f1-46e0-97fc-bfb107b63938 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 2702 microversion: 2.1 time: 0.023459 Apr 16 21:14:08.141506 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 970/1992] 10.222.0.20 () {58 vars in 1142 bytes} [Sat Apr 16 21:14:08 2022] GET /compute/v2.1/os-migrations => generated 2702 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:08.155795 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-aecd87e0-0db8-40a5-856d-80936b80b8e2 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:08.157127 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-aecd87e0-0db8-40a5-856d-80936b80b8e2 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:08.166337 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aecd87e0-0db8-40a5-856d-80936b80b8e2 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:08.167136 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aecd87e0-0db8-40a5-856d-80936b80b8e2 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:08.169369 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aecd87e0-0db8-40a5-856d-80936b80b8e2 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:08.170488 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aecd87e0-0db8-40a5-856d-80936b80b8e2 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:08.209395 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3cb2ada2-7cfe-4204-b299-2ed381b534f9 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:08.219859 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3cb2ada2-7cfe-4204-b299-2ed381b534f9 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1308 microversion: 2.1 time: 0.668169 Apr 16 21:14:08.220498 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1023/1993] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:07 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1308 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:08.243648 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7f7c6656-18f4-4018-8171-0636db3f0f43 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:08.244585 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7f7c6656-18f4-4018-8171-0636db3f0f43 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:08.252292 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7f7c6656-18f4-4018-8171-0636db3f0f43 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:08.261172 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7f7c6656-18f4-4018-8171-0636db3f0f43 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:08.261172 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7f7c6656-18f4-4018-8171-0636db3f0f43 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:08.261172 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7f7c6656-18f4-4018-8171-0636db3f0f43 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:08.338566 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-aecd87e0-0db8-40a5-856d-80936b80b8e2 tempest-LiveMigrationTest-2010750960 tempest-LiveMigrationTest-2010750960-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1533 microversion: 2.1 time: 0.188308 Apr 16 21:14:08.345686 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 971/1994] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:08 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1533 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:14:08.374241 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-dbfd5a99-6a60-4f7f-9254-a948c3844757 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:08.375021 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-dbfd5a99-6a60-4f7f-9254-a948c3844757 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:08.383661 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dbfd5a99-6a60-4f7f-9254-a948c3844757 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:08.384124 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dbfd5a99-6a60-4f7f-9254-a948c3844757 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:08.385073 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dbfd5a99-6a60-4f7f-9254-a948c3844757 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:08.385525 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dbfd5a99-6a60-4f7f-9254-a948c3844757 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:08.455307 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-dbfd5a99-6a60-4f7f-9254-a948c3844757 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:14:08.555632 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7f7c6656-18f4-4018-8171-0636db3f0f43 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:08.572538 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7f7c6656-18f4-4018-8171-0636db3f0f43 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:08.578993 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7f7c6656-18f4-4018-8171-0636db3f0f43 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:08.580647 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7f7c6656-18f4-4018-8171-0636db3f0f43 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1849 microversion: 2.32 time: 0.342675 Apr 16 21:14:08.581882 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1024/1995] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:08 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1849 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:14:08.980791 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-dbfd5a99-6a60-4f7f-9254-a948c3844757 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "DELETE /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 204 len: 0 microversion: 2.1 time: 0.607176 Apr 16 21:14:08.980791 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 972/1996] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:14:08 2022] DELETE /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 0 bytes in 610 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:14:08.986620 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c26b772b-5835-42c2-abe5-06e3f47f862b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:08.987229 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c26b772b-5835-42c2-abe5-06e3f47f862b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:08.994126 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c26b772b-5835-42c2-abe5-06e3f47f862b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:08.994586 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c26b772b-5835-42c2-abe5-06e3f47f862b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:08.995568 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c26b772b-5835-42c2-abe5-06e3f47f862b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:08.996922 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c26b772b-5835-42c2-abe5-06e3f47f862b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:09.132994 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-68ecb9c8-0fde-4ba2-a9ea-944f3e3b7cee tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:09.133977 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-68ecb9c8-0fde-4ba2-a9ea-944f3e3b7cee tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 65449361-cc88-4caa-aeff-800337a2fbb0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:09.142376 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-68ecb9c8-0fde-4ba2-a9ea-944f3e3b7cee tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:09.143971 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-68ecb9c8-0fde-4ba2-a9ea-944f3e3b7cee tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:09.144601 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-68ecb9c8-0fde-4ba2-a9ea-944f3e3b7cee tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:09.145327 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-68ecb9c8-0fde-4ba2-a9ea-944f3e3b7cee tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:09.220766 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-68ecb9c8-0fde-4ba2-a9ea-944f3e3b7cee tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87e2c1601764f23ac7530b6ad66b3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe50d9e0841749f094948101efdc3d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:09.224840 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c26b772b-5835-42c2-abe5-06e3f47f862b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:09.229755 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-68ecb9c8-0fde-4ba2-a9ea-944f3e3b7cee tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "GET /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0" status: 200 len: 1219 microversion: 2.1 time: 0.101174 Apr 16 21:14:09.232532 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 973/1997] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:09 2022] GET /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0 => generated 1219 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:14:09.235830 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c26b772b-5835-42c2-abe5-06e3f47f862b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1388 microversion: 2.1 time: 0.253038 Apr 16 21:14:09.239261 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8dedb6e0-6fdf-4a51-afc9-7894422d94cc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:09.240056 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8dedb6e0-6fdf-4a51-afc9-7894422d94cc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:09.246618 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1025/1998] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:08 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1388 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:09.251672 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8dedb6e0-6fdf-4a51-afc9-7894422d94cc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:09.252346 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8dedb6e0-6fdf-4a51-afc9-7894422d94cc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:09.253185 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8dedb6e0-6fdf-4a51-afc9-7894422d94cc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:09.253639 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8dedb6e0-6fdf-4a51-afc9-7894422d94cc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:09.400487 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-59a98563-8098-4126-83d9-77d38ffe2d2a req-94ea334b-e769-457c-b6b8-c918e8508826 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf669403-03eb-40c7-9a11-3d0422f708c7", "tag": "b6827444-dd7b-4b83-a82d-0112e07ad27f"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:09.413404 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-59a98563-8098-4126-83d9-77d38ffe2d2a req-94ea334b-e769-457c-b6b8-c918e8508826 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:09.414703 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-59a98563-8098-4126-83d9-77d38ffe2d2a req-94ea334b-e769-457c-b6b8-c918e8508826 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:09.432791 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-59a98563-8098-4126-83d9-77d38ffe2d2a req-94ea334b-e769-457c-b6b8-c918e8508826 service nova] Creating event network-changed:b6827444-dd7b-4b83-a82d-0112e07ad27f for instance cf669403-03eb-40c7-9a11-3d0422f708c7 on nch2-master-1 Apr 16 21:14:09.437195 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8dedb6e0-6fdf-4a51-afc9-7894422d94cc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:09.440645 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-59a98563-8098-4126-83d9-77d38ffe2d2a req-94ea334b-e769-457c-b6b8-c918e8508826 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045728 Apr 16 21:14:09.441905 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1026/1999] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:14:09.447132 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8dedb6e0-6fdf-4a51-afc9-7894422d94cc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1308 microversion: 2.1 time: 0.213339 Apr 16 21:14:09.448064 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 974/2000] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:09 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1308 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:09.600528 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-706c4af4-f7a2-461a-94ad-0d1bceb46d74 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:09.607581 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-706c4af4-f7a2-461a-94ad-0d1bceb46d74 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:09.615432 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-706c4af4-f7a2-461a-94ad-0d1bceb46d74 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:09.615897 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-706c4af4-f7a2-461a-94ad-0d1bceb46d74 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:09.617200 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-706c4af4-f7a2-461a-94ad-0d1bceb46d74 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:09.617675 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-706c4af4-f7a2-461a-94ad-0d1bceb46d74 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:10.044876 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-706c4af4-f7a2-461a-94ad-0d1bceb46d74 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:10.055113 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-706c4af4-f7a2-461a-94ad-0d1bceb46d74 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:10.060485 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-706c4af4-f7a2-461a-94ad-0d1bceb46d74 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:10.060485 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-706c4af4-f7a2-461a-94ad-0d1bceb46d74 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1870 microversion: 2.32 time: 0.464416 Apr 16 21:14:10.062166 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1027/2001] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:09 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1870 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:14:10.248526 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-064e3047-38c3-439d-bb67-50a510835446 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:10.249792 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-064e3047-38c3-439d-bb67-50a510835446 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 65449361-cc88-4caa-aeff-800337a2fbb0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:10.256435 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fb679b35-8e9c-4825-b30b-d37b9f901233 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:10.257126 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fb679b35-8e9c-4825-b30b-d37b9f901233 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:10.258140 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-064e3047-38c3-439d-bb67-50a510835446 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:10.259921 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-064e3047-38c3-439d-bb67-50a510835446 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:10.260959 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-064e3047-38c3-439d-bb67-50a510835446 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:10.261605 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-064e3047-38c3-439d-bb67-50a510835446 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:10.268793 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fb679b35-8e9c-4825-b30b-d37b9f901233 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:10.270863 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fb679b35-8e9c-4825-b30b-d37b9f901233 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:10.272396 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fb679b35-8e9c-4825-b30b-d37b9f901233 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:10.273887 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fb679b35-8e9c-4825-b30b-d37b9f901233 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:10.349113 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-064e3047-38c3-439d-bb67-50a510835446 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87e2c1601764f23ac7530b6ad66b3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe50d9e0841749f094948101efdc3d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:10.364453 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-064e3047-38c3-439d-bb67-50a510835446 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "GET /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0" status: 200 len: 1267 microversion: 2.1 time: 0.121038 Apr 16 21:14:10.373800 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 975/2002] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:10 2022] GET /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0 => generated 1267 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:10.466530 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-416705dd-5dda-45e3-9725-75d783b9bded tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:10.468684 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-416705dd-5dda-45e3-9725-75d783b9bded tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:10.481617 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-416705dd-5dda-45e3-9725-75d783b9bded tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:10.484355 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-416705dd-5dda-45e3-9725-75d783b9bded tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:10.487450 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-416705dd-5dda-45e3-9725-75d783b9bded tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:10.488134 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-416705dd-5dda-45e3-9725-75d783b9bded tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:10.548812 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fb679b35-8e9c-4825-b30b-d37b9f901233 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:10.556398 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fb679b35-8e9c-4825-b30b-d37b9f901233 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1388 microversion: 2.1 time: 0.306983 Apr 16 21:14:10.561685 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1028/2003] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:10 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1388 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:10.941203 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e3e22456-5a90-4699-8367-a0c4191f968d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:10.941818 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e3e22456-5a90-4699-8367-a0c4191f968d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:10.949578 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e3e22456-5a90-4699-8367-a0c4191f968d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:10.950025 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e3e22456-5a90-4699-8367-a0c4191f968d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:10.952515 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e3e22456-5a90-4699-8367-a0c4191f968d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:10.961587 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-416705dd-5dda-45e3-9725-75d783b9bded tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:10.962704 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e3e22456-5a90-4699-8367-a0c4191f968d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:10.976758 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-416705dd-5dda-45e3-9725-75d783b9bded tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1308 microversion: 2.1 time: 0.515175 Apr 16 21:14:10.977977 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 976/2004] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:10 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1308 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:14:10.990162 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e3e22456-5a90-4699-8367-a0c4191f968d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:14:11.082942 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9f84ee83-ac0c-42c5-85f7-96ae654b16be tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:11.084019 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9f84ee83-ac0c-42c5-85f7-96ae654b16be tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:11.095684 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9f84ee83-ac0c-42c5-85f7-96ae654b16be tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:11.097428 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9f84ee83-ac0c-42c5-85f7-96ae654b16be tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:11.098458 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9f84ee83-ac0c-42c5-85f7-96ae654b16be tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:11.100093 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9f84ee83-ac0c-42c5-85f7-96ae654b16be tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:11.411926 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e3e22456-5a90-4699-8367-a0c4191f968d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd" status: 204 len: 0 microversion: 2.25 time: 0.474468 Apr 16 21:14:11.412723 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1029/2005] 10.222.0.20 () {60 vars in 1279 bytes} [Sat Apr 16 21:14:10 2022] DELETE /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd => generated 0 bytes in 476 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 16 21:14:11.418449 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ee0cd693-c166-434c-bcf2-b4e4a9aab873 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:11.419287 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ee0cd693-c166-434c-bcf2-b4e4a9aab873 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 65449361-cc88-4caa-aeff-800337a2fbb0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:11.425683 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee0cd693-c166-434c-bcf2-b4e4a9aab873 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:11.426145 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee0cd693-c166-434c-bcf2-b4e4a9aab873 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:11.427008 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee0cd693-c166-434c-bcf2-b4e4a9aab873 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:11.427492 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee0cd693-c166-434c-bcf2-b4e4a9aab873 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:11.512041 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ee0cd693-c166-434c-bcf2-b4e4a9aab873 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87e2c1601764f23ac7530b6ad66b3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe50d9e0841749f094948101efdc3d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:11.519854 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ee0cd693-c166-434c-bcf2-b4e4a9aab873 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "GET /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0" status: 200 len: 1273 microversion: 2.1 time: 0.105783 Apr 16 21:14:11.520473 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1030/2006] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:11 2022] GET /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0 => generated 1273 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:11.530663 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-33715603-bdf0-47fd-9fef-8d2a97f80c8b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:11.530663 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-33715603-bdf0-47fd-9fef-8d2a97f80c8b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:11.531656 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-33715603-bdf0-47fd-9fef-8d2a97f80c8b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:11.532009 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-33715603-bdf0-47fd-9fef-8d2a97f80c8b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:11.533110 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-33715603-bdf0-47fd-9fef-8d2a97f80c8b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:11.533560 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-33715603-bdf0-47fd-9fef-8d2a97f80c8b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:11.687447 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-33715603-bdf0-47fd-9fef-8d2a97f80c8b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:11.700007 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-33715603-bdf0-47fd-9fef-8d2a97f80c8b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:11.702016 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-33715603-bdf0-47fd-9fef-8d2a97f80c8b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:11.703130 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-33715603-bdf0-47fd-9fef-8d2a97f80c8b tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd" status: 200 len: 1564 microversion: 2.25 time: 0.181697 Apr 16 21:14:11.707881 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1031/2007] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:11 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd => generated 1564 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:14:11.708342 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-f35a4dfc-97aa-482f-a177-236f8213c54f req-46bc5536-761b-40f1-9641-19891939b381 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf669403-03eb-40c7-9a11-3d0422f708c7", "tag": "89946b61-fbf7-4964-8abf-1d6403aac9ec"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:11.717764 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-f35a4dfc-97aa-482f-a177-236f8213c54f req-46bc5536-761b-40f1-9641-19891939b381 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:11.718221 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-f35a4dfc-97aa-482f-a177-236f8213c54f req-46bc5536-761b-40f1-9641-19891939b381 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:11.729740 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-f35a4dfc-97aa-482f-a177-236f8213c54f req-46bc5536-761b-40f1-9641-19891939b381 service nova] Creating event network-changed:89946b61-fbf7-4964-8abf-1d6403aac9ec for instance cf669403-03eb-40c7-9a11-3d0422f708c7 on nch2-master-1 Apr 16 21:14:11.735295 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-f35a4dfc-97aa-482f-a177-236f8213c54f req-46bc5536-761b-40f1-9641-19891939b381 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030404 Apr 16 21:14:11.735902 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1032/2008] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:14:11.738787 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9f84ee83-ac0c-42c5-85f7-96ae654b16be tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:11.741150 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3d79c822-8aae-4d49-9f6e-4adc74af72e5 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:11.742375 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3d79c822-8aae-4d49-9f6e-4adc74af72e5 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:11.749231 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d79c822-8aae-4d49-9f6e-4adc74af72e5 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:11.749695 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d79c822-8aae-4d49-9f6e-4adc74af72e5 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:11.751097 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d79c822-8aae-4d49-9f6e-4adc74af72e5 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:11.752451 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d79c822-8aae-4d49-9f6e-4adc74af72e5 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:11.784623 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9f84ee83-ac0c-42c5-85f7-96ae654b16be tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:11.789247 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9f84ee83-ac0c-42c5-85f7-96ae654b16be tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:11.794386 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9f84ee83-ac0c-42c5-85f7-96ae654b16be tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1870 microversion: 2.32 time: 0.717219 Apr 16 21:14:11.796184 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 977/2009] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:11 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1870 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:14:11.909966 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3d79c822-8aae-4d49-9f6e-4adc74af72e5 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:11.922660 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3d79c822-8aae-4d49-9f6e-4adc74af72e5 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1388 microversion: 2.1 time: 0.184831 Apr 16 21:14:11.931956 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1033/2010] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:11 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1388 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:11.994257 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2d458ba6-4589-4054-9e74-12f496e3527c tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:11.995192 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2d458ba6-4589-4054-9e74-12f496e3527c tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:12.003254 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2d458ba6-4589-4054-9e74-12f496e3527c tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:12.003865 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2d458ba6-4589-4054-9e74-12f496e3527c tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:12.004812 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2d458ba6-4589-4054-9e74-12f496e3527c tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:12.005366 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2d458ba6-4589-4054-9e74-12f496e3527c tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:12.514473 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2d458ba6-4589-4054-9e74-12f496e3527c tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:12.522258 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2d458ba6-4589-4054-9e74-12f496e3527c tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1308 microversion: 2.1 time: 0.531857 Apr 16 21:14:12.533382 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 978/2011] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:11 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1308 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:12.538413 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-78c4208f-ef76-4a94-8f01-8b56d8fa6727 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:12.539035 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-78c4208f-ef76-4a94-8f01-8b56d8fa6727 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 65449361-cc88-4caa-aeff-800337a2fbb0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:12.546401 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-78c4208f-ef76-4a94-8f01-8b56d8fa6727 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:12.547703 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-78c4208f-ef76-4a94-8f01-8b56d8fa6727 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:12.548739 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-78c4208f-ef76-4a94-8f01-8b56d8fa6727 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:12.549522 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-78c4208f-ef76-4a94-8f01-8b56d8fa6727 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:12.612667 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-78c4208f-ef76-4a94-8f01-8b56d8fa6727 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87e2c1601764f23ac7530b6ad66b3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe50d9e0841749f094948101efdc3d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:12.621303 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-78c4208f-ef76-4a94-8f01-8b56d8fa6727 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "GET /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0" status: 200 len: 1273 microversion: 2.1 time: 0.086704 Apr 16 21:14:12.621886 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1034/2012] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:12 2022] GET /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0 => generated 1273 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:14:12.721905 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ac3615e1-4f59-4c15-9e33-601a2231cd4d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:12.722526 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ac3615e1-4f59-4c15-9e33-601a2231cd4d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:12.729301 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ac3615e1-4f59-4c15-9e33-601a2231cd4d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:12.729766 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ac3615e1-4f59-4c15-9e33-601a2231cd4d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:12.730711 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ac3615e1-4f59-4c15-9e33-601a2231cd4d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:12.731167 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ac3615e1-4f59-4c15-9e33-601a2231cd4d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:12.814196 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e01c8eb1-2341-4f38-8aba-4de8d0cd08cc tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:12.814815 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e01c8eb1-2341-4f38-8aba-4de8d0cd08cc tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:12.822108 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e01c8eb1-2341-4f38-8aba-4de8d0cd08cc tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:12.822641 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e01c8eb1-2341-4f38-8aba-4de8d0cd08cc tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:12.823528 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e01c8eb1-2341-4f38-8aba-4de8d0cd08cc tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:12.826263 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e01c8eb1-2341-4f38-8aba-4de8d0cd08cc tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:13.097257 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ac3615e1-4f59-4c15-9e33-601a2231cd4d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:13.106720 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e01c8eb1-2341-4f38-8aba-4de8d0cd08cc tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:13.109154 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ac3615e1-4f59-4c15-9e33-601a2231cd4d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:13.110692 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ac3615e1-4f59-4c15-9e33-601a2231cd4d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:13.112329 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ac3615e1-4f59-4c15-9e33-601a2231cd4d tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd" status: 200 len: 1564 microversion: 2.25 time: 0.394448 Apr 16 21:14:13.117446 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e01c8eb1-2341-4f38-8aba-4de8d0cd08cc tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:13.119294 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e01c8eb1-2341-4f38-8aba-4de8d0cd08cc tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:13.121447 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e01c8eb1-2341-4f38-8aba-4de8d0cd08cc tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1870 microversion: 2.32 time: 0.310754 Apr 16 21:14:13.123535 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 979/2013] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:12 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd => generated 1564 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:14:13.128595 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3c4f70bd-cb77-45ef-b839-57b1ea8b209b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:13.129470 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3c4f70bd-cb77-45ef-b839-57b1ea8b209b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:13.133283 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1035/2014] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:12 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1870 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:14:13.136060 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3c4f70bd-cb77-45ef-b839-57b1ea8b209b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:13.137208 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3c4f70bd-cb77-45ef-b839-57b1ea8b209b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:13.138015 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3c4f70bd-cb77-45ef-b839-57b1ea8b209b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:13.138467 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3c4f70bd-cb77-45ef-b839-57b1ea8b209b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:13.290362 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-08cfa513-4fea-4898-8c92-f1a2d9742266 req-98c3bf88-51c1-40ad-b941-4d525d0cf9d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a60c9986-12b3-4fc4-9bde-7bf7f34f90bd", "name": "network-vif-deleted", "tag": "69daf0de-dee8-41ab-85fa-24c0d402ba05"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:13.299122 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-08cfa513-4fea-4898-8c92-f1a2d9742266 req-98c3bf88-51c1-40ad-b941-4d525d0cf9d9 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:13.299576 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-08cfa513-4fea-4898-8c92-f1a2d9742266 req-98c3bf88-51c1-40ad-b941-4d525d0cf9d9 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:13.310572 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-08cfa513-4fea-4898-8c92-f1a2d9742266 req-98c3bf88-51c1-40ad-b941-4d525d0cf9d9 service nova] Creating event network-vif-deleted:69daf0de-dee8-41ab-85fa-24c0d402ba05 for instance a60c9986-12b3-4fc4-9bde-7bf7f34f90bd on nch1-master-1 Apr 16 21:14:13.315492 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-08cfa513-4fea-4898-8c92-f1a2d9742266 req-98c3bf88-51c1-40ad-b941-4d525d0cf9d9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028898 Apr 16 21:14:13.316482 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1036/2015] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:14:13.456097 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3c4f70bd-cb77-45ef-b839-57b1ea8b209b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:13.463767 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3c4f70bd-cb77-45ef-b839-57b1ea8b209b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1388 microversion: 2.1 time: 0.338927 Apr 16 21:14:13.465126 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 980/2016] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:13 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1388 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:13.539745 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-89a50024-e36e-409e-86e6-9e5fb27918bd tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:13.540510 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-89a50024-e36e-409e-86e6-9e5fb27918bd tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:13.547748 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-89a50024-e36e-409e-86e6-9e5fb27918bd tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:13.548251 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-89a50024-e36e-409e-86e6-9e5fb27918bd tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:13.549055 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-89a50024-e36e-409e-86e6-9e5fb27918bd tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:13.549854 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-89a50024-e36e-409e-86e6-9e5fb27918bd tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:13.638473 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-09945818-d5ea-44bf-a040-509beefc533e tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:13.639091 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-09945818-d5ea-44bf-a040-509beefc533e tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 65449361-cc88-4caa-aeff-800337a2fbb0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:13.645790 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-09945818-d5ea-44bf-a040-509beefc533e tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:13.646525 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-09945818-d5ea-44bf-a040-509beefc533e tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:13.647320 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-09945818-d5ea-44bf-a040-509beefc533e tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:13.647936 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-09945818-d5ea-44bf-a040-509beefc533e tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:13.703187 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-89a50024-e36e-409e-86e6-9e5fb27918bd tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:13.710899 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-89a50024-e36e-409e-86e6-9e5fb27918bd tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1308 microversion: 2.1 time: 0.175440 Apr 16 21:14:13.714780 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1037/2017] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:13 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1308 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:13.853802 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-09945818-d5ea-44bf-a040-509beefc533e tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87e2c1601764f23ac7530b6ad66b3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe50d9e0841749f094948101efdc3d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:13.860961 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-09945818-d5ea-44bf-a040-509beefc533e tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "GET /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0" status: 200 len: 1315 microversion: 2.1 time: 0.226806 Apr 16 21:14:13.861543 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 981/2018] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:13 2022] GET /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0 => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:14:14.131114 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cdc410f0-032e-4f54-abc0-053bab80e266 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:14.132026 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cdc410f0-032e-4f54-abc0-053bab80e266 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:14.138725 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cdc410f0-032e-4f54-abc0-053bab80e266 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:14.139541 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cdc410f0-032e-4f54-abc0-053bab80e266 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:14.140692 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cdc410f0-032e-4f54-abc0-053bab80e266 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:14.141124 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-244995a4-00ad-4c34-8f9b-b2db9cd835a7 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:14.141753 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-244995a4-00ad-4c34-8f9b-b2db9cd835a7 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:14.142171 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cdc410f0-032e-4f54-abc0-053bab80e266 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:14.157804 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-244995a4-00ad-4c34-8f9b-b2db9cd835a7 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:14.158780 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-244995a4-00ad-4c34-8f9b-b2db9cd835a7 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:14.159859 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-244995a4-00ad-4c34-8f9b-b2db9cd835a7 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:14.160499 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-244995a4-00ad-4c34-8f9b-b2db9cd835a7 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:14.203438 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cdc410f0-032e-4f54-abc0-053bab80e266 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:14.204451 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cdc410f0-032e-4f54-abc0-053bab80e266 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:14.205312 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-cdc410f0-032e-4f54-abc0-053bab80e266 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lazy-loading 'fault' on Instance uuid a60c9986-12b3-4fc4-9bde-7bf7f34f90bd {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:14:14.289894 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cdc410f0-032e-4f54-abc0-053bab80e266 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:14.300894 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cdc410f0-032e-4f54-abc0-053bab80e266 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:14.303242 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cdc410f0-032e-4f54-abc0-053bab80e266 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:14.304866 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cdc410f0-032e-4f54-abc0-053bab80e266 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd" status: 200 len: 1352 microversion: 2.25 time: 0.177846 Apr 16 21:14:14.305575 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1038/2019] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:14 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd => generated 1352 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:14:14.485352 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ab673a15-7243-45fe-8dc9-8f0a37029463 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:14.486736 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ab673a15-7243-45fe-8dc9-8f0a37029463 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:14.495469 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ab673a15-7243-45fe-8dc9-8f0a37029463 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:14.496629 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ab673a15-7243-45fe-8dc9-8f0a37029463 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:14.498774 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ab673a15-7243-45fe-8dc9-8f0a37029463 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:14.499487 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ab673a15-7243-45fe-8dc9-8f0a37029463 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:14.758974 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ab673a15-7243-45fe-8dc9-8f0a37029463 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:14.770067 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ab673a15-7243-45fe-8dc9-8f0a37029463 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1388 microversion: 2.1 time: 0.292373 Apr 16 21:14:14.771801 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1039/2020] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:14 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1388 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:14:14.777472 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-18c9d5d5-465b-42a0-b075-f4c19f72bb35 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:14.778524 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-18c9d5d5-465b-42a0-b075-f4c19f72bb35 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:14.787661 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-244995a4-00ad-4c34-8f9b-b2db9cd835a7 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:14.797919 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-244995a4-00ad-4c34-8f9b-b2db9cd835a7 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:14.800792 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-18c9d5d5-465b-42a0-b075-f4c19f72bb35 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:14.801447 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-18c9d5d5-465b-42a0-b075-f4c19f72bb35 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:14.802264 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-18c9d5d5-465b-42a0-b075-f4c19f72bb35 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:14.802712 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-18c9d5d5-465b-42a0-b075-f4c19f72bb35 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:14.805139 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-244995a4-00ad-4c34-8f9b-b2db9cd835a7 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:14.809797 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-244995a4-00ad-4c34-8f9b-b2db9cd835a7 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1870 microversion: 2.32 time: 0.673333 Apr 16 21:14:14.811293 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 982/2021] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:14 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1870 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:14:14.879629 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-057f1be1-4e9d-448a-808f-e6d9ec2f5da3 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:14.880435 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-057f1be1-4e9d-448a-808f-e6d9ec2f5da3 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 65449361-cc88-4caa-aeff-800337a2fbb0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:14.898124 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-057f1be1-4e9d-448a-808f-e6d9ec2f5da3 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:14.898946 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-057f1be1-4e9d-448a-808f-e6d9ec2f5da3 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:14.900148 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-057f1be1-4e9d-448a-808f-e6d9ec2f5da3 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:14.900707 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-057f1be1-4e9d-448a-808f-e6d9ec2f5da3 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:15.133356 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-057f1be1-4e9d-448a-808f-e6d9ec2f5da3 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87e2c1601764f23ac7530b6ad66b3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe50d9e0841749f094948101efdc3d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:15.141952 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-057f1be1-4e9d-448a-808f-e6d9ec2f5da3 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "GET /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0" status: 200 len: 1315 microversion: 2.1 time: 0.266677 Apr 16 21:14:15.142837 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 983/2022] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:14 2022] GET /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0 => generated 1315 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:15.328479 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-82c1ccd5-871b-46f7-bbce-331a73acf4f3 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:15.335299 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-82c1ccd5-871b-46f7-bbce-331a73acf4f3 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: a60c9986-12b3-4fc4-9bde-7bf7f34f90bd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:15.336476 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-82c1ccd5-871b-46f7-bbce-331a73acf4f3 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:15.337240 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-82c1ccd5-871b-46f7-bbce-331a73acf4f3 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:15.338269 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-82c1ccd5-871b-46f7-bbce-331a73acf4f3 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:15.339008 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-82c1ccd5-871b-46f7-bbce-331a73acf4f3 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:15.345542 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-18c9d5d5-465b-42a0-b075-f4c19f72bb35 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:15.356812 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-18c9d5d5-465b-42a0-b075-f4c19f72bb35 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1308 microversion: 2.1 time: 0.583313 Apr 16 21:14:15.358742 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1040/2023] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:14 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1308 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:15.358959 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-82c1ccd5-871b-46f7-bbce-331a73acf4f3 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] HTTP exception thrown: Instance a60c9986-12b3-4fc4-9bde-7bf7f34f90bd could not be found. Apr 16 21:14:15.359878 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-82c1ccd5-871b-46f7-bbce-331a73acf4f3 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Returning 404 to user: Instance a60c9986-12b3-4fc4-9bde-7bf7f34f90bd could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:14:15.360959 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-82c1ccd5-871b-46f7-bbce-331a73acf4f3 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd" status: 404 len: 111 microversion: 2.25 time: 0.036688 Apr 16 21:14:15.364976 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-3144c37c-d699-4b91-ab92-200941975fe9 req-ba719bc6-db01-47c5-b323-6dfb82d905a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65449361-cc88-4caa-aeff-800337a2fbb0", "tag": "945aa480-3d27-4a43-9bf6-4d316c63e6b9"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:15.365128 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 984/2024] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:15 2022] GET /compute/v2.1/servers/a60c9986-12b3-4fc4-9bde-7bf7f34f90bd => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 16 21:14:15.372321 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f940b42c-c14a-4333-8f66-94ea0c46ccaa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:15.375382 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f940b42c-c14a-4333-8f66-94ea0c46ccaa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: ffc4d9b2-dd4f-44dc-a189-354eff7a5573] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:15.379410 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-3144c37c-d699-4b91-ab92-200941975fe9 req-ba719bc6-db01-47c5-b323-6dfb82d905a2 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:15.381014 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-3144c37c-d699-4b91-ab92-200941975fe9 req-ba719bc6-db01-47c5-b323-6dfb82d905a2 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:15.389531 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f940b42c-c14a-4333-8f66-94ea0c46ccaa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:15.390006 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f940b42c-c14a-4333-8f66-94ea0c46ccaa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:15.390820 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f940b42c-c14a-4333-8f66-94ea0c46ccaa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:15.391548 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f940b42c-c14a-4333-8f66-94ea0c46ccaa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:15.403949 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-3144c37c-d699-4b91-ab92-200941975fe9 req-ba719bc6-db01-47c5-b323-6dfb82d905a2 service nova] Creating event network-changed:945aa480-3d27-4a43-9bf6-4d316c63e6b9 for instance 65449361-cc88-4caa-aeff-800337a2fbb0 on nch1-master-1 Apr 16 21:14:15.411228 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-3144c37c-d699-4b91-ab92-200941975fe9 req-ba719bc6-db01-47c5-b323-6dfb82d905a2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050278 Apr 16 21:14:15.414189 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1041/2025] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:14:15.422605 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f940b42c-c14a-4333-8f66-94ea0c46ccaa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: ffc4d9b2-dd4f-44dc-a189-354eff7a5573] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:14:15.789952 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d6a518f2-3259-4569-a13a-6be6afc5c4c3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:15.790472 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f940b42c-c14a-4333-8f66-94ea0c46ccaa tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573" status: 204 len: 0 microversion: 2.25 time: 0.423684 Apr 16 21:14:15.790578 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 985/2026] 10.222.0.20 () {60 vars in 1279 bytes} [Sat Apr 16 21:14:15 2022] DELETE /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 16 21:14:15.794735 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d6a518f2-3259-4569-a13a-6be6afc5c4c3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:15.803747 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d6a518f2-3259-4569-a13a-6be6afc5c4c3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:15.803957 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bf680f8c-9d55-4b03-8fb8-c9f44970a8e4 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:15.804797 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bf680f8c-9d55-4b03-8fb8-c9f44970a8e4 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: ffc4d9b2-dd4f-44dc-a189-354eff7a5573] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:15.805097 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d6a518f2-3259-4569-a13a-6be6afc5c4c3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:15.806375 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d6a518f2-3259-4569-a13a-6be6afc5c4c3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:15.817778 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d6a518f2-3259-4569-a13a-6be6afc5c4c3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:15.827898 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bf680f8c-9d55-4b03-8fb8-c9f44970a8e4 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:15.828432 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bf680f8c-9d55-4b03-8fb8-c9f44970a8e4 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:15.829989 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bf680f8c-9d55-4b03-8fb8-c9f44970a8e4 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:15.830610 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bf680f8c-9d55-4b03-8fb8-c9f44970a8e4 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:16.011100 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-bf680f8c-9d55-4b03-8fb8-c9f44970a8e4 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:16.025064 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-bf680f8c-9d55-4b03-8fb8-c9f44970a8e4 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:16.026565 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-bf680f8c-9d55-4b03-8fb8-c9f44970a8e4 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:16.035491 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bf680f8c-9d55-4b03-8fb8-c9f44970a8e4 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573" status: 200 len: 1549 microversion: 2.25 time: 0.233128 Apr 16 21:14:16.036615 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 986/2027] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:15 2022] GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573 => generated 1549 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:14:16.041339 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b6396382-60d6-4f64-81e2-1512582a665c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:16.041871 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b6396382-60d6-4f64-81e2-1512582a665c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:16.055200 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d6a518f2-3259-4569-a13a-6be6afc5c4c3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:16.057463 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b6396382-60d6-4f64-81e2-1512582a665c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:16.057796 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b6396382-60d6-4f64-81e2-1512582a665c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:16.059300 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b6396382-60d6-4f64-81e2-1512582a665c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:16.059743 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b6396382-60d6-4f64-81e2-1512582a665c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:16.065734 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d6a518f2-3259-4569-a13a-6be6afc5c4c3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1388 microversion: 2.1 time: 0.279121 Apr 16 21:14:16.066598 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1042/2028] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:15 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1388 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:16.159613 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7527e440-c124-4cab-8ccf-c56347fe9b6c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:16.160276 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7527e440-c124-4cab-8ccf-c56347fe9b6c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 65449361-cc88-4caa-aeff-800337a2fbb0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:16.166760 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7527e440-c124-4cab-8ccf-c56347fe9b6c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:16.167540 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7527e440-c124-4cab-8ccf-c56347fe9b6c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:16.169101 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7527e440-c124-4cab-8ccf-c56347fe9b6c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:16.169530 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7527e440-c124-4cab-8ccf-c56347fe9b6c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:16.418821 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7527e440-c124-4cab-8ccf-c56347fe9b6c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87e2c1601764f23ac7530b6ad66b3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe50d9e0841749f094948101efdc3d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:16.427986 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7527e440-c124-4cab-8ccf-c56347fe9b6c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "GET /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0" status: 200 len: 1315 microversion: 2.1 time: 0.272686 Apr 16 21:14:16.428828 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1043/2029] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:16 2022] GET /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0 => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:14:16.437013 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-dd0ee5ca-498b-4a2c-8275-102ffca4b686 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:16.437626 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-dd0ee5ca-498b-4a2c-8275-102ffca4b686 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:16.446699 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dd0ee5ca-498b-4a2c-8275-102ffca4b686 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:16.447189 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dd0ee5ca-498b-4a2c-8275-102ffca4b686 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:16.447996 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dd0ee5ca-498b-4a2c-8275-102ffca4b686 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:16.448469 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dd0ee5ca-498b-4a2c-8275-102ffca4b686 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:16.523763 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b6396382-60d6-4f64-81e2-1512582a665c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:16.537339 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b6396382-60d6-4f64-81e2-1512582a665c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:16.539470 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b6396382-60d6-4f64-81e2-1512582a665c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:16.540905 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b6396382-60d6-4f64-81e2-1512582a665c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1870 microversion: 2.32 time: 0.503222 Apr 16 21:14:16.541575 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 987/2030] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:16 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1870 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:14:16.722985 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-dd0ee5ca-498b-4a2c-8275-102ffca4b686 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:16.732869 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-dd0ee5ca-498b-4a2c-8275-102ffca4b686 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1308 microversion: 2.1 time: 0.301867 Apr 16 21:14:16.734555 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1044/2031] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:16 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1308 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:17.059789 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9faf9f25-ded8-4782-a4d8-6693a7dfb3d4 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:17.061529 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9faf9f25-ded8-4782-a4d8-6693a7dfb3d4 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: ffc4d9b2-dd4f-44dc-a189-354eff7a5573] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:17.084121 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-600bc5d1-3f1d-4f59-868d-c5add5ec6d32 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:17.084696 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-600bc5d1-3f1d-4f59-868d-c5add5ec6d32 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:17.088311 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9faf9f25-ded8-4782-a4d8-6693a7dfb3d4 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:17.097575 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9faf9f25-ded8-4782-a4d8-6693a7dfb3d4 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:17.099455 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9faf9f25-ded8-4782-a4d8-6693a7dfb3d4 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:17.100106 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9faf9f25-ded8-4782-a4d8-6693a7dfb3d4 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:17.103423 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-600bc5d1-3f1d-4f59-868d-c5add5ec6d32 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:17.103682 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-600bc5d1-3f1d-4f59-868d-c5add5ec6d32 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:17.104528 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-600bc5d1-3f1d-4f59-868d-c5add5ec6d32 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:17.105526 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-600bc5d1-3f1d-4f59-868d-c5add5ec6d32 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:17.336527 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-600bc5d1-3f1d-4f59-868d-c5add5ec6d32 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:17.354637 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-600bc5d1-3f1d-4f59-868d-c5add5ec6d32 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1388 microversion: 2.1 time: 0.275621 Apr 16 21:14:17.367434 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1045/2032] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:17 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1388 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:14:17.591858 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6450afe8-a134-41e4-95c1-158a53e6f288 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1670780594", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "a7e528bf-99b2-41b7-8807-aca3eac1e8d2"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:17.652461 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-6450afe8-a134-41e4-95c1-158a53e6f288 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] validate_networks() for [('a7e528bf-99b2-41b7-8807-aca3eac1e8d2', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:14:17.690156 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9faf9f25-ded8-4782-a4d8-6693a7dfb3d4 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:17.698474 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9faf9f25-ded8-4782-a4d8-6693a7dfb3d4 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:17.700343 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9faf9f25-ded8-4782-a4d8-6693a7dfb3d4 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:17.704632 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9faf9f25-ded8-4782-a4d8-6693a7dfb3d4 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573" status: 200 len: 1549 microversion: 2.25 time: 0.651172 Apr 16 21:14:17.705376 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 988/2033] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:17 2022] GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573 => generated 1549 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:14:17.711160 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c2b27196-361e-4174-82ed-8a352cc896cc tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:17.711981 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c2b27196-361e-4174-82ed-8a352cc896cc tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 65449361-cc88-4caa-aeff-800337a2fbb0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:17.720296 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c2b27196-361e-4174-82ed-8a352cc896cc tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:17.730898 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c2b27196-361e-4174-82ed-8a352cc896cc tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:17.730898 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c2b27196-361e-4174-82ed-8a352cc896cc tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:17.730898 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c2b27196-361e-4174-82ed-8a352cc896cc tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:17.925359 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c2b27196-361e-4174-82ed-8a352cc896cc tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87e2c1601764f23ac7530b6ad66b3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe50d9e0841749f094948101efdc3d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:17.944504 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c2b27196-361e-4174-82ed-8a352cc896cc tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "GET /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0" status: 200 len: 1315 microversion: 2.1 time: 0.237220 Apr 16 21:14:17.947713 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 989/2034] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:17 2022] GET /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0 => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:17.961784 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-82e113f9-f0dd-4a56-9d4c-c633711cf5d5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:17.964749 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-82e113f9-f0dd-4a56-9d4c-c633711cf5d5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:17.971060 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-82e113f9-f0dd-4a56-9d4c-c633711cf5d5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:17.971749 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-82e113f9-f0dd-4a56-9d4c-c633711cf5d5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:17.972805 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-82e113f9-f0dd-4a56-9d4c-c633711cf5d5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:17.973427 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-82e113f9-f0dd-4a56-9d4c-c633711cf5d5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:18.132081 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-6450afe8-a134-41e4-95c1-158a53e6f288 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:14:18.133422 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-6450afe8-a134-41e4-95c1-158a53e6f288 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:14:18.133422 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-6450afe8-a134-41e4-95c1-158a53e6f288 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:14:18.133694 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-6450afe8-a134-41e4-95c1-158a53e6f288 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:14:18.134149 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-6450afe8-a134-41e4-95c1-158a53e6f288 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:14:18.145381 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6450afe8-a134-41e4-95c1-158a53e6f288 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:18.145846 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6450afe8-a134-41e4-95c1-158a53e6f288 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:18.146876 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6450afe8-a134-41e4-95c1-158a53e6f288 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:18.147499 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6450afe8-a134-41e4-95c1-158a53e6f288 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:18.169002 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-6450afe8-a134-41e4-95c1-158a53e6f288 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Getting quotas for project be0fd7025ca44244ae100b2b916ad1d8. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:14:18.176538 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-6450afe8-a134-41e4-95c1-158a53e6f288 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Getting quotas for user 27b41363947d44c9be2bda9ed14cbcc4 and project be0fd7025ca44244ae100b2b916ad1d8. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:14:18.191936 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6450afe8-a134-41e4-95c1-158a53e6f288 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:14:18.194395 ncdv-master-1 devstack@n-api.service[137408]: WARNING nova.utils [None req-6450afe8-a134-41e4-95c1-158a53e6f288 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1670780594 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-167078059 Apr 16 21:14:18.195291 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6450afe8-a134-41e4-95c1-158a53e6f288 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] [instance: 18e64ceb-9630-44a6-a82c-b8a53099b88f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:14:18.254435 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-82e113f9-f0dd-4a56-9d4c-c633711cf5d5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:18.265453 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-82e113f9-f0dd-4a56-9d4c-c633711cf5d5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:18.265453 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-82e113f9-f0dd-4a56-9d4c-c633711cf5d5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:18.266791 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-82e113f9-f0dd-4a56-9d4c-c633711cf5d5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1870 microversion: 2.32 time: 0.308953 Apr 16 21:14:18.267349 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 990/2035] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:17 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1870 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:14:18.272068 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a6c4e75b-cf5c-4010-860e-865e11761ddb tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:18.272781 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a6c4e75b-cf5c-4010-860e-865e11761ddb tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:18.279227 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a6c4e75b-cf5c-4010-860e-865e11761ddb tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:18.279700 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a6c4e75b-cf5c-4010-860e-865e11761ddb tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:18.280680 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a6c4e75b-cf5c-4010-860e-865e11761ddb tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:18.281139 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a6c4e75b-cf5c-4010-860e-865e11761ddb tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:18.351046 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6450afe8-a134-41e4-95c1-158a53e6f288 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.938777 Apr 16 21:14:18.357728 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1046/2036] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:14:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 946 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 16 21:14:18.363143 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-e575ab2a-08c4-470d-af2a-6c2065164475 req-c67e9e9b-8d94-4d02-8ab4-6e237fedd185 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffc4d9b2-dd4f-44dc-a189-354eff7a5573", "name": "network-vif-deleted", "tag": "fb4825e7-d0af-4d1c-a416-731410a77b41"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:18.375997 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-e575ab2a-08c4-470d-af2a-6c2065164475 req-c67e9e9b-8d94-4d02-8ab4-6e237fedd185 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:18.376905 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-e575ab2a-08c4-470d-af2a-6c2065164475 req-c67e9e9b-8d94-4d02-8ab4-6e237fedd185 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:18.389122 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-e575ab2a-08c4-470d-af2a-6c2065164475 req-c67e9e9b-8d94-4d02-8ab4-6e237fedd185 service nova] Creating event network-vif-deleted:fb4825e7-d0af-4d1c-a416-731410a77b41 for instance ffc4d9b2-dd4f-44dc-a189-354eff7a5573 on nch1-master-1 Apr 16 21:14:18.398686 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-e575ab2a-08c4-470d-af2a-6c2065164475 req-c67e9e9b-8d94-4d02-8ab4-6e237fedd185 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039703 Apr 16 21:14:18.399888 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1047/2037] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:14:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:14:18.408984 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-839e786e-46e7-4df4-8891-1e59c63fdeb3 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:18.410001 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-839e786e-46e7-4df4-8891-1e59c63fdeb3 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] [instance: 18e64ceb-9630-44a6-a82c-b8a53099b88f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:18.439836 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a6c4e75b-cf5c-4010-860e-865e11761ddb tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:18.448080 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a6c4e75b-cf5c-4010-860e-865e11761ddb tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1308 microversion: 2.1 time: 0.179583 Apr 16 21:14:18.448772 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 991/2038] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:18 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1308 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:18.454346 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-019a588d-387d-48ac-9406-e2eccf41dfe8 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:18.454921 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-019a588d-387d-48ac-9406-e2eccf41dfe8 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:18.465207 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-019a588d-387d-48ac-9406-e2eccf41dfe8 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:18.471776 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-019a588d-387d-48ac-9406-e2eccf41dfe8 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:18.471776 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-019a588d-387d-48ac-9406-e2eccf41dfe8 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:18.471776 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-019a588d-387d-48ac-9406-e2eccf41dfe8 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:18.500162 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-839e786e-46e7-4df4-8891-1e59c63fdeb3 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b41363947d44c9be2bda9ed14cbcc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fd7025ca44244ae100b2b916ad1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:18.507923 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-839e786e-46e7-4df4-8891-1e59c63fdeb3 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] 10.222.0.20 "GET /compute/v2.1/servers/18e64ceb-9630-44a6-a82c-b8a53099b88f" status: 200 len: 1232 microversion: 2.1 time: 0.106566 Apr 16 21:14:18.511189 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1048/2039] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:18 2022] GET /compute/v2.1/servers/18e64ceb-9630-44a6-a82c-b8a53099b88f => generated 1232 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:18.642612 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-019a588d-387d-48ac-9406-e2eccf41dfe8 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:18.650232 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-019a588d-387d-48ac-9406-e2eccf41dfe8 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1388 microversion: 2.1 time: 0.199762 Apr 16 21:14:18.650855 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 992/2040] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:18 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1388 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:18.723252 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b5469c97-8557-4b6e-a0ac-fbaa1e9efb74 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:18.723979 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b5469c97-8557-4b6e-a0ac-fbaa1e9efb74 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: ffc4d9b2-dd4f-44dc-a189-354eff7a5573] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:18.730658 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5469c97-8557-4b6e-a0ac-fbaa1e9efb74 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:18.731116 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5469c97-8557-4b6e-a0ac-fbaa1e9efb74 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:18.731900 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5469c97-8557-4b6e-a0ac-fbaa1e9efb74 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:18.732375 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5469c97-8557-4b6e-a0ac-fbaa1e9efb74 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:18.764443 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5469c97-8557-4b6e-a0ac-fbaa1e9efb74 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:18.765228 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5469c97-8557-4b6e-a0ac-fbaa1e9efb74 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:18.765911 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-b5469c97-8557-4b6e-a0ac-fbaa1e9efb74 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lazy-loading 'fault' on Instance uuid ffc4d9b2-dd4f-44dc-a189-354eff7a5573 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:14:18.813980 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b5469c97-8557-4b6e-a0ac-fbaa1e9efb74 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:18.826467 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b5469c97-8557-4b6e-a0ac-fbaa1e9efb74 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:18.828841 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b5469c97-8557-4b6e-a0ac-fbaa1e9efb74 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:18.830234 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b5469c97-8557-4b6e-a0ac-fbaa1e9efb74 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573" status: 200 len: 1351 microversion: 2.25 time: 0.111041 Apr 16 21:14:18.835416 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1049/2041] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:18 2022] GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573 => generated 1351 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:14:18.963403 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0d2f591a-66ff-4f33-983f-3cbb0befa021 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:18.963955 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0d2f591a-66ff-4f33-983f-3cbb0befa021 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 65449361-cc88-4caa-aeff-800337a2fbb0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:18.970932 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0d2f591a-66ff-4f33-983f-3cbb0befa021 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:18.971416 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0d2f591a-66ff-4f33-983f-3cbb0befa021 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:18.972318 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0d2f591a-66ff-4f33-983f-3cbb0befa021 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:18.972682 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0d2f591a-66ff-4f33-983f-3cbb0befa021 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:19.161417 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0d2f591a-66ff-4f33-983f-3cbb0befa021 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87e2c1601764f23ac7530b6ad66b3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe50d9e0841749f094948101efdc3d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:19.171142 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0d2f591a-66ff-4f33-983f-3cbb0befa021 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "GET /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0" status: 200 len: 1315 microversion: 2.1 time: 0.211659 Apr 16 21:14:19.172014 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 993/2042] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:18 2022] GET /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:19.286295 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0bc5f786-54af-4b43-b3f5-2a1b29f3dcf5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:19.293812 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0bc5f786-54af-4b43-b3f5-2a1b29f3dcf5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:19.298823 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0bc5f786-54af-4b43-b3f5-2a1b29f3dcf5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:19.299379 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0bc5f786-54af-4b43-b3f5-2a1b29f3dcf5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:19.300300 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0bc5f786-54af-4b43-b3f5-2a1b29f3dcf5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:19.300754 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0bc5f786-54af-4b43-b3f5-2a1b29f3dcf5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:19.465309 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-06ad8f86-0c75-4eef-8940-d2f2db41c36f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:19.465948 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-06ad8f86-0c75-4eef-8940-d2f2db41c36f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:19.472832 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-06ad8f86-0c75-4eef-8940-d2f2db41c36f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:19.473298 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-06ad8f86-0c75-4eef-8940-d2f2db41c36f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:19.474126 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-06ad8f86-0c75-4eef-8940-d2f2db41c36f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:19.474574 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-06ad8f86-0c75-4eef-8940-d2f2db41c36f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:19.529567 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0bc5f786-54af-4b43-b3f5-2a1b29f3dcf5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:19.544751 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0bc5f786-54af-4b43-b3f5-2a1b29f3dcf5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:19.546250 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0bc5f786-54af-4b43-b3f5-2a1b29f3dcf5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:19.552625 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0bc5f786-54af-4b43-b3f5-2a1b29f3dcf5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1870 microversion: 2.32 time: 0.265431 Apr 16 21:14:19.553285 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1050/2043] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:19 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1870 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:14:19.582021 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-70c80edc-1ef3-415f-892c-2c098ae151f8 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:19.582694 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-70c80edc-1ef3-415f-892c-2c098ae151f8 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] [instance: 18e64ceb-9630-44a6-a82c-b8a53099b88f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:19.651400 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-70c80edc-1ef3-415f-892c-2c098ae151f8 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b41363947d44c9be2bda9ed14cbcc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fd7025ca44244ae100b2b916ad1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:19.669702 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-70c80edc-1ef3-415f-892c-2c098ae151f8 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] 10.222.0.20 "GET /compute/v2.1/servers/18e64ceb-9630-44a6-a82c-b8a53099b88f" status: 200 len: 1232 microversion: 2.1 time: 0.114029 Apr 16 21:14:19.671070 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1051/2044] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:19 2022] GET /compute/v2.1/servers/18e64ceb-9630-44a6-a82c-b8a53099b88f => generated 1232 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:19.678689 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a4f8f1e2-eeb2-4ee1-a62d-c6a3df7c7737 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:19.679973 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a4f8f1e2-eeb2-4ee1-a62d-c6a3df7c7737 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:19.689417 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a4f8f1e2-eeb2-4ee1-a62d-c6a3df7c7737 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:19.690026 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a4f8f1e2-eeb2-4ee1-a62d-c6a3df7c7737 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:19.691409 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a4f8f1e2-eeb2-4ee1-a62d-c6a3df7c7737 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:19.692120 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a4f8f1e2-eeb2-4ee1-a62d-c6a3df7c7737 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:19.697374 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-06ad8f86-0c75-4eef-8940-d2f2db41c36f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:19.705318 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-06ad8f86-0c75-4eef-8940-d2f2db41c36f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1308 microversion: 2.1 time: 0.244611 Apr 16 21:14:19.705904 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 994/2045] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:19 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1308 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:19.843923 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a4f8f1e2-eeb2-4ee1-a62d-c6a3df7c7737 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:19.853585 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f0b62a20-5588-4fe7-a158-3931ca8f3c9c tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:19.853585 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f0b62a20-5588-4fe7-a158-3931ca8f3c9c tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: ffc4d9b2-dd4f-44dc-a189-354eff7a5573] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:19.856458 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f0b62a20-5588-4fe7-a158-3931ca8f3c9c tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:19.857165 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f0b62a20-5588-4fe7-a158-3931ca8f3c9c tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:19.857777 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a4f8f1e2-eeb2-4ee1-a62d-c6a3df7c7737 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1388 microversion: 2.1 time: 0.185022 Apr 16 21:14:19.858414 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f0b62a20-5588-4fe7-a158-3931ca8f3c9c tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:19.858716 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1052/2046] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:19 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1388 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:19.859377 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f0b62a20-5588-4fe7-a158-3931ca8f3c9c tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:19.876576 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-f0b62a20-5588-4fe7-a158-3931ca8f3c9c tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] HTTP exception thrown: Instance ffc4d9b2-dd4f-44dc-a189-354eff7a5573 could not be found. Apr 16 21:14:19.890937 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f0b62a20-5588-4fe7-a158-3931ca8f3c9c tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Returning 404 to user: Instance ffc4d9b2-dd4f-44dc-a189-354eff7a5573 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:14:19.891962 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f0b62a20-5588-4fe7-a158-3931ca8f3c9c tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573" status: 404 len: 111 microversion: 2.25 time: 0.046724 Apr 16 21:14:19.896263 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 995/2047] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:19 2022] GET /compute/v2.1/servers/ffc4d9b2-dd4f-44dc-a189-354eff7a5573 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:14:19.900842 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b75ae162-d39b-4354-b932-ea9733d5a169 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:19.901337 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b75ae162-d39b-4354-b932-ea9733d5a169 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d06de5cf-0b6e-4546-b316-545265d6af2a] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:19.909925 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b75ae162-d39b-4354-b932-ea9733d5a169 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:19.910403 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b75ae162-d39b-4354-b932-ea9733d5a169 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:19.911224 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b75ae162-d39b-4354-b932-ea9733d5a169 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:19.911676 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b75ae162-d39b-4354-b932-ea9733d5a169 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:19.938440 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b75ae162-d39b-4354-b932-ea9733d5a169 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d06de5cf-0b6e-4546-b316-545265d6af2a] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:14:20.188150 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-88115d31-9624-4d47-8f95-b9923d62a0c9 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:20.188821 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-88115d31-9624-4d47-8f95-b9923d62a0c9 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 65449361-cc88-4caa-aeff-800337a2fbb0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:20.199225 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-88115d31-9624-4d47-8f95-b9923d62a0c9 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:20.199225 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-88115d31-9624-4d47-8f95-b9923d62a0c9 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:20.199225 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-88115d31-9624-4d47-8f95-b9923d62a0c9 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:20.199225 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-88115d31-9624-4d47-8f95-b9923d62a0c9 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:20.217999 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b75ae162-d39b-4354-b932-ea9733d5a169 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a" status: 204 len: 0 microversion: 2.25 time: 0.320930 Apr 16 21:14:20.221844 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1053/2048] 10.222.0.20 () {60 vars in 1279 bytes} [Sat Apr 16 21:14:19 2022] DELETE /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 16 21:14:20.227634 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-361eede1-fc3e-41fb-b533-dd62e3263c4f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:20.228385 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-361eede1-fc3e-41fb-b533-dd62e3263c4f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d06de5cf-0b6e-4546-b316-545265d6af2a] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:20.234807 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-361eede1-fc3e-41fb-b533-dd62e3263c4f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:20.235280 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-361eede1-fc3e-41fb-b533-dd62e3263c4f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:20.236079 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-361eede1-fc3e-41fb-b533-dd62e3263c4f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:20.237131 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-361eede1-fc3e-41fb-b533-dd62e3263c4f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:20.364999 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-88115d31-9624-4d47-8f95-b9923d62a0c9 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87e2c1601764f23ac7530b6ad66b3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe50d9e0841749f094948101efdc3d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:20.375292 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-88115d31-9624-4d47-8f95-b9923d62a0c9 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "GET /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0" status: 200 len: 1315 microversion: 2.1 time: 0.190001 Apr 16 21:14:20.376351 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 996/2049] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:20 2022] GET /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:14:20.449605 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-361eede1-fc3e-41fb-b533-dd62e3263c4f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:20.460136 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-361eede1-fc3e-41fb-b533-dd62e3263c4f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:20.461130 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-361eede1-fc3e-41fb-b533-dd62e3263c4f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:20.462353 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-361eede1-fc3e-41fb-b533-dd62e3263c4f tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a" status: 200 len: 1563 microversion: 2.25 time: 0.238991 Apr 16 21:14:20.462933 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1054/2050] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:20 2022] GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a => generated 1563 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:14:20.577924 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3f12cdf8-ff6a-4058-94ea-bf531dc33853 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:20.582552 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3f12cdf8-ff6a-4058-94ea-bf531dc33853 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:20.589908 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3f12cdf8-ff6a-4058-94ea-bf531dc33853 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:20.590481 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3f12cdf8-ff6a-4058-94ea-bf531dc33853 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:20.591304 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3f12cdf8-ff6a-4058-94ea-bf531dc33853 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:20.591757 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3f12cdf8-ff6a-4058-94ea-bf531dc33853 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:20.687638 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4d3c6174-2dcf-4abc-86ef-4dd45e4a9320 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:20.688526 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4d3c6174-2dcf-4abc-86ef-4dd45e4a9320 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] [instance: 18e64ceb-9630-44a6-a82c-b8a53099b88f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:20.695275 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4d3c6174-2dcf-4abc-86ef-4dd45e4a9320 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:20.695740 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4d3c6174-2dcf-4abc-86ef-4dd45e4a9320 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:20.696901 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4d3c6174-2dcf-4abc-86ef-4dd45e4a9320 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:20.697290 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4d3c6174-2dcf-4abc-86ef-4dd45e4a9320 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:20.778185 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4d3c6174-2dcf-4abc-86ef-4dd45e4a9320 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b41363947d44c9be2bda9ed14cbcc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fd7025ca44244ae100b2b916ad1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:20.786388 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4d3c6174-2dcf-4abc-86ef-4dd45e4a9320 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] 10.222.0.20 "GET /compute/v2.1/servers/18e64ceb-9630-44a6-a82c-b8a53099b88f" status: 200 len: 1284 microversion: 2.1 time: 0.104162 Apr 16 21:14:20.788633 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1055/2051] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:20 2022] GET /compute/v2.1/servers/18e64ceb-9630-44a6-a82c-b8a53099b88f => generated 1284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:20.793679 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-518e733b-64ed-4865-aa0c-20261f668c5c tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:20.794290 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-518e733b-64ed-4865-aa0c-20261f668c5c tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:20.795915 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3f12cdf8-ff6a-4058-94ea-bf531dc33853 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:20.800645 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-518e733b-64ed-4865-aa0c-20261f668c5c tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:20.801101 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-518e733b-64ed-4865-aa0c-20261f668c5c tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:20.801881 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-518e733b-64ed-4865-aa0c-20261f668c5c tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:20.802332 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-518e733b-64ed-4865-aa0c-20261f668c5c tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:20.807101 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3f12cdf8-ff6a-4058-94ea-bf531dc33853 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:20.809507 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3f12cdf8-ff6a-4058-94ea-bf531dc33853 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:20.811278 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3f12cdf8-ff6a-4058-94ea-bf531dc33853 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1870 microversion: 2.32 time: 0.243711 Apr 16 21:14:20.811849 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 997/2052] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:20 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1870 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:14:20.876555 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-005ed9c5-7fce-4f36-abd5-f7441e0f0c22 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:20.877490 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-005ed9c5-7fce-4f36-abd5-f7441e0f0c22 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:20.884295 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-005ed9c5-7fce-4f36-abd5-f7441e0f0c22 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:20.884843 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-005ed9c5-7fce-4f36-abd5-f7441e0f0c22 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:20.885710 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-005ed9c5-7fce-4f36-abd5-f7441e0f0c22 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:20.886270 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-005ed9c5-7fce-4f36-abd5-f7441e0f0c22 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:20.969923 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-518e733b-64ed-4865-aa0c-20261f668c5c tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:20.980332 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-518e733b-64ed-4865-aa0c-20261f668c5c tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1308 microversion: 2.1 time: 0.189917 Apr 16 21:14:20.984220 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1056/2053] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:20 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1308 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:21.206771 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-005ed9c5-7fce-4f36-abd5-f7441e0f0c22 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:21.219891 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-005ed9c5-7fce-4f36-abd5-f7441e0f0c22 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1388 microversion: 2.1 time: 0.349241 Apr 16 21:14:21.221363 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 998/2054] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:20 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1388 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:14:21.392515 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a6a2f66d-93e4-4885-82ee-5ed36476c16c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:21.393142 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a6a2f66d-93e4-4885-82ee-5ed36476c16c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 65449361-cc88-4caa-aeff-800337a2fbb0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:21.400409 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a6a2f66d-93e4-4885-82ee-5ed36476c16c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:21.400877 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a6a2f66d-93e4-4885-82ee-5ed36476c16c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:21.402183 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a6a2f66d-93e4-4885-82ee-5ed36476c16c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:21.402636 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a6a2f66d-93e4-4885-82ee-5ed36476c16c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:21.482190 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-beb9b849-628e-42b4-98a9-e2365898ad97 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:21.483046 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-beb9b849-628e-42b4-98a9-e2365898ad97 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d06de5cf-0b6e-4546-b316-545265d6af2a] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:21.489101 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-beb9b849-628e-42b4-98a9-e2365898ad97 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:21.489764 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-beb9b849-628e-42b4-98a9-e2365898ad97 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:21.490750 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-beb9b849-628e-42b4-98a9-e2365898ad97 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:21.491372 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-beb9b849-628e-42b4-98a9-e2365898ad97 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:21.540354 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a6a2f66d-93e4-4885-82ee-5ed36476c16c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87e2c1601764f23ac7530b6ad66b3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe50d9e0841749f094948101efdc3d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:21.550948 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a6a2f66d-93e4-4885-82ee-5ed36476c16c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "GET /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0" status: 200 len: 1315 microversion: 2.1 time: 0.162517 Apr 16 21:14:21.551650 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1057/2055] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:21 2022] GET /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:21.648864 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-beb9b849-628e-42b4-98a9-e2365898ad97 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:21.657805 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-beb9b849-628e-42b4-98a9-e2365898ad97 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:21.659314 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-beb9b849-628e-42b4-98a9-e2365898ad97 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:21.660503 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-beb9b849-628e-42b4-98a9-e2365898ad97 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a" status: 200 len: 1563 microversion: 2.25 time: 0.183119 Apr 16 21:14:21.661093 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 999/2056] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:21 2022] GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a => generated 1563 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:14:21.805424 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d70824fb-3851-496f-9b6c-8947128e20ab tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:21.806147 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d70824fb-3851-496f-9b6c-8947128e20ab tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] [instance: 18e64ceb-9630-44a6-a82c-b8a53099b88f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:21.813462 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d70824fb-3851-496f-9b6c-8947128e20ab tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:21.814001 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d70824fb-3851-496f-9b6c-8947128e20ab tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:21.815094 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d70824fb-3851-496f-9b6c-8947128e20ab tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:21.815733 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d70824fb-3851-496f-9b6c-8947128e20ab tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:21.837099 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4c0063b3-1db9-4e23-b5bc-fd00dd325241 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:21.838241 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4c0063b3-1db9-4e23-b5bc-fd00dd325241 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:21.847999 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4c0063b3-1db9-4e23-b5bc-fd00dd325241 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:21.848938 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4c0063b3-1db9-4e23-b5bc-fd00dd325241 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:21.850958 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4c0063b3-1db9-4e23-b5bc-fd00dd325241 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:21.851943 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4c0063b3-1db9-4e23-b5bc-fd00dd325241 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:22.129713 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d70824fb-3851-496f-9b6c-8947128e20ab tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b41363947d44c9be2bda9ed14cbcc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fd7025ca44244ae100b2b916ad1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:22.138093 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d70824fb-3851-496f-9b6c-8947128e20ab tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] 10.222.0.20 "GET /compute/v2.1/servers/18e64ceb-9630-44a6-a82c-b8a53099b88f" status: 200 len: 1290 microversion: 2.1 time: 0.336699 Apr 16 21:14:22.138690 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1058/2057] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:21 2022] GET /compute/v2.1/servers/18e64ceb-9630-44a6-a82c-b8a53099b88f => generated 1290 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:22.143957 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-ad8e4376-d902-4a82-a1c6-0e67834d5dd9 req-7d3dca32-713b-4d98-8803-71471e545a11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d06de5cf-0b6e-4546-b316-545265d6af2a", "name": "network-vif-deleted", "tag": "808376f5-de15-494a-b722-a554d5c81386"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:22.153469 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-ad8e4376-d902-4a82-a1c6-0e67834d5dd9 req-7d3dca32-713b-4d98-8803-71471e545a11 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:22.153628 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-ad8e4376-d902-4a82-a1c6-0e67834d5dd9 req-7d3dca32-713b-4d98-8803-71471e545a11 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:22.165504 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-ad8e4376-d902-4a82-a1c6-0e67834d5dd9 req-7d3dca32-713b-4d98-8803-71471e545a11 service nova] Creating event network-vif-deleted:808376f5-de15-494a-b722-a554d5c81386 for instance d06de5cf-0b6e-4546-b316-545265d6af2a on nch1-master-1 Apr 16 21:14:22.166660 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4c0063b3-1db9-4e23-b5bc-fd00dd325241 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:22.171118 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-ad8e4376-d902-4a82-a1c6-0e67834d5dd9 req-7d3dca32-713b-4d98-8803-71471e545a11 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031294 Apr 16 21:14:22.172045 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1059/2058] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:14:22.177319 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-c6e11903-9ffe-419e-ad80-a7738fb72bd7 req-e1a9363a-046b-47af-b9b1-d06914529e7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65449361-cc88-4caa-aeff-800337a2fbb0", "name": "network-vif-plugged", "status": "completed", "tag": "945aa480-3d27-4a43-9bf6-4d316c63e6b9"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:22.177795 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4c0063b3-1db9-4e23-b5bc-fd00dd325241 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:22.180420 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4c0063b3-1db9-4e23-b5bc-fd00dd325241 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:22.181777 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4c0063b3-1db9-4e23-b5bc-fd00dd325241 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1870 microversion: 2.32 time: 0.350804 Apr 16 21:14:22.182828 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1000/2059] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:21 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1870 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:14:22.186334 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-c6e11903-9ffe-419e-ad80-a7738fb72bd7 req-e1a9363a-046b-47af-b9b1-d06914529e7d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:22.186793 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-c6e11903-9ffe-419e-ad80-a7738fb72bd7 req-e1a9363a-046b-47af-b9b1-d06914529e7d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:22.188143 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-01155a69-31c9-42eb-9e1f-b4e37c7448bf tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:22.188920 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-01155a69-31c9-42eb-9e1f-b4e37c7448bf tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:22.195283 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-01155a69-31c9-42eb-9e1f-b4e37c7448bf tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:22.199692 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-01155a69-31c9-42eb-9e1f-b4e37c7448bf tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:22.199692 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-01155a69-31c9-42eb-9e1f-b4e37c7448bf tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:22.199692 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-01155a69-31c9-42eb-9e1f-b4e37c7448bf tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:22.200509 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-c6e11903-9ffe-419e-ad80-a7738fb72bd7 req-e1a9363a-046b-47af-b9b1-d06914529e7d service nova] Creating event network-vif-plugged:945aa480-3d27-4a43-9bf6-4d316c63e6b9 for instance 65449361-cc88-4caa-aeff-800337a2fbb0 on nch1-master-1 Apr 16 21:14:22.202643 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-c6e11903-9ffe-419e-ad80-a7738fb72bd7 req-e1a9363a-046b-47af-b9b1-d06914529e7d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029243 Apr 16 21:14:22.204205 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1060/2060] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:14:22.237872 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cf84b523-e7f6-493f-b170-5544201c83a6 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:22.238590 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cf84b523-e7f6-493f-b170-5544201c83a6 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:22.245137 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cf84b523-e7f6-493f-b170-5544201c83a6 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:22.246523 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cf84b523-e7f6-493f-b170-5544201c83a6 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:22.246935 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cf84b523-e7f6-493f-b170-5544201c83a6 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:22.247335 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cf84b523-e7f6-493f-b170-5544201c83a6 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:22.390896 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cf84b523-e7f6-493f-b170-5544201c83a6 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:22.399323 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cf84b523-e7f6-493f-b170-5544201c83a6 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1388 microversion: 2.1 time: 0.165804 Apr 16 21:14:22.399920 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1061/2061] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:22 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1388 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:14:22.426173 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-01155a69-31c9-42eb-9e1f-b4e37c7448bf tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:22.434244 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-01155a69-31c9-42eb-9e1f-b4e37c7448bf tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1308 microversion: 2.1 time: 0.250193 Apr 16 21:14:22.435027 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1001/2062] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:22 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1308 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:22.569154 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e1da40bf-2c2c-4be1-bb2a-bba2d9f7921c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:22.570461 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e1da40bf-2c2c-4be1-bb2a-bba2d9f7921c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 65449361-cc88-4caa-aeff-800337a2fbb0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:22.577084 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e1da40bf-2c2c-4be1-bb2a-bba2d9f7921c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:22.577558 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e1da40bf-2c2c-4be1-bb2a-bba2d9f7921c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:22.578403 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e1da40bf-2c2c-4be1-bb2a-bba2d9f7921c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:22.578856 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e1da40bf-2c2c-4be1-bb2a-bba2d9f7921c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:22.678952 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e96aca34-fe51-4d69-a3a1-b5b1006b0034 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:22.679488 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e96aca34-fe51-4d69-a3a1-b5b1006b0034 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d06de5cf-0b6e-4546-b316-545265d6af2a] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:22.694764 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e96aca34-fe51-4d69-a3a1-b5b1006b0034 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:22.695229 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e96aca34-fe51-4d69-a3a1-b5b1006b0034 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:22.696232 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e96aca34-fe51-4d69-a3a1-b5b1006b0034 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:22.696846 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e96aca34-fe51-4d69-a3a1-b5b1006b0034 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:22.731278 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e96aca34-fe51-4d69-a3a1-b5b1006b0034 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:22.731750 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e96aca34-fe51-4d69-a3a1-b5b1006b0034 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:22.732252 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-e96aca34-fe51-4d69-a3a1-b5b1006b0034 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lazy-loading 'fault' on Instance uuid d06de5cf-0b6e-4546-b316-545265d6af2a {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:14:22.737398 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e1da40bf-2c2c-4be1-bb2a-bba2d9f7921c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87e2c1601764f23ac7530b6ad66b3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe50d9e0841749f094948101efdc3d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:22.746139 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e1da40bf-2c2c-4be1-bb2a-bba2d9f7921c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "GET /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0" status: 200 len: 1315 microversion: 2.1 time: 0.182142 Apr 16 21:14:22.746928 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1062/2063] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:22 2022] GET /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:22.802926 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e96aca34-fe51-4d69-a3a1-b5b1006b0034 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:22.811611 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e96aca34-fe51-4d69-a3a1-b5b1006b0034 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:22.813239 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e96aca34-fe51-4d69-a3a1-b5b1006b0034 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '53d5464685cc40d9a1d891c6ae39a80f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68af3300a0d149adbbf934b4ff1f87d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:22.817942 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e96aca34-fe51-4d69-a3a1-b5b1006b0034 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a" status: 200 len: 1351 microversion: 2.25 time: 0.139679 Apr 16 21:14:22.817942 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1002/2064] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:22 2022] GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a => generated 1351 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:14:23.158310 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3c875b79-db16-410a-a676-096baa30c7b2 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:23.158939 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3c875b79-db16-410a-a676-096baa30c7b2 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] [instance: 18e64ceb-9630-44a6-a82c-b8a53099b88f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:23.165147 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3c875b79-db16-410a-a676-096baa30c7b2 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:23.165610 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3c875b79-db16-410a-a676-096baa30c7b2 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:23.166472 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3c875b79-db16-410a-a676-096baa30c7b2 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:23.166918 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3c875b79-db16-410a-a676-096baa30c7b2 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:23.201209 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-971e865e-2385-4347-a187-60ac81ab0156 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:23.201985 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-971e865e-2385-4347-a187-60ac81ab0156 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:23.208509 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-971e865e-2385-4347-a187-60ac81ab0156 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:23.209073 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-971e865e-2385-4347-a187-60ac81ab0156 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:23.209936 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-971e865e-2385-4347-a187-60ac81ab0156 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:23.210459 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-971e865e-2385-4347-a187-60ac81ab0156 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:23.329865 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3c875b79-db16-410a-a676-096baa30c7b2 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b41363947d44c9be2bda9ed14cbcc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fd7025ca44244ae100b2b916ad1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:23.336276 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3c875b79-db16-410a-a676-096baa30c7b2 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] 10.222.0.20 "GET /compute/v2.1/servers/18e64ceb-9630-44a6-a82c-b8a53099b88f" status: 200 len: 1332 microversion: 2.1 time: 0.182271 Apr 16 21:14:23.337475 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1063/2065] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:23 2022] GET /compute/v2.1/servers/18e64ceb-9630-44a6-a82c-b8a53099b88f => generated 1332 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:23.416799 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-33b63bb1-c2cc-4c15-95ff-41897628c14f tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:23.418182 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-33b63bb1-c2cc-4c15-95ff-41897628c14f tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:23.425796 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-33b63bb1-c2cc-4c15-95ff-41897628c14f tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:23.426266 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-33b63bb1-c2cc-4c15-95ff-41897628c14f tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:23.427067 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-33b63bb1-c2cc-4c15-95ff-41897628c14f tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:23.427522 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-33b63bb1-c2cc-4c15-95ff-41897628c14f tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:23.523011 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-971e865e-2385-4347-a187-60ac81ab0156 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:23.536135 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-971e865e-2385-4347-a187-60ac81ab0156 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:23.537694 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-971e865e-2385-4347-a187-60ac81ab0156 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:23.538978 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-971e865e-2385-4347-a187-60ac81ab0156 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1870 microversion: 2.32 time: 0.341744 Apr 16 21:14:23.551062 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1003/2066] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:23 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1870 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:14:23.551062 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-63cc69ef-607b-4f7d-94c9-ff315799d012 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:23.551062 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-63cc69ef-607b-4f7d-94c9-ff315799d012 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:23.556805 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-63cc69ef-607b-4f7d-94c9-ff315799d012 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:23.556805 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-63cc69ef-607b-4f7d-94c9-ff315799d012 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:23.556805 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-63cc69ef-607b-4f7d-94c9-ff315799d012 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:23.556805 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-63cc69ef-607b-4f7d-94c9-ff315799d012 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:23.594042 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-33b63bb1-c2cc-4c15-95ff-41897628c14f tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:23.606572 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-33b63bb1-c2cc-4c15-95ff-41897628c14f tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1388 microversion: 2.1 time: 0.192221 Apr 16 21:14:23.607172 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1064/2067] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:23 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1388 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:14:23.715473 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-63cc69ef-607b-4f7d-94c9-ff315799d012 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:23.722911 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-63cc69ef-607b-4f7d-94c9-ff315799d012 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1308 microversion: 2.1 time: 0.181762 Apr 16 21:14:23.723469 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1004/2068] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:23 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1308 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:23.763879 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b2782332-671a-4691-ae7b-89c6d5d0852d tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:23.764531 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b2782332-671a-4691-ae7b-89c6d5d0852d tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 65449361-cc88-4caa-aeff-800337a2fbb0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:23.770477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b2782332-671a-4691-ae7b-89c6d5d0852d tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:23.770931 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b2782332-671a-4691-ae7b-89c6d5d0852d tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:23.771709 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b2782332-671a-4691-ae7b-89c6d5d0852d tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:23.772149 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b2782332-671a-4691-ae7b-89c6d5d0852d tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:23.838122 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4661ed96-6647-4542-bbf4-376d33743bd3 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:23.838857 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4661ed96-6647-4542-bbf4-376d33743bd3 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] [instance: d06de5cf-0b6e-4546-b316-545265d6af2a] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:23.847862 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4661ed96-6647-4542-bbf4-376d33743bd3 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:23.847862 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4661ed96-6647-4542-bbf4-376d33743bd3 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:23.848432 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4661ed96-6647-4542-bbf4-376d33743bd3 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:23.849110 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4661ed96-6647-4542-bbf4-376d33743bd3 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:23.864658 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-4661ed96-6647-4542-bbf4-376d33743bd3 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] HTTP exception thrown: Instance d06de5cf-0b6e-4546-b316-545265d6af2a could not be found. Apr 16 21:14:23.865329 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4661ed96-6647-4542-bbf4-376d33743bd3 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] Returning 404 to user: Instance d06de5cf-0b6e-4546-b316-545265d6af2a could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:14:23.866451 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4661ed96-6647-4542-bbf4-376d33743bd3 tempest-LiveAutoBlockMigrationV225Test-566463733 tempest-LiveAutoBlockMigrationV225Test-566463733-project] 10.222.0.20 "GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a" status: 404 len: 111 microversion: 2.25 time: 0.037235 Apr 16 21:14:23.868071 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1005/2069] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:23 2022] GET /compute/v2.1/servers/d06de5cf-0b6e-4546-b316-545265d6af2a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:14:23.954741 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b2782332-671a-4691-ae7b-89c6d5d0852d tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87e2c1601764f23ac7530b6ad66b3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe50d9e0841749f094948101efdc3d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:23.964842 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b2782332-671a-4691-ae7b-89c6d5d0852d tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "GET /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0" status: 200 len: 1315 microversion: 2.1 time: 0.204404 Apr 16 21:14:23.965791 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1065/2070] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:23 2022] GET /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:24.217706 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-9dcd4f33-e37f-4297-af9a-54c8f6f207eb req-d64f1f25-9051-4324-8682-4ea7e5bc595d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18e64ceb-9630-44a6-a82c-b8a53099b88f", "tag": "abe53b48-55b2-448c-aef2-8b7b60e401a5"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:24.226084 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-9dcd4f33-e37f-4297-af9a-54c8f6f207eb req-d64f1f25-9051-4324-8682-4ea7e5bc595d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:24.226544 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-9dcd4f33-e37f-4297-af9a-54c8f6f207eb req-d64f1f25-9051-4324-8682-4ea7e5bc595d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:24.237791 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-9dcd4f33-e37f-4297-af9a-54c8f6f207eb req-d64f1f25-9051-4324-8682-4ea7e5bc595d service nova] Creating event network-changed:abe53b48-55b2-448c-aef2-8b7b60e401a5 for instance 18e64ceb-9630-44a6-a82c-b8a53099b88f on nch1-master-1 Apr 16 21:14:24.243366 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-9dcd4f33-e37f-4297-af9a-54c8f6f207eb req-d64f1f25-9051-4324-8682-4ea7e5bc595d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029042 Apr 16 21:14:24.244251 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1006/2071] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:14:24.354341 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-612ca486-acd6-46d6-b9ce-261a2621d3c9 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:24.355000 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-612ca486-acd6-46d6-b9ce-261a2621d3c9 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] [instance: 18e64ceb-9630-44a6-a82c-b8a53099b88f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:24.360982 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-612ca486-acd6-46d6-b9ce-261a2621d3c9 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:24.361449 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-612ca486-acd6-46d6-b9ce-261a2621d3c9 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:24.362264 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-612ca486-acd6-46d6-b9ce-261a2621d3c9 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:24.362807 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-612ca486-acd6-46d6-b9ce-261a2621d3c9 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:24.560188 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-755192b5-b67f-417d-98d4-8052b3a0a471 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:24.560892 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-755192b5-b67f-417d-98d4-8052b3a0a471 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:24.566936 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-755192b5-b67f-417d-98d4-8052b3a0a471 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:24.567392 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-755192b5-b67f-417d-98d4-8052b3a0a471 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:24.568805 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-755192b5-b67f-417d-98d4-8052b3a0a471 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:24.568805 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-755192b5-b67f-417d-98d4-8052b3a0a471 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:24.581388 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-612ca486-acd6-46d6-b9ce-261a2621d3c9 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b41363947d44c9be2bda9ed14cbcc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fd7025ca44244ae100b2b916ad1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:24.589770 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-612ca486-acd6-46d6-b9ce-261a2621d3c9 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] 10.222.0.20 "GET /compute/v2.1/servers/18e64ceb-9630-44a6-a82c-b8a53099b88f" status: 200 len: 1332 microversion: 2.1 time: 0.239493 Apr 16 21:14:24.599679 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1066/2072] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:24 2022] GET /compute/v2.1/servers/18e64ceb-9630-44a6-a82c-b8a53099b88f => generated 1332 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:24.624556 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-615d696b-8127-4e5d-a512-eb6cb7f5d827 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:24.625650 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-615d696b-8127-4e5d-a512-eb6cb7f5d827 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:24.632455 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-615d696b-8127-4e5d-a512-eb6cb7f5d827 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:24.632933 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-615d696b-8127-4e5d-a512-eb6cb7f5d827 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:24.634171 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-615d696b-8127-4e5d-a512-eb6cb7f5d827 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:24.634613 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-615d696b-8127-4e5d-a512-eb6cb7f5d827 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:24.766765 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-755192b5-b67f-417d-98d4-8052b3a0a471 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:24.776805 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-755192b5-b67f-417d-98d4-8052b3a0a471 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:24.778602 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-755192b5-b67f-417d-98d4-8052b3a0a471 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:24.779972 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-755192b5-b67f-417d-98d4-8052b3a0a471 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1870 microversion: 2.32 time: 0.224753 Apr 16 21:14:24.781065 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1007/2073] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:24 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1870 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:14:24.789080 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-979d8118-7429-4b58-aef5-4dd30a61c548 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:24.789894 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-979d8118-7429-4b58-aef5-4dd30a61c548 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:24.797866 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-979d8118-7429-4b58-aef5-4dd30a61c548 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:24.798320 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-979d8118-7429-4b58-aef5-4dd30a61c548 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:24.799181 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-979d8118-7429-4b58-aef5-4dd30a61c548 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:24.799768 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-979d8118-7429-4b58-aef5-4dd30a61c548 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:24.858203 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-615d696b-8127-4e5d-a512-eb6cb7f5d827 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:24.865800 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-615d696b-8127-4e5d-a512-eb6cb7f5d827 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1388 microversion: 2.1 time: 0.246285 Apr 16 21:14:24.866370 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1067/2074] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:24 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1388 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:14:24.933864 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-979d8118-7429-4b58-aef5-4dd30a61c548 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:24.939350 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-979d8118-7429-4b58-aef5-4dd30a61c548 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1308 microversion: 2.1 time: 0.157015 Apr 16 21:14:24.940080 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1008/2075] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:24 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1308 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:24.982101 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5aefcd37-0b8e-434f-be4c-f1cf65c8eed8 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:24.982755 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5aefcd37-0b8e-434f-be4c-f1cf65c8eed8 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 65449361-cc88-4caa-aeff-800337a2fbb0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:24.988989 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5aefcd37-0b8e-434f-be4c-f1cf65c8eed8 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:24.989455 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5aefcd37-0b8e-434f-be4c-f1cf65c8eed8 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:24.990234 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5aefcd37-0b8e-434f-be4c-f1cf65c8eed8 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:24.990677 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5aefcd37-0b8e-434f-be4c-f1cf65c8eed8 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:25.127584 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5aefcd37-0b8e-434f-be4c-f1cf65c8eed8 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87e2c1601764f23ac7530b6ad66b3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe50d9e0841749f094948101efdc3d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:25.135733 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5aefcd37-0b8e-434f-be4c-f1cf65c8eed8 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "GET /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0" status: 200 len: 1503 microversion: 2.1 time: 0.158336 Apr 16 21:14:25.136377 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1068/2076] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:24 2022] GET /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0 => generated 1503 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:25.152569 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b5ee9812-cf43-47aa-b2b5-fd39b5347b24 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-860618409"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:25.153107 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b5ee9812-cf43-47aa-b2b5-fd39b5347b24 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 65449361-cc88-4caa-aeff-800337a2fbb0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:25.159329 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b5ee9812-cf43-47aa-b2b5-fd39b5347b24 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:25.159787 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b5ee9812-cf43-47aa-b2b5-fd39b5347b24 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:25.160646 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b5ee9812-cf43-47aa-b2b5-fd39b5347b24 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:25.161086 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b5ee9812-cf43-47aa-b2b5-fd39b5347b24 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:25.320807 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.network.security_group_api [None req-b5ee9812-cf43-47aa-b2b5-fd39b5347b24 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Adding security group aa451634-4ebc-46a1-bd9e-410f66c22156 to port 945aa480-3d27-4a43-9bf6-4d316c63e6b9 Apr 16 21:14:25.606739 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3fb09edf-0c52-4774-ac71-ff20e1c32abe tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:25.607575 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3fb09edf-0c52-4774-ac71-ff20e1c32abe tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] [instance: 18e64ceb-9630-44a6-a82c-b8a53099b88f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:25.614884 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3fb09edf-0c52-4774-ac71-ff20e1c32abe tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:25.615454 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3fb09edf-0c52-4774-ac71-ff20e1c32abe tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:25.616363 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3fb09edf-0c52-4774-ac71-ff20e1c32abe tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:25.616905 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3fb09edf-0c52-4774-ac71-ff20e1c32abe tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:25.800117 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3fb09edf-0c52-4774-ac71-ff20e1c32abe tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b41363947d44c9be2bda9ed14cbcc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fd7025ca44244ae100b2b916ad1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:25.809085 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3fb09edf-0c52-4774-ac71-ff20e1c32abe tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] 10.222.0.20 "GET /compute/v2.1/servers/18e64ceb-9630-44a6-a82c-b8a53099b88f" status: 200 len: 1332 microversion: 2.1 time: 0.206291 Apr 16 21:14:25.809671 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1069/2077] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:25 2022] GET /compute/v2.1/servers/18e64ceb-9630-44a6-a82c-b8a53099b88f => generated 1332 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:14:25.815120 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-55877783-eeee-4cb9-9a93-c95342cddc29 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:25.817542 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-55877783-eeee-4cb9-9a93-c95342cddc29 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:25.822658 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-55877783-eeee-4cb9-9a93-c95342cddc29 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:25.823256 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-55877783-eeee-4cb9-9a93-c95342cddc29 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:25.824823 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-55877783-eeee-4cb9-9a93-c95342cddc29 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:25.825344 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-55877783-eeee-4cb9-9a93-c95342cddc29 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:26.020663 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-55877783-eeee-4cb9-9a93-c95342cddc29 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:26.031031 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-55877783-eeee-4cb9-9a93-c95342cddc29 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:26.037498 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-55877783-eeee-4cb9-9a93-c95342cddc29 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:26.037498 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-55877783-eeee-4cb9-9a93-c95342cddc29 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1870 microversion: 2.32 time: 0.223373 Apr 16 21:14:26.037498 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1070/2078] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:25 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1870 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:14:26.039821 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6c0781a0-106b-4ad2-87af-59ca5a9e05ec tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:26.040624 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6c0781a0-106b-4ad2-87af-59ca5a9e05ec tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:26.046700 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6c0781a0-106b-4ad2-87af-59ca5a9e05ec tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:26.047168 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6c0781a0-106b-4ad2-87af-59ca5a9e05ec tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:26.047971 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6c0781a0-106b-4ad2-87af-59ca5a9e05ec tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:26.048430 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6c0781a0-106b-4ad2-87af-59ca5a9e05ec tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:26.192573 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b5ee9812-cf43-47aa-b2b5-fd39b5347b24 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "POST /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0/action" status: 202 len: 0 microversion: 2.1 time: 1.044098 Apr 16 21:14:26.198873 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1009/2079] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:14:25 2022] POST /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0/action => generated 0 bytes in 1051 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:14:26.208219 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9636e87b-8dd9-4b37-974a-0d68e7432f77 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:26.208760 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9636e87b-8dd9-4b37-974a-0d68e7432f77 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:26.225136 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9636e87b-8dd9-4b37-974a-0d68e7432f77 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:26.226429 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9636e87b-8dd9-4b37-974a-0d68e7432f77 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:26.227552 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9636e87b-8dd9-4b37-974a-0d68e7432f77 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:26.228253 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9636e87b-8dd9-4b37-974a-0d68e7432f77 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:26.279895 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6c0781a0-106b-4ad2-87af-59ca5a9e05ec tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:26.290031 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6c0781a0-106b-4ad2-87af-59ca5a9e05ec tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1388 microversion: 2.1 time: 0.254240 Apr 16 21:14:26.290617 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1071/2080] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:26 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1388 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:26.302726 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-88a63f1c-8ff0-49b2-9032-acdf8cdad17b tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '.version_select at 0x7fbb9ff4af70>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:26.485509 ncdv-master-1 devstack@n-api.service[137408]: DEBUG neutronclient.v2_0.client [None req-88a63f1c-8ff0-49b2-9032-acdf8cdad17b tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group aa451634-4ebc-46a1-bd9e-410f66c22156 in use.", "detail": ""}} {{(pid=137408) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 16 21:14:26.486465 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-88a63f1c-8ff0-49b2-9032-acdf8cdad17b tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] HTTP exception thrown: Security Group aa451634-4ebc-46a1-bd9e-410f66c22156 in use. Apr 16 21:14:26.486465 ncdv-master-1 devstack@n-api.service[137408]: Neutron server returns request_ids: ['req-96217e9b-f02a-48d5-8bbd-0d308146f850'] Apr 16 21:14:26.486833 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-88a63f1c-8ff0-49b2-9032-acdf8cdad17b tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Returning 400 to user: Security Group aa451634-4ebc-46a1-bd9e-410f66c22156 in use. Apr 16 21:14:26.486833 ncdv-master-1 devstack@n-api.service[137408]: Neutron server returns request_ids: ['req-96217e9b-f02a-48d5-8bbd-0d308146f850'] {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:14:26.487977 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-88a63f1c-8ff0-49b2-9032-acdf8cdad17b tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/aa451634-4ebc-46a1-bd9e-410f66c22156" status: 400 len: 185 microversion: 2.1 time: 0.193253 Apr 16 21:14:26.488565 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1072/2081] 10.222.0.20 () {58 vars in 1271 bytes} [Sat Apr 16 21:14:26 2022] DELETE /compute/v2.1/os-security-groups/aa451634-4ebc-46a1-bd9e-410f66c22156 => generated 185 bytes in 194 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:14:26.493738 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-769d1a79-176f-429f-9ba7-0652f0303885 req-a880a70f-5178-4d8f-8ac4-c403923ce1be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65449361-cc88-4caa-aeff-800337a2fbb0", "tag": "945aa480-3d27-4a43-9bf6-4d316c63e6b9"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:26.503458 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-769d1a79-176f-429f-9ba7-0652f0303885 req-a880a70f-5178-4d8f-8ac4-c403923ce1be service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:26.504112 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-769d1a79-176f-429f-9ba7-0652f0303885 req-a880a70f-5178-4d8f-8ac4-c403923ce1be service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:26.508132 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9636e87b-8dd9-4b37-974a-0d68e7432f77 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:26.516742 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-769d1a79-176f-429f-9ba7-0652f0303885 req-a880a70f-5178-4d8f-8ac4-c403923ce1be service nova] Creating event network-changed:945aa480-3d27-4a43-9bf6-4d316c63e6b9 for instance 65449361-cc88-4caa-aeff-800337a2fbb0 on nch1-master-1 Apr 16 21:14:26.522408 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-769d1a79-176f-429f-9ba7-0652f0303885 req-a880a70f-5178-4d8f-8ac4-c403923ce1be service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032518 Apr 16 21:14:26.523424 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1073/2082] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:14:26.524981 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9636e87b-8dd9-4b37-974a-0d68e7432f77 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1308 microversion: 2.1 time: 0.324708 Apr 16 21:14:26.525709 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1010/2083] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:26 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1308 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:26.529864 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ee7ab898-0819-40ff-b7fa-3c5b9cea0846 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:26.531046 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ee7ab898-0819-40ff-b7fa-3c5b9cea0846 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 65449361-cc88-4caa-aeff-800337a2fbb0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:26.537938 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee7ab898-0819-40ff-b7fa-3c5b9cea0846 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:26.538732 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee7ab898-0819-40ff-b7fa-3c5b9cea0846 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:26.539757 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee7ab898-0819-40ff-b7fa-3c5b9cea0846 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:26.540480 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee7ab898-0819-40ff-b7fa-3c5b9cea0846 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:26.774830 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ee7ab898-0819-40ff-b7fa-3c5b9cea0846 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "POST /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0/action" status: 202 len: 0 microversion: 2.1 time: 0.249635 Apr 16 21:14:26.775873 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1074/2084] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:14:26 2022] POST /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:14:26.784724 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bf16fc04-d6d9-4881-b8a2-6c5bb8d43eda tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:26.785732 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bf16fc04-d6d9-4881-b8a2-6c5bb8d43eda tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 65449361-cc88-4caa-aeff-800337a2fbb0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:26.793640 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bf16fc04-d6d9-4881-b8a2-6c5bb8d43eda tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:26.794274 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bf16fc04-d6d9-4881-b8a2-6c5bb8d43eda tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:26.795433 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bf16fc04-d6d9-4881-b8a2-6c5bb8d43eda tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:26.796011 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bf16fc04-d6d9-4881-b8a2-6c5bb8d43eda tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:26.826734 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b744ee85-38ce-4b47-a955-6be7e618767f tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:26.827444 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b744ee85-38ce-4b47-a955-6be7e618767f tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] [instance: 18e64ceb-9630-44a6-a82c-b8a53099b88f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:26.840970 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b744ee85-38ce-4b47-a955-6be7e618767f tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:26.841565 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b744ee85-38ce-4b47-a955-6be7e618767f tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:26.842858 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b744ee85-38ce-4b47-a955-6be7e618767f tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:26.843561 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b744ee85-38ce-4b47-a955-6be7e618767f tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:27.056978 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-bf16fc04-d6d9-4881-b8a2-6c5bb8d43eda tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87e2c1601764f23ac7530b6ad66b3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe50d9e0841749f094948101efdc3d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:27.067481 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bf16fc04-d6d9-4881-b8a2-6c5bb8d43eda tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "GET /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0" status: 200 len: 1573 microversion: 2.1 time: 0.287171 Apr 16 21:14:27.068097 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1011/2085] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:26 2022] GET /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0 => generated 1573 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:27.073596 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2601632e-3079-43ae-ad40-13ea30b67890 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:27.074606 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2601632e-3079-43ae-ad40-13ea30b67890 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:27.081752 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2601632e-3079-43ae-ad40-13ea30b67890 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:27.082470 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2601632e-3079-43ae-ad40-13ea30b67890 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:27.083718 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2601632e-3079-43ae-ad40-13ea30b67890 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:27.084633 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2601632e-3079-43ae-ad40-13ea30b67890 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:27.310391 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2601632e-3079-43ae-ad40-13ea30b67890 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:27.320318 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2601632e-3079-43ae-ad40-13ea30b67890 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:27.321871 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2601632e-3079-43ae-ad40-13ea30b67890 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:27.323081 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2601632e-3079-43ae-ad40-13ea30b67890 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1870 microversion: 2.32 time: 0.253634 Apr 16 21:14:27.323906 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1012/2086] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:27 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1870 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:14:27.328157 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1c08bc58-2384-4fbb-8c56-83d705e225f5 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:27.328788 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1c08bc58-2384-4fbb-8c56-83d705e225f5 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:27.336329 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1c08bc58-2384-4fbb-8c56-83d705e225f5 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:27.336792 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1c08bc58-2384-4fbb-8c56-83d705e225f5 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:27.337584 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1c08bc58-2384-4fbb-8c56-83d705e225f5 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:27.338034 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1c08bc58-2384-4fbb-8c56-83d705e225f5 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:27.430937 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b744ee85-38ce-4b47-a955-6be7e618767f tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b41363947d44c9be2bda9ed14cbcc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fd7025ca44244ae100b2b916ad1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:27.439240 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b744ee85-38ce-4b47-a955-6be7e618767f tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] 10.222.0.20 "GET /compute/v2.1/servers/18e64ceb-9630-44a6-a82c-b8a53099b88f" status: 200 len: 1332 microversion: 2.1 time: 0.617017 Apr 16 21:14:27.454611 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1075/2087] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:26 2022] GET /compute/v2.1/servers/18e64ceb-9630-44a6-a82c-b8a53099b88f => generated 1332 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:27.543829 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-413545cd-5667-4efe-8238-55dffb92fdfb tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:27.544600 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-413545cd-5667-4efe-8238-55dffb92fdfb tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:27.551576 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-413545cd-5667-4efe-8238-55dffb92fdfb tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:27.553206 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-413545cd-5667-4efe-8238-55dffb92fdfb tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:27.554017 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-413545cd-5667-4efe-8238-55dffb92fdfb tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:27.554499 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-413545cd-5667-4efe-8238-55dffb92fdfb tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:27.561233 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1c08bc58-2384-4fbb-8c56-83d705e225f5 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:27.576142 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1c08bc58-2384-4fbb-8c56-83d705e225f5 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1388 microversion: 2.1 time: 0.251399 Apr 16 21:14:27.577518 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1013/2088] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:27 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1388 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:27.791082 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-413545cd-5667-4efe-8238-55dffb92fdfb tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:27.807205 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-413545cd-5667-4efe-8238-55dffb92fdfb tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1308 microversion: 2.1 time: 0.266485 Apr 16 21:14:27.810503 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1076/2089] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:27 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1308 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:14:28.088728 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2ac27da4-7049-4c3b-a2b7-3c6ca0f9a4e0 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:28.088728 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2ac27da4-7049-4c3b-a2b7-3c6ca0f9a4e0 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 65449361-cc88-4caa-aeff-800337a2fbb0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:28.103699 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2ac27da4-7049-4c3b-a2b7-3c6ca0f9a4e0 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:28.104369 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2ac27da4-7049-4c3b-a2b7-3c6ca0f9a4e0 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:28.105943 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2ac27da4-7049-4c3b-a2b7-3c6ca0f9a4e0 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:28.110790 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2ac27da4-7049-4c3b-a2b7-3c6ca0f9a4e0 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:28.342819 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2ac27da4-7049-4c3b-a2b7-3c6ca0f9a4e0 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87e2c1601764f23ac7530b6ad66b3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe50d9e0841749f094948101efdc3d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:28.344703 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e0f7072a-048c-4b39-8ae3-e54587aa6f1f tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:28.345509 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e0f7072a-048c-4b39-8ae3-e54587aa6f1f tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:28.353041 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2ac27da4-7049-4c3b-a2b7-3c6ca0f9a4e0 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "GET /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0" status: 200 len: 1573 microversion: 2.1 time: 0.271443 Apr 16 21:14:28.354268 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1014/2090] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:28 2022] GET /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0 => generated 1573 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:28.359261 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e0f7072a-048c-4b39-8ae3-e54587aa6f1f tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:28.362896 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e0f7072a-048c-4b39-8ae3-e54587aa6f1f tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:28.364955 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e0f7072a-048c-4b39-8ae3-e54587aa6f1f tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:28.365527 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e0f7072a-048c-4b39-8ae3-e54587aa6f1f tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:28.457214 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1645897c-63b6-4017-b1e5-997d4dc76b59 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:28.457849 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1645897c-63b6-4017-b1e5-997d4dc76b59 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] [instance: 18e64ceb-9630-44a6-a82c-b8a53099b88f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:28.468157 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1645897c-63b6-4017-b1e5-997d4dc76b59 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:28.469293 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1645897c-63b6-4017-b1e5-997d4dc76b59 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:28.471744 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1645897c-63b6-4017-b1e5-997d4dc76b59 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:28.472235 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1645897c-63b6-4017-b1e5-997d4dc76b59 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:28.724409 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1645897c-63b6-4017-b1e5-997d4dc76b59 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b41363947d44c9be2bda9ed14cbcc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fd7025ca44244ae100b2b916ad1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:28.748674 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1645897c-63b6-4017-b1e5-997d4dc76b59 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] 10.222.0.20 "GET /compute/v2.1/servers/18e64ceb-9630-44a6-a82c-b8a53099b88f" status: 200 len: 1332 microversion: 2.1 time: 0.296171 Apr 16 21:14:28.750212 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1015/2091] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:28 2022] GET /compute/v2.1/servers/18e64ceb-9630-44a6-a82c-b8a53099b88f => generated 1332 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:28.755888 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ca305e5e-7f73-4cd6-88e9-6b08bdf2f761 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:28.756829 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ca305e5e-7f73-4cd6-88e9-6b08bdf2f761 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:28.758459 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e0f7072a-048c-4b39-8ae3-e54587aa6f1f tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:28.766902 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ca305e5e-7f73-4cd6-88e9-6b08bdf2f761 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:28.767841 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ca305e5e-7f73-4cd6-88e9-6b08bdf2f761 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:28.769156 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ca305e5e-7f73-4cd6-88e9-6b08bdf2f761 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:28.769954 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ca305e5e-7f73-4cd6-88e9-6b08bdf2f761 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:28.770767 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e0f7072a-048c-4b39-8ae3-e54587aa6f1f tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:28.774522 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e0f7072a-048c-4b39-8ae3-e54587aa6f1f tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:28.774522 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e0f7072a-048c-4b39-8ae3-e54587aa6f1f tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1870 microversion: 2.32 time: 0.435869 Apr 16 21:14:28.788498 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1077/2092] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:28 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1870 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:14:28.796748 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-9631c7f6-6f1e-4084-8491-f63c2dacc5a8 req-7bda3cd1-b309-44f7-8952-0450222f8399 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf669403-03eb-40c7-9a11-3d0422f708c7", "tag": "289d892c-efd8-4a45-8065-39c93c83ca97"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:28.809214 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-9631c7f6-6f1e-4084-8491-f63c2dacc5a8 req-7bda3cd1-b309-44f7-8952-0450222f8399 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:28.809841 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-9631c7f6-6f1e-4084-8491-f63c2dacc5a8 req-7bda3cd1-b309-44f7-8952-0450222f8399 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:28.824549 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-9631c7f6-6f1e-4084-8491-f63c2dacc5a8 req-7bda3cd1-b309-44f7-8952-0450222f8399 service nova] Creating event network-changed:289d892c-efd8-4a45-8065-39c93c83ca97 for instance cf669403-03eb-40c7-9a11-3d0422f708c7 on nch2-master-1 Apr 16 21:14:28.835885 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-9631c7f6-6f1e-4084-8491-f63c2dacc5a8 req-7bda3cd1-b309-44f7-8952-0450222f8399 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042561 Apr 16 21:14:28.836989 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1078/2093] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:14:28.843065 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2dd0e8c5-bc6f-4cda-ab22-9456112f05ed tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:28.843928 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2dd0e8c5-bc6f-4cda-ab22-9456112f05ed tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:28.852206 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2dd0e8c5-bc6f-4cda-ab22-9456112f05ed tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:28.852682 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2dd0e8c5-bc6f-4cda-ab22-9456112f05ed tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:28.853540 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2dd0e8c5-bc6f-4cda-ab22-9456112f05ed tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:28.854151 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2dd0e8c5-bc6f-4cda-ab22-9456112f05ed tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:29.028338 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ca305e5e-7f73-4cd6-88e9-6b08bdf2f761 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:29.039871 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ca305e5e-7f73-4cd6-88e9-6b08bdf2f761 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1388 microversion: 2.1 time: 0.288393 Apr 16 21:14:29.058485 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1016/2094] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:28 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1388 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:29.358492 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2dd0e8c5-bc6f-4cda-ab22-9456112f05ed tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:29.367122 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2dd0e8c5-bc6f-4cda-ab22-9456112f05ed tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1308 microversion: 2.1 time: 0.528198 Apr 16 21:14:29.371247 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fae2a885-ed86-4577-8030-ffd573ac1628 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:29.372897 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-fae2a885-ed86-4577-8030-ffd573ac1628 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 65449361-cc88-4caa-aeff-800337a2fbb0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:29.378059 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1079/2095] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:28 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1308 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:29.391746 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fae2a885-ed86-4577-8030-ffd573ac1628 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:29.392845 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fae2a885-ed86-4577-8030-ffd573ac1628 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:29.394045 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fae2a885-ed86-4577-8030-ffd573ac1628 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:29.394744 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fae2a885-ed86-4577-8030-ffd573ac1628 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:29.635504 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-fae2a885-ed86-4577-8030-ffd573ac1628 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87e2c1601764f23ac7530b6ad66b3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe50d9e0841749f094948101efdc3d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:29.644469 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fae2a885-ed86-4577-8030-ffd573ac1628 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "GET /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0" status: 200 len: 1571 microversion: 2.1 time: 0.277787 Apr 16 21:14:29.645378 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1017/2096] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:29 2022] GET /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0 => generated 1571 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:14:29.668456 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-aa1bad68-73df-4c4b-964f-b971696def2f tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1004708674"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:29.669295 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-aa1bad68-73df-4c4b-964f-b971696def2f tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 65449361-cc88-4caa-aeff-800337a2fbb0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:29.678212 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aa1bad68-73df-4c4b-964f-b971696def2f tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:29.678667 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aa1bad68-73df-4c4b-964f-b971696def2f tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:29.679578 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aa1bad68-73df-4c4b-964f-b971696def2f tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:29.680024 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aa1bad68-73df-4c4b-964f-b971696def2f tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:29.769495 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-00a8688a-86f9-469e-9ab9-2a4b666241df tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:29.770934 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-00a8688a-86f9-469e-9ab9-2a4b666241df tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] [instance: 18e64ceb-9630-44a6-a82c-b8a53099b88f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:29.781518 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-00a8688a-86f9-469e-9ab9-2a4b666241df tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:29.784876 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-00a8688a-86f9-469e-9ab9-2a4b666241df tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:29.786937 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-00a8688a-86f9-469e-9ab9-2a4b666241df tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:29.791265 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-00a8688a-86f9-469e-9ab9-2a4b666241df tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:29.965218 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.network.security_group_api [None req-aa1bad68-73df-4c4b-964f-b971696def2f tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Adding security group cb029531-d330-497f-8889-338b10e719e3 to port 945aa480-3d27-4a43-9bf6-4d316c63e6b9 Apr 16 21:14:30.054743 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-00a8688a-86f9-469e-9ab9-2a4b666241df tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b41363947d44c9be2bda9ed14cbcc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fd7025ca44244ae100b2b916ad1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:30.067317 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-00a8688a-86f9-469e-9ab9-2a4b666241df tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] 10.222.0.20 "GET /compute/v2.1/servers/18e64ceb-9630-44a6-a82c-b8a53099b88f" status: 200 len: 1332 microversion: 2.1 time: 0.303268 Apr 16 21:14:30.069454 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1018/2097] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:29 2022] GET /compute/v2.1/servers/18e64ceb-9630-44a6-a82c-b8a53099b88f => generated 1332 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:30.085840 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3f2d0ebd-b8fb-44e7-89c3-167b04c4ea29 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:30.088403 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3f2d0ebd-b8fb-44e7-89c3-167b04c4ea29 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:30.094476 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3f2d0ebd-b8fb-44e7-89c3-167b04c4ea29 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:30.095312 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3f2d0ebd-b8fb-44e7-89c3-167b04c4ea29 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:30.096451 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3f2d0ebd-b8fb-44e7-89c3-167b04c4ea29 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:30.097112 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3f2d0ebd-b8fb-44e7-89c3-167b04c4ea29 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:30.460285 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3f2d0ebd-b8fb-44e7-89c3-167b04c4ea29 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:30.480265 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3f2d0ebd-b8fb-44e7-89c3-167b04c4ea29 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:30.482829 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3f2d0ebd-b8fb-44e7-89c3-167b04c4ea29 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:30.487421 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3f2d0ebd-b8fb-44e7-89c3-167b04c4ea29 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1870 microversion: 2.32 time: 0.416140 Apr 16 21:14:30.494239 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1019/2098] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:30 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1870 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:14:30.509988 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9e3532e0-cd6a-437f-bc07-24a5f652a0e2 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:30.511459 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9e3532e0-cd6a-437f-bc07-24a5f652a0e2 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:30.518949 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9e3532e0-cd6a-437f-bc07-24a5f652a0e2 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:30.519513 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9e3532e0-cd6a-437f-bc07-24a5f652a0e2 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:30.521354 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9e3532e0-cd6a-437f-bc07-24a5f652a0e2 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:30.522165 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9e3532e0-cd6a-437f-bc07-24a5f652a0e2 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:30.679931 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9e3532e0-cd6a-437f-bc07-24a5f652a0e2 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:30.690554 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9e3532e0-cd6a-437f-bc07-24a5f652a0e2 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1388 microversion: 2.1 time: 0.192704 Apr 16 21:14:30.701516 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1020/2099] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:30 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1388 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:30.706686 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-b59ee00c-5ad7-486c-818b-81ef8c77f16a req-d45f5dfc-6394-4eb1-b079-bf0e69727e01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18e64ceb-9630-44a6-a82c-b8a53099b88f", "name": "network-vif-plugged", "status": "completed", "tag": "abe53b48-55b2-448c-aef2-8b7b60e401a5"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:30.716029 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-b59ee00c-5ad7-486c-818b-81ef8c77f16a req-d45f5dfc-6394-4eb1-b079-bf0e69727e01 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:30.717019 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-b59ee00c-5ad7-486c-818b-81ef8c77f16a req-d45f5dfc-6394-4eb1-b079-bf0e69727e01 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:30.731483 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-b59ee00c-5ad7-486c-818b-81ef8c77f16a req-d45f5dfc-6394-4eb1-b079-bf0e69727e01 service nova] Creating event network-vif-plugged:abe53b48-55b2-448c-aef2-8b7b60e401a5 for instance 18e64ceb-9630-44a6-a82c-b8a53099b88f on nch1-master-1 Apr 16 21:14:30.739609 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-b59ee00c-5ad7-486c-818b-81ef8c77f16a req-d45f5dfc-6394-4eb1-b079-bf0e69727e01 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036544 Apr 16 21:14:30.748478 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1021/2100] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:14:30.757271 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-23908758-0086-4ad7-bbbe-3109a60fc9de tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:30.758979 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-23908758-0086-4ad7-bbbe-3109a60fc9de tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:30.769674 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-23908758-0086-4ad7-bbbe-3109a60fc9de tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:30.770396 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-23908758-0086-4ad7-bbbe-3109a60fc9de tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:30.773749 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-23908758-0086-4ad7-bbbe-3109a60fc9de tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:30.774542 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-23908758-0086-4ad7-bbbe-3109a60fc9de tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:31.061953 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-23908758-0086-4ad7-bbbe-3109a60fc9de tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:31.076396 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-23908758-0086-4ad7-bbbe-3109a60fc9de tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1308 microversion: 2.1 time: 0.325644 Apr 16 21:14:31.088359 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1022/2101] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:30 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1308 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:31.105896 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-1b6e878b-821e-4264-9baf-41d075885c2e req-19d2e9e8-300a-4188-b6cd-e8f5a5d21ca8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf669403-03eb-40c7-9a11-3d0422f708c7", "tag": "3e5cf556-52a6-4c25-b89c-a2b9dc0b4a62"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:31.145297 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-1b6e878b-821e-4264-9baf-41d075885c2e req-19d2e9e8-300a-4188-b6cd-e8f5a5d21ca8 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:31.145297 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-1b6e878b-821e-4264-9baf-41d075885c2e req-19d2e9e8-300a-4188-b6cd-e8f5a5d21ca8 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:31.172879 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-1b6e878b-821e-4264-9baf-41d075885c2e req-19d2e9e8-300a-4188-b6cd-e8f5a5d21ca8 service nova] Creating event network-changed:3e5cf556-52a6-4c25-b89c-a2b9dc0b4a62 for instance cf669403-03eb-40c7-9a11-3d0422f708c7 on nch2-master-1 Apr 16 21:14:31.190102 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-1b6e878b-821e-4264-9baf-41d075885c2e req-19d2e9e8-300a-4188-b6cd-e8f5a5d21ca8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098739 Apr 16 21:14:31.193926 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1023/2102] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:14:31.207172 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5376ed46-4f93-4994-b2c6-74514464e99b tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:31.214230 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5376ed46-4f93-4994-b2c6-74514464e99b tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] [instance: 18e64ceb-9630-44a6-a82c-b8a53099b88f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:31.224081 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5376ed46-4f93-4994-b2c6-74514464e99b tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:31.224586 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5376ed46-4f93-4994-b2c6-74514464e99b tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:31.225868 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5376ed46-4f93-4994-b2c6-74514464e99b tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:31.226340 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5376ed46-4f93-4994-b2c6-74514464e99b tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:31.231012 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-aa1bad68-73df-4c4b-964f-b971696def2f tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "POST /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0/action" status: 202 len: 0 microversion: 2.1 time: 1.567123 Apr 16 21:14:31.232338 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1080/2103] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:14:29 2022] POST /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0/action => generated 0 bytes in 1569 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:14:31.241567 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-89ef63b4-3818-4d30-a8ae-88e90a68f8ec tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '.version_select at 0x7fbb9ff4adc0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:31.467141 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5376ed46-4f93-4994-b2c6-74514464e99b tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b41363947d44c9be2bda9ed14cbcc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fd7025ca44244ae100b2b916ad1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:31.477707 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5376ed46-4f93-4994-b2c6-74514464e99b tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] 10.222.0.20 "GET /compute/v2.1/servers/18e64ceb-9630-44a6-a82c-b8a53099b88f" status: 200 len: 1332 microversion: 2.1 time: 0.282473 Apr 16 21:14:31.478669 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1024/2104] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:31 2022] GET /compute/v2.1/servers/18e64ceb-9630-44a6-a82c-b8a53099b88f => generated 1332 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:31.649414 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bbd700f4-251e-4f98-b847-ef901717b01d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1987940170", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:31.714879 ncdv-master-1 devstack@n-api.service[137408]: DEBUG neutronclient.v2_0.client [None req-89ef63b4-3818-4d30-a8ae-88e90a68f8ec tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group cb029531-d330-497f-8889-338b10e719e3 in use.", "detail": ""}} {{(pid=137408) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 16 21:14:31.715889 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-89ef63b4-3818-4d30-a8ae-88e90a68f8ec tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] HTTP exception thrown: Security Group cb029531-d330-497f-8889-338b10e719e3 in use. Apr 16 21:14:31.715889 ncdv-master-1 devstack@n-api.service[137408]: Neutron server returns request_ids: ['req-bdeda956-b1e0-4d17-b6a9-5a17578d4ce9'] Apr 16 21:14:31.717151 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-89ef63b4-3818-4d30-a8ae-88e90a68f8ec tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Returning 400 to user: Security Group cb029531-d330-497f-8889-338b10e719e3 in use. Apr 16 21:14:31.717151 ncdv-master-1 devstack@n-api.service[137408]: Neutron server returns request_ids: ['req-bdeda956-b1e0-4d17-b6a9-5a17578d4ce9'] {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:14:31.720484 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-89ef63b4-3818-4d30-a8ae-88e90a68f8ec tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/cb029531-d330-497f-8889-338b10e719e3" status: 400 len: 185 microversion: 2.1 time: 0.482100 Apr 16 21:14:31.722919 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1081/2105] 10.222.0.20 () {58 vars in 1271 bytes} [Sat Apr 16 21:14:31 2022] DELETE /compute/v2.1/os-security-groups/cb029531-d330-497f-8889-338b10e719e3 => generated 185 bytes in 485 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 16 21:14:31.730487 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-bbd700f4-251e-4f98-b847-ef901717b01d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] validate_networks() for None {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:14:31.733801 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-69075b16-d935-4a7a-8e7e-27067e5495ac tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:31.737957 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-69075b16-d935-4a7a-8e7e-27067e5495ac tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:31.765903 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-69075b16-d935-4a7a-8e7e-27067e5495ac tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:31.766766 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-69075b16-d935-4a7a-8e7e-27067e5495ac tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:31.768990 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-69075b16-d935-4a7a-8e7e-27067e5495ac tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:31.772136 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-69075b16-d935-4a7a-8e7e-27067e5495ac tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:32.244126 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-bbd700f4-251e-4f98-b847-ef901717b01d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:14:32.244126 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-bbd700f4-251e-4f98-b847-ef901717b01d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:14:32.244126 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-bbd700f4-251e-4f98-b847-ef901717b01d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:14:32.245108 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-bbd700f4-251e-4f98-b847-ef901717b01d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:14:32.245580 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-bbd700f4-251e-4f98-b847-ef901717b01d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:14:32.265628 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bbd700f4-251e-4f98-b847-ef901717b01d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:32.266099 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bbd700f4-251e-4f98-b847-ef901717b01d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:32.267129 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bbd700f4-251e-4f98-b847-ef901717b01d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:32.267609 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bbd700f4-251e-4f98-b847-ef901717b01d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:32.274163 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-69075b16-d935-4a7a-8e7e-27067e5495ac tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:32.287936 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-69075b16-d935-4a7a-8e7e-27067e5495ac tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:32.292526 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-69075b16-d935-4a7a-8e7e-27067e5495ac tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:32.294074 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-69075b16-d935-4a7a-8e7e-27067e5495ac tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1870 microversion: 2.32 time: 0.569726 Apr 16 21:14:32.294926 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-bbd700f4-251e-4f98-b847-ef901717b01d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Getting quotas for project 29fd420ef9134715bd3a9f2467d924cd. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:14:32.306847 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-bbd700f4-251e-4f98-b847-ef901717b01d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Getting quotas for user d17cad39fa38448eb9827605871463a3 and project 29fd420ef9134715bd3a9f2467d924cd. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:14:32.307990 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1082/2106] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:31 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1870 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:14:32.315190 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-63ea8655-0217-4bb0-8b08-6611be661d4b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:32.316092 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-63ea8655-0217-4bb0-8b08-6611be661d4b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:32.326229 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-63ea8655-0217-4bb0-8b08-6611be661d4b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:32.326920 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-63ea8655-0217-4bb0-8b08-6611be661d4b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:32.328549 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-63ea8655-0217-4bb0-8b08-6611be661d4b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:32.329298 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-63ea8655-0217-4bb0-8b08-6611be661d4b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:32.351487 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bbd700f4-251e-4f98-b847-ef901717b01d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:14:32.356463 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bbd700f4-251e-4f98-b847-ef901717b01d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:14:32.591788 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bbd700f4-251e-4f98-b847-ef901717b01d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.111811 Apr 16 21:14:32.593730 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1025/2107] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:14:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1114 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:14:32.600494 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a2f50761-d403-4a3e-b8d5-fdbb8b3b9a6c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:32.613649 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a2f50761-d403-4a3e-b8d5-fdbb8b3b9a6c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 65449361-cc88-4caa-aeff-800337a2fbb0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:32.632569 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a2f50761-d403-4a3e-b8d5-fdbb8b3b9a6c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:32.635057 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a2f50761-d403-4a3e-b8d5-fdbb8b3b9a6c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:32.636783 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a2f50761-d403-4a3e-b8d5-fdbb8b3b9a6c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:32.639683 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a2f50761-d403-4a3e-b8d5-fdbb8b3b9a6c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:32.743470 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a2f50761-d403-4a3e-b8d5-fdbb8b3b9a6c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 65449361-cc88-4caa-aeff-800337a2fbb0] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:14:33.194293 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a2f50761-d403-4a3e-b8d5-fdbb8b3b9a6c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "DELETE /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0" status: 204 len: 0 microversion: 2.1 time: 0.598628 Apr 16 21:14:33.195635 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1026/2108] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:14:32 2022] DELETE /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:14:33.205264 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e40159bb-22e3-4fd2-a116-3239b495124f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:33.205264 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e40159bb-22e3-4fd2-a116-3239b495124f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:33.218847 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e40159bb-22e3-4fd2-a116-3239b495124f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:33.220184 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e40159bb-22e3-4fd2-a116-3239b495124f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:33.221604 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e40159bb-22e3-4fd2-a116-3239b495124f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:33.221604 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e40159bb-22e3-4fd2-a116-3239b495124f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:33.307194 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-63ea8655-0217-4bb0-8b08-6611be661d4b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:33.316514 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-63ea8655-0217-4bb0-8b08-6611be661d4b tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1388 microversion: 2.1 time: 1.007097 Apr 16 21:14:33.317857 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1083/2109] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:32 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1388 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:33.323089 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c82b5303-9cef-48f9-b63f-9a8f665e5255 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:33.323956 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c82b5303-9cef-48f9-b63f-9a8f665e5255 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] [instance: 18e64ceb-9630-44a6-a82c-b8a53099b88f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:33.332642 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c82b5303-9cef-48f9-b63f-9a8f665e5255 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:33.333397 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c82b5303-9cef-48f9-b63f-9a8f665e5255 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:33.334473 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c82b5303-9cef-48f9-b63f-9a8f665e5255 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:33.335240 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c82b5303-9cef-48f9-b63f-9a8f665e5255 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:33.445926 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e40159bb-22e3-4fd2-a116-3239b495124f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:33.454747 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e40159bb-22e3-4fd2-a116-3239b495124f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1308 microversion: 2.1 time: 0.257701 Apr 16 21:14:33.455577 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1027/2110] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:33 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1308 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:33.460804 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5629bb16-a888-4624-b44a-a9145b8eda7c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:33.461497 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5629bb16-a888-4624-b44a-a9145b8eda7c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:33.517803 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5629bb16-a888-4624-b44a-a9145b8eda7c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:33.525318 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5629bb16-a888-4624-b44a-a9145b8eda7c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 200 len: 1213 microversion: 2.1 time: 0.068512 Apr 16 21:14:33.527515 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1028/2111] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:33 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 1213 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:33.534056 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-02c06122-5387-4471-986f-1e7ff6bee39f req-1908a194-6301-4113-97ca-76ab496999a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39df3a82-5cde-4311-8bec-5ce2d111d59e", "name": "network-vif-deleted", "tag": "e220556c-73e1-42e1-a291-a4168a2b6289"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:33.537773 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c82b5303-9cef-48f9-b63f-9a8f665e5255 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b41363947d44c9be2bda9ed14cbcc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fd7025ca44244ae100b2b916ad1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:33.546273 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-02c06122-5387-4471-986f-1e7ff6bee39f req-1908a194-6301-4113-97ca-76ab496999a4 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:33.546955 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-02c06122-5387-4471-986f-1e7ff6bee39f req-1908a194-6301-4113-97ca-76ab496999a4 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:33.548343 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c82b5303-9cef-48f9-b63f-9a8f665e5255 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] 10.222.0.20 "GET /compute/v2.1/servers/18e64ceb-9630-44a6-a82c-b8a53099b88f" status: 200 len: 1537 microversion: 2.1 time: 0.229234 Apr 16 21:14:33.553647 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1084/2112] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:33 2022] GET /compute/v2.1/servers/18e64ceb-9630-44a6-a82c-b8a53099b88f => generated 1537 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:33.561980 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-02c06122-5387-4471-986f-1e7ff6bee39f req-1908a194-6301-4113-97ca-76ab496999a4 service nova] Creating event network-vif-deleted:e220556c-73e1-42e1-a291-a4168a2b6289 for instance 39df3a82-5cde-4311-8bec-5ce2d111d59e on nch2-master-1 Apr 16 21:14:33.565979 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a7373ea2-e29f-4802-b95a-3cd51535e192 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:33.565979 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a7373ea2-e29f-4802-b95a-3cd51535e192 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 65449361-cc88-4caa-aeff-800337a2fbb0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:33.570522 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-02c06122-5387-4471-986f-1e7ff6bee39f req-1908a194-6301-4113-97ca-76ab496999a4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040813 Apr 16 21:14:33.571579 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1029/2113] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:14:33.576425 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a7373ea2-e29f-4802-b95a-3cd51535e192 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:33.578103 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a7373ea2-e29f-4802-b95a-3cd51535e192 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:33.579148 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a7373ea2-e29f-4802-b95a-3cd51535e192 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:33.581606 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a7373ea2-e29f-4802-b95a-3cd51535e192 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:33.593328 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-54af56a0-8d90-4a71-bddb-0f06ef17d844 req-215a4180-fdf6-425a-910e-ecb21f798de4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65449361-cc88-4caa-aeff-800337a2fbb0", "tag": "945aa480-3d27-4a43-9bf6-4d316c63e6b9"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:33.617973 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-54af56a0-8d90-4a71-bddb-0f06ef17d844 req-215a4180-fdf6-425a-910e-ecb21f798de4 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:33.618758 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-54af56a0-8d90-4a71-bddb-0f06ef17d844 req-215a4180-fdf6-425a-910e-ecb21f798de4 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:33.643120 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-54af56a0-8d90-4a71-bddb-0f06ef17d844 req-215a4180-fdf6-425a-910e-ecb21f798de4 service nova] Creating event network-changed:945aa480-3d27-4a43-9bf6-4d316c63e6b9 for instance 65449361-cc88-4caa-aeff-800337a2fbb0 on nch1-master-1 Apr 16 21:14:33.652329 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-54af56a0-8d90-4a71-bddb-0f06ef17d844 req-215a4180-fdf6-425a-910e-ecb21f798de4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076712 Apr 16 21:14:33.652329 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1030/2114] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:14:33.659404 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-99eb7156-2c40-43f2-be59-15f275d5015a tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:33.660301 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-99eb7156-2c40-43f2-be59-15f275d5015a tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:33.671124 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-99eb7156-2c40-43f2-be59-15f275d5015a tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:33.681573 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-99eb7156-2c40-43f2-be59-15f275d5015a tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:33.681573 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-99eb7156-2c40-43f2-be59-15f275d5015a tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:33.681573 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-99eb7156-2c40-43f2-be59-15f275d5015a tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:34.037904 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-99eb7156-2c40-43f2-be59-15f275d5015a tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:34.052137 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-99eb7156-2c40-43f2-be59-15f275d5015a tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:34.054041 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-99eb7156-2c40-43f2-be59-15f275d5015a tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:34.055313 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-99eb7156-2c40-43f2-be59-15f275d5015a tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1870 microversion: 2.32 time: 0.402451 Apr 16 21:14:34.056119 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1031/2115] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:33 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1870 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:14:34.061628 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3779a854-698a-4699-9519-14bc863c50be tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Action: 'create', calling method: .version_select at 0x7fbb9feaa550>, body: {"pool": "f901fd27-41ce-4b49-9132-e60168d0f679"} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:34.117874 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a7373ea2-e29f-4802-b95a-3cd51535e192 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87e2c1601764f23ac7530b6ad66b3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe50d9e0841749f094948101efdc3d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:34.126050 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a7373ea2-e29f-4802-b95a-3cd51535e192 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "GET /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0" status: 200 len: 1646 microversion: 2.1 time: 0.570139 Apr 16 21:14:34.129178 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1085/2116] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:33 2022] GET /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0 => generated 1646 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:34.336004 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c17c1a61-1c75-40a8-8cf7-b54aef73449d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:34.337001 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c17c1a61-1c75-40a8-8cf7-b54aef73449d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:34.344667 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c17c1a61-1c75-40a8-8cf7-b54aef73449d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:34.345563 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c17c1a61-1c75-40a8-8cf7-b54aef73449d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:34.347282 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c17c1a61-1c75-40a8-8cf7-b54aef73449d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:34.347961 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c17c1a61-1c75-40a8-8cf7-b54aef73449d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:34.389507 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c17c1a61-1c75-40a8-8cf7-b54aef73449d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:34.390355 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c17c1a61-1c75-40a8-8cf7-b54aef73449d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:34.392245 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-c17c1a61-1c75-40a8-8cf7-b54aef73449d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lazy-loading 'fault' on Instance uuid 39df3a82-5cde-4311-8bec-5ce2d111d59e {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:14:34.476235 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c17c1a61-1c75-40a8-8cf7-b54aef73449d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:34.485760 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c17c1a61-1c75-40a8-8cf7-b54aef73449d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 200 len: 1188 microversion: 2.1 time: 0.154401 Apr 16 21:14:34.496635 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1086/2117] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:34 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 1188 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:14:34.502072 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6ac3d063-b7c8-46b5-8018-8f98a9fa8a79 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:34.502786 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6ac3d063-b7c8-46b5-8018-8f98a9fa8a79 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:34.509657 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6ac3d063-b7c8-46b5-8018-8f98a9fa8a79 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:34.510230 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6ac3d063-b7c8-46b5-8018-8f98a9fa8a79 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:34.511086 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6ac3d063-b7c8-46b5-8018-8f98a9fa8a79 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:34.511535 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6ac3d063-b7c8-46b5-8018-8f98a9fa8a79 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:34.747080 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6ac3d063-b7c8-46b5-8018-8f98a9fa8a79 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:34.758801 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6ac3d063-b7c8-46b5-8018-8f98a9fa8a79 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1308 microversion: 2.1 time: 0.260569 Apr 16 21:14:34.759691 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1087/2118] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:34 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1308 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:34.775416 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1826e4bf-589f-40a9-856e-9beaf4db6220 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:34.777428 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1826e4bf-589f-40a9-856e-9beaf4db6220 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:34.785077 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1826e4bf-589f-40a9-856e-9beaf4db6220 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:34.785703 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1826e4bf-589f-40a9-856e-9beaf4db6220 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:34.786649 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1826e4bf-589f-40a9-856e-9beaf4db6220 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:34.787383 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1826e4bf-589f-40a9-856e-9beaf4db6220 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:34.914008 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1826e4bf-589f-40a9-856e-9beaf4db6220 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:34.923341 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1826e4bf-589f-40a9-856e-9beaf4db6220 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 200 len: 1217 microversion: 2.1 time: 0.152616 Apr 16 21:14:34.928848 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1088/2119] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:34 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 1217 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:35.078361 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-724a9c91-0cff-483a-a24e-39abd2dcbe47 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:35.080468 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-724a9c91-0cff-483a-a24e-39abd2dcbe47 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:35.089577 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-724a9c91-0cff-483a-a24e-39abd2dcbe47 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:35.090058 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-724a9c91-0cff-483a-a24e-39abd2dcbe47 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:35.091467 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-724a9c91-0cff-483a-a24e-39abd2dcbe47 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:35.092611 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-724a9c91-0cff-483a-a24e-39abd2dcbe47 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:35.384313 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-724a9c91-0cff-483a-a24e-39abd2dcbe47 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:35.405776 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-724a9c91-0cff-483a-a24e-39abd2dcbe47 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:35.407900 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-724a9c91-0cff-483a-a24e-39abd2dcbe47 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:35.409834 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-724a9c91-0cff-483a-a24e-39abd2dcbe47 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1870 microversion: 2.32 time: 0.336594 Apr 16 21:14:35.424142 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1089/2120] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:35 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1870 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:14:35.430110 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6057e2a9-cdcb-4500-8bed-8c8dcee1a327 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:35.433584 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6057e2a9-cdcb-4500-8bed-8c8dcee1a327 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 65449361-cc88-4caa-aeff-800337a2fbb0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:35.440591 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6057e2a9-cdcb-4500-8bed-8c8dcee1a327 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:35.442679 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6057e2a9-cdcb-4500-8bed-8c8dcee1a327 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:35.443823 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6057e2a9-cdcb-4500-8bed-8c8dcee1a327 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:35.444638 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6057e2a9-cdcb-4500-8bed-8c8dcee1a327 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:35.858509 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6057e2a9-cdcb-4500-8bed-8c8dcee1a327 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87e2c1601764f23ac7530b6ad66b3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe50d9e0841749f094948101efdc3d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:35.867292 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6057e2a9-cdcb-4500-8bed-8c8dcee1a327 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "GET /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0" status: 200 len: 1646 microversion: 2.1 time: 0.440939 Apr 16 21:14:35.868523 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1090/2121] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:35 2022] GET /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0 => generated 1646 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:35.881776 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-72b5659c-0312-4d86-93d5-60ae0e1eede4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:35.882693 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-72b5659c-0312-4d86-93d5-60ae0e1eede4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: 39df3a82-5cde-4311-8bec-5ce2d111d59e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:35.900332 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-72b5659c-0312-4d86-93d5-60ae0e1eede4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:35.901253 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-72b5659c-0312-4d86-93d5-60ae0e1eede4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:35.902481 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-72b5659c-0312-4d86-93d5-60ae0e1eede4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:35.903164 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-72b5659c-0312-4d86-93d5-60ae0e1eede4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:35.939958 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-72b5659c-0312-4d86-93d5-60ae0e1eede4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] HTTP exception thrown: Instance 39df3a82-5cde-4311-8bec-5ce2d111d59e could not be found. Apr 16 21:14:35.941493 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-72b5659c-0312-4d86-93d5-60ae0e1eede4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Returning 404 to user: Instance 39df3a82-5cde-4311-8bec-5ce2d111d59e could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:14:35.942593 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-72b5659c-0312-4d86-93d5-60ae0e1eede4 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e" status: 404 len: 111 microversion: 2.1 time: 0.072836 Apr 16 21:14:35.943729 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1091/2122] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:35 2022] GET /compute/v2.1/servers/39df3a82-5cde-4311-8bec-5ce2d111d59e => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:14:35.951995 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-b4a730fe-738b-43d4-9b5b-28fe637c3c10 req-da8d5e0a-b0f6-4a9a-b738-ee45cf73ca59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf669403-03eb-40c7-9a11-3d0422f708c7", "tag": "c6438618-4e2e-4e98-a08e-fdf410282f72"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:35.974015 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-b4a730fe-738b-43d4-9b5b-28fe637c3c10 req-da8d5e0a-b0f6-4a9a-b738-ee45cf73ca59 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:35.974015 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-b4a730fe-738b-43d4-9b5b-28fe637c3c10 req-da8d5e0a-b0f6-4a9a-b738-ee45cf73ca59 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:35.986387 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-b4a730fe-738b-43d4-9b5b-28fe637c3c10 req-da8d5e0a-b0f6-4a9a-b738-ee45cf73ca59 service nova] Creating event network-changed:c6438618-4e2e-4e98-a08e-fdf410282f72 for instance cf669403-03eb-40c7-9a11-3d0422f708c7 on nch2-master-1 Apr 16 21:14:35.995752 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-b4a730fe-738b-43d4-9b5b-28fe637c3c10 req-da8d5e0a-b0f6-4a9a-b738-ee45cf73ca59 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049459 Apr 16 21:14:35.997394 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1092/2123] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:14:36.003477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0eccf453-c2f5-4076-9d37-1d936b1eb3e6 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:36.004601 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0eccf453-c2f5-4076-9d37-1d936b1eb3e6 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:36.013302 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0eccf453-c2f5-4076-9d37-1d936b1eb3e6 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:36.014072 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0eccf453-c2f5-4076-9d37-1d936b1eb3e6 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:36.015154 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0eccf453-c2f5-4076-9d37-1d936b1eb3e6 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:36.016043 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0eccf453-c2f5-4076-9d37-1d936b1eb3e6 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:36.427983 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0eccf453-c2f5-4076-9d37-1d936b1eb3e6 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:36.439783 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0eccf453-c2f5-4076-9d37-1d936b1eb3e6 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1308 microversion: 2.1 time: 0.440678 Apr 16 21:14:36.456877 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1093/2124] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:35 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1308 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:36.462007 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7087026a-21a7-4bd3-9aa5-1e7f795abd7b tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:36.462624 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7087026a-21a7-4bd3-9aa5-1e7f795abd7b tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:36.473700 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7087026a-21a7-4bd3-9aa5-1e7f795abd7b tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:36.474442 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7087026a-21a7-4bd3-9aa5-1e7f795abd7b tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:36.482795 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7087026a-21a7-4bd3-9aa5-1e7f795abd7b tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:36.482795 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7087026a-21a7-4bd3-9aa5-1e7f795abd7b tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:36.696126 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7087026a-21a7-4bd3-9aa5-1e7f795abd7b tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:36.720116 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7087026a-21a7-4bd3-9aa5-1e7f795abd7b tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 200 len: 1273 microversion: 2.1 time: 0.262012 Apr 16 21:14:36.731471 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1094/2125] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:36 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 1273 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:36.743895 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-191813c4-569b-4d34-8ecf-751a415d7ad4 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:36.743895 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-191813c4-569b-4d34-8ecf-751a415d7ad4 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:36.762686 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-191813c4-569b-4d34-8ecf-751a415d7ad4 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:36.766700 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-191813c4-569b-4d34-8ecf-751a415d7ad4 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:36.766700 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-191813c4-569b-4d34-8ecf-751a415d7ad4 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:36.766700 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-191813c4-569b-4d34-8ecf-751a415d7ad4 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:37.216583 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-191813c4-569b-4d34-8ecf-751a415d7ad4 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:37.228616 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-191813c4-569b-4d34-8ecf-751a415d7ad4 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:37.252338 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-191813c4-569b-4d34-8ecf-751a415d7ad4 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:37.254336 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-191813c4-569b-4d34-8ecf-751a415d7ad4 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1870 microversion: 2.32 time: 0.521364 Apr 16 21:14:37.255683 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1095/2126] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:36 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1870 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:14:37.263772 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-9c01756c-6840-4f62-b559-a01489c3f20b req-90d06ad5-0afb-490b-8e5c-bfdcf7b4bcab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65449361-cc88-4caa-aeff-800337a2fbb0", "name": "network-vif-deleted", "tag": "945aa480-3d27-4a43-9bf6-4d316c63e6b9"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:37.281200 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-9c01756c-6840-4f62-b559-a01489c3f20b req-90d06ad5-0afb-490b-8e5c-bfdcf7b4bcab service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:37.281707 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-9c01756c-6840-4f62-b559-a01489c3f20b req-90d06ad5-0afb-490b-8e5c-bfdcf7b4bcab service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:37.302720 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-9c01756c-6840-4f62-b559-a01489c3f20b req-90d06ad5-0afb-490b-8e5c-bfdcf7b4bcab service nova] Creating event network-vif-deleted:945aa480-3d27-4a43-9bf6-4d316c63e6b9 for instance 65449361-cc88-4caa-aeff-800337a2fbb0 on nch1-master-1 Apr 16 21:14:37.321343 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-9c01756c-6840-4f62-b559-a01489c3f20b req-90d06ad5-0afb-490b-8e5c-bfdcf7b4bcab service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063985 Apr 16 21:14:37.322308 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1096/2127] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:14:37.332786 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a88d4948-8335-438e-a0c7-fdae033aed8b tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:37.333573 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a88d4948-8335-438e-a0c7-fdae033aed8b tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 65449361-cc88-4caa-aeff-800337a2fbb0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:37.349827 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a88d4948-8335-438e-a0c7-fdae033aed8b tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:37.350302 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a88d4948-8335-438e-a0c7-fdae033aed8b tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:37.371372 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a88d4948-8335-438e-a0c7-fdae033aed8b tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:37.372020 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a88d4948-8335-438e-a0c7-fdae033aed8b tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:37.457868 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a88d4948-8335-438e-a0c7-fdae033aed8b tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:37.458558 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a88d4948-8335-438e-a0c7-fdae033aed8b tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:37.460639 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-a88d4948-8335-438e-a0c7-fdae033aed8b tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lazy-loading 'fault' on Instance uuid 65449361-cc88-4caa-aeff-800337a2fbb0 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:14:37.537807 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a88d4948-8335-438e-a0c7-fdae033aed8b tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87e2c1601764f23ac7530b6ad66b3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe50d9e0841749f094948101efdc3d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:37.552424 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a88d4948-8335-438e-a0c7-fdae033aed8b tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "GET /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0" status: 200 len: 1305 microversion: 2.1 time: 0.228870 Apr 16 21:14:37.553083 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1097/2128] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:37 2022] GET /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0 => generated 1305 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:37.572978 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a5811ad8-f9c6-422c-99a0-44d0e9f4e437 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:37.576725 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a5811ad8-f9c6-422c-99a0-44d0e9f4e437 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:37.586867 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a5811ad8-f9c6-422c-99a0-44d0e9f4e437 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:37.588450 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a5811ad8-f9c6-422c-99a0-44d0e9f4e437 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:37.590925 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a5811ad8-f9c6-422c-99a0-44d0e9f4e437 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:37.591594 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a5811ad8-f9c6-422c-99a0-44d0e9f4e437 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:37.837795 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a5811ad8-f9c6-422c-99a0-44d0e9f4e437 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:37.845614 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a5811ad8-f9c6-422c-99a0-44d0e9f4e437 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1308 microversion: 2.1 time: 0.283343 Apr 16 21:14:37.848581 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1098/2129] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:37 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1308 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:37.854838 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ae219226-d45a-4651-8622-5f66a86dce15 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:37.860709 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ae219226-d45a-4651-8622-5f66a86dce15 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:37.876643 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ae219226-d45a-4651-8622-5f66a86dce15 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:37.877524 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ae219226-d45a-4651-8622-5f66a86dce15 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:37.878610 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ae219226-d45a-4651-8622-5f66a86dce15 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:37.879067 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ae219226-d45a-4651-8622-5f66a86dce15 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:37.981879 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ae219226-d45a-4651-8622-5f66a86dce15 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:37.993305 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ae219226-d45a-4651-8622-5f66a86dce15 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 200 len: 1271 microversion: 2.1 time: 0.142305 Apr 16 21:14:37.994870 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1099/2130] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:37 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 1271 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:38.204807 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3779a854-698a-4699-9519-14bc863c50be tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.147394 Apr 16 21:14:38.205417 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1032/2131] 10.222.0.20 () {60 vars in 1169 bytes} [Sat Apr 16 21:14:34 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:14:38.221504 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3bd01d68-7026-4348-be6a-45adc8e2ec85 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Action: 'action', calling method: .version_select at 0x7fbb9d2468b0>, body: {"addFloatingIp": {"address": "172.35.1.76"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:38.224321 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3bd01d68-7026-4348-be6a-45adc8e2ec85 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] [instance: 18e64ceb-9630-44a6-a82c-b8a53099b88f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:38.234072 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3bd01d68-7026-4348-be6a-45adc8e2ec85 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:38.236069 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3bd01d68-7026-4348-be6a-45adc8e2ec85 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:38.240561 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3bd01d68-7026-4348-be6a-45adc8e2ec85 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:38.240561 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3bd01d68-7026-4348-be6a-45adc8e2ec85 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:38.276076 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-08022c08-5ce0-4ee4-bad2-eae4c6341b73 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:38.276076 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-08022c08-5ce0-4ee4-bad2-eae4c6341b73 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:38.289019 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-08022c08-5ce0-4ee4-bad2-eae4c6341b73 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:38.289477 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-08022c08-5ce0-4ee4-bad2-eae4c6341b73 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:38.290273 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-08022c08-5ce0-4ee4-bad2-eae4c6341b73 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:38.290718 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-08022c08-5ce0-4ee4-bad2-eae4c6341b73 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:38.374649 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3bd01d68-7026-4348-be6a-45adc8e2ec85 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Acquired lock "refresh_cache-18e64ceb-9630-44a6-a82c-b8a53099b88f" {{(pid=137408) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 16 21:14:38.751445 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-08022c08-5ce0-4ee4-bad2-eae4c6341b73 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:38.762935 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-08022c08-5ce0-4ee4-bad2-eae4c6341b73 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:38.764481 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-08022c08-5ce0-4ee4-bad2-eae4c6341b73 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:38.765663 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-08022c08-5ce0-4ee4-bad2-eae4c6341b73 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1870 microversion: 2.32 time: 0.495583 Apr 16 21:14:38.766231 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1033/2132] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:38 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1870 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:14:38.783310 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a38e16a1-8064-4876-b17e-b21fb747d68e tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:38.784209 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a38e16a1-8064-4876-b17e-b21fb747d68e tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 65449361-cc88-4caa-aeff-800337a2fbb0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:38.799457 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a38e16a1-8064-4876-b17e-b21fb747d68e tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:38.800261 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a38e16a1-8064-4876-b17e-b21fb747d68e tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:38.801231 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a38e16a1-8064-4876-b17e-b21fb747d68e tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:38.801844 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a38e16a1-8064-4876-b17e-b21fb747d68e tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:38.844589 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-a38e16a1-8064-4876-b17e-b21fb747d68e tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] HTTP exception thrown: Instance 65449361-cc88-4caa-aeff-800337a2fbb0 could not be found. Apr 16 21:14:38.847482 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a38e16a1-8064-4876-b17e-b21fb747d68e tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Returning 404 to user: Instance 65449361-cc88-4caa-aeff-800337a2fbb0 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:14:38.848577 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a38e16a1-8064-4876-b17e-b21fb747d68e tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "GET /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0" status: 404 len: 111 microversion: 2.1 time: 0.069403 Apr 16 21:14:38.851765 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1034/2133] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:38 2022] GET /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:14:38.867833 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cf0b570c-2838-4647-a1db-fe89943bce47 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '.version_select at 0x7fbb9fea1b80>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:39.759297 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cf0b570c-2838-4647-a1db-fe89943bce47 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/aa451634-4ebc-46a1-bd9e-410f66c22156" status: 202 len: 0 microversion: 2.1 time: 0.903090 Apr 16 21:14:39.760353 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1035/2134] 10.222.0.20 () {58 vars in 1271 bytes} [Sat Apr 16 21:14:38 2022] DELETE /compute/v2.1/os-security-groups/aa451634-4ebc-46a1-bd9e-410f66c22156 => generated 0 bytes in 905 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:14:39.765257 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6826b771-1b55-4c0e-a831-5527f43d2711 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:39.765911 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6826b771-1b55-4c0e-a831-5527f43d2711 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:39.773282 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6826b771-1b55-4c0e-a831-5527f43d2711 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:39.773993 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6826b771-1b55-4c0e-a831-5527f43d2711 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:39.774766 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6826b771-1b55-4c0e-a831-5527f43d2711 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:39.775217 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6826b771-1b55-4c0e-a831-5527f43d2711 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:39.974827 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6826b771-1b55-4c0e-a831-5527f43d2711 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:39.983457 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6826b771-1b55-4c0e-a831-5527f43d2711 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1308 microversion: 2.1 time: 0.221796 Apr 16 21:14:39.992262 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1036/2135] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:39 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1308 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:40.008757 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c8a8fac8-b8b3-429d-be84-6f40bc26bc68 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:40.010163 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c8a8fac8-b8b3-429d-be84-6f40bc26bc68 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:40.027705 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c8a8fac8-b8b3-429d-be84-6f40bc26bc68 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:40.028358 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c8a8fac8-b8b3-429d-be84-6f40bc26bc68 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:40.030068 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c8a8fac8-b8b3-429d-be84-6f40bc26bc68 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:40.030068 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c8a8fac8-b8b3-429d-be84-6f40bc26bc68 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:40.319135 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c8a8fac8-b8b3-429d-be84-6f40bc26bc68 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:40.330799 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c8a8fac8-b8b3-429d-be84-6f40bc26bc68 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 200 len: 1313 microversion: 2.1 time: 0.336708 Apr 16 21:14:40.341628 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1037/2136] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:39 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 1313 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:40.347880 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d507d88f-31bc-4e81-b6d4-0656e652f56e tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '.version_select at 0x7fbb95b96af0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:40.505016 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-3bd01d68-7026-4348-be6a-45adc8e2ec85 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] [instance: 18e64ceb-9630-44a6-a82c-b8a53099b88f] Building network info cache for instance {{(pid=137408) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Apr 16 21:14:41.067149 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d507d88f-31bc-4e81-b6d4-0656e652f56e tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/cb029531-d330-497f-8889-338b10e719e3" status: 202 len: 0 microversion: 2.1 time: 0.724066 Apr 16 21:14:41.068039 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1038/2137] 10.222.0.20 () {58 vars in 1271 bytes} [Sat Apr 16 21:14:40 2022] DELETE /compute/v2.1/os-security-groups/cb029531-d330-497f-8889-338b10e719e3 => generated 0 bytes in 725 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:14:41.073633 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a6e68f42-956b-485f-9799-69f2b2bf50e5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:41.074567 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a6e68f42-956b-485f-9799-69f2b2bf50e5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:41.106987 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a6e68f42-956b-485f-9799-69f2b2bf50e5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:41.106987 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a6e68f42-956b-485f-9799-69f2b2bf50e5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:41.106987 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a6e68f42-956b-485f-9799-69f2b2bf50e5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:41.106987 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a6e68f42-956b-485f-9799-69f2b2bf50e5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:41.429804 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a6e68f42-956b-485f-9799-69f2b2bf50e5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:41.444409 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a6e68f42-956b-485f-9799-69f2b2bf50e5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:41.446278 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a6e68f42-956b-485f-9799-69f2b2bf50e5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:41.447350 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a6e68f42-956b-485f-9799-69f2b2bf50e5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1870 microversion: 2.32 time: 0.378335 Apr 16 21:14:41.447724 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-3bd01d68-7026-4348-be6a-45adc8e2ec85 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] [instance: 18e64ceb-9630-44a6-a82c-b8a53099b88f] Updating instance_info_cache with network_info: [{"id": "abe53b48-55b2-448c-aef2-8b7b60e401a5", "address": "fa:16:3e:fe:48:43", "network": {"id": "a7e528bf-99b2-41b7-8807-aca3eac1e8d2", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1063806919-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.1.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "be0fd7025ca44244ae100b2b916ad1d8", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapabe53b48-55", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137408) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Apr 16 21:14:41.459490 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1039/2138] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:41 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1870 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:14:41.459490 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-7fa1754a-a479-4a04-97a2-f51e5e1b5838 req-7ee446df-4275-48a2-b58d-052828341bdb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18e64ceb-9630-44a6-a82c-b8a53099b88f", "tag": "abe53b48-55b2-448c-aef2-8b7b60e401a5"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:41.472346 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-7fa1754a-a479-4a04-97a2-f51e5e1b5838 req-7ee446df-4275-48a2-b58d-052828341bdb service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:41.472858 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-7fa1754a-a479-4a04-97a2-f51e5e1b5838 req-7ee446df-4275-48a2-b58d-052828341bdb service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:41.485327 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-7fa1754a-a479-4a04-97a2-f51e5e1b5838 req-7ee446df-4275-48a2-b58d-052828341bdb service nova] Creating event network-changed:abe53b48-55b2-448c-aef2-8b7b60e401a5 for instance 18e64ceb-9630-44a6-a82c-b8a53099b88f on nch1-master-1 Apr 16 21:14:41.490640 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-7fa1754a-a479-4a04-97a2-f51e5e1b5838 req-7ee446df-4275-48a2-b58d-052828341bdb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040464 Apr 16 21:14:41.491533 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1040/2139] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:14:41.498680 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-5350ae93-8815-465b-9a55-88736cc2d5fc req-2f19db99-7ea8-4776-af70-2ce61fa833f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0602327-eafa-416f-8114-3411e37e2eef", "tag": "0e4ce80e-dded-45a4-8cad-59e6b3b64323"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:41.507452 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-5350ae93-8815-465b-9a55-88736cc2d5fc req-2f19db99-7ea8-4776-af70-2ce61fa833f0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:41.508187 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-5350ae93-8815-465b-9a55-88736cc2d5fc req-2f19db99-7ea8-4776-af70-2ce61fa833f0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:41.520877 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-5350ae93-8815-465b-9a55-88736cc2d5fc req-2f19db99-7ea8-4776-af70-2ce61fa833f0 service nova] Creating event network-changed:0e4ce80e-dded-45a4-8cad-59e6b3b64323 for instance a0602327-eafa-416f-8114-3411e37e2eef on nch1-master-1 Apr 16 21:14:41.527821 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-5350ae93-8815-465b-9a55-88736cc2d5fc req-2f19db99-7ea8-4776-af70-2ce61fa833f0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033346 Apr 16 21:14:41.527821 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1041/2140] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:14:41.535870 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7908a8d3-0d38-4fd9-ba16-6d3af28996df tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:41.536689 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7908a8d3-0d38-4fd9-ba16-6d3af28996df tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:41.543944 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7908a8d3-0d38-4fd9-ba16-6d3af28996df tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:41.544383 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7908a8d3-0d38-4fd9-ba16-6d3af28996df tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:41.545615 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7908a8d3-0d38-4fd9-ba16-6d3af28996df tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:41.546328 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7908a8d3-0d38-4fd9-ba16-6d3af28996df tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:41.560128 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3bd01d68-7026-4348-be6a-45adc8e2ec85 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Releasing lock "refresh_cache-18e64ceb-9630-44a6-a82c-b8a53099b88f" {{(pid=137408) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 16 21:14:41.561917 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3bd01d68-7026-4348-be6a-45adc8e2ec85 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] 10.222.0.20 "POST /compute/v2.1/servers/18e64ceb-9630-44a6-a82c-b8a53099b88f/action" status: 202 len: 0 microversion: 2.1 time: 3.348327 Apr 16 21:14:41.562294 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1100/2141] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:14:38 2022] POST /compute/v2.1/servers/18e64ceb-9630-44a6-a82c-b8a53099b88f/action => generated 0 bytes in 3350 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Apr 16 21:14:41.569023 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b3c9889c-7fab-4439-8298-26070ee85041 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Action: 'create', calling method: .version_select at 0x7fbb9ff43820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1326398110", "description": "tempest-description-1778128857"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:41.705507 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7908a8d3-0d38-4fd9-ba16-6d3af28996df tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:41.721149 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7908a8d3-0d38-4fd9-ba16-6d3af28996df tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1308 microversion: 2.1 time: 0.189430 Apr 16 21:14:41.722814 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1042/2142] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:41 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1308 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:41.734751 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a5f67ac6-9df4-4e22-8ca9-13cc06207354 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:41.735698 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a5f67ac6-9df4-4e22-8ca9-13cc06207354 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:41.753808 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a5f67ac6-9df4-4e22-8ca9-13cc06207354 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:41.754292 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a5f67ac6-9df4-4e22-8ca9-13cc06207354 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:41.755163 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a5f67ac6-9df4-4e22-8ca9-13cc06207354 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:41.755624 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a5f67ac6-9df4-4e22-8ca9-13cc06207354 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:41.983347 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a5f67ac6-9df4-4e22-8ca9-13cc06207354 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:41.993498 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a5f67ac6-9df4-4e22-8ca9-13cc06207354 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 200 len: 1313 microversion: 2.1 time: 0.268357 Apr 16 21:14:41.995809 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1043/2143] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:41 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 1313 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:41.999700 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6863ef45-c6e5-46e7-864c-6b6a27a1a7d9 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Action: 'create', calling method: .version_select at 0x7fbb95bee4c0>, body: {"pool": "f901fd27-41ce-4b49-9132-e60168d0f679"} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:42.055835 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b3c9889c-7fab-4439-8298-26070ee85041 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.492101 Apr 16 21:14:42.060237 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1101/2144] 10.222.0.20 () {60 vars in 1179 bytes} [Sat Apr 16 21:14:41 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:14:42.068306 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-71e2a812-28f1-4156-9ea6-9fc1511e0810 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Action: 'update', calling method: .version_select at 0x7fbb95c071f0>, body: {"security_group": {"name": "tempest-sg-hth-615056822", "description": "tempest-description-hth-2019703050"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:42.419695 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-71e2a812-28f1-4156-9ea6-9fc1511e0810 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "PUT /compute/v2.1/os-security-groups/adca4344-9b99-49be-9974-2d21f2ef0eb9" status: 200 len: 217 microversion: 2.1 time: 0.353907 Apr 16 21:14:42.419695 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1102/2145] 10.222.0.20 () {60 vars in 1289 bytes} [Sat Apr 16 21:14:42 2022] PUT /compute/v2.1/os-security-groups/adca4344-9b99-49be-9974-2d21f2ef0eb9 => generated 217 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:14:42.431360 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1880caa7-f3ce-4b0a-8ac7-420e1bff726c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '.version_select at 0x7fbb95c070d0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:42.541119 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1880caa7-f3ce-4b0a-8ac7-420e1bff726c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/adca4344-9b99-49be-9974-2d21f2ef0eb9" status: 200 len: 217 microversion: 2.1 time: 0.114043 Apr 16 21:14:42.544276 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1103/2146] 10.222.0.20 () {58 vars in 1268 bytes} [Sat Apr 16 21:14:42 2022] GET /compute/v2.1/os-security-groups/adca4344-9b99-49be-9974-2d21f2ef0eb9 => generated 217 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:14:42.548029 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-dfcc7ee7-f38c-4e81-ac0d-a846d8a3124a tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:42.548681 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-dfcc7ee7-f38c-4e81-ac0d-a846d8a3124a tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:42.559442 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dfcc7ee7-f38c-4e81-ac0d-a846d8a3124a tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:42.560315 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dfcc7ee7-f38c-4e81-ac0d-a846d8a3124a tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:42.565477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dfcc7ee7-f38c-4e81-ac0d-a846d8a3124a tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:42.565477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dfcc7ee7-f38c-4e81-ac0d-a846d8a3124a tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:42.794171 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-dfcc7ee7-f38c-4e81-ac0d-a846d8a3124a tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:42.804828 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-dfcc7ee7-f38c-4e81-ac0d-a846d8a3124a tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:42.806916 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-dfcc7ee7-f38c-4e81-ac0d-a846d8a3124a tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:42.809243 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-dfcc7ee7-f38c-4e81-ac0d-a846d8a3124a tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1870 microversion: 2.32 time: 0.265627 Apr 16 21:14:42.810377 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1104/2147] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:42 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1870 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:14:42.815330 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0a0311ad-2575-438f-a6d9-3cc0e115405a tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '.version_select at 0x7fbb9ff8d310>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:43.130753 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0a0311ad-2575-438f-a6d9-3cc0e115405a tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/adca4344-9b99-49be-9974-2d21f2ef0eb9" status: 202 len: 0 microversion: 2.1 time: 0.319045 Apr 16 21:14:43.131357 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1105/2148] 10.222.0.20 () {58 vars in 1271 bytes} [Sat Apr 16 21:14:42 2022] DELETE /compute/v2.1/os-security-groups/adca4344-9b99-49be-9974-2d21f2ef0eb9 => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:14:43.136904 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-eb12e35d-8dac-43a2-ba6b-29f188b63437 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:43.137518 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-eb12e35d-8dac-43a2-ba6b-29f188b63437 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:43.149557 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eb12e35d-8dac-43a2-ba6b-29f188b63437 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:43.153388 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eb12e35d-8dac-43a2-ba6b-29f188b63437 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:43.154210 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eb12e35d-8dac-43a2-ba6b-29f188b63437 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:43.154715 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eb12e35d-8dac-43a2-ba6b-29f188b63437 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:43.356111 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-eb12e35d-8dac-43a2-ba6b-29f188b63437 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:43.365836 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-eb12e35d-8dac-43a2-ba6b-29f188b63437 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1308 microversion: 2.1 time: 0.233430 Apr 16 21:14:43.367101 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1106/2149] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:43 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1308 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:43.372614 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4feb6587-cca4-48f8-89dc-f3b0804ea33b tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:43.373532 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4feb6587-cca4-48f8-89dc-f3b0804ea33b tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:43.380199 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4feb6587-cca4-48f8-89dc-f3b0804ea33b tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:43.380958 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4feb6587-cca4-48f8-89dc-f3b0804ea33b tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:43.381992 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4feb6587-cca4-48f8-89dc-f3b0804ea33b tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:43.383415 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4feb6587-cca4-48f8-89dc-f3b0804ea33b tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:43.588643 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4feb6587-cca4-48f8-89dc-f3b0804ea33b tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:43.600406 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4feb6587-cca4-48f8-89dc-f3b0804ea33b tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 200 len: 1313 microversion: 2.1 time: 0.231711 Apr 16 21:14:43.601659 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1107/2150] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:43 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 1313 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:43.607662 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c8bf2737-0487-4668-a363-22e790c592c1 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:43.608333 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c8bf2737-0487-4668-a363-22e790c592c1 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 65449361-cc88-4caa-aeff-800337a2fbb0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:43.615851 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c8bf2737-0487-4668-a363-22e790c592c1 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:43.616624 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c8bf2737-0487-4668-a363-22e790c592c1 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:43.617670 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c8bf2737-0487-4668-a363-22e790c592c1 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:43.618356 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c8bf2737-0487-4668-a363-22e790c592c1 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:43.635929 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-c8bf2737-0487-4668-a363-22e790c592c1 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] HTTP exception thrown: Instance 65449361-cc88-4caa-aeff-800337a2fbb0 could not be found. Apr 16 21:14:43.637121 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c8bf2737-0487-4668-a363-22e790c592c1 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Returning 404 to user: Instance 65449361-cc88-4caa-aeff-800337a2fbb0 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:14:43.638722 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c8bf2737-0487-4668-a363-22e790c592c1 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "DELETE /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0" status: 404 len: 111 microversion: 2.1 time: 0.035463 Apr 16 21:14:43.639852 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1108/2151] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:14:43 2022] DELETE /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:14:43.647657 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e449f682-913f-4a22-8f6d-fd857423a67b tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:43.649049 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e449f682-913f-4a22-8f6d-fd857423a67b tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 65449361-cc88-4caa-aeff-800337a2fbb0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:43.656429 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e449f682-913f-4a22-8f6d-fd857423a67b tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:43.657543 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e449f682-913f-4a22-8f6d-fd857423a67b tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:43.658951 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e449f682-913f-4a22-8f6d-fd857423a67b tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:43.659886 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e449f682-913f-4a22-8f6d-fd857423a67b tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:43.681510 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-e449f682-913f-4a22-8f6d-fd857423a67b tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] HTTP exception thrown: Instance 65449361-cc88-4caa-aeff-800337a2fbb0 could not be found. Apr 16 21:14:43.683267 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e449f682-913f-4a22-8f6d-fd857423a67b tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Returning 404 to user: Instance 65449361-cc88-4caa-aeff-800337a2fbb0 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:14:43.695169 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e449f682-913f-4a22-8f6d-fd857423a67b tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "GET /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0" status: 404 len: 111 microversion: 2.1 time: 0.042323 Apr 16 21:14:43.699983 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1109/2152] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:43 2022] GET /compute/v2.1/servers/65449361-cc88-4caa-aeff-800337a2fbb0 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:14:43.707139 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-49e79d2c-3e57-4a76-8f84-41f1b719701d tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '.version_select at 0x7fbb96c5a3a0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:43.751718 ncdv-master-1 devstack@n-api.service[137408]: DEBUG neutronclient.v2_0.client [None req-49e79d2c-3e57-4a76-8f84-41f1b719701d tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group cb029531-d330-497f-8889-338b10e719e3 does not exist", "detail": ""}} {{(pid=137408) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 16 21:14:43.753939 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.security_group_api [None req-49e79d2c-3e57-4a76-8f84-41f1b719701d tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Neutron security group cb029531-d330-497f-8889-338b10e719e3 not found {{(pid=137408) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 16 21:14:43.754590 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-49e79d2c-3e57-4a76-8f84-41f1b719701d tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] HTTP exception thrown: Security group cb029531-d330-497f-8889-338b10e719e3 does not exist Apr 16 21:14:43.754590 ncdv-master-1 devstack@n-api.service[137408]: Neutron server returns request_ids: ['req-8a653d00-0b0c-4985-8aea-5de9df81332b'] Apr 16 21:14:43.755734 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-49e79d2c-3e57-4a76-8f84-41f1b719701d tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Returning 404 to user: Security group cb029531-d330-497f-8889-338b10e719e3 does not exist Apr 16 21:14:43.755734 ncdv-master-1 devstack@n-api.service[137408]: Neutron server returns request_ids: ['req-8a653d00-0b0c-4985-8aea-5de9df81332b'] {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:14:43.756869 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-49e79d2c-3e57-4a76-8f84-41f1b719701d tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/cb029531-d330-497f-8889-338b10e719e3" status: 404 len: 194 microversion: 2.1 time: 0.055685 Apr 16 21:14:43.763656 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1110/2153] 10.222.0.20 () {58 vars in 1271 bytes} [Sat Apr 16 21:14:43 2022] DELETE /compute/v2.1/os-security-groups/cb029531-d330-497f-8889-338b10e719e3 => generated 194 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:14:43.779258 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f253823f-37ab-4a4a-86ea-88e3f54495ef tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '.version_select at 0x7fbb9ffd4a60>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:43.814240 ncdv-master-1 devstack@n-api.service[137408]: DEBUG neutronclient.v2_0.client [None req-f253823f-37ab-4a4a-86ea-88e3f54495ef tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group aa451634-4ebc-46a1-bd9e-410f66c22156 does not exist", "detail": ""}} {{(pid=137408) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 16 21:14:43.816094 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.security_group_api [None req-f253823f-37ab-4a4a-86ea-88e3f54495ef tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Neutron security group aa451634-4ebc-46a1-bd9e-410f66c22156 not found {{(pid=137408) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 16 21:14:43.817036 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-f253823f-37ab-4a4a-86ea-88e3f54495ef tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] HTTP exception thrown: Security group aa451634-4ebc-46a1-bd9e-410f66c22156 does not exist Apr 16 21:14:43.817036 ncdv-master-1 devstack@n-api.service[137408]: Neutron server returns request_ids: ['req-5b08e1a0-c088-4d4f-ab1c-1d4fe0564d3c'] Apr 16 21:14:43.817970 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f253823f-37ab-4a4a-86ea-88e3f54495ef tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Returning 404 to user: Security group aa451634-4ebc-46a1-bd9e-410f66c22156 does not exist Apr 16 21:14:43.817970 ncdv-master-1 devstack@n-api.service[137408]: Neutron server returns request_ids: ['req-5b08e1a0-c088-4d4f-ab1c-1d4fe0564d3c'] {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:14:43.819928 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f253823f-37ab-4a4a-86ea-88e3f54495ef tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/aa451634-4ebc-46a1-bd9e-410f66c22156" status: 404 len: 194 microversion: 2.1 time: 0.053565 Apr 16 21:14:43.820737 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1111/2154] 10.222.0.20 () {58 vars in 1271 bytes} [Sat Apr 16 21:14:43 2022] DELETE /compute/v2.1/os-security-groups/aa451634-4ebc-46a1-bd9e-410f66c22156 => generated 194 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:14:43.830821 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f43437a1-980b-47f1-a186-a05b7bbff69d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:43.832367 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f43437a1-980b-47f1-a186-a05b7bbff69d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:43.867523 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f43437a1-980b-47f1-a186-a05b7bbff69d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:43.871758 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f43437a1-980b-47f1-a186-a05b7bbff69d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:43.875255 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f43437a1-980b-47f1-a186-a05b7bbff69d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:43.879468 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f43437a1-980b-47f1-a186-a05b7bbff69d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:44.172157 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f43437a1-980b-47f1-a186-a05b7bbff69d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:44.192020 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f43437a1-980b-47f1-a186-a05b7bbff69d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:44.199563 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f43437a1-980b-47f1-a186-a05b7bbff69d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:44.200954 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f43437a1-980b-47f1-a186-a05b7bbff69d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1870 microversion: 2.32 time: 0.375692 Apr 16 21:14:44.209030 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1112/2155] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:43 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1870 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:14:44.210971 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2a738317-fd5c-44b9-817c-796d6306ea86 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '.version_select at 0x7fbb9ff8dd30>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:44.245958 ncdv-master-1 devstack@n-api.service[137408]: DEBUG neutronclient.v2_0.client [None req-2a738317-fd5c-44b9-817c-796d6306ea86 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c85e969c-7391-4467-af36-6d1d63595acc does not exist", "detail": ""}} {{(pid=137408) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 16 21:14:44.246583 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.security_group_api [None req-2a738317-fd5c-44b9-817c-796d6306ea86 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Neutron security group c85e969c-7391-4467-af36-6d1d63595acc not found {{(pid=137408) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 16 21:14:44.247112 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-2a738317-fd5c-44b9-817c-796d6306ea86 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] HTTP exception thrown: Security group c85e969c-7391-4467-af36-6d1d63595acc does not exist Apr 16 21:14:44.247112 ncdv-master-1 devstack@n-api.service[137408]: Neutron server returns request_ids: ['req-f15ee411-5cdb-41d9-af56-1ed598c856d7'] Apr 16 21:14:44.247782 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2a738317-fd5c-44b9-817c-796d6306ea86 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Returning 404 to user: Security group c85e969c-7391-4467-af36-6d1d63595acc does not exist Apr 16 21:14:44.247782 ncdv-master-1 devstack@n-api.service[137408]: Neutron server returns request_ids: ['req-f15ee411-5cdb-41d9-af56-1ed598c856d7'] {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:14:44.248685 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2a738317-fd5c-44b9-817c-796d6306ea86 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/c85e969c-7391-4467-af36-6d1d63595acc" status: 404 len: 194 microversion: 2.1 time: 0.042633 Apr 16 21:14:44.249257 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1113/2156] 10.222.0.20 () {58 vars in 1271 bytes} [Sat Apr 16 21:14:44 2022] DELETE /compute/v2.1/os-security-groups/c85e969c-7391-4467-af36-6d1d63595acc => generated 194 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:14:44.266163 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-129d8888-fddd-4ab7-9292-3cf3c5651361 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '.version_select at 0x7fbb9fe7b1f0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:44.295446 ncdv-master-1 devstack@n-api.service[137408]: DEBUG neutronclient.v2_0.client [None req-129d8888-fddd-4ab7-9292-3cf3c5651361 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2dca06f2-dc9f-4be6-bd47-c610f9f7731a does not exist", "detail": ""}} {{(pid=137408) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 16 21:14:44.297318 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.security_group_api [None req-129d8888-fddd-4ab7-9292-3cf3c5651361 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Neutron security group 2dca06f2-dc9f-4be6-bd47-c610f9f7731a not found {{(pid=137408) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 16 21:14:44.297318 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-129d8888-fddd-4ab7-9292-3cf3c5651361 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] HTTP exception thrown: Security group 2dca06f2-dc9f-4be6-bd47-c610f9f7731a does not exist Apr 16 21:14:44.297318 ncdv-master-1 devstack@n-api.service[137408]: Neutron server returns request_ids: ['req-8e36a70c-5af1-4ce7-8d5a-6d27007d9fc1'] Apr 16 21:14:44.304037 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-129d8888-fddd-4ab7-9292-3cf3c5651361 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Returning 404 to user: Security group 2dca06f2-dc9f-4be6-bd47-c610f9f7731a does not exist Apr 16 21:14:44.304037 ncdv-master-1 devstack@n-api.service[137408]: Neutron server returns request_ids: ['req-8e36a70c-5af1-4ce7-8d5a-6d27007d9fc1'] {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:14:44.304037 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-129d8888-fddd-4ab7-9292-3cf3c5651361 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/2dca06f2-dc9f-4be6-bd47-c610f9f7731a" status: 404 len: 194 microversion: 2.1 time: 0.041884 Apr 16 21:14:44.304037 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1114/2157] 10.222.0.20 () {58 vars in 1271 bytes} [Sat Apr 16 21:14:44 2022] DELETE /compute/v2.1/os-security-groups/2dca06f2-dc9f-4be6-bd47-c610f9f7731a => generated 194 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:14:44.310691 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bc31869a-8924-4e57-9cd2-427157b7547c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '.version_select at 0x7fbb9ff8ddc0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:44.337938 ncdv-master-1 devstack@n-api.service[137408]: DEBUG neutronclient.v2_0.client [None req-bc31869a-8924-4e57-9cd2-427157b7547c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ffaddd03-3213-4dbd-a7e6-f2f52d73f0c2 does not exist", "detail": ""}} {{(pid=137408) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 16 21:14:44.339256 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.security_group_api [None req-bc31869a-8924-4e57-9cd2-427157b7547c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Neutron security group ffaddd03-3213-4dbd-a7e6-f2f52d73f0c2 not found {{(pid=137408) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 16 21:14:44.339863 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-bc31869a-8924-4e57-9cd2-427157b7547c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] HTTP exception thrown: Security group ffaddd03-3213-4dbd-a7e6-f2f52d73f0c2 does not exist Apr 16 21:14:44.339863 ncdv-master-1 devstack@n-api.service[137408]: Neutron server returns request_ids: ['req-b10d03dc-6197-42b7-931a-4ca8b22bba2f'] Apr 16 21:14:44.340580 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bc31869a-8924-4e57-9cd2-427157b7547c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Returning 404 to user: Security group ffaddd03-3213-4dbd-a7e6-f2f52d73f0c2 does not exist Apr 16 21:14:44.340580 ncdv-master-1 devstack@n-api.service[137408]: Neutron server returns request_ids: ['req-b10d03dc-6197-42b7-931a-4ca8b22bba2f'] {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:14:44.341576 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-bc31869a-8924-4e57-9cd2-427157b7547c tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/ffaddd03-3213-4dbd-a7e6-f2f52d73f0c2" status: 404 len: 194 microversion: 2.1 time: 0.034937 Apr 16 21:14:44.342249 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1115/2158] 10.222.0.20 () {58 vars in 1271 bytes} [Sat Apr 16 21:14:44 2022] DELETE /compute/v2.1/os-security-groups/ffaddd03-3213-4dbd-a7e6-f2f52d73f0c2 => generated 194 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:14:44.350355 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0f9be4d7-e7ac-42c2-86ec-5428396c8542 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '.version_select at 0x7fbb96c5a3a0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:44.375249 ncdv-master-1 devstack@n-api.service[137408]: DEBUG neutronclient.v2_0.client [None req-0f9be4d7-e7ac-42c2-86ec-5428396c8542 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 27a230fc-be9d-4889-8a58-24a402effdaa does not exist", "detail": ""}} {{(pid=137408) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 16 21:14:44.375868 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.security_group_api [None req-0f9be4d7-e7ac-42c2-86ec-5428396c8542 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Neutron security group 27a230fc-be9d-4889-8a58-24a402effdaa not found {{(pid=137408) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 16 21:14:44.376439 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-0f9be4d7-e7ac-42c2-86ec-5428396c8542 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] HTTP exception thrown: Security group 27a230fc-be9d-4889-8a58-24a402effdaa does not exist Apr 16 21:14:44.376439 ncdv-master-1 devstack@n-api.service[137408]: Neutron server returns request_ids: ['req-2ed896ac-43fe-45bd-8858-5047453f0b35'] Apr 16 21:14:44.377241 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0f9be4d7-e7ac-42c2-86ec-5428396c8542 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Returning 404 to user: Security group 27a230fc-be9d-4889-8a58-24a402effdaa does not exist Apr 16 21:14:44.377241 ncdv-master-1 devstack@n-api.service[137408]: Neutron server returns request_ids: ['req-2ed896ac-43fe-45bd-8858-5047453f0b35'] {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:14:44.378379 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0f9be4d7-e7ac-42c2-86ec-5428396c8542 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/27a230fc-be9d-4889-8a58-24a402effdaa" status: 404 len: 194 microversion: 2.1 time: 0.031569 Apr 16 21:14:44.379136 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1116/2159] 10.222.0.20 () {58 vars in 1271 bytes} [Sat Apr 16 21:14:44 2022] DELETE /compute/v2.1/os-security-groups/27a230fc-be9d-4889-8a58-24a402effdaa => generated 194 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:14:44.387696 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5fe25447-a0a3-46f3-a2b5-35cfdae4dbaa tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:44.388353 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5fe25447-a0a3-46f3-a2b5-35cfdae4dbaa tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:44.394455 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5fe25447-a0a3-46f3-a2b5-35cfdae4dbaa tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:44.394914 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5fe25447-a0a3-46f3-a2b5-35cfdae4dbaa tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:44.395703 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5fe25447-a0a3-46f3-a2b5-35cfdae4dbaa tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:44.396153 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5fe25447-a0a3-46f3-a2b5-35cfdae4dbaa tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:44.534844 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5fe25447-a0a3-46f3-a2b5-35cfdae4dbaa tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:44.542776 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5fe25447-a0a3-46f3-a2b5-35cfdae4dbaa tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1308 microversion: 2.1 time: 0.159996 Apr 16 21:14:44.543322 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1117/2160] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:44 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1308 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:44.547706 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-77d1a667-51f7-4cc4-8846-38ae42c2bf8f tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:44.548218 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-77d1a667-51f7-4cc4-8846-38ae42c2bf8f tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 3f88efa6-8671-4565-aa09-bfbafc6ec242] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:44.553783 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-77d1a667-51f7-4cc4-8846-38ae42c2bf8f tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:44.554249 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-77d1a667-51f7-4cc4-8846-38ae42c2bf8f tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:44.555017 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-77d1a667-51f7-4cc4-8846-38ae42c2bf8f tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:44.555456 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-77d1a667-51f7-4cc4-8846-38ae42c2bf8f tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:44.582279 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-77d1a667-51f7-4cc4-8846-38ae42c2bf8f tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 3f88efa6-8671-4565-aa09-bfbafc6ec242] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:14:45.124998 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-77d1a667-51f7-4cc4-8846-38ae42c2bf8f tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3f88efa6-8671-4565-aa09-bfbafc6ec242" status: 204 len: 0 microversion: 2.1 time: 0.580409 Apr 16 21:14:45.126299 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1118/2161] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:14:44 2022] DELETE /compute/v2.1/servers/3f88efa6-8671-4565-aa09-bfbafc6ec242 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:14:45.131814 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-63dbb4ce-788f-4fb5-a2b1-1814f6350447 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:45.132555 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-63dbb4ce-788f-4fb5-a2b1-1814f6350447 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:45.138626 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-63dbb4ce-788f-4fb5-a2b1-1814f6350447 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:45.139105 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-63dbb4ce-788f-4fb5-a2b1-1814f6350447 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:45.139918 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-63dbb4ce-788f-4fb5-a2b1-1814f6350447 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:45.140396 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-63dbb4ce-788f-4fb5-a2b1-1814f6350447 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:45.331172 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-63dbb4ce-788f-4fb5-a2b1-1814f6350447 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:45.339334 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-63dbb4ce-788f-4fb5-a2b1-1814f6350447 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 200 len: 1313 microversion: 2.1 time: 0.211099 Apr 16 21:14:45.339909 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1119/2162] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:45 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:45.345079 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f9639344-8969-4653-80d3-df2f479600ce tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:45.349061 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f9639344-8969-4653-80d3-df2f479600ce tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 3f88efa6-8671-4565-aa09-bfbafc6ec242] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:45.351825 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9639344-8969-4653-80d3-df2f479600ce tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:45.352382 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9639344-8969-4653-80d3-df2f479600ce tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:45.353208 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9639344-8969-4653-80d3-df2f479600ce tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:45.353657 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9639344-8969-4653-80d3-df2f479600ce tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:45.378002 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6863ef45-c6e5-46e7-864c-6b6a27a1a7d9 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.376683 Apr 16 21:14:45.378002 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1044/2163] 10.222.0.20 () {60 vars in 1169 bytes} [Sat Apr 16 21:14:41 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:14:45.378002 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d61a52cc-0991-4f1c-a75c-a99cd7cd5fe4 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:45.378002 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d61a52cc-0991-4f1c-a75c-a99cd7cd5fe4 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:45.391259 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d61a52cc-0991-4f1c-a75c-a99cd7cd5fe4 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:45.391865 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d61a52cc-0991-4f1c-a75c-a99cd7cd5fe4 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:45.392646 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d61a52cc-0991-4f1c-a75c-a99cd7cd5fe4 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:45.393098 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d61a52cc-0991-4f1c-a75c-a99cd7cd5fe4 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:45.535471 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f9639344-8969-4653-80d3-df2f479600ce tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87e2c1601764f23ac7530b6ad66b3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe50d9e0841749f094948101efdc3d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:45.544314 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f9639344-8969-4653-80d3-df2f479600ce tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "GET /compute/v2.1/servers/3f88efa6-8671-4565-aa09-bfbafc6ec242" status: 200 len: 1648 microversion: 2.1 time: 0.203347 Apr 16 21:14:45.544906 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1120/2164] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:45 2022] GET /compute/v2.1/servers/3f88efa6-8671-4565-aa09-bfbafc6ec242 => generated 1648 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:45.564831 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c6c86904-6033-4d01-9d66-a62ac222eb4e tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.1.88"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:45.564831 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c6c86904-6033-4d01-9d66-a62ac222eb4e tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] [instance: 18e64ceb-9630-44a6-a82c-b8a53099b88f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:45.571836 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c6c86904-6033-4d01-9d66-a62ac222eb4e tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:45.572338 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c6c86904-6033-4d01-9d66-a62ac222eb4e tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:45.576472 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c6c86904-6033-4d01-9d66-a62ac222eb4e tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:45.576930 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c6c86904-6033-4d01-9d66-a62ac222eb4e tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:45.605133 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d61a52cc-0991-4f1c-a75c-a99cd7cd5fe4 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:45.610386 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c6c86904-6033-4d01-9d66-a62ac222eb4e tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Acquired lock "refresh_cache-18e64ceb-9630-44a6-a82c-b8a53099b88f" {{(pid=137408) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 16 21:14:45.616065 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d61a52cc-0991-4f1c-a75c-a99cd7cd5fe4 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:45.617823 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d61a52cc-0991-4f1c-a75c-a99cd7cd5fe4 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:45.619107 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d61a52cc-0991-4f1c-a75c-a99cd7cd5fe4 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1870 microversion: 2.32 time: 0.245663 Apr 16 21:14:45.622266 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1045/2165] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:45 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1870 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:14:45.625650 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-682b150e-c41d-4154-9953-79b2dec7c493 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:45.626592 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-682b150e-c41d-4154-9953-79b2dec7c493 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:45.633380 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-682b150e-c41d-4154-9953-79b2dec7c493 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:45.634192 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-682b150e-c41d-4154-9953-79b2dec7c493 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:45.635098 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-682b150e-c41d-4154-9953-79b2dec7c493 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:45.636193 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-682b150e-c41d-4154-9953-79b2dec7c493 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:45.792913 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-682b150e-c41d-4154-9953-79b2dec7c493 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:45.800424 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-682b150e-c41d-4154-9953-79b2dec7c493 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1308 microversion: 2.1 time: 0.178872 Apr 16 21:14:45.802005 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1046/2166] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:45 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1308 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:46.017534 ncdv-master-1 devstack@n-api.service[137408]: DEBUG neutronclient.v2_0.client [None req-c6c86904-6033-4d01-9d66-a62ac222eb4e tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.35.1.88 (5bf1fb2f-80c2-4f1b-a24e-e8060137dc0f) with port abe53b48-55b2-448c-aef2-8b7b60e401a5 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network f901fd27-41ce-4b49-9132-e60168d0f679.", "detail": ""}} {{(pid=137408) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 16 21:14:46.018167 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c6c86904-6033-4d01-9d66-a62ac222eb4e tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Releasing lock "refresh_cache-18e64ceb-9630-44a6-a82c-b8a53099b88f" {{(pid=137408) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 16 21:14:46.018734 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-c6c86904-6033-4d01-9d66-a62ac222eb4e tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] HTTP exception thrown: Cannot associate floating IP 172.35.1.88 (5bf1fb2f-80c2-4f1b-a24e-e8060137dc0f) with port abe53b48-55b2-448c-aef2-8b7b60e401a5 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network f901fd27-41ce-4b49-9132-e60168d0f679. Apr 16 21:14:46.018734 ncdv-master-1 devstack@n-api.service[137408]: Neutron server returns request_ids: ['req-3db0636d-7daa-41fe-beac-d70e427af116'] Apr 16 21:14:46.019355 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c6c86904-6033-4d01-9d66-a62ac222eb4e tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Returning 400 to user: Cannot associate floating IP 172.35.1.88 (5bf1fb2f-80c2-4f1b-a24e-e8060137dc0f) with port abe53b48-55b2-448c-aef2-8b7b60e401a5 using fixed IP 172.20.0.14, as that fixed IP already has a floating IP on external network f901fd27-41ce-4b49-9132-e60168d0f679. Apr 16 21:14:46.019355 ncdv-master-1 devstack@n-api.service[137408]: Neutron server returns request_ids: ['req-3db0636d-7daa-41fe-beac-d70e427af116'] {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:14:46.020221 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c6c86904-6033-4d01-9d66-a62ac222eb4e tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] 10.222.0.20 "POST /compute/v2.1/servers/18e64ceb-9630-44a6-a82c-b8a53099b88f/action" status: 400 len: 381 microversion: 2.1 time: 0.462632 Apr 16 21:14:46.020821 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1121/2167] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:14:45 2022] POST /compute/v2.1/servers/18e64ceb-9630-44a6-a82c-b8a53099b88f/action => generated 381 bytes in 475 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:14:46.029793 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0006632a-86a1-4889-9c65-f3723a923dad tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Calling method '.version_select at 0x7fbb9fea14c0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:46.356562 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-75a7f3db-bb9d-479a-9422-acc30d94e0e5 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:46.359377 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-75a7f3db-bb9d-479a-9422-acc30d94e0e5 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:46.366216 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-75a7f3db-bb9d-479a-9422-acc30d94e0e5 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:46.366680 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-75a7f3db-bb9d-479a-9422-acc30d94e0e5 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:46.367958 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-75a7f3db-bb9d-479a-9422-acc30d94e0e5 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:46.368984 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-75a7f3db-bb9d-479a-9422-acc30d94e0e5 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:46.557694 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-75a7f3db-bb9d-479a-9422-acc30d94e0e5 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:46.565820 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-75a7f3db-bb9d-479a-9422-acc30d94e0e5 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 200 len: 1313 microversion: 2.1 time: 0.213459 Apr 16 21:14:46.566386 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1122/2168] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:46 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:14:46.571169 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5668dba5-1c6a-4577-9cc7-1ace11b0cd80 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:46.571723 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5668dba5-1c6a-4577-9cc7-1ace11b0cd80 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:46.578301 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5668dba5-1c6a-4577-9cc7-1ace11b0cd80 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:46.578763 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5668dba5-1c6a-4577-9cc7-1ace11b0cd80 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:46.579577 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5668dba5-1c6a-4577-9cc7-1ace11b0cd80 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:46.580311 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5668dba5-1c6a-4577-9cc7-1ace11b0cd80 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:46.804455 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5668dba5-1c6a-4577-9cc7-1ace11b0cd80 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:46.812318 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5668dba5-1c6a-4577-9cc7-1ace11b0cd80 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1683 microversion: 2.1 time: 0.244919 Apr 16 21:14:46.812990 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1123/2169] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:46 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1683 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:46.817784 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b98d2480-c143-4b86-8756-2a154700fff8 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:46.818400 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b98d2480-c143-4b86-8756-2a154700fff8 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 3f88efa6-8671-4565-aa09-bfbafc6ec242] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:46.824019 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b98d2480-c143-4b86-8756-2a154700fff8 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:46.824519 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b98d2480-c143-4b86-8756-2a154700fff8 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:46.825306 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b98d2480-c143-4b86-8756-2a154700fff8 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:46.825782 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b98d2480-c143-4b86-8756-2a154700fff8 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:46.926583 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0006632a-86a1-4889-9c65-f3723a923dad tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/5bf1fb2f-80c2-4f1b-a24e-e8060137dc0f" status: 202 len: 0 microversion: 2.1 time: 0.901160 Apr 16 21:14:46.927365 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1047/2170] 10.222.0.20 () {58 vars in 1262 bytes} [Sat Apr 16 21:14:46 2022] DELETE /compute/v2.1/os-floating-ips/5bf1fb2f-80c2-4f1b-a24e-e8060137dc0f => generated 0 bytes in 903 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:14:46.932495 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d6d37b74-14a5-4630-84ce-b06a7e76b3c6 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:46.933335 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d6d37b74-14a5-4630-84ce-b06a7e76b3c6 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:46.939847 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d6d37b74-14a5-4630-84ce-b06a7e76b3c6 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:46.940416 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d6d37b74-14a5-4630-84ce-b06a7e76b3c6 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:46.941207 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d6d37b74-14a5-4630-84ce-b06a7e76b3c6 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:46.941779 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d6d37b74-14a5-4630-84ce-b06a7e76b3c6 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:46.981011 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b98d2480-c143-4b86-8756-2a154700fff8 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87e2c1601764f23ac7530b6ad66b3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe50d9e0841749f094948101efdc3d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:46.991889 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b98d2480-c143-4b86-8756-2a154700fff8 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "GET /compute/v2.1/servers/3f88efa6-8671-4565-aa09-bfbafc6ec242" status: 200 len: 1648 microversion: 2.1 time: 0.177608 Apr 16 21:14:46.999970 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1124/2171] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:46 2022] GET /compute/v2.1/servers/3f88efa6-8671-4565-aa09-bfbafc6ec242 => generated 1648 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:46.999970 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e99d7a7a-2b4e-4cac-a7fa-665ba0bf165c tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:46.999970 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e99d7a7a-2b4e-4cac-a7fa-665ba0bf165c tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:47.005954 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e99d7a7a-2b4e-4cac-a7fa-665ba0bf165c tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:47.009416 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e99d7a7a-2b4e-4cac-a7fa-665ba0bf165c tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:47.009416 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e99d7a7a-2b4e-4cac-a7fa-665ba0bf165c tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:47.009416 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e99d7a7a-2b4e-4cac-a7fa-665ba0bf165c tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:47.136261 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d6d37b74-14a5-4630-84ce-b06a7e76b3c6 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:47.145600 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d6d37b74-14a5-4630-84ce-b06a7e76b3c6 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:47.147144 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d6d37b74-14a5-4630-84ce-b06a7e76b3c6 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:47.148353 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d6d37b74-14a5-4630-84ce-b06a7e76b3c6 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1870 microversion: 2.32 time: 0.219726 Apr 16 21:14:47.148920 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1048/2172] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:46 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1870 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:14:47.154615 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e99d7a7a-2b4e-4cac-a7fa-665ba0bf165c tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:47.154929 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bfc317fc-6419-43f7-b66f-30b9e73eb7e6 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Action: 'action', calling method: .version_select at 0x7fbb9d0b1550>, body: {"removeFloatingIp": {"address": "172.35.1.76"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:47.162162 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e99d7a7a-2b4e-4cac-a7fa-665ba0bf165c tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1308 microversion: 2.1 time: 0.167916 Apr 16 21:14:47.162768 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1125/2173] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:46 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1308 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:47.305630 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bfc317fc-6419-43f7-b66f-30b9e73eb7e6 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] [instance: 18e64ceb-9630-44a6-a82c-b8a53099b88f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:47.312010 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bfc317fc-6419-43f7-b66f-30b9e73eb7e6 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:47.312527 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bfc317fc-6419-43f7-b66f-30b9e73eb7e6 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:47.313331 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bfc317fc-6419-43f7-b66f-30b9e73eb7e6 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:47.313797 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bfc317fc-6419-43f7-b66f-30b9e73eb7e6 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:47.573954 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bfc317fc-6419-43f7-b66f-30b9e73eb7e6 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Acquired lock "refresh_cache-18e64ceb-9630-44a6-a82c-b8a53099b88f" {{(pid=137409) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 16 21:14:47.582747 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-58b7ea21-e3b3-462e-8bd6-0e9a9cc733db tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:47.583376 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-58b7ea21-e3b3-462e-8bd6-0e9a9cc733db tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:47.590015 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58b7ea21-e3b3-462e-8bd6-0e9a9cc733db tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:47.590472 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58b7ea21-e3b3-462e-8bd6-0e9a9cc733db tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:47.591319 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58b7ea21-e3b3-462e-8bd6-0e9a9cc733db tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:47.591760 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58b7ea21-e3b3-462e-8bd6-0e9a9cc733db tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:47.726515 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-58b7ea21-e3b3-462e-8bd6-0e9a9cc733db tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:47.735226 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-58b7ea21-e3b3-462e-8bd6-0e9a9cc733db tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 200 len: 1313 microversion: 2.1 time: 0.156322 Apr 16 21:14:47.736003 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1126/2174] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:47 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:14:47.830186 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7cfca097-df3e-493b-9346-046e04e49785 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:47.830821 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7cfca097-df3e-493b-9346-046e04e49785 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:47.837547 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7cfca097-df3e-493b-9346-046e04e49785 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:47.838051 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7cfca097-df3e-493b-9346-046e04e49785 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:47.838888 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7cfca097-df3e-493b-9346-046e04e49785 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:47.839417 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7cfca097-df3e-493b-9346-046e04e49785 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:47.993447 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7cfca097-df3e-493b-9346-046e04e49785 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:48.002531 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7cfca097-df3e-493b-9346-046e04e49785 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1683 microversion: 2.1 time: 0.176301 Apr 16 21:14:48.003235 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1127/2175] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:47 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1683 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:14:48.007752 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-03044dfd-6415-4713-b406-be4fba602353 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:48.008420 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-03044dfd-6415-4713-b406-be4fba602353 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 3f88efa6-8671-4565-aa09-bfbafc6ec242] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:48.022150 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-03044dfd-6415-4713-b406-be4fba602353 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:48.022150 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-03044dfd-6415-4713-b406-be4fba602353 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:48.023187 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-03044dfd-6415-4713-b406-be4fba602353 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:48.023732 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-03044dfd-6415-4713-b406-be4fba602353 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:48.348605 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-03044dfd-6415-4713-b406-be4fba602353 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87e2c1601764f23ac7530b6ad66b3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe50d9e0841749f094948101efdc3d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:48.360767 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-03044dfd-6415-4713-b406-be4fba602353 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "GET /compute/v2.1/servers/3f88efa6-8671-4565-aa09-bfbafc6ec242" status: 200 len: 1648 microversion: 2.1 time: 0.356325 Apr 16 21:14:48.371953 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1128/2176] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:48 2022] GET /compute/v2.1/servers/3f88efa6-8671-4565-aa09-bfbafc6ec242 => generated 1648 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:48.389650 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-67d473c4-fd46-441c-b81d-352cd283da6a tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:48.390580 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-67d473c4-fd46-441c-b81d-352cd283da6a tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:48.397134 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-67d473c4-fd46-441c-b81d-352cd283da6a tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:48.397591 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-67d473c4-fd46-441c-b81d-352cd283da6a tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:48.398387 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-67d473c4-fd46-441c-b81d-352cd283da6a tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:48.398833 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-67d473c4-fd46-441c-b81d-352cd283da6a tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:48.574931 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-bfc317fc-6419-43f7-b66f-30b9e73eb7e6 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] [instance: 18e64ceb-9630-44a6-a82c-b8a53099b88f] Building network info cache for instance {{(pid=137409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Apr 16 21:14:48.725447 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-67d473c4-fd46-441c-b81d-352cd283da6a tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:48.736073 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-67d473c4-fd46-441c-b81d-352cd283da6a tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:48.738140 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-67d473c4-fd46-441c-b81d-352cd283da6a tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:48.749829 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-67d473c4-fd46-441c-b81d-352cd283da6a tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1870 microversion: 2.32 time: 0.375042 Apr 16 21:14:48.749829 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1129/2177] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:48 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1870 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:14:48.754755 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-0ab77575-b92b-449a-a3f0-7f69c5144eec req-5beacd04-392b-4cb9-a47f-72883782d1d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0602327-eafa-416f-8114-3411e37e2eef", "name": "network-vif-plugged", "status": "completed", "tag": "0e4ce80e-dded-45a4-8cad-59e6b3b64323"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:48.784031 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-0ab77575-b92b-449a-a3f0-7f69c5144eec req-5beacd04-392b-4cb9-a47f-72883782d1d6 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:48.784609 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-0ab77575-b92b-449a-a3f0-7f69c5144eec req-5beacd04-392b-4cb9-a47f-72883782d1d6 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:48.801618 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-0ab77575-b92b-449a-a3f0-7f69c5144eec req-5beacd04-392b-4cb9-a47f-72883782d1d6 service nova] Creating event network-vif-plugged:0e4ce80e-dded-45a4-8cad-59e6b3b64323 for instance a0602327-eafa-416f-8114-3411e37e2eef on nch1-master-1 Apr 16 21:14:48.806656 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-0ab77575-b92b-449a-a3f0-7f69c5144eec req-5beacd04-392b-4cb9-a47f-72883782d1d6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056295 Apr 16 21:14:48.811171 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1130/2178] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:14:48.813711 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6c5da7ff-2967-4829-a841-0ddd4b46cd53 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:48.814549 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6c5da7ff-2967-4829-a841-0ddd4b46cd53 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:48.830213 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6c5da7ff-2967-4829-a841-0ddd4b46cd53 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:48.830680 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6c5da7ff-2967-4829-a841-0ddd4b46cd53 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:48.831830 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6c5da7ff-2967-4829-a841-0ddd4b46cd53 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:48.831961 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6c5da7ff-2967-4829-a841-0ddd4b46cd53 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:49.016555 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6c5da7ff-2967-4829-a841-0ddd4b46cd53 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:49.027853 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6c5da7ff-2967-4829-a841-0ddd4b46cd53 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1308 microversion: 2.1 time: 0.218126 Apr 16 21:14:49.036842 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1131/2179] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:48 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1308 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:49.044514 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-a4c5bdc1-f655-47df-b508-22eceafb34c9 req-781908bb-b5aa-4d1a-9a3b-b5b5fb144ce5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18e64ceb-9630-44a6-a82c-b8a53099b88f", "tag": "abe53b48-55b2-448c-aef2-8b7b60e401a5"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:49.054682 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-a4c5bdc1-f655-47df-b508-22eceafb34c9 req-781908bb-b5aa-4d1a-9a3b-b5b5fb144ce5 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:49.055141 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-a4c5bdc1-f655-47df-b508-22eceafb34c9 req-781908bb-b5aa-4d1a-9a3b-b5b5fb144ce5 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:49.070187 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-a4c5bdc1-f655-47df-b508-22eceafb34c9 req-781908bb-b5aa-4d1a-9a3b-b5b5fb144ce5 service nova] Creating event network-changed:abe53b48-55b2-448c-aef2-8b7b60e401a5 for instance 18e64ceb-9630-44a6-a82c-b8a53099b88f on nch1-master-1 Apr 16 21:14:49.077772 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-a4c5bdc1-f655-47df-b508-22eceafb34c9 req-781908bb-b5aa-4d1a-9a3b-b5b5fb144ce5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037861 Apr 16 21:14:49.078532 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1132/2180] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:14:49.083721 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-76e72278-30e5-42d9-9588-09e035fb74af tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:49.084885 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-76e72278-30e5-42d9-9588-09e035fb74af tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:49.091150 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-76e72278-30e5-42d9-9588-09e035fb74af tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:49.091618 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-76e72278-30e5-42d9-9588-09e035fb74af tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:49.092667 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-76e72278-30e5-42d9-9588-09e035fb74af tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:49.092920 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-76e72278-30e5-42d9-9588-09e035fb74af tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:49.257857 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-76e72278-30e5-42d9-9588-09e035fb74af tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:49.271593 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-76e72278-30e5-42d9-9588-09e035fb74af tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 200 len: 1313 microversion: 2.1 time: 0.191924 Apr 16 21:14:49.272238 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1133/2181] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:49 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:49.277350 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b1c50700-662b-4190-a88f-f19920b56a2e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:49.277981 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b1c50700-662b-4190-a88f-f19920b56a2e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:49.286376 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b1c50700-662b-4190-a88f-f19920b56a2e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:49.291486 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b1c50700-662b-4190-a88f-f19920b56a2e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:49.291486 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b1c50700-662b-4190-a88f-f19920b56a2e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:49.291486 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b1c50700-662b-4190-a88f-f19920b56a2e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:49.463938 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b1c50700-662b-4190-a88f-f19920b56a2e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:49.484476 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b1c50700-662b-4190-a88f-f19920b56a2e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.211105 Apr 16 21:14:49.502214 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1134/2182] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:49 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:49.508530 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f41d254d-2f96-4545-80a5-781c2a63a350 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:49.509287 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f41d254d-2f96-4545-80a5-781c2a63a350 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 3f88efa6-8671-4565-aa09-bfbafc6ec242] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:49.516517 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f41d254d-2f96-4545-80a5-781c2a63a350 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:49.516977 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f41d254d-2f96-4545-80a5-781c2a63a350 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:49.517781 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f41d254d-2f96-4545-80a5-781c2a63a350 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:49.518577 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f41d254d-2f96-4545-80a5-781c2a63a350 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:49.601785 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f41d254d-2f96-4545-80a5-781c2a63a350 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c87e2c1601764f23ac7530b6ad66b3fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe50d9e0841749f094948101efdc3d92', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:49.615538 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f41d254d-2f96-4545-80a5-781c2a63a350 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "GET /compute/v2.1/servers/3f88efa6-8671-4565-aa09-bfbafc6ec242" status: 200 len: 1469 microversion: 2.1 time: 0.112046 Apr 16 21:14:49.621245 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1135/2183] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:49 2022] GET /compute/v2.1/servers/3f88efa6-8671-4565-aa09-bfbafc6ec242 => generated 1469 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:49.629252 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-45b29913-8e36-4feb-96ed-726b9e1bc927 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-2116721556"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:49.631004 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-45b29913-8e36-4feb-96ed-726b9e1bc927 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:49.639570 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-45b29913-8e36-4feb-96ed-726b9e1bc927 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:49.640146 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-45b29913-8e36-4feb-96ed-726b9e1bc927 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:49.641142 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-45b29913-8e36-4feb-96ed-726b9e1bc927 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:49.641592 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-45b29913-8e36-4feb-96ed-726b9e1bc927 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:49.874021 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-bfc317fc-6419-43f7-b66f-30b9e73eb7e6 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] [instance: 18e64ceb-9630-44a6-a82c-b8a53099b88f] Updating instance_info_cache with network_info: [{"id": "abe53b48-55b2-448c-aef2-8b7b60e401a5", "address": "fa:16:3e:fe:48:43", "network": {"id": "a7e528bf-99b2-41b7-8807-aca3eac1e8d2", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1063806919-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "be0fd7025ca44244ae100b2b916ad1d8", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapabe53b48-55", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Apr 16 21:14:50.002297 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bfc317fc-6419-43f7-b66f-30b9e73eb7e6 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Releasing lock "refresh_cache-18e64ceb-9630-44a6-a82c-b8a53099b88f" {{(pid=137409) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 16 21:14:50.003284 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bfc317fc-6419-43f7-b66f-30b9e73eb7e6 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] 10.222.0.20 "POST /compute/v2.1/servers/18e64ceb-9630-44a6-a82c-b8a53099b88f/action" status: 202 len: 0 microversion: 2.1 time: 2.853424 Apr 16 21:14:50.004059 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1049/2184] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:14:47 2022] POST /compute/v2.1/servers/18e64ceb-9630-44a6-a82c-b8a53099b88f/action => generated 0 bytes in 2855 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Apr 16 21:14:50.009124 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3ecf553b-3393-4070-ac9f-a8f604a67051 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:50.009764 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3ecf553b-3393-4070-ac9f-a8f604a67051 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:50.017063 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3ecf553b-3393-4070-ac9f-a8f604a67051 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:50.017602 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3ecf553b-3393-4070-ac9f-a8f604a67051 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:50.018409 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3ecf553b-3393-4070-ac9f-a8f604a67051 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:50.018930 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3ecf553b-3393-4070-ac9f-a8f604a67051 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:50.310386 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-45b29913-8e36-4feb-96ed-726b9e1bc927 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "POST /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa/action" status: 202 len: 0 microversion: 2.1 time: 0.687616 Apr 16 21:14:50.314275 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1136/2185] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:14:49 2022] POST /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa/action => generated 0 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Apr 16 21:14:50.323469 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4d095542-75ff-4ce6-9be3-87a4900a0ed5 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Calling method '.version_select at 0x7fbb9fe7b1f0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:50.378674 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3ecf553b-3393-4070-ac9f-a8f604a67051 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:50.390858 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3ecf553b-3393-4070-ac9f-a8f604a67051 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:50.392805 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3ecf553b-3393-4070-ac9f-a8f604a67051 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:50.394214 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3ecf553b-3393-4070-ac9f-a8f604a67051 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1870 microversion: 2.32 time: 0.389109 Apr 16 21:14:50.395368 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1050/2186] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:50 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1870 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:14:50.411455 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7be2d7ba-4223-4145-8553-a22d5df5c176 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:50.412099 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7be2d7ba-4223-4145-8553-a22d5df5c176 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:50.420823 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7be2d7ba-4223-4145-8553-a22d5df5c176 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:50.423079 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7be2d7ba-4223-4145-8553-a22d5df5c176 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:50.423079 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7be2d7ba-4223-4145-8553-a22d5df5c176 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:50.423079 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7be2d7ba-4223-4145-8553-a22d5df5c176 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:50.755472 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7be2d7ba-4223-4145-8553-a22d5df5c176 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:50.764852 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7be2d7ba-4223-4145-8553-a22d5df5c176 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1308 microversion: 2.1 time: 0.368196 Apr 16 21:14:50.765449 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1051/2187] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:50 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1308 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:50.770718 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b8342485-ab10-4dd5-8864-3d4fbc0feea0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:50.771320 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b8342485-ab10-4dd5-8864-3d4fbc0feea0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:50.777315 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b8342485-ab10-4dd5-8864-3d4fbc0feea0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:50.777707 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b8342485-ab10-4dd5-8864-3d4fbc0feea0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:50.778730 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b8342485-ab10-4dd5-8864-3d4fbc0feea0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:50.779180 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b8342485-ab10-4dd5-8864-3d4fbc0feea0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:51.074598 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b8342485-ab10-4dd5-8864-3d4fbc0feea0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:51.082120 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b8342485-ab10-4dd5-8864-3d4fbc0feea0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 200 len: 1313 microversion: 2.1 time: 0.315414 Apr 16 21:14:51.082699 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1052/2188] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:50 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 1313 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:51.087422 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bc14b443-fbb4-4fd7-96ed-402f02594d87 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:51.087927 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bc14b443-fbb4-4fd7-96ed-402f02594d87 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:51.094819 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bc14b443-fbb4-4fd7-96ed-402f02594d87 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:51.095278 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bc14b443-fbb4-4fd7-96ed-402f02594d87 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:51.097248 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bc14b443-fbb4-4fd7-96ed-402f02594d87 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:51.097248 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bc14b443-fbb4-4fd7-96ed-402f02594d87 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:51.123226 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bc14b443-fbb4-4fd7-96ed-402f02594d87 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:14:51.252289 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4d095542-75ff-4ce6-9be3-87a4900a0ed5 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/f0ec0872-6a40-4e00-9007-2562b24dce30" status: 202 len: 0 microversion: 2.1 time: 0.939899 Apr 16 21:14:51.253225 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1137/2189] 10.222.0.20 () {58 vars in 1262 bytes} [Sat Apr 16 21:14:50 2022] DELETE /compute/v2.1/os-floating-ips/f0ec0872-6a40-4e00-9007-2562b24dce30 => generated 0 bytes in 942 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:14:51.258854 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3c6d58ef-c1ad-4bb0-801f-fc4a42570378 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:51.259971 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3c6d58ef-c1ad-4bb0-801f-fc4a42570378 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:51.271577 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3c6d58ef-c1ad-4bb0-801f-fc4a42570378 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:51.272441 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3c6d58ef-c1ad-4bb0-801f-fc4a42570378 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:51.273485 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3c6d58ef-c1ad-4bb0-801f-fc4a42570378 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:51.274291 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3c6d58ef-c1ad-4bb0-801f-fc4a42570378 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:51.416388 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3c6d58ef-c1ad-4bb0-801f-fc4a42570378 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:51.424164 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3c6d58ef-c1ad-4bb0-801f-fc4a42570378 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1680 microversion: 2.1 time: 0.169808 Apr 16 21:14:51.424770 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1138/2190] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:51 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1680 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:51.429684 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5b446c1f-03d2-4792-9f62-167498c1a000 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:51.430294 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5b446c1f-03d2-4792-9f62-167498c1a000 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] [instance: 3f88efa6-8671-4565-aa09-bfbafc6ec242] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:51.437335 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5b446c1f-03d2-4792-9f62-167498c1a000 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:51.437796 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5b446c1f-03d2-4792-9f62-167498c1a000 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:51.438589 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5b446c1f-03d2-4792-9f62-167498c1a000 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:51.439037 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5b446c1f-03d2-4792-9f62-167498c1a000 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:51.453566 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-5b446c1f-03d2-4792-9f62-167498c1a000 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] HTTP exception thrown: Instance 3f88efa6-8671-4565-aa09-bfbafc6ec242 could not be found. Apr 16 21:14:51.460670 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5b446c1f-03d2-4792-9f62-167498c1a000 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Returning 404 to user: Instance 3f88efa6-8671-4565-aa09-bfbafc6ec242 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:14:51.460670 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5b446c1f-03d2-4792-9f62-167498c1a000 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "GET /compute/v2.1/servers/3f88efa6-8671-4565-aa09-bfbafc6ec242" status: 404 len: 111 microversion: 2.1 time: 0.029259 Apr 16 21:14:51.460670 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1139/2191] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:51 2022] GET /compute/v2.1/servers/3f88efa6-8671-4565-aa09-bfbafc6ec242 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:14:51.460670 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-4bf24ec0-5928-434c-9817-2a7e382b3370 req-ff7d7451-65d2-4af5-85ec-e6ef563a6530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f88efa6-8671-4565-aa09-bfbafc6ec242", "name": "network-vif-deleted", "tag": "b97b89d8-fa8f-4e4a-ac51-14adc4d9a0d3"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:51.468224 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-4bf24ec0-5928-434c-9817-2a7e382b3370 req-ff7d7451-65d2-4af5-85ec-e6ef563a6530 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:51.468774 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-4bf24ec0-5928-434c-9817-2a7e382b3370 req-ff7d7451-65d2-4af5-85ec-e6ef563a6530 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:51.480119 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-4bf24ec0-5928-434c-9817-2a7e382b3370 req-ff7d7451-65d2-4af5-85ec-e6ef563a6530 service nova] Creating event network-vif-deleted:b97b89d8-fa8f-4e4a-ac51-14adc4d9a0d3 for instance 3f88efa6-8671-4565-aa09-bfbafc6ec242 on nch2-master-1 Apr 16 21:14:51.485137 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-4bf24ec0-5928-434c-9817-2a7e382b3370 req-ff7d7451-65d2-4af5-85ec-e6ef563a6530 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028546 Apr 16 21:14:51.485898 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1140/2192] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:14:51.490839 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-234d8785-6aae-4dbb-9067-c499ad548f2d tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:51.492091 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-234d8785-6aae-4dbb-9067-c499ad548f2d tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:14:51.492933 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-234d8785-6aae-4dbb-9067-c499ad548f2d tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] 10.222.0.20 "POST /compute/v2.1/servers/18e64ceb-9630-44a6-a82c-b8a53099b88f/action" status: 400 len: 142 microversion: 2.1 time: 0.006143 Apr 16 21:14:51.493446 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1141/2193] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:14:51 2022] POST /compute/v2.1/servers/18e64ceb-9630-44a6-a82c-b8a53099b88f/action => generated 142 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:14:51.498324 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e370365e-770f-46dd-8527-6370df2222e0 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:51.499083 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e370365e-770f-46dd-8527-6370df2222e0 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:51.506018 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e370365e-770f-46dd-8527-6370df2222e0 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:51.506483 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e370365e-770f-46dd-8527-6370df2222e0 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:51.507277 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e370365e-770f-46dd-8527-6370df2222e0 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:51.507727 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e370365e-770f-46dd-8527-6370df2222e0 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:51.534969 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bc14b443-fbb4-4fd7-96ed-402f02594d87 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 204 len: 0 microversion: 2.1 time: 0.450999 Apr 16 21:14:51.539175 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1053/2194] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:14:51 2022] DELETE /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:14:51.544558 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2b105d6c-a1d0-4b29-9ab2-6ce638c82152 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '.version_select at 0x7fbb9ff4b3a0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:51.713991 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e370365e-770f-46dd-8527-6370df2222e0 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:51.723220 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e370365e-770f-46dd-8527-6370df2222e0 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:51.724788 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e370365e-770f-46dd-8527-6370df2222e0 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:51.725961 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e370365e-770f-46dd-8527-6370df2222e0 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1870 microversion: 2.32 time: 0.231640 Apr 16 21:14:51.732362 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1142/2195] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:51 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1870 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:14:51.732362 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6ae6682a-050b-4863-a4e0-7473af10ef7d tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:51.733103 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6ae6682a-050b-4863-a4e0-7473af10ef7d tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] [instance: 18e64ceb-9630-44a6-a82c-b8a53099b88f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:51.739155 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6ae6682a-050b-4863-a4e0-7473af10ef7d tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:51.739852 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6ae6682a-050b-4863-a4e0-7473af10ef7d tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:51.740655 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6ae6682a-050b-4863-a4e0-7473af10ef7d tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:51.741099 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6ae6682a-050b-4863-a4e0-7473af10ef7d tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:51.766577 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6ae6682a-050b-4863-a4e0-7473af10ef7d tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Acquired lock "refresh_cache-18e64ceb-9630-44a6-a82c-b8a53099b88f" {{(pid=137408) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 16 21:14:51.878487 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6ae6682a-050b-4863-a4e0-7473af10ef7d tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Releasing lock "refresh_cache-18e64ceb-9630-44a6-a82c-b8a53099b88f" {{(pid=137408) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 16 21:14:51.879105 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-6ae6682a-050b-4863-a4e0-7473af10ef7d tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] HTTP exception thrown: floating IP not found Apr 16 21:14:51.879727 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6ae6682a-050b-4863-a4e0-7473af10ef7d tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Returning 404 to user: floating IP not found {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:14:51.880641 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6ae6682a-050b-4863-a4e0-7473af10ef7d tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] 10.222.0.20 "POST /compute/v2.1/servers/18e64ceb-9630-44a6-a82c-b8a53099b88f/action" status: 404 len: 67 microversion: 2.1 time: 0.152966 Apr 16 21:14:51.881256 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1143/2196] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:14:51 2022] POST /compute/v2.1/servers/18e64ceb-9630-44a6-a82c-b8a53099b88f/action => generated 67 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:14:51.886652 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e43cb412-8210-4d56-a0a1-5e935cb2b3aa tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:51.887282 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e43cb412-8210-4d56-a0a1-5e935cb2b3aa tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:51.893820 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e43cb412-8210-4d56-a0a1-5e935cb2b3aa tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:51.894290 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e43cb412-8210-4d56-a0a1-5e935cb2b3aa tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:51.895197 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e43cb412-8210-4d56-a0a1-5e935cb2b3aa tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:51.895657 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e43cb412-8210-4d56-a0a1-5e935cb2b3aa tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:51.937224 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2b105d6c-a1d0-4b29-9ab2-6ce638c82152 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/cc0980eb-3522-4c74-bc5f-db8b84d66c49" status: 202 len: 0 microversion: 2.1 time: 0.396738 Apr 16 21:14:51.938621 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1054/2197] 10.222.0.20 () {58 vars in 1271 bytes} [Sat Apr 16 21:14:51 2022] DELETE /compute/v2.1/os-security-groups/cc0980eb-3522-4c74-bc5f-db8b84d66c49 => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:14:51.945935 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-e086192b-a8f0-4875-bce8-82a64d9916cc req-2d88dd0e-c6d0-4378-a5b8-4a7fb91e027b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98ca4f4e-246a-449b-b9fd-e1c17e119faa", "name": "network-vif-unplugged", "status": "completed", "tag": "9bc5b971-3aa6-49d0-8b96-ab0e7cb12588"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:51.957547 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-e086192b-a8f0-4875-bce8-82a64d9916cc req-2d88dd0e-c6d0-4378-a5b8-4a7fb91e027b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:51.958514 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-e086192b-a8f0-4875-bce8-82a64d9916cc req-2d88dd0e-c6d0-4378-a5b8-4a7fb91e027b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:51.971632 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-e086192b-a8f0-4875-bce8-82a64d9916cc req-2d88dd0e-c6d0-4378-a5b8-4a7fb91e027b service nova] Creating event network-vif-unplugged:9bc5b971-3aa6-49d0-8b96-ab0e7cb12588 for instance 98ca4f4e-246a-449b-b9fd-e1c17e119faa on nch2-master-1 Apr 16 21:14:51.977818 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-e086192b-a8f0-4875-bce8-82a64d9916cc req-2d88dd0e-c6d0-4378-a5b8-4a7fb91e027b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037609 Apr 16 21:14:51.978505 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1055/2198] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:14:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:14:51.984548 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-02d94207-5249-4dc3-bfef-9a88bd74749f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:51.985250 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-02d94207-5249-4dc3-bfef-9a88bd74749f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:51.991913 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-02d94207-5249-4dc3-bfef-9a88bd74749f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:51.992269 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-02d94207-5249-4dc3-bfef-9a88bd74749f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:51.993255 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-02d94207-5249-4dc3-bfef-9a88bd74749f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:51.993888 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-02d94207-5249-4dc3-bfef-9a88bd74749f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:52.050758 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e43cb412-8210-4d56-a0a1-5e935cb2b3aa tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:52.058681 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e43cb412-8210-4d56-a0a1-5e935cb2b3aa tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1499 microversion: 2.1 time: 0.176198 Apr 16 21:14:52.059452 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1144/2199] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:51 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1499 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:52.069460 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-764a97e5-9a3b-4c77-b2db-1f8b09edcebd tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Action: 'action', calling method: .version_select at 0x7fbb9d2f6040>, body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:52.116240 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-764a97e5-9a3b-4c77-b2db-1f8b09edcebd tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Apr 16 21:14:52.116921 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-764a97e5-9a3b-4c77-b2db-1f8b09edcebd tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:14:52.117768 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-764a97e5-9a3b-4c77-b2db-1f8b09edcebd tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] 10.222.0.20 "POST /compute/v2.1/servers/18e64ceb-9630-44a6-a82c-b8a53099b88f/action" status: 404 len: 88 microversion: 2.1 time: 0.052308 Apr 16 21:14:52.118351 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1145/2200] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:14:52 2022] POST /compute/v2.1/servers/18e64ceb-9630-44a6-a82c-b8a53099b88f/action => generated 88 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:14:52.123292 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-95d67434-0d37-4785-b7e0-b6fe4c33eef9 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] Calling method '.version_select at 0x7fbb95c1fb80>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:52.166201 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-02d94207-5249-4dc3-bfef-9a88bd74749f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:52.174907 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-02d94207-5249-4dc3-bfef-9a88bd74749f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1308 microversion: 2.1 time: 0.194386 Apr 16 21:14:52.175617 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1056/2201] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:51 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1308 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:52.181477 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0647f3f9-c5b3-4615-a0d3-873619e34765 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:52.182436 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0647f3f9-c5b3-4615-a0d3-873619e34765 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:52.189126 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0647f3f9-c5b3-4615-a0d3-873619e34765 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:52.189706 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0647f3f9-c5b3-4615-a0d3-873619e34765 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:52.190571 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0647f3f9-c5b3-4615-a0d3-873619e34765 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:52.191248 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0647f3f9-c5b3-4615-a0d3-873619e34765 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:52.417726 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0647f3f9-c5b3-4615-a0d3-873619e34765 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:52.427783 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0647f3f9-c5b3-4615-a0d3-873619e34765 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 200 len: 1463 microversion: 2.1 time: 0.250498 Apr 16 21:14:52.435122 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1057/2202] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:52 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 1463 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:52.435122 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d7bd5673-81ec-469e-b2d0-f436910bea4b tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:52.435122 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d7bd5673-81ec-469e-b2d0-f436910bea4b tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] [instance: 18e64ceb-9630-44a6-a82c-b8a53099b88f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:52.442693 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d7bd5673-81ec-469e-b2d0-f436910bea4b tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:52.443175 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d7bd5673-81ec-469e-b2d0-f436910bea4b tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:52.443999 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d7bd5673-81ec-469e-b2d0-f436910bea4b tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:52.444481 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d7bd5673-81ec-469e-b2d0-f436910bea4b tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:52.473215 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d7bd5673-81ec-469e-b2d0-f436910bea4b tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] [instance: 18e64ceb-9630-44a6-a82c-b8a53099b88f] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:14:52.641768 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-95d67434-0d37-4785-b7e0-b6fe4c33eef9 tempest-SecurityGroupsTestJSON-1625354135 tempest-SecurityGroupsTestJSON-1625354135-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/dac9affa-3ddd-4873-99d7-c742d8e50a0d" status: 202 len: 0 microversion: 2.1 time: 0.522303 Apr 16 21:14:52.646046 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1146/2203] 10.222.0.20 () {58 vars in 1271 bytes} [Sat Apr 16 21:14:52 2022] DELETE /compute/v2.1/os-security-groups/dac9affa-3ddd-4873-99d7-c742d8e50a0d => generated 0 bytes in 523 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:14:52.646996 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4b356585-34a8-479c-85e5-a8e9b2e4bcab tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:52.647617 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4b356585-34a8-479c-85e5-a8e9b2e4bcab tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:52.653823 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4b356585-34a8-479c-85e5-a8e9b2e4bcab tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:52.654284 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4b356585-34a8-479c-85e5-a8e9b2e4bcab tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:52.655080 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4b356585-34a8-479c-85e5-a8e9b2e4bcab tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:52.655642 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4b356585-34a8-479c-85e5-a8e9b2e4bcab tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:52.799316 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d7bd5673-81ec-469e-b2d0-f436910bea4b tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] 10.222.0.20 "DELETE /compute/v2.1/servers/18e64ceb-9630-44a6-a82c-b8a53099b88f" status: 204 len: 0 microversion: 2.1 time: 0.368986 Apr 16 21:14:52.800018 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1058/2204] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:14:52 2022] DELETE /compute/v2.1/servers/18e64ceb-9630-44a6-a82c-b8a53099b88f => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:14:52.860074 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-66b363fb-bab7-4e07-aa21-abd20b2842db tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:52.861163 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-66b363fb-bab7-4e07-aa21-abd20b2842db tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:52.867512 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-66b363fb-bab7-4e07-aa21-abd20b2842db tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:52.868060 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-66b363fb-bab7-4e07-aa21-abd20b2842db tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:52.868933 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-66b363fb-bab7-4e07-aa21-abd20b2842db tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:52.869987 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-66b363fb-bab7-4e07-aa21-abd20b2842db tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:52.922815 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4b356585-34a8-479c-85e5-a8e9b2e4bcab tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:52.944853 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4b356585-34a8-479c-85e5-a8e9b2e4bcab tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1680 microversion: 2.1 time: 0.291171 Apr 16 21:14:52.944853 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1147/2205] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:52 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1680 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:52.944853 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1e109ee9-dfa4-41be-b822-55630ffe982c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:52.944853 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1e109ee9-dfa4-41be-b822-55630ffe982c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:52.950572 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1e109ee9-dfa4-41be-b822-55630ffe982c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:52.950968 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1e109ee9-dfa4-41be-b822-55630ffe982c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:52.951784 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1e109ee9-dfa4-41be-b822-55630ffe982c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:52.952251 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1e109ee9-dfa4-41be-b822-55630ffe982c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:53.174295 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1e109ee9-dfa4-41be-b822-55630ffe982c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:53.184563 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1e109ee9-dfa4-41be-b822-55630ffe982c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:53.186569 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1e109ee9-dfa4-41be-b822-55630ffe982c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:53.188090 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1e109ee9-dfa4-41be-b822-55630ffe982c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1870 microversion: 2.32 time: 0.252008 Apr 16 21:14:53.188695 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1148/2206] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:52 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1870 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:14:53.193449 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-26dac3dd-0972-4e52-9a2b-011ddcd55822 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:53.194066 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-26dac3dd-0972-4e52-9a2b-011ddcd55822 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] [instance: 18e64ceb-9630-44a6-a82c-b8a53099b88f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:53.200895 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-26dac3dd-0972-4e52-9a2b-011ddcd55822 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:53.201379 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-26dac3dd-0972-4e52-9a2b-011ddcd55822 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:53.202170 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-26dac3dd-0972-4e52-9a2b-011ddcd55822 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:53.202784 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-26dac3dd-0972-4e52-9a2b-011ddcd55822 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:53.327390 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-66b363fb-bab7-4e07-aa21-abd20b2842db tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 200 len: 1614 microversion: 2.1 time: 0.525919 Apr 16 21:14:53.328724 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1059/2207] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:52 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 1614 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:53.343658 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d5d271ef-3e89-457e-98f8-04bfe7e68ff6 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:53.345614 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d5d271ef-3e89-457e-98f8-04bfe7e68ff6 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:53.346172 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-26dac3dd-0972-4e52-9a2b-011ddcd55822 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b41363947d44c9be2bda9ed14cbcc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fd7025ca44244ae100b2b916ad1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:53.361870 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-26dac3dd-0972-4e52-9a2b-011ddcd55822 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] 10.222.0.20 "GET /compute/v2.1/servers/18e64ceb-9630-44a6-a82c-b8a53099b88f" status: 200 len: 1543 microversion: 2.1 time: 0.165343 Apr 16 21:14:53.362486 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d5d271ef-3e89-457e-98f8-04bfe7e68ff6 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:53.362757 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1149/2208] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:53 2022] GET /compute/v2.1/servers/18e64ceb-9630-44a6-a82c-b8a53099b88f => generated 1543 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:53.362854 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d5d271ef-3e89-457e-98f8-04bfe7e68ff6 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:53.362854 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d5d271ef-3e89-457e-98f8-04bfe7e68ff6 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:53.362854 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d5d271ef-3e89-457e-98f8-04bfe7e68ff6 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:53.363088 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cf65389a-7915-4801-abe8-61bc5d78f85a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:53.363088 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cf65389a-7915-4801-abe8-61bc5d78f85a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:53.368476 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cf65389a-7915-4801-abe8-61bc5d78f85a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:53.368941 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cf65389a-7915-4801-abe8-61bc5d78f85a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:53.370312 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cf65389a-7915-4801-abe8-61bc5d78f85a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:53.370827 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cf65389a-7915-4801-abe8-61bc5d78f85a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:53.450188 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d5d271ef-3e89-457e-98f8-04bfe7e68ff6 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:53.460582 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d5d271ef-3e89-457e-98f8-04bfe7e68ff6 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1457 microversion: 2.1 time: 0.130204 Apr 16 21:14:53.461377 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1060/2209] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:53 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1457 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:53.474103 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a2db4f0a-f315-4f5b-a38c-46b80d3319e1 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:53.474882 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a2db4f0a-f315-4f5b-a38c-46b80d3319e1 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:53.485339 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a2db4f0a-f315-4f5b-a38c-46b80d3319e1 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:53.485919 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a2db4f0a-f315-4f5b-a38c-46b80d3319e1 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:53.486820 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a2db4f0a-f315-4f5b-a38c-46b80d3319e1 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:53.487472 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a2db4f0a-f315-4f5b-a38c-46b80d3319e1 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:53.519849 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a2db4f0a-f315-4f5b-a38c-46b80d3319e1 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'ba1a0392e17d41ada25d424bcb33bfc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71cd46bc7fef45e58bd8582ba615acb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:53.520596 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a2db4f0a-f315-4f5b-a38c-46b80d3319e1 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] [instance: a0602327-eafa-416f-8114-3411e37e2eef] flavor_id is None. Assuming migration. {{(pid=137409) resize /opt/stack/nova/nova/compute/api.py:4140}} Apr 16 21:14:53.521104 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a2db4f0a-f315-4f5b-a38c-46b80d3319e1 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=137409) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 16 21:14:53.524195 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cf65389a-7915-4801-abe8-61bc5d78f85a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:53.532422 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cf65389a-7915-4801-abe8-61bc5d78f85a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1487 microversion: 2.1 time: 0.175257 Apr 16 21:14:53.533187 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1150/2210] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:53 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1487 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:53.537362 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-7ddb9c19-5758-4887-a59b-23106b28769f req-02ef69be-fb8c-433d-acbd-a74e3a279b19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d971969c-aa4b-4761-a632-23f88b833ec4", "name": "network-vif-deleted", "tag": "0e96d99c-8339-47c4-aadc-62a791ca4b9a"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:53.546152 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-7ddb9c19-5758-4887-a59b-23106b28769f req-02ef69be-fb8c-433d-acbd-a74e3a279b19 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:53.546614 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-7ddb9c19-5758-4887-a59b-23106b28769f req-02ef69be-fb8c-433d-acbd-a74e3a279b19 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:53.558600 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-7ddb9c19-5758-4887-a59b-23106b28769f req-02ef69be-fb8c-433d-acbd-a74e3a279b19 service nova] Creating event network-vif-deleted:0e96d99c-8339-47c4-aadc-62a791ca4b9a for instance d971969c-aa4b-4761-a632-23f88b833ec4 on nch1-master-1 Apr 16 21:14:53.563713 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-7ddb9c19-5758-4887-a59b-23106b28769f req-02ef69be-fb8c-433d-acbd-a74e3a279b19 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029595 Apr 16 21:14:53.564617 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1151/2211] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:14:53.571069 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-62ee3ba2-7c60-4d07-a9e2-7866e629b201 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:53.577263 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-62ee3ba2-7c60-4d07-a9e2-7866e629b201 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:53.577734 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-62ee3ba2-7c60-4d07-a9e2-7866e629b201 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:53.600804 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-62ee3ba2-7c60-4d07-a9e2-7866e629b201 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Going to try to stop instance {{(pid=137408) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 16 21:14:53.834510 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-62ee3ba2-7c60-4d07-a9e2-7866e629b201 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "POST /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef/action" status: 202 len: 0 microversion: 2.1 time: 0.268141 Apr 16 21:14:53.835172 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1152/2212] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:14:53 2022] POST /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:14:53.844771 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0f902223-4750-4dd8-85eb-8106d000029a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:53.845503 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0f902223-4750-4dd8-85eb-8106d000029a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:53.852056 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0f902223-4750-4dd8-85eb-8106d000029a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:53.852712 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0f902223-4750-4dd8-85eb-8106d000029a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:53.853492 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0f902223-4750-4dd8-85eb-8106d000029a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:53.854329 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0f902223-4750-4dd8-85eb-8106d000029a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:54.002937 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0f902223-4750-4dd8-85eb-8106d000029a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:54.010861 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0f902223-4750-4dd8-85eb-8106d000029a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1497 microversion: 2.1 time: 0.170370 Apr 16 21:14:54.011402 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1153/2213] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:53 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1497 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:14:54.016998 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6448169f-fb0c-4061-abf7-6aca190592a9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:54.016998 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6448169f-fb0c-4061-abf7-6aca190592a9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:54.022013 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6448169f-fb0c-4061-abf7-6aca190592a9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:54.022481 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6448169f-fb0c-4061-abf7-6aca190592a9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:54.023905 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6448169f-fb0c-4061-abf7-6aca190592a9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:54.023905 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6448169f-fb0c-4061-abf7-6aca190592a9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:54.070143 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a2db4f0a-f315-4f5b-a38c-46b80d3319e1 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef/action" status: 202 len: 0 microversion: 2.1 time: 0.604379 Apr 16 21:14:54.075572 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1061/2214] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:14:53 2022] POST /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef/action => generated 0 bytes in 611 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:14:54.085423 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-26f79dc6-0cba-447a-997b-2f8e355808c6 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:54.089081 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-26f79dc6-0cba-447a-997b-2f8e355808c6 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:54.104047 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-26f79dc6-0cba-447a-997b-2f8e355808c6 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:54.104776 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-26f79dc6-0cba-447a-997b-2f8e355808c6 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:54.106018 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-26f79dc6-0cba-447a-997b-2f8e355808c6 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:54.106469 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-26f79dc6-0cba-447a-997b-2f8e355808c6 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:54.187246 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6448169f-fb0c-4061-abf7-6aca190592a9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:54.195100 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6448169f-fb0c-4061-abf7-6aca190592a9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1680 microversion: 2.1 time: 0.182713 Apr 16 21:14:54.195677 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1154/2215] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:54 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1680 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:54.206339 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f216b4df-0635-4ef9-a788-aa03eb3b47e4 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:54.210047 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f216b4df-0635-4ef9-a788-aa03eb3b47e4 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:54.218893 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f216b4df-0635-4ef9-a788-aa03eb3b47e4 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:54.219609 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f216b4df-0635-4ef9-a788-aa03eb3b47e4 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:54.221084 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f216b4df-0635-4ef9-a788-aa03eb3b47e4 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:54.221829 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f216b4df-0635-4ef9-a788-aa03eb3b47e4 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:54.374500 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-26f79dc6-0cba-447a-997b-2f8e355808c6 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:54.392746 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-26f79dc6-0cba-447a-997b-2f8e355808c6 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 200 len: 1472 microversion: 2.1 time: 0.305059 Apr 16 21:14:54.395240 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1062/2216] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:54 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 1472 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:54.400198 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9e497e26-aff5-4303-b6bb-27316dd2a412 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:54.401318 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9e497e26-aff5-4303-b6bb-27316dd2a412 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] [instance: 18e64ceb-9630-44a6-a82c-b8a53099b88f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:54.413904 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9e497e26-aff5-4303-b6bb-27316dd2a412 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:54.414877 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9e497e26-aff5-4303-b6bb-27316dd2a412 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:54.416085 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9e497e26-aff5-4303-b6bb-27316dd2a412 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:54.417434 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9e497e26-aff5-4303-b6bb-27316dd2a412 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:54.489152 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f216b4df-0635-4ef9-a788-aa03eb3b47e4 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:54.501195 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f216b4df-0635-4ef9-a788-aa03eb3b47e4 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:54.501195 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f216b4df-0635-4ef9-a788-aa03eb3b47e4 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:54.502958 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f216b4df-0635-4ef9-a788-aa03eb3b47e4 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1870 microversion: 2.32 time: 0.300352 Apr 16 21:14:54.504097 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1155/2217] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:54 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1870 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:14:54.509416 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d04773b8-b1ff-4432-9369-65356fcff791 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:54.510225 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d04773b8-b1ff-4432-9369-65356fcff791 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:54.516501 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d04773b8-b1ff-4432-9369-65356fcff791 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:54.517311 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d04773b8-b1ff-4432-9369-65356fcff791 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:54.518052 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d04773b8-b1ff-4432-9369-65356fcff791 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:54.518629 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d04773b8-b1ff-4432-9369-65356fcff791 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:54.566519 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d04773b8-b1ff-4432-9369-65356fcff791 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:54.566973 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d04773b8-b1ff-4432-9369-65356fcff791 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:54.567435 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-d04773b8-b1ff-4432-9369-65356fcff791 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lazy-loading 'fault' on Instance uuid d971969c-aa4b-4761-a632-23f88b833ec4 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:14:54.626660 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d04773b8-b1ff-4432-9369-65356fcff791 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:54.636362 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d04773b8-b1ff-4432-9369-65356fcff791 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 200 len: 1300 microversion: 2.1 time: 0.130948 Apr 16 21:14:54.637502 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1156/2218] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:54 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 1300 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:54.867978 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9e497e26-aff5-4303-b6bb-27316dd2a412 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b41363947d44c9be2bda9ed14cbcc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fd7025ca44244ae100b2b916ad1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:54.879307 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9e497e26-aff5-4303-b6bb-27316dd2a412 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] 10.222.0.20 "GET /compute/v2.1/servers/18e64ceb-9630-44a6-a82c-b8a53099b88f" status: 200 len: 1543 microversion: 2.1 time: 0.482916 Apr 16 21:14:54.880740 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1063/2219] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:54 2022] GET /compute/v2.1/servers/18e64ceb-9630-44a6-a82c-b8a53099b88f => generated 1543 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:55.033454 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-791e2afe-e002-49f6-8a64-4b52a1a4ee0d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:55.033454 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-791e2afe-e002-49f6-8a64-4b52a1a4ee0d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:55.038401 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-791e2afe-e002-49f6-8a64-4b52a1a4ee0d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:55.038940 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-791e2afe-e002-49f6-8a64-4b52a1a4ee0d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:55.039822 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-791e2afe-e002-49f6-8a64-4b52a1a4ee0d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:55.040439 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-791e2afe-e002-49f6-8a64-4b52a1a4ee0d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:55.213162 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4647fc15-cd39-4125-ac4f-3825495b8cd1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:55.214114 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4647fc15-cd39-4125-ac4f-3825495b8cd1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:55.223090 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4647fc15-cd39-4125-ac4f-3825495b8cd1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:55.223545 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4647fc15-cd39-4125-ac4f-3825495b8cd1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:55.224896 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4647fc15-cd39-4125-ac4f-3825495b8cd1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:55.225727 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4647fc15-cd39-4125-ac4f-3825495b8cd1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:55.265567 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-791e2afe-e002-49f6-8a64-4b52a1a4ee0d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:55.278674 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-791e2afe-e002-49f6-8a64-4b52a1a4ee0d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1497 microversion: 2.1 time: 0.251649 Apr 16 21:14:55.278674 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1157/2220] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:55 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1497 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:55.391478 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4647fc15-cd39-4125-ac4f-3825495b8cd1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:55.399244 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4647fc15-cd39-4125-ac4f-3825495b8cd1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1688 microversion: 2.1 time: 0.190669 Apr 16 21:14:55.400784 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1064/2221] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:55 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1688 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:14:55.400906 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a497e3ce-28f4-4bcc-9d64-53cd616d4b0e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:55.401362 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a497e3ce-28f4-4bcc-9d64-53cd616d4b0e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:55.409741 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a497e3ce-28f4-4bcc-9d64-53cd616d4b0e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:55.410282 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a497e3ce-28f4-4bcc-9d64-53cd616d4b0e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:55.411216 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a497e3ce-28f4-4bcc-9d64-53cd616d4b0e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:55.411730 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a497e3ce-28f4-4bcc-9d64-53cd616d4b0e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:55.522068 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-18120c43-b276-4e62-a6d9-5505e8910ef7 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:55.522715 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-18120c43-b276-4e62-a6d9-5505e8910ef7 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:55.529879 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-18120c43-b276-4e62-a6d9-5505e8910ef7 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:55.530337 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-18120c43-b276-4e62-a6d9-5505e8910ef7 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:55.531359 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-18120c43-b276-4e62-a6d9-5505e8910ef7 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:55.532053 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-18120c43-b276-4e62-a6d9-5505e8910ef7 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:55.559571 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a497e3ce-28f4-4bcc-9d64-53cd616d4b0e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:55.567298 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a497e3ce-28f4-4bcc-9d64-53cd616d4b0e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 200 len: 1472 microversion: 2.1 time: 0.170950 Apr 16 21:14:55.567881 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1158/2222] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:55 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 1472 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:55.589311 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-0e8d48a8-1dcf-4e87-be82-ef98e61b837a req-004ba06b-92a1-4608-8058-e3e159a7bdf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18e64ceb-9630-44a6-a82c-b8a53099b88f", "name": "network-vif-deleted", "tag": "abe53b48-55b2-448c-aef2-8b7b60e401a5"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:55.600971 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-0e8d48a8-1dcf-4e87-be82-ef98e61b837a req-004ba06b-92a1-4608-8058-e3e159a7bdf9 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:55.601851 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-0e8d48a8-1dcf-4e87-be82-ef98e61b837a req-004ba06b-92a1-4608-8058-e3e159a7bdf9 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:55.617268 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-0e8d48a8-1dcf-4e87-be82-ef98e61b837a req-004ba06b-92a1-4608-8058-e3e159a7bdf9 service nova] Creating event network-vif-deleted:abe53b48-55b2-448c-aef2-8b7b60e401a5 for instance 18e64ceb-9630-44a6-a82c-b8a53099b88f on nch1-master-1 Apr 16 21:14:55.623522 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-0e8d48a8-1dcf-4e87-be82-ef98e61b837a req-004ba06b-92a1-4608-8058-e3e159a7bdf9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041828 Apr 16 21:14:55.625097 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1159/2223] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:14:55.657213 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cea6ed1a-2dcf-49c1-a461-41c4d9eec2da tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:55.658402 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cea6ed1a-2dcf-49c1-a461-41c4d9eec2da tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: d971969c-aa4b-4761-a632-23f88b833ec4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:55.678640 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cea6ed1a-2dcf-49c1-a461-41c4d9eec2da tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:55.682764 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cea6ed1a-2dcf-49c1-a461-41c4d9eec2da tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:55.682764 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cea6ed1a-2dcf-49c1-a461-41c4d9eec2da tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:55.685949 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cea6ed1a-2dcf-49c1-a461-41c4d9eec2da tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:55.705437 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-cea6ed1a-2dcf-49c1-a461-41c4d9eec2da tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] HTTP exception thrown: Instance d971969c-aa4b-4761-a632-23f88b833ec4 could not be found. Apr 16 21:14:55.706311 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cea6ed1a-2dcf-49c1-a461-41c4d9eec2da tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Returning 404 to user: Instance d971969c-aa4b-4761-a632-23f88b833ec4 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:14:55.707462 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cea6ed1a-2dcf-49c1-a461-41c4d9eec2da tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4" status: 404 len: 111 microversion: 2.1 time: 0.056932 Apr 16 21:14:55.708139 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1160/2224] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:55 2022] GET /compute/v2.1/servers/d971969c-aa4b-4761-a632-23f88b833ec4 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:14:55.718518 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-028852d8-e0cf-43f4-80bc-09e247b0dd98 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:55.719387 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-028852d8-e0cf-43f4-80bc-09e247b0dd98 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: bc3b9549-fb07-458b-84bf-3f1d36449e6e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:55.726845 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-028852d8-e0cf-43f4-80bc-09e247b0dd98 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:55.728008 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-028852d8-e0cf-43f4-80bc-09e247b0dd98 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:55.729651 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-028852d8-e0cf-43f4-80bc-09e247b0dd98 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:55.730360 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-028852d8-e0cf-43f4-80bc-09e247b0dd98 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:55.768397 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-18120c43-b276-4e62-a6d9-5505e8910ef7 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:55.785526 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-028852d8-e0cf-43f4-80bc-09e247b0dd98 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: bc3b9549-fb07-458b-84bf-3f1d36449e6e] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:14:55.801819 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-18120c43-b276-4e62-a6d9-5505e8910ef7 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:55.804067 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-18120c43-b276-4e62-a6d9-5505e8910ef7 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:55.805502 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-18120c43-b276-4e62-a6d9-5505e8910ef7 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1870 microversion: 2.32 time: 0.287446 Apr 16 21:14:55.806156 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1065/2225] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:55 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1870 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:14:55.898162 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2356ffc2-c80d-476e-8a29-45f290c160ab tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:55.899222 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2356ffc2-c80d-476e-8a29-45f290c160ab tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] [instance: 18e64ceb-9630-44a6-a82c-b8a53099b88f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:55.907994 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2356ffc2-c80d-476e-8a29-45f290c160ab tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:55.908479 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2356ffc2-c80d-476e-8a29-45f290c160ab tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:55.909744 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2356ffc2-c80d-476e-8a29-45f290c160ab tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:55.910190 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2356ffc2-c80d-476e-8a29-45f290c160ab tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:55.940880 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2356ffc2-c80d-476e-8a29-45f290c160ab tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:55.941349 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2356ffc2-c80d-476e-8a29-45f290c160ab tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:55.941809 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-2356ffc2-c80d-476e-8a29-45f290c160ab tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lazy-loading 'fault' on Instance uuid 18e64ceb-9630-44a6-a82c-b8a53099b88f {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:14:55.990042 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2356ffc2-c80d-476e-8a29-45f290c160ab tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '27b41363947d44c9be2bda9ed14cbcc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be0fd7025ca44244ae100b2b916ad1d8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:56.006206 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2356ffc2-c80d-476e-8a29-45f290c160ab tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] 10.222.0.20 "GET /compute/v2.1/servers/18e64ceb-9630-44a6-a82c-b8a53099b88f" status: 200 len: 1322 microversion: 2.1 time: 0.112315 Apr 16 21:14:56.007042 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1066/2226] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:55 2022] GET /compute/v2.1/servers/18e64ceb-9630-44a6-a82c-b8a53099b88f => generated 1322 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:56.197732 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-028852d8-e0cf-43f4-80bc-09e247b0dd98 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "DELETE /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e" status: 204 len: 0 microversion: 2.1 time: 0.484375 Apr 16 21:14:56.201897 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1161/2227] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:14:55 2022] DELETE /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 16 21:14:56.208308 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0f81a76d-9981-4856-8c60-32b5881d5b4a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:56.209057 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0f81a76d-9981-4856-8c60-32b5881d5b4a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: bc3b9549-fb07-458b-84bf-3f1d36449e6e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:56.217985 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0f81a76d-9981-4856-8c60-32b5881d5b4a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:56.218532 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0f81a76d-9981-4856-8c60-32b5881d5b4a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:56.219597 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0f81a76d-9981-4856-8c60-32b5881d5b4a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:56.220159 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0f81a76d-9981-4856-8c60-32b5881d5b4a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:56.294701 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a119da3a-f0c5-4cc1-ae90-b9dfd4fad7f0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:56.295430 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a119da3a-f0c5-4cc1-ae90-b9dfd4fad7f0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:56.304056 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a119da3a-f0c5-4cc1-ae90-b9dfd4fad7f0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:56.304555 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a119da3a-f0c5-4cc1-ae90-b9dfd4fad7f0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:56.306080 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a119da3a-f0c5-4cc1-ae90-b9dfd4fad7f0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:56.306530 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a119da3a-f0c5-4cc1-ae90-b9dfd4fad7f0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:56.364241 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0f81a76d-9981-4856-8c60-32b5881d5b4a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:56.372754 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0f81a76d-9981-4856-8c60-32b5881d5b4a tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e" status: 200 len: 1484 microversion: 2.1 time: 0.168967 Apr 16 21:14:56.379357 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1067/2228] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:56 2022] GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e => generated 1484 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:56.417963 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-560af71d-bf98-4f09-91ee-5c2b1162976e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:56.419405 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-560af71d-bf98-4f09-91ee-5c2b1162976e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:56.426183 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-560af71d-bf98-4f09-91ee-5c2b1162976e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:56.426690 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-560af71d-bf98-4f09-91ee-5c2b1162976e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:56.427535 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-560af71d-bf98-4f09-91ee-5c2b1162976e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:56.427952 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-560af71d-bf98-4f09-91ee-5c2b1162976e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:56.516064 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a119da3a-f0c5-4cc1-ae90-b9dfd4fad7f0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:56.524324 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a119da3a-f0c5-4cc1-ae90-b9dfd4fad7f0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1497 microversion: 2.1 time: 0.234688 Apr 16 21:14:56.526231 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1162/2229] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:56 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1497 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:14:56.584841 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6bf37e1b-620a-43a0-9d69-b5cf342438d2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:56.585465 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6bf37e1b-620a-43a0-9d69-b5cf342438d2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:56.591747 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-560af71d-bf98-4f09-91ee-5c2b1162976e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:56.592974 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6bf37e1b-620a-43a0-9d69-b5cf342438d2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:56.593693 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6bf37e1b-620a-43a0-9d69-b5cf342438d2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:56.594695 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6bf37e1b-620a-43a0-9d69-b5cf342438d2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:56.595140 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6bf37e1b-620a-43a0-9d69-b5cf342438d2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:56.599448 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-560af71d-bf98-4f09-91ee-5c2b1162976e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1688 microversion: 2.1 time: 0.186248 Apr 16 21:14:56.600106 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1068/2230] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:56 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1688 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:14:56.760585 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6bf37e1b-620a-43a0-9d69-b5cf342438d2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:56.777240 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6bf37e1b-620a-43a0-9d69-b5cf342438d2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 200 len: 1472 microversion: 2.1 time: 0.196330 Apr 16 21:14:56.778658 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1163/2231] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:56 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 1472 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:14:56.825764 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-898f0537-5e34-431c-94f5-72b77483eaab tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:56.826707 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-898f0537-5e34-431c-94f5-72b77483eaab tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:56.832980 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-898f0537-5e34-431c-94f5-72b77483eaab tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:56.833448 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-898f0537-5e34-431c-94f5-72b77483eaab tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:56.834237 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-898f0537-5e34-431c-94f5-72b77483eaab tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:56.834685 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-898f0537-5e34-431c-94f5-72b77483eaab tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:57.029961 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3bd0f119-c343-4761-95df-1cbc7d9846df tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:57.030829 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3bd0f119-c343-4761-95df-1cbc7d9846df tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] [instance: 18e64ceb-9630-44a6-a82c-b8a53099b88f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:57.037839 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3bd0f119-c343-4761-95df-1cbc7d9846df tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:57.038578 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3bd0f119-c343-4761-95df-1cbc7d9846df tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:57.039603 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3bd0f119-c343-4761-95df-1cbc7d9846df tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:57.040957 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3bd0f119-c343-4761-95df-1cbc7d9846df tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:57.058721 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-3bd0f119-c343-4761-95df-1cbc7d9846df tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] HTTP exception thrown: Instance 18e64ceb-9630-44a6-a82c-b8a53099b88f could not be found. Apr 16 21:14:57.060136 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3bd0f119-c343-4761-95df-1cbc7d9846df tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] Returning 404 to user: Instance 18e64ceb-9630-44a6-a82c-b8a53099b88f could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:14:57.061111 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3bd0f119-c343-4761-95df-1cbc7d9846df tempest-FloatingIPsAssociationNegativeTestJSON-1147306263 tempest-FloatingIPsAssociationNegativeTestJSON-1147306263-project] 10.222.0.20 "GET /compute/v2.1/servers/18e64ceb-9630-44a6-a82c-b8a53099b88f" status: 404 len: 111 microversion: 2.1 time: 0.036349 Apr 16 21:14:57.062123 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1164/2232] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:57 2022] GET /compute/v2.1/servers/18e64ceb-9630-44a6-a82c-b8a53099b88f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:14:57.164499 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-898f0537-5e34-431c-94f5-72b77483eaab tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:57.182860 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-898f0537-5e34-431c-94f5-72b77483eaab tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:57.185537 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-898f0537-5e34-431c-94f5-72b77483eaab tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:57.198232 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-898f0537-5e34-431c-94f5-72b77483eaab tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1870 microversion: 2.32 time: 0.365750 Apr 16 21:14:57.198232 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1069/2233] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:56 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1870 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:14:57.394330 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b8455e24-49e0-4886-be8e-83f9e9cd87f3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:57.395770 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b8455e24-49e0-4886-be8e-83f9e9cd87f3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: bc3b9549-fb07-458b-84bf-3f1d36449e6e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:57.409309 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b8455e24-49e0-4886-be8e-83f9e9cd87f3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:57.409930 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b8455e24-49e0-4886-be8e-83f9e9cd87f3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:57.411341 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b8455e24-49e0-4886-be8e-83f9e9cd87f3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:57.412751 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b8455e24-49e0-4886-be8e-83f9e9cd87f3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:57.498597 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b8455e24-49e0-4886-be8e-83f9e9cd87f3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:57.506237 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b8455e24-49e0-4886-be8e-83f9e9cd87f3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e" status: 200 len: 1442 microversion: 2.1 time: 0.119817 Apr 16 21:14:57.506877 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1165/2234] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:57 2022] GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e => generated 1442 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:57.545170 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-39fc0a66-7f94-4144-a395-948e22d5c0ec tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:57.545756 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-39fc0a66-7f94-4144-a395-948e22d5c0ec tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:57.552529 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-39fc0a66-7f94-4144-a395-948e22d5c0ec tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:57.552981 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-39fc0a66-7f94-4144-a395-948e22d5c0ec tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:57.554576 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-39fc0a66-7f94-4144-a395-948e22d5c0ec tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:57.555227 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-39fc0a66-7f94-4144-a395-948e22d5c0ec tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:57.617445 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7a5dfd20-4bbc-4e6e-93b4-b3d4849b6854 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:57.618373 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7a5dfd20-4bbc-4e6e-93b4-b3d4849b6854 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:57.625937 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7a5dfd20-4bbc-4e6e-93b4-b3d4849b6854 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:57.626677 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7a5dfd20-4bbc-4e6e-93b4-b3d4849b6854 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:57.627674 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7a5dfd20-4bbc-4e6e-93b4-b3d4849b6854 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:57.628718 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7a5dfd20-4bbc-4e6e-93b4-b3d4849b6854 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:57.800560 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7a5dfd20-4bbc-4e6e-93b4-b3d4849b6854 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:57.809738 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7a5dfd20-4bbc-4e6e-93b4-b3d4849b6854 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1688 microversion: 2.1 time: 0.195991 Apr 16 21:14:57.820921 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1166/2235] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:57 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1688 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:57.829593 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-4e8830ff-f0b4-4bbc-94db-d49f5b8f4fb0 req-1f5c6eb5-67b6-455c-a183-30d0be6e080e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc3b9549-fb07-458b-84bf-3f1d36449e6e", "name": "network-vif-deleted", "tag": "a34708cf-de0c-422b-ad52-0051f88b2bb4"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:57.840729 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-4e8830ff-f0b4-4bbc-94db-d49f5b8f4fb0 req-1f5c6eb5-67b6-455c-a183-30d0be6e080e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:57.841371 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-4e8830ff-f0b4-4bbc-94db-d49f5b8f4fb0 req-1f5c6eb5-67b6-455c-a183-30d0be6e080e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:57.856589 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-4e8830ff-f0b4-4bbc-94db-d49f5b8f4fb0 req-1f5c6eb5-67b6-455c-a183-30d0be6e080e service nova] Creating event network-vif-deleted:a34708cf-de0c-422b-ad52-0051f88b2bb4 for instance bc3b9549-fb07-458b-84bf-3f1d36449e6e on nch1-master-1 Apr 16 21:14:57.864670 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-4e8830ff-f0b4-4bbc-94db-d49f5b8f4fb0 req-1f5c6eb5-67b6-455c-a183-30d0be6e080e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040795 Apr 16 21:14:57.865705 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1167/2236] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:14:57.871615 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-01522fc8-4734-464e-b291-6eeaf259b07c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:57.872646 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-01522fc8-4734-464e-b291-6eeaf259b07c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:57.879643 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-01522fc8-4734-464e-b291-6eeaf259b07c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:57.880771 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-01522fc8-4734-464e-b291-6eeaf259b07c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:57.882298 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-01522fc8-4734-464e-b291-6eeaf259b07c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:57.882967 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-01522fc8-4734-464e-b291-6eeaf259b07c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:57.950652 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-39fc0a66-7f94-4144-a395-948e22d5c0ec tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:57.964223 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-39fc0a66-7f94-4144-a395-948e22d5c0ec tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1497 microversion: 2.1 time: 0.422068 Apr 16 21:14:57.965114 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1070/2237] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:57 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1497 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:57.970889 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-1b27a62b-9703-4f13-ab8e-ce4e8e4768aa req-f058bb2f-4e4f-4003-a35c-e39a836e5a82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98ca4f4e-246a-449b-b9fd-e1c17e119faa", "name": "network-vif-plugged", "status": "completed", "tag": "9bc5b971-3aa6-49d0-8b96-ab0e7cb12588"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:57.980599 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-1b27a62b-9703-4f13-ab8e-ce4e8e4768aa req-f058bb2f-4e4f-4003-a35c-e39a836e5a82 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:57.981438 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-1b27a62b-9703-4f13-ab8e-ce4e8e4768aa req-f058bb2f-4e4f-4003-a35c-e39a836e5a82 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:58.001570 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-1b27a62b-9703-4f13-ab8e-ce4e8e4768aa req-f058bb2f-4e4f-4003-a35c-e39a836e5a82 service nova] Creating event network-vif-plugged:9bc5b971-3aa6-49d0-8b96-ab0e7cb12588 for instance 98ca4f4e-246a-449b-b9fd-e1c17e119faa on nch2-master-1 Apr 16 21:14:58.012643 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-1b27a62b-9703-4f13-ab8e-ce4e8e4768aa req-f058bb2f-4e4f-4003-a35c-e39a836e5a82 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045720 Apr 16 21:14:58.014415 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1071/2238] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:14:58.104783 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-01522fc8-4734-464e-b291-6eeaf259b07c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:58.115805 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-01522fc8-4734-464e-b291-6eeaf259b07c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 200 len: 1472 microversion: 2.1 time: 0.248683 Apr 16 21:14:58.117037 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1168/2239] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:57 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 1472 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:58.210379 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7573d5e6-0ed7-4214-bd3e-a238527f7e9d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:58.211011 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7573d5e6-0ed7-4214-bd3e-a238527f7e9d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:58.218239 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7573d5e6-0ed7-4214-bd3e-a238527f7e9d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:58.219054 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7573d5e6-0ed7-4214-bd3e-a238527f7e9d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:58.220714 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7573d5e6-0ed7-4214-bd3e-a238527f7e9d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:58.221356 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7573d5e6-0ed7-4214-bd3e-a238527f7e9d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:58.302985 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-91a77dd7-41a2-4799-87ac-6ccda0be85b4 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1367412765", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "630ead34-ffcc-4ecb-82b7-48adfc0b0b97"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:14:58.367140 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-91a77dd7-41a2-4799-87ac-6ccda0be85b4 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] validate_networks() for [('630ead34-ffcc-4ecb-82b7-48adfc0b0b97', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:14:58.418264 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7573d5e6-0ed7-4214-bd3e-a238527f7e9d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:58.428151 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7573d5e6-0ed7-4214-bd3e-a238527f7e9d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:58.429868 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7573d5e6-0ed7-4214-bd3e-a238527f7e9d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:58.431400 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7573d5e6-0ed7-4214-bd3e-a238527f7e9d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1870 microversion: 2.32 time: 0.225417 Apr 16 21:14:58.437378 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1169/2240] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:58 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1870 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:14:58.523040 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-55b7d597-25b1-4de6-bf03-447dced37d0f tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:58.523732 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-55b7d597-25b1-4de6-bf03-447dced37d0f tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: bc3b9549-fb07-458b-84bf-3f1d36449e6e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:58.530497 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-55b7d597-25b1-4de6-bf03-447dced37d0f tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:58.530964 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-55b7d597-25b1-4de6-bf03-447dced37d0f tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:58.532075 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-55b7d597-25b1-4de6-bf03-447dced37d0f tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:58.532588 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-55b7d597-25b1-4de6-bf03-447dced37d0f tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:58.564464 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-55b7d597-25b1-4de6-bf03-447dced37d0f tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:58.565039 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-55b7d597-25b1-4de6-bf03-447dced37d0f tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:58.565561 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-55b7d597-25b1-4de6-bf03-447dced37d0f tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lazy-loading 'fault' on Instance uuid bc3b9549-fb07-458b-84bf-3f1d36449e6e {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:14:58.614113 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-55b7d597-25b1-4de6-bf03-447dced37d0f tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:58.621323 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-55b7d597-25b1-4de6-bf03-447dced37d0f tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e" status: 200 len: 1300 microversion: 2.1 time: 0.102294 Apr 16 21:14:58.622042 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1170/2241] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:58 2022] GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e => generated 1300 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:14:58.828019 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-736b13fe-acfe-4258-8628-525b10348a29 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:58.828835 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-736b13fe-acfe-4258-8628-525b10348a29 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:58.836854 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-736b13fe-acfe-4258-8628-525b10348a29 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:58.837323 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-736b13fe-acfe-4258-8628-525b10348a29 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:58.838129 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-736b13fe-acfe-4258-8628-525b10348a29 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:58.838604 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-736b13fe-acfe-4258-8628-525b10348a29 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:58.986183 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-736b13fe-acfe-4258-8628-525b10348a29 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:58.995318 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-736b13fe-acfe-4258-8628-525b10348a29 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1688 microversion: 2.1 time: 0.170741 Apr 16 21:14:58.996130 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1171/2242] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:58 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1688 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:14:59.001061 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7ae4a81e-b3c0-4ea8-a7db-1fefb8fbfdd9 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:59.002045 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7ae4a81e-b3c0-4ea8-a7db-1fefb8fbfdd9 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:59.008549 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ae4a81e-b3c0-4ea8-a7db-1fefb8fbfdd9 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:59.009406 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ae4a81e-b3c0-4ea8-a7db-1fefb8fbfdd9 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:59.009821 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ae4a81e-b3c0-4ea8-a7db-1fefb8fbfdd9 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:59.010855 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ae4a81e-b3c0-4ea8-a7db-1fefb8fbfdd9 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:59.151908 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7ae4a81e-b3c0-4ea8-a7db-1fefb8fbfdd9 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:59.153929 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-91a77dd7-41a2-4799-87ac-6ccda0be85b4 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:14:59.154442 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-91a77dd7-41a2-4799-87ac-6ccda0be85b4 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:14:59.155005 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-91a77dd7-41a2-4799-87ac-6ccda0be85b4 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:14:59.155423 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-91a77dd7-41a2-4799-87ac-6ccda0be85b4 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:14:59.156073 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-91a77dd7-41a2-4799-87ac-6ccda0be85b4 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:14:59.161957 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7ae4a81e-b3c0-4ea8-a7db-1fefb8fbfdd9 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1497 microversion: 2.1 time: 0.164880 Apr 16 21:14:59.163378 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1172/2243] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:58 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:59.169618 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c4c7046e-26ad-4915-8c4a-c3dc53983b63 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:59.170347 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c4c7046e-26ad-4915-8c4a-c3dc53983b63 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:59.175843 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-91a77dd7-41a2-4799-87ac-6ccda0be85b4 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:59.179883 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-91a77dd7-41a2-4799-87ac-6ccda0be85b4 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:59.179883 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-91a77dd7-41a2-4799-87ac-6ccda0be85b4 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:59.180142 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c4c7046e-26ad-4915-8c4a-c3dc53983b63 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:59.180288 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-91a77dd7-41a2-4799-87ac-6ccda0be85b4 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:59.180400 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c4c7046e-26ad-4915-8c4a-c3dc53983b63 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:59.180400 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c4c7046e-26ad-4915-8c4a-c3dc53983b63 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:59.180400 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c4c7046e-26ad-4915-8c4a-c3dc53983b63 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:59.196441 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-91a77dd7-41a2-4799-87ac-6ccda0be85b4 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Getting quotas for project 5ec2ad232d62489aa704075fad5305c2. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:14:59.203061 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-91a77dd7-41a2-4799-87ac-6ccda0be85b4 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Getting quotas for user b2bab3afb0f945eca1a7bf9f783cf9fc and project 5ec2ad232d62489aa704075fad5305c2. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:14:59.216547 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-91a77dd7-41a2-4799-87ac-6ccda0be85b4 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Going to run 2 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:14:59.218974 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-91a77dd7-41a2-4799-87ac-6ccda0be85b4 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: 446a5909-7904-4290-9a61-015b0a1f5d40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:14:59.360055 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c4c7046e-26ad-4915-8c4a-c3dc53983b63 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:59.367789 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c4c7046e-26ad-4915-8c4a-c3dc53983b63 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 200 len: 1472 microversion: 2.1 time: 0.203114 Apr 16 21:14:59.368614 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1173/2244] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:59 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 1472 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:14:59.409704 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-91a77dd7-41a2-4799-87ac-6ccda0be85b4 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: a839aa71-2bd6-4676-8955-1d69072cd7f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=446a5909-7904-4290-9a61-015b0a1f5d40,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:14:59.450435 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e39a23d2-394e-41d3-b961-3c3f0d370231 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:59.451861 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e39a23d2-394e-41d3-b961-3c3f0d370231 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:59.459362 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e39a23d2-394e-41d3-b961-3c3f0d370231 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:59.464017 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e39a23d2-394e-41d3-b961-3c3f0d370231 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:59.464017 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e39a23d2-394e-41d3-b961-3c3f0d370231 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:59.464017 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e39a23d2-394e-41d3-b961-3c3f0d370231 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:59.558276 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-91a77dd7-41a2-4799-87ac-6ccda0be85b4 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.386160 Apr 16 21:14:59.559960 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1072/2245] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:14:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1389 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:14:59.574647 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-02f5c5df-6354-4d4c-a6a4-7cf9fa9dcf98 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:59.584530 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-02f5c5df-6354-4d4c-a6a4-7cf9fa9dcf98 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b2bab3afb0f945eca1a7bf9f783cf9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec2ad232d62489aa704075fad5305c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:59.585525 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-02f5c5df-6354-4d4c-a6a4-7cf9fa9dcf98 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Searching by: {'deleted': False, 'project_id': '5ec2ad232d62489aa704075fad5305c2'} {{(pid=137409) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:14:59.611384 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-02f5c5df-6354-4d4c-a6a4-7cf9fa9dcf98 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:59.612775 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-02f5c5df-6354-4d4c-a6a4-7cf9fa9dcf98 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:59.613719 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-02f5c5df-6354-4d4c-a6a4-7cf9fa9dcf98 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:59.614423 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-02f5c5df-6354-4d4c-a6a4-7cf9fa9dcf98 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:59.645202 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-02f5c5df-6354-4d4c-a6a4-7cf9fa9dcf98 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.077844 Apr 16 21:14:59.646075 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1073/2246] 10.222.0.20 () {58 vars in 1124 bytes} [Sat Apr 16 21:14:59 2022] GET /compute/v2.1/servers => generated 677 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:14:59.668586 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-aefbd36c-9dc0-47e9-b3b5-4aa34394d11d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:59.669602 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-aefbd36c-9dc0-47e9-b3b5-4aa34394d11d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: bc3b9549-fb07-458b-84bf-3f1d36449e6e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:59.683200 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aefbd36c-9dc0-47e9-b3b5-4aa34394d11d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:59.684557 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aefbd36c-9dc0-47e9-b3b5-4aa34394d11d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:59.694278 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aefbd36c-9dc0-47e9-b3b5-4aa34394d11d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:59.694278 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aefbd36c-9dc0-47e9-b3b5-4aa34394d11d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:59.719314 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-aefbd36c-9dc0-47e9-b3b5-4aa34394d11d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] HTTP exception thrown: Instance bc3b9549-fb07-458b-84bf-3f1d36449e6e could not be found. Apr 16 21:14:59.722026 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-aefbd36c-9dc0-47e9-b3b5-4aa34394d11d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Returning 404 to user: Instance bc3b9549-fb07-458b-84bf-3f1d36449e6e could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:14:59.725089 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-aefbd36c-9dc0-47e9-b3b5-4aa34394d11d tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e" status: 404 len: 111 microversion: 2.1 time: 0.075973 Apr 16 21:14:59.726608 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1074/2247] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:59 2022] GET /compute/v2.1/servers/bc3b9549-fb07-458b-84bf-3f1d36449e6e => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:14:59.738047 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5d856b87-da29-4bb9-998e-9f6f45c5df44 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:59.739011 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5d856b87-da29-4bb9-998e-9f6f45c5df44 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: a839aa71-2bd6-4676-8955-1d69072cd7f0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:59.776579 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e39a23d2-394e-41d3-b961-3c3f0d370231 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:59.786591 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e39a23d2-394e-41d3-b961-3c3f0d370231 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:59.788206 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e39a23d2-394e-41d3-b961-3c3f0d370231 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:59.789395 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e39a23d2-394e-41d3-b961-3c3f0d370231 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1870 microversion: 2.32 time: 0.343732 Apr 16 21:14:59.789968 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1174/2248] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:14:59 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1870 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:14:59.796740 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-78057631-7450-433c-953f-6370aa440e30 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:14:59.797409 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-78057631-7450-433c-953f-6370aa440e30 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: e641f7ec-0d41-4439-bc77-7158fb9d346e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:14:59.804568 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-78057631-7450-433c-953f-6370aa440e30 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:59.805028 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-78057631-7450-433c-953f-6370aa440e30 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:59.806392 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-78057631-7450-433c-953f-6370aa440e30 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:14:59.807354 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-78057631-7450-433c-953f-6370aa440e30 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:14:59.839976 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5d856b87-da29-4bb9-998e-9f6f45c5df44 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2bab3afb0f945eca1a7bf9f783cf9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec2ad232d62489aa704075fad5305c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:14:59.848518 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-78057631-7450-433c-953f-6370aa440e30 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: e641f7ec-0d41-4439-bc77-7158fb9d346e] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:14:59.853215 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5d856b87-da29-4bb9-998e-9f6f45c5df44 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "GET /compute/v2.1/servers/a839aa71-2bd6-4676-8955-1d69072cd7f0" status: 200 len: 1220 microversion: 2.1 time: 0.122103 Apr 16 21:14:59.853527 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1075/2249] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:14:59 2022] GET /compute/v2.1/servers/a839aa71-2bd6-4676-8955-1d69072cd7f0 => generated 1220 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:00.022133 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cf58e1ca-18b8-4721-8547-1f3020b2a5a2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:00.023272 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-cf58e1ca-18b8-4721-8547-1f3020b2a5a2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:00.035084 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cf58e1ca-18b8-4721-8547-1f3020b2a5a2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:00.035927 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cf58e1ca-18b8-4721-8547-1f3020b2a5a2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:00.037370 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cf58e1ca-18b8-4721-8547-1f3020b2a5a2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:00.038178 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cf58e1ca-18b8-4721-8547-1f3020b2a5a2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:00.227925 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-78057631-7450-433c-953f-6370aa440e30 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e" status: 204 len: 0 microversion: 2.1 time: 0.436338 Apr 16 21:15:00.239001 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1175/2250] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:14:59 2022] DELETE /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:15:00.239001 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e938e0f6-46d8-4dbf-870d-7219087ced0b tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:00.239001 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e938e0f6-46d8-4dbf-870d-7219087ced0b tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:00.245257 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e938e0f6-46d8-4dbf-870d-7219087ced0b tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:00.245975 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e938e0f6-46d8-4dbf-870d-7219087ced0b tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:00.246959 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e938e0f6-46d8-4dbf-870d-7219087ced0b tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:00.247616 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e938e0f6-46d8-4dbf-870d-7219087ced0b tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:00.403668 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e938e0f6-46d8-4dbf-870d-7219087ced0b tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:00.412643 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cf58e1ca-18b8-4721-8547-1f3020b2a5a2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:00.414989 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e938e0f6-46d8-4dbf-870d-7219087ced0b tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1497 microversion: 2.1 time: 0.183088 Apr 16 21:15:00.416397 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1176/2251] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:00 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1497 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:00.434970 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-afa11ae8-14b0-4d16-b745-19df3d776842 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:00.434970 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-afa11ae8-14b0-4d16-b745-19df3d776842 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: e641f7ec-0d41-4439-bc77-7158fb9d346e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:00.437679 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cf58e1ca-18b8-4721-8547-1f3020b2a5a2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1688 microversion: 2.1 time: 0.428052 Apr 16 21:15:00.438953 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1076/2252] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:00 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1688 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:00.453135 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-afa11ae8-14b0-4d16-b745-19df3d776842 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:00.457081 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-afa11ae8-14b0-4d16-b745-19df3d776842 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:00.457081 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-afa11ae8-14b0-4d16-b745-19df3d776842 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:00.457081 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-afa11ae8-14b0-4d16-b745-19df3d776842 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:00.479966 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f77820db-dbef-4ecd-84b8-8d7119f99248 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:00.481521 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f77820db-dbef-4ecd-84b8-8d7119f99248 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:00.507162 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f77820db-dbef-4ecd-84b8-8d7119f99248 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:00.507979 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f77820db-dbef-4ecd-84b8-8d7119f99248 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:00.509038 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f77820db-dbef-4ecd-84b8-8d7119f99248 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:00.509893 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f77820db-dbef-4ecd-84b8-8d7119f99248 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:00.625991 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-afa11ae8-14b0-4d16-b745-19df3d776842 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:00.634166 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-afa11ae8-14b0-4d16-b745-19df3d776842 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e" status: 200 len: 1499 microversion: 2.1 time: 0.216295 Apr 16 21:15:00.640003 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1177/2253] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:00 2022] GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e => generated 1499 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:00.823166 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ed08af80-e9cd-4cae-a3b4-f4e9bf8af68f tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:00.823993 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ed08af80-e9cd-4cae-a3b4-f4e9bf8af68f tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:00.831885 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ed08af80-e9cd-4cae-a3b4-f4e9bf8af68f tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:00.832479 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ed08af80-e9cd-4cae-a3b4-f4e9bf8af68f tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:00.833365 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ed08af80-e9cd-4cae-a3b4-f4e9bf8af68f tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:00.833895 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ed08af80-e9cd-4cae-a3b4-f4e9bf8af68f tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:00.936057 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f77820db-dbef-4ecd-84b8-8d7119f99248 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:00.946342 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f77820db-dbef-4ecd-84b8-8d7119f99248 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 200 len: 1472 microversion: 2.1 time: 0.505318 Apr 16 21:15:00.949295 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1077/2254] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:00 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 1472 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:00.962613 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4112263d-3542-4fba-8ff9-0e40d4bd467f tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:00.964371 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4112263d-3542-4fba-8ff9-0e40d4bd467f tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: a839aa71-2bd6-4676-8955-1d69072cd7f0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:01.087160 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4112263d-3542-4fba-8ff9-0e40d4bd467f tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2bab3afb0f945eca1a7bf9f783cf9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec2ad232d62489aa704075fad5305c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:01.106649 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4112263d-3542-4fba-8ff9-0e40d4bd467f tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "GET /compute/v2.1/servers/a839aa71-2bd6-4676-8955-1d69072cd7f0" status: 200 len: 1220 microversion: 2.1 time: 0.155947 Apr 16 21:15:01.109511 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1078/2255] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:00 2022] GET /compute/v2.1/servers/a839aa71-2bd6-4676-8955-1d69072cd7f0 => generated 1220 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:01.136516 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ed08af80-e9cd-4cae-a3b4-f4e9bf8af68f tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:01.147660 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ed08af80-e9cd-4cae-a3b4-f4e9bf8af68f tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:01.152253 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ed08af80-e9cd-4cae-a3b4-f4e9bf8af68f tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:01.154436 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ed08af80-e9cd-4cae-a3b4-f4e9bf8af68f tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1870 microversion: 2.32 time: 0.346273 Apr 16 21:15:01.171119 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1178/2256] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:00 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1870 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:15:01.434061 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9bc898d6-d2e1-48fb-b3db-8f332d25a1d6 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:01.434678 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9bc898d6-d2e1-48fb-b3db-8f332d25a1d6 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:01.445892 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9bc898d6-d2e1-48fb-b3db-8f332d25a1d6 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:01.452424 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9bc898d6-d2e1-48fb-b3db-8f332d25a1d6 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:01.453709 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9bc898d6-d2e1-48fb-b3db-8f332d25a1d6 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:01.455268 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9bc898d6-d2e1-48fb-b3db-8f332d25a1d6 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:01.456977 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-813a6a93-1ff0-4023-ad0f-1ad43d929d34 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:01.457619 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-813a6a93-1ff0-4023-ad0f-1ad43d929d34 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:01.472887 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-813a6a93-1ff0-4023-ad0f-1ad43d929d34 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:01.473434 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-813a6a93-1ff0-4023-ad0f-1ad43d929d34 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:01.474290 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-813a6a93-1ff0-4023-ad0f-1ad43d929d34 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:01.474697 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-813a6a93-1ff0-4023-ad0f-1ad43d929d34 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:01.715168 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-813a6a93-1ff0-4023-ad0f-1ad43d929d34 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:01.742745 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-813a6a93-1ff0-4023-ad0f-1ad43d929d34 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1683 microversion: 2.1 time: 0.272784 Apr 16 21:15:01.745471 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1179/2257] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:01 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1683 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:15:01.800610 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-87e4fc12-a409-4965-a85f-d9b67a96bdf3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:01.803999 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-87e4fc12-a409-4965-a85f-d9b67a96bdf3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: e641f7ec-0d41-4439-bc77-7158fb9d346e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:01.809458 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-87e4fc12-a409-4965-a85f-d9b67a96bdf3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:01.810473 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-87e4fc12-a409-4965-a85f-d9b67a96bdf3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:01.813218 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-87e4fc12-a409-4965-a85f-d9b67a96bdf3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:01.814125 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-87e4fc12-a409-4965-a85f-d9b67a96bdf3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:02.021421 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-87e4fc12-a409-4965-a85f-d9b67a96bdf3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:02.037872 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-87e4fc12-a409-4965-a85f-d9b67a96bdf3 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e" status: 200 len: 1499 microversion: 2.1 time: 0.269225 Apr 16 21:15:02.039168 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1180/2258] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:01 2022] GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e => generated 1499 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:02.044551 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cbf6bb59-6d13-475b-8fd5-91fea11b978c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:02.045612 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cbf6bb59-6d13-475b-8fd5-91fea11b978c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:02.053432 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cbf6bb59-6d13-475b-8fd5-91fea11b978c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:02.054309 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cbf6bb59-6d13-475b-8fd5-91fea11b978c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:02.059392 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cbf6bb59-6d13-475b-8fd5-91fea11b978c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:02.060206 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cbf6bb59-6d13-475b-8fd5-91fea11b978c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:02.117215 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9bc898d6-d2e1-48fb-b3db-8f332d25a1d6 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:02.127047 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9bc898d6-d2e1-48fb-b3db-8f332d25a1d6 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1497 microversion: 2.1 time: 0.697886 Apr 16 21:15:02.141118 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1079/2259] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:01 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1497 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:02.146148 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fec7935c-91f7-4f57-bd02-32875e78bbde tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:02.146779 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-fec7935c-91f7-4f57-bd02-32875e78bbde tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: a839aa71-2bd6-4676-8955-1d69072cd7f0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:02.246665 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-fec7935c-91f7-4f57-bd02-32875e78bbde tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2bab3afb0f945eca1a7bf9f783cf9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec2ad232d62489aa704075fad5305c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:02.254327 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fec7935c-91f7-4f57-bd02-32875e78bbde tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "GET /compute/v2.1/servers/a839aa71-2bd6-4676-8955-1d69072cd7f0" status: 200 len: 1220 microversion: 2.1 time: 0.112034 Apr 16 21:15:02.266000 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1080/2260] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:02 2022] GET /compute/v2.1/servers/a839aa71-2bd6-4676-8955-1d69072cd7f0 => generated 1220 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:02.266000 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5aae388e-65a3-4dcb-bf0a-8629ac202a74 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:02.266000 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5aae388e-65a3-4dcb-bf0a-8629ac202a74 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:02.286561 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5aae388e-65a3-4dcb-bf0a-8629ac202a74 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:02.287041 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5aae388e-65a3-4dcb-bf0a-8629ac202a74 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:02.287857 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5aae388e-65a3-4dcb-bf0a-8629ac202a74 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:02.288341 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5aae388e-65a3-4dcb-bf0a-8629ac202a74 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:02.423587 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cbf6bb59-6d13-475b-8fd5-91fea11b978c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:02.442218 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cbf6bb59-6d13-475b-8fd5-91fea11b978c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 200 len: 1472 microversion: 2.1 time: 0.401688 Apr 16 21:15:02.445520 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1181/2261] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:02 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 1472 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:02.726170 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-f175e45f-962f-4e4f-a101-3bd3e3b69eb5 req-2438b289-330c-4488-a5ba-ff2480b29cf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e641f7ec-0d41-4439-bc77-7158fb9d346e", "name": "network-vif-deleted", "tag": "cde5a5c3-65ba-417d-8651-74ec3a50ff0d"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:02.745984 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-f175e45f-962f-4e4f-a101-3bd3e3b69eb5 req-2438b289-330c-4488-a5ba-ff2480b29cf6 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:02.746780 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-f175e45f-962f-4e4f-a101-3bd3e3b69eb5 req-2438b289-330c-4488-a5ba-ff2480b29cf6 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:02.755859 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5aae388e-65a3-4dcb-bf0a-8629ac202a74 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:02.764932 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-f175e45f-962f-4e4f-a101-3bd3e3b69eb5 req-2438b289-330c-4488-a5ba-ff2480b29cf6 service nova] Creating event network-vif-deleted:cde5a5c3-65ba-417d-8651-74ec3a50ff0d for instance e641f7ec-0d41-4439-bc77-7158fb9d346e on nch2-master-1 Apr 16 21:15:02.775984 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5aae388e-65a3-4dcb-bf0a-8629ac202a74 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:02.775984 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5aae388e-65a3-4dcb-bf0a-8629ac202a74 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:02.775984 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5aae388e-65a3-4dcb-bf0a-8629ac202a74 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1870 microversion: 2.32 time: 0.515820 Apr 16 21:15:02.784971 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1081/2262] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:02 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1870 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:15:02.795518 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-f175e45f-962f-4e4f-a101-3bd3e3b69eb5 req-2438b289-330c-4488-a5ba-ff2480b29cf6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073508 Apr 16 21:15:02.797578 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-57448b82-b86e-4f3a-afe4-e9d15a69f7a3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:02.802764 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-57448b82-b86e-4f3a-afe4-e9d15a69f7a3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:02.808470 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-57448b82-b86e-4f3a-afe4-e9d15a69f7a3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:02.809297 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-57448b82-b86e-4f3a-afe4-e9d15a69f7a3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:02.810403 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-57448b82-b86e-4f3a-afe4-e9d15a69f7a3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:02.813319 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1182/2263] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:15:02.815304 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-57448b82-b86e-4f3a-afe4-e9d15a69f7a3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:03.057535 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-eca1fe80-3120-4c67-a8d2-8e3e657aced5 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:03.058256 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-eca1fe80-3120-4c67-a8d2-8e3e657aced5 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: e641f7ec-0d41-4439-bc77-7158fb9d346e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:03.075572 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eca1fe80-3120-4c67-a8d2-8e3e657aced5 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:03.076039 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eca1fe80-3120-4c67-a8d2-8e3e657aced5 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:03.077080 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eca1fe80-3120-4c67-a8d2-8e3e657aced5 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:03.077684 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eca1fe80-3120-4c67-a8d2-8e3e657aced5 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:03.138843 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-57448b82-b86e-4f3a-afe4-e9d15a69f7a3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:03.152502 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-57448b82-b86e-4f3a-afe4-e9d15a69f7a3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1683 microversion: 2.1 time: 0.365986 Apr 16 21:15:03.186054 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1082/2264] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:02 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1683 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:03.193417 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-30d59871-9832-4b22-8290-d67f1099bc75 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:03.194271 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-30d59871-9832-4b22-8290-d67f1099bc75 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:03.201987 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-30d59871-9832-4b22-8290-d67f1099bc75 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:03.202766 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-30d59871-9832-4b22-8290-d67f1099bc75 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:03.203809 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-30d59871-9832-4b22-8290-d67f1099bc75 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:03.205064 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-30d59871-9832-4b22-8290-d67f1099bc75 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:03.235799 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-eca1fe80-3120-4c67-a8d2-8e3e657aced5 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '547d9f3aa3a54867971074b795d83b81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b18530cc69c44e6f8a46ca966b3e3a7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:03.246227 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-eca1fe80-3120-4c67-a8d2-8e3e657aced5 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e" status: 200 len: 1294 microversion: 2.1 time: 0.194765 Apr 16 21:15:03.247263 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1183/2265] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:03 2022] GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e => generated 1294 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:03.274707 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8d3a3408-0954-4693-ab5f-2881f14e5564 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:03.276133 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8d3a3408-0954-4693-ab5f-2881f14e5564 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: a839aa71-2bd6-4676-8955-1d69072cd7f0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:03.285234 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8d3a3408-0954-4693-ab5f-2881f14e5564 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:03.291535 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8d3a3408-0954-4693-ab5f-2881f14e5564 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:03.293512 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8d3a3408-0954-4693-ab5f-2881f14e5564 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:03.303308 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8d3a3408-0954-4693-ab5f-2881f14e5564 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:03.437829 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8d3a3408-0954-4693-ab5f-2881f14e5564 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2bab3afb0f945eca1a7bf9f783cf9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec2ad232d62489aa704075fad5305c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:03.444937 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8d3a3408-0954-4693-ab5f-2881f14e5564 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "GET /compute/v2.1/servers/a839aa71-2bd6-4676-8955-1d69072cd7f0" status: 200 len: 1272 microversion: 2.1 time: 0.174220 Apr 16 21:15:03.446939 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1184/2266] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:03 2022] GET /compute/v2.1/servers/a839aa71-2bd6-4676-8955-1d69072cd7f0 => generated 1272 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:15:03.469790 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c3240737-3dea-4b75-b18e-156b968f4c64 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:03.472544 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c3240737-3dea-4b75-b18e-156b968f4c64 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:03.501747 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-30d59871-9832-4b22-8290-d67f1099bc75 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:03.513053 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-30d59871-9832-4b22-8290-d67f1099bc75 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1497 microversion: 2.1 time: 0.325600 Apr 16 21:15:03.513652 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1083/2267] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:03 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1497 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:03.516526 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3240737-3dea-4b75-b18e-156b968f4c64 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:03.517320 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3240737-3dea-4b75-b18e-156b968f4c64 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:03.518408 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3240737-3dea-4b75-b18e-156b968f4c64 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:03.519054 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3240737-3dea-4b75-b18e-156b968f4c64 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:03.800103 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2895cd4f-13d5-44d4-8b34-cda7a6ce60a0 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:03.802637 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2895cd4f-13d5-44d4-8b34-cda7a6ce60a0 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:03.816940 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2895cd4f-13d5-44d4-8b34-cda7a6ce60a0 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:03.819574 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2895cd4f-13d5-44d4-8b34-cda7a6ce60a0 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:03.843277 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2895cd4f-13d5-44d4-8b34-cda7a6ce60a0 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:03.844923 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2895cd4f-13d5-44d4-8b34-cda7a6ce60a0 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:04.027050 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c3240737-3dea-4b75-b18e-156b968f4c64 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:04.038677 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c3240737-3dea-4b75-b18e-156b968f4c64 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 200 len: 1477 microversion: 2.1 time: 0.579144 Apr 16 21:15:04.039823 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1185/2268] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:03 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 1477 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:04.186752 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-817455b0-c57b-4a11-921e-4ec3c85c7479 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:04.188998 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-817455b0-c57b-4a11-921e-4ec3c85c7479 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:04.197656 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-817455b0-c57b-4a11-921e-4ec3c85c7479 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:04.200446 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-817455b0-c57b-4a11-921e-4ec3c85c7479 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:04.202103 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-817455b0-c57b-4a11-921e-4ec3c85c7479 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:04.203788 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-817455b0-c57b-4a11-921e-4ec3c85c7479 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:04.407635 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-817455b0-c57b-4a11-921e-4ec3c85c7479 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:04.418283 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-817455b0-c57b-4a11-921e-4ec3c85c7479 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1683 microversion: 2.1 time: 0.236216 Apr 16 21:15:04.419566 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1186/2269] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:04 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1683 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:04.425984 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-26fd0fc1-17a4-4e2d-a91e-6ddff2220601 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:04.426829 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-26fd0fc1-17a4-4e2d-a91e-6ddff2220601 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] [instance: e641f7ec-0d41-4439-bc77-7158fb9d346e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:04.438131 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-26fd0fc1-17a4-4e2d-a91e-6ddff2220601 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:04.439853 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-26fd0fc1-17a4-4e2d-a91e-6ddff2220601 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:04.440160 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-26fd0fc1-17a4-4e2d-a91e-6ddff2220601 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:04.440862 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-26fd0fc1-17a4-4e2d-a91e-6ddff2220601 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:04.453011 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2895cd4f-13d5-44d4-8b34-cda7a6ce60a0 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:04.465530 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2895cd4f-13d5-44d4-8b34-cda7a6ce60a0 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:04.470284 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2895cd4f-13d5-44d4-8b34-cda7a6ce60a0 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:04.471027 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-26fd0fc1-17a4-4e2d-a91e-6ddff2220601 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] HTTP exception thrown: Instance e641f7ec-0d41-4439-bc77-7158fb9d346e could not be found. Apr 16 21:15:04.471760 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-26fd0fc1-17a4-4e2d-a91e-6ddff2220601 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] Returning 404 to user: Instance e641f7ec-0d41-4439-bc77-7158fb9d346e could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:15:04.473975 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-26fd0fc1-17a4-4e2d-a91e-6ddff2220601 tempest-LiveMigrationTest-386991981 tempest-LiveMigrationTest-386991981-project] 10.222.0.20 "GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e" status: 404 len: 111 microversion: 2.1 time: 0.053083 Apr 16 21:15:04.479590 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2895cd4f-13d5-44d4-8b34-cda7a6ce60a0 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1870 microversion: 2.32 time: 0.688256 Apr 16 21:15:04.480363 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1187/2270] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:04 2022] GET /compute/v2.1/servers/e641f7ec-0d41-4439-bc77-7158fb9d346e => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:15:04.482882 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1084/2271] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:03 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1870 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:15:04.488682 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2755660e-00e9-45b1-acb6-628990d92945 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:04.493002 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2755660e-00e9-45b1-acb6-628990d92945 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: a839aa71-2bd6-4676-8955-1d69072cd7f0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:04.513020 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2755660e-00e9-45b1-acb6-628990d92945 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:04.517637 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2755660e-00e9-45b1-acb6-628990d92945 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:04.518725 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2755660e-00e9-45b1-acb6-628990d92945 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:04.519281 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2755660e-00e9-45b1-acb6-628990d92945 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:04.531268 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5c7e7e73-f54c-4648-b195-a79942b74865 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:04.532348 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5c7e7e73-f54c-4648-b195-a79942b74865 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:04.543120 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5c7e7e73-f54c-4648-b195-a79942b74865 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:04.544720 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5c7e7e73-f54c-4648-b195-a79942b74865 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:04.548030 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5c7e7e73-f54c-4648-b195-a79942b74865 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:04.548836 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5c7e7e73-f54c-4648-b195-a79942b74865 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:04.684575 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2755660e-00e9-45b1-acb6-628990d92945 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2bab3afb0f945eca1a7bf9f783cf9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec2ad232d62489aa704075fad5305c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:04.694992 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2755660e-00e9-45b1-acb6-628990d92945 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "GET /compute/v2.1/servers/a839aa71-2bd6-4676-8955-1d69072cd7f0" status: 200 len: 1290 microversion: 2.1 time: 0.213087 Apr 16 21:15:04.695617 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1188/2272] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:04 2022] GET /compute/v2.1/servers/a839aa71-2bd6-4676-8955-1d69072cd7f0 => generated 1290 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:04.886500 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5c7e7e73-f54c-4648-b195-a79942b74865 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:04.915083 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5c7e7e73-f54c-4648-b195-a79942b74865 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1497 microversion: 2.1 time: 0.387308 Apr 16 21:15:04.921690 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1085/2273] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:04 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1497 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:15:05.058620 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7abb70e7-d74a-47e9-a79a-48408ccc6428 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:05.059985 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7abb70e7-d74a-47e9-a79a-48408ccc6428 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:05.073394 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7abb70e7-d74a-47e9-a79a-48408ccc6428 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:05.076030 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7abb70e7-d74a-47e9-a79a-48408ccc6428 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:05.077109 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7abb70e7-d74a-47e9-a79a-48408ccc6428 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:05.079364 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7abb70e7-d74a-47e9-a79a-48408ccc6428 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:05.442400 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-46401038-3263-443e-9e3d-65ecaeb42e00 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:05.443271 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-46401038-3263-443e-9e3d-65ecaeb42e00 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:05.454636 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-46401038-3263-443e-9e3d-65ecaeb42e00 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:05.463418 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-46401038-3263-443e-9e3d-65ecaeb42e00 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:05.470903 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-46401038-3263-443e-9e3d-65ecaeb42e00 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:05.474684 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-46401038-3263-443e-9e3d-65ecaeb42e00 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:05.668501 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7abb70e7-d74a-47e9-a79a-48408ccc6428 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:05.682107 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7abb70e7-d74a-47e9-a79a-48408ccc6428 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 200 len: 1477 microversion: 2.1 time: 0.627934 Apr 16 21:15:05.682867 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1189/2274] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:05 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 1477 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:05.693883 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ab3edeaf-ae92-4baa-bc31-661e8a62f83c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:05.697696 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ab3edeaf-ae92-4baa-bc31-661e8a62f83c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:05.713886 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ab3edeaf-ae92-4baa-bc31-661e8a62f83c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:05.718638 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ab3edeaf-ae92-4baa-bc31-661e8a62f83c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:05.719567 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ab3edeaf-ae92-4baa-bc31-661e8a62f83c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:05.721328 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ab3edeaf-ae92-4baa-bc31-661e8a62f83c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:06.000126 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ab3edeaf-ae92-4baa-bc31-661e8a62f83c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:06.012401 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-46401038-3263-443e-9e3d-65ecaeb42e00 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:06.017884 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ab3edeaf-ae92-4baa-bc31-661e8a62f83c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:06.022518 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-46401038-3263-443e-9e3d-65ecaeb42e00 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1683 microversion: 2.1 time: 0.591211 Apr 16 21:15:06.024495 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ab3edeaf-ae92-4baa-bc31-661e8a62f83c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:06.026161 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1086/2275] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:05 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1683 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:06.029771 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ab3edeaf-ae92-4baa-bc31-661e8a62f83c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1870 microversion: 2.32 time: 0.345795 Apr 16 21:15:06.043025 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1190/2276] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:05 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1870 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:15:06.049366 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5cbf0861-7ed6-48e3-8ac7-85bfbde84a5d tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:06.050356 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5cbf0861-7ed6-48e3-8ac7-85bfbde84a5d tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: a839aa71-2bd6-4676-8955-1d69072cd7f0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:06.054366 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b1172787-b694-4750-82d1-3143483be4cc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:06.055018 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b1172787-b694-4750-82d1-3143483be4cc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:06.063615 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5cbf0861-7ed6-48e3-8ac7-85bfbde84a5d tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:06.064073 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5cbf0861-7ed6-48e3-8ac7-85bfbde84a5d tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:06.066061 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5cbf0861-7ed6-48e3-8ac7-85bfbde84a5d tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:06.067801 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5cbf0861-7ed6-48e3-8ac7-85bfbde84a5d tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:06.069927 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b1172787-b694-4750-82d1-3143483be4cc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:06.074688 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b1172787-b694-4750-82d1-3143483be4cc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:06.075749 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b1172787-b694-4750-82d1-3143483be4cc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:06.076421 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b1172787-b694-4750-82d1-3143483be4cc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:06.264453 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5cbf0861-7ed6-48e3-8ac7-85bfbde84a5d tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2bab3afb0f945eca1a7bf9f783cf9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec2ad232d62489aa704075fad5305c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:06.275367 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5cbf0861-7ed6-48e3-8ac7-85bfbde84a5d tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "GET /compute/v2.1/servers/a839aa71-2bd6-4676-8955-1d69072cd7f0" status: 200 len: 1278 microversion: 2.1 time: 0.247797 Apr 16 21:15:06.280958 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1087/2277] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:06 2022] GET /compute/v2.1/servers/a839aa71-2bd6-4676-8955-1d69072cd7f0 => generated 1278 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:06.319335 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b1172787-b694-4750-82d1-3143483be4cc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:06.329168 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b1172787-b694-4750-82d1-3143483be4cc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1497 microversion: 2.1 time: 0.282298 Apr 16 21:15:06.329955 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1191/2278] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:06 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1497 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:06.699497 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f610912d-55c1-46c9-a574-df548e6328bf tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:06.700514 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f610912d-55c1-46c9-a574-df548e6328bf tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:06.712145 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f610912d-55c1-46c9-a574-df548e6328bf tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:06.714251 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f610912d-55c1-46c9-a574-df548e6328bf tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:06.715287 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f610912d-55c1-46c9-a574-df548e6328bf tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:06.721876 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f610912d-55c1-46c9-a574-df548e6328bf tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:07.037257 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f610912d-55c1-46c9-a574-df548e6328bf tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:07.045513 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6528bacf-ea6d-4996-9a99-90b941635d02 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:07.046267 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6528bacf-ea6d-4996-9a99-90b941635d02 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:07.059204 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f610912d-55c1-46c9-a574-df548e6328bf tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 200 len: 1477 microversion: 2.1 time: 0.363944 Apr 16 21:15:07.062384 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1088/2279] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:06 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 1477 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:07.064353 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6528bacf-ea6d-4996-9a99-90b941635d02 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:07.064549 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6528bacf-ea6d-4996-9a99-90b941635d02 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:07.066146 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6528bacf-ea6d-4996-9a99-90b941635d02 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:07.066883 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6528bacf-ea6d-4996-9a99-90b941635d02 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:07.077127 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7ca2795c-3a66-4c29-b486-bbb2c744db7c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:07.078200 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7ca2795c-3a66-4c29-b486-bbb2c744db7c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:07.127218 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7ca2795c-3a66-4c29-b486-bbb2c744db7c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:07.129588 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7ca2795c-3a66-4c29-b486-bbb2c744db7c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:07.130648 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7ca2795c-3a66-4c29-b486-bbb2c744db7c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:07.134025 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7ca2795c-3a66-4c29-b486-bbb2c744db7c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:07.312890 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6528bacf-ea6d-4996-9a99-90b941635d02 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:07.320842 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6528bacf-ea6d-4996-9a99-90b941635d02 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1683 microversion: 2.1 time: 0.280966 Apr 16 21:15:07.321516 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1192/2280] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:07 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1683 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:07.326833 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-865ec821-57e8-43ea-afe1-210700bcdf06 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:07.327541 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-865ec821-57e8-43ea-afe1-210700bcdf06 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: a839aa71-2bd6-4676-8955-1d69072cd7f0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:07.333587 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-865ec821-57e8-43ea-afe1-210700bcdf06 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:07.334056 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-865ec821-57e8-43ea-afe1-210700bcdf06 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:07.334850 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-865ec821-57e8-43ea-afe1-210700bcdf06 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:07.335374 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-865ec821-57e8-43ea-afe1-210700bcdf06 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:07.429141 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7ca2795c-3a66-4c29-b486-bbb2c744db7c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:07.438479 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7ca2795c-3a66-4c29-b486-bbb2c744db7c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:07.442045 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7ca2795c-3a66-4c29-b486-bbb2c744db7c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:07.442045 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7ca2795c-3a66-4c29-b486-bbb2c744db7c tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1870 microversion: 2.32 time: 0.377824 Apr 16 21:15:07.442045 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1089/2281] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:07 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1870 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:15:07.447077 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5cb44652-6c57-4de9-bd24-649b8428e165 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:07.448423 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5cb44652-6c57-4de9-bd24-649b8428e165 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:07.454326 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5cb44652-6c57-4de9-bd24-649b8428e165 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:07.454782 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5cb44652-6c57-4de9-bd24-649b8428e165 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:07.455561 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5cb44652-6c57-4de9-bd24-649b8428e165 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:07.456002 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5cb44652-6c57-4de9-bd24-649b8428e165 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:07.478642 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-865ec821-57e8-43ea-afe1-210700bcdf06 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2bab3afb0f945eca1a7bf9f783cf9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec2ad232d62489aa704075fad5305c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:07.486158 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-865ec821-57e8-43ea-afe1-210700bcdf06 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "GET /compute/v2.1/servers/a839aa71-2bd6-4676-8955-1d69072cd7f0" status: 200 len: 1320 microversion: 2.1 time: 0.163596 Apr 16 21:15:07.486734 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1193/2282] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:07 2022] GET /compute/v2.1/servers/a839aa71-2bd6-4676-8955-1d69072cd7f0 => generated 1320 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:08.021509 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-935cf5ad-ccb2-4700-a77e-b96200dd72da tempest-ImagesDeleteNegativeTestJSON-1550478414 tempest-ImagesDeleteNegativeTestJSON-1550478414-project] 10.222.0.20 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.172107 Apr 16 21:15:08.022061 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1194/2283] 10.222.0.20 () {58 vars in 1127 bytes} [Sat Apr 16 21:15:07 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Apr 16 21:15:08.032515 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-7bd51135-3363-4587-9397-fa04fa0f6ebb req-86bfef71-6b2b-4722-878d-203ab4eff902 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "446a5909-7904-4290-9a61-015b0a1f5d40", "tag": "f42a9fb9-89c0-40cb-b996-9d91b0f13a6e"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:08.040587 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-7bd51135-3363-4587-9397-fa04fa0f6ebb req-86bfef71-6b2b-4722-878d-203ab4eff902 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:08.041435 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-7bd51135-3363-4587-9397-fa04fa0f6ebb req-86bfef71-6b2b-4722-878d-203ab4eff902 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:08.058812 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-7bd51135-3363-4587-9397-fa04fa0f6ebb req-86bfef71-6b2b-4722-878d-203ab4eff902 service nova] Creating event network-changed:f42a9fb9-89c0-40cb-b996-9d91b0f13a6e for instance 446a5909-7904-4290-9a61-015b0a1f5d40 on nch1-master-1 Apr 16 21:15:08.065139 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-7bd51135-3363-4587-9397-fa04fa0f6ebb req-86bfef71-6b2b-4722-878d-203ab4eff902 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041513 Apr 16 21:15:08.066053 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1195/2284] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:15:08.075074 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6635af30-dcd2-42af-8957-34a11a6bfdae tempest-ImagesDeleteNegativeTestJSON-1550478414 tempest-ImagesDeleteNegativeTestJSON-1550478414-project] Calling method '.version_select at 0x7fbba0076670>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:08.102062 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-6635af30-dcd2-42af-8957-34a11a6bfdae tempest-ImagesDeleteNegativeTestJSON-1550478414 tempest-ImagesDeleteNegativeTestJSON-1550478414-project] HTTP exception thrown: Image not found. Apr 16 21:15:08.102062 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6635af30-dcd2-42af-8957-34a11a6bfdae tempest-ImagesDeleteNegativeTestJSON-1550478414 tempest-ImagesDeleteNegativeTestJSON-1550478414-project] Returning 404 to user: Image not found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:15:08.102062 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6635af30-dcd2-42af-8957-34a11a6bfdae tempest-ImagesDeleteNegativeTestJSON-1550478414 tempest-ImagesDeleteNegativeTestJSON-1550478414-project] 10.222.0.20 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.034359 Apr 16 21:15:08.102520 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1196/2285] 10.222.0.20 () {58 vars in 1133 bytes} [Sat Apr 16 21:15:08 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:15:08.111483 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9df840f0-e318-49fe-b9a5-2195e2eec9bf tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:08.112326 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9df840f0-e318-49fe-b9a5-2195e2eec9bf tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:08.131134 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9df840f0-e318-49fe-b9a5-2195e2eec9bf tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:08.132382 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9df840f0-e318-49fe-b9a5-2195e2eec9bf tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:08.134110 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9df840f0-e318-49fe-b9a5-2195e2eec9bf tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:08.134789 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9df840f0-e318-49fe-b9a5-2195e2eec9bf tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:08.294397 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5cb44652-6c57-4de9-bd24-649b8428e165 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:08.306402 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5cb44652-6c57-4de9-bd24-649b8428e165 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1497 microversion: 2.1 time: 0.863422 Apr 16 21:15:08.310457 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1090/2286] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:07 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1497 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:08.326131 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-27cc090d-2d2c-427c-a116-eee0da2e7d01 tempest-ImagesDeleteNegativeTestJSON-1550478414 tempest-ImagesDeleteNegativeTestJSON-1550478414-project] Calling method '.version_select at 0x7fbba00b2ee0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:08.374913 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-27cc090d-2d2c-427c-a116-eee0da2e7d01 tempest-ImagesDeleteNegativeTestJSON-1550478414 tempest-ImagesDeleteNegativeTestJSON-1550478414-project] HTTP exception thrown: Image not found. Apr 16 21:15:08.375742 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-27cc090d-2d2c-427c-a116-eee0da2e7d01 tempest-ImagesDeleteNegativeTestJSON-1550478414 tempest-ImagesDeleteNegativeTestJSON-1550478414-project] Returning 404 to user: Image not found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:15:08.376795 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-27cc090d-2d2c-427c-a116-eee0da2e7d01 tempest-ImagesDeleteNegativeTestJSON-1550478414 tempest-ImagesDeleteNegativeTestJSON-1550478414-project] 10.222.0.20 "DELETE /compute/v2.1/images/ce38c7be-655e-44f4-86cd-2150dbb4e5ej" status: 404 len: 62 microversion: 2.1 time: 0.065230 Apr 16 21:15:08.377843 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1091/2287] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:08 2022] DELETE /compute/v2.1/images/ce38c7be-655e-44f4-86cd-2150dbb4e5ej => generated 62 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:15:08.378767 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9df840f0-e318-49fe-b9a5-2195e2eec9bf tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:08.382826 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-616748ef-e0c3-456b-9727-8f34ed8bb0f5 req-b8f737f8-c1b0-4f91-a48c-14dbeb6e1271 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf669403-03eb-40c7-9a11-3d0422f708c7", "name": "network-vif-plugged", "status": "completed", "tag": "973da309-126f-4308-a6f4-32352abab6e7"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:08.392328 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9df840f0-e318-49fe-b9a5-2195e2eec9bf tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 200 len: 1477 microversion: 2.1 time: 0.288930 Apr 16 21:15:08.403238 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-616748ef-e0c3-456b-9727-8f34ed8bb0f5 req-b8f737f8-c1b0-4f91-a48c-14dbeb6e1271 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:08.407588 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1197/2288] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:08 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 1477 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:08.410675 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-616748ef-e0c3-456b-9727-8f34ed8bb0f5 req-b8f737f8-c1b0-4f91-a48c-14dbeb6e1271 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:08.413517 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1c688b3f-5ee0-4c54-9550-d6de0ed7b1d7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:08.414364 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1c688b3f-5ee0-4c54-9550-d6de0ed7b1d7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:08.422975 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1c688b3f-5ee0-4c54-9550-d6de0ed7b1d7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:08.423712 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1c688b3f-5ee0-4c54-9550-d6de0ed7b1d7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:08.424732 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1c688b3f-5ee0-4c54-9550-d6de0ed7b1d7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:08.425384 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1c688b3f-5ee0-4c54-9550-d6de0ed7b1d7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:08.432495 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-616748ef-e0c3-456b-9727-8f34ed8bb0f5 req-b8f737f8-c1b0-4f91-a48c-14dbeb6e1271 service nova] Creating event network-vif-plugged:973da309-126f-4308-a6f4-32352abab6e7 for instance cf669403-03eb-40c7-9a11-3d0422f708c7 on nch2-master-1 Apr 16 21:15:08.459186 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-616748ef-e0c3-456b-9727-8f34ed8bb0f5 req-b8f737f8-c1b0-4f91-a48c-14dbeb6e1271 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079707 Apr 16 21:15:08.460890 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1092/2289] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:15:08.473910 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d7c759aa-2e9d-426a-b09e-f968fa8cdfe6 tempest-ImagesDeleteNegativeTestJSON-1550478414 tempest-ImagesDeleteNegativeTestJSON-1550478414-project] Calling method '.version_select at 0x7fbb96252ca0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:08.498781 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-d7c759aa-2e9d-426a-b09e-f968fa8cdfe6 tempest-ImagesDeleteNegativeTestJSON-1550478414 tempest-ImagesDeleteNegativeTestJSON-1550478414-project] HTTP exception thrown: Image not found. Apr 16 21:15:08.499409 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d7c759aa-2e9d-426a-b09e-f968fa8cdfe6 tempest-ImagesDeleteNegativeTestJSON-1550478414 tempest-ImagesDeleteNegativeTestJSON-1550478414-project] Returning 404 to user: Image not found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:15:08.500289 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d7c759aa-2e9d-426a-b09e-f968fa8cdfe6 tempest-ImagesDeleteNegativeTestJSON-1550478414 tempest-ImagesDeleteNegativeTestJSON-1550478414-project] 10.222.0.20 "DELETE /compute/v2.1/images/30f39651-25f3-4879-a697-c9954d3a34f21" status: 404 len: 62 microversion: 2.1 time: 0.037373 Apr 16 21:15:08.500853 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1093/2290] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:15:08 2022] DELETE /compute/v2.1/images/30f39651-25f3-4879-a697-c9954d3a34f21 => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:15:08.510508 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cd949ab5-f6fb-49ed-9a9a-0a189f6bd4b6 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:08.511270 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-cd949ab5-f6fb-49ed-9a9a-0a189f6bd4b6 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:08.539384 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cd949ab5-f6fb-49ed-9a9a-0a189f6bd4b6 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:08.540111 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cd949ab5-f6fb-49ed-9a9a-0a189f6bd4b6 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:08.541033 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cd949ab5-f6fb-49ed-9a9a-0a189f6bd4b6 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:08.541988 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cd949ab5-f6fb-49ed-9a9a-0a189f6bd4b6 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:09.053590 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cd949ab5-f6fb-49ed-9a9a-0a189f6bd4b6 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:09.080118 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cd949ab5-f6fb-49ed-9a9a-0a189f6bd4b6 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:09.083030 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cd949ab5-f6fb-49ed-9a9a-0a189f6bd4b6 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:09.091247 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1c688b3f-5ee0-4c54-9550-d6de0ed7b1d7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:09.105584 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cd949ab5-f6fb-49ed-9a9a-0a189f6bd4b6 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1870 microversion: 2.32 time: 0.600209 Apr 16 21:15:09.107094 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1094/2291] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:08 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1870 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:15:09.113155 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1c688b3f-5ee0-4c54-9550-d6de0ed7b1d7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1683 microversion: 2.1 time: 0.700622 Apr 16 21:15:09.114491 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1198/2292] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:08 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1683 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:09.140128 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bf3da436-734e-4d2e-bb83-b070af1ec8f1 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:09.144365 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-14bfe870-fa95-4d54-ab4f-dd0d4c064242 tempest-ImagesDeleteNegativeTestJSON-1550478414 tempest-ImagesDeleteNegativeTestJSON-1550478414-project] Calling method '.version_select at 0x7fbb9ff430d0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:09.145329 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bf3da436-734e-4d2e-bb83-b070af1ec8f1 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: a839aa71-2bd6-4676-8955-1d69072cd7f0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:09.185526 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-14bfe870-fa95-4d54-ab4f-dd0d4c064242 tempest-ImagesDeleteNegativeTestJSON-1550478414 tempest-ImagesDeleteNegativeTestJSON-1550478414-project] HTTP exception thrown: Image not found. Apr 16 21:15:09.188310 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bf3da436-734e-4d2e-bb83-b070af1ec8f1 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:09.189638 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-14bfe870-fa95-4d54-ab4f-dd0d4c064242 tempest-ImagesDeleteNegativeTestJSON-1550478414 tempest-ImagesDeleteNegativeTestJSON-1550478414-project] Returning 404 to user: Image not found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:15:09.190354 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bf3da436-734e-4d2e-bb83-b070af1ec8f1 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:09.192276 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-14bfe870-fa95-4d54-ab4f-dd0d4c064242 tempest-ImagesDeleteNegativeTestJSON-1550478414 tempest-ImagesDeleteNegativeTestJSON-1550478414-project] 10.222.0.20 "DELETE /compute/v2.1/images/tempest-invalid-837555927" status: 404 len: 62 microversion: 2.1 time: 0.074577 Apr 16 21:15:09.196635 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bf3da436-734e-4d2e-bb83-b070af1ec8f1 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:09.196635 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bf3da436-734e-4d2e-bb83-b070af1ec8f1 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:09.198528 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1199/2293] 10.222.0.20 () {58 vars in 1202 bytes} [Sat Apr 16 21:15:09 2022] DELETE /compute/v2.1/images/tempest-invalid-837555927 => generated 62 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:15:09.219578 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f162f8a9-4120-4838-8c62-7f744a363547 tempest-ImagesDeleteNegativeTestJSON-1550478414 tempest-ImagesDeleteNegativeTestJSON-1550478414-project] Calling method '.version_select at 0x7fbb96c37a60>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:09.263204 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-f162f8a9-4120-4838-8c62-7f744a363547 tempest-ImagesDeleteNegativeTestJSON-1550478414 tempest-ImagesDeleteNegativeTestJSON-1550478414-project] HTTP exception thrown: Image not found. Apr 16 21:15:09.264462 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f162f8a9-4120-4838-8c62-7f744a363547 tempest-ImagesDeleteNegativeTestJSON-1550478414 tempest-ImagesDeleteNegativeTestJSON-1550478414-project] Returning 404 to user: Image not found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:15:09.266292 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f162f8a9-4120-4838-8c62-7f744a363547 tempest-ImagesDeleteNegativeTestJSON-1550478414 tempest-ImagesDeleteNegativeTestJSON-1550478414-project] 10.222.0.20 "DELETE /compute/v2.1/images/200d27fe-a6ab-4032-ac1f-ec9be360db99" status: 404 len: 62 microversion: 2.1 time: 0.055201 Apr 16 21:15:09.268001 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1200/2294] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:09 2022] DELETE /compute/v2.1/images/200d27fe-a6ab-4032-ac1f-ec9be360db99 => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:15:09.328524 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f334e132-0ad0-4061-9031-1cfc0ba365cc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:09.329341 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f334e132-0ad0-4061-9031-1cfc0ba365cc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:09.340122 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f334e132-0ad0-4061-9031-1cfc0ba365cc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:09.340809 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f334e132-0ad0-4061-9031-1cfc0ba365cc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:09.341734 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f334e132-0ad0-4061-9031-1cfc0ba365cc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:09.343366 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f334e132-0ad0-4061-9031-1cfc0ba365cc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:09.591116 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f334e132-0ad0-4061-9031-1cfc0ba365cc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:09.599392 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f334e132-0ad0-4061-9031-1cfc0ba365cc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1497 microversion: 2.1 time: 0.274999 Apr 16 21:15:09.599984 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1201/2295] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:09 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1497 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:15:09.605592 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9b316681-5a82-4620-9fd3-756c1a08cbf3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:09.606412 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9b316681-5a82-4620-9fd3-756c1a08cbf3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:09.612822 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9b316681-5a82-4620-9fd3-756c1a08cbf3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:09.613777 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9b316681-5a82-4620-9fd3-756c1a08cbf3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:09.614798 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9b316681-5a82-4620-9fd3-756c1a08cbf3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:09.616030 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9b316681-5a82-4620-9fd3-756c1a08cbf3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:09.658400 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-bf3da436-734e-4d2e-bb83-b070af1ec8f1 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2bab3afb0f945eca1a7bf9f783cf9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec2ad232d62489aa704075fad5305c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:09.692009 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bf3da436-734e-4d2e-bb83-b070af1ec8f1 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "GET /compute/v2.1/servers/a839aa71-2bd6-4676-8955-1d69072cd7f0" status: 200 len: 1320 microversion: 2.1 time: 0.578866 Apr 16 21:15:09.693341 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1095/2296] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:09 2022] GET /compute/v2.1/servers/a839aa71-2bd6-4676-8955-1d69072cd7f0 => generated 1320 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:09.858105 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9b316681-5a82-4620-9fd3-756c1a08cbf3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:09.864267 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9b316681-5a82-4620-9fd3-756c1a08cbf3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 200 len: 1477 microversion: 2.1 time: 0.262941 Apr 16 21:15:09.865323 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1202/2297] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:09 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 1477 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:10.128355 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a14d698a-292e-4ad4-9489-470b8cce30d6 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:10.129284 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a14d698a-292e-4ad4-9489-470b8cce30d6 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:10.131849 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-40b3bfc2-a81c-410c-9cb4-884b2f8e7597 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:10.132511 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-40b3bfc2-a81c-410c-9cb4-884b2f8e7597 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:10.143295 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40b3bfc2-a81c-410c-9cb4-884b2f8e7597 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:10.143671 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a14d698a-292e-4ad4-9489-470b8cce30d6 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:10.145199 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a14d698a-292e-4ad4-9489-470b8cce30d6 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:10.146358 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40b3bfc2-a81c-410c-9cb4-884b2f8e7597 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:10.148930 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40b3bfc2-a81c-410c-9cb4-884b2f8e7597 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:10.149210 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a14d698a-292e-4ad4-9489-470b8cce30d6 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:10.149445 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40b3bfc2-a81c-410c-9cb4-884b2f8e7597 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:10.150952 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a14d698a-292e-4ad4-9489-470b8cce30d6 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:10.372961 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-40b3bfc2-a81c-410c-9cb4-884b2f8e7597 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:10.382233 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-40b3bfc2-a81c-410c-9cb4-884b2f8e7597 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1683 microversion: 2.1 time: 0.255154 Apr 16 21:15:10.397823 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1203/2298] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:10 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1683 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:10.403607 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-0caa1554-ea61-4ccd-9b32-2f248a779e80 req-d9e35e3a-bf6f-4588-b036-035bc01a3306 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a839aa71-2bd6-4676-8955-1d69072cd7f0", "tag": "e95787b0-2955-4c9d-b856-d0002bfc2eb5"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:10.432461 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-0caa1554-ea61-4ccd-9b32-2f248a779e80 req-d9e35e3a-bf6f-4588-b036-035bc01a3306 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:10.432923 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-0caa1554-ea61-4ccd-9b32-2f248a779e80 req-d9e35e3a-bf6f-4588-b036-035bc01a3306 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:10.455206 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-0caa1554-ea61-4ccd-9b32-2f248a779e80 req-d9e35e3a-bf6f-4588-b036-035bc01a3306 service nova] Creating event network-changed:e95787b0-2955-4c9d-b856-d0002bfc2eb5 for instance a839aa71-2bd6-4676-8955-1d69072cd7f0 on nch1-master-1 Apr 16 21:15:10.464052 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a14d698a-292e-4ad4-9489-470b8cce30d6 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:10.469537 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-0caa1554-ea61-4ccd-9b32-2f248a779e80 req-d9e35e3a-bf6f-4588-b036-035bc01a3306 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070085 Apr 16 21:15:10.471945 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1204/2299] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:15:10.479151 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a14d698a-292e-4ad4-9489-470b8cce30d6 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:10.485714 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a14d698a-292e-4ad4-9489-470b8cce30d6 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:10.486831 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a14d698a-292e-4ad4-9489-470b8cce30d6 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1870 microversion: 2.32 time: 0.364240 Apr 16 21:15:10.487440 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-88bf32c3-9057-4e30-bff1-173e39907146 req-aed36988-5764-44dd-a8e6-9de27508f391 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf669403-03eb-40c7-9a11-3d0422f708c7", "name": "network-vif-plugged", "status": "completed", "tag": "89946b61-fbf7-4964-8abf-1d6403aac9ec"}, {"server_uuid": "cf669403-03eb-40c7-9a11-3d0422f708c7", "name": "network-vif-plugged", "status": "completed", "tag": "90479900-4d72-46a0-92ee-feff9e50d619"}, {"server_uuid": "cf669403-03eb-40c7-9a11-3d0422f708c7", "name": "network-vif-plugged", "status": "completed", "tag": "b6827444-dd7b-4b83-a82d-0112e07ad27f"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:10.488285 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1096/2300] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:10 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1870 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:15:10.504855 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-88bf32c3-9057-4e30-bff1-173e39907146 req-aed36988-5764-44dd-a8e6-9de27508f391 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:10.505316 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-88bf32c3-9057-4e30-bff1-173e39907146 req-aed36988-5764-44dd-a8e6-9de27508f391 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:10.517573 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-88bf32c3-9057-4e30-bff1-173e39907146 req-aed36988-5764-44dd-a8e6-9de27508f391 service nova] Creating event network-vif-plugged:89946b61-fbf7-4964-8abf-1d6403aac9ec for instance cf669403-03eb-40c7-9a11-3d0422f708c7 on nch2-master-1 Apr 16 21:15:10.518615 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-88bf32c3-9057-4e30-bff1-173e39907146 req-aed36988-5764-44dd-a8e6-9de27508f391 service nova] Creating event network-vif-plugged:90479900-4d72-46a0-92ee-feff9e50d619 for instance cf669403-03eb-40c7-9a11-3d0422f708c7 on nch2-master-1 Apr 16 21:15:10.519321 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-88bf32c3-9057-4e30-bff1-173e39907146 req-aed36988-5764-44dd-a8e6-9de27508f391 service nova] Creating event network-vif-plugged:b6827444-dd7b-4b83-a82d-0112e07ad27f for instance cf669403-03eb-40c7-9a11-3d0422f708c7 on nch2-master-1 Apr 16 21:15:10.526202 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-88bf32c3-9057-4e30-bff1-173e39907146 req-aed36988-5764-44dd-a8e6-9de27508f391 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.042821 Apr 16 21:15:10.527563 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1205/2301] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:15:10.617183 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5b563380-254e-4f30-9d0a-fd1de194c0f5 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:10.618171 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5b563380-254e-4f30-9d0a-fd1de194c0f5 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:10.631194 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5b563380-254e-4f30-9d0a-fd1de194c0f5 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:10.632051 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5b563380-254e-4f30-9d0a-fd1de194c0f5 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:10.633675 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5b563380-254e-4f30-9d0a-fd1de194c0f5 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:10.634432 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5b563380-254e-4f30-9d0a-fd1de194c0f5 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:10.710268 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-eb21336a-2095-4df9-b2a3-6e46b0d74a68 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:10.710909 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-eb21336a-2095-4df9-b2a3-6e46b0d74a68 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: a839aa71-2bd6-4676-8955-1d69072cd7f0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:10.734132 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eb21336a-2095-4df9-b2a3-6e46b0d74a68 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:10.734132 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eb21336a-2095-4df9-b2a3-6e46b0d74a68 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:10.734132 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eb21336a-2095-4df9-b2a3-6e46b0d74a68 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:10.734132 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eb21336a-2095-4df9-b2a3-6e46b0d74a68 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:10.982290 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-eb21336a-2095-4df9-b2a3-6e46b0d74a68 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2bab3afb0f945eca1a7bf9f783cf9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec2ad232d62489aa704075fad5305c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:10.993443 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-eb21336a-2095-4df9-b2a3-6e46b0d74a68 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "GET /compute/v2.1/servers/a839aa71-2bd6-4676-8955-1d69072cd7f0" status: 200 len: 1320 microversion: 2.1 time: 0.287380 Apr 16 21:15:10.995367 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1206/2302] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:10 2022] GET /compute/v2.1/servers/a839aa71-2bd6-4676-8955-1d69072cd7f0 => generated 1320 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:11.000725 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-55f73db0-a7f1-4578-ac9f-7c555facccb3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:11.002071 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-55f73db0-a7f1-4578-ac9f-7c555facccb3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:11.011871 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-55f73db0-a7f1-4578-ac9f-7c555facccb3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:11.013005 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-55f73db0-a7f1-4578-ac9f-7c555facccb3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:11.014965 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-55f73db0-a7f1-4578-ac9f-7c555facccb3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:11.015658 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-55f73db0-a7f1-4578-ac9f-7c555facccb3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:11.051765 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5b563380-254e-4f30-9d0a-fd1de194c0f5 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:11.075585 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5b563380-254e-4f30-9d0a-fd1de194c0f5 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1497 microversion: 2.1 time: 0.462957 Apr 16 21:15:11.077501 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1097/2303] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:10 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1497 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:11.187244 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-55f73db0-a7f1-4578-ac9f-7c555facccb3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:11.195941 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-55f73db0-a7f1-4578-ac9f-7c555facccb3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 200 len: 1477 microversion: 2.1 time: 0.199321 Apr 16 21:15:11.196936 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1207/2304] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:10 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 1477 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:11.403147 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9e63ac8b-36c2-44d4-9a10-00a9fef18cae tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:11.404140 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9e63ac8b-36c2-44d4-9a10-00a9fef18cae tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:11.416880 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9e63ac8b-36c2-44d4-9a10-00a9fef18cae tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:11.421642 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9e63ac8b-36c2-44d4-9a10-00a9fef18cae tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:11.423345 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9e63ac8b-36c2-44d4-9a10-00a9fef18cae tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:11.425197 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9e63ac8b-36c2-44d4-9a10-00a9fef18cae tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:11.508262 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3980a9f9-9a40-4c1b-9b78-ad657223725d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:11.509215 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3980a9f9-9a40-4c1b-9b78-ad657223725d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:11.521121 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3980a9f9-9a40-4c1b-9b78-ad657223725d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:11.523164 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3980a9f9-9a40-4c1b-9b78-ad657223725d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:11.524426 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3980a9f9-9a40-4c1b-9b78-ad657223725d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:11.525114 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3980a9f9-9a40-4c1b-9b78-ad657223725d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:11.887980 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3980a9f9-9a40-4c1b-9b78-ad657223725d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:11.900552 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3980a9f9-9a40-4c1b-9b78-ad657223725d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:11.904408 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3980a9f9-9a40-4c1b-9b78-ad657223725d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:11.905432 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3980a9f9-9a40-4c1b-9b78-ad657223725d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1870 microversion: 2.32 time: 0.400557 Apr 16 21:15:11.907151 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1208/2305] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:11 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1870 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:15:12.016936 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a31fd8e4-4b13-4cff-a0c2-d6d90069e1bc tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:12.017901 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a31fd8e4-4b13-4cff-a0c2-d6d90069e1bc tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: a839aa71-2bd6-4676-8955-1d69072cd7f0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:12.054105 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9e63ac8b-36c2-44d4-9a10-00a9fef18cae tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:12.057403 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a31fd8e4-4b13-4cff-a0c2-d6d90069e1bc tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:12.057999 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a31fd8e4-4b13-4cff-a0c2-d6d90069e1bc tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:12.058898 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a31fd8e4-4b13-4cff-a0c2-d6d90069e1bc tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:12.059514 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a31fd8e4-4b13-4cff-a0c2-d6d90069e1bc tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:12.064310 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9e63ac8b-36c2-44d4-9a10-00a9fef18cae tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1683 microversion: 2.1 time: 0.665737 Apr 16 21:15:12.075337 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1098/2306] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:11 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1683 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:12.092941 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1490221f-21b4-4b0b-a89d-ce8b2fc8db9d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:12.097812 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1490221f-21b4-4b0b-a89d-ce8b2fc8db9d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:12.120990 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1490221f-21b4-4b0b-a89d-ce8b2fc8db9d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:12.122806 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1490221f-21b4-4b0b-a89d-ce8b2fc8db9d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:12.125589 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1490221f-21b4-4b0b-a89d-ce8b2fc8db9d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:12.129341 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1490221f-21b4-4b0b-a89d-ce8b2fc8db9d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:12.315197 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a31fd8e4-4b13-4cff-a0c2-d6d90069e1bc tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2bab3afb0f945eca1a7bf9f783cf9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec2ad232d62489aa704075fad5305c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:12.326382 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a31fd8e4-4b13-4cff-a0c2-d6d90069e1bc tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "GET /compute/v2.1/servers/a839aa71-2bd6-4676-8955-1d69072cd7f0" status: 200 len: 1320 microversion: 2.1 time: 0.315673 Apr 16 21:15:12.336842 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1209/2307] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:12 2022] GET /compute/v2.1/servers/a839aa71-2bd6-4676-8955-1d69072cd7f0 => generated 1320 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:12.342949 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c244675e-7c1e-4705-8f72-3fe07d5f721e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:12.343959 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c244675e-7c1e-4705-8f72-3fe07d5f721e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:12.354410 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c244675e-7c1e-4705-8f72-3fe07d5f721e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:12.355159 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c244675e-7c1e-4705-8f72-3fe07d5f721e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:12.356126 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c244675e-7c1e-4705-8f72-3fe07d5f721e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:12.357166 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c244675e-7c1e-4705-8f72-3fe07d5f721e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:12.444704 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1490221f-21b4-4b0b-a89d-ce8b2fc8db9d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:12.454710 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1490221f-21b4-4b0b-a89d-ce8b2fc8db9d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1497 microversion: 2.1 time: 0.365543 Apr 16 21:15:12.470270 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1099/2308] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:12 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1497 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:12.557362 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-0abbf210-331f-4634-9751-9040daff5b6a req-603d3ff9-f44a-489d-81c6-3846b2ab6b35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf669403-03eb-40c7-9a11-3d0422f708c7", "name": "network-vif-plugged", "status": "completed", "tag": "c6438618-4e2e-4e98-a08e-fdf410282f72"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:12.579612 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-0abbf210-331f-4634-9751-9040daff5b6a req-603d3ff9-f44a-489d-81c6-3846b2ab6b35 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:12.580079 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-0abbf210-331f-4634-9751-9040daff5b6a req-603d3ff9-f44a-489d-81c6-3846b2ab6b35 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:12.613500 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-0abbf210-331f-4634-9751-9040daff5b6a req-603d3ff9-f44a-489d-81c6-3846b2ab6b35 service nova] Creating event network-vif-plugged:c6438618-4e2e-4e98-a08e-fdf410282f72 for instance cf669403-03eb-40c7-9a11-3d0422f708c7 on nch2-master-1 Apr 16 21:15:12.626420 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-0abbf210-331f-4634-9751-9040daff5b6a req-603d3ff9-f44a-489d-81c6-3846b2ab6b35 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071319 Apr 16 21:15:12.627807 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1100/2309] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:15:12.633287 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c244675e-7c1e-4705-8f72-3fe07d5f721e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:12.642308 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c244675e-7c1e-4705-8f72-3fe07d5f721e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 200 len: 1477 microversion: 2.1 time: 0.303301 Apr 16 21:15:12.650707 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1210/2310] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:12 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 1477 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:12.937107 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-09236a64-df59-4f20-a910-1f5aab7f8d29 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:12.937941 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-09236a64-df59-4f20-a910-1f5aab7f8d29 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:12.948738 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-09236a64-df59-4f20-a910-1f5aab7f8d29 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:12.949520 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-09236a64-df59-4f20-a910-1f5aab7f8d29 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:12.950515 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-09236a64-df59-4f20-a910-1f5aab7f8d29 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:12.951200 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-09236a64-df59-4f20-a910-1f5aab7f8d29 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:13.102799 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2b3c6803-25ce-435d-8e7f-f3ab6ac9a769 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:13.102799 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2b3c6803-25ce-435d-8e7f-f3ab6ac9a769 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:13.108918 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b3c6803-25ce-435d-8e7f-f3ab6ac9a769 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:13.109449 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b3c6803-25ce-435d-8e7f-f3ab6ac9a769 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:13.110321 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b3c6803-25ce-435d-8e7f-f3ab6ac9a769 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:13.110775 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b3c6803-25ce-435d-8e7f-f3ab6ac9a769 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:13.259023 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-09236a64-df59-4f20-a910-1f5aab7f8d29 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:13.269232 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-09236a64-df59-4f20-a910-1f5aab7f8d29 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:13.270791 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-09236a64-df59-4f20-a910-1f5aab7f8d29 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:13.272012 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-09236a64-df59-4f20-a910-1f5aab7f8d29 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1870 microversion: 2.32 time: 0.345418 Apr 16 21:15:13.280961 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1101/2311] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:12 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1870 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:15:13.281075 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2b3c6803-25ce-435d-8e7f-f3ab6ac9a769 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:13.288953 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2b3c6803-25ce-435d-8e7f-f3ab6ac9a769 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1683 microversion: 2.1 time: 0.203094 Apr 16 21:15:13.289960 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1211/2312] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:13 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1683 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:13.344630 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b1668b23-8e50-4d2c-89a8-bf8b062e3af0 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:13.345362 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b1668b23-8e50-4d2c-89a8-bf8b062e3af0 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: a839aa71-2bd6-4676-8955-1d69072cd7f0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:13.351741 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b1668b23-8e50-4d2c-89a8-bf8b062e3af0 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:13.352096 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b1668b23-8e50-4d2c-89a8-bf8b062e3af0 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:13.352958 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b1668b23-8e50-4d2c-89a8-bf8b062e3af0 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:13.353382 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b1668b23-8e50-4d2c-89a8-bf8b062e3af0 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:13.473746 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b86b61fe-7c45-4f5b-a673-abed8294e6ba tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:13.474374 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b86b61fe-7c45-4f5b-a673-abed8294e6ba tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:13.481939 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b86b61fe-7c45-4f5b-a673-abed8294e6ba tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:13.482403 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b86b61fe-7c45-4f5b-a673-abed8294e6ba tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:13.483193 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b86b61fe-7c45-4f5b-a673-abed8294e6ba tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:13.483638 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b86b61fe-7c45-4f5b-a673-abed8294e6ba tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:13.487005 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b1668b23-8e50-4d2c-89a8-bf8b062e3af0 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2bab3afb0f945eca1a7bf9f783cf9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec2ad232d62489aa704075fad5305c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:13.494638 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b1668b23-8e50-4d2c-89a8-bf8b062e3af0 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "GET /compute/v2.1/servers/a839aa71-2bd6-4676-8955-1d69072cd7f0" status: 200 len: 1320 microversion: 2.1 time: 0.154148 Apr 16 21:15:13.495214 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1102/2313] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:13 2022] GET /compute/v2.1/servers/a839aa71-2bd6-4676-8955-1d69072cd7f0 => generated 1320 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:13.651099 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b86b61fe-7c45-4f5b-a673-abed8294e6ba tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:13.651099 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b86b61fe-7c45-4f5b-a673-abed8294e6ba tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1497 microversion: 2.1 time: 0.156251 Apr 16 21:15:13.651099 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1212/2314] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:13 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:15:13.665366 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-240803e2-0053-466d-965c-93841c2dfbb5 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:13.666016 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-240803e2-0053-466d-965c-93841c2dfbb5 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:13.672725 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-240803e2-0053-466d-965c-93841c2dfbb5 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:13.673188 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-240803e2-0053-466d-965c-93841c2dfbb5 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:13.673977 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-240803e2-0053-466d-965c-93841c2dfbb5 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:13.674443 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-240803e2-0053-466d-965c-93841c2dfbb5 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:13.810802 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-240803e2-0053-466d-965c-93841c2dfbb5 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:13.818412 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-240803e2-0053-466d-965c-93841c2dfbb5 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 200 len: 1477 microversion: 2.1 time: 0.156838 Apr 16 21:15:13.818984 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1103/2315] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:13 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 1477 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:14.294928 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c9a0c865-e087-48cf-9202-3817809a1c29 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:14.295634 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c9a0c865-e087-48cf-9202-3817809a1c29 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:14.309254 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c07529e6-3569-4ea5-9ebf-442e71b13113 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:14.310885 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c07529e6-3569-4ea5-9ebf-442e71b13113 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:14.318317 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c9a0c865-e087-48cf-9202-3817809a1c29 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:14.319181 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c9a0c865-e087-48cf-9202-3817809a1c29 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:14.320328 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c9a0c865-e087-48cf-9202-3817809a1c29 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:14.321501 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c9a0c865-e087-48cf-9202-3817809a1c29 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:14.322474 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c07529e6-3569-4ea5-9ebf-442e71b13113 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:14.324298 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c07529e6-3569-4ea5-9ebf-442e71b13113 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:14.325214 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c07529e6-3569-4ea5-9ebf-442e71b13113 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:14.326893 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c07529e6-3569-4ea5-9ebf-442e71b13113 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:14.536964 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c07529e6-3569-4ea5-9ebf-442e71b13113 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:14.547064 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c07529e6-3569-4ea5-9ebf-442e71b13113 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1683 microversion: 2.1 time: 0.242968 Apr 16 21:15:14.547966 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1104/2316] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:14 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1683 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:15:14.642135 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c9a0c865-e087-48cf-9202-3817809a1c29 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:14.656757 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c9a0c865-e087-48cf-9202-3817809a1c29 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:14.662747 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c9a0c865-e087-48cf-9202-3817809a1c29 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:14.663999 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c9a0c865-e087-48cf-9202-3817809a1c29 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1870 microversion: 2.32 time: 0.375089 Apr 16 21:15:14.676078 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1213/2317] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:14 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1870 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:15:14.676078 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-43ee773e-853e-4c2d-b65e-e81e633746f1 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:14.676078 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-43ee773e-853e-4c2d-b65e-e81e633746f1 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: a839aa71-2bd6-4676-8955-1d69072cd7f0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:14.681681 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-43ee773e-853e-4c2d-b65e-e81e633746f1 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:14.681964 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-43ee773e-853e-4c2d-b65e-e81e633746f1 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:14.682768 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-43ee773e-853e-4c2d-b65e-e81e633746f1 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:14.683215 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-43ee773e-853e-4c2d-b65e-e81e633746f1 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:14.750398 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0410a0a6-95ae-4387-9e09-8da60ea58c1f tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-776234812", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": "none"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:14.826204 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-0410a0a6-95ae-4387-9e09-8da60ea58c1f tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:15:14.826956 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-0410a0a6-95ae-4387-9e09-8da60ea58c1f tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:15:14.827566 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-0410a0a6-95ae-4387-9e09-8da60ea58c1f tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:15:14.828058 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-0410a0a6-95ae-4387-9e09-8da60ea58c1f tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:15:14.828587 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-0410a0a6-95ae-4387-9e09-8da60ea58c1f tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:15:14.843574 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0410a0a6-95ae-4387-9e09-8da60ea58c1f tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:14.844138 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0410a0a6-95ae-4387-9e09-8da60ea58c1f tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:14.847902 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0410a0a6-95ae-4387-9e09-8da60ea58c1f tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:14.847902 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0410a0a6-95ae-4387-9e09-8da60ea58c1f tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:14.865066 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-0410a0a6-95ae-4387-9e09-8da60ea58c1f tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Getting quotas for project 70c257ac1872478aacd8b8a29b3c3420. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:15:14.871292 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-0410a0a6-95ae-4387-9e09-8da60ea58c1f tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Getting quotas for user a87f9fd93b204260ae387e6fa1802df3 and project 70c257ac1872478aacd8b8a29b3c3420. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:15:14.881485 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-43ee773e-853e-4c2d-b65e-e81e633746f1 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2bab3afb0f945eca1a7bf9f783cf9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec2ad232d62489aa704075fad5305c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:14.884680 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0410a0a6-95ae-4387-9e09-8da60ea58c1f tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:15:14.887203 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0410a0a6-95ae-4387-9e09-8da60ea58c1f tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:15:14.898035 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-43ee773e-853e-4c2d-b65e-e81e633746f1 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "GET /compute/v2.1/servers/a839aa71-2bd6-4676-8955-1d69072cd7f0" status: 200 len: 1320 microversion: 2.1 time: 0.230459 Apr 16 21:15:14.898966 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1214/2318] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:14 2022] GET /compute/v2.1/servers/a839aa71-2bd6-4676-8955-1d69072cd7f0 => generated 1320 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:14.913205 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3219445b-309a-46ea-8631-b0f205f05228 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:14.913831 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3219445b-309a-46ea-8631-b0f205f05228 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:14.926388 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3219445b-309a-46ea-8631-b0f205f05228 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:14.926873 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3219445b-309a-46ea-8631-b0f205f05228 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:14.927776 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3219445b-309a-46ea-8631-b0f205f05228 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:14.928657 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3219445b-309a-46ea-8631-b0f205f05228 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:15.066837 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0410a0a6-95ae-4387-9e09-8da60ea58c1f tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.517467 Apr 16 21:15:15.067817 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1105/2319] 10.222.0.20 () {62 vars in 1187 bytes} [Sat Apr 16 21:15:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 16 21:15:15.079677 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-d997a269-da8b-43fd-b182-b47e01c14d95 req-bc5fe863-18a6-4a31-94ba-19b46590f7d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf669403-03eb-40c7-9a11-3d0422f708c7", "name": "network-vif-plugged", "status": "completed", "tag": "289d892c-efd8-4a45-8065-39c93c83ca97"}, {"server_uuid": "cf669403-03eb-40c7-9a11-3d0422f708c7", "name": "network-vif-plugged", "status": "completed", "tag": "3e5cf556-52a6-4c25-b89c-a2b9dc0b4a62"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:15.105887 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-d997a269-da8b-43fd-b182-b47e01c14d95 req-bc5fe863-18a6-4a31-94ba-19b46590f7d0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:15.105887 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-d997a269-da8b-43fd-b182-b47e01c14d95 req-bc5fe863-18a6-4a31-94ba-19b46590f7d0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:15.128798 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-d997a269-da8b-43fd-b182-b47e01c14d95 req-bc5fe863-18a6-4a31-94ba-19b46590f7d0 service nova] Creating event network-vif-plugged:289d892c-efd8-4a45-8065-39c93c83ca97 for instance cf669403-03eb-40c7-9a11-3d0422f708c7 on nch2-master-1 Apr 16 21:15:15.129319 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-d997a269-da8b-43fd-b182-b47e01c14d95 req-bc5fe863-18a6-4a31-94ba-19b46590f7d0 service nova] Creating event network-vif-plugged:3e5cf556-52a6-4c25-b89c-a2b9dc0b4a62 for instance cf669403-03eb-40c7-9a11-3d0422f708c7 on nch2-master-1 Apr 16 21:15:15.136605 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-d997a269-da8b-43fd-b182-b47e01c14d95 req-bc5fe863-18a6-4a31-94ba-19b46590f7d0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.061639 Apr 16 21:15:15.137116 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3219445b-309a-46ea-8631-b0f205f05228 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:15.137511 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1106/2320] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:15:15.142774 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a51a47d1-ee66-49e3-876b-12e975e94097 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:15.143603 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a51a47d1-ee66-49e3-876b-12e975e94097 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:15.149249 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3219445b-309a-46ea-8631-b0f205f05228 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1497 microversion: 2.1 time: 0.248719 Apr 16 21:15:15.150201 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1215/2321] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:14 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1497 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:15.150858 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a51a47d1-ee66-49e3-876b-12e975e94097 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:15.151331 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a51a47d1-ee66-49e3-876b-12e975e94097 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:15.152098 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a51a47d1-ee66-49e3-876b-12e975e94097 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:15.152803 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a51a47d1-ee66-49e3-876b-12e975e94097 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:15.155513 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6b79074e-f9b4-4cf0-9bba-ed9a870af52c tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:15.157865 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6b79074e-f9b4-4cf0-9bba-ed9a870af52c tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:15.265325 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6b79074e-f9b4-4cf0-9bba-ed9a870af52c tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:15.286351 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6b79074e-f9b4-4cf0-9bba-ed9a870af52c tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:15.297185 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6b79074e-f9b4-4cf0-9bba-ed9a870af52c tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:15.309944 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6b79074e-f9b4-4cf0-9bba-ed9a870af52c tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "PUT /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1358 microversion: 2.75 time: 0.158064 Apr 16 21:15:15.315662 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1216/2322] 10.222.0.20 () {62 vars in 1296 bytes} [Sat Apr 16 21:15:15 2022] PUT /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:15:15.329984 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f0b74dd7-ae70-4df1-8362-6c7a4ca7ecb1 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:15.331083 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f0b74dd7-ae70-4df1-8362-6c7a4ca7ecb1 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:15.417405 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f0b74dd7-ae70-4df1-8362-6c7a4ca7ecb1 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:15.427649 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f0b74dd7-ae70-4df1-8362-6c7a4ca7ecb1 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:15.429791 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f0b74dd7-ae70-4df1-8362-6c7a4ca7ecb1 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:15.438373 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f0b74dd7-ae70-4df1-8362-6c7a4ca7ecb1 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1358 microversion: 2.75 time: 0.112495 Apr 16 21:15:15.439696 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1217/2323] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:15 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1358 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:15:15.566592 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f761dd98-d364-4d3e-b509-a83c74d7f170 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:15.567812 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f761dd98-d364-4d3e-b509-a83c74d7f170 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:15.576996 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f761dd98-d364-4d3e-b509-a83c74d7f170 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:15.577834 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f761dd98-d364-4d3e-b509-a83c74d7f170 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:15.579081 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f761dd98-d364-4d3e-b509-a83c74d7f170 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:15.580047 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f761dd98-d364-4d3e-b509-a83c74d7f170 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:15.779351 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f761dd98-d364-4d3e-b509-a83c74d7f170 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:15.788873 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f761dd98-d364-4d3e-b509-a83c74d7f170 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1683 microversion: 2.1 time: 0.227172 Apr 16 21:15:15.800143 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1218/2324] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:15 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1683 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:15:15.806129 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-59cfcc41-4f8d-4857-95c3-99e47c462476 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:15.807519 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-59cfcc41-4f8d-4857-95c3-99e47c462476 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:15.814034 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-59cfcc41-4f8d-4857-95c3-99e47c462476 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:15.814455 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-59cfcc41-4f8d-4857-95c3-99e47c462476 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:15.815438 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-59cfcc41-4f8d-4857-95c3-99e47c462476 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:15.815889 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-59cfcc41-4f8d-4857-95c3-99e47c462476 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:15.876342 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a51a47d1-ee66-49e3-876b-12e975e94097 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:15.884727 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a51a47d1-ee66-49e3-876b-12e975e94097 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 200 len: 1477 microversion: 2.1 time: 0.745978 Apr 16 21:15:15.888628 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1107/2325] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:15 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 1477 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:15.916419 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c4d2051e-7dea-45dc-a11d-dea6756b000c tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:15.917453 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c4d2051e-7dea-45dc-a11d-dea6756b000c tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: a839aa71-2bd6-4676-8955-1d69072cd7f0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:15.924985 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c4d2051e-7dea-45dc-a11d-dea6756b000c tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:15.925687 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c4d2051e-7dea-45dc-a11d-dea6756b000c tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:15.926678 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c4d2051e-7dea-45dc-a11d-dea6756b000c tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:15.927518 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c4d2051e-7dea-45dc-a11d-dea6756b000c tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:16.117787 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c4d2051e-7dea-45dc-a11d-dea6756b000c tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2bab3afb0f945eca1a7bf9f783cf9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec2ad232d62489aa704075fad5305c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:16.135644 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c4d2051e-7dea-45dc-a11d-dea6756b000c tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "GET /compute/v2.1/servers/a839aa71-2bd6-4676-8955-1d69072cd7f0" status: 200 len: 1320 microversion: 2.1 time: 0.221943 Apr 16 21:15:16.147710 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1108/2326] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:15 2022] GET /compute/v2.1/servers/a839aa71-2bd6-4676-8955-1d69072cd7f0 => generated 1320 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:16.166969 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-59cfcc41-4f8d-4857-95c3-99e47c462476 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:16.178976 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6feb42ce-3dd9-4eaa-a6c1-1a2bf8e492e1 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:16.179905 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6feb42ce-3dd9-4eaa-a6c1-1a2bf8e492e1 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:16.187613 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6feb42ce-3dd9-4eaa-a6c1-1a2bf8e492e1 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:16.188705 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6feb42ce-3dd9-4eaa-a6c1-1a2bf8e492e1 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:16.189720 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6feb42ce-3dd9-4eaa-a6c1-1a2bf8e492e1 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:16.190328 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6feb42ce-3dd9-4eaa-a6c1-1a2bf8e492e1 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:16.191025 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-59cfcc41-4f8d-4857-95c3-99e47c462476 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:16.195974 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-59cfcc41-4f8d-4857-95c3-99e47c462476 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:16.197889 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-59cfcc41-4f8d-4857-95c3-99e47c462476 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1870 microversion: 2.32 time: 0.396441 Apr 16 21:15:16.198476 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1219/2327] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:15 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1870 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:15:16.367024 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6feb42ce-3dd9-4eaa-a6c1-1a2bf8e492e1 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:16.377990 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6feb42ce-3dd9-4eaa-a6c1-1a2bf8e492e1 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1497 microversion: 2.1 time: 0.213807 Apr 16 21:15:16.381848 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1109/2328] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:16 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1497 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:15:16.461218 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5559eef9-fe2a-4876-80dc-d541072ee319 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:16.462078 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5559eef9-fe2a-4876-80dc-d541072ee319 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:16.612771 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5559eef9-fe2a-4876-80dc-d541072ee319 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:16.624539 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5559eef9-fe2a-4876-80dc-d541072ee319 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:16.624539 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5559eef9-fe2a-4876-80dc-d541072ee319 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:16.651657 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5559eef9-fe2a-4876-80dc-d541072ee319 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1358 microversion: 2.75 time: 0.195520 Apr 16 21:15:16.664228 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1220/2329] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:16 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1358 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:15:16.718220 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7610bc95-4e80-4467-8619-29aef5c0d0b6 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1224640236", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "ce54676e-63e2-4bec-8d37-78514d0685e3"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:16.780208 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-7610bc95-4e80-4467-8619-29aef5c0d0b6 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] validate_networks() for [('ce54676e-63e2-4bec-8d37-78514d0685e3', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:15:16.810020 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f8609936-eee5-490c-93ab-5e46aea75a0a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:16.810682 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f8609936-eee5-490c-93ab-5e46aea75a0a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:16.821217 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f8609936-eee5-490c-93ab-5e46aea75a0a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:16.823448 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f8609936-eee5-490c-93ab-5e46aea75a0a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:16.824936 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f8609936-eee5-490c-93ab-5e46aea75a0a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:16.825473 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f8609936-eee5-490c-93ab-5e46aea75a0a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:17.041050 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f8609936-eee5-490c-93ab-5e46aea75a0a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:17.050595 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f8609936-eee5-490c-93ab-5e46aea75a0a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1683 microversion: 2.1 time: 0.246713 Apr 16 21:15:17.051683 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1221/2330] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:16 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1683 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:17.058118 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1a93b214-e14c-4cc4-856e-00ba0cf3fe47 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:17.059582 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1a93b214-e14c-4cc4-856e-00ba0cf3fe47 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:17.066157 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1a93b214-e14c-4cc4-856e-00ba0cf3fe47 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:17.066939 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1a93b214-e14c-4cc4-856e-00ba0cf3fe47 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:17.068043 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1a93b214-e14c-4cc4-856e-00ba0cf3fe47 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:17.068800 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1a93b214-e14c-4cc4-856e-00ba0cf3fe47 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:17.295885 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-7610bc95-4e80-4467-8619-29aef5c0d0b6 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:15:17.296468 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-7610bc95-4e80-4467-8619-29aef5c0d0b6 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:15:17.296955 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-7610bc95-4e80-4467-8619-29aef5c0d0b6 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:15:17.297682 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-7610bc95-4e80-4467-8619-29aef5c0d0b6 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:15:17.298278 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-7610bc95-4e80-4467-8619-29aef5c0d0b6 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:15:17.309100 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1a93b214-e14c-4cc4-856e-00ba0cf3fe47 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:17.309468 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7610bc95-4e80-4467-8619-29aef5c0d0b6 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:17.309862 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7610bc95-4e80-4467-8619-29aef5c0d0b6 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:17.311024 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7610bc95-4e80-4467-8619-29aef5c0d0b6 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:17.311810 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7610bc95-4e80-4467-8619-29aef5c0d0b6 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:17.317095 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1a93b214-e14c-4cc4-856e-00ba0cf3fe47 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 200 len: 1477 microversion: 2.1 time: 0.263978 Apr 16 21:15:17.320316 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1222/2331] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:17 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 1477 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:17.324725 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-becf3c80-04e8-43b5-a704-038304edf67b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:17.325269 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-becf3c80-04e8-43b5-a704-038304edf67b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: a839aa71-2bd6-4676-8955-1d69072cd7f0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:17.335026 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-becf3c80-04e8-43b5-a704-038304edf67b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:17.336435 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-becf3c80-04e8-43b5-a704-038304edf67b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:17.337777 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-becf3c80-04e8-43b5-a704-038304edf67b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:17.338234 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-becf3c80-04e8-43b5-a704-038304edf67b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:17.349367 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-7610bc95-4e80-4467-8619-29aef5c0d0b6 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Getting quotas for project c63d4ed9df1548b88731e003044c32da. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:15:17.360877 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-7610bc95-4e80-4467-8619-29aef5c0d0b6 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Getting quotas for user 6230c967390f4c5f8d3b9580bac4b340 and project c63d4ed9df1548b88731e003044c32da. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:15:17.375564 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7610bc95-4e80-4467-8619-29aef5c0d0b6 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:15:17.380534 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7610bc95-4e80-4467-8619-29aef5c0d0b6 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:15:17.497584 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-becf3c80-04e8-43b5-a704-038304edf67b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2bab3afb0f945eca1a7bf9f783cf9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec2ad232d62489aa704075fad5305c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:17.507581 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-becf3c80-04e8-43b5-a704-038304edf67b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "GET /compute/v2.1/servers/a839aa71-2bd6-4676-8955-1d69072cd7f0" status: 200 len: 1320 microversion: 2.1 time: 0.187809 Apr 16 21:15:17.509781 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1223/2332] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:17 2022] GET /compute/v2.1/servers/a839aa71-2bd6-4676-8955-1d69072cd7f0 => generated 1320 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:17.513448 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-e225a055-7b99-459f-a417-98252d3f9ced req-91f991d8-0ea9-45af-a257-93895bbb9f9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "446a5909-7904-4290-9a61-015b0a1f5d40", "name": "network-vif-plugged", "status": "completed", "tag": "f42a9fb9-89c0-40cb-b996-9d91b0f13a6e"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:17.524196 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-e225a055-7b99-459f-a417-98252d3f9ced req-91f991d8-0ea9-45af-a257-93895bbb9f9b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:17.525492 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-e225a055-7b99-459f-a417-98252d3f9ced req-91f991d8-0ea9-45af-a257-93895bbb9f9b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:17.541442 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-e225a055-7b99-459f-a417-98252d3f9ced req-91f991d8-0ea9-45af-a257-93895bbb9f9b service nova] Creating event network-vif-plugged:f42a9fb9-89c0-40cb-b996-9d91b0f13a6e for instance 446a5909-7904-4290-9a61-015b0a1f5d40 on nch1-master-1 Apr 16 21:15:17.553991 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-e225a055-7b99-459f-a417-98252d3f9ced req-91f991d8-0ea9-45af-a257-93895bbb9f9b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044185 Apr 16 21:15:17.554604 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1224/2333] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:15:17.563433 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ff869929-c49b-4814-8fff-1690bef543f7 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:17.564414 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ff869929-c49b-4814-8fff-1690bef543f7 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:17.572425 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ff869929-c49b-4814-8fff-1690bef543f7 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:17.573284 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ff869929-c49b-4814-8fff-1690bef543f7 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:17.574336 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ff869929-c49b-4814-8fff-1690bef543f7 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:17.575093 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ff869929-c49b-4814-8fff-1690bef543f7 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:17.594281 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7610bc95-4e80-4467-8619-29aef5c0d0b6 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.966871 Apr 16 21:15:17.599958 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1110/2334] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:15:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 973 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:15:17.614311 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-942b8b7c-5266-43fa-8e50-1026e3873abc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:17.614946 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-942b8b7c-5266-43fa-8e50-1026e3873abc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:17.640207 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-942b8b7c-5266-43fa-8e50-1026e3873abc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:17.640627 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-942b8b7c-5266-43fa-8e50-1026e3873abc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:17.657234 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-942b8b7c-5266-43fa-8e50-1026e3873abc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:17.660208 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-942b8b7c-5266-43fa-8e50-1026e3873abc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:17.948984 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-942b8b7c-5266-43fa-8e50-1026e3873abc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:17.974636 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-942b8b7c-5266-43fa-8e50-1026e3873abc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1497 microversion: 2.1 time: 0.371871 Apr 16 21:15:17.988208 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1111/2335] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:17 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1497 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:17.995886 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-321004fb-363f-4aa3-a9c2-e7277dc1dab0 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:18.002306 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-321004fb-363f-4aa3-a9c2-e7277dc1dab0 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:18.200130 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ff869929-c49b-4814-8fff-1690bef543f7 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:18.200130 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ff869929-c49b-4814-8fff-1690bef543f7 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:18.200130 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ff869929-c49b-4814-8fff-1690bef543f7 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:18.200130 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ff869929-c49b-4814-8fff-1690bef543f7 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1870 microversion: 2.32 time: 0.511926 Apr 16 21:15:18.200130 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1225/2336] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:17 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1870 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:15:18.200130 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f2ebbbcb-12ad-43fb-8e74-c91c2f93de00 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:18.200130 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f2ebbbcb-12ad-43fb-8e74-c91c2f93de00 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:18.200130 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f2ebbbcb-12ad-43fb-8e74-c91c2f93de00 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:18.200130 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f2ebbbcb-12ad-43fb-8e74-c91c2f93de00 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:18.200130 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f2ebbbcb-12ad-43fb-8e74-c91c2f93de00 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:18.202686 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f2ebbbcb-12ad-43fb-8e74-c91c2f93de00 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:18.204364 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-321004fb-363f-4aa3-a9c2-e7277dc1dab0 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:18.204364 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-321004fb-363f-4aa3-a9c2-e7277dc1dab0 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f" status: 200 len: 1225 microversion: 2.1 time: 0.137522 Apr 16 21:15:18.204364 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1112/2337] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:17 2022] GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f => generated 1225 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:18.204364 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d87fc945-1198-4c0e-8502-fb7e3f176d79 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:18.204364 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d87fc945-1198-4c0e-8502-fb7e3f176d79 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:18.204364 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d87fc945-1198-4c0e-8502-fb7e3f176d79 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:18.204364 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d87fc945-1198-4c0e-8502-fb7e3f176d79 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:18.204364 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d87fc945-1198-4c0e-8502-fb7e3f176d79 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:18.204364 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d87fc945-1198-4c0e-8502-fb7e3f176d79 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:18.219381 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f2ebbbcb-12ad-43fb-8e74-c91c2f93de00 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:18.229555 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f2ebbbcb-12ad-43fb-8e74-c91c2f93de00 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:18.231220 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f2ebbbcb-12ad-43fb-8e74-c91c2f93de00 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:18.238061 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f2ebbbcb-12ad-43fb-8e74-c91c2f93de00 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1410 microversion: 2.75 time: 0.166212 Apr 16 21:15:18.238644 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1226/2338] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:18 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1410 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:15:18.287593 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d87fc945-1198-4c0e-8502-fb7e3f176d79 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:18.295406 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d87fc945-1198-4c0e-8502-fb7e3f176d79 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1683 microversion: 2.1 time: 0.165074 Apr 16 21:15:18.295977 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1113/2339] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:18 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:18.334201 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7ea48064-40ff-403d-8bd7-79ca5c563168 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:18.334828 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7ea48064-40ff-403d-8bd7-79ca5c563168 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:18.340940 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ea48064-40ff-403d-8bd7-79ca5c563168 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:18.341440 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ea48064-40ff-403d-8bd7-79ca5c563168 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:18.342231 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ea48064-40ff-403d-8bd7-79ca5c563168 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:18.342684 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ea48064-40ff-403d-8bd7-79ca5c563168 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:18.478032 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7ea48064-40ff-403d-8bd7-79ca5c563168 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:18.483680 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7ea48064-40ff-403d-8bd7-79ca5c563168 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 200 len: 1477 microversion: 2.1 time: 0.153285 Apr 16 21:15:18.484694 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1227/2340] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:18 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 1477 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:18.533036 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5dd59690-a01d-44e4-a69b-e87ba67ed182 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:18.533653 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5dd59690-a01d-44e4-a69b-e87ba67ed182 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: a839aa71-2bd6-4676-8955-1d69072cd7f0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:18.540246 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5dd59690-a01d-44e4-a69b-e87ba67ed182 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:18.540773 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5dd59690-a01d-44e4-a69b-e87ba67ed182 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:18.541575 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5dd59690-a01d-44e4-a69b-e87ba67ed182 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:18.542674 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5dd59690-a01d-44e4-a69b-e87ba67ed182 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:18.702548 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5dd59690-a01d-44e4-a69b-e87ba67ed182 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2bab3afb0f945eca1a7bf9f783cf9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec2ad232d62489aa704075fad5305c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:18.711543 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5dd59690-a01d-44e4-a69b-e87ba67ed182 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "GET /compute/v2.1/servers/a839aa71-2bd6-4676-8955-1d69072cd7f0" status: 200 len: 1320 microversion: 2.1 time: 0.183170 Apr 16 21:15:18.712971 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1114/2341] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:18 2022] GET /compute/v2.1/servers/a839aa71-2bd6-4676-8955-1d69072cd7f0 => generated 1320 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:18.993161 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d30f3ff3-e558-4484-986b-bb8d005bfe89 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:18.994882 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d30f3ff3-e558-4484-986b-bb8d005bfe89 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:19.002046 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d30f3ff3-e558-4484-986b-bb8d005bfe89 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:19.002516 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d30f3ff3-e558-4484-986b-bb8d005bfe89 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:19.003316 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d30f3ff3-e558-4484-986b-bb8d005bfe89 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:19.003773 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d30f3ff3-e558-4484-986b-bb8d005bfe89 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:19.167119 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d30f3ff3-e558-4484-986b-bb8d005bfe89 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:19.175280 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d30f3ff3-e558-4484-986b-bb8d005bfe89 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1497 microversion: 2.1 time: 0.186283 Apr 16 21:15:19.185751 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1228/2342] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:18 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1497 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:19.239912 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9de7c43c-3217-45f1-b0bb-460043a12225 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:19.239912 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9de7c43c-3217-45f1-b0bb-460043a12225 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:19.240396 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1b5dc9b1-8cb8-4e17-a767-2638b297950d tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:19.240396 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1b5dc9b1-8cb8-4e17-a767-2638b297950d tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:19.240623 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9de7c43c-3217-45f1-b0bb-460043a12225 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:19.240623 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9de7c43c-3217-45f1-b0bb-460043a12225 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:19.240623 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9de7c43c-3217-45f1-b0bb-460043a12225 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:19.240623 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9de7c43c-3217-45f1-b0bb-460043a12225 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:19.287297 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1b5dc9b1-8cb8-4e17-a767-2638b297950d tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:19.295082 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1b5dc9b1-8cb8-4e17-a767-2638b297950d tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f" status: 200 len: 1225 microversion: 2.1 time: 0.074125 Apr 16 21:15:19.295934 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1229/2343] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:19 2022] GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f => generated 1225 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:15:19.301590 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fb898e23-42a9-43e4-8468-d6ef02bf2b55 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:19.303019 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fb898e23-42a9-43e4-8468-d6ef02bf2b55 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:19.308662 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fb898e23-42a9-43e4-8468-d6ef02bf2b55 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:19.309124 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fb898e23-42a9-43e4-8468-d6ef02bf2b55 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:19.309907 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fb898e23-42a9-43e4-8468-d6ef02bf2b55 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:19.310727 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fb898e23-42a9-43e4-8468-d6ef02bf2b55 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:19.387576 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fb898e23-42a9-43e4-8468-d6ef02bf2b55 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:19.395666 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fb898e23-42a9-43e4-8468-d6ef02bf2b55 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:19.397141 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fb898e23-42a9-43e4-8468-d6ef02bf2b55 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:19.402668 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fb898e23-42a9-43e4-8468-d6ef02bf2b55 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1428 microversion: 2.75 time: 0.105944 Apr 16 21:15:19.403461 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1230/2344] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:19 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1428 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:15:19.408115 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6d2c9e6b-2246-4fef-8263-561381179af4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:19.408826 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6d2c9e6b-2246-4fef-8263-561381179af4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:19.414847 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6d2c9e6b-2246-4fef-8263-561381179af4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:19.415366 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6d2c9e6b-2246-4fef-8263-561381179af4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:19.426523 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6d2c9e6b-2246-4fef-8263-561381179af4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:19.426523 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6d2c9e6b-2246-4fef-8263-561381179af4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:19.515720 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9de7c43c-3217-45f1-b0bb-460043a12225 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:19.533168 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9de7c43c-3217-45f1-b0bb-460043a12225 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:19.535176 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9de7c43c-3217-45f1-b0bb-460043a12225 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:19.536360 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9de7c43c-3217-45f1-b0bb-460043a12225 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1870 microversion: 2.32 time: 0.323589 Apr 16 21:15:19.544591 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1115/2345] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:19 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1870 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:15:19.551547 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e0379570-c6fe-4355-a114-8195947a2f73 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:19.551547 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e0379570-c6fe-4355-a114-8195947a2f73 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:19.558505 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e0379570-c6fe-4355-a114-8195947a2f73 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:19.559398 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e0379570-c6fe-4355-a114-8195947a2f73 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:19.560427 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e0379570-c6fe-4355-a114-8195947a2f73 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:19.561247 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e0379570-c6fe-4355-a114-8195947a2f73 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:19.570673 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6d2c9e6b-2246-4fef-8263-561381179af4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:19.579012 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6d2c9e6b-2246-4fef-8263-561381179af4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1683 microversion: 2.1 time: 0.174706 Apr 16 21:15:19.580948 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1231/2346] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:19 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1683 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:19.584133 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-bb79f90f-d59b-4f28-80b3-414442a757e5 req-daaf51c6-d829-49f8-a118-f78cab3d6d03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a839aa71-2bd6-4676-8955-1d69072cd7f0", "name": "network-vif-plugged", "status": "completed", "tag": "e95787b0-2955-4c9d-b856-d0002bfc2eb5"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:19.592569 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-bb79f90f-d59b-4f28-80b3-414442a757e5 req-daaf51c6-d829-49f8-a118-f78cab3d6d03 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:19.593032 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-bb79f90f-d59b-4f28-80b3-414442a757e5 req-daaf51c6-d829-49f8-a118-f78cab3d6d03 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:19.622342 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-bb79f90f-d59b-4f28-80b3-414442a757e5 req-daaf51c6-d829-49f8-a118-f78cab3d6d03 service nova] Creating event network-vif-plugged:e95787b0-2955-4c9d-b856-d0002bfc2eb5 for instance a839aa71-2bd6-4676-8955-1d69072cd7f0 on nch1-master-1 Apr 16 21:15:19.627319 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-bb79f90f-d59b-4f28-80b3-414442a757e5 req-daaf51c6-d829-49f8-a118-f78cab3d6d03 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046489 Apr 16 21:15:19.627950 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1232/2347] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:15:19.706354 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e0379570-c6fe-4355-a114-8195947a2f73 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:19.712753 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e0379570-c6fe-4355-a114-8195947a2f73 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 200 len: 1477 microversion: 2.1 time: 0.166739 Apr 16 21:15:19.713332 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1116/2348] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:19 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 1477 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:19.730815 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-033fb1db-0663-4242-8497-5bf513df878e tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:19.730815 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-033fb1db-0663-4242-8497-5bf513df878e tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: a839aa71-2bd6-4676-8955-1d69072cd7f0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:19.736742 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-033fb1db-0663-4242-8497-5bf513df878e tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:19.737361 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-033fb1db-0663-4242-8497-5bf513df878e tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:19.738176 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-033fb1db-0663-4242-8497-5bf513df878e tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:19.738627 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-033fb1db-0663-4242-8497-5bf513df878e tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:19.881712 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-033fb1db-0663-4242-8497-5bf513df878e tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2bab3afb0f945eca1a7bf9f783cf9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec2ad232d62489aa704075fad5305c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:19.889880 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-033fb1db-0663-4242-8497-5bf513df878e tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "GET /compute/v2.1/servers/a839aa71-2bd6-4676-8955-1d69072cd7f0" status: 200 len: 1320 microversion: 2.1 time: 0.164639 Apr 16 21:15:19.890453 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1233/2349] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:19 2022] GET /compute/v2.1/servers/a839aa71-2bd6-4676-8955-1d69072cd7f0 => generated 1320 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:20.193467 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-64fc6892-a077-4c07-b55d-52c9f35847dd tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:20.194089 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-64fc6892-a077-4c07-b55d-52c9f35847dd tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:20.200195 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-64fc6892-a077-4c07-b55d-52c9f35847dd tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:20.200850 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-64fc6892-a077-4c07-b55d-52c9f35847dd tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:20.201649 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-64fc6892-a077-4c07-b55d-52c9f35847dd tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:20.202100 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-64fc6892-a077-4c07-b55d-52c9f35847dd tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:20.312920 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a4cda9c5-26c1-437e-81bc-dbdf7e7a2053 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:20.313620 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a4cda9c5-26c1-437e-81bc-dbdf7e7a2053 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:20.319665 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a4cda9c5-26c1-437e-81bc-dbdf7e7a2053 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:20.320124 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a4cda9c5-26c1-437e-81bc-dbdf7e7a2053 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:20.320937 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a4cda9c5-26c1-437e-81bc-dbdf7e7a2053 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:20.321453 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a4cda9c5-26c1-437e-81bc-dbdf7e7a2053 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:20.330805 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-64fc6892-a077-4c07-b55d-52c9f35847dd tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:20.338407 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-64fc6892-a077-4c07-b55d-52c9f35847dd tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1497 microversion: 2.1 time: 0.148888 Apr 16 21:15:20.339228 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1117/2350] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:20 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1497 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:20.382032 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a4cda9c5-26c1-437e-81bc-dbdf7e7a2053 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:20.389864 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a4cda9c5-26c1-437e-81bc-dbdf7e7a2053 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f" status: 200 len: 1229 microversion: 2.1 time: 0.080994 Apr 16 21:15:20.390541 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1234/2351] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:20 2022] GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f => generated 1229 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:15:20.433390 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2542a195-5ad2-46a9-8c4d-78345310c159 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:20.434011 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2542a195-5ad2-46a9-8c4d-78345310c159 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:20.439962 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2542a195-5ad2-46a9-8c4d-78345310c159 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:20.440455 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2542a195-5ad2-46a9-8c4d-78345310c159 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:20.441242 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2542a195-5ad2-46a9-8c4d-78345310c159 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:20.441833 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2542a195-5ad2-46a9-8c4d-78345310c159 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:20.553266 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2542a195-5ad2-46a9-8c4d-78345310c159 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:20.559666 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3b4592bd-49a3-45a4-adb5-52fb32dcbfcd tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:20.560349 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3b4592bd-49a3-45a4-adb5-52fb32dcbfcd tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:20.561365 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2542a195-5ad2-46a9-8c4d-78345310c159 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:20.562905 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2542a195-5ad2-46a9-8c4d-78345310c159 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:20.567788 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3b4592bd-49a3-45a4-adb5-52fb32dcbfcd tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:20.568277 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3b4592bd-49a3-45a4-adb5-52fb32dcbfcd tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:20.568967 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2542a195-5ad2-46a9-8c4d-78345310c159 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1416 microversion: 2.75 time: 0.139951 Apr 16 21:15:20.569110 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3b4592bd-49a3-45a4-adb5-52fb32dcbfcd tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:20.569544 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3b4592bd-49a3-45a4-adb5-52fb32dcbfcd tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:20.569676 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1118/2352] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:20 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1416 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:15:20.596814 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8bf3bfc9-940c-4655-8b42-5d4142a4a5d1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:20.597431 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8bf3bfc9-940c-4655-8b42-5d4142a4a5d1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:20.604202 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8bf3bfc9-940c-4655-8b42-5d4142a4a5d1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:20.604666 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8bf3bfc9-940c-4655-8b42-5d4142a4a5d1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:20.605488 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8bf3bfc9-940c-4655-8b42-5d4142a4a5d1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:20.605973 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8bf3bfc9-940c-4655-8b42-5d4142a4a5d1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:20.738950 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8bf3bfc9-940c-4655-8b42-5d4142a4a5d1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:20.746975 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8bf3bfc9-940c-4655-8b42-5d4142a4a5d1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1683 microversion: 2.1 time: 0.154221 Apr 16 21:15:20.747571 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1119/2353] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:20 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1683 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:15:20.754437 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d7879c42-a20c-4882-9859-aae7ba997ad2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:20.754437 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d7879c42-a20c-4882-9859-aae7ba997ad2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:20.759359 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d7879c42-a20c-4882-9859-aae7ba997ad2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:20.759823 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d7879c42-a20c-4882-9859-aae7ba997ad2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:20.760675 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d7879c42-a20c-4882-9859-aae7ba997ad2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:20.761118 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d7879c42-a20c-4882-9859-aae7ba997ad2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:20.769105 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3b4592bd-49a3-45a4-adb5-52fb32dcbfcd tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:20.779079 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3b4592bd-49a3-45a4-adb5-52fb32dcbfcd tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:20.780667 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3b4592bd-49a3-45a4-adb5-52fb32dcbfcd tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:20.782161 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3b4592bd-49a3-45a4-adb5-52fb32dcbfcd tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 2821 microversion: 2.32 time: 0.231110 Apr 16 21:15:20.782773 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1235/2354] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:20 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 2821 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:15:20.801545 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0c9573ab-1e28-49f3-9ddc-d93b2cb2614a tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:20.801964 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0c9573ab-1e28-49f3-9ddc-d93b2cb2614a tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:20.808571 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0c9573ab-1e28-49f3-9ddc-d93b2cb2614a tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:20.809034 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0c9573ab-1e28-49f3-9ddc-d93b2cb2614a tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:20.809835 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0c9573ab-1e28-49f3-9ddc-d93b2cb2614a tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:20.810281 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0c9573ab-1e28-49f3-9ddc-d93b2cb2614a tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:20.894241 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d7879c42-a20c-4882-9859-aae7ba997ad2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:20.904212 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d7879c42-a20c-4882-9859-aae7ba997ad2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 200 len: 1476 microversion: 2.1 time: 0.155458 Apr 16 21:15:20.904997 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1120/2355] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:20 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 1476 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:20.909732 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-739fba4c-b013-4522-83fe-674efefec589 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:20.910380 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-739fba4c-b013-4522-83fe-674efefec589 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: a839aa71-2bd6-4676-8955-1d69072cd7f0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:20.920051 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-739fba4c-b013-4522-83fe-674efefec589 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:20.920754 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-739fba4c-b013-4522-83fe-674efefec589 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:20.921661 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-739fba4c-b013-4522-83fe-674efefec589 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:20.922241 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-739fba4c-b013-4522-83fe-674efefec589 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:20.932121 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0c9573ab-1e28-49f3-9ddc-d93b2cb2614a tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7/os-interface" status: 200 len: 1828 microversion: 2.32 time: 0.133881 Apr 16 21:15:20.932754 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1236/2356] 10.222.0.20 () {60 vars in 1315 bytes} [Sat Apr 16 21:15:20 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7/os-interface => generated 1828 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:15:21.216784 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-739fba4c-b013-4522-83fe-674efefec589 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2bab3afb0f945eca1a7bf9f783cf9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec2ad232d62489aa704075fad5305c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:21.224409 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-739fba4c-b013-4522-83fe-674efefec589 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "GET /compute/v2.1/servers/a839aa71-2bd6-4676-8955-1d69072cd7f0" status: 200 len: 1320 microversion: 2.1 time: 0.318460 Apr 16 21:15:21.227179 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1121/2357] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:20 2022] GET /compute/v2.1/servers/a839aa71-2bd6-4676-8955-1d69072cd7f0 => generated 1320 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:21.355754 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1e5918f9-4d0d-44e6-8d18-760cc8177da0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:21.356313 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1e5918f9-4d0d-44e6-8d18-760cc8177da0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:21.362890 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1e5918f9-4d0d-44e6-8d18-760cc8177da0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:21.363350 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1e5918f9-4d0d-44e6-8d18-760cc8177da0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:21.364132 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1e5918f9-4d0d-44e6-8d18-760cc8177da0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:21.364625 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1e5918f9-4d0d-44e6-8d18-760cc8177da0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:21.407072 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2fcff01e-6393-49f6-8b50-1836a1db43f1 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:21.408205 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2fcff01e-6393-49f6-8b50-1836a1db43f1 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:21.414438 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2fcff01e-6393-49f6-8b50-1836a1db43f1 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:21.415049 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2fcff01e-6393-49f6-8b50-1836a1db43f1 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:21.416679 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2fcff01e-6393-49f6-8b50-1836a1db43f1 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:21.417356 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2fcff01e-6393-49f6-8b50-1836a1db43f1 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:21.493849 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2fcff01e-6393-49f6-8b50-1836a1db43f1 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:21.502203 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2fcff01e-6393-49f6-8b50-1836a1db43f1 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f" status: 200 len: 1229 microversion: 2.1 time: 0.099468 Apr 16 21:15:21.502940 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1122/2358] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:21 2022] GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f => generated 1229 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:15:21.506779 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1e5918f9-4d0d-44e6-8d18-760cc8177da0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:21.514757 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1e5918f9-4d0d-44e6-8d18-760cc8177da0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1497 microversion: 2.1 time: 0.163794 Apr 16 21:15:21.518091 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1237/2359] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:21 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:21.590416 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-88874aa8-714b-4ab2-a3ee-08020d1b2e94 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:21.591035 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-88874aa8-714b-4ab2-a3ee-08020d1b2e94 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:21.597063 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-88874aa8-714b-4ab2-a3ee-08020d1b2e94 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:21.597556 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-88874aa8-714b-4ab2-a3ee-08020d1b2e94 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:21.598305 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-88874aa8-714b-4ab2-a3ee-08020d1b2e94 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:21.598765 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-88874aa8-714b-4ab2-a3ee-08020d1b2e94 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:21.672770 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-88874aa8-714b-4ab2-a3ee-08020d1b2e94 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:21.680787 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-88874aa8-714b-4ab2-a3ee-08020d1b2e94 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:21.682640 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-88874aa8-714b-4ab2-a3ee-08020d1b2e94 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:21.690241 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-88874aa8-714b-4ab2-a3ee-08020d1b2e94 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1416 microversion: 2.75 time: 0.102062 Apr 16 21:15:21.690241 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1123/2360] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:21 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1416 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:15:21.764393 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-77408bb4-d421-4a00-b364-31938666f22a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:21.765113 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-77408bb4-d421-4a00-b364-31938666f22a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:21.772131 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-77408bb4-d421-4a00-b364-31938666f22a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:21.772685 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-77408bb4-d421-4a00-b364-31938666f22a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:21.773570 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-77408bb4-d421-4a00-b364-31938666f22a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:21.774024 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-77408bb4-d421-4a00-b364-31938666f22a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:21.904475 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-77408bb4-d421-4a00-b364-31938666f22a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:21.912295 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-77408bb4-d421-4a00-b364-31938666f22a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1683 microversion: 2.1 time: 0.151789 Apr 16 21:15:21.912870 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1238/2361] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:21 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:21.923061 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-661d6238-e5c0-41b9-a569-2583552f3e98 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:21.923061 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-661d6238-e5c0-41b9-a569-2583552f3e98 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:21.929250 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-661d6238-e5c0-41b9-a569-2583552f3e98 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:21.929800 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-661d6238-e5c0-41b9-a569-2583552f3e98 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:21.930618 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-661d6238-e5c0-41b9-a569-2583552f3e98 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:21.931100 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-661d6238-e5c0-41b9-a569-2583552f3e98 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:22.190966 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-661d6238-e5c0-41b9-a569-2583552f3e98 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:22.205490 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-661d6238-e5c0-41b9-a569-2583552f3e98 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 200 len: 1476 microversion: 2.1 time: 0.287226 Apr 16 21:15:22.210893 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1124/2362] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:21 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 1476 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:22.236904 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-3f16f87a-c3f6-436f-b8b3-004dbeeebe12 req-e6f66808-09fe-4f81-b4f8-6903a7aa2b81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf669403-03eb-40c7-9a11-3d0422f708c7", "tag": "90479900-4d72-46a0-92ee-feff9e50d619"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:22.243506 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-174360ef-0368-48f9-9a5b-49a28c65e104 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:22.244363 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-174360ef-0368-48f9-9a5b-49a28c65e104 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: a839aa71-2bd6-4676-8955-1d69072cd7f0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:22.251733 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-3f16f87a-c3f6-436f-b8b3-004dbeeebe12 req-e6f66808-09fe-4f81-b4f8-6903a7aa2b81 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:22.253359 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-174360ef-0368-48f9-9a5b-49a28c65e104 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:22.253513 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-3f16f87a-c3f6-436f-b8b3-004dbeeebe12 req-e6f66808-09fe-4f81-b4f8-6903a7aa2b81 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:22.253976 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-174360ef-0368-48f9-9a5b-49a28c65e104 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:22.255668 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-174360ef-0368-48f9-9a5b-49a28c65e104 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:22.256413 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-174360ef-0368-48f9-9a5b-49a28c65e104 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:22.268976 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-3f16f87a-c3f6-436f-b8b3-004dbeeebe12 req-e6f66808-09fe-4f81-b4f8-6903a7aa2b81 service nova] Creating event network-changed:90479900-4d72-46a0-92ee-feff9e50d619 for instance cf669403-03eb-40c7-9a11-3d0422f708c7 on nch2-master-1 Apr 16 21:15:22.277379 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-3f16f87a-c3f6-436f-b8b3-004dbeeebe12 req-e6f66808-09fe-4f81-b4f8-6903a7aa2b81 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044145 Apr 16 21:15:22.278075 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1239/2363] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:15:22.403451 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-174360ef-0368-48f9-9a5b-49a28c65e104 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2bab3afb0f945eca1a7bf9f783cf9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec2ad232d62489aa704075fad5305c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:22.411173 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-174360ef-0368-48f9-9a5b-49a28c65e104 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "GET /compute/v2.1/servers/a839aa71-2bd6-4676-8955-1d69072cd7f0" status: 200 len: 1508 microversion: 2.1 time: 0.172629 Apr 16 21:15:22.411759 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1125/2364] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:22 2022] GET /compute/v2.1/servers/a839aa71-2bd6-4676-8955-1d69072cd7f0 => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:15:22.428789 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7cf03686-e908-4878-9be9-76f68a7150e5 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:22.429596 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7cf03686-e908-4878-9be9-76f68a7150e5 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: 446a5909-7904-4290-9a61-015b0a1f5d40] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:22.435792 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7cf03686-e908-4878-9be9-76f68a7150e5 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:22.436201 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7cf03686-e908-4878-9be9-76f68a7150e5 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:22.436983 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7cf03686-e908-4878-9be9-76f68a7150e5 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:22.437423 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7cf03686-e908-4878-9be9-76f68a7150e5 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:22.519052 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d105e0ea-fae5-4295-83e2-363d34d23955 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:22.519676 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d105e0ea-fae5-4295-83e2-363d34d23955 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:22.526532 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d105e0ea-fae5-4295-83e2-363d34d23955 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:22.528975 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d105e0ea-fae5-4295-83e2-363d34d23955 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:22.529450 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d105e0ea-fae5-4295-83e2-363d34d23955 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:22.529905 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d105e0ea-fae5-4295-83e2-363d34d23955 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:22.588477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7cf03686-e908-4878-9be9-76f68a7150e5 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2bab3afb0f945eca1a7bf9f783cf9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec2ad232d62489aa704075fad5305c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:22.596684 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7cf03686-e908-4878-9be9-76f68a7150e5 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "GET /compute/v2.1/servers/446a5909-7904-4290-9a61-015b0a1f5d40" status: 200 len: 1508 microversion: 2.1 time: 0.172097 Apr 16 21:15:22.597796 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1240/2365] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:22 2022] GET /compute/v2.1/servers/446a5909-7904-4290-9a61-015b0a1f5d40 => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:22.598859 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d105e0ea-fae5-4295-83e2-363d34d23955 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:22.602747 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-eb65a0e1-2177-4d13-aeef-ecc16a1e9df2 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:22.605281 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-eb65a0e1-2177-4d13-aeef-ecc16a1e9df2 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:22.610141 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d105e0ea-fae5-4295-83e2-363d34d23955 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f" status: 200 len: 1221 microversion: 2.1 time: 0.094967 Apr 16 21:15:22.610896 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1126/2366] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:22 2022] GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f => generated 1221 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:15:22.615940 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-950e3423-e41f-4722-8cc6-2d717b460c17 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:22.616484 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-950e3423-e41f-4722-8cc6-2d717b460c17 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: 446a5909-7904-4290-9a61-015b0a1f5d40] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:22.622760 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-950e3423-e41f-4722-8cc6-2d717b460c17 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:22.623370 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-950e3423-e41f-4722-8cc6-2d717b460c17 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:22.623755 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eb65a0e1-2177-4d13-aeef-ecc16a1e9df2 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:22.624197 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-950e3423-e41f-4722-8cc6-2d717b460c17 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:22.624328 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eb65a0e1-2177-4d13-aeef-ecc16a1e9df2 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:22.625092 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-950e3423-e41f-4722-8cc6-2d717b460c17 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:22.625223 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eb65a0e1-2177-4d13-aeef-ecc16a1e9df2 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:22.625967 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eb65a0e1-2177-4d13-aeef-ecc16a1e9df2 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:22.653281 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-950e3423-e41f-4722-8cc6-2d717b460c17 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: 446a5909-7904-4290-9a61-015b0a1f5d40] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:15:22.906606 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-eb65a0e1-2177-4d13-aeef-ecc16a1e9df2 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:22.918293 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-eb65a0e1-2177-4d13-aeef-ecc16a1e9df2 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1497 microversion: 2.1 time: 0.319321 Apr 16 21:15:22.919335 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1241/2367] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:22 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1497 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:22.924811 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3ccee355-ddb4-4374-a020-6708cda431ae tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:22.924811 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3ccee355-ddb4-4374-a020-6708cda431ae tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:22.930915 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3ccee355-ddb4-4374-a020-6708cda431ae tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:22.931519 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3ccee355-ddb4-4374-a020-6708cda431ae tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:22.932548 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3ccee355-ddb4-4374-a020-6708cda431ae tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:22.933174 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3ccee355-ddb4-4374-a020-6708cda431ae tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:23.010495 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3ccee355-ddb4-4374-a020-6708cda431ae tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:23.020688 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3ccee355-ddb4-4374-a020-6708cda431ae tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:23.022341 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3ccee355-ddb4-4374-a020-6708cda431ae tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:23.042084 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3ccee355-ddb4-4374-a020-6708cda431ae tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1416 microversion: 2.75 time: 0.121748 Apr 16 21:15:23.045742 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1242/2368] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:22 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1416 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:15:23.053122 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-98ff3acc-d6a4-4ca7-830f-6f3f4cf6337a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:23.054850 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-98ff3acc-d6a4-4ca7-830f-6f3f4cf6337a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:23.061098 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-98ff3acc-d6a4-4ca7-830f-6f3f4cf6337a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:23.061657 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-98ff3acc-d6a4-4ca7-830f-6f3f4cf6337a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:23.062563 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-98ff3acc-d6a4-4ca7-830f-6f3f4cf6337a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:23.063083 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-98ff3acc-d6a4-4ca7-830f-6f3f4cf6337a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:23.200060 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-950e3423-e41f-4722-8cc6-2d717b460c17 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "DELETE /compute/v2.1/servers/446a5909-7904-4290-9a61-015b0a1f5d40" status: 204 len: 0 microversion: 2.1 time: 0.587857 Apr 16 21:15:23.201011 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1127/2369] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:15:22 2022] DELETE /compute/v2.1/servers/446a5909-7904-4290-9a61-015b0a1f5d40 => generated 0 bytes in 590 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:15:23.211219 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2b5d1a0e-3455-4169-b600-fb608a746a12 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:23.211822 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2b5d1a0e-3455-4169-b600-fb608a746a12 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: a839aa71-2bd6-4676-8955-1d69072cd7f0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:23.218798 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2b5d1a0e-3455-4169-b600-fb608a746a12 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:23.219263 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2b5d1a0e-3455-4169-b600-fb608a746a12 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:23.220044 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2b5d1a0e-3455-4169-b600-fb608a746a12 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:23.220569 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2b5d1a0e-3455-4169-b600-fb608a746a12 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:23.247772 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2b5d1a0e-3455-4169-b600-fb608a746a12 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: a839aa71-2bd6-4676-8955-1d69072cd7f0] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:15:23.277133 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-98ff3acc-d6a4-4ca7-830f-6f3f4cf6337a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:23.288157 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-98ff3acc-d6a4-4ca7-830f-6f3f4cf6337a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.240788 Apr 16 21:15:23.288502 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1243/2370] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:23 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:23.296477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ffc89c03-b4a0-4f73-900d-867a15e7480a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:23.296477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ffc89c03-b4a0-4f73-900d-867a15e7480a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:23.315599 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ffc89c03-b4a0-4f73-900d-867a15e7480a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:23.316065 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ffc89c03-b4a0-4f73-900d-867a15e7480a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:23.316919 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ffc89c03-b4a0-4f73-900d-867a15e7480a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:23.318441 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ffc89c03-b4a0-4f73-900d-867a15e7480a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:23.555353 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ffc89c03-b4a0-4f73-900d-867a15e7480a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:23.573613 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ffc89c03-b4a0-4f73-900d-867a15e7480a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 200 len: 1476 microversion: 2.1 time: 0.284056 Apr 16 21:15:23.593582 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1244/2371] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:23 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 1476 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:23.599572 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-ca6213ef-177b-493b-84ea-cc1f30349d2b req-3414427d-2441-4de8-90b5-e97cbe928f99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0602327-eafa-416f-8114-3411e37e2eef", "name": "network-vif-unplugged", "status": "completed", "tag": "0e4ce80e-dded-45a4-8cad-59e6b3b64323"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:23.609828 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-ca6213ef-177b-493b-84ea-cc1f30349d2b req-3414427d-2441-4de8-90b5-e97cbe928f99 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:23.611059 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-ca6213ef-177b-493b-84ea-cc1f30349d2b req-3414427d-2441-4de8-90b5-e97cbe928f99 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:23.626626 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-ca6213ef-177b-493b-84ea-cc1f30349d2b req-3414427d-2441-4de8-90b5-e97cbe928f99 service nova] Creating event network-vif-unplugged:0e4ce80e-dded-45a4-8cad-59e6b3b64323 for instance a0602327-eafa-416f-8114-3411e37e2eef on nch2-master-1 Apr 16 21:15:23.638116 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [req-ca6213ef-177b-493b-84ea-cc1f30349d2b req-3414427d-2441-4de8-90b5-e97cbe928f99 service nova] Instance a0602327-eafa-416f-8114-3411e37e2eef is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 16 21:15:23.651484 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-ca6213ef-177b-493b-84ea-cc1f30349d2b req-3414427d-2441-4de8-90b5-e97cbe928f99 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055934 Apr 16 21:15:23.652805 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1245/2372] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:15:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:15:23.670113 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-221bba46-4715-4be2-81f7-e2b04b4edd59 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:23.672032 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-221bba46-4715-4be2-81f7-e2b04b4edd59 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:23.685847 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-221bba46-4715-4be2-81f7-e2b04b4edd59 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:23.686317 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-221bba46-4715-4be2-81f7-e2b04b4edd59 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:23.687309 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-221bba46-4715-4be2-81f7-e2b04b4edd59 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:23.687768 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-221bba46-4715-4be2-81f7-e2b04b4edd59 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:23.751631 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2b5d1a0e-3455-4169-b600-fb608a746a12 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a839aa71-2bd6-4676-8955-1d69072cd7f0" status: 204 len: 0 microversion: 2.1 time: 0.545821 Apr 16 21:15:23.752486 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1128/2373] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:15:23 2022] DELETE /compute/v2.1/servers/a839aa71-2bd6-4676-8955-1d69072cd7f0 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 16 21:15:23.833816 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-221bba46-4715-4be2-81f7-e2b04b4edd59 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:23.844887 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-221bba46-4715-4be2-81f7-e2b04b4edd59 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f" status: 200 len: 1277 microversion: 2.1 time: 0.189328 Apr 16 21:15:23.854436 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1246/2374] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:23 2022] GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f => generated 1277 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:23.912725 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bb434ddd-99f1-4fc1-9f8f-3a96b27f43bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-1842139646", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "630ead34-ffcc-4ecb-82b7-48adfc0b0b97"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:23.951594 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-272f6aa1-7220-41c4-981d-f5641786adfa tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:23.954284 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-272f6aa1-7220-41c4-981d-f5641786adfa tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:23.966153 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-272f6aa1-7220-41c4-981d-f5641786adfa tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:23.968698 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-272f6aa1-7220-41c4-981d-f5641786adfa tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:23.974493 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-272f6aa1-7220-41c4-981d-f5641786adfa tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:23.974493 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-272f6aa1-7220-41c4-981d-f5641786adfa tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:24.032063 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-bb434ddd-99f1-4fc1-9f8f-3a96b27f43bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] validate_networks() for [('630ead34-ffcc-4ecb-82b7-48adfc0b0b97', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:15:24.438967 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-272f6aa1-7220-41c4-981d-f5641786adfa tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:24.448819 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-272f6aa1-7220-41c4-981d-f5641786adfa tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1497 microversion: 2.1 time: 0.517476 Apr 16 21:15:24.466771 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1247/2375] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:23 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1497 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:24.474063 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4cdfd89f-c369-4d7f-8e2f-4796289dd971 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:24.474760 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4cdfd89f-c369-4d7f-8e2f-4796289dd971 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:24.480875 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4cdfd89f-c369-4d7f-8e2f-4796289dd971 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:24.481375 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4cdfd89f-c369-4d7f-8e2f-4796289dd971 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:24.482213 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4cdfd89f-c369-4d7f-8e2f-4796289dd971 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:24.482656 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4cdfd89f-c369-4d7f-8e2f-4796289dd971 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:24.571262 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4cdfd89f-c369-4d7f-8e2f-4796289dd971 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:24.586329 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4cdfd89f-c369-4d7f-8e2f-4796289dd971 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:24.588983 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4cdfd89f-c369-4d7f-8e2f-4796289dd971 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:24.596936 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4cdfd89f-c369-4d7f-8e2f-4796289dd971 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1437 microversion: 2.75 time: 0.128390 Apr 16 21:15:24.607387 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1248/2376] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:24 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1437 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:15:24.607387 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b778b913-8f33-44e1-afee-0e20c9a84b54 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:24.607387 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b778b913-8f33-44e1-afee-0e20c9a84b54 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:24.615027 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-bb434ddd-99f1-4fc1-9f8f-3a96b27f43bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:15:24.615680 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-bb434ddd-99f1-4fc1-9f8f-3a96b27f43bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:15:24.616425 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-bb434ddd-99f1-4fc1-9f8f-3a96b27f43bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:15:24.616852 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-bb434ddd-99f1-4fc1-9f8f-3a96b27f43bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:15:24.617279 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-bb434ddd-99f1-4fc1-9f8f-3a96b27f43bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:15:24.627132 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bb434ddd-99f1-4fc1-9f8f-3a96b27f43bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:24.627877 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bb434ddd-99f1-4fc1-9f8f-3a96b27f43bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:24.628808 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b778b913-8f33-44e1-afee-0e20c9a84b54 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:24.629115 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bb434ddd-99f1-4fc1-9f8f-3a96b27f43bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:24.629259 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b778b913-8f33-44e1-afee-0e20c9a84b54 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:24.629869 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bb434ddd-99f1-4fc1-9f8f-3a96b27f43bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:24.630051 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b778b913-8f33-44e1-afee-0e20c9a84b54 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:24.630498 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b778b913-8f33-44e1-afee-0e20c9a84b54 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:24.650798 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-bb434ddd-99f1-4fc1-9f8f-3a96b27f43bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Getting quotas for project 5ec2ad232d62489aa704075fad5305c2. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:15:24.657578 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-bb434ddd-99f1-4fc1-9f8f-3a96b27f43bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Getting quotas for user b2bab3afb0f945eca1a7bf9f783cf9fc and project 5ec2ad232d62489aa704075fad5305c2. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:15:24.673304 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bb434ddd-99f1-4fc1-9f8f-3a96b27f43bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Going to run 2 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:15:24.690654 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bb434ddd-99f1-4fc1-9f8f-3a96b27f43bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: ae2e0ce1-35a6-4ef8-83f4-44237fe59f65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:15:24.873390 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bb434ddd-99f1-4fc1-9f8f-3a96b27f43bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: 41932213-4c87-4ee1-909f-50d95297cd64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=ae2e0ce1-35a6-4ef8-83f4-44237fe59f65,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:15:24.956495 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b778b913-8f33-44e1-afee-0e20c9a84b54 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:24.971324 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b778b913-8f33-44e1-afee-0e20c9a84b54 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 200 len: 1476 microversion: 2.1 time: 0.365787 Apr 16 21:15:24.971971 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1249/2377] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:24 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 1476 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:24.981561 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-997b6c6e-2cda-4760-82a9-68c49b038f64 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:24.981561 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-997b6c6e-2cda-4760-82a9-68c49b038f64 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:24.986518 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-997b6c6e-2cda-4760-82a9-68c49b038f64 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:24.986995 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-997b6c6e-2cda-4760-82a9-68c49b038f64 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:24.988313 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-997b6c6e-2cda-4760-82a9-68c49b038f64 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:24.988313 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-997b6c6e-2cda-4760-82a9-68c49b038f64 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:25.021735 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bb434ddd-99f1-4fc1-9f8f-3a96b27f43bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.114429 Apr 16 21:15:25.026754 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1129/2378] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:15:23 2022] POST /compute/v2.1/servers => generated 32 bytes in 1120 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Apr 16 21:15:25.033107 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8c6a6bb2-5187-475f-9358-e30dc8f3f220 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:25.033925 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8c6a6bb2-5187-475f-9358-e30dc8f3f220 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:25.043329 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8c6a6bb2-5187-475f-9358-e30dc8f3f220 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:25.044052 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8c6a6bb2-5187-475f-9358-e30dc8f3f220 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:25.045906 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8c6a6bb2-5187-475f-9358-e30dc8f3f220 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:25.046527 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8c6a6bb2-5187-475f-9358-e30dc8f3f220 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:25.111941 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-997b6c6e-2cda-4760-82a9-68c49b038f64 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:15:25.112326 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-997b6c6e-2cda-4760-82a9-68c49b038f64 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:15:25.112820 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-997b6c6e-2cda-4760-82a9-68c49b038f64 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:15:25.113247 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-997b6c6e-2cda-4760-82a9-68c49b038f64 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:15:25.113674 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-997b6c6e-2cda-4760-82a9-68c49b038f64 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:15:25.135232 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8c6a6bb2-5187-475f-9358-e30dc8f3f220 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:25.148555 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8c6a6bb2-5187-475f-9358-e30dc8f3f220 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f" status: 200 len: 1283 microversion: 2.1 time: 0.120425 Apr 16 21:15:25.149178 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1130/2379] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:25 2022] GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f => generated 1283 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:25.170074 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-56a9348e-b4a0-4b55-84b3-b2f7173dd96b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:25.175022 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-56a9348e-b4a0-4b55-84b3-b2f7173dd96b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b2bab3afb0f945eca1a7bf9f783cf9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec2ad232d62489aa704075fad5305c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:25.176005 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-56a9348e-b4a0-4b55-84b3-b2f7173dd96b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Searching by: {'deleted': False, 'project_id': '5ec2ad232d62489aa704075fad5305c2'} {{(pid=137409) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:15:25.197531 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-56a9348e-b4a0-4b55-84b3-b2f7173dd96b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:25.198208 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-56a9348e-b4a0-4b55-84b3-b2f7173dd96b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:25.206724 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-56a9348e-b4a0-4b55-84b3-b2f7173dd96b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:25.206724 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-56a9348e-b4a0-4b55-84b3-b2f7173dd96b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:25.241569 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.multi_cell_list [None req-56a9348e-b4a0-4b55-84b3-b2f7173dd96b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=137409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 16 21:15:25.273048 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-56a9348e-b4a0-4b55-84b3-b2f7173dd96b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 1337 microversion: 2.1 time: 0.121853 Apr 16 21:15:25.273853 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1131/2380] 10.222.0.20 () {58 vars in 1124 bytes} [Sat Apr 16 21:15:25 2022] GET /compute/v2.1/servers => generated 1337 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:25.284921 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-11473a1f-2efb-400a-a44b-68a9c94cf3ff tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:25.285480 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-11473a1f-2efb-400a-a44b-68a9c94cf3ff tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: 41932213-4c87-4ee1-909f-50d95297cd64] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:25.339067 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-11473a1f-2efb-400a-a44b-68a9c94cf3ff tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2bab3afb0f945eca1a7bf9f783cf9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec2ad232d62489aa704075fad5305c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:25.346189 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-11473a1f-2efb-400a-a44b-68a9c94cf3ff tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "GET /compute/v2.1/servers/41932213-4c87-4ee1-909f-50d95297cd64" status: 200 len: 1218 microversion: 2.1 time: 0.065233 Apr 16 21:15:25.348349 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1132/2381] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:25 2022] GET /compute/v2.1/servers/41932213-4c87-4ee1-909f-50d95297cd64 => generated 1218 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:25.394963 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-997b6c6e-2cda-4760-82a9-68c49b038f64 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:25.401750 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-997b6c6e-2cda-4760-82a9-68c49b038f64 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:25.402523 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-997b6c6e-2cda-4760-82a9-68c49b038f64 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:25.403883 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-997b6c6e-2cda-4760-82a9-68c49b038f64 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:25.404562 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-997b6c6e-2cda-4760-82a9-68c49b038f64 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:25.476707 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-28c4019d-be55-431a-b414-22cda66cd69a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:25.477833 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-28c4019d-be55-431a-b414-22cda66cd69a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:25.495229 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-28c4019d-be55-431a-b414-22cda66cd69a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:25.495229 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-28c4019d-be55-431a-b414-22cda66cd69a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:25.495229 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-28c4019d-be55-431a-b414-22cda66cd69a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:25.495229 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-28c4019d-be55-431a-b414-22cda66cd69a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:25.880679 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-997b6c6e-2cda-4760-82a9-68c49b038f64 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:25.890619 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-997b6c6e-2cda-4760-82a9-68c49b038f64 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:25.894146 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-997b6c6e-2cda-4760-82a9-68c49b038f64 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:25.901155 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-997b6c6e-2cda-4760-82a9-68c49b038f64 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "POST /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356/action" status: 202 len: 1494 microversion: 2.75 time: 0.928032 Apr 16 21:15:25.902629 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1250/2382] 10.222.0.20 () {62 vars in 1318 bytes} [Sat Apr 16 21:15:24 2022] POST /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356/action => generated 1494 bytes in 930 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Apr 16 21:15:25.908661 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-40ba8f1c-46ea-4d89-a862-73479a07e0e8 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:25.909550 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-40ba8f1c-46ea-4d89-a862-73479a07e0e8 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:25.916601 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40ba8f1c-46ea-4d89-a862-73479a07e0e8 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:25.917553 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40ba8f1c-46ea-4d89-a862-73479a07e0e8 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:25.918527 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40ba8f1c-46ea-4d89-a862-73479a07e0e8 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:25.919143 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40ba8f1c-46ea-4d89-a862-73479a07e0e8 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:25.921998 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-28c4019d-be55-431a-b414-22cda66cd69a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:25.930870 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-28c4019d-be55-431a-b414-22cda66cd69a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 200 len: 1474 microversion: 2.1 time: 0.460972 Apr 16 21:15:25.936676 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1133/2383] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:25 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 1474 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:15:25.947593 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-da7a923c-5c86-4210-a9b0-56701aebca9a req-cf73cd83-bc7e-4c38-9992-fbf4cb1f0b5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98ca4f4e-246a-449b-b9fd-e1c17e119faa", "name": "network-vif-unplugged", "status": "completed", "tag": "9bc5b971-3aa6-49d0-8b96-ab0e7cb12588"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:25.958454 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-da7a923c-5c86-4210-a9b0-56701aebca9a req-cf73cd83-bc7e-4c38-9992-fbf4cb1f0b5a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:25.958977 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-da7a923c-5c86-4210-a9b0-56701aebca9a req-cf73cd83-bc7e-4c38-9992-fbf4cb1f0b5a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:25.972209 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-da7a923c-5c86-4210-a9b0-56701aebca9a req-cf73cd83-bc7e-4c38-9992-fbf4cb1f0b5a service nova] Creating event network-vif-unplugged:9bc5b971-3aa6-49d0-8b96-ab0e7cb12588 for instance 98ca4f4e-246a-449b-b9fd-e1c17e119faa on nch2-master-1 Apr 16 21:15:25.977603 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-da7a923c-5c86-4210-a9b0-56701aebca9a req-cf73cd83-bc7e-4c38-9992-fbf4cb1f0b5a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044958 Apr 16 21:15:25.978856 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1134/2384] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:15:25.984504 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-603bf443-64f8-4e0c-be44-2be2c3304936 req-1cf0945a-7b40-4738-b911-4b35195b82b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0602327-eafa-416f-8114-3411e37e2eef", "tag": "0e4ce80e-dded-45a4-8cad-59e6b3b64323"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:25.993108 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-603bf443-64f8-4e0c-be44-2be2c3304936 req-1cf0945a-7b40-4738-b911-4b35195b82b3 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:25.993586 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-603bf443-64f8-4e0c-be44-2be2c3304936 req-1cf0945a-7b40-4738-b911-4b35195b82b3 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:26.005673 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-603bf443-64f8-4e0c-be44-2be2c3304936 req-1cf0945a-7b40-4738-b911-4b35195b82b3 service nova] Creating event network-changed:0e4ce80e-dded-45a4-8cad-59e6b3b64323 for instance a0602327-eafa-416f-8114-3411e37e2eef on nch2-master-1 Apr 16 21:15:26.014761 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [req-603bf443-64f8-4e0c-be44-2be2c3304936 req-1cf0945a-7b40-4738-b911-4b35195b82b3 service nova] Instance a0602327-eafa-416f-8114-3411e37e2eef is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137409) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 16 21:15:26.025866 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-603bf443-64f8-4e0c-be44-2be2c3304936 req-1cf0945a-7b40-4738-b911-4b35195b82b3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045046 Apr 16 21:15:26.027030 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1135/2385] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:15:26.033767 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1b6027c7-7e6f-4698-8668-99949d613a7c tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:26.035289 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1b6027c7-7e6f-4698-8668-99949d613a7c tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:26.042735 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1b6027c7-7e6f-4698-8668-99949d613a7c tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:26.043272 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1b6027c7-7e6f-4698-8668-99949d613a7c tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:26.044065 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1b6027c7-7e6f-4698-8668-99949d613a7c tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:26.044554 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1b6027c7-7e6f-4698-8668-99949d613a7c tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:26.078183 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-40ba8f1c-46ea-4d89-a862-73479a07e0e8 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:26.086190 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-40ba8f1c-46ea-4d89-a862-73479a07e0e8 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.182288 Apr 16 21:15:26.086781 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1251/2386] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:25 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:26.099138 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-57d50143-34a9-433c-80d5-52aaa47e3af7 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1199841195"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:26.100256 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-57d50143-34a9-433c-80d5-52aaa47e3af7 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:26.109931 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-57d50143-34a9-433c-80d5-52aaa47e3af7 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:26.110553 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-57d50143-34a9-433c-80d5-52aaa47e3af7 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:26.112958 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-57d50143-34a9-433c-80d5-52aaa47e3af7 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:26.112958 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-57d50143-34a9-433c-80d5-52aaa47e3af7 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:26.200032 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1b6027c7-7e6f-4698-8668-99949d613a7c tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:26.212161 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1b6027c7-7e6f-4698-8668-99949d613a7c tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:26.215441 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1b6027c7-7e6f-4698-8668-99949d613a7c tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:26.223218 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1b6027c7-7e6f-4698-8668-99949d613a7c tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1446 microversion: 2.75 time: 0.195009 Apr 16 21:15:26.225377 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1136/2387] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:26 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1446 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:15:26.234041 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-38873d97-748b-4bed-860d-03416f511ee2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:26.234041 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-38873d97-748b-4bed-860d-03416f511ee2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:26.253040 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-38873d97-748b-4bed-860d-03416f511ee2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:26.253752 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-38873d97-748b-4bed-860d-03416f511ee2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:26.257727 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-38873d97-748b-4bed-860d-03416f511ee2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:26.257727 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-38873d97-748b-4bed-860d-03416f511ee2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:26.606124 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-38873d97-748b-4bed-860d-03416f511ee2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:26.623130 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-38873d97-748b-4bed-860d-03416f511ee2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 200 len: 1474 microversion: 2.1 time: 0.395966 Apr 16 21:15:26.623873 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1137/2388] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:26 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 1474 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:26.632400 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-93c9c6ef-1653-4127-9675-51fc791c26c3 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:26.633206 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-93c9c6ef-1653-4127-9675-51fc791c26c3 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:26.641770 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-93c9c6ef-1653-4127-9675-51fc791c26c3 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:26.644681 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-93c9c6ef-1653-4127-9675-51fc791c26c3 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:26.645746 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-93c9c6ef-1653-4127-9675-51fc791c26c3 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:26.646200 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-93c9c6ef-1653-4127-9675-51fc791c26c3 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:26.778341 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-57d50143-34a9-433c-80d5-52aaa47e3af7 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "POST /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef/action" status: 202 len: 0 microversion: 2.1 time: 0.690273 Apr 16 21:15:26.779897 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1252/2389] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:15:26 2022] POST /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef/action => generated 0 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 16 21:15:26.785867 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0b0bd7f4-cf8c-493e-a953-9b058e5b5401 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:26.787005 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0b0bd7f4-cf8c-493e-a953-9b058e5b5401 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: 41932213-4c87-4ee1-909f-50d95297cd64] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:26.842963 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0b0bd7f4-cf8c-493e-a953-9b058e5b5401 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2bab3afb0f945eca1a7bf9f783cf9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec2ad232d62489aa704075fad5305c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:26.850032 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0b0bd7f4-cf8c-493e-a953-9b058e5b5401 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "GET /compute/v2.1/servers/41932213-4c87-4ee1-909f-50d95297cd64" status: 200 len: 1218 microversion: 2.1 time: 0.068846 Apr 16 21:15:26.850630 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1253/2390] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:26 2022] GET /compute/v2.1/servers/41932213-4c87-4ee1-909f-50d95297cd64 => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:26.865350 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-de55a5fa-55c0-4740-8e69-20c092e65534 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbba00969d0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:26.913729 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-de55a5fa-55c0-4740-8e69-20c092e65534 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231" status: 200 len: 1412 microversion: 2.1 time: 0.052339 Apr 16 21:15:26.914388 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1254/2391] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:15:26 2022] GET /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231 => generated 1412 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:27.093279 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-583cfd2d-a8b4-476d-afe8-d92ac417d257 req-6c39de9a-9fed-4095-913f-0f660f45066c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "446a5909-7904-4290-9a61-015b0a1f5d40", "name": "network-vif-deleted", "tag": "f42a9fb9-89c0-40cb-b996-9d91b0f13a6e"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:27.103008 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-583cfd2d-a8b4-476d-afe8-d92ac417d257 req-6c39de9a-9fed-4095-913f-0f660f45066c service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:27.103681 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-583cfd2d-a8b4-476d-afe8-d92ac417d257 req-6c39de9a-9fed-4095-913f-0f660f45066c service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:27.130697 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-583cfd2d-a8b4-476d-afe8-d92ac417d257 req-6c39de9a-9fed-4095-913f-0f660f45066c service nova] Creating event network-vif-deleted:f42a9fb9-89c0-40cb-b996-9d91b0f13a6e for instance 446a5909-7904-4290-9a61-015b0a1f5d40 on nch1-master-1 Apr 16 21:15:27.141171 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-583cfd2d-a8b4-476d-afe8-d92ac417d257 req-6c39de9a-9fed-4095-913f-0f660f45066c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050527 Apr 16 21:15:27.142531 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1255/2392] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:15:27.246530 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-99d6fdc4-3e5b-4cc7-b752-3fa60ef18a56 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:27.247309 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-99d6fdc4-3e5b-4cc7-b752-3fa60ef18a56 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:27.264350 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-99d6fdc4-3e5b-4cc7-b752-3fa60ef18a56 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:27.265982 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-99d6fdc4-3e5b-4cc7-b752-3fa60ef18a56 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:27.267691 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-99d6fdc4-3e5b-4cc7-b752-3fa60ef18a56 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:27.268144 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-99d6fdc4-3e5b-4cc7-b752-3fa60ef18a56 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:27.291169 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-93c9c6ef-1653-4127-9675-51fc791c26c3 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:27.305032 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-93c9c6ef-1653-4127-9675-51fc791c26c3 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f" status: 200 len: 1325 microversion: 2.1 time: 0.679014 Apr 16 21:15:27.318729 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1138/2393] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:26 2022] GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f => generated 1325 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:27.376086 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-99d6fdc4-3e5b-4cc7-b752-3fa60ef18a56 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:27.384461 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-99d6fdc4-3e5b-4cc7-b752-3fa60ef18a56 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:27.385993 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-99d6fdc4-3e5b-4cc7-b752-3fa60ef18a56 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:27.392569 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-99d6fdc4-3e5b-4cc7-b752-3fa60ef18a56 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1446 microversion: 2.75 time: 0.151619 Apr 16 21:15:27.393258 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1256/2394] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:27 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1446 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:15:27.641214 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a2e01488-331c-4035-844a-43fe7e48abee tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:27.641829 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a2e01488-331c-4035-844a-43fe7e48abee tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:27.647927 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a2e01488-331c-4035-844a-43fe7e48abee tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:27.648431 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a2e01488-331c-4035-844a-43fe7e48abee tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:27.649214 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a2e01488-331c-4035-844a-43fe7e48abee tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:27.649669 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a2e01488-331c-4035-844a-43fe7e48abee tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:27.779635 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a2e01488-331c-4035-844a-43fe7e48abee tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:27.787414 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a2e01488-331c-4035-844a-43fe7e48abee tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 200 len: 1474 microversion: 2.1 time: 0.150229 Apr 16 21:15:27.787986 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1139/2395] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:27 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 1474 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:15:27.867576 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e751cba8-07c1-4551-aaec-3a3fff326cce tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:27.868220 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e751cba8-07c1-4551-aaec-3a3fff326cce tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: 41932213-4c87-4ee1-909f-50d95297cd64] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:27.875419 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e751cba8-07c1-4551-aaec-3a3fff326cce tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:27.875878 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e751cba8-07c1-4551-aaec-3a3fff326cce tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:27.876690 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e751cba8-07c1-4551-aaec-3a3fff326cce tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:27.877132 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e751cba8-07c1-4551-aaec-3a3fff326cce tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:27.927087 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ba2e55f8-345d-4155-bced-943071a04ae8 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb96f41c10>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:27.940971 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e751cba8-07c1-4551-aaec-3a3fff326cce tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2bab3afb0f945eca1a7bf9f783cf9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec2ad232d62489aa704075fad5305c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:27.948530 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e751cba8-07c1-4551-aaec-3a3fff326cce tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "GET /compute/v2.1/servers/41932213-4c87-4ee1-909f-50d95297cd64" status: 200 len: 1214 microversion: 2.1 time: 0.084828 Apr 16 21:15:27.949102 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1257/2396] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:27 2022] GET /compute/v2.1/servers/41932213-4c87-4ee1-909f-50d95297cd64 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:27.978785 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ba2e55f8-345d-4155-bced-943071a04ae8 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231" status: 200 len: 1412 microversion: 2.1 time: 0.049425 Apr 16 21:15:27.978785 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1140/2397] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:15:27 2022] GET /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231 => generated 1412 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:28.326217 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-810c1c22-86d8-4fde-8c33-92a8e0569a08 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:28.327503 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-810c1c22-86d8-4fde-8c33-92a8e0569a08 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:28.338052 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-810c1c22-86d8-4fde-8c33-92a8e0569a08 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:28.339467 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-810c1c22-86d8-4fde-8c33-92a8e0569a08 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:28.341247 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-810c1c22-86d8-4fde-8c33-92a8e0569a08 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:28.341879 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-810c1c22-86d8-4fde-8c33-92a8e0569a08 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:28.417086 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e2a0b291-d436-42c8-962e-ac798fc78b96 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:28.418232 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e2a0b291-d436-42c8-962e-ac798fc78b96 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:28.433336 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e2a0b291-d436-42c8-962e-ac798fc78b96 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:28.434753 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e2a0b291-d436-42c8-962e-ac798fc78b96 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:28.437248 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e2a0b291-d436-42c8-962e-ac798fc78b96 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:28.437853 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e2a0b291-d436-42c8-962e-ac798fc78b96 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:28.590921 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e2a0b291-d436-42c8-962e-ac798fc78b96 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:28.605395 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e2a0b291-d436-42c8-962e-ac798fc78b96 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:28.609110 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e2a0b291-d436-42c8-962e-ac798fc78b96 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:28.616985 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e2a0b291-d436-42c8-962e-ac798fc78b96 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1446 microversion: 2.75 time: 0.207205 Apr 16 21:15:28.617809 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1141/2398] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:28 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1446 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:15:28.807170 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7b59ed82-f6c0-4d11-8de1-0aeaab841307 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:28.807815 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7b59ed82-f6c0-4d11-8de1-0aeaab841307 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:28.814874 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7b59ed82-f6c0-4d11-8de1-0aeaab841307 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:28.815592 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7b59ed82-f6c0-4d11-8de1-0aeaab841307 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:28.816748 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7b59ed82-f6c0-4d11-8de1-0aeaab841307 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:28.817551 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7b59ed82-f6c0-4d11-8de1-0aeaab841307 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:28.818340 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-810c1c22-86d8-4fde-8c33-92a8e0569a08 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:28.825873 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-810c1c22-86d8-4fde-8c33-92a8e0569a08 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f" status: 200 len: 1325 microversion: 2.1 time: 0.506354 Apr 16 21:15:28.839881 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1258/2399] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:28 2022] GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f => generated 1325 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:28.966423 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9c9c887f-9e77-4e43-a0c6-aef4ecfa3486 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:28.967083 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9c9c887f-9e77-4e43-a0c6-aef4ecfa3486 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: 41932213-4c87-4ee1-909f-50d95297cd64] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:28.974851 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9c9c887f-9e77-4e43-a0c6-aef4ecfa3486 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:28.975789 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9c9c887f-9e77-4e43-a0c6-aef4ecfa3486 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:28.977390 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9c9c887f-9e77-4e43-a0c6-aef4ecfa3486 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:28.978640 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9c9c887f-9e77-4e43-a0c6-aef4ecfa3486 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:29.075932 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7b59ed82-f6c0-4d11-8de1-0aeaab841307 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:29.085078 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7b59ed82-f6c0-4d11-8de1-0aeaab841307 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 200 len: 1474 microversion: 2.1 time: 0.283019 Apr 16 21:15:29.086127 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1142/2400] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:28 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 1474 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:29.092715 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c2511782-cee7-4276-826f-e3490af8aa5f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb9feaa700>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:29.102949 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9c9c887f-9e77-4e43-a0c6-aef4ecfa3486 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2bab3afb0f945eca1a7bf9f783cf9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec2ad232d62489aa704075fad5305c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:29.112712 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9c9c887f-9e77-4e43-a0c6-aef4ecfa3486 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "GET /compute/v2.1/servers/41932213-4c87-4ee1-909f-50d95297cd64" status: 200 len: 1270 microversion: 2.1 time: 0.150515 Apr 16 21:15:29.113870 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1259/2401] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:28 2022] GET /compute/v2.1/servers/41932213-4c87-4ee1-909f-50d95297cd64 => generated 1270 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:15:29.118647 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9ecb6ea4-c552-4990-910e-7a20852f86ec tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:29.119528 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9ecb6ea4-c552-4990-910e-7a20852f86ec tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:29.133120 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9ecb6ea4-c552-4990-910e-7a20852f86ec tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:29.134915 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9ecb6ea4-c552-4990-910e-7a20852f86ec tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:29.136126 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9ecb6ea4-c552-4990-910e-7a20852f86ec tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:29.136716 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9ecb6ea4-c552-4990-910e-7a20852f86ec tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:29.153139 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c2511782-cee7-4276-826f-e3490af8aa5f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231" status: 200 len: 1412 microversion: 2.1 time: 0.065701 Apr 16 21:15:29.159443 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1143/2402] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:15:29 2022] GET /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231 => generated 1412 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:29.181072 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-db177e1b-d201-4f74-8e8d-5051eafbcea1 req-957e3c98-ed1b-4a64-99dd-526314a7f6df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a839aa71-2bd6-4676-8955-1d69072cd7f0", "name": "network-vif-deleted", "tag": "e95787b0-2955-4c9d-b856-d0002bfc2eb5"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:29.189295 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-db177e1b-d201-4f74-8e8d-5051eafbcea1 req-957e3c98-ed1b-4a64-99dd-526314a7f6df service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:29.189894 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-db177e1b-d201-4f74-8e8d-5051eafbcea1 req-957e3c98-ed1b-4a64-99dd-526314a7f6df service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:29.201501 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-db177e1b-d201-4f74-8e8d-5051eafbcea1 req-957e3c98-ed1b-4a64-99dd-526314a7f6df service nova] Creating event network-vif-deleted:e95787b0-2955-4c9d-b856-d0002bfc2eb5 for instance a839aa71-2bd6-4676-8955-1d69072cd7f0 on nch1-master-1 Apr 16 21:15:29.206424 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-db177e1b-d201-4f74-8e8d-5051eafbcea1 req-957e3c98-ed1b-4a64-99dd-526314a7f6df service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029016 Apr 16 21:15:29.207402 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1144/2403] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:15:29.466932 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9ecb6ea4-c552-4990-910e-7a20852f86ec tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:29.478636 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9ecb6ea4-c552-4990-910e-7a20852f86ec tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.360859 Apr 16 21:15:29.480841 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1260/2404] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:29 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:29.497577 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e53fda9f-79b2-4843-b836-e2f51ba5356f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:29.498422 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e53fda9f-79b2-4843-b836-e2f51ba5356f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:29.507937 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e53fda9f-79b2-4843-b836-e2f51ba5356f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:29.510750 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e53fda9f-79b2-4843-b836-e2f51ba5356f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:29.511610 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e53fda9f-79b2-4843-b836-e2f51ba5356f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:29.515703 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e53fda9f-79b2-4843-b836-e2f51ba5356f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:29.637201 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-407eef50-d239-4358-8b5a-9bf5673e77e9 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:29.637827 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-407eef50-d239-4358-8b5a-9bf5673e77e9 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:29.644488 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-407eef50-d239-4358-8b5a-9bf5673e77e9 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:29.645191 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-407eef50-d239-4358-8b5a-9bf5673e77e9 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:29.646216 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-407eef50-d239-4358-8b5a-9bf5673e77e9 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:29.646834 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-407eef50-d239-4358-8b5a-9bf5673e77e9 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:29.702266 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e53fda9f-79b2-4843-b836-e2f51ba5356f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:29.710492 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e53fda9f-79b2-4843-b836-e2f51ba5356f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.217607 Apr 16 21:15:29.713298 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1145/2405] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:29 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:29.729602 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b72f1f50-fc5f-495b-ad3e-b597787b4137 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:29.730320 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b72f1f50-fc5f-495b-ad3e-b597787b4137 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:29.736451 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b72f1f50-fc5f-495b-ad3e-b597787b4137 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:29.736979 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b72f1f50-fc5f-495b-ad3e-b597787b4137 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:29.737859 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b72f1f50-fc5f-495b-ad3e-b597787b4137 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:29.738373 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b72f1f50-fc5f-495b-ad3e-b597787b4137 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:29.746074 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-407eef50-d239-4358-8b5a-9bf5673e77e9 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:29.757853 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-407eef50-d239-4358-8b5a-9bf5673e77e9 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:29.760484 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-407eef50-d239-4358-8b5a-9bf5673e77e9 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:29.767046 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-407eef50-d239-4358-8b5a-9bf5673e77e9 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1446 microversion: 2.75 time: 0.133721 Apr 16 21:15:29.768269 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1261/2406] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:29 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1446 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:15:29.785690 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-1b9a9cdb-505e-48b7-815e-b96d91c3ea14 req-992fe074-e660-4376-add4-f5c1c3c51aa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a03d234-848c-408c-b46c-e2afebb2c61f", "tag": "f5131071-ff36-4b36-bf83-e46eb31e3bf8"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:29.796275 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-1b9a9cdb-505e-48b7-815e-b96d91c3ea14 req-992fe074-e660-4376-add4-f5c1c3c51aa8 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:29.797116 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-1b9a9cdb-505e-48b7-815e-b96d91c3ea14 req-992fe074-e660-4376-add4-f5c1c3c51aa8 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:29.813304 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-1b9a9cdb-505e-48b7-815e-b96d91c3ea14 req-992fe074-e660-4376-add4-f5c1c3c51aa8 service nova] Creating event network-changed:f5131071-ff36-4b36-bf83-e46eb31e3bf8 for instance 1a03d234-848c-408c-b46c-e2afebb2c61f on nch2-master-1 Apr 16 21:15:29.820042 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-1b9a9cdb-505e-48b7-815e-b96d91c3ea14 req-992fe074-e660-4376-add4-f5c1c3c51aa8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039580 Apr 16 21:15:29.822193 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1262/2407] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:15:29.848469 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-90690c2f-f8e7-4483-af0d-39072a9f6d86 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:29.849672 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-90690c2f-f8e7-4483-af0d-39072a9f6d86 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:29.857585 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-90690c2f-f8e7-4483-af0d-39072a9f6d86 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:29.858371 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-90690c2f-f8e7-4483-af0d-39072a9f6d86 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:29.859442 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-90690c2f-f8e7-4483-af0d-39072a9f6d86 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:29.860370 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-90690c2f-f8e7-4483-af0d-39072a9f6d86 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:30.082676 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b72f1f50-fc5f-495b-ad3e-b597787b4137 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:30.092103 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b72f1f50-fc5f-495b-ad3e-b597787b4137 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.366716 Apr 16 21:15:30.096353 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1146/2408] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:29 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:30.100466 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-90690c2f-f8e7-4483-af0d-39072a9f6d86 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:30.109254 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-80927968-0711-44d3-97ed-e7e5b712fa5f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:30.112043 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-80927968-0711-44d3-97ed-e7e5b712fa5f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:30.122075 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-90690c2f-f8e7-4483-af0d-39072a9f6d86 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f" status: 200 len: 1325 microversion: 2.1 time: 0.281698 Apr 16 21:15:30.123082 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1263/2409] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:29 2022] GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f => generated 1325 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:30.130925 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c79c5d0a-c979-4b13-8a6b-c1466d2fde43 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:30.132187 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-80927968-0711-44d3-97ed-e7e5b712fa5f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:30.132586 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c79c5d0a-c979-4b13-8a6b-c1466d2fde43 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:30.132744 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-80927968-0711-44d3-97ed-e7e5b712fa5f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:30.133595 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-80927968-0711-44d3-97ed-e7e5b712fa5f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:30.134561 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-80927968-0711-44d3-97ed-e7e5b712fa5f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:30.148209 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c79c5d0a-c979-4b13-8a6b-c1466d2fde43 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:30.149139 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c79c5d0a-c979-4b13-8a6b-c1466d2fde43 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:30.150986 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c79c5d0a-c979-4b13-8a6b-c1466d2fde43 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:30.152499 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c79c5d0a-c979-4b13-8a6b-c1466d2fde43 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:30.371826 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c79c5d0a-c979-4b13-8a6b-c1466d2fde43 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:30.383480 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c79c5d0a-c979-4b13-8a6b-c1466d2fde43 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 200 len: 1471 microversion: 2.1 time: 0.258491 Apr 16 21:15:30.396250 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-80927968-0711-44d3-97ed-e7e5b712fa5f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "POST /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa/action" status: 202 len: 0 microversion: 2.1 time: 0.286319 Apr 16 21:15:30.396250 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1147/2410] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:15:30 2022] POST /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:15:30.404212 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d979f9f7-00c3-44f3-bdf7-c250d156a3f1 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:30.407572 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d979f9f7-00c3-44f3-bdf7-c250d156a3f1 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: 41932213-4c87-4ee1-909f-50d95297cd64] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:30.410366 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1264/2411] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:30 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 1471 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:30.417209 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d979f9f7-00c3-44f3-bdf7-c250d156a3f1 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:30.419751 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d979f9f7-00c3-44f3-bdf7-c250d156a3f1 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:30.419751 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d979f9f7-00c3-44f3-bdf7-c250d156a3f1 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:30.419751 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d979f9f7-00c3-44f3-bdf7-c250d156a3f1 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:30.420160 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7c7f0a61-4fe4-45b9-acd3-84bb5e9b0a68 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb965b63a0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:30.488693 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7c7f0a61-4fe4-45b9-acd3-84bb5e9b0a68 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231" status: 200 len: 1412 microversion: 2.1 time: 0.070203 Apr 16 21:15:30.488693 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1265/2412] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:15:30 2022] GET /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231 => generated 1412 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:30.488693 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-090f703c-64b6-4eb7-aca0-0dbfa14412bc tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:30.489152 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-090f703c-64b6-4eb7-aca0-0dbfa14412bc tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:30.508508 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-090f703c-64b6-4eb7-aca0-0dbfa14412bc tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:30.508815 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-090f703c-64b6-4eb7-aca0-0dbfa14412bc tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:30.510567 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-090f703c-64b6-4eb7-aca0-0dbfa14412bc tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:30.511177 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-090f703c-64b6-4eb7-aca0-0dbfa14412bc tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:30.754230 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-090f703c-64b6-4eb7-aca0-0dbfa14412bc tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "POST /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef/action" status: 204 len: 0 microversion: 2.1 time: 0.268676 Apr 16 21:15:30.758217 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1266/2413] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:15:30 2022] POST /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef/action => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:15:30.764385 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ead3a8f6-f024-40fa-8467-dd38bddc8511 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:30.764765 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ead3a8f6-f024-40fa-8467-dd38bddc8511 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:30.779692 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ead3a8f6-f024-40fa-8467-dd38bddc8511 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:30.780151 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ead3a8f6-f024-40fa-8467-dd38bddc8511 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:30.780981 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ead3a8f6-f024-40fa-8467-dd38bddc8511 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:30.781884 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ead3a8f6-f024-40fa-8467-dd38bddc8511 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:30.813620 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d979f9f7-00c3-44f3-bdf7-c250d156a3f1 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2bab3afb0f945eca1a7bf9f783cf9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec2ad232d62489aa704075fad5305c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:30.824394 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d979f9f7-00c3-44f3-bdf7-c250d156a3f1 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "GET /compute/v2.1/servers/41932213-4c87-4ee1-909f-50d95297cd64" status: 200 len: 1318 microversion: 2.1 time: 0.430262 Apr 16 21:15:30.825062 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1148/2414] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:30 2022] GET /compute/v2.1/servers/41932213-4c87-4ee1-909f-50d95297cd64 => generated 1318 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:30.830707 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3af0632d-4984-4a5a-9321-19ccd67b4413 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:30.831543 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3af0632d-4984-4a5a-9321-19ccd67b4413 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:30.839379 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3af0632d-4984-4a5a-9321-19ccd67b4413 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:30.839846 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3af0632d-4984-4a5a-9321-19ccd67b4413 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:30.840800 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3af0632d-4984-4a5a-9321-19ccd67b4413 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:30.841372 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3af0632d-4984-4a5a-9321-19ccd67b4413 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:31.086614 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ead3a8f6-f024-40fa-8467-dd38bddc8511 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:31.098066 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ead3a8f6-f024-40fa-8467-dd38bddc8511 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1672 microversion: 2.1 time: 0.338144 Apr 16 21:15:31.098954 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1267/2415] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:30 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1672 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:31.105965 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-96b9ff86-2a08-47d6-b873-df2fdcc826a5 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:31.107304 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-96b9ff86-2a08-47d6-b873-df2fdcc826a5 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:31.115404 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-96b9ff86-2a08-47d6-b873-df2fdcc826a5 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:31.116250 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-96b9ff86-2a08-47d6-b873-df2fdcc826a5 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:31.121263 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-96b9ff86-2a08-47d6-b873-df2fdcc826a5 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:31.121263 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-96b9ff86-2a08-47d6-b873-df2fdcc826a5 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:31.206625 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-96b9ff86-2a08-47d6-b873-df2fdcc826a5 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:31.215541 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-96b9ff86-2a08-47d6-b873-df2fdcc826a5 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:31.217116 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-96b9ff86-2a08-47d6-b873-df2fdcc826a5 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:31.222337 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-96b9ff86-2a08-47d6-b873-df2fdcc826a5 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1446 microversion: 2.75 time: 0.121975 Apr 16 21:15:31.222939 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1268/2416] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:31 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1446 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:15:31.228597 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fef29f04-18aa-4092-b7ed-78a435082bbd tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:31.229215 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fef29f04-18aa-4092-b7ed-78a435082bbd tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:31.234973 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fef29f04-18aa-4092-b7ed-78a435082bbd tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:31.236309 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fef29f04-18aa-4092-b7ed-78a435082bbd tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:31.236309 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fef29f04-18aa-4092-b7ed-78a435082bbd tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:31.236715 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fef29f04-18aa-4092-b7ed-78a435082bbd tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:31.313095 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3af0632d-4984-4a5a-9321-19ccd67b4413 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:31.328948 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3af0632d-4984-4a5a-9321-19ccd67b4413 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 200 len: 1471 microversion: 2.1 time: 0.502308 Apr 16 21:15:31.336153 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1149/2417] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:30 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 1471 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:31.372429 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fef29f04-18aa-4092-b7ed-78a435082bbd tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:31.383560 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fef29f04-18aa-4092-b7ed-78a435082bbd tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f" status: 200 len: 1325 microversion: 2.1 time: 0.159424 Apr 16 21:15:31.385728 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1269/2418] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:31 2022] GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f => generated 1325 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:31.495850 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6fa59109-121c-480a-a75d-f100ba6ae164 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb96f975e0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:31.544882 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6fa59109-121c-480a-a75d-f100ba6ae164 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231" status: 200 len: 1412 microversion: 2.1 time: 0.052834 Apr 16 21:15:31.545527 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1150/2419] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:15:31 2022] GET /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231 => generated 1412 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:31.847680 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-78c11d0c-257f-4f84-928e-6d149e2e737d tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:31.847680 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-78c11d0c-257f-4f84-928e-6d149e2e737d tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: 41932213-4c87-4ee1-909f-50d95297cd64] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:31.852046 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-78c11d0c-257f-4f84-928e-6d149e2e737d tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:31.853059 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-78c11d0c-257f-4f84-928e-6d149e2e737d tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:31.853855 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-78c11d0c-257f-4f84-928e-6d149e2e737d tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:31.854302 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-78c11d0c-257f-4f84-928e-6d149e2e737d tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:31.943642 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-2a836840-be67-4d3c-8364-726ec49073b2 req-284cdbd1-c479-4db2-9dfb-46f419296cda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae2e0ce1-35a6-4ef8-83f4-44237fe59f65", "tag": "1bf2401d-a2fc-43d2-8639-8a27abfa3686"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:31.964202 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-2a836840-be67-4d3c-8364-726ec49073b2 req-284cdbd1-c479-4db2-9dfb-46f419296cda service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:31.964771 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-2a836840-be67-4d3c-8364-726ec49073b2 req-284cdbd1-c479-4db2-9dfb-46f419296cda service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:31.977579 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-2a836840-be67-4d3c-8364-726ec49073b2 req-284cdbd1-c479-4db2-9dfb-46f419296cda service nova] Creating event network-changed:1bf2401d-a2fc-43d2-8639-8a27abfa3686 for instance ae2e0ce1-35a6-4ef8-83f4-44237fe59f65 on nch1-master-1 Apr 16 21:15:31.983173 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-2a836840-be67-4d3c-8364-726ec49073b2 req-284cdbd1-c479-4db2-9dfb-46f419296cda service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043520 Apr 16 21:15:31.985238 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1151/2420] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:15:32.041362 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-78c11d0c-257f-4f84-928e-6d149e2e737d tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2bab3afb0f945eca1a7bf9f783cf9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec2ad232d62489aa704075fad5305c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:32.050094 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-78c11d0c-257f-4f84-928e-6d149e2e737d tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "GET /compute/v2.1/servers/41932213-4c87-4ee1-909f-50d95297cd64" status: 200 len: 1318 microversion: 2.1 time: 0.211346 Apr 16 21:15:32.050957 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1270/2421] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:31 2022] GET /compute/v2.1/servers/41932213-4c87-4ee1-909f-50d95297cd64 => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:32.099195 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-ca070ae2-ccdf-4374-ae78-335c1ad44a96 req-3e0376d8-ddd9-4b6e-8726-e920b5a63d49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0602327-eafa-416f-8114-3411e37e2eef", "name": "network-vif-plugged", "status": "completed", "tag": "0e4ce80e-dded-45a4-8cad-59e6b3b64323"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:32.110346 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-ca070ae2-ccdf-4374-ae78-335c1ad44a96 req-3e0376d8-ddd9-4b6e-8726-e920b5a63d49 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:32.115913 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bd194077-c076-415b-94c1-dfae646cafaa tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:32.116865 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-bd194077-c076-415b-94c1-dfae646cafaa tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:32.120187 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-ca070ae2-ccdf-4374-ae78-335c1ad44a96 req-3e0376d8-ddd9-4b6e-8726-e920b5a63d49 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:32.128008 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bd194077-c076-415b-94c1-dfae646cafaa tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:32.128368 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bd194077-c076-415b-94c1-dfae646cafaa tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:32.129362 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bd194077-c076-415b-94c1-dfae646cafaa tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:32.129815 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bd194077-c076-415b-94c1-dfae646cafaa tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:32.142513 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-ca070ae2-ccdf-4374-ae78-335c1ad44a96 req-3e0376d8-ddd9-4b6e-8726-e920b5a63d49 service nova] Creating event network-vif-plugged:0e4ce80e-dded-45a4-8cad-59e6b3b64323 for instance a0602327-eafa-416f-8114-3411e37e2eef on nch2-master-1 Apr 16 21:15:32.150478 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [req-ca070ae2-ccdf-4374-ae78-335c1ad44a96 req-3e0376d8-ddd9-4b6e-8726-e920b5a63d49 service nova] Instance a0602327-eafa-416f-8114-3411e37e2eef is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137409) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 16 21:15:32.162938 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-ca070ae2-ccdf-4374-ae78-335c1ad44a96 req-3e0376d8-ddd9-4b6e-8726-e920b5a63d49 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068256 Apr 16 21:15:32.163966 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1152/2422] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:15:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:15:32.250287 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-dd302a5d-38d9-4a73-ba97-2e19eec660e3 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:32.255810 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-dd302a5d-38d9-4a73-ba97-2e19eec660e3 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:32.258018 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dd302a5d-38d9-4a73-ba97-2e19eec660e3 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:32.258499 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dd302a5d-38d9-4a73-ba97-2e19eec660e3 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:32.259345 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dd302a5d-38d9-4a73-ba97-2e19eec660e3 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:32.260004 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dd302a5d-38d9-4a73-ba97-2e19eec660e3 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:32.310964 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-bd194077-c076-415b-94c1-dfae646cafaa tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:32.319434 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-bd194077-c076-415b-94c1-dfae646cafaa tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1672 microversion: 2.1 time: 0.207230 Apr 16 21:15:32.320038 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1271/2423] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:32 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1672 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:15:32.348941 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d6bb9aaa-e7e6-44a9-aa51-23401edb9636 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:32.349855 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d6bb9aaa-e7e6-44a9-aa51-23401edb9636 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:32.357138 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d6bb9aaa-e7e6-44a9-aa51-23401edb9636 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:32.357695 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d6bb9aaa-e7e6-44a9-aa51-23401edb9636 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:32.358569 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d6bb9aaa-e7e6-44a9-aa51-23401edb9636 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:32.359125 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d6bb9aaa-e7e6-44a9-aa51-23401edb9636 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:32.428457 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-dd302a5d-38d9-4a73-ba97-2e19eec660e3 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:32.440085 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-dd302a5d-38d9-4a73-ba97-2e19eec660e3 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:32.441843 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-dd302a5d-38d9-4a73-ba97-2e19eec660e3 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:32.447575 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-dd302a5d-38d9-4a73-ba97-2e19eec660e3 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1446 microversion: 2.75 time: 0.201952 Apr 16 21:15:32.459891 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1153/2424] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:32 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1446 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:15:32.466216 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8406de50-a3d7-46fa-807a-bd6e73f3347b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:32.467064 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8406de50-a3d7-46fa-807a-bd6e73f3347b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:32.473535 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8406de50-a3d7-46fa-807a-bd6e73f3347b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:32.473994 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8406de50-a3d7-46fa-807a-bd6e73f3347b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:32.474989 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8406de50-a3d7-46fa-807a-bd6e73f3347b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:32.475439 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8406de50-a3d7-46fa-807a-bd6e73f3347b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:32.514414 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d6bb9aaa-e7e6-44a9-aa51-23401edb9636 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:32.523475 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d6bb9aaa-e7e6-44a9-aa51-23401edb9636 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 200 len: 1471 microversion: 2.1 time: 0.178587 Apr 16 21:15:32.524155 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1272/2425] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:32 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 1471 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:15:32.558637 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-76c774aa-7ee5-428d-b8a9-262e7a5c2aa6 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbba0077700>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:32.606258 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-76c774aa-7ee5-428d-b8a9-262e7a5c2aa6 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231" status: 200 len: 1412 microversion: 2.1 time: 0.052006 Apr 16 21:15:32.606852 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1273/2426] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:15:32 2022] GET /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231 => generated 1412 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:32.863524 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8406de50-a3d7-46fa-807a-bd6e73f3347b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:32.871582 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8406de50-a3d7-46fa-807a-bd6e73f3347b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f" status: 200 len: 1325 microversion: 2.1 time: 0.410306 Apr 16 21:15:32.872165 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1154/2427] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:32 2022] GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f => generated 1325 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:33.067940 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fb5d7e48-d8e3-437e-9f5b-52c45a1c2d6a tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:33.072995 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fb5d7e48-d8e3-437e-9f5b-52c45a1c2d6a tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: 41932213-4c87-4ee1-909f-50d95297cd64] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:33.074840 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fb5d7e48-d8e3-437e-9f5b-52c45a1c2d6a tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:33.075298 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fb5d7e48-d8e3-437e-9f5b-52c45a1c2d6a tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:33.076196 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fb5d7e48-d8e3-437e-9f5b-52c45a1c2d6a tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:33.076665 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fb5d7e48-d8e3-437e-9f5b-52c45a1c2d6a tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:33.211734 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fb5d7e48-d8e3-437e-9f5b-52c45a1c2d6a tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2bab3afb0f945eca1a7bf9f783cf9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec2ad232d62489aa704075fad5305c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:33.221816 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fb5d7e48-d8e3-437e-9f5b-52c45a1c2d6a tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "GET /compute/v2.1/servers/41932213-4c87-4ee1-909f-50d95297cd64" status: 200 len: 1318 microversion: 2.1 time: 0.158369 Apr 16 21:15:33.222495 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1274/2428] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:33 2022] GET /compute/v2.1/servers/41932213-4c87-4ee1-909f-50d95297cd64 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:33.337661 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a22028bf-70fa-4b88-9b60-8b09857713f3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:33.338271 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a22028bf-70fa-4b88-9b60-8b09857713f3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:33.345196 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a22028bf-70fa-4b88-9b60-8b09857713f3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:33.345656 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a22028bf-70fa-4b88-9b60-8b09857713f3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:33.346518 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a22028bf-70fa-4b88-9b60-8b09857713f3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:33.346961 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a22028bf-70fa-4b88-9b60-8b09857713f3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:33.467804 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e7c6cf52-42b8-4030-94ac-ba2d79318f81 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:33.468496 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e7c6cf52-42b8-4030-94ac-ba2d79318f81 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:33.475632 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e7c6cf52-42b8-4030-94ac-ba2d79318f81 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:33.476133 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e7c6cf52-42b8-4030-94ac-ba2d79318f81 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:33.476989 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e7c6cf52-42b8-4030-94ac-ba2d79318f81 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:33.477425 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e7c6cf52-42b8-4030-94ac-ba2d79318f81 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:33.542534 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e7c6cf52-42b8-4030-94ac-ba2d79318f81 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:33.551952 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e7c6cf52-42b8-4030-94ac-ba2d79318f81 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:33.557087 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e7c6cf52-42b8-4030-94ac-ba2d79318f81 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:33.559162 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e7c6cf52-42b8-4030-94ac-ba2d79318f81 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1446 microversion: 2.75 time: 0.095502 Apr 16 21:15:33.560501 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1275/2429] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:33 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1446 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:15:33.565254 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-159a4c2b-d8f8-4f32-8278-3cabc08cf4ea tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:33.565863 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-159a4c2b-d8f8-4f32-8278-3cabc08cf4ea tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:33.572483 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-159a4c2b-d8f8-4f32-8278-3cabc08cf4ea tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:33.572944 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-159a4c2b-d8f8-4f32-8278-3cabc08cf4ea tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:33.573891 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-159a4c2b-d8f8-4f32-8278-3cabc08cf4ea tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:33.574383 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-159a4c2b-d8f8-4f32-8278-3cabc08cf4ea tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:33.618179 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a22028bf-70fa-4b88-9b60-8b09857713f3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:33.626146 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a22028bf-70fa-4b88-9b60-8b09857713f3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1672 microversion: 2.1 time: 0.293144 Apr 16 21:15:33.627376 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1155/2430] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:33 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1672 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:33.641086 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9cff471e-efaa-428d-9129-27869009bc45 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb96258040>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:33.698588 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9cff471e-efaa-428d-9129-27869009bc45 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231" status: 200 len: 1412 microversion: 2.1 time: 0.069695 Apr 16 21:15:33.699592 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1156/2431] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:15:33 2022] GET /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231 => generated 1412 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:33.735366 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-159a4c2b-d8f8-4f32-8278-3cabc08cf4ea tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:33.743087 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-159a4c2b-d8f8-4f32-8278-3cabc08cf4ea tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 200 len: 1471 microversion: 2.1 time: 0.181448 Apr 16 21:15:33.744278 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1276/2432] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:33 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 1471 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:33.888486 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1bc04b63-1f2f-44e3-acd8-3fca9f51c2f0 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:33.889109 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1bc04b63-1f2f-44e3-acd8-3fca9f51c2f0 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:33.902365 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1bc04b63-1f2f-44e3-acd8-3fca9f51c2f0 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:33.902802 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1bc04b63-1f2f-44e3-acd8-3fca9f51c2f0 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:33.903941 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1bc04b63-1f2f-44e3-acd8-3fca9f51c2f0 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:33.904411 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1bc04b63-1f2f-44e3-acd8-3fca9f51c2f0 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:34.014168 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-eec2c113-38e1-493c-82c3-d5364d9781a5 req-e2a4b849-e5a7-40bc-8ea9-68075eaa2a09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41932213-4c87-4ee1-909f-50d95297cd64", "tag": "101a84f6-6ff5-4c6a-b599-738ac67c53ee"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:34.022476 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-eec2c113-38e1-493c-82c3-d5364d9781a5 req-e2a4b849-e5a7-40bc-8ea9-68075eaa2a09 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:34.023519 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-eec2c113-38e1-493c-82c3-d5364d9781a5 req-e2a4b849-e5a7-40bc-8ea9-68075eaa2a09 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:34.035367 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-eec2c113-38e1-493c-82c3-d5364d9781a5 req-e2a4b849-e5a7-40bc-8ea9-68075eaa2a09 service nova] Creating event network-changed:101a84f6-6ff5-4c6a-b599-738ac67c53ee for instance 41932213-4c87-4ee1-909f-50d95297cd64 on nch1-master-1 Apr 16 21:15:34.041023 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-eec2c113-38e1-493c-82c3-d5364d9781a5 req-e2a4b849-e5a7-40bc-8ea9-68075eaa2a09 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030632 Apr 16 21:15:34.042123 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1277/2433] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:15:34.107590 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1bc04b63-1f2f-44e3-acd8-3fca9f51c2f0 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:34.115109 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1bc04b63-1f2f-44e3-acd8-3fca9f51c2f0 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f" status: 200 len: 1325 microversion: 2.1 time: 0.230708 Apr 16 21:15:34.115889 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1157/2434] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:33 2022] GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f => generated 1325 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:34.239478 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-60fdafd7-b208-4c83-a31d-56bcf7e33aec tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:34.240230 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-60fdafd7-b208-4c83-a31d-56bcf7e33aec tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: 41932213-4c87-4ee1-909f-50d95297cd64] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:34.247610 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-60fdafd7-b208-4c83-a31d-56bcf7e33aec tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:34.248011 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-60fdafd7-b208-4c83-a31d-56bcf7e33aec tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:34.248859 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-60fdafd7-b208-4c83-a31d-56bcf7e33aec tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:34.249335 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-60fdafd7-b208-4c83-a31d-56bcf7e33aec tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:34.396407 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-60fdafd7-b208-4c83-a31d-56bcf7e33aec tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2bab3afb0f945eca1a7bf9f783cf9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec2ad232d62489aa704075fad5305c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:34.404659 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-60fdafd7-b208-4c83-a31d-56bcf7e33aec tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "GET /compute/v2.1/servers/41932213-4c87-4ee1-909f-50d95297cd64" status: 200 len: 1318 microversion: 2.1 time: 0.169493 Apr 16 21:15:34.407378 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1278/2435] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:34 2022] GET /compute/v2.1/servers/41932213-4c87-4ee1-909f-50d95297cd64 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:34.579436 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-25e0b1a0-8200-4d10-a1b0-cb7da2c4892e tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:34.580052 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-25e0b1a0-8200-4d10-a1b0-cb7da2c4892e tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:34.586834 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-25e0b1a0-8200-4d10-a1b0-cb7da2c4892e tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:34.587950 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-25e0b1a0-8200-4d10-a1b0-cb7da2c4892e tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:34.588751 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-25e0b1a0-8200-4d10-a1b0-cb7da2c4892e tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:34.589201 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-25e0b1a0-8200-4d10-a1b0-cb7da2c4892e tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:34.645087 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5727fb24-5f78-447b-a85d-4721df44279d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:34.645921 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5727fb24-5f78-447b-a85d-4721df44279d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:34.652531 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-25e0b1a0-8200-4d10-a1b0-cb7da2c4892e tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:34.652696 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5727fb24-5f78-447b-a85d-4721df44279d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:34.653136 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5727fb24-5f78-447b-a85d-4721df44279d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:34.653923 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5727fb24-5f78-447b-a85d-4721df44279d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:34.654371 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5727fb24-5f78-447b-a85d-4721df44279d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:34.660738 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-25e0b1a0-8200-4d10-a1b0-cb7da2c4892e tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:34.662255 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-25e0b1a0-8200-4d10-a1b0-cb7da2c4892e tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:34.667648 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-25e0b1a0-8200-4d10-a1b0-cb7da2c4892e tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1446 microversion: 2.75 time: 0.092186 Apr 16 21:15:34.668456 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1158/2436] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:34 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1446 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:15:34.712600 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ce0c86a7-be82-4be4-8034-5f6714921289 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb96f2e1f0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:34.755064 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ce0c86a7-be82-4be4-8034-5f6714921289 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231" status: 200 len: 1412 microversion: 2.1 time: 0.046718 Apr 16 21:15:34.756228 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1159/2437] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:15:34 2022] GET /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231 => generated 1412 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:15:34.764991 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5f1d1d3d-fc5b-42db-b47e-cc54809e7107 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:34.765644 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5f1d1d3d-fc5b-42db-b47e-cc54809e7107 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:34.771852 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5f1d1d3d-fc5b-42db-b47e-cc54809e7107 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:34.776345 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5f1d1d3d-fc5b-42db-b47e-cc54809e7107 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:34.776345 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5f1d1d3d-fc5b-42db-b47e-cc54809e7107 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:34.776345 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5f1d1d3d-fc5b-42db-b47e-cc54809e7107 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:34.796255 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5727fb24-5f78-447b-a85d-4721df44279d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:34.804427 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5727fb24-5f78-447b-a85d-4721df44279d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1677 microversion: 2.1 time: 0.163144 Apr 16 21:15:34.805215 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1279/2438] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:34 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:15:34.910302 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5f1d1d3d-fc5b-42db-b47e-cc54809e7107 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:34.917974 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5f1d1d3d-fc5b-42db-b47e-cc54809e7107 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 200 len: 1463 microversion: 2.1 time: 0.161065 Apr 16 21:15:34.918541 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1160/2439] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:34 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 1463 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:34.935780 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c62f65f4-6685-45c7-9ea5-8338a8dd80e4 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:34.936430 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c62f65f4-6685-45c7-9ea5-8338a8dd80e4 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:34.942379 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c62f65f4-6685-45c7-9ea5-8338a8dd80e4 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:34.942852 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c62f65f4-6685-45c7-9ea5-8338a8dd80e4 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:34.948475 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c62f65f4-6685-45c7-9ea5-8338a8dd80e4 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:34.948475 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c62f65f4-6685-45c7-9ea5-8338a8dd80e4 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:35.080990 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c62f65f4-6685-45c7-9ea5-8338a8dd80e4 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 200 len: 1614 microversion: 2.1 time: 0.148850 Apr 16 21:15:35.081616 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1280/2440] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:34 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 1614 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:35.104738 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bb18c1d7-4f4b-4106-9376-9f7ca6c56ab2 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Calling method '.version_select at 0x7fbb96bb0c10>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:35.107201 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bb18c1d7-4f4b-4106-9376-9f7ca6c56ab2 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:35.107603 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bb18c1d7-4f4b-4106-9376-9f7ca6c56ab2 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:35.114468 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bb18c1d7-4f4b-4106-9376-9f7ca6c56ab2 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.013920 Apr 16 21:15:35.115031 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1161/2441] 10.222.0.20 () {58 vars in 1142 bytes} [Sat Apr 16 21:15:35 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:15:35.132428 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-83080f18-d4cd-4b7a-b2a8-71f116ab86ff tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:35.133069 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-83080f18-d4cd-4b7a-b2a8-71f116ab86ff tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:35.139587 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-83080f18-d4cd-4b7a-b2a8-71f116ab86ff tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:35.140053 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-83080f18-d4cd-4b7a-b2a8-71f116ab86ff tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:35.140913 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-83080f18-d4cd-4b7a-b2a8-71f116ab86ff tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:35.141376 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-83080f18-d4cd-4b7a-b2a8-71f116ab86ff tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:35.268460 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8ccfafbf-878c-4218-917e-2862da535a33 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1934313383", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:35.275342 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-83080f18-d4cd-4b7a-b2a8-71f116ab86ff tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:35.293175 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-83080f18-d4cd-4b7a-b2a8-71f116ab86ff tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f" status: 200 len: 1325 microversion: 2.1 time: 0.154670 Apr 16 21:15:35.293175 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1281/2442] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:35 2022] GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f => generated 1325 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:35.318236 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-8ccfafbf-878c-4218-917e-2862da535a33 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] validate_networks() for None {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:15:35.427166 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ebce81b7-55c9-4e77-910a-e3edb0939f94 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:35.427806 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ebce81b7-55c9-4e77-910a-e3edb0939f94 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: 41932213-4c87-4ee1-909f-50d95297cd64] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:35.434831 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ebce81b7-55c9-4e77-910a-e3edb0939f94 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:35.435302 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ebce81b7-55c9-4e77-910a-e3edb0939f94 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:35.436098 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ebce81b7-55c9-4e77-910a-e3edb0939f94 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:35.436577 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ebce81b7-55c9-4e77-910a-e3edb0939f94 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:35.523676 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-8ccfafbf-878c-4218-917e-2862da535a33 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:15:35.524192 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-8ccfafbf-878c-4218-917e-2862da535a33 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:15:35.525321 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-8ccfafbf-878c-4218-917e-2862da535a33 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:15:35.525826 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-8ccfafbf-878c-4218-917e-2862da535a33 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:15:35.526314 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-8ccfafbf-878c-4218-917e-2862da535a33 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:15:35.535984 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8ccfafbf-878c-4218-917e-2862da535a33 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:35.536555 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8ccfafbf-878c-4218-917e-2862da535a33 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:35.537462 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8ccfafbf-878c-4218-917e-2862da535a33 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:35.537978 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8ccfafbf-878c-4218-917e-2862da535a33 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:35.555481 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-8ccfafbf-878c-4218-917e-2862da535a33 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Getting quotas for project 29fd420ef9134715bd3a9f2467d924cd. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:15:35.560946 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-8ccfafbf-878c-4218-917e-2862da535a33 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Getting quotas for user d17cad39fa38448eb9827605871463a3 and project 29fd420ef9134715bd3a9f2467d924cd. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:15:35.567761 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ebce81b7-55c9-4e77-910a-e3edb0939f94 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2bab3afb0f945eca1a7bf9f783cf9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec2ad232d62489aa704075fad5305c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:35.573842 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8ccfafbf-878c-4218-917e-2862da535a33 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:15:35.575426 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ebce81b7-55c9-4e77-910a-e3edb0939f94 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "GET /compute/v2.1/servers/41932213-4c87-4ee1-909f-50d95297cd64" status: 200 len: 1318 microversion: 2.1 time: 0.152401 Apr 16 21:15:35.576027 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1282/2443] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:35 2022] GET /compute/v2.1/servers/41932213-4c87-4ee1-909f-50d95297cd64 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:15:35.576150 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8ccfafbf-878c-4218-917e-2862da535a33 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:15:35.687589 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-69406220-f9a0-4db9-9568-259161c0fc4a tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:35.687828 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-69406220-f9a0-4db9-9568-259161c0fc4a tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:35.694466 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-69406220-f9a0-4db9-9568-259161c0fc4a tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:35.694919 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-69406220-f9a0-4db9-9568-259161c0fc4a tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:35.695728 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-69406220-f9a0-4db9-9568-259161c0fc4a tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:35.696258 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-69406220-f9a0-4db9-9568-259161c0fc4a tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:35.775152 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8ccfafbf-878c-4218-917e-2862da535a33 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.509345 Apr 16 21:15:35.775152 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1162/2444] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:15:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 511 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 16 21:15:35.777475 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-69406220-f9a0-4db9-9568-259161c0fc4a tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:35.784867 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-aa829a1a-2b8e-42b4-878f-69012003b2d9 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb96bb00d0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:35.787587 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-69406220-f9a0-4db9-9568-259161c0fc4a tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:35.794329 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-69406220-f9a0-4db9-9568-259161c0fc4a tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:35.809307 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-69406220-f9a0-4db9-9568-259161c0fc4a tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1446 microversion: 2.75 time: 0.125975 Apr 16 21:15:35.809896 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1283/2445] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:35 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1446 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:15:35.827592 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d2a6243a-5f31-4b35-b1a9-433ccc484ce3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:35.828267 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d2a6243a-5f31-4b35-b1a9-433ccc484ce3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:35.847429 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-aa829a1a-2b8e-42b4-878f-69012003b2d9 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231" status: 200 len: 1412 microversion: 2.1 time: 0.071012 Apr 16 21:15:35.848370 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1163/2446] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:15:35 2022] GET /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231 => generated 1412 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:35.854430 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-74056f3a-e7c8-4505-b7ad-33850391d937 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:35.855419 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-74056f3a-e7c8-4505-b7ad-33850391d937 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:35.863496 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-74056f3a-e7c8-4505-b7ad-33850391d937 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:35.864826 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-74056f3a-e7c8-4505-b7ad-33850391d937 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:35.866000 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-74056f3a-e7c8-4505-b7ad-33850391d937 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:35.866722 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-74056f3a-e7c8-4505-b7ad-33850391d937 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:35.928253 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d2a6243a-5f31-4b35-b1a9-433ccc484ce3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:35.935674 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d2a6243a-5f31-4b35-b1a9-433ccc484ce3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1213 microversion: 2.1 time: 0.117448 Apr 16 21:15:35.936278 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1284/2447] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:35 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1213 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:36.138509 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-74056f3a-e7c8-4505-b7ad-33850391d937 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:36.146796 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-74056f3a-e7c8-4505-b7ad-33850391d937 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.297116 Apr 16 21:15:36.147666 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1164/2448] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:35 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:36.163747 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-10cc3c9a-6513-49a0-a017-857160e90a4f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:36.164822 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-10cc3c9a-6513-49a0-a017-857160e90a4f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:36.171559 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-10cc3c9a-6513-49a0-a017-857160e90a4f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:36.177850 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-10cc3c9a-6513-49a0-a017-857160e90a4f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:36.177850 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-10cc3c9a-6513-49a0-a017-857160e90a4f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:36.177850 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-10cc3c9a-6513-49a0-a017-857160e90a4f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:36.186031 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-8c4ef0f5-8589-450c-a6e0-0acba31d4323 req-3eba071c-97ea-471a-98e2-d9f1e109488f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e98c6a8-a1a1-4e8d-98bf-18f5967003ef", "name": "network-vif-plugged", "status": "completed", "tag": "7f99c127-cfc6-412e-914a-153d34cbba61"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:36.197129 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-8c4ef0f5-8589-450c-a6e0-0acba31d4323 req-3eba071c-97ea-471a-98e2-d9f1e109488f service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:36.197734 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-8c4ef0f5-8589-450c-a6e0-0acba31d4323 req-3eba071c-97ea-471a-98e2-d9f1e109488f service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:36.224864 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-8c4ef0f5-8589-450c-a6e0-0acba31d4323 req-3eba071c-97ea-471a-98e2-d9f1e109488f service nova] Creating event network-vif-plugged:7f99c127-cfc6-412e-914a-153d34cbba61 for instance 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef on nch2-master-1 Apr 16 21:15:36.230616 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-8c4ef0f5-8589-450c-a6e0-0acba31d4323 req-3eba071c-97ea-471a-98e2-d9f1e109488f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048251 Apr 16 21:15:36.231331 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1165/2449] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:15:36.301879 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d3c3492f-9c09-413a-8da8-80fa85a18f59 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:36.302757 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d3c3492f-9c09-413a-8da8-80fa85a18f59 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:36.309631 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d3c3492f-9c09-413a-8da8-80fa85a18f59 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:36.310147 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d3c3492f-9c09-413a-8da8-80fa85a18f59 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:36.310999 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d3c3492f-9c09-413a-8da8-80fa85a18f59 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:36.311613 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d3c3492f-9c09-413a-8da8-80fa85a18f59 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:36.331644 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-10cc3c9a-6513-49a0-a017-857160e90a4f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "POST /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa/action" status: 200 len: 145 microversion: 2.1 time: 0.172037 Apr 16 21:15:36.332905 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1285/2450] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:15:36 2022] POST /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa/action => generated 145 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:15:36.342895 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9aa388fe-6fc2-41f2-8a66-6970dbb95367 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:36.343617 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9aa388fe-6fc2-41f2-8a66-6970dbb95367 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:36.354377 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9aa388fe-6fc2-41f2-8a66-6970dbb95367 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:36.361914 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9aa388fe-6fc2-41f2-8a66-6970dbb95367 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:36.363067 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9aa388fe-6fc2-41f2-8a66-6970dbb95367 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:36.363514 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9aa388fe-6fc2-41f2-8a66-6970dbb95367 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:36.493712 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d3c3492f-9c09-413a-8da8-80fa85a18f59 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:36.501422 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d3c3492f-9c09-413a-8da8-80fa85a18f59 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f" status: 200 len: 1325 microversion: 2.1 time: 0.204087 Apr 16 21:15:36.501999 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1166/2451] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:36 2022] GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f => generated 1325 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:15:36.519494 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9aa388fe-6fc2-41f2-8a66-6970dbb95367 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:36.527678 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9aa388fe-6fc2-41f2-8a66-6970dbb95367 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.189134 Apr 16 21:15:36.528271 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1286/2452] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:36 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:36.545577 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-540719d4-035c-4384-b58e-e2433033763a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:36.546197 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-540719d4-035c-4384-b58e-e2433033763a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:36.552095 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-540719d4-035c-4384-b58e-e2433033763a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:36.552585 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-540719d4-035c-4384-b58e-e2433033763a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:36.553361 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-540719d4-035c-4384-b58e-e2433033763a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:36.553808 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-540719d4-035c-4384-b58e-e2433033763a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:36.592471 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b55f681d-0196-47f4-82ba-2ffd799c1cdd tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:36.593121 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b55f681d-0196-47f4-82ba-2ffd799c1cdd tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: 41932213-4c87-4ee1-909f-50d95297cd64] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:36.602382 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b55f681d-0196-47f4-82ba-2ffd799c1cdd tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:36.602935 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b55f681d-0196-47f4-82ba-2ffd799c1cdd tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:36.603959 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b55f681d-0196-47f4-82ba-2ffd799c1cdd tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:36.604437 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b55f681d-0196-47f4-82ba-2ffd799c1cdd tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:36.701317 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-540719d4-035c-4384-b58e-e2433033763a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:36.709275 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-540719d4-035c-4384-b58e-e2433033763a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.167463 Apr 16 21:15:36.709850 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1167/2453] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:36 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:36.727722 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a7cc0fa1-fdc3-4d2b-97c9-e2d2968dcb58 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:36.728569 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a7cc0fa1-fdc3-4d2b-97c9-e2d2968dcb58 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:36.736910 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a7cc0fa1-fdc3-4d2b-97c9-e2d2968dcb58 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:36.736910 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a7cc0fa1-fdc3-4d2b-97c9-e2d2968dcb58 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:36.737351 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a7cc0fa1-fdc3-4d2b-97c9-e2d2968dcb58 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:36.738029 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a7cc0fa1-fdc3-4d2b-97c9-e2d2968dcb58 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:36.752655 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b55f681d-0196-47f4-82ba-2ffd799c1cdd tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2bab3afb0f945eca1a7bf9f783cf9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec2ad232d62489aa704075fad5305c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:36.762980 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b55f681d-0196-47f4-82ba-2ffd799c1cdd tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "GET /compute/v2.1/servers/41932213-4c87-4ee1-909f-50d95297cd64" status: 200 len: 1318 microversion: 2.1 time: 0.174441 Apr 16 21:15:36.763651 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1287/2454] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:36 2022] GET /compute/v2.1/servers/41932213-4c87-4ee1-909f-50d95297cd64 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:15:36.831020 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d287f707-40bc-444f-bc49-d89f00a8e3de tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:36.831788 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d287f707-40bc-444f-bc49-d89f00a8e3de tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:36.840963 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d287f707-40bc-444f-bc49-d89f00a8e3de tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:36.846762 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d287f707-40bc-444f-bc49-d89f00a8e3de tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:36.847994 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d287f707-40bc-444f-bc49-d89f00a8e3de tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:36.848655 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d287f707-40bc-444f-bc49-d89f00a8e3de tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:36.888390 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a7cc0fa1-fdc3-4d2b-97c9-e2d2968dcb58 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:36.897025 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a7cc0fa1-fdc3-4d2b-97c9-e2d2968dcb58 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.174952 Apr 16 21:15:36.898144 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1168/2455] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:36 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:15:36.919211 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-acce4ebe-8a80-4f9e-817d-7c7b7fdb1513 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb96c42e50>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:36.961496 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d287f707-40bc-444f-bc49-d89f00a8e3de tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:36.971298 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-acce4ebe-8a80-4f9e-817d-7c7b7fdb1513 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231" status: 200 len: 1412 microversion: 2.1 time: 0.071815 Apr 16 21:15:36.971885 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1169/2456] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:15:36 2022] GET /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231 => generated 1412 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:36.977574 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5886f5d8-d3c9-4904-84b5-ab3a96d163d3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:36.982885 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d287f707-40bc-444f-bc49-d89f00a8e3de tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:36.984681 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d287f707-40bc-444f-bc49-d89f00a8e3de tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:36.987874 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5886f5d8-d3c9-4904-84b5-ab3a96d163d3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:36.991748 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d287f707-40bc-444f-bc49-d89f00a8e3de tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1446 microversion: 2.75 time: 0.164478 Apr 16 21:15:36.993057 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1288/2457] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:36 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1446 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:15:36.997760 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5886f5d8-d3c9-4904-84b5-ab3a96d163d3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:36.998464 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5886f5d8-d3c9-4904-84b5-ab3a96d163d3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:36.999269 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5886f5d8-d3c9-4904-84b5-ab3a96d163d3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:36.999717 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5886f5d8-d3c9-4904-84b5-ab3a96d163d3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:37.008728 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-adfebbbc-91b1-4c71-b996-4cae5623fcb4 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:37.010039 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-adfebbbc-91b1-4c71-b996-4cae5623fcb4 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:37.017895 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-adfebbbc-91b1-4c71-b996-4cae5623fcb4 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:37.018950 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-adfebbbc-91b1-4c71-b996-4cae5623fcb4 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:37.019945 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-adfebbbc-91b1-4c71-b996-4cae5623fcb4 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:37.020594 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-adfebbbc-91b1-4c71-b996-4cae5623fcb4 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:37.117936 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-adfebbbc-91b1-4c71-b996-4cae5623fcb4 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:37.133401 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-adfebbbc-91b1-4c71-b996-4cae5623fcb4 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1217 microversion: 2.1 time: 0.133381 Apr 16 21:15:37.140446 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1289/2458] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:36 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1217 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:37.187960 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5886f5d8-d3c9-4904-84b5-ab3a96d163d3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:37.195479 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5886f5d8-d3c9-4904-84b5-ab3a96d163d3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.221509 Apr 16 21:15:37.198668 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1170/2459] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:36 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:37.300483 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5c18be69-f98c-4430-894f-c57e9ae12ddc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-849881881", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "f9e642b5-0144-4768-b572-192069e5751e"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:37.359091 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-5c18be69-f98c-4430-894f-c57e9ae12ddc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] validate_networks() for [('f9e642b5-0144-4768-b572-192069e5751e', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:15:37.523208 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e8fbff32-ea6f-4933-8b3c-f6b299288fdf tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:37.523829 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e8fbff32-ea6f-4933-8b3c-f6b299288fdf tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:37.538826 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e8fbff32-ea6f-4933-8b3c-f6b299288fdf tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:37.539560 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e8fbff32-ea6f-4933-8b3c-f6b299288fdf tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:37.541440 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e8fbff32-ea6f-4933-8b3c-f6b299288fdf tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:37.542326 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e8fbff32-ea6f-4933-8b3c-f6b299288fdf tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:37.726912 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e8fbff32-ea6f-4933-8b3c-f6b299288fdf tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:37.739586 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e8fbff32-ea6f-4933-8b3c-f6b299288fdf tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f" status: 200 len: 1325 microversion: 2.1 time: 0.221054 Apr 16 21:15:37.740465 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1171/2460] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:37 2022] GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f => generated 1325 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:15:37.779984 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-41da67b6-c2f4-4550-a836-6f843656dcdd tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:37.780797 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-41da67b6-c2f4-4550-a836-6f843656dcdd tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: 41932213-4c87-4ee1-909f-50d95297cd64] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:37.787825 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-41da67b6-c2f4-4550-a836-6f843656dcdd tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:37.788773 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-41da67b6-c2f4-4550-a836-6f843656dcdd tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:37.789812 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-41da67b6-c2f4-4550-a836-6f843656dcdd tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:37.791379 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-41da67b6-c2f4-4550-a836-6f843656dcdd tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:37.825461 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-5c18be69-f98c-4430-894f-c57e9ae12ddc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:15:37.826209 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-5c18be69-f98c-4430-894f-c57e9ae12ddc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:15:37.826863 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-5c18be69-f98c-4430-894f-c57e9ae12ddc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:15:37.827513 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-5c18be69-f98c-4430-894f-c57e9ae12ddc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:15:37.828098 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-5c18be69-f98c-4430-894f-c57e9ae12ddc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:15:37.839431 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5c18be69-f98c-4430-894f-c57e9ae12ddc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:37.840105 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5c18be69-f98c-4430-894f-c57e9ae12ddc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:37.844351 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5c18be69-f98c-4430-894f-c57e9ae12ddc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:37.844914 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5c18be69-f98c-4430-894f-c57e9ae12ddc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:37.868517 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-5c18be69-f98c-4430-894f-c57e9ae12ddc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Getting quotas for project ceac90e6c7024b4ea350bfa95e1b5249. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:15:37.875161 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-5c18be69-f98c-4430-894f-c57e9ae12ddc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Getting quotas for user 6bb1c0cdf6274f118ebbe97829ddad65 and project ceac90e6c7024b4ea350bfa95e1b5249. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:15:37.889430 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5c18be69-f98c-4430-894f-c57e9ae12ddc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:15:37.892301 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5c18be69-f98c-4430-894f-c57e9ae12ddc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 999c16db-7916-4753-ae16-9ed72c8e6922] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:15:38.003460 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-41da67b6-c2f4-4550-a836-6f843656dcdd tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2bab3afb0f945eca1a7bf9f783cf9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec2ad232d62489aa704075fad5305c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:38.013462 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-41da67b6-c2f4-4550-a836-6f843656dcdd tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "GET /compute/v2.1/servers/41932213-4c87-4ee1-909f-50d95297cd64" status: 200 len: 1318 microversion: 2.1 time: 0.237226 Apr 16 21:15:38.018883 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1172/2461] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:37 2022] GET /compute/v2.1/servers/41932213-4c87-4ee1-909f-50d95297cd64 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:38.027984 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b72eb32c-89a8-4435-ac58-3067e9660766 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb9feaa5e0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:38.042221 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5c18be69-f98c-4430-894f-c57e9ae12ddc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.741741 Apr 16 21:15:38.042221 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1290/2462] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:15:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:15:38.044714 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-89f7e266-4255-4a31-b8a1-72f3c3e98dfa tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:38.046096 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-89f7e266-4255-4a31-b8a1-72f3c3e98dfa tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:38.055263 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-89f7e266-4255-4a31-b8a1-72f3c3e98dfa tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:38.055836 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-89f7e266-4255-4a31-b8a1-72f3c3e98dfa tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:38.057614 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-89f7e266-4255-4a31-b8a1-72f3c3e98dfa tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:38.058081 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-89f7e266-4255-4a31-b8a1-72f3c3e98dfa tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:38.108716 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b72eb32c-89a8-4435-ac58-3067e9660766 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231" status: 200 len: 1412 microversion: 2.1 time: 0.093271 Apr 16 21:15:38.109585 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1173/2463] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:15:38 2022] GET /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231 => generated 1412 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:38.119941 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-179636f0-efbb-4c04-9407-e9d736597445 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:38.120602 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-179636f0-efbb-4c04-9407-e9d736597445 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 999c16db-7916-4753-ae16-9ed72c8e6922] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:38.209193 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-89f7e266-4255-4a31-b8a1-72f3c3e98dfa tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:38.219778 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-89f7e266-4255-4a31-b8a1-72f3c3e98dfa tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:38.221634 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-89f7e266-4255-4a31-b8a1-72f3c3e98dfa tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:38.233072 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-89f7e266-4255-4a31-b8a1-72f3c3e98dfa tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1446 microversion: 2.75 time: 0.188170 Apr 16 21:15:38.233072 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1291/2464] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:38 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1446 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:15:38.249607 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a0204011-2dcb-4a64-acb2-8b6a1712dee8 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:38.250604 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a0204011-2dcb-4a64-acb2-8b6a1712dee8 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:38.258155 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a0204011-2dcb-4a64-acb2-8b6a1712dee8 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:38.258737 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a0204011-2dcb-4a64-acb2-8b6a1712dee8 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:38.259790 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a0204011-2dcb-4a64-acb2-8b6a1712dee8 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:38.260266 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a0204011-2dcb-4a64-acb2-8b6a1712dee8 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:38.357052 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a0204011-2dcb-4a64-acb2-8b6a1712dee8 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:38.366578 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a0204011-2dcb-4a64-acb2-8b6a1712dee8 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1273 microversion: 2.1 time: 0.135891 Apr 16 21:15:38.371347 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1292/2465] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:38 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1273 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:38.418065 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-179636f0-efbb-4c04-9407-e9d736597445 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:38.431196 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-179636f0-efbb-4c04-9407-e9d736597445 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922" status: 200 len: 1214 microversion: 2.1 time: 0.319777 Apr 16 21:15:38.444022 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1174/2466] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:38 2022] GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922 => generated 1214 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:38.757670 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6f21f043-a026-4169-866c-79bb5990061a tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:38.758510 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6f21f043-a026-4169-866c-79bb5990061a tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:38.766741 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6f21f043-a026-4169-866c-79bb5990061a tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:38.772601 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6f21f043-a026-4169-866c-79bb5990061a tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:38.772601 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6f21f043-a026-4169-866c-79bb5990061a tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:38.772601 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6f21f043-a026-4169-866c-79bb5990061a tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:39.031516 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-50875dea-e163-45c9-bc54-d86f00591d62 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:39.032371 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-50875dea-e163-45c9-bc54-d86f00591d62 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: 41932213-4c87-4ee1-909f-50d95297cd64] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:39.048589 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-50875dea-e163-45c9-bc54-d86f00591d62 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:39.051832 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-50875dea-e163-45c9-bc54-d86f00591d62 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:39.053127 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-50875dea-e163-45c9-bc54-d86f00591d62 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:39.053781 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-50875dea-e163-45c9-bc54-d86f00591d62 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:39.059259 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6f21f043-a026-4169-866c-79bb5990061a tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:39.069576 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6f21f043-a026-4169-866c-79bb5990061a tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f" status: 200 len: 1325 microversion: 2.1 time: 0.316277 Apr 16 21:15:39.072079 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1293/2467] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:38 2022] GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f => generated 1325 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:39.124379 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4fdc4cb3-6d63-4561-a405-caa12d06914e tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb9615f0d0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:39.209843 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4fdc4cb3-6d63-4561-a405-caa12d06914e tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231" status: 200 len: 1412 microversion: 2.1 time: 0.090143 Apr 16 21:15:39.215831 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1294/2468] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:15:39 2022] GET /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231 => generated 1412 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:39.217516 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-cdfd4052-b36d-429e-86e5-839f3cc65a7f req-99bd26f3-fe34-4cca-a106-352fd9c55c13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a03d234-848c-408c-b46c-e2afebb2c61f", "name": "network-vif-plugged", "status": "completed", "tag": "f5131071-ff36-4b36-bf83-e46eb31e3bf8"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:39.232386 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-cdfd4052-b36d-429e-86e5-839f3cc65a7f req-99bd26f3-fe34-4cca-a106-352fd9c55c13 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:39.232995 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-cdfd4052-b36d-429e-86e5-839f3cc65a7f req-99bd26f3-fe34-4cca-a106-352fd9c55c13 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:39.253351 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-cdfd4052-b36d-429e-86e5-839f3cc65a7f req-99bd26f3-fe34-4cca-a106-352fd9c55c13 service nova] Creating event network-vif-plugged:f5131071-ff36-4b36-bf83-e46eb31e3bf8 for instance 1a03d234-848c-408c-b46c-e2afebb2c61f on nch2-master-1 Apr 16 21:15:39.263096 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-cdfd4052-b36d-429e-86e5-839f3cc65a7f req-99bd26f3-fe34-4cca-a106-352fd9c55c13 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050711 Apr 16 21:15:39.264018 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1295/2469] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:15:39.272136 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6d2b1ec4-c542-4d1c-a8de-0ecc860e4e5a tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:39.273014 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6d2b1ec4-c542-4d1c-a8de-0ecc860e4e5a tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:39.297008 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6d2b1ec4-c542-4d1c-a8de-0ecc860e4e5a tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:39.297814 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6d2b1ec4-c542-4d1c-a8de-0ecc860e4e5a tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:39.302833 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6d2b1ec4-c542-4d1c-a8de-0ecc860e4e5a tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:39.304437 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6d2b1ec4-c542-4d1c-a8de-0ecc860e4e5a tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:39.396837 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-50875dea-e163-45c9-bc54-d86f00591d62 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2bab3afb0f945eca1a7bf9f783cf9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec2ad232d62489aa704075fad5305c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:39.412417 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-50875dea-e163-45c9-bc54-d86f00591d62 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "GET /compute/v2.1/servers/41932213-4c87-4ee1-909f-50d95297cd64" status: 200 len: 1318 microversion: 2.1 time: 0.378256 Apr 16 21:15:39.413112 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1175/2470] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:39 2022] GET /compute/v2.1/servers/41932213-4c87-4ee1-909f-50d95297cd64 => generated 1318 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:39.427517 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6d551ecd-287c-4747-9a88-c7e2b57fa68f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:39.428200 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6d551ecd-287c-4747-9a88-c7e2b57fa68f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:39.430281 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6d2b1ec4-c542-4d1c-a8de-0ecc860e4e5a tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:39.443286 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6d2b1ec4-c542-4d1c-a8de-0ecc860e4e5a tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:39.445143 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6d551ecd-287c-4747-9a88-c7e2b57fa68f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:39.454668 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6d551ecd-287c-4747-9a88-c7e2b57fa68f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:39.454668 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6d551ecd-287c-4747-9a88-c7e2b57fa68f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:39.454668 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6d551ecd-287c-4747-9a88-c7e2b57fa68f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:39.455515 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6d2b1ec4-c542-4d1c-a8de-0ecc860e4e5a tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:39.457133 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6d2b1ec4-c542-4d1c-a8de-0ecc860e4e5a tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1446 microversion: 2.75 time: 0.190582 Apr 16 21:15:39.469420 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1296/2471] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:39 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1446 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:15:39.481624 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-70803d59-b01f-4e1f-8cd3-843515fb5eae tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:39.483563 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-70803d59-b01f-4e1f-8cd3-843515fb5eae tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 999c16db-7916-4753-ae16-9ed72c8e6922] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:39.490919 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-70803d59-b01f-4e1f-8cd3-843515fb5eae tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:39.491563 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-70803d59-b01f-4e1f-8cd3-843515fb5eae tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:39.494821 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-70803d59-b01f-4e1f-8cd3-843515fb5eae tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:39.494821 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-70803d59-b01f-4e1f-8cd3-843515fb5eae tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:39.538566 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6d551ecd-287c-4747-9a88-c7e2b57fa68f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:39.548044 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6d551ecd-287c-4747-9a88-c7e2b57fa68f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1271 microversion: 2.1 time: 0.124460 Apr 16 21:15:39.549248 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1176/2472] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:39 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1271 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:39.574249 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-70803d59-b01f-4e1f-8cd3-843515fb5eae tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:39.583732 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-70803d59-b01f-4e1f-8cd3-843515fb5eae tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922" status: 200 len: 1218 microversion: 2.1 time: 0.116443 Apr 16 21:15:39.584607 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1297/2473] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:39 2022] GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922 => generated 1218 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:40.087636 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cbf32815-69a9-4491-97eb-b5e7615782df tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:40.089325 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-cbf32815-69a9-4491-97eb-b5e7615782df tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:40.099323 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cbf32815-69a9-4491-97eb-b5e7615782df tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:40.100316 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cbf32815-69a9-4491-97eb-b5e7615782df tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:40.101559 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cbf32815-69a9-4491-97eb-b5e7615782df tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:40.104134 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cbf32815-69a9-4491-97eb-b5e7615782df tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:40.226305 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-48dfc84f-2e30-480f-9560-14f438315f68 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb9615f940>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:40.353093 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-48dfc84f-2e30-480f-9560-14f438315f68 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231" status: 200 len: 1412 microversion: 2.1 time: 0.132960 Apr 16 21:15:40.353626 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1298/2474] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:15:40 2022] GET /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231 => generated 1412 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:40.357335 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cbf32815-69a9-4491-97eb-b5e7615782df tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:40.376840 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cbf32815-69a9-4491-97eb-b5e7615782df tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f" status: 200 len: 1325 microversion: 2.1 time: 0.293588 Apr 16 21:15:40.381770 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1177/2475] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:40 2022] GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f => generated 1325 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:40.430237 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-731c3134-89b8-49d3-af62-ca2cfb25c951 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:40.430965 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-731c3134-89b8-49d3-af62-ca2cfb25c951 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: 41932213-4c87-4ee1-909f-50d95297cd64] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:40.443684 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-731c3134-89b8-49d3-af62-ca2cfb25c951 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:40.444155 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-731c3134-89b8-49d3-af62-ca2cfb25c951 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:40.445151 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-731c3134-89b8-49d3-af62-ca2cfb25c951 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:40.445805 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-731c3134-89b8-49d3-af62-ca2cfb25c951 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:40.477145 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-510cf3ff-7e69-4bd5-a38f-b9b669c62c72 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:40.478304 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-510cf3ff-7e69-4bd5-a38f-b9b669c62c72 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:40.485402 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-510cf3ff-7e69-4bd5-a38f-b9b669c62c72 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:40.486166 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-510cf3ff-7e69-4bd5-a38f-b9b669c62c72 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:40.487142 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-510cf3ff-7e69-4bd5-a38f-b9b669c62c72 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:40.487584 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-510cf3ff-7e69-4bd5-a38f-b9b669c62c72 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:40.627780 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-731c3134-89b8-49d3-af62-ca2cfb25c951 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2bab3afb0f945eca1a7bf9f783cf9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec2ad232d62489aa704075fad5305c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:40.639465 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-731c3134-89b8-49d3-af62-ca2cfb25c951 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "GET /compute/v2.1/servers/41932213-4c87-4ee1-909f-50d95297cd64" status: 200 len: 1318 microversion: 2.1 time: 0.213761 Apr 16 21:15:40.640449 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1299/2476] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:40 2022] GET /compute/v2.1/servers/41932213-4c87-4ee1-909f-50d95297cd64 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:40.647310 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6175b9d2-c212-4719-a638-2336586796bb tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:40.649441 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6175b9d2-c212-4719-a638-2336586796bb tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:40.655879 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6175b9d2-c212-4719-a638-2336586796bb tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:40.657188 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6175b9d2-c212-4719-a638-2336586796bb tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:40.658253 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6175b9d2-c212-4719-a638-2336586796bb tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:40.659281 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6175b9d2-c212-4719-a638-2336586796bb tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:40.855700 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6175b9d2-c212-4719-a638-2336586796bb tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:40.864672 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6175b9d2-c212-4719-a638-2336586796bb tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1313 microversion: 2.1 time: 0.222037 Apr 16 21:15:40.867460 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1300/2477] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:40 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:40.873902 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8141612d-a882-46c2-9752-58c9b0b5f6de tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:40.874519 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8141612d-a882-46c2-9752-58c9b0b5f6de tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 999c16db-7916-4753-ae16-9ed72c8e6922] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:40.881258 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8141612d-a882-46c2-9752-58c9b0b5f6de tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:40.881742 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8141612d-a882-46c2-9752-58c9b0b5f6de tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:40.882683 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8141612d-a882-46c2-9752-58c9b0b5f6de tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:40.883141 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8141612d-a882-46c2-9752-58c9b0b5f6de tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:40.954472 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8141612d-a882-46c2-9752-58c9b0b5f6de tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:40.963066 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8141612d-a882-46c2-9752-58c9b0b5f6de tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922" status: 200 len: 1284 microversion: 2.1 time: 0.093601 Apr 16 21:15:40.964887 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1301/2478] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:40 2022] GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922 => generated 1284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:41.068906 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-510cf3ff-7e69-4bd5-a38f-b9b669c62c72 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:41.098688 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-510cf3ff-7e69-4bd5-a38f-b9b669c62c72 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:41.109404 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-510cf3ff-7e69-4bd5-a38f-b9b669c62c72 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:41.135805 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-510cf3ff-7e69-4bd5-a38f-b9b669c62c72 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1446 microversion: 2.75 time: 0.660938 Apr 16 21:15:41.139034 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1178/2479] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:40 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1446 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:15:41.366608 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2a0b04c1-c2d5-46f1-aab8-c2236e826fc3 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb96d9e040>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:41.397244 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2ae7265e-92e4-4d00-bb63-953d40082a48 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:41.397938 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2ae7265e-92e4-4d00-bb63-953d40082a48 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:41.405249 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2ae7265e-92e4-4d00-bb63-953d40082a48 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:41.406405 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2ae7265e-92e4-4d00-bb63-953d40082a48 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:41.407340 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2ae7265e-92e4-4d00-bb63-953d40082a48 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:41.407998 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2ae7265e-92e4-4d00-bb63-953d40082a48 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:41.475846 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2a0b04c1-c2d5-46f1-aab8-c2236e826fc3 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231" status: 200 len: 1412 microversion: 2.1 time: 0.113261 Apr 16 21:15:41.484727 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1302/2480] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:15:41 2022] GET /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231 => generated 1412 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:41.658070 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2b458558-73e7-47e8-8b64-1186d48ab5c1 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:41.658710 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2b458558-73e7-47e8-8b64-1186d48ab5c1 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: 41932213-4c87-4ee1-909f-50d95297cd64] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:41.665001 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b458558-73e7-47e8-8b64-1186d48ab5c1 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:41.666003 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b458558-73e7-47e8-8b64-1186d48ab5c1 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:41.666798 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b458558-73e7-47e8-8b64-1186d48ab5c1 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:41.667433 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b458558-73e7-47e8-8b64-1186d48ab5c1 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:41.704886 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2ae7265e-92e4-4d00-bb63-953d40082a48 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:41.715280 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2ae7265e-92e4-4d00-bb63-953d40082a48 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f" status: 200 len: 1325 microversion: 2.1 time: 0.322129 Apr 16 21:15:41.716354 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1179/2481] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:41 2022] GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f => generated 1325 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:15:41.820384 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2b458558-73e7-47e8-8b64-1186d48ab5c1 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2bab3afb0f945eca1a7bf9f783cf9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec2ad232d62489aa704075fad5305c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:41.829035 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2b458558-73e7-47e8-8b64-1186d48ab5c1 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "GET /compute/v2.1/servers/41932213-4c87-4ee1-909f-50d95297cd64" status: 200 len: 1318 microversion: 2.1 time: 0.175416 Apr 16 21:15:41.866363 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1303/2482] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:41 2022] GET /compute/v2.1/servers/41932213-4c87-4ee1-909f-50d95297cd64 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:15:41.885370 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c7f049a2-2a63-4200-885d-4f3986e3f9f9 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:41.886257 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c7f049a2-2a63-4200-885d-4f3986e3f9f9 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:41.892301 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c7f049a2-2a63-4200-885d-4f3986e3f9f9 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:41.892761 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c7f049a2-2a63-4200-885d-4f3986e3f9f9 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:41.893604 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c7f049a2-2a63-4200-885d-4f3986e3f9f9 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:41.894046 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c7f049a2-2a63-4200-885d-4f3986e3f9f9 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:41.982794 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2005b2f0-7fdb-419c-9d4f-56535eda029a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:41.983721 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2005b2f0-7fdb-419c-9d4f-56535eda029a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 999c16db-7916-4753-ae16-9ed72c8e6922] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:41.989764 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2005b2f0-7fdb-419c-9d4f-56535eda029a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:41.990286 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2005b2f0-7fdb-419c-9d4f-56535eda029a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:41.991079 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2005b2f0-7fdb-419c-9d4f-56535eda029a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:41.991525 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2005b2f0-7fdb-419c-9d4f-56535eda029a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:42.068951 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2005b2f0-7fdb-419c-9d4f-56535eda029a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:42.078421 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2005b2f0-7fdb-419c-9d4f-56535eda029a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922" status: 200 len: 1272 microversion: 2.1 time: 0.100110 Apr 16 21:15:42.094637 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1304/2483] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:41 2022] GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922 => generated 1272 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:15:42.095774 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-867604c0-b446-47b4-81f5-22cd2fc6281b req-95444ece-9ec0-4add-8b6b-dd9ba7ff8f80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2389c37c-30cc-4355-a3a2-44653cb17fd6", "tag": "0b67129e-ca8a-4c23-aff2-5c3d6e70e65a"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:42.107060 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-867604c0-b446-47b4-81f5-22cd2fc6281b req-95444ece-9ec0-4add-8b6b-dd9ba7ff8f80 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:42.107060 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-867604c0-b446-47b4-81f5-22cd2fc6281b req-95444ece-9ec0-4add-8b6b-dd9ba7ff8f80 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:42.131983 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-867604c0-b446-47b4-81f5-22cd2fc6281b req-95444ece-9ec0-4add-8b6b-dd9ba7ff8f80 service nova] Creating event network-changed:0b67129e-ca8a-4c23-aff2-5c3d6e70e65a for instance 2389c37c-30cc-4355-a3a2-44653cb17fd6 on nch1-master-1 Apr 16 21:15:42.140655 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-867604c0-b446-47b4-81f5-22cd2fc6281b req-95444ece-9ec0-4add-8b6b-dd9ba7ff8f80 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048605 Apr 16 21:15:42.142823 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1305/2484] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:15:42.162764 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-efda153e-70bd-417b-9f7d-1451699603f6 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:42.163694 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-efda153e-70bd-417b-9f7d-1451699603f6 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:42.172085 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-efda153e-70bd-417b-9f7d-1451699603f6 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:42.177797 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-efda153e-70bd-417b-9f7d-1451699603f6 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:42.177797 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-efda153e-70bd-417b-9f7d-1451699603f6 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:42.177797 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-efda153e-70bd-417b-9f7d-1451699603f6 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:42.273561 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c7f049a2-2a63-4200-885d-4f3986e3f9f9 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:42.276676 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-efda153e-70bd-417b-9f7d-1451699603f6 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:42.286078 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-efda153e-70bd-417b-9f7d-1451699603f6 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:42.287958 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-efda153e-70bd-417b-9f7d-1451699603f6 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:42.288124 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c7f049a2-2a63-4200-885d-4f3986e3f9f9 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1313 microversion: 2.1 time: 0.402647 Apr 16 21:15:42.298115 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-efda153e-70bd-417b-9f7d-1451699603f6 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1446 microversion: 2.75 time: 0.141798 Apr 16 21:15:42.307090 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1180/2485] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:41 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1313 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:42.322030 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1306/2486] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:42 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1446 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:15:42.490928 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-aff9ec5d-765a-43f8-85f9-fda54c717a24 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb96a6f700>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:42.557595 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-aff9ec5d-765a-43f8-85f9-fda54c717a24 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231" status: 200 len: 1412 microversion: 2.1 time: 0.070869 Apr 16 21:15:42.558177 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1181/2487] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:15:42 2022] GET /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231 => generated 1412 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:42.593836 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-039f93d6-3247-427e-a987-3e56f2b60496 req-65430491-3869-443d-98d0-abf6431a3e7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41932213-4c87-4ee1-909f-50d95297cd64", "name": "network-vif-plugged", "status": "completed", "tag": "101a84f6-6ff5-4c6a-b599-738ac67c53ee"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:42.620906 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-039f93d6-3247-427e-a987-3e56f2b60496 req-65430491-3869-443d-98d0-abf6431a3e7d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:42.621665 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-039f93d6-3247-427e-a987-3e56f2b60496 req-65430491-3869-443d-98d0-abf6431a3e7d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:42.640086 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-039f93d6-3247-427e-a987-3e56f2b60496 req-65430491-3869-443d-98d0-abf6431a3e7d service nova] Creating event network-vif-plugged:101a84f6-6ff5-4c6a-b599-738ac67c53ee for instance 41932213-4c87-4ee1-909f-50d95297cd64 on nch1-master-1 Apr 16 21:15:42.647342 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-039f93d6-3247-427e-a987-3e56f2b60496 req-65430491-3869-443d-98d0-abf6431a3e7d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057915 Apr 16 21:15:42.648099 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1307/2488] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:15:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:15:42.737494 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-860b123d-e565-4f85-baa7-313def679e05 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:42.738414 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-860b123d-e565-4f85-baa7-313def679e05 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:42.761083 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-860b123d-e565-4f85-baa7-313def679e05 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:42.761612 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-860b123d-e565-4f85-baa7-313def679e05 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:42.762407 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-860b123d-e565-4f85-baa7-313def679e05 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:42.762851 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-860b123d-e565-4f85-baa7-313def679e05 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:42.849128 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-07def4f7-9668-4f66-a036-978b94ee242b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:42.849840 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-07def4f7-9668-4f66-a036-978b94ee242b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: 41932213-4c87-4ee1-909f-50d95297cd64] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:42.857059 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-07def4f7-9668-4f66-a036-978b94ee242b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:42.858027 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-07def4f7-9668-4f66-a036-978b94ee242b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:42.858844 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-07def4f7-9668-4f66-a036-978b94ee242b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:42.859469 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-07def4f7-9668-4f66-a036-978b94ee242b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:43.032040 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-07def4f7-9668-4f66-a036-978b94ee242b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2bab3afb0f945eca1a7bf9f783cf9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec2ad232d62489aa704075fad5305c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:43.040714 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-07def4f7-9668-4f66-a036-978b94ee242b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "GET /compute/v2.1/servers/41932213-4c87-4ee1-909f-50d95297cd64" status: 200 len: 1318 microversion: 2.1 time: 0.196910 Apr 16 21:15:43.042660 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1308/2489] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:42 2022] GET /compute/v2.1/servers/41932213-4c87-4ee1-909f-50d95297cd64 => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:15:43.102191 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-62ea6b2f-0afb-41ba-90cb-15252ca659e7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:43.103640 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-62ea6b2f-0afb-41ba-90cb-15252ca659e7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 999c16db-7916-4753-ae16-9ed72c8e6922] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:43.110490 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-62ea6b2f-0afb-41ba-90cb-15252ca659e7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:43.111351 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-62ea6b2f-0afb-41ba-90cb-15252ca659e7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:43.112287 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-62ea6b2f-0afb-41ba-90cb-15252ca659e7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:43.113012 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-62ea6b2f-0afb-41ba-90cb-15252ca659e7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:43.254572 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-860b123d-e565-4f85-baa7-313def679e05 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:43.265376 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-860b123d-e565-4f85-baa7-313def679e05 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f" status: 200 len: 1521 microversion: 2.1 time: 0.533551 Apr 16 21:15:43.266081 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1182/2490] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:42 2022] GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f => generated 1521 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:43.283963 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-62ea6b2f-0afb-41ba-90cb-15252ca659e7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:43.288378 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-10bc2902-6843-4aec-bd74-6fca3b7e1d55 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:43.294544 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-10bc2902-6843-4aec-bd74-6fca3b7e1d55 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:43.305325 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-62ea6b2f-0afb-41ba-90cb-15252ca659e7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922" status: 200 len: 1314 microversion: 2.1 time: 0.206873 Apr 16 21:15:43.306234 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1309/2491] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:43 2022] GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:15:43.309519 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-10bc2902-6843-4aec-bd74-6fca3b7e1d55 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:43.310608 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-10bc2902-6843-4aec-bd74-6fca3b7e1d55 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:43.314043 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-10bc2902-6843-4aec-bd74-6fca3b7e1d55 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:43.315478 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-10bc2902-6843-4aec-bd74-6fca3b7e1d55 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:43.318720 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ef408165-082b-4959-bf3f-7ee2eddcf74d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:43.323090 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ef408165-082b-4959-bf3f-7ee2eddcf74d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:43.338464 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ef408165-082b-4959-bf3f-7ee2eddcf74d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:43.338928 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ef408165-082b-4959-bf3f-7ee2eddcf74d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:43.339737 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ef408165-082b-4959-bf3f-7ee2eddcf74d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:43.340206 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ef408165-082b-4959-bf3f-7ee2eddcf74d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:43.553506 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ef408165-082b-4959-bf3f-7ee2eddcf74d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:43.567653 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ef408165-082b-4959-bf3f-7ee2eddcf74d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1313 microversion: 2.1 time: 0.258757 Apr 16 21:15:43.573851 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1310/2492] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:43 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:43.579110 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-76acea57-157e-4159-8712-79d6cfaecd1c tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:43.579110 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-76acea57-157e-4159-8712-79d6cfaecd1c tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:43.588466 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-76acea57-157e-4159-8712-79d6cfaecd1c tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:43.589166 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-76acea57-157e-4159-8712-79d6cfaecd1c tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:43.590180 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-76acea57-157e-4159-8712-79d6cfaecd1c tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:43.590840 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-76acea57-157e-4159-8712-79d6cfaecd1c tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:43.668957 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-10bc2902-6843-4aec-bd74-6fca3b7e1d55 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:43.681836 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-10bc2902-6843-4aec-bd74-6fca3b7e1d55 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f" status: 200 len: 1521 microversion: 2.1 time: 0.399987 Apr 16 21:15:43.697147 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-76acea57-157e-4159-8712-79d6cfaecd1c tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:43.698310 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1183/2493] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:43 2022] GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f => generated 1521 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:43.705342 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-76acea57-157e-4159-8712-79d6cfaecd1c tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:43.705648 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d92e775d-281c-4636-8c4f-bca936a65188 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb964899d0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:43.707987 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-76acea57-157e-4159-8712-79d6cfaecd1c tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:43.714406 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-76acea57-157e-4159-8712-79d6cfaecd1c tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1446 microversion: 2.75 time: 0.139537 Apr 16 21:15:43.724585 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1311/2494] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:43 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1446 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:15:43.724585 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-21c29a01-60ac-4310-b539-756c5c4caaae tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-101922773", "metadata": {"": ""}}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:43.724585 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-21c29a01-60ac-4310-b539-756c5c4caaae tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:15:43.724585 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-21c29a01-60ac-4310-b539-756c5c4caaae tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "POST /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f/action" status: 400 len: 170 microversion: 2.1 time: 0.006953 Apr 16 21:15:43.724585 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1312/2495] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Apr 16 21:15:43 2022] POST /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f/action => generated 170 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:15:43.750463 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-630ea06c-f2f3-4b82-a3bd-2a035fd12f81 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:43.751225 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-630ea06c-f2f3-4b82-a3bd-2a035fd12f81 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:43.762560 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-630ea06c-f2f3-4b82-a3bd-2a035fd12f81 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:43.763164 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-630ea06c-f2f3-4b82-a3bd-2a035fd12f81 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:43.764289 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-630ea06c-f2f3-4b82-a3bd-2a035fd12f81 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:43.764835 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-630ea06c-f2f3-4b82-a3bd-2a035fd12f81 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:43.790828 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d92e775d-281c-4636-8c4f-bca936a65188 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231" status: 200 len: 1412 microversion: 2.1 time: 0.083156 Apr 16 21:15:43.791967 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1184/2496] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:15:43 2022] GET /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231 => generated 1412 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:43.990188 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-630ea06c-f2f3-4b82-a3bd-2a035fd12f81 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:44.000244 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-630ea06c-f2f3-4b82-a3bd-2a035fd12f81 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f" status: 200 len: 1521 microversion: 2.1 time: 0.265211 Apr 16 21:15:44.005122 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1313/2497] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:43 2022] GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:44.029606 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-65f274b4-ff99-4d63-83f6-273aed534e80 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:44.030653 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-65f274b4-ff99-4d63-83f6-273aed534e80 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:44.037531 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-65f274b4-ff99-4d63-83f6-273aed534e80 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:44.038307 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-65f274b4-ff99-4d63-83f6-273aed534e80 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:44.039501 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-65f274b4-ff99-4d63-83f6-273aed534e80 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:44.041303 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-65f274b4-ff99-4d63-83f6-273aed534e80 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:44.057879 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-18381508-e1d2-44de-ae25-128998e87f4e tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:44.058711 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-18381508-e1d2-44de-ae25-128998e87f4e tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: 41932213-4c87-4ee1-909f-50d95297cd64] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:44.071064 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-18381508-e1d2-44de-ae25-128998e87f4e tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:44.072382 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-18381508-e1d2-44de-ae25-128998e87f4e tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:44.076198 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-18381508-e1d2-44de-ae25-128998e87f4e tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:44.078600 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-18381508-e1d2-44de-ae25-128998e87f4e tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:44.342227 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-65f274b4-ff99-4d63-83f6-273aed534e80 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:44.354725 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-65f274b4-ff99-4d63-83f6-273aed534e80 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f" status: 200 len: 1521 microversion: 2.1 time: 0.331636 Apr 16 21:15:44.356366 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1185/2498] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:44 2022] GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f => generated 1521 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:44.361656 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-48095864-9978-4a86-9530-4f2e4133be9e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:44.362554 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-48095864-9978-4a86-9530-4f2e4133be9e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 999c16db-7916-4753-ae16-9ed72c8e6922] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:44.371191 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-48095864-9978-4a86-9530-4f2e4133be9e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:44.371982 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-48095864-9978-4a86-9530-4f2e4133be9e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:44.372971 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-48095864-9978-4a86-9530-4f2e4133be9e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:44.374043 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-48095864-9978-4a86-9530-4f2e4133be9e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:44.582649 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-48095864-9978-4a86-9530-4f2e4133be9e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:44.591947 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-48095864-9978-4a86-9530-4f2e4133be9e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922" status: 200 len: 1314 microversion: 2.1 time: 0.234043 Apr 16 21:15:44.596830 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1186/2499] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:44 2022] GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:44.603684 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-51e041b4-780e-4921-800e-5b571070387b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-877301102", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:44.605285 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-51e041b4-780e-4921-800e-5b571070387b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:15:44.607063 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-51e041b4-780e-4921-800e-5b571070387b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "POST /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f/action" status: 400 len: 938 microversion: 2.1 time: 0.008266 Apr 16 21:15:44.608051 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1187/2500] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Apr 16 21:15:44 2022] POST /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f/action => generated 938 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:15:44.617515 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-31b641d2-801a-4b50-b630-76f6664abe12 req-99166eca-f18d-4d1d-9258-f7d338e2b77e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "999c16db-7916-4753-ae16-9ed72c8e6922", "tag": "90cb3288-a22b-4ad5-a087-5f17138b5d8b"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:44.627093 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-31b641d2-801a-4b50-b630-76f6664abe12 req-99166eca-f18d-4d1d-9258-f7d338e2b77e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:44.627840 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-31b641d2-801a-4b50-b630-76f6664abe12 req-99166eca-f18d-4d1d-9258-f7d338e2b77e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:44.640530 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-31b641d2-801a-4b50-b630-76f6664abe12 req-99166eca-f18d-4d1d-9258-f7d338e2b77e service nova] Creating event network-changed:90cb3288-a22b-4ad5-a087-5f17138b5d8b for instance 999c16db-7916-4753-ae16-9ed72c8e6922 on nch1-master-1 Apr 16 21:15:44.647988 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-18381508-e1d2-44de-ae25-128998e87f4e tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2bab3afb0f945eca1a7bf9f783cf9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec2ad232d62489aa704075fad5305c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:44.660278 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-18381508-e1d2-44de-ae25-128998e87f4e tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "GET /compute/v2.1/servers/41932213-4c87-4ee1-909f-50d95297cd64" status: 200 len: 1318 microversion: 2.1 time: 0.605675 Apr 16 21:15:44.660903 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1314/2501] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:44 2022] GET /compute/v2.1/servers/41932213-4c87-4ee1-909f-50d95297cd64 => generated 1318 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:15:44.662563 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-31b641d2-801a-4b50-b630-76f6664abe12 req-99166eca-f18d-4d1d-9258-f7d338e2b77e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053064 Apr 16 21:15:44.663149 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1188/2502] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:15:44.669277 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-16f508c0-7ef3-4cde-8878-a6d361fe03be tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:44.669896 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-16f508c0-7ef3-4cde-8878-a6d361fe03be tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:44.675310 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-246b1656-b521-4f49-b68d-983132c63dc2 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:44.676016 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-246b1656-b521-4f49-b68d-983132c63dc2 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:44.683793 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-16f508c0-7ef3-4cde-8878-a6d361fe03be tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:44.684282 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-16f508c0-7ef3-4cde-8878-a6d361fe03be tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:44.685082 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-16f508c0-7ef3-4cde-8878-a6d361fe03be tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:44.692599 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-16f508c0-7ef3-4cde-8878-a6d361fe03be tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:44.697131 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-246b1656-b521-4f49-b68d-983132c63dc2 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:44.697970 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-246b1656-b521-4f49-b68d-983132c63dc2 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:44.699055 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-246b1656-b521-4f49-b68d-983132c63dc2 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:44.699711 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-246b1656-b521-4f49-b68d-983132c63dc2 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:44.883087 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-16f508c0-7ef3-4cde-8878-a6d361fe03be tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:44.892971 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-16f508c0-7ef3-4cde-8878-a6d361fe03be tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1313 microversion: 2.1 time: 0.230989 Apr 16 21:15:44.893901 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1315/2503] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:44 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:44.900140 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-53e958af-0bfa-4a6c-b6c4-103afebf119e req-7da676cb-1173-4ae3-aaed-827f0c83e941 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae2e0ce1-35a6-4ef8-83f4-44237fe59f65", "name": "network-vif-plugged", "status": "completed", "tag": "1bf2401d-a2fc-43d2-8639-8a27abfa3686"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:44.910139 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-53e958af-0bfa-4a6c-b6c4-103afebf119e req-7da676cb-1173-4ae3-aaed-827f0c83e941 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:44.911976 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-53e958af-0bfa-4a6c-b6c4-103afebf119e req-7da676cb-1173-4ae3-aaed-827f0c83e941 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:44.913811 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-246b1656-b521-4f49-b68d-983132c63dc2 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:44.925463 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-53e958af-0bfa-4a6c-b6c4-103afebf119e req-7da676cb-1173-4ae3-aaed-827f0c83e941 service nova] Creating event network-vif-plugged:1bf2401d-a2fc-43d2-8639-8a27abfa3686 for instance ae2e0ce1-35a6-4ef8-83f4-44237fe59f65 on nch1-master-1 Apr 16 21:15:44.927012 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-246b1656-b521-4f49-b68d-983132c63dc2 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f" status: 200 len: 1521 microversion: 2.1 time: 0.262006 Apr 16 21:15:44.930604 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-53e958af-0bfa-4a6c-b6c4-103afebf119e req-7da676cb-1173-4ae3-aaed-827f0c83e941 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035249 Apr 16 21:15:44.942387 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1189/2505] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:44 2022] GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f => generated 1521 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:44.942646 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1316/2505] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:15:44.942646 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-faa4b184-6f43-42a7-81d0-0dfb3781db47 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb964bc790>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:44.945858 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-aa74ac96-a2f5-44b9-a44f-37b65cb65cf9 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:44.947003 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-aa74ac96-a2f5-44b9-a44f-37b65cb65cf9 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:44.955335 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aa74ac96-a2f5-44b9-a44f-37b65cb65cf9 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:44.955913 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aa74ac96-a2f5-44b9-a44f-37b65cb65cf9 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:44.956762 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aa74ac96-a2f5-44b9-a44f-37b65cb65cf9 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:44.957350 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aa74ac96-a2f5-44b9-a44f-37b65cb65cf9 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:44.996322 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-faa4b184-6f43-42a7-81d0-0dfb3781db47 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231" status: 200 len: 1412 microversion: 2.1 time: 0.063252 Apr 16 21:15:44.997202 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1317/2506] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:15:44 2022] GET /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231 => generated 1412 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:45.007318 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3e376d2f-ef51-4689-831d-f9632d31c4de tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:45.008047 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3e376d2f-ef51-4689-831d-f9632d31c4de tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:45.018868 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3e376d2f-ef51-4689-831d-f9632d31c4de tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:45.019594 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3e376d2f-ef51-4689-831d-f9632d31c4de tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:45.020469 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3e376d2f-ef51-4689-831d-f9632d31c4de tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:45.020904 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3e376d2f-ef51-4689-831d-f9632d31c4de tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:45.037702 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-aa74ac96-a2f5-44b9-a44f-37b65cb65cf9 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:45.046021 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-aa74ac96-a2f5-44b9-a44f-37b65cb65cf9 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:45.047618 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-aa74ac96-a2f5-44b9-a44f-37b65cb65cf9 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:45.053268 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-aa74ac96-a2f5-44b9-a44f-37b65cb65cf9 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1446 microversion: 2.75 time: 0.118682 Apr 16 21:15:45.054539 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1190/2507] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:44 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1446 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:15:45.236824 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3e376d2f-ef51-4689-831d-f9632d31c4de tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:45.247400 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3e376d2f-ef51-4689-831d-f9632d31c4de tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f" status: 200 len: 1521 microversion: 2.1 time: 0.249141 Apr 16 21:15:45.260116 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1318/2508] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:44 2022] GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:45.267462 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f5bbe81c-eb35-477c-8571-b2220c21a5c2 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:45.269129 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f5bbe81c-eb35-477c-8571-b2220c21a5c2 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:15:45.270095 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f5bbe81c-eb35-477c-8571-b2220c21a5c2 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "POST /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f/action" status: 400 len: 619 microversion: 2.1 time: 0.008211 Apr 16 21:15:45.273795 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1191/2509] 10.222.0.20 () {60 vars in 1278 bytes} [Sat Apr 16 21:15:45 2022] POST /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f/action => generated 619 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:15:45.288321 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cf9b3cde-2b08-4998-92b4-c3305a75e85d tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:45.289370 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cf9b3cde-2b08-4998-92b4-c3305a75e85d tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:45.304432 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cf9b3cde-2b08-4998-92b4-c3305a75e85d tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:45.305015 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cf9b3cde-2b08-4998-92b4-c3305a75e85d tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:45.307296 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cf9b3cde-2b08-4998-92b4-c3305a75e85d tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:45.307848 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cf9b3cde-2b08-4998-92b4-c3305a75e85d tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:45.500209 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cf9b3cde-2b08-4998-92b4-c3305a75e85d tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:45.508491 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cf9b3cde-2b08-4998-92b4-c3305a75e85d tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f" status: 200 len: 1521 microversion: 2.1 time: 0.231114 Apr 16 21:15:45.512482 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1319/2510] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:45 2022] GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:45.528631 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3b43f678-c90c-48fa-9c5e-c0c643dbf90d tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:45.529260 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3b43f678-c90c-48fa-9c5e-c0c643dbf90d tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:45.536807 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3b43f678-c90c-48fa-9c5e-c0c643dbf90d tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:45.537533 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3b43f678-c90c-48fa-9c5e-c0c643dbf90d tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:45.538537 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3b43f678-c90c-48fa-9c5e-c0c643dbf90d tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:45.539012 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3b43f678-c90c-48fa-9c5e-c0c643dbf90d tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:45.614990 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-949966bb-1878-4d8b-9b27-5ba5b3062d0e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:45.615614 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-949966bb-1878-4d8b-9b27-5ba5b3062d0e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 999c16db-7916-4753-ae16-9ed72c8e6922] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:45.625166 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-949966bb-1878-4d8b-9b27-5ba5b3062d0e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:45.625710 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-949966bb-1878-4d8b-9b27-5ba5b3062d0e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:45.626649 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-949966bb-1878-4d8b-9b27-5ba5b3062d0e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:45.627171 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-949966bb-1878-4d8b-9b27-5ba5b3062d0e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:45.822070 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3b43f678-c90c-48fa-9c5e-c0c643dbf90d tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:45.833424 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3b43f678-c90c-48fa-9c5e-c0c643dbf90d tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f" status: 200 len: 1521 microversion: 2.1 time: 0.309749 Apr 16 21:15:45.843358 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-949966bb-1878-4d8b-9b27-5ba5b3062d0e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:45.847632 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1192/2511] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:45 2022] GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:45.853343 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-949966bb-1878-4d8b-9b27-5ba5b3062d0e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922" status: 200 len: 1314 microversion: 2.1 time: 0.241772 Apr 16 21:15:45.864464 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1320/2512] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:45 2022] GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:45.865069 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fe7d3039-74db-4339-bb61-2944a70acf8d tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:45.865069 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-fe7d3039-74db-4339-bb61-2944a70acf8d tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: 41932213-4c87-4ee1-909f-50d95297cd64] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:45.865338 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-51ba20cc-0b19-4392-ad7a-a5118ed314c0 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1810779870"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:45.865338 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-51ba20cc-0b19-4392-ad7a-a5118ed314c0 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:45.865764 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fe7d3039-74db-4339-bb61-2944a70acf8d tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:45.865764 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fe7d3039-74db-4339-bb61-2944a70acf8d tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:45.865764 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fe7d3039-74db-4339-bb61-2944a70acf8d tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:45.865764 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fe7d3039-74db-4339-bb61-2944a70acf8d tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:45.868925 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-51ba20cc-0b19-4392-ad7a-a5118ed314c0 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:45.869391 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-51ba20cc-0b19-4392-ad7a-a5118ed314c0 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:45.870182 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-51ba20cc-0b19-4392-ad7a-a5118ed314c0 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:45.870705 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-51ba20cc-0b19-4392-ad7a-a5118ed314c0 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:46.048995 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-fe7d3039-74db-4339-bb61-2944a70acf8d tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2bab3afb0f945eca1a7bf9f783cf9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec2ad232d62489aa704075fad5305c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:46.058835 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fe7d3039-74db-4339-bb61-2944a70acf8d tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "GET /compute/v2.1/servers/41932213-4c87-4ee1-909f-50d95297cd64" status: 200 len: 1505 microversion: 2.1 time: 0.209436 Apr 16 21:15:46.059838 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1193/2513] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:45 2022] GET /compute/v2.1/servers/41932213-4c87-4ee1-909f-50d95297cd64 => generated 1505 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:46.078059 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-46c5e32a-0270-4321-9c48-9d9fd01eb2c2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:46.078612 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-46c5e32a-0270-4321-9c48-9d9fd01eb2c2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:46.085767 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-46c5e32a-0270-4321-9c48-9d9fd01eb2c2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:46.086232 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-46c5e32a-0270-4321-9c48-9d9fd01eb2c2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:46.087577 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-46c5e32a-0270-4321-9c48-9d9fd01eb2c2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:46.088031 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-46c5e32a-0270-4321-9c48-9d9fd01eb2c2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:46.320019 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-46c5e32a-0270-4321-9c48-9d9fd01eb2c2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:46.337757 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-46c5e32a-0270-4321-9c48-9d9fd01eb2c2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1313 microversion: 2.1 time: 0.263795 Apr 16 21:15:46.338331 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1194/2514] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:46 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1313 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:46.343489 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bce0fbfa-7877-449f-a613-315e1f373bfb tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb96a48040>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:46.546332 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bce0fbfa-7877-449f-a613-315e1f373bfb tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231" status: 200 len: 1412 microversion: 2.1 time: 0.206079 Apr 16 21:15:46.547165 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1195/2515] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:15:46 2022] GET /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231 => generated 1412 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:46.556886 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a023be3a-a674-4ea6-8785-11ae1a89c1a2 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:46.557570 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a023be3a-a674-4ea6-8785-11ae1a89c1a2 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:46.571521 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a023be3a-a674-4ea6-8785-11ae1a89c1a2 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:46.571977 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a023be3a-a674-4ea6-8785-11ae1a89c1a2 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:46.572792 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a023be3a-a674-4ea6-8785-11ae1a89c1a2 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:46.573237 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a023be3a-a674-4ea6-8785-11ae1a89c1a2 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:46.640850 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a023be3a-a674-4ea6-8785-11ae1a89c1a2 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:46.648756 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a023be3a-a674-4ea6-8785-11ae1a89c1a2 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:46.650335 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a023be3a-a674-4ea6-8785-11ae1a89c1a2 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:46.655437 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a023be3a-a674-4ea6-8785-11ae1a89c1a2 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1446 microversion: 2.75 time: 0.107392 Apr 16 21:15:46.656452 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1196/2516] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:46 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1446 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:15:46.660856 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8ec22423-c03e-4e50-a222-3ceb775842ab tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:46.781965 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8ec22423-c03e-4e50-a222-3ceb775842ab tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: ae2e0ce1-35a6-4ef8-83f4-44237fe59f65] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:46.781965 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8ec22423-c03e-4e50-a222-3ceb775842ab tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:46.781965 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8ec22423-c03e-4e50-a222-3ceb775842ab tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:46.781965 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8ec22423-c03e-4e50-a222-3ceb775842ab tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:46.781965 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8ec22423-c03e-4e50-a222-3ceb775842ab tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:46.836682 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8ec22423-c03e-4e50-a222-3ceb775842ab tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2bab3afb0f945eca1a7bf9f783cf9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec2ad232d62489aa704075fad5305c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:46.843919 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8ec22423-c03e-4e50-a222-3ceb775842ab tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2e0ce1-35a6-4ef8-83f4-44237fe59f65" status: 200 len: 1318 microversion: 2.1 time: 0.186512 Apr 16 21:15:46.844525 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1197/2517] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:46 2022] GET /compute/v2.1/servers/ae2e0ce1-35a6-4ef8-83f4-44237fe59f65 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:46.876224 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-01a4c56d-a192-426a-9ce5-8e74e74775ba tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:46.876842 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-01a4c56d-a192-426a-9ce5-8e74e74775ba tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 999c16db-7916-4753-ae16-9ed72c8e6922] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:46.882723 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-01a4c56d-a192-426a-9ce5-8e74e74775ba tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:46.883180 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-01a4c56d-a192-426a-9ce5-8e74e74775ba tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:46.884635 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-01a4c56d-a192-426a-9ce5-8e74e74775ba tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:46.885085 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-01a4c56d-a192-426a-9ce5-8e74e74775ba tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:47.018547 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-01a4c56d-a192-426a-9ce5-8e74e74775ba tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:47.026321 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-01a4c56d-a192-426a-9ce5-8e74e74775ba tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922" status: 200 len: 1314 microversion: 2.1 time: 0.153868 Apr 16 21:15:47.027121 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1198/2518] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:46 2022] GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:15:47.129016 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-51ba20cc-0b19-4392-ad7a-a5118ed314c0 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "POST /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f/action" status: 202 len: 0 microversion: 2.1 time: 1.273465 Apr 16 21:15:47.129954 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1321/2519] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:15:45 2022] POST /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f/action => generated 0 bytes in 1275 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 16 21:15:47.140624 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3e7982ad-545f-4813-b760-21a83407217e tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1149407691"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:47.144149 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3e7982ad-545f-4813-b760-21a83407217e tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:47.151759 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e7982ad-545f-4813-b760-21a83407217e tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:47.152232 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e7982ad-545f-4813-b760-21a83407217e tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:47.153031 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e7982ad-545f-4813-b760-21a83407217e tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:47.153474 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e7982ad-545f-4813-b760-21a83407217e tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:47.190623 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-3e7982ad-545f-4813-b760-21a83407217e tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] HTTP exception thrown: Cannot 'createImage' instance 1a03d234-848c-408c-b46c-e2afebb2c61f while it is in task_state image_snapshot_pending Apr 16 21:15:47.191355 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3e7982ad-545f-4813-b760-21a83407217e tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Returning 409 to user: Cannot 'createImage' instance 1a03d234-848c-408c-b46c-e2afebb2c61f while it is in task_state image_snapshot_pending {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:15:47.192299 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3e7982ad-545f-4813-b760-21a83407217e tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "POST /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f/action" status: 409 len: 167 microversion: 2.1 time: 0.056474 Apr 16 21:15:47.193052 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1199/2520] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:15:47 2022] POST /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f/action => generated 167 bytes in 58 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:15:47.201796 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a9e657a8-ed64-4fcf-8cdf-070abdda79ce tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '.version_select at 0x7fbba0076ca0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:47.356081 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5c4fc57c-cd18-49c7-b737-92a80ac662d2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:47.356694 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5c4fc57c-cd18-49c7-b737-92a80ac662d2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:47.364329 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5c4fc57c-cd18-49c7-b737-92a80ac662d2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:47.365122 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5c4fc57c-cd18-49c7-b737-92a80ac662d2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:47.366130 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5c4fc57c-cd18-49c7-b737-92a80ac662d2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:47.366757 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5c4fc57c-cd18-49c7-b737-92a80ac662d2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:47.487780 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a9e657a8-ed64-4fcf-8cdf-070abdda79ce tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "DELETE /compute/v2.1/images/34e8a435-71d4-499d-a028-30c444fa2ce3" status: 204 len: 0 microversion: 2.1 time: 0.290112 Apr 16 21:15:47.489441 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1322/2521] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:47 2022] DELETE /compute/v2.1/images/34e8a435-71d4-499d-a028-30c444fa2ce3 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 16 21:15:47.497020 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e57efadd-173e-42e3-9158-fb49a8211df3 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:47.497909 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e57efadd-173e-42e3-9158-fb49a8211df3 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:47.515960 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e57efadd-173e-42e3-9158-fb49a8211df3 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:47.516600 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e57efadd-173e-42e3-9158-fb49a8211df3 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:47.517505 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e57efadd-173e-42e3-9158-fb49a8211df3 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:47.519327 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e57efadd-173e-42e3-9158-fb49a8211df3 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:47.539446 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5c4fc57c-cd18-49c7-b737-92a80ac662d2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:47.549403 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5c4fc57c-cd18-49c7-b737-92a80ac662d2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1313 microversion: 2.1 time: 0.198266 Apr 16 21:15:47.560756 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1200/2522] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:47 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:15:47.565669 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-37ed6b7c-1979-405f-bca1-7da2fbead819 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb962b4430>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:47.651392 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-37ed6b7c-1979-405f-bca1-7da2fbead819 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231" status: 200 len: 1412 microversion: 2.1 time: 0.088920 Apr 16 21:15:47.652996 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1201/2523] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:15:47 2022] GET /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231 => generated 1412 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:47.701714 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e57efadd-173e-42e3-9158-fb49a8211df3 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:47.710583 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e57efadd-173e-42e3-9158-fb49a8211df3 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f" status: 200 len: 1533 microversion: 2.1 time: 0.217729 Apr 16 21:15:47.711358 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1323/2524] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:47 2022] GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f => generated 1533 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:47.801046 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-82d5be5f-cf07-4f25-9072-d736cd440d2e tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:47.802197 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-82d5be5f-cf07-4f25-9072-d736cd440d2e tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:47.813193 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-82d5be5f-cf07-4f25-9072-d736cd440d2e tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:47.813748 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-82d5be5f-cf07-4f25-9072-d736cd440d2e tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:47.814626 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-82d5be5f-cf07-4f25-9072-d736cd440d2e tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:47.815153 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-82d5be5f-cf07-4f25-9072-d736cd440d2e tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:47.860939 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-36486962-bf4a-492f-a93f-059b59856f2b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:47.861959 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-36486962-bf4a-492f-a93f-059b59856f2b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: ae2e0ce1-35a6-4ef8-83f4-44237fe59f65] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:47.870361 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-36486962-bf4a-492f-a93f-059b59856f2b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:47.870940 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-36486962-bf4a-492f-a93f-059b59856f2b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:47.871801 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-36486962-bf4a-492f-a93f-059b59856f2b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:47.872345 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-36486962-bf4a-492f-a93f-059b59856f2b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:47.914448 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-82d5be5f-cf07-4f25-9072-d736cd440d2e tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:47.924389 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-82d5be5f-cf07-4f25-9072-d736cd440d2e tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:47.925950 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-82d5be5f-cf07-4f25-9072-d736cd440d2e tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:47.934221 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-82d5be5f-cf07-4f25-9072-d736cd440d2e tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1446 microversion: 2.75 time: 0.138641 Apr 16 21:15:47.935184 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1202/2525] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:47 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1446 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:15:48.034160 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-36486962-bf4a-492f-a93f-059b59856f2b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2bab3afb0f945eca1a7bf9f783cf9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec2ad232d62489aa704075fad5305c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:48.044353 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-36486962-bf4a-492f-a93f-059b59856f2b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2e0ce1-35a6-4ef8-83f4-44237fe59f65" status: 200 len: 1506 microversion: 2.1 time: 0.187315 Apr 16 21:15:48.045106 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1324/2526] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:47 2022] GET /compute/v2.1/servers/ae2e0ce1-35a6-4ef8-83f4-44237fe59f65 => generated 1506 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:15:48.046690 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-96d6782b-3334-45cc-8914-491ba82d8c16 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:48.047404 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-96d6782b-3334-45cc-8914-491ba82d8c16 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 999c16db-7916-4753-ae16-9ed72c8e6922] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:48.068454 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-96d6782b-3334-45cc-8914-491ba82d8c16 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:48.068454 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-96d6782b-3334-45cc-8914-491ba82d8c16 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:48.068869 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-96d6782b-3334-45cc-8914-491ba82d8c16 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:48.069447 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-96d6782b-3334-45cc-8914-491ba82d8c16 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:48.073731 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e34a1e94-ee98-42ea-bd97-cf6041a3d6bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:48.077141 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e34a1e94-ee98-42ea-bd97-cf6041a3d6bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: ae2e0ce1-35a6-4ef8-83f4-44237fe59f65] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:48.085626 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e34a1e94-ee98-42ea-bd97-cf6041a3d6bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:48.088014 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e34a1e94-ee98-42ea-bd97-cf6041a3d6bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:48.088014 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e34a1e94-ee98-42ea-bd97-cf6041a3d6bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:48.088014 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e34a1e94-ee98-42ea-bd97-cf6041a3d6bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:48.125504 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e34a1e94-ee98-42ea-bd97-cf6041a3d6bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: ae2e0ce1-35a6-4ef8-83f4-44237fe59f65] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:15:48.246691 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-96d6782b-3334-45cc-8914-491ba82d8c16 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:48.270712 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-96d6782b-3334-45cc-8914-491ba82d8c16 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922" status: 200 len: 1314 microversion: 2.1 time: 0.230410 Apr 16 21:15:48.284395 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1203/2527] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:48 2022] GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:48.478965 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e34a1e94-ee98-42ea-bd97-cf6041a3d6bf tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ae2e0ce1-35a6-4ef8-83f4-44237fe59f65" status: 204 len: 0 microversion: 2.1 time: 0.412253 Apr 16 21:15:48.483497 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1325/2528] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:15:48 2022] DELETE /compute/v2.1/servers/ae2e0ce1-35a6-4ef8-83f4-44237fe59f65 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:15:48.488642 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fa72ddde-c031-44bd-8ee6-6c2afa883a89 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:48.489152 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-fa72ddde-c031-44bd-8ee6-6c2afa883a89 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: 41932213-4c87-4ee1-909f-50d95297cd64] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:48.495324 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fa72ddde-c031-44bd-8ee6-6c2afa883a89 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:48.495787 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fa72ddde-c031-44bd-8ee6-6c2afa883a89 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:48.496623 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fa72ddde-c031-44bd-8ee6-6c2afa883a89 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:48.497074 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fa72ddde-c031-44bd-8ee6-6c2afa883a89 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:48.522320 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-fa72ddde-c031-44bd-8ee6-6c2afa883a89 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: 41932213-4c87-4ee1-909f-50d95297cd64] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:15:48.568783 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7ecbf808-e1ce-4d90-86ca-fab178057395 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:48.569499 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7ecbf808-e1ce-4d90-86ca-fab178057395 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:48.576460 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ecbf808-e1ce-4d90-86ca-fab178057395 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:48.576970 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ecbf808-e1ce-4d90-86ca-fab178057395 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:48.577731 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ecbf808-e1ce-4d90-86ca-fab178057395 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:48.578182 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ecbf808-e1ce-4d90-86ca-fab178057395 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:48.752772 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7ecbf808-e1ce-4d90-86ca-fab178057395 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:48.771806 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7ecbf808-e1ce-4d90-86ca-fab178057395 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1313 microversion: 2.1 time: 0.208042 Apr 16 21:15:48.781574 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1326/2529] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:48 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:48.786012 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cb3564eb-290b-488a-8ec9-7ff446b17742 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbba00e79d0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:48.833642 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cb3564eb-290b-488a-8ec9-7ff446b17742 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231" status: 200 len: 1412 microversion: 2.1 time: 0.059555 Apr 16 21:15:48.834468 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1327/2530] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:15:48 2022] GET /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231 => generated 1412 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:48.839239 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b9550ce8-b93f-422c-9815-e886096f4417 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:48.839835 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b9550ce8-b93f-422c-9815-e886096f4417 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:48.846311 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b9550ce8-b93f-422c-9815-e886096f4417 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:48.851544 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b9550ce8-b93f-422c-9815-e886096f4417 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:48.851544 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b9550ce8-b93f-422c-9815-e886096f4417 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:48.851544 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b9550ce8-b93f-422c-9815-e886096f4417 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:48.878363 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fa72ddde-c031-44bd-8ee6-6c2afa883a89 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "DELETE /compute/v2.1/servers/41932213-4c87-4ee1-909f-50d95297cd64" status: 204 len: 0 microversion: 2.1 time: 0.393205 Apr 16 21:15:48.879886 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1204/2531] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:15:48 2022] DELETE /compute/v2.1/servers/41932213-4c87-4ee1-909f-50d95297cd64 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:15:48.888822 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-43022fc8-1e71-4e4c-bd65-80722302f8ce tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:48.890025 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-43022fc8-1e71-4e4c-bd65-80722302f8ce tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: ae2e0ce1-35a6-4ef8-83f4-44237fe59f65] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:48.901753 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-43022fc8-1e71-4e4c-bd65-80722302f8ce tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:48.904578 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-43022fc8-1e71-4e4c-bd65-80722302f8ce tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:48.905413 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-43022fc8-1e71-4e4c-bd65-80722302f8ce tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:48.906685 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-43022fc8-1e71-4e4c-bd65-80722302f8ce tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:49.002675 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b9550ce8-b93f-422c-9815-e886096f4417 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:49.011147 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b9550ce8-b93f-422c-9815-e886096f4417 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f" status: 200 len: 1533 microversion: 2.1 time: 0.175744 Apr 16 21:15:49.020898 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1328/2532] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:48 2022] GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f => generated 1533 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:49.033871 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4ccfcf3e-12a4-45dd-ae06-22b72c2c7eb1 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:49.033871 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4ccfcf3e-12a4-45dd-ae06-22b72c2c7eb1 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:49.039467 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4ccfcf3e-12a4-45dd-ae06-22b72c2c7eb1 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:49.040720 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4ccfcf3e-12a4-45dd-ae06-22b72c2c7eb1 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:49.042348 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4ccfcf3e-12a4-45dd-ae06-22b72c2c7eb1 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:49.042984 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4ccfcf3e-12a4-45dd-ae06-22b72c2c7eb1 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:49.096551 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-43022fc8-1e71-4e4c-bd65-80722302f8ce tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2bab3afb0f945eca1a7bf9f783cf9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec2ad232d62489aa704075fad5305c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:49.106857 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-43022fc8-1e71-4e4c-bd65-80722302f8ce tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2e0ce1-35a6-4ef8-83f4-44237fe59f65" status: 200 len: 1512 microversion: 2.1 time: 0.222522 Apr 16 21:15:49.107817 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1205/2533] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:48 2022] GET /compute/v2.1/servers/ae2e0ce1-35a6-4ef8-83f4-44237fe59f65 => generated 1512 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:15:49.110354 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4ccfcf3e-12a4-45dd-ae06-22b72c2c7eb1 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:49.119528 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4ccfcf3e-12a4-45dd-ae06-22b72c2c7eb1 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:49.121922 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4ccfcf3e-12a4-45dd-ae06-22b72c2c7eb1 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:49.128516 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4ccfcf3e-12a4-45dd-ae06-22b72c2c7eb1 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1446 microversion: 2.75 time: 0.115259 Apr 16 21:15:49.144469 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1329/2534] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:49 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1446 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:15:49.293704 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5a796051-76c7-4252-974d-cc8832b15549 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:49.294541 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5a796051-76c7-4252-974d-cc8832b15549 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 999c16db-7916-4753-ae16-9ed72c8e6922] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:49.302096 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5a796051-76c7-4252-974d-cc8832b15549 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:49.302560 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5a796051-76c7-4252-974d-cc8832b15549 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:49.303689 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5a796051-76c7-4252-974d-cc8832b15549 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:49.304345 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5a796051-76c7-4252-974d-cc8832b15549 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:49.473771 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5a796051-76c7-4252-974d-cc8832b15549 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:49.482283 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5a796051-76c7-4252-974d-cc8832b15549 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922" status: 200 len: 1314 microversion: 2.1 time: 0.193753 Apr 16 21:15:49.482994 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1206/2535] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:49 2022] GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:49.789951 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cb65d9e4-58c5-4836-86b2-97af801de052 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:49.791498 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cb65d9e4-58c5-4836-86b2-97af801de052 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:49.798811 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cb65d9e4-58c5-4836-86b2-97af801de052 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:49.799380 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cb65d9e4-58c5-4836-86b2-97af801de052 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:49.801189 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cb65d9e4-58c5-4836-86b2-97af801de052 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:49.801189 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cb65d9e4-58c5-4836-86b2-97af801de052 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:49.847770 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ebaae7ce-8fdb-42f5-9942-f94376df8d62 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb962bdc10>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:49.908274 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ebaae7ce-8fdb-42f5-9942-f94376df8d62 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231" status: 200 len: 1412 microversion: 2.1 time: 0.065188 Apr 16 21:15:49.919334 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1207/2536] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:15:49 2022] GET /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231 => generated 1412 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:15:49.979843 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cb65d9e4-58c5-4836-86b2-97af801de052 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:49.989476 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cb65d9e4-58c5-4836-86b2-97af801de052 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1313 microversion: 2.1 time: 0.203835 Apr 16 21:15:49.990182 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1330/2537] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:49 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:50.029353 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fead8dec-7083-4647-ae98-0700a6af9d25 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:50.030285 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-fead8dec-7083-4647-ae98-0700a6af9d25 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:50.038087 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fead8dec-7083-4647-ae98-0700a6af9d25 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:50.039221 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fead8dec-7083-4647-ae98-0700a6af9d25 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:50.040768 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fead8dec-7083-4647-ae98-0700a6af9d25 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:50.041222 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fead8dec-7083-4647-ae98-0700a6af9d25 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:50.127135 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0dd6a098-b69a-4c48-8c91-8ac22cae7a36 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:50.127769 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0dd6a098-b69a-4c48-8c91-8ac22cae7a36 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: ae2e0ce1-35a6-4ef8-83f4-44237fe59f65] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:50.151439 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0dd6a098-b69a-4c48-8c91-8ac22cae7a36 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:50.152163 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0dd6a098-b69a-4c48-8c91-8ac22cae7a36 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:50.153187 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0dd6a098-b69a-4c48-8c91-8ac22cae7a36 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:50.153808 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0dd6a098-b69a-4c48-8c91-8ac22cae7a36 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:50.253435 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-fead8dec-7083-4647-ae98-0700a6af9d25 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:50.262004 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fead8dec-7083-4647-ae98-0700a6af9d25 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f" status: 200 len: 1539 microversion: 2.1 time: 0.236559 Apr 16 21:15:50.262805 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1208/2538] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:50 2022] GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f => generated 1539 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:50.267937 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4f87812d-8645-489a-bace-553753b5918e tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:50.267937 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4f87812d-8645-489a-bace-553753b5918e tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:50.277576 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4f87812d-8645-489a-bace-553753b5918e tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:50.278172 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4f87812d-8645-489a-bace-553753b5918e tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:50.279112 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4f87812d-8645-489a-bace-553753b5918e tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:50.279716 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4f87812d-8645-489a-bace-553753b5918e tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:50.351461 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4f87812d-8645-489a-bace-553753b5918e tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:50.360085 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4f87812d-8645-489a-bace-553753b5918e tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:50.361354 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0dd6a098-b69a-4c48-8c91-8ac22cae7a36 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2bab3afb0f945eca1a7bf9f783cf9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec2ad232d62489aa704075fad5305c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:50.361648 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4f87812d-8645-489a-bace-553753b5918e tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:50.366789 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4f87812d-8645-489a-bace-553753b5918e tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1446 microversion: 2.75 time: 0.103208 Apr 16 21:15:50.370349 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0dd6a098-b69a-4c48-8c91-8ac22cae7a36 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2e0ce1-35a6-4ef8-83f4-44237fe59f65" status: 200 len: 1512 microversion: 2.1 time: 0.247302 Apr 16 21:15:50.379362 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1209/2539] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:50 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1446 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:15:50.380129 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1331/2540] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:50 2022] GET /compute/v2.1/servers/ae2e0ce1-35a6-4ef8-83f4-44237fe59f65 => generated 1512 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:50.500415 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c9b294eb-f064-45ae-a2a1-eef1eed1fe89 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:50.500959 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c9b294eb-f064-45ae-a2a1-eef1eed1fe89 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 999c16db-7916-4753-ae16-9ed72c8e6922] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:50.507495 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c9b294eb-f064-45ae-a2a1-eef1eed1fe89 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:50.508777 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c9b294eb-f064-45ae-a2a1-eef1eed1fe89 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:50.508895 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c9b294eb-f064-45ae-a2a1-eef1eed1fe89 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:50.509317 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c9b294eb-f064-45ae-a2a1-eef1eed1fe89 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:50.665738 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c9b294eb-f064-45ae-a2a1-eef1eed1fe89 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:50.677937 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c9b294eb-f064-45ae-a2a1-eef1eed1fe89 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922" status: 200 len: 1314 microversion: 2.1 time: 0.181350 Apr 16 21:15:50.688828 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1210/2541] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:50 2022] GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:50.705762 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-7e404eb4-9d33-4ba0-ac36-59ada0159557 req-68b74c7e-4a96-4282-b5d9-b5b4e7aa1b45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2389c37c-30cc-4355-a3a2-44653cb17fd6", "name": "network-vif-plugged", "status": "completed", "tag": "0b67129e-ca8a-4c23-aff2-5c3d6e70e65a"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:50.715740 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-7e404eb4-9d33-4ba0-ac36-59ada0159557 req-68b74c7e-4a96-4282-b5d9-b5b4e7aa1b45 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:50.716213 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-7e404eb4-9d33-4ba0-ac36-59ada0159557 req-68b74c7e-4a96-4282-b5d9-b5b4e7aa1b45 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:50.730157 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-7e404eb4-9d33-4ba0-ac36-59ada0159557 req-68b74c7e-4a96-4282-b5d9-b5b4e7aa1b45 service nova] Creating event network-vif-plugged:0b67129e-ca8a-4c23-aff2-5c3d6e70e65a for instance 2389c37c-30cc-4355-a3a2-44653cb17fd6 on nch1-master-1 Apr 16 21:15:50.735379 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-7e404eb4-9d33-4ba0-ac36-59ada0159557 req-68b74c7e-4a96-4282-b5d9-b5b4e7aa1b45 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034477 Apr 16 21:15:50.735978 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1332/2542] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:15:50.926484 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b60217ac-20d7-431f-8245-4730f6ba8a7b tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb965f0670>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:51.012513 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5d37f3d1-f924-4f1e-b5fc-cb1eba4a6191 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:51.017028 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b60217ac-20d7-431f-8245-4730f6ba8a7b tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231" status: 200 len: 1412 microversion: 2.1 time: 0.094594 Apr 16 21:15:51.018097 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5d37f3d1-f924-4f1e-b5fc-cb1eba4a6191 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:51.023834 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1211/2543] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:15:50 2022] GET /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231 => generated 1412 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:51.037197 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5d37f3d1-f924-4f1e-b5fc-cb1eba4a6191 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:51.037793 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5d37f3d1-f924-4f1e-b5fc-cb1eba4a6191 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:51.038622 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5d37f3d1-f924-4f1e-b5fc-cb1eba4a6191 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:51.039139 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5d37f3d1-f924-4f1e-b5fc-cb1eba4a6191 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:51.181161 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5d37f3d1-f924-4f1e-b5fc-cb1eba4a6191 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:51.188561 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5d37f3d1-f924-4f1e-b5fc-cb1eba4a6191 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1313 microversion: 2.1 time: 0.183034 Apr 16 21:15:51.189136 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1333/2544] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:51 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:51.279455 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7d9729d0-49cc-4155-beb6-3cc9e3e1ba77 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:51.282755 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7d9729d0-49cc-4155-beb6-3cc9e3e1ba77 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:51.287351 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7d9729d0-49cc-4155-beb6-3cc9e3e1ba77 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:51.287858 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7d9729d0-49cc-4155-beb6-3cc9e3e1ba77 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:51.288615 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7d9729d0-49cc-4155-beb6-3cc9e3e1ba77 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:51.289058 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7d9729d0-49cc-4155-beb6-3cc9e3e1ba77 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:51.388191 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7ed06322-6ee3-4130-a1e9-11648e83a33f tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:51.389208 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7ed06322-6ee3-4130-a1e9-11648e83a33f tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:51.395452 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ed06322-6ee3-4130-a1e9-11648e83a33f tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:51.406213 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ed06322-6ee3-4130-a1e9-11648e83a33f tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:51.406213 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ed06322-6ee3-4130-a1e9-11648e83a33f tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:51.406213 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ed06322-6ee3-4130-a1e9-11648e83a33f tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:51.465044 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7ed06322-6ee3-4130-a1e9-11648e83a33f tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:51.474642 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7ed06322-6ee3-4130-a1e9-11648e83a33f tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:51.476505 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7ed06322-6ee3-4130-a1e9-11648e83a33f tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:51.482385 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7ed06322-6ee3-4130-a1e9-11648e83a33f tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1446 microversion: 2.75 time: 0.098876 Apr 16 21:15:51.482981 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1334/2545] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:51 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1446 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:15:51.487732 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d451c93a-ef6a-44ac-a721-dbe398da9e6b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:51.488386 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d451c93a-ef6a-44ac-a721-dbe398da9e6b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: ae2e0ce1-35a6-4ef8-83f4-44237fe59f65] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:51.495308 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d451c93a-ef6a-44ac-a721-dbe398da9e6b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:51.495825 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d451c93a-ef6a-44ac-a721-dbe398da9e6b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:51.496787 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d451c93a-ef6a-44ac-a721-dbe398da9e6b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:51.497243 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d451c93a-ef6a-44ac-a721-dbe398da9e6b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:51.637375 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d451c93a-ef6a-44ac-a721-dbe398da9e6b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2bab3afb0f945eca1a7bf9f783cf9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec2ad232d62489aa704075fad5305c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:51.644974 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d451c93a-ef6a-44ac-a721-dbe398da9e6b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2e0ce1-35a6-4ef8-83f4-44237fe59f65" status: 200 len: 1512 microversion: 2.1 time: 0.160982 Apr 16 21:15:51.645561 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1335/2546] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:51 2022] GET /compute/v2.1/servers/ae2e0ce1-35a6-4ef8-83f4-44237fe59f65 => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:51.695092 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7b506c1e-a8fc-49f8-be03-5afee8315d64 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:51.695710 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7b506c1e-a8fc-49f8-be03-5afee8315d64 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 999c16db-7916-4753-ae16-9ed72c8e6922] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:51.701721 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7b506c1e-a8fc-49f8-be03-5afee8315d64 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:51.702176 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7b506c1e-a8fc-49f8-be03-5afee8315d64 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:51.702949 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7b506c1e-a8fc-49f8-be03-5afee8315d64 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:51.703387 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7b506c1e-a8fc-49f8-be03-5afee8315d64 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:51.836019 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7b506c1e-a8fc-49f8-be03-5afee8315d64 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:51.843665 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7b506c1e-a8fc-49f8-be03-5afee8315d64 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922" status: 200 len: 1314 microversion: 2.1 time: 0.152482 Apr 16 21:15:51.844286 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1336/2547] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:51 2022] GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:51.911951 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7d9729d0-49cc-4155-beb6-3cc9e3e1ba77 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:51.919844 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7d9729d0-49cc-4155-beb6-3cc9e3e1ba77 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f" status: 200 len: 1539 microversion: 2.1 time: 0.644346 Apr 16 21:15:51.929375 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1212/2548] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:51 2022] GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f => generated 1539 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:52.037375 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-89539690-8f84-45fe-929e-bce573daadb2 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb96870670>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:52.083371 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-89539690-8f84-45fe-929e-bce573daadb2 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231" status: 200 len: 1421 microversion: 2.1 time: 0.049861 Apr 16 21:15:52.084122 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1337/2549] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:15:52 2022] GET /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231 => generated 1421 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:15:52.096427 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-71f78d13-cc35-4777-a94a-6d0b6c0c8039 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb962a6e50>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:52.142212 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-71f78d13-cc35-4777-a94a-6d0b6c0c8039 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231" status: 200 len: 1421 microversion: 2.1 time: 0.050160 Apr 16 21:15:52.142820 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1213/2550] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:15:52 2022] GET /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231 => generated 1421 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:52.156539 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-76c275aa-a1c3-47e7-841e-f5876eb62763 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb964dcd30>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:52.206216 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1f8a7e94-1448-49f0-81a3-492dee23140f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:52.206783 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1f8a7e94-1448-49f0-81a3-492dee23140f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:52.217129 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1f8a7e94-1448-49f0-81a3-492dee23140f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:52.217589 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1f8a7e94-1448-49f0-81a3-492dee23140f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:52.218377 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1f8a7e94-1448-49f0-81a3-492dee23140f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:52.218819 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1f8a7e94-1448-49f0-81a3-492dee23140f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:52.477868 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1f8a7e94-1448-49f0-81a3-492dee23140f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:52.486948 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1f8a7e94-1448-49f0-81a3-492dee23140f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1313 microversion: 2.1 time: 0.285693 Apr 16 21:15:52.488444 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1214/2551] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:52 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:52.493683 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-19edfba3-ebf9-4220-9a23-405bec8a8d29 req-0e35e587-e88d-40d0-936a-5df11e3b2acb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae2e0ce1-35a6-4ef8-83f4-44237fe59f65", "name": "network-vif-deleted", "tag": "1bf2401d-a2fc-43d2-8639-8a27abfa3686"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:52.504909 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-19edfba3-ebf9-4220-9a23-405bec8a8d29 req-0e35e587-e88d-40d0-936a-5df11e3b2acb service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:52.505587 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-19edfba3-ebf9-4220-9a23-405bec8a8d29 req-0e35e587-e88d-40d0-936a-5df11e3b2acb service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:52.521199 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-19edfba3-ebf9-4220-9a23-405bec8a8d29 req-0e35e587-e88d-40d0-936a-5df11e3b2acb service nova] Creating event network-vif-deleted:1bf2401d-a2fc-43d2-8639-8a27abfa3686 for instance ae2e0ce1-35a6-4ef8-83f4-44237fe59f65 on nch1-master-1 Apr 16 21:15:52.526807 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-19edfba3-ebf9-4220-9a23-405bec8a8d29 req-0e35e587-e88d-40d0-936a-5df11e3b2acb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036922 Apr 16 21:15:52.527473 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1215/2552] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:15:52.534351 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4b3a2302-b26f-4f1b-986c-159a831507db tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:52.535066 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4b3a2302-b26f-4f1b-986c-159a831507db tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:52.541974 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4b3a2302-b26f-4f1b-986c-159a831507db tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:52.543387 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4b3a2302-b26f-4f1b-986c-159a831507db tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:52.543387 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4b3a2302-b26f-4f1b-986c-159a831507db tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:52.543783 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4b3a2302-b26f-4f1b-986c-159a831507db tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:52.614179 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4b3a2302-b26f-4f1b-986c-159a831507db tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:52.622395 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4b3a2302-b26f-4f1b-986c-159a831507db tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:52.623964 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4b3a2302-b26f-4f1b-986c-159a831507db tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:52.628814 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4b3a2302-b26f-4f1b-986c-159a831507db tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1446 microversion: 2.75 time: 0.099656 Apr 16 21:15:52.629653 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1216/2553] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:52 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1446 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:15:52.661323 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a7bfa0ed-fa39-40b3-a363-0dab9ebff81a tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:52.661948 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a7bfa0ed-fa39-40b3-a363-0dab9ebff81a tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: ae2e0ce1-35a6-4ef8-83f4-44237fe59f65] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:52.668130 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a7bfa0ed-fa39-40b3-a363-0dab9ebff81a tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:52.668780 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a7bfa0ed-fa39-40b3-a363-0dab9ebff81a tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:52.669579 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a7bfa0ed-fa39-40b3-a363-0dab9ebff81a tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:52.670044 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a7bfa0ed-fa39-40b3-a363-0dab9ebff81a tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:52.709572 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a7bfa0ed-fa39-40b3-a363-0dab9ebff81a tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:52.710729 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a7bfa0ed-fa39-40b3-a363-0dab9ebff81a tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:52.711274 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-a7bfa0ed-fa39-40b3-a363-0dab9ebff81a tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lazy-loading 'fault' on Instance uuid ae2e0ce1-35a6-4ef8-83f4-44237fe59f65 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:15:52.771709 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a7bfa0ed-fa39-40b3-a363-0dab9ebff81a tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2bab3afb0f945eca1a7bf9f783cf9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec2ad232d62489aa704075fad5305c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:52.783689 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a7bfa0ed-fa39-40b3-a363-0dab9ebff81a tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2e0ce1-35a6-4ef8-83f4-44237fe59f65" status: 200 len: 1308 microversion: 2.1 time: 0.126275 Apr 16 21:15:52.784992 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1217/2554] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:52 2022] GET /compute/v2.1/servers/ae2e0ce1-35a6-4ef8-83f4-44237fe59f65 => generated 1308 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:52.797381 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-377ba47b-f53c-4422-8d14-91da047c7223 req-20050e73-d0de-46a5-a8ab-500cbb18fbb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "999c16db-7916-4753-ae16-9ed72c8e6922", "name": "network-vif-plugged", "status": "completed", "tag": "90cb3288-a22b-4ad5-a087-5f17138b5d8b"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:52.816277 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-377ba47b-f53c-4422-8d14-91da047c7223 req-20050e73-d0de-46a5-a8ab-500cbb18fbb1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:52.816277 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-377ba47b-f53c-4422-8d14-91da047c7223 req-20050e73-d0de-46a5-a8ab-500cbb18fbb1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:52.825960 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-377ba47b-f53c-4422-8d14-91da047c7223 req-20050e73-d0de-46a5-a8ab-500cbb18fbb1 service nova] Creating event network-vif-plugged:90cb3288-a22b-4ad5-a087-5f17138b5d8b for instance 999c16db-7916-4753-ae16-9ed72c8e6922 on nch1-master-1 Apr 16 21:15:52.831305 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-377ba47b-f53c-4422-8d14-91da047c7223 req-20050e73-d0de-46a5-a8ab-500cbb18fbb1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045039 Apr 16 21:15:52.832060 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1218/2555] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:15:52.863478 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1089da53-0a49-41ea-999c-027754b15df4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:52.864294 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1089da53-0a49-41ea-999c-027754b15df4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 999c16db-7916-4753-ae16-9ed72c8e6922] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:52.871657 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1089da53-0a49-41ea-999c-027754b15df4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:52.876861 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1089da53-0a49-41ea-999c-027754b15df4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:52.876861 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1089da53-0a49-41ea-999c-027754b15df4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:52.876861 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1089da53-0a49-41ea-999c-027754b15df4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:53.037823 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1089da53-0a49-41ea-999c-027754b15df4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:53.046308 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1089da53-0a49-41ea-999c-027754b15df4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922" status: 200 len: 1314 microversion: 2.1 time: 0.188742 Apr 16 21:15:53.046897 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1219/2556] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:52 2022] GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:15:53.051853 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a1490db7-5efd-4108-8ea3-9103d19352f6 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:53.052771 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a1490db7-5efd-4108-8ea3-9103d19352f6 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:53.058890 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a1490db7-5efd-4108-8ea3-9103d19352f6 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:53.059712 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a1490db7-5efd-4108-8ea3-9103d19352f6 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:53.060705 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a1490db7-5efd-4108-8ea3-9103d19352f6 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:53.061145 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a1490db7-5efd-4108-8ea3-9103d19352f6 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:53.224591 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a1490db7-5efd-4108-8ea3-9103d19352f6 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:53.232201 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a1490db7-5efd-4108-8ea3-9103d19352f6 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f" status: 200 len: 1539 microversion: 2.1 time: 0.184320 Apr 16 21:15:53.232782 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1220/2557] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:53 2022] GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f => generated 1539 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:53.504421 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-edc4f914-715c-42b2-849f-232029a9f9ec tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:53.507788 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-edc4f914-715c-42b2-849f-232029a9f9ec tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:53.511918 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-edc4f914-715c-42b2-849f-232029a9f9ec tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:53.512411 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-edc4f914-715c-42b2-849f-232029a9f9ec tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:53.513193 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-edc4f914-715c-42b2-849f-232029a9f9ec tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:53.513635 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-edc4f914-715c-42b2-849f-232029a9f9ec tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:53.637628 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-76c275aa-a1c3-47e7-841e-f5876eb62763 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "DELETE /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231" status: 204 len: 0 microversion: 2.1 time: 1.486016 Apr 16 21:15:53.643408 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1338/2558] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:52 2022] DELETE /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231 => generated 0 bytes in 1489 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:15:53.652021 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-edc4f914-715c-42b2-849f-232029a9f9ec tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:53.655216 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9e770dcf-72e9-4ecc-a23a-9973c8a2f2b2 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:53.656765 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9e770dcf-72e9-4ecc-a23a-9973c8a2f2b2 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:53.662340 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-edc4f914-715c-42b2-849f-232029a9f9ec tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1462 microversion: 2.1 time: 0.161887 Apr 16 21:15:53.662966 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1221/2559] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:53 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1462 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:15:53.664373 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9e770dcf-72e9-4ecc-a23a-9973c8a2f2b2 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:53.664849 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9e770dcf-72e9-4ecc-a23a-9973c8a2f2b2 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:53.665668 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9e770dcf-72e9-4ecc-a23a-9973c8a2f2b2 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:53.666115 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9e770dcf-72e9-4ecc-a23a-9973c8a2f2b2 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:53.667835 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-45188ff2-d477-4336-9883-f67921fb35c1 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:53.668605 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-45188ff2-d477-4336-9883-f67921fb35c1 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:53.681856 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-45188ff2-d477-4336-9883-f67921fb35c1 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:53.682343 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-45188ff2-d477-4336-9883-f67921fb35c1 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:53.687710 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-45188ff2-d477-4336-9883-f67921fb35c1 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:53.687710 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-45188ff2-d477-4336-9883-f67921fb35c1 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:53.692587 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9e770dcf-72e9-4ecc-a23a-9973c8a2f2b2 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:15:53.748067 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-45188ff2-d477-4336-9883-f67921fb35c1 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:53.756202 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-45188ff2-d477-4336-9883-f67921fb35c1 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:53.757739 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-45188ff2-d477-4336-9883-f67921fb35c1 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:53.763122 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-45188ff2-d477-4336-9883-f67921fb35c1 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1446 microversion: 2.75 time: 0.099068 Apr 16 21:15:53.763693 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1222/2560] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:53 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1446 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:15:53.768132 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-377536eb-f214-4b19-b471-621b35a6854e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:53.769239 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-377536eb-f214-4b19-b471-621b35a6854e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:53.774846 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-377536eb-f214-4b19-b471-621b35a6854e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:53.775311 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-377536eb-f214-4b19-b471-621b35a6854e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:53.776083 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-377536eb-f214-4b19-b471-621b35a6854e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:53.776562 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-377536eb-f214-4b19-b471-621b35a6854e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:53.861150 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-377536eb-f214-4b19-b471-621b35a6854e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:53.867487 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-377536eb-f214-4b19-b471-621b35a6854e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Old instance type m1.heat2, new instance type m1.heat {{(pid=137409) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 16 21:15:53.874267 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-377536eb-f214-4b19-b471-621b35a6854e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:15:53.874702 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-377536eb-f214-4b19-b471-621b35a6854e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:15:53.875177 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-377536eb-f214-4b19-b471-621b35a6854e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:15:53.875594 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-377536eb-f214-4b19-b471-621b35a6854e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:15:53.876007 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-377536eb-f214-4b19-b471-621b35a6854e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:15:54.062670 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9e770dcf-72e9-4ecc-a23a-9973c8a2f2b2 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 204 len: 0 microversion: 2.1 time: 0.418709 Apr 16 21:15:54.063759 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1339/2561] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:15:53 2022] DELETE /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:15:54.070552 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ca0f9102-a8ab-4e38-995c-01628520102b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:54.072619 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ca0f9102-a8ab-4e38-995c-01628520102b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: ae2e0ce1-35a6-4ef8-83f4-44237fe59f65] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:54.079079 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ca0f9102-a8ab-4e38-995c-01628520102b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:54.079538 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ca0f9102-a8ab-4e38-995c-01628520102b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:54.080584 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ca0f9102-a8ab-4e38-995c-01628520102b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:54.081026 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ca0f9102-a8ab-4e38-995c-01628520102b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:54.097659 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-ca0f9102-a8ab-4e38-995c-01628520102b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] HTTP exception thrown: Instance ae2e0ce1-35a6-4ef8-83f4-44237fe59f65 could not be found. Apr 16 21:15:54.097659 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ca0f9102-a8ab-4e38-995c-01628520102b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Returning 404 to user: Instance ae2e0ce1-35a6-4ef8-83f4-44237fe59f65 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:15:54.097659 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ca0f9102-a8ab-4e38-995c-01628520102b tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "GET /compute/v2.1/servers/ae2e0ce1-35a6-4ef8-83f4-44237fe59f65" status: 404 len: 111 microversion: 2.1 time: 0.032203 Apr 16 21:15:54.098144 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1340/2562] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:54 2022] GET /compute/v2.1/servers/ae2e0ce1-35a6-4ef8-83f4-44237fe59f65 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:15:54.105819 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ad888192-f0c9-4ede-8f5e-716fa9a443a6 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:54.106583 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ad888192-f0c9-4ede-8f5e-716fa9a443a6 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 999c16db-7916-4753-ae16-9ed72c8e6922] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:54.112973 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ad888192-f0c9-4ede-8f5e-716fa9a443a6 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:54.113433 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ad888192-f0c9-4ede-8f5e-716fa9a443a6 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:54.114219 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ad888192-f0c9-4ede-8f5e-716fa9a443a6 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:54.114666 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ad888192-f0c9-4ede-8f5e-716fa9a443a6 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:54.164135 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-377536eb-f214-4b19-b471-621b35a6854e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "POST /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6/action" status: 202 len: 0 microversion: 2.1 time: 0.399286 Apr 16 21:15:54.168250 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1223/2563] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:15:53 2022] POST /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6/action => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:15:54.182967 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a82b80f2-2805-44cb-b2a4-c17de075a43f tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:54.186139 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a82b80f2-2805-44cb-b2a4-c17de075a43f tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: 41932213-4c87-4ee1-909f-50d95297cd64] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:54.193956 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a82b80f2-2805-44cb-b2a4-c17de075a43f tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:54.194489 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a82b80f2-2805-44cb-b2a4-c17de075a43f tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:54.195538 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a82b80f2-2805-44cb-b2a4-c17de075a43f tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:54.195986 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a82b80f2-2805-44cb-b2a4-c17de075a43f tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:54.229260 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a82b80f2-2805-44cb-b2a4-c17de075a43f tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:54.229734 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a82b80f2-2805-44cb-b2a4-c17de075a43f tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:54.230381 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-a82b80f2-2805-44cb-b2a4-c17de075a43f tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lazy-loading 'fault' on Instance uuid 41932213-4c87-4ee1-909f-50d95297cd64 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:15:54.278268 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ad888192-f0c9-4ede-8f5e-716fa9a443a6 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:54.286432 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ad888192-f0c9-4ede-8f5e-716fa9a443a6 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922" status: 200 len: 1314 microversion: 2.1 time: 0.187559 Apr 16 21:15:54.291104 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1341/2564] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:54 2022] GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:54.294331 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a82b80f2-2805-44cb-b2a4-c17de075a43f tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b2bab3afb0f945eca1a7bf9f783cf9fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ec2ad232d62489aa704075fad5305c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:54.297924 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cd00e1d0-71f0-45a9-b99d-0f6b5853cb63 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:54.298550 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cd00e1d0-71f0-45a9-b99d-0f6b5853cb63 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:54.302442 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a82b80f2-2805-44cb-b2a4-c17de075a43f tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "GET /compute/v2.1/servers/41932213-4c87-4ee1-909f-50d95297cd64" status: 200 len: 1308 microversion: 2.1 time: 0.134601 Apr 16 21:15:54.303758 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1224/2565] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:54 2022] GET /compute/v2.1/servers/41932213-4c87-4ee1-909f-50d95297cd64 => generated 1308 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:54.304477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cd00e1d0-71f0-45a9-b99d-0f6b5853cb63 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:54.304944 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cd00e1d0-71f0-45a9-b99d-0f6b5853cb63 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:54.305738 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cd00e1d0-71f0-45a9-b99d-0f6b5853cb63 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:54.306416 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cd00e1d0-71f0-45a9-b99d-0f6b5853cb63 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:54.309988 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4e5429aa-1e30-4284-93cf-6e5d69f5bcd7 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-64984580", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "769f0aad-9fdd-4679-bf9a-69cbe3356918"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:54.371684 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-4e5429aa-1e30-4284-93cf-6e5d69f5bcd7 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] validate_networks() for [('769f0aad-9fdd-4679-bf9a-69cbe3356918', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:15:54.489730 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cd00e1d0-71f0-45a9-b99d-0f6b5853cb63 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:54.498172 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cd00e1d0-71f0-45a9-b99d-0f6b5853cb63 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1471 microversion: 2.1 time: 0.210115 Apr 16 21:15:54.508326 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1342/2566] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:54 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1471 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:54.514107 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1bfe4c01-62ec-414f-ba93-f31ca99b1c05 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:54.514813 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1bfe4c01-62ec-414f-ba93-f31ca99b1c05 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:54.521210 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1bfe4c01-62ec-414f-ba93-f31ca99b1c05 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:54.521676 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1bfe4c01-62ec-414f-ba93-f31ca99b1c05 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:54.522503 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1bfe4c01-62ec-414f-ba93-f31ca99b1c05 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:54.523591 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1bfe4c01-62ec-414f-ba93-f31ca99b1c05 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:54.661057 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1bfe4c01-62ec-414f-ba93-f31ca99b1c05 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:54.669601 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1bfe4c01-62ec-414f-ba93-f31ca99b1c05 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f" status: 200 len: 1539 microversion: 2.1 time: 0.168945 Apr 16 21:15:54.688870 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1343/2567] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:54 2022] GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f => generated 1539 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:54.698990 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-d359fe28-779b-4870-9990-fd15207b34dc req-fc04fa0f-6142-48df-88fd-9d9cbde29cf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41932213-4c87-4ee1-909f-50d95297cd64", "name": "network-vif-deleted", "tag": "101a84f6-6ff5-4c6a-b599-738ac67c53ee"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:54.707478 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-d359fe28-779b-4870-9990-fd15207b34dc req-fc04fa0f-6142-48df-88fd-9d9cbde29cf4 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:54.708057 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-d359fe28-779b-4870-9990-fd15207b34dc req-fc04fa0f-6142-48df-88fd-9d9cbde29cf4 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:54.720229 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-d359fe28-779b-4870-9990-fd15207b34dc req-fc04fa0f-6142-48df-88fd-9d9cbde29cf4 service nova] Creating event network-vif-deleted:101a84f6-6ff5-4c6a-b599-738ac67c53ee for instance 41932213-4c87-4ee1-909f-50d95297cd64 on nch1-master-1 Apr 16 21:15:54.725523 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-d359fe28-779b-4870-9990-fd15207b34dc req-fc04fa0f-6142-48df-88fd-9d9cbde29cf4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033275 Apr 16 21:15:54.726371 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1344/2568] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:15:54.783668 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9e535b2f-18c5-4e10-aab0-60020c5831c0 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:54.789295 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9e535b2f-18c5-4e10-aab0-60020c5831c0 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:54.793835 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-4e5429aa-1e30-4284-93cf-6e5d69f5bcd7 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:15:54.794263 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-4e5429aa-1e30-4284-93cf-6e5d69f5bcd7 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:15:54.794831 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-4e5429aa-1e30-4284-93cf-6e5d69f5bcd7 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:15:54.795154 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-4e5429aa-1e30-4284-93cf-6e5d69f5bcd7 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:15:54.795576 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-4e5429aa-1e30-4284-93cf-6e5d69f5bcd7 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:15:54.796877 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9e535b2f-18c5-4e10-aab0-60020c5831c0 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:54.797133 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9e535b2f-18c5-4e10-aab0-60020c5831c0 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:54.798334 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9e535b2f-18c5-4e10-aab0-60020c5831c0 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:54.799276 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9e535b2f-18c5-4e10-aab0-60020c5831c0 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:54.811944 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4e5429aa-1e30-4284-93cf-6e5d69f5bcd7 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:54.812439 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4e5429aa-1e30-4284-93cf-6e5d69f5bcd7 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:54.813267 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4e5429aa-1e30-4284-93cf-6e5d69f5bcd7 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:54.813713 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4e5429aa-1e30-4284-93cf-6e5d69f5bcd7 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:54.830952 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-4e5429aa-1e30-4284-93cf-6e5d69f5bcd7 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Getting quotas for project f95103d3663146e9ba6ffb49a05196b4. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:15:54.839198 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-4e5429aa-1e30-4284-93cf-6e5d69f5bcd7 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Getting quotas for user 3ad32f0114a44a3bac0c966003e312df and project f95103d3663146e9ba6ffb49a05196b4. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:15:54.854165 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4e5429aa-1e30-4284-93cf-6e5d69f5bcd7 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:15:54.856439 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4e5429aa-1e30-4284-93cf-6e5d69f5bcd7 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: ff70294f-a73f-4dcf-aaf4-bd979106f1b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:15:54.870496 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9e535b2f-18c5-4e10-aab0-60020c5831c0 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:54.878406 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9e535b2f-18c5-4e10-aab0-60020c5831c0 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:54.882362 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9e535b2f-18c5-4e10-aab0-60020c5831c0 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:54.884822 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9e535b2f-18c5-4e10-aab0-60020c5831c0 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1446 microversion: 2.75 time: 0.105713 Apr 16 21:15:54.885425 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1345/2569] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:54 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1446 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:15:54.977438 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4e5429aa-1e30-4284-93cf-6e5d69f5bcd7 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.672119 Apr 16 21:15:54.983883 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1225/2570] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:15:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:15:54.989124 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0815e532-92fd-4edb-8323-2abfa77bfe29 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:54.989688 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0815e532-92fd-4edb-8323-2abfa77bfe29 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: ff70294f-a73f-4dcf-aaf4-bd979106f1b8] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:55.066443 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0815e532-92fd-4edb-8323-2abfa77bfe29 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:55.073324 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0815e532-92fd-4edb-8323-2abfa77bfe29 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8" status: 200 len: 1206 microversion: 2.1 time: 0.088092 Apr 16 21:15:55.074084 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1346/2571] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:54 2022] GET /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8 => generated 1206 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:55.155049 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-37880068-61b1-41dc-8388-a7cfcecafb47 req-07b3c40d-7b98-4797-adce-f46bc9fa945f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a03d234-848c-408c-b46c-e2afebb2c61f", "name": "network-vif-plugged", "status": "completed", "tag": "f5131071-ff36-4b36-bf83-e46eb31e3bf8"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:55.164824 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-37880068-61b1-41dc-8388-a7cfcecafb47 req-07b3c40d-7b98-4797-adce-f46bc9fa945f service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:55.165997 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-37880068-61b1-41dc-8388-a7cfcecafb47 req-07b3c40d-7b98-4797-adce-f46bc9fa945f service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:55.177377 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-37880068-61b1-41dc-8388-a7cfcecafb47 req-07b3c40d-7b98-4797-adce-f46bc9fa945f service nova] Creating event network-vif-plugged:f5131071-ff36-4b36-bf83-e46eb31e3bf8 for instance 1a03d234-848c-408c-b46c-e2afebb2c61f on nch2-master-1 Apr 16 21:15:55.182487 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-37880068-61b1-41dc-8388-a7cfcecafb47 req-07b3c40d-7b98-4797-adce-f46bc9fa945f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034498 Apr 16 21:15:55.183070 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1226/2572] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:15:55.303242 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0b007c37-4a31-453a-b69b-aaba3051a4ca tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:55.303971 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0b007c37-4a31-453a-b69b-aaba3051a4ca tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 999c16db-7916-4753-ae16-9ed72c8e6922] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:55.310662 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0b007c37-4a31-453a-b69b-aaba3051a4ca tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:55.311121 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0b007c37-4a31-453a-b69b-aaba3051a4ca tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:55.311904 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0b007c37-4a31-453a-b69b-aaba3051a4ca tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:55.312395 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0b007c37-4a31-453a-b69b-aaba3051a4ca tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:55.320957 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3a614b9c-5876-4cd2-b5da-b61010fc46d8 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:55.322240 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3a614b9c-5876-4cd2-b5da-b61010fc46d8 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] [instance: 41932213-4c87-4ee1-909f-50d95297cd64] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:55.328808 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3a614b9c-5876-4cd2-b5da-b61010fc46d8 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:55.329264 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3a614b9c-5876-4cd2-b5da-b61010fc46d8 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:55.351796 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3a614b9c-5876-4cd2-b5da-b61010fc46d8 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:55.351796 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3a614b9c-5876-4cd2-b5da-b61010fc46d8 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:55.351796 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-3a614b9c-5876-4cd2-b5da-b61010fc46d8 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] HTTP exception thrown: Instance 41932213-4c87-4ee1-909f-50d95297cd64 could not be found. Apr 16 21:15:55.351796 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3a614b9c-5876-4cd2-b5da-b61010fc46d8 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] Returning 404 to user: Instance 41932213-4c87-4ee1-909f-50d95297cd64 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:15:55.351796 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3a614b9c-5876-4cd2-b5da-b61010fc46d8 tempest-MultipleCreateTestJSON-1251751187 tempest-MultipleCreateTestJSON-1251751187-project] 10.222.0.20 "GET /compute/v2.1/servers/41932213-4c87-4ee1-909f-50d95297cd64" status: 404 len: 111 microversion: 2.1 time: 0.029956 Apr 16 21:15:55.351796 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1227/2573] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:55 2022] GET /compute/v2.1/servers/41932213-4c87-4ee1-909f-50d95297cd64 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:15:55.508372 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0b007c37-4a31-453a-b69b-aaba3051a4ca tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:55.517783 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0b007c37-4a31-453a-b69b-aaba3051a4ca tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922" status: 200 len: 1501 microversion: 2.1 time: 0.218655 Apr 16 21:15:55.518376 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1347/2574] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:55 2022] GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922 => generated 1501 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:55.519251 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-49b00dcb-b8b6-42fc-a640-6b287049a0e1 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:55.519916 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-49b00dcb-b8b6-42fc-a640-6b287049a0e1 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:55.526965 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-49b00dcb-b8b6-42fc-a640-6b287049a0e1 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:55.528580 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-49b00dcb-b8b6-42fc-a640-6b287049a0e1 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:55.529603 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-49b00dcb-b8b6-42fc-a640-6b287049a0e1 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:55.530816 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-49b00dcb-b8b6-42fc-a640-6b287049a0e1 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:55.536491 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-25fa943c-2c7e-43cd-8f57-d858a7336d1a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:55.553401 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-25fa943c-2c7e-43cd-8f57-d858a7336d1a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:55.553401 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-25fa943c-2c7e-43cd-8f57-d858a7336d1a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:55.566199 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-25fa943c-2c7e-43cd-8f57-d858a7336d1a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 999c16db-7916-4753-ae16-9ed72c8e6922] Going to try to stop instance {{(pid=137408) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 16 21:15:55.683859 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-49b00dcb-b8b6-42fc-a640-6b287049a0e1 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:55.691626 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-49b00dcb-b8b6-42fc-a640-6b287049a0e1 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1471 microversion: 2.1 time: 0.177886 Apr 16 21:15:55.692248 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1228/2575] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:55 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1471 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:15:55.701890 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f1f8a173-c25f-43b7-a874-9044a53cabbc tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:55.702485 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f1f8a173-c25f-43b7-a874-9044a53cabbc tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:55.708690 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f1f8a173-c25f-43b7-a874-9044a53cabbc tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:55.709176 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f1f8a173-c25f-43b7-a874-9044a53cabbc tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:55.709953 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f1f8a173-c25f-43b7-a874-9044a53cabbc tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:55.710398 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f1f8a173-c25f-43b7-a874-9044a53cabbc tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:55.755037 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-25fa943c-2c7e-43cd-8f57-d858a7336d1a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "POST /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922/action" status: 202 len: 0 microversion: 2.1 time: 0.222896 Apr 16 21:15:55.756323 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1348/2576] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:15:55 2022] POST /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:15:55.773138 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a452934f-f203-4292-b939-bbc3e3bc030e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:55.773836 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a452934f-f203-4292-b939-bbc3e3bc030e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 999c16db-7916-4753-ae16-9ed72c8e6922] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:55.781941 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a452934f-f203-4292-b939-bbc3e3bc030e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:55.782414 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a452934f-f203-4292-b939-bbc3e3bc030e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:55.786966 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a452934f-f203-4292-b939-bbc3e3bc030e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:55.794208 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a452934f-f203-4292-b939-bbc3e3bc030e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:55.870124 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f1f8a173-c25f-43b7-a874-9044a53cabbc tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:55.878496 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f1f8a173-c25f-43b7-a874-9044a53cabbc tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f" status: 200 len: 1539 microversion: 2.1 time: 0.180028 Apr 16 21:15:55.879503 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1229/2577] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:55 2022] GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f => generated 1539 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:15:55.908076 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-275fa7a6-ffce-4301-8e38-b2f719cb92a3 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:55.908076 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-275fa7a6-ffce-4301-8e38-b2f719cb92a3 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:55.912855 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-275fa7a6-ffce-4301-8e38-b2f719cb92a3 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:55.913313 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-275fa7a6-ffce-4301-8e38-b2f719cb92a3 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:55.914086 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-275fa7a6-ffce-4301-8e38-b2f719cb92a3 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:55.914523 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-275fa7a6-ffce-4301-8e38-b2f719cb92a3 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:55.982404 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-275fa7a6-ffce-4301-8e38-b2f719cb92a3 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:55.992092 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-275fa7a6-ffce-4301-8e38-b2f719cb92a3 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:55.999714 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-275fa7a6-ffce-4301-8e38-b2f719cb92a3 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:56.006103 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-275fa7a6-ffce-4301-8e38-b2f719cb92a3 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1446 microversion: 2.75 time: 0.106439 Apr 16 21:15:56.006935 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1230/2578] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:55 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1446 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:15:56.029110 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a452934f-f203-4292-b939-bbc3e3bc030e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:56.037109 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a452934f-f203-4292-b939-bbc3e3bc030e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922" status: 200 len: 1511 microversion: 2.1 time: 0.268729 Apr 16 21:15:56.037697 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1349/2579] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:55 2022] GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922 => generated 1511 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:15:56.091818 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ed0f41f7-cad9-49e6-aacd-86893a1f7f9f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:56.092447 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ed0f41f7-cad9-49e6-aacd-86893a1f7f9f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: ff70294f-a73f-4dcf-aaf4-bd979106f1b8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:56.098570 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ed0f41f7-cad9-49e6-aacd-86893a1f7f9f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:56.099122 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ed0f41f7-cad9-49e6-aacd-86893a1f7f9f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:56.103720 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ed0f41f7-cad9-49e6-aacd-86893a1f7f9f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:56.103720 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ed0f41f7-cad9-49e6-aacd-86893a1f7f9f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:56.162518 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ed0f41f7-cad9-49e6-aacd-86893a1f7f9f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:56.170782 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ed0f41f7-cad9-49e6-aacd-86893a1f7f9f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8" status: 200 len: 1210 microversion: 2.1 time: 0.083640 Apr 16 21:15:56.171347 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1231/2580] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:56 2022] GET /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8 => generated 1210 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:56.709021 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ca1578c0-f516-4eaa-8f2a-0170d90165c3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:56.709637 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ca1578c0-f516-4eaa-8f2a-0170d90165c3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:56.716575 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ca1578c0-f516-4eaa-8f2a-0170d90165c3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:56.717034 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ca1578c0-f516-4eaa-8f2a-0170d90165c3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:56.717813 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ca1578c0-f516-4eaa-8f2a-0170d90165c3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:56.718254 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ca1578c0-f516-4eaa-8f2a-0170d90165c3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:56.872130 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ca1578c0-f516-4eaa-8f2a-0170d90165c3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:56.879808 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ca1578c0-f516-4eaa-8f2a-0170d90165c3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1471 microversion: 2.1 time: 0.174853 Apr 16 21:15:56.880448 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1350/2581] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:56 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1471 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:56.895144 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ce2c7849-ef10-42ac-b98d-2f9bfe682e5b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:56.898031 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ce2c7849-ef10-42ac-b98d-2f9bfe682e5b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:56.901813 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ce2c7849-ef10-42ac-b98d-2f9bfe682e5b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:56.902269 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ce2c7849-ef10-42ac-b98d-2f9bfe682e5b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:56.903043 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ce2c7849-ef10-42ac-b98d-2f9bfe682e5b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:56.903484 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ce2c7849-ef10-42ac-b98d-2f9bfe682e5b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:57.029079 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7f68a36d-f471-46c9-97a4-a6cfbbfd9cc2 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:57.030806 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7f68a36d-f471-46c9-97a4-a6cfbbfd9cc2 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:57.039766 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7f68a36d-f471-46c9-97a4-a6cfbbfd9cc2 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:57.040821 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7f68a36d-f471-46c9-97a4-a6cfbbfd9cc2 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:57.042002 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7f68a36d-f471-46c9-97a4-a6cfbbfd9cc2 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:57.042460 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7f68a36d-f471-46c9-97a4-a6cfbbfd9cc2 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:57.043626 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ce2c7849-ef10-42ac-b98d-2f9bfe682e5b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:57.052740 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ce2c7849-ef10-42ac-b98d-2f9bfe682e5b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f" status: 200 len: 1539 microversion: 2.1 time: 0.161064 Apr 16 21:15:57.052740 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1232/2582] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:56 2022] GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f => generated 1539 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:57.057709 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-32ba7786-37d5-4ff7-b074-a35b20a23dea tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:57.058356 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-32ba7786-37d5-4ff7-b074-a35b20a23dea tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 999c16db-7916-4753-ae16-9ed72c8e6922] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:57.065084 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-32ba7786-37d5-4ff7-b074-a35b20a23dea tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:57.065590 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-32ba7786-37d5-4ff7-b074-a35b20a23dea tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:57.066295 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-32ba7786-37d5-4ff7-b074-a35b20a23dea tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:57.066746 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-32ba7786-37d5-4ff7-b074-a35b20a23dea tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:57.123759 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7f68a36d-f471-46c9-97a4-a6cfbbfd9cc2 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:57.132149 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7f68a36d-f471-46c9-97a4-a6cfbbfd9cc2 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:57.133773 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7f68a36d-f471-46c9-97a4-a6cfbbfd9cc2 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:57.139461 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7f68a36d-f471-46c9-97a4-a6cfbbfd9cc2 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1446 microversion: 2.75 time: 0.117352 Apr 16 21:15:57.140038 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1351/2583] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:57 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1446 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:15:57.188159 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7c1a9605-02c7-4612-afe2-6c6524ecf36a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:57.188792 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7c1a9605-02c7-4612-afe2-6c6524ecf36a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: ff70294f-a73f-4dcf-aaf4-bd979106f1b8] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:57.194990 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7c1a9605-02c7-4612-afe2-6c6524ecf36a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:57.195447 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7c1a9605-02c7-4612-afe2-6c6524ecf36a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:57.196262 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7c1a9605-02c7-4612-afe2-6c6524ecf36a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:57.197327 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7c1a9605-02c7-4612-afe2-6c6524ecf36a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:57.202431 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-32ba7786-37d5-4ff7-b074-a35b20a23dea tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:57.210794 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-32ba7786-37d5-4ff7-b074-a35b20a23dea tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922" status: 200 len: 1511 microversion: 2.1 time: 0.156751 Apr 16 21:15:57.211468 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1233/2584] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:57 2022] GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922 => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:57.216304 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-331166c2-0684-4aea-a492-46fe8507504e req-e4b85b65-5715-488f-8ba1-6bc59a244d17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e98c6a8-a1a1-4e8d-98bf-18f5967003ef", "name": "network-vif-unplugged", "status": "completed", "tag": "7f99c127-cfc6-412e-914a-153d34cbba61"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:57.223774 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-331166c2-0684-4aea-a492-46fe8507504e req-e4b85b65-5715-488f-8ba1-6bc59a244d17 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:57.224356 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-331166c2-0684-4aea-a492-46fe8507504e req-e4b85b65-5715-488f-8ba1-6bc59a244d17 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:57.235608 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-331166c2-0684-4aea-a492-46fe8507504e req-e4b85b65-5715-488f-8ba1-6bc59a244d17 service nova] Creating event network-vif-unplugged:7f99c127-cfc6-412e-914a-153d34cbba61 for instance 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef on nch2-master-1 Apr 16 21:15:57.241122 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-331166c2-0684-4aea-a492-46fe8507504e req-e4b85b65-5715-488f-8ba1-6bc59a244d17 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028546 Apr 16 21:15:57.241928 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1234/2585] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:15:57.275436 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7c1a9605-02c7-4612-afe2-6c6524ecf36a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:57.283454 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7c1a9605-02c7-4612-afe2-6c6524ecf36a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8" status: 200 len: 1210 microversion: 2.1 time: 0.099202 Apr 16 21:15:57.284195 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1352/2586] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:57 2022] GET /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8 => generated 1210 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:57.899057 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-217418bb-0ee3-46bb-a0b7-636647b0479e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:57.899793 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-217418bb-0ee3-46bb-a0b7-636647b0479e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:57.909348 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-217418bb-0ee3-46bb-a0b7-636647b0479e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:57.909895 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-217418bb-0ee3-46bb-a0b7-636647b0479e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:57.911181 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-217418bb-0ee3-46bb-a0b7-636647b0479e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:57.911977 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-217418bb-0ee3-46bb-a0b7-636647b0479e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:57.993082 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-a35b9e3d-a1c2-43a1-9923-518cd1ebdafd req-4a155709-82df-4c58-83d5-7d11a2c24a18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e98c6a8-a1a1-4e8d-98bf-18f5967003ef", "name": "network-vif-deleted", "tag": "7f99c127-cfc6-412e-914a-153d34cbba61"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:15:58.003389 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-a35b9e3d-a1c2-43a1-9923-518cd1ebdafd req-4a155709-82df-4c58-83d5-7d11a2c24a18 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:58.003938 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-a35b9e3d-a1c2-43a1-9923-518cd1ebdafd req-4a155709-82df-4c58-83d5-7d11a2c24a18 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:58.015954 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-a35b9e3d-a1c2-43a1-9923-518cd1ebdafd req-4a155709-82df-4c58-83d5-7d11a2c24a18 service nova] Creating event network-vif-deleted:7f99c127-cfc6-412e-914a-153d34cbba61 for instance 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef on nch2-master-1 Apr 16 21:15:58.023150 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-a35b9e3d-a1c2-43a1-9923-518cd1ebdafd req-4a155709-82df-4c58-83d5-7d11a2c24a18 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033919 Apr 16 21:15:58.024204 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1353/2587] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:15:58.070779 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a2adb5bc-37d3-47d8-8487-bfa4f422f09d tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:58.071817 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a2adb5bc-37d3-47d8-8487-bfa4f422f09d tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:58.077051 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-217418bb-0ee3-46bb-a0b7-636647b0479e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:58.078485 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a2adb5bc-37d3-47d8-8487-bfa4f422f09d tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:58.078954 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a2adb5bc-37d3-47d8-8487-bfa4f422f09d tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:58.079959 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a2adb5bc-37d3-47d8-8487-bfa4f422f09d tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:58.080609 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a2adb5bc-37d3-47d8-8487-bfa4f422f09d tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:58.084779 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-217418bb-0ee3-46bb-a0b7-636647b0479e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1471 microversion: 2.1 time: 0.191281 Apr 16 21:15:58.085366 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1235/2588] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:57 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1471 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:58.160088 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7870909a-7b24-49a4-a6b5-a0422a7beeea tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:58.161245 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7870909a-7b24-49a4-a6b5-a0422a7beeea tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:58.174822 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7870909a-7b24-49a4-a6b5-a0422a7beeea tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:58.175280 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7870909a-7b24-49a4-a6b5-a0422a7beeea tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:58.176295 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7870909a-7b24-49a4-a6b5-a0422a7beeea tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:58.180133 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7870909a-7b24-49a4-a6b5-a0422a7beeea tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:58.245392 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a2adb5bc-37d3-47d8-8487-bfa4f422f09d tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:58.255999 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a2adb5bc-37d3-47d8-8487-bfa4f422f09d tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f" status: 200 len: 1534 microversion: 2.1 time: 0.189301 Apr 16 21:15:58.256717 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1354/2589] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:58 2022] GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f => generated 1534 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:15:58.262271 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-be621096-86e1-42c2-8a2e-1a00e69c03ab tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:58.263031 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-be621096-86e1-42c2-8a2e-1a00e69c03ab tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 999c16db-7916-4753-ae16-9ed72c8e6922] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:58.266237 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7870909a-7b24-49a4-a6b5-a0422a7beeea tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:58.269452 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-be621096-86e1-42c2-8a2e-1a00e69c03ab tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:58.270299 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-be621096-86e1-42c2-8a2e-1a00e69c03ab tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:58.271105 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-be621096-86e1-42c2-8a2e-1a00e69c03ab tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:58.271558 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-be621096-86e1-42c2-8a2e-1a00e69c03ab tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:58.277513 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7870909a-7b24-49a4-a6b5-a0422a7beeea tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:58.279152 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7870909a-7b24-49a4-a6b5-a0422a7beeea tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:58.284705 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7870909a-7b24-49a4-a6b5-a0422a7beeea tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1452 microversion: 2.75 time: 0.129146 Apr 16 21:15:58.285625 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1236/2590] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:58 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1452 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:15:58.300105 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d03046b7-a690-4aaa-aef2-fd50775a25ec tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:58.300983 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d03046b7-a690-4aaa-aef2-fd50775a25ec tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: ff70294f-a73f-4dcf-aaf4-bd979106f1b8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:58.307882 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d03046b7-a690-4aaa-aef2-fd50775a25ec tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:58.309145 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d03046b7-a690-4aaa-aef2-fd50775a25ec tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:58.310040 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d03046b7-a690-4aaa-aef2-fd50775a25ec tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:58.310590 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d03046b7-a690-4aaa-aef2-fd50775a25ec tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:58.374046 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d03046b7-a690-4aaa-aef2-fd50775a25ec tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:58.381736 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d03046b7-a690-4aaa-aef2-fd50775a25ec tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8" status: 200 len: 1258 microversion: 2.1 time: 0.085318 Apr 16 21:15:58.382319 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1237/2591] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:58 2022] GET /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8 => generated 1258 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:58.426853 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-be621096-86e1-42c2-8a2e-1a00e69c03ab tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:58.434697 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-be621096-86e1-42c2-8a2e-1a00e69c03ab tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922" status: 200 len: 1511 microversion: 2.1 time: 0.176866 Apr 16 21:15:58.435289 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1355/2592] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:58 2022] GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922 => generated 1511 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:59.107406 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-795efb31-6231-4aa8-b9fb-97bdb45ea0a6 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:59.108133 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-795efb31-6231-4aa8-b9fb-97bdb45ea0a6 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:59.114104 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-795efb31-6231-4aa8-b9fb-97bdb45ea0a6 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:59.114567 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-795efb31-6231-4aa8-b9fb-97bdb45ea0a6 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:59.115361 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-795efb31-6231-4aa8-b9fb-97bdb45ea0a6 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:59.115907 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-795efb31-6231-4aa8-b9fb-97bdb45ea0a6 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:59.251334 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-795efb31-6231-4aa8-b9fb-97bdb45ea0a6 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:59.259984 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-795efb31-6231-4aa8-b9fb-97bdb45ea0a6 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1471 microversion: 2.1 time: 0.156929 Apr 16 21:15:59.260592 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1238/2593] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:59 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1471 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:59.273184 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ddbaf4ca-11d1-4388-9326-3dc63fe167fb tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:59.273809 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ddbaf4ca-11d1-4388-9326-3dc63fe167fb tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:59.281373 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ddbaf4ca-11d1-4388-9326-3dc63fe167fb tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:59.281839 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ddbaf4ca-11d1-4388-9326-3dc63fe167fb tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:59.282637 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ddbaf4ca-11d1-4388-9326-3dc63fe167fb tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:59.283158 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ddbaf4ca-11d1-4388-9326-3dc63fe167fb tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:59.304445 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a3f12cd1-840f-4433-8780-e009cb02d21d tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:59.305054 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a3f12cd1-840f-4433-8780-e009cb02d21d tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:59.313726 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a3f12cd1-840f-4433-8780-e009cb02d21d tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:59.313726 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a3f12cd1-840f-4433-8780-e009cb02d21d tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:59.314766 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a3f12cd1-840f-4433-8780-e009cb02d21d tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:59.315360 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a3f12cd1-840f-4433-8780-e009cb02d21d tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:59.425655 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a3f12cd1-840f-4433-8780-e009cb02d21d tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:59.436134 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a3f12cd1-840f-4433-8780-e009cb02d21d tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:59.438385 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a3f12cd1-840f-4433-8780-e009cb02d21d tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:59.447666 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a3f12cd1-840f-4433-8780-e009cb02d21d tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1452 microversion: 2.75 time: 0.147088 Apr 16 21:15:59.448833 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1239/2594] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:15:59 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1452 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:15:59.454860 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ffb4af8e-2419-49d1-888e-9d1ab1fa9ed8 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:59.455690 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ffb4af8e-2419-49d1-888e-9d1ab1fa9ed8 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: ff70294f-a73f-4dcf-aaf4-bd979106f1b8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:59.464105 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ffb4af8e-2419-49d1-888e-9d1ab1fa9ed8 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:59.464793 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ffb4af8e-2419-49d1-888e-9d1ab1fa9ed8 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:59.465864 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ffb4af8e-2419-49d1-888e-9d1ab1fa9ed8 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:59.466495 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ffb4af8e-2419-49d1-888e-9d1ab1fa9ed8 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:59.486417 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ddbaf4ca-11d1-4388-9326-3dc63fe167fb tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:59.494694 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ddbaf4ca-11d1-4388-9326-3dc63fe167fb tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f" status: 200 len: 1521 microversion: 2.1 time: 0.225484 Apr 16 21:15:59.495283 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1356/2595] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:59 2022] GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:59.501044 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-69fd368b-d8a8-4b0e-ad74-23212113d4bd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:59.501979 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-69fd368b-d8a8-4b0e-ad74-23212113d4bd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 999c16db-7916-4753-ae16-9ed72c8e6922] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:59.509098 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-69fd368b-d8a8-4b0e-ad74-23212113d4bd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:59.509800 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-69fd368b-d8a8-4b0e-ad74-23212113d4bd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:59.510782 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-69fd368b-d8a8-4b0e-ad74-23212113d4bd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:59.511230 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-69fd368b-d8a8-4b0e-ad74-23212113d4bd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:59.565827 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ffb4af8e-2419-49d1-888e-9d1ab1fa9ed8 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:59.576148 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ffb4af8e-2419-49d1-888e-9d1ab1fa9ed8 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8" status: 200 len: 1266 microversion: 2.1 time: 0.124901 Apr 16 21:15:59.576148 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1240/2596] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:59 2022] GET /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8 => generated 1266 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:59.580599 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e6f17447-c340-4a59-975d-f8a2f122ff6f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:59.580916 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e6f17447-c340-4a59-975d-f8a2f122ff6f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:59.588904 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e6f17447-c340-4a59-975d-f8a2f122ff6f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:59.589776 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e6f17447-c340-4a59-975d-f8a2f122ff6f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:59.590950 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e6f17447-c340-4a59-975d-f8a2f122ff6f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:59.591416 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e6f17447-c340-4a59-975d-f8a2f122ff6f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:59.617833 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e6f17447-c340-4a59-975d-f8a2f122ff6f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:15:59.660648 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-69fd368b-d8a8-4b0e-ad74-23212113d4bd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:15:59.668840 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-69fd368b-d8a8-4b0e-ad74-23212113d4bd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922" status: 200 len: 1511 microversion: 2.1 time: 0.172359 Apr 16 21:15:59.669422 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1357/2597] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:59 2022] GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922 => generated 1511 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:15:59.889021 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e6f17447-c340-4a59-975d-f8a2f122ff6f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f" status: 204 len: 0 microversion: 2.1 time: 0.311514 Apr 16 21:15:59.889021 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1241/2598] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:15:59 2022] DELETE /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:15:59.898392 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-92df702a-c8d1-4edb-b70d-7bb454d3e00b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:15:59.899016 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-92df702a-c8d1-4edb-b70d-7bb454d3e00b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:15:59.915686 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-92df702a-c8d1-4edb-b70d-7bb454d3e00b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:59.916396 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-92df702a-c8d1-4edb-b70d-7bb454d3e00b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:15:59.917328 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-92df702a-c8d1-4edb-b70d-7bb454d3e00b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:15:59.917888 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-92df702a-c8d1-4edb-b70d-7bb454d3e00b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:00.067098 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-92df702a-c8d1-4edb-b70d-7bb454d3e00b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:00.075664 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-92df702a-c8d1-4edb-b70d-7bb454d3e00b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f" status: 200 len: 1527 microversion: 2.1 time: 0.181308 Apr 16 21:16:00.080288 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1358/2599] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:15:59 2022] GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f => generated 1527 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:00.278633 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e330d2d3-516d-4d00-9382-38a93f127ce0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:00.279341 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e330d2d3-516d-4d00-9382-38a93f127ce0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:00.286445 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e330d2d3-516d-4d00-9382-38a93f127ce0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:00.287126 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e330d2d3-516d-4d00-9382-38a93f127ce0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:00.291432 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e330d2d3-516d-4d00-9382-38a93f127ce0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:00.291432 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e330d2d3-516d-4d00-9382-38a93f127ce0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:00.436048 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e330d2d3-516d-4d00-9382-38a93f127ce0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:00.448818 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e330d2d3-516d-4d00-9382-38a93f127ce0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1471 microversion: 2.1 time: 0.174385 Apr 16 21:16:00.450043 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1242/2600] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:00 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1471 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:00.468347 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-61950914-3196-416b-b7a6-867263b7fcb7 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:00.468980 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-61950914-3196-416b-b7a6-867263b7fcb7 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:00.476719 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-61950914-3196-416b-b7a6-867263b7fcb7 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:00.477237 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-61950914-3196-416b-b7a6-867263b7fcb7 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:00.478878 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-61950914-3196-416b-b7a6-867263b7fcb7 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:00.479501 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-61950914-3196-416b-b7a6-867263b7fcb7 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:00.575750 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-61950914-3196-416b-b7a6-867263b7fcb7 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:00.584030 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-61950914-3196-416b-b7a6-867263b7fcb7 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:00.585858 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-61950914-3196-416b-b7a6-867263b7fcb7 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:00.592260 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2304d911-7781-4738-af32-66d224ab8f06 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:00.592851 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2304d911-7781-4738-af32-66d224ab8f06 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: ff70294f-a73f-4dcf-aaf4-bd979106f1b8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:00.599227 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2304d911-7781-4738-af32-66d224ab8f06 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:00.599839 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2304d911-7781-4738-af32-66d224ab8f06 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:00.600899 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2304d911-7781-4738-af32-66d224ab8f06 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:00.605084 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2304d911-7781-4738-af32-66d224ab8f06 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:00.605209 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-61950914-3196-416b-b7a6-867263b7fcb7 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1452 microversion: 2.75 time: 0.137584 Apr 16 21:16:00.605209 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1359/2601] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:16:00 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1452 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:16:00.662338 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2304d911-7781-4738-af32-66d224ab8f06 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:00.670515 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2304d911-7781-4738-af32-66d224ab8f06 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8" status: 200 len: 1266 microversion: 2.1 time: 0.082237 Apr 16 21:16:00.671316 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1243/2602] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:00 2022] GET /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8 => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:00.687293 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b6e695e9-6b28-4475-af1d-e9b010e716fb tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:00.688382 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b6e695e9-6b28-4475-af1d-e9b010e716fb tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 999c16db-7916-4753-ae16-9ed72c8e6922] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:00.695592 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b6e695e9-6b28-4475-af1d-e9b010e716fb tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:00.696164 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b6e695e9-6b28-4475-af1d-e9b010e716fb tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:00.698079 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b6e695e9-6b28-4475-af1d-e9b010e716fb tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:00.698871 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b6e695e9-6b28-4475-af1d-e9b010e716fb tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:00.910924 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b6e695e9-6b28-4475-af1d-e9b010e716fb tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:00.921728 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b6e695e9-6b28-4475-af1d-e9b010e716fb tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922" status: 200 len: 1511 microversion: 2.1 time: 0.239375 Apr 16 21:16:00.925292 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1360/2603] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:00 2022] GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922 => generated 1511 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:01.097449 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-98ffe3f2-da16-42df-89f1-a5dd3b7d737e tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:01.097449 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-98ffe3f2-da16-42df-89f1-a5dd3b7d737e tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:01.103602 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-98ffe3f2-da16-42df-89f1-a5dd3b7d737e tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:01.104076 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-98ffe3f2-da16-42df-89f1-a5dd3b7d737e tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:01.105019 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-98ffe3f2-da16-42df-89f1-a5dd3b7d737e tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:01.115677 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-16e2b084-64d3-42b0-ac6f-33ec092c5806 req-03a74bc9-b39b-41e3-91d7-dc97e85accbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a03d234-848c-408c-b46c-e2afebb2c61f", "name": "network-vif-unplugged", "status": "completed", "tag": "f5131071-ff36-4b36-bf83-e46eb31e3bf8"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:16:01.122022 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-98ffe3f2-da16-42df-89f1-a5dd3b7d737e tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:01.129886 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-16e2b084-64d3-42b0-ac6f-33ec092c5806 req-03a74bc9-b39b-41e3-91d7-dc97e85accbd service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:01.130339 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-16e2b084-64d3-42b0-ac6f-33ec092c5806 req-03a74bc9-b39b-41e3-91d7-dc97e85accbd service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:01.153907 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-16e2b084-64d3-42b0-ac6f-33ec092c5806 req-03a74bc9-b39b-41e3-91d7-dc97e85accbd service nova] Creating event network-vif-unplugged:f5131071-ff36-4b36-bf83-e46eb31e3bf8 for instance 1a03d234-848c-408c-b46c-e2afebb2c61f on nch2-master-1 Apr 16 21:16:01.162341 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-16e2b084-64d3-42b0-ac6f-33ec092c5806 req-03a74bc9-b39b-41e3-91d7-dc97e85accbd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054627 Apr 16 21:16:01.163815 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1361/2604] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:16:01.285030 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-98ffe3f2-da16-42df-89f1-a5dd3b7d737e tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:01.298121 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-98ffe3f2-da16-42df-89f1-a5dd3b7d737e tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f" status: 200 len: 1527 microversion: 2.1 time: 0.209214 Apr 16 21:16:01.298709 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1244/2605] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:01 2022] GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f => generated 1527 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:01.471025 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8b3e47ac-7fa3-4eb6-9756-c15e74f4b561 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:01.473629 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8b3e47ac-7fa3-4eb6-9756-c15e74f4b561 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:01.484020 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8b3e47ac-7fa3-4eb6-9756-c15e74f4b561 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:01.484534 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8b3e47ac-7fa3-4eb6-9756-c15e74f4b561 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:01.485562 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8b3e47ac-7fa3-4eb6-9756-c15e74f4b561 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:01.486017 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8b3e47ac-7fa3-4eb6-9756-c15e74f4b561 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:01.621591 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b498e954-2a8b-4b66-b852-19cdf4535bde tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:01.623368 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b498e954-2a8b-4b66-b852-19cdf4535bde tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:01.631446 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b498e954-2a8b-4b66-b852-19cdf4535bde tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:01.631939 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b498e954-2a8b-4b66-b852-19cdf4535bde tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:01.632819 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b498e954-2a8b-4b66-b852-19cdf4535bde tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:01.633645 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b498e954-2a8b-4b66-b852-19cdf4535bde tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:01.737252 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b498e954-2a8b-4b66-b852-19cdf4535bde tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:01.748419 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b498e954-2a8b-4b66-b852-19cdf4535bde tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:01.751220 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b498e954-2a8b-4b66-b852-19cdf4535bde tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:01.758159 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b498e954-2a8b-4b66-b852-19cdf4535bde tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1452 microversion: 2.75 time: 0.140405 Apr 16 21:16:01.758748 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1245/2606] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:16:01 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1452 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:16:01.773714 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-be358d3c-c218-4271-8ce4-213db3b420d8 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:01.774342 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-be358d3c-c218-4271-8ce4-213db3b420d8 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: ff70294f-a73f-4dcf-aaf4-bd979106f1b8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:01.780592 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8b3e47ac-7fa3-4eb6-9756-c15e74f4b561 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:01.781729 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-be358d3c-c218-4271-8ce4-213db3b420d8 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:01.783351 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-be358d3c-c218-4271-8ce4-213db3b420d8 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:01.784192 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-be358d3c-c218-4271-8ce4-213db3b420d8 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:01.785441 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-be358d3c-c218-4271-8ce4-213db3b420d8 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:01.799130 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8b3e47ac-7fa3-4eb6-9756-c15e74f4b561 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1476 microversion: 2.1 time: 0.335342 Apr 16 21:16:01.801745 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1362/2607] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:01 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1476 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:01.875109 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-be358d3c-c218-4271-8ce4-213db3b420d8 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:01.886819 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-be358d3c-c218-4271-8ce4-213db3b420d8 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8" status: 200 len: 1266 microversion: 2.1 time: 0.126825 Apr 16 21:16:01.887420 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1246/2608] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:01 2022] GET /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8 => generated 1266 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:01.945691 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3bab178f-ffc3-42e3-b9d2-2cbedc019ba3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:01.946741 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3bab178f-ffc3-42e3-b9d2-2cbedc019ba3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 999c16db-7916-4753-ae16-9ed72c8e6922] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:01.953763 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3bab178f-ffc3-42e3-b9d2-2cbedc019ba3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:01.954432 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3bab178f-ffc3-42e3-b9d2-2cbedc019ba3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:01.955591 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3bab178f-ffc3-42e3-b9d2-2cbedc019ba3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:01.956105 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3bab178f-ffc3-42e3-b9d2-2cbedc019ba3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:02.294452 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3bab178f-ffc3-42e3-b9d2-2cbedc019ba3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:02.302353 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3bab178f-ffc3-42e3-b9d2-2cbedc019ba3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922" status: 200 len: 1511 microversion: 2.1 time: 0.364960 Apr 16 21:16:02.303183 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1363/2609] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:01 2022] GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922 => generated 1511 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:02.317498 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c6087378-7c66-4496-beb5-621764177dc0 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:02.318435 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c6087378-7c66-4496-beb5-621764177dc0 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:02.325246 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c6087378-7c66-4496-beb5-621764177dc0 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:02.325811 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c6087378-7c66-4496-beb5-621764177dc0 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:02.326684 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c6087378-7c66-4496-beb5-621764177dc0 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:02.327373 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c6087378-7c66-4496-beb5-621764177dc0 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:02.465481 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c6087378-7c66-4496-beb5-621764177dc0 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:02.472982 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c6087378-7c66-4496-beb5-621764177dc0 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f" status: 200 len: 1527 microversion: 2.1 time: 0.159512 Apr 16 21:16:02.473588 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1247/2610] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:02 2022] GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f => generated 1527 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:02.779272 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-68fa2f5c-fe7c-45ab-8a53-a0467a5ba829 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:02.781231 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-68fa2f5c-fe7c-45ab-8a53-a0467a5ba829 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:02.788740 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-68fa2f5c-fe7c-45ab-8a53-a0467a5ba829 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:02.789400 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-68fa2f5c-fe7c-45ab-8a53-a0467a5ba829 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:02.790423 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-68fa2f5c-fe7c-45ab-8a53-a0467a5ba829 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:02.790867 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-68fa2f5c-fe7c-45ab-8a53-a0467a5ba829 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:02.818302 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5b40ff66-9eed-4de3-ad60-45fd63fdca42 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:02.819067 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5b40ff66-9eed-4de3-ad60-45fd63fdca42 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:02.827191 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5b40ff66-9eed-4de3-ad60-45fd63fdca42 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:02.827650 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5b40ff66-9eed-4de3-ad60-45fd63fdca42 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:02.828868 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5b40ff66-9eed-4de3-ad60-45fd63fdca42 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:02.833455 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5b40ff66-9eed-4de3-ad60-45fd63fdca42 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:02.879822 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-68fa2f5c-fe7c-45ab-8a53-a0467a5ba829 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:02.888767 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-68fa2f5c-fe7c-45ab-8a53-a0467a5ba829 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:02.890590 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-68fa2f5c-fe7c-45ab-8a53-a0467a5ba829 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:02.895680 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-68fa2f5c-fe7c-45ab-8a53-a0467a5ba829 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1452 microversion: 2.75 time: 0.121098 Apr 16 21:16:02.908735 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1364/2611] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:16:02 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1452 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:16:02.913909 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ce8aa30f-5933-4c13-b86a-c1f7a2c16e8a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:02.914535 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ce8aa30f-5933-4c13-b86a-c1f7a2c16e8a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: ff70294f-a73f-4dcf-aaf4-bd979106f1b8] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:02.921320 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ce8aa30f-5933-4c13-b86a-c1f7a2c16e8a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:02.921785 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ce8aa30f-5933-4c13-b86a-c1f7a2c16e8a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:02.922585 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ce8aa30f-5933-4c13-b86a-c1f7a2c16e8a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:02.923032 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ce8aa30f-5933-4c13-b86a-c1f7a2c16e8a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:02.990674 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5b40ff66-9eed-4de3-ad60-45fd63fdca42 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:02.998600 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5b40ff66-9eed-4de3-ad60-45fd63fdca42 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1476 microversion: 2.1 time: 0.184248 Apr 16 21:16:02.999176 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1248/2612] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:02 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1476 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:03.037118 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ce8aa30f-5933-4c13-b86a-c1f7a2c16e8a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:03.049077 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ce8aa30f-5933-4c13-b86a-c1f7a2c16e8a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8" status: 200 len: 1276 microversion: 2.1 time: 0.138410 Apr 16 21:16:03.050191 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1365/2613] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:02 2022] GET /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8 => generated 1276 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:03.321787 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-34f39488-f012-4270-8337-b647980c874a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:03.323539 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-34f39488-f012-4270-8337-b647980c874a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 999c16db-7916-4753-ae16-9ed72c8e6922] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:03.332872 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-34f39488-f012-4270-8337-b647980c874a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:03.333462 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-34f39488-f012-4270-8337-b647980c874a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:03.334694 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-34f39488-f012-4270-8337-b647980c874a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:03.335290 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-34f39488-f012-4270-8337-b647980c874a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:03.479619 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-34f39488-f012-4270-8337-b647980c874a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:03.491156 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-85a46762-1eab-4a5e-833e-ab6cb53f25a7 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:03.494025 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-85a46762-1eab-4a5e-833e-ab6cb53f25a7 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:03.498932 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-34f39488-f012-4270-8337-b647980c874a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922" status: 200 len: 1511 microversion: 2.1 time: 0.183797 Apr 16 21:16:03.499525 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1249/2614] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:03 2022] GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922 => generated 1511 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:03.504754 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-85a46762-1eab-4a5e-833e-ab6cb53f25a7 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:03.505685 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-85a46762-1eab-4a5e-833e-ab6cb53f25a7 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:03.506678 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-85a46762-1eab-4a5e-833e-ab6cb53f25a7 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:03.507849 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-85a46762-1eab-4a5e-833e-ab6cb53f25a7 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:03.849978 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-85a46762-1eab-4a5e-833e-ab6cb53f25a7 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:03.860430 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-85a46762-1eab-4a5e-833e-ab6cb53f25a7 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f" status: 200 len: 1527 microversion: 2.1 time: 0.373952 Apr 16 21:16:03.861387 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1366/2615] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:03 2022] GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f => generated 1527 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:03.916390 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-673bec99-88b3-4537-8fcc-8dca68d01b60 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:03.917863 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-673bec99-88b3-4537-8fcc-8dca68d01b60 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:03.925077 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-673bec99-88b3-4537-8fcc-8dca68d01b60 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:03.925596 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-673bec99-88b3-4537-8fcc-8dca68d01b60 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:03.926440 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-673bec99-88b3-4537-8fcc-8dca68d01b60 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:03.926982 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-673bec99-88b3-4537-8fcc-8dca68d01b60 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:04.002440 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-673bec99-88b3-4537-8fcc-8dca68d01b60 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:04.015578 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-95dd3f27-c73f-4b31-b549-c191d5e7d2e9 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:04.016216 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-95dd3f27-c73f-4b31-b549-c191d5e7d2e9 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:04.023770 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-673bec99-88b3-4537-8fcc-8dca68d01b60 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:04.025303 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-95dd3f27-c73f-4b31-b549-c191d5e7d2e9 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:04.025971 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-95dd3f27-c73f-4b31-b549-c191d5e7d2e9 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:04.026760 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-95dd3f27-c73f-4b31-b549-c191d5e7d2e9 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:04.027176 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-673bec99-88b3-4537-8fcc-8dca68d01b60 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:04.027894 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-95dd3f27-c73f-4b31-b549-c191d5e7d2e9 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:04.039426 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-673bec99-88b3-4537-8fcc-8dca68d01b60 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1452 microversion: 2.75 time: 0.127979 Apr 16 21:16:04.040468 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1250/2616] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:16:03 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1452 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:16:04.073475 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2225b1ef-f689-4f1c-b278-671903181b08 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:04.074217 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2225b1ef-f689-4f1c-b278-671903181b08 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: ff70294f-a73f-4dcf-aaf4-bd979106f1b8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:04.080397 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2225b1ef-f689-4f1c-b278-671903181b08 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:04.080948 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2225b1ef-f689-4f1c-b278-671903181b08 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:04.081824 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2225b1ef-f689-4f1c-b278-671903181b08 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:04.082345 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2225b1ef-f689-4f1c-b278-671903181b08 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:04.158258 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2225b1ef-f689-4f1c-b278-671903181b08 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:04.166313 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2225b1ef-f689-4f1c-b278-671903181b08 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8" status: 200 len: 1264 microversion: 2.1 time: 0.097262 Apr 16 21:16:04.172222 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1251/2617] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:04 2022] GET /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8 => generated 1264 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:04.237310 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-95dd3f27-c73f-4b31-b549-c191d5e7d2e9 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:04.244839 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-95dd3f27-c73f-4b31-b549-c191d5e7d2e9 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1476 microversion: 2.1 time: 0.233246 Apr 16 21:16:04.245417 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1367/2618] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:04 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1476 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:04.516833 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7232c178-68d0-45ab-b563-3fde2166edce tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:04.518645 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7232c178-68d0-45ab-b563-3fde2166edce tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 999c16db-7916-4753-ae16-9ed72c8e6922] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:04.525880 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7232c178-68d0-45ab-b563-3fde2166edce tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:04.526349 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7232c178-68d0-45ab-b563-3fde2166edce tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:04.527155 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7232c178-68d0-45ab-b563-3fde2166edce tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:04.527607 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7232c178-68d0-45ab-b563-3fde2166edce tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:04.733758 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7232c178-68d0-45ab-b563-3fde2166edce tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:04.747776 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7232c178-68d0-45ab-b563-3fde2166edce tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922" status: 200 len: 1511 microversion: 2.1 time: 0.234871 Apr 16 21:16:04.757684 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1252/2619] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:04 2022] GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922 => generated 1511 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:04.878420 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b607bb8a-157e-4fd0-9d11-1b7cbd6b458a tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:04.879057 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b607bb8a-157e-4fd0-9d11-1b7cbd6b458a tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:04.887796 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b607bb8a-157e-4fd0-9d11-1b7cbd6b458a tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:04.888561 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b607bb8a-157e-4fd0-9d11-1b7cbd6b458a tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:04.889861 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b607bb8a-157e-4fd0-9d11-1b7cbd6b458a tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:04.890318 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b607bb8a-157e-4fd0-9d11-1b7cbd6b458a tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:05.060757 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-95397cc6-c7f3-43dc-a8de-a8b23fe471db tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:05.070651 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-95397cc6-c7f3-43dc-a8de-a8b23fe471db tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:05.081846 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-95397cc6-c7f3-43dc-a8de-a8b23fe471db tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:05.084894 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-95397cc6-c7f3-43dc-a8de-a8b23fe471db tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:05.085915 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-95397cc6-c7f3-43dc-a8de-a8b23fe471db tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:05.088446 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-95397cc6-c7f3-43dc-a8de-a8b23fe471db tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:05.210309 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-95397cc6-c7f3-43dc-a8de-a8b23fe471db tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:05.220136 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-95397cc6-c7f3-43dc-a8de-a8b23fe471db tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:05.221798 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-95397cc6-c7f3-43dc-a8de-a8b23fe471db tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:05.229415 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-95397cc6-c7f3-43dc-a8de-a8b23fe471db tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1437 microversion: 2.75 time: 0.173988 Apr 16 21:16:05.230324 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1253/2620] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:16:05 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1437 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:16:05.237998 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e53abcae-a0d7-4313-991d-6155657eb2db tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:05.239071 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e53abcae-a0d7-4313-991d-6155657eb2db tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: ff70294f-a73f-4dcf-aaf4-bd979106f1b8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:05.250436 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e53abcae-a0d7-4313-991d-6155657eb2db tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:05.251193 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e53abcae-a0d7-4313-991d-6155657eb2db tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:05.252203 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e53abcae-a0d7-4313-991d-6155657eb2db tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:05.252868 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e53abcae-a0d7-4313-991d-6155657eb2db tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:05.342546 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b607bb8a-157e-4fd0-9d11-1b7cbd6b458a tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:05.352539 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b607bb8a-157e-4fd0-9d11-1b7cbd6b458a tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f" status: 200 len: 1527 microversion: 2.1 time: 0.478084 Apr 16 21:16:05.353669 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1368/2621] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:04 2022] GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f => generated 1527 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:05.443834 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e53abcae-a0d7-4313-991d-6155657eb2db tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:05.452696 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e53abcae-a0d7-4313-991d-6155657eb2db tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8" status: 200 len: 1306 microversion: 2.1 time: 0.220497 Apr 16 21:16:05.453580 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1254/2622] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:05 2022] GET /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8 => generated 1306 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:05.458832 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-11edf288-09a1-41c3-b080-6005b1b362cc tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:05.463095 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-11edf288-09a1-41c3-b080-6005b1b362cc tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:05.466202 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-11edf288-09a1-41c3-b080-6005b1b362cc tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:05.466670 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-11edf288-09a1-41c3-b080-6005b1b362cc tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:05.467670 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-11edf288-09a1-41c3-b080-6005b1b362cc tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:05.468241 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-11edf288-09a1-41c3-b080-6005b1b362cc tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:05.603421 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-10e5396f-f889-4347-a31a-8816a7696ce1 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:16:05.606501 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-10e5396f-f889-4347-a31a-8816a7696ce1 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:05.614839 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-10e5396f-f889-4347-a31a-8816a7696ce1 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:05.615295 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-10e5396f-f889-4347-a31a-8816a7696ce1 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:05.616090 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-10e5396f-f889-4347-a31a-8816a7696ce1 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:05.616556 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-10e5396f-f889-4347-a31a-8816a7696ce1 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:05.619195 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-11edf288-09a1-41c3-b080-6005b1b362cc tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:05.632744 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-11edf288-09a1-41c3-b080-6005b1b362cc tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1476 microversion: 2.1 time: 0.178030 Apr 16 21:16:05.635158 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1255/2623] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:05 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1476 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:05.721765 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-10e5396f-f889-4347-a31a-8816a7696ce1 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:16:05.722181 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-10e5396f-f889-4347-a31a-8816a7696ce1 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:16:05.722696 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-10e5396f-f889-4347-a31a-8816a7696ce1 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:16:05.723112 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-10e5396f-f889-4347-a31a-8816a7696ce1 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:16:05.723524 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-10e5396f-f889-4347-a31a-8816a7696ce1 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:16:05.766079 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d977661f-f314-475a-865c-e55a359f1621 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:05.766875 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d977661f-f314-475a-865c-e55a359f1621 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 999c16db-7916-4753-ae16-9ed72c8e6922] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:05.772970 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d977661f-f314-475a-865c-e55a359f1621 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:05.774015 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d977661f-f314-475a-865c-e55a359f1621 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:05.774224 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d977661f-f314-475a-865c-e55a359f1621 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:05.774870 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d977661f-f314-475a-865c-e55a359f1621 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:05.942784 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d977661f-f314-475a-865c-e55a359f1621 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:05.952490 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d977661f-f314-475a-865c-e55a359f1621 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922" status: 200 len: 1511 microversion: 2.1 time: 0.190722 Apr 16 21:16:05.953081 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1256/2624] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:05 2022] GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922 => generated 1511 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:05.960257 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-c8e8db15-c525-46a1-a619-6754f22c4057 req-9d8a902c-75fc-4513-8bdb-f80a8ae5010d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a03d234-848c-408c-b46c-e2afebb2c61f", "name": "network-vif-deleted", "tag": "f5131071-ff36-4b36-bf83-e46eb31e3bf8"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:16:05.969629 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-c8e8db15-c525-46a1-a619-6754f22c4057 req-9d8a902c-75fc-4513-8bdb-f80a8ae5010d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:05.970080 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-c8e8db15-c525-46a1-a619-6754f22c4057 req-9d8a902c-75fc-4513-8bdb-f80a8ae5010d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:05.981737 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-c8e8db15-c525-46a1-a619-6754f22c4057 req-9d8a902c-75fc-4513-8bdb-f80a8ae5010d service nova] Creating event network-vif-deleted:f5131071-ff36-4b36-bf83-e46eb31e3bf8 for instance 1a03d234-848c-408c-b46c-e2afebb2c61f on nch2-master-1 Apr 16 21:16:05.983862 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-10e5396f-f889-4347-a31a-8816a7696ce1 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:05.986851 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-c8e8db15-c525-46a1-a619-6754f22c4057 req-9d8a902c-75fc-4513-8bdb-f80a8ae5010d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030034 Apr 16 21:16:05.987640 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1257/2625] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:16:05.991551 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-10e5396f-f889-4347-a31a-8816a7696ce1 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:05.992269 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-10e5396f-f889-4347-a31a-8816a7696ce1 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:05.993707 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-10e5396f-f889-4347-a31a-8816a7696ce1 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:05.994395 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-10e5396f-f889-4347-a31a-8816a7696ce1 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:06.370158 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-abdd534d-d481-4702-956b-1b52415e3561 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:06.370919 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-abdd534d-d481-4702-956b-1b52415e3561 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:06.377598 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-abdd534d-d481-4702-956b-1b52415e3561 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:06.378567 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-abdd534d-d481-4702-956b-1b52415e3561 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:06.381155 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-abdd534d-d481-4702-956b-1b52415e3561 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:06.381155 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-abdd534d-d481-4702-956b-1b52415e3561 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:06.412965 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-abdd534d-d481-4702-956b-1b52415e3561 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:06.413426 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-abdd534d-d481-4702-956b-1b52415e3561 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:06.413892 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-abdd534d-d481-4702-956b-1b52415e3561 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lazy-loading 'fault' on Instance uuid 1a03d234-848c-408c-b46c-e2afebb2c61f {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:16:06.458007 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-abdd534d-d481-4702-956b-1b52415e3561 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:06.468731 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-10e5396f-f889-4347-a31a-8816a7696ce1 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lazy-loading 'services' on Instance uuid 9ce03e87-6962-45d5-910e-f87b61fef356 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:16:06.469265 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-abdd534d-d481-4702-956b-1b52415e3561 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f" status: 200 len: 1315 microversion: 2.1 time: 0.103409 Apr 16 21:16:06.469858 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1258/2626] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:06 2022] GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f => generated 1315 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:06.474816 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ba94eae6-d0c3-4c6b-a5b8-ad09a048e707 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:06.475751 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ba94eae6-d0c3-4c6b-a5b8-ad09a048e707 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: ff70294f-a73f-4dcf-aaf4-bd979106f1b8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:06.491529 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ba94eae6-d0c3-4c6b-a5b8-ad09a048e707 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:06.494214 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ba94eae6-d0c3-4c6b-a5b8-ad09a048e707 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:06.495731 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ba94eae6-d0c3-4c6b-a5b8-ad09a048e707 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:06.496534 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ba94eae6-d0c3-4c6b-a5b8-ad09a048e707 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:06.502928 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-10e5396f-f889-4347-a31a-8816a7696ce1 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356/action" status: 202 len: 1940 microversion: 2.75 time: 1.147948 Apr 16 21:16:06.504942 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1369/2627] 10.222.0.20 () {62 vars in 1318 bytes} [Sat Apr 16 21:16:05 2022] POST /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356/action => generated 1940 bytes in 1150 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Apr 16 21:16:06.528151 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c9f9d9d8-037f-4443-a824-236014ee7779 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:06.529128 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c9f9d9d8-037f-4443-a824-236014ee7779 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:06.537921 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c9f9d9d8-037f-4443-a824-236014ee7779 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:06.539518 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c9f9d9d8-037f-4443-a824-236014ee7779 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:06.540880 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c9f9d9d8-037f-4443-a824-236014ee7779 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:06.541538 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c9f9d9d8-037f-4443-a824-236014ee7779 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:06.654234 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-c9f9d9d8-037f-4443-a824-236014ee7779 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lazy-loading 'services' on Instance uuid 9ce03e87-6962-45d5-910e-f87b61fef356 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:16:06.684197 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ba94eae6-d0c3-4c6b-a5b8-ad09a048e707 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:06.686766 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c9f9d9d8-037f-4443-a824-236014ee7779 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1927 microversion: 2.75 time: 0.167647 Apr 16 21:16:06.687968 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1370/2628] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:16:06 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1927 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:16:06.693096 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5777818e-e3d8-4ef7-905f-2737255f66c2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:06.693741 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5777818e-e3d8-4ef7-905f-2737255f66c2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:06.700505 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5777818e-e3d8-4ef7-905f-2737255f66c2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:06.701321 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5777818e-e3d8-4ef7-905f-2737255f66c2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:06.702397 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5777818e-e3d8-4ef7-905f-2737255f66c2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:06.702532 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5777818e-e3d8-4ef7-905f-2737255f66c2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:06.707667 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ba94eae6-d0c3-4c6b-a5b8-ad09a048e707 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8" status: 200 len: 1306 microversion: 2.1 time: 0.236505 Apr 16 21:16:06.713826 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1259/2629] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:06 2022] GET /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8 => generated 1306 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:06.879012 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5777818e-e3d8-4ef7-905f-2737255f66c2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:06.888521 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5777818e-e3d8-4ef7-905f-2737255f66c2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1476 microversion: 2.1 time: 0.199225 Apr 16 21:16:06.897055 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1371/2630] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:06 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1476 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:06.978581 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9c59f576-937c-45ac-b1f7-b00055a3705f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:06.980954 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9c59f576-937c-45ac-b1f7-b00055a3705f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 999c16db-7916-4753-ae16-9ed72c8e6922] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:07.003722 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9c59f576-937c-45ac-b1f7-b00055a3705f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:07.010907 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9c59f576-937c-45ac-b1f7-b00055a3705f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:07.012385 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9c59f576-937c-45ac-b1f7-b00055a3705f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:07.012909 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9c59f576-937c-45ac-b1f7-b00055a3705f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:07.031368 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-311f5155-04ae-47f4-baec-0c0a0e3173c0 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-507878297", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:16:07.098464 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-311f5155-04ae-47f4-baec-0c0a0e3173c0 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] validate_networks() for [('006efeff-f11c-4209-8816-f1fa1acf7fed', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:16:07.337433 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9c59f576-937c-45ac-b1f7-b00055a3705f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:07.346372 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9c59f576-937c-45ac-b1f7-b00055a3705f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922" status: 200 len: 1511 microversion: 2.1 time: 0.379902 Apr 16 21:16:07.347288 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1372/2631] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:06 2022] GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922 => generated 1511 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:07.487967 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-423dc7a7-995b-447e-a3d2-a36efa94a3cc tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:07.488747 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-423dc7a7-995b-447e-a3d2-a36efa94a3cc tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:07.495184 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-423dc7a7-995b-447e-a3d2-a36efa94a3cc tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:07.496004 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-423dc7a7-995b-447e-a3d2-a36efa94a3cc tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:07.497101 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-423dc7a7-995b-447e-a3d2-a36efa94a3cc tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:07.497786 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-423dc7a7-995b-447e-a3d2-a36efa94a3cc tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:07.513217 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-423dc7a7-995b-447e-a3d2-a36efa94a3cc tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] HTTP exception thrown: Instance 1a03d234-848c-408c-b46c-e2afebb2c61f could not be found. Apr 16 21:16:07.514449 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-423dc7a7-995b-447e-a3d2-a36efa94a3cc tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Returning 404 to user: Instance 1a03d234-848c-408c-b46c-e2afebb2c61f could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:16:07.515583 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-423dc7a7-995b-447e-a3d2-a36efa94a3cc tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f" status: 404 len: 111 microversion: 2.1 time: 0.032492 Apr 16 21:16:07.516751 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1373/2632] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:07 2022] GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:16:07.525674 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-562d69ae-108b-447d-ac65-3cff467e534a tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Action: 'create', calling method: .version_select at 0x7fbb9654be50>, body: {"keypair": {"name": "tempest-keypair-673050155"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:16:07.541922 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-562d69ae-108b-447d-ac65-3cff467e534a tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Getting quotas for project c63d4ed9df1548b88731e003044c32da. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:16:07.547838 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-562d69ae-108b-447d-ac65-3cff467e534a tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Getting quotas for user 6230c967390f4c5f8d3b9580bac4b340 and project c63d4ed9df1548b88731e003044c32da. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:16:07.588409 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-311f5155-04ae-47f4-baec-0c0a0e3173c0 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:16:07.588906 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-311f5155-04ae-47f4-baec-0c0a0e3173c0 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:16:07.589358 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-311f5155-04ae-47f4-baec-0c0a0e3173c0 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:16:07.589959 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-311f5155-04ae-47f4-baec-0c0a0e3173c0 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:16:07.590374 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-311f5155-04ae-47f4-baec-0c0a0e3173c0 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:16:07.600371 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-311f5155-04ae-47f4-baec-0c0a0e3173c0 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:07.600880 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-311f5155-04ae-47f4-baec-0c0a0e3173c0 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:07.601881 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-311f5155-04ae-47f4-baec-0c0a0e3173c0 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:07.602326 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-311f5155-04ae-47f4-baec-0c0a0e3173c0 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:07.619694 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-311f5155-04ae-47f4-baec-0c0a0e3173c0 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Getting quotas for project ff01c614d0ea4275b713b7e872342151. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:16:07.625907 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-311f5155-04ae-47f4-baec-0c0a0e3173c0 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Getting quotas for user 929bcf59f4fb4eb7a8b76809cce91e6e and project ff01c614d0ea4275b713b7e872342151. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:16:07.638689 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-311f5155-04ae-47f4-baec-0c0a0e3173c0 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:16:07.641027 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-311f5155-04ae-47f4-baec-0c0a0e3173c0 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: dc95a4d6-f40d-4087-91ae-3038926df942] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:16:07.681716 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-562d69ae-108b-447d-ac65-3cff467e534a tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Getting quotas for project c63d4ed9df1548b88731e003044c32da. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:16:07.687180 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-562d69ae-108b-447d-ac65-3cff467e534a tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Getting quotas for user 6230c967390f4c5f8d3b9580bac4b340 and project c63d4ed9df1548b88731e003044c32da. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:16:07.703011 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-562d69ae-108b-447d-ac65-3cff467e534a tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.181576 Apr 16 21:16:07.708649 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1374/2633] 10.222.0.20 () {60 vars in 1157 bytes} [Sat Apr 16 21:16:07 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:07.708649 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c288307f-caa6-40a6-b0bd-00a5f69d10a7 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:07.709081 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c288307f-caa6-40a6-b0bd-00a5f69d10a7 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:07.715824 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c288307f-caa6-40a6-b0bd-00a5f69d10a7 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:07.716358 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c288307f-caa6-40a6-b0bd-00a5f69d10a7 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:07.717152 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c288307f-caa6-40a6-b0bd-00a5f69d10a7 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:07.717727 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c288307f-caa6-40a6-b0bd-00a5f69d10a7 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:07.788799 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-c288307f-caa6-40a6-b0bd-00a5f69d10a7 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lazy-loading 'services' on Instance uuid 9ce03e87-6962-45d5-910e-f87b61fef356 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:16:07.794340 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-311f5155-04ae-47f4-baec-0c0a0e3173c0 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.848056 Apr 16 21:16:07.794998 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1260/2634] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:16:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 849 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:16:07.804327 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-01d3b95e-d25a-4428-9db6-c9a6475a09a8 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:07.804948 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-01d3b95e-d25a-4428-9db6-c9a6475a09a8 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: ff70294f-a73f-4dcf-aaf4-bd979106f1b8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:07.809189 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c288307f-caa6-40a6-b0bd-00a5f69d10a7 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1927 microversion: 2.75 time: 0.104555 Apr 16 21:16:07.810143 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1375/2635] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:16:07 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1927 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:16:07.812099 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-01d3b95e-d25a-4428-9db6-c9a6475a09a8 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:07.812657 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-01d3b95e-d25a-4428-9db6-c9a6475a09a8 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:07.816444 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-01d3b95e-d25a-4428-9db6-c9a6475a09a8 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:07.816444 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-01d3b95e-d25a-4428-9db6-c9a6475a09a8 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:07.816636 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a519124d-7436-4d1f-a9b5-3d232249dd70 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:07.816636 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a519124d-7436-4d1f-a9b5-3d232249dd70 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: dc95a4d6-f40d-4087-91ae-3038926df942] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:07.897653 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a519124d-7436-4d1f-a9b5-3d232249dd70 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:07.908808 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a519124d-7436-4d1f-a9b5-3d232249dd70 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942" status: 200 len: 1221 microversion: 2.1 time: 0.097693 Apr 16 21:16:07.909410 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1376/2636] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:07 2022] GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942 => generated 1221 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:07.923981 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-238c20b3-a573-448b-a484-8e62fc51deb3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:07.924655 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-238c20b3-a573-448b-a484-8e62fc51deb3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:07.937980 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-238c20b3-a573-448b-a484-8e62fc51deb3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:07.938447 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-238c20b3-a573-448b-a484-8e62fc51deb3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:07.939249 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-238c20b3-a573-448b-a484-8e62fc51deb3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:07.939701 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-238c20b3-a573-448b-a484-8e62fc51deb3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:08.063687 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-01d3b95e-d25a-4428-9db6-c9a6475a09a8 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:08.084478 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-01d3b95e-d25a-4428-9db6-c9a6475a09a8 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8" status: 200 len: 1306 microversion: 2.1 time: 0.283483 Apr 16 21:16:08.092855 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1261/2637] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:07 2022] GET /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8 => generated 1306 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:08.100746 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-17480087-a594-4b8f-98b0-bb46edeb7636 req-7bf5f5f0-5b2d-41bc-85af-654c5eba1162 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff70294f-a73f-4dcf-aaf4-bd979106f1b8", "tag": "16b4583f-548f-4d1c-8ae5-e1254189e93a"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:16:08.119765 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-17480087-a594-4b8f-98b0-bb46edeb7636 req-7bf5f5f0-5b2d-41bc-85af-654c5eba1162 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:08.119765 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-17480087-a594-4b8f-98b0-bb46edeb7636 req-7bf5f5f0-5b2d-41bc-85af-654c5eba1162 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:08.137865 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-17480087-a594-4b8f-98b0-bb46edeb7636 req-7bf5f5f0-5b2d-41bc-85af-654c5eba1162 service nova] Creating event network-changed:16b4583f-548f-4d1c-8ae5-e1254189e93a for instance ff70294f-a73f-4dcf-aaf4-bd979106f1b8 on nch2-master-1 Apr 16 21:16:08.145956 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-17480087-a594-4b8f-98b0-bb46edeb7636 req-7bf5f5f0-5b2d-41bc-85af-654c5eba1162 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055793 Apr 16 21:16:08.150045 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1262/2638] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:16:08.154603 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-410f7ab0-64a5-42c3-8663-f09d63060f0a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1626549989", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:16:08.163778 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-238c20b3-a573-448b-a484-8e62fc51deb3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:08.179610 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-238c20b3-a573-448b-a484-8e62fc51deb3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1476 microversion: 2.1 time: 0.266842 Apr 16 21:16:08.194191 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1377/2639] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:07 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1476 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:08.219588 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-410f7ab0-64a5-42c3-8663-f09d63060f0a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] validate_networks() for [('006efeff-f11c-4209-8816-f1fa1acf7fed', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:16:08.365447 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b1c25463-9476-4f02-8787-3b2e56e1e71e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:08.365839 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b1c25463-9476-4f02-8787-3b2e56e1e71e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 999c16db-7916-4753-ae16-9ed72c8e6922] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:08.372709 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b1c25463-9476-4f02-8787-3b2e56e1e71e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:08.373146 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b1c25463-9476-4f02-8787-3b2e56e1e71e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:08.373939 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b1c25463-9476-4f02-8787-3b2e56e1e71e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:08.374382 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b1c25463-9476-4f02-8787-3b2e56e1e71e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:08.550077 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b1c25463-9476-4f02-8787-3b2e56e1e71e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:08.559997 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b1c25463-9476-4f02-8787-3b2e56e1e71e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922" status: 200 len: 1511 microversion: 2.1 time: 0.198401 Apr 16 21:16:08.561230 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1378/2640] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:08 2022] GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922 => generated 1511 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:08.739282 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-410f7ab0-64a5-42c3-8663-f09d63060f0a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:16:08.740534 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-410f7ab0-64a5-42c3-8663-f09d63060f0a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:16:08.741006 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-410f7ab0-64a5-42c3-8663-f09d63060f0a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:16:08.741455 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-410f7ab0-64a5-42c3-8663-f09d63060f0a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:16:08.741893 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-410f7ab0-64a5-42c3-8663-f09d63060f0a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:16:08.751396 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-410f7ab0-64a5-42c3-8663-f09d63060f0a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:08.752089 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-410f7ab0-64a5-42c3-8663-f09d63060f0a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:08.753111 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-410f7ab0-64a5-42c3-8663-f09d63060f0a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:08.753720 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-410f7ab0-64a5-42c3-8663-f09d63060f0a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:08.777954 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-410f7ab0-64a5-42c3-8663-f09d63060f0a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Getting quotas for project ff01c614d0ea4275b713b7e872342151. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:16:08.783951 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-410f7ab0-64a5-42c3-8663-f09d63060f0a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Getting quotas for user 929bcf59f4fb4eb7a8b76809cce91e6e and project ff01c614d0ea4275b713b7e872342151. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:16:08.798364 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-410f7ab0-64a5-42c3-8663-f09d63060f0a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:16:08.800922 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-410f7ab0-64a5-42c3-8663-f09d63060f0a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:16:08.833566 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-825bb24a-2678-4a91-9ee7-ff8edd4bb7b7 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:08.834208 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-825bb24a-2678-4a91-9ee7-ff8edd4bb7b7 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:08.843647 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-825bb24a-2678-4a91-9ee7-ff8edd4bb7b7 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:08.844101 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-825bb24a-2678-4a91-9ee7-ff8edd4bb7b7 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:08.844942 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-825bb24a-2678-4a91-9ee7-ff8edd4bb7b7 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:08.845387 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-825bb24a-2678-4a91-9ee7-ff8edd4bb7b7 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:08.932569 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-825bb24a-2678-4a91-9ee7-ff8edd4bb7b7 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lazy-loading 'services' on Instance uuid 9ce03e87-6962-45d5-910e-f87b61fef356 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:16:08.950989 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-825bb24a-2678-4a91-9ee7-ff8edd4bb7b7 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1927 microversion: 2.75 time: 0.125919 Apr 16 21:16:08.952063 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1379/2641] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:16:08 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1927 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:16:08.979553 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-410f7ab0-64a5-42c3-8663-f09d63060f0a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.831405 Apr 16 21:16:08.980232 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1263/2642] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:16:08 2022] POST /compute/v2.1/servers => generated 383 bytes in 833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:16:08.990162 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e16f0024-3b9d-4af2-b793-65dd31556b29 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:08.990711 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e16f0024-3b9d-4af2-b793-65dd31556b29 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:09.057724 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e16f0024-3b9d-4af2-b793-65dd31556b29 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:09.065849 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e16f0024-3b9d-4af2-b793-65dd31556b29 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140" status: 200 len: 1222 microversion: 2.1 time: 0.079513 Apr 16 21:16:09.067125 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1380/2643] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:08 2022] GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140 => generated 1222 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:09.107205 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1e790e9e-d1c1-4c8d-aa16-5f6f7ad9c4a0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:09.107910 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1e790e9e-d1c1-4c8d-aa16-5f6f7ad9c4a0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: ff70294f-a73f-4dcf-aaf4-bd979106f1b8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:09.115444 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1e790e9e-d1c1-4c8d-aa16-5f6f7ad9c4a0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:09.115838 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1e790e9e-d1c1-4c8d-aa16-5f6f7ad9c4a0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:09.121085 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1e790e9e-d1c1-4c8d-aa16-5f6f7ad9c4a0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:09.121085 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1e790e9e-d1c1-4c8d-aa16-5f6f7ad9c4a0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:09.224859 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-94ca2d44-5cd6-4a73-b53d-7ad55e51fa08 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:09.224859 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-94ca2d44-5cd6-4a73-b53d-7ad55e51fa08 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:09.249788 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-94ca2d44-5cd6-4a73-b53d-7ad55e51fa08 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:09.250576 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-94ca2d44-5cd6-4a73-b53d-7ad55e51fa08 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:09.251611 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-94ca2d44-5cd6-4a73-b53d-7ad55e51fa08 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:09.252062 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-94ca2d44-5cd6-4a73-b53d-7ad55e51fa08 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:09.367358 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1e790e9e-d1c1-4c8d-aa16-5f6f7ad9c4a0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:09.378146 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1e790e9e-d1c1-4c8d-aa16-5f6f7ad9c4a0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8" status: 200 len: 1306 microversion: 2.1 time: 0.274839 Apr 16 21:16:09.390030 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1264/2644] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:09 2022] GET /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8 => generated 1306 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:09.501374 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-94ca2d44-5cd6-4a73-b53d-7ad55e51fa08 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:09.510307 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-94ca2d44-5cd6-4a73-b53d-7ad55e51fa08 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1476 microversion: 2.1 time: 0.300610 Apr 16 21:16:09.511157 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1381/2645] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:09 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1476 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:09.578211 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-93054cd8-47bd-4421-81dc-4a9c66bd39cb tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:09.579441 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-93054cd8-47bd-4421-81dc-4a9c66bd39cb tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 999c16db-7916-4753-ae16-9ed72c8e6922] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:09.587834 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-93054cd8-47bd-4421-81dc-4a9c66bd39cb tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:09.588586 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-93054cd8-47bd-4421-81dc-4a9c66bd39cb tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:09.590631 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-93054cd8-47bd-4421-81dc-4a9c66bd39cb tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:09.590631 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-93054cd8-47bd-4421-81dc-4a9c66bd39cb tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:09.756138 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-93054cd8-47bd-4421-81dc-4a9c66bd39cb tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:09.765193 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-93054cd8-47bd-4421-81dc-4a9c66bd39cb tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922" status: 200 len: 1511 microversion: 2.1 time: 0.191449 Apr 16 21:16:09.765791 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1265/2646] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:09 2022] GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922 => generated 1511 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:09.971637 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f6692e15-9428-4a18-80ed-6f58e262b4f1 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:09.972813 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f6692e15-9428-4a18-80ed-6f58e262b4f1 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:09.988701 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6692e15-9428-4a18-80ed-6f58e262b4f1 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:09.989529 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6692e15-9428-4a18-80ed-6f58e262b4f1 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:09.990568 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6692e15-9428-4a18-80ed-6f58e262b4f1 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:09.991247 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6692e15-9428-4a18-80ed-6f58e262b4f1 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:10.090250 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a01bf7e9-7a79-47ad-83d2-a7fda01f7482 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:10.090250 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a01bf7e9-7a79-47ad-83d2-a7fda01f7482 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:10.095650 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a01bf7e9-7a79-47ad-83d2-a7fda01f7482 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:10.095895 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-f6692e15-9428-4a18-80ed-6f58e262b4f1 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lazy-loading 'services' on Instance uuid 9ce03e87-6962-45d5-910e-f87b61fef356 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:16:10.096543 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a01bf7e9-7a79-47ad-83d2-a7fda01f7482 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:10.097528 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a01bf7e9-7a79-47ad-83d2-a7fda01f7482 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:10.098146 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a01bf7e9-7a79-47ad-83d2-a7fda01f7482 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:10.119630 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f6692e15-9428-4a18-80ed-6f58e262b4f1 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1927 microversion: 2.75 time: 0.151684 Apr 16 21:16:10.121094 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1382/2647] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:16:09 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1927 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:16:10.173120 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a01bf7e9-7a79-47ad-83d2-a7fda01f7482 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:10.182003 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a01bf7e9-7a79-47ad-83d2-a7fda01f7482 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140" status: 200 len: 1226 microversion: 2.1 time: 0.102921 Apr 16 21:16:10.183834 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1266/2648] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:10 2022] GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140 => generated 1226 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:10.395327 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d177efc0-1e2c-4b39-a04e-e638309cc2cc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:10.396759 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d177efc0-1e2c-4b39-a04e-e638309cc2cc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: ff70294f-a73f-4dcf-aaf4-bd979106f1b8] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:10.407700 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d177efc0-1e2c-4b39-a04e-e638309cc2cc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:10.407700 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d177efc0-1e2c-4b39-a04e-e638309cc2cc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:10.407700 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d177efc0-1e2c-4b39-a04e-e638309cc2cc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:10.407700 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d177efc0-1e2c-4b39-a04e-e638309cc2cc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:10.527416 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b7023bdd-cad7-41cc-899d-301b772db4d2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:10.528069 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b7023bdd-cad7-41cc-899d-301b772db4d2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:10.534888 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b7023bdd-cad7-41cc-899d-301b772db4d2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:10.535349 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b7023bdd-cad7-41cc-899d-301b772db4d2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:10.536264 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b7023bdd-cad7-41cc-899d-301b772db4d2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:10.536714 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b7023bdd-cad7-41cc-899d-301b772db4d2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:10.737427 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d177efc0-1e2c-4b39-a04e-e638309cc2cc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:10.781878 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d177efc0-1e2c-4b39-a04e-e638309cc2cc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8" status: 200 len: 1306 microversion: 2.1 time: 0.389711 Apr 16 21:16:10.783319 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1383/2649] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:10 2022] GET /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8 => generated 1306 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:10.793921 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b7023bdd-cad7-41cc-899d-301b772db4d2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:10.797791 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d09cf6fa-cfc0-4bcc-bddc-cdecff62ca3e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:10.799089 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d09cf6fa-cfc0-4bcc-bddc-cdecff62ca3e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 999c16db-7916-4753-ae16-9ed72c8e6922] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:10.804054 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b7023bdd-cad7-41cc-899d-301b772db4d2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1476 microversion: 2.1 time: 0.280954 Apr 16 21:16:10.808074 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1267/2650] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:10 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1476 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:10.821661 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d09cf6fa-cfc0-4bcc-bddc-cdecff62ca3e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:10.822478 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d09cf6fa-cfc0-4bcc-bddc-cdecff62ca3e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:10.823945 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d09cf6fa-cfc0-4bcc-bddc-cdecff62ca3e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:10.825122 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d09cf6fa-cfc0-4bcc-bddc-cdecff62ca3e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:11.009688 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d09cf6fa-cfc0-4bcc-bddc-cdecff62ca3e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:11.017512 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d09cf6fa-cfc0-4bcc-bddc-cdecff62ca3e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922" status: 200 len: 1511 microversion: 2.1 time: 0.232734 Apr 16 21:16:11.021446 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1384/2651] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:10 2022] GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922 => generated 1511 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:11.060965 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9dc52537-6535-49af-b0ba-21263e0d371f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-278905184", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:16:11.122816 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-9dc52537-6535-49af-b0ba-21263e0d371f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] validate_networks() for [('ce54676e-63e2-4bec-8d37-78514d0685e3', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:16:11.139573 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c415dadf-932e-4417-8484-00b5f457b6c6 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:11.140307 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c415dadf-932e-4417-8484-00b5f457b6c6 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:11.147296 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c415dadf-932e-4417-8484-00b5f457b6c6 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:11.147856 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c415dadf-932e-4417-8484-00b5f457b6c6 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:11.148739 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c415dadf-932e-4417-8484-00b5f457b6c6 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:11.149306 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c415dadf-932e-4417-8484-00b5f457b6c6 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:11.225574 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-c415dadf-932e-4417-8484-00b5f457b6c6 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lazy-loading 'services' on Instance uuid 9ce03e87-6962-45d5-910e-f87b61fef356 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:16:11.245649 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c415dadf-932e-4417-8484-00b5f457b6c6 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1927 microversion: 2.75 time: 0.109850 Apr 16 21:16:11.246647 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1385/2652] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:16:11 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1927 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:16:11.251583 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7fc769ae-04c9-49e3-a1cf-de97664885b5 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:11.252546 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7fc769ae-04c9-49e3-a1cf-de97664885b5 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:11.259494 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7fc769ae-04c9-49e3-a1cf-de97664885b5 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:11.260353 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7fc769ae-04c9-49e3-a1cf-de97664885b5 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:11.261258 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7fc769ae-04c9-49e3-a1cf-de97664885b5 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:11.261880 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7fc769ae-04c9-49e3-a1cf-de97664885b5 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:11.327014 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7fc769ae-04c9-49e3-a1cf-de97664885b5 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:11.335591 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7fc769ae-04c9-49e3-a1cf-de97664885b5 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140" status: 200 len: 1274 microversion: 2.1 time: 0.087662 Apr 16 21:16:11.346195 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1386/2653] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:11 2022] GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140 => generated 1274 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:11.800201 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7acc78aa-2741-4890-a397-c6f9cf9a140a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:11.800803 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7acc78aa-2741-4890-a397-c6f9cf9a140a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: ff70294f-a73f-4dcf-aaf4-bd979106f1b8] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:11.807719 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7acc78aa-2741-4890-a397-c6f9cf9a140a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:11.808211 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7acc78aa-2741-4890-a397-c6f9cf9a140a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:11.809003 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7acc78aa-2741-4890-a397-c6f9cf9a140a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:11.809451 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7acc78aa-2741-4890-a397-c6f9cf9a140a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:11.958784 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7acc78aa-2741-4890-a397-c6f9cf9a140a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:11.967589 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7acc78aa-2741-4890-a397-c6f9cf9a140a tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8" status: 200 len: 1306 microversion: 2.1 time: 0.171332 Apr 16 21:16:11.968549 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1387/2654] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:11 2022] GET /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8 => generated 1306 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:11.978392 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f596773b-2be5-40de-b51b-bf3639f827ec tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:11.978392 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f596773b-2be5-40de-b51b-bf3639f827ec tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:11.982135 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f596773b-2be5-40de-b51b-bf3639f827ec tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:11.982713 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f596773b-2be5-40de-b51b-bf3639f827ec tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:11.983628 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f596773b-2be5-40de-b51b-bf3639f827ec tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:11.984238 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f596773b-2be5-40de-b51b-bf3639f827ec tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:12.129246 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f596773b-2be5-40de-b51b-bf3639f827ec tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:12.137663 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f596773b-2be5-40de-b51b-bf3639f827ec tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1476 microversion: 2.1 time: 0.167420 Apr 16 21:16:12.138366 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1388/2655] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:11 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1476 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:12.145093 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e7de67e8-1348-4437-9dea-8d28a83bf247 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:12.145768 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e7de67e8-1348-4437-9dea-8d28a83bf247 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 999c16db-7916-4753-ae16-9ed72c8e6922] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:12.152455 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e7de67e8-1348-4437-9dea-8d28a83bf247 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:12.152916 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e7de67e8-1348-4437-9dea-8d28a83bf247 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:12.153715 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e7de67e8-1348-4437-9dea-8d28a83bf247 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:12.154159 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e7de67e8-1348-4437-9dea-8d28a83bf247 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:12.285365 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-9dc52537-6535-49af-b0ba-21263e0d371f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:16:12.285966 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-9dc52537-6535-49af-b0ba-21263e0d371f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:16:12.286252 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-9dc52537-6535-49af-b0ba-21263e0d371f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:16:12.286664 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-9dc52537-6535-49af-b0ba-21263e0d371f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:16:12.287076 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-9dc52537-6535-49af-b0ba-21263e0d371f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:16:12.292905 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e7de67e8-1348-4437-9dea-8d28a83bf247 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:12.297191 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9dc52537-6535-49af-b0ba-21263e0d371f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:12.297568 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9dc52537-6535-49af-b0ba-21263e0d371f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:12.298380 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9dc52537-6535-49af-b0ba-21263e0d371f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:12.298814 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9dc52537-6535-49af-b0ba-21263e0d371f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:12.301372 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e7de67e8-1348-4437-9dea-8d28a83bf247 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922" status: 200 len: 1511 microversion: 2.1 time: 0.161592 Apr 16 21:16:12.302072 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1389/2656] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:12 2022] GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922 => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:12.307561 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0b87bb09-b41d-4d1e-80f6-3396ee5e4e2d tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:12.308308 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0b87bb09-b41d-4d1e-80f6-3396ee5e4e2d tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:12.314429 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0b87bb09-b41d-4d1e-80f6-3396ee5e4e2d tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:12.314976 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0b87bb09-b41d-4d1e-80f6-3396ee5e4e2d tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:12.315832 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0b87bb09-b41d-4d1e-80f6-3396ee5e4e2d tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:12.316476 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0b87bb09-b41d-4d1e-80f6-3396ee5e4e2d tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:12.327250 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-9dc52537-6535-49af-b0ba-21263e0d371f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Getting quotas for project c63d4ed9df1548b88731e003044c32da. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:16:12.332461 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-9dc52537-6535-49af-b0ba-21263e0d371f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Getting quotas for user 6230c967390f4c5f8d3b9580bac4b340 and project c63d4ed9df1548b88731e003044c32da. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:16:12.344691 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9dc52537-6535-49af-b0ba-21263e0d371f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:16:12.346812 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9dc52537-6535-49af-b0ba-21263e0d371f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 8cb60874-b0f3-4055-a4d1-531f4a147992] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:16:12.396677 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-0b87bb09-b41d-4d1e-80f6-3396ee5e4e2d tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lazy-loading 'services' on Instance uuid 9ce03e87-6962-45d5-910e-f87b61fef356 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:16:12.413523 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0b87bb09-b41d-4d1e-80f6-3396ee5e4e2d tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1927 microversion: 2.75 time: 0.109919 Apr 16 21:16:12.414600 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1390/2657] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:16:12 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1927 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:16:12.419808 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8c36f9cd-3b85-4307-a49e-ae4680f1ed47 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:12.420454 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8c36f9cd-3b85-4307-a49e-ae4680f1ed47 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:12.426523 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8c36f9cd-3b85-4307-a49e-ae4680f1ed47 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:12.426992 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8c36f9cd-3b85-4307-a49e-ae4680f1ed47 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:12.427835 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8c36f9cd-3b85-4307-a49e-ae4680f1ed47 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:12.428324 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8c36f9cd-3b85-4307-a49e-ae4680f1ed47 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:12.489907 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8c36f9cd-3b85-4307-a49e-ae4680f1ed47 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:12.500737 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8c36f9cd-3b85-4307-a49e-ae4680f1ed47 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140" status: 200 len: 1280 microversion: 2.1 time: 0.084365 Apr 16 21:16:12.511512 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1391/2658] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:12 2022] GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140 => generated 1280 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:12.549112 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9dc52537-6535-49af-b0ba-21263e0d371f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.494365 Apr 16 21:16:12.550361 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1268/2659] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:16:11 2022] POST /compute/v2.1/servers => generated 383 bytes in 1496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:16:12.563330 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-971d7503-1773-4026-aeb7-b377b9f71eda tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:12.564349 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-971d7503-1773-4026-aeb7-b377b9f71eda tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 8cb60874-b0f3-4055-a4d1-531f4a147992] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:12.633389 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-971d7503-1773-4026-aeb7-b377b9f71eda tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:12.642578 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-971d7503-1773-4026-aeb7-b377b9f71eda tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992" status: 200 len: 1224 microversion: 2.1 time: 0.085102 Apr 16 21:16:12.643762 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1392/2660] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:12 2022] GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992 => generated 1224 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:12.986036 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0582988a-f0c2-45ac-a4ce-3b8997a80d9d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:12.986555 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0582988a-f0c2-45ac-a4ce-3b8997a80d9d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: ff70294f-a73f-4dcf-aaf4-bd979106f1b8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:12.992566 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0582988a-f0c2-45ac-a4ce-3b8997a80d9d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:12.993693 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0582988a-f0c2-45ac-a4ce-3b8997a80d9d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:12.994476 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0582988a-f0c2-45ac-a4ce-3b8997a80d9d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:12.994922 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0582988a-f0c2-45ac-a4ce-3b8997a80d9d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:13.154942 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-07b2a69d-cd0d-4dff-8876-397b11aa0428 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:13.156462 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-07b2a69d-cd0d-4dff-8876-397b11aa0428 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:13.164486 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-07b2a69d-cd0d-4dff-8876-397b11aa0428 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:13.165471 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-07b2a69d-cd0d-4dff-8876-397b11aa0428 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:13.166257 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-07b2a69d-cd0d-4dff-8876-397b11aa0428 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:13.166702 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-07b2a69d-cd0d-4dff-8876-397b11aa0428 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:13.327407 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-07b2a69d-cd0d-4dff-8876-397b11aa0428 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:13.337981 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-07b2a69d-cd0d-4dff-8876-397b11aa0428 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1476 microversion: 2.1 time: 0.186770 Apr 16 21:16:13.340205 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1393/2661] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:13 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1476 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:13.344464 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0582988a-f0c2-45ac-a4ce-3b8997a80d9d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:13.348699 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-47fe0d7b-37ce-474d-bbfe-e69e0abd9fce tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:13.353758 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-47fe0d7b-37ce-474d-bbfe-e69e0abd9fce tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 999c16db-7916-4753-ae16-9ed72c8e6922] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:13.364485 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0582988a-f0c2-45ac-a4ce-3b8997a80d9d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8" status: 200 len: 1306 microversion: 2.1 time: 0.382138 Apr 16 21:16:13.366916 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-47fe0d7b-37ce-474d-bbfe-e69e0abd9fce tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:13.367692 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1269/2662] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:12 2022] GET /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8 => generated 1306 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:13.372988 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-47fe0d7b-37ce-474d-bbfe-e69e0abd9fce tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:13.376618 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-47fe0d7b-37ce-474d-bbfe-e69e0abd9fce tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:13.377711 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-47fe0d7b-37ce-474d-bbfe-e69e0abd9fce tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:13.434751 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ca7bb8a8-c856-46b4-b109-0f1f8285eb9f tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:13.436815 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ca7bb8a8-c856-46b4-b109-0f1f8285eb9f tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:13.445741 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ca7bb8a8-c856-46b4-b109-0f1f8285eb9f tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:13.446591 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ca7bb8a8-c856-46b4-b109-0f1f8285eb9f tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:13.447618 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ca7bb8a8-c856-46b4-b109-0f1f8285eb9f tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:13.448702 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ca7bb8a8-c856-46b4-b109-0f1f8285eb9f tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:13.574823 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-47fe0d7b-37ce-474d-bbfe-e69e0abd9fce tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:13.582970 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-47fe0d7b-37ce-474d-bbfe-e69e0abd9fce tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922" status: 200 len: 1511 microversion: 2.1 time: 0.240455 Apr 16 21:16:13.583695 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1394/2663] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:13 2022] GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922 => generated 1511 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:13.589263 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-9cefa261-3635-4da2-b43e-5ec419438247 req-9a983da9-ecb1-446b-82bd-1b6357ae74b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff70294f-a73f-4dcf-aaf4-bd979106f1b8", "name": "network-vif-plugged", "status": "completed", "tag": "16b4583f-548f-4d1c-8ae5-e1254189e93a"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:16:13.597611 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-9cefa261-3635-4da2-b43e-5ec419438247 req-9a983da9-ecb1-446b-82bd-1b6357ae74b6 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:13.598070 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-9cefa261-3635-4da2-b43e-5ec419438247 req-9a983da9-ecb1-446b-82bd-1b6357ae74b6 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:13.608621 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-ca7bb8a8-c856-46b4-b109-0f1f8285eb9f tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lazy-loading 'services' on Instance uuid 9ce03e87-6962-45d5-910e-f87b61fef356 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:16:13.611401 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-9cefa261-3635-4da2-b43e-5ec419438247 req-9a983da9-ecb1-446b-82bd-1b6357ae74b6 service nova] Creating event network-vif-plugged:16b4583f-548f-4d1c-8ae5-e1254189e93a for instance ff70294f-a73f-4dcf-aaf4-bd979106f1b8 on nch2-master-1 Apr 16 21:16:13.616742 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-9cefa261-3635-4da2-b43e-5ec419438247 req-9a983da9-ecb1-446b-82bd-1b6357ae74b6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031584 Apr 16 21:16:13.617469 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1395/2664] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:16:13.623082 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5ab40d7d-13e5-4125-9f67-af6e736d5927 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:13.623986 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5ab40d7d-13e5-4125-9f67-af6e736d5927 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:13.637066 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ca7bb8a8-c856-46b4-b109-0f1f8285eb9f tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1927 microversion: 2.75 time: 0.206576 Apr 16 21:16:13.638090 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1270/2665] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:16:13 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1927 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:16:13.644083 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5ab40d7d-13e5-4125-9f67-af6e736d5927 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:13.644770 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5ab40d7d-13e5-4125-9f67-af6e736d5927 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:13.645746 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5ab40d7d-13e5-4125-9f67-af6e736d5927 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:13.646502 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5ab40d7d-13e5-4125-9f67-af6e736d5927 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:13.680916 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2cb19211-a726-4387-b508-0eab910256df tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:13.686815 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2cb19211-a726-4387-b508-0eab910256df tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 8cb60874-b0f3-4055-a4d1-531f4a147992] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:13.696673 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2cb19211-a726-4387-b508-0eab910256df tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:13.700392 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2cb19211-a726-4387-b508-0eab910256df tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:13.701203 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2cb19211-a726-4387-b508-0eab910256df tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:13.701650 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2cb19211-a726-4387-b508-0eab910256df tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:13.895320 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2cb19211-a726-4387-b508-0eab910256df tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:13.908705 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2cb19211-a726-4387-b508-0eab910256df tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992" status: 200 len: 1228 microversion: 2.1 time: 0.243535 Apr 16 21:16:13.909676 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1271/2666] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:13 2022] GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992 => generated 1228 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:13.916853 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5ab40d7d-13e5-4125-9f67-af6e736d5927 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:13.924841 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5ab40d7d-13e5-4125-9f67-af6e736d5927 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140" status: 200 len: 1322 microversion: 2.1 time: 0.306069 Apr 16 21:16:13.925417 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1396/2667] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:13 2022] GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140 => generated 1322 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:14.252587 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-11148924-99ad-40de-abb1-3af77f743c75 req-7967d4f1-9bfe-4e66-91b7-5e51b541d0ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc95a4d6-f40d-4087-91ae-3038926df942", "tag": "ed5b9e7e-736b-4251-8d00-ad2beb4e1443"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:16:14.264271 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-11148924-99ad-40de-abb1-3af77f743c75 req-7967d4f1-9bfe-4e66-91b7-5e51b541d0ac service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:14.269816 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-11148924-99ad-40de-abb1-3af77f743c75 req-7967d4f1-9bfe-4e66-91b7-5e51b541d0ac service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:14.282597 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-11148924-99ad-40de-abb1-3af77f743c75 req-7967d4f1-9bfe-4e66-91b7-5e51b541d0ac service nova] Creating event network-changed:ed5b9e7e-736b-4251-8d00-ad2beb4e1443 for instance dc95a4d6-f40d-4087-91ae-3038926df942 on nch1-master-1 Apr 16 21:16:14.291279 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-11148924-99ad-40de-abb1-3af77f743c75 req-7967d4f1-9bfe-4e66-91b7-5e51b541d0ac service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042662 Apr 16 21:16:14.292469 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1272/2668] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:16:14.357030 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-01687332-f0e0-493c-a51c-11223c8f230c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:14.358515 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-01687332-f0e0-493c-a51c-11223c8f230c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:14.370977 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-01687332-f0e0-493c-a51c-11223c8f230c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:14.371568 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-01687332-f0e0-493c-a51c-11223c8f230c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:14.373332 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-01687332-f0e0-493c-a51c-11223c8f230c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:14.373855 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-01687332-f0e0-493c-a51c-11223c8f230c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:14.395907 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0bfa74b7-e589-437b-8300-d884f45dd107 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:14.397333 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0bfa74b7-e589-437b-8300-d884f45dd107 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: ff70294f-a73f-4dcf-aaf4-bd979106f1b8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:14.405062 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0bfa74b7-e589-437b-8300-d884f45dd107 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:14.406039 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0bfa74b7-e589-437b-8300-d884f45dd107 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:14.412304 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0bfa74b7-e589-437b-8300-d884f45dd107 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:14.413274 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0bfa74b7-e589-437b-8300-d884f45dd107 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:14.531180 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-01687332-f0e0-493c-a51c-11223c8f230c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:14.543186 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-01687332-f0e0-493c-a51c-11223c8f230c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1476 microversion: 2.1 time: 0.190468 Apr 16 21:16:14.544052 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1397/2669] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:14 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1476 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:14.603109 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-64777ae8-872a-4f24-8554-719173de3c1c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:14.604406 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-64777ae8-872a-4f24-8554-719173de3c1c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 999c16db-7916-4753-ae16-9ed72c8e6922] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:14.611455 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-64777ae8-872a-4f24-8554-719173de3c1c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:14.612074 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-64777ae8-872a-4f24-8554-719173de3c1c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:14.614237 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-64777ae8-872a-4f24-8554-719173de3c1c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:14.614720 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-64777ae8-872a-4f24-8554-719173de3c1c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:14.728021 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0bfa74b7-e589-437b-8300-d884f45dd107 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:14.736058 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0bfa74b7-e589-437b-8300-d884f45dd107 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8" status: 200 len: 1306 microversion: 2.1 time: 0.356814 Apr 16 21:16:14.736874 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1273/2670] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:14 2022] GET /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8 => generated 1306 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:14.741541 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9a94fed1-8743-4a05-b882-9206c747029a tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:14.742406 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9a94fed1-8743-4a05-b882-9206c747029a tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:14.749100 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9a94fed1-8743-4a05-b882-9206c747029a tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:14.749554 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9a94fed1-8743-4a05-b882-9206c747029a tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:14.751464 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9a94fed1-8743-4a05-b882-9206c747029a tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:14.751464 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9a94fed1-8743-4a05-b882-9206c747029a tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:14.779583 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-64777ae8-872a-4f24-8554-719173de3c1c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:14.787747 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-64777ae8-872a-4f24-8554-719173de3c1c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922" status: 200 len: 1511 microversion: 2.1 time: 0.189792 Apr 16 21:16:14.788407 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1398/2671] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:14 2022] GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922 => generated 1511 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:14.837833 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-9a94fed1-8743-4a05-b882-9206c747029a tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lazy-loading 'services' on Instance uuid 9ce03e87-6962-45d5-910e-f87b61fef356 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:16:14.856836 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9a94fed1-8743-4a05-b882-9206c747029a tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1927 microversion: 2.75 time: 0.118572 Apr 16 21:16:14.857340 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1274/2672] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:16:14 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1927 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:16:14.926169 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d0dd86c4-cbfb-4630-b3a1-08f5268f9e7e tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:14.936010 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d0dd86c4-cbfb-4630-b3a1-08f5268f9e7e tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 8cb60874-b0f3-4055-a4d1-531f4a147992] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:14.936010 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d0dd86c4-cbfb-4630-b3a1-08f5268f9e7e tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:14.936010 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d0dd86c4-cbfb-4630-b3a1-08f5268f9e7e tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:14.936010 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d0dd86c4-cbfb-4630-b3a1-08f5268f9e7e tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:14.936010 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d0dd86c4-cbfb-4630-b3a1-08f5268f9e7e tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:14.944524 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6b4fb6a3-3c25-4f28-82cd-cb942fb29fbc tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:14.945147 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6b4fb6a3-3c25-4f28-82cd-cb942fb29fbc tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:14.951745 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6b4fb6a3-3c25-4f28-82cd-cb942fb29fbc tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:14.952267 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6b4fb6a3-3c25-4f28-82cd-cb942fb29fbc tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:14.953162 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6b4fb6a3-3c25-4f28-82cd-cb942fb29fbc tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:14.953652 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6b4fb6a3-3c25-4f28-82cd-cb942fb29fbc tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:15.022013 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d0dd86c4-cbfb-4630-b3a1-08f5268f9e7e tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:15.030114 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d0dd86c4-cbfb-4630-b3a1-08f5268f9e7e tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992" status: 200 len: 1220 microversion: 2.1 time: 0.107885 Apr 16 21:16:15.030954 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1399/2673] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:14 2022] GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992 => generated 1220 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:15.561288 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-285a360e-e42e-4ff7-83a0-493fd89f32c5 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:15.562672 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-285a360e-e42e-4ff7-83a0-493fd89f32c5 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:15.569803 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-285a360e-e42e-4ff7-83a0-493fd89f32c5 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:15.570193 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-285a360e-e42e-4ff7-83a0-493fd89f32c5 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:15.570986 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-285a360e-e42e-4ff7-83a0-493fd89f32c5 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:15.571426 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-285a360e-e42e-4ff7-83a0-493fd89f32c5 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:15.637970 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6b4fb6a3-3c25-4f28-82cd-cb942fb29fbc tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:15.646431 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6b4fb6a3-3c25-4f28-82cd-cb942fb29fbc tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140" status: 200 len: 1322 microversion: 2.1 time: 0.705680 Apr 16 21:16:15.656771 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1275/2674] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:14 2022] GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140 => generated 1322 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:15.718073 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-285a360e-e42e-4ff7-83a0-493fd89f32c5 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:15.725921 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-285a360e-e42e-4ff7-83a0-493fd89f32c5 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1476 microversion: 2.1 time: 0.168616 Apr 16 21:16:15.726497 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1400/2675] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:15 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1476 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:15.753805 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ea589476-5156-4614-bc5a-4614ba4a05bc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:15.754430 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ea589476-5156-4614-bc5a-4614ba4a05bc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: ff70294f-a73f-4dcf-aaf4-bd979106f1b8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:15.760651 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ea589476-5156-4614-bc5a-4614ba4a05bc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:15.761363 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ea589476-5156-4614-bc5a-4614ba4a05bc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:15.762152 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ea589476-5156-4614-bc5a-4614ba4a05bc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:15.762599 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ea589476-5156-4614-bc5a-4614ba4a05bc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:15.805397 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-44e8f776-38e1-4c87-944e-f16062ef9afa tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:15.806053 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-44e8f776-38e1-4c87-944e-f16062ef9afa tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 999c16db-7916-4753-ae16-9ed72c8e6922] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:15.811960 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-44e8f776-38e1-4c87-944e-f16062ef9afa tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:15.812551 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-44e8f776-38e1-4c87-944e-f16062ef9afa tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:15.813334 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-44e8f776-38e1-4c87-944e-f16062ef9afa tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:15.813782 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-44e8f776-38e1-4c87-944e-f16062ef9afa tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:15.984128 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ea589476-5156-4614-bc5a-4614ba4a05bc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:15.994500 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ea589476-5156-4614-bc5a-4614ba4a05bc tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8" status: 200 len: 1485 microversion: 2.1 time: 0.244516 Apr 16 21:16:15.997237 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1276/2676] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:15 2022] GET /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8 => generated 1485 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:16.002471 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8fa6e278-d39c-4ae1-9439-042b99406010 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:16.003624 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8fa6e278-d39c-4ae1-9439-042b99406010 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:16.016727 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8fa6e278-d39c-4ae1-9439-042b99406010 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:16.017301 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8fa6e278-d39c-4ae1-9439-042b99406010 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:16.019452 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8fa6e278-d39c-4ae1-9439-042b99406010 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:16.019452 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8fa6e278-d39c-4ae1-9439-042b99406010 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:16.052204 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-44e8f776-38e1-4c87-944e-f16062ef9afa tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:16.060058 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-44e8f776-38e1-4c87-944e-f16062ef9afa tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922" status: 200 len: 1511 microversion: 2.1 time: 0.258644 Apr 16 21:16:16.060776 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1401/2677] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:15 2022] GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922 => generated 1511 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:16.066090 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-37975dc8-86d4-42ff-9de7-79d658c947d0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:16:16.067153 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-37975dc8-86d4-42ff-9de7-79d658c947d0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: ff70294f-a73f-4dcf-aaf4-bd979106f1b8] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:16.075279 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-37975dc8-86d4-42ff-9de7-79d658c947d0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:16.080568 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-37975dc8-86d4-42ff-9de7-79d658c947d0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:16.080568 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-37975dc8-86d4-42ff-9de7-79d658c947d0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:16.080568 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-37975dc8-86d4-42ff-9de7-79d658c947d0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:16.101933 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-37975dc8-86d4-42ff-9de7-79d658c947d0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lazy-loading 'flavor' on Instance uuid ff70294f-a73f-4dcf-aaf4-bd979106f1b8 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:16:16.121752 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-8fa6e278-d39c-4ae1-9439-042b99406010 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lazy-loading 'services' on Instance uuid 9ce03e87-6962-45d5-910e-f87b61fef356 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:16:16.141419 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8fa6e278-d39c-4ae1-9439-042b99406010 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1927 microversion: 2.75 time: 0.142716 Apr 16 21:16:16.154408 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1277/2678] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:16:15 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1927 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:16:16.160112 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a04e4cd8-886c-42d2-b6ea-972b0a0d5a3c tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:16.160961 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a04e4cd8-886c-42d2-b6ea-972b0a0d5a3c tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 8cb60874-b0f3-4055-a4d1-531f4a147992] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:16.167381 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a04e4cd8-886c-42d2-b6ea-972b0a0d5a3c tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:16.168035 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a04e4cd8-886c-42d2-b6ea-972b0a0d5a3c tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:16.169089 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a04e4cd8-886c-42d2-b6ea-972b0a0d5a3c tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:16.169709 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a04e4cd8-886c-42d2-b6ea-972b0a0d5a3c tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:16.232114 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a04e4cd8-886c-42d2-b6ea-972b0a0d5a3c tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:16.239700 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a04e4cd8-886c-42d2-b6ea-972b0a0d5a3c tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992" status: 200 len: 1294 microversion: 2.1 time: 0.084002 Apr 16 21:16:16.240278 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1278/2679] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:16 2022] GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992 => generated 1294 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:16.336032 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-08a2d0fc-8d1e-44d7-ac28-39c6229e8f46 req-5efb213e-a48a-4a29-9cd9-c68b9f0e6205 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89f07150-d0ab-41c9-a9bf-692e9d9c5140", "tag": "973bd67e-86f2-41a6-afe9-0081fe7b246c"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:16:16.344560 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-08a2d0fc-8d1e-44d7-ac28-39c6229e8f46 req-5efb213e-a48a-4a29-9cd9-c68b9f0e6205 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:16.345089 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-08a2d0fc-8d1e-44d7-ac28-39c6229e8f46 req-5efb213e-a48a-4a29-9cd9-c68b9f0e6205 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:16.356198 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-08a2d0fc-8d1e-44d7-ac28-39c6229e8f46 req-5efb213e-a48a-4a29-9cd9-c68b9f0e6205 service nova] Creating event network-changed:973bd67e-86f2-41a6-afe9-0081fe7b246c for instance 89f07150-d0ab-41c9-a9bf-692e9d9c5140 on nch1-master-1 Apr 16 21:16:16.361100 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-08a2d0fc-8d1e-44d7-ac28-39c6229e8f46 req-5efb213e-a48a-4a29-9cd9-c68b9f0e6205 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028663 Apr 16 21:16:16.361799 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1279/2680] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:16:16.482851 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-37975dc8-86d4-42ff-9de7-79d658c947d0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "POST /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8/action" status: 202 len: 0 microversion: 2.1 time: 0.419996 Apr 16 21:16:16.483514 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1402/2681] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:16:16 2022] POST /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8/action => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:16:16.498920 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-50a8f031-f7d7-4cc8-9f60-c8ef384621b0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:16.499883 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-50a8f031-f7d7-4cc8-9f60-c8ef384621b0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: ff70294f-a73f-4dcf-aaf4-bd979106f1b8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:16.506780 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-50a8f031-f7d7-4cc8-9f60-c8ef384621b0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:16.512462 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-50a8f031-f7d7-4cc8-9f60-c8ef384621b0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:16.512462 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-50a8f031-f7d7-4cc8-9f60-c8ef384621b0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:16.512462 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-50a8f031-f7d7-4cc8-9f60-c8ef384621b0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:16.662237 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-50a8f031-f7d7-4cc8-9f60-c8ef384621b0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:16.666203 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ff139ce3-cd34-40be-b5f6-07a454fcff84 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:16.667616 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ff139ce3-cd34-40be-b5f6-07a454fcff84 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:16.675438 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ff139ce3-cd34-40be-b5f6-07a454fcff84 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:16.676236 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ff139ce3-cd34-40be-b5f6-07a454fcff84 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:16.677318 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ff139ce3-cd34-40be-b5f6-07a454fcff84 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:16.677774 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ff139ce3-cd34-40be-b5f6-07a454fcff84 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:16.685098 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-50a8f031-f7d7-4cc8-9f60-c8ef384621b0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8" status: 200 len: 1493 microversion: 2.1 time: 0.196138 Apr 16 21:16:16.693550 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1280/2682] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:16 2022] GET /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8 => generated 1493 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:16.744358 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-925c7af5-ad8a-4a1b-a76c-4f48fac7a7d3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:16.745282 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-925c7af5-ad8a-4a1b-a76c-4f48fac7a7d3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:16.752304 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-925c7af5-ad8a-4a1b-a76c-4f48fac7a7d3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:16.752771 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-925c7af5-ad8a-4a1b-a76c-4f48fac7a7d3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:16.753631 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-925c7af5-ad8a-4a1b-a76c-4f48fac7a7d3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:16.754074 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-925c7af5-ad8a-4a1b-a76c-4f48fac7a7d3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:16.892509 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-925c7af5-ad8a-4a1b-a76c-4f48fac7a7d3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:16.900458 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-925c7af5-ad8a-4a1b-a76c-4f48fac7a7d3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1476 microversion: 2.1 time: 0.161324 Apr 16 21:16:16.901135 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1281/2683] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:16 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1476 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:16.914090 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ff139ce3-cd34-40be-b5f6-07a454fcff84 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:16.922229 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ff139ce3-cd34-40be-b5f6-07a454fcff84 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140" status: 200 len: 1322 microversion: 2.1 time: 0.261704 Apr 16 21:16:16.922803 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1403/2684] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:16 2022] GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140 => generated 1322 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:17.077259 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3bb2d5d3-3e94-4eae-b02a-9e6e4227dfa2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:17.078066 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3bb2d5d3-3e94-4eae-b02a-9e6e4227dfa2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 999c16db-7916-4753-ae16-9ed72c8e6922] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:17.083968 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3bb2d5d3-3e94-4eae-b02a-9e6e4227dfa2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:17.084465 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3bb2d5d3-3e94-4eae-b02a-9e6e4227dfa2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:17.085520 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3bb2d5d3-3e94-4eae-b02a-9e6e4227dfa2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:17.085980 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3bb2d5d3-3e94-4eae-b02a-9e6e4227dfa2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:17.162180 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-706c5d20-8ca0-425f-82be-5b50f00c91ce tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:17.162804 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-706c5d20-8ca0-425f-82be-5b50f00c91ce tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:17.169499 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-706c5d20-8ca0-425f-82be-5b50f00c91ce tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:17.169895 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-706c5d20-8ca0-425f-82be-5b50f00c91ce tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:17.170680 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-706c5d20-8ca0-425f-82be-5b50f00c91ce tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:17.171125 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-706c5d20-8ca0-425f-82be-5b50f00c91ce tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:17.228422 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3bb2d5d3-3e94-4eae-b02a-9e6e4227dfa2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:17.236302 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3bb2d5d3-3e94-4eae-b02a-9e6e4227dfa2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922" status: 200 len: 1511 microversion: 2.1 time: 0.162840 Apr 16 21:16:17.236887 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1282/2685] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:17 2022] GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922 => generated 1511 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:17.241576 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-706c5d20-8ca0-425f-82be-5b50f00c91ce tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lazy-loading 'services' on Instance uuid 9ce03e87-6962-45d5-910e-f87b61fef356 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:16:17.258439 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-706c5d20-8ca0-425f-82be-5b50f00c91ce tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1927 microversion: 2.75 time: 0.100110 Apr 16 21:16:17.259046 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1404/2686] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:16:17 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1927 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:16:17.262279 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f0c33887-818b-47a6-9985-ebe52d73386f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:17.264281 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f0c33887-818b-47a6-9985-ebe52d73386f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 8cb60874-b0f3-4055-a4d1-531f4a147992] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:17.269699 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f0c33887-818b-47a6-9985-ebe52d73386f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:17.270160 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f0c33887-818b-47a6-9985-ebe52d73386f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:17.270936 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f0c33887-818b-47a6-9985-ebe52d73386f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:17.271386 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f0c33887-818b-47a6-9985-ebe52d73386f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:17.411022 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f0c33887-818b-47a6-9985-ebe52d73386f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:17.420415 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f0c33887-818b-47a6-9985-ebe52d73386f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992" status: 200 len: 1324 microversion: 2.1 time: 0.163469 Apr 16 21:16:17.430303 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1283/2687] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:17 2022] GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992 => generated 1324 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:17.709014 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8e5a3b5a-350f-4afe-8b30-aa09de018acd tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:17.709768 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8e5a3b5a-350f-4afe-8b30-aa09de018acd tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: ff70294f-a73f-4dcf-aaf4-bd979106f1b8] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:17.717312 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8e5a3b5a-350f-4afe-8b30-aa09de018acd tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:17.717768 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8e5a3b5a-350f-4afe-8b30-aa09de018acd tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:17.718567 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8e5a3b5a-350f-4afe-8b30-aa09de018acd tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:17.719008 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8e5a3b5a-350f-4afe-8b30-aa09de018acd tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:17.918645 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-887fc7f7-e421-4cbe-b2ae-d797a04632df tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:17.919266 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-887fc7f7-e421-4cbe-b2ae-d797a04632df tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:17.925918 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8e5a3b5a-350f-4afe-8b30-aa09de018acd tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:17.934007 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8e5a3b5a-350f-4afe-8b30-aa09de018acd tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8" status: 200 len: 1476 microversion: 2.1 time: 0.228836 Apr 16 21:16:17.934440 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-887fc7f7-e421-4cbe-b2ae-d797a04632df tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:17.934911 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1405/2688] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:17 2022] GET /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8 => generated 1476 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:17.935299 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-887fc7f7-e421-4cbe-b2ae-d797a04632df tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:17.936275 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-887fc7f7-e421-4cbe-b2ae-d797a04632df tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:17.936865 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-887fc7f7-e421-4cbe-b2ae-d797a04632df tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:17.940312 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-05a5ff57-2d12-4113-a9c1-43cf66d8c1eb tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:17.941005 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-05a5ff57-2d12-4113-a9c1-43cf66d8c1eb tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:17.947985 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-05a5ff57-2d12-4113-a9c1-43cf66d8c1eb tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:17.948454 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-05a5ff57-2d12-4113-a9c1-43cf66d8c1eb tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:17.949254 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-05a5ff57-2d12-4113-a9c1-43cf66d8c1eb tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:17.949706 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-05a5ff57-2d12-4113-a9c1-43cf66d8c1eb tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:18.075439 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-887fc7f7-e421-4cbe-b2ae-d797a04632df tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:18.084001 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-887fc7f7-e421-4cbe-b2ae-d797a04632df tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1476 microversion: 2.1 time: 0.169233 Apr 16 21:16:18.084955 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1284/2689] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:17 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1476 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:18.089867 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4d38db17-f70d-4246-a95b-5e72f6ab3b45 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1357092028"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:16:18.091283 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4d38db17-f70d-4246-a95b-5e72f6ab3b45 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: ff70294f-a73f-4dcf-aaf4-bd979106f1b8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:18.098072 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4d38db17-f70d-4246-a95b-5e72f6ab3b45 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:18.098572 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4d38db17-f70d-4246-a95b-5e72f6ab3b45 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:18.099816 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4d38db17-f70d-4246-a95b-5e72f6ab3b45 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:18.100307 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4d38db17-f70d-4246-a95b-5e72f6ab3b45 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:18.120396 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-05a5ff57-2d12-4113-a9c1-43cf66d8c1eb tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:18.128400 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-05a5ff57-2d12-4113-a9c1-43cf66d8c1eb tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140" status: 200 len: 1322 microversion: 2.1 time: 0.192174 Apr 16 21:16:18.129148 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1406/2690] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:17 2022] GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140 => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:18.207899 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-be59d4f1-adcc-44f2-a409-e4ea8045e6b5 req-ed95ae6b-b0d0-40fa-b8cc-e9d4d172bda1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8cb60874-b0f3-4055-a4d1-531f4a147992", "tag": "f7e32037-5681-45d7-a2cb-a1ccb583ae68"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:16:18.225916 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-be59d4f1-adcc-44f2-a409-e4ea8045e6b5 req-ed95ae6b-b0d0-40fa-b8cc-e9d4d172bda1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:18.226377 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-be59d4f1-adcc-44f2-a409-e4ea8045e6b5 req-ed95ae6b-b0d0-40fa-b8cc-e9d4d172bda1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:18.261383 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-be59d4f1-adcc-44f2-a409-e4ea8045e6b5 req-ed95ae6b-b0d0-40fa-b8cc-e9d4d172bda1 service nova] Creating event network-changed:f7e32037-5681-45d7-a2cb-a1ccb583ae68 for instance 8cb60874-b0f3-4055-a4d1-531f4a147992 on nch2-master-1 Apr 16 21:16:18.272956 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-be59d4f1-adcc-44f2-a409-e4ea8045e6b5 req-ed95ae6b-b0d0-40fa-b8cc-e9d4d172bda1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068638 Apr 16 21:16:18.274242 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1407/2691] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:16:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:16:18.281419 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4fe05cad-9cda-4894-99da-a113c1efa928 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:18.282507 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4fe05cad-9cda-4894-99da-a113c1efa928 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 999c16db-7916-4753-ae16-9ed72c8e6922] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:18.291649 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4fe05cad-9cda-4894-99da-a113c1efa928 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:18.293252 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4fe05cad-9cda-4894-99da-a113c1efa928 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:18.294147 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4fe05cad-9cda-4894-99da-a113c1efa928 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:18.294711 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4fe05cad-9cda-4894-99da-a113c1efa928 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:18.576962 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4fe05cad-9cda-4894-99da-a113c1efa928 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:18.584436 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4fe05cad-9cda-4894-99da-a113c1efa928 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922" status: 200 len: 1511 microversion: 2.1 time: 0.308589 Apr 16 21:16:18.592613 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1408/2692] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:18 2022] GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922 => generated 1511 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:18.592613 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-04635591-31c4-4e01-bd6b-88b548eaf55b tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:18.592613 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-04635591-31c4-4e01-bd6b-88b548eaf55b tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:18.596459 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-04635591-31c4-4e01-bd6b-88b548eaf55b tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:18.596944 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-04635591-31c4-4e01-bd6b-88b548eaf55b tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:18.597728 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-04635591-31c4-4e01-bd6b-88b548eaf55b tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:18.598173 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-04635591-31c4-4e01-bd6b-88b548eaf55b tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:18.634064 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4d38db17-f70d-4246-a95b-5e72f6ab3b45 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "POST /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8/action" status: 202 len: 0 microversion: 2.1 time: 0.547538 Apr 16 21:16:18.635441 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1285/2693] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:16:18 2022] POST /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8/action => generated 0 bytes in 550 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 16 21:16:18.641381 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-47626f96-64fd-4a6d-884c-b3f4cf8cea21 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:18.642455 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-47626f96-64fd-4a6d-884c-b3f4cf8cea21 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 8cb60874-b0f3-4055-a4d1-531f4a147992] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:18.649576 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-47626f96-64fd-4a6d-884c-b3f4cf8cea21 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:18.650107 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-47626f96-64fd-4a6d-884c-b3f4cf8cea21 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:18.651166 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-47626f96-64fd-4a6d-884c-b3f4cf8cea21 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:18.651953 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-47626f96-64fd-4a6d-884c-b3f4cf8cea21 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:18.703013 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-04635591-31c4-4e01-bd6b-88b548eaf55b tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lazy-loading 'services' on Instance uuid 9ce03e87-6962-45d5-910e-f87b61fef356 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:16:18.721224 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-04635591-31c4-4e01-bd6b-88b548eaf55b tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1927 microversion: 2.75 time: 0.135133 Apr 16 21:16:18.733555 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1409/2694] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:16:18 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1927 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:16:18.738436 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-490932b6-e84e-4247-b01e-e78b6bb4d503 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb95b0b790>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:18.800280 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-490932b6-e84e-4247-b01e-e78b6bb4d503 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73" status: 200 len: 1438 microversion: 2.1 time: 0.065482 Apr 16 21:16:18.800958 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1410/2695] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:16:18 2022] GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73 => generated 1438 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:18.819726 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-47626f96-64fd-4a6d-884c-b3f4cf8cea21 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:18.827938 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-47626f96-64fd-4a6d-884c-b3f4cf8cea21 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992" status: 200 len: 1324 microversion: 2.1 time: 0.191044 Apr 16 21:16:18.828679 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1286/2696] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:18 2022] GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992 => generated 1324 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:19.101204 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d247c97d-e8b2-4fbd-9f86-aa45e1713f36 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:19.101816 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d247c97d-e8b2-4fbd-9f86-aa45e1713f36 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:19.108808 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d247c97d-e8b2-4fbd-9f86-aa45e1713f36 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:19.109271 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d247c97d-e8b2-4fbd-9f86-aa45e1713f36 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:19.110045 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d247c97d-e8b2-4fbd-9f86-aa45e1713f36 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:19.110482 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d247c97d-e8b2-4fbd-9f86-aa45e1713f36 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:19.146137 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-079791c9-67b8-466c-8c15-bb206984f37b tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:19.147443 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-079791c9-67b8-466c-8c15-bb206984f37b tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:19.154603 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-079791c9-67b8-466c-8c15-bb206984f37b tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:19.155057 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-079791c9-67b8-466c-8c15-bb206984f37b tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:19.156089 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-079791c9-67b8-466c-8c15-bb206984f37b tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:19.156558 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-079791c9-67b8-466c-8c15-bb206984f37b tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:19.285274 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-079791c9-67b8-466c-8c15-bb206984f37b tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:19.293081 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-079791c9-67b8-466c-8c15-bb206984f37b tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140" status: 200 len: 1322 microversion: 2.1 time: 0.150831 Apr 16 21:16:19.293626 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d247c97d-e8b2-4fbd-9f86-aa45e1713f36 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:19.293796 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1287/2697] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:19 2022] GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:19.301229 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d247c97d-e8b2-4fbd-9f86-aa45e1713f36 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1476 microversion: 2.1 time: 0.204107 Apr 16 21:16:19.306466 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1411/2698] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:19 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1476 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:19.601778 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3d16ab44-a7cf-41bf-a653-672cd7140acd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:19.602992 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3d16ab44-a7cf-41bf-a653-672cd7140acd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 999c16db-7916-4753-ae16-9ed72c8e6922] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:19.609132 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3d16ab44-a7cf-41bf-a653-672cd7140acd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:19.612379 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3d16ab44-a7cf-41bf-a653-672cd7140acd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:19.612379 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3d16ab44-a7cf-41bf-a653-672cd7140acd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:19.612379 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3d16ab44-a7cf-41bf-a653-672cd7140acd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:19.740872 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bb81dfb9-a01e-4f2c-b378-3b0c7a776291 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:19.741487 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-bb81dfb9-a01e-4f2c-b378-3b0c7a776291 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:19.742668 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3d16ab44-a7cf-41bf-a653-672cd7140acd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:19.748449 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bb81dfb9-a01e-4f2c-b378-3b0c7a776291 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:19.748901 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bb81dfb9-a01e-4f2c-b378-3b0c7a776291 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:19.749737 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bb81dfb9-a01e-4f2c-b378-3b0c7a776291 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:19.750245 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3d16ab44-a7cf-41bf-a653-672cd7140acd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922" status: 200 len: 1511 microversion: 2.1 time: 0.152371 Apr 16 21:16:19.750387 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bb81dfb9-a01e-4f2c-b378-3b0c7a776291 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:19.750825 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1288/2699] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:19 2022] GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922 => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:19.814089 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-954f798c-55dd-4f2c-a387-e4c87c62488c tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb95969940>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:19.821874 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-bb81dfb9-a01e-4f2c-b378-3b0c7a776291 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lazy-loading 'services' on Instance uuid 9ce03e87-6962-45d5-910e-f87b61fef356 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:16:19.839367 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-bb81dfb9-a01e-4f2c-b378-3b0c7a776291 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1927 microversion: 2.75 time: 0.102334 Apr 16 21:16:19.839904 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1412/2700] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:16:19 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1927 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:16:19.844445 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b7b1a6a7-9c5d-45fa-808c-7f12ada40a88 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:19.845061 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b7b1a6a7-9c5d-45fa-808c-7f12ada40a88 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 8cb60874-b0f3-4055-a4d1-531f4a147992] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:19.853902 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b7b1a6a7-9c5d-45fa-808c-7f12ada40a88 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:19.853902 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b7b1a6a7-9c5d-45fa-808c-7f12ada40a88 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:19.853902 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b7b1a6a7-9c5d-45fa-808c-7f12ada40a88 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:19.853902 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b7b1a6a7-9c5d-45fa-808c-7f12ada40a88 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:19.858362 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-954f798c-55dd-4f2c-a387-e4c87c62488c tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73" status: 200 len: 1438 microversion: 2.1 time: 0.048028 Apr 16 21:16:19.858965 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1289/2701] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:16:19 2022] GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73 => generated 1438 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:19.983170 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b7b1a6a7-9c5d-45fa-808c-7f12ada40a88 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:19.990575 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b7b1a6a7-9c5d-45fa-808c-7f12ada40a88 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992" status: 200 len: 1324 microversion: 2.1 time: 0.149675 Apr 16 21:16:19.991441 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1413/2702] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:19 2022] GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992 => generated 1324 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:20.312121 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e77b2e0b-2eba-451e-a266-401d5eaa5bf8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:20.312766 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e77b2e0b-2eba-451e-a266-401d5eaa5bf8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:20.321365 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e77b2e0b-2eba-451e-a266-401d5eaa5bf8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:20.321691 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0b471d8d-f745-4174-90fd-14878ee4cf47 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:20.321841 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e77b2e0b-2eba-451e-a266-401d5eaa5bf8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:20.322325 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0b471d8d-f745-4174-90fd-14878ee4cf47 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:20.322813 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e77b2e0b-2eba-451e-a266-401d5eaa5bf8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:20.323051 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e77b2e0b-2eba-451e-a266-401d5eaa5bf8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:20.328561 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0b471d8d-f745-4174-90fd-14878ee4cf47 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:20.329214 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0b471d8d-f745-4174-90fd-14878ee4cf47 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:20.329772 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0b471d8d-f745-4174-90fd-14878ee4cf47 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:20.330222 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0b471d8d-f745-4174-90fd-14878ee4cf47 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:20.462117 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e77b2e0b-2eba-451e-a266-401d5eaa5bf8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:20.466595 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0b471d8d-f745-4174-90fd-14878ee4cf47 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:20.470495 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e77b2e0b-2eba-451e-a266-401d5eaa5bf8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140" status: 200 len: 1322 microversion: 2.1 time: 0.164238 Apr 16 21:16:20.471533 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1290/2703] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:20 2022] GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:20.474843 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0b471d8d-f745-4174-90fd-14878ee4cf47 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1476 microversion: 2.1 time: 0.157672 Apr 16 21:16:20.484129 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1414/2704] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:20 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1476 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:20.767744 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2c9e6d1b-57dc-4f44-aefa-7a02e8c25fef tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:20.768398 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2c9e6d1b-57dc-4f44-aefa-7a02e8c25fef tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 999c16db-7916-4753-ae16-9ed72c8e6922] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:20.775099 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2c9e6d1b-57dc-4f44-aefa-7a02e8c25fef tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:20.775551 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2c9e6d1b-57dc-4f44-aefa-7a02e8c25fef tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:20.776464 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2c9e6d1b-57dc-4f44-aefa-7a02e8c25fef tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:20.776906 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2c9e6d1b-57dc-4f44-aefa-7a02e8c25fef tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:20.859945 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d7619091-8d8f-43f9-a637-596f870c8988 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:20.860699 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d7619091-8d8f-43f9-a637-596f870c8988 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:20.869176 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d7619091-8d8f-43f9-a637-596f870c8988 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:20.869707 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d7619091-8d8f-43f9-a637-596f870c8988 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:20.870556 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d7619091-8d8f-43f9-a637-596f870c8988 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:20.871070 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d7619091-8d8f-43f9-a637-596f870c8988 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:20.912426 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2c9e6d1b-57dc-4f44-aefa-7a02e8c25fef tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:20.919812 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2c9e6d1b-57dc-4f44-aefa-7a02e8c25fef tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922" status: 200 len: 1511 microversion: 2.1 time: 0.155980 Apr 16 21:16:20.920415 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1291/2705] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:20 2022] GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922 => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:20.924726 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9991d093-3ddf-49b8-adfc-5e29bd038328 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb9ff735e0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:20.942191 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-d7619091-8d8f-43f9-a637-596f870c8988 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lazy-loading 'services' on Instance uuid 9ce03e87-6962-45d5-910e-f87b61fef356 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:16:20.962554 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d7619091-8d8f-43f9-a637-596f870c8988 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1927 microversion: 2.75 time: 0.106899 Apr 16 21:16:20.963282 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1415/2706] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:16:20 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1927 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:16:20.969529 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9991d093-3ddf-49b8-adfc-5e29bd038328 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73" status: 200 len: 1438 microversion: 2.1 time: 0.048096 Apr 16 21:16:20.970107 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1292/2707] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:16:20 2022] GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73 => generated 1438 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:21.006598 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c3d60536-c0d7-4453-9c28-37f8e7aff4e5 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:21.007216 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c3d60536-c0d7-4453-9c28-37f8e7aff4e5 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 8cb60874-b0f3-4055-a4d1-531f4a147992] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:21.013961 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3d60536-c0d7-4453-9c28-37f8e7aff4e5 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:21.014422 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3d60536-c0d7-4453-9c28-37f8e7aff4e5 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:21.015226 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3d60536-c0d7-4453-9c28-37f8e7aff4e5 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:21.015656 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3d60536-c0d7-4453-9c28-37f8e7aff4e5 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:21.146041 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c3d60536-c0d7-4453-9c28-37f8e7aff4e5 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:21.153574 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c3d60536-c0d7-4453-9c28-37f8e7aff4e5 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992" status: 200 len: 1324 microversion: 2.1 time: 0.150747 Apr 16 21:16:21.154137 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1416/2708] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:21 2022] GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992 => generated 1324 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:21.488330 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1752f304-c756-43a0-8831-a260417b2ebe tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:21.488885 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1752f304-c756-43a0-8831-a260417b2ebe tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:21.491070 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f9b1b383-5892-45f8-99e4-a54013e52a45 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:21.491819 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f9b1b383-5892-45f8-99e4-a54013e52a45 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:21.496528 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1752f304-c756-43a0-8831-a260417b2ebe tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:21.497068 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1752f304-c756-43a0-8831-a260417b2ebe tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:21.497853 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1752f304-c756-43a0-8831-a260417b2ebe tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:21.498361 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1752f304-c756-43a0-8831-a260417b2ebe tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:21.498482 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9b1b383-5892-45f8-99e4-a54013e52a45 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:21.498924 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9b1b383-5892-45f8-99e4-a54013e52a45 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:21.499690 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9b1b383-5892-45f8-99e4-a54013e52a45 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:21.500129 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9b1b383-5892-45f8-99e4-a54013e52a45 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:21.629473 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1752f304-c756-43a0-8831-a260417b2ebe tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:21.629785 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f9b1b383-5892-45f8-99e4-a54013e52a45 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:21.637248 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1752f304-c756-43a0-8831-a260417b2ebe tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140" status: 200 len: 1322 microversion: 2.1 time: 0.154004 Apr 16 21:16:21.643318 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f9b1b383-5892-45f8-99e4-a54013e52a45 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1476 microversion: 2.1 time: 0.150634 Apr 16 21:16:21.643487 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1293/2709] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:21 2022] GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:21.643664 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1417/2710] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:21 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1476 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:21.936840 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-eafc6df2-961c-4748-a7a4-a8b001aec2b8 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:21.937479 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-eafc6df2-961c-4748-a7a4-a8b001aec2b8 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 999c16db-7916-4753-ae16-9ed72c8e6922] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:21.943804 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eafc6df2-961c-4748-a7a4-a8b001aec2b8 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:21.944364 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eafc6df2-961c-4748-a7a4-a8b001aec2b8 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:21.945188 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eafc6df2-961c-4748-a7a4-a8b001aec2b8 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:21.945660 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eafc6df2-961c-4748-a7a4-a8b001aec2b8 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:21.981560 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8f642422-8b4c-4086-9f59-966f96155e63 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:21.982167 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8f642422-8b4c-4086-9f59-966f96155e63 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:21.989017 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8f642422-8b4c-4086-9f59-966f96155e63 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:21.989517 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8f642422-8b4c-4086-9f59-966f96155e63 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:21.990264 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8f642422-8b4c-4086-9f59-966f96155e63 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:21.990705 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8f642422-8b4c-4086-9f59-966f96155e63 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:22.065195 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-8f642422-8b4c-4086-9f59-966f96155e63 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lazy-loading 'services' on Instance uuid 9ce03e87-6962-45d5-910e-f87b61fef356 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:16:22.082745 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8f642422-8b4c-4086-9f59-966f96155e63 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1927 microversion: 2.75 time: 0.104798 Apr 16 21:16:22.088385 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-eafc6df2-961c-4748-a7a4-a8b001aec2b8 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:22.088579 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1418/2711] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:16:21 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1927 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:16:22.088802 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d945b807-2878-47fd-a23b-cbc97ae72986 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb95ab9a60>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:22.097038 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-eafc6df2-961c-4748-a7a4-a8b001aec2b8 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922" status: 200 len: 1511 microversion: 2.1 time: 0.163882 Apr 16 21:16:22.099141 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1294/2712] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:21 2022] GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922 => generated 1511 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:22.131392 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d945b807-2878-47fd-a23b-cbc97ae72986 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73" status: 200 len: 1438 microversion: 2.1 time: 0.046697 Apr 16 21:16:22.131965 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1419/2713] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:16:22 2022] GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73 => generated 1438 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:22.170650 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ae1c3621-4c32-4e19-8a8a-321097deacaf tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:22.171337 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ae1c3621-4c32-4e19-8a8a-321097deacaf tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 8cb60874-b0f3-4055-a4d1-531f4a147992] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:22.177335 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ae1c3621-4c32-4e19-8a8a-321097deacaf tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:22.177793 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ae1c3621-4c32-4e19-8a8a-321097deacaf tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:22.179251 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ae1c3621-4c32-4e19-8a8a-321097deacaf tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:22.179705 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ae1c3621-4c32-4e19-8a8a-321097deacaf tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:22.318144 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ae1c3621-4c32-4e19-8a8a-321097deacaf tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:22.326105 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ae1c3621-4c32-4e19-8a8a-321097deacaf tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992" status: 200 len: 1324 microversion: 2.1 time: 0.159644 Apr 16 21:16:22.326877 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1295/2714] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:22 2022] GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992 => generated 1324 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:22.576916 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-063592e5-8348-471e-a44a-e106224179ee req-65e1b5be-f990-4575-a0bc-5a3f8810b8a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89f07150-d0ab-41c9-a9bf-692e9d9c5140", "name": "network-vif-plugged", "status": "completed", "tag": "973bd67e-86f2-41a6-afe9-0081fe7b246c"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:16:22.584976 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-063592e5-8348-471e-a44a-e106224179ee req-65e1b5be-f990-4575-a0bc-5a3f8810b8a8 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:22.585424 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-063592e5-8348-471e-a44a-e106224179ee req-65e1b5be-f990-4575-a0bc-5a3f8810b8a8 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:22.595812 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-063592e5-8348-471e-a44a-e106224179ee req-65e1b5be-f990-4575-a0bc-5a3f8810b8a8 service nova] Creating event network-vif-plugged:973bd67e-86f2-41a6-afe9-0081fe7b246c for instance 89f07150-d0ab-41c9-a9bf-692e9d9c5140 on nch1-master-1 Apr 16 21:16:22.600739 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-063592e5-8348-471e-a44a-e106224179ee req-65e1b5be-f990-4575-a0bc-5a3f8810b8a8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027529 Apr 16 21:16:22.601505 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1420/2715] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:16:22.654096 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ca1ddf11-e2be-4378-8b24-af5925bb37ad tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:22.654720 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ca1ddf11-e2be-4378-8b24-af5925bb37ad tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:22.657801 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d2ffb1b9-9339-4dd0-b06c-9765c7c89e3c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:22.658784 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d2ffb1b9-9339-4dd0-b06c-9765c7c89e3c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:22.661913 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ca1ddf11-e2be-4378-8b24-af5925bb37ad tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:22.662375 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ca1ddf11-e2be-4378-8b24-af5925bb37ad tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:22.663239 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ca1ddf11-e2be-4378-8b24-af5925bb37ad tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:22.663820 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ca1ddf11-e2be-4378-8b24-af5925bb37ad tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:22.671376 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d2ffb1b9-9339-4dd0-b06c-9765c7c89e3c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:22.671605 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d2ffb1b9-9339-4dd0-b06c-9765c7c89e3c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:22.674959 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d2ffb1b9-9339-4dd0-b06c-9765c7c89e3c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:22.674959 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d2ffb1b9-9339-4dd0-b06c-9765c7c89e3c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:22.857900 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ca1ddf11-e2be-4378-8b24-af5925bb37ad tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:22.865327 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d2ffb1b9-9339-4dd0-b06c-9765c7c89e3c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:22.867027 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ca1ddf11-e2be-4378-8b24-af5925bb37ad tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140" status: 200 len: 1322 microversion: 2.1 time: 0.216805 Apr 16 21:16:22.868523 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1296/2716] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:22 2022] GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:22.874228 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d2ffb1b9-9339-4dd0-b06c-9765c7c89e3c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1475 microversion: 2.1 time: 0.222854 Apr 16 21:16:22.884196 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1421/2717] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:22 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1475 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:23.103538 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d3cafa02-6b60-46f4-9fde-42b7bb1b73a9 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:23.104165 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d3cafa02-6b60-46f4-9fde-42b7bb1b73a9 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:23.110801 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d3cafa02-6b60-46f4-9fde-42b7bb1b73a9 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:23.112737 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d3cafa02-6b60-46f4-9fde-42b7bb1b73a9 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:23.113759 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d3cafa02-6b60-46f4-9fde-42b7bb1b73a9 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:23.114395 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d3cafa02-6b60-46f4-9fde-42b7bb1b73a9 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:23.117434 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-84eab391-50cf-41fe-846a-4fdef86510b9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:23.118071 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-84eab391-50cf-41fe-846a-4fdef86510b9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 999c16db-7916-4753-ae16-9ed72c8e6922] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:23.125526 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-84eab391-50cf-41fe-846a-4fdef86510b9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:23.125992 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-84eab391-50cf-41fe-846a-4fdef86510b9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:23.127064 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-84eab391-50cf-41fe-846a-4fdef86510b9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:23.127266 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-84eab391-50cf-41fe-846a-4fdef86510b9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:23.192537 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-d3cafa02-6b60-46f4-9fde-42b7bb1b73a9 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lazy-loading 'services' on Instance uuid 9ce03e87-6962-45d5-910e-f87b61fef356 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:16:23.211073 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d3cafa02-6b60-46f4-9fde-42b7bb1b73a9 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1927 microversion: 2.75 time: 0.111929 Apr 16 21:16:23.218884 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1297/2718] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:16:23 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1927 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:16:23.218884 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c5cd9025-c48d-45cc-bbb7-6abc9303b58f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb96571790>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:23.270074 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c5cd9025-c48d-45cc-bbb7-6abc9303b58f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73" status: 200 len: 1438 microversion: 2.1 time: 0.056247 Apr 16 21:16:23.271079 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1298/2719] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:16:23 2022] GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73 => generated 1438 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:23.325588 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-84eab391-50cf-41fe-846a-4fdef86510b9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:23.334508 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-84eab391-50cf-41fe-846a-4fdef86510b9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922" status: 200 len: 1488 microversion: 2.1 time: 0.220850 Apr 16 21:16:23.351651 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1422/2720] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:23 2022] GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922 => generated 1488 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:23.356866 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e80d3c97-9afa-4cc5-89db-4318b1fb9d01 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:23.357708 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e80d3c97-9afa-4cc5-89db-4318b1fb9d01 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 8cb60874-b0f3-4055-a4d1-531f4a147992] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:23.364363 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e80d3c97-9afa-4cc5-89db-4318b1fb9d01 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:23.368853 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fc43ded2-036c-4e69-8287-cf9e40a349a1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:16:23.368853 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fc43ded2-036c-4e69-8287-cf9e40a349a1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:23.370075 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e80d3c97-9afa-4cc5-89db-4318b1fb9d01 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:23.370909 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e80d3c97-9afa-4cc5-89db-4318b1fb9d01 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:23.371356 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e80d3c97-9afa-4cc5-89db-4318b1fb9d01 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:23.379819 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fc43ded2-036c-4e69-8287-cf9e40a349a1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:23.380320 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fc43ded2-036c-4e69-8287-cf9e40a349a1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:23.381107 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fc43ded2-036c-4e69-8287-cf9e40a349a1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:23.381555 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fc43ded2-036c-4e69-8287-cf9e40a349a1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:23.467991 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fc43ded2-036c-4e69-8287-cf9e40a349a1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "POST /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa/action" status: 200 len: 190 microversion: 2.1 time: 0.113471 Apr 16 21:16:23.473805 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1423/2721] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:16:23 2022] POST /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa/action => generated 190 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:16:23.479476 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-2f4d2cd5-a8ac-4a83-9de0-ea3d5212f59f req-f0b69490-c582-40c0-86a7-af3fc899313e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2389c37c-30cc-4355-a3a2-44653cb17fd6", "name": "network-vif-unplugged", "status": "completed", "tag": "0b67129e-ca8a-4c23-aff2-5c3d6e70e65a"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:16:23.489044 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-2f4d2cd5-a8ac-4a83-9de0-ea3d5212f59f req-f0b69490-c582-40c0-86a7-af3fc899313e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:23.489493 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-2f4d2cd5-a8ac-4a83-9de0-ea3d5212f59f req-f0b69490-c582-40c0-86a7-af3fc899313e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:23.506232 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e80d3c97-9afa-4cc5-89db-4318b1fb9d01 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:23.513617 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e80d3c97-9afa-4cc5-89db-4318b1fb9d01 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992" status: 200 len: 1324 microversion: 2.1 time: 0.166079 Apr 16 21:16:23.514197 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1299/2722] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:23 2022] GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992 => generated 1324 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:23.523086 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-2f4d2cd5-a8ac-4a83-9de0-ea3d5212f59f req-f0b69490-c582-40c0-86a7-af3fc899313e service nova] Creating event network-vif-unplugged:0b67129e-ca8a-4c23-aff2-5c3d6e70e65a for instance 2389c37c-30cc-4355-a3a2-44653cb17fd6 on nch2-master-1 Apr 16 21:16:23.524564 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [req-2f4d2cd5-a8ac-4a83-9de0-ea3d5212f59f req-f0b69490-c582-40c0-86a7-af3fc899313e service nova] Instance 2389c37c-30cc-4355-a3a2-44653cb17fd6 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 16 21:16:23.531406 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-71b09a69-c1a9-4b86-bcbe-407be3ae409d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:23.531406 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-71b09a69-c1a9-4b86-bcbe-407be3ae409d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:23.536510 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-2f4d2cd5-a8ac-4a83-9de0-ea3d5212f59f req-f0b69490-c582-40c0-86a7-af3fc899313e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.062356 Apr 16 21:16:23.537511 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1424/2723] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:16:23.541068 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-71b09a69-c1a9-4b86-bcbe-407be3ae409d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:23.543167 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-71b09a69-c1a9-4b86-bcbe-407be3ae409d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:23.544163 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-71b09a69-c1a9-4b86-bcbe-407be3ae409d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:23.544715 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-71b09a69-c1a9-4b86-bcbe-407be3ae409d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:23.689391 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-71b09a69-c1a9-4b86-bcbe-407be3ae409d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:23.699596 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-71b09a69-c1a9-4b86-bcbe-407be3ae409d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.172573 Apr 16 21:16:23.708958 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1300/2724] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:23 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:23.728684 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d872e3f7-fb24-4361-be25-9c530bec427d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:23.729446 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d872e3f7-fb24-4361-be25-9c530bec427d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:23.737470 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d872e3f7-fb24-4361-be25-9c530bec427d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:23.738808 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d872e3f7-fb24-4361-be25-9c530bec427d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:23.743851 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d872e3f7-fb24-4361-be25-9c530bec427d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:23.744438 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d872e3f7-fb24-4361-be25-9c530bec427d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:23.883672 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1e7b0f28-ffbd-4928-ba32-9e14c62982a8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:23.887248 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1e7b0f28-ffbd-4928-ba32-9e14c62982a8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:23.891772 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1e7b0f28-ffbd-4928-ba32-9e14c62982a8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:23.892836 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1e7b0f28-ffbd-4928-ba32-9e14c62982a8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:23.893660 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1e7b0f28-ffbd-4928-ba32-9e14c62982a8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:23.894119 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1e7b0f28-ffbd-4928-ba32-9e14c62982a8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:24.018861 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d872e3f7-fb24-4361-be25-9c530bec427d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:24.027562 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d872e3f7-fb24-4361-be25-9c530bec427d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.304510 Apr 16 21:16:24.046749 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1425/2725] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:23 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:24.051504 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7c9b96a5-1c0d-482a-869e-b775b68d16af tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:24.052391 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7c9b96a5-1c0d-482a-869e-b775b68d16af tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:24.060150 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7c9b96a5-1c0d-482a-869e-b775b68d16af tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:24.063914 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7c9b96a5-1c0d-482a-869e-b775b68d16af tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:24.063914 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7c9b96a5-1c0d-482a-869e-b775b68d16af tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:24.063914 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7c9b96a5-1c0d-482a-869e-b775b68d16af tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:24.138880 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1e7b0f28-ffbd-4928-ba32-9e14c62982a8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:24.149991 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1e7b0f28-ffbd-4928-ba32-9e14c62982a8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140" status: 200 len: 1322 microversion: 2.1 time: 0.268204 Apr 16 21:16:24.149991 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1301/2726] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:23 2022] GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140 => generated 1322 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:24.156047 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f61a7a13-8df6-47ba-98f9-9142a17291d5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:24.156928 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f61a7a13-8df6-47ba-98f9-9142a17291d5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:24.163526 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f61a7a13-8df6-47ba-98f9-9142a17291d5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:24.163985 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f61a7a13-8df6-47ba-98f9-9142a17291d5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:24.165422 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f61a7a13-8df6-47ba-98f9-9142a17291d5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:24.165864 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f61a7a13-8df6-47ba-98f9-9142a17291d5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:24.272257 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7c9b96a5-1c0d-482a-869e-b775b68d16af tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:24.281896 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7c9b96a5-1c0d-482a-869e-b775b68d16af tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1475 microversion: 2.1 time: 0.234034 Apr 16 21:16:24.282742 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1426/2727] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:24 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1475 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:24.287823 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-21013b02-6d67-43d8-af06-928458ffac3c tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:24.288634 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-21013b02-6d67-43d8-af06-928458ffac3c tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:24.295657 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-21013b02-6d67-43d8-af06-928458ffac3c tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:24.296254 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-21013b02-6d67-43d8-af06-928458ffac3c tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:24.297156 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-21013b02-6d67-43d8-af06-928458ffac3c tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:24.297727 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-21013b02-6d67-43d8-af06-928458ffac3c tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:24.317848 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f61a7a13-8df6-47ba-98f9-9142a17291d5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:24.323707 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f61a7a13-8df6-47ba-98f9-9142a17291d5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.171923 Apr 16 21:16:24.324352 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1302/2728] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:24 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:24.329185 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cc2074ae-0973-45df-90e8-070980f27d1c tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb9597c700>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:24.374211 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cc2074ae-0973-45df-90e8-070980f27d1c tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73" status: 200 len: 1438 microversion: 2.1 time: 0.048572 Apr 16 21:16:24.375007 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1303/2729] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:16:24 2022] GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73 => generated 1438 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:24.379466 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-331bcac8-3b46-4ce7-b99d-dd0088322102 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:24.380059 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-331bcac8-3b46-4ce7-b99d-dd0088322102 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:24.391435 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-331bcac8-3b46-4ce7-b99d-dd0088322102 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:24.391435 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-331bcac8-3b46-4ce7-b99d-dd0088322102 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:24.391435 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-331bcac8-3b46-4ce7-b99d-dd0088322102 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:24.391746 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-331bcac8-3b46-4ce7-b99d-dd0088322102 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:24.396318 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-21013b02-6d67-43d8-af06-928458ffac3c tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lazy-loading 'services' on Instance uuid 9ce03e87-6962-45d5-910e-f87b61fef356 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:16:24.415537 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-21013b02-6d67-43d8-af06-928458ffac3c tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1927 microversion: 2.75 time: 0.130691 Apr 16 21:16:24.416744 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1427/2730] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:16:24 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1927 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:16:24.531115 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-331bcac8-3b46-4ce7-b99d-dd0088322102 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:24.532453 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-88e90302-8f37-4f65-b556-897b36cbaabf tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:24.533543 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-88e90302-8f37-4f65-b556-897b36cbaabf tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 8cb60874-b0f3-4055-a4d1-531f4a147992] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:24.541455 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-331bcac8-3b46-4ce7-b99d-dd0088322102 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.165567 Apr 16 21:16:24.542099 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-88e90302-8f37-4f65-b556-897b36cbaabf tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:24.543697 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1304/2731] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:24 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:24.545000 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-88e90302-8f37-4f65-b556-897b36cbaabf tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:24.546265 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-88e90302-8f37-4f65-b556-897b36cbaabf tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:24.547053 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-88e90302-8f37-4f65-b556-897b36cbaabf tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:24.625025 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-033271cf-7457-4c90-9218-7120d331ef36 req-239f1e9e-6642-4097-a928-754b6d2fc984 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc95a4d6-f40d-4087-91ae-3038926df942", "name": "network-vif-plugged", "status": "completed", "tag": "ed5b9e7e-736b-4251-8d00-ad2beb4e1443"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:16:24.634515 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-033271cf-7457-4c90-9218-7120d331ef36 req-239f1e9e-6642-4097-a928-754b6d2fc984 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:24.636442 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-033271cf-7457-4c90-9218-7120d331ef36 req-239f1e9e-6642-4097-a928-754b6d2fc984 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:24.650675 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-033271cf-7457-4c90-9218-7120d331ef36 req-239f1e9e-6642-4097-a928-754b6d2fc984 service nova] Creating event network-vif-plugged:ed5b9e7e-736b-4251-8d00-ad2beb4e1443 for instance dc95a4d6-f40d-4087-91ae-3038926df942 on nch1-master-1 Apr 16 21:16:24.657488 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-033271cf-7457-4c90-9218-7120d331ef36 req-239f1e9e-6642-4097-a928-754b6d2fc984 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035730 Apr 16 21:16:24.658491 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1305/2732] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:16:24.671501 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e78bd743-da69-4272-9469-be7545015a3c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1804596599", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "f9e642b5-0144-4768-b572-192069e5751e"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:16:24.736228 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-e78bd743-da69-4272-9469-be7545015a3c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] validate_networks() for [('f9e642b5-0144-4768-b572-192069e5751e', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:16:24.741189 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-88e90302-8f37-4f65-b556-897b36cbaabf tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:24.750240 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-88e90302-8f37-4f65-b556-897b36cbaabf tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992" status: 200 len: 1324 microversion: 2.1 time: 0.223302 Apr 16 21:16:24.750840 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1428/2733] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:24 2022] GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992 => generated 1324 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:25.166395 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6f130a91-9054-467e-b38f-1af553df68ee tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:25.167090 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6f130a91-9054-467e-b38f-1af553df68ee tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:25.169524 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-e78bd743-da69-4272-9469-be7545015a3c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:16:25.170034 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-e78bd743-da69-4272-9469-be7545015a3c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:16:25.170584 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-e78bd743-da69-4272-9469-be7545015a3c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:16:25.171079 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-e78bd743-da69-4272-9469-be7545015a3c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:16:25.171609 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-e78bd743-da69-4272-9469-be7545015a3c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:16:25.173470 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6f130a91-9054-467e-b38f-1af553df68ee tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:25.173930 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6f130a91-9054-467e-b38f-1af553df68ee tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:25.174720 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6f130a91-9054-467e-b38f-1af553df68ee tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:25.175163 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6f130a91-9054-467e-b38f-1af553df68ee tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:25.181330 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e78bd743-da69-4272-9469-be7545015a3c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:25.181921 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e78bd743-da69-4272-9469-be7545015a3c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:25.183791 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e78bd743-da69-4272-9469-be7545015a3c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:25.184487 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e78bd743-da69-4272-9469-be7545015a3c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:25.201433 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-e78bd743-da69-4272-9469-be7545015a3c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Getting quotas for project ceac90e6c7024b4ea350bfa95e1b5249. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:16:25.206813 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-e78bd743-da69-4272-9469-be7545015a3c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Getting quotas for user 6bb1c0cdf6274f118ebbe97829ddad65 and project ceac90e6c7024b4ea350bfa95e1b5249. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:16:25.219215 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e78bd743-da69-4272-9469-be7545015a3c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:16:25.222379 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e78bd743-da69-4272-9469-be7545015a3c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:16:25.306415 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6f130a91-9054-467e-b38f-1af553df68ee tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:25.313830 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6f130a91-9054-467e-b38f-1af553df68ee tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140" status: 200 len: 1517 microversion: 2.1 time: 0.152247 Apr 16 21:16:25.314405 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1429/2734] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:25 2022] GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140 => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:25.318897 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-489d67be-31f8-4465-b115-3a369b694dd1 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:25.319505 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-489d67be-31f8-4465-b115-3a369b694dd1 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:25.325084 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-489d67be-31f8-4465-b115-3a369b694dd1 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:25.325533 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-489d67be-31f8-4465-b115-3a369b694dd1 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:25.326310 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-489d67be-31f8-4465-b115-3a369b694dd1 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:25.326758 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-489d67be-31f8-4465-b115-3a369b694dd1 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:25.440770 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e78bd743-da69-4272-9469-be7545015a3c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.774655 Apr 16 21:16:25.441668 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1306/2735] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:16:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:16:25.448202 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3faa4fa6-0433-4329-a212-39554bd830fc tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:16:25.450950 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3faa4fa6-0433-4329-a212-39554bd830fc tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:25.455752 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3faa4fa6-0433-4329-a212-39554bd830fc tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:25.456190 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3faa4fa6-0433-4329-a212-39554bd830fc tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:25.457135 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3faa4fa6-0433-4329-a212-39554bd830fc tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:25.457589 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3faa4fa6-0433-4329-a212-39554bd830fc tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:25.473830 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-489d67be-31f8-4465-b115-3a369b694dd1 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:25.479433 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-489d67be-31f8-4465-b115-3a369b694dd1 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1473 microversion: 2.1 time: 0.163965 Apr 16 21:16:25.480039 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1430/2736] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:25 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1473 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:25.484992 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-67802d42-b5a5-4df0-8bca-ae9970d30ed2 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb95a8b160>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:25.494185 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-3faa4fa6-0433-4329-a212-39554bd830fc tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lazy-loading 'flavor' on Instance uuid 89f07150-d0ab-41c9-a9bf-692e9d9c5140 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:16:25.532195 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-67802d42-b5a5-4df0-8bca-ae9970d30ed2 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73" status: 200 len: 1438 microversion: 2.1 time: 0.050892 Apr 16 21:16:25.532847 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1431/2737] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:16:25 2022] GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73 => generated 1438 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:25.538377 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a632c1d4-8125-4fc4-9272-de660437a17b tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:25.539187 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a632c1d4-8125-4fc4-9272-de660437a17b tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:25.547402 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a632c1d4-8125-4fc4-9272-de660437a17b tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:25.547870 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a632c1d4-8125-4fc4-9272-de660437a17b tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:25.548800 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a632c1d4-8125-4fc4-9272-de660437a17b tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:25.549243 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a632c1d4-8125-4fc4-9272-de660437a17b tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:25.621701 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-a632c1d4-8125-4fc4-9272-de660437a17b tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lazy-loading 'services' on Instance uuid 9ce03e87-6962-45d5-910e-f87b61fef356 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:16:25.640069 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a632c1d4-8125-4fc4-9272-de660437a17b tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1927 microversion: 2.75 time: 0.106013 Apr 16 21:16:25.640694 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1432/2738] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:16:25 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1927 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:16:25.645300 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1a1d683b-72f6-48b5-831a-351454b9f28b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:25.645910 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1a1d683b-72f6-48b5-831a-351454b9f28b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:25.698070 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1a1d683b-72f6-48b5-831a-351454b9f28b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:25.705035 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1a1d683b-72f6-48b5-831a-351454b9f28b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18" status: 200 len: 1215 microversion: 2.1 time: 0.063350 Apr 16 21:16:25.705617 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1433/2739] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:25 2022] GET /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18 => generated 1215 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:25.709964 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-9174537d-e6f1-411c-9ae6-b1cedf171a97 req-5d625c3b-d116-48a2-8bc6-206722631022 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2389c37c-30cc-4355-a3a2-44653cb17fd6", "tag": "0b67129e-ca8a-4c23-aff2-5c3d6e70e65a"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:16:25.718720 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-9174537d-e6f1-411c-9ae6-b1cedf171a97 req-5d625c3b-d116-48a2-8bc6-206722631022 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:25.719167 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-9174537d-e6f1-411c-9ae6-b1cedf171a97 req-5d625c3b-d116-48a2-8bc6-206722631022 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:25.732346 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-9174537d-e6f1-411c-9ae6-b1cedf171a97 req-5d625c3b-d116-48a2-8bc6-206722631022 service nova] Creating event network-changed:0b67129e-ca8a-4c23-aff2-5c3d6e70e65a for instance 2389c37c-30cc-4355-a3a2-44653cb17fd6 on nch2-master-1 Apr 16 21:16:25.738214 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [req-9174537d-e6f1-411c-9ae6-b1cedf171a97 req-5d625c3b-d116-48a2-8bc6-206722631022 service nova] Instance 2389c37c-30cc-4355-a3a2-44653cb17fd6 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 16 21:16:25.748675 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-9174537d-e6f1-411c-9ae6-b1cedf171a97 req-5d625c3b-d116-48a2-8bc6-206722631022 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041905 Apr 16 21:16:25.749274 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1434/2740] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:16:25.769299 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e625eab8-69a8-4bb5-b312-5055cab37ff6 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:25.769509 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e625eab8-69a8-4bb5-b312-5055cab37ff6 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 8cb60874-b0f3-4055-a4d1-531f4a147992] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:25.776399 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e625eab8-69a8-4bb5-b312-5055cab37ff6 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:25.776856 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e625eab8-69a8-4bb5-b312-5055cab37ff6 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:25.777640 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e625eab8-69a8-4bb5-b312-5055cab37ff6 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:25.778081 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e625eab8-69a8-4bb5-b312-5055cab37ff6 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:25.876608 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3faa4fa6-0433-4329-a212-39554bd830fc tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "POST /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140/action" status: 200 len: 32 microversion: 2.1 time: 0.433593 Apr 16 21:16:25.880337 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1307/2741] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:16:25 2022] POST /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140/action => generated 32 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:16:25.887841 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-23782165-9c0f-41ec-b13a-026d40acb110 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:25.888560 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-23782165-9c0f-41ec-b13a-026d40acb110 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:25.895355 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-23782165-9c0f-41ec-b13a-026d40acb110 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:25.895813 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-23782165-9c0f-41ec-b13a-026d40acb110 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:25.896622 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-23782165-9c0f-41ec-b13a-026d40acb110 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:25.897066 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-23782165-9c0f-41ec-b13a-026d40acb110 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:25.923853 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e625eab8-69a8-4bb5-b312-5055cab37ff6 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:25.931806 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e625eab8-69a8-4bb5-b312-5055cab37ff6 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992" status: 200 len: 1324 microversion: 2.1 time: 0.167090 Apr 16 21:16:25.940113 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1435/2742] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:25 2022] GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992 => generated 1324 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:26.176457 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-23782165-9c0f-41ec-b13a-026d40acb110 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:26.184702 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-23782165-9c0f-41ec-b13a-026d40acb110 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140" status: 200 len: 1523 microversion: 2.1 time: 0.301676 Apr 16 21:16:26.185281 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1308/2743] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:25 2022] GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140 => generated 1523 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:26.497804 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f34ce8ae-6739-4a4c-b3a3-2c381b1c3949 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:26.498478 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f34ce8ae-6739-4a4c-b3a3-2c381b1c3949 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:26.505009 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f34ce8ae-6739-4a4c-b3a3-2c381b1c3949 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:26.505477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f34ce8ae-6739-4a4c-b3a3-2c381b1c3949 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:26.506276 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f34ce8ae-6739-4a4c-b3a3-2c381b1c3949 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:26.506723 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f34ce8ae-6739-4a4c-b3a3-2c381b1c3949 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:26.546156 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d010c923-b40f-48df-ab2d-d89e74cd6f7d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb9ff73040>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:26.593535 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d010c923-b40f-48df-ab2d-d89e74cd6f7d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73" status: 200 len: 1438 microversion: 2.1 time: 0.051208 Apr 16 21:16:26.594118 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1309/2744] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:16:26 2022] GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73 => generated 1438 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:26.657116 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f34ce8ae-6739-4a4c-b3a3-2c381b1c3949 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:26.661208 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cddac925-7f83-418b-8627-87b7b632ff73 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:26.665577 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-cddac925-7f83-418b-8627-87b7b632ff73 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:26.668423 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cddac925-7f83-418b-8627-87b7b632ff73 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:26.669098 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cddac925-7f83-418b-8627-87b7b632ff73 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:26.670107 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cddac925-7f83-418b-8627-87b7b632ff73 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:26.670733 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cddac925-7f83-418b-8627-87b7b632ff73 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:26.686287 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f34ce8ae-6739-4a4c-b3a3-2c381b1c3949 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1473 microversion: 2.1 time: 0.187887 Apr 16 21:16:26.694126 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1436/2745] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:26 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1473 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:26.699886 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-bbec8f27-40d2-4a39-b48f-647743a49a77 req-de287517-68c5-4511-98cc-6d1077b7b0cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff70294f-a73f-4dcf-aaf4-bd979106f1b8", "name": "network-vif-plugged", "status": "completed", "tag": "16b4583f-548f-4d1c-8ae5-e1254189e93a"}, {"server_uuid": "8cb60874-b0f3-4055-a4d1-531f4a147992", "name": "network-vif-plugged", "status": "completed", "tag": "f7e32037-5681-45d7-a2cb-a1ccb583ae68"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:16:26.710985 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-bbec8f27-40d2-4a39-b48f-647743a49a77 req-de287517-68c5-4511-98cc-6d1077b7b0cd service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:26.716370 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-bbec8f27-40d2-4a39-b48f-647743a49a77 req-de287517-68c5-4511-98cc-6d1077b7b0cd service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:26.724661 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-bbec8f27-40d2-4a39-b48f-647743a49a77 req-de287517-68c5-4511-98cc-6d1077b7b0cd service nova] Creating event network-vif-plugged:16b4583f-548f-4d1c-8ae5-e1254189e93a for instance ff70294f-a73f-4dcf-aaf4-bd979106f1b8 on nch2-master-1 Apr 16 21:16:26.725180 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-bbec8f27-40d2-4a39-b48f-647743a49a77 req-de287517-68c5-4511-98cc-6d1077b7b0cd service nova] Creating event network-vif-plugged:f7e32037-5681-45d7-a2cb-a1ccb583ae68 for instance 8cb60874-b0f3-4055-a4d1-531f4a147992 on nch2-master-1 Apr 16 21:16:26.732448 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-bbec8f27-40d2-4a39-b48f-647743a49a77 req-de287517-68c5-4511-98cc-6d1077b7b0cd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036835 Apr 16 21:16:26.733106 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1437/2746] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:16:26 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:16:26.741664 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f3c51c23-dcc7-4a49-8d25-86d77ee7fbe1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:26.742370 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f3c51c23-dcc7-4a49-8d25-86d77ee7fbe1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:26.749188 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f3c51c23-dcc7-4a49-8d25-86d77ee7fbe1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:26.749655 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f3c51c23-dcc7-4a49-8d25-86d77ee7fbe1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:26.750439 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f3c51c23-dcc7-4a49-8d25-86d77ee7fbe1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:26.751089 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f3c51c23-dcc7-4a49-8d25-86d77ee7fbe1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:26.765951 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-cddac925-7f83-418b-8627-87b7b632ff73 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lazy-loading 'services' on Instance uuid 9ce03e87-6962-45d5-910e-f87b61fef356 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:16:26.788732 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cddac925-7f83-418b-8627-87b7b632ff73 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1927 microversion: 2.75 time: 0.131511 Apr 16 21:16:26.790180 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1310/2747] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:16:26 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1927 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:16:26.826200 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f3c51c23-dcc7-4a49-8d25-86d77ee7fbe1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:26.826729 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f3c51c23-dcc7-4a49-8d25-86d77ee7fbe1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18" status: 200 len: 1219 microversion: 2.1 time: 0.089421 Apr 16 21:16:26.827303 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1438/2748] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:26 2022] GET /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:26.957018 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fbf058d3-5a00-4d60-b48d-f23c1e58392d tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:26.957652 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-fbf058d3-5a00-4d60-b48d-f23c1e58392d tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 8cb60874-b0f3-4055-a4d1-531f4a147992] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:26.965216 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fbf058d3-5a00-4d60-b48d-f23c1e58392d tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:26.965670 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fbf058d3-5a00-4d60-b48d-f23c1e58392d tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:26.966438 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fbf058d3-5a00-4d60-b48d-f23c1e58392d tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:26.966922 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fbf058d3-5a00-4d60-b48d-f23c1e58392d tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:27.099342 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-fbf058d3-5a00-4d60-b48d-f23c1e58392d tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:27.107222 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fbf058d3-5a00-4d60-b48d-f23c1e58392d tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992" status: 200 len: 1324 microversion: 2.1 time: 0.154088 Apr 16 21:16:27.111559 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1311/2749] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:26 2022] GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992 => generated 1324 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:27.202892 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-94362674-0acd-4e96-acc1-0003b90f5020 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:27.203504 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-94362674-0acd-4e96-acc1-0003b90f5020 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:27.209617 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-94362674-0acd-4e96-acc1-0003b90f5020 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:27.210077 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-94362674-0acd-4e96-acc1-0003b90f5020 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:27.210877 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-94362674-0acd-4e96-acc1-0003b90f5020 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:27.211932 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-94362674-0acd-4e96-acc1-0003b90f5020 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:27.340857 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-94362674-0acd-4e96-acc1-0003b90f5020 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:27.348704 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-94362674-0acd-4e96-acc1-0003b90f5020 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140" status: 200 len: 1523 microversion: 2.1 time: 0.149619 Apr 16 21:16:27.349222 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1439/2750] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:27 2022] GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140 => generated 1523 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:27.607077 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5dabeb0d-1d3c-4bca-947b-8b7fb20d07ef tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb958fbf70>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:27.649233 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5dabeb0d-1d3c-4bca-947b-8b7fb20d07ef tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73" status: 200 len: 1438 microversion: 2.1 time: 0.045433 Apr 16 21:16:27.650729 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1312/2751] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:16:27 2022] GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73 => generated 1438 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:27.698904 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-12747ad7-40ca-4810-af59-e2699f635c09 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:27.699555 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-12747ad7-40ca-4810-af59-e2699f635c09 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:27.706370 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-12747ad7-40ca-4810-af59-e2699f635c09 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:27.708147 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-12747ad7-40ca-4810-af59-e2699f635c09 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:27.708147 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-12747ad7-40ca-4810-af59-e2699f635c09 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:27.708147 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-12747ad7-40ca-4810-af59-e2699f635c09 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:27.810557 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fecb377e-701d-48c9-b561-d97fd6c3156a tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:27.811218 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-fecb377e-701d-48c9-b561-d97fd6c3156a tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:27.818588 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fecb377e-701d-48c9-b561-d97fd6c3156a tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:27.819061 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fecb377e-701d-48c9-b561-d97fd6c3156a tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:27.819852 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fecb377e-701d-48c9-b561-d97fd6c3156a tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:27.820335 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fecb377e-701d-48c9-b561-d97fd6c3156a tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:27.835866 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-12747ad7-40ca-4810-af59-e2699f635c09 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:27.843341 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-12747ad7-40ca-4810-af59-e2699f635c09 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1473 microversion: 2.1 time: 0.148470 Apr 16 21:16:27.843917 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1440/2752] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:27 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1473 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:27.848670 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-37c13a83-2e68-4c80-85a1-12fb47564bb7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:27.849280 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-37c13a83-2e68-4c80-85a1-12fb47564bb7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:27.855982 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-37c13a83-2e68-4c80-85a1-12fb47564bb7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:27.856460 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-37c13a83-2e68-4c80-85a1-12fb47564bb7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:27.857293 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-37c13a83-2e68-4c80-85a1-12fb47564bb7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:27.857675 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-37c13a83-2e68-4c80-85a1-12fb47564bb7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:27.892394 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-fecb377e-701d-48c9-b561-d97fd6c3156a tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lazy-loading 'services' on Instance uuid 9ce03e87-6962-45d5-910e-f87b61fef356 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:16:27.910435 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fecb377e-701d-48c9-b561-d97fd6c3156a tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1927 microversion: 2.75 time: 0.104658 Apr 16 21:16:27.911021 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1313/2753] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:16:27 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1927 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:16:27.924729 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-37c13a83-2e68-4c80-85a1-12fb47564bb7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:27.932222 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-37c13a83-2e68-4c80-85a1-12fb47564bb7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18" status: 200 len: 1219 microversion: 2.1 time: 0.087210 Apr 16 21:16:27.932790 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1441/2754] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:27 2022] GET /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:28.124825 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0f4e1538-c345-443b-9c18-d202be31be16 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:28.125392 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0f4e1538-c345-443b-9c18-d202be31be16 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 8cb60874-b0f3-4055-a4d1-531f4a147992] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:28.131570 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0f4e1538-c345-443b-9c18-d202be31be16 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:28.132027 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0f4e1538-c345-443b-9c18-d202be31be16 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:28.132903 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0f4e1538-c345-443b-9c18-d202be31be16 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:28.133909 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0f4e1538-c345-443b-9c18-d202be31be16 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:28.257659 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0f4e1538-c345-443b-9c18-d202be31be16 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:28.265795 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0f4e1538-c345-443b-9c18-d202be31be16 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992" status: 200 len: 1324 microversion: 2.1 time: 0.144831 Apr 16 21:16:28.266360 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1314/2755] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:28 2022] GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992 => generated 1324 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:28.366015 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-dc8b6791-f444-4223-88d4-e80da1319ac5 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:28.366707 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-dc8b6791-f444-4223-88d4-e80da1319ac5 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:28.373337 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dc8b6791-f444-4223-88d4-e80da1319ac5 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:28.377631 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dc8b6791-f444-4223-88d4-e80da1319ac5 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:28.377631 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dc8b6791-f444-4223-88d4-e80da1319ac5 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:28.377631 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dc8b6791-f444-4223-88d4-e80da1319ac5 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:28.501650 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-dc8b6791-f444-4223-88d4-e80da1319ac5 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:28.509861 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-dc8b6791-f444-4223-88d4-e80da1319ac5 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140" status: 200 len: 1523 microversion: 2.1 time: 0.147839 Apr 16 21:16:28.510425 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1442/2756] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:28 2022] GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:28.662761 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-17aef45e-f749-4774-8a1a-aeceb4e3077b tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb964e6e50>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:28.717272 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-17aef45e-f749-4774-8a1a-aeceb4e3077b tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73" status: 200 len: 1438 microversion: 2.1 time: 0.058263 Apr 16 21:16:28.717890 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1315/2757] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:16:28 2022] GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73 => generated 1438 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:28.860426 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-631a3d24-c274-4ef1-be26-60a7aef82197 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:28.861041 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-631a3d24-c274-4ef1-be26-60a7aef82197 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:28.868460 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-631a3d24-c274-4ef1-be26-60a7aef82197 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:28.872418 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-631a3d24-c274-4ef1-be26-60a7aef82197 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:28.872418 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-631a3d24-c274-4ef1-be26-60a7aef82197 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:28.872418 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-631a3d24-c274-4ef1-be26-60a7aef82197 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:28.932617 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3a43d0ae-469b-4907-8b2f-bdd9b52ea7a7 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:28.933230 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3a43d0ae-469b-4907-8b2f-bdd9b52ea7a7 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:28.941121 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3a43d0ae-469b-4907-8b2f-bdd9b52ea7a7 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:28.941601 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3a43d0ae-469b-4907-8b2f-bdd9b52ea7a7 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:28.942387 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3a43d0ae-469b-4907-8b2f-bdd9b52ea7a7 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:28.942829 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3a43d0ae-469b-4907-8b2f-bdd9b52ea7a7 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:29.007699 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-631a3d24-c274-4ef1-be26-60a7aef82197 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:29.015234 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-631a3d24-c274-4ef1-be26-60a7aef82197 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1473 microversion: 2.1 time: 0.158723 Apr 16 21:16:29.020352 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1443/2758] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:28 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1473 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:29.020498 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-3a43d0ae-469b-4907-8b2f-bdd9b52ea7a7 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lazy-loading 'services' on Instance uuid 9ce03e87-6962-45d5-910e-f87b61fef356 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:16:29.020633 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6304247a-e95b-4761-b347-7324c27db853 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:29.021382 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6304247a-e95b-4761-b347-7324c27db853 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:29.026939 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6304247a-e95b-4761-b347-7324c27db853 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:29.027400 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6304247a-e95b-4761-b347-7324c27db853 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:29.028295 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6304247a-e95b-4761-b347-7324c27db853 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:29.028960 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6304247a-e95b-4761-b347-7324c27db853 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:29.034998 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3a43d0ae-469b-4907-8b2f-bdd9b52ea7a7 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1927 microversion: 2.75 time: 0.108012 Apr 16 21:16:29.035579 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1316/2759] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:16:28 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1927 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:16:29.088942 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6304247a-e95b-4761-b347-7324c27db853 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:29.096151 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6304247a-e95b-4761-b347-7324c27db853 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18" status: 200 len: 1211 microversion: 2.1 time: 0.079360 Apr 16 21:16:29.096739 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1444/2760] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:29 2022] GET /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18 => generated 1211 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:29.284576 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e8d1e1f0-c7a6-49f4-b710-dfabef730e3b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:29.285204 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e8d1e1f0-c7a6-49f4-b710-dfabef730e3b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 8cb60874-b0f3-4055-a4d1-531f4a147992] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:29.294305 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e8d1e1f0-c7a6-49f4-b710-dfabef730e3b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:29.294785 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e8d1e1f0-c7a6-49f4-b710-dfabef730e3b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:29.295574 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e8d1e1f0-c7a6-49f4-b710-dfabef730e3b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:29.296119 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e8d1e1f0-c7a6-49f4-b710-dfabef730e3b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:29.433504 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e8d1e1f0-c7a6-49f4-b710-dfabef730e3b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:29.440929 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e8d1e1f0-c7a6-49f4-b710-dfabef730e3b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992" status: 200 len: 1324 microversion: 2.1 time: 0.160686 Apr 16 21:16:29.441511 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1317/2761] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:29 2022] GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992 => generated 1324 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:29.527538 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f6fe4d77-4fdc-40ef-a15a-227db388eb6a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:29.528191 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f6fe4d77-4fdc-40ef-a15a-227db388eb6a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:29.534347 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6fe4d77-4fdc-40ef-a15a-227db388eb6a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:29.534872 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6fe4d77-4fdc-40ef-a15a-227db388eb6a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:29.535704 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6fe4d77-4fdc-40ef-a15a-227db388eb6a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:29.536191 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6fe4d77-4fdc-40ef-a15a-227db388eb6a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:29.663525 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f6fe4d77-4fdc-40ef-a15a-227db388eb6a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:29.671060 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f6fe4d77-4fdc-40ef-a15a-227db388eb6a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140" status: 200 len: 1523 microversion: 2.1 time: 0.148103 Apr 16 21:16:29.674229 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1445/2762] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:29 2022] GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140 => generated 1523 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:29.730660 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a39d8915-a016-48e2-bd5e-84d243dee80e tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb9589ed30>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:29.772296 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a39d8915-a016-48e2-bd5e-84d243dee80e tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73" status: 200 len: 1438 microversion: 2.1 time: 0.045485 Apr 16 21:16:29.772869 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1318/2763] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:16:29 2022] GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73 => generated 1438 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:30.033235 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e02183d2-0fe5-48e0-a9e8-da166656d434 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:30.033963 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e02183d2-0fe5-48e0-a9e8-da166656d434 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:30.040717 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e02183d2-0fe5-48e0-a9e8-da166656d434 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:30.041176 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e02183d2-0fe5-48e0-a9e8-da166656d434 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:30.041961 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e02183d2-0fe5-48e0-a9e8-da166656d434 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:30.042405 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e02183d2-0fe5-48e0-a9e8-da166656d434 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:30.056701 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-de402d00-92d1-45d0-bc6c-ec74bb5585e2 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:30.057888 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-de402d00-92d1-45d0-bc6c-ec74bb5585e2 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:30.063945 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-de402d00-92d1-45d0-bc6c-ec74bb5585e2 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:30.064655 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-de402d00-92d1-45d0-bc6c-ec74bb5585e2 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:30.065435 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-de402d00-92d1-45d0-bc6c-ec74bb5585e2 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:30.065872 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-de402d00-92d1-45d0-bc6c-ec74bb5585e2 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:30.138013 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-de402d00-92d1-45d0-bc6c-ec74bb5585e2 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lazy-loading 'services' on Instance uuid 9ce03e87-6962-45d5-910e-f87b61fef356 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:16:30.156673 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-de402d00-92d1-45d0-bc6c-ec74bb5585e2 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1927 microversion: 2.75 time: 0.105103 Apr 16 21:16:30.160418 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1319/2764] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:16:30 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1927 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:16:30.162132 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8166426a-3380-482b-acca-6438a976a4b1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:30.162899 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8166426a-3380-482b-acca-6438a976a4b1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:30.169100 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8166426a-3380-482b-acca-6438a976a4b1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:30.169771 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8166426a-3380-482b-acca-6438a976a4b1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:30.170731 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8166426a-3380-482b-acca-6438a976a4b1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:30.171176 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8166426a-3380-482b-acca-6438a976a4b1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:30.198018 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e02183d2-0fe5-48e0-a9e8-da166656d434 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:30.205455 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e02183d2-0fe5-48e0-a9e8-da166656d434 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1470 microversion: 2.1 time: 0.176329 Apr 16 21:16:30.206037 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1446/2765] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:30 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1470 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:30.224509 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-312fb6f6-0f03-47ac-9659-3946d1095cbd tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:16:30.225049 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-312fb6f6-0f03-47ac-9659-3946d1095cbd tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:30.231624 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-312fb6f6-0f03-47ac-9659-3946d1095cbd tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:30.232086 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-312fb6f6-0f03-47ac-9659-3946d1095cbd tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:30.232930 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-312fb6f6-0f03-47ac-9659-3946d1095cbd tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:30.233383 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-312fb6f6-0f03-47ac-9659-3946d1095cbd tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:30.239104 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8166426a-3380-482b-acca-6438a976a4b1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:30.246951 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8166426a-3380-482b-acca-6438a976a4b1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18" status: 200 len: 1267 microversion: 2.1 time: 0.088644 Apr 16 21:16:30.247540 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1320/2766] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:30 2022] GET /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18 => generated 1267 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:30.459434 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a0bbc22a-eace-4c34-85dc-49cf5e483dce tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:30.460136 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a0bbc22a-eace-4c34-85dc-49cf5e483dce tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 8cb60874-b0f3-4055-a4d1-531f4a147992] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:30.466260 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a0bbc22a-eace-4c34-85dc-49cf5e483dce tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:30.466831 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a0bbc22a-eace-4c34-85dc-49cf5e483dce tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:30.467687 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a0bbc22a-eace-4c34-85dc-49cf5e483dce tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:30.468300 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a0bbc22a-eace-4c34-85dc-49cf5e483dce tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:30.511801 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-312fb6f6-0f03-47ac-9659-3946d1095cbd tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "POST /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6/action" status: 204 len: 0 microversion: 2.1 time: 0.290982 Apr 16 21:16:30.516054 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1447/2767] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:16:30 2022] POST /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6/action => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 16 21:16:30.521692 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-db6c2f81-e663-4608-9059-b6dbf1a1f452 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:30.522461 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-db6c2f81-e663-4608-9059-b6dbf1a1f452 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:30.528934 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-db6c2f81-e663-4608-9059-b6dbf1a1f452 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:30.529404 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-db6c2f81-e663-4608-9059-b6dbf1a1f452 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:30.530199 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-db6c2f81-e663-4608-9059-b6dbf1a1f452 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:30.530906 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-db6c2f81-e663-4608-9059-b6dbf1a1f452 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:30.605918 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a0bbc22a-eace-4c34-85dc-49cf5e483dce tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:30.613854 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a0bbc22a-eace-4c34-85dc-49cf5e483dce tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992" status: 200 len: 1324 microversion: 2.1 time: 0.158391 Apr 16 21:16:30.614851 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1321/2768] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:30 2022] GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992 => generated 1324 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:30.665238 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-db6c2f81-e663-4608-9059-b6dbf1a1f452 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:30.673213 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-db6c2f81-e663-4608-9059-b6dbf1a1f452 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1470 microversion: 2.1 time: 0.155823 Apr 16 21:16:30.674021 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1448/2769] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:30 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:30.688238 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-272a8f37-b936-4c88-8234-67a7ed8642ab tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:30.688449 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-272a8f37-b936-4c88-8234-67a7ed8642ab tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:30.694478 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-272a8f37-b936-4c88-8234-67a7ed8642ab tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:30.694941 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-272a8f37-b936-4c88-8234-67a7ed8642ab tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:30.695766 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-272a8f37-b936-4c88-8234-67a7ed8642ab tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:30.696236 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-272a8f37-b936-4c88-8234-67a7ed8642ab tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:30.786836 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-96545ae8-e4af-4a7c-992b-ca3178d94832 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb95a5e670>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:30.843678 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-96545ae8-e4af-4a7c-992b-ca3178d94832 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73" status: 200 len: 1438 microversion: 2.1 time: 0.060248 Apr 16 21:16:30.849748 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1449/2770] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:16:30 2022] GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73 => generated 1438 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:30.892554 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-272a8f37-b936-4c88-8234-67a7ed8642ab tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:30.902910 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-272a8f37-b936-4c88-8234-67a7ed8642ab tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140" status: 200 len: 1523 microversion: 2.1 time: 0.218725 Apr 16 21:16:30.910880 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1322/2771] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:30 2022] GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140 => generated 1523 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:31.177423 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ecbc6d87-b492-45ae-99fe-346aa8d1ab9c tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:31.178520 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ecbc6d87-b492-45ae-99fe-346aa8d1ab9c tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:31.193195 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ecbc6d87-b492-45ae-99fe-346aa8d1ab9c tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:31.193195 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ecbc6d87-b492-45ae-99fe-346aa8d1ab9c tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:31.193195 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ecbc6d87-b492-45ae-99fe-346aa8d1ab9c tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:31.193195 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ecbc6d87-b492-45ae-99fe-346aa8d1ab9c tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:31.269597 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c6b3cc06-a13d-4e52-982f-83420d1b7c6c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:31.271315 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c6b3cc06-a13d-4e52-982f-83420d1b7c6c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:31.275512 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-ecbc6d87-b492-45ae-99fe-346aa8d1ab9c tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lazy-loading 'services' on Instance uuid 9ce03e87-6962-45d5-910e-f87b61fef356 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:16:31.289297 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c6b3cc06-a13d-4e52-982f-83420d1b7c6c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:31.293326 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c6b3cc06-a13d-4e52-982f-83420d1b7c6c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:31.294196 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c6b3cc06-a13d-4e52-982f-83420d1b7c6c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:31.294646 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c6b3cc06-a13d-4e52-982f-83420d1b7c6c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:31.300820 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ecbc6d87-b492-45ae-99fe-346aa8d1ab9c tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1927 microversion: 2.75 time: 0.128000 Apr 16 21:16:31.301705 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1450/2772] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:16:31 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1927 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:16:31.601470 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c6b3cc06-a13d-4e52-982f-83420d1b7c6c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:31.608940 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c6b3cc06-a13d-4e52-982f-83420d1b7c6c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18" status: 200 len: 1275 microversion: 2.1 time: 0.347955 Apr 16 21:16:31.609606 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1323/2773] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:31 2022] GET /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18 => generated 1275 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:31.632353 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ff3f16fd-c5d9-43b7-9818-5ce9d4259672 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:31.633954 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ff3f16fd-c5d9-43b7-9818-5ce9d4259672 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 8cb60874-b0f3-4055-a4d1-531f4a147992] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:31.640916 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ff3f16fd-c5d9-43b7-9818-5ce9d4259672 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:31.641402 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ff3f16fd-c5d9-43b7-9818-5ce9d4259672 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:31.642305 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ff3f16fd-c5d9-43b7-9818-5ce9d4259672 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:31.642884 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ff3f16fd-c5d9-43b7-9818-5ce9d4259672 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:31.690613 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f55bcaef-d46d-4556-a3c3-8ba736b52e7f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:31.691391 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f55bcaef-d46d-4556-a3c3-8ba736b52e7f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:31.699873 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f55bcaef-d46d-4556-a3c3-8ba736b52e7f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:31.700483 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f55bcaef-d46d-4556-a3c3-8ba736b52e7f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:31.701480 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f55bcaef-d46d-4556-a3c3-8ba736b52e7f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:31.702003 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f55bcaef-d46d-4556-a3c3-8ba736b52e7f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:31.873900 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f55bcaef-d46d-4556-a3c3-8ba736b52e7f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:31.882416 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ff3f16fd-c5d9-43b7-9818-5ce9d4259672 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:31.882810 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f55bcaef-d46d-4556-a3c3-8ba736b52e7f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1470 microversion: 2.1 time: 0.197041 Apr 16 21:16:31.890509 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ff3f16fd-c5d9-43b7-9818-5ce9d4259672 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992" status: 200 len: 1520 microversion: 2.1 time: 0.263457 Apr 16 21:16:31.891427 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1451/2774] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:31 2022] GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992 => generated 1520 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:31.896533 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-45d4c872-ef5f-4a29-92b3-aacaf01a1582 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb95b0b670>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:31.902013 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1324/2775] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:31 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1470 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:31.917832 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4e15eede-ac74-4aa7-b4da-3bd30d259c36 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:31.918618 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4e15eede-ac74-4aa7-b4da-3bd30d259c36 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 8cb60874-b0f3-4055-a4d1-531f4a147992] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:31.925312 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4e15eede-ac74-4aa7-b4da-3bd30d259c36 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:31.926127 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4e15eede-ac74-4aa7-b4da-3bd30d259c36 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:31.926998 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4e15eede-ac74-4aa7-b4da-3bd30d259c36 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:31.927518 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4e15eede-ac74-4aa7-b4da-3bd30d259c36 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:31.968967 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-45d4c872-ef5f-4a29-92b3-aacaf01a1582 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73" status: 200 len: 1438 microversion: 2.1 time: 0.075956 Apr 16 21:16:31.975320 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1452/2776] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:16:31 2022] GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73 => generated 1438 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:31.981675 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-aecabe0a-e052-4308-84aa-0edd02e2bb3e tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:31.987048 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-aecabe0a-e052-4308-84aa-0edd02e2bb3e tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:31.989773 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aecabe0a-e052-4308-84aa-0edd02e2bb3e tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:31.990316 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aecabe0a-e052-4308-84aa-0edd02e2bb3e tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:31.991194 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aecabe0a-e052-4308-84aa-0edd02e2bb3e tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:31.991713 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aecabe0a-e052-4308-84aa-0edd02e2bb3e tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:32.103436 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4e15eede-ac74-4aa7-b4da-3bd30d259c36 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:32.114017 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4e15eede-ac74-4aa7-b4da-3bd30d259c36 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992" status: 200 len: 1520 microversion: 2.1 time: 0.201580 Apr 16 21:16:32.115094 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1325/2777] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:31 2022] GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992 => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:32.132503 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-99bbe154-8c5e-47fc-87eb-190e891cd88c tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-247888983"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:16:32.133802 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-99bbe154-8c5e-47fc-87eb-190e891cd88c tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 8cb60874-b0f3-4055-a4d1-531f4a147992] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:32.140486 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-99bbe154-8c5e-47fc-87eb-190e891cd88c tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:32.141085 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-99bbe154-8c5e-47fc-87eb-190e891cd88c tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:32.141979 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-99bbe154-8c5e-47fc-87eb-190e891cd88c tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:32.142705 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-99bbe154-8c5e-47fc-87eb-190e891cd88c tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:32.499877 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-aecabe0a-e052-4308-84aa-0edd02e2bb3e tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:32.509152 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-aecabe0a-e052-4308-84aa-0edd02e2bb3e tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140" status: 200 len: 1523 microversion: 2.1 time: 0.532657 Apr 16 21:16:32.509862 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1453/2778] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:31 2022] GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140 => generated 1523 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:32.515352 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cc06e9cc-f2fe-489f-be57-85083fec69e0 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:32.516204 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cc06e9cc-f2fe-489f-be57-85083fec69e0 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:32.526673 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cc06e9cc-f2fe-489f-be57-85083fec69e0 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:32.526673 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cc06e9cc-f2fe-489f-be57-85083fec69e0 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:32.526673 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cc06e9cc-f2fe-489f-be57-85083fec69e0 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:32.526673 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cc06e9cc-f2fe-489f-be57-85083fec69e0 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:32.619163 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-cc06e9cc-f2fe-489f-be57-85083fec69e0 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lazy-loading 'services' on Instance uuid 9ce03e87-6962-45d5-910e-f87b61fef356 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:16:32.664056 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cc06e9cc-f2fe-489f-be57-85083fec69e0 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1927 microversion: 2.75 time: 0.146980 Apr 16 21:16:32.664056 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1454/2779] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:16:32 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1927 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:16:32.685228 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-9e497a84-43c1-484f-b253-684286201ad5 req-9e67fa2d-0346-4571-b5d1-4db91315b802 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2389c37c-30cc-4355-a3a2-44653cb17fd6", "name": "network-vif-plugged", "status": "completed", "tag": "0b67129e-ca8a-4c23-aff2-5c3d6e70e65a"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:16:32.692288 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-99bbe154-8c5e-47fc-87eb-190e891cd88c tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "POST /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992/action" status: 202 len: 0 microversion: 2.1 time: 0.564578 Apr 16 21:16:32.694379 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1326/2780] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:16:32 2022] POST /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992/action => generated 0 bytes in 568 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 16 21:16:32.710084 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-64beb2be-1d24-42d1-9a3f-a3816d2ee769 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:32.712799 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-64beb2be-1d24-42d1-9a3f-a3816d2ee769 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:32.725799 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-9e497a84-43c1-484f-b253-684286201ad5 req-9e67fa2d-0346-4571-b5d1-4db91315b802 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:32.726348 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-9e497a84-43c1-484f-b253-684286201ad5 req-9e67fa2d-0346-4571-b5d1-4db91315b802 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:32.726504 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-64beb2be-1d24-42d1-9a3f-a3816d2ee769 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:32.727542 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-64beb2be-1d24-42d1-9a3f-a3816d2ee769 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:32.728497 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-64beb2be-1d24-42d1-9a3f-a3816d2ee769 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:32.741551 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-64beb2be-1d24-42d1-9a3f-a3816d2ee769 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:32.756428 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-9e497a84-43c1-484f-b253-684286201ad5 req-9e67fa2d-0346-4571-b5d1-4db91315b802 service nova] Creating event network-vif-plugged:0b67129e-ca8a-4c23-aff2-5c3d6e70e65a for instance 2389c37c-30cc-4355-a3a2-44653cb17fd6 on nch2-master-1 Apr 16 21:16:32.771307 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-9e497a84-43c1-484f-b253-684286201ad5 req-9e67fa2d-0346-4571-b5d1-4db91315b802 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109193 Apr 16 21:16:32.774505 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1455/2781] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:16:32.791772 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-03195287-6e41-483b-b3e0-3f61630febd9 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '.version_select at 0x7fbb959c04c0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:33.060596 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-64beb2be-1d24-42d1-9a3f-a3816d2ee769 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:33.087271 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-64beb2be-1d24-42d1-9a3f-a3816d2ee769 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18" status: 200 len: 1315 microversion: 2.1 time: 0.391586 Apr 16 21:16:33.104328 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1327/2782] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:32 2022] GET /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18 => generated 1315 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:33.114720 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ead82de9-3071-4281-9f2c-ddfefb56f918 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:33.117106 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ead82de9-3071-4281-9f2c-ddfefb56f918 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:33.143787 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ead82de9-3071-4281-9f2c-ddfefb56f918 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:33.144389 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ead82de9-3071-4281-9f2c-ddfefb56f918 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:33.151166 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ead82de9-3071-4281-9f2c-ddfefb56f918 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:33.151824 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ead82de9-3071-4281-9f2c-ddfefb56f918 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:33.208905 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-03195287-6e41-483b-b3e0-3f61630febd9 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "DELETE /compute/v2.1/images/519a00e1-dffc-4883-99b3-e1f11eaa0f3a" status: 204 len: 0 microversion: 2.1 time: 0.433080 Apr 16 21:16:33.212090 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1456/2783] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:32 2022] DELETE /compute/v2.1/images/519a00e1-dffc-4883-99b3-e1f11eaa0f3a => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:16:33.227917 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d36b6b4b-52a5-4d5b-87f5-c18608164657 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb95a34670>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:33.317076 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d36b6b4b-52a5-4d5b-87f5-c18608164657 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73" status: 200 len: 1438 microversion: 2.1 time: 0.106196 Apr 16 21:16:33.318188 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1457/2784] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:16:33 2022] GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73 => generated 1438 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:33.324082 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-821f498a-caa6-4044-9126-6f1b79945f18 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '.version_select at 0x7fbb95a5edc0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:33.352367 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-821f498a-caa6-4044-9126-6f1b79945f18 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] HTTP exception thrown: Image not found. Apr 16 21:16:33.356343 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-821f498a-caa6-4044-9126-6f1b79945f18 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Returning 404 to user: Image not found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:16:33.356343 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-821f498a-caa6-4044-9126-6f1b79945f18 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/images/519a00e1-dffc-4883-99b3-e1f11eaa0f3a" status: 404 len: 62 microversion: 2.1 time: 0.035617 Apr 16 21:16:33.357137 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1458/2785] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:16:33 2022] GET /compute/v2.1/images/519a00e1-dffc-4883-99b3-e1f11eaa0f3a => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:16:33.358677 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ead82de9-3071-4281-9f2c-ddfefb56f918 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:33.369507 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ead82de9-3071-4281-9f2c-ddfefb56f918 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1462 microversion: 2.1 time: 0.273245 Apr 16 21:16:33.370696 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7a50a9e3-a54c-4ce2-b46e-58189170ee22 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:33.371413 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7a50a9e3-a54c-4ce2-b46e-58189170ee22 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 8cb60874-b0f3-4055-a4d1-531f4a147992] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:33.371729 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1328/2786] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:33 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1462 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:33.391040 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-55f5b901-89e3-4995-bee1-4085586236a2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:33.392000 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-55f5b901-89e3-4995-bee1-4085586236a2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:33.392242 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7a50a9e3-a54c-4ce2-b46e-58189170ee22 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:33.392712 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7a50a9e3-a54c-4ce2-b46e-58189170ee22 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:33.393511 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7a50a9e3-a54c-4ce2-b46e-58189170ee22 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:33.393960 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7a50a9e3-a54c-4ce2-b46e-58189170ee22 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:33.400357 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-55f5b901-89e3-4995-bee1-4085586236a2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:33.401248 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-55f5b901-89e3-4995-bee1-4085586236a2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:33.402427 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-55f5b901-89e3-4995-bee1-4085586236a2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:33.403173 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-55f5b901-89e3-4995-bee1-4085586236a2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:33.575077 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-55f5b901-89e3-4995-bee1-4085586236a2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:33.587661 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-55f5b901-89e3-4995-bee1-4085586236a2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1462 microversion: 2.1 time: 0.202182 Apr 16 21:16:33.599072 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1329/2787] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:33 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1462 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:33.599072 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1b2f30df-8165-478d-8cc0-b7695b1bb011 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:33.599433 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1b2f30df-8165-478d-8cc0-b7695b1bb011 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:33.610435 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1b2f30df-8165-478d-8cc0-b7695b1bb011 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:33.610898 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1b2f30df-8165-478d-8cc0-b7695b1bb011 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:33.611745 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1b2f30df-8165-478d-8cc0-b7695b1bb011 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:33.612430 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1b2f30df-8165-478d-8cc0-b7695b1bb011 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:33.640941 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7a50a9e3-a54c-4ce2-b46e-58189170ee22 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:33.654491 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7a50a9e3-a54c-4ce2-b46e-58189170ee22 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992" status: 200 len: 1532 microversion: 2.1 time: 0.287586 Apr 16 21:16:33.665376 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1459/2788] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:33 2022] GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992 => generated 1532 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:33.665376 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9d67f541-b384-400a-a3bd-a90120491f71 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Calling method '.version_select at 0x7fbb959d6280>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:33.667235 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9d67f541-b384-400a-a3bd-a90120491f71 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:33.669145 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9d67f541-b384-400a-a3bd-a90120491f71 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:33.689207 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9d67f541-b384-400a-a3bd-a90120491f71 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] 10.222.0.20 "GET /compute/v2.1/os-migrations" status: 200 len: 803 microversion: 2.1 time: 0.031958 Apr 16 21:16:33.700878 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1460/2789] 10.222.0.20 () {58 vars in 1142 bytes} [Sat Apr 16 21:16:33 2022] GET /compute/v2.1/os-migrations => generated 803 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:16:33.700878 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-482a9a92-9664-4cdf-8755-2d691d8bd333 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:33.700878 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-482a9a92-9664-4cdf-8755-2d691d8bd333 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:33.715997 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-482a9a92-9664-4cdf-8755-2d691d8bd333 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:33.716481 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-482a9a92-9664-4cdf-8755-2d691d8bd333 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:33.717277 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-482a9a92-9664-4cdf-8755-2d691d8bd333 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:33.717717 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-482a9a92-9664-4cdf-8755-2d691d8bd333 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:33.828030 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-482a9a92-9664-4cdf-8755-2d691d8bd333 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lazy-loading 'services' on Instance uuid 9ce03e87-6962-45d5-910e-f87b61fef356 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:16:33.834137 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1b2f30df-8165-478d-8cc0-b7695b1bb011 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:33.842814 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1b2f30df-8165-478d-8cc0-b7695b1bb011 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140" status: 200 len: 1523 microversion: 2.1 time: 0.252711 Apr 16 21:16:33.843718 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1330/2790] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:33 2022] GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140 => generated 1523 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:33.849024 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-482a9a92-9664-4cdf-8755-2d691d8bd333 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1927 microversion: 2.75 time: 0.156536 Apr 16 21:16:33.849875 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1461/2791] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:16:33 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1927 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:16:33.857577 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b7b7c3e8-3ce3-4894-9cb9-4e0dcdd92e51 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:33.866409 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b7b7c3e8-3ce3-4894-9cb9-4e0dcdd92e51 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021541 Apr 16 21:16:33.872872 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1331/2792] 10.222.0.20 () {58 vars in 1136 bytes} [Sat Apr 16 21:16:33 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:16:33.881584 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c5159082-27ac-4875-8cac-c12e7541d726 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-967889651", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:16:33.883845 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:16:33.883845 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:16:34.042896 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c5159082-27ac-4875-8cac-c12e7541d726 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 498 microversion: 2.1 time: 0.168510 Apr 16 21:16:34.044998 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1462/2793] 10.222.0.20 () {60 vars in 1145 bytes} [Sat Apr 16 21:16:33 2022] POST /compute/v2.1/flavors => generated 498 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:16:34.057494 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d229f091-16d1-448b-bde5-d0fea378bb50 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:34.076114 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d229f091-16d1-448b-bde5-d0fea378bb50 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.024866 Apr 16 21:16:34.078123 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1332/2794] 10.222.0.20 () {58 vars in 1181 bytes} [Sat Apr 16 21:16:34 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:16:34.119995 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-af33959a-968f-4274-afe8-bacd65d4e916 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:34.122094 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-af33959a-968f-4274-afe8-bacd65d4e916 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:34.138845 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-af33959a-968f-4274-afe8-bacd65d4e916 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:34.138845 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-af33959a-968f-4274-afe8-bacd65d4e916 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:34.144935 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-af33959a-968f-4274-afe8-bacd65d4e916 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:34.145792 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-af33959a-968f-4274-afe8-bacd65d4e916 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:34.229191 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7e8cadd9-3199-4c8e-97dd-69a6d7aaede7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-361788153", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "f61f5a90-0fc1-43f4-8519-4c36f67a4a60"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:16:34.296546 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-7e8cadd9-3199-4c8e-97dd-69a6d7aaede7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] validate_networks() for None {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:16:34.416067 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-af33959a-968f-4274-afe8-bacd65d4e916 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:34.425533 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-af33959a-968f-4274-afe8-bacd65d4e916 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18" status: 200 len: 1315 microversion: 2.1 time: 0.314525 Apr 16 21:16:34.428485 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1463/2795] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:34 2022] GET /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18 => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:34.436441 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f8edd6dc-338d-4c2d-bc9c-69d671f19342 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb95afdb80>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:34.504602 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f8edd6dc-338d-4c2d-bc9c-69d671f19342 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73" status: 200 len: 1438 microversion: 2.1 time: 0.071718 Apr 16 21:16:34.515147 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1464/2796] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:16:34 2022] GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73 => generated 1438 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:34.527385 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-1090f148-b185-4a16-89df-30ca6cea9bfc req-b5d734bb-cc28-4fc4-b1ee-03774c03d150 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18", "tag": "880aed47-539f-4469-8060-4c63493e9b1d"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:16:34.548922 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-1090f148-b185-4a16-89df-30ca6cea9bfc req-b5d734bb-cc28-4fc4-b1ee-03774c03d150 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:34.549603 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-1090f148-b185-4a16-89df-30ca6cea9bfc req-b5d734bb-cc28-4fc4-b1ee-03774c03d150 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:34.568800 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-1090f148-b185-4a16-89df-30ca6cea9bfc req-b5d734bb-cc28-4fc4-b1ee-03774c03d150 service nova] Creating event network-changed:880aed47-539f-4469-8060-4c63493e9b1d for instance 8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18 on nch2-master-1 Apr 16 21:16:34.582433 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-1090f148-b185-4a16-89df-30ca6cea9bfc req-b5d734bb-cc28-4fc4-b1ee-03774c03d150 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064756 Apr 16 21:16:34.584317 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1465/2797] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:16:34.614825 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-7e8cadd9-3199-4c8e-97dd-69a6d7aaede7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:16:34.615255 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-7e8cadd9-3199-4c8e-97dd-69a6d7aaede7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:16:34.615735 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-7e8cadd9-3199-4c8e-97dd-69a6d7aaede7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:16:34.616214 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-7e8cadd9-3199-4c8e-97dd-69a6d7aaede7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:16:34.616588 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-7e8cadd9-3199-4c8e-97dd-69a6d7aaede7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:16:34.627740 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7e8cadd9-3199-4c8e-97dd-69a6d7aaede7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:34.628358 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7e8cadd9-3199-4c8e-97dd-69a6d7aaede7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:34.629875 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7e8cadd9-3199-4c8e-97dd-69a6d7aaede7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:34.630321 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7e8cadd9-3199-4c8e-97dd-69a6d7aaede7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:34.652036 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-7e8cadd9-3199-4c8e-97dd-69a6d7aaede7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Getting quotas for project 29fd420ef9134715bd3a9f2467d924cd. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:16:34.658146 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-7e8cadd9-3199-4c8e-97dd-69a6d7aaede7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Getting quotas for user d17cad39fa38448eb9827605871463a3 and project 29fd420ef9134715bd3a9f2467d924cd. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:16:34.676045 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7e8cadd9-3199-4c8e-97dd-69a6d7aaede7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:16:34.678751 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7e8cadd9-3199-4c8e-97dd-69a6d7aaede7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:16:34.686052 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8f5903e4-e66c-4722-af88-adb5fb0da58e tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:34.690248 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8f5903e4-e66c-4722-af88-adb5fb0da58e tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 8cb60874-b0f3-4055-a4d1-531f4a147992] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:34.695321 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8f5903e4-e66c-4722-af88-adb5fb0da58e tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:34.701764 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8f5903e4-e66c-4722-af88-adb5fb0da58e tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:34.702899 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8f5903e4-e66c-4722-af88-adb5fb0da58e tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:34.703898 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8f5903e4-e66c-4722-af88-adb5fb0da58e tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:34.845379 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7e8cadd9-3199-4c8e-97dd-69a6d7aaede7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.622636 Apr 16 21:16:34.846035 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1333/2798] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:16:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 16 21:16:34.858796 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ad8b58c3-1805-456c-9ee3-6b8a918a7c1b tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:34.858796 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ad8b58c3-1805-456c-9ee3-6b8a918a7c1b tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:34.953820 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ad8b58c3-1805-456c-9ee3-6b8a918a7c1b tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:34.955717 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ad8b58c3-1805-456c-9ee3-6b8a918a7c1b tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1278 microversion: 2.1 time: 0.101558 Apr 16 21:16:34.966327 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1334/2799] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:34 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1278 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:34.971212 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6bf1557b-20e6-4860-bda7-5932ccddddb0 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:34.971826 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6bf1557b-20e6-4860-bda7-5932ccddddb0 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:34.978796 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6bf1557b-20e6-4860-bda7-5932ccddddb0 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:34.979263 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6bf1557b-20e6-4860-bda7-5932ccddddb0 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:34.980047 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6bf1557b-20e6-4860-bda7-5932ccddddb0 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:34.980622 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6bf1557b-20e6-4860-bda7-5932ccddddb0 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:35.096771 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8f5903e4-e66c-4722-af88-adb5fb0da58e tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:35.108057 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8f5903e4-e66c-4722-af88-adb5fb0da58e tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992" status: 200 len: 1532 microversion: 2.1 time: 0.438139 Apr 16 21:16:35.118073 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1466/2800] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:34 2022] GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992 => generated 1532 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:35.123243 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-eca90eb8-5c74-4999-b764-c27edec03f11 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:35.124138 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-eca90eb8-5c74-4999-b764-c27edec03f11 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:35.131775 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eca90eb8-5c74-4999-b764-c27edec03f11 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:35.132679 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eca90eb8-5c74-4999-b764-c27edec03f11 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:35.133891 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eca90eb8-5c74-4999-b764-c27edec03f11 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:35.134617 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eca90eb8-5c74-4999-b764-c27edec03f11 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:35.189976 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6bf1557b-20e6-4860-bda7-5932ccddddb0 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:35.197971 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6bf1557b-20e6-4860-bda7-5932ccddddb0 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140" status: 200 len: 1523 microversion: 2.1 time: 0.230475 Apr 16 21:16:35.208698 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1335/2801] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:34 2022] GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140 => generated 1523 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:35.243178 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-eca90eb8-5c74-4999-b764-c27edec03f11 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lazy-loading 'services' on Instance uuid 9ce03e87-6962-45d5-910e-f87b61fef356 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:16:35.262625 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-eca90eb8-5c74-4999-b764-c27edec03f11 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1927 microversion: 2.75 time: 0.142782 Apr 16 21:16:35.263683 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1467/2802] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:16:35 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1927 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:16:35.445382 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d7cc2c83-3166-4faa-af2a-002d147c4e17 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:35.446809 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d7cc2c83-3166-4faa-af2a-002d147c4e17 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:35.454884 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d7cc2c83-3166-4faa-af2a-002d147c4e17 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:35.455342 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d7cc2c83-3166-4faa-af2a-002d147c4e17 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:35.456390 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d7cc2c83-3166-4faa-af2a-002d147c4e17 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:35.457002 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d7cc2c83-3166-4faa-af2a-002d147c4e17 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:35.526036 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3919b6e5-e584-423c-a7f4-7f06eb920c4c tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb959f20d0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:35.592855 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3919b6e5-e584-423c-a7f4-7f06eb920c4c tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73" status: 200 len: 1438 microversion: 2.1 time: 0.076775 Apr 16 21:16:35.598433 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1468/2803] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:16:35 2022] GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73 => generated 1438 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:35.644749 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d7cc2c83-3166-4faa-af2a-002d147c4e17 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:35.659071 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d7cc2c83-3166-4faa-af2a-002d147c4e17 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18" status: 200 len: 1315 microversion: 2.1 time: 0.217763 Apr 16 21:16:35.659970 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1336/2804] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:35 2022] GET /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:35.972728 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-165f0878-d729-4c67-b678-37800433bcf6 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:35.974020 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-165f0878-d729-4c67-b678-37800433bcf6 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:36.036869 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-165f0878-d729-4c67-b678-37800433bcf6 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:36.044848 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-165f0878-d729-4c67-b678-37800433bcf6 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1278 microversion: 2.1 time: 0.076124 Apr 16 21:16:36.047513 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1469/2805] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:35 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1278 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:36.125951 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-de8adb72-b1c7-42e1-b77e-84ed475c1acc tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:36.126780 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-de8adb72-b1c7-42e1-b77e-84ed475c1acc tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 8cb60874-b0f3-4055-a4d1-531f4a147992] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:36.133819 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-de8adb72-b1c7-42e1-b77e-84ed475c1acc tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:36.134447 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-de8adb72-b1c7-42e1-b77e-84ed475c1acc tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:36.135279 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-de8adb72-b1c7-42e1-b77e-84ed475c1acc tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:36.135842 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-de8adb72-b1c7-42e1-b77e-84ed475c1acc tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:36.216511 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-568de8cb-0b06-4575-8b02-0a564cc71e5c tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:36.217989 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-568de8cb-0b06-4575-8b02-0a564cc71e5c tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:36.234261 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-568de8cb-0b06-4575-8b02-0a564cc71e5c tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:36.248079 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-568de8cb-0b06-4575-8b02-0a564cc71e5c tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:36.249411 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-568de8cb-0b06-4575-8b02-0a564cc71e5c tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:36.249887 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-568de8cb-0b06-4575-8b02-0a564cc71e5c tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:36.302771 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-de8adb72-b1c7-42e1-b77e-84ed475c1acc tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:36.319565 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-de8adb72-b1c7-42e1-b77e-84ed475c1acc tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992" status: 200 len: 1538 microversion: 2.1 time: 0.197174 Apr 16 21:16:36.320190 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1337/2806] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:36 2022] GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992 => generated 1538 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:36.335679 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a8d744da-9173-4955-99f5-48e4633b2357 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:36.336998 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a8d744da-9173-4955-99f5-48e4633b2357 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:36.344638 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a8d744da-9173-4955-99f5-48e4633b2357 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:36.345104 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a8d744da-9173-4955-99f5-48e4633b2357 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:36.345995 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a8d744da-9173-4955-99f5-48e4633b2357 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:36.346470 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a8d744da-9173-4955-99f5-48e4633b2357 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:36.425967 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-a8d744da-9173-4955-99f5-48e4633b2357 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lazy-loading 'services' on Instance uuid 9ce03e87-6962-45d5-910e-f87b61fef356 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:16:36.426243 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-568de8cb-0b06-4575-8b02-0a564cc71e5c tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:36.436732 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-568de8cb-0b06-4575-8b02-0a564cc71e5c tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140" status: 200 len: 1523 microversion: 2.1 time: 0.224426 Apr 16 21:16:36.437345 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1470/2807] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:36 2022] GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140 => generated 1523 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:36.446642 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a8d744da-9173-4955-99f5-48e4633b2357 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1927 microversion: 2.75 time: 0.124834 Apr 16 21:16:36.447453 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1338/2808] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:16:36 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1927 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:16:36.607005 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2606e26e-5912-431b-af50-b80582e69745 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb95980c10>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:36.658471 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2606e26e-5912-431b-af50-b80582e69745 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73" status: 200 len: 1438 microversion: 2.1 time: 0.056082 Apr 16 21:16:36.659399 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1471/2809] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:16:36 2022] GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73 => generated 1438 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:36.675804 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-05b691cb-2351-421e-ba6e-2d0a008f3a23 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:36.677190 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-05b691cb-2351-421e-ba6e-2d0a008f3a23 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:36.684234 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-05b691cb-2351-421e-ba6e-2d0a008f3a23 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:36.684701 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-05b691cb-2351-421e-ba6e-2d0a008f3a23 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:36.685492 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-05b691cb-2351-421e-ba6e-2d0a008f3a23 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:36.685936 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-05b691cb-2351-421e-ba6e-2d0a008f3a23 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:36.818223 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-05b691cb-2351-421e-ba6e-2d0a008f3a23 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:36.827140 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-05b691cb-2351-421e-ba6e-2d0a008f3a23 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18" status: 200 len: 1315 microversion: 2.1 time: 0.154769 Apr 16 21:16:36.827660 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1339/2810] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:36 2022] GET /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:37.072857 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d2c48a4d-6499-4bf6-84d6-257b68d7b156 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:37.075511 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d2c48a4d-6499-4bf6-84d6-257b68d7b156 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:37.084250 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d2c48a4d-6499-4bf6-84d6-257b68d7b156 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:37.091890 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d2c48a4d-6499-4bf6-84d6-257b68d7b156 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:37.091890 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d2c48a4d-6499-4bf6-84d6-257b68d7b156 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:37.091890 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d2c48a4d-6499-4bf6-84d6-257b68d7b156 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:37.167413 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d2c48a4d-6499-4bf6-84d6-257b68d7b156 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:37.178614 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d2c48a4d-6499-4bf6-84d6-257b68d7b156 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1274 microversion: 2.1 time: 0.114618 Apr 16 21:16:37.179622 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1472/2811] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:37 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1274 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:37.340814 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-40a7e953-f85b-45c7-9a8f-dca275aa3a63 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:37.341684 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-40a7e953-f85b-45c7-9a8f-dca275aa3a63 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 8cb60874-b0f3-4055-a4d1-531f4a147992] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:37.347921 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-40a7e953-f85b-45c7-9a8f-dca275aa3a63 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:37.348636 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-40a7e953-f85b-45c7-9a8f-dca275aa3a63 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:37.349612 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-40a7e953-f85b-45c7-9a8f-dca275aa3a63 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:37.350243 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-40a7e953-f85b-45c7-9a8f-dca275aa3a63 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:37.453520 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f304cd76-b457-4832-ad10-0bf1cdaf1cb7 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:37.454532 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f304cd76-b457-4832-ad10-0bf1cdaf1cb7 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:37.462415 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f304cd76-b457-4832-ad10-0bf1cdaf1cb7 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:37.463301 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f304cd76-b457-4832-ad10-0bf1cdaf1cb7 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:37.464698 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f304cd76-b457-4832-ad10-0bf1cdaf1cb7 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:37.465405 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f304cd76-b457-4832-ad10-0bf1cdaf1cb7 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:37.496385 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-40a7e953-f85b-45c7-9a8f-dca275aa3a63 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:37.512456 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-40a7e953-f85b-45c7-9a8f-dca275aa3a63 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992" status: 200 len: 1538 microversion: 2.1 time: 0.174745 Apr 16 21:16:37.513761 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1340/2812] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:37 2022] GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992 => generated 1538 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:37.521956 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-34ccec45-391a-4f60-9d8f-8da8f19dc880 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:37.523079 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-34ccec45-391a-4f60-9d8f-8da8f19dc880 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:37.536021 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-34ccec45-391a-4f60-9d8f-8da8f19dc880 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:37.539774 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-34ccec45-391a-4f60-9d8f-8da8f19dc880 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:37.539774 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-34ccec45-391a-4f60-9d8f-8da8f19dc880 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:37.539774 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-34ccec45-391a-4f60-9d8f-8da8f19dc880 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:37.614246 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f304cd76-b457-4832-ad10-0bf1cdaf1cb7 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:37.623899 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f304cd76-b457-4832-ad10-0bf1cdaf1cb7 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140" status: 200 len: 1523 microversion: 2.1 time: 0.173245 Apr 16 21:16:37.624483 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1473/2813] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:37 2022] GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:37.637818 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-34ccec45-391a-4f60-9d8f-8da8f19dc880 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lazy-loading 'services' on Instance uuid 9ce03e87-6962-45d5-910e-f87b61fef356 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:16:37.658258 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-34ccec45-391a-4f60-9d8f-8da8f19dc880 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1927 microversion: 2.75 time: 0.142798 Apr 16 21:16:37.659270 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1341/2814] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:16:37 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1927 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:16:37.675780 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-dd9da7f7-fa46-4aa1-bda6-5a832bfe2272 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb95a93af0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:37.731910 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-dd9da7f7-fa46-4aa1-bda6-5a832bfe2272 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73" status: 200 len: 1438 microversion: 2.1 time: 0.063451 Apr 16 21:16:37.733246 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1474/2815] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:16:37 2022] GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73 => generated 1438 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:37.845081 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1d782f42-30ac-43f1-a227-6fd647271a9f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:37.845789 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1d782f42-30ac-43f1-a227-6fd647271a9f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:37.853588 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1d782f42-30ac-43f1-a227-6fd647271a9f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:37.854131 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1d782f42-30ac-43f1-a227-6fd647271a9f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:37.854992 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1d782f42-30ac-43f1-a227-6fd647271a9f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:37.855440 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1d782f42-30ac-43f1-a227-6fd647271a9f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:38.172381 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1d782f42-30ac-43f1-a227-6fd647271a9f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:38.180114 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1d782f42-30ac-43f1-a227-6fd647271a9f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18" status: 200 len: 1315 microversion: 2.1 time: 0.339096 Apr 16 21:16:38.180743 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1342/2816] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:37 2022] GET /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18 => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:38.204330 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b7ab0cfe-b2ec-4130-ac07-be44e65772af tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:38.205729 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b7ab0cfe-b2ec-4130-ac07-be44e65772af tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:38.224424 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b7ab0cfe-b2ec-4130-ac07-be44e65772af tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:38.225266 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b7ab0cfe-b2ec-4130-ac07-be44e65772af tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:38.227823 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b7ab0cfe-b2ec-4130-ac07-be44e65772af tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:38.228553 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b7ab0cfe-b2ec-4130-ac07-be44e65772af tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:38.324293 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b7ab0cfe-b2ec-4130-ac07-be44e65772af tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:38.335917 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b7ab0cfe-b2ec-4130-ac07-be44e65772af tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1336 microversion: 2.1 time: 0.135619 Apr 16 21:16:38.347273 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1475/2817] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:38 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1336 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:38.531947 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-acaec5a9-0d78-41eb-8ccb-c9284b0fe983 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:38.532687 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-acaec5a9-0d78-41eb-8ccb-c9284b0fe983 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 8cb60874-b0f3-4055-a4d1-531f4a147992] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:38.547076 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-acaec5a9-0d78-41eb-8ccb-c9284b0fe983 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:38.549867 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-acaec5a9-0d78-41eb-8ccb-c9284b0fe983 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:38.549867 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-acaec5a9-0d78-41eb-8ccb-c9284b0fe983 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:38.549867 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-acaec5a9-0d78-41eb-8ccb-c9284b0fe983 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:38.644118 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-39a4c9d3-8179-45c2-a736-91d51846fd65 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:38.645891 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-39a4c9d3-8179-45c2-a736-91d51846fd65 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:38.690529 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-39a4c9d3-8179-45c2-a736-91d51846fd65 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:38.690996 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-39a4c9d3-8179-45c2-a736-91d51846fd65 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:38.693283 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-39a4c9d3-8179-45c2-a736-91d51846fd65 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:38.693856 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-39a4c9d3-8179-45c2-a736-91d51846fd65 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:38.786118 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-acaec5a9-0d78-41eb-8ccb-c9284b0fe983 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:38.796656 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-acaec5a9-0d78-41eb-8ccb-c9284b0fe983 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992" status: 200 len: 1538 microversion: 2.1 time: 0.269589 Apr 16 21:16:38.806778 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1343/2818] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:38 2022] GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992 => generated 1538 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:38.806778 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6473d39b-cf2b-4f97-8ab5-e6c61c585131 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:38.806778 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6473d39b-cf2b-4f97-8ab5-e6c61c585131 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:38.814284 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6473d39b-cf2b-4f97-8ab5-e6c61c585131 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:38.814741 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6473d39b-cf2b-4f97-8ab5-e6c61c585131 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:38.815537 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6473d39b-cf2b-4f97-8ab5-e6c61c585131 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:38.815982 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6473d39b-cf2b-4f97-8ab5-e6c61c585131 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:38.907153 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-39a4c9d3-8179-45c2-a736-91d51846fd65 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:38.918047 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-39a4c9d3-8179-45c2-a736-91d51846fd65 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140" status: 200 len: 1523 microversion: 2.1 time: 0.282826 Apr 16 21:16:38.934803 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-6473d39b-cf2b-4f97-8ab5-e6c61c585131 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lazy-loading 'services' on Instance uuid 9ce03e87-6962-45d5-910e-f87b61fef356 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:16:38.934934 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1476/2819] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:38 2022] GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140 => generated 1523 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:38.939522 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-61a203bc-84a3-4978-99d4-2eb8482d41ca tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb959c04c0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:38.971624 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6473d39b-cf2b-4f97-8ab5-e6c61c585131 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1927 microversion: 2.75 time: 0.173502 Apr 16 21:16:38.977649 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1344/2820] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:16:38 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1927 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:16:39.025842 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-61a203bc-84a3-4978-99d4-2eb8482d41ca tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73" status: 200 len: 1438 microversion: 2.1 time: 0.092831 Apr 16 21:16:39.026874 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1477/2821] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:16:38 2022] GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73 => generated 1438 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:39.202151 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5dc2e4a1-b0e8-419c-b40a-24f5ba525030 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:39.203047 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5dc2e4a1-b0e8-419c-b40a-24f5ba525030 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:39.210311 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5dc2e4a1-b0e8-419c-b40a-24f5ba525030 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:39.211340 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5dc2e4a1-b0e8-419c-b40a-24f5ba525030 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:39.213494 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5dc2e4a1-b0e8-419c-b40a-24f5ba525030 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:39.214138 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5dc2e4a1-b0e8-419c-b40a-24f5ba525030 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:39.360639 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5602102f-9be1-4476-9898-d072030e8ce9 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:39.362043 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5602102f-9be1-4476-9898-d072030e8ce9 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:39.372862 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5602102f-9be1-4476-9898-d072030e8ce9 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:39.373625 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5602102f-9be1-4476-9898-d072030e8ce9 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:39.375158 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5602102f-9be1-4476-9898-d072030e8ce9 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:39.376143 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5602102f-9be1-4476-9898-d072030e8ce9 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:39.544400 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5602102f-9be1-4476-9898-d072030e8ce9 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:39.553344 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5602102f-9be1-4476-9898-d072030e8ce9 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1378 microversion: 2.1 time: 0.196856 Apr 16 21:16:39.558521 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1478/2822] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:39 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1378 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:39.580028 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5dc2e4a1-b0e8-419c-b40a-24f5ba525030 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:39.592334 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5dc2e4a1-b0e8-419c-b40a-24f5ba525030 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18" status: 200 len: 1315 microversion: 2.1 time: 0.396704 Apr 16 21:16:39.594067 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1345/2823] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:39 2022] GET /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18 => generated 1315 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:39.819242 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-155d7e25-976e-423b-92ee-4fd38c6eb6ad tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:39.822314 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-155d7e25-976e-423b-92ee-4fd38c6eb6ad tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 8cb60874-b0f3-4055-a4d1-531f4a147992] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:39.829449 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-155d7e25-976e-423b-92ee-4fd38c6eb6ad tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:39.830290 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-155d7e25-976e-423b-92ee-4fd38c6eb6ad tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:39.831265 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-155d7e25-976e-423b-92ee-4fd38c6eb6ad tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:39.831878 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-155d7e25-976e-423b-92ee-4fd38c6eb6ad tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:39.936883 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9196c96f-959d-4337-b9e4-969388de4e15 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:39.937849 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9196c96f-959d-4337-b9e4-969388de4e15 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:39.955444 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9196c96f-959d-4337-b9e4-969388de4e15 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:39.957377 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9196c96f-959d-4337-b9e4-969388de4e15 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:39.960833 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9196c96f-959d-4337-b9e4-969388de4e15 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:39.964417 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9196c96f-959d-4337-b9e4-969388de4e15 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:40.252241 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-155d7e25-976e-423b-92ee-4fd38c6eb6ad tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:40.264744 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-155d7e25-976e-423b-92ee-4fd38c6eb6ad tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992" status: 200 len: 1538 microversion: 2.1 time: 0.453398 Apr 16 21:16:40.282458 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1479/2824] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:39 2022] GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992 => generated 1538 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:40.285962 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d6b1750a-dd42-4d8f-8b76-a67760b903b1 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:40.287362 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d6b1750a-dd42-4d8f-8b76-a67760b903b1 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:40.295995 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d6b1750a-dd42-4d8f-8b76-a67760b903b1 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:40.312629 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d6b1750a-dd42-4d8f-8b76-a67760b903b1 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:40.312629 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d6b1750a-dd42-4d8f-8b76-a67760b903b1 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:40.312629 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d6b1750a-dd42-4d8f-8b76-a67760b903b1 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:40.437159 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9196c96f-959d-4337-b9e4-969388de4e15 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:40.437159 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9196c96f-959d-4337-b9e4-969388de4e15 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140" status: 200 len: 1523 microversion: 2.1 time: 0.480623 Apr 16 21:16:40.437159 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1346/2825] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:39 2022] GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140 => generated 1523 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:40.437159 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-dfd23389-681f-4182-ad8f-2d2e064ca590 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb9597ca60>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:40.437708 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-d6b1750a-dd42-4d8f-8b76-a67760b903b1 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lazy-loading 'services' on Instance uuid 9ce03e87-6962-45d5-910e-f87b61fef356 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:16:40.457336 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d6b1750a-dd42-4d8f-8b76-a67760b903b1 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1927 microversion: 2.75 time: 0.177752 Apr 16 21:16:40.458026 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1480/2826] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:16:40 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1927 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:16:40.494640 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-dfd23389-681f-4182-ad8f-2d2e064ca590 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73" status: 200 len: 1438 microversion: 2.1 time: 0.074942 Apr 16 21:16:40.495226 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1347/2827] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:16:40 2022] GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73 => generated 1438 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:40.575135 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4241b190-23d8-4908-8800-4ef2162a7274 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:40.575840 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4241b190-23d8-4908-8800-4ef2162a7274 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:40.583202 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4241b190-23d8-4908-8800-4ef2162a7274 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:40.583705 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4241b190-23d8-4908-8800-4ef2162a7274 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:40.584611 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4241b190-23d8-4908-8800-4ef2162a7274 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:40.585096 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4241b190-23d8-4908-8800-4ef2162a7274 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:40.611753 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9afac36b-f6a8-442d-922c-18e912dc003b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:40.612423 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9afac36b-f6a8-442d-922c-18e912dc003b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:40.620385 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9afac36b-f6a8-442d-922c-18e912dc003b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:40.621346 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9afac36b-f6a8-442d-922c-18e912dc003b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:40.621662 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9afac36b-f6a8-442d-922c-18e912dc003b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:40.622500 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9afac36b-f6a8-442d-922c-18e912dc003b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:40.748711 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4241b190-23d8-4908-8800-4ef2162a7274 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:40.756285 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4241b190-23d8-4908-8800-4ef2162a7274 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1378 microversion: 2.1 time: 0.185815 Apr 16 21:16:40.756874 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1481/2828] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:40 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1378 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:40.761392 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-b14bb911-8b8e-4deb-ac76-a6da83b9bc86 req-ce656b93-e7df-4b37-9285-1a31891d54e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cb60874-b0f3-4055-a4d1-531f4a147992", "name": "network-vif-plugged", "status": "completed", "tag": "f7e32037-5681-45d7-a2cb-a1ccb583ae68"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:16:40.768404 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9afac36b-f6a8-442d-922c-18e912dc003b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:40.769688 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-b14bb911-8b8e-4deb-ac76-a6da83b9bc86 req-ce656b93-e7df-4b37-9285-1a31891d54e2 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:40.770173 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-b14bb911-8b8e-4deb-ac76-a6da83b9bc86 req-ce656b93-e7df-4b37-9285-1a31891d54e2 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:40.778288 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9afac36b-f6a8-442d-922c-18e912dc003b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18" status: 200 len: 1315 microversion: 2.1 time: 0.171193 Apr 16 21:16:40.782617 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-b14bb911-8b8e-4deb-ac76-a6da83b9bc86 req-ce656b93-e7df-4b37-9285-1a31891d54e2 service nova] Creating event network-vif-plugged:f7e32037-5681-45d7-a2cb-a1ccb583ae68 for instance 8cb60874-b0f3-4055-a4d1-531f4a147992 on nch2-master-1 Apr 16 21:16:40.788648 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1348/2829] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:40 2022] GET /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:40.791315 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-b14bb911-8b8e-4deb-ac76-a6da83b9bc86 req-ce656b93-e7df-4b37-9285-1a31891d54e2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033263 Apr 16 21:16:40.792075 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1482/2830] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:16:40.827180 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-01f049ac-4924-4ec8-90e5-10f9b4485321 req-040d064b-b50c-466a-b361-8cfbd20972e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbcf087b-c508-46e9-a546-99b764daddbb", "tag": "c077f313-2701-4802-bf5a-28338c745ec4"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:16:40.837004 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-01f049ac-4924-4ec8-90e5-10f9b4485321 req-040d064b-b50c-466a-b361-8cfbd20972e1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:40.837555 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-01f049ac-4924-4ec8-90e5-10f9b4485321 req-040d064b-b50c-466a-b361-8cfbd20972e1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:40.851028 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-01f049ac-4924-4ec8-90e5-10f9b4485321 req-040d064b-b50c-466a-b361-8cfbd20972e1 service nova] Creating event network-changed:c077f313-2701-4802-bf5a-28338c745ec4 for instance cbcf087b-c508-46e9-a546-99b764daddbb on nch1-master-1 Apr 16 21:16:40.856104 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-01f049ac-4924-4ec8-90e5-10f9b4485321 req-040d064b-b50c-466a-b361-8cfbd20972e1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033137 Apr 16 21:16:40.857003 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1349/2831] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:16:41.285078 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5fb4ab35-0efc-4d4d-b87f-6acc4151ff5a tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:41.286152 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5fb4ab35-0efc-4d4d-b87f-6acc4151ff5a tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 8cb60874-b0f3-4055-a4d1-531f4a147992] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:41.295972 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5fb4ab35-0efc-4d4d-b87f-6acc4151ff5a tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:41.296866 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5fb4ab35-0efc-4d4d-b87f-6acc4151ff5a tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:41.297784 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5fb4ab35-0efc-4d4d-b87f-6acc4151ff5a tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:41.298235 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5fb4ab35-0efc-4d4d-b87f-6acc4151ff5a tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:41.433062 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-55b80dae-20c9-49c7-9f02-d97640b043c1 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:41.434311 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-55b80dae-20c9-49c7-9f02-d97640b043c1 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:41.438359 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5fb4ab35-0efc-4d4d-b87f-6acc4151ff5a tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:41.442447 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-55b80dae-20c9-49c7-9f02-d97640b043c1 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:41.443639 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-55b80dae-20c9-49c7-9f02-d97640b043c1 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:41.444460 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-55b80dae-20c9-49c7-9f02-d97640b043c1 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:41.444962 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-55b80dae-20c9-49c7-9f02-d97640b043c1 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:41.448449 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5fb4ab35-0efc-4d4d-b87f-6acc4151ff5a tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992" status: 200 len: 1538 microversion: 2.1 time: 0.169217 Apr 16 21:16:41.449489 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1483/2832] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:41 2022] GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992 => generated 1538 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:41.481805 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d5f6e426-8376-48b2-8d3c-78c4ea1b110c tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:41.482586 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d5f6e426-8376-48b2-8d3c-78c4ea1b110c tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:41.489002 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d5f6e426-8376-48b2-8d3c-78c4ea1b110c tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:41.489798 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d5f6e426-8376-48b2-8d3c-78c4ea1b110c tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:41.490829 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d5f6e426-8376-48b2-8d3c-78c4ea1b110c tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:41.491277 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d5f6e426-8376-48b2-8d3c-78c4ea1b110c tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:41.580753 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-d5f6e426-8376-48b2-8d3c-78c4ea1b110c tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lazy-loading 'services' on Instance uuid 9ce03e87-6962-45d5-910e-f87b61fef356 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:16:41.612122 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d5f6e426-8376-48b2-8d3c-78c4ea1b110c tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1933 microversion: 2.75 time: 0.133469 Apr 16 21:16:41.613362 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1484/2833] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:16:41 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1933 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:16:41.619142 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8057ba09-d9fb-4f28-b6bc-023d2029ef68 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb95980f70>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:41.663874 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-55b80dae-20c9-49c7-9f02-d97640b043c1 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:41.677974 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-55b80dae-20c9-49c7-9f02-d97640b043c1 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140" status: 200 len: 1523 microversion: 2.1 time: 0.250438 Apr 16 21:16:41.689418 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8057ba09-d9fb-4f28-b6bc-023d2029ef68 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73" status: 200 len: 1438 microversion: 2.1 time: 0.074473 Apr 16 21:16:41.690010 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1485/2834] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:16:41 2022] GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73 => generated 1438 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:41.695702 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1350/2835] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:41 2022] GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140 => generated 1523 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:41.774446 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f0ecb90d-6522-431a-9370-5a1f3969f245 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:41.775070 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f0ecb90d-6522-431a-9370-5a1f3969f245 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:41.782441 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f0ecb90d-6522-431a-9370-5a1f3969f245 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:41.782911 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f0ecb90d-6522-431a-9370-5a1f3969f245 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:41.783713 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f0ecb90d-6522-431a-9370-5a1f3969f245 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:41.784349 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f0ecb90d-6522-431a-9370-5a1f3969f245 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:41.795643 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7ca34f53-5ad8-4e39-973b-0b28abf1f907 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:41.806797 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7ca34f53-5ad8-4e39-973b-0b28abf1f907 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:41.806797 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7ca34f53-5ad8-4e39-973b-0b28abf1f907 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:41.806797 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7ca34f53-5ad8-4e39-973b-0b28abf1f907 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:41.806797 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7ca34f53-5ad8-4e39-973b-0b28abf1f907 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:41.806797 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7ca34f53-5ad8-4e39-973b-0b28abf1f907 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:41.925081 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f0ecb90d-6522-431a-9370-5a1f3969f245 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:41.933049 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f0ecb90d-6522-431a-9370-5a1f3969f245 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1378 microversion: 2.1 time: 0.163224 Apr 16 21:16:41.942771 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1486/2836] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:41 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1378 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:41.950376 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7ca34f53-5ad8-4e39-973b-0b28abf1f907 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:41.956882 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7ca34f53-5ad8-4e39-973b-0b28abf1f907 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18" status: 200 len: 1315 microversion: 2.1 time: 0.165416 Apr 16 21:16:41.957456 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1351/2837] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:41 2022] GET /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:42.466577 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bcb91425-0bad-4c5c-a820-6cedb38c419c tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:42.467193 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-bcb91425-0bad-4c5c-a820-6cedb38c419c tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 8cb60874-b0f3-4055-a4d1-531f4a147992] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:42.474534 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bcb91425-0bad-4c5c-a820-6cedb38c419c tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:42.475360 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bcb91425-0bad-4c5c-a820-6cedb38c419c tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:42.476313 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bcb91425-0bad-4c5c-a820-6cedb38c419c tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:42.477243 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bcb91425-0bad-4c5c-a820-6cedb38c419c tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:42.609860 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-bcb91425-0bad-4c5c-a820-6cedb38c419c tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:42.617482 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-bcb91425-0bad-4c5c-a820-6cedb38c419c tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992" status: 200 len: 1538 microversion: 2.1 time: 0.154786 Apr 16 21:16:42.618153 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1487/2838] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:42 2022] GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992 => generated 1538 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:42.635126 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f929bcfd-9417-4323-af40-51b902dcd15e tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:42.635692 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f929bcfd-9417-4323-af40-51b902dcd15e tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:42.642191 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f929bcfd-9417-4323-af40-51b902dcd15e tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:42.642651 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f929bcfd-9417-4323-af40-51b902dcd15e tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:42.643430 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f929bcfd-9417-4323-af40-51b902dcd15e tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:42.643902 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f929bcfd-9417-4323-af40-51b902dcd15e tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:42.703095 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fdc6f073-7531-41cd-a65a-ff773313ae43 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb95980ca0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:42.736132 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-f929bcfd-9417-4323-af40-51b902dcd15e tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lazy-loading 'services' on Instance uuid 9ce03e87-6962-45d5-910e-f87b61fef356 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:16:42.751667 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fdc6f073-7531-41cd-a65a-ff773313ae43 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73" status: 200 len: 1438 microversion: 2.1 time: 0.052580 Apr 16 21:16:42.756220 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1488/2839] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:16:42 2022] GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73 => generated 1438 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:42.756450 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f929bcfd-9417-4323-af40-51b902dcd15e tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1933 microversion: 2.75 time: 0.125227 Apr 16 21:16:42.757453 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e60a0b08-4bbb-4f1c-b9b3-85d697fb3ad6 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:42.757649 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1352/2840] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:16:42 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1933 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:16:42.758160 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e60a0b08-4bbb-4f1c-b9b3-85d697fb3ad6 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:42.765743 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e60a0b08-4bbb-4f1c-b9b3-85d697fb3ad6 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:42.765743 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e60a0b08-4bbb-4f1c-b9b3-85d697fb3ad6 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:42.766038 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e60a0b08-4bbb-4f1c-b9b3-85d697fb3ad6 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:42.766437 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e60a0b08-4bbb-4f1c-b9b3-85d697fb3ad6 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:42.911447 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e60a0b08-4bbb-4f1c-b9b3-85d697fb3ad6 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:42.920888 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e60a0b08-4bbb-4f1c-b9b3-85d697fb3ad6 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140" status: 200 len: 1523 microversion: 2.1 time: 0.167079 Apr 16 21:16:42.921618 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1489/2841] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:42 2022] GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:42.950719 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a493143d-cee5-4231-a69d-a24ee696eeaa tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:42.951516 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a493143d-cee5-4231-a69d-a24ee696eeaa tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:42.957886 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a493143d-cee5-4231-a69d-a24ee696eeaa tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:42.958635 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a493143d-cee5-4231-a69d-a24ee696eeaa tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:42.959643 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a493143d-cee5-4231-a69d-a24ee696eeaa tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:42.960221 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a493143d-cee5-4231-a69d-a24ee696eeaa tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:42.974253 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6e69f506-cf07-41fc-a3ff-bbc2f0a89797 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:42.975093 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6e69f506-cf07-41fc-a3ff-bbc2f0a89797 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:42.983220 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6e69f506-cf07-41fc-a3ff-bbc2f0a89797 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:42.983770 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6e69f506-cf07-41fc-a3ff-bbc2f0a89797 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:42.986750 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6e69f506-cf07-41fc-a3ff-bbc2f0a89797 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:42.987201 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6e69f506-cf07-41fc-a3ff-bbc2f0a89797 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:43.128587 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a493143d-cee5-4231-a69d-a24ee696eeaa tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:43.137301 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a493143d-cee5-4231-a69d-a24ee696eeaa tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1378 microversion: 2.1 time: 0.191035 Apr 16 21:16:43.139434 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1353/2842] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:42 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1378 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:43.149552 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6e69f506-cf07-41fc-a3ff-bbc2f0a89797 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:43.157944 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6e69f506-cf07-41fc-a3ff-bbc2f0a89797 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18" status: 200 len: 1315 microversion: 2.1 time: 0.187634 Apr 16 21:16:43.159172 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1490/2843] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:42 2022] GET /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:43.635223 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-701986b8-f86f-46cb-8700-470653099c29 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:43.636233 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-701986b8-f86f-46cb-8700-470653099c29 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 8cb60874-b0f3-4055-a4d1-531f4a147992] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:43.648224 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-701986b8-f86f-46cb-8700-470653099c29 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:43.649405 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-701986b8-f86f-46cb-8700-470653099c29 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:43.650493 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-701986b8-f86f-46cb-8700-470653099c29 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:43.651193 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-701986b8-f86f-46cb-8700-470653099c29 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:43.766294 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4b692d67-57b0-486b-a6bc-cef4e02738a9 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb95984700>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:43.851519 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4b692d67-57b0-486b-a6bc-cef4e02738a9 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73" status: 200 len: 1438 microversion: 2.1 time: 0.089965 Apr 16 21:16:43.863074 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1491/2844] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:16:43 2022] GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73 => generated 1438 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:43.868674 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-df60a46a-898a-4e9c-ae99-b896ddde396d tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:43.869539 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-df60a46a-898a-4e9c-ae99-b896ddde396d tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:43.877508 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-701986b8-f86f-46cb-8700-470653099c29 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:43.881793 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-df60a46a-898a-4e9c-ae99-b896ddde396d tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:43.881793 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-df60a46a-898a-4e9c-ae99-b896ddde396d tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:43.881793 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-df60a46a-898a-4e9c-ae99-b896ddde396d tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:43.881793 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-df60a46a-898a-4e9c-ae99-b896ddde396d tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:43.891184 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-701986b8-f86f-46cb-8700-470653099c29 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992" status: 200 len: 1538 microversion: 2.1 time: 0.259920 Apr 16 21:16:43.903189 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1354/2845] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:43 2022] GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992 => generated 1538 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:43.913384 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-bf1fde34-affb-47de-9d9e-d2d39dd9669a req-28f9c7eb-893b-4639-837a-fef6c2345f9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18", "name": "network-vif-plugged", "status": "completed", "tag": "880aed47-539f-4469-8060-4c63493e9b1d"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:16:43.923839 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-bf1fde34-affb-47de-9d9e-d2d39dd9669a req-28f9c7eb-893b-4639-837a-fef6c2345f9a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:43.924576 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-bf1fde34-affb-47de-9d9e-d2d39dd9669a req-28f9c7eb-893b-4639-837a-fef6c2345f9a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:43.943485 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-bf1fde34-affb-47de-9d9e-d2d39dd9669a req-28f9c7eb-893b-4639-837a-fef6c2345f9a service nova] Creating event network-vif-plugged:880aed47-539f-4469-8060-4c63493e9b1d for instance 8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18 on nch2-master-1 Apr 16 21:16:43.951361 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-bf1fde34-affb-47de-9d9e-d2d39dd9669a req-28f9c7eb-893b-4639-837a-fef6c2345f9a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045707 Apr 16 21:16:43.952591 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1355/2846] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:16:43.960092 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4dded02b-a184-49f7-beb6-ae553dba10f7 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:43.961575 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4dded02b-a184-49f7-beb6-ae553dba10f7 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:43.971323 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4dded02b-a184-49f7-beb6-ae553dba10f7 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:43.973823 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4dded02b-a184-49f7-beb6-ae553dba10f7 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:43.974223 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4dded02b-a184-49f7-beb6-ae553dba10f7 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:43.974921 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4dded02b-a184-49f7-beb6-ae553dba10f7 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:43.980006 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-df60a46a-898a-4e9c-ae99-b896ddde396d tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lazy-loading 'services' on Instance uuid 9ce03e87-6962-45d5-910e-f87b61fef356 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:16:44.011893 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-df60a46a-898a-4e9c-ae99-b896ddde396d tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1933 microversion: 2.75 time: 0.147697 Apr 16 21:16:44.012532 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1492/2847] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:16:43 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1933 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:16:44.135209 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4dded02b-a184-49f7-beb6-ae553dba10f7 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:44.142974 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4dded02b-a184-49f7-beb6-ae553dba10f7 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140" status: 200 len: 1523 microversion: 2.1 time: 0.189085 Apr 16 21:16:44.143609 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1356/2848] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:43 2022] GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140 => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:44.158835 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0fc9a7e0-8709-46be-aa69-055645583447 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:44.159487 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0fc9a7e0-8709-46be-aa69-055645583447 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:44.166459 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0fc9a7e0-8709-46be-aa69-055645583447 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:44.168334 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0fc9a7e0-8709-46be-aa69-055645583447 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:44.168334 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0fc9a7e0-8709-46be-aa69-055645583447 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:44.168334 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0fc9a7e0-8709-46be-aa69-055645583447 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:44.175977 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e15a7297-8f47-43af-8551-d50b073be362 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:44.178157 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e15a7297-8f47-43af-8551-d50b073be362 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:44.184396 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e15a7297-8f47-43af-8551-d50b073be362 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:44.184854 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e15a7297-8f47-43af-8551-d50b073be362 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:44.185679 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e15a7297-8f47-43af-8551-d50b073be362 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:44.186101 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e15a7297-8f47-43af-8551-d50b073be362 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:44.320538 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0fc9a7e0-8709-46be-aa69-055645583447 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:44.328521 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0fc9a7e0-8709-46be-aa69-055645583447 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1378 microversion: 2.1 time: 0.173711 Apr 16 21:16:44.340373 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1493/2849] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:44 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1378 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:44.364239 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e15a7297-8f47-43af-8551-d50b073be362 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:44.371956 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e15a7297-8f47-43af-8551-d50b073be362 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18" status: 200 len: 1315 microversion: 2.1 time: 0.199723 Apr 16 21:16:44.383004 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1357/2850] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:44 2022] GET /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18 => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:44.865507 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4240d4f7-355d-4226-bdb7-8581e042cb06 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb959d69d0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:44.911389 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-76d8f767-5b90-4bd7-b5cd-c64a80d7685e tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:44.912647 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-76d8f767-5b90-4bd7-b5cd-c64a80d7685e tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 8cb60874-b0f3-4055-a4d1-531f4a147992] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:44.927058 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-76d8f767-5b90-4bd7-b5cd-c64a80d7685e tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:44.927521 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-76d8f767-5b90-4bd7-b5cd-c64a80d7685e tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:44.928350 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-76d8f767-5b90-4bd7-b5cd-c64a80d7685e tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:44.930273 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-76d8f767-5b90-4bd7-b5cd-c64a80d7685e tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:44.930397 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4240d4f7-355d-4226-bdb7-8581e042cb06 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73" status: 200 len: 1438 microversion: 2.1 time: 0.067922 Apr 16 21:16:44.930767 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1494/2851] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:16:44 2022] GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73 => generated 1438 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:45.031770 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2df2d216-f6e8-4ef0-8687-d7726fe8c8ac tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:45.032441 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2df2d216-f6e8-4ef0-8687-d7726fe8c8ac tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:45.041707 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2df2d216-f6e8-4ef0-8687-d7726fe8c8ac tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:45.042828 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2df2d216-f6e8-4ef0-8687-d7726fe8c8ac tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:45.043544 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2df2d216-f6e8-4ef0-8687-d7726fe8c8ac tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:45.044210 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2df2d216-f6e8-4ef0-8687-d7726fe8c8ac tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:45.091153 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-76d8f767-5b90-4bd7-b5cd-c64a80d7685e tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:45.101885 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-76d8f767-5b90-4bd7-b5cd-c64a80d7685e tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992" status: 200 len: 1538 microversion: 2.1 time: 0.196335 Apr 16 21:16:45.102690 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1358/2852] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:44 2022] GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992 => generated 1538 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:45.143787 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-2df2d216-f6e8-4ef0-8687-d7726fe8c8ac tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lazy-loading 'services' on Instance uuid 9ce03e87-6962-45d5-910e-f87b61fef356 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:16:45.161571 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-da462921-e335-4b91-9db2-d51cf216c4a3 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:45.162281 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-da462921-e335-4b91-9db2-d51cf216c4a3 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:45.162429 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2df2d216-f6e8-4ef0-8687-d7726fe8c8ac tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1933 microversion: 2.75 time: 0.135149 Apr 16 21:16:45.163242 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1495/2853] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:16:45 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1933 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:16:45.168974 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-da462921-e335-4b91-9db2-d51cf216c4a3 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:45.169590 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-da462921-e335-4b91-9db2-d51cf216c4a3 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:45.170743 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-da462921-e335-4b91-9db2-d51cf216c4a3 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:45.171264 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-da462921-e335-4b91-9db2-d51cf216c4a3 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:45.327362 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-da462921-e335-4b91-9db2-d51cf216c4a3 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:45.336835 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-da462921-e335-4b91-9db2-d51cf216c4a3 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140" status: 200 len: 1523 microversion: 2.1 time: 0.178894 Apr 16 21:16:45.344781 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1359/2854] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:45 2022] GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140 => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:45.346408 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f097793c-7cb1-4c1d-87b0-7f3b6d66b2d3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:45.347060 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f097793c-7cb1-4c1d-87b0-7f3b6d66b2d3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:45.355974 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f097793c-7cb1-4c1d-87b0-7f3b6d66b2d3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:45.356473 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f097793c-7cb1-4c1d-87b0-7f3b6d66b2d3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:45.357286 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f097793c-7cb1-4c1d-87b0-7f3b6d66b2d3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:45.357821 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f097793c-7cb1-4c1d-87b0-7f3b6d66b2d3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:45.391122 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a9c5519e-beb7-466d-9bf9-d389bcb2d235 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:45.392849 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a9c5519e-beb7-466d-9bf9-d389bcb2d235 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:45.405193 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a9c5519e-beb7-466d-9bf9-d389bcb2d235 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:45.410344 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a9c5519e-beb7-466d-9bf9-d389bcb2d235 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:45.410344 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a9c5519e-beb7-466d-9bf9-d389bcb2d235 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:45.410344 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a9c5519e-beb7-466d-9bf9-d389bcb2d235 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:45.531581 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f097793c-7cb1-4c1d-87b0-7f3b6d66b2d3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:45.540405 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f097793c-7cb1-4c1d-87b0-7f3b6d66b2d3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1378 microversion: 2.1 time: 0.197728 Apr 16 21:16:45.548436 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1496/2855] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:45 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1378 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:45.594247 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a9c5519e-beb7-466d-9bf9-d389bcb2d235 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:45.604562 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a9c5519e-beb7-466d-9bf9-d389bcb2d235 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18" status: 200 len: 1315 microversion: 2.1 time: 0.216710 Apr 16 21:16:45.612792 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1360/2856] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:45 2022] GET /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18 => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:45.943896 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-286edbbc-8a52-4c71-8e92-cf214792661f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb95afd4c0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:45.986581 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-286edbbc-8a52-4c71-8e92-cf214792661f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73" status: 200 len: 1438 microversion: 2.1 time: 0.046702 Apr 16 21:16:45.987163 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1497/2857] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:16:45 2022] GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73 => generated 1438 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:46.120710 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1c46e4e7-36ec-4112-ab2e-bf4931155e54 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:46.121324 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1c46e4e7-36ec-4112-ab2e-bf4931155e54 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 8cb60874-b0f3-4055-a4d1-531f4a147992] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:46.128238 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1c46e4e7-36ec-4112-ab2e-bf4931155e54 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:46.128689 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1c46e4e7-36ec-4112-ab2e-bf4931155e54 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:46.129478 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1c46e4e7-36ec-4112-ab2e-bf4931155e54 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:46.129922 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1c46e4e7-36ec-4112-ab2e-bf4931155e54 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:46.181504 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7853463a-32f4-423e-bf45-4dd2de9677bc tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:46.182128 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7853463a-32f4-423e-bf45-4dd2de9677bc tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:46.188815 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7853463a-32f4-423e-bf45-4dd2de9677bc tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:46.193972 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7853463a-32f4-423e-bf45-4dd2de9677bc tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:46.193972 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7853463a-32f4-423e-bf45-4dd2de9677bc tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:46.193972 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7853463a-32f4-423e-bf45-4dd2de9677bc tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:46.261767 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1c46e4e7-36ec-4112-ab2e-bf4931155e54 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:46.267460 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-7853463a-32f4-423e-bf45-4dd2de9677bc tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lazy-loading 'services' on Instance uuid 9ce03e87-6962-45d5-910e-f87b61fef356 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:16:46.269367 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1c46e4e7-36ec-4112-ab2e-bf4931155e54 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992" status: 200 len: 1533 microversion: 2.1 time: 0.153887 Apr 16 21:16:46.269946 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1361/2858] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:46 2022] GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992 => generated 1533 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:46.285160 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7853463a-32f4-423e-bf45-4dd2de9677bc tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1933 microversion: 2.75 time: 0.107984 Apr 16 21:16:46.285735 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1498/2859] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:16:46 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1933 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:16:46.354424 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9228679c-4df1-4988-a1e0-ab7ed4d7de8f tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:46.355075 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9228679c-4df1-4988-a1e0-ab7ed4d7de8f tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:46.361058 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9228679c-4df1-4988-a1e0-ab7ed4d7de8f tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:46.361519 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9228679c-4df1-4988-a1e0-ab7ed4d7de8f tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:46.362293 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9228679c-4df1-4988-a1e0-ab7ed4d7de8f tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:46.362736 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9228679c-4df1-4988-a1e0-ab7ed4d7de8f tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:46.497371 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9228679c-4df1-4988-a1e0-ab7ed4d7de8f tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:46.505303 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9228679c-4df1-4988-a1e0-ab7ed4d7de8f tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140" status: 200 len: 1523 microversion: 2.1 time: 0.155420 Apr 16 21:16:46.505876 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1362/2860] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:46 2022] GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:46.557787 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-712e3331-6ffa-4ef9-b1d0-46e902b6c4a3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:46.558409 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-712e3331-6ffa-4ef9-b1d0-46e902b6c4a3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:46.564236 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-712e3331-6ffa-4ef9-b1d0-46e902b6c4a3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:46.564699 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-712e3331-6ffa-4ef9-b1d0-46e902b6c4a3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:46.565507 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-712e3331-6ffa-4ef9-b1d0-46e902b6c4a3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:46.565955 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-712e3331-6ffa-4ef9-b1d0-46e902b6c4a3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:46.619958 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8f75c09d-4e05-4174-a1f8-ed4238415999 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:46.620604 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8f75c09d-4e05-4174-a1f8-ed4238415999 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:46.628109 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8f75c09d-4e05-4174-a1f8-ed4238415999 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:46.628848 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8f75c09d-4e05-4174-a1f8-ed4238415999 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:46.630289 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8f75c09d-4e05-4174-a1f8-ed4238415999 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:46.630742 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8f75c09d-4e05-4174-a1f8-ed4238415999 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:46.705807 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-712e3331-6ffa-4ef9-b1d0-46e902b6c4a3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:46.715468 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-712e3331-6ffa-4ef9-b1d0-46e902b6c4a3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1378 microversion: 2.1 time: 0.161575 Apr 16 21:16:46.716148 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1499/2861] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:46 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1378 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:46.747042 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-fd52b5ee-44ab-494a-b4e4-65d6b1c31fd8 req-0d2f46c1-5b6e-4d74-998b-51f65a2033e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbcf087b-c508-46e9-a546-99b764daddbb", "name": "network-vif-plugged", "status": "completed", "tag": "c077f313-2701-4802-bf5a-28338c745ec4"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:16:46.755352 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-fd52b5ee-44ab-494a-b4e4-65d6b1c31fd8 req-0d2f46c1-5b6e-4d74-998b-51f65a2033e2 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:46.762512 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-fd52b5ee-44ab-494a-b4e4-65d6b1c31fd8 req-0d2f46c1-5b6e-4d74-998b-51f65a2033e2 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:46.767935 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-fd52b5ee-44ab-494a-b4e4-65d6b1c31fd8 req-0d2f46c1-5b6e-4d74-998b-51f65a2033e2 service nova] Creating event network-vif-plugged:c077f313-2701-4802-bf5a-28338c745ec4 for instance cbcf087b-c508-46e9-a546-99b764daddbb on nch1-master-1 Apr 16 21:16:46.772035 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8f75c09d-4e05-4174-a1f8-ed4238415999 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:46.773118 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-fd52b5ee-44ab-494a-b4e4-65d6b1c31fd8 req-0d2f46c1-5b6e-4d74-998b-51f65a2033e2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029986 Apr 16 21:16:46.774849 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1500/2862] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:16:46.781159 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8f75c09d-4e05-4174-a1f8-ed4238415999 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18" status: 200 len: 1315 microversion: 2.1 time: 0.165184 Apr 16 21:16:46.781730 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1363/2863] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:46 2022] GET /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:47.001476 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-22588709-cc0c-4a87-a2f9-a12d2de96d82 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb95a34790>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:47.047418 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-22588709-cc0c-4a87-a2f9-a12d2de96d82 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73" status: 200 len: 1447 microversion: 2.1 time: 0.050577 Apr 16 21:16:47.048048 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1501/2864] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:16:46 2022] GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73 => generated 1447 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:47.059977 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-71bc39da-9cd7-4f6c-8d12-73a5313d6329 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb958b5700>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:47.104978 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-71bc39da-9cd7-4f6c-8d12-73a5313d6329 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73" status: 200 len: 1447 microversion: 2.1 time: 0.048937 Apr 16 21:16:47.105544 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1364/2865] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:16:47 2022] GET /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73 => generated 1447 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:47.117639 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-314585de-0842-4431-9caf-37726fe3b703 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb95980a60>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:47.287681 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8144c8a9-436c-4c21-ac7f-8f1d1b6bb4ca tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:47.288259 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8144c8a9-436c-4c21-ac7f-8f1d1b6bb4ca tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 8cb60874-b0f3-4055-a4d1-531f4a147992] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:47.294377 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8144c8a9-436c-4c21-ac7f-8f1d1b6bb4ca tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:47.294829 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8144c8a9-436c-4c21-ac7f-8f1d1b6bb4ca tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:47.295592 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8144c8a9-436c-4c21-ac7f-8f1d1b6bb4ca tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:47.296032 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8144c8a9-436c-4c21-ac7f-8f1d1b6bb4ca tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:47.432212 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8144c8a9-436c-4c21-ac7f-8f1d1b6bb4ca tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:47.439604 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8144c8a9-436c-4c21-ac7f-8f1d1b6bb4ca tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992" status: 200 len: 1533 microversion: 2.1 time: 0.156424 Apr 16 21:16:47.440190 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1365/2866] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:47 2022] GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992 => generated 1533 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:47.444396 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-61ef27f0-a3b8-435f-b3d4-7de208db0537 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:47.445023 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-61ef27f0-a3b8-435f-b3d4-7de208db0537 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:47.451418 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-61ef27f0-a3b8-435f-b3d4-7de208db0537 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:47.452401 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-61ef27f0-a3b8-435f-b3d4-7de208db0537 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:47.452729 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-61ef27f0-a3b8-435f-b3d4-7de208db0537 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:47.453175 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-61ef27f0-a3b8-435f-b3d4-7de208db0537 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:47.522515 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-61ef27f0-a3b8-435f-b3d4-7de208db0537 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lazy-loading 'services' on Instance uuid 9ce03e87-6962-45d5-910e-f87b61fef356 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:16:47.542418 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-61ef27f0-a3b8-435f-b3d4-7de208db0537 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1933 microversion: 2.75 time: 0.099478 Apr 16 21:16:47.542418 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1366/2867] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:16:47 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1933 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:16:47.545908 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-db0914ec-cd72-4edd-a15e-1a3daa91253a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:47.546508 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-db0914ec-cd72-4edd-a15e-1a3daa91253a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:47.552616 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-db0914ec-cd72-4edd-a15e-1a3daa91253a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:47.553071 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-db0914ec-cd72-4edd-a15e-1a3daa91253a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:47.553841 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-db0914ec-cd72-4edd-a15e-1a3daa91253a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:47.554314 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-db0914ec-cd72-4edd-a15e-1a3daa91253a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:47.688686 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-db0914ec-cd72-4edd-a15e-1a3daa91253a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:47.696548 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-db0914ec-cd72-4edd-a15e-1a3daa91253a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140" status: 200 len: 1523 microversion: 2.1 time: 0.154195 Apr 16 21:16:47.697167 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1367/2868] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:47 2022] GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:47.733263 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a1d0682d-a6f0-465a-8575-9e534b32e5cb tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:47.734506 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a1d0682d-a6f0-465a-8575-9e534b32e5cb tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:47.741089 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a1d0682d-a6f0-465a-8575-9e534b32e5cb tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:47.741546 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a1d0682d-a6f0-465a-8575-9e534b32e5cb tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:47.743025 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a1d0682d-a6f0-465a-8575-9e534b32e5cb tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:47.743468 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a1d0682d-a6f0-465a-8575-9e534b32e5cb tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:47.872298 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a1d0682d-a6f0-465a-8575-9e534b32e5cb tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:47.880191 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a1d0682d-a6f0-465a-8575-9e534b32e5cb tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1378 microversion: 2.1 time: 0.150855 Apr 16 21:16:47.880795 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1368/2869] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:47 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1378 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:47.886634 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0bcb05b1-2add-4dcd-847a-174a40e23859 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:47.886634 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0bcb05b1-2add-4dcd-847a-174a40e23859 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:47.892772 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0bcb05b1-2add-4dcd-847a-174a40e23859 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:47.893231 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0bcb05b1-2add-4dcd-847a-174a40e23859 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:47.894036 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0bcb05b1-2add-4dcd-847a-174a40e23859 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:47.894477 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0bcb05b1-2add-4dcd-847a-174a40e23859 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:48.027496 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0bcb05b1-2add-4dcd-847a-174a40e23859 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:48.036532 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0bcb05b1-2add-4dcd-847a-174a40e23859 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18" status: 200 len: 1315 microversion: 2.1 time: 0.154632 Apr 16 21:16:48.037129 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1369/2870] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:47 2022] GET /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:48.373427 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-314585de-0842-4431-9caf-37726fe3b703 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "DELETE /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73" status: 204 len: 0 microversion: 2.1 time: 1.260027 Apr 16 21:16:48.374038 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1502/2871] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:47 2022] DELETE /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73 => generated 0 bytes in 1261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:16:48.382124 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-015f63db-b0f4-4050-85ac-28cd4c1c26fb tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:48.383193 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-015f63db-b0f4-4050-85ac-28cd4c1c26fb tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: ff70294f-a73f-4dcf-aaf4-bd979106f1b8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:48.389749 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-015f63db-b0f4-4050-85ac-28cd4c1c26fb tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:48.390203 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-015f63db-b0f4-4050-85ac-28cd4c1c26fb tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:48.390980 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-015f63db-b0f4-4050-85ac-28cd4c1c26fb tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:48.391418 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-015f63db-b0f4-4050-85ac-28cd4c1c26fb tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:48.417797 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-015f63db-b0f4-4050-85ac-28cd4c1c26fb tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: ff70294f-a73f-4dcf-aaf4-bd979106f1b8] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:16:48.457205 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-74d66e86-33c3-4c80-9f02-a377fd710cbe tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:48.457965 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-74d66e86-33c3-4c80-9f02-a377fd710cbe tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 8cb60874-b0f3-4055-a4d1-531f4a147992] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:48.464985 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-74d66e86-33c3-4c80-9f02-a377fd710cbe tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:48.465447 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-74d66e86-33c3-4c80-9f02-a377fd710cbe tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:48.466222 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-74d66e86-33c3-4c80-9f02-a377fd710cbe tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:48.466696 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-74d66e86-33c3-4c80-9f02-a377fd710cbe tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:48.597069 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-74d66e86-33c3-4c80-9f02-a377fd710cbe tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:48.604644 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-74d66e86-33c3-4c80-9f02-a377fd710cbe tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992" status: 200 len: 1520 microversion: 2.1 time: 0.151267 Apr 16 21:16:48.605217 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1503/2872] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:48 2022] GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:48.609626 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-de7bff06-bb27-443b-adb6-ce4144aec781 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:48.614660 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-de7bff06-bb27-443b-adb6-ce4144aec781 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:48.616339 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-de7bff06-bb27-443b-adb6-ce4144aec781 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:48.616797 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-de7bff06-bb27-443b-adb6-ce4144aec781 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:48.618327 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-de7bff06-bb27-443b-adb6-ce4144aec781 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:48.618961 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-de7bff06-bb27-443b-adb6-ce4144aec781 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:48.698146 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-de7bff06-bb27-443b-adb6-ce4144aec781 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] Lazy-loading 'services' on Instance uuid 9ce03e87-6962-45d5-910e-f87b61fef356 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:16:48.705122 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-015f63db-b0f4-4050-85ac-28cd4c1c26fb tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8" status: 204 len: 0 microversion: 2.1 time: 0.326510 Apr 16 21:16:48.708066 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1370/2873] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:16:48 2022] DELETE /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:16:48.713775 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f11287c4-5ac9-4625-956c-279f3ae4645b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:48.714585 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f11287c4-5ac9-4625-956c-279f3ae4645b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 8cb60874-b0f3-4055-a4d1-531f4a147992] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:48.721573 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f11287c4-5ac9-4625-956c-279f3ae4645b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:48.722029 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f11287c4-5ac9-4625-956c-279f3ae4645b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:48.722894 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f11287c4-5ac9-4625-956c-279f3ae4645b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:48.723382 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f11287c4-5ac9-4625-956c-279f3ae4645b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:48.730833 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-de7bff06-bb27-443b-adb6-ce4144aec781 tempest-ServersAdmin275Test-1345470105 tempest-ServersAdmin275Test-1345470105-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1918 microversion: 2.75 time: 0.124575 Apr 16 21:16:48.740969 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1504/2874] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:16:48 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1918 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:16:48.752065 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d4aab20a-86ac-4389-b7ae-751129db7c37 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:48.753732 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d4aab20a-86ac-4389-b7ae-751129db7c37 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:48.764139 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d4aab20a-86ac-4389-b7ae-751129db7c37 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:48.765133 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f11287c4-5ac9-4625-956c-279f3ae4645b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 8cb60874-b0f3-4055-a4d1-531f4a147992] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:16:48.767044 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d4aab20a-86ac-4389-b7ae-751129db7c37 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:48.769664 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d4aab20a-86ac-4389-b7ae-751129db7c37 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:48.770329 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d4aab20a-86ac-4389-b7ae-751129db7c37 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:48.904473 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d4aab20a-86ac-4389-b7ae-751129db7c37 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:48.913225 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d4aab20a-86ac-4389-b7ae-751129db7c37 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140" status: 200 len: 1523 microversion: 2.1 time: 0.171145 Apr 16 21:16:48.914060 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1505/2875] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:48 2022] GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:48.918621 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-62731787-4cd9-4896-b91e-c91f1bef51ab tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:48.919203 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-62731787-4cd9-4896-b91e-c91f1bef51ab tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:48.927534 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-62731787-4cd9-4896-b91e-c91f1bef51ab tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:48.928082 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-62731787-4cd9-4896-b91e-c91f1bef51ab tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:48.928901 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-62731787-4cd9-4896-b91e-c91f1bef51ab tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:48.929377 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-62731787-4cd9-4896-b91e-c91f1bef51ab tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:48.956728 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-62731787-4cd9-4896-b91e-c91f1bef51ab tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:16:49.191859 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f11287c4-5ac9-4625-956c-279f3ae4645b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992" status: 204 len: 0 microversion: 2.1 time: 0.481931 Apr 16 21:16:49.192568 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1371/2876] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:16:48 2022] DELETE /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:16:49.197970 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0e91555c-e814-4642-8ea5-6f0413f75384 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-228190819", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "769f0aad-9fdd-4679-bf9a-69cbe3356918"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:16:49.249298 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-0e91555c-e814-4642-8ea5-6f0413f75384 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] validate_networks() for [('769f0aad-9fdd-4679-bf9a-69cbe3356918', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:16:49.282532 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-62731787-4cd9-4896-b91e-c91f1bef51ab tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 204 len: 0 microversion: 2.75 time: 0.367180 Apr 16 21:16:49.283126 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1506/2877] 10.222.0.20 () {60 vars in 1279 bytes} [Sat Apr 16 21:16:48 2022] DELETE /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 16 21:16:49.288462 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-eec427b0-b785-46bf-bed5-e338bb713f08 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:49.292549 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-eec427b0-b785-46bf-bed5-e338bb713f08 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:49.295458 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eec427b0-b785-46bf-bed5-e338bb713f08 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:49.295916 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eec427b0-b785-46bf-bed5-e338bb713f08 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:49.296756 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eec427b0-b785-46bf-bed5-e338bb713f08 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:49.297266 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eec427b0-b785-46bf-bed5-e338bb713f08 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:49.428144 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-eec427b0-b785-46bf-bed5-e338bb713f08 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:49.436159 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-eec427b0-b785-46bf-bed5-e338bb713f08 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1527 microversion: 2.1 time: 0.151783 Apr 16 21:16:49.436760 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1507/2878] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:49 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1527 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:49.441471 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1b6b1d69-cf2b-4e02-bb85-244c1424b0e3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:49.442486 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1b6b1d69-cf2b-4e02-bb85-244c1424b0e3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:49.448323 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1b6b1d69-cf2b-4e02-bb85-244c1424b0e3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:49.448781 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1b6b1d69-cf2b-4e02-bb85-244c1424b0e3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:49.449561 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1b6b1d69-cf2b-4e02-bb85-244c1424b0e3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:49.450137 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1b6b1d69-cf2b-4e02-bb85-244c1424b0e3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:49.593560 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1b6b1d69-cf2b-4e02-bb85-244c1424b0e3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:49.601358 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1b6b1d69-cf2b-4e02-bb85-244c1424b0e3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18" status: 200 len: 1502 microversion: 2.1 time: 0.163538 Apr 16 21:16:49.602612 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1508/2879] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:49 2022] GET /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18 => generated 1502 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:49.607384 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4b2b0a3c-11cb-4888-be3f-4de23619c1b9 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:49.608003 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4b2b0a3c-11cb-4888-be3f-4de23619c1b9 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 8cb60874-b0f3-4055-a4d1-531f4a147992] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:49.614311 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4b2b0a3c-11cb-4888-be3f-4de23619c1b9 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:49.614777 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4b2b0a3c-11cb-4888-be3f-4de23619c1b9 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:49.615629 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4b2b0a3c-11cb-4888-be3f-4de23619c1b9 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:49.616086 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4b2b0a3c-11cb-4888-be3f-4de23619c1b9 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:49.623152 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-0e91555c-e814-4642-8ea5-6f0413f75384 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:16:49.623653 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-0e91555c-e814-4642-8ea5-6f0413f75384 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:16:49.624220 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-0e91555c-e814-4642-8ea5-6f0413f75384 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:16:49.624709 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-0e91555c-e814-4642-8ea5-6f0413f75384 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:16:49.625201 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-0e91555c-e814-4642-8ea5-6f0413f75384 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:16:49.634237 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0e91555c-e814-4642-8ea5-6f0413f75384 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:49.634794 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0e91555c-e814-4642-8ea5-6f0413f75384 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:49.635672 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0e91555c-e814-4642-8ea5-6f0413f75384 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:49.636195 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0e91555c-e814-4642-8ea5-6f0413f75384 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:49.653631 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-0e91555c-e814-4642-8ea5-6f0413f75384 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Getting quotas for project f95103d3663146e9ba6ffb49a05196b4. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:16:49.659420 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-0e91555c-e814-4642-8ea5-6f0413f75384 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Getting quotas for user 3ad32f0114a44a3bac0c966003e312df and project f95103d3663146e9ba6ffb49a05196b4. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:16:49.672697 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0e91555c-e814-4642-8ea5-6f0413f75384 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:16:49.675089 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0e91555c-e814-4642-8ea5-6f0413f75384 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: cbe15e89-26b4-4f20-adaf-fcb6f68085c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:16:49.745893 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4b2b0a3c-11cb-4888-be3f-4de23619c1b9 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:49.753235 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4b2b0a3c-11cb-4888-be3f-4de23619c1b9 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992" status: 200 len: 1526 microversion: 2.1 time: 0.149676 Apr 16 21:16:49.753953 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1509/2880] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:49 2022] GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992 => generated 1526 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:49.759108 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-776972d0-4bdc-49ac-9ecc-457c6ef7ac20 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:49.759803 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-776972d0-4bdc-49ac-9ecc-457c6ef7ac20 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:49.765441 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-776972d0-4bdc-49ac-9ecc-457c6ef7ac20 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:49.765944 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-776972d0-4bdc-49ac-9ecc-457c6ef7ac20 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:49.766710 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-776972d0-4bdc-49ac-9ecc-457c6ef7ac20 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:49.767147 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-776972d0-4bdc-49ac-9ecc-457c6ef7ac20 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:49.830830 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-776972d0-4bdc-49ac-9ecc-457c6ef7ac20 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:49.839352 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-776972d0-4bdc-49ac-9ecc-457c6ef7ac20 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:49.840925 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-776972d0-4bdc-49ac-9ecc-457c6ef7ac20 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:49.845524 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0e91555c-e814-4642-8ea5-6f0413f75384 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.651592 Apr 16 21:16:49.845948 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-776972d0-4bdc-49ac-9ecc-457c6ef7ac20 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1443 microversion: 2.75 time: 0.091017 Apr 16 21:16:49.846564 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1372/2881] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:16:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:16:49.848341 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1510/2882] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:16:49 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:16:49.851240 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a19f1e36-be1a-4b5f-afec-d78cf2f8bf19 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:16:49.851379 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cd14a4e8-4961-4159-9000-2d2424e8e455 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:49.851953 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-cd14a4e8-4961-4159-9000-2d2424e8e455 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:49.852238 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a19f1e36-be1a-4b5f-afec-d78cf2f8bf19 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:49.858102 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a19f1e36-be1a-4b5f-afec-d78cf2f8bf19 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:49.858264 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cd14a4e8-4961-4159-9000-2d2424e8e455 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:49.858556 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a19f1e36-be1a-4b5f-afec-d78cf2f8bf19 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:49.858673 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cd14a4e8-4961-4159-9000-2d2424e8e455 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:49.859338 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a19f1e36-be1a-4b5f-afec-d78cf2f8bf19 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:49.859459 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cd14a4e8-4961-4159-9000-2d2424e8e455 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:49.859854 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cd14a4e8-4961-4159-9000-2d2424e8e455 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:49.859969 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a19f1e36-be1a-4b5f-afec-d78cf2f8bf19 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:50.004200 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cd14a4e8-4961-4159-9000-2d2424e8e455 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:50.012686 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cd14a4e8-4961-4159-9000-2d2424e8e455 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1527 microversion: 2.1 time: 0.165002 Apr 16 21:16:50.014134 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1373/2883] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:49 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1527 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:50.022567 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-21229b83-3512-4571-b2b9-3563baef25a2 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:50.023843 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-21229b83-3512-4571-b2b9-3563baef25a2 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: cbe15e89-26b4-4f20-adaf-fcb6f68085c9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:50.074797 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-21229b83-3512-4571-b2b9-3563baef25a2 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:50.081336 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-21229b83-3512-4571-b2b9-3563baef25a2 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/cbe15e89-26b4-4f20-adaf-fcb6f68085c9" status: 200 len: 1207 microversion: 2.1 time: 0.067157 Apr 16 21:16:50.081900 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1374/2884] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:50 2022] GET /compute/v2.1/servers/cbe15e89-26b4-4f20-adaf-fcb6f68085c9 => generated 1207 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:50.090349 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cd02c9ae-8f5e-48e9-bf05-b8b2fb786598 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:50.090960 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-cd02c9ae-8f5e-48e9-bf05-b8b2fb786598 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:50.096695 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cd02c9ae-8f5e-48e9-bf05-b8b2fb786598 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:50.097174 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cd02c9ae-8f5e-48e9-bf05-b8b2fb786598 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:50.098027 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cd02c9ae-8f5e-48e9-bf05-b8b2fb786598 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:50.098511 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cd02c9ae-8f5e-48e9-bf05-b8b2fb786598 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:50.231425 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cd02c9ae-8f5e-48e9-bf05-b8b2fb786598 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:50.238578 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cd02c9ae-8f5e-48e9-bf05-b8b2fb786598 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140" status: 200 len: 1523 microversion: 2.1 time: 0.152004 Apr 16 21:16:50.239157 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1375/2885] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:50 2022] GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:50.244043 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5e484254-6749-453c-8c81-617736e6df19 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:50.244940 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:16:50.244940 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:16:50.357886 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5e484254-6749-453c-8c81-617736e6df19 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/f61f5a90-0fc1-43f4-8519-4c36f67a4a60" status: 202 len: 0 microversion: 2.1 time: 0.117558 Apr 16 21:16:50.358689 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1376/2886] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:16:50 2022] DELETE /compute/v2.1/flavors/f61f5a90-0fc1-43f4-8519-4c36f67a4a60 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:16:50.367410 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0fd5eee1-abe2-440e-bd98-1de8a1ad7237 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:50.387210 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0fd5eee1-abe2-440e-bd98-1de8a1ad7237 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024414 Apr 16 21:16:50.388003 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1377/2887] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:16:50 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:50.403505 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f4a9f35a-a8db-4961-a26c-06f40d2dd889 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:16:50.404584 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f4a9f35a-a8db-4961-a26c-06f40d2dd889 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:50.411032 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f4a9f35a-a8db-4961-a26c-06f40d2dd889 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:50.411494 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f4a9f35a-a8db-4961-a26c-06f40d2dd889 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:50.412332 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f4a9f35a-a8db-4961-a26c-06f40d2dd889 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:50.412775 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f4a9f35a-a8db-4961-a26c-06f40d2dd889 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:50.440028 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f4a9f35a-a8db-4961-a26c-06f40d2dd889 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:50.446696 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f4a9f35a-a8db-4961-a26c-06f40d2dd889 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Old instance type tempest-test_resize_flavor_-967889651, new instance type m1.heat {{(pid=137409) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 16 21:16:50.452996 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-f4a9f35a-a8db-4961-a26c-06f40d2dd889 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:16:50.453425 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-f4a9f35a-a8db-4961-a26c-06f40d2dd889 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:16:50.453900 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-f4a9f35a-a8db-4961-a26c-06f40d2dd889 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:16:50.454313 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-f4a9f35a-a8db-4961-a26c-06f40d2dd889 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:16:50.454732 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-f4a9f35a-a8db-4961-a26c-06f40d2dd889 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:16:50.704503 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f4a9f35a-a8db-4961-a26c-06f40d2dd889 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "POST /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb/action" status: 202 len: 0 microversion: 2.1 time: 0.304911 Apr 16 21:16:50.708318 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1378/2888] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:16:50 2022] POST /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 16 21:16:50.717180 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-91683d92-eaf5-446a-99aa-ab89b916529e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:50.717180 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-91683d92-eaf5-446a-99aa-ab89b916529e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:50.725496 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-91683d92-eaf5-446a-99aa-ab89b916529e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:50.727019 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-91683d92-eaf5-446a-99aa-ab89b916529e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:50.728015 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-91683d92-eaf5-446a-99aa-ab89b916529e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:50.728873 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-91683d92-eaf5-446a-99aa-ab89b916529e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:50.919600 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a19f1e36-be1a-4b5f-afec-d78cf2f8bf19 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "POST /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18/action" status: 200 len: 14 microversion: 2.1 time: 1.071488 Apr 16 21:16:50.920677 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1511/2889] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:16:49 2022] POST /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18/action => generated 14 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:16:50.928229 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-424b0cdc-c189-4337-82ff-cef3dd7071ac tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:50.931074 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-424b0cdc-c189-4337-82ff-cef3dd7071ac tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 8cb60874-b0f3-4055-a4d1-531f4a147992] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:50.936620 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-424b0cdc-c189-4337-82ff-cef3dd7071ac tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:50.937334 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-424b0cdc-c189-4337-82ff-cef3dd7071ac tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:50.938328 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-424b0cdc-c189-4337-82ff-cef3dd7071ac tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:50.938959 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-424b0cdc-c189-4337-82ff-cef3dd7071ac tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:50.948386 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-91683d92-eaf5-446a-99aa-ab89b916529e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:50.957088 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-91683d92-eaf5-446a-99aa-ab89b916529e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1536 microversion: 2.1 time: 0.247533 Apr 16 21:16:50.961505 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1379/2890] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:50 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1536 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:50.977325 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1311de51-a0d8-473e-bd40-55d27a725aef tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:50.978548 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1311de51-a0d8-473e-bd40-55d27a725aef tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:50.987303 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1311de51-a0d8-473e-bd40-55d27a725aef tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:50.987303 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1311de51-a0d8-473e-bd40-55d27a725aef tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:50.987303 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1311de51-a0d8-473e-bd40-55d27a725aef tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:50.987303 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1311de51-a0d8-473e-bd40-55d27a725aef tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:51.058840 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1311de51-a0d8-473e-bd40-55d27a725aef tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:51.070879 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1311de51-a0d8-473e-bd40-55d27a725aef tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:51.072636 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1311de51-a0d8-473e-bd40-55d27a725aef tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:51.078375 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1311de51-a0d8-473e-bd40-55d27a725aef tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1443 microversion: 2.75 time: 0.109394 Apr 16 21:16:51.079296 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1380/2891] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:16:50 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1443 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:16:51.097660 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-74f2c33f-1b82-431b-9949-c77930cb4b38 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:51.097660 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-74f2c33f-1b82-431b-9949-c77930cb4b38 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: cbe15e89-26b4-4f20-adaf-fcb6f68085c9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:51.104669 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-74f2c33f-1b82-431b-9949-c77930cb4b38 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:51.105342 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-74f2c33f-1b82-431b-9949-c77930cb4b38 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:51.106010 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-74f2c33f-1b82-431b-9949-c77930cb4b38 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:51.106460 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-74f2c33f-1b82-431b-9949-c77930cb4b38 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:51.171969 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-424b0cdc-c189-4337-82ff-cef3dd7071ac tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:51.180476 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-424b0cdc-c189-4337-82ff-cef3dd7071ac tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992" status: 200 len: 1526 microversion: 2.1 time: 0.256320 Apr 16 21:16:51.180978 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-74f2c33f-1b82-431b-9949-c77930cb4b38 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:51.181146 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1512/2892] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:50 2022] GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992 => generated 1526 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:51.189376 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-74f2c33f-1b82-431b-9949-c77930cb4b38 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/cbe15e89-26b4-4f20-adaf-fcb6f68085c9" status: 200 len: 1203 microversion: 2.1 time: 0.096055 Apr 16 21:16:51.189994 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1381/2893] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:51 2022] GET /compute/v2.1/servers/cbe15e89-26b4-4f20-adaf-fcb6f68085c9 => generated 1203 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:51.256278 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-81cb2c20-2e8e-46ed-b683-b7c23af08786 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:51.257028 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-81cb2c20-2e8e-46ed-b683-b7c23af08786 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:51.265392 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-81cb2c20-2e8e-46ed-b683-b7c23af08786 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:51.265932 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-81cb2c20-2e8e-46ed-b683-b7c23af08786 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:51.267225 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-81cb2c20-2e8e-46ed-b683-b7c23af08786 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:51.267735 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-81cb2c20-2e8e-46ed-b683-b7c23af08786 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:51.407159 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-81cb2c20-2e8e-46ed-b683-b7c23af08786 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:51.414538 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-81cb2c20-2e8e-46ed-b683-b7c23af08786 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140" status: 200 len: 1523 microversion: 2.1 time: 0.162282 Apr 16 21:16:51.415107 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1513/2894] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:51 2022] GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:51.652839 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-4dada50e-b85e-4084-8f5e-a92a2dfdfc28 req-b3ef5261-99c6-4590-950d-8bc7324ac209 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8cb60874-b0f3-4055-a4d1-531f4a147992", "name": "network-vif-unplugged", "status": "completed", "tag": "f7e32037-5681-45d7-a2cb-a1ccb583ae68"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:16:51.661664 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-4dada50e-b85e-4084-8f5e-a92a2dfdfc28 req-b3ef5261-99c6-4590-950d-8bc7324ac209 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:51.662179 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-4dada50e-b85e-4084-8f5e-a92a2dfdfc28 req-b3ef5261-99c6-4590-950d-8bc7324ac209 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:51.673781 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-4dada50e-b85e-4084-8f5e-a92a2dfdfc28 req-b3ef5261-99c6-4590-950d-8bc7324ac209 service nova] Creating event network-vif-unplugged:f7e32037-5681-45d7-a2cb-a1ccb583ae68 for instance 8cb60874-b0f3-4055-a4d1-531f4a147992 on nch2-master-1 Apr 16 21:16:51.679197 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-4dada50e-b85e-4084-8f5e-a92a2dfdfc28 req-b3ef5261-99c6-4590-950d-8bc7324ac209 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030364 Apr 16 21:16:51.681211 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1382/2895] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:16:51.931553 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-41962cbf-35b2-4e5c-9cb0-c9f1d7fac5d2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:16:51.932536 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-41962cbf-35b2-4e5c-9cb0-c9f1d7fac5d2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:51.939271 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-41962cbf-35b2-4e5c-9cb0-c9f1d7fac5d2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:51.939660 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-41962cbf-35b2-4e5c-9cb0-c9f1d7fac5d2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:51.940500 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-41962cbf-35b2-4e5c-9cb0-c9f1d7fac5d2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:51.940947 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-41962cbf-35b2-4e5c-9cb0-c9f1d7fac5d2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:51.978702 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3812e8d5-e45e-4dfc-a9fa-128256f29a67 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:51.979401 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3812e8d5-e45e-4dfc-a9fa-128256f29a67 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:51.985422 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3812e8d5-e45e-4dfc-a9fa-128256f29a67 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:51.985879 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3812e8d5-e45e-4dfc-a9fa-128256f29a67 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:51.986677 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3812e8d5-e45e-4dfc-a9fa-128256f29a67 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:51.987119 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3812e8d5-e45e-4dfc-a9fa-128256f29a67 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:52.209757 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3812e8d5-e45e-4dfc-a9fa-128256f29a67 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:52.217273 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3812e8d5-e45e-4dfc-a9fa-128256f29a67 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1536 microversion: 2.1 time: 0.243222 Apr 16 21:16:52.217855 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1383/2896] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:51 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1536 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:52.222404 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-355738fa-30c1-468c-be77-b4737dbfcbdc tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:52.223011 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-355738fa-30c1-468c-be77-b4737dbfcbdc tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:52.229390 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-355738fa-30c1-468c-be77-b4737dbfcbdc tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:52.230095 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-355738fa-30c1-468c-be77-b4737dbfcbdc tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:52.230886 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-355738fa-30c1-468c-be77-b4737dbfcbdc tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:52.231329 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-355738fa-30c1-468c-be77-b4737dbfcbdc tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:52.299589 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-355738fa-30c1-468c-be77-b4737dbfcbdc tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:52.308220 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-355738fa-30c1-468c-be77-b4737dbfcbdc tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:52.309735 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-355738fa-30c1-468c-be77-b4737dbfcbdc tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:52.314448 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-355738fa-30c1-468c-be77-b4737dbfcbdc tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1443 microversion: 2.75 time: 0.095653 Apr 16 21:16:52.315016 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1384/2897] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:16:52 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:16:52.319314 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a8bee322-444b-4bb5-8d7d-f2114c24ec83 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:52.319955 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a8bee322-444b-4bb5-8d7d-f2114c24ec83 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 8cb60874-b0f3-4055-a4d1-531f4a147992] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:52.325748 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a8bee322-444b-4bb5-8d7d-f2114c24ec83 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:52.326209 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a8bee322-444b-4bb5-8d7d-f2114c24ec83 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:52.326992 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a8bee322-444b-4bb5-8d7d-f2114c24ec83 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:52.327440 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a8bee322-444b-4bb5-8d7d-f2114c24ec83 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:52.543559 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a8bee322-444b-4bb5-8d7d-f2114c24ec83 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:52.551028 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a8bee322-444b-4bb5-8d7d-f2114c24ec83 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992" status: 200 len: 1526 microversion: 2.1 time: 0.235020 Apr 16 21:16:52.551619 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1385/2898] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:52 2022] GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992 => generated 1526 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:52.556112 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-011c0e7d-e533-4762-860e-d4d451c2457b tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:52.556741 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-011c0e7d-e533-4762-860e-d4d451c2457b tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: cbe15e89-26b4-4f20-adaf-fcb6f68085c9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:52.562601 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-011c0e7d-e533-4762-860e-d4d451c2457b tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:52.563065 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-011c0e7d-e533-4762-860e-d4d451c2457b tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:52.566735 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-011c0e7d-e533-4762-860e-d4d451c2457b tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:52.566735 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-011c0e7d-e533-4762-860e-d4d451c2457b tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:52.660154 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-011c0e7d-e533-4762-860e-d4d451c2457b tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:52.669042 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-011c0e7d-e533-4762-860e-d4d451c2457b tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/cbe15e89-26b4-4f20-adaf-fcb6f68085c9" status: 200 len: 1265 microversion: 2.1 time: 0.116410 Apr 16 21:16:52.671257 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1386/2899] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:52 2022] GET /compute/v2.1/servers/cbe15e89-26b4-4f20-adaf-fcb6f68085c9 => generated 1265 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:52.682180 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-be14eb24-d958-41bf-89df-631d198a725d tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:52.682882 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-be14eb24-d958-41bf-89df-631d198a725d tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:52.689683 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-be14eb24-d958-41bf-89df-631d198a725d tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:52.690146 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-be14eb24-d958-41bf-89df-631d198a725d tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:52.690928 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-be14eb24-d958-41bf-89df-631d198a725d tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:52.691365 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-be14eb24-d958-41bf-89df-631d198a725d tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:52.730094 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-41962cbf-35b2-4e5c-9cb0-c9f1d7fac5d2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "POST /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18/action" status: 200 len: 14 microversion: 2.1 time: 0.803697 Apr 16 21:16:52.733624 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1514/2900] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:16:51 2022] POST /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18/action => generated 14 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 16 21:16:53.171315 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-be14eb24-d958-41bf-89df-631d198a725d tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:53.179168 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-be14eb24-d958-41bf-89df-631d198a725d tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140" status: 200 len: 1523 microversion: 2.1 time: 0.508586 Apr 16 21:16:53.179902 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1387/2901] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:52 2022] GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140 => generated 1523 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:53.236758 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b884abae-c1c0-40d1-9698-1b28d132e5be tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:53.238157 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b884abae-c1c0-40d1-9698-1b28d132e5be tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:53.246649 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b884abae-c1c0-40d1-9698-1b28d132e5be tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:53.247483 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b884abae-c1c0-40d1-9698-1b28d132e5be tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:53.249403 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b884abae-c1c0-40d1-9698-1b28d132e5be tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:53.249950 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b884abae-c1c0-40d1-9698-1b28d132e5be tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:53.338340 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c52076fc-31bc-497f-a791-6be7380095d2 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:53.339101 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c52076fc-31bc-497f-a791-6be7380095d2 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:53.354530 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c52076fc-31bc-497f-a791-6be7380095d2 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:53.354753 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c52076fc-31bc-497f-a791-6be7380095d2 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:53.356075 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c52076fc-31bc-497f-a791-6be7380095d2 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:53.356602 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c52076fc-31bc-497f-a791-6be7380095d2 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:53.424122 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b884abae-c1c0-40d1-9698-1b28d132e5be tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:53.433253 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b884abae-c1c0-40d1-9698-1b28d132e5be tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1536 microversion: 2.1 time: 0.201287 Apr 16 21:16:53.434582 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1515/2902] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:53 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1536 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:53.484735 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c52076fc-31bc-497f-a791-6be7380095d2 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:53.493534 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c52076fc-31bc-497f-a791-6be7380095d2 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:53.495778 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c52076fc-31bc-497f-a791-6be7380095d2 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:53.501104 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c52076fc-31bc-497f-a791-6be7380095d2 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1443 microversion: 2.75 time: 0.170447 Apr 16 21:16:53.501992 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1388/2903] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:16:53 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1443 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:16:53.568389 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f6e1c73c-9841-4289-9741-8a9ebb8ca2ae tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:53.570860 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f6e1c73c-9841-4289-9741-8a9ebb8ca2ae tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 8cb60874-b0f3-4055-a4d1-531f4a147992] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:53.576993 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6e1c73c-9841-4289-9741-8a9ebb8ca2ae tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:53.577451 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6e1c73c-9841-4289-9741-8a9ebb8ca2ae tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:53.578245 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6e1c73c-9841-4289-9741-8a9ebb8ca2ae tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:53.578689 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6e1c73c-9841-4289-9741-8a9ebb8ca2ae tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:53.686528 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5079552e-b42a-446b-962e-cd68499f27fa tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:53.687973 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5079552e-b42a-446b-962e-cd68499f27fa tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: cbe15e89-26b4-4f20-adaf-fcb6f68085c9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:53.694795 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5079552e-b42a-446b-962e-cd68499f27fa tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:53.695811 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5079552e-b42a-446b-962e-cd68499f27fa tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:53.696688 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5079552e-b42a-446b-962e-cd68499f27fa tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:53.697136 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5079552e-b42a-446b-962e-cd68499f27fa tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:53.722057 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f6e1c73c-9841-4289-9741-8a9ebb8ca2ae tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:53.730237 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f6e1c73c-9841-4289-9741-8a9ebb8ca2ae tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992" status: 200 len: 1526 microversion: 2.1 time: 0.165701 Apr 16 21:16:53.730816 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1516/2904] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:53 2022] GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992 => generated 1526 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:53.746165 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2f42255a-08ba-4377-b09b-a270f7815735 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:16:53.748077 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2f42255a-08ba-4377-b09b-a270f7815735 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:53.753145 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2f42255a-08ba-4377-b09b-a270f7815735 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:53.753607 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2f42255a-08ba-4377-b09b-a270f7815735 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:53.754390 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2f42255a-08ba-4377-b09b-a270f7815735 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:53.754868 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2f42255a-08ba-4377-b09b-a270f7815735 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:53.970169 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5079552e-b42a-446b-962e-cd68499f27fa tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:53.978398 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5079552e-b42a-446b-962e-cd68499f27fa tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/cbe15e89-26b4-4f20-adaf-fcb6f68085c9" status: 200 len: 1307 microversion: 2.1 time: 0.295936 Apr 16 21:16:53.978972 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1389/2905] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:53 2022] GET /compute/v2.1/servers/cbe15e89-26b4-4f20-adaf-fcb6f68085c9 => generated 1307 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:53.983344 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-6cdbe334-b3eb-430a-82a4-528b541c777f req-05dd0fd3-8269-4270-8ef3-b18c91e7a588 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff70294f-a73f-4dcf-aaf4-bd979106f1b8", "name": "network-vif-deleted", "tag": "16b4583f-548f-4d1c-8ae5-e1254189e93a"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:16:53.993143 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-6cdbe334-b3eb-430a-82a4-528b541c777f req-05dd0fd3-8269-4270-8ef3-b18c91e7a588 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:53.993667 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-6cdbe334-b3eb-430a-82a4-528b541c777f req-05dd0fd3-8269-4270-8ef3-b18c91e7a588 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:54.004826 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-6cdbe334-b3eb-430a-82a4-528b541c777f req-05dd0fd3-8269-4270-8ef3-b18c91e7a588 service nova] Creating event network-vif-deleted:16b4583f-548f-4d1c-8ae5-e1254189e93a for instance ff70294f-a73f-4dcf-aaf4-bd979106f1b8 on nch2-master-1 Apr 16 21:16:54.009890 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-6cdbe334-b3eb-430a-82a4-528b541c777f req-05dd0fd3-8269-4270-8ef3-b18c91e7a588 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029800 Apr 16 21:16:54.010645 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1390/2906] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:16:54.197462 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d3daaea5-bdb1-4243-9e7e-ea29e364c0d8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:54.198178 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d3daaea5-bdb1-4243-9e7e-ea29e364c0d8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:54.204339 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d3daaea5-bdb1-4243-9e7e-ea29e364c0d8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:54.204867 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d3daaea5-bdb1-4243-9e7e-ea29e364c0d8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:54.205714 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d3daaea5-bdb1-4243-9e7e-ea29e364c0d8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:54.209969 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d3daaea5-bdb1-4243-9e7e-ea29e364c0d8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:54.292810 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2f42255a-08ba-4377-b09b-a270f7815735 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "POST /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18/action" status: 200 len: 14 microversion: 2.1 time: 0.550664 Apr 16 21:16:54.293812 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1517/2907] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:16:53 2022] POST /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18/action => generated 14 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 16 21:16:54.460667 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-501ad495-faf9-4f1c-947d-5adec5359aff tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:54.461950 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-501ad495-faf9-4f1c-947d-5adec5359aff tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:54.466272 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d3daaea5-bdb1-4243-9e7e-ea29e364c0d8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:54.474884 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d3daaea5-bdb1-4243-9e7e-ea29e364c0d8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140" status: 200 len: 1523 microversion: 2.1 time: 0.282224 Apr 16 21:16:54.491537 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-501ad495-faf9-4f1c-947d-5adec5359aff tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:54.493036 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1391/2908] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:54 2022] GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140 => generated 1523 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:54.493549 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-501ad495-faf9-4f1c-947d-5adec5359aff tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:54.494348 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-501ad495-faf9-4f1c-947d-5adec5359aff tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:54.495018 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-501ad495-faf9-4f1c-947d-5adec5359aff tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:54.522972 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ad367524-ea2e-4976-a4a8-8c31b7f9c096 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:54.524504 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ad367524-ea2e-4976-a4a8-8c31b7f9c096 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:54.534060 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ad367524-ea2e-4976-a4a8-8c31b7f9c096 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:54.535113 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ad367524-ea2e-4976-a4a8-8c31b7f9c096 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:54.537566 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ad367524-ea2e-4976-a4a8-8c31b7f9c096 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:54.538609 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ad367524-ea2e-4976-a4a8-8c31b7f9c096 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:54.663918 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ad367524-ea2e-4976-a4a8-8c31b7f9c096 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:54.673473 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ad367524-ea2e-4976-a4a8-8c31b7f9c096 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:54.675041 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ad367524-ea2e-4976-a4a8-8c31b7f9c096 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:54.681226 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ad367524-ea2e-4976-a4a8-8c31b7f9c096 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1443 microversion: 2.75 time: 0.163497 Apr 16 21:16:54.693412 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1392/2909] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:16:54 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1443 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:16:54.748482 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b1a9b245-0e37-4789-96dd-56f6d3b020a4 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:54.749313 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b1a9b245-0e37-4789-96dd-56f6d3b020a4 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 8cb60874-b0f3-4055-a4d1-531f4a147992] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:54.757428 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b1a9b245-0e37-4789-96dd-56f6d3b020a4 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:54.758863 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b1a9b245-0e37-4789-96dd-56f6d3b020a4 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:54.759884 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b1a9b245-0e37-4789-96dd-56f6d3b020a4 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:54.760598 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b1a9b245-0e37-4789-96dd-56f6d3b020a4 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:54.763461 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-501ad495-faf9-4f1c-947d-5adec5359aff tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:54.776409 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-501ad495-faf9-4f1c-947d-5adec5359aff tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1536 microversion: 2.1 time: 0.328000 Apr 16 21:16:54.777851 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1518/2910] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:54 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1536 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:54.995812 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c61c43c9-1ed8-4263-b173-1fd0dee58345 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:54.996595 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c61c43c9-1ed8-4263-b173-1fd0dee58345 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: cbe15e89-26b4-4f20-adaf-fcb6f68085c9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:55.002686 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c61c43c9-1ed8-4263-b173-1fd0dee58345 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:55.003182 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c61c43c9-1ed8-4263-b173-1fd0dee58345 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:55.004046 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c61c43c9-1ed8-4263-b173-1fd0dee58345 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:55.004614 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c61c43c9-1ed8-4263-b173-1fd0dee58345 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:55.192630 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c61c43c9-1ed8-4263-b173-1fd0dee58345 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:55.200677 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c61c43c9-1ed8-4263-b173-1fd0dee58345 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/cbe15e89-26b4-4f20-adaf-fcb6f68085c9" status: 200 len: 1307 microversion: 2.1 time: 0.209534 Apr 16 21:16:55.201723 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1519/2911] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:54 2022] GET /compute/v2.1/servers/cbe15e89-26b4-4f20-adaf-fcb6f68085c9 => generated 1307 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:55.202658 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b1a9b245-0e37-4789-96dd-56f6d3b020a4 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:55.216180 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b1a9b245-0e37-4789-96dd-56f6d3b020a4 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992" status: 200 len: 1526 microversion: 2.1 time: 0.472149 Apr 16 21:16:55.216810 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1393/2912] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:54 2022] GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992 => generated 1526 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:55.303139 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5f8bf07e-5203-41d0-b9ea-b3057935fb1b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:16:55.305047 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5f8bf07e-5203-41d0-b9ea-b3057935fb1b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:55.312030 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5f8bf07e-5203-41d0-b9ea-b3057935fb1b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:55.312658 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5f8bf07e-5203-41d0-b9ea-b3057935fb1b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:55.313476 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5f8bf07e-5203-41d0-b9ea-b3057935fb1b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:55.313925 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5f8bf07e-5203-41d0-b9ea-b3057935fb1b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:55.492403 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a835821f-7406-4aac-91b1-c631df34a9b7 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:55.498238 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a835821f-7406-4aac-91b1-c631df34a9b7 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:55.499192 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a835821f-7406-4aac-91b1-c631df34a9b7 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:55.499721 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a835821f-7406-4aac-91b1-c631df34a9b7 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:55.500527 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a835821f-7406-4aac-91b1-c631df34a9b7 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:55.500968 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a835821f-7406-4aac-91b1-c631df34a9b7 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:55.578382 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5f8bf07e-5203-41d0-b9ea-b3057935fb1b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "POST /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18/action" status: 200 len: 14 microversion: 2.1 time: 0.278236 Apr 16 21:16:55.579501 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1520/2913] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:16:55 2022] POST /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18/action => generated 14 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:16:55.701032 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f9934592-71d8-44d6-adb1-2b8c9c74264b tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:55.701995 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f9934592-71d8-44d6-adb1-2b8c9c74264b tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:55.710490 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9934592-71d8-44d6-adb1-2b8c9c74264b tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:55.710490 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9934592-71d8-44d6-adb1-2b8c9c74264b tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:55.712020 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9934592-71d8-44d6-adb1-2b8c9c74264b tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:55.712490 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9934592-71d8-44d6-adb1-2b8c9c74264b tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:55.746661 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9934592-71d8-44d6-adb1-2b8c9c74264b tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:55.747445 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9934592-71d8-44d6-adb1-2b8c9c74264b tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:55.747899 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-f9934592-71d8-44d6-adb1-2b8c9c74264b tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lazy-loading 'fault' on Instance uuid 9ce03e87-6962-45d5-910e-f87b61fef356 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:16:55.800472 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f9934592-71d8-44d6-adb1-2b8c9c74264b tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:55.809158 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f9934592-71d8-44d6-adb1-2b8c9c74264b tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:55.810679 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f9934592-71d8-44d6-adb1-2b8c9c74264b tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a87f9fd93b204260ae387e6fa1802df3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70c257ac1872478aacd8b8a29b3c3420', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:55.815596 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f9934592-71d8-44d6-adb1-2b8c9c74264b tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 200 len: 1448 microversion: 2.75 time: 0.118824 Apr 16 21:16:55.816165 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1521/2914] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:16:55 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 1448 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:16:55.828484 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-83b7a4e1-1d44-4e39-bee7-4b37c9de43ba tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:55.828484 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-83b7a4e1-1d44-4e39-bee7-4b37c9de43ba tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:55.828484 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-83b7a4e1-1d44-4e39-bee7-4b37c9de43ba tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:55.828484 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-83b7a4e1-1d44-4e39-bee7-4b37c9de43ba tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:55.828898 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-83b7a4e1-1d44-4e39-bee7-4b37c9de43ba tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:55.829260 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-83b7a4e1-1d44-4e39-bee7-4b37c9de43ba tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:55.871766 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a835821f-7406-4aac-91b1-c631df34a9b7 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:55.880777 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a835821f-7406-4aac-91b1-c631df34a9b7 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140" status: 200 len: 1503 microversion: 2.1 time: 0.391822 Apr 16 21:16:55.881628 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1394/2915] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:55 2022] GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140 => generated 1503 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:55.898626 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-26ce5548-76c0-4cb0-990f-f97802cb6b89 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:55.899499 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-26ce5548-76c0-4cb0-990f-f97802cb6b89 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: dc95a4d6-f40d-4087-91ae-3038926df942] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:55.905691 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-26ce5548-76c0-4cb0-990f-f97802cb6b89 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:55.906385 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-26ce5548-76c0-4cb0-990f-f97802cb6b89 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:55.907366 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-26ce5548-76c0-4cb0-990f-f97802cb6b89 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:55.907689 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-26ce5548-76c0-4cb0-990f-f97802cb6b89 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:55.977645 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-83b7a4e1-1d44-4e39-bee7-4b37c9de43ba tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:55.985686 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-83b7a4e1-1d44-4e39-bee7-4b37c9de43ba tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1536 microversion: 2.1 time: 0.168444 Apr 16 21:16:55.986262 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1522/2916] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:55 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1536 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:56.033784 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-6ee995ba-3bd6-49f1-93b1-c7ec99418fdb req-6ccdbd33-5784-400d-9e61-fe7df4457661 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbe15e89-26b4-4f20-adaf-fcb6f68085c9", "tag": "10211d90-780e-4a95-9f0e-6bed268c796e"}, {"server_uuid": "8cb60874-b0f3-4055-a4d1-531f4a147992", "name": "network-vif-deleted", "tag": "f7e32037-5681-45d7-a2cb-a1ccb583ae68"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:16:56.055055 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-6ee995ba-3bd6-49f1-93b1-c7ec99418fdb req-6ccdbd33-5784-400d-9e61-fe7df4457661 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:56.055511 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-6ee995ba-3bd6-49f1-93b1-c7ec99418fdb req-6ccdbd33-5784-400d-9e61-fe7df4457661 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:56.080962 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-6ee995ba-3bd6-49f1-93b1-c7ec99418fdb req-6ccdbd33-5784-400d-9e61-fe7df4457661 service nova] Creating event network-changed:10211d90-780e-4a95-9f0e-6bed268c796e for instance cbe15e89-26b4-4f20-adaf-fcb6f68085c9 on nch1-master-1 Apr 16 21:16:56.081479 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-6ee995ba-3bd6-49f1-93b1-c7ec99418fdb req-6ccdbd33-5784-400d-9e61-fe7df4457661 service nova] Creating event network-vif-deleted:f7e32037-5681-45d7-a2cb-a1ccb583ae68 for instance 8cb60874-b0f3-4055-a4d1-531f4a147992 on nch2-master-1 Apr 16 21:16:56.093931 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-6ee995ba-3bd6-49f1-93b1-c7ec99418fdb req-6ccdbd33-5784-400d-9e61-fe7df4457661 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.065171 Apr 16 21:16:56.094451 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1523/2917] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:16:56.114574 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-26ce5548-76c0-4cb0-990f-f97802cb6b89 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:56.122882 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-26ce5548-76c0-4cb0-990f-f97802cb6b89 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942" status: 200 len: 1515 microversion: 2.1 time: 0.228622 Apr 16 21:16:56.123451 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1395/2918] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:55 2022] GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942 => generated 1515 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:56.140982 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-39dd0f8f-7862-44ea-a326-a14a7b16fac8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:16:56.142279 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-39dd0f8f-7862-44ea-a326-a14a7b16fac8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 9e239093-bfd8-4536-82fd-eabe75904a60] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:56.147648 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-39dd0f8f-7862-44ea-a326-a14a7b16fac8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] HTTP exception thrown: Instance 9e239093-bfd8-4536-82fd-eabe75904a60 could not be found. Apr 16 21:16:56.148288 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-39dd0f8f-7862-44ea-a326-a14a7b16fac8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Returning 404 to user: Instance 9e239093-bfd8-4536-82fd-eabe75904a60 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:16:56.149090 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-39dd0f8f-7862-44ea-a326-a14a7b16fac8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "POST /compute/v2.1/servers/9e239093-bfd8-4536-82fd-eabe75904a60/action" status: 404 len: 111 microversion: 2.1 time: 0.012528 Apr 16 21:16:56.149614 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1524/2919] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:16:56 2022] POST /compute/v2.1/servers/9e239093-bfd8-4536-82fd-eabe75904a60/action => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:16:56.158880 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5c815ee5-10d6-4ca1-93c5-ddcc5eabbd5c tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:16:56.159500 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5c815ee5-10d6-4ca1-93c5-ddcc5eabbd5c tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: dc95a4d6-f40d-4087-91ae-3038926df942] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:56.165499 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5c815ee5-10d6-4ca1-93c5-ddcc5eabbd5c tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:56.166001 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5c815ee5-10d6-4ca1-93c5-ddcc5eabbd5c tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:56.166770 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5c815ee5-10d6-4ca1-93c5-ddcc5eabbd5c tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:56.167211 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5c815ee5-10d6-4ca1-93c5-ddcc5eabbd5c tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:56.216795 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b43ca9ac-6e30-471f-b97f-b4a601e04c0c tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:56.217526 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b43ca9ac-6e30-471f-b97f-b4a601e04c0c tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: cbe15e89-26b4-4f20-adaf-fcb6f68085c9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:56.224471 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b43ca9ac-6e30-471f-b97f-b4a601e04c0c tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:56.224925 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b43ca9ac-6e30-471f-b97f-b4a601e04c0c tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:56.225710 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b43ca9ac-6e30-471f-b97f-b4a601e04c0c tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:56.226175 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b43ca9ac-6e30-471f-b97f-b4a601e04c0c tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:56.373331 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b43ca9ac-6e30-471f-b97f-b4a601e04c0c tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:56.381093 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b43ca9ac-6e30-471f-b97f-b4a601e04c0c tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/cbe15e89-26b4-4f20-adaf-fcb6f68085c9" status: 200 len: 1307 microversion: 2.1 time: 0.168096 Apr 16 21:16:56.384312 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1525/2920] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:56 2022] GET /compute/v2.1/servers/cbe15e89-26b4-4f20-adaf-fcb6f68085c9 => generated 1307 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:56.386891 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-58c5047f-19f0-4308-aaa1-28511511e969 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:56.387457 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-58c5047f-19f0-4308-aaa1-28511511e969 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 8cb60874-b0f3-4055-a4d1-531f4a147992] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:56.393541 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58c5047f-19f0-4308-aaa1-28511511e969 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:56.394012 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58c5047f-19f0-4308-aaa1-28511511e969 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:56.394801 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58c5047f-19f0-4308-aaa1-28511511e969 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:56.395314 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58c5047f-19f0-4308-aaa1-28511511e969 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:56.425381 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58c5047f-19f0-4308-aaa1-28511511e969 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:56.425851 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58c5047f-19f0-4308-aaa1-28511511e969 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:56.426312 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-58c5047f-19f0-4308-aaa1-28511511e969 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lazy-loading 'fault' on Instance uuid 8cb60874-b0f3-4055-a4d1-531f4a147992 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:16:56.470525 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-58c5047f-19f0-4308-aaa1-28511511e969 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:56.478691 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-58c5047f-19f0-4308-aaa1-28511511e969 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992" status: 200 len: 1314 microversion: 2.1 time: 0.096007 Apr 16 21:16:56.479298 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1526/2921] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:56 2022] GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992 => generated 1314 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:56.531341 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5c815ee5-10d6-4ca1-93c5-ddcc5eabbd5c tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "POST /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942/action" status: 202 len: 0 microversion: 2.1 time: 0.376393 Apr 16 21:16:56.531984 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1396/2922] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:16:56 2022] POST /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942/action => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:16:56.540519 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-578c2156-1f2f-4b1f-be1b-365f7f607e25 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:56.541138 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-578c2156-1f2f-4b1f-be1b-365f7f607e25 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: dc95a4d6-f40d-4087-91ae-3038926df942] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:56.547134 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-578c2156-1f2f-4b1f-be1b-365f7f607e25 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:56.547597 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-578c2156-1f2f-4b1f-be1b-365f7f607e25 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:56.548430 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-578c2156-1f2f-4b1f-be1b-365f7f607e25 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:56.548877 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-578c2156-1f2f-4b1f-be1b-365f7f607e25 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:56.590402 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-33aaf62f-cbb6-4e8d-bb56-7e58a9b72b72 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:16:56.591486 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-33aaf62f-cbb6-4e8d-bb56-7e58a9b72b72 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:56.597644 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-33aaf62f-cbb6-4e8d-bb56-7e58a9b72b72 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:56.598103 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-33aaf62f-cbb6-4e8d-bb56-7e58a9b72b72 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:56.598908 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-33aaf62f-cbb6-4e8d-bb56-7e58a9b72b72 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:56.599331 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-33aaf62f-cbb6-4e8d-bb56-7e58a9b72b72 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:56.679157 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-578c2156-1f2f-4b1f-be1b-365f7f607e25 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:56.688015 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-578c2156-1f2f-4b1f-be1b-365f7f607e25 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942" status: 200 len: 1520 microversion: 2.1 time: 0.151804 Apr 16 21:16:56.689724 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1527/2923] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:56 2022] GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:56.697651 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-33aaf62f-cbb6-4e8d-bb56-7e58a9b72b72 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "POST /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18/action" status: 200 len: 14 microversion: 2.1 time: 0.111128 Apr 16 21:16:56.698576 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1397/2924] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:16:56 2022] POST /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 16 21:16:56.836477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a9495bca-f823-4847-8e18-d50734a162a5 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:56.837097 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a9495bca-f823-4847-8e18-d50734a162a5 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] [instance: 9ce03e87-6962-45d5-910e-f87b61fef356] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:56.843573 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9495bca-f823-4847-8e18-d50734a162a5 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:56.844036 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9495bca-f823-4847-8e18-d50734a162a5 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:56.844854 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9495bca-f823-4847-8e18-d50734a162a5 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:56.845324 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9495bca-f823-4847-8e18-d50734a162a5 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:56.860082 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-a9495bca-f823-4847-8e18-d50734a162a5 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] HTTP exception thrown: Instance 9ce03e87-6962-45d5-910e-f87b61fef356 could not be found. Apr 16 21:16:56.860711 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a9495bca-f823-4847-8e18-d50734a162a5 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] Returning 404 to user: Instance 9ce03e87-6962-45d5-910e-f87b61fef356 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:16:56.861555 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a9495bca-f823-4847-8e18-d50734a162a5 tempest-ServersAdmin275Test-2114213762 tempest-ServersAdmin275Test-2114213762-project] 10.222.0.20 "GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356" status: 404 len: 111 microversion: 2.75 time: 0.029641 Apr 16 21:16:56.862116 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1528/2925] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:16:56 2022] GET /compute/v2.1/servers/9ce03e87-6962-45d5-910e-f87b61fef356 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:16:57.003672 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b57589b9-53c4-4abe-b737-f8b9fdf35468 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:57.004436 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b57589b9-53c4-4abe-b737-f8b9fdf35468 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:57.012265 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b57589b9-53c4-4abe-b737-f8b9fdf35468 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:57.012755 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b57589b9-53c4-4abe-b737-f8b9fdf35468 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:57.013532 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b57589b9-53c4-4abe-b737-f8b9fdf35468 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:57.013972 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b57589b9-53c4-4abe-b737-f8b9fdf35468 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:57.149968 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b57589b9-53c4-4abe-b737-f8b9fdf35468 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:57.157942 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b57589b9-53c4-4abe-b737-f8b9fdf35468 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1541 microversion: 2.1 time: 0.158690 Apr 16 21:16:57.158507 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1398/2926] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:56 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1541 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:57.399146 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ea5cd4ce-9a06-44dc-8137-2013233149a1 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:57.399767 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ea5cd4ce-9a06-44dc-8137-2013233149a1 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: cbe15e89-26b4-4f20-adaf-fcb6f68085c9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:57.406464 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ea5cd4ce-9a06-44dc-8137-2013233149a1 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:57.406888 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ea5cd4ce-9a06-44dc-8137-2013233149a1 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:57.407681 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ea5cd4ce-9a06-44dc-8137-2013233149a1 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:57.408131 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ea5cd4ce-9a06-44dc-8137-2013233149a1 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:57.497308 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-93436bb0-e029-4aab-8196-d415ad7bc809 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:57.498211 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-93436bb0-e029-4aab-8196-d415ad7bc809 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 8cb60874-b0f3-4055-a4d1-531f4a147992] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:57.505130 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-93436bb0-e029-4aab-8196-d415ad7bc809 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:57.506320 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-93436bb0-e029-4aab-8196-d415ad7bc809 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:57.507058 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-93436bb0-e029-4aab-8196-d415ad7bc809 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:57.508444 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-93436bb0-e029-4aab-8196-d415ad7bc809 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:57.530766 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-93436bb0-e029-4aab-8196-d415ad7bc809 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] HTTP exception thrown: Instance 8cb60874-b0f3-4055-a4d1-531f4a147992 could not be found. Apr 16 21:16:57.531579 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-93436bb0-e029-4aab-8196-d415ad7bc809 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Returning 404 to user: Instance 8cb60874-b0f3-4055-a4d1-531f4a147992 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:16:57.532598 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-93436bb0-e029-4aab-8196-d415ad7bc809 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992" status: 404 len: 111 microversion: 2.1 time: 0.039995 Apr 16 21:16:57.533173 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1399/2927] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:57 2022] GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:16:57.619636 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ea5cd4ce-9a06-44dc-8137-2013233149a1 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:57.633673 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ea5cd4ce-9a06-44dc-8137-2013233149a1 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/cbe15e89-26b4-4f20-adaf-fcb6f68085c9" status: 200 len: 1307 microversion: 2.1 time: 0.237380 Apr 16 21:16:57.643716 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1529/2928] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:57 2022] GET /compute/v2.1/servers/cbe15e89-26b4-4f20-adaf-fcb6f68085c9 => generated 1307 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:57.677320 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7bab12db-7fb3-4a36-bf4a-0ee0c5c35801 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1025243426", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:16:57.707187 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-eec441a8-6c44-4aa1-b0e5-433c18b9b175 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:57.707888 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-eec441a8-6c44-4aa1-b0e5-433c18b9b175 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: dc95a4d6-f40d-4087-91ae-3038926df942] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:57.718383 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eec441a8-6c44-4aa1-b0e5-433c18b9b175 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:57.719167 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eec441a8-6c44-4aa1-b0e5-433c18b9b175 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:57.720296 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eec441a8-6c44-4aa1-b0e5-433c18b9b175 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:57.720959 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eec441a8-6c44-4aa1-b0e5-433c18b9b175 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:57.750276 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-7bab12db-7fb3-4a36-bf4a-0ee0c5c35801 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] validate_networks() for [('ce54676e-63e2-4bec-8d37-78514d0685e3', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:16:57.897545 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-eec441a8-6c44-4aa1-b0e5-433c18b9b175 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:57.912385 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-eec441a8-6c44-4aa1-b0e5-433c18b9b175 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942" status: 200 len: 1500 microversion: 2.1 time: 0.204329 Apr 16 21:16:57.912385 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1530/2929] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:57 2022] GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942 => generated 1500 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:16:57.912385 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b71fedd8-0141-4c45-8651-350235f8b1d3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:16:57.912385 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b71fedd8-0141-4c45-8651-350235f8b1d3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:57.917860 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b71fedd8-0141-4c45-8651-350235f8b1d3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:57.918547 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b71fedd8-0141-4c45-8651-350235f8b1d3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:57.919580 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b71fedd8-0141-4c45-8651-350235f8b1d3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:57.920015 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b71fedd8-0141-4c45-8651-350235f8b1d3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:57.958589 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b71fedd8-0141-4c45-8651-350235f8b1d3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "POST /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18/action" status: 200 len: 14 microversion: 2.1 time: 0.051237 Apr 16 21:16:57.959260 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1531/2930] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:16:57 2022] POST /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18/action => generated 14 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:16:57.967792 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1f0d6e53-7c40-4797-99d2-1a53181c2c5b tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:16:57.969512 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1f0d6e53-7c40-4797-99d2-1a53181c2c5b tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: dc95a4d6-f40d-4087-91ae-3038926df942] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:57.976692 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1f0d6e53-7c40-4797-99d2-1a53181c2c5b tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:57.977184 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1f0d6e53-7c40-4797-99d2-1a53181c2c5b tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:57.978190 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1f0d6e53-7c40-4797-99d2-1a53181c2c5b tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:57.978633 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1f0d6e53-7c40-4797-99d2-1a53181c2c5b tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:58.002790 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-1f0d6e53-7c40-4797-99d2-1a53181c2c5b tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lazy-loading 'flavor' on Instance uuid dc95a4d6-f40d-4087-91ae-3038926df942 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:16:58.015213 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-1f0d6e53-7c40-4797-99d2-1a53181c2c5b tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] HTTP exception thrown: Cannot 'rescue' instance dc95a4d6-f40d-4087-91ae-3038926df942 while it is in vm_state paused Apr 16 21:16:58.016628 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1f0d6e53-7c40-4797-99d2-1a53181c2c5b tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Returning 409 to user: Cannot 'rescue' instance dc95a4d6-f40d-4087-91ae-3038926df942 while it is in vm_state paused {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:16:58.016767 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1f0d6e53-7c40-4797-99d2-1a53181c2c5b tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "POST /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942/action" status: 409 len: 144 microversion: 2.1 time: 0.056230 Apr 16 21:16:58.017309 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1532/2931] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:16:57 2022] POST /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942/action => generated 144 bytes in 57 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:16:58.025296 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ac1859d0-b39f-428d-a174-5f509d86a0c6 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:16:58.025829 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ac1859d0-b39f-428d-a174-5f509d86a0c6 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: dc95a4d6-f40d-4087-91ae-3038926df942] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:58.031743 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ac1859d0-b39f-428d-a174-5f509d86a0c6 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:58.032231 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ac1859d0-b39f-428d-a174-5f509d86a0c6 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:58.033011 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ac1859d0-b39f-428d-a174-5f509d86a0c6 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:58.033473 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ac1859d0-b39f-428d-a174-5f509d86a0c6 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:58.253205 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ac1859d0-b39f-428d-a174-5f509d86a0c6 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "POST /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942/action" status: 202 len: 0 microversion: 2.1 time: 0.231190 Apr 16 21:16:58.254569 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1533/2932] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:16:58 2022] POST /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 16 21:16:58.262271 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c0cfa54a-8352-4cc0-bf86-715302dd5851 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:58.262988 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c0cfa54a-8352-4cc0-bf86-715302dd5851 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:58.269934 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c0cfa54a-8352-4cc0-bf86-715302dd5851 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:58.269934 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c0cfa54a-8352-4cc0-bf86-715302dd5851 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:58.270899 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c0cfa54a-8352-4cc0-bf86-715302dd5851 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:58.271346 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c0cfa54a-8352-4cc0-bf86-715302dd5851 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:58.423978 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-7bab12db-7fb3-4a36-bf4a-0ee0c5c35801 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:16:58.424784 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-7bab12db-7fb3-4a36-bf4a-0ee0c5c35801 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:16:58.428750 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-7bab12db-7fb3-4a36-bf4a-0ee0c5c35801 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:16:58.428750 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-7bab12db-7fb3-4a36-bf4a-0ee0c5c35801 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:16:58.428750 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-7bab12db-7fb3-4a36-bf4a-0ee0c5c35801 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:16:58.431828 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c0cfa54a-8352-4cc0-bf86-715302dd5851 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:58.438187 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7bab12db-7fb3-4a36-bf4a-0ee0c5c35801 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:58.438640 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7bab12db-7fb3-4a36-bf4a-0ee0c5c35801 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:58.439638 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7bab12db-7fb3-4a36-bf4a-0ee0c5c35801 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:58.440415 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c0cfa54a-8352-4cc0-bf86-715302dd5851 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1541 microversion: 2.1 time: 0.184344 Apr 16 21:16:58.440550 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7bab12db-7fb3-4a36-bf4a-0ee0c5c35801 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:58.440992 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1534/2933] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:58 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1541 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:58.446736 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d23c39ec-39b6-424b-8d35-c21a1d808153 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:58.447589 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d23c39ec-39b6-424b-8d35-c21a1d808153 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: dc95a4d6-f40d-4087-91ae-3038926df942] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:58.455513 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d23c39ec-39b6-424b-8d35-c21a1d808153 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:58.456247 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d23c39ec-39b6-424b-8d35-c21a1d808153 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:58.457112 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d23c39ec-39b6-424b-8d35-c21a1d808153 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:58.457678 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d23c39ec-39b6-424b-8d35-c21a1d808153 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:58.477397 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-7bab12db-7fb3-4a36-bf4a-0ee0c5c35801 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Getting quotas for project c63d4ed9df1548b88731e003044c32da. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:16:58.483000 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-7bab12db-7fb3-4a36-bf4a-0ee0c5c35801 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Getting quotas for user 6230c967390f4c5f8d3b9580bac4b340 and project c63d4ed9df1548b88731e003044c32da. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:16:58.497846 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7bab12db-7fb3-4a36-bf4a-0ee0c5c35801 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:16:58.500198 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7bab12db-7fb3-4a36-bf4a-0ee0c5c35801 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 6458699b-6221-4f77-85fe-d41710e9c3bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:16:58.603363 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7bab12db-7fb3-4a36-bf4a-0ee0c5c35801 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.930871 Apr 16 21:16:58.609586 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1400/2934] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:16:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 938 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:16:58.615032 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-eaa0b235-b458-40c8-bc5d-71a0cfca04be tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:58.615927 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-eaa0b235-b458-40c8-bc5d-71a0cfca04be tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 6458699b-6221-4f77-85fe-d41710e9c3bd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:58.648486 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d23c39ec-39b6-424b-8d35-c21a1d808153 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:58.661372 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d23c39ec-39b6-424b-8d35-c21a1d808153 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942" status: 200 len: 1507 microversion: 2.1 time: 0.219024 Apr 16 21:16:58.661956 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1535/2935] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:58 2022] GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942 => generated 1507 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:58.675399 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d4795f9d-fedb-4123-a47a-90e30c32b259 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:58.677645 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d4795f9d-fedb-4123-a47a-90e30c32b259 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: cbe15e89-26b4-4f20-adaf-fcb6f68085c9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:58.691744 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d4795f9d-fedb-4123-a47a-90e30c32b259 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:58.692207 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d4795f9d-fedb-4123-a47a-90e30c32b259 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:58.694465 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d4795f9d-fedb-4123-a47a-90e30c32b259 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:58.695483 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d4795f9d-fedb-4123-a47a-90e30c32b259 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:58.708405 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-eaa0b235-b458-40c8-bc5d-71a0cfca04be tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:58.716294 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-eaa0b235-b458-40c8-bc5d-71a0cfca04be tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/6458699b-6221-4f77-85fe-d41710e9c3bd" status: 200 len: 1225 microversion: 2.1 time: 0.105315 Apr 16 21:16:58.716977 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1401/2936] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:58 2022] GET /compute/v2.1/servers/6458699b-6221-4f77-85fe-d41710e9c3bd => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:58.973687 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1665b171-30cf-4348-8e5a-7b0ef8021bdd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:16:58.974848 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1665b171-30cf-4348-8e5a-7b0ef8021bdd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:58.982254 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1665b171-30cf-4348-8e5a-7b0ef8021bdd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:58.982818 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1665b171-30cf-4348-8e5a-7b0ef8021bdd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:58.984650 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1665b171-30cf-4348-8e5a-7b0ef8021bdd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:58.985173 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1665b171-30cf-4348-8e5a-7b0ef8021bdd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:59.034312 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1665b171-30cf-4348-8e5a-7b0ef8021bdd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "POST /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18/action" status: 200 len: 14 microversion: 2.1 time: 0.064379 Apr 16 21:16:59.038725 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1402/2937] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:16:58 2022] POST /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18/action => generated 14 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:16:59.203619 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d4795f9d-fedb-4123-a47a-90e30c32b259 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:59.210947 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d4795f9d-fedb-4123-a47a-90e30c32b259 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/cbe15e89-26b4-4f20-adaf-fcb6f68085c9" status: 200 len: 1307 microversion: 2.1 time: 0.541751 Apr 16 21:16:59.211520 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1536/2938] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:58 2022] GET /compute/v2.1/servers/cbe15e89-26b4-4f20-adaf-fcb6f68085c9 => generated 1307 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:59.458597 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-333bf68f-4bd0-45d5-aaeb-68a06f26adab tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:59.459415 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-333bf68f-4bd0-45d5-aaeb-68a06f26adab tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:59.466720 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-333bf68f-4bd0-45d5-aaeb-68a06f26adab tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:59.467187 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-333bf68f-4bd0-45d5-aaeb-68a06f26adab tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:59.467975 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-333bf68f-4bd0-45d5-aaeb-68a06f26adab tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:59.468473 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-333bf68f-4bd0-45d5-aaeb-68a06f26adab tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:59.599104 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-333bf68f-4bd0-45d5-aaeb-68a06f26adab tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:59.607670 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-333bf68f-4bd0-45d5-aaeb-68a06f26adab tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1541 microversion: 2.1 time: 0.153374 Apr 16 21:16:59.608327 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1403/2939] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:59 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1541 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:59.680204 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-912e11b9-8d37-4df9-b51d-45f7c2427e27 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:59.681904 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-912e11b9-8d37-4df9-b51d-45f7c2427e27 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: dc95a4d6-f40d-4087-91ae-3038926df942] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:59.689109 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-912e11b9-8d37-4df9-b51d-45f7c2427e27 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:59.689576 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-912e11b9-8d37-4df9-b51d-45f7c2427e27 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:59.690368 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-912e11b9-8d37-4df9-b51d-45f7c2427e27 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:59.690898 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-912e11b9-8d37-4df9-b51d-45f7c2427e27 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:59.738000 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8811fa12-5390-4a0d-9843-d1e5b890cbd0 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:16:59.738711 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8811fa12-5390-4a0d-9843-d1e5b890cbd0 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 6458699b-6221-4f77-85fe-d41710e9c3bd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:16:59.746027 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8811fa12-5390-4a0d-9843-d1e5b890cbd0 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:59.746897 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8811fa12-5390-4a0d-9843-d1e5b890cbd0 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:59.748499 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8811fa12-5390-4a0d-9843-d1e5b890cbd0 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:16:59.749837 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8811fa12-5390-4a0d-9843-d1e5b890cbd0 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:16:59.832975 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-912e11b9-8d37-4df9-b51d-45f7c2427e27 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:59.840498 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8811fa12-5390-4a0d-9843-d1e5b890cbd0 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:16:59.841865 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-912e11b9-8d37-4df9-b51d-45f7c2427e27 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942" status: 200 len: 1515 microversion: 2.1 time: 0.166374 Apr 16 21:16:59.842459 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1537/2940] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:59 2022] GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942 => generated 1515 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:16:59.848401 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8811fa12-5390-4a0d-9843-d1e5b890cbd0 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/6458699b-6221-4f77-85fe-d41710e9c3bd" status: 200 len: 1229 microversion: 2.1 time: 0.114527 Apr 16 21:16:59.848929 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1404/2941] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:16:59 2022] GET /compute/v2.1/servers/6458699b-6221-4f77-85fe-d41710e9c3bd => generated 1229 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:00.046091 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-184af84d-4395-451c-851c-b8f9130b0490 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:00.047190 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-184af84d-4395-451c-851c-b8f9130b0490 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:00.053927 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-184af84d-4395-451c-851c-b8f9130b0490 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:00.054402 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-184af84d-4395-451c-851c-b8f9130b0490 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:00.055201 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-184af84d-4395-451c-851c-b8f9130b0490 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:00.055653 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-184af84d-4395-451c-851c-b8f9130b0490 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:00.092849 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-184af84d-4395-451c-851c-b8f9130b0490 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "POST /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18/action" status: 200 len: 14 microversion: 2.1 time: 0.050492 Apr 16 21:17:00.093637 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1538/2942] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:17:00 2022] POST /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18/action => generated 14 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:17:00.227748 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-30b674a8-27a7-472f-a8c6-762277259560 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:00.228493 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-30b674a8-27a7-472f-a8c6-762277259560 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: cbe15e89-26b4-4f20-adaf-fcb6f68085c9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:00.236975 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-30b674a8-27a7-472f-a8c6-762277259560 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:00.237492 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-30b674a8-27a7-472f-a8c6-762277259560 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:00.238347 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-30b674a8-27a7-472f-a8c6-762277259560 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:00.238967 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-30b674a8-27a7-472f-a8c6-762277259560 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:00.369879 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-30b674a8-27a7-472f-a8c6-762277259560 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:00.377347 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-30b674a8-27a7-472f-a8c6-762277259560 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/cbe15e89-26b4-4f20-adaf-fcb6f68085c9" status: 200 len: 1307 microversion: 2.1 time: 0.153874 Apr 16 21:17:00.377913 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1405/2943] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:00 2022] GET /compute/v2.1/servers/cbe15e89-26b4-4f20-adaf-fcb6f68085c9 => generated 1307 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:00.629730 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7b767c7c-7c66-444f-8ee4-c7c145ca02fa tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:00.629730 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7b767c7c-7c66-444f-8ee4-c7c145ca02fa tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:00.637414 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7b767c7c-7c66-444f-8ee4-c7c145ca02fa tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:00.637877 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7b767c7c-7c66-444f-8ee4-c7c145ca02fa tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:00.638677 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7b767c7c-7c66-444f-8ee4-c7c145ca02fa tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:00.639121 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7b767c7c-7c66-444f-8ee4-c7c145ca02fa tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:00.843341 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7b767c7c-7c66-444f-8ee4-c7c145ca02fa tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:00.863257 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-dc3b1b17-f94e-47ba-8074-710b860168aa req-e2cea985-dad6-419f-8e3f-f0431e41d0ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbe15e89-26b4-4f20-adaf-fcb6f68085c9", "name": "network-vif-plugged", "status": "completed", "tag": "10211d90-780e-4a95-9f0e-6bed268c796e"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:00.880737 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7b767c7c-7c66-444f-8ee4-c7c145ca02fa tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1541 microversion: 2.1 time: 0.258316 Apr 16 21:17:00.880994 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-dc3b1b17-f94e-47ba-8074-710b860168aa req-e2cea985-dad6-419f-8e3f-f0431e41d0ef service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:00.882007 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-dc3b1b17-f94e-47ba-8074-710b860168aa req-e2cea985-dad6-419f-8e3f-f0431e41d0ef service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:00.884313 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1539/2944] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:00 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1541 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:17:00.897133 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-dc3b1b17-f94e-47ba-8074-710b860168aa req-e2cea985-dad6-419f-8e3f-f0431e41d0ef service nova] Creating event network-vif-plugged:10211d90-780e-4a95-9f0e-6bed268c796e for instance cbe15e89-26b4-4f20-adaf-fcb6f68085c9 on nch1-master-1 Apr 16 21:17:00.898575 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e8f926e1-dea0-4ddf-bbff-eca121c5c6bb tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:00.899777 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e8f926e1-dea0-4ddf-bbff-eca121c5c6bb tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 6458699b-6221-4f77-85fe-d41710e9c3bd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:00.902534 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-dc3b1b17-f94e-47ba-8074-710b860168aa req-e2cea985-dad6-419f-8e3f-f0431e41d0ef service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043960 Apr 16 21:17:00.907256 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1406/2945] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:17:00.922703 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e8f926e1-dea0-4ddf-bbff-eca121c5c6bb tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:00.927595 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e8f926e1-dea0-4ddf-bbff-eca121c5c6bb tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:00.930512 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e8f926e1-dea0-4ddf-bbff-eca121c5c6bb tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:00.931401 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e8f926e1-dea0-4ddf-bbff-eca121c5c6bb tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:01.011784 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e8f926e1-dea0-4ddf-bbff-eca121c5c6bb tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:01.026324 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e8f926e1-dea0-4ddf-bbff-eca121c5c6bb tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/6458699b-6221-4f77-85fe-d41710e9c3bd" status: 200 len: 1285 microversion: 2.1 time: 0.139478 Apr 16 21:17:01.027210 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1540/2946] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:00 2022] GET /compute/v2.1/servers/6458699b-6221-4f77-85fe-d41710e9c3bd => generated 1285 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:01.107878 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ca194056-2c86-4102-9854-1676a1aeaddc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:01.109191 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ca194056-2c86-4102-9854-1676a1aeaddc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:01.117370 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ca194056-2c86-4102-9854-1676a1aeaddc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:01.118438 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ca194056-2c86-4102-9854-1676a1aeaddc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:01.120916 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ca194056-2c86-4102-9854-1676a1aeaddc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:01.121574 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ca194056-2c86-4102-9854-1676a1aeaddc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:01.174919 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ca194056-2c86-4102-9854-1676a1aeaddc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "POST /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18/action" status: 200 len: 14 microversion: 2.1 time: 0.065401 Apr 16 21:17:01.174919 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1407/2947] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:17:01 2022] POST /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18/action => generated 14 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:17:01.400879 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-def11cdc-cc0f-462b-9fc8-43066bf339c4 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:01.401945 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-def11cdc-cc0f-462b-9fc8-43066bf339c4 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: cbe15e89-26b4-4f20-adaf-fcb6f68085c9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:01.409541 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-def11cdc-cc0f-462b-9fc8-43066bf339c4 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:01.415689 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-def11cdc-cc0f-462b-9fc8-43066bf339c4 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:01.415689 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-def11cdc-cc0f-462b-9fc8-43066bf339c4 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:01.415689 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-def11cdc-cc0f-462b-9fc8-43066bf339c4 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:01.618689 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-def11cdc-cc0f-462b-9fc8-43066bf339c4 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:01.628377 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-def11cdc-cc0f-462b-9fc8-43066bf339c4 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/cbe15e89-26b4-4f20-adaf-fcb6f68085c9" status: 200 len: 1307 microversion: 2.1 time: 0.234655 Apr 16 21:17:01.628377 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1541/2948] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:01 2022] GET /compute/v2.1/servers/cbe15e89-26b4-4f20-adaf-fcb6f68085c9 => generated 1307 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:01.902346 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-620d53ec-b972-4833-b12e-0bc9d49a6371 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:01.903519 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-620d53ec-b972-4833-b12e-0bc9d49a6371 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:01.910902 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-620d53ec-b972-4833-b12e-0bc9d49a6371 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:01.911352 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-620d53ec-b972-4833-b12e-0bc9d49a6371 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:01.912134 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-620d53ec-b972-4833-b12e-0bc9d49a6371 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:01.912601 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-620d53ec-b972-4833-b12e-0bc9d49a6371 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:02.047789 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-59d5028f-d49f-4829-9e34-ab2dd509de7f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:02.048587 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-59d5028f-d49f-4829-9e34-ab2dd509de7f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 6458699b-6221-4f77-85fe-d41710e9c3bd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:02.060541 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-59d5028f-d49f-4829-9e34-ab2dd509de7f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:02.063653 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-59d5028f-d49f-4829-9e34-ab2dd509de7f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:02.064668 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-59d5028f-d49f-4829-9e34-ab2dd509de7f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:02.065246 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-59d5028f-d49f-4829-9e34-ab2dd509de7f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:02.150574 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-620d53ec-b972-4833-b12e-0bc9d49a6371 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:02.167511 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-620d53ec-b972-4833-b12e-0bc9d49a6371 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1541 microversion: 2.1 time: 0.269871 Apr 16 21:17:02.179968 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1408/2949] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:01 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1541 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:02.186825 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a82a1f9e-03e7-4cad-adbf-b63fc9c291bf tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:02.188064 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a82a1f9e-03e7-4cad-adbf-b63fc9c291bf tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:02.195913 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a82a1f9e-03e7-4cad-adbf-b63fc9c291bf tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:02.197813 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a82a1f9e-03e7-4cad-adbf-b63fc9c291bf tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:02.197813 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a82a1f9e-03e7-4cad-adbf-b63fc9c291bf tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:02.198332 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a82a1f9e-03e7-4cad-adbf-b63fc9c291bf tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:02.245370 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a82a1f9e-03e7-4cad-adbf-b63fc9c291bf tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "POST /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18/action" status: 200 len: 14 microversion: 2.1 time: 0.063804 Apr 16 21:17:02.246059 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1409/2950] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:17:02 2022] POST /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18/action => generated 14 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:17:02.252504 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-59d5028f-d49f-4829-9e34-ab2dd509de7f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:02.261888 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-59d5028f-d49f-4829-9e34-ab2dd509de7f tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/6458699b-6221-4f77-85fe-d41710e9c3bd" status: 200 len: 1325 microversion: 2.1 time: 0.218277 Apr 16 21:17:02.268920 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1542/2951] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:02 2022] GET /compute/v2.1/servers/6458699b-6221-4f77-85fe-d41710e9c3bd => generated 1325 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:17:02.645658 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-47a16cf7-f3d8-4397-a843-d0c6f8fe4104 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:02.646573 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-47a16cf7-f3d8-4397-a843-d0c6f8fe4104 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: cbe15e89-26b4-4f20-adaf-fcb6f68085c9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:02.654313 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-47a16cf7-f3d8-4397-a843-d0c6f8fe4104 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:02.654777 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-47a16cf7-f3d8-4397-a843-d0c6f8fe4104 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:02.655943 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-47a16cf7-f3d8-4397-a843-d0c6f8fe4104 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:02.656417 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-47a16cf7-f3d8-4397-a843-d0c6f8fe4104 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:02.684822 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-16520118-fe20-47cb-819c-e2958c3d3756 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:02.686242 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-16520118-fe20-47cb-819c-e2958c3d3756 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: dc95a4d6-f40d-4087-91ae-3038926df942] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:02.697329 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-16520118-fe20-47cb-819c-e2958c3d3756 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:02.698055 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-16520118-fe20-47cb-819c-e2958c3d3756 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:02.699063 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-16520118-fe20-47cb-819c-e2958c3d3756 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:02.699701 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-16520118-fe20-47cb-819c-e2958c3d3756 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:02.730591 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-16520118-fe20-47cb-819c-e2958c3d3756 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lazy-loading 'flavor' on Instance uuid dc95a4d6-f40d-4087-91ae-3038926df942 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:17:02.869848 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-47a16cf7-f3d8-4397-a843-d0c6f8fe4104 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:02.877947 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-47a16cf7-f3d8-4397-a843-d0c6f8fe4104 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/cbe15e89-26b4-4f20-adaf-fcb6f68085c9" status: 200 len: 1487 microversion: 2.1 time: 0.236734 Apr 16 21:17:02.883788 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1410/2952] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:02 2022] GET /compute/v2.1/servers/cbe15e89-26b4-4f20-adaf-fcb6f68085c9 => generated 1487 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:02.883788 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-b0823a88-d71d-41e2-8540-d4b9af1c6c38 req-16924241-71ff-4d7c-9315-c6237bb18eb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6458699b-6221-4f77-85fe-d41710e9c3bd", "tag": "94e8eb87-ee7a-4a8e-bb59-9075350ddd30"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:02.891563 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-b0823a88-d71d-41e2-8540-d4b9af1c6c38 req-16924241-71ff-4d7c-9315-c6237bb18eb2 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:02.892050 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-b0823a88-d71d-41e2-8540-d4b9af1c6c38 req-16924241-71ff-4d7c-9315-c6237bb18eb2 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:02.904265 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-b0823a88-d71d-41e2-8540-d4b9af1c6c38 req-16924241-71ff-4d7c-9315-c6237bb18eb2 service nova] Creating event network-changed:94e8eb87-ee7a-4a8e-bb59-9075350ddd30 for instance 6458699b-6221-4f77-85fe-d41710e9c3bd on nch2-master-1 Apr 16 21:17:02.910569 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-b0823a88-d71d-41e2-8540-d4b9af1c6c38 req-16924241-71ff-4d7c-9315-c6237bb18eb2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030568 Apr 16 21:17:02.911704 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1411/2953] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:17:02.919316 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-96d4521e-a449-4a2d-a677-f450d4ca2f0b tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-999445853"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:02.921130 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-96d4521e-a449-4a2d-a677-f450d4ca2f0b tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: cbe15e89-26b4-4f20-adaf-fcb6f68085c9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:02.927579 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-96d4521e-a449-4a2d-a677-f450d4ca2f0b tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:02.928040 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-96d4521e-a449-4a2d-a677-f450d4ca2f0b tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:02.929135 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-96d4521e-a449-4a2d-a677-f450d4ca2f0b tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:02.929595 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-96d4521e-a449-4a2d-a677-f450d4ca2f0b tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:03.145997 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-16520118-fe20-47cb-819c-e2958c3d3756 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "POST /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942/action" status: 200 len: 32 microversion: 2.1 time: 0.466138 Apr 16 21:17:03.153440 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1543/2954] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:17:02 2022] POST /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942/action => generated 32 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 16 21:17:03.157745 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9a6eeb8d-2e68-4669-8044-89c54261c8d3 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:03.158468 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9a6eeb8d-2e68-4669-8044-89c54261c8d3 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: dc95a4d6-f40d-4087-91ae-3038926df942] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:03.165929 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a6eeb8d-2e68-4669-8044-89c54261c8d3 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:03.166406 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a6eeb8d-2e68-4669-8044-89c54261c8d3 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:03.167201 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a6eeb8d-2e68-4669-8044-89c54261c8d3 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:03.167848 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a6eeb8d-2e68-4669-8044-89c54261c8d3 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:03.371051 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9a6eeb8d-2e68-4669-8044-89c54261c8d3 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:03.378917 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9a6eeb8d-2e68-4669-8044-89c54261c8d3 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942" status: 200 len: 1521 microversion: 2.1 time: 0.226030 Apr 16 21:17:03.379867 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1544/2955] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:03 2022] GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:03.385728 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e86a12c5-4f46-4693-81f5-912f6fbeb1dc tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:03.386322 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e86a12c5-4f46-4693-81f5-912f6fbeb1dc tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:03.392522 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e86a12c5-4f46-4693-81f5-912f6fbeb1dc tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:03.393123 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e86a12c5-4f46-4693-81f5-912f6fbeb1dc tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:03.397077 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e86a12c5-4f46-4693-81f5-912f6fbeb1dc tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:03.397077 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e86a12c5-4f46-4693-81f5-912f6fbeb1dc tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:03.621298 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e86a12c5-4f46-4693-81f5-912f6fbeb1dc tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:03.629488 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e86a12c5-4f46-4693-81f5-912f6fbeb1dc tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1541 microversion: 2.1 time: 0.248333 Apr 16 21:17:03.630142 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1545/2956] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:03 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1541 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:03.639755 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-82a25eed-3e6e-4793-910b-0d5307897a02 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:03.641060 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-82a25eed-3e6e-4793-910b-0d5307897a02 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:03.642890 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-96d4521e-a449-4a2d-a677-f450d4ca2f0b tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "POST /compute/v2.1/servers/cbe15e89-26b4-4f20-adaf-fcb6f68085c9/action" status: 202 len: 0 microversion: 2.1 time: 0.729561 Apr 16 21:17:03.648930 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1412/2957] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:17:02 2022] POST /compute/v2.1/servers/cbe15e89-26b4-4f20-adaf-fcb6f68085c9/action => generated 0 bytes in 735 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 16 21:17:03.654072 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-82a25eed-3e6e-4793-910b-0d5307897a02 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:03.654544 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-82a25eed-3e6e-4793-910b-0d5307897a02 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:03.655683 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-82a25eed-3e6e-4793-910b-0d5307897a02 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:03.656215 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-82a25eed-3e6e-4793-910b-0d5307897a02 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:03.658590 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7f8997be-1be3-4cc8-8bd6-6360a30fc341 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:03.662260 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7f8997be-1be3-4cc8-8bd6-6360a30fc341 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 6458699b-6221-4f77-85fe-d41710e9c3bd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:03.673326 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7f8997be-1be3-4cc8-8bd6-6360a30fc341 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:03.675652 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7f8997be-1be3-4cc8-8bd6-6360a30fc341 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:03.678427 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7f8997be-1be3-4cc8-8bd6-6360a30fc341 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:03.678964 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7f8997be-1be3-4cc8-8bd6-6360a30fc341 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:03.940596 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7f8997be-1be3-4cc8-8bd6-6360a30fc341 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:03.951761 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7f8997be-1be3-4cc8-8bd6-6360a30fc341 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/6458699b-6221-4f77-85fe-d41710e9c3bd" status: 200 len: 1325 microversion: 2.1 time: 0.301193 Apr 16 21:17:03.962620 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1413/2958] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:03 2022] GET /compute/v2.1/servers/6458699b-6221-4f77-85fe-d41710e9c3bd => generated 1325 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:03.968051 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8db0c7f6-2121-42ab-925c-4ba08f4d1095 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb965715e0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:04.027374 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8db0c7f6-2121-42ab-925c-4ba08f4d1095 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/c932cf42-d8f7-4104-aa85-776fe7e8cac5" status: 200 len: 1411 microversion: 2.1 time: 0.062607 Apr 16 21:17:04.028530 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1414/2959] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:17:03 2022] GET /compute/v2.1/images/c932cf42-d8f7-4104-aa85-776fe7e8cac5 => generated 1411 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:04.040948 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9c05ab18-48bd-4cfa-a252-bf6ce54f4868 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb958600d0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:04.088482 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9c05ab18-48bd-4cfa-a252-bf6ce54f4868 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/c932cf42-d8f7-4104-aa85-776fe7e8cac5" status: 200 len: 1411 microversion: 2.1 time: 0.051777 Apr 16 21:17:04.089051 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1415/2960] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:17:04 2022] GET /compute/v2.1/images/c932cf42-d8f7-4104-aa85-776fe7e8cac5 => generated 1411 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:17:04.100531 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ba808e5b-6a35-46dc-af5e-6bb2e121aa40 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb9597c0d0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:04.371174 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ba808e5b-6a35-46dc-af5e-6bb2e121aa40 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "DELETE /compute/v2.1/images/c932cf42-d8f7-4104-aa85-776fe7e8cac5" status: 204 len: 0 microversion: 2.1 time: 0.274580 Apr 16 21:17:04.371780 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1416/2961] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:04 2022] DELETE /compute/v2.1/images/c932cf42-d8f7-4104-aa85-776fe7e8cac5 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 16 21:17:04.380067 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-962168a4-c3df-43cb-9d80-b87b8f350fe0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb957fd790>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:04.405503 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-962168a4-c3df-43cb-9d80-b87b8f350fe0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] HTTP exception thrown: Image not found. Apr 16 21:17:04.406222 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-962168a4-c3df-43cb-9d80-b87b8f350fe0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Returning 404 to user: Image not found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:17:04.407147 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-962168a4-c3df-43cb-9d80-b87b8f350fe0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/images/c932cf42-d8f7-4104-aa85-776fe7e8cac5" status: 404 len: 62 microversion: 2.1 time: 0.031084 Apr 16 21:17:04.407904 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1417/2962] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:17:04 2022] GET /compute/v2.1/images/c932cf42-d8f7-4104-aa85-776fe7e8cac5 => generated 62 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Apr 16 21:17:04.412620 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9001c30f-5086-4803-998a-e02dafb67d7d tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:04.414066 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9001c30f-5086-4803-998a-e02dafb67d7d tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: dc95a4d6-f40d-4087-91ae-3038926df942] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:04.420028 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9001c30f-5086-4803-998a-e02dafb67d7d tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:04.420478 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9001c30f-5086-4803-998a-e02dafb67d7d tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:04.421284 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9001c30f-5086-4803-998a-e02dafb67d7d tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:04.421735 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9001c30f-5086-4803-998a-e02dafb67d7d tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:04.584926 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9001c30f-5086-4803-998a-e02dafb67d7d tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:04.594084 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9001c30f-5086-4803-998a-e02dafb67d7d tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942" status: 200 len: 1521 microversion: 2.1 time: 0.184858 Apr 16 21:17:04.595475 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1418/2963] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:04 2022] GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:04.600201 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-15ee2663-4073-4dd0-99cd-5bc267f896e7 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:04.600894 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-15ee2663-4073-4dd0-99cd-5bc267f896e7 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: cbe15e89-26b4-4f20-adaf-fcb6f68085c9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:04.609079 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-15ee2663-4073-4dd0-99cd-5bc267f896e7 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:04.609559 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-15ee2663-4073-4dd0-99cd-5bc267f896e7 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:04.610503 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-15ee2663-4073-4dd0-99cd-5bc267f896e7 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:04.615332 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-15ee2663-4073-4dd0-99cd-5bc267f896e7 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:04.777004 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-15ee2663-4073-4dd0-99cd-5bc267f896e7 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:04.785252 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-15ee2663-4073-4dd0-99cd-5bc267f896e7 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/cbe15e89-26b4-4f20-adaf-fcb6f68085c9" status: 200 len: 1499 microversion: 2.1 time: 0.189202 Apr 16 21:17:04.786055 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1419/2964] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:04 2022] GET /compute/v2.1/servers/cbe15e89-26b4-4f20-adaf-fcb6f68085c9 => generated 1499 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:04.791179 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5cd1aa64-928d-4617-92ab-bef0ffa83521 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:04.792046 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5cd1aa64-928d-4617-92ab-bef0ffa83521 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:04.798358 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5cd1aa64-928d-4617-92ab-bef0ffa83521 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:04.798827 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5cd1aa64-928d-4617-92ab-bef0ffa83521 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:04.799611 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5cd1aa64-928d-4617-92ab-bef0ffa83521 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:04.800064 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5cd1aa64-928d-4617-92ab-bef0ffa83521 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:04.962112 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5cd1aa64-928d-4617-92ab-bef0ffa83521 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:04.970172 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5cd1aa64-928d-4617-92ab-bef0ffa83521 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1541 microversion: 2.1 time: 0.183344 Apr 16 21:17:04.970895 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1420/2965] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:04 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1541 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:04.983056 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2cc44acc-290c-4717-b374-a5080a84cbce tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:04.983980 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2cc44acc-290c-4717-b374-a5080a84cbce tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 6458699b-6221-4f77-85fe-d41710e9c3bd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:04.990085 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2cc44acc-290c-4717-b374-a5080a84cbce tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:04.990817 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2cc44acc-290c-4717-b374-a5080a84cbce tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:04.992469 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2cc44acc-290c-4717-b374-a5080a84cbce tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:04.992980 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2cc44acc-290c-4717-b374-a5080a84cbce tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:05.144412 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2cc44acc-290c-4717-b374-a5080a84cbce tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:05.154012 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2cc44acc-290c-4717-b374-a5080a84cbce tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/6458699b-6221-4f77-85fe-d41710e9c3bd" status: 200 len: 1325 microversion: 2.1 time: 0.176495 Apr 16 21:17:05.154926 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1421/2966] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:04 2022] GET /compute/v2.1/servers/6458699b-6221-4f77-85fe-d41710e9c3bd => generated 1325 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:05.611337 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-54eaa4d7-782b-49e8-bcf9-0fac4502f53a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:05.611978 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-54eaa4d7-782b-49e8-bcf9-0fac4502f53a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: dc95a4d6-f40d-4087-91ae-3038926df942] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:05.618019 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-54eaa4d7-782b-49e8-bcf9-0fac4502f53a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:05.618479 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-54eaa4d7-782b-49e8-bcf9-0fac4502f53a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:05.619256 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-54eaa4d7-782b-49e8-bcf9-0fac4502f53a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:05.619705 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-54eaa4d7-782b-49e8-bcf9-0fac4502f53a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:05.855858 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-54eaa4d7-782b-49e8-bcf9-0fac4502f53a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:05.864252 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-54eaa4d7-782b-49e8-bcf9-0fac4502f53a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942" status: 200 len: 1521 microversion: 2.1 time: 0.256604 Apr 16 21:17:05.874282 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1422/2967] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:05 2022] GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942 => generated 1521 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:17:05.874282 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ef955f62-a2a3-4ecc-b1cf-33a8b3e2264d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:05.874282 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ef955f62-a2a3-4ecc-b1cf-33a8b3e2264d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: cbe15e89-26b4-4f20-adaf-fcb6f68085c9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:05.877630 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ef955f62-a2a3-4ecc-b1cf-33a8b3e2264d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:05.883027 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ef955f62-a2a3-4ecc-b1cf-33a8b3e2264d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:05.883027 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ef955f62-a2a3-4ecc-b1cf-33a8b3e2264d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:05.883027 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ef955f62-a2a3-4ecc-b1cf-33a8b3e2264d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:05.960379 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-82a25eed-3e6e-4793-910b-0d5307897a02 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "POST /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18/action" status: 200 len: 16394 microversion: 2.1 time: 2.325742 Apr 16 21:17:05.962484 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1546/2968] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:17:03 2022] POST /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18/action => generated 16394 bytes in 2331 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:17:05.971575 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fb23a32f-b271-4bc8-93c0-fbf2a86cc90a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:05.972718 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fb23a32f-b271-4bc8-93c0-fbf2a86cc90a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:05.983838 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fb23a32f-b271-4bc8-93c0-fbf2a86cc90a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:05.984467 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fb23a32f-b271-4bc8-93c0-fbf2a86cc90a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:05.985368 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fb23a32f-b271-4bc8-93c0-fbf2a86cc90a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:05.986023 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fb23a32f-b271-4bc8-93c0-fbf2a86cc90a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:06.122358 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ef955f62-a2a3-4ecc-b1cf-33a8b3e2264d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:06.133155 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ef955f62-a2a3-4ecc-b1cf-33a8b3e2264d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/cbe15e89-26b4-4f20-adaf-fcb6f68085c9" status: 200 len: 1505 microversion: 2.1 time: 0.266268 Apr 16 21:17:06.136551 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1423/2969] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:05 2022] GET /compute/v2.1/servers/cbe15e89-26b4-4f20-adaf-fcb6f68085c9 => generated 1505 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:06.145354 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5a85f4d4-093b-45e5-bc17-45e51a33c8d9 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:06.146299 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5a85f4d4-093b-45e5-bc17-45e51a33c8d9 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:06.153480 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5a85f4d4-093b-45e5-bc17-45e51a33c8d9 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:06.154270 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5a85f4d4-093b-45e5-bc17-45e51a33c8d9 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:06.155490 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5a85f4d4-093b-45e5-bc17-45e51a33c8d9 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:06.156392 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5a85f4d4-093b-45e5-bc17-45e51a33c8d9 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:06.282333 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fb23a32f-b271-4bc8-93c0-fbf2a86cc90a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:06.295072 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fb23a32f-b271-4bc8-93c0-fbf2a86cc90a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.328036 Apr 16 21:17:06.296265 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1547/2970] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:05 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:17:06.302958 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-89b1e0cc-f158-4b7e-80aa-d8436d0ba81c tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:06.303576 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-89b1e0cc-f158-4b7e-80aa-d8436d0ba81c tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 6458699b-6221-4f77-85fe-d41710e9c3bd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:06.310623 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-89b1e0cc-f158-4b7e-80aa-d8436d0ba81c tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:06.311338 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-89b1e0cc-f158-4b7e-80aa-d8436d0ba81c tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:06.312410 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-89b1e0cc-f158-4b7e-80aa-d8436d0ba81c tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:06.313019 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-89b1e0cc-f158-4b7e-80aa-d8436d0ba81c tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:06.449246 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5a85f4d4-093b-45e5-bc17-45e51a33c8d9 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:06.463191 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5a85f4d4-093b-45e5-bc17-45e51a33c8d9 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1541 microversion: 2.1 time: 0.321717 Apr 16 21:17:06.463900 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1424/2971] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:06 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1541 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:06.472671 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-89b1e0cc-f158-4b7e-80aa-d8436d0ba81c tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:06.481470 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4f5f47ee-f7c6-47d0-a081-3494b44c733b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:06.482099 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4f5f47ee-f7c6-47d0-a081-3494b44c733b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:06.483036 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-89b1e0cc-f158-4b7e-80aa-d8436d0ba81c tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/6458699b-6221-4f77-85fe-d41710e9c3bd" status: 200 len: 1325 microversion: 2.1 time: 0.184833 Apr 16 21:17:06.484295 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1548/2972] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:06 2022] GET /compute/v2.1/servers/6458699b-6221-4f77-85fe-d41710e9c3bd => generated 1325 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:06.488573 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4f5f47ee-f7c6-47d0-a081-3494b44c733b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:06.489036 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4f5f47ee-f7c6-47d0-a081-3494b44c733b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:06.491081 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4f5f47ee-f7c6-47d0-a081-3494b44c733b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:06.491730 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4f5f47ee-f7c6-47d0-a081-3494b44c733b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:06.757796 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4f5f47ee-f7c6-47d0-a081-3494b44c733b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:06.782176 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4f5f47ee-f7c6-47d0-a081-3494b44c733b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.305352 Apr 16 21:17:06.786269 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1425/2973] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:06 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:06.799416 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d98b6ff6-4667-47ae-80f7-f40e50754186 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:06.800258 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d98b6ff6-4667-47ae-80f7-f40e50754186 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:06.808516 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d98b6ff6-4667-47ae-80f7-f40e50754186 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:06.809349 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d98b6ff6-4667-47ae-80f7-f40e50754186 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:06.811201 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d98b6ff6-4667-47ae-80f7-f40e50754186 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:06.811201 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d98b6ff6-4667-47ae-80f7-f40e50754186 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:06.883327 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e7e375a6-7bee-456b-a959-c93ba9790171 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:06.885223 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e7e375a6-7bee-456b-a959-c93ba9790171 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: dc95a4d6-f40d-4087-91ae-3038926df942] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:06.896737 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e7e375a6-7bee-456b-a959-c93ba9790171 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:06.897744 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e7e375a6-7bee-456b-a959-c93ba9790171 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:06.898790 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e7e375a6-7bee-456b-a959-c93ba9790171 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:06.902707 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e7e375a6-7bee-456b-a959-c93ba9790171 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:07.086648 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e7e375a6-7bee-456b-a959-c93ba9790171 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:07.108013 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e7e375a6-7bee-456b-a959-c93ba9790171 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942" status: 200 len: 1521 microversion: 2.1 time: 0.229742 Apr 16 21:17:07.111277 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1426/2974] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:06 2022] GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:07.155431 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f34457c8-21d2-486c-9747-9d4b4c56a171 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:07.181657 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f34457c8-21d2-486c-9747-9d4b4c56a171 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: cbe15e89-26b4-4f20-adaf-fcb6f68085c9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:07.181657 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f34457c8-21d2-486c-9747-9d4b4c56a171 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:07.181657 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f34457c8-21d2-486c-9747-9d4b4c56a171 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:07.181657 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f34457c8-21d2-486c-9747-9d4b4c56a171 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:07.181657 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f34457c8-21d2-486c-9747-9d4b4c56a171 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:07.346475 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f34457c8-21d2-486c-9747-9d4b4c56a171 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:07.356535 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f34457c8-21d2-486c-9747-9d4b4c56a171 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/cbe15e89-26b4-4f20-adaf-fcb6f68085c9" status: 200 len: 1505 microversion: 2.1 time: 0.205231 Apr 16 21:17:07.358201 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1427/2975] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:07 2022] GET /compute/v2.1/servers/cbe15e89-26b4-4f20-adaf-fcb6f68085c9 => generated 1505 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:17:07.370389 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d98b6ff6-4667-47ae-80f7-f40e50754186 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:07.378224 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d98b6ff6-4667-47ae-80f7-f40e50754186 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.585389 Apr 16 21:17:07.378824 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1549/2976] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:06 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:07.395588 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6160e98e-daaf-4718-86e2-163a81539d4c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:07.398380 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6160e98e-daaf-4718-86e2-163a81539d4c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:07.403819 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6160e98e-daaf-4718-86e2-163a81539d4c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:07.404678 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6160e98e-daaf-4718-86e2-163a81539d4c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:07.406727 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6160e98e-daaf-4718-86e2-163a81539d4c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:07.407425 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6160e98e-daaf-4718-86e2-163a81539d4c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:07.485842 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d67a6e53-8748-4966-afb0-b32f48974ad3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:07.486788 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d67a6e53-8748-4966-afb0-b32f48974ad3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:07.497242 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d67a6e53-8748-4966-afb0-b32f48974ad3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:07.498015 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d67a6e53-8748-4966-afb0-b32f48974ad3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:07.499014 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d67a6e53-8748-4966-afb0-b32f48974ad3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:07.499703 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d67a6e53-8748-4966-afb0-b32f48974ad3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:07.572504 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6160e98e-daaf-4718-86e2-163a81539d4c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:07.582495 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6160e98e-daaf-4718-86e2-163a81539d4c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.190933 Apr 16 21:17:07.583796 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1428/2977] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:07 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:07.589807 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8cf72925-cb7e-40d6-aa62-a012fe71e41b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:07.590682 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8cf72925-cb7e-40d6-aa62-a012fe71e41b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 6458699b-6221-4f77-85fe-d41710e9c3bd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:07.598101 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8cf72925-cb7e-40d6-aa62-a012fe71e41b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:07.599114 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8cf72925-cb7e-40d6-aa62-a012fe71e41b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:07.600085 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8cf72925-cb7e-40d6-aa62-a012fe71e41b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:07.601790 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8cf72925-cb7e-40d6-aa62-a012fe71e41b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:07.708903 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d67a6e53-8748-4966-afb0-b32f48974ad3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:07.721398 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d67a6e53-8748-4966-afb0-b32f48974ad3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1541 microversion: 2.1 time: 0.241256 Apr 16 21:17:07.736080 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1550/2978] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:07 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1541 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:17:07.736080 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8d6abedf-318f-44ef-844e-a7229dc299da tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:07.736080 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8d6abedf-318f-44ef-844e-a7229dc299da tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:07.749748 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8d6abedf-318f-44ef-844e-a7229dc299da tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:07.750237 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8d6abedf-318f-44ef-844e-a7229dc299da tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:07.751207 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8d6abedf-318f-44ef-844e-a7229dc299da tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:07.751673 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8d6abedf-318f-44ef-844e-a7229dc299da tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:07.814305 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8cf72925-cb7e-40d6-aa62-a012fe71e41b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:07.820153 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8cf72925-cb7e-40d6-aa62-a012fe71e41b tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/6458699b-6221-4f77-85fe-d41710e9c3bd" status: 200 len: 1325 microversion: 2.1 time: 0.234577 Apr 16 21:17:07.821196 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1429/2979] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:07 2022] GET /compute/v2.1/servers/6458699b-6221-4f77-85fe-d41710e9c3bd => generated 1325 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:07.932988 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8d6abedf-318f-44ef-844e-a7229dc299da tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Locking {{(pid=137408) lock /opt/stack/nova/nova/compute/api.py:4698}} Apr 16 21:17:07.990619 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d44890c5-0bce-487f-ab4c-d7f22f4eb8d5 tempest-FloatingIPsTestJSON-120707403 tempest-FloatingIPsTestJSON-120707403-project] Action: 'create', calling method: .version_select at 0x7fbb9582bee0>, body: {"pool": null} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:08.196969 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8d6abedf-318f-44ef-844e-a7229dc299da tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "POST /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa/action" status: 202 len: 0 microversion: 2.1 time: 0.468170 Apr 16 21:17:08.198245 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1551/2980] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:17:07 2022] POST /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa/action => generated 0 bytes in 470 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:17:08.204490 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3954d9c8-a744-47ab-b97b-464ac9451b30 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:08.205387 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3954d9c8-a744-47ab-b97b-464ac9451b30 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: dc95a4d6-f40d-4087-91ae-3038926df942] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:08.214121 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3954d9c8-a744-47ab-b97b-464ac9451b30 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:08.214783 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3954d9c8-a744-47ab-b97b-464ac9451b30 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:08.215768 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3954d9c8-a744-47ab-b97b-464ac9451b30 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:08.216419 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3954d9c8-a744-47ab-b97b-464ac9451b30 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:08.360232 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3954d9c8-a744-47ab-b97b-464ac9451b30 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:08.368970 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3954d9c8-a744-47ab-b97b-464ac9451b30 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942" status: 200 len: 1521 microversion: 2.1 time: 0.169415 Apr 16 21:17:08.369644 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1552/2981] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:08 2022] GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:08.375161 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e03d2f30-4fa3-48fd-a5af-a040abdd8444 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:08.376483 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e03d2f30-4fa3-48fd-a5af-a040abdd8444 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:08.383703 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e03d2f30-4fa3-48fd-a5af-a040abdd8444 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:08.391346 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e03d2f30-4fa3-48fd-a5af-a040abdd8444 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:08.391346 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e03d2f30-4fa3-48fd-a5af-a040abdd8444 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:08.391346 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e03d2f30-4fa3-48fd-a5af-a040abdd8444 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:08.533649 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e03d2f30-4fa3-48fd-a5af-a040abdd8444 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:08.540347 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e03d2f30-4fa3-48fd-a5af-a040abdd8444 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.169310 Apr 16 21:17:08.540990 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1553/2982] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:08 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:08.552519 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5b1ea793-9196-4b20-bf94-c10628f48869 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:08.553145 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5b1ea793-9196-4b20-bf94-c10628f48869 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: cbe15e89-26b4-4f20-adaf-fcb6f68085c9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:08.559956 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5b1ea793-9196-4b20-bf94-c10628f48869 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:08.560469 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5b1ea793-9196-4b20-bf94-c10628f48869 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:08.561251 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5b1ea793-9196-4b20-bf94-c10628f48869 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:08.561690 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5b1ea793-9196-4b20-bf94-c10628f48869 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:08.716726 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5b1ea793-9196-4b20-bf94-c10628f48869 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:08.724603 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5b1ea793-9196-4b20-bf94-c10628f48869 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/cbe15e89-26b4-4f20-adaf-fcb6f68085c9" status: 200 len: 1487 microversion: 2.1 time: 0.182614 Apr 16 21:17:08.725178 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1554/2983] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:08 2022] GET /compute/v2.1/servers/cbe15e89-26b4-4f20-adaf-fcb6f68085c9 => generated 1487 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:08.730442 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-45d20780-e38e-47a1-9c92-f6d7d144fd66 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:08.737015 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-45d20780-e38e-47a1-9c92-f6d7d144fd66 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:08.737505 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-45d20780-e38e-47a1-9c92-f6d7d144fd66 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:08.760204 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-45d20780-e38e-47a1-9c92-f6d7d144fd66 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] HTTP exception thrown: Instance 98ca4f4e-246a-449b-b9fd-e1c17e119faa is locked Apr 16 21:17:08.760917 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-45d20780-e38e-47a1-9c92-f6d7d144fd66 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Returning 409 to user: Instance 98ca4f4e-246a-449b-b9fd-e1c17e119faa is locked {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:17:08.761799 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-45d20780-e38e-47a1-9c92-f6d7d144fd66 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "POST /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa/action" status: 409 len: 107 microversion: 2.1 time: 0.035703 Apr 16 21:17:08.762358 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1555/2984] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:17:08 2022] POST /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa/action => generated 107 bytes in 37 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:17:08.766998 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d00154af-4233-47da-a65d-9ee4be2b5202 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:08.767620 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d00154af-4233-47da-a65d-9ee4be2b5202 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:08.774172 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d00154af-4233-47da-a65d-9ee4be2b5202 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:08.774748 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d00154af-4233-47da-a65d-9ee4be2b5202 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:08.775599 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d00154af-4233-47da-a65d-9ee4be2b5202 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:08.776044 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d00154af-4233-47da-a65d-9ee4be2b5202 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:08.944577 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d00154af-4233-47da-a65d-9ee4be2b5202 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:08.953038 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d00154af-4233-47da-a65d-9ee4be2b5202 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1541 microversion: 2.1 time: 0.189683 Apr 16 21:17:08.954199 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1556/2985] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:08 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1541 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:08.961456 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b1f931e8-8c28-4fd1-9234-3b3f548a0dba tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:08.962573 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b1f931e8-8c28-4fd1-9234-3b3f548a0dba tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: cbe15e89-26b4-4f20-adaf-fcb6f68085c9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:08.970240 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b1f931e8-8c28-4fd1-9234-3b3f548a0dba tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:08.971069 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b1f931e8-8c28-4fd1-9234-3b3f548a0dba tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:08.972057 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b1f931e8-8c28-4fd1-9234-3b3f548a0dba tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:08.972706 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b1f931e8-8c28-4fd1-9234-3b3f548a0dba tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:08.999024 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b1f931e8-8c28-4fd1-9234-3b3f548a0dba tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: cbe15e89-26b4-4f20-adaf-fcb6f68085c9] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:17:09.318929 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b1f931e8-8c28-4fd1-9234-3b3f548a0dba tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cbe15e89-26b4-4f20-adaf-fcb6f68085c9" status: 204 len: 0 microversion: 2.1 time: 0.363133 Apr 16 21:17:09.329867 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1557/2986] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:17:08 2022] DELETE /compute/v2.1/servers/cbe15e89-26b4-4f20-adaf-fcb6f68085c9 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:17:09.329867 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1a9f40ba-2b85-4227-89b7-096a0518d6bc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:09.329867 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1a9f40ba-2b85-4227-89b7-096a0518d6bc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:09.332399 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1a9f40ba-2b85-4227-89b7-096a0518d6bc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:09.333571 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1a9f40ba-2b85-4227-89b7-096a0518d6bc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:09.334369 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1a9f40ba-2b85-4227-89b7-096a0518d6bc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:09.334815 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1a9f40ba-2b85-4227-89b7-096a0518d6bc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:09.563026 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1a9f40ba-2b85-4227-89b7-096a0518d6bc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Unlocking {{(pid=137408) unlock /opt/stack/nova/nova/compute/api.py:4727}} Apr 16 21:17:09.700398 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d44890c5-0bce-487f-ab4c-d7f22f4eb8d5 tempest-FloatingIPsTestJSON-120707403 tempest-FloatingIPsTestJSON-120707403-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.878445 Apr 16 21:17:09.701001 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1430/2987] 10.222.0.20 () {60 vars in 1169 bytes} [Sat Apr 16 21:17:07 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1880 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:17:09.706184 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-57ea5685-a2ba-4d03-b93e-5d2b0940468c tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:09.707073 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-57ea5685-a2ba-4d03-b93e-5d2b0940468c tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 6458699b-6221-4f77-85fe-d41710e9c3bd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:09.715325 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-57ea5685-a2ba-4d03-b93e-5d2b0940468c tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:09.715782 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-57ea5685-a2ba-4d03-b93e-5d2b0940468c tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:09.716620 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-57ea5685-a2ba-4d03-b93e-5d2b0940468c tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:09.717051 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-57ea5685-a2ba-4d03-b93e-5d2b0940468c tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:09.814159 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1a9f40ba-2b85-4227-89b7-096a0518d6bc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "POST /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa/action" status: 202 len: 0 microversion: 2.1 time: 0.493137 Apr 16 21:17:09.815133 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1558/2988] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:17:09 2022] POST /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa/action => generated 0 bytes in 495 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:17:09.821916 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-38101ea2-c008-4cb8-bc19-d051c459e06c req-55196de4-be69-4a09-ac04-093f8e9d11e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbe15e89-26b4-4f20-adaf-fcb6f68085c9", "name": "network-vif-plugged", "status": "completed", "tag": "10211d90-780e-4a95-9f0e-6bed268c796e"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:09.831131 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-38101ea2-c008-4cb8-bc19-d051c459e06c req-55196de4-be69-4a09-ac04-093f8e9d11e4 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:09.831777 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-38101ea2-c008-4cb8-bc19-d051c459e06c req-55196de4-be69-4a09-ac04-093f8e9d11e4 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:09.844943 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-38101ea2-c008-4cb8-bc19-d051c459e06c req-55196de4-be69-4a09-ac04-093f8e9d11e4 service nova] Creating event network-vif-plugged:10211d90-780e-4a95-9f0e-6bed268c796e for instance cbe15e89-26b4-4f20-adaf-fcb6f68085c9 on nch1-master-1 Apr 16 21:17:09.850550 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-38101ea2-c008-4cb8-bc19-d051c459e06c req-55196de4-be69-4a09-ac04-093f8e9d11e4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033916 Apr 16 21:17:09.852084 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1559/2989] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:17:09.857630 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d02f6dfc-3aca-4cfc-9082-045b1fabe013 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb959b5dc0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:09.866420 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-57ea5685-a2ba-4d03-b93e-5d2b0940468c tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:09.886106 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-d02f6dfc-3aca-4cfc-9082-045b1fabe013 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] HTTP exception thrown: Image not found. Apr 16 21:17:09.886738 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d02f6dfc-3aca-4cfc-9082-045b1fabe013 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Returning 404 to user: Image not found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:17:09.887600 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d02f6dfc-3aca-4cfc-9082-045b1fabe013 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "DELETE /compute/v2.1/images/c932cf42-d8f7-4104-aa85-776fe7e8cac5" status: 404 len: 62 microversion: 2.1 time: 0.034159 Apr 16 21:17:09.888214 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1560/2990] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:09 2022] DELETE /compute/v2.1/images/c932cf42-d8f7-4104-aa85-776fe7e8cac5 => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:17:09.895737 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-57ea5685-a2ba-4d03-b93e-5d2b0940468c tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/6458699b-6221-4f77-85fe-d41710e9c3bd" status: 200 len: 1325 microversion: 2.1 time: 0.193637 Apr 16 21:17:09.898362 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b9f4b2c0-3714-468c-a40a-5d5270bba384 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:09.898582 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1431/2991] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:09 2022] GET /compute/v2.1/servers/6458699b-6221-4f77-85fe-d41710e9c3bd => generated 1325 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:09.899498 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b9f4b2c0-3714-468c-a40a-5d5270bba384 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: dc95a4d6-f40d-4087-91ae-3038926df942] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:09.904971 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f5583d48-9170-40da-9ee4-eb437dbc9584 tempest-FloatingIPsTestJSON-120707403 tempest-FloatingIPsTestJSON-120707403-project] Calling method '.version_select at 0x7fbb95860790>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:09.911541 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b9f4b2c0-3714-468c-a40a-5d5270bba384 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:09.912384 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b9f4b2c0-3714-468c-a40a-5d5270bba384 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:09.914427 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b9f4b2c0-3714-468c-a40a-5d5270bba384 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:09.915120 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b9f4b2c0-3714-468c-a40a-5d5270bba384 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:10.062008 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b9f4b2c0-3714-468c-a40a-5d5270bba384 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:10.071812 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b9f4b2c0-3714-468c-a40a-5d5270bba384 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942" status: 200 len: 1521 microversion: 2.1 time: 0.182218 Apr 16 21:17:10.072572 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1561/2992] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:09 2022] GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:10.078110 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d873d833-b2ba-48e7-9c2d-3900e0916bc9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:10.086828 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d873d833-b2ba-48e7-9c2d-3900e0916bc9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:10.087370 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d873d833-b2ba-48e7-9c2d-3900e0916bc9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:10.113222 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d873d833-b2ba-48e7-9c2d-3900e0916bc9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Going to try to stop instance {{(pid=137408) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 16 21:17:10.326372 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d873d833-b2ba-48e7-9c2d-3900e0916bc9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "POST /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa/action" status: 202 len: 0 microversion: 2.1 time: 0.252516 Apr 16 21:17:10.331944 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1562/2993] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:17:10 2022] POST /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:17:10.338702 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d9dbb3a0-3a02-4fd2-b0cd-f1e3477a9e86 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:10.339308 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d9dbb3a0-3a02-4fd2-b0cd-f1e3477a9e86 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: cbe15e89-26b4-4f20-adaf-fcb6f68085c9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:10.348294 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d9dbb3a0-3a02-4fd2-b0cd-f1e3477a9e86 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:10.349094 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d9dbb3a0-3a02-4fd2-b0cd-f1e3477a9e86 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:10.349909 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d9dbb3a0-3a02-4fd2-b0cd-f1e3477a9e86 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:10.350538 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d9dbb3a0-3a02-4fd2-b0cd-f1e3477a9e86 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:10.386777 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d9dbb3a0-3a02-4fd2-b0cd-f1e3477a9e86 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: cbe15e89-26b4-4f20-adaf-fcb6f68085c9] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:17:10.428535 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f5583d48-9170-40da-9ee4-eb437dbc9584 tempest-FloatingIPsTestJSON-120707403 tempest-FloatingIPsTestJSON-120707403-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/e83bb863-69b1-4c64-a287-cc0f45784a15" status: 200 len: 142 microversion: 2.1 time: 0.528924 Apr 16 21:17:10.429695 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1432/2994] 10.222.0.20 () {58 vars in 1259 bytes} [Sat Apr 16 21:17:09 2022] GET /compute/v2.1/os-floating-ips/e83bb863-69b1-4c64-a287-cc0f45784a15 => generated 142 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:17:10.434207 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-aa6f70e0-7a75-453c-b336-85555f1e0295 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:10.434818 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-aa6f70e0-7a75-453c-b336-85555f1e0295 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:10.445140 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aa6f70e0-7a75-453c-b336-85555f1e0295 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:10.445652 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aa6f70e0-7a75-453c-b336-85555f1e0295 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:10.446448 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aa6f70e0-7a75-453c-b336-85555f1e0295 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:10.446882 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aa6f70e0-7a75-453c-b336-85555f1e0295 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:10.551196 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.compute.api [None req-d9dbb3a0-3a02-4fd2-b0cd-f1e3477a9e86 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: cbe15e89-26b4-4f20-adaf-fcb6f68085c9] Instance is already in deleting state, ignoring this request Apr 16 21:17:10.552218 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d9dbb3a0-3a02-4fd2-b0cd-f1e3477a9e86 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cbe15e89-26b4-4f20-adaf-fcb6f68085c9" status: 204 len: 0 microversion: 2.1 time: 0.222552 Apr 16 21:17:10.556076 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1563/2995] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:17:10 2022] DELETE /compute/v2.1/servers/cbe15e89-26b4-4f20-adaf-fcb6f68085c9 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:17:10.561565 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9311b87d-d1f6-4d22-97bd-8f43c17c25d2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:10.567813 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9311b87d-d1f6-4d22-97bd-8f43c17c25d2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:10.568970 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9311b87d-d1f6-4d22-97bd-8f43c17c25d2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:10.569448 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9311b87d-d1f6-4d22-97bd-8f43c17c25d2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:10.570277 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9311b87d-d1f6-4d22-97bd-8f43c17c25d2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:10.570729 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9311b87d-d1f6-4d22-97bd-8f43c17c25d2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:10.671948 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-aa6f70e0-7a75-453c-b336-85555f1e0295 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:10.680768 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-aa6f70e0-7a75-453c-b336-85555f1e0295 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1541 microversion: 2.1 time: 0.249975 Apr 16 21:17:10.681991 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1433/2996] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:10 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1541 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:10.687299 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b0dc85a0-b662-4a3b-aa5e-7092c5adc792 tempest-FloatingIPsTestJSON-120707403 tempest-FloatingIPsTestJSON-120707403-project] Calling method '.version_select at 0x7fbb962a6e50>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:10.737409 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9311b87d-d1f6-4d22-97bd-8f43c17c25d2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:10.749725 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9311b87d-d1f6-4d22-97bd-8f43c17c25d2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1680 microversion: 2.1 time: 0.191400 Apr 16 21:17:10.750001 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1564/2997] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:10 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1680 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:10.764901 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-75446f3c-f2fe-4f79-9dbc-879e2f7fb99c tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:10.768059 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-75446f3c-f2fe-4f79-9dbc-879e2f7fb99c tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: cbe15e89-26b4-4f20-adaf-fcb6f68085c9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:10.773005 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-75446f3c-f2fe-4f79-9dbc-879e2f7fb99c tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:10.773405 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-75446f3c-f2fe-4f79-9dbc-879e2f7fb99c tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:10.774195 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-75446f3c-f2fe-4f79-9dbc-879e2f7fb99c tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:10.774650 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-75446f3c-f2fe-4f79-9dbc-879e2f7fb99c tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:10.920217 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-75446f3c-f2fe-4f79-9dbc-879e2f7fb99c tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:10.924997 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b0dc85a0-b662-4a3b-aa5e-7092c5adc792 tempest-FloatingIPsTestJSON-120707403 tempest-FloatingIPsTestJSON-120707403-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.241771 Apr 16 21:17:10.927458 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1434/2998] 10.222.0.20 () {58 vars in 1148 bytes} [Sat Apr 16 21:17:10 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:17:10.928602 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-75446f3c-f2fe-4f79-9dbc-879e2f7fb99c tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/cbe15e89-26b4-4f20-adaf-fcb6f68085c9" status: 200 len: 1493 microversion: 2.1 time: 0.167139 Apr 16 21:17:10.928602 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1565/2999] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:10 2022] GET /compute/v2.1/servers/cbe15e89-26b4-4f20-adaf-fcb6f68085c9 => generated 1493 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:10.937895 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3968dea4-a8ed-4542-9b6f-6631e588db5c tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:10.938819 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3968dea4-a8ed-4542-9b6f-6631e588db5c tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 6458699b-6221-4f77-85fe-d41710e9c3bd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:10.941334 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-094bed97-7c1c-4382-8037-c388dda7b68a tempest-FloatingIPsTestJSON-120707403 tempest-FloatingIPsTestJSON-120707403-project] Calling method '.version_select at 0x7fbb95afdb80>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:10.946826 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3968dea4-a8ed-4542-9b6f-6631e588db5c tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:10.947407 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3968dea4-a8ed-4542-9b6f-6631e588db5c tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:10.948384 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3968dea4-a8ed-4542-9b6f-6631e588db5c tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:10.948921 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3968dea4-a8ed-4542-9b6f-6631e588db5c tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:11.315807 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3968dea4-a8ed-4542-9b6f-6631e588db5c tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:11.329797 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3968dea4-a8ed-4542-9b6f-6631e588db5c tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/6458699b-6221-4f77-85fe-d41710e9c3bd" status: 200 len: 1325 microversion: 2.1 time: 0.400997 Apr 16 21:17:11.330552 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1435/3000] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:10 2022] GET /compute/v2.1/servers/6458699b-6221-4f77-85fe-d41710e9c3bd => generated 1325 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:11.346388 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d47654ca-4925-44da-b296-25e1a0b9c372 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:11.349106 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d47654ca-4925-44da-b296-25e1a0b9c372 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: dc95a4d6-f40d-4087-91ae-3038926df942] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:11.365443 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d47654ca-4925-44da-b296-25e1a0b9c372 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:11.366496 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d47654ca-4925-44da-b296-25e1a0b9c372 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:11.367815 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d47654ca-4925-44da-b296-25e1a0b9c372 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:11.368483 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d47654ca-4925-44da-b296-25e1a0b9c372 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:11.569069 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d47654ca-4925-44da-b296-25e1a0b9c372 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:11.579611 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d47654ca-4925-44da-b296-25e1a0b9c372 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942" status: 200 len: 1521 microversion: 2.1 time: 0.246375 Apr 16 21:17:11.580549 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1436/3001] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:11 2022] GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942 => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:11.701513 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-47d6323c-2a35-45ff-9c8e-baa96e760b8a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:11.702398 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-47d6323c-2a35-45ff-9c8e-baa96e760b8a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:11.715042 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-47d6323c-2a35-45ff-9c8e-baa96e760b8a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:11.715509 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-47d6323c-2a35-45ff-9c8e-baa96e760b8a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:11.717076 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-47d6323c-2a35-45ff-9c8e-baa96e760b8a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:11.717803 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-47d6323c-2a35-45ff-9c8e-baa96e760b8a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:11.932149 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-094bed97-7c1c-4382-8037-c388dda7b68a tempest-FloatingIPsTestJSON-120707403 tempest-FloatingIPsTestJSON-120707403-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/e83bb863-69b1-4c64-a287-cc0f45784a15" status: 202 len: 0 microversion: 2.1 time: 0.994523 Apr 16 21:17:11.933975 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1566/3002] 10.222.0.20 () {58 vars in 1262 bytes} [Sat Apr 16 21:17:10 2022] DELETE /compute/v2.1/os-floating-ips/e83bb863-69b1-4c64-a287-cc0f45784a15 => generated 0 bytes in 997 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:17:11.945741 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d240c586-6d0b-48a3-91a4-d2bf2c0f596c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:11.945741 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d240c586-6d0b-48a3-91a4-d2bf2c0f596c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:11.946344 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-47d6323c-2a35-45ff-9c8e-baa96e760b8a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:11.954444 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d240c586-6d0b-48a3-91a4-d2bf2c0f596c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:11.954917 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d240c586-6d0b-48a3-91a4-d2bf2c0f596c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:11.955376 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-47d6323c-2a35-45ff-9c8e-baa96e760b8a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1541 microversion: 2.1 time: 0.259935 Apr 16 21:17:11.955703 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d240c586-6d0b-48a3-91a4-d2bf2c0f596c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:11.955963 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1437/3003] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:11 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1541 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:17:11.956540 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d240c586-6d0b-48a3-91a4-d2bf2c0f596c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:11.970382 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-b903effb-bcad-4bf6-a412-11ff0b677059 req-e396dba0-2695-49f0-997d-bf83dcb9d990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6458699b-6221-4f77-85fe-d41710e9c3bd", "name": "network-vif-plugged", "status": "completed", "tag": "94e8eb87-ee7a-4a8e-bb59-9075350ddd30"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:11.979531 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-b903effb-bcad-4bf6-a412-11ff0b677059 req-e396dba0-2695-49f0-997d-bf83dcb9d990 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:11.980281 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-b903effb-bcad-4bf6-a412-11ff0b677059 req-e396dba0-2695-49f0-997d-bf83dcb9d990 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:11.993846 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-b903effb-bcad-4bf6-a412-11ff0b677059 req-e396dba0-2695-49f0-997d-bf83dcb9d990 service nova] Creating event network-vif-plugged:94e8eb87-ee7a-4a8e-bb59-9075350ddd30 for instance 6458699b-6221-4f77-85fe-d41710e9c3bd on nch2-master-1 Apr 16 21:17:11.999672 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-b903effb-bcad-4bf6-a412-11ff0b677059 req-e396dba0-2695-49f0-997d-bf83dcb9d990 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041827 Apr 16 21:17:12.002868 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1438/3004] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:17:12.010073 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-be253f94-4eda-42eb-8c12-610374452240 req-17936bc2-db88-418a-a546-0468a7ec9574 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbe15e89-26b4-4f20-adaf-fcb6f68085c9", "name": "network-vif-deleted", "tag": "10211d90-780e-4a95-9f0e-6bed268c796e"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:12.018264 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-be253f94-4eda-42eb-8c12-610374452240 req-17936bc2-db88-418a-a546-0468a7ec9574 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:12.018717 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-be253f94-4eda-42eb-8c12-610374452240 req-17936bc2-db88-418a-a546-0468a7ec9574 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:12.036893 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-be253f94-4eda-42eb-8c12-610374452240 req-17936bc2-db88-418a-a546-0468a7ec9574 service nova] Creating event network-vif-deleted:10211d90-780e-4a95-9f0e-6bed268c796e for instance cbe15e89-26b4-4f20-adaf-fcb6f68085c9 on nch1-master-1 Apr 16 21:17:12.044764 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-be253f94-4eda-42eb-8c12-610374452240 req-17936bc2-db88-418a-a546-0468a7ec9574 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040591 Apr 16 21:17:12.046179 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1439/3005] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:17:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:17:12.055354 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-622c2ac8-0ab4-4a37-81fd-1e24d785cd6b tempest-FloatingIPsTestJSON-120707403 tempest-FloatingIPsTestJSON-120707403-project] Action: 'create', calling method: .version_select at 0x7fbb95835820>, body: {"pool": null} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:12.194940 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d240c586-6d0b-48a3-91a4-d2bf2c0f596c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:12.203216 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d240c586-6d0b-48a3-91a4-d2bf2c0f596c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1680 microversion: 2.1 time: 0.267930 Apr 16 21:17:12.203792 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1567/3006] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:11 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1680 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:12.209403 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e35f394e-7a57-4815-8909-e4bdee1efa04 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:12.210881 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e35f394e-7a57-4815-8909-e4bdee1efa04 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: cbe15e89-26b4-4f20-adaf-fcb6f68085c9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:12.217350 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e35f394e-7a57-4815-8909-e4bdee1efa04 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:12.225597 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e35f394e-7a57-4815-8909-e4bdee1efa04 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:12.225597 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e35f394e-7a57-4815-8909-e4bdee1efa04 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:12.225597 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e35f394e-7a57-4815-8909-e4bdee1efa04 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:12.287523 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e35f394e-7a57-4815-8909-e4bdee1efa04 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:12.295858 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e35f394e-7a57-4815-8909-e4bdee1efa04 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/cbe15e89-26b4-4f20-adaf-fcb6f68085c9" status: 200 len: 1292 microversion: 2.1 time: 0.090711 Apr 16 21:17:12.309157 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1568/3007] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:12 2022] GET /compute/v2.1/servers/cbe15e89-26b4-4f20-adaf-fcb6f68085c9 => generated 1292 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:12.346806 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2114eea8-61e9-4b4d-bd94-5c6eb4c2118e tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:12.347586 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2114eea8-61e9-4b4d-bd94-5c6eb4c2118e tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 6458699b-6221-4f77-85fe-d41710e9c3bd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:12.354037 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2114eea8-61e9-4b4d-bd94-5c6eb4c2118e tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:12.354511 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2114eea8-61e9-4b4d-bd94-5c6eb4c2118e tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:12.355531 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2114eea8-61e9-4b4d-bd94-5c6eb4c2118e tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:12.355970 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2114eea8-61e9-4b4d-bd94-5c6eb4c2118e tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:12.513203 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2114eea8-61e9-4b4d-bd94-5c6eb4c2118e tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:12.521104 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2114eea8-61e9-4b4d-bd94-5c6eb4c2118e tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/6458699b-6221-4f77-85fe-d41710e9c3bd" status: 200 len: 1325 microversion: 2.1 time: 0.178055 Apr 16 21:17:12.521986 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1569/3008] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:12 2022] GET /compute/v2.1/servers/6458699b-6221-4f77-85fe-d41710e9c3bd => generated 1325 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:17:12.597240 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4d5da9b6-59f9-4359-b017-2bc4ec0d1c7d tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:12.597949 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4d5da9b6-59f9-4359-b017-2bc4ec0d1c7d tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: dc95a4d6-f40d-4087-91ae-3038926df942] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:12.604006 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4d5da9b6-59f9-4359-b017-2bc4ec0d1c7d tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:12.604499 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4d5da9b6-59f9-4359-b017-2bc4ec0d1c7d tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:12.605274 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4d5da9b6-59f9-4359-b017-2bc4ec0d1c7d tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:12.605832 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4d5da9b6-59f9-4359-b017-2bc4ec0d1c7d tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:12.744043 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4d5da9b6-59f9-4359-b017-2bc4ec0d1c7d tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:12.752090 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4d5da9b6-59f9-4359-b017-2bc4ec0d1c7d tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942" status: 200 len: 1521 microversion: 2.1 time: 0.158962 Apr 16 21:17:12.753452 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1570/3009] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:12 2022] GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:17:12.973077 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2621ceac-011d-425e-bd72-6e0efa9a1d9f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:12.973779 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2621ceac-011d-425e-bd72-6e0efa9a1d9f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:12.980300 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2621ceac-011d-425e-bd72-6e0efa9a1d9f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:12.980767 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2621ceac-011d-425e-bd72-6e0efa9a1d9f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:12.981559 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2621ceac-011d-425e-bd72-6e0efa9a1d9f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:12.982003 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2621ceac-011d-425e-bd72-6e0efa9a1d9f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:13.114015 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2621ceac-011d-425e-bd72-6e0efa9a1d9f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:13.122391 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2621ceac-011d-425e-bd72-6e0efa9a1d9f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1541 microversion: 2.1 time: 0.153275 Apr 16 21:17:13.122968 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1571/3010] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:12 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1541 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:17:13.221087 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-eb761a88-09f8-4f92-8be3-4f586fbb04dc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:13.221731 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-eb761a88-09f8-4f92-8be3-4f586fbb04dc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:13.227784 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eb761a88-09f8-4f92-8be3-4f586fbb04dc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:13.228376 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eb761a88-09f8-4f92-8be3-4f586fbb04dc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:13.229198 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eb761a88-09f8-4f92-8be3-4f586fbb04dc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:13.229641 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eb761a88-09f8-4f92-8be3-4f586fbb04dc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:13.362305 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-eb761a88-09f8-4f92-8be3-4f586fbb04dc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:13.370243 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-eb761a88-09f8-4f92-8be3-4f586fbb04dc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1680 microversion: 2.1 time: 0.153209 Apr 16 21:17:13.370935 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1572/3011] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:13 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:13.376293 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-74dc3298-a4f4-4c79-a2f1-b9281218d0ac tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:13.376293 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-74dc3298-a4f4-4c79-a2f1-b9281218d0ac tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: cbe15e89-26b4-4f20-adaf-fcb6f68085c9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:13.383048 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-74dc3298-a4f4-4c79-a2f1-b9281218d0ac tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:13.383619 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-74dc3298-a4f4-4c79-a2f1-b9281218d0ac tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:13.384444 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-74dc3298-a4f4-4c79-a2f1-b9281218d0ac tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:13.384895 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-74dc3298-a4f4-4c79-a2f1-b9281218d0ac tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:13.415053 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-74dc3298-a4f4-4c79-a2f1-b9281218d0ac tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:13.415508 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-74dc3298-a4f4-4c79-a2f1-b9281218d0ac tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:13.415966 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-74dc3298-a4f4-4c79-a2f1-b9281218d0ac tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lazy-loading 'fault' on Instance uuid cbe15e89-26b4-4f20-adaf-fcb6f68085c9 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:17:13.459047 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-74dc3298-a4f4-4c79-a2f1-b9281218d0ac tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad32f0114a44a3bac0c966003e312df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95103d3663146e9ba6ffb49a05196b4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:13.466861 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-74dc3298-a4f4-4c79-a2f1-b9281218d0ac tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/cbe15e89-26b4-4f20-adaf-fcb6f68085c9" status: 200 len: 1297 microversion: 2.1 time: 0.095015 Apr 16 21:17:13.467446 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1573/3012] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:13 2022] GET /compute/v2.1/servers/cbe15e89-26b4-4f20-adaf-fcb6f68085c9 => generated 1297 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:13.538915 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-95e6c4c3-d178-4389-90e8-f761605e2ea1 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:13.539539 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-95e6c4c3-d178-4389-90e8-f761605e2ea1 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 6458699b-6221-4f77-85fe-d41710e9c3bd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:13.545604 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-95e6c4c3-d178-4389-90e8-f761605e2ea1 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:13.552325 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-95e6c4c3-d178-4389-90e8-f761605e2ea1 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:13.552325 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-95e6c4c3-d178-4389-90e8-f761605e2ea1 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:13.552325 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-95e6c4c3-d178-4389-90e8-f761605e2ea1 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:13.685704 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-95e6c4c3-d178-4389-90e8-f761605e2ea1 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:13.694052 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-95e6c4c3-d178-4389-90e8-f761605e2ea1 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/6458699b-6221-4f77-85fe-d41710e9c3bd" status: 200 len: 1325 microversion: 2.1 time: 0.158971 Apr 16 21:17:13.695274 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1574/3013] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:13 2022] GET /compute/v2.1/servers/6458699b-6221-4f77-85fe-d41710e9c3bd => generated 1325 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:17:13.718175 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-622c2ac8-0ab4-4a37-81fd-1e24d785cd6b tempest-FloatingIPsTestJSON-120707403 tempest-FloatingIPsTestJSON-120707403-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.670305 Apr 16 21:17:13.718948 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1440/3014] 10.222.0.20 () {60 vars in 1169 bytes} [Sat Apr 16 21:17:12 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1672 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:17:13.729912 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9fd8a7ce-ae49-4691-bb79-a060684b5ef8 tempest-FloatingIPsTestJSON-120707403 tempest-FloatingIPsTestJSON-120707403-project] Calling method '.version_select at 0x7fbb95934670>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:13.770654 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-75122150-331b-4f44-a928-3e3cb2755f7d tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:13.771540 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-75122150-331b-4f44-a928-3e3cb2755f7d tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: dc95a4d6-f40d-4087-91ae-3038926df942] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:13.778259 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-75122150-331b-4f44-a928-3e3cb2755f7d tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:13.778726 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-75122150-331b-4f44-a928-3e3cb2755f7d tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:13.779506 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-75122150-331b-4f44-a928-3e3cb2755f7d tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:13.779945 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-75122150-331b-4f44-a928-3e3cb2755f7d tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:13.932250 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-75122150-331b-4f44-a928-3e3cb2755f7d tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:13.939744 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-75122150-331b-4f44-a928-3e3cb2755f7d tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942" status: 200 len: 1521 microversion: 2.1 time: 0.173606 Apr 16 21:17:13.940362 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1441/3015] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:13 2022] GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:17:14.138920 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b54175ef-de90-48be-899f-2e06713d3d9a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:14.139531 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b54175ef-de90-48be-899f-2e06713d3d9a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:14.146000 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b54175ef-de90-48be-899f-2e06713d3d9a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:14.146453 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b54175ef-de90-48be-899f-2e06713d3d9a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:14.147226 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b54175ef-de90-48be-899f-2e06713d3d9a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:14.148208 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b54175ef-de90-48be-899f-2e06713d3d9a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:14.322321 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b54175ef-de90-48be-899f-2e06713d3d9a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:14.329648 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b54175ef-de90-48be-899f-2e06713d3d9a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1541 microversion: 2.1 time: 0.194597 Apr 16 21:17:14.330219 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1442/3016] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:14 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1541 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:17:14.388316 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e3fc7e55-f3d1-4ced-81ff-8fdca0e958e3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:14.389062 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e3fc7e55-f3d1-4ced-81ff-8fdca0e958e3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:14.395112 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e3fc7e55-f3d1-4ced-81ff-8fdca0e958e3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:14.399400 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e3fc7e55-f3d1-4ced-81ff-8fdca0e958e3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:14.399400 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e3fc7e55-f3d1-4ced-81ff-8fdca0e958e3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:14.399400 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e3fc7e55-f3d1-4ced-81ff-8fdca0e958e3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:14.551551 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e3fc7e55-f3d1-4ced-81ff-8fdca0e958e3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:14.564533 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e3fc7e55-f3d1-4ced-81ff-8fdca0e958e3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1680 microversion: 2.1 time: 0.180303 Apr 16 21:17:14.564802 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9fd8a7ce-ae49-4691-bb79-a060684b5ef8 tempest-FloatingIPsTestJSON-120707403 tempest-FloatingIPsTestJSON-120707403-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/874b7f74-36d5-4e76-8f71-eebf8a856ea1" status: 202 len: 0 microversion: 2.1 time: 0.839067 Apr 16 21:17:14.571098 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1575/3018] 10.222.0.20 () {58 vars in 1262 bytes} [Sat Apr 16 21:17:13 2022] DELETE /compute/v2.1/os-floating-ips/874b7f74-36d5-4e76-8f71-eebf8a856ea1 => generated 0 bytes in 840 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:17:14.571363 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1443/3018] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:14 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1680 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:17:14.571475 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-409e3071-b38a-4e83-a682-a0f72467160b tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:14.572944 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-409e3071-b38a-4e83-a682-a0f72467160b tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: cbe15e89-26b4-4f20-adaf-fcb6f68085c9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:14.578937 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a52ac974-1854-4348-b5bb-33fcc6abec92 tempest-FloatingIPsTestJSON-120707403 tempest-FloatingIPsTestJSON-120707403-project] Calling method '.version_select at 0x7fbb95969700>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:14.584496 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-409e3071-b38a-4e83-a682-a0f72467160b tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:14.584961 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-409e3071-b38a-4e83-a682-a0f72467160b tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:14.586399 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-409e3071-b38a-4e83-a682-a0f72467160b tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:14.586834 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-409e3071-b38a-4e83-a682-a0f72467160b tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:14.600427 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-409e3071-b38a-4e83-a682-a0f72467160b tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] HTTP exception thrown: Instance cbe15e89-26b4-4f20-adaf-fcb6f68085c9 could not be found. Apr 16 21:17:14.601560 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-409e3071-b38a-4e83-a682-a0f72467160b tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Returning 404 to user: Instance cbe15e89-26b4-4f20-adaf-fcb6f68085c9 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:17:14.602401 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-409e3071-b38a-4e83-a682-a0f72467160b tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/cbe15e89-26b4-4f20-adaf-fcb6f68085c9" status: 404 len: 111 microversion: 2.1 time: 0.036113 Apr 16 21:17:14.603392 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1576/3019] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:14 2022] GET /compute/v2.1/servers/cbe15e89-26b4-4f20-adaf-fcb6f68085c9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:17:14.610751 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6b8e87c1-5e9d-4e9d-b097-f919d9d1d4bf tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb9594fe50>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:14.625909 ncdv-master-1 devstack@n-api.service[137409]: DEBUG neutronclient.v2_0.client [None req-a52ac974-1854-4348-b5bb-33fcc6abec92 tempest-FloatingIPsTestJSON-120707403 tempest-FloatingIPsTestJSON-120707403-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 874b7f74-36d5-4e76-8f71-eebf8a856ea1 could not be found", "detail": ""}} {{(pid=137409) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 16 21:17:14.626678 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-a52ac974-1854-4348-b5bb-33fcc6abec92 tempest-FloatingIPsTestJSON-120707403 tempest-FloatingIPsTestJSON-120707403-project] HTTP exception thrown: Floating IP not found for ID 874b7f74-36d5-4e76-8f71-eebf8a856ea1 Apr 16 21:17:14.627298 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a52ac974-1854-4348-b5bb-33fcc6abec92 tempest-FloatingIPsTestJSON-120707403 tempest-FloatingIPsTestJSON-120707403-project] Returning 404 to user: Floating IP not found for ID 874b7f74-36d5-4e76-8f71-eebf8a856ea1 {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:17:14.628189 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a52ac974-1854-4348-b5bb-33fcc6abec92 tempest-FloatingIPsTestJSON-120707403 tempest-FloatingIPsTestJSON-120707403-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/874b7f74-36d5-4e76-8f71-eebf8a856ea1" status: 404 len: 111 microversion: 2.1 time: 0.057835 Apr 16 21:17:14.632487 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-6b8e87c1-5e9d-4e9d-b097-f919d9d1d4bf tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] HTTP exception thrown: Image not found. Apr 16 21:17:14.632838 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1444/3020] 10.222.0.20 () {58 vars in 1259 bytes} [Sat Apr 16 21:17:14 2022] GET /compute/v2.1/os-floating-ips/874b7f74-36d5-4e76-8f71-eebf8a856ea1 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:17:14.633114 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6b8e87c1-5e9d-4e9d-b097-f919d9d1d4bf tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Returning 404 to user: Image not found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:17:14.633911 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6b8e87c1-5e9d-4e9d-b097-f919d9d1d4bf tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "DELETE /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73" status: 404 len: 62 microversion: 2.1 time: 0.026686 Apr 16 21:17:14.634450 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1577/3021] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:14 2022] DELETE /compute/v2.1/images/7eac04fe-a5c5-43ed-b0a0-8aeec2019d73 => generated 62 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Apr 16 21:17:14.640512 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a70c4358-520e-4211-acbf-beb0b0437251 tempest-FloatingIPsTestJSON-120707403 tempest-FloatingIPsTestJSON-120707403-project] Calling method '.version_select at 0x7fbb962b43a0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:14.641986 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e0a53422-24bb-4276-8834-e6ed9369ce5d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:14.643696 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e0a53422-24bb-4276-8834-e6ed9369ce5d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: ff70294f-a73f-4dcf-aaf4-bd979106f1b8] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:14.649588 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e0a53422-24bb-4276-8834-e6ed9369ce5d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:14.650046 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e0a53422-24bb-4276-8834-e6ed9369ce5d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:14.650828 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e0a53422-24bb-4276-8834-e6ed9369ce5d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:14.651376 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e0a53422-24bb-4276-8834-e6ed9369ce5d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:14.665435 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-e0a53422-24bb-4276-8834-e6ed9369ce5d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] HTTP exception thrown: Instance ff70294f-a73f-4dcf-aaf4-bd979106f1b8 could not be found. Apr 16 21:17:14.666041 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e0a53422-24bb-4276-8834-e6ed9369ce5d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Returning 404 to user: Instance ff70294f-a73f-4dcf-aaf4-bd979106f1b8 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:17:14.666890 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e0a53422-24bb-4276-8834-e6ed9369ce5d tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8" status: 404 len: 111 microversion: 2.1 time: 0.028614 Apr 16 21:17:14.667624 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1578/3022] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:17:14 2022] DELETE /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:17:14.675728 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-261a501f-4826-4f37-a10e-6602c2e846c0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:14.676414 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-261a501f-4826-4f37-a10e-6602c2e846c0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: ff70294f-a73f-4dcf-aaf4-bd979106f1b8] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:14.683428 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-261a501f-4826-4f37-a10e-6602c2e846c0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:14.684140 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-261a501f-4826-4f37-a10e-6602c2e846c0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:14.684931 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-261a501f-4826-4f37-a10e-6602c2e846c0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:14.685382 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-261a501f-4826-4f37-a10e-6602c2e846c0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:14.694388 ncdv-master-1 devstack@n-api.service[137409]: DEBUG neutronclient.v2_0.client [None req-a70c4358-520e-4211-acbf-beb0b0437251 tempest-FloatingIPsTestJSON-120707403 tempest-FloatingIPsTestJSON-120707403-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 874b7f74-36d5-4e76-8f71-eebf8a856ea1 could not be found", "detail": ""}} {{(pid=137409) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 16 21:17:14.695147 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-a70c4358-520e-4211-acbf-beb0b0437251 tempest-FloatingIPsTestJSON-120707403 tempest-FloatingIPsTestJSON-120707403-project] HTTP exception thrown: Floating IP not found for ID 874b7f74-36d5-4e76-8f71-eebf8a856ea1 Apr 16 21:17:14.695752 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a70c4358-520e-4211-acbf-beb0b0437251 tempest-FloatingIPsTestJSON-120707403 tempest-FloatingIPsTestJSON-120707403-project] Returning 404 to user: Floating IP not found for ID 874b7f74-36d5-4e76-8f71-eebf8a856ea1 {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:17:14.696680 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a70c4358-520e-4211-acbf-beb0b0437251 tempest-FloatingIPsTestJSON-120707403 tempest-FloatingIPsTestJSON-120707403-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/874b7f74-36d5-4e76-8f71-eebf8a856ea1" status: 404 len: 111 microversion: 2.1 time: 0.062765 Apr 16 21:17:14.698820 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1445/3023] 10.222.0.20 () {58 vars in 1262 bytes} [Sat Apr 16 21:17:14 2022] DELETE /compute/v2.1/os-floating-ips/874b7f74-36d5-4e76-8f71-eebf8a856ea1 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:17:14.699555 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-261a501f-4826-4f37-a10e-6602c2e846c0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] HTTP exception thrown: Instance ff70294f-a73f-4dcf-aaf4-bd979106f1b8 could not be found. Apr 16 21:17:14.700204 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-261a501f-4826-4f37-a10e-6602c2e846c0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Returning 404 to user: Instance ff70294f-a73f-4dcf-aaf4-bd979106f1b8 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:17:14.701038 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-261a501f-4826-4f37-a10e-6602c2e846c0 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8" status: 404 len: 111 microversion: 2.1 time: 0.029476 Apr 16 21:17:14.704762 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1579/3024] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:14 2022] GET /compute/v2.1/servers/ff70294f-a73f-4dcf-aaf4-bd979106f1b8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:17:14.710576 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6024f536-e9c6-4b07-970d-bd8f8e486a50 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:14.710756 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5f43c5d0-6c81-408b-96f9-ff306c9c5466 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb957fd3a0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:14.713835 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6024f536-e9c6-4b07-970d-bd8f8e486a50 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 6458699b-6221-4f77-85fe-d41710e9c3bd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:14.717408 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6024f536-e9c6-4b07-970d-bd8f8e486a50 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:14.718074 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6024f536-e9c6-4b07-970d-bd8f8e486a50 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:14.719115 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6024f536-e9c6-4b07-970d-bd8f8e486a50 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:14.719318 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6024f536-e9c6-4b07-970d-bd8f8e486a50 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:14.733289 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-5f43c5d0-6c81-408b-96f9-ff306c9c5466 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] HTTP exception thrown: Image not found. Apr 16 21:17:14.733988 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5f43c5d0-6c81-408b-96f9-ff306c9c5466 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Returning 404 to user: Image not found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:17:14.735054 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5f43c5d0-6c81-408b-96f9-ff306c9c5466 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "DELETE /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231" status: 404 len: 62 microversion: 2.1 time: 0.028851 Apr 16 21:17:14.735946 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1446/3025] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:14 2022] DELETE /compute/v2.1/images/6981f1b8-fbeb-4aba-bd4e-cd0b96f66231 => generated 62 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:17:14.745112 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6f7f63a2-7bee-4877-b993-d3580ccbd667 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:14.745728 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6f7f63a2-7bee-4877-b993-d3580ccbd667 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:14.753263 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6f7f63a2-7bee-4877-b993-d3580ccbd667 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:14.753823 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6f7f63a2-7bee-4877-b993-d3580ccbd667 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:14.755365 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6f7f63a2-7bee-4877-b993-d3580ccbd667 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:14.755890 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6f7f63a2-7bee-4877-b993-d3580ccbd667 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:14.771373 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-6f7f63a2-7bee-4877-b993-d3580ccbd667 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] HTTP exception thrown: Instance 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef could not be found. Apr 16 21:17:14.771991 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6f7f63a2-7bee-4877-b993-d3580ccbd667 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Returning 404 to user: Instance 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:17:14.772997 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6f7f63a2-7bee-4877-b993-d3580ccbd667 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 404 len: 111 microversion: 2.1 time: 0.032918 Apr 16 21:17:14.773730 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1447/3026] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:17:14 2022] DELETE /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:17:14.781579 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1b666f43-6e52-4d48-a72e-1a5b7701c19e tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:14.782317 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1b666f43-6e52-4d48-a72e-1a5b7701c19e tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:14.789401 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1b666f43-6e52-4d48-a72e-1a5b7701c19e tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:14.789855 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1b666f43-6e52-4d48-a72e-1a5b7701c19e tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:14.794215 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1b666f43-6e52-4d48-a72e-1a5b7701c19e tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:14.794215 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1b666f43-6e52-4d48-a72e-1a5b7701c19e tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:14.806908 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-1b666f43-6e52-4d48-a72e-1a5b7701c19e tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] HTTP exception thrown: Instance 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef could not be found. Apr 16 21:17:14.807732 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1b666f43-6e52-4d48-a72e-1a5b7701c19e tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Returning 404 to user: Instance 9e98c6a8-a1a1-4e8d-98bf-18f5967003ef could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:17:14.808550 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1b666f43-6e52-4d48-a72e-1a5b7701c19e tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef" status: 404 len: 111 microversion: 2.1 time: 0.031066 Apr 16 21:17:14.809294 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1448/3027] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:14 2022] GET /compute/v2.1/servers/9e98c6a8-a1a1-4e8d-98bf-18f5967003ef => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:17:14.819393 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c4eed7a4-05a3-4fc2-bc38-c8e413ee6f7f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '.version_select at 0x7fbb958ed280>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:14.844993 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-c4eed7a4-05a3-4fc2-bc38-c8e413ee6f7f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] HTTP exception thrown: Image not found. Apr 16 21:17:14.845734 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c4eed7a4-05a3-4fc2-bc38-c8e413ee6f7f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Returning 404 to user: Image not found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:17:14.846675 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c4eed7a4-05a3-4fc2-bc38-c8e413ee6f7f tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "DELETE /compute/v2.1/images/d631a0d5-6e5b-4edc-b753-706449e6c1ef" status: 404 len: 62 microversion: 2.1 time: 0.033350 Apr 16 21:17:14.848218 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1449/3028] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:14 2022] DELETE /compute/v2.1/images/d631a0d5-6e5b-4edc-b753-706449e6c1ef => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Apr 16 21:17:14.855686 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-974a2da6-4122-48ca-b4a3-a306779ed139 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:14.856202 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-974a2da6-4122-48ca-b4a3-a306779ed139 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9ea94c91-140c-428c-8831-03efc8c571f6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:14.862942 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-974a2da6-4122-48ca-b4a3-a306779ed139 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:14.863471 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-974a2da6-4122-48ca-b4a3-a306779ed139 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:14.864286 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-974a2da6-4122-48ca-b4a3-a306779ed139 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:14.864731 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-974a2da6-4122-48ca-b4a3-a306779ed139 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:14.873557 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6024f536-e9c6-4b07-970d-bd8f8e486a50 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:14.878662 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-974a2da6-4122-48ca-b4a3-a306779ed139 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] HTTP exception thrown: Instance 9ea94c91-140c-428c-8831-03efc8c571f6 could not be found. Apr 16 21:17:14.879260 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-974a2da6-4122-48ca-b4a3-a306779ed139 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Returning 404 to user: Instance 9ea94c91-140c-428c-8831-03efc8c571f6 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:17:14.880785 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-974a2da6-4122-48ca-b4a3-a306779ed139 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9ea94c91-140c-428c-8831-03efc8c571f6" status: 404 len: 111 microversion: 2.1 time: 0.028825 Apr 16 21:17:14.881347 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1450/3029] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:17:14 2022] DELETE /compute/v2.1/servers/9ea94c91-140c-428c-8831-03efc8c571f6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:17:14.882548 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6024f536-e9c6-4b07-970d-bd8f8e486a50 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/6458699b-6221-4f77-85fe-d41710e9c3bd" status: 200 len: 1522 microversion: 2.1 time: 0.175228 Apr 16 21:17:14.883213 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1580/3030] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:14 2022] GET /compute/v2.1/servers/6458699b-6221-4f77-85fe-d41710e9c3bd => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:14.889650 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-530d154c-4cbf-4d50-993b-cd35c8426155 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:14.890331 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-530d154c-4cbf-4d50-993b-cd35c8426155 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] [instance: 9ea94c91-140c-428c-8831-03efc8c571f6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:14.900696 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-530d154c-4cbf-4d50-993b-cd35c8426155 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:14.900696 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-530d154c-4cbf-4d50-993b-cd35c8426155 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:14.900696 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-530d154c-4cbf-4d50-993b-cd35c8426155 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:14.900696 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-530d154c-4cbf-4d50-993b-cd35c8426155 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:14.902895 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e21fb280-a838-457d-bfb8-04caeeb08c76 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:14.903497 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e21fb280-a838-457d-bfb8-04caeeb08c76 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 6458699b-6221-4f77-85fe-d41710e9c3bd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:14.909990 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e21fb280-a838-457d-bfb8-04caeeb08c76 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:14.910471 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e21fb280-a838-457d-bfb8-04caeeb08c76 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:14.911265 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e21fb280-a838-457d-bfb8-04caeeb08c76 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:14.911712 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e21fb280-a838-457d-bfb8-04caeeb08c76 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:14.915293 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-530d154c-4cbf-4d50-993b-cd35c8426155 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] HTTP exception thrown: Instance 9ea94c91-140c-428c-8831-03efc8c571f6 could not be found. Apr 16 21:17:14.916126 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-530d154c-4cbf-4d50-993b-cd35c8426155 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] Returning 404 to user: Instance 9ea94c91-140c-428c-8831-03efc8c571f6 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:17:14.917051 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-530d154c-4cbf-4d50-993b-cd35c8426155 tempest-ImagesTestJSON-613187597 tempest-ImagesTestJSON-613187597-project] 10.222.0.20 "GET /compute/v2.1/servers/9ea94c91-140c-428c-8831-03efc8c571f6" status: 404 len: 111 microversion: 2.1 time: 0.031146 Apr 16 21:17:14.920807 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1451/3031] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:14 2022] GET /compute/v2.1/servers/9ea94c91-140c-428c-8831-03efc8c571f6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:17:14.937183 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e21fb280-a838-457d-bfb8-04caeeb08c76 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 6458699b-6221-4f77-85fe-d41710e9c3bd] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:17:14.957310 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2c6d773c-a5f4-4425-a245-7ded497a6832 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:14.957724 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2c6d773c-a5f4-4425-a245-7ded497a6832 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: dc95a4d6-f40d-4087-91ae-3038926df942] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:14.964555 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2c6d773c-a5f4-4425-a245-7ded497a6832 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:14.965018 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2c6d773c-a5f4-4425-a245-7ded497a6832 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:14.965803 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2c6d773c-a5f4-4425-a245-7ded497a6832 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:14.966247 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2c6d773c-a5f4-4425-a245-7ded497a6832 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:15.226732 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e21fb280-a838-457d-bfb8-04caeeb08c76 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6458699b-6221-4f77-85fe-d41710e9c3bd" status: 204 len: 0 microversion: 2.1 time: 0.326469 Apr 16 21:17:15.227072 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1581/3032] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:17:14 2022] DELETE /compute/v2.1/servers/6458699b-6221-4f77-85fe-d41710e9c3bd => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 16 21:17:15.235578 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-023e77f5-ef98-4cc4-b10d-025198c784ff tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:15.236308 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-023e77f5-ef98-4cc4-b10d-025198c784ff tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 6458699b-6221-4f77-85fe-d41710e9c3bd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:15.242818 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-023e77f5-ef98-4cc4-b10d-025198c784ff tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:15.243338 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-023e77f5-ef98-4cc4-b10d-025198c784ff tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:15.244121 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-023e77f5-ef98-4cc4-b10d-025198c784ff tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:15.244584 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-023e77f5-ef98-4cc4-b10d-025198c784ff tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:15.263293 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2c6d773c-a5f4-4425-a245-7ded497a6832 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:15.271879 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2c6d773c-a5f4-4425-a245-7ded497a6832 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942" status: 200 len: 1521 microversion: 2.1 time: 0.318779 Apr 16 21:17:15.272866 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1452/3033] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:14 2022] GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942 => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:17:15.352399 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-27ce0563-ed41-43e9-9e9c-66412f4e8ad8 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:15.353138 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-27ce0563-ed41-43e9-9e9c-66412f4e8ad8 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:15.360320 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-27ce0563-ed41-43e9-9e9c-66412f4e8ad8 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:15.360904 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-27ce0563-ed41-43e9-9e9c-66412f4e8ad8 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:15.361857 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-27ce0563-ed41-43e9-9e9c-66412f4e8ad8 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:15.362308 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-27ce0563-ed41-43e9-9e9c-66412f4e8ad8 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:15.424097 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-023e77f5-ef98-4cc4-b10d-025198c784ff tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:15.432240 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-023e77f5-ef98-4cc4-b10d-025198c784ff tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/6458699b-6221-4f77-85fe-d41710e9c3bd" status: 200 len: 1528 microversion: 2.1 time: 0.200684 Apr 16 21:17:15.433229 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1582/3034] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:15 2022] GET /compute/v2.1/servers/6458699b-6221-4f77-85fe-d41710e9c3bd => generated 1528 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:17:15.583055 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c34aad23-95bf-41b9-bb7b-3c19f1c3d125 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:15.584677 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c34aad23-95bf-41b9-bb7b-3c19f1c3d125 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:15.593883 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c34aad23-95bf-41b9-bb7b-3c19f1c3d125 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:15.593883 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c34aad23-95bf-41b9-bb7b-3c19f1c3d125 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:15.593883 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c34aad23-95bf-41b9-bb7b-3c19f1c3d125 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:15.593883 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c34aad23-95bf-41b9-bb7b-3c19f1c3d125 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:15.749746 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-27ce0563-ed41-43e9-9e9c-66412f4e8ad8 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:15.758355 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-27ce0563-ed41-43e9-9e9c-66412f4e8ad8 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1540 microversion: 2.1 time: 0.413015 Apr 16 21:17:15.759137 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1453/3035] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:15 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1540 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:15.833598 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c34aad23-95bf-41b9-bb7b-3c19f1c3d125 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:15.842487 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c34aad23-95bf-41b9-bb7b-3c19f1c3d125 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1680 microversion: 2.1 time: 0.263453 Apr 16 21:17:15.843361 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1583/3036] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:15 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1680 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:16.290427 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-02932f01-efc7-4cfb-81bc-1d006dd51995 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:16.291001 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-02932f01-efc7-4cfb-81bc-1d006dd51995 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: dc95a4d6-f40d-4087-91ae-3038926df942] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:16.297890 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-02932f01-efc7-4cfb-81bc-1d006dd51995 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:16.299279 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-02932f01-efc7-4cfb-81bc-1d006dd51995 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:16.299279 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-02932f01-efc7-4cfb-81bc-1d006dd51995 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:16.299582 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-02932f01-efc7-4cfb-81bc-1d006dd51995 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:16.454426 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-80765d63-4c75-4a58-8084-5c612c6a91f2 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:16.454426 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-80765d63-4c75-4a58-8084-5c612c6a91f2 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 6458699b-6221-4f77-85fe-d41710e9c3bd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:16.458779 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-80765d63-4c75-4a58-8084-5c612c6a91f2 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:16.459644 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-80765d63-4c75-4a58-8084-5c612c6a91f2 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:16.461318 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-80765d63-4c75-4a58-8084-5c612c6a91f2 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:16.461965 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-80765d63-4c75-4a58-8084-5c612c6a91f2 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:16.646129 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-80765d63-4c75-4a58-8084-5c612c6a91f2 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:16.656945 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-80765d63-4c75-4a58-8084-5c612c6a91f2 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/6458699b-6221-4f77-85fe-d41710e9c3bd" status: 200 len: 1528 microversion: 2.1 time: 0.211432 Apr 16 21:17:16.662197 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1584/3037] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:16 2022] GET /compute/v2.1/servers/6458699b-6221-4f77-85fe-d41710e9c3bd => generated 1528 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:17:16.668571 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-02932f01-efc7-4cfb-81bc-1d006dd51995 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:16.676712 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-02932f01-efc7-4cfb-81bc-1d006dd51995 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942" status: 200 len: 1521 microversion: 2.1 time: 0.390919 Apr 16 21:17:16.677328 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1454/3038] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:16 2022] GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942 => generated 1521 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:16.782947 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-af2a9546-37f7-413d-98ae-b510873d30c7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:16.782947 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-af2a9546-37f7-413d-98ae-b510873d30c7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:16.783931 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-af2a9546-37f7-413d-98ae-b510873d30c7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:16.784422 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-af2a9546-37f7-413d-98ae-b510873d30c7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:16.785219 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-af2a9546-37f7-413d-98ae-b510873d30c7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:16.785662 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-af2a9546-37f7-413d-98ae-b510873d30c7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:16.858908 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-145cee61-0261-49b2-925c-64a2fd3191e5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:16.859522 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-145cee61-0261-49b2-925c-64a2fd3191e5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:16.870623 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-145cee61-0261-49b2-925c-64a2fd3191e5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:16.871384 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-145cee61-0261-49b2-925c-64a2fd3191e5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:16.872601 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-145cee61-0261-49b2-925c-64a2fd3191e5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:16.873047 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-145cee61-0261-49b2-925c-64a2fd3191e5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:17.006512 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-af2a9546-37f7-413d-98ae-b510873d30c7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:17.011649 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-af2a9546-37f7-413d-98ae-b510873d30c7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1540 microversion: 2.1 time: 0.240469 Apr 16 21:17:17.012243 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1585/3039] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:16 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1540 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:17.399787 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-145cee61-0261-49b2-925c-64a2fd3191e5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:17.407680 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-145cee61-0261-49b2-925c-64a2fd3191e5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1680 microversion: 2.1 time: 0.552736 Apr 16 21:17:17.408464 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1455/3040] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:16 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1680 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:17:17.696072 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a3448ef1-a8ca-4a38-8bcd-6b2764c307e8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:17.697804 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-07040233-0e0c-4b8c-add0-60038e5be536 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:17.698970 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-07040233-0e0c-4b8c-add0-60038e5be536 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 6458699b-6221-4f77-85fe-d41710e9c3bd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:17.703008 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a3448ef1-a8ca-4a38-8bcd-6b2764c307e8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: dc95a4d6-f40d-4087-91ae-3038926df942] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:17.714253 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a3448ef1-a8ca-4a38-8bcd-6b2764c307e8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:17.715416 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-07040233-0e0c-4b8c-add0-60038e5be536 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:17.716051 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a3448ef1-a8ca-4a38-8bcd-6b2764c307e8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:17.717671 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a3448ef1-a8ca-4a38-8bcd-6b2764c307e8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:17.718300 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-07040233-0e0c-4b8c-add0-60038e5be536 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:17.718955 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a3448ef1-a8ca-4a38-8bcd-6b2764c307e8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:17.720060 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-07040233-0e0c-4b8c-add0-60038e5be536 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:17.723315 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-07040233-0e0c-4b8c-add0-60038e5be536 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:17.878534 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-07040233-0e0c-4b8c-add0-60038e5be536 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:17.886053 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-07040233-0e0c-4b8c-add0-60038e5be536 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/6458699b-6221-4f77-85fe-d41710e9c3bd" status: 200 len: 1528 microversion: 2.1 time: 0.209648 Apr 16 21:17:17.886924 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1586/3041] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:17 2022] GET /compute/v2.1/servers/6458699b-6221-4f77-85fe-d41710e9c3bd => generated 1528 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:17.990827 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a3448ef1-a8ca-4a38-8bcd-6b2764c307e8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:17.998407 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a3448ef1-a8ca-4a38-8bcd-6b2764c307e8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942" status: 200 len: 1501 microversion: 2.1 time: 0.308317 Apr 16 21:17:17.998990 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1456/3042] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:17 2022] GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942 => generated 1501 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:18.023750 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5373bc96-e497-4a60-913f-3dcf5c90c2b5 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "54669e2d-9a4c-425d-8821-4c2e7cc2cddb"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:18.024862 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5373bc96-e497-4a60-913f-3dcf5c90c2b5 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: dc95a4d6-f40d-4087-91ae-3038926df942] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:18.029096 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-397901fa-6958-4000-98f9-3199e24042a3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:18.029716 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-397901fa-6958-4000-98f9-3199e24042a3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:18.036048 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5373bc96-e497-4a60-913f-3dcf5c90c2b5 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:18.039686 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5373bc96-e497-4a60-913f-3dcf5c90c2b5 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:18.040581 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-397901fa-6958-4000-98f9-3199e24042a3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:18.041284 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-397901fa-6958-4000-98f9-3199e24042a3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:18.042322 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5373bc96-e497-4a60-913f-3dcf5c90c2b5 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:18.042593 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-397901fa-6958-4000-98f9-3199e24042a3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:18.042790 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5373bc96-e497-4a60-913f-3dcf5c90c2b5 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:18.043368 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-397901fa-6958-4000-98f9-3199e24042a3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:18.090812 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-5373bc96-e497-4a60-913f-3dcf5c90c2b5 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] HTTP exception thrown: Cannot 'attach_volume' instance dc95a4d6-f40d-4087-91ae-3038926df942 while it is in vm_state rescued Apr 16 21:17:18.091419 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5373bc96-e497-4a60-913f-3dcf5c90c2b5 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Returning 409 to user: Cannot 'attach_volume' instance dc95a4d6-f40d-4087-91ae-3038926df942 while it is in vm_state rescued {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:17:18.096787 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5373bc96-e497-4a60-913f-3dcf5c90c2b5 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "POST /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.078988 Apr 16 21:17:18.099278 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1587/3043] 10.222.0.20 () {60 vars in 1322 bytes} [Sat Apr 16 21:17:18 2022] POST /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942/os-volume_attachments => generated 152 bytes in 82 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:17:18.115903 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-69dcad95-6769-4978-b189-bf6cbbdfca6c req-148fad56-2146-4209-8fd6-ed8f8ce57b60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6458699b-6221-4f77-85fe-d41710e9c3bd", "name": "network-vif-deleted", "tag": "94e8eb87-ee7a-4a8e-bb59-9075350ddd30"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:18.124798 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-69dcad95-6769-4978-b189-bf6cbbdfca6c req-148fad56-2146-4209-8fd6-ed8f8ce57b60 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:18.125319 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-69dcad95-6769-4978-b189-bf6cbbdfca6c req-148fad56-2146-4209-8fd6-ed8f8ce57b60 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:18.148444 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-69dcad95-6769-4978-b189-bf6cbbdfca6c req-148fad56-2146-4209-8fd6-ed8f8ce57b60 service nova] Creating event network-vif-deleted:94e8eb87-ee7a-4a8e-bb59-9075350ddd30 for instance 6458699b-6221-4f77-85fe-d41710e9c3bd on nch2-master-1 Apr 16 21:17:18.156392 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-69dcad95-6769-4978-b189-bf6cbbdfca6c req-148fad56-2146-4209-8fd6-ed8f8ce57b60 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045952 Apr 16 21:17:18.158997 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1588/3044] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:17:18.171151 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9a8e2aac-0563-4dfb-bc92-54db6ed39693 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:18.174447 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9a8e2aac-0563-4dfb-bc92-54db6ed39693 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: dc95a4d6-f40d-4087-91ae-3038926df942] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:18.188074 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a8e2aac-0563-4dfb-bc92-54db6ed39693 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:18.195086 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a8e2aac-0563-4dfb-bc92-54db6ed39693 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:18.196366 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a8e2aac-0563-4dfb-bc92-54db6ed39693 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:18.196989 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a8e2aac-0563-4dfb-bc92-54db6ed39693 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:18.243236 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-397901fa-6958-4000-98f9-3199e24042a3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:18.254305 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-397901fa-6958-4000-98f9-3199e24042a3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1472 microversion: 2.1 time: 0.228909 Apr 16 21:17:18.258082 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1457/3045] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:18 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1472 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:18.425845 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-49ce91af-c6df-4b4e-904c-abaf8f85302d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:18.427055 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-49ce91af-c6df-4b4e-904c-abaf8f85302d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:18.434671 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-49ce91af-c6df-4b4e-904c-abaf8f85302d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:18.435422 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-49ce91af-c6df-4b4e-904c-abaf8f85302d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:18.436260 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-49ce91af-c6df-4b4e-904c-abaf8f85302d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:18.436716 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-49ce91af-c6df-4b4e-904c-abaf8f85302d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:18.458587 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9a8e2aac-0563-4dfb-bc92-54db6ed39693 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "POST /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942/action" status: 202 len: 0 microversion: 2.1 time: 0.297715 Apr 16 21:17:18.459743 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1589/3046] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:17:18 2022] POST /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:17:18.470722 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-413a399a-3a22-4051-a70b-a8610ad027fa tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:18.475499 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-413a399a-3a22-4051-a70b-a8610ad027fa tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: dc95a4d6-f40d-4087-91ae-3038926df942] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:18.492608 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-413a399a-3a22-4051-a70b-a8610ad027fa tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:18.493393 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-413a399a-3a22-4051-a70b-a8610ad027fa tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:18.499592 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-413a399a-3a22-4051-a70b-a8610ad027fa tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:18.499592 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-413a399a-3a22-4051-a70b-a8610ad027fa tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:18.594128 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-49ce91af-c6df-4b4e-904c-abaf8f85302d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:18.603328 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-49ce91af-c6df-4b4e-904c-abaf8f85302d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1680 microversion: 2.1 time: 0.182195 Apr 16 21:17:18.604771 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1458/3047] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:18 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1680 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:17:18.738516 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-413a399a-3a22-4051-a70b-a8610ad027fa tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:18.747299 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-413a399a-3a22-4051-a70b-a8610ad027fa tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942" status: 200 len: 1509 microversion: 2.1 time: 0.282460 Apr 16 21:17:18.747892 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1590/3048] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:18 2022] GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942 => generated 1509 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:17:18.833212 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-23168241-04e3-4827-b84d-709c679e0a2c req-4977dff9-e953-403c-a456-07a38934297c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbcf087b-c508-46e9-a546-99b764daddbb", "name": "network-vif-unplugged", "status": "completed", "tag": "c077f313-2701-4802-bf5a-28338c745ec4"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:18.849143 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-23168241-04e3-4827-b84d-709c679e0a2c req-4977dff9-e953-403c-a456-07a38934297c service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:18.849994 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-23168241-04e3-4827-b84d-709c679e0a2c req-4977dff9-e953-403c-a456-07a38934297c service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:18.865103 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-23168241-04e3-4827-b84d-709c679e0a2c req-4977dff9-e953-403c-a456-07a38934297c service nova] Creating event network-vif-unplugged:c077f313-2701-4802-bf5a-28338c745ec4 for instance cbcf087b-c508-46e9-a546-99b764daddbb on nch1-master-1 Apr 16 21:17:18.871360 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [req-23168241-04e3-4827-b84d-709c679e0a2c req-4977dff9-e953-403c-a456-07a38934297c service nova] Instance cbcf087b-c508-46e9-a546-99b764daddbb is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=137409) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 16 21:17:18.878294 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-23168241-04e3-4827-b84d-709c679e0a2c req-4977dff9-e953-403c-a456-07a38934297c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051445 Apr 16 21:17:18.879027 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1459/3049] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:17:18.902895 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5dc1d218-a842-4f7d-90b1-04cba9a6e9e2 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:18.904202 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5dc1d218-a842-4f7d-90b1-04cba9a6e9e2 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 6458699b-6221-4f77-85fe-d41710e9c3bd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:18.912426 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5dc1d218-a842-4f7d-90b1-04cba9a6e9e2 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:18.912993 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5dc1d218-a842-4f7d-90b1-04cba9a6e9e2 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:18.914209 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5dc1d218-a842-4f7d-90b1-04cba9a6e9e2 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:18.915143 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5dc1d218-a842-4f7d-90b1-04cba9a6e9e2 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:18.949506 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5dc1d218-a842-4f7d-90b1-04cba9a6e9e2 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:18.950021 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5dc1d218-a842-4f7d-90b1-04cba9a6e9e2 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:18.950490 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-5dc1d218-a842-4f7d-90b1-04cba9a6e9e2 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lazy-loading 'fault' on Instance uuid 6458699b-6221-4f77-85fe-d41710e9c3bd {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:17:19.003811 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5dc1d218-a842-4f7d-90b1-04cba9a6e9e2 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6230c967390f4c5f8d3b9580bac4b340', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c63d4ed9df1548b88731e003044c32da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:19.012348 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5dc1d218-a842-4f7d-90b1-04cba9a6e9e2 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/6458699b-6221-4f77-85fe-d41710e9c3bd" status: 200 len: 1315 microversion: 2.1 time: 0.113284 Apr 16 21:17:19.012955 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1591/3050] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:18 2022] GET /compute/v2.1/servers/6458699b-6221-4f77-85fe-d41710e9c3bd => generated 1315 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:19.274216 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-95a96136-eb79-4fb8-b060-1dd97e1d313a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:19.274836 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-95a96136-eb79-4fb8-b060-1dd97e1d313a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:19.281151 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-95a96136-eb79-4fb8-b060-1dd97e1d313a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:19.281608 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-95a96136-eb79-4fb8-b060-1dd97e1d313a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:19.282372 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-95a96136-eb79-4fb8-b060-1dd97e1d313a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:19.282809 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-95a96136-eb79-4fb8-b060-1dd97e1d313a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:19.489547 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-95a96136-eb79-4fb8-b060-1dd97e1d313a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:19.498882 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-95a96136-eb79-4fb8-b060-1dd97e1d313a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1472 microversion: 2.1 time: 0.227971 Apr 16 21:17:19.500139 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1460/3051] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:19 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1472 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:19.633681 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a98b9288-8c79-44b6-bd00-9e51d906708b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:19.635339 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a98b9288-8c79-44b6-bd00-9e51d906708b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:19.641956 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a98b9288-8c79-44b6-bd00-9e51d906708b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:19.642888 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a98b9288-8c79-44b6-bd00-9e51d906708b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:19.644154 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a98b9288-8c79-44b6-bd00-9e51d906708b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:19.644888 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a98b9288-8c79-44b6-bd00-9e51d906708b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:19.765222 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0c775663-f1ad-4fe7-8868-4cdc498ed0f6 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:19.766111 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0c775663-f1ad-4fe7-8868-4cdc498ed0f6 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: dc95a4d6-f40d-4087-91ae-3038926df942] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:19.796540 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0c775663-f1ad-4fe7-8868-4cdc498ed0f6 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:19.802049 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0c775663-f1ad-4fe7-8868-4cdc498ed0f6 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:19.802049 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0c775663-f1ad-4fe7-8868-4cdc498ed0f6 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:19.810863 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0c775663-f1ad-4fe7-8868-4cdc498ed0f6 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:19.982363 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a98b9288-8c79-44b6-bd00-9e51d906708b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:19.994278 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a98b9288-8c79-44b6-bd00-9e51d906708b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1680 microversion: 2.1 time: 0.376370 Apr 16 21:17:19.995748 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1592/3052] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:19 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1680 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:17:20.036263 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-52a61e14-b8b7-4106-bbfd-65bfc2553319 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:20.036263 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-52a61e14-b8b7-4106-bbfd-65bfc2553319 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 6458699b-6221-4f77-85fe-d41710e9c3bd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:20.068689 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-52a61e14-b8b7-4106-bbfd-65bfc2553319 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:20.072336 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-52a61e14-b8b7-4106-bbfd-65bfc2553319 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:20.074452 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-52a61e14-b8b7-4106-bbfd-65bfc2553319 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:20.075850 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-52a61e14-b8b7-4106-bbfd-65bfc2553319 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:20.083701 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0c775663-f1ad-4fe7-8868-4cdc498ed0f6 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:20.093907 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0c775663-f1ad-4fe7-8868-4cdc498ed0f6 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942" status: 200 len: 1509 microversion: 2.1 time: 0.332779 Apr 16 21:17:20.094964 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1461/3053] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:19 2022] GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942 => generated 1509 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:20.114967 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-52a61e14-b8b7-4106-bbfd-65bfc2553319 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] HTTP exception thrown: Instance 6458699b-6221-4f77-85fe-d41710e9c3bd could not be found. Apr 16 21:17:20.116149 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-52a61e14-b8b7-4106-bbfd-65bfc2553319 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Returning 404 to user: Instance 6458699b-6221-4f77-85fe-d41710e9c3bd could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:17:20.117016 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-52a61e14-b8b7-4106-bbfd-65bfc2553319 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/6458699b-6221-4f77-85fe-d41710e9c3bd" status: 404 len: 111 microversion: 2.1 time: 0.091158 Apr 16 21:17:20.117736 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1593/3054] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:20 2022] GET /compute/v2.1/servers/6458699b-6221-4f77-85fe-d41710e9c3bd => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:17:20.125702 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-05e4710a-ddee-4774-a705-b432bf3f4ac7 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '.version_select at 0x7fbb957db310>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:20.152472 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-05e4710a-ddee-4774-a705-b432bf3f4ac7 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] HTTP exception thrown: Image not found. Apr 16 21:17:20.153099 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-05e4710a-ddee-4774-a705-b432bf3f4ac7 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Returning 404 to user: Image not found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:17:20.154514 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-05e4710a-ddee-4774-a705-b432bf3f4ac7 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "DELETE /compute/v2.1/images/519a00e1-dffc-4883-99b3-e1f11eaa0f3a" status: 404 len: 62 microversion: 2.1 time: 0.032135 Apr 16 21:17:20.159624 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1462/3055] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:20 2022] DELETE /compute/v2.1/images/519a00e1-dffc-4883-99b3-e1f11eaa0f3a => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:17:20.164588 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8685d339-c6d6-4d47-9ae1-0e93983eb4f7 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:20.167828 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8685d339-c6d6-4d47-9ae1-0e93983eb4f7 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 8cb60874-b0f3-4055-a4d1-531f4a147992] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:20.173514 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8685d339-c6d6-4d47-9ae1-0e93983eb4f7 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:20.173973 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8685d339-c6d6-4d47-9ae1-0e93983eb4f7 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:20.174752 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8685d339-c6d6-4d47-9ae1-0e93983eb4f7 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:20.175190 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8685d339-c6d6-4d47-9ae1-0e93983eb4f7 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:20.190579 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-8685d339-c6d6-4d47-9ae1-0e93983eb4f7 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] HTTP exception thrown: Instance 8cb60874-b0f3-4055-a4d1-531f4a147992 could not be found. Apr 16 21:17:20.191246 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8685d339-c6d6-4d47-9ae1-0e93983eb4f7 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Returning 404 to user: Instance 8cb60874-b0f3-4055-a4d1-531f4a147992 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:17:20.192148 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8685d339-c6d6-4d47-9ae1-0e93983eb4f7 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992" status: 404 len: 111 microversion: 2.1 time: 0.032660 Apr 16 21:17:20.192713 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1594/3056] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:17:20 2022] DELETE /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:17:20.201582 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-86d586ab-e459-4ffa-83ba-a5a74cabb9aa tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:20.202266 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-86d586ab-e459-4ffa-83ba-a5a74cabb9aa tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 8cb60874-b0f3-4055-a4d1-531f4a147992] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:20.209552 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-86d586ab-e459-4ffa-83ba-a5a74cabb9aa tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:20.210103 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-86d586ab-e459-4ffa-83ba-a5a74cabb9aa tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:20.211959 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-86d586ab-e459-4ffa-83ba-a5a74cabb9aa tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:20.211959 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-86d586ab-e459-4ffa-83ba-a5a74cabb9aa tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:20.225095 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-86d586ab-e459-4ffa-83ba-a5a74cabb9aa tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] HTTP exception thrown: Instance 8cb60874-b0f3-4055-a4d1-531f4a147992 could not be found. Apr 16 21:17:20.225809 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-86d586ab-e459-4ffa-83ba-a5a74cabb9aa tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Returning 404 to user: Instance 8cb60874-b0f3-4055-a4d1-531f4a147992 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:17:20.226838 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-86d586ab-e459-4ffa-83ba-a5a74cabb9aa tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992" status: 404 len: 111 microversion: 2.1 time: 0.029375 Apr 16 21:17:20.227457 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1463/3057] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:20 2022] GET /compute/v2.1/servers/8cb60874-b0f3-4055-a4d1-531f4a147992 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:17:20.241895 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f14f5e47-25b3-4d28-bb82-d8be14522ce7 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '.version_select at 0x7fbb9593b940>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:20.285207 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d1c0f1c0-0675-490e-a93c-5c79fd46a834 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb9580b040>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:20.328590 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d1c0f1c0-0675-490e-a93c-5c79fd46a834 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/09ad8237-f421-4e3a-9fb7-6395c5a27ba6" status: 200 len: 662 microversion: 2.1 time: 0.047027 Apr 16 21:17:20.329170 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1464/3058] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:17:20 2022] GET /compute/v2.1/images/09ad8237-f421-4e3a-9fb7-6395c5a27ba6 => generated 662 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:17:20.340454 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-307c705d-c7b9-4eee-828b-5469885b1d9a tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb9582bdc0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:20.392877 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f14f5e47-25b3-4d28-bb82-d8be14522ce7 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-673050155" status: 202 len: 0 microversion: 2.1 time: 0.155304 Apr 16 21:17:20.397108 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1595/3059] 10.222.0.20 () {58 vars in 1217 bytes} [Sat Apr 16 21:17:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-673050155 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:17:20.397452 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-307c705d-c7b9-4eee-828b-5469885b1d9a tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/09ad8237-f421-4e3a-9fb7-6395c5a27ba6" status: 200 len: 662 microversion: 2.1 time: 0.059690 Apr 16 21:17:20.420445 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1465/3060] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:17:20 2022] GET /compute/v2.1/images/09ad8237-f421-4e3a-9fb7-6395c5a27ba6 => generated 662 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:17:20.516983 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2a539401-e53c-4a91-b0d6-638d3eeb19a4 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:20.521950 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2a539401-e53c-4a91-b0d6-638d3eeb19a4 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:20.529847 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2a539401-e53c-4a91-b0d6-638d3eeb19a4 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:20.530582 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2a539401-e53c-4a91-b0d6-638d3eeb19a4 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:20.531914 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2a539401-e53c-4a91-b0d6-638d3eeb19a4 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:20.532790 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2a539401-e53c-4a91-b0d6-638d3eeb19a4 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:20.851615 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2a539401-e53c-4a91-b0d6-638d3eeb19a4 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:20.861765 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2a539401-e53c-4a91-b0d6-638d3eeb19a4 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1469 microversion: 2.1 time: 0.348876 Apr 16 21:17:20.862344 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1596/3061] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:20 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1469 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:20.880283 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-62812931-b4dd-4e86-81c7-c85a400c9f8d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:20.884321 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-62812931-b4dd-4e86-81c7-c85a400c9f8d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:20.890673 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-62812931-b4dd-4e86-81c7-c85a400c9f8d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:20.896525 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-62812931-b4dd-4e86-81c7-c85a400c9f8d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:20.896525 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-62812931-b4dd-4e86-81c7-c85a400c9f8d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:20.896525 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-62812931-b4dd-4e86-81c7-c85a400c9f8d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:20.936883 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-62812931-b4dd-4e86-81c7-c85a400c9f8d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:20.938283 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-62812931-b4dd-4e86-81c7-c85a400c9f8d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:20.941545 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-62812931-b4dd-4e86-81c7-c85a400c9f8d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:20.941545 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-62812931-b4dd-4e86-81c7-c85a400c9f8d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:20.964650 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-62812931-b4dd-4e86-81c7-c85a400c9f8d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Getting quotas for project 29fd420ef9134715bd3a9f2467d924cd. Resources: {'ram', 'cores'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:17:20.969905 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-62812931-b4dd-4e86-81c7-c85a400c9f8d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Getting quotas for user d17cad39fa38448eb9827605871463a3 and project 29fd420ef9134715bd3a9f2467d924cd. Resources: {'ram', 'cores'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:17:21.012096 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-85504877-3d22-4295-bc53-239dc84191f1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:21.012925 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-85504877-3d22-4295-bc53-239dc84191f1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:21.019340 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-85504877-3d22-4295-bc53-239dc84191f1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:21.019797 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-85504877-3d22-4295-bc53-239dc84191f1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:21.020606 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-85504877-3d22-4295-bc53-239dc84191f1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:21.021050 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-85504877-3d22-4295-bc53-239dc84191f1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:21.192827 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-85504877-3d22-4295-bc53-239dc84191f1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:21.202034 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-85504877-3d22-4295-bc53-239dc84191f1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1657 microversion: 2.1 time: 0.193899 Apr 16 21:17:21.202618 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1597/3062] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:21 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1657 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:21.215478 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f9715cbe-d7d1-46d5-b61c-aa7d4f989866 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:21.217909 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f9715cbe-d7d1-46d5-b61c-aa7d4f989866 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: dc95a4d6-f40d-4087-91ae-3038926df942] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:21.226525 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9715cbe-d7d1-46d5-b61c-aa7d4f989866 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:21.227087 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9715cbe-d7d1-46d5-b61c-aa7d4f989866 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:21.227757 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9715cbe-d7d1-46d5-b61c-aa7d4f989866 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:21.228641 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9715cbe-d7d1-46d5-b61c-aa7d4f989866 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:21.397101 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f9715cbe-d7d1-46d5-b61c-aa7d4f989866 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:21.406137 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f9715cbe-d7d1-46d5-b61c-aa7d4f989866 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942" status: 200 len: 1509 microversion: 2.1 time: 0.202129 Apr 16 21:17:21.406440 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-62812931-b4dd-4e86-81c7-c85a400c9f8d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "POST /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb/action" status: 202 len: 0 microversion: 2.1 time: 0.530849 Apr 16 21:17:21.407097 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1466/3063] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:17:20 2022] POST /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb/action => generated 0 bytes in 532 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 16 21:17:21.408158 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1598/3064] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:21 2022] GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942 => generated 1509 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:21.412649 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4f095b03-307f-4a97-ba28-e9676b66a3ac tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:21.415352 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-29ac3cfa-271b-49e3-830e-18cc87f26403 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '.version_select at 0x7fbb958be670>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:21.421703 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4f095b03-307f-4a97-ba28-e9676b66a3ac tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:21.422483 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4f095b03-307f-4a97-ba28-e9676b66a3ac tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:21.446591 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4f095b03-307f-4a97-ba28-e9676b66a3ac tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Going to try to start instance {{(pid=137409) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 16 21:17:21.460464 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-29ac3cfa-271b-49e3-830e-18cc87f26403 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] HTTP exception thrown: Image not found. Apr 16 21:17:21.462498 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-29ac3cfa-271b-49e3-830e-18cc87f26403 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Returning 404 to user: Image not found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:17:21.462498 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-29ac3cfa-271b-49e3-830e-18cc87f26403 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "DELETE /compute/v2.1/images/34e8a435-71d4-499d-a028-30c444fa2ce3" status: 404 len: 62 microversion: 2.1 time: 0.052418 Apr 16 21:17:21.465656 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1599/3065] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:21 2022] DELETE /compute/v2.1/images/34e8a435-71d4-499d-a028-30c444fa2ce3 => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:17:21.467897 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b14ebf61-0615-4513-9723-a0bc9285e815 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:21.468974 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b14ebf61-0615-4513-9723-a0bc9285e815 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:21.476603 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b14ebf61-0615-4513-9723-a0bc9285e815 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:21.477067 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b14ebf61-0615-4513-9723-a0bc9285e815 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:21.477859 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b14ebf61-0615-4513-9723-a0bc9285e815 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:21.478382 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b14ebf61-0615-4513-9723-a0bc9285e815 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:21.617581 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b14ebf61-0615-4513-9723-a0bc9285e815 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:21.625292 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b14ebf61-0615-4513-9723-a0bc9285e815 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1468 microversion: 2.1 time: 0.161378 Apr 16 21:17:21.625862 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1600/3066] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:21 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1468 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:21.630450 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f60bdbc2-029c-47a5-85f3-6c3ffbbd5202 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:21.630950 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f60bdbc2-029c-47a5-85f3-6c3ffbbd5202 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:21.636773 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f60bdbc2-029c-47a5-85f3-6c3ffbbd5202 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:21.637231 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f60bdbc2-029c-47a5-85f3-6c3ffbbd5202 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:21.638008 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f60bdbc2-029c-47a5-85f3-6c3ffbbd5202 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:21.638450 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f60bdbc2-029c-47a5-85f3-6c3ffbbd5202 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:21.652483 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-f60bdbc2-029c-47a5-85f3-6c3ffbbd5202 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] HTTP exception thrown: Instance 1a03d234-848c-408c-b46c-e2afebb2c61f could not be found. Apr 16 21:17:21.653081 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f60bdbc2-029c-47a5-85f3-6c3ffbbd5202 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Returning 404 to user: Instance 1a03d234-848c-408c-b46c-e2afebb2c61f could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:17:21.653908 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f60bdbc2-029c-47a5-85f3-6c3ffbbd5202 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f" status: 404 len: 111 microversion: 2.1 time: 0.027146 Apr 16 21:17:21.654445 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1601/3067] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:17:21 2022] DELETE /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:17:21.662519 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1575e7af-aef1-41ae-832e-1573ba4cfc53 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:21.663722 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1575e7af-aef1-41ae-832e-1573ba4cfc53 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] [instance: 1a03d234-848c-408c-b46c-e2afebb2c61f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:21.670042 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4f095b03-307f-4a97-ba28-e9676b66a3ac tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "POST /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa/action" status: 202 len: 0 microversion: 2.1 time: 0.260356 Apr 16 21:17:21.671624 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1467/3068] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:17:21 2022] POST /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:17:21.672434 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1575e7af-aef1-41ae-832e-1573ba4cfc53 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:21.673542 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1575e7af-aef1-41ae-832e-1573ba4cfc53 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:21.674770 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1575e7af-aef1-41ae-832e-1573ba4cfc53 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:21.675221 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1575e7af-aef1-41ae-832e-1573ba4cfc53 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:21.702551 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-1575e7af-aef1-41ae-832e-1573ba4cfc53 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] HTTP exception thrown: Instance 1a03d234-848c-408c-b46c-e2afebb2c61f could not be found. Apr 16 21:17:21.702853 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1575e7af-aef1-41ae-832e-1573ba4cfc53 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] Returning 404 to user: Instance 1a03d234-848c-408c-b46c-e2afebb2c61f could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:17:21.703863 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1575e7af-aef1-41ae-832e-1573ba4cfc53 tempest-ImagesOneServerNegativeTestJSON-2043930767 tempest-ImagesOneServerNegativeTestJSON-2043930767-project] 10.222.0.20 "GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f" status: 404 len: 111 microversion: 2.1 time: 0.044991 Apr 16 21:17:21.704678 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1602/3069] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:21 2022] GET /compute/v2.1/servers/1a03d234-848c-408c-b46c-e2afebb2c61f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:17:21.711429 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3a624341-1cf3-430b-9ee4-844baa3d4bfb tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:21.720039 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3a624341-1cf3-430b-9ee4-844baa3d4bfb tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:21.735925 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3a624341-1cf3-430b-9ee4-844baa3d4bfb tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:21.738268 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3a624341-1cf3-430b-9ee4-844baa3d4bfb tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:21.739354 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3a624341-1cf3-430b-9ee4-844baa3d4bfb tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:21.744758 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3a624341-1cf3-430b-9ee4-844baa3d4bfb tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:22.077609 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3a624341-1cf3-430b-9ee4-844baa3d4bfb tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:22.085301 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3a624341-1cf3-430b-9ee4-844baa3d4bfb tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1666 microversion: 2.1 time: 0.392012 Apr 16 21:17:22.095479 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1468/3070] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:21 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1666 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:22.425913 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-55dc4fe5-2444-4dde-b8df-4472f81d0646 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:22.427026 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-55dc4fe5-2444-4dde-b8df-4472f81d0646 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: dc95a4d6-f40d-4087-91ae-3038926df942] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:22.434368 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-55dc4fe5-2444-4dde-b8df-4472f81d0646 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:22.434887 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-55dc4fe5-2444-4dde-b8df-4472f81d0646 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:22.435684 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-55dc4fe5-2444-4dde-b8df-4472f81d0646 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:22.436130 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-55dc4fe5-2444-4dde-b8df-4472f81d0646 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:22.512297 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-be3d7a52-e3e3-4905-a95a-c08fd4358836 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb95835670>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:22.592478 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-be3d7a52-e3e3-4905-a95a-c08fd4358836 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/d0f1e34c-d801-4bc4-8677-b12311ef7aee" status: 200 len: 660 microversion: 2.1 time: 0.087899 Apr 16 21:17:22.594001 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1469/3071] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:17:22 2022] GET /compute/v2.1/images/d0f1e34c-d801-4bc4-8677-b12311ef7aee => generated 660 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:17:22.607368 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-68cf787f-2b0a-401c-b6e9-e52acc39c691 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb95860700>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:22.659378 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-68cf787f-2b0a-401c-b6e9-e52acc39c691 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/d0f1e34c-d801-4bc4-8677-b12311ef7aee" status: 200 len: 660 microversion: 2.1 time: 0.057159 Apr 16 21:17:22.660511 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1470/3072] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:17:22 2022] GET /compute/v2.1/images/d0f1e34c-d801-4bc4-8677-b12311ef7aee => generated 660 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:17:22.664062 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-55dc4fe5-2444-4dde-b8df-4472f81d0646 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:22.666324 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c0471223-dfee-4731-a7fb-5a8e51e59ba9 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:22.667567 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c0471223-dfee-4731-a7fb-5a8e51e59ba9 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:22.680568 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c0471223-dfee-4731-a7fb-5a8e51e59ba9 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:22.681466 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c0471223-dfee-4731-a7fb-5a8e51e59ba9 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:22.682501 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c0471223-dfee-4731-a7fb-5a8e51e59ba9 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:22.683232 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c0471223-dfee-4731-a7fb-5a8e51e59ba9 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:22.689777 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-55dc4fe5-2444-4dde-b8df-4472f81d0646 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942" status: 200 len: 1515 microversion: 2.1 time: 0.267749 Apr 16 21:17:22.690389 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1603/3073] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:22 2022] GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942 => generated 1515 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:22.922462 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-8b651762-4806-43db-8b43-fb931a165c2e req-a1ddbc46-f05b-4967-b9d8-30b0fed04f5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbcf087b-c508-46e9-a546-99b764daddbb", "name": "network-vif-plugged", "status": "completed", "tag": "c077f313-2701-4802-bf5a-28338c745ec4"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:22.936420 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-8b651762-4806-43db-8b43-fb931a165c2e req-a1ddbc46-f05b-4967-b9d8-30b0fed04f5a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:22.937065 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-8b651762-4806-43db-8b43-fb931a165c2e req-a1ddbc46-f05b-4967-b9d8-30b0fed04f5a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:22.972884 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-8b651762-4806-43db-8b43-fb931a165c2e req-a1ddbc46-f05b-4967-b9d8-30b0fed04f5a service nova] Creating event network-vif-plugged:c077f313-2701-4802-bf5a-28338c745ec4 for instance cbcf087b-c508-46e9-a546-99b764daddbb on nch1-master-1 Apr 16 21:17:22.990272 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [req-8b651762-4806-43db-8b43-fb931a165c2e req-a1ddbc46-f05b-4967-b9d8-30b0fed04f5a service nova] Instance cbcf087b-c508-46e9-a546-99b764daddbb is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1'} {{(pid=137408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 16 21:17:23.001636 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-8b651762-4806-43db-8b43-fb931a165c2e req-a1ddbc46-f05b-4967-b9d8-30b0fed04f5a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084743 Apr 16 21:17:23.002647 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1604/3074] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:17:23.076580 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c0471223-dfee-4731-a7fb-5a8e51e59ba9 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:23.103476 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f0290e17-a95f-4ddc-8b27-638484066d9c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:23.104483 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f0290e17-a95f-4ddc-8b27-638484066d9c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:23.110139 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c0471223-dfee-4731-a7fb-5a8e51e59ba9 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1468 microversion: 2.1 time: 0.435245 Apr 16 21:17:23.114494 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1471/3075] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:22 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1468 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:23.119538 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f0290e17-a95f-4ddc-8b27-638484066d9c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:23.120275 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f0290e17-a95f-4ddc-8b27-638484066d9c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:23.121343 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f0290e17-a95f-4ddc-8b27-638484066d9c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:23.122163 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f0290e17-a95f-4ddc-8b27-638484066d9c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:23.273080 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f0290e17-a95f-4ddc-8b27-638484066d9c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:23.281203 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f0290e17-a95f-4ddc-8b27-638484066d9c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1666 microversion: 2.1 time: 0.182936 Apr 16 21:17:23.281910 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1605/3076] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:23 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1666 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:17:23.709777 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-86d6f2d9-bbf6-4977-9642-3d1f2aa34d94 tempest-ListImageFiltersNegativeTestJSON-1442854538 tempest-ListImageFiltersNegativeTestJSON-1442854538-project] Calling method '.version_select at 0x7fbb957dd0d0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:23.730759 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-86d6f2d9-bbf6-4977-9642-3d1f2aa34d94 tempest-ListImageFiltersNegativeTestJSON-1442854538 tempest-ListImageFiltersNegativeTestJSON-1442854538-project] HTTP exception thrown: Image not found. Apr 16 21:17:23.731370 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-86d6f2d9-bbf6-4977-9642-3d1f2aa34d94 tempest-ListImageFiltersNegativeTestJSON-1442854538 tempest-ListImageFiltersNegativeTestJSON-1442854538-project] Returning 404 to user: Image not found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:17:23.732260 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-86d6f2d9-bbf6-4977-9642-3d1f2aa34d94 tempest-ListImageFiltersNegativeTestJSON-1442854538 tempest-ListImageFiltersNegativeTestJSON-1442854538-project] 10.222.0.20 "GET /compute/v2.1/images/8a11031d-7073-465e-b2c9-bf4269fe73fd" status: 404 len: 62 microversion: 2.1 time: 0.265130 Apr 16 21:17:23.735546 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1472/3077] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:17:23 2022] GET /compute/v2.1/images/8a11031d-7073-465e-b2c9-bf4269fe73fd => generated 62 bytes in 266 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:17:24.131079 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-692d56ec-3a6f-421a-bcc8-167b5f56e0cd tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:24.131721 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-692d56ec-3a6f-421a-bcc8-167b5f56e0cd tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:24.139749 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-692d56ec-3a6f-421a-bcc8-167b5f56e0cd tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:24.141100 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-692d56ec-3a6f-421a-bcc8-167b5f56e0cd tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:24.142186 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-692d56ec-3a6f-421a-bcc8-167b5f56e0cd tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:24.142842 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-692d56ec-3a6f-421a-bcc8-167b5f56e0cd tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:24.289024 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-692d56ec-3a6f-421a-bcc8-167b5f56e0cd tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:24.297091 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-692d56ec-3a6f-421a-bcc8-167b5f56e0cd tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1468 microversion: 2.1 time: 0.170062 Apr 16 21:17:24.298198 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1606/3078] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:24 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1468 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:24.301378 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-dab7402e-e1dc-4ec1-bf76-a2670cc76713 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:24.302077 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-dab7402e-e1dc-4ec1-bf76-a2670cc76713 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:24.308577 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dab7402e-e1dc-4ec1-bf76-a2670cc76713 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:24.309387 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dab7402e-e1dc-4ec1-bf76-a2670cc76713 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:24.310284 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dab7402e-e1dc-4ec1-bf76-a2670cc76713 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:24.310731 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dab7402e-e1dc-4ec1-bf76-a2670cc76713 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:24.453645 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-dab7402e-e1dc-4ec1-bf76-a2670cc76713 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:24.468191 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-dab7402e-e1dc-4ec1-bf76-a2670cc76713 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.173166 Apr 16 21:17:24.474514 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1473/3079] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:24 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:17:24.489096 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3a167fca-4a80-4891-b014-c0d3f462d88c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:24.489777 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3a167fca-4a80-4891-b014-c0d3f462d88c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:24.496410 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3a167fca-4a80-4891-b014-c0d3f462d88c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:24.497060 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3a167fca-4a80-4891-b014-c0d3f462d88c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:24.498048 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3a167fca-4a80-4891-b014-c0d3f462d88c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:24.498774 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3a167fca-4a80-4891-b014-c0d3f462d88c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:24.642858 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3a167fca-4a80-4891-b014-c0d3f462d88c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:24.650530 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3a167fca-4a80-4891-b014-c0d3f462d88c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.165253 Apr 16 21:17:24.651150 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1607/3080] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:24 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:24.666982 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-488d80a8-aae1-4bc9-8e79-06239aeba135 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:24.669715 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-488d80a8-aae1-4bc9-8e79-06239aeba135 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:24.674945 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-488d80a8-aae1-4bc9-8e79-06239aeba135 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:24.677943 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-488d80a8-aae1-4bc9-8e79-06239aeba135 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:24.679347 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-488d80a8-aae1-4bc9-8e79-06239aeba135 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:24.679840 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-488d80a8-aae1-4bc9-8e79-06239aeba135 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:24.866960 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-177242c6-3e2e-4615-a435-98a3cdbf02ad tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb95934700>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:24.876281 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-488d80a8-aae1-4bc9-8e79-06239aeba135 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Unlocking {{(pid=137409) unlock /opt/stack/nova/nova/compute/api.py:4727}} Apr 16 21:17:24.926398 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-177242c6-3e2e-4615-a435-98a3cdbf02ad tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/17acdee7-0ba6-430c-a1f3-2f23d5016268" status: 200 len: 662 microversion: 2.1 time: 0.064411 Apr 16 21:17:24.927053 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1608/3081] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:17:24 2022] GET /compute/v2.1/images/17acdee7-0ba6-430c-a1f3-2f23d5016268 => generated 662 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:17:24.939908 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bccac1d7-4f21-4682-9939-5b22a19175b9 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb9594c040>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:24.983221 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-bccac1d7-4f21-4682-9939-5b22a19175b9 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/17acdee7-0ba6-430c-a1f3-2f23d5016268" status: 200 len: 662 microversion: 2.1 time: 0.047879 Apr 16 21:17:24.984327 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1609/3082] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:17:24 2022] GET /compute/v2.1/images/17acdee7-0ba6-430c-a1f3-2f23d5016268 => generated 662 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:17:25.108495 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1bd51923-1d4b-435a-bd45-9221ed227de5 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-234165167", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:25.162333 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-488d80a8-aae1-4bc9-8e79-06239aeba135 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "POST /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa/action" status: 202 len: 0 microversion: 2.1 time: 0.499284 Apr 16 21:17:25.163821 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-1bd51923-1d4b-435a-bd45-9221ed227de5 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] validate_networks() for None {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:17:25.164329 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1474/3083] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:17:24 2022] POST /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa/action => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:17:25.176701 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-11ca1259-f986-4391-b6ba-4a1e6fb6e741 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:25.177344 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-11ca1259-f986-4391-b6ba-4a1e6fb6e741 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:25.184153 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-11ca1259-f986-4391-b6ba-4a1e6fb6e741 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:25.184644 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-11ca1259-f986-4391-b6ba-4a1e6fb6e741 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:25.185450 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-11ca1259-f986-4391-b6ba-4a1e6fb6e741 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:25.185873 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-11ca1259-f986-4391-b6ba-4a1e6fb6e741 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:25.408630 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-11ca1259-f986-4391-b6ba-4a1e6fb6e741 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:25.419619 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-11ca1259-f986-4391-b6ba-4a1e6fb6e741 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.247449 Apr 16 21:17:25.421391 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1475/3084] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:25 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:17:25.437104 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0685a56d-bf1b-4d38-90ab-2af8913b7a42 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:25.437104 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0685a56d-bf1b-4d38-90ab-2af8913b7a42 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:25.441103 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0685a56d-bf1b-4d38-90ab-2af8913b7a42 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:25.441569 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0685a56d-bf1b-4d38-90ab-2af8913b7a42 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:25.442365 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0685a56d-bf1b-4d38-90ab-2af8913b7a42 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:25.442811 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0685a56d-bf1b-4d38-90ab-2af8913b7a42 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:25.481881 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-1bd51923-1d4b-435a-bd45-9221ed227de5 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:17:25.482599 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-1bd51923-1d4b-435a-bd45-9221ed227de5 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:17:25.483440 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-1bd51923-1d4b-435a-bd45-9221ed227de5 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:17:25.484072 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-1bd51923-1d4b-435a-bd45-9221ed227de5 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:17:25.484729 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-1bd51923-1d4b-435a-bd45-9221ed227de5 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:17:25.502024 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1bd51923-1d4b-435a-bd45-9221ed227de5 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:25.503017 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1bd51923-1d4b-435a-bd45-9221ed227de5 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:25.504256 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1bd51923-1d4b-435a-bd45-9221ed227de5 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:25.510627 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1bd51923-1d4b-435a-bd45-9221ed227de5 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:25.558270 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-1bd51923-1d4b-435a-bd45-9221ed227de5 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Getting quotas for project c79f0fe4726d4abcbdc2672a15f709f9. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:17:25.569114 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-1bd51923-1d4b-435a-bd45-9221ed227de5 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Getting quotas for user 484bca4e32554ed4af061012f30666ea and project c79f0fe4726d4abcbdc2672a15f709f9. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:17:25.619034 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1bd51923-1d4b-435a-bd45-9221ed227de5 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:17:25.624780 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1bd51923-1d4b-435a-bd45-9221ed227de5 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] [instance: 9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:17:25.722191 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0685a56d-bf1b-4d38-90ab-2af8913b7a42 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:25.730939 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0685a56d-bf1b-4d38-90ab-2af8913b7a42 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1468 microversion: 2.1 time: 0.307959 Apr 16 21:17:25.740879 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1476/3085] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:25 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1468 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:25.743208 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-35eba518-1938-4901-a348-236ef8bd6de9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:25.743842 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-35eba518-1938-4901-a348-236ef8bd6de9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:25.749834 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-35eba518-1938-4901-a348-236ef8bd6de9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:25.750302 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-35eba518-1938-4901-a348-236ef8bd6de9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:25.751093 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-35eba518-1938-4901-a348-236ef8bd6de9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:25.751541 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-35eba518-1938-4901-a348-236ef8bd6de9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:25.772640 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1bd51923-1d4b-435a-bd45-9221ed227de5 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.668167 Apr 16 21:17:25.773592 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1610/3086] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:17:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 670 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:17:25.778794 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4aeccf62-88e4-4be8-ab5a-0158b336b273 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Action: 'create', calling method: .version_select at 0x7fbb9594d670>, body: {"keypair": {"name": "tempest-keypair-1637182820"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:25.810457 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-4aeccf62-88e4-4be8-ab5a-0158b336b273 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Getting quotas for project ff01c614d0ea4275b713b7e872342151. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:17:25.816683 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-4aeccf62-88e4-4be8-ab5a-0158b336b273 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Getting quotas for user 929bcf59f4fb4eb7a8b76809cce91e6e and project ff01c614d0ea4275b713b7e872342151. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:17:26.336027 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-35eba518-1938-4901-a348-236ef8bd6de9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:26.336027 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-35eba518-1938-4901-a348-236ef8bd6de9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.299012 Apr 16 21:17:26.336027 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1477/3087] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:25 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:26.336027 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f96f7f8f-940b-4a55-a692-525ca82f1585 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-304197654", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:26.336027 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-f96f7f8f-940b-4a55-a692-525ca82f1585 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] validate_networks() for None {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:17:26.341003 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-4aeccf62-88e4-4be8-ab5a-0158b336b273 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Getting quotas for project ff01c614d0ea4275b713b7e872342151. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:17:26.341003 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-4aeccf62-88e4-4be8-ab5a-0158b336b273 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Getting quotas for user 929bcf59f4fb4eb7a8b76809cce91e6e and project ff01c614d0ea4275b713b7e872342151. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:17:26.341003 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4aeccf62-88e4-4be8-ab5a-0158b336b273 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.378707 Apr 16 21:17:26.341003 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1611/3088] 10.222.0.20 () {60 vars in 1157 bytes} [Sat Apr 16 21:17:25 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:26.341003 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-405e278b-1db4-48c7-ac6f-009d39e8c9fa tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:26.341003 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-405e278b-1db4-48c7-ac6f-009d39e8c9fa tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:26.341003 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-405e278b-1db4-48c7-ac6f-009d39e8c9fa tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:26.341003 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-405e278b-1db4-48c7-ac6f-009d39e8c9fa tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:26.341003 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-405e278b-1db4-48c7-ac6f-009d39e8c9fa tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:26.341003 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-405e278b-1db4-48c7-ac6f-009d39e8c9fa tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:26.341003 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-405e278b-1db4-48c7-ac6f-009d39e8c9fa tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:26.344561 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-405e278b-1db4-48c7-ac6f-009d39e8c9fa tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.186366 Apr 16 21:17:26.346074 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1612/3089] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:26 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:26.366864 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7af29e6c-12b0-4d0c-b1af-c11bc68186ee tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:26.367624 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7af29e6c-12b0-4d0c-b1af-c11bc68186ee tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:26.376693 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7af29e6c-12b0-4d0c-b1af-c11bc68186ee tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:26.382232 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7af29e6c-12b0-4d0c-b1af-c11bc68186ee tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:26.382232 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7af29e6c-12b0-4d0c-b1af-c11bc68186ee tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:26.382232 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7af29e6c-12b0-4d0c-b1af-c11bc68186ee tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:26.482896 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-f96f7f8f-940b-4a55-a692-525ca82f1585 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:17:26.482896 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-f96f7f8f-940b-4a55-a692-525ca82f1585 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:17:26.482896 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-f96f7f8f-940b-4a55-a692-525ca82f1585 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:17:26.482896 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-f96f7f8f-940b-4a55-a692-525ca82f1585 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:17:26.482896 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-f96f7f8f-940b-4a55-a692-525ca82f1585 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:17:26.718177 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7af29e6c-12b0-4d0c-b1af-c11bc68186ee tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "POST /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa/action" status: 202 len: 0 microversion: 2.1 time: 0.357374 Apr 16 21:17:26.722106 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1613/3090] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:17:26 2022] POST /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa/action => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:17:26.748202 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3d8960b3-4d0c-4773-a1c1-6d8ffcb73ec9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:26.748965 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3d8960b3-4d0c-4773-a1c1-6d8ffcb73ec9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:26.755463 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d8960b3-4d0c-4773-a1c1-6d8ffcb73ec9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:26.757335 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d8960b3-4d0c-4773-a1c1-6d8ffcb73ec9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:26.757335 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d8960b3-4d0c-4773-a1c1-6d8ffcb73ec9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:26.757335 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d8960b3-4d0c-4773-a1c1-6d8ffcb73ec9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:26.798526 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f96f7f8f-940b-4a55-a692-525ca82f1585 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:26.798982 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f96f7f8f-940b-4a55-a692-525ca82f1585 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:26.799808 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f96f7f8f-940b-4a55-a692-525ca82f1585 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:26.800281 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f96f7f8f-940b-4a55-a692-525ca82f1585 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:26.837853 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-f96f7f8f-940b-4a55-a692-525ca82f1585 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Getting quotas for project c79f0fe4726d4abcbdc2672a15f709f9. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:17:26.844703 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-f96f7f8f-940b-4a55-a692-525ca82f1585 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Getting quotas for user 484bca4e32554ed4af061012f30666ea and project c79f0fe4726d4abcbdc2672a15f709f9. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:17:26.861653 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f96f7f8f-940b-4a55-a692-525ca82f1585 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:17:26.864419 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f96f7f8f-940b-4a55-a692-525ca82f1585 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] [instance: 0ba3ff1f-0ee1-4dba-8354-10aaef694161] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:17:26.985425 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3d8960b3-4d0c-4773-a1c1-6d8ffcb73ec9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:26.996632 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3d8960b3-4d0c-4773-a1c1-6d8ffcb73ec9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1675 microversion: 2.1 time: 0.272413 Apr 16 21:17:26.998296 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1614/3091] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:26 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1675 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:27.005513 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9dca213f-d619-4bfb-b9ef-b368d14fcda0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:27.006267 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9dca213f-d619-4bfb-b9ef-b368d14fcda0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:27.019407 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9dca213f-d619-4bfb-b9ef-b368d14fcda0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:27.019407 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9dca213f-d619-4bfb-b9ef-b368d14fcda0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:27.019407 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9dca213f-d619-4bfb-b9ef-b368d14fcda0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:27.019407 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9dca213f-d619-4bfb-b9ef-b368d14fcda0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:27.110638 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f96f7f8f-940b-4a55-a692-525ca82f1585 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.074924 Apr 16 21:17:27.112218 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1478/3092] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:17:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1077 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:17:27.266433 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9dca213f-d619-4bfb-b9ef-b368d14fcda0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:27.277703 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9dca213f-d619-4bfb-b9ef-b368d14fcda0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1534 microversion: 2.1 time: 0.277527 Apr 16 21:17:27.278987 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1615/3093] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:26 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1534 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:27.296250 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e9af64bc-b591-4b2f-a477-20531d07fbf1 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:27.297202 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e9af64bc-b591-4b2f-a477-20531d07fbf1 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] [instance: 0ba3ff1f-0ee1-4dba-8354-10aaef694161] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:27.339715 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-217771a2-493c-4641-a9b4-65926f88a59f tempest-KeyPairsNegativeTestJSON-716818897 tempest-KeyPairsNegativeTestJSON-716818897-project] Action: 'create', calling method: .version_select at 0x7fbb9579d310>, body: {"keypair": {"name": "key_/.\\@:"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:27.347696 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-217771a2-493c-4641-a9b4-65926f88a59f tempest-KeyPairsNegativeTestJSON-716818897 tempest-KeyPairsNegativeTestJSON-716818897-project] HTTP exception thrown: Keypair data is invalid: Keypair name contains unsafe characters Apr 16 21:17:27.347696 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-217771a2-493c-4641-a9b4-65926f88a59f tempest-KeyPairsNegativeTestJSON-716818897 tempest-KeyPairsNegativeTestJSON-716818897-project] Returning 400 to user: Keypair data is invalid: Keypair name contains unsafe characters {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:17:27.347696 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-217771a2-493c-4641-a9b4-65926f88a59f tempest-KeyPairsNegativeTestJSON-716818897 tempest-KeyPairsNegativeTestJSON-716818897-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.233254 Apr 16 21:17:27.347696 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1479/3094] 10.222.0.20 () {60 vars in 1157 bytes} [Sat Apr 16 21:17:27 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 235 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:17:27.400441 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e9af64bc-b591-4b2f-a477-20531d07fbf1 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484bca4e32554ed4af061012f30666ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79f0fe4726d4abcbdc2672a15f709f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:27.408777 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e9af64bc-b591-4b2f-a477-20531d07fbf1 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161" status: 200 len: 1217 microversion: 2.1 time: 0.117905 Apr 16 21:17:27.409579 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1616/3095] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:27 2022] GET /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161 => generated 1217 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:27.416243 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7710a3ae-c336-4de9-91fd-3e09d55486c7 tempest-KeyPairsNegativeTestJSON-716818897 tempest-KeyPairsNegativeTestJSON-716818897-project] Action: 'create', calling method: .version_select at 0x7fbb95939dc0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1465243229", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:27.417654 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6b872dda-ac82-4529-80ae-9fd4edd3e04b tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] Action: 'create', calling method: .version_select at 0x7fbb957dd430>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1178421233", "description": "tempest-description-1609146141"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:27.434265 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-7710a3ae-c336-4de9-91fd-3e09d55486c7 tempest-KeyPairsNegativeTestJSON-716818897 tempest-KeyPairsNegativeTestJSON-716818897-project] Getting quotas for project 17d036a334dd4557b7ba23fa2419f3cd. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:17:27.439411 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-7710a3ae-c336-4de9-91fd-3e09d55486c7 tempest-KeyPairsNegativeTestJSON-716818897 tempest-KeyPairsNegativeTestJSON-716818897-project] Getting quotas for user 117dae107bdd41a1b0202ab40080d230 and project 17d036a334dd4557b7ba23fa2419f3cd. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:17:27.457491 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-7710a3ae-c336-4de9-91fd-3e09d55486c7 tempest-KeyPairsNegativeTestJSON-716818897 tempest-KeyPairsNegativeTestJSON-716818897-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Apr 16 21:17:27.458092 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7710a3ae-c336-4de9-91fd-3e09d55486c7 tempest-KeyPairsNegativeTestJSON-716818897 tempest-KeyPairsNegativeTestJSON-716818897-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:17:27.458920 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7710a3ae-c336-4de9-91fd-3e09d55486c7 tempest-KeyPairsNegativeTestJSON-716818897 tempest-KeyPairsNegativeTestJSON-716818897-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.048249 Apr 16 21:17:27.459689 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1617/3096] 10.222.0.20 () {60 vars in 1159 bytes} [Sat Apr 16 21:17:27 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 49 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Apr 16 21:17:27.468304 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5cec47dc-a0fc-4c90-b6c1-dad5bec369ba tempest-KeyPairsNegativeTestJSON-716818897 tempest-KeyPairsNegativeTestJSON-716818897-project] Action: 'create', calling method: .version_select at 0x7fbb95939820>, body: {"keypair": {"name": "tempest-keypair-158726825"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:27.482249 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-5cec47dc-a0fc-4c90-b6c1-dad5bec369ba tempest-KeyPairsNegativeTestJSON-716818897 tempest-KeyPairsNegativeTestJSON-716818897-project] Getting quotas for project 17d036a334dd4557b7ba23fa2419f3cd. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:17:27.487647 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-5cec47dc-a0fc-4c90-b6c1-dad5bec369ba tempest-KeyPairsNegativeTestJSON-716818897 tempest-KeyPairsNegativeTestJSON-716818897-project] Getting quotas for user 117dae107bdd41a1b0202ab40080d230 and project 17d036a334dd4557b7ba23fa2419f3cd. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:17:27.705283 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-5cec47dc-a0fc-4c90-b6c1-dad5bec369ba tempest-KeyPairsNegativeTestJSON-716818897 tempest-KeyPairsNegativeTestJSON-716818897-project] Getting quotas for project 17d036a334dd4557b7ba23fa2419f3cd. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:17:27.711363 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-5cec47dc-a0fc-4c90-b6c1-dad5bec369ba tempest-KeyPairsNegativeTestJSON-716818897 tempest-KeyPairsNegativeTestJSON-716818897-project] Getting quotas for user 117dae107bdd41a1b0202ab40080d230 and project 17d036a334dd4557b7ba23fa2419f3cd. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:17:27.729690 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5cec47dc-a0fc-4c90-b6c1-dad5bec369ba tempest-KeyPairsNegativeTestJSON-716818897 tempest-KeyPairsNegativeTestJSON-716818897-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.264841 Apr 16 21:17:27.730283 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1618/3097] 10.222.0.20 () {60 vars in 1157 bytes} [Sat Apr 16 21:17:27 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:17:27.740609 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-941ed0af-fc4b-4eeb-a841-61bc4ed5ff3e tempest-KeyPairsNegativeTestJSON-716818897 tempest-KeyPairsNegativeTestJSON-716818897-project] Action: 'create', calling method: .version_select at 0x7fbb959390d0>, body: {"keypair": {"name": "tempest-keypair-158726825"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:27.755151 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-941ed0af-fc4b-4eeb-a841-61bc4ed5ff3e tempest-KeyPairsNegativeTestJSON-716818897 tempest-KeyPairsNegativeTestJSON-716818897-project] Getting quotas for project 17d036a334dd4557b7ba23fa2419f3cd. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:17:27.760126 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-941ed0af-fc4b-4eeb-a841-61bc4ed5ff3e tempest-KeyPairsNegativeTestJSON-716818897 tempest-KeyPairsNegativeTestJSON-716818897-project] Getting quotas for user 117dae107bdd41a1b0202ab40080d230 and project 17d036a334dd4557b7ba23fa2419f3cd. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:17:27.866137 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6b872dda-ac82-4529-80ae-9fd4edd3e04b tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.517827 Apr 16 21:17:27.866729 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1480/3098] 10.222.0.20 () {60 vars in 1179 bytes} [Sat Apr 16 21:17:27 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:17:27.877925 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fe85800a-3aa5-42b3-8839-755ed1ef257d tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] Action: 'create', calling method: .version_select at 0x7fbb9579d160>, body: {"security_group_rule": {"parent_group_id": "dd068948-fd7f-4b27-a4d2-ae6b9d6879cd", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:28.091737 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-941ed0af-fc4b-4eeb-a841-61bc4ed5ff3e tempest-KeyPairsNegativeTestJSON-716818897 tempest-KeyPairsNegativeTestJSON-716818897-project] HTTP exception thrown: Key pair 'tempest-keypair-158726825' already exists. Apr 16 21:17:28.092407 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-941ed0af-fc4b-4eeb-a841-61bc4ed5ff3e tempest-KeyPairsNegativeTestJSON-716818897 tempest-KeyPairsNegativeTestJSON-716818897-project] Returning 409 to user: Key pair 'tempest-keypair-158726825' already exists. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:17:28.093266 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-941ed0af-fc4b-4eeb-a841-61bc4ed5ff3e tempest-KeyPairsNegativeTestJSON-716818897 tempest-KeyPairsNegativeTestJSON-716818897-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.356517 Apr 16 21:17:28.094845 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1619/3099] 10.222.0.20 () {60 vars in 1157 bytes} [Sat Apr 16 21:17:27 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 358 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:17:28.100011 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6af1a43a-73da-46c4-86ab-04ec5d4d5940 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:28.145322 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6af1a43a-73da-46c4-86ab-04ec5d4d5940 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:28.145322 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6af1a43a-73da-46c4-86ab-04ec5d4d5940 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:28.145322 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6af1a43a-73da-46c4-86ab-04ec5d4d5940 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:28.145322 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6af1a43a-73da-46c4-86ab-04ec5d4d5940 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:28.145322 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6af1a43a-73da-46c4-86ab-04ec5d4d5940 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:28.322866 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6af1a43a-73da-46c4-86ab-04ec5d4d5940 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:28.330421 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6af1a43a-73da-46c4-86ab-04ec5d4d5940 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1655 microversion: 2.1 time: 0.234564 Apr 16 21:17:28.330998 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1620/3100] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:28 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1655 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:28.338815 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-732fa4e0-bcf9-49b8-bcf6-907b165abe9f tempest-KeyPairsNegativeTestJSON-716818897 tempest-KeyPairsNegativeTestJSON-716818897-project] Calling method '.version_select at 0x7fbb959323a0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:28.384199 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fe85800a-3aa5-42b3-8839-755ed1ef257d tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.510175 Apr 16 21:17:28.384846 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1481/3101] 10.222.0.20 () {60 vars in 1194 bytes} [Sat Apr 16 21:17:27 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:17:28.390346 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9991782d-5c46-434f-8471-6defd1e2adac tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:28.390511 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9991782d-5c46-434f-8471-6defd1e2adac tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:28.397275 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9991782d-5c46-434f-8471-6defd1e2adac tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:28.397663 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9991782d-5c46-434f-8471-6defd1e2adac tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:28.398453 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9991782d-5c46-434f-8471-6defd1e2adac tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:28.398906 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9991782d-5c46-434f-8471-6defd1e2adac tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:28.415423 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-732fa4e0-bcf9-49b8-bcf6-907b165abe9f tempest-KeyPairsNegativeTestJSON-716818897 tempest-KeyPairsNegativeTestJSON-716818897-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-158726825" status: 202 len: 0 microversion: 2.1 time: 0.083263 Apr 16 21:17:28.416071 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1621/3102] 10.222.0.20 () {58 vars in 1217 bytes} [Sat Apr 16 21:17:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-158726825 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:17:28.422005 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9a725a5a-3e22-4579-8307-4013f71faed4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:28.422513 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9a725a5a-3e22-4579-8307-4013f71faed4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:28.429664 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a725a5a-3e22-4579-8307-4013f71faed4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:28.430906 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a725a5a-3e22-4579-8307-4013f71faed4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:28.431825 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a725a5a-3e22-4579-8307-4013f71faed4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:28.432297 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a725a5a-3e22-4579-8307-4013f71faed4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:28.554429 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9991782d-5c46-434f-8471-6defd1e2adac tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:28.564057 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9991782d-5c46-434f-8471-6defd1e2adac tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1534 microversion: 2.1 time: 0.177914 Apr 16 21:17:28.564844 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1482/3103] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:28 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1534 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:28.589227 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9d0b4e50-d039-4c60-8693-27c85e762dff tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] Action: 'create', calling method: .version_select at 0x7fbb95835700>, body: {"security_group_rule": {"parent_group_id": "dd068948-fd7f-4b27-a4d2-ae6b9d6879cd", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:28.664195 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-9d0b4e50-d039-4c60-8693-27c85e762dff tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] HTTP exception thrown: This rule already exists in group dd068948-fd7f-4b27-a4d2-ae6b9d6879cd Apr 16 21:17:28.667061 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9d0b4e50-d039-4c60-8693-27c85e762dff tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] Returning 400 to user: This rule already exists in group dd068948-fd7f-4b27-a4d2-ae6b9d6879cd {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:17:28.668580 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9d0b4e50-d039-4c60-8693-27c85e762dff tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.083565 Apr 16 21:17:28.669476 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1483/3104] 10.222.0.20 () {60 vars in 1194 bytes} [Sat Apr 16 21:17:28 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 85 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:17:28.675896 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-80e93ee8-92f7-408e-be1c-b5c87bd6bfb7 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:28.676760 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-80e93ee8-92f7-408e-be1c-b5c87bd6bfb7 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] [instance: 0ba3ff1f-0ee1-4dba-8354-10aaef694161] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:28.686345 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-80e93ee8-92f7-408e-be1c-b5c87bd6bfb7 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:28.687108 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-80e93ee8-92f7-408e-be1c-b5c87bd6bfb7 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:28.688096 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-80e93ee8-92f7-408e-be1c-b5c87bd6bfb7 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:28.688804 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-80e93ee8-92f7-408e-be1c-b5c87bd6bfb7 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:28.768220 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-80e93ee8-92f7-408e-be1c-b5c87bd6bfb7 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484bca4e32554ed4af061012f30666ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79f0fe4726d4abcbdc2672a15f709f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:28.775570 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-80e93ee8-92f7-408e-be1c-b5c87bd6bfb7 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161" status: 200 len: 1221 microversion: 2.1 time: 0.104916 Apr 16 21:17:28.776266 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1484/3105] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:28 2022] GET /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161 => generated 1221 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:28.782016 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f55f5c41-4b89-4416-ba5e-db4c7451632c tempest-KeyPairsNegativeTestJSON-716818897 tempest-KeyPairsNegativeTestJSON-716818897-project] Action: 'create', calling method: .version_select at 0x7fbb9579d820>, body: {"keypair": {"name": ""}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:28.783560 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f55f5c41-4b89-4416-ba5e-db4c7451632c tempest-KeyPairsNegativeTestJSON-716818897 tempest-KeyPairsNegativeTestJSON-716818897-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:17:28.784491 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f55f5c41-4b89-4416-ba5e-db4c7451632c tempest-KeyPairsNegativeTestJSON-716818897 tempest-KeyPairsNegativeTestJSON-716818897-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.006911 Apr 16 21:17:28.785108 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1485/3106] 10.222.0.20 () {60 vars in 1157 bytes} [Sat Apr 16 21:17:28 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:17:28.795542 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4ab998d2-65d5-4600-a378-9b7e7c744161 tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] Calling method '.version_select at 0x7fbb958355e0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:28.875699 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9a725a5a-3e22-4579-8307-4013f71faed4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "POST /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa/action" status: 202 len: 0 microversion: 2.1 time: 0.458293 Apr 16 21:17:28.876568 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1622/3107] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:17:28 2022] POST /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa/action => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:17:28.884132 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-abd8b0fa-b8b5-4d47-85cc-00f5d1bf3f16 tempest-KeyPairsNegativeTestJSON-716818897 tempest-KeyPairsNegativeTestJSON-716818897-project] Action: 'create', calling method: .version_select at 0x7fbb95933ca0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1153601172", "public_key": " "}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:28.922938 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-abd8b0fa-b8b5-4d47-85cc-00f5d1bf3f16 tempest-KeyPairsNegativeTestJSON-716818897 tempest-KeyPairsNegativeTestJSON-716818897-project] Getting quotas for project 17d036a334dd4557b7ba23fa2419f3cd. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:17:28.922938 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-abd8b0fa-b8b5-4d47-85cc-00f5d1bf3f16 tempest-KeyPairsNegativeTestJSON-716818897 tempest-KeyPairsNegativeTestJSON-716818897-project] Getting quotas for user 117dae107bdd41a1b0202ab40080d230 and project 17d036a334dd4557b7ba23fa2419f3cd. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:17:28.933203 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-abd8b0fa-b8b5-4d47-85cc-00f5d1bf3f16 tempest-KeyPairsNegativeTestJSON-716818897 tempest-KeyPairsNegativeTestJSON-716818897-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Apr 16 21:17:28.933819 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-abd8b0fa-b8b5-4d47-85cc-00f5d1bf3f16 tempest-KeyPairsNegativeTestJSON-716818897 tempest-KeyPairsNegativeTestJSON-716818897-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:17:28.934666 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-abd8b0fa-b8b5-4d47-85cc-00f5d1bf3f16 tempest-KeyPairsNegativeTestJSON-716818897 tempest-KeyPairsNegativeTestJSON-716818897-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.057179 Apr 16 21:17:28.935595 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1623/3108] 10.222.0.20 () {60 vars in 1157 bytes} [Sat Apr 16 21:17:28 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 58 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Apr 16 21:17:28.940940 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9a3cf68b-bb57-40ab-91a6-5bb9d8009689 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:28.942560 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9a3cf68b-bb57-40ab-91a6-5bb9d8009689 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:28.949511 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a3cf68b-bb57-40ab-91a6-5bb9d8009689 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:28.949858 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a3cf68b-bb57-40ab-91a6-5bb9d8009689 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:28.950712 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a3cf68b-bb57-40ab-91a6-5bb9d8009689 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:28.951438 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a3cf68b-bb57-40ab-91a6-5bb9d8009689 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:29.144010 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4ab998d2-65d5-4600-a378-9b7e7c744161 tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-group-rules/4b44e006-cc1c-404e-8db0-8185d2cf0dc1" status: 202 len: 0 microversion: 2.1 time: 0.357530 Apr 16 21:17:29.144774 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1486/3109] 10.222.0.20 () {58 vars in 1286 bytes} [Sat Apr 16 21:17:28 2022] DELETE /compute/v2.1/os-security-group-rules/4b44e006-cc1c-404e-8db0-8185d2cf0dc1 => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:17:29.146535 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9a3cf68b-bb57-40ab-91a6-5bb9d8009689 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:29.152333 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-27c6228d-3e1a-4e08-afa8-3b0888819d5b req-2faac339-cc1a-4f32-9f4e-7948ff7f1dd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbcf087b-c508-46e9-a546-99b764daddbb", "name": "network-vif-unplugged", "status": "completed", "tag": "c077f313-2701-4802-bf5a-28338c745ec4"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:29.157578 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9a3cf68b-bb57-40ab-91a6-5bb9d8009689 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1662 microversion: 2.1 time: 0.220534 Apr 16 21:17:29.158212 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1624/3110] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:28 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1662 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:29.171271 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-27c6228d-3e1a-4e08-afa8-3b0888819d5b req-2faac339-cc1a-4f32-9f4e-7948ff7f1dd8 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:29.171858 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8a1b673a-568a-4e77-94e3-f31cd0cea556 tempest-KeyPairsNegativeTestJSON-716818897 tempest-KeyPairsNegativeTestJSON-716818897-project] Action: 'create', calling method: .version_select at 0x7fbb95933ee0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:29.172535 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-27c6228d-3e1a-4e08-afa8-3b0888819d5b req-2faac339-cc1a-4f32-9f4e-7948ff7f1dd8 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:29.173555 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8a1b673a-568a-4e77-94e3-f31cd0cea556 tempest-KeyPairsNegativeTestJSON-716818897 tempest-KeyPairsNegativeTestJSON-716818897-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:17:29.174442 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8a1b673a-568a-4e77-94e3-f31cd0cea556 tempest-KeyPairsNegativeTestJSON-716818897 tempest-KeyPairsNegativeTestJSON-716818897-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.013940 Apr 16 21:17:29.176331 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1625/3111] 10.222.0.20 () {60 vars in 1158 bytes} [Sat Apr 16 21:17:29 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:17:29.182676 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2daab28a-9e4c-40d0-951e-fbc27ca07af1 tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] Action: 'create', calling method: .version_select at 0x7fbb95934670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1254445640", "description": "tempest-description-1539580248"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:29.210825 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-27c6228d-3e1a-4e08-afa8-3b0888819d5b req-2faac339-cc1a-4f32-9f4e-7948ff7f1dd8 service nova] Creating event network-vif-unplugged:c077f313-2701-4802-bf5a-28338c745ec4 for instance cbcf087b-c508-46e9-a546-99b764daddbb on nch1-master-1 Apr 16 21:17:29.221425 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-27c6228d-3e1a-4e08-afa8-3b0888819d5b req-2faac339-cc1a-4f32-9f4e-7948ff7f1dd8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071588 Apr 16 21:17:29.222499 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1487/3112] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:17:29.229789 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d8f2f3b0-c2ea-494c-bbfa-ce46c2251518 tempest-KeyPairsNegativeTestJSON-716818897 tempest-KeyPairsNegativeTestJSON-716818897-project] Action: 'create', calling method: .version_select at 0x7fbb95835820>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-816743408", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:29.246672 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-d8f2f3b0-c2ea-494c-bbfa-ce46c2251518 tempest-KeyPairsNegativeTestJSON-716818897 tempest-KeyPairsNegativeTestJSON-716818897-project] Getting quotas for project 17d036a334dd4557b7ba23fa2419f3cd. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:17:29.252953 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-d8f2f3b0-c2ea-494c-bbfa-ce46c2251518 tempest-KeyPairsNegativeTestJSON-716818897 tempest-KeyPairsNegativeTestJSON-716818897-project] Getting quotas for user 117dae107bdd41a1b0202ab40080d230 and project 17d036a334dd4557b7ba23fa2419f3cd. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:17:29.284414 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-d8f2f3b0-c2ea-494c-bbfa-ce46c2251518 tempest-KeyPairsNegativeTestJSON-716818897 tempest-KeyPairsNegativeTestJSON-716818897-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Apr 16 21:17:29.285067 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d8f2f3b0-c2ea-494c-bbfa-ce46c2251518 tempest-KeyPairsNegativeTestJSON-716818897 tempest-KeyPairsNegativeTestJSON-716818897-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:17:29.286287 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d8f2f3b0-c2ea-494c-bbfa-ce46c2251518 tempest-KeyPairsNegativeTestJSON-716818897 tempest-KeyPairsNegativeTestJSON-716818897-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.062386 Apr 16 21:17:29.287054 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1488/3113] 10.222.0.20 () {60 vars in 1158 bytes} [Sat Apr 16 21:17:29 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 64 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Apr 16 21:17:29.297606 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-724fbe27-57c1-4f23-a375-6b620cb243bb tempest-KeyPairsNegativeTestJSON-716818897 tempest-KeyPairsNegativeTestJSON-716818897-project] Calling method '.version_select at 0x7fbb958604c0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:29.309697 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-724fbe27-57c1-4f23-a375-6b620cb243bb tempest-KeyPairsNegativeTestJSON-716818897 tempest-KeyPairsNegativeTestJSON-716818897-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-1327688830 not found for user 117dae107bdd41a1b0202ab40080d230 Apr 16 21:17:29.310660 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-724fbe27-57c1-4f23-a375-6b620cb243bb tempest-KeyPairsNegativeTestJSON-716818897 tempest-KeyPairsNegativeTestJSON-716818897-project] Returning 404 to user: Keypair tempest-keypair-non-existent-1327688830 not found for user 117dae107bdd41a1b0202ab40080d230 {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:17:29.311165 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-724fbe27-57c1-4f23-a375-6b620cb243bb tempest-KeyPairsNegativeTestJSON-716818897 tempest-KeyPairsNegativeTestJSON-716818897-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1327688830" status: 404 len: 145 microversion: 2.1 time: 0.017723 Apr 16 21:17:29.317043 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1489/3114] 10.222.0.20 () {58 vars in 1259 bytes} [Sat Apr 16 21:17:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-1327688830 => generated 145 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:17:29.510877 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-00e57159-8891-496c-9d0c-a281e03ba25e tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1665803314", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "006efeff-f11c-4209-8816-f1fa1acf7fed"}], "security_groups": [{"name": "tempest-securitygroup--607996063"}], "key_name": "tempest-keypair-1637182820", "user_data": "}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:29.622441 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-00e57159-8891-496c-9d0c-a281e03ba25e tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] validate_networks() for [('006efeff-f11c-4209-8816-f1fa1acf7fed', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:17:29.757048 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2daab28a-9e4c-40d0-951e-fbc27ca07af1 tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.578801 Apr 16 21:17:29.757636 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1626/3115] 10.222.0.20 () {60 vars in 1179 bytes} [Sat Apr 16 21:17:29 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:17:29.763645 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3aa29aaf-d7e6-441a-9a75-552e56fbbf5c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:29.763645 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3aa29aaf-d7e6-441a-9a75-552e56fbbf5c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:29.773526 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3aa29aaf-d7e6-441a-9a75-552e56fbbf5c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:29.774197 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3aa29aaf-d7e6-441a-9a75-552e56fbbf5c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:29.774884 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3aa29aaf-d7e6-441a-9a75-552e56fbbf5c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:29.775327 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3aa29aaf-d7e6-441a-9a75-552e56fbbf5c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:30.033051 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3aa29aaf-d7e6-441a-9a75-552e56fbbf5c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:30.042212 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3aa29aaf-d7e6-441a-9a75-552e56fbbf5c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1527 microversion: 2.1 time: 0.283328 Apr 16 21:17:30.055040 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1627/3116] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:29 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1527 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:30.060403 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e244d916-947f-40fe-adb4-31b2b26bb46b tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] Action: 'create', calling method: .version_select at 0x7fbb95978280>, body: {"security_group_rule": {"parent_group_id": "8f278b55-a402-42ca-9089-b6c5590c16e0", "ip_protocol": "tcp", "from_port": 327089227, "to_port": 22}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:30.218388 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-e244d916-947f-40fe-adb4-31b2b26bb46b tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] HTTP exception thrown: Invalid port range 327089227:22. Former value cannot be greater than the later Apr 16 21:17:30.219201 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e244d916-947f-40fe-adb4-31b2b26bb46b tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] Returning 400 to user: Invalid port range 327089227:22. Former value cannot be greater than the later {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:17:30.220128 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e244d916-947f-40fe-adb4-31b2b26bb46b tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.163795 Apr 16 21:17:30.225089 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1628/3117] 10.222.0.20 () {60 vars in 1194 bytes} [Sat Apr 16 21:17:30 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 165 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:17:30.228516 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-93be8b68-32af-4ace-84cc-5191ac66c5df tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:30.229441 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-93be8b68-32af-4ace-84cc-5191ac66c5df tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] [instance: 0ba3ff1f-0ee1-4dba-8354-10aaef694161] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:30.238868 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-93be8b68-32af-4ace-84cc-5191ac66c5df tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:30.239619 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-93be8b68-32af-4ace-84cc-5191ac66c5df tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:30.240675 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-93be8b68-32af-4ace-84cc-5191ac66c5df tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:30.241170 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-93be8b68-32af-4ace-84cc-5191ac66c5df tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:30.320196 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-00e57159-8891-496c-9d0c-a281e03ba25e tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:17:30.320898 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-00e57159-8891-496c-9d0c-a281e03ba25e tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:17:30.321608 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-00e57159-8891-496c-9d0c-a281e03ba25e tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:17:30.322593 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-00e57159-8891-496c-9d0c-a281e03ba25e tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:17:30.323194 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-00e57159-8891-496c-9d0c-a281e03ba25e tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:17:30.324902 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-93be8b68-32af-4ace-84cc-5191ac66c5df tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484bca4e32554ed4af061012f30666ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79f0fe4726d4abcbdc2672a15f709f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:30.335219 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-00e57159-8891-496c-9d0c-a281e03ba25e tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:30.335891 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-00e57159-8891-496c-9d0c-a281e03ba25e tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:30.336773 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-93be8b68-32af-4ace-84cc-5191ac66c5df tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161" status: 200 len: 1275 microversion: 2.1 time: 0.113893 Apr 16 21:17:30.336875 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-00e57159-8891-496c-9d0c-a281e03ba25e tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:30.337384 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1629/3118] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:30 2022] GET /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161 => generated 1275 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:30.337497 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-00e57159-8891-496c-9d0c-a281e03ba25e tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:30.343787 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9500eb88-f751-4509-a1d4-b8425bf7042d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:30.344602 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9500eb88-f751-4509-a1d4-b8425bf7042d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:30.350648 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9500eb88-f751-4509-a1d4-b8425bf7042d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:30.355836 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9500eb88-f751-4509-a1d4-b8425bf7042d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:30.355836 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9500eb88-f751-4509-a1d4-b8425bf7042d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:30.355836 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9500eb88-f751-4509-a1d4-b8425bf7042d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:30.357663 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-00e57159-8891-496c-9d0c-a281e03ba25e tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Getting quotas for project ff01c614d0ea4275b713b7e872342151. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:17:30.362963 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-00e57159-8891-496c-9d0c-a281e03ba25e tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Getting quotas for user 929bcf59f4fb4eb7a8b76809cce91e6e and project ff01c614d0ea4275b713b7e872342151. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:17:30.377849 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-00e57159-8891-496c-9d0c-a281e03ba25e tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:17:30.380336 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-00e57159-8891-496c-9d0c-a281e03ba25e tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:17:30.526566 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-00e57159-8891-496c-9d0c-a281e03ba25e tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.019256 Apr 16 21:17:30.530678 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1490/3119] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:17:29 2022] POST /compute/v2.1/servers => generated 408 bytes in 1025 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 16 21:17:30.542661 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d86040a1-6dd9-484e-8842-cc50ffc0725f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:30.543115 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d86040a1-6dd9-484e-8842-cc50ffc0725f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:30.555501 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d86040a1-6dd9-484e-8842-cc50ffc0725f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:30.555501 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d86040a1-6dd9-484e-8842-cc50ffc0725f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:30.555501 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d86040a1-6dd9-484e-8842-cc50ffc0725f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:30.555501 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d86040a1-6dd9-484e-8842-cc50ffc0725f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:30.728029 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9500eb88-f751-4509-a1d4-b8425bf7042d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:30.738133 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9500eb88-f751-4509-a1d4-b8425bf7042d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1527 microversion: 2.1 time: 0.399637 Apr 16 21:17:30.738724 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1630/3120] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:30 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1527 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:30.746332 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d524c551-764a-46ca-b73a-bac82ff71741 tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] Action: 'create', calling method: .version_select at 0x7fbb95978550>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-928741637", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:30.751806 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-d524c551-764a-46ca-b73a-bac82ff71741 tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] HTTP exception thrown: Security group id should be uuid Apr 16 21:17:30.755105 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d524c551-764a-46ca-b73a-bac82ff71741 tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] Returning 400 to user: Security group id should be uuid {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:17:30.773965 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d524c551-764a-46ca-b73a-bac82ff71741 tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.017380 Apr 16 21:17:30.781926 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1631/3121] 10.222.0.20 () {60 vars in 1194 bytes} [Sat Apr 16 21:17:30 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Apr 16 21:17:30.786916 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-43853a5f-0de6-4542-8c10-427f9e5148de tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:30.787538 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-43853a5f-0de6-4542-8c10-427f9e5148de tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:30.800696 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d86040a1-6dd9-484e-8842-cc50ffc0725f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:30.814934 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d86040a1-6dd9-484e-8842-cc50ffc0725f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.282746 Apr 16 21:17:30.817130 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1491/3122] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:30 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:30.832111 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f9f4e913-ab36-40ee-b806-6231dfa63597 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:30.833506 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:17:30.833506 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:17:30.842054 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-f9f4e913-ab36-40ee-b806-6231dfa63597 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] HTTP exception thrown: Flavor f61f5a90-0fc1-43f4-8519-4c36f67a4a60 could not be found. Apr 16 21:17:30.853196 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f9f4e913-ab36-40ee-b806-6231dfa63597 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Returning 404 to user: Flavor f61f5a90-0fc1-43f4-8519-4c36f67a4a60 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:17:30.854218 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f9f4e913-ab36-40ee-b806-6231dfa63597 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/f61f5a90-0fc1-43f4-8519-4c36f67a4a60" status: 404 len: 109 microversion: 2.1 time: 0.035841 Apr 16 21:17:30.858449 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1492/3123] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:17:30 2022] DELETE /compute/v2.1/flavors/f61f5a90-0fc1-43f4-8519-4c36f67a4a60 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:17:30.868143 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f5f260f2-8eaf-4093-bf5d-928db09ffd1a tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] Action: 'create', calling method: .version_select at 0x7fbb958359d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-728648872", "description": "tempest-description-1555673499"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:30.951890 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-43853a5f-0de6-4542-8c10-427f9e5148de tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:30.962050 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-43853a5f-0de6-4542-8c10-427f9e5148de tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09" status: 200 len: 1246 microversion: 2.1 time: 0.178829 Apr 16 21:17:30.962989 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1632/3124] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:30 2022] GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09 => generated 1246 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:30.976815 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5381a6b3-6a22-4c91-b35b-c17b5a091d84 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:30.977898 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5381a6b3-6a22-4c91-b35b-c17b5a091d84 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:30.993429 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5381a6b3-6a22-4c91-b35b-c17b5a091d84 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:30.993894 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5381a6b3-6a22-4c91-b35b-c17b5a091d84 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:30.994749 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5381a6b3-6a22-4c91-b35b-c17b5a091d84 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:30.995197 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5381a6b3-6a22-4c91-b35b-c17b5a091d84 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:31.234182 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5381a6b3-6a22-4c91-b35b-c17b5a091d84 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:31.242924 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5381a6b3-6a22-4c91-b35b-c17b5a091d84 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.277573 Apr 16 21:17:31.243777 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1633/3125] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:30 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:31.253940 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-af78aca1-e4b8-47c4-80cc-f5277e6f4201 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2139237347", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:31.328987 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-af78aca1-e4b8-47c4-80cc-f5277e6f4201 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] validate_networks() for None {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:17:31.360248 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f5f260f2-8eaf-4093-bf5d-928db09ffd1a tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.504024 Apr 16 21:17:31.360741 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1493/3126] 10.222.0.20 () {60 vars in 1179 bytes} [Sat Apr 16 21:17:30 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:17:31.367812 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b6dc98d3-61ce-4065-8cfa-8544cb6c47af tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:31.367812 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b6dc98d3-61ce-4065-8cfa-8544cb6c47af tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:31.374506 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b6dc98d3-61ce-4065-8cfa-8544cb6c47af tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:31.375150 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b6dc98d3-61ce-4065-8cfa-8544cb6c47af tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:31.376281 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b6dc98d3-61ce-4065-8cfa-8544cb6c47af tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:31.376909 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b6dc98d3-61ce-4065-8cfa-8544cb6c47af tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:31.728234 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b6dc98d3-61ce-4065-8cfa-8544cb6c47af tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:31.736869 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b6dc98d3-61ce-4065-8cfa-8544cb6c47af tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.374861 Apr 16 21:17:31.737304 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1494/3127] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:31 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:31.754467 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9f65a15e-73ca-4c36-ac1f-c17800f2e95d tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:31.755264 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9f65a15e-73ca-4c36-ac1f-c17800f2e95d tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] [instance: 0ba3ff1f-0ee1-4dba-8354-10aaef694161] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:31.755699 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-af78aca1-e4b8-47c4-80cc-f5277e6f4201 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:17:31.756143 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-af78aca1-e4b8-47c4-80cc-f5277e6f4201 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:17:31.756820 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-af78aca1-e4b8-47c4-80cc-f5277e6f4201 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:17:31.757438 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-af78aca1-e4b8-47c4-80cc-f5277e6f4201 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:17:31.757874 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-af78aca1-e4b8-47c4-80cc-f5277e6f4201 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:17:31.762137 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9f65a15e-73ca-4c36-ac1f-c17800f2e95d tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:31.762761 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9f65a15e-73ca-4c36-ac1f-c17800f2e95d tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:31.763546 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9f65a15e-73ca-4c36-ac1f-c17800f2e95d tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:31.763988 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9f65a15e-73ca-4c36-ac1f-c17800f2e95d tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:31.769363 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-af78aca1-e4b8-47c4-80cc-f5277e6f4201 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:31.770035 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-af78aca1-e4b8-47c4-80cc-f5277e6f4201 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:31.770922 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-af78aca1-e4b8-47c4-80cc-f5277e6f4201 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:31.771370 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-af78aca1-e4b8-47c4-80cc-f5277e6f4201 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:31.790503 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-af78aca1-e4b8-47c4-80cc-f5277e6f4201 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Getting quotas for project 29fd420ef9134715bd3a9f2467d924cd. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:17:31.796018 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-af78aca1-e4b8-47c4-80cc-f5277e6f4201 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Getting quotas for user d17cad39fa38448eb9827605871463a3 and project 29fd420ef9134715bd3a9f2467d924cd. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:17:31.814952 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-af78aca1-e4b8-47c4-80cc-f5277e6f4201 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:17:31.819790 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-af78aca1-e4b8-47c4-80cc-f5277e6f4201 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:17:31.990560 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-af78aca1-e4b8-47c4-80cc-f5277e6f4201 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.745388 Apr 16 21:17:31.992404 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1634/3128] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:17:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:17:31.998044 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1585fd46-ebe0-491b-9081-74047342855a tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] Action: 'create', calling method: .version_select at 0x7fbb959515e0>, body: {"security_group_rule": {"parent_group_id": "73de52a5-edc9-4871-8c88-6a779fbb8c54", "ip_protocol": "tempest-999-1874098013", "from_port": 22, "to_port": 22}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:32.377879 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9f65a15e-73ca-4c36-ac1f-c17800f2e95d tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484bca4e32554ed4af061012f30666ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79f0fe4726d4abcbdc2672a15f709f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:32.393154 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9f65a15e-73ca-4c36-ac1f-c17800f2e95d tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161" status: 200 len: 1317 microversion: 2.1 time: 0.643485 Apr 16 21:17:32.395434 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1495/3129] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:31 2022] GET /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161 => generated 1317 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:32.403326 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-40d46b22-c4a8-4169-adff-9f84b36cb242 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:32.404766 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-40d46b22-c4a8-4169-adff-9f84b36cb242 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:32.415338 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-40d46b22-c4a8-4169-adff-9f84b36cb242 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:32.416704 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-40d46b22-c4a8-4169-adff-9f84b36cb242 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:32.418003 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-40d46b22-c4a8-4169-adff-9f84b36cb242 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:32.418905 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-40d46b22-c4a8-4169-adff-9f84b36cb242 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:32.524862 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-1585fd46-ebe0-491b-9081-74047342855a tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] HTTP exception thrown: Invalid IP protocol tempest-999-1874098013. Apr 16 21:17:32.525857 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1585fd46-ebe0-491b-9081-74047342855a tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] Returning 400 to user: Invalid IP protocol tempest-999-1874098013. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:17:32.527450 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1585fd46-ebe0-491b-9081-74047342855a tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.533854 Apr 16 21:17:32.528128 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1635/3130] 10.222.0.20 () {60 vars in 1194 bytes} [Sat Apr 16 21:17:31 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 535 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Apr 16 21:17:32.538687 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-67d86371-8fc7-4b5b-a26f-ce3f721980d3 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:32.540137 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-67d86371-8fc7-4b5b-a26f-ce3f721980d3 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:32.546527 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-67d86371-8fc7-4b5b-a26f-ce3f721980d3 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:32.546995 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-67d86371-8fc7-4b5b-a26f-ce3f721980d3 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:32.547843 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-67d86371-8fc7-4b5b-a26f-ce3f721980d3 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:32.548473 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-67d86371-8fc7-4b5b-a26f-ce3f721980d3 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:32.609265 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-40d46b22-c4a8-4169-adff-9f84b36cb242 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:32.633840 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-40d46b22-c4a8-4169-adff-9f84b36cb242 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.237054 Apr 16 21:17:32.645975 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1496/3131] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:32 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:32.651633 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-98e92c26-0b52-4fb5-bc77-b3c9780fc1ca tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:32.652455 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-98e92c26-0b52-4fb5-bc77-b3c9780fc1ca tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:32.686555 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-67d86371-8fc7-4b5b-a26f-ce3f721980d3 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:32.696746 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-67d86371-8fc7-4b5b-a26f-ce3f721980d3 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09" status: 200 len: 1250 microversion: 2.1 time: 0.162320 Apr 16 21:17:32.697487 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1636/3132] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:32 2022] GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09 => generated 1250 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:32.703255 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9316240c-226f-420c-8052-d943e2fa3070 tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] Action: 'create', calling method: .version_select at 0x7fbb95934a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1686246683", "description": "tempest-description-1129230205"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:32.797862 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-98e92c26-0b52-4fb5-bc77-b3c9780fc1ca tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:32.809127 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-98e92c26-0b52-4fb5-bc77-b3c9780fc1ca tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1213 microversion: 2.1 time: 0.161791 Apr 16 21:17:32.809705 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1497/3133] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:32 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1213 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:32.819651 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-250898f2-341d-4028-8ae7-42eb74266895 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:32.821900 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-250898f2-341d-4028-8ae7-42eb74266895 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:32.828297 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-250898f2-341d-4028-8ae7-42eb74266895 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:32.830999 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-250898f2-341d-4028-8ae7-42eb74266895 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:32.830999 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-250898f2-341d-4028-8ae7-42eb74266895 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:32.830999 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-250898f2-341d-4028-8ae7-42eb74266895 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:33.153726 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-250898f2-341d-4028-8ae7-42eb74266895 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:33.174424 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-250898f2-341d-4028-8ae7-42eb74266895 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.358699 Apr 16 21:17:33.175095 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1498/3134] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:32 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:33.249229 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9316240c-226f-420c-8052-d943e2fa3070 tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.549762 Apr 16 21:17:33.256884 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1637/3135] 10.222.0.20 () {60 vars in 1179 bytes} [Sat Apr 16 21:17:32 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:17:33.259088 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-e9aac280-84f3-404b-9d0b-f3f743fb261b req-db2d5363-1d92-47ac-a1e7-3e3cb7237176 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbcf087b-c508-46e9-a546-99b764daddbb", "name": "network-vif-plugged", "status": "completed", "tag": "c077f313-2701-4802-bf5a-28338c745ec4"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:33.285474 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-e9aac280-84f3-404b-9d0b-f3f743fb261b req-db2d5363-1d92-47ac-a1e7-3e3cb7237176 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:33.285474 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-e9aac280-84f3-404b-9d0b-f3f743fb261b req-db2d5363-1d92-47ac-a1e7-3e3cb7237176 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:33.323329 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-e9aac280-84f3-404b-9d0b-f3f743fb261b req-db2d5363-1d92-47ac-a1e7-3e3cb7237176 service nova] Creating event network-vif-plugged:c077f313-2701-4802-bf5a-28338c745ec4 for instance cbcf087b-c508-46e9-a546-99b764daddbb on nch1-master-1 Apr 16 21:17:33.330385 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-e9aac280-84f3-404b-9d0b-f3f743fb261b req-db2d5363-1d92-47ac-a1e7-3e3cb7237176 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076470 Apr 16 21:17:33.335356 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1638/3136] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:17:33.347241 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-79e7af1c-f990-4cd8-96eb-7c221a497bc7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:33.348040 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-79e7af1c-f990-4cd8-96eb-7c221a497bc7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:33.359944 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-79e7af1c-f990-4cd8-96eb-7c221a497bc7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:33.361796 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-79e7af1c-f990-4cd8-96eb-7c221a497bc7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:33.362638 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-79e7af1c-f990-4cd8-96eb-7c221a497bc7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:33.363093 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-79e7af1c-f990-4cd8-96eb-7c221a497bc7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:33.401085 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-291dba70-9317-4c1d-9a7c-f2bf96cc2b68 req-b81c822c-b081-41e2-bc6f-d572275e3a06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523", "tag": "0eab5a77-408a-45d7-86ff-b5c0a4b550d1"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:33.432849 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-291dba70-9317-4c1d-9a7c-f2bf96cc2b68 req-b81c822c-b081-41e2-bc6f-d572275e3a06 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:33.433519 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-291dba70-9317-4c1d-9a7c-f2bf96cc2b68 req-b81c822c-b081-41e2-bc6f-d572275e3a06 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:33.448125 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-291dba70-9317-4c1d-9a7c-f2bf96cc2b68 req-b81c822c-b081-41e2-bc6f-d572275e3a06 service nova] Creating event network-changed:0eab5a77-408a-45d7-86ff-b5c0a4b550d1 for instance 9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523 on nch2-master-1 Apr 16 21:17:33.453062 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-291dba70-9317-4c1d-9a7c-f2bf96cc2b68 req-b81c822c-b081-41e2-bc6f-d572275e3a06 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.265059 Apr 16 21:17:33.454168 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1499/3137] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:17:33.461377 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-103772f9-e4bc-4e27-befa-6c24d1ac06c7 tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] Action: 'create', calling method: .version_select at 0x7fbb95808f70>, body: {"security_group_rule": {"parent_group_id": "31e4f60e-9fcd-4d82-9ebc-d6d0b3a254cb", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:33.636305 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-79e7af1c-f990-4cd8-96eb-7c221a497bc7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:33.640467 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-103772f9-e4bc-4e27-befa-6c24d1ac06c7 tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Apr 16 21:17:33.644070 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-103772f9-e4bc-4e27-befa-6c24d1ac06c7 tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:17:33.644070 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-103772f9-e4bc-4e27-befa-6c24d1ac06c7 tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.185373 Apr 16 21:17:33.647398 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-79e7af1c-f990-4cd8-96eb-7c221a497bc7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.307598 Apr 16 21:17:33.647542 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1500/3138] 10.222.0.20 () {60 vars in 1194 bytes} [Sat Apr 16 21:17:33 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 193 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:17:33.648009 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1639/3139] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:33 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:33.661975 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-29c2595e-0c03-4449-91a6-937c86b32342 req-51e6838b-5f05-4638-bf2c-f95d6076094d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ba3ff1f-0ee1-4dba-8354-10aaef694161", "tag": "da205378-8574-416e-8ccf-7ec5bb2d4541"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:33.669055 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9bcfc522-36a7-467e-b108-3dd86777b6df tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:33.669808 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9bcfc522-36a7-467e-b108-3dd86777b6df tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] [instance: 0ba3ff1f-0ee1-4dba-8354-10aaef694161] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:33.676489 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-29c2595e-0c03-4449-91a6-937c86b32342 req-51e6838b-5f05-4638-bf2c-f95d6076094d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:33.677134 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-29c2595e-0c03-4449-91a6-937c86b32342 req-51e6838b-5f05-4638-bf2c-f95d6076094d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:33.680654 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9bcfc522-36a7-467e-b108-3dd86777b6df tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:33.681921 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9bcfc522-36a7-467e-b108-3dd86777b6df tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:33.683759 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9bcfc522-36a7-467e-b108-3dd86777b6df tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:33.684420 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9bcfc522-36a7-467e-b108-3dd86777b6df tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:33.706249 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-29c2595e-0c03-4449-91a6-937c86b32342 req-51e6838b-5f05-4638-bf2c-f95d6076094d service nova] Creating event network-changed:da205378-8574-416e-8ccf-7ec5bb2d4541 for instance 0ba3ff1f-0ee1-4dba-8354-10aaef694161 on nch2-master-1 Apr 16 21:17:33.711721 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-29c2595e-0c03-4449-91a6-937c86b32342 req-51e6838b-5f05-4638-bf2c-f95d6076094d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054530 Apr 16 21:17:33.712810 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1640/3140] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:17:33.718973 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-012c406e-707b-42f3-b07a-f559c2dacb8c tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] Action: 'create', calling method: .version_select at 0x7fbb9593d0d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-749597405", "description": "tempest-description-1357684860"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:33.961275 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9bcfc522-36a7-467e-b108-3dd86777b6df tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484bca4e32554ed4af061012f30666ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79f0fe4726d4abcbdc2672a15f709f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:33.969455 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9bcfc522-36a7-467e-b108-3dd86777b6df tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161" status: 200 len: 1317 microversion: 2.1 time: 0.320421 Apr 16 21:17:33.970261 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1501/3141] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:33 2022] GET /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161 => generated 1317 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:33.984490 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-09801440-d759-4e55-80a2-92ec154ee0d8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:33.985145 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-09801440-d759-4e55-80a2-92ec154ee0d8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:33.993208 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-09801440-d759-4e55-80a2-92ec154ee0d8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:33.993675 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-09801440-d759-4e55-80a2-92ec154ee0d8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:33.995154 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-09801440-d759-4e55-80a2-92ec154ee0d8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:33.995615 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-09801440-d759-4e55-80a2-92ec154ee0d8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:34.078366 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-09801440-d759-4e55-80a2-92ec154ee0d8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:34.085833 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-09801440-d759-4e55-80a2-92ec154ee0d8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09" status: 200 len: 1306 microversion: 2.1 time: 0.114138 Apr 16 21:17:34.086402 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1502/3142] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:33 2022] GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09 => generated 1306 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:34.096491 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9f684278-7f96-4a9a-96fb-08c10c990b7a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:34.097413 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9f684278-7f96-4a9a-96fb-08c10c990b7a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:34.117709 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9f684278-7f96-4a9a-96fb-08c10c990b7a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:34.120509 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9f684278-7f96-4a9a-96fb-08c10c990b7a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:34.121665 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9f684278-7f96-4a9a-96fb-08c10c990b7a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:34.122394 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9f684278-7f96-4a9a-96fb-08c10c990b7a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:34.222839 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9f684278-7f96-4a9a-96fb-08c10c990b7a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:34.232121 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9f684278-7f96-4a9a-96fb-08c10c990b7a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1209 microversion: 2.1 time: 0.144644 Apr 16 21:17:34.240240 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1503/3143] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:34 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1209 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:34.240486 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-012c406e-707b-42f3-b07a-f559c2dacb8c tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.522980 Apr 16 21:17:34.240486 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1641/3144] 10.222.0.20 () {60 vars in 1179 bytes} [Sat Apr 16 21:17:33 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:17:34.241836 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-88880ae4-e5ef-4ae7-ac54-b7842d0934fe tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:34.243029 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-88880ae4-e5ef-4ae7-ac54-b7842d0934fe tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] [instance: 58b86589-e35e-4b91-b192-9f744516f66f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:34.249600 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2d7a575e-68d1-4c1b-995e-bb7098fc821b tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] Action: 'create', calling method: .version_select at 0x7fbb959349d0>, body: {"security_group_rule": {"parent_group_id": "be05b7f5-df70-49c6-8204-3afad3f3854e", "ip_protocol": "tcp", "from_port": 22, "to_port": 1276280439}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:34.265250 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-88880ae4-e5ef-4ae7-ac54-b7842d0934fe tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:34.265723 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-88880ae4-e5ef-4ae7-ac54-b7842d0934fe tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:34.266530 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-88880ae4-e5ef-4ae7-ac54-b7842d0934fe tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:34.267553 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-88880ae4-e5ef-4ae7-ac54-b7842d0934fe tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:34.326103 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-88880ae4-e5ef-4ae7-ac54-b7842d0934fe tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] 10.222.0.20 "POST /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f/action" status: 200 len: 24575 microversion: 2.1 time: 0.091518 Apr 16 21:17:34.327251 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1504/3145] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:17:34 2022] POST /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f/action => generated 24575 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:17:34.338083 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-2d7a575e-68d1-4c1b-995e-bb7098fc821b tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] HTTP exception thrown: Invalid port range 22:1276280439. Valid TCP ports should be between 1-65535 Apr 16 21:17:34.338908 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2d7a575e-68d1-4c1b-995e-bb7098fc821b tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] Returning 400 to user: Invalid port range 22:1276280439. Valid TCP ports should be between 1-65535 {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:17:34.339907 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2d7a575e-68d1-4c1b-995e-bb7098fc821b tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.095479 Apr 16 21:17:34.346426 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1642/3146] 10.222.0.20 () {60 vars in 1194 bytes} [Sat Apr 16 21:17:34 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:17:34.352533 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a337a4b9-ece4-477d-962f-4fd76e490bd1 tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] Action: 'create', calling method: .version_select at 0x7fbb9580b820>, body: {"security_group_rule": {"parent_group_id": "8f3c8167-796e-4376-90e9-ea030c2178c0", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:34.353501 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b9a76504-ea0d-49bf-ae35-2a866a0ecf07 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:34.357055 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b9a76504-ea0d-49bf-ae35-2a866a0ecf07 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1a6ff623974d4156a05a7bd3e3b3ed5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840fd4cbe2fd414bb97f14898bf9647d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:34.357827 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b9a76504-ea0d-49bf-ae35-2a866a0ecf07 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Searching by: {'deleted': False, 'project_id': '840fd4cbe2fd414bb97f14898bf9647d'} {{(pid=137408) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:17:34.363358 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b9a76504-ea0d-49bf-ae35-2a866a0ecf07 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:34.364134 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b9a76504-ea0d-49bf-ae35-2a866a0ecf07 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:34.364741 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b9a76504-ea0d-49bf-ae35-2a866a0ecf07 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:34.365336 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b9a76504-ea0d-49bf-ae35-2a866a0ecf07 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:34.390585 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.multi_cell_list [None req-b9a76504-ea0d-49bf-ae35-2a866a0ecf07 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137408) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 16 21:17:34.391777 ncdv-master-1 devstack@n-api.service[137409]: DEBUG neutronclient.v2_0.client [None req-a337a4b9-ece4-477d-962f-4fd76e490bd1 tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8f3c8167-796e-4376-90e9-ea030c2178c0 does not exist", "detail": ""}} {{(pid=137409) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 16 21:17:34.394236 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.security_group_api [None req-a337a4b9-ece4-477d-962f-4fd76e490bd1 tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] Neutron security group 8f3c8167-796e-4376-90e9-ea030c2178c0 not found {{(pid=137409) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 16 21:17:34.394899 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-a337a4b9-ece4-477d-962f-4fd76e490bd1 tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] HTTP exception thrown: Security group 8f3c8167-796e-4376-90e9-ea030c2178c0 does not exist Apr 16 21:17:34.394899 ncdv-master-1 devstack@n-api.service[137409]: Neutron server returns request_ids: ['req-ffc3ca49-bd91-4773-848e-afd5b225af3d'] Apr 16 21:17:34.395734 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a337a4b9-ece4-477d-962f-4fd76e490bd1 tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] Returning 404 to user: Security group 8f3c8167-796e-4376-90e9-ea030c2178c0 does not exist Apr 16 21:17:34.395734 ncdv-master-1 devstack@n-api.service[137409]: Neutron server returns request_ids: ['req-ffc3ca49-bd91-4773-848e-afd5b225af3d'] {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:17:34.396719 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a337a4b9-ece4-477d-962f-4fd76e490bd1 tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.049252 Apr 16 21:17:34.397391 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1505/3147] 10.222.0.20 () {60 vars in 1194 bytes} [Sat Apr 16 21:17:34 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:17:34.410443 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d105456f-d84c-4f93-8432-45ecf93572f6 tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] Calling method '.version_select at 0x7fbb95835a60>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:34.424298 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b9a76504-ea0d-49bf-ae35-2a866a0ecf07 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.076289 Apr 16 21:17:34.425877 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1643/3148] 10.222.0.20 () {58 vars in 1124 bytes} [Sat Apr 16 21:17:34 2022] GET /compute/v2.1/servers => generated 343 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:17:34.435161 ncdv-master-1 devstack@n-api.service[137409]: DEBUG neutronclient.v2_0.client [None req-d105456f-d84c-4f93-8432-45ecf93572f6 tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 48116f88-15bb-4acf-a776-ffb4b7cf1161 does not exist", "detail": ""}} {{(pid=137409) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 16 21:17:34.435826 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.security_group_api [None req-d105456f-d84c-4f93-8432-45ecf93572f6 tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] Neutron security group rule 48116f88-15bb-4acf-a776-ffb4b7cf1161 not found {{(pid=137409) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Apr 16 21:17:34.436273 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d0804289-3644-4b04-8d2a-80affcc00c6b tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:34.436528 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-d105456f-d84c-4f93-8432-45ecf93572f6 tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] HTTP exception thrown: Security group rule 48116f88-15bb-4acf-a776-ffb4b7cf1161 does not exist Apr 16 21:17:34.436528 ncdv-master-1 devstack@n-api.service[137409]: Neutron server returns request_ids: ['req-9f54ced9-9862-4d0f-bbdd-90f0af497d55'] Apr 16 21:17:34.437258 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d105456f-d84c-4f93-8432-45ecf93572f6 tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] Returning 404 to user: Security group rule 48116f88-15bb-4acf-a776-ffb4b7cf1161 does not exist Apr 16 21:17:34.437258 ncdv-master-1 devstack@n-api.service[137409]: Neutron server returns request_ids: ['req-9f54ced9-9862-4d0f-bbdd-90f0af497d55'] {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:17:34.438226 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d105456f-d84c-4f93-8432-45ecf93572f6 tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-group-rules/48116f88-15bb-4acf-a776-ffb4b7cf1161" status: 404 len: 199 microversion: 2.1 time: 0.035086 Apr 16 21:17:34.438872 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1506/3149] 10.222.0.20 () {58 vars in 1286 bytes} [Sat Apr 16 21:17:34 2022] DELETE /compute/v2.1/os-security-group-rules/48116f88-15bb-4acf-a776-ffb4b7cf1161 => generated 199 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:17:34.439532 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d0804289-3644-4b04-8d2a-80affcc00c6b tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1a6ff623974d4156a05a7bd3e3b3ed5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840fd4cbe2fd414bb97f14898bf9647d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:34.440310 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d0804289-3644-4b04-8d2a-80affcc00c6b tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Searching by: {'deleted': False, 'project_id': '840fd4cbe2fd414bb97f14898bf9647d'} {{(pid=137408) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:17:34.447492 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d0804289-3644-4b04-8d2a-80affcc00c6b tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:34.448886 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d0804289-3644-4b04-8d2a-80affcc00c6b tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:34.449010 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d0bc56cd-1ec8-477e-bb0e-31e943e69db9 tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] Calling method '.version_select at 0x7fbb958601f0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:34.449527 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d0804289-3644-4b04-8d2a-80affcc00c6b tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:34.450051 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d0804289-3644-4b04-8d2a-80affcc00c6b tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:34.544949 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.multi_cell_list [None req-d0804289-3644-4b04-8d2a-80affcc00c6b tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137408) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 16 21:17:34.619381 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d0804289-3644-4b04-8d2a-80affcc00c6b tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a6ff623974d4156a05a7bd3e3b3ed5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840fd4cbe2fd414bb97f14898bf9647d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:34.626331 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d0804289-3644-4b04-8d2a-80affcc00c6b tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:34.626788 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d0804289-3644-4b04-8d2a-80affcc00c6b tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:34.772942 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d0804289-3644-4b04-8d2a-80affcc00c6b tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 1604 microversion: 2.1 time: 0.340323 Apr 16 21:17:34.773559 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1644/3150] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:17:34 2022] GET /compute/v2.1/servers/detail => generated 1604 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:17:34.791046 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-60a35077-0c27-4a5a-9735-09b6814089ab tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:34.798938 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-60a35077-0c27-4a5a-9735-09b6814089ab tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012277 Apr 16 21:17:34.799482 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1645/3151] 10.222.0.20 () {58 vars in 1136 bytes} [Sat Apr 16 21:17:34 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:17:34.902969 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d0bc56cd-1ec8-477e-bb0e-31e943e69db9 tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/be05b7f5-df70-49c6-8204-3afad3f3854e" status: 202 len: 0 microversion: 2.1 time: 0.458929 Apr 16 21:17:34.906884 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1507/3152] 10.222.0.20 () {58 vars in 1271 bytes} [Sat Apr 16 21:17:34 2022] DELETE /compute/v2.1/os-security-groups/be05b7f5-df70-49c6-8204-3afad3f3854e => generated 0 bytes in 460 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 16 21:17:34.912331 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d4e20aab-8193-405a-904e-c4f5feaed34f tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] Calling method '.version_select at 0x7fbb959519d0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:34.995535 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b32935ac-bc0e-41d1-871e-a60302c74360 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:34.997210 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b32935ac-bc0e-41d1-871e-a60302c74360 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] [instance: 0ba3ff1f-0ee1-4dba-8354-10aaef694161] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:35.008058 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b32935ac-bc0e-41d1-871e-a60302c74360 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:35.008985 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b32935ac-bc0e-41d1-871e-a60302c74360 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:35.010310 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b32935ac-bc0e-41d1-871e-a60302c74360 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:35.011003 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b32935ac-bc0e-41d1-871e-a60302c74360 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:35.261706 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d4e20aab-8193-405a-904e-c4f5feaed34f tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/31e4f60e-9fcd-4d82-9ebc-d6d0b3a254cb" status: 202 len: 0 microversion: 2.1 time: 0.353222 Apr 16 21:17:35.267073 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1646/3153] 10.222.0.20 () {58 vars in 1271 bytes} [Sat Apr 16 21:17:34 2022] DELETE /compute/v2.1/os-security-groups/31e4f60e-9fcd-4d82-9ebc-d6d0b3a254cb => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:17:35.272807 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bacf8906-be21-4cf7-a504-b0fdc9b0e530 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:35.273753 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-bacf8906-be21-4cf7-a504-b0fdc9b0e530 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:35.291230 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bacf8906-be21-4cf7-a504-b0fdc9b0e530 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:35.292241 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bacf8906-be21-4cf7-a504-b0fdc9b0e530 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:35.293292 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bacf8906-be21-4cf7-a504-b0fdc9b0e530 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:35.295594 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bacf8906-be21-4cf7-a504-b0fdc9b0e530 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:35.452006 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b32935ac-bc0e-41d1-871e-a60302c74360 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484bca4e32554ed4af061012f30666ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79f0fe4726d4abcbdc2672a15f709f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:35.461195 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b32935ac-bc0e-41d1-871e-a60302c74360 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161" status: 200 len: 1317 microversion: 2.1 time: 0.475966 Apr 16 21:17:35.462461 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1508/3154] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:34 2022] GET /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161 => generated 1317 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:35.467517 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c08bdc16-75dd-4b15-8bdd-26c20a38a12e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:35.468496 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c08bdc16-75dd-4b15-8bdd-26c20a38a12e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:35.476307 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-bacf8906-be21-4cf7-a504-b0fdc9b0e530 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:35.476610 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c08bdc16-75dd-4b15-8bdd-26c20a38a12e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:35.477450 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c08bdc16-75dd-4b15-8bdd-26c20a38a12e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:35.480544 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c08bdc16-75dd-4b15-8bdd-26c20a38a12e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:35.481274 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c08bdc16-75dd-4b15-8bdd-26c20a38a12e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:35.485228 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-bacf8906-be21-4cf7-a504-b0fdc9b0e530 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09" status: 200 len: 1371 microversion: 2.1 time: 0.216861 Apr 16 21:17:35.486059 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1647/3155] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:35 2022] GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09 => generated 1371 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:35.492140 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1cd332c2-be30-429c-a5e7-27866bb3c8e6 tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] Calling method '.version_select at 0x7fbb959e9a60>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:35.590767 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c08bdc16-75dd-4b15-8bdd-26c20a38a12e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:35.598709 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c08bdc16-75dd-4b15-8bdd-26c20a38a12e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1271 microversion: 2.1 time: 0.134858 Apr 16 21:17:35.599686 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1509/3156] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:35 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1271 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:35.774328 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1cd332c2-be30-429c-a5e7-27866bb3c8e6 tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/73de52a5-edc9-4871-8c88-6a779fbb8c54" status: 202 len: 0 microversion: 2.1 time: 0.286556 Apr 16 21:17:35.775135 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1648/3157] 10.222.0.20 () {58 vars in 1271 bytes} [Sat Apr 16 21:17:35 2022] DELETE /compute/v2.1/os-security-groups/73de52a5-edc9-4871-8c88-6a779fbb8c54 => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:17:35.784475 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-eb0aab1d-0bb5-4214-82f5-04cc9ade821b tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] Calling method '.version_select at 0x7fbb9586e700>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:36.481197 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c6d1b2fb-81b2-4d2e-b422-5fdb5d223a29 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:36.481863 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c6d1b2fb-81b2-4d2e-b422-5fdb5d223a29 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] [instance: 0ba3ff1f-0ee1-4dba-8354-10aaef694161] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:36.492401 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c6d1b2fb-81b2-4d2e-b422-5fdb5d223a29 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:36.492929 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c6d1b2fb-81b2-4d2e-b422-5fdb5d223a29 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:36.493771 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c6d1b2fb-81b2-4d2e-b422-5fdb5d223a29 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:36.494227 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c6d1b2fb-81b2-4d2e-b422-5fdb5d223a29 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:36.721457 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c6d1b2fb-81b2-4d2e-b422-5fdb5d223a29 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484bca4e32554ed4af061012f30666ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79f0fe4726d4abcbdc2672a15f709f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:36.732327 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c6d1b2fb-81b2-4d2e-b422-5fdb5d223a29 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161" status: 200 len: 1317 microversion: 2.1 time: 0.257001 Apr 16 21:17:36.732817 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1649/3158] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:36 2022] GET /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161 => generated 1317 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:36.739763 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8bf939e0-870c-4cc7-8ee6-2cce725988dd tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:36.741120 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8bf939e0-870c-4cc7-8ee6-2cce725988dd tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:36.748812 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8bf939e0-870c-4cc7-8ee6-2cce725988dd tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:36.749489 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8bf939e0-870c-4cc7-8ee6-2cce725988dd tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:36.750437 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8bf939e0-870c-4cc7-8ee6-2cce725988dd tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:36.751024 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8bf939e0-870c-4cc7-8ee6-2cce725988dd tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:36.958811 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8bf939e0-870c-4cc7-8ee6-2cce725988dd tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:36.969598 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8bf939e0-870c-4cc7-8ee6-2cce725988dd tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09" status: 200 len: 1371 microversion: 2.1 time: 0.235034 Apr 16 21:17:36.983196 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1650/3159] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:36 2022] GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09 => generated 1371 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:36.989974 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-74edefea-3e61-44bb-912d-525e7d4fa68b tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:36.993332 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-74edefea-3e61-44bb-912d-525e7d4fa68b tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:37.006593 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-74edefea-3e61-44bb-912d-525e7d4fa68b tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:37.007460 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-74edefea-3e61-44bb-912d-525e7d4fa68b tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:37.008481 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-74edefea-3e61-44bb-912d-525e7d4fa68b tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:37.009071 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-74edefea-3e61-44bb-912d-525e7d4fa68b tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:37.090070 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-74edefea-3e61-44bb-912d-525e7d4fa68b tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:37.099285 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-74edefea-3e61-44bb-912d-525e7d4fa68b tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1271 microversion: 2.1 time: 0.114856 Apr 16 21:17:37.110510 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1651/3160] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:36 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1271 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:37.140867 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-eb0aab1d-0bb5-4214-82f5-04cc9ade821b tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/8f278b55-a402-42ca-9089-b6c5590c16e0" status: 202 len: 0 microversion: 2.1 time: 1.358145 Apr 16 21:17:37.141503 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1510/3161] 10.222.0.20 () {58 vars in 1271 bytes} [Sat Apr 16 21:17:35 2022] DELETE /compute/v2.1/os-security-groups/8f278b55-a402-42ca-9089-b6c5590c16e0 => generated 0 bytes in 1363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:17:37.160606 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-eb49ec52-0a64-4b8f-9ad6-92f2d5f5c5bf tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] Calling method '.version_select at 0x7fbb959b9280>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:37.484622 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-eb49ec52-0a64-4b8f-9ad6-92f2d5f5c5bf tempest-SecurityGroupRulesNegativeTestJSON-978614951 tempest-SecurityGroupRulesNegativeTestJSON-978614951-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/dd068948-fd7f-4b27-a4d2-ae6b9d6879cd" status: 202 len: 0 microversion: 2.1 time: 0.335202 Apr 16 21:17:37.486922 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1652/3162] 10.222.0.20 () {58 vars in 1271 bytes} [Sat Apr 16 21:17:37 2022] DELETE /compute/v2.1/os-security-groups/dd068948-fd7f-4b27-a4d2-ae6b9d6879cd => generated 0 bytes in 339 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:17:37.749390 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-74fb2044-54bd-4438-b233-7b0cb6cb9ab8 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:37.750019 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-74fb2044-54bd-4438-b233-7b0cb6cb9ab8 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] [instance: 0ba3ff1f-0ee1-4dba-8354-10aaef694161] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:37.773275 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-74fb2044-54bd-4438-b233-7b0cb6cb9ab8 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:37.783851 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-74fb2044-54bd-4438-b233-7b0cb6cb9ab8 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:37.783851 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-74fb2044-54bd-4438-b233-7b0cb6cb9ab8 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:37.783851 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-74fb2044-54bd-4438-b233-7b0cb6cb9ab8 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:37.994107 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-646c11e9-36f4-4d8b-9077-7bed3d03f235 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:37.994107 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-646c11e9-36f4-4d8b-9077-7bed3d03f235 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:38.004863 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-646c11e9-36f4-4d8b-9077-7bed3d03f235 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:38.005341 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-646c11e9-36f4-4d8b-9077-7bed3d03f235 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:38.006152 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-646c11e9-36f4-4d8b-9077-7bed3d03f235 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:38.007316 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-646c11e9-36f4-4d8b-9077-7bed3d03f235 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:38.265621 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-646c11e9-36f4-4d8b-9077-7bed3d03f235 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:38.283652 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-646c11e9-36f4-4d8b-9077-7bed3d03f235 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09" status: 200 len: 1371 microversion: 2.1 time: 0.299686 Apr 16 21:17:38.285526 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1653/3163] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:37 2022] GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09 => generated 1371 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:38.293415 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a57e02a3-0cf5-498b-b8b4-76db31daa169 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:38.294505 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a57e02a3-0cf5-498b-b8b4-76db31daa169 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:38.305117 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a57e02a3-0cf5-498b-b8b4-76db31daa169 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:38.306590 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a57e02a3-0cf5-498b-b8b4-76db31daa169 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:38.307726 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a57e02a3-0cf5-498b-b8b4-76db31daa169 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:38.308353 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a57e02a3-0cf5-498b-b8b4-76db31daa169 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:38.416793 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-74fb2044-54bd-4438-b233-7b0cb6cb9ab8 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484bca4e32554ed4af061012f30666ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79f0fe4726d4abcbdc2672a15f709f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:38.425265 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-74fb2044-54bd-4438-b233-7b0cb6cb9ab8 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161" status: 200 len: 1317 microversion: 2.1 time: 0.680560 Apr 16 21:17:38.426382 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1511/3164] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:37 2022] GET /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161 => generated 1317 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:38.518058 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a57e02a3-0cf5-498b-b8b4-76db31daa169 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:38.526568 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a57e02a3-0cf5-498b-b8b4-76db31daa169 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1313 microversion: 2.1 time: 0.239486 Apr 16 21:17:38.527287 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1654/3165] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:38 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:38.943198 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-fbdd689c-21b7-4462-bd4e-7fba04eac01a req-653260ee-cb8b-43eb-a3a0-03ef29709abf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c7cd9df-57f3-47a6-aa40-76ee208e2c09", "tag": "b83812ef-1c6d-4509-9af6-301ec0cf5b84"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:38.957346 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-fbdd689c-21b7-4462-bd4e-7fba04eac01a req-653260ee-cb8b-43eb-a3a0-03ef29709abf service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:38.957801 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-fbdd689c-21b7-4462-bd4e-7fba04eac01a req-653260ee-cb8b-43eb-a3a0-03ef29709abf service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:38.969749 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-fbdd689c-21b7-4462-bd4e-7fba04eac01a req-653260ee-cb8b-43eb-a3a0-03ef29709abf service nova] Creating event network-changed:b83812ef-1c6d-4509-9af6-301ec0cf5b84 for instance 8c7cd9df-57f3-47a6-aa40-76ee208e2c09 on nch1-master-1 Apr 16 21:17:38.975514 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-fbdd689c-21b7-4462-bd4e-7fba04eac01a req-653260ee-cb8b-43eb-a3a0-03ef29709abf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037054 Apr 16 21:17:38.976647 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1512/3166] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:17:39.302626 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1c20d52a-99f0-44ff-b8a9-eed830b8dc58 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:39.303764 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1c20d52a-99f0-44ff-b8a9-eed830b8dc58 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:39.312440 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1c20d52a-99f0-44ff-b8a9-eed830b8dc58 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:39.313601 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1c20d52a-99f0-44ff-b8a9-eed830b8dc58 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:39.329013 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1c20d52a-99f0-44ff-b8a9-eed830b8dc58 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:39.330291 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1c20d52a-99f0-44ff-b8a9-eed830b8dc58 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:39.445425 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-03225b78-6008-45b7-8187-bba99c8623c3 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:39.446809 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-03225b78-6008-45b7-8187-bba99c8623c3 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] [instance: 0ba3ff1f-0ee1-4dba-8354-10aaef694161] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:39.466123 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-03225b78-6008-45b7-8187-bba99c8623c3 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:39.468127 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-03225b78-6008-45b7-8187-bba99c8623c3 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:39.469410 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-03225b78-6008-45b7-8187-bba99c8623c3 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:39.471913 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-03225b78-6008-45b7-8187-bba99c8623c3 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:39.487959 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1c20d52a-99f0-44ff-b8a9-eed830b8dc58 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:39.498083 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1c20d52a-99f0-44ff-b8a9-eed830b8dc58 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09" status: 200 len: 1371 microversion: 2.1 time: 0.199198 Apr 16 21:17:39.499359 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1655/3167] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:39 2022] GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09 => generated 1371 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:39.545732 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-57e43b4a-7684-4e8a-9b99-2fa93fd6e913 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:39.546357 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-57e43b4a-7684-4e8a-9b99-2fa93fd6e913 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:39.552713 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-57e43b4a-7684-4e8a-9b99-2fa93fd6e913 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:39.553774 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-57e43b4a-7684-4e8a-9b99-2fa93fd6e913 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:39.554760 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-57e43b4a-7684-4e8a-9b99-2fa93fd6e913 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:39.555208 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-57e43b4a-7684-4e8a-9b99-2fa93fd6e913 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:39.713585 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-57e43b4a-7684-4e8a-9b99-2fa93fd6e913 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:39.721114 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-57e43b4a-7684-4e8a-9b99-2fa93fd6e913 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1313 microversion: 2.1 time: 0.179686 Apr 16 21:17:39.722097 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1656/3168] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:39 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:39.920766 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-03225b78-6008-45b7-8187-bba99c8623c3 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484bca4e32554ed4af061012f30666ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79f0fe4726d4abcbdc2672a15f709f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:39.939143 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-03225b78-6008-45b7-8187-bba99c8623c3 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161" status: 200 len: 1317 microversion: 2.1 time: 0.500168 Apr 16 21:17:39.949506 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1513/3169] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:39 2022] GET /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161 => generated 1317 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:17:40.515977 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5b11e4d3-c81e-45d7-ace5-314064a8feef tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:40.516636 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5b11e4d3-c81e-45d7-ace5-314064a8feef tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:40.533459 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5b11e4d3-c81e-45d7-ace5-314064a8feef tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:40.537312 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5b11e4d3-c81e-45d7-ace5-314064a8feef tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:40.539357 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5b11e4d3-c81e-45d7-ace5-314064a8feef tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:40.540810 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5b11e4d3-c81e-45d7-ace5-314064a8feef tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:40.555864 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ab6670b0-458b-4494-a57a-4c4e56b41f51 tempest-AZV2TestJSON-54009799 tempest-AZV2TestJSON-54009799-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:40.557590 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ab6670b0-458b-4494-a57a-4c4e56b41f51 tempest-AZV2TestJSON-54009799 tempest-AZV2TestJSON-54009799-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:40.562360 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ab6670b0-458b-4494-a57a-4c4e56b41f51 tempest-AZV2TestJSON-54009799 tempest-AZV2TestJSON-54009799-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:40.562360 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ab6670b0-458b-4494-a57a-4c4e56b41f51 tempest-AZV2TestJSON-54009799 tempest-AZV2TestJSON-54009799-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:40.562360 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ab6670b0-458b-4494-a57a-4c4e56b41f51 tempest-AZV2TestJSON-54009799 tempest-AZV2TestJSON-54009799-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:40.594253 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ab6670b0-458b-4494-a57a-4c4e56b41f51 tempest-AZV2TestJSON-54009799 tempest-AZV2TestJSON-54009799-project] 10.222.0.20 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.197789 Apr 16 21:17:40.595010 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1657/3170] 10.222.0.20 () {58 vars in 1163 bytes} [Sat Apr 16 21:17:40 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:17:40.741639 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ae32d06c-4a64-4480-bc6b-67ceda3d286d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:40.742272 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ae32d06c-4a64-4480-bc6b-67ceda3d286d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:40.748790 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ae32d06c-4a64-4480-bc6b-67ceda3d286d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:40.749414 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ae32d06c-4a64-4480-bc6b-67ceda3d286d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:40.750200 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ae32d06c-4a64-4480-bc6b-67ceda3d286d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:40.750780 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ae32d06c-4a64-4480-bc6b-67ceda3d286d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:40.939838 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5b11e4d3-c81e-45d7-ace5-314064a8feef tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:40.947370 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5b11e4d3-c81e-45d7-ace5-314064a8feef tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09" status: 200 len: 1371 microversion: 2.1 time: 0.436110 Apr 16 21:17:40.958448 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ae32d06c-4a64-4480-bc6b-67ceda3d286d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:40.959007 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1514/3171] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:40 2022] GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09 => generated 1371 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:40.965116 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-303b70b2-89bd-447d-8489-3891ea06012e tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:40.966177 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-303b70b2-89bd-447d-8489-3891ea06012e tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] [instance: 0ba3ff1f-0ee1-4dba-8354-10aaef694161] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:40.978275 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-303b70b2-89bd-447d-8489-3891ea06012e tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:40.978275 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-303b70b2-89bd-447d-8489-3891ea06012e tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:40.978275 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-303b70b2-89bd-447d-8489-3891ea06012e tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:40.978275 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-303b70b2-89bd-447d-8489-3891ea06012e tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:40.978573 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ae32d06c-4a64-4480-bc6b-67ceda3d286d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1313 microversion: 2.1 time: 0.238014 Apr 16 21:17:40.978573 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1658/3172] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:40 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1313 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:41.013743 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-5c5c11a6-584c-46df-9a2e-2671be8114c2 req-f84928d6-14d4-4f3e-b362-b4bc0a00aa08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71bd33e5-85e5-452d-8ddb-e1817ed9abd2", "tag": "f69be29b-9cad-412c-a6a2-2f5df4fa07b2"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:41.026124 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-5c5c11a6-584c-46df-9a2e-2671be8114c2 req-f84928d6-14d4-4f3e-b362-b4bc0a00aa08 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:41.032263 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-5c5c11a6-584c-46df-9a2e-2671be8114c2 req-f84928d6-14d4-4f3e-b362-b4bc0a00aa08 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:41.083665 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-5c5c11a6-584c-46df-9a2e-2671be8114c2 req-f84928d6-14d4-4f3e-b362-b4bc0a00aa08 service nova] Creating event network-changed:f69be29b-9cad-412c-a6a2-2f5df4fa07b2 for instance 71bd33e5-85e5-452d-8ddb-e1817ed9abd2 on nch1-master-1 Apr 16 21:17:41.093812 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-5c5c11a6-584c-46df-9a2e-2671be8114c2 req-f84928d6-14d4-4f3e-b362-b4bc0a00aa08 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085311 Apr 16 21:17:41.095177 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1659/3173] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:17:41.243419 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-303b70b2-89bd-447d-8489-3891ea06012e tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484bca4e32554ed4af061012f30666ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79f0fe4726d4abcbdc2672a15f709f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:41.253187 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-303b70b2-89bd-447d-8489-3891ea06012e tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161" status: 200 len: 1317 microversion: 2.1 time: 0.292432 Apr 16 21:17:41.254291 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1515/3174] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:40 2022] GET /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161 => generated 1317 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:41.813300 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-1b56b80e-d064-477d-8736-febec95b8eed req-24f7432e-7bfb-4efc-8715-8c796499b92d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523", "name": "network-vif-plugged", "status": "completed", "tag": "0eab5a77-408a-45d7-86ff-b5c0a4b550d1"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:41.823163 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-1b56b80e-d064-477d-8736-febec95b8eed req-24f7432e-7bfb-4efc-8715-8c796499b92d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:41.823846 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-1b56b80e-d064-477d-8736-febec95b8eed req-24f7432e-7bfb-4efc-8715-8c796499b92d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:41.836676 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-1b56b80e-d064-477d-8736-febec95b8eed req-24f7432e-7bfb-4efc-8715-8c796499b92d service nova] Creating event network-vif-plugged:0eab5a77-408a-45d7-86ff-b5c0a4b550d1 for instance 9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523 on nch2-master-1 Apr 16 21:17:41.842392 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-1b56b80e-d064-477d-8736-febec95b8eed req-24f7432e-7bfb-4efc-8715-8c796499b92d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033521 Apr 16 21:17:41.845732 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1660/3175] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:17:41.969730 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-82f65522-4802-44e2-9600-ec36f1334bc3 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:41.970520 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-82f65522-4802-44e2-9600-ec36f1334bc3 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:41.985867 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-82f65522-4802-44e2-9600-ec36f1334bc3 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:41.986596 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-82f65522-4802-44e2-9600-ec36f1334bc3 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:41.987620 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-82f65522-4802-44e2-9600-ec36f1334bc3 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:41.988306 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-82f65522-4802-44e2-9600-ec36f1334bc3 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:41.995800 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-af1a7a16-dead-43f8-9e4f-98193e0d95c1 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:41.996753 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-af1a7a16-dead-43f8-9e4f-98193e0d95c1 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:42.003583 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-af1a7a16-dead-43f8-9e4f-98193e0d95c1 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:42.004041 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-af1a7a16-dead-43f8-9e4f-98193e0d95c1 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:42.017703 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-af1a7a16-dead-43f8-9e4f-98193e0d95c1 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:42.018184 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-af1a7a16-dead-43f8-9e4f-98193e0d95c1 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:42.240407 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-82f65522-4802-44e2-9600-ec36f1334bc3 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:42.251004 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-82f65522-4802-44e2-9600-ec36f1334bc3 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09" status: 200 len: 1371 microversion: 2.1 time: 0.287541 Apr 16 21:17:42.256094 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1516/3176] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:41 2022] GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09 => generated 1371 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:42.270857 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-94b530cd-4efb-42b9-8c66-c6a59e460ce3 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:42.271850 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-94b530cd-4efb-42b9-8c66-c6a59e460ce3 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] [instance: 0ba3ff1f-0ee1-4dba-8354-10aaef694161] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:42.285060 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-94b530cd-4efb-42b9-8c66-c6a59e460ce3 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:42.289534 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-94b530cd-4efb-42b9-8c66-c6a59e460ce3 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:42.291250 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-94b530cd-4efb-42b9-8c66-c6a59e460ce3 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:42.291939 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-94b530cd-4efb-42b9-8c66-c6a59e460ce3 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:42.411093 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-af1a7a16-dead-43f8-9e4f-98193e0d95c1 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:42.426819 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-af1a7a16-dead-43f8-9e4f-98193e0d95c1 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1313 microversion: 2.1 time: 0.435864 Apr 16 21:17:42.436065 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1661/3177] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:41 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1313 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:42.534586 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-94b530cd-4efb-42b9-8c66-c6a59e460ce3 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484bca4e32554ed4af061012f30666ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79f0fe4726d4abcbdc2672a15f709f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:42.542658 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-94b530cd-4efb-42b9-8c66-c6a59e460ce3 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161" status: 200 len: 1317 microversion: 2.1 time: 0.276024 Apr 16 21:17:42.543774 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1517/3178] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:42 2022] GET /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161 => generated 1317 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:43.275802 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6386af02-8a06-46be-a5ba-3d70d34edd55 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:43.276481 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6386af02-8a06-46be-a5ba-3d70d34edd55 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:43.287877 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6386af02-8a06-46be-a5ba-3d70d34edd55 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:43.288412 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6386af02-8a06-46be-a5ba-3d70d34edd55 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:43.289254 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6386af02-8a06-46be-a5ba-3d70d34edd55 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:43.290349 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6386af02-8a06-46be-a5ba-3d70d34edd55 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:43.446196 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-964c760a-db72-4f2e-bdca-b3462a2ab412 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:43.446844 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-964c760a-db72-4f2e-bdca-b3462a2ab412 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:43.469844 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-964c760a-db72-4f2e-bdca-b3462a2ab412 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:43.470335 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-964c760a-db72-4f2e-bdca-b3462a2ab412 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:43.471160 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-964c760a-db72-4f2e-bdca-b3462a2ab412 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:43.471622 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-964c760a-db72-4f2e-bdca-b3462a2ab412 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:43.712850 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-964c760a-db72-4f2e-bdca-b3462a2ab412 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:43.721119 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-964c760a-db72-4f2e-bdca-b3462a2ab412 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1313 microversion: 2.1 time: 0.279128 Apr 16 21:17:43.721718 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1518/3179] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:43 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1313 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:43.735854 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5bbdd3b3-4d93-4bc0-b8fa-3430a2db1e8b tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:43.738690 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5bbdd3b3-4d93-4bc0-b8fa-3430a2db1e8b tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] [instance: 0ba3ff1f-0ee1-4dba-8354-10aaef694161] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:43.750076 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5bbdd3b3-4d93-4bc0-b8fa-3430a2db1e8b tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:43.751005 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5bbdd3b3-4d93-4bc0-b8fa-3430a2db1e8b tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:43.752044 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5bbdd3b3-4d93-4bc0-b8fa-3430a2db1e8b tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:43.752851 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5bbdd3b3-4d93-4bc0-b8fa-3430a2db1e8b tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:43.963647 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6386af02-8a06-46be-a5ba-3d70d34edd55 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:43.972898 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6386af02-8a06-46be-a5ba-3d70d34edd55 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09" status: 200 len: 1371 microversion: 2.1 time: 0.701436 Apr 16 21:17:43.981054 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1662/3180] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:43 2022] GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09 => generated 1371 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:44.085985 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5bbdd3b3-4d93-4bc0-b8fa-3430a2db1e8b tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484bca4e32554ed4af061012f30666ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79f0fe4726d4abcbdc2672a15f709f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:44.093529 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5bbdd3b3-4d93-4bc0-b8fa-3430a2db1e8b tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161" status: 200 len: 1317 microversion: 2.1 time: 0.370483 Apr 16 21:17:44.094970 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1519/3181] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:43 2022] GET /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161 => generated 1317 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:44.125285 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-08e511a7-7beb-4b30-8786-2446c5c938db tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Action: 'create', calling method: .version_select at 0x7fbb959b9e50>, body: {"keypair": {"name": "tempest-keypair-1579756113"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:44.142372 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-08e511a7-7beb-4b30-8786-2446c5c938db tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Getting quotas for project 3bc8f8d1fc734ce182645a464d35ead8. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:17:44.150256 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-08e511a7-7beb-4b30-8786-2446c5c938db tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Getting quotas for user f0f6bbe8241a49c890032fb779c4bc13 and project 3bc8f8d1fc734ce182645a464d35ead8. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:17:44.487711 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-08e511a7-7beb-4b30-8786-2446c5c938db tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Getting quotas for project 3bc8f8d1fc734ce182645a464d35ead8. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:17:44.493444 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-08e511a7-7beb-4b30-8786-2446c5c938db tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Getting quotas for user f0f6bbe8241a49c890032fb779c4bc13 and project 3bc8f8d1fc734ce182645a464d35ead8. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:17:44.513739 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-08e511a7-7beb-4b30-8786-2446c5c938db tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.535689 Apr 16 21:17:44.513739 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1663/3182] 10.222.0.20 () {60 vars in 1157 bytes} [Sat Apr 16 21:17:43 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:44.742237 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2bda00e7-537f-4d58-896d-dbba252b81d6 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:44.743838 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2bda00e7-537f-4d58-896d-dbba252b81d6 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:44.755512 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2bda00e7-537f-4d58-896d-dbba252b81d6 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:44.755512 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2bda00e7-537f-4d58-896d-dbba252b81d6 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:44.755512 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2bda00e7-537f-4d58-896d-dbba252b81d6 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:44.755512 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2bda00e7-537f-4d58-896d-dbba252b81d6 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:44.989828 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6c28c12f-06f8-4a97-bca2-608921baca1a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:44.990994 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6c28c12f-06f8-4a97-bca2-608921baca1a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:44.997661 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6c28c12f-06f8-4a97-bca2-608921baca1a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:44.998068 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6c28c12f-06f8-4a97-bca2-608921baca1a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:44.998868 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6c28c12f-06f8-4a97-bca2-608921baca1a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:44.999322 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6c28c12f-06f8-4a97-bca2-608921baca1a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:45.170644 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2bda00e7-537f-4d58-896d-dbba252b81d6 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:45.182846 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2bda00e7-537f-4d58-896d-dbba252b81d6 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1313 microversion: 2.1 time: 0.447725 Apr 16 21:17:45.184326 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1520/3183] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:44 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1313 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:45.199137 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-11efe942-469e-4406-8434-76bf70d7474a tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:45.205736 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6c28c12f-06f8-4a97-bca2-608921baca1a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:45.216756 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6c28c12f-06f8-4a97-bca2-608921baca1a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09" status: 200 len: 1371 microversion: 2.1 time: 0.230689 Apr 16 21:17:45.217875 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1664/3184] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:44 2022] GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09 => generated 1371 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:45.218745 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-11efe942-469e-4406-8434-76bf70d7474a tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] [instance: 0ba3ff1f-0ee1-4dba-8354-10aaef694161] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:45.239565 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-11efe942-469e-4406-8434-76bf70d7474a tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:45.240041 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-11efe942-469e-4406-8434-76bf70d7474a tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:45.244100 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-11efe942-469e-4406-8434-76bf70d7474a tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:45.244662 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-11efe942-469e-4406-8434-76bf70d7474a tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:45.502638 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-11efe942-469e-4406-8434-76bf70d7474a tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484bca4e32554ed4af061012f30666ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79f0fe4726d4abcbdc2672a15f709f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:45.510849 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-11efe942-469e-4406-8434-76bf70d7474a tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161" status: 200 len: 1317 microversion: 2.1 time: 0.325113 Apr 16 21:17:45.511420 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1521/3185] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:45 2022] GET /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161 => generated 1317 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:46.124784 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-78285e30-e7f6-4bb4-b603-2bd1fb1ca034 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-915639982", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "faa6ac51-0e46-43d3-bed2-87e1b1a96e0a"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:46.201578 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-38588845-e059-42b9-95d5-f798a060004d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:46.202205 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-38588845-e059-42b9-95d5-f798a060004d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:46.213334 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-38588845-e059-42b9-95d5-f798a060004d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:46.213980 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-38588845-e059-42b9-95d5-f798a060004d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:46.214775 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-38588845-e059-42b9-95d5-f798a060004d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:46.215486 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-38588845-e059-42b9-95d5-f798a060004d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:46.221317 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-78285e30-e7f6-4bb4-b603-2bd1fb1ca034 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] validate_networks() for [('faa6ac51-0e46-43d3-bed2-87e1b1a96e0a', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:17:46.403566 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-38588845-e059-42b9-95d5-f798a060004d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:46.417459 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-38588845-e059-42b9-95d5-f798a060004d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1313 microversion: 2.1 time: 0.220319 Apr 16 21:17:46.418615 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1522/3186] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:46 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:17:46.437163 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-059f933c-a04b-487c-a59b-ae587c74a33c tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:46.438346 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-059f933c-a04b-487c-a59b-ae587c74a33c tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:46.456279 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-059f933c-a04b-487c-a59b-ae587c74a33c tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:46.456933 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-059f933c-a04b-487c-a59b-ae587c74a33c tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:46.457295 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-059f933c-a04b-487c-a59b-ae587c74a33c tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:46.457912 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-059f933c-a04b-487c-a59b-ae587c74a33c tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:46.749508 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-059f933c-a04b-487c-a59b-ae587c74a33c tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:46.759239 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-059f933c-a04b-487c-a59b-ae587c74a33c tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09" status: 200 len: 1371 microversion: 2.1 time: 0.339178 Apr 16 21:17:46.760434 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1523/3187] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:46 2022] GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09 => generated 1371 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:46.765510 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ff6370cb-9dba-498a-b9b2-983d1fe3c777 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:46.768292 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ff6370cb-9dba-498a-b9b2-983d1fe3c777 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] [instance: 0ba3ff1f-0ee1-4dba-8354-10aaef694161] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:46.776500 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ff6370cb-9dba-498a-b9b2-983d1fe3c777 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:46.778023 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ff6370cb-9dba-498a-b9b2-983d1fe3c777 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:46.779039 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ff6370cb-9dba-498a-b9b2-983d1fe3c777 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:46.780281 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ff6370cb-9dba-498a-b9b2-983d1fe3c777 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:46.961829 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ff6370cb-9dba-498a-b9b2-983d1fe3c777 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484bca4e32554ed4af061012f30666ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79f0fe4726d4abcbdc2672a15f709f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:46.971459 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ff6370cb-9dba-498a-b9b2-983d1fe3c777 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161" status: 200 len: 1317 microversion: 2.1 time: 0.209666 Apr 16 21:17:46.973255 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1524/3188] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:46 2022] GET /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161 => generated 1317 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:47.069423 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-21e10431-ba97-4bf5-b2de-3e11aa2ecd4d req-bf00a9ab-998a-404a-9e84-673ae71dab34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ba3ff1f-0ee1-4dba-8354-10aaef694161", "name": "network-vif-plugged", "status": "completed", "tag": "da205378-8574-416e-8ccf-7ec5bb2d4541"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:47.078122 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-21e10431-ba97-4bf5-b2de-3e11aa2ecd4d req-bf00a9ab-998a-404a-9e84-673ae71dab34 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:47.078580 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-21e10431-ba97-4bf5-b2de-3e11aa2ecd4d req-bf00a9ab-998a-404a-9e84-673ae71dab34 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:47.084855 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-78285e30-e7f6-4bb4-b603-2bd1fb1ca034 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:17:47.085753 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-78285e30-e7f6-4bb4-b603-2bd1fb1ca034 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:17:47.086416 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-78285e30-e7f6-4bb4-b603-2bd1fb1ca034 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:17:47.087339 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-78285e30-e7f6-4bb4-b603-2bd1fb1ca034 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:17:47.088810 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-78285e30-e7f6-4bb4-b603-2bd1fb1ca034 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:17:47.091478 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-21e10431-ba97-4bf5-b2de-3e11aa2ecd4d req-bf00a9ab-998a-404a-9e84-673ae71dab34 service nova] Creating event network-vif-plugged:da205378-8574-416e-8ccf-7ec5bb2d4541 for instance 0ba3ff1f-0ee1-4dba-8354-10aaef694161 on nch2-master-1 Apr 16 21:17:47.097554 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-21e10431-ba97-4bf5-b2de-3e11aa2ecd4d req-bf00a9ab-998a-404a-9e84-673ae71dab34 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122247 Apr 16 21:17:47.098843 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1525/3189] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:17:47.103793 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-78285e30-e7f6-4bb4-b603-2bd1fb1ca034 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:47.106610 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-78285e30-e7f6-4bb4-b603-2bd1fb1ca034 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:47.106610 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-78285e30-e7f6-4bb4-b603-2bd1fb1ca034 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:47.107234 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-78285e30-e7f6-4bb4-b603-2bd1fb1ca034 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:47.149514 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-78285e30-e7f6-4bb4-b603-2bd1fb1ca034 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Getting quotas for project 6391ed1060eb48748245ced6bceec92b. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:17:47.171707 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-78285e30-e7f6-4bb4-b603-2bd1fb1ca034 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Getting quotas for user af0b023ad5d34809930c8d837c06c247 and project 6391ed1060eb48748245ced6bceec92b. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:17:47.185464 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-78285e30-e7f6-4bb4-b603-2bd1fb1ca034 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:17:47.187990 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-78285e30-e7f6-4bb4-b603-2bd1fb1ca034 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] [instance: 5e9fe25d-f215-444a-b161-5a76d2766905] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:17:47.313713 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-78285e30-e7f6-4bb4-b603-2bd1fb1ca034 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.287019 Apr 16 21:17:47.327345 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1665/3190] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:17:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1301 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 16 21:17:47.347934 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-011728c9-75d1-4c3b-a7ca-01690ba2f709 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:47.348687 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-011728c9-75d1-4c3b-a7ca-01690ba2f709 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] [instance: 5e9fe25d-f215-444a-b161-5a76d2766905] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:47.418128 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-011728c9-75d1-4c3b-a7ca-01690ba2f709 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0b023ad5d34809930c8d837c06c247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6391ed1060eb48748245ced6bceec92b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:47.426279 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-011728c9-75d1-4c3b-a7ca-01690ba2f709 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] 10.222.0.20 "GET /compute/v2.1/servers/5e9fe25d-f215-444a-b161-5a76d2766905" status: 200 len: 1223 microversion: 2.1 time: 0.092822 Apr 16 21:17:47.427033 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1526/3191] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:47 2022] GET /compute/v2.1/servers/5e9fe25d-f215-444a-b161-5a76d2766905 => generated 1223 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:17:47.435269 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-df12daa5-f10d-4ce9-9ac0-1d118c109875 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:47.436213 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-df12daa5-f10d-4ce9-9ac0-1d118c109875 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:47.451619 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-df12daa5-f10d-4ce9-9ac0-1d118c109875 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:47.451619 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-df12daa5-f10d-4ce9-9ac0-1d118c109875 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:47.454085 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-df12daa5-f10d-4ce9-9ac0-1d118c109875 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:47.454991 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-df12daa5-f10d-4ce9-9ac0-1d118c109875 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:47.714324 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-df12daa5-f10d-4ce9-9ac0-1d118c109875 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:47.722471 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-df12daa5-f10d-4ce9-9ac0-1d118c109875 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1313 microversion: 2.1 time: 0.291481 Apr 16 21:17:47.723259 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1666/3192] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:47 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1313 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:47.776485 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9529856f-6eab-45c0-b179-e9a1c54c76ce tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:47.777144 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9529856f-6eab-45c0-b179-e9a1c54c76ce tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:47.784763 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9529856f-6eab-45c0-b179-e9a1c54c76ce tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:47.785229 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9529856f-6eab-45c0-b179-e9a1c54c76ce tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:47.786036 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9529856f-6eab-45c0-b179-e9a1c54c76ce tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:47.786475 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9529856f-6eab-45c0-b179-e9a1c54c76ce tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:47.846624 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4e4b9b80-58d7-4a19-acf6-8ceaae13b339 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-2104048469", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "377e62c7-2e1c-405c-8820-462b8940afab"}], "security_groups": [{"name": "tempest-securitygroup--289760136"}], "key_name": "tempest-keypair-1579756113", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:47.934602 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9529856f-6eab-45c0-b179-e9a1c54c76ce tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:47.943044 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9529856f-6eab-45c0-b179-e9a1c54c76ce tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09" status: 200 len: 1371 microversion: 2.1 time: 0.171153 Apr 16 21:17:47.953513 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1527/3193] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:47 2022] GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09 => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:47.972145 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-4e4b9b80-58d7-4a19-acf6-8ceaae13b339 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] validate_networks() for [('377e62c7-2e1c-405c-8820-462b8940afab', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:17:48.003737 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5baec99c-2cfe-43bc-9bf3-3678913211ff tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:48.003737 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5baec99c-2cfe-43bc-9bf3-3678913211ff tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] [instance: 0ba3ff1f-0ee1-4dba-8354-10aaef694161] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:48.023926 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5baec99c-2cfe-43bc-9bf3-3678913211ff tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:48.024778 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5baec99c-2cfe-43bc-9bf3-3678913211ff tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:48.025774 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5baec99c-2cfe-43bc-9bf3-3678913211ff tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:48.026360 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5baec99c-2cfe-43bc-9bf3-3678913211ff tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:48.191804 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5baec99c-2cfe-43bc-9bf3-3678913211ff tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484bca4e32554ed4af061012f30666ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79f0fe4726d4abcbdc2672a15f709f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:48.200710 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5baec99c-2cfe-43bc-9bf3-3678913211ff tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161" status: 200 len: 1317 microversion: 2.1 time: 0.214368 Apr 16 21:17:48.208136 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1528/3194] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:47 2022] GET /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161 => generated 1317 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:48.427539 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-4e4b9b80-58d7-4a19-acf6-8ceaae13b339 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Getting quotas for project 3bc8f8d1fc734ce182645a464d35ead8. Resources: dict_keys(['metadata_items']) {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:17:48.433374 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-4e4b9b80-58d7-4a19-acf6-8ceaae13b339 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Getting quotas for user f0f6bbe8241a49c890032fb779c4bc13 and project 3bc8f8d1fc734ce182645a464d35ead8. Resources: dict_keys(['metadata_items']) {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:17:48.442846 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8de14d97-08e7-4e54-ac64-71a5bcdba509 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:48.444639 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8de14d97-08e7-4e54-ac64-71a5bcdba509 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] [instance: 5e9fe25d-f215-444a-b161-5a76d2766905] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:48.446797 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-4e4b9b80-58d7-4a19-acf6-8ceaae13b339 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:17:48.447231 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-4e4b9b80-58d7-4a19-acf6-8ceaae13b339 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:17:48.447717 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-4e4b9b80-58d7-4a19-acf6-8ceaae13b339 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:17:48.448196 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-4e4b9b80-58d7-4a19-acf6-8ceaae13b339 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:17:48.448617 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-4e4b9b80-58d7-4a19-acf6-8ceaae13b339 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:17:48.457180 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4e4b9b80-58d7-4a19-acf6-8ceaae13b339 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:48.457642 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4e4b9b80-58d7-4a19-acf6-8ceaae13b339 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:48.458462 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4e4b9b80-58d7-4a19-acf6-8ceaae13b339 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:48.462220 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4e4b9b80-58d7-4a19-acf6-8ceaae13b339 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:48.476020 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-4e4b9b80-58d7-4a19-acf6-8ceaae13b339 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Getting quotas for project 3bc8f8d1fc734ce182645a464d35ead8. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:17:48.481452 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-4e4b9b80-58d7-4a19-acf6-8ceaae13b339 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Getting quotas for user f0f6bbe8241a49c890032fb779c4bc13 and project 3bc8f8d1fc734ce182645a464d35ead8. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:17:48.498517 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4e4b9b80-58d7-4a19-acf6-8ceaae13b339 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:17:48.498724 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8de14d97-08e7-4e54-ac64-71a5bcdba509 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0b023ad5d34809930c8d837c06c247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6391ed1060eb48748245ced6bceec92b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:48.500806 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4e4b9b80-58d7-4a19-acf6-8ceaae13b339 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] [instance: 150835ec-2a90-46c5-8fe1-970a84f2e0cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:17:48.505163 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8de14d97-08e7-4e54-ac64-71a5bcdba509 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] 10.222.0.20 "GET /compute/v2.1/servers/5e9fe25d-f215-444a-b161-5a76d2766905" status: 200 len: 1223 microversion: 2.1 time: 0.066212 Apr 16 21:17:48.507183 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1529/3195] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:48 2022] GET /compute/v2.1/servers/5e9fe25d-f215-444a-b161-5a76d2766905 => generated 1223 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:17:48.679568 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4e4b9b80-58d7-4a19-acf6-8ceaae13b339 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.838078 Apr 16 21:17:48.680760 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1667/3196] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:17:47 2022] POST /compute/v2.1/servers => generated 408 bytes in 840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 16 21:17:48.690526 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0db01cbe-223a-484d-9a6e-c0c97d4818a1 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:48.691144 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0db01cbe-223a-484d-9a6e-c0c97d4818a1 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] [instance: 150835ec-2a90-46c5-8fe1-970a84f2e0cd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:48.739595 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2f5ac6e4-3253-41b2-9cfe-72c1c844ef5d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:48.740245 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2f5ac6e4-3253-41b2-9cfe-72c1c844ef5d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:48.747621 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2f5ac6e4-3253-41b2-9cfe-72c1c844ef5d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:48.748534 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2f5ac6e4-3253-41b2-9cfe-72c1c844ef5d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:48.749503 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2f5ac6e4-3253-41b2-9cfe-72c1c844ef5d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:48.750097 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2f5ac6e4-3253-41b2-9cfe-72c1c844ef5d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:48.751213 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0db01cbe-223a-484d-9a6e-c0c97d4818a1 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f6bbe8241a49c890032fb779c4bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc8f8d1fc734ce182645a464d35ead8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:48.759954 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0db01cbe-223a-484d-9a6e-c0c97d4818a1 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] 10.222.0.20 "GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd" status: 200 len: 1278 microversion: 2.1 time: 0.073151 Apr 16 21:17:48.761774 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1530/3197] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:48 2022] GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd => generated 1278 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:48.901490 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2f5ac6e4-3253-41b2-9cfe-72c1c844ef5d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:48.909541 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2f5ac6e4-3253-41b2-9cfe-72c1c844ef5d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1313 microversion: 2.1 time: 0.174431 Apr 16 21:17:48.910356 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1668/3198] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:48 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:48.961433 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2c6aaa30-7421-4148-8c26-ee6a01ab29ec tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:48.962009 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2c6aaa30-7421-4148-8c26-ee6a01ab29ec tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:48.968354 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2c6aaa30-7421-4148-8c26-ee6a01ab29ec tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:48.968830 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2c6aaa30-7421-4148-8c26-ee6a01ab29ec tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:48.969627 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2c6aaa30-7421-4148-8c26-ee6a01ab29ec tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:48.970078 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2c6aaa30-7421-4148-8c26-ee6a01ab29ec tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:49.105042 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2c6aaa30-7421-4148-8c26-ee6a01ab29ec tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:49.113145 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2c6aaa30-7421-4148-8c26-ee6a01ab29ec tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09" status: 200 len: 1371 microversion: 2.1 time: 0.156258 Apr 16 21:17:49.119843 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-3d9cd15e-cff7-4b02-a824-0e03aca5051c req-5a9a6442-9ffe-4545-8be8-52b4588fd5ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c7cd9df-57f3-47a6-aa40-76ee208e2c09", "name": "network-vif-plugged", "status": "completed", "tag": "b83812ef-1c6d-4509-9af6-301ec0cf5b84"}, {"server_uuid": "71bd33e5-85e5-452d-8ddb-e1817ed9abd2", "name": "network-vif-plugged", "status": "completed", "tag": "f69be29b-9cad-412c-a6a2-2f5df4fa07b2"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:49.124769 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1531/3199] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:48 2022] GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09 => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:49.130106 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-3d9cd15e-cff7-4b02-a824-0e03aca5051c req-5a9a6442-9ffe-4545-8be8-52b4588fd5ef service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:49.130634 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-3d9cd15e-cff7-4b02-a824-0e03aca5051c req-5a9a6442-9ffe-4545-8be8-52b4588fd5ef service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:49.143247 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-3d9cd15e-cff7-4b02-a824-0e03aca5051c req-5a9a6442-9ffe-4545-8be8-52b4588fd5ef service nova] Creating event network-vif-plugged:b83812ef-1c6d-4509-9af6-301ec0cf5b84 for instance 8c7cd9df-57f3-47a6-aa40-76ee208e2c09 on nch1-master-1 Apr 16 21:17:49.143763 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-3d9cd15e-cff7-4b02-a824-0e03aca5051c req-5a9a6442-9ffe-4545-8be8-52b4588fd5ef service nova] Creating event network-vif-plugged:f69be29b-9cad-412c-a6a2-2f5df4fa07b2 for instance 71bd33e5-85e5-452d-8ddb-e1817ed9abd2 on nch1-master-1 Apr 16 21:17:49.150201 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-3d9cd15e-cff7-4b02-a824-0e03aca5051c req-5a9a6442-9ffe-4545-8be8-52b4588fd5ef service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034928 Apr 16 21:17:49.150789 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1669/3200] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:17:49.218445 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ee4a5bae-1706-475b-8015-bd2f8b447fcf tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:49.218981 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ee4a5bae-1706-475b-8015-bd2f8b447fcf tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] [instance: 0ba3ff1f-0ee1-4dba-8354-10aaef694161] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:49.225558 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ee4a5bae-1706-475b-8015-bd2f8b447fcf tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:49.226022 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ee4a5bae-1706-475b-8015-bd2f8b447fcf tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:49.226832 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ee4a5bae-1706-475b-8015-bd2f8b447fcf tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:49.227280 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ee4a5bae-1706-475b-8015-bd2f8b447fcf tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:49.469261 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ee4a5bae-1706-475b-8015-bd2f8b447fcf tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484bca4e32554ed4af061012f30666ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79f0fe4726d4abcbdc2672a15f709f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:49.477709 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ee4a5bae-1706-475b-8015-bd2f8b447fcf tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161" status: 200 len: 1467 microversion: 2.1 time: 0.263557 Apr 16 21:17:49.478282 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1532/3201] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:49 2022] GET /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161 => generated 1467 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:49.494232 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c25eb7a1-b237-4f94-b212-8040ec125856 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:49.494946 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c25eb7a1-b237-4f94-b212-8040ec125856 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] [instance: 9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:49.501118 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c25eb7a1-b237-4f94-b212-8040ec125856 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:49.501578 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c25eb7a1-b237-4f94-b212-8040ec125856 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:49.502358 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c25eb7a1-b237-4f94-b212-8040ec125856 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:49.502809 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c25eb7a1-b237-4f94-b212-8040ec125856 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:49.523560 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fa2d20fc-cf68-4614-bc4b-460aed990871 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:49.524228 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-fa2d20fc-cf68-4614-bc4b-460aed990871 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] [instance: 5e9fe25d-f215-444a-b161-5a76d2766905] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:49.530424 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fa2d20fc-cf68-4614-bc4b-460aed990871 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:49.530915 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fa2d20fc-cf68-4614-bc4b-460aed990871 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:49.531706 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fa2d20fc-cf68-4614-bc4b-460aed990871 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:49.532157 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fa2d20fc-cf68-4614-bc4b-460aed990871 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:49.593772 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-fa2d20fc-cf68-4614-bc4b-460aed990871 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0b023ad5d34809930c8d837c06c247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6391ed1060eb48748245ced6bceec92b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:49.602245 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fa2d20fc-cf68-4614-bc4b-460aed990871 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] 10.222.0.20 "GET /compute/v2.1/servers/5e9fe25d-f215-444a-b161-5a76d2766905" status: 200 len: 1275 microversion: 2.1 time: 0.083358 Apr 16 21:17:49.602969 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1533/3202] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:49 2022] GET /compute/v2.1/servers/5e9fe25d-f215-444a-b161-5a76d2766905 => generated 1275 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:17:49.635773 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c25eb7a1-b237-4f94-b212-8040ec125856 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484bca4e32554ed4af061012f30666ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79f0fe4726d4abcbdc2672a15f709f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:49.643515 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c25eb7a1-b237-4f94-b212-8040ec125856 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/servers/9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523" status: 200 len: 1467 microversion: 2.1 time: 0.153656 Apr 16 21:17:49.644087 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1670/3203] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:49 2022] GET /compute/v2.1/servers/9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523 => generated 1467 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:49.660620 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fb40977a-200f-4557-905f-f6a4e1869af2 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-107908288"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:49.661806 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-fb40977a-200f-4557-905f-f6a4e1869af2 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] [instance: 9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:49.668379 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fb40977a-200f-4557-905f-f6a4e1869af2 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:49.668923 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fb40977a-200f-4557-905f-f6a4e1869af2 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:49.669799 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fb40977a-200f-4557-905f-f6a4e1869af2 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:49.684005 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fb40977a-200f-4557-905f-f6a4e1869af2 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:49.777713 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c9c14d10-07ba-41d7-948f-59bb09bf612e tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:49.778470 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c9c14d10-07ba-41d7-948f-59bb09bf612e tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] [instance: 150835ec-2a90-46c5-8fe1-970a84f2e0cd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:49.837537 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c9c14d10-07ba-41d7-948f-59bb09bf612e tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f6bbe8241a49c890032fb779c4bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc8f8d1fc734ce182645a464d35ead8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:49.844703 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c9c14d10-07ba-41d7-948f-59bb09bf612e tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] 10.222.0.20 "GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd" status: 200 len: 1278 microversion: 2.1 time: 0.071340 Apr 16 21:17:49.854289 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1671/3204] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:49 2022] GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd => generated 1278 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:17:49.926146 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-87892bfb-e561-41e7-9e36-837b87fa2233 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:49.926765 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-87892bfb-e561-41e7-9e36-837b87fa2233 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:49.933550 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-87892bfb-e561-41e7-9e36-837b87fa2233 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:49.934012 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-87892bfb-e561-41e7-9e36-837b87fa2233 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:49.934788 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-87892bfb-e561-41e7-9e36-837b87fa2233 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:49.935237 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-87892bfb-e561-41e7-9e36-837b87fa2233 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:50.125911 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-87892bfb-e561-41e7-9e36-837b87fa2233 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:50.138882 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-87892bfb-e561-41e7-9e36-837b87fa2233 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1313 microversion: 2.1 time: 0.216401 Apr 16 21:17:50.152401 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1672/3205] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:49 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:17:50.158853 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-97fea831-ae36-42ae-af64-a63b8a342889 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:50.159526 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-97fea831-ae36-42ae-af64-a63b8a342889 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:50.166427 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-97fea831-ae36-42ae-af64-a63b8a342889 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:50.166892 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-97fea831-ae36-42ae-af64-a63b8a342889 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:50.167862 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-97fea831-ae36-42ae-af64-a63b8a342889 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:50.168343 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-97fea831-ae36-42ae-af64-a63b8a342889 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:50.219404 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fb40977a-200f-4557-905f-f6a4e1869af2 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "POST /compute/v2.1/servers/9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523/action" status: 202 len: 0 microversion: 2.1 time: 0.561514 Apr 16 21:17:50.225667 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1534/3206] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:17:49 2022] POST /compute/v2.1/servers/9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523/action => generated 0 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 16 21:17:50.239650 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-99234761-965f-4b4f-a4e2-dfc7c88277f1 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb9580baf0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:50.291161 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-99234761-965f-4b4f-a4e2-dfc7c88277f1 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9" status: 200 len: 1454 microversion: 2.1 time: 0.059936 Apr 16 21:17:50.291979 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1535/3207] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:17:50 2022] GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9 => generated 1454 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:50.406735 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-97fea831-ae36-42ae-af64-a63b8a342889 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:50.414959 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-97fea831-ae36-42ae-af64-a63b8a342889 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09" status: 200 len: 1371 microversion: 2.1 time: 0.261233 Apr 16 21:17:50.415532 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1673/3208] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:50 2022] GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09 => generated 1371 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:50.625072 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-54e2e752-41be-47c4-9aff-880dd2bf9ed5 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:50.625824 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-54e2e752-41be-47c4-9aff-880dd2bf9ed5 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] [instance: 5e9fe25d-f215-444a-b161-5a76d2766905] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:50.633680 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-54e2e752-41be-47c4-9aff-880dd2bf9ed5 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:50.634149 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-54e2e752-41be-47c4-9aff-880dd2bf9ed5 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:50.634940 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-54e2e752-41be-47c4-9aff-880dd2bf9ed5 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:50.635557 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-54e2e752-41be-47c4-9aff-880dd2bf9ed5 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:50.712592 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-54e2e752-41be-47c4-9aff-880dd2bf9ed5 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0b023ad5d34809930c8d837c06c247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6391ed1060eb48748245ced6bceec92b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:50.720987 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-54e2e752-41be-47c4-9aff-880dd2bf9ed5 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] 10.222.0.20 "GET /compute/v2.1/servers/5e9fe25d-f215-444a-b161-5a76d2766905" status: 200 len: 1281 microversion: 2.1 time: 0.099854 Apr 16 21:17:50.721658 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1536/3209] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:50 2022] GET /compute/v2.1/servers/5e9fe25d-f215-444a-b161-5a76d2766905 => generated 1281 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:50.871048 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ef8ef442-46d8-43c4-b322-fa7d964e9ab0 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:50.872405 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ef8ef442-46d8-43c4-b322-fa7d964e9ab0 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] [instance: 150835ec-2a90-46c5-8fe1-970a84f2e0cd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:50.882731 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ef8ef442-46d8-43c4-b322-fa7d964e9ab0 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:50.883271 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ef8ef442-46d8-43c4-b322-fa7d964e9ab0 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:50.884903 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ef8ef442-46d8-43c4-b322-fa7d964e9ab0 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:50.885429 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ef8ef442-46d8-43c4-b322-fa7d964e9ab0 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:50.951735 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ef8ef442-46d8-43c4-b322-fa7d964e9ab0 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f6bbe8241a49c890032fb779c4bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc8f8d1fc734ce182645a464d35ead8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:50.959796 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ef8ef442-46d8-43c4-b322-fa7d964e9ab0 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] 10.222.0.20 "GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd" status: 200 len: 1330 microversion: 2.1 time: 0.100423 Apr 16 21:17:50.960834 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1674/3210] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:50 2022] GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd => generated 1330 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:51.156561 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d7fc066b-560e-4c90-8942-df533023a6ab tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:51.157173 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d7fc066b-560e-4c90-8942-df533023a6ab tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:51.163901 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d7fc066b-560e-4c90-8942-df533023a6ab tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:51.164382 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d7fc066b-560e-4c90-8942-df533023a6ab tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:51.165156 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d7fc066b-560e-4c90-8942-df533023a6ab tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:51.165679 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d7fc066b-560e-4c90-8942-df533023a6ab tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:51.304800 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-58f023f4-2519-43a6-ba44-a18e1b000815 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb9593de50>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:51.357189 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-58f023f4-2519-43a6-ba44-a18e1b000815 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9" status: 200 len: 1454 microversion: 2.1 time: 0.056330 Apr 16 21:17:51.358658 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1675/3211] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:17:51 2022] GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9 => generated 1454 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:17:51.391097 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d7fc066b-560e-4c90-8942-df533023a6ab tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:51.399696 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d7fc066b-560e-4c90-8942-df533023a6ab tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1313 microversion: 2.1 time: 0.247361 Apr 16 21:17:51.412530 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1537/3212] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:51 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:51.433751 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-75794f6e-f683-458f-bc02-11abed85a865 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:51.434578 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-75794f6e-f683-458f-bc02-11abed85a865 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:51.447565 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-75794f6e-f683-458f-bc02-11abed85a865 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:51.448354 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-75794f6e-f683-458f-bc02-11abed85a865 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:51.449283 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-75794f6e-f683-458f-bc02-11abed85a865 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:51.449744 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-75794f6e-f683-458f-bc02-11abed85a865 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:51.739650 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9426ad44-cd4c-4d07-a6d8-40edb147d1cb tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:51.741649 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9426ad44-cd4c-4d07-a6d8-40edb147d1cb tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] [instance: 5e9fe25d-f215-444a-b161-5a76d2766905] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:51.748510 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9426ad44-cd4c-4d07-a6d8-40edb147d1cb tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:51.748987 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9426ad44-cd4c-4d07-a6d8-40edb147d1cb tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:51.750129 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9426ad44-cd4c-4d07-a6d8-40edb147d1cb tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:51.750777 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9426ad44-cd4c-4d07-a6d8-40edb147d1cb tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:51.753784 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-75794f6e-f683-458f-bc02-11abed85a865 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:51.765024 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-75794f6e-f683-458f-bc02-11abed85a865 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09" status: 200 len: 1565 microversion: 2.1 time: 0.336329 Apr 16 21:17:51.779410 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1676/3213] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:51 2022] GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09 => generated 1565 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:51.807213 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b901707c-b2eb-4ed1-851b-0481e742f284 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:51.807721 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b901707c-b2eb-4ed1-851b-0481e742f284 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:51.815832 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b901707c-b2eb-4ed1-851b-0481e742f284 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:51.816392 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b901707c-b2eb-4ed1-851b-0481e742f284 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:51.818383 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b901707c-b2eb-4ed1-851b-0481e742f284 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:51.819503 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b901707c-b2eb-4ed1-851b-0481e742f284 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:51.964196 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b901707c-b2eb-4ed1-851b-0481e742f284 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.183275 Apr 16 21:17:51.971233 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1677/3214] 10.222.0.20 () {58 vars in 1274 bytes} [Sat Apr 16 21:17:51 2022] GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09/os-interface => generated 284 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:17:51.977986 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cbb2b697-06a2-45fb-b955-3fa849b095dc tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:51.978800 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cbb2b697-06a2-45fb-b955-3fa849b095dc tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] [instance: 150835ec-2a90-46c5-8fe1-970a84f2e0cd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:51.985530 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cbb2b697-06a2-45fb-b955-3fa849b095dc tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:51.986067 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cbb2b697-06a2-45fb-b955-3fa849b095dc tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:51.987493 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cbb2b697-06a2-45fb-b955-3fa849b095dc tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:51.987721 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cbb2b697-06a2-45fb-b955-3fa849b095dc tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:52.023217 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9426ad44-cd4c-4d07-a6d8-40edb147d1cb tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0b023ad5d34809930c8d837c06c247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6391ed1060eb48748245ced6bceec92b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:52.032508 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9426ad44-cd4c-4d07-a6d8-40edb147d1cb tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] 10.222.0.20 "GET /compute/v2.1/servers/5e9fe25d-f215-444a-b161-5a76d2766905" status: 200 len: 1323 microversion: 2.1 time: 0.296711 Apr 16 21:17:52.035335 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1538/3215] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:51 2022] GET /compute/v2.1/servers/5e9fe25d-f215-444a-b161-5a76d2766905 => generated 1323 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:17:52.081018 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cbb2b697-06a2-45fb-b955-3fa849b095dc tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f6bbe8241a49c890032fb779c4bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc8f8d1fc734ce182645a464d35ead8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:52.089289 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cbb2b697-06a2-45fb-b955-3fa849b095dc tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] 10.222.0.20 "GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd" status: 200 len: 1336 microversion: 2.1 time: 0.115609 Apr 16 21:17:52.090194 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1678/3216] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:51 2022] GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd => generated 1336 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:17:52.372425 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5be2013c-412e-46cb-8854-e3ea5b6bc0ee tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb958089d0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:52.418761 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e7d4a8c2-cf23-47d6-9405-a45437ea703d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:52.419385 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e7d4a8c2-cf23-47d6-9405-a45437ea703d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:52.421327 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5be2013c-412e-46cb-8854-e3ea5b6bc0ee tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9" status: 200 len: 1454 microversion: 2.1 time: 0.054435 Apr 16 21:17:52.422191 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1539/3217] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:17:52 2022] GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9 => generated 1454 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:52.432615 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e7d4a8c2-cf23-47d6-9405-a45437ea703d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:52.433359 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e7d4a8c2-cf23-47d6-9405-a45437ea703d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:52.434298 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e7d4a8c2-cf23-47d6-9405-a45437ea703d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:52.434891 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e7d4a8c2-cf23-47d6-9405-a45437ea703d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:52.513091 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-3c8e937d-ea0b-4587-b512-dfdfcab28241 req-bfd9a0a4-de5a-4f73-85ea-0a70ef830bfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e9fe25d-f215-444a-b161-5a76d2766905", "tag": "23957a4d-6230-4dd9-89ec-dd700bca0441"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:52.523615 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-3c8e937d-ea0b-4587-b512-dfdfcab28241 req-bfd9a0a4-de5a-4f73-85ea-0a70ef830bfe service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:52.524219 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-3c8e937d-ea0b-4587-b512-dfdfcab28241 req-bfd9a0a4-de5a-4f73-85ea-0a70ef830bfe service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:52.539189 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-3c8e937d-ea0b-4587-b512-dfdfcab28241 req-bfd9a0a4-de5a-4f73-85ea-0a70ef830bfe service nova] Creating event network-changed:23957a4d-6230-4dd9-89ec-dd700bca0441 for instance 5e9fe25d-f215-444a-b161-5a76d2766905 on nch2-master-1 Apr 16 21:17:52.545465 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-3c8e937d-ea0b-4587-b512-dfdfcab28241 req-bfd9a0a4-de5a-4f73-85ea-0a70ef830bfe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037696 Apr 16 21:17:52.546484 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1540/3218] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:17:52.699193 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e7d4a8c2-cf23-47d6-9405-a45437ea703d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:52.709972 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e7d4a8c2-cf23-47d6-9405-a45437ea703d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1462 microversion: 2.1 time: 0.295107 Apr 16 21:17:52.711064 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1679/3219] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:52 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1462 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:52.729708 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c20d206b-0874-4bb0-af2a-7d96cbb7fb3e tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:52.730423 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c20d206b-0874-4bb0-af2a-7d96cbb7fb3e tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:52.737611 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c20d206b-0874-4bb0-af2a-7d96cbb7fb3e tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:52.738073 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c20d206b-0874-4bb0-af2a-7d96cbb7fb3e tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:52.739026 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c20d206b-0874-4bb0-af2a-7d96cbb7fb3e tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:52.739618 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c20d206b-0874-4bb0-af2a-7d96cbb7fb3e tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:53.051295 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-585f03cd-39cd-45b5-a5ee-6fdf7a4b64d2 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:53.051824 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-585f03cd-39cd-45b5-a5ee-6fdf7a4b64d2 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] [instance: 5e9fe25d-f215-444a-b161-5a76d2766905] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:53.059391 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-585f03cd-39cd-45b5-a5ee-6fdf7a4b64d2 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:53.059852 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-585f03cd-39cd-45b5-a5ee-6fdf7a4b64d2 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:53.061250 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-585f03cd-39cd-45b5-a5ee-6fdf7a4b64d2 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:53.061706 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-585f03cd-39cd-45b5-a5ee-6fdf7a4b64d2 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:53.135551 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c20d206b-0874-4bb0-af2a-7d96cbb7fb3e tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1613 microversion: 2.1 time: 0.410848 Apr 16 21:17:53.147905 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1541/3220] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:52 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1613 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:53.153255 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f6bf51e2-09f1-4b16-a37a-05519c931fbc tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:53.153997 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f6bf51e2-09f1-4b16-a37a-05519c931fbc tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] [instance: 150835ec-2a90-46c5-8fe1-970a84f2e0cd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:53.164134 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f6bf51e2-09f1-4b16-a37a-05519c931fbc tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:53.164769 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f6bf51e2-09f1-4b16-a37a-05519c931fbc tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:53.165690 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f6bf51e2-09f1-4b16-a37a-05519c931fbc tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:53.166141 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f6bf51e2-09f1-4b16-a37a-05519c931fbc tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:53.438736 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-585f03cd-39cd-45b5-a5ee-6fdf7a4b64d2 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0b023ad5d34809930c8d837c06c247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6391ed1060eb48748245ced6bceec92b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:53.448428 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-585f03cd-39cd-45b5-a5ee-6fdf7a4b64d2 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] 10.222.0.20 "GET /compute/v2.1/servers/5e9fe25d-f215-444a-b161-5a76d2766905" status: 200 len: 1323 microversion: 2.1 time: 0.401026 Apr 16 21:17:53.463078 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1680/3221] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:53 2022] GET /compute/v2.1/servers/5e9fe25d-f215-444a-b161-5a76d2766905 => generated 1323 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:53.469787 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9113c143-8652-45b2-9a75-52112a15f7f0 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:53.470384 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9113c143-8652-45b2-9a75-52112a15f7f0 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:53.477381 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9113c143-8652-45b2-9a75-52112a15f7f0 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:53.477902 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9113c143-8652-45b2-9a75-52112a15f7f0 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:53.479527 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9113c143-8652-45b2-9a75-52112a15f7f0 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:53.479527 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9113c143-8652-45b2-9a75-52112a15f7f0 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:53.580948 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9113c143-8652-45b2-9a75-52112a15f7f0 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'ba1a0392e17d41ada25d424bcb33bfc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '71cd46bc7fef45e58bd8582ba615acb7', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:53.580948 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9113c143-8652-45b2-9a75-52112a15f7f0 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] flavor_id is None. Assuming migration. {{(pid=137408) resize /opt/stack/nova/nova/compute/api.py:4140}} Apr 16 21:17:53.580948 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9113c143-8652-45b2-9a75-52112a15f7f0 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=137408) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 16 21:17:53.770345 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f6bf51e2-09f1-4b16-a37a-05519c931fbc tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f6bbe8241a49c890032fb779c4bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc8f8d1fc734ce182645a464d35ead8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:53.783783 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f6bf51e2-09f1-4b16-a37a-05519c931fbc tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] 10.222.0.20 "GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd" status: 200 len: 1403 microversion: 2.1 time: 0.634401 Apr 16 21:17:53.785328 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1542/3222] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:53 2022] GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd => generated 1403 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:53.791208 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-32f69956-902a-4a8b-a8a6-16f057bde32a tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb9584f430>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:53.864602 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-32f69956-902a-4a8b-a8a6-16f057bde32a tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9" status: 200 len: 1454 microversion: 2.1 time: 0.077790 Apr 16 21:17:53.865218 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1543/3223] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:17:53 2022] GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9 => generated 1454 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:54.143391 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9113c143-8652-45b2-9a75-52112a15f7f0 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2/action" status: 202 len: 0 microversion: 2.1 time: 0.678532 Apr 16 21:17:54.153278 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-44988107-b999-4afc-96af-8259bb4ca5da tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:54.154470 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-44988107-b999-4afc-96af-8259bb4ca5da tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:54.164060 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-44988107-b999-4afc-96af-8259bb4ca5da tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:54.170536 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1681/3224] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:17:53 2022] POST /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2/action => generated 0 bytes in 703 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:17:54.170667 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-44988107-b999-4afc-96af-8259bb4ca5da tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:54.172130 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-44988107-b999-4afc-96af-8259bb4ca5da tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:54.172130 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-44988107-b999-4afc-96af-8259bb4ca5da tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:54.468728 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9d6952e2-30cf-40a6-930a-87f13a9a2841 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:54.470167 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9d6952e2-30cf-40a6-930a-87f13a9a2841 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] [instance: 5e9fe25d-f215-444a-b161-5a76d2766905] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:54.519325 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9d6952e2-30cf-40a6-930a-87f13a9a2841 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:54.521753 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9d6952e2-30cf-40a6-930a-87f13a9a2841 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:54.524210 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9d6952e2-30cf-40a6-930a-87f13a9a2841 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:54.526006 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9d6952e2-30cf-40a6-930a-87f13a9a2841 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:54.591440 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-44988107-b999-4afc-96af-8259bb4ca5da tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:54.599153 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-44988107-b999-4afc-96af-8259bb4ca5da tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1471 microversion: 2.1 time: 0.450605 Apr 16 21:17:54.610635 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1544/3225] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:54 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1471 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:54.809409 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fb71bf2d-a569-4397-a1fe-dcd900fdd879 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:54.810031 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-fb71bf2d-a569-4397-a1fe-dcd900fdd879 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] [instance: 150835ec-2a90-46c5-8fe1-970a84f2e0cd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:54.824137 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fb71bf2d-a569-4397-a1fe-dcd900fdd879 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:54.824775 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fb71bf2d-a569-4397-a1fe-dcd900fdd879 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:54.825460 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fb71bf2d-a569-4397-a1fe-dcd900fdd879 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:54.825908 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fb71bf2d-a569-4397-a1fe-dcd900fdd879 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:54.990083 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-fb71bf2d-a569-4397-a1fe-dcd900fdd879 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f6bbe8241a49c890032fb779c4bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc8f8d1fc734ce182645a464d35ead8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:54.999973 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fb71bf2d-a569-4397-a1fe-dcd900fdd879 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] 10.222.0.20 "GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd" status: 200 len: 1403 microversion: 2.1 time: 0.201839 Apr 16 21:17:55.000971 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1545/3226] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:54 2022] GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd => generated 1403 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:55.006057 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-72830994-b873-4657-bee0-6ffccd746ebc req-93e91f7f-cece-4883-80d9-50382565b4a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c7cd9df-57f3-47a6-aa40-76ee208e2c09", "tag": "b83812ef-1c6d-4509-9af6-301ec0cf5b84"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:55.014361 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-72830994-b873-4657-bee0-6ffccd746ebc req-93e91f7f-cece-4883-80d9-50382565b4a6 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:55.014819 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-72830994-b873-4657-bee0-6ffccd746ebc req-93e91f7f-cece-4883-80d9-50382565b4a6 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:55.028476 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-72830994-b873-4657-bee0-6ffccd746ebc req-93e91f7f-cece-4883-80d9-50382565b4a6 service nova] Creating event network-changed:b83812ef-1c6d-4509-9af6-301ec0cf5b84 for instance 8c7cd9df-57f3-47a6-aa40-76ee208e2c09 on nch1-master-1 Apr 16 21:17:55.030549 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9d6952e2-30cf-40a6-930a-87f13a9a2841 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0b023ad5d34809930c8d837c06c247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6391ed1060eb48748245ced6bceec92b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:55.034465 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-72830994-b873-4657-bee0-6ffccd746ebc req-93e91f7f-cece-4883-80d9-50382565b4a6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032001 Apr 16 21:17:55.035812 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1546/3227] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:17:55.043212 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9d6952e2-30cf-40a6-930a-87f13a9a2841 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] 10.222.0.20 "GET /compute/v2.1/servers/5e9fe25d-f215-444a-b161-5a76d2766905" status: 200 len: 1323 microversion: 2.1 time: 0.580856 Apr 16 21:17:55.043607 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-375987d5-931b-45c3-afd8-4ba19faaaa61 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb9586e820>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:55.043754 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1682/3228] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:54 2022] GET /compute/v2.1/servers/5e9fe25d-f215-444a-b161-5a76d2766905 => generated 1323 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:55.136643 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-375987d5-931b-45c3-afd8-4ba19faaaa61 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9" status: 200 len: 1454 microversion: 2.1 time: 0.076963 Apr 16 21:17:55.136643 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1547/3229] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:17:55 2022] GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9 => generated 1454 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:55.140692 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-a1460aef-911d-4cba-bcd4-a514f663e833 req-10ddceb7-6e20-47e2-9ab0-8ca5d7affce1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "150835ec-2a90-46c5-8fe1-970a84f2e0cd", "tag": "0e7313ce-6b11-4893-959a-077cf629642f"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:55.151283 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-a1460aef-911d-4cba-bcd4-a514f663e833 req-10ddceb7-6e20-47e2-9ab0-8ca5d7affce1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:55.151887 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-a1460aef-911d-4cba-bcd4-a514f663e833 req-10ddceb7-6e20-47e2-9ab0-8ca5d7affce1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:55.170783 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-a1460aef-911d-4cba-bcd4-a514f663e833 req-10ddceb7-6e20-47e2-9ab0-8ca5d7affce1 service nova] Creating event network-changed:0e7313ce-6b11-4893-959a-077cf629642f for instance 150835ec-2a90-46c5-8fe1-970a84f2e0cd on nch2-master-1 Apr 16 21:17:55.181728 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-a1460aef-911d-4cba-bcd4-a514f663e833 req-10ddceb7-6e20-47e2-9ab0-8ca5d7affce1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047726 Apr 16 21:17:55.182353 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1683/3230] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:17:55.618696 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d5811f7f-ce91-4c42-a08c-e08ce9f417a6 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:55.620445 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d5811f7f-ce91-4c42-a08c-e08ce9f417a6 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:55.627878 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d5811f7f-ce91-4c42-a08c-e08ce9f417a6 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:55.628707 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d5811f7f-ce91-4c42-a08c-e08ce9f417a6 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:55.629747 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d5811f7f-ce91-4c42-a08c-e08ce9f417a6 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:55.630405 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d5811f7f-ce91-4c42-a08c-e08ce9f417a6 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:55.786949 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d5811f7f-ce91-4c42-a08c-e08ce9f417a6 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:55.795804 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d5811f7f-ce91-4c42-a08c-e08ce9f417a6 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1471 microversion: 2.1 time: 0.182340 Apr 16 21:17:55.797036 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1548/3231] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:55 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1471 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:56.018676 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c84d7aff-b197-4043-ba7c-ea6b91ae4bf2 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:56.019355 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c84d7aff-b197-4043-ba7c-ea6b91ae4bf2 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] [instance: 150835ec-2a90-46c5-8fe1-970a84f2e0cd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:56.025535 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c84d7aff-b197-4043-ba7c-ea6b91ae4bf2 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:56.025997 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c84d7aff-b197-4043-ba7c-ea6b91ae4bf2 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:56.027701 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c84d7aff-b197-4043-ba7c-ea6b91ae4bf2 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:56.027701 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c84d7aff-b197-4043-ba7c-ea6b91ae4bf2 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:56.061849 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-94858eff-05cb-479c-b454-54d2d2b1c250 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:56.062559 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-94858eff-05cb-479c-b454-54d2d2b1c250 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] [instance: 5e9fe25d-f215-444a-b161-5a76d2766905] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:56.069736 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-94858eff-05cb-479c-b454-54d2d2b1c250 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:56.070319 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-94858eff-05cb-479c-b454-54d2d2b1c250 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:56.071120 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-94858eff-05cb-479c-b454-54d2d2b1c250 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:56.071566 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-94858eff-05cb-479c-b454-54d2d2b1c250 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:56.165517 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c84d7aff-b197-4043-ba7c-ea6b91ae4bf2 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f6bbe8241a49c890032fb779c4bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc8f8d1fc734ce182645a464d35ead8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:56.180207 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c84d7aff-b197-4043-ba7c-ea6b91ae4bf2 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] 10.222.0.20 "GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd" status: 200 len: 1403 microversion: 2.1 time: 0.166752 Apr 16 21:17:56.180827 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1684/3232] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:56 2022] GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd => generated 1403 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:56.191975 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5b12de00-23d3-4d76-b14a-a6b75e147472 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb95a93160>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:56.235548 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-94858eff-05cb-479c-b454-54d2d2b1c250 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0b023ad5d34809930c8d837c06c247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6391ed1060eb48748245ced6bceec92b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:56.242176 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5b12de00-23d3-4d76-b14a-a6b75e147472 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9" status: 200 len: 1454 microversion: 2.1 time: 0.057679 Apr 16 21:17:56.242771 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1685/3233] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:17:56 2022] GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9 => generated 1454 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:56.250629 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-94858eff-05cb-479c-b454-54d2d2b1c250 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] 10.222.0.20 "GET /compute/v2.1/servers/5e9fe25d-f215-444a-b161-5a76d2766905" status: 200 len: 1323 microversion: 2.1 time: 0.192573 Apr 16 21:17:56.251213 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1549/3234] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:56 2022] GET /compute/v2.1/servers/5e9fe25d-f215-444a-b161-5a76d2766905 => generated 1323 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:17:56.312030 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-5ee9be83-7154-4f13-b44f-6ae4c67793c4 req-08712912-ea73-485c-a023-8a44feb1c383 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523", "name": "network-vif-plugged", "status": "completed", "tag": "0eab5a77-408a-45d7-86ff-b5c0a4b550d1"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:17:56.324312 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-5ee9be83-7154-4f13-b44f-6ae4c67793c4 req-08712912-ea73-485c-a023-8a44feb1c383 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:56.324312 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-5ee9be83-7154-4f13-b44f-6ae4c67793c4 req-08712912-ea73-485c-a023-8a44feb1c383 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:56.332094 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-5ee9be83-7154-4f13-b44f-6ae4c67793c4 req-08712912-ea73-485c-a023-8a44feb1c383 service nova] Creating event network-vif-plugged:0eab5a77-408a-45d7-86ff-b5c0a4b550d1 for instance 9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523 on nch2-master-1 Apr 16 21:17:56.337162 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-5ee9be83-7154-4f13-b44f-6ae4c67793c4 req-08712912-ea73-485c-a023-8a44feb1c383 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028853 Apr 16 21:17:56.337781 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1686/3235] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:17:56.813501 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1cdfa726-a713-4156-87d0-e075e8d96e9f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:56.814084 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1cdfa726-a713-4156-87d0-e075e8d96e9f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:56.820060 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1cdfa726-a713-4156-87d0-e075e8d96e9f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:56.820553 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1cdfa726-a713-4156-87d0-e075e8d96e9f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:56.821321 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1cdfa726-a713-4156-87d0-e075e8d96e9f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:56.821763 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1cdfa726-a713-4156-87d0-e075e8d96e9f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:56.948279 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1cdfa726-a713-4156-87d0-e075e8d96e9f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:56.956940 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1cdfa726-a713-4156-87d0-e075e8d96e9f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1471 microversion: 2.1 time: 0.147430 Apr 16 21:17:56.957518 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1550/3236] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:56 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1471 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:57.197982 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3d40362d-0de4-4526-9e59-be41a1272e2d tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:57.198685 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3d40362d-0de4-4526-9e59-be41a1272e2d tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] [instance: 150835ec-2a90-46c5-8fe1-970a84f2e0cd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:57.205782 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d40362d-0de4-4526-9e59-be41a1272e2d tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:57.206240 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d40362d-0de4-4526-9e59-be41a1272e2d tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:57.207017 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d40362d-0de4-4526-9e59-be41a1272e2d tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:57.207456 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d40362d-0de4-4526-9e59-be41a1272e2d tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:57.254884 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d226245f-8367-4eee-9ce7-f5080a321319 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb9586ec10>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:57.300715 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d226245f-8367-4eee-9ce7-f5080a321319 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9" status: 200 len: 1454 microversion: 2.1 time: 0.049669 Apr 16 21:17:57.301290 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1551/3237] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:17:57 2022] GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9 => generated 1454 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:17:57.305708 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8195649d-fccb-4608-82bc-60dbea2265ef tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:57.306312 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8195649d-fccb-4608-82bc-60dbea2265ef tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] [instance: 5e9fe25d-f215-444a-b161-5a76d2766905] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:57.313358 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8195649d-fccb-4608-82bc-60dbea2265ef tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:57.313861 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8195649d-fccb-4608-82bc-60dbea2265ef tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:57.314637 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8195649d-fccb-4608-82bc-60dbea2265ef tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:57.315076 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8195649d-fccb-4608-82bc-60dbea2265ef tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:57.348697 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3d40362d-0de4-4526-9e59-be41a1272e2d tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f6bbe8241a49c890032fb779c4bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc8f8d1fc734ce182645a464d35ead8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:57.357552 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3d40362d-0de4-4526-9e59-be41a1272e2d tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] 10.222.0.20 "GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd" status: 200 len: 1403 microversion: 2.1 time: 0.164289 Apr 16 21:17:57.358209 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1687/3238] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:57 2022] GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd => generated 1403 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:57.447942 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8195649d-fccb-4608-82bc-60dbea2265ef tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0b023ad5d34809930c8d837c06c247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6391ed1060eb48748245ced6bceec92b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:57.455272 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8195649d-fccb-4608-82bc-60dbea2265ef tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] 10.222.0.20 "GET /compute/v2.1/servers/5e9fe25d-f215-444a-b161-5a76d2766905" status: 200 len: 1323 microversion: 2.1 time: 0.153048 Apr 16 21:17:57.455838 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1552/3239] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:57 2022] GET /compute/v2.1/servers/5e9fe25d-f215-444a-b161-5a76d2766905 => generated 1323 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:57.975214 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c047d9e1-fed5-478f-8de4-bef2833152c7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:57.975869 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c047d9e1-fed5-478f-8de4-bef2833152c7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:57.982056 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c047d9e1-fed5-478f-8de4-bef2833152c7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:57.982527 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c047d9e1-fed5-478f-8de4-bef2833152c7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:57.983317 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c047d9e1-fed5-478f-8de4-bef2833152c7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:57.983768 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c047d9e1-fed5-478f-8de4-bef2833152c7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:58.296982 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c047d9e1-fed5-478f-8de4-bef2833152c7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:58.306329 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c047d9e1-fed5-478f-8de4-bef2833152c7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1471 microversion: 2.1 time: 0.335619 Apr 16 21:17:58.316423 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1688/3240] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:57 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1471 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:58.321151 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3df39723-107a-4b40-bab7-62f3a48d2cb5 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb9586ef70>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:58.368359 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3df39723-107a-4b40-bab7-62f3a48d2cb5 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9" status: 200 len: 1454 microversion: 2.1 time: 0.051088 Apr 16 21:17:58.372283 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1553/3241] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:17:58 2022] GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9 => generated 1454 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:58.378855 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8db358f6-337e-46a8-8ae2-4ddce6723f35 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:58.379506 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8db358f6-337e-46a8-8ae2-4ddce6723f35 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] [instance: 150835ec-2a90-46c5-8fe1-970a84f2e0cd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:58.385694 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8db358f6-337e-46a8-8ae2-4ddce6723f35 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:58.386153 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8db358f6-337e-46a8-8ae2-4ddce6723f35 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:58.386933 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8db358f6-337e-46a8-8ae2-4ddce6723f35 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:58.387377 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8db358f6-337e-46a8-8ae2-4ddce6723f35 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:58.473154 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-80a76868-ebff-4d95-8733-8c127e944db7 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:58.473811 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-80a76868-ebff-4d95-8733-8c127e944db7 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] [instance: 5e9fe25d-f215-444a-b161-5a76d2766905] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:58.495116 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-80a76868-ebff-4d95-8733-8c127e944db7 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:58.495116 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-80a76868-ebff-4d95-8733-8c127e944db7 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:58.495116 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-80a76868-ebff-4d95-8733-8c127e944db7 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:58.495116 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-80a76868-ebff-4d95-8733-8c127e944db7 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:58.623898 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8db358f6-337e-46a8-8ae2-4ddce6723f35 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f6bbe8241a49c890032fb779c4bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc8f8d1fc734ce182645a464d35ead8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:58.632324 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-80a76868-ebff-4d95-8733-8c127e944db7 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0b023ad5d34809930c8d837c06c247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6391ed1060eb48748245ced6bceec92b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:58.640097 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8db358f6-337e-46a8-8ae2-4ddce6723f35 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] 10.222.0.20 "GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd" status: 200 len: 1403 microversion: 2.1 time: 0.264992 Apr 16 21:17:58.640823 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-80a76868-ebff-4d95-8733-8c127e944db7 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] 10.222.0.20 "GET /compute/v2.1/servers/5e9fe25d-f215-444a-b161-5a76d2766905" status: 200 len: 1323 microversion: 2.1 time: 0.172237 Apr 16 21:17:58.640948 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1689/3242] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:58 2022] GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd => generated 1403 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:58.641798 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1554/3243] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:58 2022] GET /compute/v2.1/servers/5e9fe25d-f215-444a-b161-5a76d2766905 => generated 1323 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:59.323620 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-791055f5-31c1-49a0-b2b2-29d58893aaee tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:59.324383 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-791055f5-31c1-49a0-b2b2-29d58893aaee tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:59.331418 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-791055f5-31c1-49a0-b2b2-29d58893aaee tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:59.331958 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-791055f5-31c1-49a0-b2b2-29d58893aaee tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:59.332777 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-791055f5-31c1-49a0-b2b2-29d58893aaee tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:59.333219 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-791055f5-31c1-49a0-b2b2-29d58893aaee tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:59.389087 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-de29d02c-cd5f-4277-902d-de765824ecd3 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb9586e040>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:59.429586 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-de29d02c-cd5f-4277-902d-de765824ecd3 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9" status: 200 len: 1454 microversion: 2.1 time: 0.051395 Apr 16 21:17:59.435184 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1555/3244] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:17:59 2022] GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9 => generated 1454 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:17:59.480482 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-791055f5-31c1-49a0-b2b2-29d58893aaee tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:59.488344 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-791055f5-31c1-49a0-b2b2-29d58893aaee tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1471 microversion: 2.1 time: 0.168828 Apr 16 21:17:59.488930 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1690/3245] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:59 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1471 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:59.658839 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-22963792-279d-4736-b661-5f993b0aa410 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:59.659213 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ae2a2d46-6543-4f0f-8d64-179f4dd740b3 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:17:59.659563 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-22963792-279d-4736-b661-5f993b0aa410 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] [instance: 5e9fe25d-f215-444a-b161-5a76d2766905] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:59.659839 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ae2a2d46-6543-4f0f-8d64-179f4dd740b3 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] [instance: 150835ec-2a90-46c5-8fe1-970a84f2e0cd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:17:59.667153 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-22963792-279d-4736-b661-5f993b0aa410 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:59.667618 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-22963792-279d-4736-b661-5f993b0aa410 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:59.667819 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ae2a2d46-6543-4f0f-8d64-179f4dd740b3 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:59.668410 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ae2a2d46-6543-4f0f-8d64-179f4dd740b3 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:59.668530 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-22963792-279d-4736-b661-5f993b0aa410 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:59.674099 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-22963792-279d-4736-b661-5f993b0aa410 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:59.674264 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ae2a2d46-6543-4f0f-8d64-179f4dd740b3 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:17:59.674264 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ae2a2d46-6543-4f0f-8d64-179f4dd740b3 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:17:59.803987 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-22963792-279d-4736-b661-5f993b0aa410 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0b023ad5d34809930c8d837c06c247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6391ed1060eb48748245ced6bceec92b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:59.812337 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-22963792-279d-4736-b661-5f993b0aa410 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] 10.222.0.20 "GET /compute/v2.1/servers/5e9fe25d-f215-444a-b161-5a76d2766905" status: 200 len: 1323 microversion: 2.1 time: 0.157681 Apr 16 21:17:59.812925 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1691/3246] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:59 2022] GET /compute/v2.1/servers/5e9fe25d-f215-444a-b161-5a76d2766905 => generated 1323 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:17:59.881649 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ae2a2d46-6543-4f0f-8d64-179f4dd740b3 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f6bbe8241a49c890032fb779c4bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc8f8d1fc734ce182645a464d35ead8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:17:59.891398 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ae2a2d46-6543-4f0f-8d64-179f4dd740b3 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] 10.222.0.20 "GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd" status: 200 len: 1403 microversion: 2.1 time: 0.234402 Apr 16 21:17:59.891398 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1556/3247] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:17:59 2022] GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd => generated 1403 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:00.443694 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3c7c40ad-db2a-4b1e-b273-488e3cec46ad tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb9594cb80>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:00.487222 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3c7c40ad-db2a-4b1e-b273-488e3cec46ad tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9" status: 200 len: 1454 microversion: 2.1 time: 0.048282 Apr 16 21:18:00.488194 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1692/3248] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:00 2022] GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9 => generated 1454 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:00.506308 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-56e6e5c6-2b60-40a4-8282-252b105994e2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:00.507477 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-56e6e5c6-2b60-40a4-8282-252b105994e2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:00.514318 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-56e6e5c6-2b60-40a4-8282-252b105994e2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:00.516872 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-56e6e5c6-2b60-40a4-8282-252b105994e2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:00.516872 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-56e6e5c6-2b60-40a4-8282-252b105994e2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:00.516872 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-56e6e5c6-2b60-40a4-8282-252b105994e2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:00.647700 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-56e6e5c6-2b60-40a4-8282-252b105994e2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:00.655427 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-56e6e5c6-2b60-40a4-8282-252b105994e2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1476 microversion: 2.1 time: 0.153495 Apr 16 21:18:00.655997 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1557/3249] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:00 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1476 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:00.828971 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c9e6de24-9fc6-45ea-bec0-6a464e1421fc tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:00.829541 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c9e6de24-9fc6-45ea-bec0-6a464e1421fc tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] [instance: 5e9fe25d-f215-444a-b161-5a76d2766905] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:00.836544 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c9e6de24-9fc6-45ea-bec0-6a464e1421fc tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:00.837001 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c9e6de24-9fc6-45ea-bec0-6a464e1421fc tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:00.837792 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c9e6de24-9fc6-45ea-bec0-6a464e1421fc tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:00.838238 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c9e6de24-9fc6-45ea-bec0-6a464e1421fc tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:00.906867 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f1ce9fd3-66e8-4d42-a0bf-e23bebefee91 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:00.907585 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f1ce9fd3-66e8-4d42-a0bf-e23bebefee91 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] [instance: 150835ec-2a90-46c5-8fe1-970a84f2e0cd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:00.913939 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f1ce9fd3-66e8-4d42-a0bf-e23bebefee91 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:00.916873 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f1ce9fd3-66e8-4d42-a0bf-e23bebefee91 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:00.916873 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f1ce9fd3-66e8-4d42-a0bf-e23bebefee91 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:00.916873 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f1ce9fd3-66e8-4d42-a0bf-e23bebefee91 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:00.975692 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c9e6de24-9fc6-45ea-bec0-6a464e1421fc tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0b023ad5d34809930c8d837c06c247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6391ed1060eb48748245ced6bceec92b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:00.983967 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c9e6de24-9fc6-45ea-bec0-6a464e1421fc tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] 10.222.0.20 "GET /compute/v2.1/servers/5e9fe25d-f215-444a-b161-5a76d2766905" status: 200 len: 1323 microversion: 2.1 time: 0.159053 Apr 16 21:18:00.984659 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1693/3250] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:00 2022] GET /compute/v2.1/servers/5e9fe25d-f215-444a-b161-5a76d2766905 => generated 1323 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:01.045710 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f1ce9fd3-66e8-4d42-a0bf-e23bebefee91 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f6bbe8241a49c890032fb779c4bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc8f8d1fc734ce182645a464d35ead8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:01.053736 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f1ce9fd3-66e8-4d42-a0bf-e23bebefee91 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] 10.222.0.20 "GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd" status: 200 len: 1403 microversion: 2.1 time: 0.151421 Apr 16 21:18:01.054314 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1558/3251] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:00 2022] GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd => generated 1403 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:01.158613 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-15f9f5e2-6d58-47af-b2af-ade6229a62f0 req-f3edad82-2c8d-48ec-884c-133a550633f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e9fe25d-f215-444a-b161-5a76d2766905", "name": "network-vif-plugged", "status": "completed", "tag": "23957a4d-6230-4dd9-89ec-dd700bca0441"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:18:01.167344 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-15f9f5e2-6d58-47af-b2af-ade6229a62f0 req-f3edad82-2c8d-48ec-884c-133a550633f6 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:01.167800 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-15f9f5e2-6d58-47af-b2af-ade6229a62f0 req-f3edad82-2c8d-48ec-884c-133a550633f6 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:01.179368 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-15f9f5e2-6d58-47af-b2af-ade6229a62f0 req-f3edad82-2c8d-48ec-884c-133a550633f6 service nova] Creating event network-vif-plugged:23957a4d-6230-4dd9-89ec-dd700bca0441 for instance 5e9fe25d-f215-444a-b161-5a76d2766905 on nch2-master-1 Apr 16 21:18:01.184634 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-15f9f5e2-6d58-47af-b2af-ade6229a62f0 req-f3edad82-2c8d-48ec-884c-133a550633f6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030243 Apr 16 21:18:01.191460 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1694/3252] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:18:01.500139 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ca3f1c93-3f11-4875-9a35-b8d84316f70a tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb958f1d30>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:01.543352 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ca3f1c93-3f11-4875-9a35-b8d84316f70a tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9" status: 200 len: 1454 microversion: 2.1 time: 0.047218 Apr 16 21:18:01.544258 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1559/3253] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:01 2022] GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9 => generated 1454 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:01.673777 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3d88dffa-aa91-4c06-b9f3-6b697a8bff0d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:01.674481 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3d88dffa-aa91-4c06-b9f3-6b697a8bff0d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:01.680839 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d88dffa-aa91-4c06-b9f3-6b697a8bff0d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:01.681297 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d88dffa-aa91-4c06-b9f3-6b697a8bff0d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:01.682070 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d88dffa-aa91-4c06-b9f3-6b697a8bff0d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:01.682508 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d88dffa-aa91-4c06-b9f3-6b697a8bff0d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:01.810722 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3d88dffa-aa91-4c06-b9f3-6b697a8bff0d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:01.818946 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3d88dffa-aa91-4c06-b9f3-6b697a8bff0d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1476 microversion: 2.1 time: 0.149651 Apr 16 21:18:01.819563 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1695/3254] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:01 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1476 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:02.001839 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-15001470-6aa8-42e7-bdd2-e351999f671c tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:02.002457 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-15001470-6aa8-42e7-bdd2-e351999f671c tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] [instance: 5e9fe25d-f215-444a-b161-5a76d2766905] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:02.009918 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-15001470-6aa8-42e7-bdd2-e351999f671c tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:02.010382 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-15001470-6aa8-42e7-bdd2-e351999f671c tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:02.011210 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-15001470-6aa8-42e7-bdd2-e351999f671c tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:02.011733 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-15001470-6aa8-42e7-bdd2-e351999f671c tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:02.070685 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a22caac8-22fe-48a2-8dae-c9c2699fb55d tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:02.071311 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a22caac8-22fe-48a2-8dae-c9c2699fb55d tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] [instance: 150835ec-2a90-46c5-8fe1-970a84f2e0cd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:02.077551 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a22caac8-22fe-48a2-8dae-c9c2699fb55d tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:02.078014 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a22caac8-22fe-48a2-8dae-c9c2699fb55d tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:02.078796 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a22caac8-22fe-48a2-8dae-c9c2699fb55d tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:02.079238 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a22caac8-22fe-48a2-8dae-c9c2699fb55d tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:02.145854 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-15001470-6aa8-42e7-bdd2-e351999f671c tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0b023ad5d34809930c8d837c06c247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6391ed1060eb48748245ced6bceec92b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:02.153884 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-15001470-6aa8-42e7-bdd2-e351999f671c tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] 10.222.0.20 "GET /compute/v2.1/servers/5e9fe25d-f215-444a-b161-5a76d2766905" status: 200 len: 1323 microversion: 2.1 time: 0.156121 Apr 16 21:18:02.154805 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1560/3255] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:01 2022] GET /compute/v2.1/servers/5e9fe25d-f215-444a-b161-5a76d2766905 => generated 1323 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:02.211812 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a22caac8-22fe-48a2-8dae-c9c2699fb55d tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f6bbe8241a49c890032fb779c4bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc8f8d1fc734ce182645a464d35ead8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:02.219419 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a22caac8-22fe-48a2-8dae-c9c2699fb55d tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] 10.222.0.20 "GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd" status: 200 len: 1403 microversion: 2.1 time: 0.153170 Apr 16 21:18:02.219995 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1696/3256] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:02 2022] GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd => generated 1403 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:18:02.557016 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b23c54ec-0f07-48ac-ab32-a7d4de58a5c8 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb9580baf0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:02.600760 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b23c54ec-0f07-48ac-ab32-a7d4de58a5c8 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9" status: 200 len: 1454 microversion: 2.1 time: 0.048239 Apr 16 21:18:02.601340 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1561/3257] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:02 2022] GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9 => generated 1454 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:02.836588 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f833f653-cf9b-4e3f-a708-848d8afa84ba tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:02.837224 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f833f653-cf9b-4e3f-a708-848d8afa84ba tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:02.844073 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f833f653-cf9b-4e3f-a708-848d8afa84ba tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:02.844581 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f833f653-cf9b-4e3f-a708-848d8afa84ba tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:02.845518 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f833f653-cf9b-4e3f-a708-848d8afa84ba tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:02.845974 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f833f653-cf9b-4e3f-a708-848d8afa84ba tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:02.974165 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f833f653-cf9b-4e3f-a708-848d8afa84ba tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:02.982501 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f833f653-cf9b-4e3f-a708-848d8afa84ba tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1476 microversion: 2.1 time: 0.150595 Apr 16 21:18:02.983087 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1697/3258] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:02 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1476 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:03.170393 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0088b683-5953-4268-a1ad-9df6360cb2ff tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:03.171009 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0088b683-5953-4268-a1ad-9df6360cb2ff tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] [instance: 5e9fe25d-f215-444a-b161-5a76d2766905] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:03.177043 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0088b683-5953-4268-a1ad-9df6360cb2ff tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:03.181905 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0088b683-5953-4268-a1ad-9df6360cb2ff tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:03.181905 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0088b683-5953-4268-a1ad-9df6360cb2ff tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:03.181905 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0088b683-5953-4268-a1ad-9df6360cb2ff tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:03.235172 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2841e7b4-71a8-48ea-95ab-7244563a8b3a tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:03.235804 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2841e7b4-71a8-48ea-95ab-7244563a8b3a tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] [instance: 150835ec-2a90-46c5-8fe1-970a84f2e0cd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:03.245342 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2841e7b4-71a8-48ea-95ab-7244563a8b3a tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:03.245342 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2841e7b4-71a8-48ea-95ab-7244563a8b3a tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:03.245342 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2841e7b4-71a8-48ea-95ab-7244563a8b3a tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:03.245342 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2841e7b4-71a8-48ea-95ab-7244563a8b3a tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:03.315815 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0088b683-5953-4268-a1ad-9df6360cb2ff tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0b023ad5d34809930c8d837c06c247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6391ed1060eb48748245ced6bceec92b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:03.323689 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0088b683-5953-4268-a1ad-9df6360cb2ff tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] 10.222.0.20 "GET /compute/v2.1/servers/5e9fe25d-f215-444a-b161-5a76d2766905" status: 200 len: 1323 microversion: 2.1 time: 0.157247 Apr 16 21:18:03.324480 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1562/3259] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:03 2022] GET /compute/v2.1/servers/5e9fe25d-f215-444a-b161-5a76d2766905 => generated 1323 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:03.378088 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2841e7b4-71a8-48ea-95ab-7244563a8b3a tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f6bbe8241a49c890032fb779c4bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc8f8d1fc734ce182645a464d35ead8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:03.386027 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2841e7b4-71a8-48ea-95ab-7244563a8b3a tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] 10.222.0.20 "GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd" status: 200 len: 1403 microversion: 2.1 time: 0.154871 Apr 16 21:18:03.386602 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1698/3260] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:03 2022] GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd => generated 1403 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:18:03.614016 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-81fa0671-44df-4295-9ed8-bb0f4a4a67a0 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb9579c5e0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:03.658354 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-81fa0671-44df-4295-9ed8-bb0f4a4a67a0 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9" status: 200 len: 1454 microversion: 2.1 time: 0.048228 Apr 16 21:18:03.658938 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1563/3261] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:03 2022] GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9 => generated 1454 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:03.998805 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-25a5be61-11a6-43d6-8512-714da050edc5 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:03.999505 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-25a5be61-11a6-43d6-8512-714da050edc5 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:04.007376 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-25a5be61-11a6-43d6-8512-714da050edc5 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:04.007865 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-25a5be61-11a6-43d6-8512-714da050edc5 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:04.008708 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-25a5be61-11a6-43d6-8512-714da050edc5 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:04.009179 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-25a5be61-11a6-43d6-8512-714da050edc5 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:04.148773 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-25a5be61-11a6-43d6-8512-714da050edc5 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:04.156824 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-25a5be61-11a6-43d6-8512-714da050edc5 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1476 microversion: 2.1 time: 0.161926 Apr 16 21:18:04.159382 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1699/3262] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:03 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1476 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:04.341246 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-70f6a53c-3602-4cd2-908d-05c8c3485b31 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:04.341901 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-70f6a53c-3602-4cd2-908d-05c8c3485b31 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] [instance: 5e9fe25d-f215-444a-b161-5a76d2766905] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:04.348604 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-70f6a53c-3602-4cd2-908d-05c8c3485b31 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:04.349172 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-70f6a53c-3602-4cd2-908d-05c8c3485b31 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:04.350562 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-70f6a53c-3602-4cd2-908d-05c8c3485b31 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:04.351005 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-70f6a53c-3602-4cd2-908d-05c8c3485b31 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:04.411508 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-655c3003-11c6-4a79-958d-c36d00e4dc7b tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:04.412980 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-655c3003-11c6-4a79-958d-c36d00e4dc7b tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] [instance: 150835ec-2a90-46c5-8fe1-970a84f2e0cd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:04.419475 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-655c3003-11c6-4a79-958d-c36d00e4dc7b tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:04.419933 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-655c3003-11c6-4a79-958d-c36d00e4dc7b tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:04.420925 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-655c3003-11c6-4a79-958d-c36d00e4dc7b tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:04.421545 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-655c3003-11c6-4a79-958d-c36d00e4dc7b tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:04.496897 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-70f6a53c-3602-4cd2-908d-05c8c3485b31 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0b023ad5d34809930c8d837c06c247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6391ed1060eb48748245ced6bceec92b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:04.503111 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-70f6a53c-3602-4cd2-908d-05c8c3485b31 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] 10.222.0.20 "GET /compute/v2.1/servers/5e9fe25d-f215-444a-b161-5a76d2766905" status: 200 len: 1323 microversion: 2.1 time: 0.165870 Apr 16 21:18:04.503866 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1564/3263] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:04 2022] GET /compute/v2.1/servers/5e9fe25d-f215-444a-b161-5a76d2766905 => generated 1323 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:04.564597 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-655c3003-11c6-4a79-958d-c36d00e4dc7b tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f6bbe8241a49c890032fb779c4bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc8f8d1fc734ce182645a464d35ead8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:04.573354 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-655c3003-11c6-4a79-958d-c36d00e4dc7b tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] 10.222.0.20 "GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd" status: 200 len: 1403 microversion: 2.1 time: 0.165574 Apr 16 21:18:04.574999 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1700/3264] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:04 2022] GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd => generated 1403 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:04.672018 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e54bb549-0f87-4033-ae07-6f162de65cff tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb95808dc0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:04.715041 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e54bb549-0f87-4033-ae07-6f162de65cff tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9" status: 200 len: 1454 microversion: 2.1 time: 0.046724 Apr 16 21:18:04.719384 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1565/3265] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:04 2022] GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9 => generated 1454 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:18:05.176396 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d5415d54-3f73-46ab-b2bb-0ee286fe79d7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:05.177024 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d5415d54-3f73-46ab-b2bb-0ee286fe79d7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:05.186899 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d5415d54-3f73-46ab-b2bb-0ee286fe79d7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:05.187680 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d5415d54-3f73-46ab-b2bb-0ee286fe79d7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:05.188707 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d5415d54-3f73-46ab-b2bb-0ee286fe79d7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:05.189155 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d5415d54-3f73-46ab-b2bb-0ee286fe79d7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:05.343332 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d5415d54-3f73-46ab-b2bb-0ee286fe79d7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:05.358861 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d5415d54-3f73-46ab-b2bb-0ee286fe79d7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1476 microversion: 2.1 time: 0.188271 Apr 16 21:18:05.359738 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1701/3266] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:05 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1476 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:05.521756 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-734eb9ef-2a0e-494c-8fac-9a56ee231dac tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:05.526949 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-734eb9ef-2a0e-494c-8fac-9a56ee231dac tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] [instance: 5e9fe25d-f215-444a-b161-5a76d2766905] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:05.529989 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-734eb9ef-2a0e-494c-8fac-9a56ee231dac tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:05.530649 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-734eb9ef-2a0e-494c-8fac-9a56ee231dac tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:05.531604 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-734eb9ef-2a0e-494c-8fac-9a56ee231dac tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:05.532215 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-734eb9ef-2a0e-494c-8fac-9a56ee231dac tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:05.597060 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b5562467-90a0-40b4-830d-0a91d2f10553 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:05.597661 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b5562467-90a0-40b4-830d-0a91d2f10553 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] [instance: 150835ec-2a90-46c5-8fe1-970a84f2e0cd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:05.606083 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5562467-90a0-40b4-830d-0a91d2f10553 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:05.606546 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5562467-90a0-40b4-830d-0a91d2f10553 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:05.607342 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5562467-90a0-40b4-830d-0a91d2f10553 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:05.608210 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5562467-90a0-40b4-830d-0a91d2f10553 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:05.708756 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-734eb9ef-2a0e-494c-8fac-9a56ee231dac tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0b023ad5d34809930c8d837c06c247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6391ed1060eb48748245ced6bceec92b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:05.717326 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-734eb9ef-2a0e-494c-8fac-9a56ee231dac tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] 10.222.0.20 "GET /compute/v2.1/servers/5e9fe25d-f215-444a-b161-5a76d2766905" status: 200 len: 1519 microversion: 2.1 time: 0.201079 Apr 16 21:18:05.719260 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1566/3267] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:05 2022] GET /compute/v2.1/servers/5e9fe25d-f215-444a-b161-5a76d2766905 => generated 1519 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:05.725179 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-d55d39d6-2c7d-449e-9016-b826edfed499 req-137db957-520f-4143-890d-c995c6893e69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "150835ec-2a90-46c5-8fe1-970a84f2e0cd", "name": "network-vif-plugged", "status": "completed", "tag": "0e7313ce-6b11-4893-959a-077cf629642f"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:18:05.734004 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-d55d39d6-2c7d-449e-9016-b826edfed499 req-137db957-520f-4143-890d-c995c6893e69 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:05.734711 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-d55d39d6-2c7d-449e-9016-b826edfed499 req-137db957-520f-4143-890d-c995c6893e69 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:05.753162 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-d55d39d6-2c7d-449e-9016-b826edfed499 req-137db957-520f-4143-890d-c995c6893e69 service nova] Creating event network-vif-plugged:0e7313ce-6b11-4893-959a-077cf629642f for instance 150835ec-2a90-46c5-8fe1-970a84f2e0cd on nch2-master-1 Apr 16 21:18:05.762647 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-d55d39d6-2c7d-449e-9016-b826edfed499 req-137db957-520f-4143-890d-c995c6893e69 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040953 Apr 16 21:18:05.763554 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1567/3268] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:18:05.770694 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-92bfb8be-1db5-40e6-a07b-a1a514c5da1e tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb959739d0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:05.819644 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b5562467-90a0-40b4-830d-0a91d2f10553 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f6bbe8241a49c890032fb779c4bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc8f8d1fc734ce182645a464d35ead8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:05.829611 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b5562467-90a0-40b4-830d-0a91d2f10553 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] 10.222.0.20 "GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd" status: 200 len: 1403 microversion: 2.1 time: 0.236689 Apr 16 21:18:05.850214 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1702/3269] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:05 2022] GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd => generated 1403 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:18:05.862883 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ba266d6b-cae5-448e-bc55-e9644bbc812a tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-268201150", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "faa6ac51-0e46-43d3-bed2-87e1b1a96e0a"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:18:05.876132 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-92bfb8be-1db5-40e6-a07b-a1a514c5da1e tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9" status: 200 len: 1454 microversion: 2.1 time: 0.110660 Apr 16 21:18:05.876697 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1568/3270] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:05 2022] GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9 => generated 1454 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:05.878720 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ba266d6b-cae5-448e-bc55-e9644bbc812a tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:18:05.880161 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ba266d6b-cae5-448e-bc55-e9644bbc812a tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.032000 Apr 16 21:18:05.881955 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1703/3271] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:18:05 2022] POST /compute/v2.1/servers => generated 175 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:18:05.898717 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3ea589ae-d868-4bb3-9851-27fcdf7e5c1e tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:05.901653 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3ea589ae-d868-4bb3-9851-27fcdf7e5c1e tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] [instance: 6b317a25-5d61-4e06-bcf5-c45a2e02cbd9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:05.908754 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-3ea589ae-d868-4bb3-9851-27fcdf7e5c1e tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] HTTP exception thrown: Instance 6b317a25-5d61-4e06-bcf5-c45a2e02cbd9 could not be found. Apr 16 21:18:05.909744 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3ea589ae-d868-4bb3-9851-27fcdf7e5c1e tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Returning 404 to user: Instance 6b317a25-5d61-4e06-bcf5-c45a2e02cbd9 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:18:05.910981 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3ea589ae-d868-4bb3-9851-27fcdf7e5c1e tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] 10.222.0.20 "GET /compute/v2.1/servers/6b317a25-5d61-4e06-bcf5-c45a2e02cbd9/metadata" status: 404 len: 111 microversion: 2.1 time: 0.016296 Apr 16 21:18:05.911790 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1569/3272] 10.222.0.20 () {58 vars in 1262 bytes} [Sat Apr 16 21:18:05 2022] GET /compute/v2.1/servers/6b317a25-5d61-4e06-bcf5-c45a2e02cbd9/metadata => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:18:05.974026 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-aef7c5c7-0159-4483-980e-36bbac5266b3 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2072830172", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "faa6ac51-0e46-43d3-bed2-87e1b1a96e0a"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:18:05.975268 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-aef7c5c7-0159-4483-980e-36bbac5266b3 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:18:06.033947 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-aef7c5c7-0159-4483-980e-36bbac5266b3 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.006591 Apr 16 21:18:06.033947 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1704/3273] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:18:05 2022] POST /compute/v2.1/servers => generated 687 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:18:06.035564 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c3c0f53e-2b90-445c-acb1-ed9883695b0e tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-612813196", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "faa6ac51-0e46-43d3-bed2-87e1b1a96e0a"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:18:06.038256 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c3c0f53e-2b90-445c-acb1-ed9883695b0e tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:18:06.039328 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c3c0f53e-2b90-445c-acb1-ed9883695b0e tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.009147 Apr 16 21:18:06.039954 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1570/3274] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:18:06 2022] POST /compute/v2.1/servers => generated 689 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:18:06.098044 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-85d1fd86-dafb-4d37-bcc7-c666fcb8bea6 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1006392092", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "faa6ac51-0e46-43d3-bed2-87e1b1a96e0a"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:18:06.098044 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-85d1fd86-dafb-4d37-bcc7-c666fcb8bea6 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:18:06.099010 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-85d1fd86-dafb-4d37-bcc7-c666fcb8bea6 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.010535 Apr 16 21:18:06.104745 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1705/3275] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:18:06 2022] POST /compute/v2.1/servers => generated 1197 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Apr 16 21:18:06.165934 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0a35ab77-2778-4ce3-b8f1-ed4b5c6b561b tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-464356125", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "faa6ac51-0e46-43d3-bed2-87e1b1a96e0a"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:18:06.167745 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0a35ab77-2778-4ce3-b8f1-ed4b5c6b561b tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:18:06.168595 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0a35ab77-2778-4ce3-b8f1-ed4b5c6b561b tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.007884 Apr 16 21:18:06.169128 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1571/3276] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Apr 16 21:18:06 2022] POST /compute/v2.1/servers => generated 2221 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Apr 16 21:18:06.179436 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-33a5b9e0-4d57-4a2c-9be5-c88570231b2e tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:06.185137 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-33a5b9e0-4d57-4a2c-9be5-c88570231b2e tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] [instance: 177dbfe4-0c03-466e-8f68-c7816fc3ad90] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:06.187096 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-33a5b9e0-4d57-4a2c-9be5-c88570231b2e tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] HTTP exception thrown: Instance 177dbfe4-0c03-466e-8f68-c7816fc3ad90 could not be found. Apr 16 21:18:06.187696 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-33a5b9e0-4d57-4a2c-9be5-c88570231b2e tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Returning 404 to user: Instance 177dbfe4-0c03-466e-8f68-c7816fc3ad90 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:18:06.188676 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-33a5b9e0-4d57-4a2c-9be5-c88570231b2e tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] 10.222.0.20 "GET /compute/v2.1/servers/177dbfe4-0c03-466e-8f68-c7816fc3ad90/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.013114 Apr 16 21:18:06.189194 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1706/3277] 10.222.0.20 () {58 vars in 1280 bytes} [Sat Apr 16 21:18:06 2022] GET /compute/v2.1/servers/177dbfe4-0c03-466e-8f68-c7816fc3ad90/metadata/test2 => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:18:06.202998 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-024a6bfd-ca45-48c0-b821-46e5478d1751 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:06.203485 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-024a6bfd-ca45-48c0-b821-46e5478d1751 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] [instance: 5e9fe25d-f215-444a-b161-5a76d2766905] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:06.211252 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-024a6bfd-ca45-48c0-b821-46e5478d1751 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:06.211720 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-024a6bfd-ca45-48c0-b821-46e5478d1751 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:06.212552 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-024a6bfd-ca45-48c0-b821-46e5478d1751 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:06.213002 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-024a6bfd-ca45-48c0-b821-46e5478d1751 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:06.239020 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-024a6bfd-ca45-48c0-b821-46e5478d1751 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] [instance: 5e9fe25d-f215-444a-b161-5a76d2766905] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:18:06.377668 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d2cec57e-720e-4cba-919c-18b299830394 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:06.378775 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d2cec57e-720e-4cba-919c-18b299830394 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:06.386778 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d2cec57e-720e-4cba-919c-18b299830394 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:06.387344 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d2cec57e-720e-4cba-919c-18b299830394 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:06.388352 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d2cec57e-720e-4cba-919c-18b299830394 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:06.388889 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d2cec57e-720e-4cba-919c-18b299830394 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:06.547617 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d2cec57e-720e-4cba-919c-18b299830394 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:06.557082 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d2cec57e-720e-4cba-919c-18b299830394 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1476 microversion: 2.1 time: 0.184328 Apr 16 21:18:06.557673 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1707/3278] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:06 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1476 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:06.619781 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-024a6bfd-ca45-48c0-b821-46e5478d1751 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5e9fe25d-f215-444a-b161-5a76d2766905" status: 204 len: 0 microversion: 2.1 time: 0.420380 Apr 16 21:18:06.621343 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1572/3279] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:18:06 2022] DELETE /compute/v2.1/servers/5e9fe25d-f215-444a-b161-5a76d2766905 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:18:06.634838 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8c086d1e-8b89-4c28-9c31-b85fe96e2c94 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:06.634838 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8c086d1e-8b89-4c28-9c31-b85fe96e2c94 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] [instance: 5e9fe25d-f215-444a-b161-5a76d2766905] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:06.639268 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8c086d1e-8b89-4c28-9c31-b85fe96e2c94 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:06.640138 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8c086d1e-8b89-4c28-9c31-b85fe96e2c94 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:06.641501 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8c086d1e-8b89-4c28-9c31-b85fe96e2c94 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:06.642182 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8c086d1e-8b89-4c28-9c31-b85fe96e2c94 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:06.797516 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8c086d1e-8b89-4c28-9c31-b85fe96e2c94 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0b023ad5d34809930c8d837c06c247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6391ed1060eb48748245ced6bceec92b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:06.806281 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8c086d1e-8b89-4c28-9c31-b85fe96e2c94 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] 10.222.0.20 "GET /compute/v2.1/servers/5e9fe25d-f215-444a-b161-5a76d2766905" status: 200 len: 1525 microversion: 2.1 time: 0.180801 Apr 16 21:18:06.806873 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1708/3280] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:06 2022] GET /compute/v2.1/servers/5e9fe25d-f215-444a-b161-5a76d2766905 => generated 1525 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:06.850265 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-92706ebe-0d0b-4fdb-957c-fc6243817114 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:06.852462 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-92706ebe-0d0b-4fdb-957c-fc6243817114 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] [instance: 150835ec-2a90-46c5-8fe1-970a84f2e0cd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:06.862141 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-92706ebe-0d0b-4fdb-957c-fc6243817114 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:06.862665 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-92706ebe-0d0b-4fdb-957c-fc6243817114 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:06.863454 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-92706ebe-0d0b-4fdb-957c-fc6243817114 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:06.863903 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-92706ebe-0d0b-4fdb-957c-fc6243817114 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:06.890465 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4134e7b6-dac6-4d4a-b385-4dea41a1ad28 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb95b17820>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:06.941455 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4134e7b6-dac6-4d4a-b385-4dea41a1ad28 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9" status: 200 len: 1454 microversion: 2.1 time: 0.055515 Apr 16 21:18:06.942787 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1709/3281] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:06 2022] GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9 => generated 1454 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:18:07.048907 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-92706ebe-0d0b-4fdb-957c-fc6243817114 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f6bbe8241a49c890032fb779c4bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc8f8d1fc734ce182645a464d35ead8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:07.057948 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-92706ebe-0d0b-4fdb-957c-fc6243817114 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] 10.222.0.20 "GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd" status: 200 len: 1403 microversion: 2.1 time: 0.213704 Apr 16 21:18:07.059407 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1573/3282] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:06 2022] GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd => generated 1403 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:07.575221 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-10d68fe7-79b7-4095-8d43-e286b159c644 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:07.575905 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-10d68fe7-79b7-4095-8d43-e286b159c644 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:07.581982 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-10d68fe7-79b7-4095-8d43-e286b159c644 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:07.582435 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-10d68fe7-79b7-4095-8d43-e286b159c644 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:07.583248 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-10d68fe7-79b7-4095-8d43-e286b159c644 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:07.584239 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-10d68fe7-79b7-4095-8d43-e286b159c644 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:07.715757 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-10d68fe7-79b7-4095-8d43-e286b159c644 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:07.723367 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-10d68fe7-79b7-4095-8d43-e286b159c644 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1476 microversion: 2.1 time: 0.152686 Apr 16 21:18:07.723939 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1710/3283] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:07 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1476 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:07.823390 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4081492b-6177-4442-b658-be3c979f51e8 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:07.823998 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4081492b-6177-4442-b658-be3c979f51e8 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] [instance: 5e9fe25d-f215-444a-b161-5a76d2766905] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:07.832315 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4081492b-6177-4442-b658-be3c979f51e8 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:07.832315 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4081492b-6177-4442-b658-be3c979f51e8 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:07.832315 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4081492b-6177-4442-b658-be3c979f51e8 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:07.832315 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4081492b-6177-4442-b658-be3c979f51e8 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:07.958682 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-dc5c44d5-6cb4-4b29-b525-49928bf98f11 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb959e9d30>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:07.974735 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4081492b-6177-4442-b658-be3c979f51e8 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0b023ad5d34809930c8d837c06c247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6391ed1060eb48748245ced6bceec92b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:07.983539 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4081492b-6177-4442-b658-be3c979f51e8 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] 10.222.0.20 "GET /compute/v2.1/servers/5e9fe25d-f215-444a-b161-5a76d2766905" status: 200 len: 1525 microversion: 2.1 time: 0.163996 Apr 16 21:18:07.984786 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1574/3284] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:07 2022] GET /compute/v2.1/servers/5e9fe25d-f215-444a-b161-5a76d2766905 => generated 1525 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:08.013536 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-dc5c44d5-6cb4-4b29-b525-49928bf98f11 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9" status: 200 len: 1454 microversion: 2.1 time: 0.061740 Apr 16 21:18:08.014592 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1711/3285] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:07 2022] GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9 => generated 1454 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:18:08.077390 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-492506a3-c983-482c-be63-e54dd0f0cfc5 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:08.078005 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-492506a3-c983-482c-be63-e54dd0f0cfc5 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] [instance: 150835ec-2a90-46c5-8fe1-970a84f2e0cd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:08.086044 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-492506a3-c983-482c-be63-e54dd0f0cfc5 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:08.087122 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-492506a3-c983-482c-be63-e54dd0f0cfc5 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:08.088056 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-492506a3-c983-482c-be63-e54dd0f0cfc5 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:08.088530 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-492506a3-c983-482c-be63-e54dd0f0cfc5 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:08.231912 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-492506a3-c983-482c-be63-e54dd0f0cfc5 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f6bbe8241a49c890032fb779c4bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc8f8d1fc734ce182645a464d35ead8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:08.242891 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-492506a3-c983-482c-be63-e54dd0f0cfc5 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] 10.222.0.20 "GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd" status: 200 len: 1403 microversion: 2.1 time: 0.169515 Apr 16 21:18:08.249810 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1575/3286] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:08 2022] GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd => generated 1403 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:08.742592 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ed333382-2b74-4b3f-9fc6-1ae35f2108f6 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:08.743245 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ed333382-2b74-4b3f-9fc6-1ae35f2108f6 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:08.750546 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ed333382-2b74-4b3f-9fc6-1ae35f2108f6 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:08.751543 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ed333382-2b74-4b3f-9fc6-1ae35f2108f6 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:08.751901 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ed333382-2b74-4b3f-9fc6-1ae35f2108f6 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:08.752594 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ed333382-2b74-4b3f-9fc6-1ae35f2108f6 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:08.898869 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ed333382-2b74-4b3f-9fc6-1ae35f2108f6 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:08.907158 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ed333382-2b74-4b3f-9fc6-1ae35f2108f6 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1476 microversion: 2.1 time: 0.170174 Apr 16 21:18:08.917513 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1712/3287] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:08 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1476 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:09.001898 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cb4b9362-02c1-4c52-b479-f184719a2ef7 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:09.002695 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-cb4b9362-02c1-4c52-b479-f184719a2ef7 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] [instance: 5e9fe25d-f215-444a-b161-5a76d2766905] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:09.011467 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cb4b9362-02c1-4c52-b479-f184719a2ef7 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:09.012356 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cb4b9362-02c1-4c52-b479-f184719a2ef7 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:09.013482 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cb4b9362-02c1-4c52-b479-f184719a2ef7 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:09.014089 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cb4b9362-02c1-4c52-b479-f184719a2ef7 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:09.027325 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1745db76-a9d4-4f19-9206-89cf242b1694 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb9ffebb80>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:09.103151 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1745db76-a9d4-4f19-9206-89cf242b1694 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9" status: 200 len: 1454 microversion: 2.1 time: 0.079592 Apr 16 21:18:09.104966 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1713/3288] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:09 2022] GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9 => generated 1454 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:18:09.182994 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cb4b9362-02c1-4c52-b479-f184719a2ef7 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0b023ad5d34809930c8d837c06c247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6391ed1060eb48748245ced6bceec92b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:09.190926 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cb4b9362-02c1-4c52-b479-f184719a2ef7 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] 10.222.0.20 "GET /compute/v2.1/servers/5e9fe25d-f215-444a-b161-5a76d2766905" status: 200 len: 1525 microversion: 2.1 time: 0.193582 Apr 16 21:18:09.191491 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1576/3289] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:08 2022] GET /compute/v2.1/servers/5e9fe25d-f215-444a-b161-5a76d2766905 => generated 1525 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:09.259695 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3b74da36-f0cd-41db-a613-4f101a938ea9 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:09.260297 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3b74da36-f0cd-41db-a613-4f101a938ea9 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] [instance: 150835ec-2a90-46c5-8fe1-970a84f2e0cd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:09.266514 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3b74da36-f0cd-41db-a613-4f101a938ea9 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:09.267006 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3b74da36-f0cd-41db-a613-4f101a938ea9 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:09.267791 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3b74da36-f0cd-41db-a613-4f101a938ea9 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:09.268277 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3b74da36-f0cd-41db-a613-4f101a938ea9 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:09.409375 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3b74da36-f0cd-41db-a613-4f101a938ea9 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f6bbe8241a49c890032fb779c4bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc8f8d1fc734ce182645a464d35ead8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:09.418494 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3b74da36-f0cd-41db-a613-4f101a938ea9 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] 10.222.0.20 "GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd" status: 200 len: 1590 microversion: 2.1 time: 0.163279 Apr 16 21:18:09.419356 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1714/3290] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:09 2022] GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd => generated 1590 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:09.435592 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f7d974f3-c3ed-4c19-bf52-9b4270098ebe tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:09.436469 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f7d974f3-c3ed-4c19-bf52-9b4270098ebe tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] [instance: 150835ec-2a90-46c5-8fe1-970a84f2e0cd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:09.442626 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f7d974f3-c3ed-4c19-bf52-9b4270098ebe tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:09.443164 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f7d974f3-c3ed-4c19-bf52-9b4270098ebe tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:09.443973 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f7d974f3-c3ed-4c19-bf52-9b4270098ebe tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:09.444637 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f7d974f3-c3ed-4c19-bf52-9b4270098ebe tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:09.545709 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f7d974f3-c3ed-4c19-bf52-9b4270098ebe tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] 10.222.0.20 "GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.113018 Apr 16 21:18:09.552362 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1577/3291] 10.222.0.20 () {58 vars in 1274 bytes} [Sat Apr 16 21:18:09 2022] GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd/os-interface => generated 285 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:18:09.924883 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cc833906-f9cf-415b-8660-8f7bad66b7f7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:09.925527 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cc833906-f9cf-415b-8660-8f7bad66b7f7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:09.934719 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cc833906-f9cf-415b-8660-8f7bad66b7f7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:09.940674 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cc833906-f9cf-415b-8660-8f7bad66b7f7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:09.940674 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cc833906-f9cf-415b-8660-8f7bad66b7f7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:09.940674 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cc833906-f9cf-415b-8660-8f7bad66b7f7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:10.118976 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d75f4e25-cde8-4231-877d-5ae108fa8630 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb9595e5e0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:10.205892 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d75f4e25-cde8-4231-877d-5ae108fa8630 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9" status: 200 len: 1454 microversion: 2.1 time: 0.092168 Apr 16 21:18:10.212770 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1578/3292] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:10 2022] GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9 => generated 1454 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:18:10.218392 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7f1ffc1c-0007-45f3-a3dc-6723d3ceae17 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:10.223072 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7f1ffc1c-0007-45f3-a3dc-6723d3ceae17 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] [instance: 5e9fe25d-f215-444a-b161-5a76d2766905] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:10.233443 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7f1ffc1c-0007-45f3-a3dc-6723d3ceae17 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:10.236440 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7f1ffc1c-0007-45f3-a3dc-6723d3ceae17 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:10.237441 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7f1ffc1c-0007-45f3-a3dc-6723d3ceae17 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:10.238055 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7f1ffc1c-0007-45f3-a3dc-6723d3ceae17 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:10.282879 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cc833906-f9cf-415b-8660-8f7bad66b7f7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:10.297559 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cc833906-f9cf-415b-8660-8f7bad66b7f7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1476 microversion: 2.1 time: 0.374875 Apr 16 21:18:10.300384 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1715/3293] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:09 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1476 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:10.420211 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7f1ffc1c-0007-45f3-a3dc-6723d3ceae17 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0b023ad5d34809930c8d837c06c247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6391ed1060eb48748245ced6bceec92b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:10.432430 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7f1ffc1c-0007-45f3-a3dc-6723d3ceae17 tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] 10.222.0.20 "GET /compute/v2.1/servers/5e9fe25d-f215-444a-b161-5a76d2766905" status: 200 len: 1525 microversion: 2.1 time: 0.218271 Apr 16 21:18:10.444221 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1579/3294] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:10 2022] GET /compute/v2.1/servers/5e9fe25d-f215-444a-b161-5a76d2766905 => generated 1525 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:10.973314 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-2ccac21b-1f56-4ed2-9d9c-be607cd73617 req-78da60a9-eb6d-4889-8338-d827c52361e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e9fe25d-f215-444a-b161-5a76d2766905", "name": "network-vif-deleted", "tag": "23957a4d-6230-4dd9-89ec-dd700bca0441"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:18:10.983065 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-2ccac21b-1f56-4ed2-9d9c-be607cd73617 req-78da60a9-eb6d-4889-8338-d827c52361e2 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:10.983543 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-2ccac21b-1f56-4ed2-9d9c-be607cd73617 req-78da60a9-eb6d-4889-8338-d827c52361e2 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:10.995574 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-2ccac21b-1f56-4ed2-9d9c-be607cd73617 req-78da60a9-eb6d-4889-8338-d827c52361e2 service nova] Creating event network-vif-deleted:23957a4d-6230-4dd9-89ec-dd700bca0441 for instance 5e9fe25d-f215-444a-b161-5a76d2766905 on nch2-master-1 Apr 16 21:18:11.000478 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-2ccac21b-1f56-4ed2-9d9c-be607cd73617 req-78da60a9-eb6d-4889-8338-d827c52361e2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030830 Apr 16 21:18:11.001065 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1716/3295] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:18:11.219959 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-af3710c3-7c72-4f39-b27f-cfea379d004e tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb95835b80>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:11.267261 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-af3710c3-7c72-4f39-b27f-cfea379d004e tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9" status: 200 len: 1454 microversion: 2.1 time: 0.051183 Apr 16 21:18:11.268016 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1580/3296] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:11 2022] GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9 => generated 1454 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:11.319223 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a8920c75-00c0-4dc3-9a69-60bc70cf417f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:11.319992 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a8920c75-00c0-4dc3-9a69-60bc70cf417f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:11.329517 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a8920c75-00c0-4dc3-9a69-60bc70cf417f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:11.329517 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a8920c75-00c0-4dc3-9a69-60bc70cf417f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:11.329517 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a8920c75-00c0-4dc3-9a69-60bc70cf417f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:11.329517 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a8920c75-00c0-4dc3-9a69-60bc70cf417f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:11.457089 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7fa53f2c-083e-47bd-a5ff-0156877ecafb tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:11.463790 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7fa53f2c-083e-47bd-a5ff-0156877ecafb tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] [instance: 5e9fe25d-f215-444a-b161-5a76d2766905] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:11.486433 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7fa53f2c-083e-47bd-a5ff-0156877ecafb tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:11.486906 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7fa53f2c-083e-47bd-a5ff-0156877ecafb tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:11.488128 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7fa53f2c-083e-47bd-a5ff-0156877ecafb tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:11.491261 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7fa53f2c-083e-47bd-a5ff-0156877ecafb tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:11.547586 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7fa53f2c-083e-47bd-a5ff-0156877ecafb tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:11.548439 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7fa53f2c-083e-47bd-a5ff-0156877ecafb tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:11.549090 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-7fa53f2c-083e-47bd-a5ff-0156877ecafb tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lazy-loading 'fault' on Instance uuid 5e9fe25d-f215-444a-b161-5a76d2766905 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:18:11.581883 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a8920c75-00c0-4dc3-9a69-60bc70cf417f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:11.590013 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a8920c75-00c0-4dc3-9a69-60bc70cf417f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1476 microversion: 2.1 time: 0.276150 Apr 16 21:18:11.590920 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1717/3297] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:11 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1476 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:11.616154 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7fa53f2c-083e-47bd-a5ff-0156877ecafb tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af0b023ad5d34809930c8d837c06c247', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6391ed1060eb48748245ced6bceec92b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:11.623973 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7fa53f2c-083e-47bd-a5ff-0156877ecafb tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] 10.222.0.20 "GET /compute/v2.1/servers/5e9fe25d-f215-444a-b161-5a76d2766905" status: 200 len: 1313 microversion: 2.1 time: 0.176775 Apr 16 21:18:11.633913 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1581/3298] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:11 2022] GET /compute/v2.1/servers/5e9fe25d-f215-444a-b161-5a76d2766905 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:18:11.916465 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ec714e8d-14c3-43a7-a0bf-2b146de42288 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:11.918993 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ec714e8d-14c3-43a7-a0bf-2b146de42288 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] [instance: 150835ec-2a90-46c5-8fe1-970a84f2e0cd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:11.924540 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ec714e8d-14c3-43a7-a0bf-2b146de42288 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:11.924997 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ec714e8d-14c3-43a7-a0bf-2b146de42288 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:11.925819 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ec714e8d-14c3-43a7-a0bf-2b146de42288 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:11.926272 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ec714e8d-14c3-43a7-a0bf-2b146de42288 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:12.081224 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ec714e8d-14c3-43a7-a0bf-2b146de42288 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f6bbe8241a49c890032fb779c4bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc8f8d1fc734ce182645a464d35ead8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:12.093226 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ec714e8d-14c3-43a7-a0bf-2b146de42288 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] 10.222.0.20 "GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd" status: 200 len: 1590 microversion: 2.1 time: 0.181102 Apr 16 21:18:12.108994 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1718/3299] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:11 2022] GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd => generated 1590 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:12.281358 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7247eaaf-b549-4e96-accb-1e8950d49bab tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb9584faf0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:12.338254 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7247eaaf-b549-4e96-accb-1e8950d49bab tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9" status: 200 len: 1454 microversion: 2.1 time: 0.060333 Apr 16 21:18:12.344621 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1582/3300] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:12 2022] GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9 => generated 1454 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:12.609202 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7d68f931-5947-4c01-a975-59c82187c7bc tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:12.610320 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7d68f931-5947-4c01-a975-59c82187c7bc tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:12.618500 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7d68f931-5947-4c01-a975-59c82187c7bc tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:12.619245 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7d68f931-5947-4c01-a975-59c82187c7bc tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:12.620467 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7d68f931-5947-4c01-a975-59c82187c7bc tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:12.621315 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7d68f931-5947-4c01-a975-59c82187c7bc tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:12.641873 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-135a97e9-8237-49cf-b6b5-99a38a91a45a tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:12.642775 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-135a97e9-8237-49cf-b6b5-99a38a91a45a tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] [instance: 5e9fe25d-f215-444a-b161-5a76d2766905] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:12.655132 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-135a97e9-8237-49cf-b6b5-99a38a91a45a tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:12.660150 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-135a97e9-8237-49cf-b6b5-99a38a91a45a tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:12.665283 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-135a97e9-8237-49cf-b6b5-99a38a91a45a tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:12.665965 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-135a97e9-8237-49cf-b6b5-99a38a91a45a tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:12.697008 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-135a97e9-8237-49cf-b6b5-99a38a91a45a tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] HTTP exception thrown: Instance 5e9fe25d-f215-444a-b161-5a76d2766905 could not be found. Apr 16 21:18:12.705802 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-135a97e9-8237-49cf-b6b5-99a38a91a45a tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] Returning 404 to user: Instance 5e9fe25d-f215-444a-b161-5a76d2766905 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:18:12.705802 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-135a97e9-8237-49cf-b6b5-99a38a91a45a tempest-ServerMetadataNegativeTestJSON-946370870 tempest-ServerMetadataNegativeTestJSON-946370870-project] 10.222.0.20 "GET /compute/v2.1/servers/5e9fe25d-f215-444a-b161-5a76d2766905" status: 404 len: 111 microversion: 2.1 time: 0.061357 Apr 16 21:18:12.705802 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1583/3301] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:12 2022] GET /compute/v2.1/servers/5e9fe25d-f215-444a-b161-5a76d2766905 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:18:12.804730 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7d68f931-5947-4c01-a975-59c82187c7bc tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:12.816770 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7d68f931-5947-4c01-a975-59c82187c7bc tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1476 microversion: 2.1 time: 0.212243 Apr 16 21:18:12.827425 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1719/3302] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:12 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1476 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:13.017752 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-e7f58837-a2f0-46a7-ab93-b9155a828b29 req-2637fa9f-0cad-4e7f-b38c-cf1a76e88bee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "150835ec-2a90-46c5-8fe1-970a84f2e0cd", "tag": "0e7313ce-6b11-4893-959a-077cf629642f"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:18:13.028079 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-e7f58837-a2f0-46a7-ab93-b9155a828b29 req-2637fa9f-0cad-4e7f-b38c-cf1a76e88bee service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:13.029213 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-e7f58837-a2f0-46a7-ab93-b9155a828b29 req-2637fa9f-0cad-4e7f-b38c-cf1a76e88bee service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:13.049779 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-e7f58837-a2f0-46a7-ab93-b9155a828b29 req-2637fa9f-0cad-4e7f-b38c-cf1a76e88bee service nova] Creating event network-changed:0e7313ce-6b11-4893-959a-077cf629642f for instance 150835ec-2a90-46c5-8fe1-970a84f2e0cd on nch2-master-1 Apr 16 21:18:13.059598 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-e7f58837-a2f0-46a7-ab93-b9155a828b29 req-2637fa9f-0cad-4e7f-b38c-cf1a76e88bee service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047721 Apr 16 21:18:13.060629 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1584/3303] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:18:13.352301 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3c64d7df-737b-4816-aa17-cf0439659c0d tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb95b17310>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:13.438206 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3c64d7df-737b-4816-aa17-cf0439659c0d tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9" status: 200 len: 1454 microversion: 2.1 time: 0.090411 Apr 16 21:18:13.444907 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1720/3304] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:13 2022] GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9 => generated 1454 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:13.835098 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8c8348d8-db41-42cd-a5d9-4b5bb5e663bc tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:13.835867 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8c8348d8-db41-42cd-a5d9-4b5bb5e663bc tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:13.844514 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8c8348d8-db41-42cd-a5d9-4b5bb5e663bc tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:13.845190 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8c8348d8-db41-42cd-a5d9-4b5bb5e663bc tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:13.846235 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8c8348d8-db41-42cd-a5d9-4b5bb5e663bc tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:13.846692 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8c8348d8-db41-42cd-a5d9-4b5bb5e663bc tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:14.001962 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8c8348d8-db41-42cd-a5d9-4b5bb5e663bc tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:14.010072 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8c8348d8-db41-42cd-a5d9-4b5bb5e663bc tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1476 microversion: 2.1 time: 0.179126 Apr 16 21:18:14.011535 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1585/3305] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:13 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1476 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:14.455322 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8cf09963-f327-4154-8bad-6e4fc74b5ff1 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb9ffebb80>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:14.508336 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8cf09963-f327-4154-8bad-6e4fc74b5ff1 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9" status: 200 len: 1454 microversion: 2.1 time: 0.059585 Apr 16 21:18:14.509406 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1721/3306] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:14 2022] GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9 => generated 1454 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:15.027365 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-46932635-461a-4520-9b22-5fb9d91c5258 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:15.028239 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-46932635-461a-4520-9b22-5fb9d91c5258 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:15.035427 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-46932635-461a-4520-9b22-5fb9d91c5258 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:15.035953 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-46932635-461a-4520-9b22-5fb9d91c5258 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:15.036818 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-46932635-461a-4520-9b22-5fb9d91c5258 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:15.037272 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-46932635-461a-4520-9b22-5fb9d91c5258 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:15.182577 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-46932635-461a-4520-9b22-5fb9d91c5258 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:15.190116 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-46932635-461a-4520-9b22-5fb9d91c5258 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1476 microversion: 2.1 time: 0.167120 Apr 16 21:18:15.190674 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1586/3307] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:15 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1476 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:15.524404 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9a23335b-10ac-4f8f-a014-334d201b4200 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb965e79d0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:15.579248 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9a23335b-10ac-4f8f-a014-334d201b4200 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9" status: 200 len: 1454 microversion: 2.1 time: 0.058613 Apr 16 21:18:15.579710 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1722/3308] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:15 2022] GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9 => generated 1454 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:15.881387 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-46932635-461a-4520-9b22-5fb9d91c5258 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:15.883523 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-46932635-461a-4520-9b22-5fb9d91c5258 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001988 Apr 16 21:18:15.883523 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1587/3309] 10.222.0.20 () {56 vars in 885 bytes} [Sat Apr 16 21:18:15 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Apr 16 21:18:15.889317 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9a23335b-10ac-4f8f-a014-334d201b4200 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:15.890494 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9a23335b-10ac-4f8f-a014-334d201b4200 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002067 Apr 16 21:18:15.891079 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1723/3310] 10.222.0.20 () {54 vars in 1034 bytes} [Sat Apr 16 21:18:15 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Apr 16 21:18:15.896675 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-46932635-461a-4520-9b22-5fb9d91c5258 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:15.915484 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-46932635-461a-4520-9b22-5fb9d91c5258 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001263 Apr 16 21:18:15.915484 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1588/3311] 10.222.0.20 () {54 vars in 1040 bytes} [Sat Apr 16 21:18:15 2022] GET /compute/v2.1/ => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:18:15.920874 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9a23335b-10ac-4f8f-a014-334d201b4200 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:15.921786 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9a23335b-10ac-4f8f-a014-334d201b4200 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001118 Apr 16 21:18:15.922117 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1724/3312] 10.222.0.20 () {56 vars in 885 bytes} [Sat Apr 16 21:18:15 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Apr 16 21:18:16.206709 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7acbcf2a-fd90-496d-9501-546b706e5022 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:16.207329 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7acbcf2a-fd90-496d-9501-546b706e5022 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:16.213605 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7acbcf2a-fd90-496d-9501-546b706e5022 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:16.214063 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7acbcf2a-fd90-496d-9501-546b706e5022 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:16.214830 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7acbcf2a-fd90-496d-9501-546b706e5022 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:16.215271 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7acbcf2a-fd90-496d-9501-546b706e5022 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:16.346829 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7acbcf2a-fd90-496d-9501-546b706e5022 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:16.354881 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7acbcf2a-fd90-496d-9501-546b706e5022 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1476 microversion: 2.1 time: 0.152097 Apr 16 21:18:16.355459 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1589/3313] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:16 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1476 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:16.594310 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bb4ecd94-2699-43d3-9274-8a9f25f7ca80 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb964dc8b0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:16.638838 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-bb4ecd94-2699-43d3-9274-8a9f25f7ca80 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9" status: 200 len: 1463 microversion: 2.1 time: 0.049517 Apr 16 21:18:16.639454 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1725/3314] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:16 2022] GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9 => generated 1463 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:16.651460 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d1b66b04-9c9d-478a-9d8e-62448e65977e tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb9584f040>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:16.702913 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d1b66b04-9c9d-478a-9d8e-62448e65977e tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9" status: 200 len: 1463 microversion: 2.1 time: 0.055292 Apr 16 21:18:16.703628 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1590/3315] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:16 2022] GET /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9 => generated 1463 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:18:16.716717 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3b54fe7b-336e-484f-b243-a1b99e2393e3 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:16.717347 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3b54fe7b-336e-484f-b243-a1b99e2393e3 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] [instance: 9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:16.723376 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3b54fe7b-336e-484f-b243-a1b99e2393e3 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:16.723838 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3b54fe7b-336e-484f-b243-a1b99e2393e3 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:16.724687 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3b54fe7b-336e-484f-b243-a1b99e2393e3 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:16.725133 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3b54fe7b-336e-484f-b243-a1b99e2393e3 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:16.853544 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3b54fe7b-336e-484f-b243-a1b99e2393e3 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484bca4e32554ed4af061012f30666ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79f0fe4726d4abcbdc2672a15f709f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:16.861405 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3b54fe7b-336e-484f-b243-a1b99e2393e3 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/servers/9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523" status: 200 len: 1480 microversion: 2.1 time: 0.148504 Apr 16 21:18:16.861986 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1726/3316] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:16 2022] GET /compute/v2.1/servers/9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523 => generated 1480 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:17.373083 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bd68d305-b74c-47ce-956e-10329c1c469f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:17.373709 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bd68d305-b74c-47ce-956e-10329c1c469f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:17.380151 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bd68d305-b74c-47ce-956e-10329c1c469f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:17.381262 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bd68d305-b74c-47ce-956e-10329c1c469f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:17.382053 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bd68d305-b74c-47ce-956e-10329c1c469f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:17.382502 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bd68d305-b74c-47ce-956e-10329c1c469f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:17.517166 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-bd68d305-b74c-47ce-956e-10329c1c469f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:17.524651 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bd68d305-b74c-47ce-956e-10329c1c469f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1476 microversion: 2.1 time: 0.156346 Apr 16 21:18:17.525219 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1591/3317] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:17 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1476 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:17.878573 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4969eb48-cbfc-4b4e-8e8b-1deb244a5dff tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:17.879192 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4969eb48-cbfc-4b4e-8e8b-1deb244a5dff tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] [instance: 9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:17.885828 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4969eb48-cbfc-4b4e-8e8b-1deb244a5dff tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:17.886287 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4969eb48-cbfc-4b4e-8e8b-1deb244a5dff tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:17.887067 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4969eb48-cbfc-4b4e-8e8b-1deb244a5dff tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:17.887512 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4969eb48-cbfc-4b4e-8e8b-1deb244a5dff tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:18.016238 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4969eb48-cbfc-4b4e-8e8b-1deb244a5dff tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484bca4e32554ed4af061012f30666ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79f0fe4726d4abcbdc2672a15f709f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:18.024581 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4969eb48-cbfc-4b4e-8e8b-1deb244a5dff tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/servers/9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523" status: 200 len: 1467 microversion: 2.1 time: 0.149776 Apr 16 21:18:18.025222 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1727/3318] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:17 2022] GET /compute/v2.1/servers/9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523 => generated 1467 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:18.043505 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4214c51b-f503-48f0-8dd5-0fe7a6cb4417 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1923459041"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:18:18.044787 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4214c51b-f503-48f0-8dd5-0fe7a6cb4417 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] [instance: 0ba3ff1f-0ee1-4dba-8354-10aaef694161] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:18.050748 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4214c51b-f503-48f0-8dd5-0fe7a6cb4417 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:18.051273 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4214c51b-f503-48f0-8dd5-0fe7a6cb4417 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:18.052150 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4214c51b-f503-48f0-8dd5-0fe7a6cb4417 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:18.052692 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4214c51b-f503-48f0-8dd5-0fe7a6cb4417 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:18.541697 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-287ccff1-dfe7-4695-83cb-7a77e0798de0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:18.542558 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-287ccff1-dfe7-4695-83cb-7a77e0798de0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:18.548631 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-287ccff1-dfe7-4695-83cb-7a77e0798de0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:18.549091 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-287ccff1-dfe7-4695-83cb-7a77e0798de0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:18.549875 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-287ccff1-dfe7-4695-83cb-7a77e0798de0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:18.550322 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-287ccff1-dfe7-4695-83cb-7a77e0798de0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:18.611704 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4214c51b-f503-48f0-8dd5-0fe7a6cb4417 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "POST /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161/action" status: 202 len: 0 microversion: 2.1 time: 0.574431 Apr 16 21:18:18.613582 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1592/3319] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:18:18 2022] POST /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161/action => generated 0 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 16 21:18:18.627571 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7da1c62d-d75e-4816-aded-e6772265db43 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb95973790>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:18.702831 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7da1c62d-d75e-4816-aded-e6772265db43 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/1fbece82-f4ee-4e94-949b-04e6fc239ff1" status: 200 len: 1455 microversion: 2.1 time: 0.079570 Apr 16 21:18:18.703424 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1593/3320] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:18 2022] GET /compute/v2.1/images/1fbece82-f4ee-4e94-949b-04e6fc239ff1 => generated 1455 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:18:18.712542 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-287ccff1-dfe7-4695-83cb-7a77e0798de0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:18.722833 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-287ccff1-dfe7-4695-83cb-7a77e0798de0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1476 microversion: 2.1 time: 0.185085 Apr 16 21:18:18.733226 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1728/3321] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:18 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1476 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:18:19.522831 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-bfd1d79a-c4c9-49a3-972a-4eb5fddea41c req-414e5238-8790-42b1-8afc-68af8a001022 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523", "name": "network-vif-unplugged", "status": "completed", "tag": "0eab5a77-408a-45d7-86ff-b5c0a4b550d1"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:18:19.532580 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-bfd1d79a-c4c9-49a3-972a-4eb5fddea41c req-414e5238-8790-42b1-8afc-68af8a001022 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:19.533040 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-bfd1d79a-c4c9-49a3-972a-4eb5fddea41c req-414e5238-8790-42b1-8afc-68af8a001022 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:19.543740 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-bfd1d79a-c4c9-49a3-972a-4eb5fddea41c req-414e5238-8790-42b1-8afc-68af8a001022 service nova] Creating event network-vif-unplugged:0eab5a77-408a-45d7-86ff-b5c0a4b550d1 for instance 9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523 on nch2-master-1 Apr 16 21:18:19.548572 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-bfd1d79a-c4c9-49a3-972a-4eb5fddea41c req-414e5238-8790-42b1-8afc-68af8a001022 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030890 Apr 16 21:18:19.549146 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1594/3322] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:18:19.715783 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-78427eab-b1d5-47c2-8363-543b4e6ac823 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb96773e50>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:19.741692 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-32d6f631-a375-4c96-8154-8412d087bbb5 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:19.742124 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-32d6f631-a375-4c96-8154-8412d087bbb5 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:19.748403 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-32d6f631-a375-4c96-8154-8412d087bbb5 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:19.748893 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-32d6f631-a375-4c96-8154-8412d087bbb5 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:19.749688 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-32d6f631-a375-4c96-8154-8412d087bbb5 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:19.750147 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-32d6f631-a375-4c96-8154-8412d087bbb5 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:19.759610 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-78427eab-b1d5-47c2-8363-543b4e6ac823 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/1fbece82-f4ee-4e94-949b-04e6fc239ff1" status: 200 len: 1455 microversion: 2.1 time: 0.047926 Apr 16 21:18:19.760215 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1729/3323] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:19 2022] GET /compute/v2.1/images/1fbece82-f4ee-4e94-949b-04e6fc239ff1 => generated 1455 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:19.878572 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-32d6f631-a375-4c96-8154-8412d087bbb5 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:19.886765 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-32d6f631-a375-4c96-8154-8412d087bbb5 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1476 microversion: 2.1 time: 0.150234 Apr 16 21:18:19.887374 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1595/3324] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:19 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1476 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:18:20.765733 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9a2a822c-9666-4d5a-b55d-20ecac745324 tempest-VolumesTestJSON-1786337923 tempest-VolumesTestJSON-1786337923-project] Calling method '.version_select at 0x7fbb9594fdc0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:20.773078 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-47c41535-25bf-403c-80f5-bf2c781fe096 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb95835820>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:20.814958 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9a2a822c-9666-4d5a-b55d-20ecac745324 tempest-VolumesTestJSON-1786337923 tempest-VolumesTestJSON-1786337923-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/1358f4d1-a8a7-4e32-a974-ba9661e73667" status: 200 len: 344 microversion: 2.1 time: 0.053851 Apr 16 21:18:20.815678 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1730/3325] 10.222.0.20 () {58 vars in 1244 bytes} [Sat Apr 16 21:18:20 2022] GET /compute/v2.1/os-volumes/1358f4d1-a8a7-4e32-a974-ba9661e73667 => generated 344 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:18:20.818692 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-47c41535-25bf-403c-80f5-bf2c781fe096 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/1fbece82-f4ee-4e94-949b-04e6fc239ff1" status: 200 len: 1455 microversion: 2.1 time: 0.049430 Apr 16 21:18:20.819271 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1596/3326] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:20 2022] GET /compute/v2.1/images/1fbece82-f4ee-4e94-949b-04e6fc239ff1 => generated 1455 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:20.904841 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-10846d01-d58e-422c-b32e-f091424a8062 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:20.905470 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-10846d01-d58e-422c-b32e-f091424a8062 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:20.912046 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-10846d01-d58e-422c-b32e-f091424a8062 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:20.912548 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-10846d01-d58e-422c-b32e-f091424a8062 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:20.913342 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-10846d01-d58e-422c-b32e-f091424a8062 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:20.913818 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-10846d01-d58e-422c-b32e-f091424a8062 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:21.044547 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-10846d01-d58e-422c-b32e-f091424a8062 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:21.051145 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-10846d01-d58e-422c-b32e-f091424a8062 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1476 microversion: 2.1 time: 0.150561 Apr 16 21:18:21.051685 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1731/3327] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:20 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1476 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:21.833034 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4c1ca5ce-b7fd-441a-af85-5ccd21290dc1 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb9ff38ca0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:21.874901 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4c1ca5ce-b7fd-441a-af85-5ccd21290dc1 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/1fbece82-f4ee-4e94-949b-04e6fc239ff1" status: 200 len: 1455 microversion: 2.1 time: 0.046710 Apr 16 21:18:21.875476 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1597/3328] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:21 2022] GET /compute/v2.1/images/1fbece82-f4ee-4e94-949b-04e6fc239ff1 => generated 1455 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:22.067879 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-129881ff-6b2c-49a1-832f-29bed7c37a1d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:22.068537 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-129881ff-6b2c-49a1-832f-29bed7c37a1d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:22.075336 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-129881ff-6b2c-49a1-832f-29bed7c37a1d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:22.075807 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-129881ff-6b2c-49a1-832f-29bed7c37a1d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:22.076615 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-129881ff-6b2c-49a1-832f-29bed7c37a1d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:22.077068 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-129881ff-6b2c-49a1-832f-29bed7c37a1d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:22.208405 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-129881ff-6b2c-49a1-832f-29bed7c37a1d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:22.215828 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-129881ff-6b2c-49a1-832f-29bed7c37a1d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1476 microversion: 2.1 time: 0.151938 Apr 16 21:18:22.216506 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1732/3329] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:22 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1476 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:22.889561 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ec3dffbc-e5f9-4370-b15e-6acc8e1d99f3 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb95973af0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:22.931555 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ec3dffbc-e5f9-4370-b15e-6acc8e1d99f3 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/1fbece82-f4ee-4e94-949b-04e6fc239ff1" status: 200 len: 1455 microversion: 2.1 time: 0.046630 Apr 16 21:18:22.932116 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1598/3330] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:22 2022] GET /compute/v2.1/images/1fbece82-f4ee-4e94-949b-04e6fc239ff1 => generated 1455 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:23.232942 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ea386e23-b65b-4024-a0c9-8eb570d96c23 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:23.233502 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ea386e23-b65b-4024-a0c9-8eb570d96c23 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:23.240401 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ea386e23-b65b-4024-a0c9-8eb570d96c23 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:23.240861 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ea386e23-b65b-4024-a0c9-8eb570d96c23 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:23.242208 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ea386e23-b65b-4024-a0c9-8eb570d96c23 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:23.242650 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ea386e23-b65b-4024-a0c9-8eb570d96c23 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:23.367877 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ea386e23-b65b-4024-a0c9-8eb570d96c23 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:23.375370 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ea386e23-b65b-4024-a0c9-8eb570d96c23 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1476 microversion: 2.1 time: 0.146453 Apr 16 21:18:23.376006 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1733/3331] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:23 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1476 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:23.508729 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c116f4a2-e7a3-454f-9faa-c54195179592 tempest-VolumesTestJSON-1786337923 tempest-VolumesTestJSON-1786337923-project] Calling method '.version_select at 0x7fbb95973b80>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:23.555301 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c116f4a2-e7a3-454f-9faa-c54195179592 tempest-VolumesTestJSON-1786337923 tempest-VolumesTestJSON-1786337923-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/3fa85617-9e0b-4a8d-9abf-149cf6fb9a11" status: 200 len: 342 microversion: 2.1 time: 0.050432 Apr 16 21:18:23.556003 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1599/3332] 10.222.0.20 () {58 vars in 1244 bytes} [Sat Apr 16 21:18:23 2022] GET /compute/v2.1/os-volumes/3fa85617-9e0b-4a8d-9abf-149cf6fb9a11 => generated 342 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:18:23.944782 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3813911a-c51f-429f-9961-8b05e160a39d tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb95a8b670>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:23.988697 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3813911a-c51f-429f-9961-8b05e160a39d tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/1fbece82-f4ee-4e94-949b-04e6fc239ff1" status: 200 len: 1455 microversion: 2.1 time: 0.047801 Apr 16 21:18:23.989443 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1734/3333] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:23 2022] GET /compute/v2.1/images/1fbece82-f4ee-4e94-949b-04e6fc239ff1 => generated 1455 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:24.394230 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-76ee98be-5916-4254-826e-716e0fc09f85 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:24.395458 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-76ee98be-5916-4254-826e-716e0fc09f85 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:24.403112 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-76ee98be-5916-4254-826e-716e0fc09f85 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:24.403575 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-76ee98be-5916-4254-826e-716e0fc09f85 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:24.404671 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-76ee98be-5916-4254-826e-716e0fc09f85 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:24.405124 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-76ee98be-5916-4254-826e-716e0fc09f85 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:24.538049 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-76ee98be-5916-4254-826e-716e0fc09f85 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:24.545503 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-76ee98be-5916-4254-826e-716e0fc09f85 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1476 microversion: 2.1 time: 0.156141 Apr 16 21:18:24.546069 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1600/3334] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:24 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1476 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:25.003777 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-10f069e4-0118-4392-8d9d-49cea06c4420 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb966981f0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:25.045849 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-10f069e4-0118-4392-8d9d-49cea06c4420 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/1fbece82-f4ee-4e94-949b-04e6fc239ff1" status: 200 len: 1455 microversion: 2.1 time: 0.047895 Apr 16 21:18:25.046470 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1735/3335] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:24 2022] GET /compute/v2.1/images/1fbece82-f4ee-4e94-949b-04e6fc239ff1 => generated 1455 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:25.563500 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cbb34331-bce6-41fc-8f52-bffe4a42330d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:25.564769 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-cbb34331-bce6-41fc-8f52-bffe4a42330d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:25.572094 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cbb34331-bce6-41fc-8f52-bffe4a42330d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:25.572590 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cbb34331-bce6-41fc-8f52-bffe4a42330d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:25.573481 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cbb34331-bce6-41fc-8f52-bffe4a42330d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:25.573939 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cbb34331-bce6-41fc-8f52-bffe4a42330d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:25.708575 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cbb34331-bce6-41fc-8f52-bffe4a42330d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:25.716682 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cbb34331-bce6-41fc-8f52-bffe4a42330d tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1476 microversion: 2.1 time: 0.157628 Apr 16 21:18:25.717475 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1601/3336] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:25 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1476 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:25.759501 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-73428c40-314b-4f57-a9f1-bc7a1e93949c req-a67eee97-a6cd-4821-a0e1-0710407a1503 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ba3ff1f-0ee1-4dba-8354-10aaef694161", "name": "network-vif-plugged", "status": "completed", "tag": "da205378-8574-416e-8ccf-7ec5bb2d4541"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:18:25.767583 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-73428c40-314b-4f57-a9f1-bc7a1e93949c req-a67eee97-a6cd-4821-a0e1-0710407a1503 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:25.768035 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-73428c40-314b-4f57-a9f1-bc7a1e93949c req-a67eee97-a6cd-4821-a0e1-0710407a1503 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:25.778408 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-73428c40-314b-4f57-a9f1-bc7a1e93949c req-a67eee97-a6cd-4821-a0e1-0710407a1503 service nova] Creating event network-vif-plugged:da205378-8574-416e-8ccf-7ec5bb2d4541 for instance 0ba3ff1f-0ee1-4dba-8354-10aaef694161 on nch2-master-1 Apr 16 21:18:25.783962 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-73428c40-314b-4f57-a9f1-bc7a1e93949c req-a67eee97-a6cd-4821-a0e1-0710407a1503 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028596 Apr 16 21:18:25.784608 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1736/3337] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:18:26.058906 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5a20012c-00d2-4238-a0e4-ba905f52f516 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb95973820>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:26.099877 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5a20012c-00d2-4238-a0e4-ba905f52f516 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/1fbece82-f4ee-4e94-949b-04e6fc239ff1" status: 200 len: 1455 microversion: 2.1 time: 0.044872 Apr 16 21:18:26.101139 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1602/3338] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:26 2022] GET /compute/v2.1/images/1fbece82-f4ee-4e94-949b-04e6fc239ff1 => generated 1455 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:26.176035 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-98fae047-18b0-4180-9fe4-d6a8447f14df tempest-VolumesTestJSON-1786337923 tempest-VolumesTestJSON-1786337923-project] Calling method '.version_select at 0x7fbb95a8bee0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:26.221382 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-98fae047-18b0-4180-9fe4-d6a8447f14df tempest-VolumesTestJSON-1786337923 tempest-VolumesTestJSON-1786337923-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/bbb77aaa-e22d-449c-8093-4a2883627371" status: 200 len: 344 microversion: 2.1 time: 0.049534 Apr 16 21:18:26.221956 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1737/3339] 10.222.0.20 () {58 vars in 1244 bytes} [Sat Apr 16 21:18:26 2022] GET /compute/v2.1/os-volumes/bbb77aaa-e22d-449c-8093-4a2883627371 => generated 344 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:18:26.233655 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a3e86637-be20-430e-91b7-25cd9f316351 tempest-VolumesTestJSON-1786337923 tempest-VolumesTestJSON-1786337923-project] Calling method '.version_select at 0x7fbb9584f3a0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:26.319517 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a3e86637-be20-430e-91b7-25cd9f316351 tempest-VolumesTestJSON-1786337923 tempest-VolumesTestJSON-1786337923-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1013 microversion: 2.1 time: 0.089532 Apr 16 21:18:26.320093 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1603/3340] 10.222.0.20 () {58 vars in 1133 bytes} [Sat Apr 16 21:18:26 2022] GET /compute/v2.1/os-volumes => generated 1013 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:26.332682 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6f528e66-f071-4cf9-8da8-099ec07840a9 tempest-VolumesTestJSON-1786337923 tempest-VolumesTestJSON-1786337923-project] Calling method '.version_select at 0x7fbb965e79d0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:26.414348 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6f528e66-f071-4cf9-8da8-099ec07840a9 tempest-VolumesTestJSON-1786337923 tempest-VolumesTestJSON-1786337923-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 679 microversion: 2.1 time: 0.085744 Apr 16 21:18:26.414923 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1738/3341] 10.222.0.20 () {58 vars in 1148 bytes} [Sat Apr 16 21:18:26 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 679 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:18:26.429187 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-431c4b94-85ec-4236-b916-03564108af1c tempest-VolumesTestJSON-1786337923 tempest-VolumesTestJSON-1786337923-project] Calling method '.version_select at 0x7fbb96534820>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:26.508164 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-431c4b94-85ec-4236-b916-03564108af1c tempest-VolumesTestJSON-1786337923 tempest-VolumesTestJSON-1786337923-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1013 microversion: 2.1 time: 0.082778 Apr 16 21:18:26.508769 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1604/3342] 10.222.0.20 () {58 vars in 1133 bytes} [Sat Apr 16 21:18:26 2022] GET /compute/v2.1/os-volumes => generated 1013 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:26.519900 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4a506cc5-bcec-417c-bced-3babcdab2c2b tempest-VolumesTestJSON-1786337923 tempest-VolumesTestJSON-1786337923-project] Calling method '.version_select at 0x7fbb965e74c0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:26.598282 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4a506cc5-bcec-417c-bced-3babcdab2c2b tempest-VolumesTestJSON-1786337923 tempest-VolumesTestJSON-1786337923-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 345 microversion: 2.1 time: 0.082113 Apr 16 21:18:26.598860 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1739/3343] 10.222.0.20 () {58 vars in 1166 bytes} [Sat Apr 16 21:18:26 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 345 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:18:26.611469 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a1685068-0581-44bc-94a2-e359c329530e tempest-VolumesTestJSON-1786337923 tempest-VolumesTestJSON-1786337923-project] Calling method '.version_select at 0x7fbb9584f8b0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:26.690092 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a1685068-0581-44bc-94a2-e359c329530e tempest-VolumesTestJSON-1786337923 tempest-VolumesTestJSON-1786337923-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 679 microversion: 2.1 time: 0.083286 Apr 16 21:18:26.690671 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1605/3344] 10.222.0.20 () {58 vars in 1169 bytes} [Sat Apr 16 21:18:26 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 679 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:18:26.702942 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-af55ed00-288d-4267-a94f-e8bf2f79a215 tempest-VolumesTestJSON-1786337923 tempest-VolumesTestJSON-1786337923-project] Calling method '.version_select at 0x7fbb95a8b670>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:26.733322 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7dc4a8dc-31aa-4537-a66b-82a461d53f47 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:26.733935 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7dc4a8dc-31aa-4537-a66b-82a461d53f47 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:26.740705 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7dc4a8dc-31aa-4537-a66b-82a461d53f47 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:26.741316 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7dc4a8dc-31aa-4537-a66b-82a461d53f47 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:26.741967 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7dc4a8dc-31aa-4537-a66b-82a461d53f47 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:26.742409 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7dc4a8dc-31aa-4537-a66b-82a461d53f47 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:26.785090 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-af55ed00-288d-4267-a94f-e8bf2f79a215 tempest-VolumesTestJSON-1786337923 tempest-VolumesTestJSON-1786337923-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1013 microversion: 2.1 time: 0.085819 Apr 16 21:18:26.785814 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1740/3345] 10.222.0.20 () {58 vars in 1154 bytes} [Sat Apr 16 21:18:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1013 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:26.797145 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4fccbd3c-ff29-43a0-ad39-df4d4f0fb3e5 tempest-VolumesTestJSON-1786337923 tempest-VolumesTestJSON-1786337923-project] Calling method '.version_select at 0x7fbb964bc1f0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:26.874439 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7dc4a8dc-31aa-4537-a66b-82a461d53f47 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:26.882985 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4fccbd3c-ff29-43a0-ad39-df4d4f0fb3e5 tempest-VolumesTestJSON-1786337923 tempest-VolumesTestJSON-1786337923-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 345 microversion: 2.1 time: 0.089446 Apr 16 21:18:26.883282 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7dc4a8dc-31aa-4537-a66b-82a461d53f47 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1476 microversion: 2.1 time: 0.153744 Apr 16 21:18:26.883559 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1741/3346] 10.222.0.20 () {58 vars in 1187 bytes} [Sat Apr 16 21:18:26 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 345 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:18:26.883993 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1606/3347] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:26 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1476 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:18:26.894794 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-181e21c2-7a20-41ea-9f36-4608c3389fb4 tempest-VolumesTestJSON-1786337923 tempest-VolumesTestJSON-1786337923-project] Calling method '.version_select at 0x7fbb96870ee0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:26.974042 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-181e21c2-7a20-41ea-9f36-4608c3389fb4 tempest-VolumesTestJSON-1786337923 tempest-VolumesTestJSON-1786337923-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1013 microversion: 2.1 time: 0.082559 Apr 16 21:18:26.974630 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1742/3348] 10.222.0.20 () {58 vars in 1154 bytes} [Sat Apr 16 21:18:26 2022] GET /compute/v2.1/os-volumes/detail => generated 1013 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:27.113062 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ca6e222d-2e0a-4071-8b5f-4d05b18e588d tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb95860b80>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:27.161045 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ca6e222d-2e0a-4071-8b5f-4d05b18e588d tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/1fbece82-f4ee-4e94-949b-04e6fc239ff1" status: 200 len: 1455 microversion: 2.1 time: 0.051476 Apr 16 21:18:27.161330 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1607/3349] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:27 2022] GET /compute/v2.1/images/1fbece82-f4ee-4e94-949b-04e6fc239ff1 => generated 1455 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:27.900924 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-68bd69ee-3fd4-48a5-b1ba-0a5d12921b1f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:27.901823 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-68bd69ee-3fd4-48a5-b1ba-0a5d12921b1f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:27.908918 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-68bd69ee-3fd4-48a5-b1ba-0a5d12921b1f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:27.909383 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-68bd69ee-3fd4-48a5-b1ba-0a5d12921b1f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:27.910169 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-68bd69ee-3fd4-48a5-b1ba-0a5d12921b1f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:27.910615 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-68bd69ee-3fd4-48a5-b1ba-0a5d12921b1f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:28.043967 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-68bd69ee-3fd4-48a5-b1ba-0a5d12921b1f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:28.051430 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-68bd69ee-3fd4-48a5-b1ba-0a5d12921b1f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1476 microversion: 2.1 time: 0.155744 Apr 16 21:18:28.052016 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1743/3350] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:27 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1476 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:28.175065 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-60d6c831-f8c1-4435-956b-7281174e813a tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb964ff5e0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:28.218902 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-60d6c831-f8c1-4435-956b-7281174e813a tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/1fbece82-f4ee-4e94-949b-04e6fc239ff1" status: 200 len: 1455 microversion: 2.1 time: 0.048520 Apr 16 21:18:28.219480 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1608/3351] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:28 2022] GET /compute/v2.1/images/1fbece82-f4ee-4e94-949b-04e6fc239ff1 => generated 1455 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:29.068848 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ce2ece8a-a0ba-420b-8bda-f14f3d32a1cb tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:29.069476 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ce2ece8a-a0ba-420b-8bda-f14f3d32a1cb tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:29.076380 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ce2ece8a-a0ba-420b-8bda-f14f3d32a1cb tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:29.076854 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ce2ece8a-a0ba-420b-8bda-f14f3d32a1cb tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:29.077640 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ce2ece8a-a0ba-420b-8bda-f14f3d32a1cb tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:29.078094 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ce2ece8a-a0ba-420b-8bda-f14f3d32a1cb tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:29.208249 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ce2ece8a-a0ba-420b-8bda-f14f3d32a1cb tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:29.215974 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ce2ece8a-a0ba-420b-8bda-f14f3d32a1cb tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1476 microversion: 2.1 time: 0.151192 Apr 16 21:18:29.216578 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1744/3352] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:29 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1476 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:18:29.233520 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bbed8ac6-2956-4a17-85fa-e3f3e4a77f92 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb958359d0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:29.280313 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bbed8ac6-2956-4a17-85fa-e3f3e4a77f92 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/1fbece82-f4ee-4e94-949b-04e6fc239ff1" status: 200 len: 1455 microversion: 2.1 time: 0.051608 Apr 16 21:18:29.280889 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1609/3353] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:29 2022] GET /compute/v2.1/images/1fbece82-f4ee-4e94-949b-04e6fc239ff1 => generated 1455 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:30.234346 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-46aac2dd-239e-40c3-862a-30de2c3e4872 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:30.234969 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-46aac2dd-239e-40c3-862a-30de2c3e4872 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:30.244473 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-46aac2dd-239e-40c3-862a-30de2c3e4872 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:30.245048 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-46aac2dd-239e-40c3-862a-30de2c3e4872 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:30.245845 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-46aac2dd-239e-40c3-862a-30de2c3e4872 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:30.246287 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-46aac2dd-239e-40c3-862a-30de2c3e4872 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:30.298352 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-42033d3a-e8b1-42d7-99c5-ac3b4e7cf196 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb96534ee0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:30.373998 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-42033d3a-e8b1-42d7-99c5-ac3b4e7cf196 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/1fbece82-f4ee-4e94-949b-04e6fc239ff1" status: 200 len: 1455 microversion: 2.1 time: 0.084364 Apr 16 21:18:30.387776 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1610/3354] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:30 2022] GET /compute/v2.1/images/1fbece82-f4ee-4e94-949b-04e6fc239ff1 => generated 1455 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:30.429036 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-46aac2dd-239e-40c3-862a-30de2c3e4872 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:30.440686 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-46aac2dd-239e-40c3-862a-30de2c3e4872 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1476 microversion: 2.1 time: 0.210610 Apr 16 21:18:30.441376 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1745/3355] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:30 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1476 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:30.836618 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e89e1ac7-97b8-42f7-aebe-1dea5eda30c7 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9687446e-2d63-4b79-8b0a-20abf71fe84e"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:18:30.838259 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e89e1ac7-97b8-42f7-aebe-1dea5eda30c7 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:30.844733 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e89e1ac7-97b8-42f7-aebe-1dea5eda30c7 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:30.845324 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e89e1ac7-97b8-42f7-aebe-1dea5eda30c7 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:30.846198 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e89e1ac7-97b8-42f7-aebe-1dea5eda30c7 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:30.846719 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e89e1ac7-97b8-42f7-aebe-1dea5eda30c7 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:31.400618 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7874ce56-1308-4ccd-a681-257376106a27 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb95939040>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:31.456071 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7874ce56-1308-4ccd-a681-257376106a27 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/1fbece82-f4ee-4e94-949b-04e6fc239ff1" status: 200 len: 1455 microversion: 2.1 time: 0.061060 Apr 16 21:18:31.458193 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1746/3356] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:31 2022] GET /compute/v2.1/images/1fbece82-f4ee-4e94-949b-04e6fc239ff1 => generated 1455 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:31.465491 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-34ae3282-0848-45b3-bd2f-975bb0340d46 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:31.466330 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-34ae3282-0848-45b3-bd2f-975bb0340d46 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:31.473482 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-34ae3282-0848-45b3-bd2f-975bb0340d46 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:31.473948 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-34ae3282-0848-45b3-bd2f-975bb0340d46 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:31.477432 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-34ae3282-0848-45b3-bd2f-975bb0340d46 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:31.478477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-34ae3282-0848-45b3-bd2f-975bb0340d46 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:31.645720 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-34ae3282-0848-45b3-bd2f-975bb0340d46 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:31.654528 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-34ae3282-0848-45b3-bd2f-975bb0340d46 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1476 microversion: 2.1 time: 0.196419 Apr 16 21:18:31.664848 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1747/3357] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:31 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1476 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:32.471083 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-94ee2174-7d3c-4218-a2d2-cac814bfb7aa tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb96bea040>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:32.514677 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-94ee2174-7d3c-4218-a2d2-cac814bfb7aa tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/1fbece82-f4ee-4e94-949b-04e6fc239ff1" status: 200 len: 1455 microversion: 2.1 time: 0.047719 Apr 16 21:18:32.515258 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1748/3358] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:32 2022] GET /compute/v2.1/images/1fbece82-f4ee-4e94-949b-04e6fc239ff1 => generated 1455 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:18:32.671491 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b5f8a7f9-ea52-467f-84b1-7b13e66627c2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:32.673139 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b5f8a7f9-ea52-467f-84b1-7b13e66627c2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:32.681590 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5f8a7f9-ea52-467f-84b1-7b13e66627c2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:32.682425 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5f8a7f9-ea52-467f-84b1-7b13e66627c2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:32.683512 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5f8a7f9-ea52-467f-84b1-7b13e66627c2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:32.684411 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5f8a7f9-ea52-467f-84b1-7b13e66627c2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:32.863666 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b5f8a7f9-ea52-467f-84b1-7b13e66627c2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:32.874574 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b5f8a7f9-ea52-467f-84b1-7b13e66627c2 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1476 microversion: 2.1 time: 0.206394 Apr 16 21:18:32.875826 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1749/3359] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:32 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1476 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:18:32.991158 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e89e1ac7-97b8-42f7-aebe-1dea5eda30c7 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "POST /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.158949 Apr 16 21:18:32.997737 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1611/3360] 10.222.0.20 () {60 vars in 1322 bytes} [Sat Apr 16 21:18:30 2022] POST /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09/os-volume_attachments => generated 194 bytes in 2161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:18:33.538131 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-eba66887-59ce-4c55-9486-b02004c48052 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb95860790>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:33.626846 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-eba66887-59ce-4c55-9486-b02004c48052 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/1fbece82-f4ee-4e94-949b-04e6fc239ff1" status: 200 len: 1455 microversion: 2.1 time: 0.100965 Apr 16 21:18:33.637213 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1612/3361] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:33 2022] GET /compute/v2.1/images/1fbece82-f4ee-4e94-949b-04e6fc239ff1 => generated 1455 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:33.761136 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-d09e6ad5-8b15-4a00-81fe-22bb627dc64f req-01c9fee9-d2c1-4fe3-91df-34259cb54006 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71bd33e5-85e5-452d-8ddb-e1817ed9abd2", "name": "network-vif-unplugged", "status": "completed", "tag": "f69be29b-9cad-412c-a6a2-2f5df4fa07b2"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:18:33.782580 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-d09e6ad5-8b15-4a00-81fe-22bb627dc64f req-01c9fee9-d2c1-4fe3-91df-34259cb54006 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:33.783509 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-d09e6ad5-8b15-4a00-81fe-22bb627dc64f req-01c9fee9-d2c1-4fe3-91df-34259cb54006 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:33.819667 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-d09e6ad5-8b15-4a00-81fe-22bb627dc64f req-01c9fee9-d2c1-4fe3-91df-34259cb54006 service nova] Creating event network-vif-unplugged:f69be29b-9cad-412c-a6a2-2f5df4fa07b2 for instance 71bd33e5-85e5-452d-8ddb-e1817ed9abd2 on nch2-master-1 Apr 16 21:18:33.828683 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [req-d09e6ad5-8b15-4a00-81fe-22bb627dc64f req-01c9fee9-d2c1-4fe3-91df-34259cb54006 service nova] Instance 71bd33e5-85e5-452d-8ddb-e1817ed9abd2 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 16 21:18:33.847764 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-d09e6ad5-8b15-4a00-81fe-22bb627dc64f req-01c9fee9-d2c1-4fe3-91df-34259cb54006 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.348214 Apr 16 21:18:33.848582 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1750/3362] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:18:33.892735 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8d7bf711-d0e4-4bcb-a1d4-7e34688d142f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:33.893466 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8d7bf711-d0e4-4bcb-a1d4-7e34688d142f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:33.909639 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8d7bf711-d0e4-4bcb-a1d4-7e34688d142f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:33.910423 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8d7bf711-d0e4-4bcb-a1d4-7e34688d142f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:33.911419 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8d7bf711-d0e4-4bcb-a1d4-7e34688d142f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:33.912010 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8d7bf711-d0e4-4bcb-a1d4-7e34688d142f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:34.115946 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8d7bf711-d0e4-4bcb-a1d4-7e34688d142f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:34.140833 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8d7bf711-d0e4-4bcb-a1d4-7e34688d142f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1475 microversion: 2.1 time: 0.238904 Apr 16 21:18:34.143924 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1613/3363] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:33 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1475 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:34.651500 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-378927ef-3281-461a-9cf9-abd36c95cff2 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb95afd430>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:34.720159 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-378927ef-3281-461a-9cf9-abd36c95cff2 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/1fbece82-f4ee-4e94-949b-04e6fc239ff1" status: 200 len: 1455 microversion: 2.1 time: 0.083873 Apr 16 21:18:34.721275 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1751/3364] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:34 2022] GET /compute/v2.1/images/1fbece82-f4ee-4e94-949b-04e6fc239ff1 => generated 1455 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:35.160463 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-81886ac0-c20a-4a11-9a73-5315a75a9cfd tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:35.161698 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-81886ac0-c20a-4a11-9a73-5315a75a9cfd tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:35.170325 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-81886ac0-c20a-4a11-9a73-5315a75a9cfd tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:35.171967 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-81886ac0-c20a-4a11-9a73-5315a75a9cfd tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:35.171967 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-81886ac0-c20a-4a11-9a73-5315a75a9cfd tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:35.172793 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-81886ac0-c20a-4a11-9a73-5315a75a9cfd tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:35.331932 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-81886ac0-c20a-4a11-9a73-5315a75a9cfd tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:35.339985 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-81886ac0-c20a-4a11-9a73-5315a75a9cfd tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1473 microversion: 2.1 time: 0.183585 Apr 16 21:18:35.340535 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1614/3365] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:35 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1473 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:35.734457 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1da89e88-43f0-4d16-97b2-005b7d6b3de3 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb968764c0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:35.791280 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1da89e88-43f0-4d16-97b2-005b7d6b3de3 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/1fbece82-f4ee-4e94-949b-04e6fc239ff1" status: 200 len: 1455 microversion: 2.1 time: 0.061577 Apr 16 21:18:35.792127 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1752/3366] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:35 2022] GET /compute/v2.1/images/1fbece82-f4ee-4e94-949b-04e6fc239ff1 => generated 1455 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:35.888552 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-5e2d7421-45a8-405e-96f7-8d2d3ccb022e req-2810b508-2776-47de-bee9-f5e81e7a952c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71bd33e5-85e5-452d-8ddb-e1817ed9abd2", "tag": "f69be29b-9cad-412c-a6a2-2f5df4fa07b2"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:18:35.897720 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-5e2d7421-45a8-405e-96f7-8d2d3ccb022e req-2810b508-2776-47de-bee9-f5e81e7a952c service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:35.900356 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-5e2d7421-45a8-405e-96f7-8d2d3ccb022e req-2810b508-2776-47de-bee9-f5e81e7a952c service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:35.913198 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-5e2d7421-45a8-405e-96f7-8d2d3ccb022e req-2810b508-2776-47de-bee9-f5e81e7a952c service nova] Creating event network-changed:f69be29b-9cad-412c-a6a2-2f5df4fa07b2 for instance 71bd33e5-85e5-452d-8ddb-e1817ed9abd2 on nch2-master-1 Apr 16 21:18:35.919864 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [req-5e2d7421-45a8-405e-96f7-8d2d3ccb022e req-2810b508-2776-47de-bee9-f5e81e7a952c service nova] Instance 71bd33e5-85e5-452d-8ddb-e1817ed9abd2 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137409) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 16 21:18:35.930972 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-5e2d7421-45a8-405e-96f7-8d2d3ccb022e req-2810b508-2776-47de-bee9-f5e81e7a952c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046213 Apr 16 21:18:35.931812 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1615/3367] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:18:36.357541 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-87fe4fa8-a3ed-4ceb-8df1-a00834b387f3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:36.358525 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-87fe4fa8-a3ed-4ceb-8df1-a00834b387f3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:36.365745 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-87fe4fa8-a3ed-4ceb-8df1-a00834b387f3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:36.367120 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-87fe4fa8-a3ed-4ceb-8df1-a00834b387f3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:36.368670 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-87fe4fa8-a3ed-4ceb-8df1-a00834b387f3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:36.369189 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-87fe4fa8-a3ed-4ceb-8df1-a00834b387f3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:36.794746 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-87fe4fa8-a3ed-4ceb-8df1-a00834b387f3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:36.803566 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-87fe4fa8-a3ed-4ceb-8df1-a00834b387f3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1473 microversion: 2.1 time: 0.450074 Apr 16 21:18:36.805885 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6ba92e47-8668-42fd-83a4-e9e0a1b754bf tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb9ff73310>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:36.807309 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1753/3368] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:36 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1473 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:36.850684 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6ba92e47-8668-42fd-83a4-e9e0a1b754bf tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/1fbece82-f4ee-4e94-949b-04e6fc239ff1" status: 200 len: 1455 microversion: 2.1 time: 0.049644 Apr 16 21:18:36.853381 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1616/3369] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:36 2022] GET /compute/v2.1/images/1fbece82-f4ee-4e94-949b-04e6fc239ff1 => generated 1455 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:37.445456 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-20678979-70ce-4649-aade-9dfe98b8e8fd tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:18:37.446861 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-20678979-70ce-4649-aade-9dfe98b8e8fd tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:37.454032 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-20678979-70ce-4649-aade-9dfe98b8e8fd tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:37.454949 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-20678979-70ce-4649-aade-9dfe98b8e8fd tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:37.455885 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-20678979-70ce-4649-aade-9dfe98b8e8fd tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:37.459345 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-20678979-70ce-4649-aade-9dfe98b8e8fd tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:37.488199 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-20678979-70ce-4649-aade-9dfe98b8e8fd tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lazy-loading 'flavor' on Instance uuid 8c7cd9df-57f3-47a6-aa40-76ee208e2c09 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:18:37.825685 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d524adfb-036f-40e8-bea2-4fda4d210bfa tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:37.827607 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d524adfb-036f-40e8-bea2-4fda4d210bfa tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:37.835043 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d524adfb-036f-40e8-bea2-4fda4d210bfa tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:37.835758 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d524adfb-036f-40e8-bea2-4fda4d210bfa tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:37.836874 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d524adfb-036f-40e8-bea2-4fda4d210bfa tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:37.837377 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d524adfb-036f-40e8-bea2-4fda4d210bfa tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:37.853157 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-20678979-70ce-4649-aade-9dfe98b8e8fd tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "POST /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09/action" status: 200 len: 32 microversion: 2.1 time: 0.411907 Apr 16 21:18:37.865117 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1754/3370] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:18:37 2022] POST /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09/action => generated 32 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:18:37.887154 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cabe13fa-1f03-417d-b868-1c85621a6af9 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:37.887872 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cabe13fa-1f03-417d-b868-1c85621a6af9 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:37.898100 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cabe13fa-1f03-417d-b868-1c85621a6af9 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:37.901698 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cabe13fa-1f03-417d-b868-1c85621a6af9 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:37.901698 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cabe13fa-1f03-417d-b868-1c85621a6af9 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:37.901698 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cabe13fa-1f03-417d-b868-1c85621a6af9 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:38.039326 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d524adfb-036f-40e8-bea2-4fda4d210bfa tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:38.047228 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d524adfb-036f-40e8-bea2-4fda4d210bfa tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1473 microversion: 2.1 time: 0.227409 Apr 16 21:18:38.056090 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1617/3371] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:37 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1473 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:38.061396 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5a559cb4-a541-425d-ab42-2eef3550d25d tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb9ff38940>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:38.094871 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cabe13fa-1f03-417d-b868-1c85621a6af9 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:38.104804 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cabe13fa-1f03-417d-b868-1c85621a6af9 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09" status: 200 len: 1736 microversion: 2.1 time: 0.234456 Apr 16 21:18:38.116054 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1755/3372] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:37 2022] GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09 => generated 1736 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:38.127201 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5a559cb4-a541-425d-ab42-2eef3550d25d tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/1fbece82-f4ee-4e94-949b-04e6fc239ff1" status: 200 len: 1455 microversion: 2.1 time: 0.069646 Apr 16 21:18:38.129928 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1618/3373] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:38 2022] GET /compute/v2.1/images/1fbece82-f4ee-4e94-949b-04e6fc239ff1 => generated 1455 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:38.785859 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-efd457ec-5afe-4e22-b751-6c73b0f3fadc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:18:38.789225 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-efd457ec-5afe-4e22-b751-6c73b0f3fadc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:38.801189 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-efd457ec-5afe-4e22-b751-6c73b0f3fadc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:38.801804 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-efd457ec-5afe-4e22-b751-6c73b0f3fadc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:38.802675 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-efd457ec-5afe-4e22-b751-6c73b0f3fadc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:38.803197 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-efd457ec-5afe-4e22-b751-6c73b0f3fadc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:39.065949 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-48c2af2d-2590-4deb-96c0-11ea67261ed9 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:39.067195 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-48c2af2d-2590-4deb-96c0-11ea67261ed9 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:39.074935 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-48c2af2d-2590-4deb-96c0-11ea67261ed9 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:39.075661 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-48c2af2d-2590-4deb-96c0-11ea67261ed9 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:39.076501 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-48c2af2d-2590-4deb-96c0-11ea67261ed9 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:39.077094 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-48c2af2d-2590-4deb-96c0-11ea67261ed9 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:39.128758 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-efd457ec-5afe-4e22-b751-6c73b0f3fadc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "POST /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa/action" status: 202 len: 0 microversion: 2.1 time: 0.502661 Apr 16 21:18:39.137473 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1756/3374] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:18:38 2022] POST /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa/action => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:18:39.149798 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c3d41fac-ed28-47b9-92d2-ec2d5f501cd6 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:39.156956 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c3d41fac-ed28-47b9-92d2-ec2d5f501cd6 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:39.177043 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3d41fac-ed28-47b9-92d2-ec2d5f501cd6 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:39.182977 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3d41fac-ed28-47b9-92d2-ec2d5f501cd6 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:39.182977 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3d41fac-ed28-47b9-92d2-ec2d5f501cd6 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:39.182977 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3d41fac-ed28-47b9-92d2-ec2d5f501cd6 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:39.318280 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-48c2af2d-2590-4deb-96c0-11ea67261ed9 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:39.328159 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-48c2af2d-2590-4deb-96c0-11ea67261ed9 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1473 microversion: 2.1 time: 0.266827 Apr 16 21:18:39.329643 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1619/3375] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:39 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1473 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:18:39.334822 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-15ef28b6-247e-46fe-a0b0-f55763ea2c97 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:39.336234 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-15ef28b6-247e-46fe-a0b0-f55763ea2c97 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:39.343599 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-15ef28b6-247e-46fe-a0b0-f55763ea2c97 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:39.344361 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-15ef28b6-247e-46fe-a0b0-f55763ea2c97 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:39.345344 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-15ef28b6-247e-46fe-a0b0-f55763ea2c97 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:39.345956 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-15ef28b6-247e-46fe-a0b0-f55763ea2c97 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:39.515138 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-15ef28b6-247e-46fe-a0b0-f55763ea2c97 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:39.526583 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-15ef28b6-247e-46fe-a0b0-f55763ea2c97 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1672 microversion: 2.1 time: 0.195651 Apr 16 21:18:39.528964 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1620/3376] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:39 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1672 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:39.533604 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-44656b0e-d3a3-42c5-a8d7-92320aaad313 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb96a3d5e0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:39.598299 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-44656b0e-d3a3-42c5-a8d7-92320aaad313 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/1fbece82-f4ee-4e94-949b-04e6fc239ff1" status: 200 len: 1455 microversion: 2.1 time: 0.068979 Apr 16 21:18:39.603414 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1621/3377] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:39 2022] GET /compute/v2.1/images/1fbece82-f4ee-4e94-949b-04e6fc239ff1 => generated 1455 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:39.621337 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c3d41fac-ed28-47b9-92d2-ec2d5f501cd6 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:39.637154 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c3d41fac-ed28-47b9-92d2-ec2d5f501cd6 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09" status: 200 len: 1736 microversion: 2.1 time: 0.495761 Apr 16 21:18:39.640615 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1757/3378] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:39 2022] GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09 => generated 1736 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:40.348065 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4a9002a8-40a1-4e94-879f-ca6a242eada3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:40.353596 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4a9002a8-40a1-4e94-879f-ca6a242eada3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:40.356399 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4a9002a8-40a1-4e94-879f-ca6a242eada3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:40.356857 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4a9002a8-40a1-4e94-879f-ca6a242eada3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:40.357630 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4a9002a8-40a1-4e94-879f-ca6a242eada3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:40.358076 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4a9002a8-40a1-4e94-879f-ca6a242eada3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:40.498493 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4a9002a8-40a1-4e94-879f-ca6a242eada3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:40.506755 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4a9002a8-40a1-4e94-879f-ca6a242eada3 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1470 microversion: 2.1 time: 0.163635 Apr 16 21:18:40.507337 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1622/3379] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:40 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1470 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:40.523636 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-59f0428d-01be-44a3-a271-cb0e1768ce34 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:18:40.524286 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-59f0428d-01be-44a3-a271-cb0e1768ce34 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:40.531285 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-59f0428d-01be-44a3-a271-cb0e1768ce34 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:40.536443 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-59f0428d-01be-44a3-a271-cb0e1768ce34 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:40.541386 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-59f0428d-01be-44a3-a271-cb0e1768ce34 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:40.542078 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-59f0428d-01be-44a3-a271-cb0e1768ce34 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:40.547683 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6a5de9cc-2694-4e73-9741-5c8ef3c0b3b3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:40.548545 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6a5de9cc-2694-4e73-9741-5c8ef3c0b3b3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:40.555948 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6a5de9cc-2694-4e73-9741-5c8ef3c0b3b3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:40.556701 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6a5de9cc-2694-4e73-9741-5c8ef3c0b3b3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:40.557870 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6a5de9cc-2694-4e73-9741-5c8ef3c0b3b3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:40.558495 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6a5de9cc-2694-4e73-9741-5c8ef3c0b3b3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:40.734391 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6a5de9cc-2694-4e73-9741-5c8ef3c0b3b3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:40.746078 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6a5de9cc-2694-4e73-9741-5c8ef3c0b3b3 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1677 microversion: 2.1 time: 0.203801 Apr 16 21:18:40.755939 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1623/3380] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:40 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1677 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:18:40.755939 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7192afa1-b920-488e-8efa-1b37576296a0 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb96a3db80>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:40.816778 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7192afa1-b920-488e-8efa-1b37576296a0 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/1fbece82-f4ee-4e94-949b-04e6fc239ff1" status: 200 len: 1455 microversion: 2.1 time: 0.068945 Apr 16 21:18:40.822452 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1624/3381] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:40 2022] GET /compute/v2.1/images/1fbece82-f4ee-4e94-949b-04e6fc239ff1 => generated 1455 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:40.827572 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a1dc74f0-78bf-4ac1-92fa-78ed9c201e7a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:40.828208 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a1dc74f0-78bf-4ac1-92fa-78ed9c201e7a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:40.834512 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a1dc74f0-78bf-4ac1-92fa-78ed9c201e7a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:40.834970 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a1dc74f0-78bf-4ac1-92fa-78ed9c201e7a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:40.836318 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a1dc74f0-78bf-4ac1-92fa-78ed9c201e7a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:40.836771 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a1dc74f0-78bf-4ac1-92fa-78ed9c201e7a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:40.839829 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-59f0428d-01be-44a3-a271-cb0e1768ce34 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "POST /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2/action" status: 202 len: 0 microversion: 2.1 time: 0.320032 Apr 16 21:18:40.840887 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1758/3382] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:18:40 2022] POST /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:18:40.849378 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f8f8eb8b-39cf-42e0-b6ca-fc2e0608066e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:40.850584 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f8f8eb8b-39cf-42e0-b6ca-fc2e0608066e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:40.858777 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f8f8eb8b-39cf-42e0-b6ca-fc2e0608066e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:40.859681 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f8f8eb8b-39cf-42e0-b6ca-fc2e0608066e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:40.860597 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f8f8eb8b-39cf-42e0-b6ca-fc2e0608066e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:40.861774 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f8f8eb8b-39cf-42e0-b6ca-fc2e0608066e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:40.998087 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a1dc74f0-78bf-4ac1-92fa-78ed9c201e7a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:41.007592 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f8f8eb8b-39cf-42e0-b6ca-fc2e0608066e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:41.008690 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a1dc74f0-78bf-4ac1-92fa-78ed9c201e7a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09" status: 200 len: 1736 microversion: 2.1 time: 0.184671 Apr 16 21:18:41.018446 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1625/3383] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:40 2022] GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09 => generated 1736 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:41.019233 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f8f8eb8b-39cf-42e0-b6ca-fc2e0608066e tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1469 microversion: 2.1 time: 0.174154 Apr 16 21:18:41.020052 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1759/3384] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:40 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1469 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:41.763464 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-32a9c552-0a85-4473-8eea-3d7294cce037 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:41.763979 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-32a9c552-0a85-4473-8eea-3d7294cce037 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:41.770767 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-32a9c552-0a85-4473-8eea-3d7294cce037 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:41.771232 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-32a9c552-0a85-4473-8eea-3d7294cce037 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:41.772038 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-32a9c552-0a85-4473-8eea-3d7294cce037 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:41.772517 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-32a9c552-0a85-4473-8eea-3d7294cce037 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:41.829832 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-559dba37-9034-4f15-b8ea-554306118343 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb965a2a60>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:41.878835 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-559dba37-9034-4f15-b8ea-554306118343 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/1fbece82-f4ee-4e94-949b-04e6fc239ff1" status: 200 len: 1464 microversion: 2.1 time: 0.052788 Apr 16 21:18:41.882252 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1760/3385] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:41 2022] GET /compute/v2.1/images/1fbece82-f4ee-4e94-949b-04e6fc239ff1 => generated 1464 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:18:41.890527 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2cf31673-a2be-402d-9571-62b9b663f738 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb96f758b0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:41.910193 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-32a9c552-0a85-4473-8eea-3d7294cce037 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:41.919258 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-32a9c552-0a85-4473-8eea-3d7294cce037 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.159732 Apr 16 21:18:41.919840 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1626/3386] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:41 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:41.935724 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2cf31673-a2be-402d-9571-62b9b663f738 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/1fbece82-f4ee-4e94-949b-04e6fc239ff1" status: 200 len: 1464 microversion: 2.1 time: 0.048813 Apr 16 21:18:41.936314 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1761/3387] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:41 2022] GET /compute/v2.1/images/1fbece82-f4ee-4e94-949b-04e6fc239ff1 => generated 1464 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:18:41.951236 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-86cdba46-d56a-45fd-a2b2-01c797356baf tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:41.958081 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-86cdba46-d56a-45fd-a2b2-01c797356baf tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] [instance: 0ba3ff1f-0ee1-4dba-8354-10aaef694161] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:41.958081 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-86cdba46-d56a-45fd-a2b2-01c797356baf tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:41.958346 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-86cdba46-d56a-45fd-a2b2-01c797356baf tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:41.959155 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-86cdba46-d56a-45fd-a2b2-01c797356baf tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:41.959605 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-86cdba46-d56a-45fd-a2b2-01c797356baf tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:42.026162 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6e9ab697-8e7a-4ab7-af76-09f7a18d3d57 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:42.026871 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6e9ab697-8e7a-4ab7-af76-09f7a18d3d57 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:42.033405 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6e9ab697-8e7a-4ab7-af76-09f7a18d3d57 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:42.033945 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6e9ab697-8e7a-4ab7-af76-09f7a18d3d57 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:42.034829 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6e9ab697-8e7a-4ab7-af76-09f7a18d3d57 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:42.035352 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6e9ab697-8e7a-4ab7-af76-09f7a18d3d57 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:42.087618 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-86cdba46-d56a-45fd-a2b2-01c797356baf tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484bca4e32554ed4af061012f30666ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79f0fe4726d4abcbdc2672a15f709f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:42.095021 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-86cdba46-d56a-45fd-a2b2-01c797356baf tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161" status: 200 len: 1480 microversion: 2.1 time: 0.147728 Apr 16 21:18:42.095790 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1627/3388] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:41 2022] GET /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161 => generated 1480 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:42.100286 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-06f061b3-66b5-4a06-b57a-be376afe73aa tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:42.101435 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-06f061b3-66b5-4a06-b57a-be376afe73aa tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:42.107757 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-06f061b3-66b5-4a06-b57a-be376afe73aa tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:42.107757 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-06f061b3-66b5-4a06-b57a-be376afe73aa tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:42.108376 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-06f061b3-66b5-4a06-b57a-be376afe73aa tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:42.108821 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-06f061b3-66b5-4a06-b57a-be376afe73aa tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:42.169759 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6e9ab697-8e7a-4ab7-af76-09f7a18d3d57 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:42.177873 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6e9ab697-8e7a-4ab7-af76-09f7a18d3d57 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09" status: 200 len: 1736 microversion: 2.1 time: 0.155777 Apr 16 21:18:42.178425 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1762/3389] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:42 2022] GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:18:42.243480 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-06f061b3-66b5-4a06-b57a-be376afe73aa tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:42.251062 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-06f061b3-66b5-4a06-b57a-be376afe73aa tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1469 microversion: 2.1 time: 0.154294 Apr 16 21:18:42.251630 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1628/3390] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:42 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1469 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:42.659461 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-adf1c5b9-a2e8-4aa0-9416-a2e05f2d5f15 req-555253b0-7782-473a-a5b8-4645bfd40dc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71bd33e5-85e5-452d-8ddb-e1817ed9abd2", "name": "network-vif-plugged", "status": "completed", "tag": "f69be29b-9cad-412c-a6a2-2f5df4fa07b2"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:18:42.668003 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-adf1c5b9-a2e8-4aa0-9416-a2e05f2d5f15 req-555253b0-7782-473a-a5b8-4645bfd40dc1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:42.668489 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-adf1c5b9-a2e8-4aa0-9416-a2e05f2d5f15 req-555253b0-7782-473a-a5b8-4645bfd40dc1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:42.680367 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-adf1c5b9-a2e8-4aa0-9416-a2e05f2d5f15 req-555253b0-7782-473a-a5b8-4645bfd40dc1 service nova] Creating event network-vif-plugged:f69be29b-9cad-412c-a6a2-2f5df4fa07b2 for instance 71bd33e5-85e5-452d-8ddb-e1817ed9abd2 on nch2-master-1 Apr 16 21:18:42.685745 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [req-adf1c5b9-a2e8-4aa0-9416-a2e05f2d5f15 req-555253b0-7782-473a-a5b8-4645bfd40dc1 service nova] Instance 71bd33e5-85e5-452d-8ddb-e1817ed9abd2 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 16 21:18:42.696838 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-adf1c5b9-a2e8-4aa0-9416-a2e05f2d5f15 req-555253b0-7782-473a-a5b8-4645bfd40dc1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041274 Apr 16 21:18:42.697444 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1763/3391] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:18:43.111978 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-58ee3a50-c82c-47dd-ac51-8af928b19328 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:43.112699 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-58ee3a50-c82c-47dd-ac51-8af928b19328 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] [instance: 0ba3ff1f-0ee1-4dba-8354-10aaef694161] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:43.119886 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-58ee3a50-c82c-47dd-ac51-8af928b19328 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:43.120374 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-58ee3a50-c82c-47dd-ac51-8af928b19328 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:43.121143 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-58ee3a50-c82c-47dd-ac51-8af928b19328 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:43.121585 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-58ee3a50-c82c-47dd-ac51-8af928b19328 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:43.197154 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-85d2861f-0b6b-4c40-9a1f-155ada356800 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:43.198019 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-85d2861f-0b6b-4c40-9a1f-155ada356800 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:43.205004 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-85d2861f-0b6b-4c40-9a1f-155ada356800 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:43.205501 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-85d2861f-0b6b-4c40-9a1f-155ada356800 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:43.206252 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-85d2861f-0b6b-4c40-9a1f-155ada356800 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:43.206983 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-85d2861f-0b6b-4c40-9a1f-155ada356800 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:43.256500 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-58ee3a50-c82c-47dd-ac51-8af928b19328 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484bca4e32554ed4af061012f30666ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79f0fe4726d4abcbdc2672a15f709f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:43.265250 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-58ee3a50-c82c-47dd-ac51-8af928b19328 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161" status: 200 len: 1480 microversion: 2.1 time: 0.157153 Apr 16 21:18:43.265838 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1629/3392] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:43 2022] GET /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161 => generated 1480 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:18:43.270417 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-416a862b-db0a-4db1-a6cc-954bff87d401 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:43.271080 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-416a862b-db0a-4db1-a6cc-954bff87d401 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:43.277092 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-416a862b-db0a-4db1-a6cc-954bff87d401 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:43.277560 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-416a862b-db0a-4db1-a6cc-954bff87d401 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:43.278349 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-416a862b-db0a-4db1-a6cc-954bff87d401 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:43.278799 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-416a862b-db0a-4db1-a6cc-954bff87d401 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:43.348786 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-85d2861f-0b6b-4c40-9a1f-155ada356800 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:43.357287 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-85d2861f-0b6b-4c40-9a1f-155ada356800 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09" status: 200 len: 1736 microversion: 2.1 time: 0.165877 Apr 16 21:18:43.357864 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1764/3393] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:43 2022] GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09 => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:18:43.412007 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-416a862b-db0a-4db1-a6cc-954bff87d401 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:43.420474 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-416a862b-db0a-4db1-a6cc-954bff87d401 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1469 microversion: 2.1 time: 0.153634 Apr 16 21:18:43.421058 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1630/3394] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:43 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1469 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:44.282181 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bd45269d-c51a-4d8a-9a5c-2ca9d4c0ed27 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:44.282705 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-bd45269d-c51a-4d8a-9a5c-2ca9d4c0ed27 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] [instance: 0ba3ff1f-0ee1-4dba-8354-10aaef694161] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:44.289347 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bd45269d-c51a-4d8a-9a5c-2ca9d4c0ed27 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:44.289808 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bd45269d-c51a-4d8a-9a5c-2ca9d4c0ed27 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:44.290587 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bd45269d-c51a-4d8a-9a5c-2ca9d4c0ed27 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:44.291177 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bd45269d-c51a-4d8a-9a5c-2ca9d4c0ed27 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:44.374999 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-69bfd3f6-226d-44b7-a8be-e67d75727c50 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:44.375662 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-69bfd3f6-226d-44b7-a8be-e67d75727c50 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:44.382818 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-69bfd3f6-226d-44b7-a8be-e67d75727c50 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:44.383713 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-69bfd3f6-226d-44b7-a8be-e67d75727c50 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:44.384525 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-69bfd3f6-226d-44b7-a8be-e67d75727c50 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:44.384970 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-69bfd3f6-226d-44b7-a8be-e67d75727c50 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:44.419794 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-bd45269d-c51a-4d8a-9a5c-2ca9d4c0ed27 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484bca4e32554ed4af061012f30666ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79f0fe4726d4abcbdc2672a15f709f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:44.427397 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-bd45269d-c51a-4d8a-9a5c-2ca9d4c0ed27 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161" status: 200 len: 1467 microversion: 2.1 time: 0.149514 Apr 16 21:18:44.431046 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1765/3395] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:44 2022] GET /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161 => generated 1467 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:44.444971 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a3547512-7ce9-4ccf-aa45-9512f0019ed4 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:44.451134 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a3547512-7ce9-4ccf-aa45-9512f0019ed4 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:44.453097 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a3547512-7ce9-4ccf-aa45-9512f0019ed4 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:44.453565 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a3547512-7ce9-4ccf-aa45-9512f0019ed4 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:44.454367 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a3547512-7ce9-4ccf-aa45-9512f0019ed4 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:44.454948 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a3547512-7ce9-4ccf-aa45-9512f0019ed4 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:44.531522 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-69bfd3f6-226d-44b7-a8be-e67d75727c50 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:44.539796 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-69bfd3f6-226d-44b7-a8be-e67d75727c50 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09" status: 200 len: 1736 microversion: 2.1 time: 0.168805 Apr 16 21:18:44.540579 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1631/3396] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:44 2022] GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:18:44.545196 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e26fc678-c780-4132-887a-1b3f0e784c7e tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-879239878"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:18:44.546280 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e26fc678-c780-4132-887a-1b3f0e784c7e tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] [instance: 9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:44.552103 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e26fc678-c780-4132-887a-1b3f0e784c7e tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:44.555931 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e26fc678-c780-4132-887a-1b3f0e784c7e tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:44.555931 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e26fc678-c780-4132-887a-1b3f0e784c7e tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:44.555931 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e26fc678-c780-4132-887a-1b3f0e784c7e tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:44.615481 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a3547512-7ce9-4ccf-aa45-9512f0019ed4 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:44.632277 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a3547512-7ce9-4ccf-aa45-9512f0019ed4 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1469 microversion: 2.1 time: 0.184115 Apr 16 21:18:44.632277 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1766/3397] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:44 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1469 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:18:45.072439 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e26fc678-c780-4132-887a-1b3f0e784c7e tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "POST /compute/v2.1/servers/9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523/action" status: 202 len: 0 microversion: 2.1 time: 0.530547 Apr 16 21:18:45.073167 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1632/3398] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:18:44 2022] POST /compute/v2.1/servers/9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523/action => generated 0 bytes in 532 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 16 21:18:45.082856 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-faa54897-f66b-4076-8627-560eee4c5728 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb9593de50>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:45.114098 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-70ef4f80-f7ad-4639-8215-e7a8a01c6cc7 req-28ea6005-80d3-437d-9d89-1d2c1db967de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71bd33e5-85e5-452d-8ddb-e1817ed9abd2", "name": "network-vif-unplugged", "status": "completed", "tag": "f69be29b-9cad-412c-a6a2-2f5df4fa07b2"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:18:45.120376 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-70ef4f80-f7ad-4639-8215-e7a8a01c6cc7 req-28ea6005-80d3-437d-9d89-1d2c1db967de service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:45.120843 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-70ef4f80-f7ad-4639-8215-e7a8a01c6cc7 req-28ea6005-80d3-437d-9d89-1d2c1db967de service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:45.128738 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-faa54897-f66b-4076-8627-560eee4c5728 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/0525c28c-bdce-4175-be0f-2c6b3f430341" status: 200 len: 1454 microversion: 2.1 time: 0.049839 Apr 16 21:18:45.129328 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1767/3399] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:45 2022] GET /compute/v2.1/images/0525c28c-bdce-4175-be0f-2c6b3f430341 => generated 1454 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:45.132927 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-70ef4f80-f7ad-4639-8215-e7a8a01c6cc7 req-28ea6005-80d3-437d-9d89-1d2c1db967de service nova] Creating event network-vif-unplugged:f69be29b-9cad-412c-a6a2-2f5df4fa07b2 for instance 71bd33e5-85e5-452d-8ddb-e1817ed9abd2 on nch1-master-1 Apr 16 21:18:45.138340 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [req-70ef4f80-f7ad-4639-8215-e7a8a01c6cc7 req-28ea6005-80d3-437d-9d89-1d2c1db967de service nova] Instance 71bd33e5-85e5-452d-8ddb-e1817ed9abd2 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137409) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 16 21:18:45.149384 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-70ef4f80-f7ad-4639-8215-e7a8a01c6cc7 req-28ea6005-80d3-437d-9d89-1d2c1db967de service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043243 Apr 16 21:18:45.150058 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1633/3400] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:18:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:18:45.557433 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-01162029-b037-40a5-859d-c2b70c58e06b tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:45.557997 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-01162029-b037-40a5-859d-c2b70c58e06b tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:45.564872 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-01162029-b037-40a5-859d-c2b70c58e06b tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:45.565450 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-01162029-b037-40a5-859d-c2b70c58e06b tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:45.566234 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-01162029-b037-40a5-859d-c2b70c58e06b tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:45.566675 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-01162029-b037-40a5-859d-c2b70c58e06b tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:45.645353 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c6055bbc-73a1-4f06-b0e0-bf57a609629a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:45.646793 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c6055bbc-73a1-4f06-b0e0-bf57a609629a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:45.655059 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c6055bbc-73a1-4f06-b0e0-bf57a609629a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:45.656018 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c6055bbc-73a1-4f06-b0e0-bf57a609629a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:45.657063 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c6055bbc-73a1-4f06-b0e0-bf57a609629a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:45.658518 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c6055bbc-73a1-4f06-b0e0-bf57a609629a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:45.724206 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-01162029-b037-40a5-859d-c2b70c58e06b tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:45.732898 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-01162029-b037-40a5-859d-c2b70c58e06b tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09" status: 200 len: 1736 microversion: 2.1 time: 0.180224 Apr 16 21:18:45.738811 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1768/3401] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:45 2022] GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09 => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:45.876935 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c6055bbc-73a1-4f06-b0e0-bf57a609629a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:45.885653 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c6055bbc-73a1-4f06-b0e0-bf57a609629a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1469 microversion: 2.1 time: 0.246392 Apr 16 21:18:45.886266 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1634/3402] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:45 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1469 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:18:46.147459 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9930f65b-6068-4c9f-b852-a58f71856d80 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb96817af0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:46.190336 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9930f65b-6068-4c9f-b852-a58f71856d80 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/0525c28c-bdce-4175-be0f-2c6b3f430341" status: 200 len: 1454 microversion: 2.1 time: 0.046615 Apr 16 21:18:46.190912 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1769/3403] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:46 2022] GET /compute/v2.1/images/0525c28c-bdce-4175-be0f-2c6b3f430341 => generated 1454 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:46.544741 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-f6debc68-0faf-4041-ae86-106c1b63c70c req-7f1622cc-db5d-4670-9aeb-f353fcda2b2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ba3ff1f-0ee1-4dba-8354-10aaef694161", "name": "network-vif-unplugged", "status": "completed", "tag": "da205378-8574-416e-8ccf-7ec5bb2d4541"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:18:46.553014 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-f6debc68-0faf-4041-ae86-106c1b63c70c req-7f1622cc-db5d-4670-9aeb-f353fcda2b2a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:46.553464 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-f6debc68-0faf-4041-ae86-106c1b63c70c req-7f1622cc-db5d-4670-9aeb-f353fcda2b2a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:46.564810 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-f6debc68-0faf-4041-ae86-106c1b63c70c req-7f1622cc-db5d-4670-9aeb-f353fcda2b2a service nova] Creating event network-vif-unplugged:da205378-8574-416e-8ccf-7ec5bb2d4541 for instance 0ba3ff1f-0ee1-4dba-8354-10aaef694161 on nch2-master-1 Apr 16 21:18:46.570014 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-f6debc68-0faf-4041-ae86-106c1b63c70c req-7f1622cc-db5d-4670-9aeb-f353fcda2b2a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029410 Apr 16 21:18:46.570697 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1635/3404] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:18:46.751432 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4afa3900-0a97-4f0e-a511-0f52ddea54d7 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:46.752048 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4afa3900-0a97-4f0e-a511-0f52ddea54d7 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:46.760618 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4afa3900-0a97-4f0e-a511-0f52ddea54d7 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:46.761073 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4afa3900-0a97-4f0e-a511-0f52ddea54d7 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:46.761849 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4afa3900-0a97-4f0e-a511-0f52ddea54d7 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:46.762291 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4afa3900-0a97-4f0e-a511-0f52ddea54d7 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:46.893540 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4afa3900-0a97-4f0e-a511-0f52ddea54d7 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:46.902427 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4afa3900-0a97-4f0e-a511-0f52ddea54d7 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09" status: 200 len: 1736 microversion: 2.1 time: 0.155857 Apr 16 21:18:46.905169 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fd9e6dcf-8c36-4bf6-8069-36b807f083fb tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:46.905911 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-fd9e6dcf-8c36-4bf6-8069-36b807f083fb tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:46.909592 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1770/3405] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:46 2022] GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:46.912090 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fd9e6dcf-8c36-4bf6-8069-36b807f083fb tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:46.914431 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fd9e6dcf-8c36-4bf6-8069-36b807f083fb tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:46.914431 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fd9e6dcf-8c36-4bf6-8069-36b807f083fb tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:46.914431 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fd9e6dcf-8c36-4bf6-8069-36b807f083fb tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:47.049704 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-fd9e6dcf-8c36-4bf6-8069-36b807f083fb tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:47.057230 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fd9e6dcf-8c36-4bf6-8069-36b807f083fb tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1469 microversion: 2.1 time: 0.158046 Apr 16 21:18:47.057803 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1636/3406] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:46 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1469 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:18:47.164255 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-2edae5fe-4ebc-4eb0-8841-d0f0fd0a7b06 req-0f9bc9c4-1e12-4e25-8a9e-cc28ae39e9f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71bd33e5-85e5-452d-8ddb-e1817ed9abd2", "tag": "f69be29b-9cad-412c-a6a2-2f5df4fa07b2"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:18:47.172617 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-2edae5fe-4ebc-4eb0-8841-d0f0fd0a7b06 req-0f9bc9c4-1e12-4e25-8a9e-cc28ae39e9f0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:47.173109 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-2edae5fe-4ebc-4eb0-8841-d0f0fd0a7b06 req-0f9bc9c4-1e12-4e25-8a9e-cc28ae39e9f0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:47.196156 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-2edae5fe-4ebc-4eb0-8841-d0f0fd0a7b06 req-0f9bc9c4-1e12-4e25-8a9e-cc28ae39e9f0 service nova] Creating event network-changed:f69be29b-9cad-412c-a6a2-2f5df4fa07b2 for instance 71bd33e5-85e5-452d-8ddb-e1817ed9abd2 on nch1-master-1 Apr 16 21:18:47.196156 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [req-2edae5fe-4ebc-4eb0-8841-d0f0fd0a7b06 req-0f9bc9c4-1e12-4e25-8a9e-cc28ae39e9f0 service nova] Instance 71bd33e5-85e5-452d-8ddb-e1817ed9abd2 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 16 21:18:47.202195 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-2edae5fe-4ebc-4eb0-8841-d0f0fd0a7b06 req-0f9bc9c4-1e12-4e25-8a9e-cc28ae39e9f0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041653 Apr 16 21:18:47.202796 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1771/3407] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:18:47.204569 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f03e44f6-b966-4d55-939e-aa98edf834cb tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb95835a60>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:47.249821 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f03e44f6-b966-4d55-939e-aa98edf834cb tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/0525c28c-bdce-4175-be0f-2c6b3f430341" status: 200 len: 1454 microversion: 2.1 time: 0.049629 Apr 16 21:18:47.250323 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1637/3408] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:47 2022] GET /compute/v2.1/images/0525c28c-bdce-4175-be0f-2c6b3f430341 => generated 1454 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:18:47.920340 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cefad615-e30e-4f4a-968b-e9c3ab740068 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:47.921157 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cefad615-e30e-4f4a-968b-e9c3ab740068 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:47.928211 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cefad615-e30e-4f4a-968b-e9c3ab740068 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:47.928667 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cefad615-e30e-4f4a-968b-e9c3ab740068 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:47.929505 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cefad615-e30e-4f4a-968b-e9c3ab740068 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:47.930140 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cefad615-e30e-4f4a-968b-e9c3ab740068 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:48.074478 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cefad615-e30e-4f4a-968b-e9c3ab740068 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:48.079159 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-50a01255-06d4-4371-933e-fcc91b01e0a0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:48.079814 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-50a01255-06d4-4371-933e-fcc91b01e0a0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:48.083492 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cefad615-e30e-4f4a-968b-e9c3ab740068 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09" status: 200 len: 1736 microversion: 2.1 time: 0.167864 Apr 16 21:18:48.084785 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1772/3409] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:47 2022] GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:48.087299 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-50a01255-06d4-4371-933e-fcc91b01e0a0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:48.088414 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-50a01255-06d4-4371-933e-fcc91b01e0a0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:48.093580 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-50a01255-06d4-4371-933e-fcc91b01e0a0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:48.093580 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-50a01255-06d4-4371-933e-fcc91b01e0a0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:48.223032 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-50a01255-06d4-4371-933e-fcc91b01e0a0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:48.231178 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-50a01255-06d4-4371-933e-fcc91b01e0a0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1469 microversion: 2.1 time: 0.160417 Apr 16 21:18:48.231785 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1638/3410] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:48 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1469 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:48.262989 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4981d25d-1621-43d7-9091-e072c18e5d3f tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb95934310>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:48.306832 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4981d25d-1621-43d7-9091-e072c18e5d3f tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/0525c28c-bdce-4175-be0f-2c6b3f430341" status: 200 len: 1454 microversion: 2.1 time: 0.047765 Apr 16 21:18:48.307453 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1773/3411] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:48 2022] GET /compute/v2.1/images/0525c28c-bdce-4175-be0f-2c6b3f430341 => generated 1454 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:49.101769 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1ef28e1f-339f-4a09-88af-090e73845701 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:49.102456 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1ef28e1f-339f-4a09-88af-090e73845701 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:49.109621 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1ef28e1f-339f-4a09-88af-090e73845701 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:49.110096 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1ef28e1f-339f-4a09-88af-090e73845701 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:49.110940 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1ef28e1f-339f-4a09-88af-090e73845701 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:49.111395 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1ef28e1f-339f-4a09-88af-090e73845701 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:49.237958 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1ef28e1f-339f-4a09-88af-090e73845701 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:49.246437 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1ef28e1f-339f-4a09-88af-090e73845701 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09" status: 200 len: 1736 microversion: 2.1 time: 0.148593 Apr 16 21:18:49.247232 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1639/3412] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:49 2022] GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:49.249636 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2e528335-077f-420f-b74d-5af766af99ba tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:49.250264 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2e528335-077f-420f-b74d-5af766af99ba tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:49.257031 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2e528335-077f-420f-b74d-5af766af99ba tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:49.257488 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2e528335-077f-420f-b74d-5af766af99ba tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:49.258305 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2e528335-077f-420f-b74d-5af766af99ba tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:49.258745 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2e528335-077f-420f-b74d-5af766af99ba tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:49.320008 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-152c6d83-09c1-44ea-aca2-21745f119f2f tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb9597c940>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:49.364201 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-152c6d83-09c1-44ea-aca2-21745f119f2f tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/0525c28c-bdce-4175-be0f-2c6b3f430341" status: 200 len: 1454 microversion: 2.1 time: 0.047762 Apr 16 21:18:49.364760 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1640/3413] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:49 2022] GET /compute/v2.1/images/0525c28c-bdce-4175-be0f-2c6b3f430341 => generated 1454 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:18:49.387754 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2e528335-077f-420f-b74d-5af766af99ba tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:49.395547 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2e528335-077f-420f-b74d-5af766af99ba tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1462 microversion: 2.1 time: 0.150627 Apr 16 21:18:49.396126 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1774/3414] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:49 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1462 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:18:49.411669 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1b8fc75a-e00a-4272-af87-69a8a55d8e12 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:49.412315 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1b8fc75a-e00a-4272-af87-69a8a55d8e12 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:49.418851 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1b8fc75a-e00a-4272-af87-69a8a55d8e12 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:49.422999 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1b8fc75a-e00a-4272-af87-69a8a55d8e12 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:49.422999 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1b8fc75a-e00a-4272-af87-69a8a55d8e12 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:49.422999 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1b8fc75a-e00a-4272-af87-69a8a55d8e12 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:49.554245 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1b8fc75a-e00a-4272-af87-69a8a55d8e12 tempest-MigrationsAdminTest-1514841512 tempest-MigrationsAdminTest-1514841512-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1613 microversion: 2.1 time: 0.146188 Apr 16 21:18:49.556464 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1641/3415] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:49 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1613 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:18:49.585926 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-40a619ee-95cf-48f3-b563-e8820144e091 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:49.586436 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-40a619ee-95cf-48f3-b563-e8820144e091 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:49.593041 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40a619ee-95cf-48f3-b563-e8820144e091 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:49.593509 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40a619ee-95cf-48f3-b563-e8820144e091 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:49.594545 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40a619ee-95cf-48f3-b563-e8820144e091 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:49.594997 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40a619ee-95cf-48f3-b563-e8820144e091 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:49.627320 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-40a619ee-95cf-48f3-b563-e8820144e091 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:18:49.936861 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-40a619ee-95cf-48f3-b563-e8820144e091 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "DELETE /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 204 len: 0 microversion: 2.1 time: 0.341793 Apr 16 21:18:49.936861 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1775/3416] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:18:49 2022] DELETE /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:18:49.937150 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c2bf755c-34f9-4e28-86c6-0c5795007b0f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:49.937150 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c2bf755c-34f9-4e28-86c6-0c5795007b0f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:49.937626 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c2bf755c-34f9-4e28-86c6-0c5795007b0f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:49.938088 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c2bf755c-34f9-4e28-86c6-0c5795007b0f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:49.938867 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c2bf755c-34f9-4e28-86c6-0c5795007b0f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:49.939313 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c2bf755c-34f9-4e28-86c6-0c5795007b0f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:50.069347 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c2bf755c-34f9-4e28-86c6-0c5795007b0f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:50.077848 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c2bf755c-34f9-4e28-86c6-0c5795007b0f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1468 microversion: 2.1 time: 0.150657 Apr 16 21:18:50.082107 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1642/3417] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:49 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1468 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:18:50.264891 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b6c938d1-528c-49f3-86dc-f3dbe24ad8a1 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:50.266712 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b6c938d1-528c-49f3-86dc-f3dbe24ad8a1 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:50.274677 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b6c938d1-528c-49f3-86dc-f3dbe24ad8a1 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:50.274856 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b6c938d1-528c-49f3-86dc-f3dbe24ad8a1 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:50.276065 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b6c938d1-528c-49f3-86dc-f3dbe24ad8a1 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:50.276065 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b6c938d1-528c-49f3-86dc-f3dbe24ad8a1 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:50.377498 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-435ed7fc-498c-4d95-a207-6025757aa153 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb96534c10>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:50.428036 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-435ed7fc-498c-4d95-a207-6025757aa153 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/0525c28c-bdce-4175-be0f-2c6b3f430341" status: 200 len: 1454 microversion: 2.1 time: 0.054331 Apr 16 21:18:50.428926 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1643/3418] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:50 2022] GET /compute/v2.1/images/0525c28c-bdce-4175-be0f-2c6b3f430341 => generated 1454 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:18:50.465829 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b6c938d1-528c-49f3-86dc-f3dbe24ad8a1 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:50.475153 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b6c938d1-528c-49f3-86dc-f3dbe24ad8a1 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09" status: 200 len: 1736 microversion: 2.1 time: 0.215202 Apr 16 21:18:50.475802 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1776/3419] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:50 2022] GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09 => generated 1736 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:18:51.094718 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-208b9fd3-482f-4633-a67c-51088ff5109a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:51.095337 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-208b9fd3-482f-4633-a67c-51088ff5109a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:51.101978 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-208b9fd3-482f-4633-a67c-51088ff5109a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:51.102447 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-208b9fd3-482f-4633-a67c-51088ff5109a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:51.103224 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-208b9fd3-482f-4633-a67c-51088ff5109a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:51.103679 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-208b9fd3-482f-4633-a67c-51088ff5109a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:51.264449 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-208b9fd3-482f-4633-a67c-51088ff5109a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:51.271863 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-208b9fd3-482f-4633-a67c-51088ff5109a tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1468 microversion: 2.1 time: 0.181129 Apr 16 21:18:51.272460 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1644/3420] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:51 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1468 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:51.441663 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f6c39100-f83e-4bf1-8a87-801469f00f22 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb9654b8b0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:51.488074 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f6c39100-f83e-4bf1-8a87-801469f00f22 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/0525c28c-bdce-4175-be0f-2c6b3f430341" status: 200 len: 1454 microversion: 2.1 time: 0.050389 Apr 16 21:18:51.488826 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1777/3421] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:51 2022] GET /compute/v2.1/images/0525c28c-bdce-4175-be0f-2c6b3f430341 => generated 1454 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:51.493467 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a5a5b1f4-467e-4510-a8f9-70d89c247970 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:51.494769 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a5a5b1f4-467e-4510-a8f9-70d89c247970 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:51.501772 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a5a5b1f4-467e-4510-a8f9-70d89c247970 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:51.502246 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a5a5b1f4-467e-4510-a8f9-70d89c247970 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:51.503048 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a5a5b1f4-467e-4510-a8f9-70d89c247970 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:51.503496 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a5a5b1f4-467e-4510-a8f9-70d89c247970 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:51.713864 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a5a5b1f4-467e-4510-a8f9-70d89c247970 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:51.721911 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a5a5b1f4-467e-4510-a8f9-70d89c247970 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09" status: 200 len: 1736 microversion: 2.1 time: 0.232411 Apr 16 21:18:51.722762 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1645/3422] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:51 2022] GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09 => generated 1736 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:51.857175 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-728985ed-5795-484d-bab5-3af70b90c13f req-fbbc5a45-729f-42db-a009-d1238447f335 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71bd33e5-85e5-452d-8ddb-e1817ed9abd2", "name": "network-vif-plugged", "status": "completed", "tag": "f69be29b-9cad-412c-a6a2-2f5df4fa07b2"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:18:51.865827 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-728985ed-5795-484d-bab5-3af70b90c13f req-fbbc5a45-729f-42db-a009-d1238447f335 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:51.866284 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-728985ed-5795-484d-bab5-3af70b90c13f req-fbbc5a45-729f-42db-a009-d1238447f335 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:51.876595 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-728985ed-5795-484d-bab5-3af70b90c13f req-fbbc5a45-729f-42db-a009-d1238447f335 service nova] Creating event network-vif-plugged:f69be29b-9cad-412c-a6a2-2f5df4fa07b2 for instance 71bd33e5-85e5-452d-8ddb-e1817ed9abd2 on nch1-master-1 Apr 16 21:18:51.881476 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-728985ed-5795-484d-bab5-3af70b90c13f req-fbbc5a45-729f-42db-a009-d1238447f335 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028769 Apr 16 21:18:51.882624 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1778/3423] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:18:52.157554 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-d446c407-02fd-4382-a9e4-f892297be33f req-52bbca8e-4b00-4599-9472-52d4eae71986 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71bd33e5-85e5-452d-8ddb-e1817ed9abd2", "name": "network-vif-deleted", "tag": "f69be29b-9cad-412c-a6a2-2f5df4fa07b2"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:18:52.171160 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-d446c407-02fd-4382-a9e4-f892297be33f req-52bbca8e-4b00-4599-9472-52d4eae71986 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:52.171881 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-d446c407-02fd-4382-a9e4-f892297be33f req-52bbca8e-4b00-4599-9472-52d4eae71986 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:52.183493 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-d446c407-02fd-4382-a9e4-f892297be33f req-52bbca8e-4b00-4599-9472-52d4eae71986 service nova] Creating event network-vif-deleted:f69be29b-9cad-412c-a6a2-2f5df4fa07b2 for instance 71bd33e5-85e5-452d-8ddb-e1817ed9abd2 on nch1-master-1 Apr 16 21:18:52.189170 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-d446c407-02fd-4382-a9e4-f892297be33f req-52bbca8e-4b00-4599-9472-52d4eae71986 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035752 Apr 16 21:18:52.193602 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1646/3424] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:18:52.292759 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8c857779-5ce2-47e0-8353-51db9a0bcab7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:52.293779 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8c857779-5ce2-47e0-8353-51db9a0bcab7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:52.301825 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8c857779-5ce2-47e0-8353-51db9a0bcab7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:52.302743 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8c857779-5ce2-47e0-8353-51db9a0bcab7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:52.303805 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8c857779-5ce2-47e0-8353-51db9a0bcab7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:52.304595 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8c857779-5ce2-47e0-8353-51db9a0bcab7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:52.374559 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8c857779-5ce2-47e0-8353-51db9a0bcab7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:52.382319 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8c857779-5ce2-47e0-8353-51db9a0bcab7 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 200 len: 1426 microversion: 2.1 time: 0.094881 Apr 16 21:18:52.382894 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1779/3425] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:52 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 1426 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:52.502772 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-65cc6196-09f8-43e2-8a2a-0e11675397ef tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb96534700>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:52.552296 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-65cc6196-09f8-43e2-8a2a-0e11675397ef tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/0525c28c-bdce-4175-be0f-2c6b3f430341" status: 200 len: 1454 microversion: 2.1 time: 0.054552 Apr 16 21:18:52.552878 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1647/3426] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:52 2022] GET /compute/v2.1/images/0525c28c-bdce-4175-be0f-2c6b3f430341 => generated 1454 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:52.738881 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2d68164a-6165-4d9b-ab59-e579f1e671cb tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:52.739497 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2d68164a-6165-4d9b-ab59-e579f1e671cb tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:52.746947 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2d68164a-6165-4d9b-ab59-e579f1e671cb tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:52.747288 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2d68164a-6165-4d9b-ab59-e579f1e671cb tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:52.748070 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2d68164a-6165-4d9b-ab59-e579f1e671cb tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:52.748544 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2d68164a-6165-4d9b-ab59-e579f1e671cb tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:52.882472 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2d68164a-6165-4d9b-ab59-e579f1e671cb tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:52.891585 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2d68164a-6165-4d9b-ab59-e579f1e671cb tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09" status: 200 len: 1716 microversion: 2.1 time: 0.156593 Apr 16 21:18:52.892152 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1780/3427] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:52 2022] GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09 => generated 1716 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:52.995876 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c077d7b4-c74f-469a-a107-123b7e9edf19 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:52.996532 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c077d7b4-c74f-469a-a107-123b7e9edf19 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:53.003273 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c077d7b4-c74f-469a-a107-123b7e9edf19 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:53.003738 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c077d7b4-c74f-469a-a107-123b7e9edf19 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:53.004549 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c077d7b4-c74f-469a-a107-123b7e9edf19 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:53.005001 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c077d7b4-c74f-469a-a107-123b7e9edf19 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:53.084861 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-c077d7b4-c74f-469a-a107-123b7e9edf19 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] HTTP exception thrown: Cannot 'detach_volume' instance 8c7cd9df-57f3-47a6-aa40-76ee208e2c09 while it is in vm_state rescued Apr 16 21:18:53.084861 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c077d7b4-c74f-469a-a107-123b7e9edf19 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Returning 409 to user: Cannot 'detach_volume' instance 8c7cd9df-57f3-47a6-aa40-76ee208e2c09 while it is in vm_state rescued {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:18:53.085828 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c077d7b4-c74f-469a-a107-123b7e9edf19 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09/os-volume_attachments/9687446e-2d63-4b79-8b0a-20abf71fe84e" status: 409 len: 152 microversion: 2.1 time: 0.094733 Apr 16 21:18:53.086396 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1648/3428] 10.222.0.20 () {58 vars in 1415 bytes} [Sat Apr 16 21:18:52 2022] DELETE /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09/os-volume_attachments/9687446e-2d63-4b79-8b0a-20abf71fe84e => generated 152 bytes in 96 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:18:53.095122 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-85c4e8f5-ca82-4cbb-a13d-3bf5b01d2093 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:18:53.095843 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-85c4e8f5-ca82-4cbb-a13d-3bf5b01d2093 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:53.102131 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-85c4e8f5-ca82-4cbb-a13d-3bf5b01d2093 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:53.102654 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-85c4e8f5-ca82-4cbb-a13d-3bf5b01d2093 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:53.103956 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-85c4e8f5-ca82-4cbb-a13d-3bf5b01d2093 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:53.104464 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-85c4e8f5-ca82-4cbb-a13d-3bf5b01d2093 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:53.359669 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-85c4e8f5-ca82-4cbb-a13d-3bf5b01d2093 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "POST /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09/action" status: 202 len: 0 microversion: 2.1 time: 0.268527 Apr 16 21:18:53.360359 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1781/3429] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:18:53 2022] POST /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:18:53.369364 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-720cf99f-7afe-48fd-b353-55b994909ae8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:53.370143 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-720cf99f-7afe-48fd-b353-55b994909ae8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:53.376362 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-720cf99f-7afe-48fd-b353-55b994909ae8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:53.376818 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-720cf99f-7afe-48fd-b353-55b994909ae8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:53.381805 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-720cf99f-7afe-48fd-b353-55b994909ae8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:53.381805 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-720cf99f-7afe-48fd-b353-55b994909ae8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:53.400985 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8ae5d408-96c1-43e8-b92d-6ca00ee73bd0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:53.404833 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8ae5d408-96c1-43e8-b92d-6ca00ee73bd0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 71bd33e5-85e5-452d-8ddb-e1817ed9abd2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:53.408477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8ae5d408-96c1-43e8-b92d-6ca00ee73bd0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:53.408942 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8ae5d408-96c1-43e8-b92d-6ca00ee73bd0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:53.409776 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8ae5d408-96c1-43e8-b92d-6ca00ee73bd0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:53.410274 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8ae5d408-96c1-43e8-b92d-6ca00ee73bd0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:53.424814 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-8ae5d408-96c1-43e8-b92d-6ca00ee73bd0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] HTTP exception thrown: Instance 71bd33e5-85e5-452d-8ddb-e1817ed9abd2 could not be found. Apr 16 21:18:53.425444 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8ae5d408-96c1-43e8-b92d-6ca00ee73bd0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Returning 404 to user: Instance 71bd33e5-85e5-452d-8ddb-e1817ed9abd2 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:18:53.426290 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8ae5d408-96c1-43e8-b92d-6ca00ee73bd0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2" status: 404 len: 111 microversion: 2.1 time: 0.030218 Apr 16 21:18:53.432075 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1782/3430] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:53 2022] GET /compute/v2.1/servers/71bd33e5-85e5-452d-8ddb-e1817ed9abd2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:18:53.440407 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6db321f0-b2d7-4e9d-98ea-b61ee3185a82 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:53.440915 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6db321f0-b2d7-4e9d-98ea-b61ee3185a82 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:53.449007 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6db321f0-b2d7-4e9d-98ea-b61ee3185a82 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:53.456969 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6db321f0-b2d7-4e9d-98ea-b61ee3185a82 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:53.456969 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6db321f0-b2d7-4e9d-98ea-b61ee3185a82 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:53.456969 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6db321f0-b2d7-4e9d-98ea-b61ee3185a82 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:53.479059 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6db321f0-b2d7-4e9d-98ea-b61ee3185a82 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:18:53.549411 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-720cf99f-7afe-48fd-b353-55b994909ae8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:53.561381 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-720cf99f-7afe-48fd-b353-55b994909ae8 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09" status: 200 len: 1724 microversion: 2.1 time: 0.196010 Apr 16 21:18:53.563115 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1649/3431] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:53 2022] GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09 => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:53.583676 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0b36a1be-9d5b-4ec3-a162-d0ecad979020 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb95808a60>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:53.634522 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0b36a1be-9d5b-4ec3-a162-d0ecad979020 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/0525c28c-bdce-4175-be0f-2c6b3f430341" status: 200 len: 1454 microversion: 2.1 time: 0.065683 Apr 16 21:18:53.635214 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1650/3432] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:53 2022] GET /compute/v2.1/images/0525c28c-bdce-4175-be0f-2c6b3f430341 => generated 1454 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:53.723161 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6db321f0-b2d7-4e9d-98ea-b61ee3185a82 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 204 len: 0 microversion: 2.1 time: 0.286483 Apr 16 21:18:53.727766 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1783/3433] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:18:53 2022] DELETE /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:18:53.733550 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4fa19661-02f9-45b7-9bb7-0a6e724d1375 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:53.734438 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4fa19661-02f9-45b7-9bb7-0a6e724d1375 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:53.741412 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4fa19661-02f9-45b7-9bb7-0a6e724d1375 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:53.741871 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4fa19661-02f9-45b7-9bb7-0a6e724d1375 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:53.742815 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4fa19661-02f9-45b7-9bb7-0a6e724d1375 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:53.743363 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4fa19661-02f9-45b7-9bb7-0a6e724d1375 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:53.872149 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4fa19661-02f9-45b7-9bb7-0a6e724d1375 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:53.879570 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4fa19661-02f9-45b7-9bb7-0a6e724d1375 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1533 microversion: 2.1 time: 0.151274 Apr 16 21:18:53.880148 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1651/3434] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:53 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1533 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:53.897879 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-3891cce8-c007-4692-a06e-44010daef026 req-c3754748-cf36-4f60-85a4-adfca8740921 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523", "name": "network-vif-plugged", "status": "completed", "tag": "0eab5a77-408a-45d7-86ff-b5c0a4b550d1"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:18:53.907708 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-3891cce8-c007-4692-a06e-44010daef026 req-c3754748-cf36-4f60-85a4-adfca8740921 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:53.909715 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-3891cce8-c007-4692-a06e-44010daef026 req-c3754748-cf36-4f60-85a4-adfca8740921 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:53.920900 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-3891cce8-c007-4692-a06e-44010daef026 req-c3754748-cf36-4f60-85a4-adfca8740921 service nova] Creating event network-vif-plugged:0eab5a77-408a-45d7-86ff-b5c0a4b550d1 for instance 9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523 on nch2-master-1 Apr 16 21:18:53.928845 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-3891cce8-c007-4692-a06e-44010daef026 req-c3754748-cf36-4f60-85a4-adfca8740921 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031900 Apr 16 21:18:53.928845 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1784/3435] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:18:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:18:54.581356 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f31945f2-29a9-4313-b71c-7fc8cf79fd64 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:54.581975 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f31945f2-29a9-4313-b71c-7fc8cf79fd64 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:54.588845 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f31945f2-29a9-4313-b71c-7fc8cf79fd64 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:54.589310 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f31945f2-29a9-4313-b71c-7fc8cf79fd64 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:54.590092 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f31945f2-29a9-4313-b71c-7fc8cf79fd64 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:54.590537 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f31945f2-29a9-4313-b71c-7fc8cf79fd64 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:54.648574 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d08f0919-d0dc-4244-9bad-4d10b4453a46 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb96d83af0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:54.709744 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d08f0919-d0dc-4244-9bad-4d10b4453a46 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/0525c28c-bdce-4175-be0f-2c6b3f430341" status: 200 len: 1454 microversion: 2.1 time: 0.065500 Apr 16 21:18:54.710339 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1785/3436] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:54 2022] GET /compute/v2.1/images/0525c28c-bdce-4175-be0f-2c6b3f430341 => generated 1454 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:54.787399 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f31945f2-29a9-4313-b71c-7fc8cf79fd64 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:54.797164 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f31945f2-29a9-4313-b71c-7fc8cf79fd64 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09" status: 200 len: 1724 microversion: 2.1 time: 0.219713 Apr 16 21:18:54.798465 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1652/3437] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:54 2022] GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09 => generated 1724 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:54.896407 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b5c96353-983f-442e-807e-dae41c1b5c89 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:54.897145 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b5c96353-983f-442e-807e-dae41c1b5c89 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:54.905022 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5c96353-983f-442e-807e-dae41c1b5c89 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:54.906118 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5c96353-983f-442e-807e-dae41c1b5c89 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:54.906907 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5c96353-983f-442e-807e-dae41c1b5c89 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:54.907347 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5c96353-983f-442e-807e-dae41c1b5c89 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:55.065535 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b5c96353-983f-442e-807e-dae41c1b5c89 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:55.072989 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b5c96353-983f-442e-807e-dae41c1b5c89 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1533 microversion: 2.1 time: 0.180525 Apr 16 21:18:55.077929 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1786/3438] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:54 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1533 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:55.723028 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c7c0a077-b6e5-4726-9e8e-7360e859def3 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb964e69d0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:55.795901 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c7c0a077-b6e5-4726-9e8e-7360e859def3 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/0525c28c-bdce-4175-be0f-2c6b3f430341" status: 200 len: 1454 microversion: 2.1 time: 0.076765 Apr 16 21:18:55.798479 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1653/3439] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:55 2022] GET /compute/v2.1/images/0525c28c-bdce-4175-be0f-2c6b3f430341 => generated 1454 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:55.815197 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-002e4775-bbb4-492c-9f69-0b7976101c34 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:55.816966 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-002e4775-bbb4-492c-9f69-0b7976101c34 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:55.829021 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-002e4775-bbb4-492c-9f69-0b7976101c34 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:55.837958 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-002e4775-bbb4-492c-9f69-0b7976101c34 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:55.843252 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-002e4775-bbb4-492c-9f69-0b7976101c34 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:55.857354 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-002e4775-bbb4-492c-9f69-0b7976101c34 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:56.115915 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5f573fd4-a1d7-4fa6-82b0-20bc4040f5e3 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:18:56.117472 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5f573fd4-a1d7-4fa6-82b0-20bc4040f5e3 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:56.127972 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5f573fd4-a1d7-4fa6-82b0-20bc4040f5e3 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:56.128832 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5f573fd4-a1d7-4fa6-82b0-20bc4040f5e3 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:56.129702 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5f573fd4-a1d7-4fa6-82b0-20bc4040f5e3 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:56.130231 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5f573fd4-a1d7-4fa6-82b0-20bc4040f5e3 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:56.190598 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5f573fd4-a1d7-4fa6-82b0-20bc4040f5e3 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "POST /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7/action" status: 200 len: 24573 microversion: 2.32 time: 0.464465 Apr 16 21:18:56.192257 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1787/3440] 10.222.0.20 () {62 vars in 1318 bytes} [Sat Apr 16 21:18:55 2022] POST /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7/action => generated 24573 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Apr 16 21:18:56.200597 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-c74b3840-d375-4929-b628-5a025918f84e req-e3564110-982a-4b65-9b28-c4b2ef213f50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbcf087b-c508-46e9-a546-99b764daddbb", "name": "network-vif-unplugged", "status": "completed", "tag": "c077f313-2701-4802-bf5a-28338c745ec4"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:18:56.213538 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-c74b3840-d375-4929-b628-5a025918f84e req-e3564110-982a-4b65-9b28-c4b2ef213f50 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:56.215096 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-c74b3840-d375-4929-b628-5a025918f84e req-e3564110-982a-4b65-9b28-c4b2ef213f50 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:56.233053 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-c74b3840-d375-4929-b628-5a025918f84e req-e3564110-982a-4b65-9b28-c4b2ef213f50 service nova] Creating event network-vif-unplugged:c077f313-2701-4802-bf5a-28338c745ec4 for instance cbcf087b-c508-46e9-a546-99b764daddbb on nch1-master-1 Apr 16 21:18:56.239605 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-c74b3840-d375-4929-b628-5a025918f84e req-e3564110-982a-4b65-9b28-c4b2ef213f50 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045581 Apr 16 21:18:56.241375 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1788/3441] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:18:56.248078 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b9d829a2-0d77-4733-bfd4-001257344f10 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:56.248826 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b9d829a2-0d77-4733-bfd4-001257344f10 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:56.256202 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-002e4775-bbb4-492c-9f69-0b7976101c34 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:56.271287 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-002e4775-bbb4-492c-9f69-0b7976101c34 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09" status: 200 len: 1724 microversion: 2.1 time: 0.459981 Apr 16 21:18:56.272138 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b9d829a2-0d77-4733-bfd4-001257344f10 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:56.273897 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1654/3442] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:55 2022] GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09 => generated 1724 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:18:56.274608 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b9d829a2-0d77-4733-bfd4-001257344f10 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:56.276250 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b9d829a2-0d77-4733-bfd4-001257344f10 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:56.277316 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b9d829a2-0d77-4733-bfd4-001257344f10 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:56.454566 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b9d829a2-0d77-4733-bfd4-001257344f10 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:56.482469 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b9d829a2-0d77-4733-bfd4-001257344f10 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1533 microversion: 2.1 time: 0.239694 Apr 16 21:18:56.485574 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1789/3443] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:56 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1533 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:56.590821 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-3f7e3459-8489-46e6-b02b-b969eab268d0 req-e11cca4a-b490-4cf7-b7d1-c80bb6cc68ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbcf087b-c508-46e9-a546-99b764daddbb", "name": "network-vif-deleted", "tag": "c077f313-2701-4802-bf5a-28338c745ec4"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:18:56.600099 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-3f7e3459-8489-46e6-b02b-b969eab268d0 req-e11cca4a-b490-4cf7-b7d1-c80bb6cc68ac service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:56.600598 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-3f7e3459-8489-46e6-b02b-b969eab268d0 req-e11cca4a-b490-4cf7-b7d1-c80bb6cc68ac service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:56.619387 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-3f7e3459-8489-46e6-b02b-b969eab268d0 req-e11cca4a-b490-4cf7-b7d1-c80bb6cc68ac service nova] Creating event network-vif-deleted:c077f313-2701-4802-bf5a-28338c745ec4 for instance cbcf087b-c508-46e9-a546-99b764daddbb on nch1-master-1 Apr 16 21:18:56.624646 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-3f7e3459-8489-46e6-b02b-b969eab268d0 req-e11cca4a-b490-4cf7-b7d1-c80bb6cc68ac service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038728 Apr 16 21:18:56.628584 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1655/3444] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:18:56.812430 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1dcd2e5e-573d-4fff-b2ae-c1766690beeb tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb96870ee0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:56.881413 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1dcd2e5e-573d-4fff-b2ae-c1766690beeb tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/0525c28c-bdce-4175-be0f-2c6b3f430341" status: 200 len: 1454 microversion: 2.1 time: 0.073430 Apr 16 21:18:56.884556 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1790/3445] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:56 2022] GET /compute/v2.1/images/0525c28c-bdce-4175-be0f-2c6b3f430341 => generated 1454 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:57.296735 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ddd3dad1-c494-42f8-8029-70c6ef68a8a1 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:57.298029 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ddd3dad1-c494-42f8-8029-70c6ef68a8a1 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:57.308760 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ddd3dad1-c494-42f8-8029-70c6ef68a8a1 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:57.309555 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ddd3dad1-c494-42f8-8029-70c6ef68a8a1 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:57.310617 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ddd3dad1-c494-42f8-8029-70c6ef68a8a1 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:57.311585 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ddd3dad1-c494-42f8-8029-70c6ef68a8a1 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:57.505428 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0f15bf91-28f6-4f6c-91fa-01bb42755d0c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:57.516056 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0f15bf91-28f6-4f6c-91fa-01bb42755d0c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:57.545413 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0f15bf91-28f6-4f6c-91fa-01bb42755d0c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:57.548430 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0f15bf91-28f6-4f6c-91fa-01bb42755d0c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:57.552454 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0f15bf91-28f6-4f6c-91fa-01bb42755d0c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:57.553763 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0f15bf91-28f6-4f6c-91fa-01bb42755d0c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:57.556685 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ddd3dad1-c494-42f8-8029-70c6ef68a8a1 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:57.570529 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ddd3dad1-c494-42f8-8029-70c6ef68a8a1 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09" status: 200 len: 1724 microversion: 2.1 time: 0.278091 Apr 16 21:18:57.572619 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1656/3446] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:57 2022] GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09 => generated 1724 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:57.596981 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0f15bf91-28f6-4f6c-91fa-01bb42755d0c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:57.597447 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0f15bf91-28f6-4f6c-91fa-01bb42755d0c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:57.599142 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-0f15bf91-28f6-4f6c-91fa-01bb42755d0c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lazy-loading 'fault' on Instance uuid cbcf087b-c508-46e9-a546-99b764daddbb {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:18:57.642155 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0f15bf91-28f6-4f6c-91fa-01bb42755d0c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:57.653945 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0f15bf91-28f6-4f6c-91fa-01bb42755d0c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 200 len: 1368 microversion: 2.1 time: 0.157868 Apr 16 21:18:57.654799 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1791/3447] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:57 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:57.895671 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fd979ccf-5c68-42f3-a79e-9f799b5d2230 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb96a3d670>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:57.961524 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fd979ccf-5c68-42f3-a79e-9f799b5d2230 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/0525c28c-bdce-4175-be0f-2c6b3f430341" status: 200 len: 1454 microversion: 2.1 time: 0.070141 Apr 16 21:18:57.963379 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1657/3448] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:57 2022] GET /compute/v2.1/images/0525c28c-bdce-4175-be0f-2c6b3f430341 => generated 1454 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:58.639033 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ee630326-5c73-48a8-ba70-ce1895d521e1 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:58.639033 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ee630326-5c73-48a8-ba70-ce1895d521e1 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:58.639033 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee630326-5c73-48a8-ba70-ce1895d521e1 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:58.639033 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee630326-5c73-48a8-ba70-ce1895d521e1 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:58.639033 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee630326-5c73-48a8-ba70-ce1895d521e1 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:58.639033 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee630326-5c73-48a8-ba70-ce1895d521e1 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:58.672868 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-66efaeb1-074f-4145-abf5-87eb669b9eb0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:58.673523 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-66efaeb1-074f-4145-abf5-87eb669b9eb0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: cbcf087b-c508-46e9-a546-99b764daddbb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:58.686926 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-66efaeb1-074f-4145-abf5-87eb669b9eb0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:58.692858 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-66efaeb1-074f-4145-abf5-87eb669b9eb0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:58.693876 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-66efaeb1-074f-4145-abf5-87eb669b9eb0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:58.694317 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-66efaeb1-074f-4145-abf5-87eb669b9eb0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:58.711663 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-66efaeb1-074f-4145-abf5-87eb669b9eb0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] HTTP exception thrown: Instance cbcf087b-c508-46e9-a546-99b764daddbb could not be found. Apr 16 21:18:58.712606 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-66efaeb1-074f-4145-abf5-87eb669b9eb0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Returning 404 to user: Instance cbcf087b-c508-46e9-a546-99b764daddbb could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:18:58.713614 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-66efaeb1-074f-4145-abf5-87eb669b9eb0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb" status: 404 len: 111 microversion: 2.1 time: 0.045944 Apr 16 21:18:58.714326 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1658/3449] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:58 2022] GET /compute/v2.1/servers/cbcf087b-c508-46e9-a546-99b764daddbb => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:18:58.722284 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-59e1e61b-49ab-4fc5-9851-c4efd381e764 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:58.723011 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-59e1e61b-49ab-4fc5-9851-c4efd381e764 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:58.729301 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-59e1e61b-49ab-4fc5-9851-c4efd381e764 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:58.729761 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-59e1e61b-49ab-4fc5-9851-c4efd381e764 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:58.731167 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-59e1e61b-49ab-4fc5-9851-c4efd381e764 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:58.731167 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-59e1e61b-49ab-4fc5-9851-c4efd381e764 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:58.757164 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-59e1e61b-49ab-4fc5-9851-c4efd381e764 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:18:58.822367 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ee630326-5c73-48a8-ba70-ce1895d521e1 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:58.831399 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ee630326-5c73-48a8-ba70-ce1895d521e1 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09" status: 200 len: 1730 microversion: 2.1 time: 0.225221 Apr 16 21:18:58.831976 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1792/3450] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:58 2022] GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09 => generated 1730 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:58.849877 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-67331959-4cb5-49bd-9862-0871b33baf8f tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:58.850954 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-67331959-4cb5-49bd-9862-0871b33baf8f tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:58.859168 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-67331959-4cb5-49bd-9862-0871b33baf8f tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:58.859626 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-67331959-4cb5-49bd-9862-0871b33baf8f tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:58.860464 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-67331959-4cb5-49bd-9862-0871b33baf8f tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:58.861079 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-67331959-4cb5-49bd-9862-0871b33baf8f tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:59.073275 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-67331959-4cb5-49bd-9862-0871b33baf8f tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.227008 Apr 16 21:18:59.085555 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1793/3451] 10.222.0.20 () {58 vars in 1274 bytes} [Sat Apr 16 21:18:58 2022] GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09/os-interface => generated 284 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:18:59.093204 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f8915efc-d8b6-45ca-af97-bd45ad7d3a31 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb9c068ee0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:59.165124 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f8915efc-d8b6-45ca-af97-bd45ad7d3a31 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/0525c28c-bdce-4175-be0f-2c6b3f430341" status: 200 len: 1454 microversion: 2.1 time: 0.078151 Apr 16 21:18:59.165831 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1794/3452] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:18:59 2022] GET /compute/v2.1/images/0525c28c-bdce-4175-be0f-2c6b3f430341 => generated 1454 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:18:59.476165 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-59e1e61b-49ab-4fc5-9851-c4efd381e764 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 204 len: 0 microversion: 2.1 time: 0.757359 Apr 16 21:18:59.479613 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1659/3453] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:18:58 2022] DELETE /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 0 bytes in 759 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 16 21:18:59.484963 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5ffd329e-d10a-4198-ad84-c4719e9ed2b8 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:18:59.487661 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5ffd329e-d10a-4198-ad84-c4719e9ed2b8 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:18:59.491522 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5ffd329e-d10a-4198-ad84-c4719e9ed2b8 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:59.491983 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5ffd329e-d10a-4198-ad84-c4719e9ed2b8 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:59.492850 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5ffd329e-d10a-4198-ad84-c4719e9ed2b8 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:18:59.493299 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5ffd329e-d10a-4198-ad84-c4719e9ed2b8 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:18:59.698132 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5ffd329e-d10a-4198-ad84-c4719e9ed2b8 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:18:59.709773 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5ffd329e-d10a-4198-ad84-c4719e9ed2b8 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1468 microversion: 2.1 time: 0.228274 Apr 16 21:18:59.710908 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1795/3454] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:18:59 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1468 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:00.182787 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-78fdb6cd-a9a0-4a4e-82b7-212e9672633b tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb96534d30>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:00.263130 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-78fdb6cd-a9a0-4a4e-82b7-212e9672633b tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/0525c28c-bdce-4175-be0f-2c6b3f430341" status: 200 len: 1454 microversion: 2.1 time: 0.088290 Apr 16 21:19:00.267258 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1660/3455] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:19:00 2022] GET /compute/v2.1/images/0525c28c-bdce-4175-be0f-2c6b3f430341 => generated 1454 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:00.282720 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-421de13d-6065-4985-8576-a4838baa8197 req-925ea386-d3dd-42da-aec2-2d024677d5e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c7cd9df-57f3-47a6-aa40-76ee208e2c09", "tag": "b83812ef-1c6d-4509-9af6-301ec0cf5b84"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:19:00.302990 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-421de13d-6065-4985-8576-a4838baa8197 req-925ea386-d3dd-42da-aec2-2d024677d5e1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:00.303500 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-421de13d-6065-4985-8576-a4838baa8197 req-925ea386-d3dd-42da-aec2-2d024677d5e1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:00.348208 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-421de13d-6065-4985-8576-a4838baa8197 req-925ea386-d3dd-42da-aec2-2d024677d5e1 service nova] Creating event network-changed:b83812ef-1c6d-4509-9af6-301ec0cf5b84 for instance 8c7cd9df-57f3-47a6-aa40-76ee208e2c09 on nch1-master-1 Apr 16 21:19:00.359165 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-421de13d-6065-4985-8576-a4838baa8197 req-925ea386-d3dd-42da-aec2-2d024677d5e1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081139 Apr 16 21:19:00.366815 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1796/3456] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:19:00.727980 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2dbb2375-8f96-4bfb-9799-814c00973c2b tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:00.731000 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2dbb2375-8f96-4bfb-9799-814c00973c2b tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:00.742185 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2dbb2375-8f96-4bfb-9799-814c00973c2b tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:00.742987 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2dbb2375-8f96-4bfb-9799-814c00973c2b tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:00.745526 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2dbb2375-8f96-4bfb-9799-814c00973c2b tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:00.749537 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2dbb2375-8f96-4bfb-9799-814c00973c2b tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:01.038383 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2dbb2375-8f96-4bfb-9799-814c00973c2b tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:01.049427 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2dbb2375-8f96-4bfb-9799-814c00973c2b tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1468 microversion: 2.1 time: 0.325844 Apr 16 21:19:01.050289 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1661/3457] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:00 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1468 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:01.281334 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-58391e41-971f-4a62-8226-45e6339aec60 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb96f75ca0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:01.359912 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-58391e41-971f-4a62-8226-45e6339aec60 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/0525c28c-bdce-4175-be0f-2c6b3f430341" status: 200 len: 1454 microversion: 2.1 time: 0.084615 Apr 16 21:19:01.360705 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1797/3458] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:19:01 2022] GET /compute/v2.1/images/0525c28c-bdce-4175-be0f-2c6b3f430341 => generated 1454 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:02.075005 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-eabee3f5-74f3-43c6-b1f2-26dd02a4252c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:02.076237 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-eabee3f5-74f3-43c6-b1f2-26dd02a4252c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:02.093023 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eabee3f5-74f3-43c6-b1f2-26dd02a4252c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:02.102004 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-1aa44e30-8a69-4c28-8add-211899a32dcc req-13dad7db-935c-4a29-af9e-161b8d4506f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2389c37c-30cc-4355-a3a2-44653cb17fd6", "name": "network-vif-deleted", "tag": "0b67129e-ca8a-4c23-aff2-5c3d6e70e65a"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:19:02.109364 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eabee3f5-74f3-43c6-b1f2-26dd02a4252c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:02.110776 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eabee3f5-74f3-43c6-b1f2-26dd02a4252c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:02.112508 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eabee3f5-74f3-43c6-b1f2-26dd02a4252c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:02.119511 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-1aa44e30-8a69-4c28-8add-211899a32dcc req-13dad7db-935c-4a29-af9e-161b8d4506f4 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:02.120653 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-1aa44e30-8a69-4c28-8add-211899a32dcc req-13dad7db-935c-4a29-af9e-161b8d4506f4 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:02.145975 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-1aa44e30-8a69-4c28-8add-211899a32dcc req-13dad7db-935c-4a29-af9e-161b8d4506f4 service nova] Creating event network-vif-deleted:0b67129e-ca8a-4c23-aff2-5c3d6e70e65a for instance 2389c37c-30cc-4355-a3a2-44653cb17fd6 on nch2-master-1 Apr 16 21:19:02.159935 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-1aa44e30-8a69-4c28-8add-211899a32dcc req-13dad7db-935c-4a29-af9e-161b8d4506f4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063522 Apr 16 21:19:02.169693 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1798/3459] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:19:02.220284 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-eabee3f5-74f3-43c6-b1f2-26dd02a4252c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:02.228854 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-eabee3f5-74f3-43c6-b1f2-26dd02a4252c tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1426 microversion: 2.1 time: 0.164185 Apr 16 21:19:02.229661 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1662/3460] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:02 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1426 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:02.392379 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fb159d12-4674-4eb2-8e2e-e63d63a52287 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb96f753a0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:02.396110 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-568a1ca8-2cc8-4c42-80d3-ad7436618ac5 req-dc8de850-1df2-44de-b394-1855fd918dd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c7cd9df-57f3-47a6-aa40-76ee208e2c09", "tag": "b83812ef-1c6d-4509-9af6-301ec0cf5b84"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:19:02.418374 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-568a1ca8-2cc8-4c42-80d3-ad7436618ac5 req-dc8de850-1df2-44de-b394-1855fd918dd9 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:02.419099 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-568a1ca8-2cc8-4c42-80d3-ad7436618ac5 req-dc8de850-1df2-44de-b394-1855fd918dd9 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:02.435874 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-568a1ca8-2cc8-4c42-80d3-ad7436618ac5 req-dc8de850-1df2-44de-b394-1855fd918dd9 service nova] Creating event network-changed:b83812ef-1c6d-4509-9af6-301ec0cf5b84 for instance 8c7cd9df-57f3-47a6-aa40-76ee208e2c09 on nch1-master-1 Apr 16 21:19:02.445982 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-568a1ca8-2cc8-4c42-80d3-ad7436618ac5 req-dc8de850-1df2-44de-b394-1855fd918dd9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053004 Apr 16 21:19:02.451467 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1663/3461] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:19:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:19:02.480320 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fb159d12-4674-4eb2-8e2e-e63d63a52287 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/0525c28c-bdce-4175-be0f-2c6b3f430341" status: 200 len: 1454 microversion: 2.1 time: 0.109393 Apr 16 21:19:02.481159 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1799/3462] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:19:02 2022] GET /compute/v2.1/images/0525c28c-bdce-4175-be0f-2c6b3f430341 => generated 1454 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:03.248524 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4cba431e-34f3-4279-9dcb-2e2ab1a9d2ec tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:03.249517 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4cba431e-34f3-4279-9dcb-2e2ab1a9d2ec tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:03.258141 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4cba431e-34f3-4279-9dcb-2e2ab1a9d2ec tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:03.258614 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4cba431e-34f3-4279-9dcb-2e2ab1a9d2ec tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:03.260846 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4cba431e-34f3-4279-9dcb-2e2ab1a9d2ec tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:03.261326 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4cba431e-34f3-4279-9dcb-2e2ab1a9d2ec tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:03.299313 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4cba431e-34f3-4279-9dcb-2e2ab1a9d2ec tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:03.299892 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4cba431e-34f3-4279-9dcb-2e2ab1a9d2ec tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:03.300404 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-4cba431e-34f3-4279-9dcb-2e2ab1a9d2ec tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lazy-loading 'fault' on Instance uuid 2389c37c-30cc-4355-a3a2-44653cb17fd6 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:19:03.347113 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4cba431e-34f3-4279-9dcb-2e2ab1a9d2ec tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:03.356097 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4cba431e-34f3-4279-9dcb-2e2ab1a9d2ec tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 200 len: 1303 microversion: 2.1 time: 0.113084 Apr 16 21:19:03.356835 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1664/3463] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:03 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 1303 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:03.494968 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a6c4fda6-df63-4ae3-bbb7-53230283464e tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb9ffeb040>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:03.540804 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a6c4fda6-df63-4ae3-bbb7-53230283464e tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/0525c28c-bdce-4175-be0f-2c6b3f430341" status: 200 len: 1454 microversion: 2.1 time: 0.050351 Apr 16 21:19:03.541387 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1800/3464] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:19:03 2022] GET /compute/v2.1/images/0525c28c-bdce-4175-be0f-2c6b3f430341 => generated 1454 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:04.373582 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9361322d-8311-48c4-a426-5bd5d5e14b5f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:04.374307 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9361322d-8311-48c4-a426-5bd5d5e14b5f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: 2389c37c-30cc-4355-a3a2-44653cb17fd6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:04.381662 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9361322d-8311-48c4-a426-5bd5d5e14b5f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:04.382287 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9361322d-8311-48c4-a426-5bd5d5e14b5f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:04.388097 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9361322d-8311-48c4-a426-5bd5d5e14b5f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:04.388097 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9361322d-8311-48c4-a426-5bd5d5e14b5f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:04.408932 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-9361322d-8311-48c4-a426-5bd5d5e14b5f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] HTTP exception thrown: Instance 2389c37c-30cc-4355-a3a2-44653cb17fd6 could not be found. Apr 16 21:19:04.409809 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9361322d-8311-48c4-a426-5bd5d5e14b5f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Returning 404 to user: Instance 2389c37c-30cc-4355-a3a2-44653cb17fd6 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:19:04.411367 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9361322d-8311-48c4-a426-5bd5d5e14b5f tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6" status: 404 len: 111 microversion: 2.1 time: 0.042091 Apr 16 21:19:04.412351 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1665/3465] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:04 2022] GET /compute/v2.1/servers/2389c37c-30cc-4355-a3a2-44653cb17fd6 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:19:04.424713 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-43a82654-a2a5-4456-9bc9-1308645ebecf tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:04.425648 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-43a82654-a2a5-4456-9bc9-1308645ebecf tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:04.435997 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-43a82654-a2a5-4456-9bc9-1308645ebecf tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:04.436741 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-43a82654-a2a5-4456-9bc9-1308645ebecf tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:04.437625 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-43a82654-a2a5-4456-9bc9-1308645ebecf tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:04.439703 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-43a82654-a2a5-4456-9bc9-1308645ebecf tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:04.474935 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-43a82654-a2a5-4456-9bc9-1308645ebecf tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:19:04.556090 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-80504e84-11be-4683-a895-db088fabe4a5 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb965340d0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:04.612519 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-80504e84-11be-4683-a895-db088fabe4a5 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/0525c28c-bdce-4175-be0f-2c6b3f430341" status: 200 len: 1454 microversion: 2.1 time: 0.061809 Apr 16 21:19:04.614751 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1666/3466] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:19:04 2022] GET /compute/v2.1/images/0525c28c-bdce-4175-be0f-2c6b3f430341 => generated 1454 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:19:04.781499 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-43a82654-a2a5-4456-9bc9-1308645ebecf tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 204 len: 0 microversion: 2.1 time: 0.360885 Apr 16 21:19:04.787495 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1801/3467] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:19:04 2022] DELETE /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:19:04.793205 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-488fd3bd-cb11-4c8c-84f6-e28c8e759097 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:04.794194 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-488fd3bd-cb11-4c8c-84f6-e28c8e759097 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:04.801325 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-488fd3bd-cb11-4c8c-84f6-e28c8e759097 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:04.801791 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-488fd3bd-cb11-4c8c-84f6-e28c8e759097 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:04.802586 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-488fd3bd-cb11-4c8c-84f6-e28c8e759097 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:04.803037 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-488fd3bd-cb11-4c8c-84f6-e28c8e759097 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:04.962956 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-488fd3bd-cb11-4c8c-84f6-e28c8e759097 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:04.971613 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-488fd3bd-cb11-4c8c-84f6-e28c8e759097 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 200 len: 1469 microversion: 2.1 time: 0.183255 Apr 16 21:19:04.972807 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1667/3468] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:04 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 1469 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:19:05.628465 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-60d0d188-6b5f-4b10-8d6d-d231ee6405d9 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb96745f70>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:05.685637 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-60d0d188-6b5f-4b10-8d6d-d231ee6405d9 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/0525c28c-bdce-4175-be0f-2c6b3f430341" status: 200 len: 1454 microversion: 2.1 time: 0.061775 Apr 16 21:19:05.686590 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1802/3469] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:19:05 2022] GET /compute/v2.1/images/0525c28c-bdce-4175-be0f-2c6b3f430341 => generated 1454 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:05.993271 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5ec7ec2d-76c4-4978-97eb-821b8c07a149 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:05.995189 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5ec7ec2d-76c4-4978-97eb-821b8c07a149 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:06.003372 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5ec7ec2d-76c4-4978-97eb-821b8c07a149 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:06.006551 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5ec7ec2d-76c4-4978-97eb-821b8c07a149 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:06.007622 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5ec7ec2d-76c4-4978-97eb-821b8c07a149 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:06.008260 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5ec7ec2d-76c4-4978-97eb-821b8c07a149 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:06.472115 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5ec7ec2d-76c4-4978-97eb-821b8c07a149 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:06.480614 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5ec7ec2d-76c4-4978-97eb-821b8c07a149 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 200 len: 1469 microversion: 2.1 time: 0.493827 Apr 16 21:19:06.481206 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1668/3470] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:05 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 1469 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:06.701385 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b9191632-3a1d-400c-8892-754c9896d6b9 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb96698ee0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:06.748685 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b9191632-3a1d-400c-8892-754c9896d6b9 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/0525c28c-bdce-4175-be0f-2c6b3f430341" status: 200 len: 1454 microversion: 2.1 time: 0.052859 Apr 16 21:19:06.749296 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1803/3471] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:19:06 2022] GET /compute/v2.1/images/0525c28c-bdce-4175-be0f-2c6b3f430341 => generated 1454 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:07.163872 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-8775925c-f833-4d83-8204-244260236bca req-7b469f01-6baa-430d-b279-28f1149f6bba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0602327-eafa-416f-8114-3411e37e2eef", "name": "network-vif-deleted", "tag": "0e4ce80e-dded-45a4-8cad-59e6b3b64323"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:19:07.175894 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-8775925c-f833-4d83-8204-244260236bca req-7b469f01-6baa-430d-b279-28f1149f6bba service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:07.176761 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-8775925c-f833-4d83-8204-244260236bca req-7b469f01-6baa-430d-b279-28f1149f6bba service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:07.191789 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-8775925c-f833-4d83-8204-244260236bca req-7b469f01-6baa-430d-b279-28f1149f6bba service nova] Creating event network-vif-deleted:0e4ce80e-dded-45a4-8cad-59e6b3b64323 for instance a0602327-eafa-416f-8114-3411e37e2eef on nch2-master-1 Apr 16 21:19:07.199620 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-8775925c-f833-4d83-8204-244260236bca req-7b469f01-6baa-430d-b279-28f1149f6bba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041233 Apr 16 21:19:07.200537 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1669/3472] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:19:07.500151 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-34e69b7d-137d-45f2-9b40-e0427739fb46 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:07.501323 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-34e69b7d-137d-45f2-9b40-e0427739fb46 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:07.508571 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-34e69b7d-137d-45f2-9b40-e0427739fb46 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:07.509022 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-34e69b7d-137d-45f2-9b40-e0427739fb46 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:07.510488 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-34e69b7d-137d-45f2-9b40-e0427739fb46 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:07.510981 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-34e69b7d-137d-45f2-9b40-e0427739fb46 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:07.561793 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-34e69b7d-137d-45f2-9b40-e0427739fb46 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:07.562534 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-34e69b7d-137d-45f2-9b40-e0427739fb46 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:07.563327 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-34e69b7d-137d-45f2-9b40-e0427739fb46 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lazy-loading 'fault' on Instance uuid a0602327-eafa-416f-8114-3411e37e2eef {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:19:07.615295 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-34e69b7d-137d-45f2-9b40-e0427739fb46 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd17cad39fa38448eb9827605871463a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29fd420ef9134715bd3a9f2467d924cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:07.623113 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-34e69b7d-137d-45f2-9b40-e0427739fb46 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 200 len: 1303 microversion: 2.1 time: 0.128134 Apr 16 21:19:07.623725 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1804/3473] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:07 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 1303 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:07.761458 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-42d21736-8dcc-488b-bb5a-fa43123eb51e tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb95808ee0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:07.810827 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-42d21736-8dcc-488b-bb5a-fa43123eb51e tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/0525c28c-bdce-4175-be0f-2c6b3f430341" status: 200 len: 1463 microversion: 2.1 time: 0.053626 Apr 16 21:19:07.811916 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1670/3474] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:19:07 2022] GET /compute/v2.1/images/0525c28c-bdce-4175-be0f-2c6b3f430341 => generated 1463 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:07.824427 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6415a4ab-c22f-4089-99da-478fe6ac8053 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb95a8bd30>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:07.873803 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6415a4ab-c22f-4089-99da-478fe6ac8053 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/0525c28c-bdce-4175-be0f-2c6b3f430341" status: 200 len: 1463 microversion: 2.1 time: 0.054548 Apr 16 21:19:07.874386 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1805/3475] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:19:07 2022] GET /compute/v2.1/images/0525c28c-bdce-4175-be0f-2c6b3f430341 => generated 1463 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:07.889459 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c2ebed48-6b3c-413a-8372-ed8fce0176b6 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:07.889459 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c2ebed48-6b3c-413a-8372-ed8fce0176b6 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] [instance: 9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:07.893842 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c2ebed48-6b3c-413a-8372-ed8fce0176b6 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:07.894308 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c2ebed48-6b3c-413a-8372-ed8fce0176b6 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:07.895166 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c2ebed48-6b3c-413a-8372-ed8fce0176b6 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:07.895623 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c2ebed48-6b3c-413a-8372-ed8fce0176b6 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:08.036254 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c2ebed48-6b3c-413a-8372-ed8fce0176b6 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484bca4e32554ed4af061012f30666ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79f0fe4726d4abcbdc2672a15f709f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:08.044740 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c2ebed48-6b3c-413a-8372-ed8fce0176b6 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/servers/9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523" status: 200 len: 1480 microversion: 2.1 time: 0.162496 Apr 16 21:19:08.045785 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1671/3476] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:07 2022] GET /compute/v2.1/servers/9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523 => generated 1480 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:19:08.641689 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-297af3ac-8a68-45fb-a6cc-97b20dd4dbc0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:08.642316 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-297af3ac-8a68-45fb-a6cc-97b20dd4dbc0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] [instance: a0602327-eafa-416f-8114-3411e37e2eef] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:08.649634 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-297af3ac-8a68-45fb-a6cc-97b20dd4dbc0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:08.650093 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-297af3ac-8a68-45fb-a6cc-97b20dd4dbc0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:08.651013 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-297af3ac-8a68-45fb-a6cc-97b20dd4dbc0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:08.651463 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-297af3ac-8a68-45fb-a6cc-97b20dd4dbc0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:08.665964 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-297af3ac-8a68-45fb-a6cc-97b20dd4dbc0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] HTTP exception thrown: Instance a0602327-eafa-416f-8114-3411e37e2eef could not be found. Apr 16 21:19:08.666577 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-297af3ac-8a68-45fb-a6cc-97b20dd4dbc0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] Returning 404 to user: Instance a0602327-eafa-416f-8114-3411e37e2eef could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:19:08.667418 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-297af3ac-8a68-45fb-a6cc-97b20dd4dbc0 tempest-MigrationsAdminTest-221990036 tempest-MigrationsAdminTest-221990036-project] 10.222.0.20 "GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef" status: 404 len: 111 microversion: 2.1 time: 0.030029 Apr 16 21:19:08.667975 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1806/3477] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:08 2022] GET /compute/v2.1/servers/a0602327-eafa-416f-8114-3411e37e2eef => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:19:09.062759 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7e0fd63b-2de5-44a5-92f2-5461f531f0a3 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:09.063391 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7e0fd63b-2de5-44a5-92f2-5461f531f0a3 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] [instance: 9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:09.070038 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7e0fd63b-2de5-44a5-92f2-5461f531f0a3 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:09.070496 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7e0fd63b-2de5-44a5-92f2-5461f531f0a3 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:09.071277 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7e0fd63b-2de5-44a5-92f2-5461f531f0a3 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:09.071719 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7e0fd63b-2de5-44a5-92f2-5461f531f0a3 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:09.229732 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7e0fd63b-2de5-44a5-92f2-5461f531f0a3 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484bca4e32554ed4af061012f30666ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79f0fe4726d4abcbdc2672a15f709f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:09.237785 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7e0fd63b-2de5-44a5-92f2-5461f531f0a3 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/servers/9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523" status: 200 len: 1467 microversion: 2.1 time: 0.179025 Apr 16 21:19:09.238582 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1672/3478] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:09 2022] GET /compute/v2.1/servers/9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523 => generated 1467 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:09.257891 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-943b994d-f58b-402a-92f9-abc5c0257c7e tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb96698ee0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:09.355413 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-943b994d-f58b-402a-92f9-abc5c0257c7e tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images?changes-since=2022-04-16T21%3A17%3A23Z" status: 200 len: 1902 microversion: 2.1 time: 0.104196 Apr 16 21:19:09.355995 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1807/3479] 10.222.0.20 () {58 vars in 1198 bytes} [Sat Apr 16 21:19:09 2022] GET /compute/v2.1/images?changes-since=2022-04-16T21%3A17%3A23Z => generated 1902 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:09.370177 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-446d496e-5ce2-4c61-a195-b55e21133567 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb96e0c9d0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:09.443553 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-446d496e-5ce2-4c61-a195-b55e21133567 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1525069718" status: 200 len: 485 microversion: 2.1 time: 0.077243 Apr 16 21:19:09.444126 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1673/3480] 10.222.0.20 () {58 vars in 1230 bytes} [Sat Apr 16 21:19:09 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-1525069718 => generated 485 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:19:09.455501 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a57d04c3-ebd8-4d2e-967f-9ae0f7192f51 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb96d83af0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:09.542040 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a57d04c3-ebd8-4d2e-967f-9ae0f7192f51 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images?server=9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523" status: 200 len: 956 microversion: 2.1 time: 0.090456 Apr 16 21:19:09.556272 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d068ec68-e62b-4a4b-a9ed-134040c6a23c tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb9653a700>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:09.556838 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1808/3481] 10.222.0.20 () {58 vars in 1208 bytes} [Sat Apr 16 21:19:09 2022] GET /compute/v2.1/images?server=9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523 => generated 956 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:19:09.607853 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d068ec68-e62b-4a4b-a9ed-134040c6a23c tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fv2.1%2Fservers%2F0ba3ff1f-0ee1-4dba-8354-10aaef694161" status: 200 len: 485 microversion: 2.1 time: 0.056525 Apr 16 21:19:09.608465 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1674/3482] 10.222.0.20 () {58 vars in 1316 bytes} [Sat Apr 16 21:19:09 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fv2.1%2Fservers%2F0ba3ff1f-0ee1-4dba-8354-10aaef694161 => generated 485 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:19:09.618938 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-02e0df7a-b3ca-471e-990d-db7adf9e5481 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb9645df70>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:09.668234 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-02e0df7a-b3ca-471e-990d-db7adf9e5481 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fservers%2F0ba3ff1f-0ee1-4dba-8354-10aaef694161" status: 200 len: 485 microversion: 2.1 time: 0.053078 Apr 16 21:19:09.668820 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1809/3483] 10.222.0.20 () {58 vars in 1302 bytes} [Sat Apr 16 21:19:09 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fservers%2F0ba3ff1f-0ee1-4dba-8354-10aaef694161 => generated 485 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:19:09.680104 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6061c71f-7212-4222-a349-5b62701972ec tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb95927b80>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:09.795354 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6061c71f-7212-4222-a349-5b62701972ec tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3279 microversion: 2.1 time: 0.118846 Apr 16 21:19:09.796109 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1675/3484] 10.222.0.20 () {58 vars in 1148 bytes} [Sat Apr 16 21:19:09 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3279 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:09.809295 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c902fa7d-fba5-4e78-b443-3bc74b4cb6b7 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb965bd700>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:09.874977 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c902fa7d-fba5-4e78-b443-3bc74b4cb6b7 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.069425 Apr 16 21:19:09.876812 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1810/3485] 10.222.0.20 () {58 vars in 1148 bytes} [Sat Apr 16 21:19:09 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:09.889672 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4277d05e-5319-408b-b897-853e1a694cd7 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb9653af70>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:09.941606 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4277d05e-5319-408b-b897-853e1a694cd7 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images?limit=1" status: 200 len: 621 microversion: 2.1 time: 0.055760 Apr 16 21:19:09.942212 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1676/3486] 10.222.0.20 () {58 vars in 1136 bytes} [Sat Apr 16 21:19:09 2022] GET /compute/v2.1/images?limit=1 => generated 621 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:19:09.954452 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-259a22c6-7682-4057-8198-76ebf8f60710 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb9615fb80>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:10.035156 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-259a22c6-7682-4057-8198-76ebf8f60710 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/detail?changes-since=2022-04-16T21%3A17%3A18Z" status: 200 len: 6332 microversion: 2.1 time: 0.084646 Apr 16 21:19:10.035751 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1811/3487] 10.222.0.20 () {58 vars in 1219 bytes} [Sat Apr 16 21:19:09 2022] GET /compute/v2.1/images/detail?changes-since=2022-04-16T21%3A17%3A18Z => generated 6332 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:10.057902 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9fc5a493-f58c-48e2-8fce-396264a1673d tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb96bb0c10>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:10.107119 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9fc5a493-f58c-48e2-8fce-396264a1673d tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1525069718" status: 200 len: 665 microversion: 2.1 time: 0.050899 Apr 16 21:19:10.107119 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1677/3488] 10.222.0.20 () {58 vars in 1251 bytes} [Sat Apr 16 21:19:10 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-1525069718 => generated 665 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:19:10.119287 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e86183c7-9018-491f-a570-95cdfc874b5c tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb9593dee0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:10.171141 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e86183c7-9018-491f-a570-95cdfc874b5c tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fv2.1%2Fservers%2F0ba3ff1f-0ee1-4dba-8354-10aaef694161" status: 200 len: 1467 microversion: 2.1 time: 0.056262 Apr 16 21:19:10.171833 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1812/3489] 10.222.0.20 () {58 vars in 1337 bytes} [Sat Apr 16 21:19:10 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fv2.1%2Fservers%2F0ba3ff1f-0ee1-4dba-8354-10aaef694161 => generated 1467 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:10.184389 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bb8dc2dd-1d0f-4e50-8d9c-1b2d2bc47227 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb96e048b0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:10.234772 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bb8dc2dd-1d0f-4e50-8d9c-1b2d2bc47227 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fservers%2F0ba3ff1f-0ee1-4dba-8354-10aaef694161" status: 200 len: 1467 microversion: 2.1 time: 0.054814 Apr 16 21:19:10.235377 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1678/3490] 10.222.0.20 () {58 vars in 1323 bytes} [Sat Apr 16 21:19:10 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.20%2Fcompute%2Fservers%2F0ba3ff1f-0ee1-4dba-8354-10aaef694161 => generated 1467 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:10.250465 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8a45729d-3aac-4120-ae6e-588dd775caaa tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb965bd310>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:10.341712 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8a45729d-3aac-4120-ae6e-588dd775caaa tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7107 microversion: 2.1 time: 0.095121 Apr 16 21:19:10.342366 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1813/3491] 10.222.0.20 () {58 vars in 1169 bytes} [Sat Apr 16 21:19:10 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7107 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:10.360147 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f17bc6fa-fdbe-4ae3-bff2-e54035b2c068 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb96ca73a0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:10.428675 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f17bc6fa-fdbe-4ae3-bff2-e54035b2c068 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4375 microversion: 2.1 time: 0.073134 Apr 16 21:19:10.437651 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1679/3492] 10.222.0.20 () {58 vars in 1169 bytes} [Sat Apr 16 21:19:10 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4375 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:10.443219 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c1d10e57-a44e-4f08-9cbd-f6aef3198dcc tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb9615f9d0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:10.485000 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c1d10e57-a44e-4f08-9cbd-f6aef3198dcc tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/88bbe9a7-19d2-4102-9634-058b7c590848" status: 200 len: 784 microversion: 2.1 time: 0.045672 Apr 16 21:19:10.485577 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1814/3493] 10.222.0.20 () {58 vars in 1232 bytes} [Sat Apr 16 21:19:10 2022] GET /compute/v2.1/images/88bbe9a7-19d2-4102-9634-058b7c590848 => generated 784 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:19:10.498542 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6ab17b86-ce22-4f48-9acc-9c8af2b0f5b5 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb964e63a0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:10.555443 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6ab17b86-ce22-4f48-9acc-9c8af2b0f5b5 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1610 microversion: 2.1 time: 0.060602 Apr 16 21:19:10.556998 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1680/3494] 10.222.0.20 () {58 vars in 1157 bytes} [Sat Apr 16 21:19:10 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1610 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:10.570513 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6b03ce56-90c5-4827-aef4-19f86d273ed0 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb965bdee0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:12.046967 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6b03ce56-90c5-4827-aef4-19f86d273ed0 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "DELETE /compute/v2.1/images/0525c28c-bdce-4175-be0f-2c6b3f430341" status: 204 len: 0 microversion: 2.1 time: 1.480206 Apr 16 21:19:12.047581 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1815/3495] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:10 2022] DELETE /compute/v2.1/images/0525c28c-bdce-4175-be0f-2c6b3f430341 => generated 0 bytes in 1481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:19:12.057105 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3a891fc7-5b2e-40ee-8b84-b6742ece52c9 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb96e04dc0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:13.498385 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3a891fc7-5b2e-40ee-8b84-b6742ece52c9 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "DELETE /compute/v2.1/images/1fbece82-f4ee-4e94-949b-04e6fc239ff1" status: 204 len: 0 microversion: 2.1 time: 1.446561 Apr 16 21:19:13.498960 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1681/3496] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:12 2022] DELETE /compute/v2.1/images/1fbece82-f4ee-4e94-949b-04e6fc239ff1 => generated 0 bytes in 1448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 16 21:19:13.507986 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-25e960c9-944a-4070-867a-7098af9d41c4 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb95a8b820>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:13.776460 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-218cb3dc-846d-439a-b2eb-ba920ad1a6da req-dc907d96-a100-476e-bddc-3b8308a9e4dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523", "name": "network-vif-unplugged", "status": "completed", "tag": "0eab5a77-408a-45d7-86ff-b5c0a4b550d1"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:19:13.786094 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-218cb3dc-846d-439a-b2eb-ba920ad1a6da req-dc907d96-a100-476e-bddc-3b8308a9e4dc service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:13.786554 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-218cb3dc-846d-439a-b2eb-ba920ad1a6da req-dc907d96-a100-476e-bddc-3b8308a9e4dc service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:13.804571 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-218cb3dc-846d-439a-b2eb-ba920ad1a6da req-dc907d96-a100-476e-bddc-3b8308a9e4dc service nova] Creating event network-vif-unplugged:0eab5a77-408a-45d7-86ff-b5c0a4b550d1 for instance 9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523 on nch2-master-1 Apr 16 21:19:13.810155 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-218cb3dc-846d-439a-b2eb-ba920ad1a6da req-dc907d96-a100-476e-bddc-3b8308a9e4dc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038543 Apr 16 21:19:13.811189 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1682/3497] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:19:14.921379 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-25e960c9-944a-4070-867a-7098af9d41c4 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "DELETE /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9" status: 204 len: 0 microversion: 2.1 time: 1.418108 Apr 16 21:19:14.922051 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1816/3498] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:13 2022] DELETE /compute/v2.1/images/210d20ea-26b6-40d0-b1cc-411e57717cb9 => generated 0 bytes in 1419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:19:14.931624 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3c748b32-ba8d-4297-b3eb-d0921a625808 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:14.932237 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3c748b32-ba8d-4297-b3eb-d0921a625808 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] [instance: 0ba3ff1f-0ee1-4dba-8354-10aaef694161] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:14.938582 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3c748b32-ba8d-4297-b3eb-d0921a625808 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:14.939042 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3c748b32-ba8d-4297-b3eb-d0921a625808 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:14.939813 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3c748b32-ba8d-4297-b3eb-d0921a625808 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:14.940475 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3c748b32-ba8d-4297-b3eb-d0921a625808 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:14.972573 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3c748b32-ba8d-4297-b3eb-d0921a625808 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] [instance: 0ba3ff1f-0ee1-4dba-8354-10aaef694161] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:19:15.264785 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3c748b32-ba8d-4297-b3eb-d0921a625808 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161" status: 204 len: 0 microversion: 2.1 time: 0.337946 Apr 16 21:19:15.265708 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1683/3499] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:19:14 2022] DELETE /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:19:15.278329 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6ef2ada9-5de3-42ba-b951-e3eeed702930 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:15.279449 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6ef2ada9-5de3-42ba-b951-e3eeed702930 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] [instance: 0ba3ff1f-0ee1-4dba-8354-10aaef694161] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:15.289595 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6ef2ada9-5de3-42ba-b951-e3eeed702930 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:15.290455 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6ef2ada9-5de3-42ba-b951-e3eeed702930 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:15.292514 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6ef2ada9-5de3-42ba-b951-e3eeed702930 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:15.293330 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6ef2ada9-5de3-42ba-b951-e3eeed702930 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:15.451903 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6ef2ada9-5de3-42ba-b951-e3eeed702930 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484bca4e32554ed4af061012f30666ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79f0fe4726d4abcbdc2672a15f709f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:15.459685 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6ef2ada9-5de3-42ba-b951-e3eeed702930 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161" status: 200 len: 1473 microversion: 2.1 time: 0.188606 Apr 16 21:19:15.460278 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1817/3500] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:15 2022] GET /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161 => generated 1473 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:16.477507 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-dfdf10a8-33cb-4765-98dd-e016215ca8dc tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:16.478181 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-dfdf10a8-33cb-4765-98dd-e016215ca8dc tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] [instance: 0ba3ff1f-0ee1-4dba-8354-10aaef694161] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:16.484775 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dfdf10a8-33cb-4765-98dd-e016215ca8dc tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:16.485284 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dfdf10a8-33cb-4765-98dd-e016215ca8dc tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:16.486044 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dfdf10a8-33cb-4765-98dd-e016215ca8dc tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:16.486485 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dfdf10a8-33cb-4765-98dd-e016215ca8dc tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:16.697717 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-dfdf10a8-33cb-4765-98dd-e016215ca8dc tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484bca4e32554ed4af061012f30666ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79f0fe4726d4abcbdc2672a15f709f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:16.705515 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-dfdf10a8-33cb-4765-98dd-e016215ca8dc tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161" status: 200 len: 1473 microversion: 2.1 time: 0.232462 Apr 16 21:19:16.706120 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1684/3501] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:16 2022] GET /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161 => generated 1473 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:17.723258 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-26992c80-50f4-4df9-b857-4303a4544edb tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:17.724957 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-26992c80-50f4-4df9-b857-4303a4544edb tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] [instance: 0ba3ff1f-0ee1-4dba-8354-10aaef694161] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:17.733045 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-26992c80-50f4-4df9-b857-4303a4544edb tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:17.733959 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-26992c80-50f4-4df9-b857-4303a4544edb tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:17.734829 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-26992c80-50f4-4df9-b857-4303a4544edb tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:17.735347 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-26992c80-50f4-4df9-b857-4303a4544edb tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:17.943309 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-26992c80-50f4-4df9-b857-4303a4544edb tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484bca4e32554ed4af061012f30666ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79f0fe4726d4abcbdc2672a15f709f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:17.948422 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-26992c80-50f4-4df9-b857-4303a4544edb tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161" status: 200 len: 1473 microversion: 2.1 time: 0.229342 Apr 16 21:19:17.949127 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1818/3502] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:17 2022] GET /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161 => generated 1473 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:18.178955 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-eb626c58-b7fc-4a5f-a61d-6867b1c4c154 req-9324d012-f247-4fde-bf8e-0bda25c4fa6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ba3ff1f-0ee1-4dba-8354-10aaef694161", "name": "network-vif-deleted", "tag": "da205378-8574-416e-8ccf-7ec5bb2d4541"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:19:18.190699 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-eb626c58-b7fc-4a5f-a61d-6867b1c4c154 req-9324d012-f247-4fde-bf8e-0bda25c4fa6e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:18.191158 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-eb626c58-b7fc-4a5f-a61d-6867b1c4c154 req-9324d012-f247-4fde-bf8e-0bda25c4fa6e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:18.203463 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-eb626c58-b7fc-4a5f-a61d-6867b1c4c154 req-9324d012-f247-4fde-bf8e-0bda25c4fa6e service nova] Creating event network-vif-deleted:da205378-8574-416e-8ccf-7ec5bb2d4541 for instance 0ba3ff1f-0ee1-4dba-8354-10aaef694161 on nch2-master-1 Apr 16 21:19:18.209076 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-eb626c58-b7fc-4a5f-a61d-6867b1c4c154 req-9324d012-f247-4fde-bf8e-0bda25c4fa6e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042338 Apr 16 21:19:18.209669 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1685/3503] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:19:18.966195 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1afbde2d-4f23-4ca6-b170-f451f05cefdf tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:18.966809 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1afbde2d-4f23-4ca6-b170-f451f05cefdf tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] [instance: 0ba3ff1f-0ee1-4dba-8354-10aaef694161] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:18.973726 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1afbde2d-4f23-4ca6-b170-f451f05cefdf tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:18.974196 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1afbde2d-4f23-4ca6-b170-f451f05cefdf tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:18.975027 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1afbde2d-4f23-4ca6-b170-f451f05cefdf tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:18.975480 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1afbde2d-4f23-4ca6-b170-f451f05cefdf tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:19.007286 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1afbde2d-4f23-4ca6-b170-f451f05cefdf tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:19.007756 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1afbde2d-4f23-4ca6-b170-f451f05cefdf tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:19.008255 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-1afbde2d-4f23-4ca6-b170-f451f05cefdf tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lazy-loading 'fault' on Instance uuid 0ba3ff1f-0ee1-4dba-8354-10aaef694161 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:19:19.064005 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1afbde2d-4f23-4ca6-b170-f451f05cefdf tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484bca4e32554ed4af061012f30666ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79f0fe4726d4abcbdc2672a15f709f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:19.074359 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1afbde2d-4f23-4ca6-b170-f451f05cefdf tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161" status: 200 len: 1307 microversion: 2.1 time: 0.112178 Apr 16 21:19:19.074965 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1819/3504] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:18 2022] GET /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161 => generated 1307 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:20.095039 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6e275a62-6498-4ded-9ba6-d14fe2d27990 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:20.096564 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6e275a62-6498-4ded-9ba6-d14fe2d27990 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] [instance: 0ba3ff1f-0ee1-4dba-8354-10aaef694161] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:20.104334 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6e275a62-6498-4ded-9ba6-d14fe2d27990 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:20.105013 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6e275a62-6498-4ded-9ba6-d14fe2d27990 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:20.105994 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6e275a62-6498-4ded-9ba6-d14fe2d27990 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:20.106596 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6e275a62-6498-4ded-9ba6-d14fe2d27990 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:20.121590 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-6e275a62-6498-4ded-9ba6-d14fe2d27990 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] HTTP exception thrown: Instance 0ba3ff1f-0ee1-4dba-8354-10aaef694161 could not be found. Apr 16 21:19:20.122194 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6e275a62-6498-4ded-9ba6-d14fe2d27990 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Returning 404 to user: Instance 0ba3ff1f-0ee1-4dba-8354-10aaef694161 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:19:20.123250 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6e275a62-6498-4ded-9ba6-d14fe2d27990 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161" status: 404 len: 111 microversion: 2.1 time: 0.032310 Apr 16 21:19:20.124134 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1820/3505] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:20 2022] GET /compute/v2.1/servers/0ba3ff1f-0ee1-4dba-8354-10aaef694161 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:19:20.131705 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-37b90cb5-a3e8-4368-92fb-be94d8234a8a tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:20.132326 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-37b90cb5-a3e8-4368-92fb-be94d8234a8a tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] [instance: 9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:20.138758 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-37b90cb5-a3e8-4368-92fb-be94d8234a8a tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:20.139308 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-37b90cb5-a3e8-4368-92fb-be94d8234a8a tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:20.140260 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-37b90cb5-a3e8-4368-92fb-be94d8234a8a tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:20.140733 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-37b90cb5-a3e8-4368-92fb-be94d8234a8a tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:20.166421 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-37b90cb5-a3e8-4368-92fb-be94d8234a8a tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] [instance: 9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:19:20.303216 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-80b36285-955e-4b8a-9e85-6f634d176c1d tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1446555893", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "a9c5ca64-24f2-435b-b1e5-e6bf23be4c40"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:19:20.357775 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-80b36285-955e-4b8a-9e85-6f634d176c1d tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] validate_networks() for [('a9c5ca64-24f2-435b-b1e5-e6bf23be4c40', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:19:20.442052 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-37b90cb5-a3e8-4368-92fb-be94d8234a8a tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523" status: 204 len: 0 microversion: 2.1 time: 0.313712 Apr 16 21:19:20.442936 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1821/3506] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:19:20 2022] DELETE /compute/v2.1/servers/9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 16 21:19:20.451373 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4321c97a-d473-479b-945e-aa33abe51b5a tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:20.452084 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4321c97a-d473-479b-945e-aa33abe51b5a tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] [instance: 9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:20.458477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4321c97a-d473-479b-945e-aa33abe51b5a tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:20.458912 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4321c97a-d473-479b-945e-aa33abe51b5a tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:20.459801 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4321c97a-d473-479b-945e-aa33abe51b5a tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:20.460765 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4321c97a-d473-479b-945e-aa33abe51b5a tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:20.605307 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4321c97a-d473-479b-945e-aa33abe51b5a tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484bca4e32554ed4af061012f30666ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79f0fe4726d4abcbdc2672a15f709f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:20.613149 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4321c97a-d473-479b-945e-aa33abe51b5a tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/servers/9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523" status: 200 len: 1473 microversion: 2.1 time: 0.166040 Apr 16 21:19:20.613793 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1822/3507] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:20 2022] GET /compute/v2.1/servers/9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523 => generated 1473 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:19:20.880383 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-80b36285-955e-4b8a-9e85-6f634d176c1d tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:19:20.880944 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-80b36285-955e-4b8a-9e85-6f634d176c1d tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:19:20.881426 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-80b36285-955e-4b8a-9e85-6f634d176c1d tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:19:20.881841 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-80b36285-955e-4b8a-9e85-6f634d176c1d tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:19:20.882441 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-80b36285-955e-4b8a-9e85-6f634d176c1d tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:19:20.891701 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-80b36285-955e-4b8a-9e85-6f634d176c1d tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:20.892229 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-80b36285-955e-4b8a-9e85-6f634d176c1d tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:20.893061 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-80b36285-955e-4b8a-9e85-6f634d176c1d tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:20.893504 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-80b36285-955e-4b8a-9e85-6f634d176c1d tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:20.911155 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-80b36285-955e-4b8a-9e85-6f634d176c1d tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Getting quotas for project c3cbfdc065da4c4b9f599d9cdd99496d. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:19:20.916639 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-80b36285-955e-4b8a-9e85-6f634d176c1d tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Getting quotas for user 7495514ac1444f17b2b0fe5b8ba534b1 and project c3cbfdc065da4c4b9f599d9cdd99496d. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:19:20.928882 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-80b36285-955e-4b8a-9e85-6f634d176c1d tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:19:20.931318 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-80b36285-955e-4b8a-9e85-6f634d176c1d tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] [instance: 3ea60a95-8b64-4410-a953-747f38619ffa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:19:21.009767 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-80b36285-955e-4b8a-9e85-6f634d176c1d tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.955849 Apr 16 21:19:21.010492 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1686/3508] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:19:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:19:21.021234 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-26b88594-4d4e-41eb-970a-cb04ad1525c0 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:21.021857 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-26b88594-4d4e-41eb-970a-cb04ad1525c0 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] [instance: 3ea60a95-8b64-4410-a953-747f38619ffa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:21.076574 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-26b88594-4d4e-41eb-970a-cb04ad1525c0 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495514ac1444f17b2b0fe5b8ba534b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cbfdc065da4c4b9f599d9cdd99496d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:21.085393 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-26b88594-4d4e-41eb-970a-cb04ad1525c0 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] 10.222.0.20 "GET /compute/v2.1/servers/3ea60a95-8b64-4410-a953-747f38619ffa" status: 200 len: 1218 microversion: 2.1 time: 0.066433 Apr 16 21:19:21.085393 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1823/3509] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:21 2022] GET /compute/v2.1/servers/3ea60a95-8b64-4410-a953-747f38619ffa => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:19:21.630351 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a92f172b-e94f-4db7-a627-acf0364270d9 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:21.630967 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a92f172b-e94f-4db7-a627-acf0364270d9 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] [instance: 9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:21.640996 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a92f172b-e94f-4db7-a627-acf0364270d9 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:21.641457 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a92f172b-e94f-4db7-a627-acf0364270d9 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:21.642244 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a92f172b-e94f-4db7-a627-acf0364270d9 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:21.642687 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a92f172b-e94f-4db7-a627-acf0364270d9 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:21.793018 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a92f172b-e94f-4db7-a627-acf0364270d9 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484bca4e32554ed4af061012f30666ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79f0fe4726d4abcbdc2672a15f709f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:21.802082 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a92f172b-e94f-4db7-a627-acf0364270d9 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/servers/9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523" status: 200 len: 1473 microversion: 2.1 time: 0.175881 Apr 16 21:19:21.802749 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1687/3510] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:21 2022] GET /compute/v2.1/servers/9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523 => generated 1473 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:22.100551 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-aaf32543-d09e-4385-8021-afdbfcaef052 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:22.101165 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-aaf32543-d09e-4385-8021-afdbfcaef052 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] [instance: 3ea60a95-8b64-4410-a953-747f38619ffa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:22.109093 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aaf32543-d09e-4385-8021-afdbfcaef052 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:22.109550 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aaf32543-d09e-4385-8021-afdbfcaef052 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:22.110322 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aaf32543-d09e-4385-8021-afdbfcaef052 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:22.110791 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aaf32543-d09e-4385-8021-afdbfcaef052 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:22.170813 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-aaf32543-d09e-4385-8021-afdbfcaef052 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495514ac1444f17b2b0fe5b8ba534b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cbfdc065da4c4b9f599d9cdd99496d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:22.178352 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-aaf32543-d09e-4385-8021-afdbfcaef052 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] 10.222.0.20 "GET /compute/v2.1/servers/3ea60a95-8b64-4410-a953-747f38619ffa" status: 200 len: 1222 microversion: 2.1 time: 0.081702 Apr 16 21:19:22.178936 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1824/3511] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:22 2022] GET /compute/v2.1/servers/3ea60a95-8b64-4410-a953-747f38619ffa => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:22.823172 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2859f62a-92fa-4861-932e-bb82a29173fa tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:22.823782 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2859f62a-92fa-4861-932e-bb82a29173fa tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] [instance: 9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:22.830525 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2859f62a-92fa-4861-932e-bb82a29173fa tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:22.830983 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2859f62a-92fa-4861-932e-bb82a29173fa tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:22.831764 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2859f62a-92fa-4861-932e-bb82a29173fa tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:22.832229 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2859f62a-92fa-4861-932e-bb82a29173fa tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:22.917419 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2859f62a-92fa-4861-932e-bb82a29173fa tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484bca4e32554ed4af061012f30666ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79f0fe4726d4abcbdc2672a15f709f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:22.925730 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2859f62a-92fa-4861-932e-bb82a29173fa tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/servers/9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523" status: 200 len: 1431 microversion: 2.1 time: 0.110784 Apr 16 21:19:22.926312 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1688/3512] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:22 2022] GET /compute/v2.1/servers/9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523 => generated 1431 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:22.940784 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-5f2cf8f9-daaf-4f15-af78-c09e4cdf61b2 req-627d8c6d-ceb7-4767-8fad-a3cc7d04ef7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523", "name": "network-vif-deleted", "tag": "0eab5a77-408a-45d7-86ff-b5c0a4b550d1"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:19:22.949665 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-5f2cf8f9-daaf-4f15-af78-c09e4cdf61b2 req-627d8c6d-ceb7-4767-8fad-a3cc7d04ef7b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:22.955224 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-5f2cf8f9-daaf-4f15-af78-c09e4cdf61b2 req-627d8c6d-ceb7-4767-8fad-a3cc7d04ef7b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:22.964249 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-5f2cf8f9-daaf-4f15-af78-c09e4cdf61b2 req-627d8c6d-ceb7-4767-8fad-a3cc7d04ef7b service nova] Creating event network-vif-deleted:0eab5a77-408a-45d7-86ff-b5c0a4b550d1 for instance 9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523 on nch2-master-1 Apr 16 21:19:22.969416 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-5f2cf8f9-daaf-4f15-af78-c09e4cdf61b2 req-627d8c6d-ceb7-4767-8fad-a3cc7d04ef7b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032355 Apr 16 21:19:22.971168 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1825/3513] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:19:23.196188 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fb04ea09-46ca-4b81-b574-9cdd2b18dda2 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:23.196828 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-fb04ea09-46ca-4b81-b574-9cdd2b18dda2 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] [instance: 3ea60a95-8b64-4410-a953-747f38619ffa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:23.203329 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fb04ea09-46ca-4b81-b574-9cdd2b18dda2 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:23.204126 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fb04ea09-46ca-4b81-b574-9cdd2b18dda2 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:23.205799 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fb04ea09-46ca-4b81-b574-9cdd2b18dda2 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:23.206542 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fb04ea09-46ca-4b81-b574-9cdd2b18dda2 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:23.276993 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-fb04ea09-46ca-4b81-b574-9cdd2b18dda2 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495514ac1444f17b2b0fe5b8ba534b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cbfdc065da4c4b9f599d9cdd99496d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:23.285711 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fb04ea09-46ca-4b81-b574-9cdd2b18dda2 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] 10.222.0.20 "GET /compute/v2.1/servers/3ea60a95-8b64-4410-a953-747f38619ffa" status: 200 len: 1278 microversion: 2.1 time: 0.094665 Apr 16 21:19:23.287355 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1689/3514] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:23 2022] GET /compute/v2.1/servers/3ea60a95-8b64-4410-a953-747f38619ffa => generated 1278 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:23.945105 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-15e0dcfe-4ecd-4656-bf04-445b17bfae02 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:23.945896 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-15e0dcfe-4ecd-4656-bf04-445b17bfae02 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] [instance: 9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:23.956101 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-15e0dcfe-4ecd-4656-bf04-445b17bfae02 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:23.956688 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-15e0dcfe-4ecd-4656-bf04-445b17bfae02 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:23.957834 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-15e0dcfe-4ecd-4656-bf04-445b17bfae02 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:23.958401 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-15e0dcfe-4ecd-4656-bf04-445b17bfae02 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:23.995929 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-15e0dcfe-4ecd-4656-bf04-445b17bfae02 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:23.996433 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-15e0dcfe-4ecd-4656-bf04-445b17bfae02 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:23.996902 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-15e0dcfe-4ecd-4656-bf04-445b17bfae02 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lazy-loading 'fault' on Instance uuid 9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:19:24.041758 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-15e0dcfe-4ecd-4656-bf04-445b17bfae02 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '484bca4e32554ed4af061012f30666ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c79f0fe4726d4abcbdc2672a15f709f9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:24.048790 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-15e0dcfe-4ecd-4656-bf04-445b17bfae02 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/servers/9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523" status: 200 len: 1307 microversion: 2.1 time: 0.108823 Apr 16 21:19:24.049396 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1826/3515] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:23 2022] GET /compute/v2.1/servers/9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523 => generated 1307 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:24.303287 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bb3f796a-0ff0-4f30-b0c8-b5f088e82cc8 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:24.303910 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bb3f796a-0ff0-4f30-b0c8-b5f088e82cc8 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] [instance: 3ea60a95-8b64-4410-a953-747f38619ffa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:24.311776 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bb3f796a-0ff0-4f30-b0c8-b5f088e82cc8 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:24.312285 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bb3f796a-0ff0-4f30-b0c8-b5f088e82cc8 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:24.313378 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bb3f796a-0ff0-4f30-b0c8-b5f088e82cc8 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:24.313831 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bb3f796a-0ff0-4f30-b0c8-b5f088e82cc8 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:24.447011 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-bb3f796a-0ff0-4f30-b0c8-b5f088e82cc8 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495514ac1444f17b2b0fe5b8ba534b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cbfdc065da4c4b9f599d9cdd99496d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:24.454291 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bb3f796a-0ff0-4f30-b0c8-b5f088e82cc8 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] 10.222.0.20 "GET /compute/v2.1/servers/3ea60a95-8b64-4410-a953-747f38619ffa" status: 200 len: 1318 microversion: 2.1 time: 0.155171 Apr 16 21:19:24.454863 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1690/3516] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:24 2022] GET /compute/v2.1/servers/3ea60a95-8b64-4410-a953-747f38619ffa => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:24.986935 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-3558364d-b0e0-43ac-8eb1-c23efaa51bf2 req-e16a0749-9c8e-4765-a465-ab1c6f9e235b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ea60a95-8b64-4410-a953-747f38619ffa", "tag": "da5c53cc-6d81-4340-85c9-4cb9fd280548"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:19:24.993738 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-3558364d-b0e0-43ac-8eb1-c23efaa51bf2 req-e16a0749-9c8e-4765-a465-ab1c6f9e235b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:24.994169 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-3558364d-b0e0-43ac-8eb1-c23efaa51bf2 req-e16a0749-9c8e-4765-a465-ab1c6f9e235b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:25.004590 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-3558364d-b0e0-43ac-8eb1-c23efaa51bf2 req-e16a0749-9c8e-4765-a465-ab1c6f9e235b service nova] Creating event network-changed:da5c53cc-6d81-4340-85c9-4cb9fd280548 for instance 3ea60a95-8b64-4410-a953-747f38619ffa on nch2-master-1 Apr 16 21:19:25.009227 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-3558364d-b0e0-43ac-8eb1-c23efaa51bf2 req-e16a0749-9c8e-4765-a465-ab1c6f9e235b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028058 Apr 16 21:19:25.009810 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1827/3517] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:19:25.065563 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3c7a2116-16ea-42da-b087-23d8096cbaa0 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:25.066290 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3c7a2116-16ea-42da-b087-23d8096cbaa0 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] [instance: 9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:25.072406 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3c7a2116-16ea-42da-b087-23d8096cbaa0 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:25.073016 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3c7a2116-16ea-42da-b087-23d8096cbaa0 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:25.073866 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3c7a2116-16ea-42da-b087-23d8096cbaa0 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:25.074333 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3c7a2116-16ea-42da-b087-23d8096cbaa0 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:25.088476 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-3c7a2116-16ea-42da-b087-23d8096cbaa0 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] HTTP exception thrown: Instance 9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523 could not be found. Apr 16 21:19:25.089087 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3c7a2116-16ea-42da-b087-23d8096cbaa0 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Returning 404 to user: Instance 9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:19:25.089928 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3c7a2116-16ea-42da-b087-23d8096cbaa0 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "GET /compute/v2.1/servers/9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523" status: 404 len: 111 microversion: 2.1 time: 0.028361 Apr 16 21:19:25.090484 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1691/3518] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:25 2022] GET /compute/v2.1/servers/9d54ba5f-3cb3-4d9b-a136-7d5f1b39a523 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:19:25.099296 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-120388ac-e44f-4086-b2f6-486ec6c1413f tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb95afd1f0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:25.476742 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-25fb2b49-774b-4b7b-bcf9-327bfc05f61e tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:25.477797 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-25fb2b49-774b-4b7b-bcf9-327bfc05f61e tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] [instance: 3ea60a95-8b64-4410-a953-747f38619ffa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:25.485928 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-25fb2b49-774b-4b7b-bcf9-327bfc05f61e tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:25.486550 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-25fb2b49-774b-4b7b-bcf9-327bfc05f61e tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:25.487631 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-25fb2b49-774b-4b7b-bcf9-327bfc05f61e tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:25.488211 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-25fb2b49-774b-4b7b-bcf9-327bfc05f61e tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:25.644120 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-25fb2b49-774b-4b7b-bcf9-327bfc05f61e tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495514ac1444f17b2b0fe5b8ba534b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cbfdc065da4c4b9f599d9cdd99496d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:25.651996 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-25fb2b49-774b-4b7b-bcf9-327bfc05f61e tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] 10.222.0.20 "GET /compute/v2.1/servers/3ea60a95-8b64-4410-a953-747f38619ffa" status: 200 len: 1318 microversion: 2.1 time: 0.182281 Apr 16 21:19:25.652591 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1692/3519] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:25 2022] GET /compute/v2.1/servers/3ea60a95-8b64-4410-a953-747f38619ffa => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:19:25.725971 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-120388ac-e44f-4086-b2f6-486ec6c1413f tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "DELETE /compute/v2.1/images/17acdee7-0ba6-430c-a1f3-2f23d5016268" status: 204 len: 0 microversion: 2.1 time: 0.630940 Apr 16 21:19:25.726561 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1828/3520] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:25 2022] DELETE /compute/v2.1/images/17acdee7-0ba6-430c-a1f3-2f23d5016268 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:19:25.734806 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5cd3c4e1-401c-4e9f-815c-ea3a32db1498 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb958f13a0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:26.314019 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5cd3c4e1-401c-4e9f-815c-ea3a32db1498 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "DELETE /compute/v2.1/images/d0f1e34c-d801-4bc4-8677-b12311ef7aee" status: 204 len: 0 microversion: 2.1 time: 0.583039 Apr 16 21:19:26.317528 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1693/3521] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:25 2022] DELETE /compute/v2.1/images/d0f1e34c-d801-4bc4-8677-b12311ef7aee => generated 0 bytes in 584 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 16 21:19:26.323693 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-621a9f73-c887-4886-82d5-d73226f7a843 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] Calling method '.version_select at 0x7fbb965bd0d0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:26.669297 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e27714f7-7c85-4a8e-8533-51926eb210d0 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:26.670018 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e27714f7-7c85-4a8e-8533-51926eb210d0 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] [instance: 3ea60a95-8b64-4410-a953-747f38619ffa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:26.677347 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e27714f7-7c85-4a8e-8533-51926eb210d0 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:26.677808 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e27714f7-7c85-4a8e-8533-51926eb210d0 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:26.678955 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e27714f7-7c85-4a8e-8533-51926eb210d0 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:26.679383 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e27714f7-7c85-4a8e-8533-51926eb210d0 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:26.818812 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e27714f7-7c85-4a8e-8533-51926eb210d0 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495514ac1444f17b2b0fe5b8ba534b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cbfdc065da4c4b9f599d9cdd99496d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:26.828654 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e27714f7-7c85-4a8e-8533-51926eb210d0 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] 10.222.0.20 "GET /compute/v2.1/servers/3ea60a95-8b64-4410-a953-747f38619ffa" status: 200 len: 1318 microversion: 2.1 time: 0.163686 Apr 16 21:19:26.829602 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1694/3522] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:26 2022] GET /compute/v2.1/servers/3ea60a95-8b64-4410-a953-747f38619ffa => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:19:27.039263 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-621a9f73-c887-4886-82d5-d73226f7a843 tempest-ListImageFiltersTestJSON-1666922811 tempest-ListImageFiltersTestJSON-1666922811-project] 10.222.0.20 "DELETE /compute/v2.1/images/09ad8237-f421-4e3a-9fb7-6395c5a27ba6" status: 204 len: 0 microversion: 2.1 time: 0.720480 Apr 16 21:19:27.039923 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1829/3523] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:26 2022] DELETE /compute/v2.1/images/09ad8237-f421-4e3a-9fb7-6395c5a27ba6 => generated 0 bytes in 722 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:19:27.848892 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ba9ad185-07e4-4d5b-b925-94f0cb0ee83f tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:27.850044 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ba9ad185-07e4-4d5b-b925-94f0cb0ee83f tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] [instance: 3ea60a95-8b64-4410-a953-747f38619ffa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:27.859362 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ba9ad185-07e4-4d5b-b925-94f0cb0ee83f tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:27.859843 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ba9ad185-07e4-4d5b-b925-94f0cb0ee83f tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:27.860599 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ba9ad185-07e4-4d5b-b925-94f0cb0ee83f tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:27.861040 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ba9ad185-07e4-4d5b-b925-94f0cb0ee83f tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:28.002210 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ba9ad185-07e4-4d5b-b925-94f0cb0ee83f tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495514ac1444f17b2b0fe5b8ba534b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cbfdc065da4c4b9f599d9cdd99496d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:28.009804 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ba9ad185-07e4-4d5b-b925-94f0cb0ee83f tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] 10.222.0.20 "GET /compute/v2.1/servers/3ea60a95-8b64-4410-a953-747f38619ffa" status: 200 len: 1318 microversion: 2.1 time: 0.166799 Apr 16 21:19:28.010488 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1695/3524] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:27 2022] GET /compute/v2.1/servers/3ea60a95-8b64-4410-a953-747f38619ffa => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:29.027028 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a2b54787-213f-41be-9a8a-53d0b23f3cf9 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:29.027763 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a2b54787-213f-41be-9a8a-53d0b23f3cf9 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] [instance: 3ea60a95-8b64-4410-a953-747f38619ffa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:29.035936 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a2b54787-213f-41be-9a8a-53d0b23f3cf9 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:29.036643 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a2b54787-213f-41be-9a8a-53d0b23f3cf9 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:29.037624 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a2b54787-213f-41be-9a8a-53d0b23f3cf9 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:29.038065 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a2b54787-213f-41be-9a8a-53d0b23f3cf9 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:29.189712 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a2b54787-213f-41be-9a8a-53d0b23f3cf9 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495514ac1444f17b2b0fe5b8ba534b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cbfdc065da4c4b9f599d9cdd99496d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:29.197479 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a2b54787-213f-41be-9a8a-53d0b23f3cf9 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] 10.222.0.20 "GET /compute/v2.1/servers/3ea60a95-8b64-4410-a953-747f38619ffa" status: 200 len: 1318 microversion: 2.1 time: 0.175193 Apr 16 21:19:29.198054 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1830/3525] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:29 2022] GET /compute/v2.1/servers/3ea60a95-8b64-4410-a953-747f38619ffa => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:30.214279 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a42d4beb-66fb-4149-83ee-c01dc4a2cffd tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:30.215090 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a42d4beb-66fb-4149-83ee-c01dc4a2cffd tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] [instance: 3ea60a95-8b64-4410-a953-747f38619ffa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:30.222117 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a42d4beb-66fb-4149-83ee-c01dc4a2cffd tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:30.222584 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a42d4beb-66fb-4149-83ee-c01dc4a2cffd tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:30.223379 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a42d4beb-66fb-4149-83ee-c01dc4a2cffd tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:30.223830 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a42d4beb-66fb-4149-83ee-c01dc4a2cffd tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:30.373057 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a42d4beb-66fb-4149-83ee-c01dc4a2cffd tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495514ac1444f17b2b0fe5b8ba534b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cbfdc065da4c4b9f599d9cdd99496d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:30.382272 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a42d4beb-66fb-4149-83ee-c01dc4a2cffd tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] 10.222.0.20 "GET /compute/v2.1/servers/3ea60a95-8b64-4410-a953-747f38619ffa" status: 200 len: 1318 microversion: 2.1 time: 0.171637 Apr 16 21:19:30.383126 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1696/3526] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:30 2022] GET /compute/v2.1/servers/3ea60a95-8b64-4410-a953-747f38619ffa => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:30.945025 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cbfce7b0-b675-4ab1-a4bd-482c53768400 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:30.945682 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-cbfce7b0-b675-4ab1-a4bd-482c53768400 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:30.952409 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cbfce7b0-b675-4ab1-a4bd-482c53768400 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:30.953198 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cbfce7b0-b675-4ab1-a4bd-482c53768400 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:30.954088 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cbfce7b0-b675-4ab1-a4bd-482c53768400 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:30.954591 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cbfce7b0-b675-4ab1-a4bd-482c53768400 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:31.035447 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-cbfce7b0-b675-4ab1-a4bd-482c53768400 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lazy-loading 'services' on Instance uuid 8c7cd9df-57f3-47a6-aa40-76ee208e2c09 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:19:31.111406 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-639aca2c-bcf3-429e-8fb5-d7a5f50bb8a4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1523242040", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "90b900dd-0d06-4537-95d8-47dd03c283fc"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:19:31.165380 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-639aca2c-bcf3-429e-8fb5-d7a5f50bb8a4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] validate_networks() for [('90b900dd-0d06-4537-95d8-47dd03c283fc', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:19:31.224995 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cbfce7b0-b675-4ab1-a4bd-482c53768400 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09/os-volume_attachments/9687446e-2d63-4b79-8b0a-20abf71fe84e" status: 202 len: 0 microversion: 2.1 time: 0.285175 Apr 16 21:19:31.227195 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1697/3527] 10.222.0.20 () {58 vars in 1415 bytes} [Sat Apr 16 21:19:30 2022] DELETE /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09/os-volume_attachments/9687446e-2d63-4b79-8b0a-20abf71fe84e => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 16 21:19:31.235166 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-64a44bc4-fc4b-4cfc-bb74-ae4346264837 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:31.236164 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-64a44bc4-fc4b-4cfc-bb74-ae4346264837 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:31.242720 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-64a44bc4-fc4b-4cfc-bb74-ae4346264837 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:31.253285 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-64a44bc4-fc4b-4cfc-bb74-ae4346264837 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:31.253285 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-64a44bc4-fc4b-4cfc-bb74-ae4346264837 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:31.253285 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-64a44bc4-fc4b-4cfc-bb74-ae4346264837 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:31.277403 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-64a44bc4-fc4b-4cfc-bb74-ae4346264837 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043903 Apr 16 21:19:31.277403 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1698/3528] 10.222.0.20 () {58 vars in 1301 bytes} [Sat Apr 16 21:19:31 2022] GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:19:31.401203 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c6f76933-559b-4043-b4aa-1d3c8dc356d2 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:31.401848 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c6f76933-559b-4043-b4aa-1d3c8dc356d2 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] [instance: 3ea60a95-8b64-4410-a953-747f38619ffa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:31.407925 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c6f76933-559b-4043-b4aa-1d3c8dc356d2 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:31.408423 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c6f76933-559b-4043-b4aa-1d3c8dc356d2 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:31.409198 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c6f76933-559b-4043-b4aa-1d3c8dc356d2 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:31.409643 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c6f76933-559b-4043-b4aa-1d3c8dc356d2 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:31.551893 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c6f76933-559b-4043-b4aa-1d3c8dc356d2 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495514ac1444f17b2b0fe5b8ba534b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cbfdc065da4c4b9f599d9cdd99496d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:31.559999 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c6f76933-559b-4043-b4aa-1d3c8dc356d2 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] 10.222.0.20 "GET /compute/v2.1/servers/3ea60a95-8b64-4410-a953-747f38619ffa" status: 200 len: 1318 microversion: 2.1 time: 0.162703 Apr 16 21:19:31.560619 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1699/3529] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:31 2022] GET /compute/v2.1/servers/3ea60a95-8b64-4410-a953-747f38619ffa => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:19:31.629377 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-639aca2c-bcf3-429e-8fb5-d7a5f50bb8a4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:19:31.629806 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-639aca2c-bcf3-429e-8fb5-d7a5f50bb8a4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:19:31.630284 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-639aca2c-bcf3-429e-8fb5-d7a5f50bb8a4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:19:31.630698 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-639aca2c-bcf3-429e-8fb5-d7a5f50bb8a4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:19:31.631140 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-639aca2c-bcf3-429e-8fb5-d7a5f50bb8a4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:19:31.640739 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-639aca2c-bcf3-429e-8fb5-d7a5f50bb8a4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:31.641278 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-639aca2c-bcf3-429e-8fb5-d7a5f50bb8a4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:31.642216 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-639aca2c-bcf3-429e-8fb5-d7a5f50bb8a4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:31.642747 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-639aca2c-bcf3-429e-8fb5-d7a5f50bb8a4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:31.660389 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-639aca2c-bcf3-429e-8fb5-d7a5f50bb8a4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Getting quotas for project 14f08d6620b54fb597d356afc45617c7. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:19:31.666498 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-639aca2c-bcf3-429e-8fb5-d7a5f50bb8a4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Getting quotas for user aae8536e08dd4bfb88adc698e7a33d3b and project 14f08d6620b54fb597d356afc45617c7. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:19:31.679561 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-639aca2c-bcf3-429e-8fb5-d7a5f50bb8a4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:19:31.682075 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-639aca2c-bcf3-429e-8fb5-d7a5f50bb8a4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:19:31.798835 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-639aca2c-bcf3-429e-8fb5-d7a5f50bb8a4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.961858 Apr 16 21:19:31.799545 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1831/3530] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:19:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 16 21:19:31.809432 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1d9eefe3-128a-45d1-a08d-3d42a56ba289 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:31.815704 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1d9eefe3-128a-45d1-a08d-3d42a56ba289 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:31.869893 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1d9eefe3-128a-45d1-a08d-3d42a56ba289 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:31.877342 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1d9eefe3-128a-45d1-a08d-3d42a56ba289 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 200 len: 1218 microversion: 2.1 time: 0.071557 Apr 16 21:19:31.878073 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1700/3531] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:31 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:31.929223 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-75ad5291-f0da-475d-b4f2-697366f89ca9 req-6b2f7828-8012-4819-984e-0bce5a0299ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ea60a95-8b64-4410-a953-747f38619ffa", "name": "network-vif-plugged", "status": "completed", "tag": "da5c53cc-6d81-4340-85c9-4cb9fd280548"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:19:31.943117 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-75ad5291-f0da-475d-b4f2-697366f89ca9 req-6b2f7828-8012-4819-984e-0bce5a0299ce service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:31.944067 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-75ad5291-f0da-475d-b4f2-697366f89ca9 req-6b2f7828-8012-4819-984e-0bce5a0299ce service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:31.982267 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-75ad5291-f0da-475d-b4f2-697366f89ca9 req-6b2f7828-8012-4819-984e-0bce5a0299ce service nova] Creating event network-vif-plugged:da5c53cc-6d81-4340-85c9-4cb9fd280548 for instance 3ea60a95-8b64-4410-a953-747f38619ffa on nch2-master-1 Apr 16 21:19:31.992907 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-75ad5291-f0da-475d-b4f2-697366f89ca9 req-6b2f7828-8012-4819-984e-0bce5a0299ce service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070619 Apr 16 21:19:31.995066 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1832/3532] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:19:32.286145 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e5b3b014-9b93-409a-adab-886cb9bf469b tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:32.287225 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e5b3b014-9b93-409a-adab-886cb9bf469b tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:32.295236 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e5b3b014-9b93-409a-adab-886cb9bf469b tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:32.295695 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e5b3b014-9b93-409a-adab-886cb9bf469b tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:32.296654 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e5b3b014-9b93-409a-adab-886cb9bf469b tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:32.297100 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e5b3b014-9b93-409a-adab-886cb9bf469b tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:32.325860 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e5b3b014-9b93-409a-adab-886cb9bf469b tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043808 Apr 16 21:19:32.327511 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1701/3533] 10.222.0.20 () {58 vars in 1301 bytes} [Sat Apr 16 21:19:32 2022] GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:19:32.557498 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-82a381a4-3f9e-4f69-93f1-eb22914dab3f tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:32.561119 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-82a381a4-3f9e-4f69-93f1-eb22914dab3f tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f0f6bbe8241a49c890032fb779c4bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc8f8d1fc734ce182645a464d35ead8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:32.561881 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-82a381a4-3f9e-4f69-93f1-eb22914dab3f tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Searching by: {'deleted': False, 'project_id': '3bc8f8d1fc734ce182645a464d35ead8'} {{(pid=137408) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:19:32.567420 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-82a381a4-3f9e-4f69-93f1-eb22914dab3f tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:32.567882 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-82a381a4-3f9e-4f69-93f1-eb22914dab3f tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:32.568788 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-82a381a4-3f9e-4f69-93f1-eb22914dab3f tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:32.569243 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-82a381a4-3f9e-4f69-93f1-eb22914dab3f tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:32.577416 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-01579fa2-2ed1-4c68-80c4-f58955ffbc46 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:32.578253 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-01579fa2-2ed1-4c68-80c4-f58955ffbc46 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] [instance: 3ea60a95-8b64-4410-a953-747f38619ffa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:32.584680 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-01579fa2-2ed1-4c68-80c4-f58955ffbc46 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:32.585176 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-01579fa2-2ed1-4c68-80c4-f58955ffbc46 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:32.586026 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-01579fa2-2ed1-4c68-80c4-f58955ffbc46 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:32.586460 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-01579fa2-2ed1-4c68-80c4-f58955ffbc46 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:32.594950 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.multi_cell_list [None req-82a381a4-3f9e-4f69-93f1-eb22914dab3f tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137408) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 16 21:19:32.626399 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-82a381a4-3f9e-4f69-93f1-eb22914dab3f tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.074049 Apr 16 21:19:32.626986 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1833/3534] 10.222.0.20 () {58 vars in 1124 bytes} [Sat Apr 16 21:19:32 2022] GET /compute/v2.1/servers => generated 340 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:19:32.638558 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5d0bb8d8-514d-476c-9b72-313ccf4f6214 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:32.642009 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5d0bb8d8-514d-476c-9b72-313ccf4f6214 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f0f6bbe8241a49c890032fb779c4bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc8f8d1fc734ce182645a464d35ead8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:32.642943 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5d0bb8d8-514d-476c-9b72-313ccf4f6214 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Searching by: {'deleted': False, 'project_id': '3bc8f8d1fc734ce182645a464d35ead8'} {{(pid=137408) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:19:32.648208 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5d0bb8d8-514d-476c-9b72-313ccf4f6214 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:32.650820 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5d0bb8d8-514d-476c-9b72-313ccf4f6214 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:32.650820 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5d0bb8d8-514d-476c-9b72-313ccf4f6214 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:32.650820 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5d0bb8d8-514d-476c-9b72-313ccf4f6214 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:32.676525 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.multi_cell_list [None req-5d0bb8d8-514d-476c-9b72-313ccf4f6214 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137408) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 16 21:19:32.716323 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5d0bb8d8-514d-476c-9b72-313ccf4f6214 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f6bbe8241a49c890032fb779c4bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc8f8d1fc734ce182645a464d35ead8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:32.723117 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5d0bb8d8-514d-476c-9b72-313ccf4f6214 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:32.723592 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5d0bb8d8-514d-476c-9b72-313ccf4f6214 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:32.742806 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-01579fa2-2ed1-4c68-80c4-f58955ffbc46 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495514ac1444f17b2b0fe5b8ba534b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cbfdc065da4c4b9f599d9cdd99496d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:32.751969 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-01579fa2-2ed1-4c68-80c4-f58955ffbc46 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] 10.222.0.20 "GET /compute/v2.1/servers/3ea60a95-8b64-4410-a953-747f38619ffa" status: 200 len: 1318 microversion: 2.1 time: 0.178357 Apr 16 21:19:32.752838 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1702/3535] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:32 2022] GET /compute/v2.1/servers/3ea60a95-8b64-4410-a953-747f38619ffa => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:19:32.837581 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5d0bb8d8-514d-476c-9b72-313ccf4f6214 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 1712 microversion: 2.1 time: 0.203186 Apr 16 21:19:32.838256 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1834/3536] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:19:32 2022] GET /compute/v2.1/servers/detail => generated 1712 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:19:32.855472 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a013fea5-8535-46dc-b6a0-e64fbcb539d4 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:32.863610 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a013fea5-8535-46dc-b6a0-e64fbcb539d4 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.012501 Apr 16 21:19:32.864152 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1703/3537] 10.222.0.20 () {58 vars in 1136 bytes} [Sat Apr 16 21:19:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:19:32.897819 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2c110606-914c-409a-9d79-6969dea70216 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:32.899093 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2c110606-914c-409a-9d79-6969dea70216 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:32.954396 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2c110606-914c-409a-9d79-6969dea70216 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:32.961167 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2c110606-914c-409a-9d79-6969dea70216 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 200 len: 1218 microversion: 2.1 time: 0.071532 Apr 16 21:19:32.961740 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1835/3538] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:32 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 1218 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:33.338168 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3cf3a16e-1cac-4f79-9503-34aab485623f tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:33.339981 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3cf3a16e-1cac-4f79-9503-34aab485623f tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:33.350549 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3cf3a16e-1cac-4f79-9503-34aab485623f tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:33.351403 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3cf3a16e-1cac-4f79-9503-34aab485623f tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:33.352415 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3cf3a16e-1cac-4f79-9503-34aab485623f tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:33.358754 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3cf3a16e-1cac-4f79-9503-34aab485623f tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:33.417992 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3cf3a16e-1cac-4f79-9503-34aab485623f tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.084324 Apr 16 21:19:33.418561 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1704/3539] 10.222.0.20 () {58 vars in 1301 bytes} [Sat Apr 16 21:19:33 2022] GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:19:33.485609 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4514b50b-0b4f-486c-965e-fae01bf7008f tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:19:33.486671 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4514b50b-0b4f-486c-965e-fae01bf7008f tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:33.511662 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4514b50b-0b4f-486c-965e-fae01bf7008f tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:33.512134 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4514b50b-0b4f-486c-965e-fae01bf7008f tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:33.513172 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4514b50b-0b4f-486c-965e-fae01bf7008f tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:33.513633 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4514b50b-0b4f-486c-965e-fae01bf7008f tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:33.544696 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-4514b50b-0b4f-486c-965e-fae01bf7008f tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] HTTP exception thrown: Cannot 'reboot' instance 89f07150-d0ab-41c9-a9bf-692e9d9c5140 while it is in vm_state rescued Apr 16 21:19:33.547168 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4514b50b-0b4f-486c-965e-fae01bf7008f tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Returning 409 to user: Cannot 'reboot' instance 89f07150-d0ab-41c9-a9bf-692e9d9c5140 while it is in vm_state rescued {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:19:33.547168 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4514b50b-0b4f-486c-965e-fae01bf7008f tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "POST /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140/action" status: 409 len: 145 microversion: 2.1 time: 0.064690 Apr 16 21:19:33.547168 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1836/3540] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:19:33 2022] POST /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140/action => generated 145 bytes in 66 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:19:33.556309 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-98632264-e5c8-4996-9d13-9096f5139534 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:19:33.557739 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-98632264-e5c8-4996-9d13-9096f5139534 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:33.564375 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-98632264-e5c8-4996-9d13-9096f5139534 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:33.564375 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-98632264-e5c8-4996-9d13-9096f5139534 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:33.564957 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-98632264-e5c8-4996-9d13-9096f5139534 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:33.565398 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-98632264-e5c8-4996-9d13-9096f5139534 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:33.591481 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-98632264-e5c8-4996-9d13-9096f5139534 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] HTTP exception thrown: Cannot 'rebuild' instance 89f07150-d0ab-41c9-a9bf-692e9d9c5140 while it is in vm_state rescued Apr 16 21:19:33.592087 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-98632264-e5c8-4996-9d13-9096f5139534 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Returning 409 to user: Cannot 'rebuild' instance 89f07150-d0ab-41c9-a9bf-692e9d9c5140 while it is in vm_state rescued {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:19:33.592970 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-98632264-e5c8-4996-9d13-9096f5139534 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "POST /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140/action" status: 409 len: 146 microversion: 2.1 time: 0.040652 Apr 16 21:19:33.593521 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1705/3541] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:19:33 2022] POST /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140/action => generated 146 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:19:33.600226 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fd6052ca-2b39-46e8-970a-08a8a913d600 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:33.601132 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fd6052ca-2b39-46e8-970a-08a8a913d600 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] [instance: 150835ec-2a90-46c5-8fe1-970a84f2e0cd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:33.602704 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f1f70e6b-74ac-4077-a706-83251a6a6e68 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:33.603332 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f1f70e6b-74ac-4077-a706-83251a6a6e68 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:33.607457 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fd6052ca-2b39-46e8-970a-08a8a913d600 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:33.607946 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fd6052ca-2b39-46e8-970a-08a8a913d600 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:33.608935 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fd6052ca-2b39-46e8-970a-08a8a913d600 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:33.609366 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fd6052ca-2b39-46e8-970a-08a8a913d600 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:33.609512 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f1f70e6b-74ac-4077-a706-83251a6a6e68 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:33.609958 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f1f70e6b-74ac-4077-a706-83251a6a6e68 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:33.610807 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f1f70e6b-74ac-4077-a706-83251a6a6e68 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:33.611264 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f1f70e6b-74ac-4077-a706-83251a6a6e68 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:33.637100 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f1f70e6b-74ac-4077-a706-83251a6a6e68 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:19:33.640463 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fd6052ca-2b39-46e8-970a-08a8a913d600 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] [instance: 150835ec-2a90-46c5-8fe1-970a84f2e0cd] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:19:33.956434 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f1f70e6b-74ac-4077-a706-83251a6a6e68 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09" status: 204 len: 0 microversion: 2.1 time: 0.357148 Apr 16 21:19:33.957005 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1706/3542] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:19:33 2022] DELETE /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 16 21:19:33.963236 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-02afbbf1-d232-47ae-b5d6-c1dbf35884b5 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:33.966536 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-02afbbf1-d232-47ae-b5d6-c1dbf35884b5 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] [instance: 3ea60a95-8b64-4410-a953-747f38619ffa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:33.971762 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-02afbbf1-d232-47ae-b5d6-c1dbf35884b5 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:33.972372 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-02afbbf1-d232-47ae-b5d6-c1dbf35884b5 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:33.973212 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-02afbbf1-d232-47ae-b5d6-c1dbf35884b5 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:33.973666 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-02afbbf1-d232-47ae-b5d6-c1dbf35884b5 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:34.070774 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fd6052ca-2b39-46e8-970a-08a8a913d600 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] 10.222.0.20 "DELETE /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd" status: 204 len: 0 microversion: 2.1 time: 0.475709 Apr 16 21:19:34.075994 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1837/3543] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:19:33 2022] DELETE /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 16 21:19:34.079897 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9146a5b7-a858-465d-bcd7-803593a818e4 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:34.080807 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9146a5b7-a858-465d-bcd7-803593a818e4 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:34.086811 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9146a5b7-a858-465d-bcd7-803593a818e4 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:34.087268 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9146a5b7-a858-465d-bcd7-803593a818e4 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:34.088109 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9146a5b7-a858-465d-bcd7-803593a818e4 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:34.088659 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9146a5b7-a858-465d-bcd7-803593a818e4 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:34.116783 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-02afbbf1-d232-47ae-b5d6-c1dbf35884b5 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495514ac1444f17b2b0fe5b8ba534b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cbfdc065da4c4b9f599d9cdd99496d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:34.125197 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-02afbbf1-d232-47ae-b5d6-c1dbf35884b5 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] 10.222.0.20 "GET /compute/v2.1/servers/3ea60a95-8b64-4410-a953-747f38619ffa" status: 200 len: 1508 microversion: 2.1 time: 0.166647 Apr 16 21:19:34.130606 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1707/3544] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:33 2022] GET /compute/v2.1/servers/3ea60a95-8b64-4410-a953-747f38619ffa => generated 1508 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:34.130606 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3e78b9a1-b873-4b7b-8efe-d7a4ff53a53d tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:34.131232 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3e78b9a1-b873-4b7b-8efe-d7a4ff53a53d tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:34.140668 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e78b9a1-b873-4b7b-8efe-d7a4ff53a53d tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:34.140668 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e78b9a1-b873-4b7b-8efe-d7a4ff53a53d tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:34.141626 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e78b9a1-b873-4b7b-8efe-d7a4ff53a53d tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:34.142181 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e78b9a1-b873-4b7b-8efe-d7a4ff53a53d tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:34.212394 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3e78b9a1-b873-4b7b-8efe-d7a4ff53a53d tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:34.224980 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3e78b9a1-b873-4b7b-8efe-d7a4ff53a53d tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 200 len: 1270 microversion: 2.1 time: 0.098037 Apr 16 21:19:34.226923 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1708/3545] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:34 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 1270 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:34.230873 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-eb52b56c-9c89-41df-8583-805714f08749 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:34.231592 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-eb52b56c-9c89-41df-8583-805714f08749 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] [instance: 150835ec-2a90-46c5-8fe1-970a84f2e0cd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:34.237748 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eb52b56c-9c89-41df-8583-805714f08749 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:34.238296 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eb52b56c-9c89-41df-8583-805714f08749 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:34.239234 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eb52b56c-9c89-41df-8583-805714f08749 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:34.239759 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eb52b56c-9c89-41df-8583-805714f08749 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:34.273256 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9146a5b7-a858-465d-bcd7-803593a818e4 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:34.282152 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9146a5b7-a858-465d-bcd7-803593a818e4 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09" status: 200 len: 1690 microversion: 2.1 time: 0.208550 Apr 16 21:19:34.298716 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1838/3546] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:34 2022] GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09 => generated 1690 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:34.388292 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-eb52b56c-9c89-41df-8583-805714f08749 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f6bbe8241a49c890032fb779c4bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc8f8d1fc734ce182645a464d35ead8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:34.395758 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-eb52b56c-9c89-41df-8583-805714f08749 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] 10.222.0.20 "GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd" status: 200 len: 1715 microversion: 2.1 time: 0.169051 Apr 16 21:19:34.396358 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1709/3547] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:34 2022] GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd => generated 1715 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:35.243197 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-752aa15a-9c3f-48f2-abc0-df65c54ebba4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:35.243776 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-752aa15a-9c3f-48f2-abc0-df65c54ebba4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:35.251018 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-752aa15a-9c3f-48f2-abc0-df65c54ebba4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:35.256271 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-752aa15a-9c3f-48f2-abc0-df65c54ebba4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:35.256271 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-752aa15a-9c3f-48f2-abc0-df65c54ebba4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:35.256271 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-752aa15a-9c3f-48f2-abc0-df65c54ebba4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:35.306248 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ae8df693-2e65-45b1-8ae5-372f1b12a6ed tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:35.306952 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ae8df693-2e65-45b1-8ae5-372f1b12a6ed tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:35.313907 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ae8df693-2e65-45b1-8ae5-372f1b12a6ed tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:35.315370 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ae8df693-2e65-45b1-8ae5-372f1b12a6ed tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:35.316303 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ae8df693-2e65-45b1-8ae5-372f1b12a6ed tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:35.316966 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ae8df693-2e65-45b1-8ae5-372f1b12a6ed tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:35.317437 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-752aa15a-9c3f-48f2-abc0-df65c54ebba4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:35.326240 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-752aa15a-9c3f-48f2-abc0-df65c54ebba4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 200 len: 1278 microversion: 2.1 time: 0.087567 Apr 16 21:19:35.326846 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1839/3548] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:35 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 1278 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:35.412695 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-14593af2-af99-4c32-9292-0fa89a8f060c tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:35.413312 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-14593af2-af99-4c32-9292-0fa89a8f060c tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] [instance: 150835ec-2a90-46c5-8fe1-970a84f2e0cd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:35.419258 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-14593af2-af99-4c32-9292-0fa89a8f060c tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:35.423749 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-14593af2-af99-4c32-9292-0fa89a8f060c tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:35.423749 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-14593af2-af99-4c32-9292-0fa89a8f060c tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:35.423749 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-14593af2-af99-4c32-9292-0fa89a8f060c tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:35.453898 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ae8df693-2e65-45b1-8ae5-372f1b12a6ed tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:35.463236 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ae8df693-2e65-45b1-8ae5-372f1b12a6ed tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09" status: 200 len: 1690 microversion: 2.1 time: 0.160932 Apr 16 21:19:35.464061 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1710/3549] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:35 2022] GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09 => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:19:35.566457 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-14593af2-af99-4c32-9292-0fa89a8f060c tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f6bbe8241a49c890032fb779c4bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc8f8d1fc734ce182645a464d35ead8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:35.574476 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-14593af2-af99-4c32-9292-0fa89a8f060c tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] 10.222.0.20 "GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd" status: 200 len: 1715 microversion: 2.1 time: 0.165651 Apr 16 21:19:35.575548 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1840/3550] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:35 2022] GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd => generated 1715 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:19:36.345063 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c25ff215-3d7d-4744-84ec-e0241ac7dfc3 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:36.346006 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c25ff215-3d7d-4744-84ec-e0241ac7dfc3 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:36.352568 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c25ff215-3d7d-4744-84ec-e0241ac7dfc3 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:36.353153 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c25ff215-3d7d-4744-84ec-e0241ac7dfc3 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:36.360411 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c25ff215-3d7d-4744-84ec-e0241ac7dfc3 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:36.360411 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c25ff215-3d7d-4744-84ec-e0241ac7dfc3 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:36.421229 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c25ff215-3d7d-4744-84ec-e0241ac7dfc3 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:36.428803 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c25ff215-3d7d-4744-84ec-e0241ac7dfc3 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 200 len: 1278 microversion: 2.1 time: 0.087796 Apr 16 21:19:36.429498 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1711/3551] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:36 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 1278 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:36.487912 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-dd9df58a-b0e2-4038-9241-92fcea930c53 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:36.488582 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-dd9df58a-b0e2-4038-9241-92fcea930c53 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:36.495242 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dd9df58a-b0e2-4038-9241-92fcea930c53 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:36.495703 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dd9df58a-b0e2-4038-9241-92fcea930c53 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:36.496527 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dd9df58a-b0e2-4038-9241-92fcea930c53 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:36.497008 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dd9df58a-b0e2-4038-9241-92fcea930c53 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:36.592784 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0d2d19cd-bb9e-43a2-841d-6d06af93f71e tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:36.595161 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0d2d19cd-bb9e-43a2-841d-6d06af93f71e tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] [instance: 150835ec-2a90-46c5-8fe1-970a84f2e0cd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:36.599434 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0d2d19cd-bb9e-43a2-841d-6d06af93f71e tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:36.599912 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0d2d19cd-bb9e-43a2-841d-6d06af93f71e tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:36.600715 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0d2d19cd-bb9e-43a2-841d-6d06af93f71e tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:36.601164 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0d2d19cd-bb9e-43a2-841d-6d06af93f71e tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:36.670021 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0d2d19cd-bb9e-43a2-841d-6d06af93f71e tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f6bbe8241a49c890032fb779c4bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc8f8d1fc734ce182645a464d35ead8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:36.674572 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0d2d19cd-bb9e-43a2-841d-6d06af93f71e tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] 10.222.0.20 "GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd" status: 200 len: 1648 microversion: 2.1 time: 0.085679 Apr 16 21:19:36.675653 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1712/3552] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:36 2022] GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd => generated 1648 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:19:36.906876 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cdc0667a-2e28-441c-b489-57bc0606b20f tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7abd27d9-5866-44e0-bd74-3021f6bf9989"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:19:36.908726 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-cdc0667a-2e28-441c-b489-57bc0606b20f tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] [instance: 3ea60a95-8b64-4410-a953-747f38619ffa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:36.915424 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cdc0667a-2e28-441c-b489-57bc0606b20f tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:36.916068 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cdc0667a-2e28-441c-b489-57bc0606b20f tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:36.916991 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cdc0667a-2e28-441c-b489-57bc0606b20f tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:36.917601 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cdc0667a-2e28-441c-b489-57bc0606b20f tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:37.016074 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-dd9df58a-b0e2-4038-9241-92fcea930c53 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:37.026656 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-dd9df58a-b0e2-4038-9241-92fcea930c53 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09" status: 200 len: 1690 microversion: 2.1 time: 0.544694 Apr 16 21:19:37.037242 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1841/3553] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:36 2022] GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09 => generated 1690 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:37.262498 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-a13ff497-4913-420a-a5ea-9820f5f012b3 req-a5f81c2c-9965-47db-a7fa-b93654e22f1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "150835ec-2a90-46c5-8fe1-970a84f2e0cd", "name": "network-vif-deleted", "tag": "0e7313ce-6b11-4893-959a-077cf629642f"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:19:37.286091 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-a13ff497-4913-420a-a5ea-9820f5f012b3 req-a5f81c2c-9965-47db-a7fa-b93654e22f1d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:37.286615 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-a13ff497-4913-420a-a5ea-9820f5f012b3 req-a5f81c2c-9965-47db-a7fa-b93654e22f1d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:37.300866 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-a13ff497-4913-420a-a5ea-9820f5f012b3 req-a5f81c2c-9965-47db-a7fa-b93654e22f1d service nova] Creating event network-vif-deleted:0e7313ce-6b11-4893-959a-077cf629642f for instance 150835ec-2a90-46c5-8fe1-970a84f2e0cd on nch2-master-1 Apr 16 21:19:37.306810 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-a13ff497-4913-420a-a5ea-9820f5f012b3 req-a5f81c2c-9965-47db-a7fa-b93654e22f1d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048541 Apr 16 21:19:37.308613 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1842/3554] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:19:37.448342 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-408d595c-b159-4bb6-bdac-03e65f93d6bf tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:37.449787 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-408d595c-b159-4bb6-bdac-03e65f93d6bf tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:37.477608 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-408d595c-b159-4bb6-bdac-03e65f93d6bf tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:37.482341 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-408d595c-b159-4bb6-bdac-03e65f93d6bf tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:37.487561 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-408d595c-b159-4bb6-bdac-03e65f93d6bf tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:37.490260 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-408d595c-b159-4bb6-bdac-03e65f93d6bf tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:37.576926 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-408d595c-b159-4bb6-bdac-03e65f93d6bf tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:37.590228 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-408d595c-b159-4bb6-bdac-03e65f93d6bf tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 200 len: 1276 microversion: 2.1 time: 0.148430 Apr 16 21:19:37.590937 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1843/3555] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:37 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 1276 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:37.694688 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b9f8f940-2b7e-4291-862f-c7de3e7b8ff0 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:37.695494 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b9f8f940-2b7e-4291-862f-c7de3e7b8ff0 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] [instance: 150835ec-2a90-46c5-8fe1-970a84f2e0cd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:37.705453 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b9f8f940-2b7e-4291-862f-c7de3e7b8ff0 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:37.706623 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b9f8f940-2b7e-4291-862f-c7de3e7b8ff0 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:37.710977 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b9f8f940-2b7e-4291-862f-c7de3e7b8ff0 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:37.710977 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b9f8f940-2b7e-4291-862f-c7de3e7b8ff0 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:37.746174 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b9f8f940-2b7e-4291-862f-c7de3e7b8ff0 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:37.746915 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b9f8f940-2b7e-4291-862f-c7de3e7b8ff0 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:37.747797 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-b9f8f940-2b7e-4291-862f-c7de3e7b8ff0 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lazy-loading 'fault' on Instance uuid 150835ec-2a90-46c5-8fe1-970a84f2e0cd {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:19:37.754094 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cdc0667a-2e28-441c-b489-57bc0606b20f tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] 10.222.0.20 "POST /compute/v2.1/servers/3ea60a95-8b64-4410-a953-747f38619ffa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.851238 Apr 16 21:19:37.757075 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1713/3556] 10.222.0.20 () {60 vars in 1322 bytes} [Sat Apr 16 21:19:36 2022] POST /compute/v2.1/servers/3ea60a95-8b64-4410-a953-747f38619ffa/os-volume_attachments => generated 194 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:19:37.812230 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b9f8f940-2b7e-4291-862f-c7de3e7b8ff0 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f0f6bbe8241a49c890032fb779c4bc13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3bc8f8d1fc734ce182645a464d35ead8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:37.825274 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b9f8f940-2b7e-4291-862f-c7de3e7b8ff0 tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] 10.222.0.20 "GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd" status: 200 len: 1368 microversion: 2.1 time: 0.136361 Apr 16 21:19:37.832005 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1844/3557] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:37 2022] GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd => generated 1368 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:38.045438 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d7d6bba8-4369-4ce5-860a-f80e6401e6a6 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:38.046159 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d7d6bba8-4369-4ce5-860a-f80e6401e6a6 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:38.057600 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d7d6bba8-4369-4ce5-860a-f80e6401e6a6 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:38.058082 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d7d6bba8-4369-4ce5-860a-f80e6401e6a6 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:38.058892 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d7d6bba8-4369-4ce5-860a-f80e6401e6a6 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:38.059353 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d7d6bba8-4369-4ce5-860a-f80e6401e6a6 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:38.193941 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d7d6bba8-4369-4ce5-860a-f80e6401e6a6 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:38.226712 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d7d6bba8-4369-4ce5-860a-f80e6401e6a6 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09" status: 200 len: 1623 microversion: 2.1 time: 0.185190 Apr 16 21:19:38.228459 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1714/3558] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:38 2022] GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09 => generated 1623 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:38.607183 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a8a01b01-99b5-4233-8beb-b3ca851f395f tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:38.607807 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a8a01b01-99b5-4233-8beb-b3ca851f395f tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:38.615460 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a8a01b01-99b5-4233-8beb-b3ca851f395f tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:38.619853 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a8a01b01-99b5-4233-8beb-b3ca851f395f tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:38.621448 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a8a01b01-99b5-4233-8beb-b3ca851f395f tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:38.621911 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a8a01b01-99b5-4233-8beb-b3ca851f395f tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:38.847590 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e3919c81-a423-4405-bda8-90396b5cd04a tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:38.848847 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e3919c81-a423-4405-bda8-90396b5cd04a tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] [instance: 150835ec-2a90-46c5-8fe1-970a84f2e0cd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:38.860433 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e3919c81-a423-4405-bda8-90396b5cd04a tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:38.884199 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e3919c81-a423-4405-bda8-90396b5cd04a tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:38.885628 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e3919c81-a423-4405-bda8-90396b5cd04a tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:38.892028 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e3919c81-a423-4405-bda8-90396b5cd04a tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:38.908327 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a8a01b01-99b5-4233-8beb-b3ca851f395f tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:38.922927 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a8a01b01-99b5-4233-8beb-b3ca851f395f tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 200 len: 1318 microversion: 2.1 time: 0.319285 Apr 16 21:19:38.925640 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-e3919c81-a423-4405-bda8-90396b5cd04a tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] HTTP exception thrown: Instance 150835ec-2a90-46c5-8fe1-970a84f2e0cd could not be found. Apr 16 21:19:38.933318 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e3919c81-a423-4405-bda8-90396b5cd04a tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Returning 404 to user: Instance 150835ec-2a90-46c5-8fe1-970a84f2e0cd could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:19:38.935272 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e3919c81-a423-4405-bda8-90396b5cd04a tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] 10.222.0.20 "GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd" status: 404 len: 111 microversion: 2.1 time: 0.092230 Apr 16 21:19:38.935932 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1845/3559] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:38 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 1318 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:38.937457 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1715/3560] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:38 2022] GET /compute/v2.1/servers/150835ec-2a90-46c5-8fe1-970a84f2e0cd => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:19:38.951931 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-dd42ddbe-88d3-4dc4-ab87-36c5b96ad003 req-383193e7-80b2-4a78-9425-af406fea8b4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c7cd9df-57f3-47a6-aa40-76ee208e2c09", "name": "network-vif-deleted", "tag": "b83812ef-1c6d-4509-9af6-301ec0cf5b84"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:19:38.971646 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8cbb829f-6978-4ced-8b3c-a6560a5f4a3e tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] Calling method '.version_select at 0x7fbb9c0ca700>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:38.979908 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-dd42ddbe-88d3-4dc4-ab87-36c5b96ad003 req-383193e7-80b2-4a78-9425-af406fea8b4f service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:38.980407 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-dd42ddbe-88d3-4dc4-ab87-36c5b96ad003 req-383193e7-80b2-4a78-9425-af406fea8b4f service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:39.014589 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-dd42ddbe-88d3-4dc4-ab87-36c5b96ad003 req-383193e7-80b2-4a78-9425-af406fea8b4f service nova] Creating event network-vif-deleted:b83812ef-1c6d-4509-9af6-301ec0cf5b84 for instance 8c7cd9df-57f3-47a6-aa40-76ee208e2c09 on nch1-master-1 Apr 16 21:19:39.019994 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-dd42ddbe-88d3-4dc4-ab87-36c5b96ad003 req-383193e7-80b2-4a78-9425-af406fea8b4f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071548 Apr 16 21:19:39.020724 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1716/3561] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:19:39.129477 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8cbb829f-6978-4ced-8b3c-a6560a5f4a3e tempest-ServersTestManualDisk-85619298 tempest-ServersTestManualDisk-85619298-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1579756113" status: 202 len: 0 microversion: 2.1 time: 0.165509 Apr 16 21:19:39.133374 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1846/3562] 10.222.0.20 () {58 vars in 1220 bytes} [Sat Apr 16 21:19:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1579756113 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:19:39.245558 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-aee16582-7455-4514-b8ab-81d47c75833c tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:39.246415 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-aee16582-7455-4514-b8ab-81d47c75833c tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:39.258293 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aee16582-7455-4514-b8ab-81d47c75833c tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:39.260276 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aee16582-7455-4514-b8ab-81d47c75833c tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:39.261255 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aee16582-7455-4514-b8ab-81d47c75833c tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:39.262666 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aee16582-7455-4514-b8ab-81d47c75833c tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:39.554067 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-aee16582-7455-4514-b8ab-81d47c75833c tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:39.582368 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-aee16582-7455-4514-b8ab-81d47c75833c tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09" status: 200 len: 1331 microversion: 2.1 time: 0.339713 Apr 16 21:19:39.583285 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1717/3563] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:39 2022] GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09 => generated 1331 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:39.942531 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-882fb7be-ca67-486d-b0a8-2706ee7cf5e6 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:39.943398 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-882fb7be-ca67-486d-b0a8-2706ee7cf5e6 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:39.967089 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-882fb7be-ca67-486d-b0a8-2706ee7cf5e6 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:39.967586 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-882fb7be-ca67-486d-b0a8-2706ee7cf5e6 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:39.968437 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-882fb7be-ca67-486d-b0a8-2706ee7cf5e6 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:39.969065 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-882fb7be-ca67-486d-b0a8-2706ee7cf5e6 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:40.294291 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-882fb7be-ca67-486d-b0a8-2706ee7cf5e6 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:40.305447 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-882fb7be-ca67-486d-b0a8-2706ee7cf5e6 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 200 len: 1318 microversion: 2.1 time: 0.368433 Apr 16 21:19:40.307122 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1847/3564] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:39 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 1318 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:40.604656 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-037979c2-6fda-4378-8a02-bdf8964f60a6 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:40.605917 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-037979c2-6fda-4378-8a02-bdf8964f60a6 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 8c7cd9df-57f3-47a6-aa40-76ee208e2c09] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:40.613329 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-037979c2-6fda-4378-8a02-bdf8964f60a6 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:40.613789 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-037979c2-6fda-4378-8a02-bdf8964f60a6 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:40.615350 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-037979c2-6fda-4378-8a02-bdf8964f60a6 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:40.615866 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-037979c2-6fda-4378-8a02-bdf8964f60a6 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:40.639762 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-037979c2-6fda-4378-8a02-bdf8964f60a6 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] HTTP exception thrown: Instance 8c7cd9df-57f3-47a6-aa40-76ee208e2c09 could not be found. Apr 16 21:19:40.640798 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-037979c2-6fda-4378-8a02-bdf8964f60a6 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Returning 404 to user: Instance 8c7cd9df-57f3-47a6-aa40-76ee208e2c09 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:19:40.642105 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-037979c2-6fda-4378-8a02-bdf8964f60a6 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09" status: 404 len: 111 microversion: 2.1 time: 0.041847 Apr 16 21:19:40.646790 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1718/3565] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:40 2022] GET /compute/v2.1/servers/8c7cd9df-57f3-47a6-aa40-76ee208e2c09 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:19:40.653064 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5c17bcd8-c62b-43f3-a3cb-5cd498e34f75 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '.version_select at 0x7fbb9c0ca0d0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:40.752373 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5c17bcd8-c62b-43f3-a3cb-5cd498e34f75 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1637182820" status: 202 len: 0 microversion: 2.1 time: 0.103960 Apr 16 21:19:40.753460 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1848/3566] 10.222.0.20 () {58 vars in 1220 bytes} [Sat Apr 16 21:19:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1637182820 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:19:41.110225 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-e97f72a3-748a-4249-9326-a4b1554cf279 req-39bf9c76-a561-4eb8-99c0-33df27ea7fab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b0c963a-7042-4bca-9d87-6b90beed5f18", "tag": "afda655b-bf23-4e30-b6df-18f670dcee9f"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:19:41.123971 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-e97f72a3-748a-4249-9326-a4b1554cf279 req-39bf9c76-a561-4eb8-99c0-33df27ea7fab service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:41.125157 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-e97f72a3-748a-4249-9326-a4b1554cf279 req-39bf9c76-a561-4eb8-99c0-33df27ea7fab service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:41.139885 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-e97f72a3-748a-4249-9326-a4b1554cf279 req-39bf9c76-a561-4eb8-99c0-33df27ea7fab service nova] Creating event network-changed:afda655b-bf23-4e30-b6df-18f670dcee9f for instance 6b0c963a-7042-4bca-9d87-6b90beed5f18 on nch1-master-1 Apr 16 21:19:41.146438 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-e97f72a3-748a-4249-9326-a4b1554cf279 req-39bf9c76-a561-4eb8-99c0-33df27ea7fab service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041188 Apr 16 21:19:41.147626 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1719/3567] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:19:41.324848 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-062bd431-90dc-418d-ad27-7bc809e62ef5 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:41.326346 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-062bd431-90dc-418d-ad27-7bc809e62ef5 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:41.336058 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-062bd431-90dc-418d-ad27-7bc809e62ef5 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:41.336817 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-062bd431-90dc-418d-ad27-7bc809e62ef5 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:41.347710 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-062bd431-90dc-418d-ad27-7bc809e62ef5 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:41.348529 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-062bd431-90dc-418d-ad27-7bc809e62ef5 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:41.613634 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-062bd431-90dc-418d-ad27-7bc809e62ef5 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:41.629861 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-062bd431-90dc-418d-ad27-7bc809e62ef5 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 200 len: 1318 microversion: 2.1 time: 0.310677 Apr 16 21:19:41.642631 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1849/3568] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:41 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 1318 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:42.535562 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e5395c7e-18f8-4c66-8a5e-b9d9f1617760 tempest-VolumesAdminNegativeTest-2062402325 tempest-VolumesAdminNegativeTest-2062402325-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "9ac4a53e-ea07-424e-90ad-197eceed5314"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:19:42.537105 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e5395c7e-18f8-4c66-8a5e-b9d9f1617760 tempest-VolumesAdminNegativeTest-2062402325 tempest-VolumesAdminNegativeTest-2062402325-project-admin] [instance: 3ea60a95-8b64-4410-a953-747f38619ffa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:42.545056 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e5395c7e-18f8-4c66-8a5e-b9d9f1617760 tempest-VolumesAdminNegativeTest-2062402325 tempest-VolumesAdminNegativeTest-2062402325-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:42.545615 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e5395c7e-18f8-4c66-8a5e-b9d9f1617760 tempest-VolumesAdminNegativeTest-2062402325 tempest-VolumesAdminNegativeTest-2062402325-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:42.546554 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e5395c7e-18f8-4c66-8a5e-b9d9f1617760 tempest-VolumesAdminNegativeTest-2062402325 tempest-VolumesAdminNegativeTest-2062402325-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:42.547105 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e5395c7e-18f8-4c66-8a5e-b9d9f1617760 tempest-VolumesAdminNegativeTest-2062402325 tempest-VolumesAdminNegativeTest-2062402325-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:42.648326 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-07cf7795-9dfb-47b5-8228-305af23d0bb5 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:42.651032 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-07cf7795-9dfb-47b5-8228-305af23d0bb5 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:42.659740 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-07cf7795-9dfb-47b5-8228-305af23d0bb5 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:42.660975 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-07cf7795-9dfb-47b5-8228-305af23d0bb5 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:42.662054 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-07cf7795-9dfb-47b5-8228-305af23d0bb5 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:42.662881 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-07cf7795-9dfb-47b5-8228-305af23d0bb5 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:42.666085 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-e5395c7e-18f8-4c66-8a5e-b9d9f1617760 tempest-VolumesAdminNegativeTest-2062402325 tempest-VolumesAdminNegativeTest-2062402325-project-admin] HTTP exception thrown: Volume 9ac4a53e-ea07-424e-90ad-197eceed5314 could not be found. Apr 16 21:19:42.666767 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e5395c7e-18f8-4c66-8a5e-b9d9f1617760 tempest-VolumesAdminNegativeTest-2062402325 tempest-VolumesAdminNegativeTest-2062402325-project-admin] Returning 400 to user: Volume 9ac4a53e-ea07-424e-90ad-197eceed5314 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:19:42.671636 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e5395c7e-18f8-4c66-8a5e-b9d9f1617760 tempest-VolumesAdminNegativeTest-2062402325 tempest-VolumesAdminNegativeTest-2062402325-project-admin] 10.222.0.20 "PUT /compute/v2.1/servers/3ea60a95-8b64-4410-a953-747f38619ffa/os-volume_attachments/7abd27d9-5866-44e0-bd74-3021f6bf9989" status: 400 len: 107 microversion: 2.1 time: 0.344444 Apr 16 21:19:42.671636 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1720/3569] 10.222.0.20 () {60 vars in 1432 bytes} [Sat Apr 16 21:19:42 2022] PUT /compute/v2.1/servers/3ea60a95-8b64-4410-a953-747f38619ffa/os-volume_attachments/7abd27d9-5866-44e0-bd74-3021f6bf9989 => generated 107 bytes in 346 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:19:42.747048 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ee51cea8-bcaf-440a-9089-859b0ab67329 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:42.749685 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ee51cea8-bcaf-440a-9089-859b0ab67329 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] [instance: 3ea60a95-8b64-4410-a953-747f38619ffa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:42.755168 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ee51cea8-bcaf-440a-9089-859b0ab67329 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:42.755800 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ee51cea8-bcaf-440a-9089-859b0ab67329 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:42.756746 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ee51cea8-bcaf-440a-9089-859b0ab67329 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:42.757301 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ee51cea8-bcaf-440a-9089-859b0ab67329 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:42.861597 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-ee51cea8-bcaf-440a-9089-859b0ab67329 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lazy-loading 'services' on Instance uuid 3ea60a95-8b64-4410-a953-747f38619ffa {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:19:42.888818 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-07cf7795-9dfb-47b5-8228-305af23d0bb5 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:42.902031 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-07cf7795-9dfb-47b5-8228-305af23d0bb5 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 200 len: 1318 microversion: 2.1 time: 0.254440 Apr 16 21:19:42.902813 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1850/3570] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:42 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 1318 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:43.115732 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ee51cea8-bcaf-440a-9089-859b0ab67329 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3ea60a95-8b64-4410-a953-747f38619ffa/os-volume_attachments/7abd27d9-5866-44e0-bd74-3021f6bf9989" status: 202 len: 0 microversion: 2.1 time: 0.372787 Apr 16 21:19:43.117015 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1721/3571] 10.222.0.20 () {58 vars in 1415 bytes} [Sat Apr 16 21:19:42 2022] DELETE /compute/v2.1/servers/3ea60a95-8b64-4410-a953-747f38619ffa/os-volume_attachments/7abd27d9-5866-44e0-bd74-3021f6bf9989 => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:19:43.126766 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9ecc2a1d-a39b-4fc4-890a-18e799b4fdbb tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:43.128003 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9ecc2a1d-a39b-4fc4-890a-18e799b4fdbb tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] [instance: 3ea60a95-8b64-4410-a953-747f38619ffa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:43.140397 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9ecc2a1d-a39b-4fc4-890a-18e799b4fdbb tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:43.140397 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9ecc2a1d-a39b-4fc4-890a-18e799b4fdbb tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:43.140397 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9ecc2a1d-a39b-4fc4-890a-18e799b4fdbb tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:43.140397 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9ecc2a1d-a39b-4fc4-890a-18e799b4fdbb tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:43.171018 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9ecc2a1d-a39b-4fc4-890a-18e799b4fdbb tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] 10.222.0.20 "GET /compute/v2.1/servers/3ea60a95-8b64-4410-a953-747f38619ffa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049163 Apr 16 21:19:43.172265 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1851/3572] 10.222.0.20 () {58 vars in 1301 bytes} [Sat Apr 16 21:19:43 2022] GET /compute/v2.1/servers/3ea60a95-8b64-4410-a953-747f38619ffa/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:19:43.920084 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9fcd6695-0622-4211-ad6a-85e3bab8b60e tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:43.924140 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9fcd6695-0622-4211-ad6a-85e3bab8b60e tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:43.937816 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9fcd6695-0622-4211-ad6a-85e3bab8b60e tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:43.938293 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9fcd6695-0622-4211-ad6a-85e3bab8b60e tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:43.939087 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9fcd6695-0622-4211-ad6a-85e3bab8b60e tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:43.939532 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9fcd6695-0622-4211-ad6a-85e3bab8b60e tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:44.189923 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-65e874d7-a4b1-4908-934c-6d3a1a7b1945 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:44.191877 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-65e874d7-a4b1-4908-934c-6d3a1a7b1945 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] [instance: 3ea60a95-8b64-4410-a953-747f38619ffa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:44.202527 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-65e874d7-a4b1-4908-934c-6d3a1a7b1945 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:44.203091 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-65e874d7-a4b1-4908-934c-6d3a1a7b1945 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:44.204006 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-65e874d7-a4b1-4908-934c-6d3a1a7b1945 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:44.205058 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-65e874d7-a4b1-4908-934c-6d3a1a7b1945 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:44.241011 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-65e874d7-a4b1-4908-934c-6d3a1a7b1945 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] 10.222.0.20 "GET /compute/v2.1/servers/3ea60a95-8b64-4410-a953-747f38619ffa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061466 Apr 16 21:19:44.241700 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1852/3573] 10.222.0.20 () {58 vars in 1301 bytes} [Sat Apr 16 21:19:44 2022] GET /compute/v2.1/servers/3ea60a95-8b64-4410-a953-747f38619ffa/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:19:44.300048 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9fcd6695-0622-4211-ad6a-85e3bab8b60e tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:44.307741 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9fcd6695-0622-4211-ad6a-85e3bab8b60e tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 200 len: 1318 microversion: 2.1 time: 0.392159 Apr 16 21:19:44.308716 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1722/3574] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:43 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 1318 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:45.276254 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-47e306c9-0ca5-4485-8d2a-2db5e6df987a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:45.276896 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-47e306c9-0ca5-4485-8d2a-2db5e6df987a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:45.285880 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-47e306c9-0ca5-4485-8d2a-2db5e6df987a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:45.286345 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-47e306c9-0ca5-4485-8d2a-2db5e6df987a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:45.289477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-47e306c9-0ca5-4485-8d2a-2db5e6df987a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:45.290132 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-47e306c9-0ca5-4485-8d2a-2db5e6df987a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:45.328344 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-821755df-a7e7-4673-a3fa-989eb5b95034 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:45.329302 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-821755df-a7e7-4673-a3fa-989eb5b95034 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:45.337692 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-821755df-a7e7-4673-a3fa-989eb5b95034 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:45.338417 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-821755df-a7e7-4673-a3fa-989eb5b95034 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:45.339789 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-821755df-a7e7-4673-a3fa-989eb5b95034 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:45.340507 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-821755df-a7e7-4673-a3fa-989eb5b95034 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:45.456290 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-47e306c9-0ca5-4485-8d2a-2db5e6df987a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:45.467484 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-47e306c9-0ca5-4485-8d2a-2db5e6df987a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.201019 Apr 16 21:19:45.468079 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1853/3575] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:45 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:19:45.489091 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f40811e7-78ff-42cc-9950-0d5f8aaab79f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:45.490014 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f40811e7-78ff-42cc-9950-0d5f8aaab79f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:45.497269 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f40811e7-78ff-42cc-9950-0d5f8aaab79f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:45.497949 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f40811e7-78ff-42cc-9950-0d5f8aaab79f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:45.498892 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f40811e7-78ff-42cc-9950-0d5f8aaab79f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:45.499475 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f40811e7-78ff-42cc-9950-0d5f8aaab79f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:45.563244 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-821755df-a7e7-4673-a3fa-989eb5b95034 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:45.567136 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-821755df-a7e7-4673-a3fa-989eb5b95034 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 200 len: 1318 microversion: 2.1 time: 0.245908 Apr 16 21:19:45.567719 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1723/3576] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:45 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:45.642051 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f40811e7-78ff-42cc-9950-0d5f8aaab79f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:45.650442 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f40811e7-78ff-42cc-9950-0d5f8aaab79f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.164457 Apr 16 21:19:45.651023 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1854/3577] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:45 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:45.666954 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f075c4db-8e44-4a50-8712-8aa6349b500a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:45.667668 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f075c4db-8e44-4a50-8712-8aa6349b500a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:45.674167 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f075c4db-8e44-4a50-8712-8aa6349b500a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:45.674854 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f075c4db-8e44-4a50-8712-8aa6349b500a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:45.675810 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f075c4db-8e44-4a50-8712-8aa6349b500a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:45.676291 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f075c4db-8e44-4a50-8712-8aa6349b500a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:45.824890 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f075c4db-8e44-4a50-8712-8aa6349b500a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:45.832260 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f075c4db-8e44-4a50-8712-8aa6349b500a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.169659 Apr 16 21:19:45.832825 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1724/3578] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:45 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:45.849029 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8b92d689-bba4-4174-90e2-42734266892c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:45.849645 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8b92d689-bba4-4174-90e2-42734266892c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:45.856149 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8b92d689-bba4-4174-90e2-42734266892c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:45.856712 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8b92d689-bba4-4174-90e2-42734266892c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:45.857491 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8b92d689-bba4-4174-90e2-42734266892c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:45.857934 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8b92d689-bba4-4174-90e2-42734266892c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:46.008830 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8b92d689-bba4-4174-90e2-42734266892c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:46.017731 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8b92d689-bba4-4174-90e2-42734266892c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.173116 Apr 16 21:19:46.018317 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1855/3579] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:45 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:46.236039 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-c9f7326b-eced-4249-b1db-f18431959818 req-8bcddb04-4fa8-403b-a21c-ae4c6e6794d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b0c963a-7042-4bca-9d87-6b90beed5f18", "name": "network-vif-plugged", "status": "completed", "tag": "afda655b-bf23-4e30-b6df-18f670dcee9f"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:19:46.236613 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-55943a17-0f73-4249-83f1-e24be9584740 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1327070577", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "f9e642b5-0144-4768-b572-192069e5751e"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:19:46.254042 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-c9f7326b-eced-4249-b1db-f18431959818 req-8bcddb04-4fa8-403b-a21c-ae4c6e6794d3 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:46.256579 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-c9f7326b-eced-4249-b1db-f18431959818 req-8bcddb04-4fa8-403b-a21c-ae4c6e6794d3 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:46.276766 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-c9f7326b-eced-4249-b1db-f18431959818 req-8bcddb04-4fa8-403b-a21c-ae4c6e6794d3 service nova] Creating event network-vif-plugged:afda655b-bf23-4e30-b6df-18f670dcee9f for instance 6b0c963a-7042-4bca-9d87-6b90beed5f18 on nch1-master-1 Apr 16 21:19:46.284077 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-c9f7326b-eced-4249-b1db-f18431959818 req-8bcddb04-4fa8-403b-a21c-ae4c6e6794d3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063268 Apr 16 21:19:46.285058 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1725/3580] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:19:46.322670 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-55943a17-0f73-4249-83f1-e24be9584740 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] validate_networks() for [('f9e642b5-0144-4768-b572-192069e5751e', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:19:46.591499 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e1ad86f7-30ee-4ade-985a-207cd77de92e tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:46.593669 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e1ad86f7-30ee-4ade-985a-207cd77de92e tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:46.608389 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e1ad86f7-30ee-4ade-985a-207cd77de92e tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:46.610555 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e1ad86f7-30ee-4ade-985a-207cd77de92e tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:46.611991 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e1ad86f7-30ee-4ade-985a-207cd77de92e tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:46.613368 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e1ad86f7-30ee-4ade-985a-207cd77de92e tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:46.760757 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-55943a17-0f73-4249-83f1-e24be9584740 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:19:46.761365 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-55943a17-0f73-4249-83f1-e24be9584740 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:19:46.761867 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-55943a17-0f73-4249-83f1-e24be9584740 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:19:46.762309 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-55943a17-0f73-4249-83f1-e24be9584740 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:19:46.762735 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-55943a17-0f73-4249-83f1-e24be9584740 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:19:46.772292 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-55943a17-0f73-4249-83f1-e24be9584740 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:46.772928 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-55943a17-0f73-4249-83f1-e24be9584740 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:46.773759 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-55943a17-0f73-4249-83f1-e24be9584740 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:46.774273 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-55943a17-0f73-4249-83f1-e24be9584740 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:46.797887 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-55943a17-0f73-4249-83f1-e24be9584740 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Getting quotas for project ceac90e6c7024b4ea350bfa95e1b5249. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:19:46.803349 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-55943a17-0f73-4249-83f1-e24be9584740 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Getting quotas for user 6bb1c0cdf6274f118ebbe97829ddad65 and project ceac90e6c7024b4ea350bfa95e1b5249. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:19:46.817551 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-55943a17-0f73-4249-83f1-e24be9584740 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:19:46.820996 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-55943a17-0f73-4249-83f1-e24be9584740 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 1b86bdab-b733-4af5-b2a7-c997869b690c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:19:46.870083 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e1ad86f7-30ee-4ade-985a-207cd77de92e tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:46.877920 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e1ad86f7-30ee-4ade-985a-207cd77de92e tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 200 len: 1318 microversion: 2.1 time: 0.297384 Apr 16 21:19:46.878612 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1726/3581] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:46 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 1318 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:19:46.954943 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1d66204e-c6cc-42d3-8af1-428d0c25342e tempest-VolumesAdminNegativeTest-2062402325 tempest-VolumesAdminNegativeTest-2062402325-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "904b1c55-3b2a-45e4-bc6c-e20877b1f4f9"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:19:46.955988 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1d66204e-c6cc-42d3-8af1-428d0c25342e tempest-VolumesAdminNegativeTest-2062402325 tempest-VolumesAdminNegativeTest-2062402325-project-admin] [instance: 3ea60a95-8b64-4410-a953-747f38619ffa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:46.962279 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1d66204e-c6cc-42d3-8af1-428d0c25342e tempest-VolumesAdminNegativeTest-2062402325 tempest-VolumesAdminNegativeTest-2062402325-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:46.963268 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1d66204e-c6cc-42d3-8af1-428d0c25342e tempest-VolumesAdminNegativeTest-2062402325 tempest-VolumesAdminNegativeTest-2062402325-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:46.964060 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1d66204e-c6cc-42d3-8af1-428d0c25342e tempest-VolumesAdminNegativeTest-2062402325 tempest-VolumesAdminNegativeTest-2062402325-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:46.964711 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1d66204e-c6cc-42d3-8af1-428d0c25342e tempest-VolumesAdminNegativeTest-2062402325 tempest-VolumesAdminNegativeTest-2062402325-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:46.997959 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-55943a17-0f73-4249-83f1-e24be9584740 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.768147 Apr 16 21:19:46.999217 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1856/3582] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:19:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:19:47.012577 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2b8db3e4-8e2a-47c0-b3b3-7640a49a7cb4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:47.013150 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2b8db3e4-8e2a-47c0-b3b3-7640a49a7cb4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 1b86bdab-b733-4af5-b2a7-c997869b690c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:47.043320 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-1d66204e-c6cc-42d3-8af1-428d0c25342e tempest-VolumesAdminNegativeTest-2062402325 tempest-VolumesAdminNegativeTest-2062402325-project-admin] HTTP exception thrown: Volume 5835c00d-8690-4a86-bd50-1bd01909cffd could not be found. Apr 16 21:19:47.045933 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1d66204e-c6cc-42d3-8af1-428d0c25342e tempest-VolumesAdminNegativeTest-2062402325 tempest-VolumesAdminNegativeTest-2062402325-project-admin] Returning 404 to user: Volume 5835c00d-8690-4a86-bd50-1bd01909cffd could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:19:47.047848 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1d66204e-c6cc-42d3-8af1-428d0c25342e tempest-VolumesAdminNegativeTest-2062402325 tempest-VolumesAdminNegativeTest-2062402325-project-admin] 10.222.0.20 "PUT /compute/v2.1/servers/3ea60a95-8b64-4410-a953-747f38619ffa/os-volume_attachments/5835c00d-8690-4a86-bd50-1bd01909cffd" status: 404 len: 109 microversion: 2.1 time: 0.096783 Apr 16 21:19:47.048845 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1727/3583] 10.222.0.20 () {60 vars in 1432 bytes} [Sat Apr 16 21:19:46 2022] PUT /compute/v2.1/servers/3ea60a95-8b64-4410-a953-747f38619ffa/os-volume_attachments/5835c00d-8690-4a86-bd50-1bd01909cffd => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:19:47.110657 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2b8db3e4-8e2a-47c0-b3b3-7640a49a7cb4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:47.132851 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2b8db3e4-8e2a-47c0-b3b3-7640a49a7cb4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/1b86bdab-b733-4af5-b2a7-c997869b690c" status: 200 len: 1215 microversion: 2.1 time: 0.125876 Apr 16 21:19:47.135350 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1857/3584] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:47 2022] GET /compute/v2.1/servers/1b86bdab-b733-4af5-b2a7-c997869b690c => generated 1215 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:19:47.898585 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0ce85043-126c-42e6-8b2d-b525bc3aabc2 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:47.899766 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0ce85043-126c-42e6-8b2d-b525bc3aabc2 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:47.908515 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0ce85043-126c-42e6-8b2d-b525bc3aabc2 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:47.909102 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0ce85043-126c-42e6-8b2d-b525bc3aabc2 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:47.909941 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0ce85043-126c-42e6-8b2d-b525bc3aabc2 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:47.910385 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0ce85043-126c-42e6-8b2d-b525bc3aabc2 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:48.054105 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0ce85043-126c-42e6-8b2d-b525bc3aabc2 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:48.064815 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0ce85043-126c-42e6-8b2d-b525bc3aabc2 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 200 len: 1318 microversion: 2.1 time: 0.173814 Apr 16 21:19:48.067617 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1728/3585] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:47 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:48.154777 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-69532751-1926-4efb-831a-889b9dcdef33 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:48.155960 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-69532751-1926-4efb-831a-889b9dcdef33 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 1b86bdab-b733-4af5-b2a7-c997869b690c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:48.166436 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-69532751-1926-4efb-831a-889b9dcdef33 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:48.168125 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-69532751-1926-4efb-831a-889b9dcdef33 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:48.168566 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-69532751-1926-4efb-831a-889b9dcdef33 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:48.169263 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-69532751-1926-4efb-831a-889b9dcdef33 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:48.248714 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-69532751-1926-4efb-831a-889b9dcdef33 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:48.261076 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-69532751-1926-4efb-831a-889b9dcdef33 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/1b86bdab-b733-4af5-b2a7-c997869b690c" status: 200 len: 1219 microversion: 2.1 time: 0.111605 Apr 16 21:19:48.262030 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1858/3586] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:48 2022] GET /compute/v2.1/servers/1b86bdab-b733-4af5-b2a7-c997869b690c => generated 1219 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:49.089755 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e9908047-18b1-4757-a723-59135ce38c03 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:49.102071 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e9908047-18b1-4757-a723-59135ce38c03 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:49.114152 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e9908047-18b1-4757-a723-59135ce38c03 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:49.121353 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e9908047-18b1-4757-a723-59135ce38c03 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:49.131486 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e9908047-18b1-4757-a723-59135ce38c03 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:49.133016 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e9908047-18b1-4757-a723-59135ce38c03 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:49.282236 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2ef68870-e4cf-455a-9306-1bf7e3d27c2a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:49.283422 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2ef68870-e4cf-455a-9306-1bf7e3d27c2a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 1b86bdab-b733-4af5-b2a7-c997869b690c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:49.295022 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2ef68870-e4cf-455a-9306-1bf7e3d27c2a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:49.297525 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2ef68870-e4cf-455a-9306-1bf7e3d27c2a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:49.300378 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2ef68870-e4cf-455a-9306-1bf7e3d27c2a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:49.307647 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2ef68870-e4cf-455a-9306-1bf7e3d27c2a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:49.363286 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e9908047-18b1-4757-a723-59135ce38c03 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:49.374548 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e9908047-18b1-4757-a723-59135ce38c03 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 200 len: 1509 microversion: 2.1 time: 0.293370 Apr 16 21:19:49.375521 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1729/3587] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:49 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 1509 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:49.404900 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-aee34c3c-fb88-45e1-95e3-b8c6685b5222 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:49.406398 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-aee34c3c-fb88-45e1-95e3-b8c6685b5222 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:49.413797 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aee34c3c-fb88-45e1-95e3-b8c6685b5222 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:49.414341 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aee34c3c-fb88-45e1-95e3-b8c6685b5222 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:49.416275 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aee34c3c-fb88-45e1-95e3-b8c6685b5222 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:49.416870 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aee34c3c-fb88-45e1-95e3-b8c6685b5222 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:49.442338 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2ef68870-e4cf-455a-9306-1bf7e3d27c2a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:49.450202 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2ef68870-e4cf-455a-9306-1bf7e3d27c2a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/1b86bdab-b733-4af5-b2a7-c997869b690c" status: 200 len: 1267 microversion: 2.1 time: 0.175735 Apr 16 21:19:49.452445 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1859/3588] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:49 2022] GET /compute/v2.1/servers/1b86bdab-b733-4af5-b2a7-c997869b690c => generated 1267 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:49.596108 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-aee34c3c-fb88-45e1-95e3-b8c6685b5222 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:49.606600 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-aee34c3c-fb88-45e1-95e3-b8c6685b5222 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 200 len: 1509 microversion: 2.1 time: 0.207401 Apr 16 21:19:49.607853 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1730/3589] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:49 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 1509 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:49.624845 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e12b2361-2fa8-46ca-9f57-5210779b49a1 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "OS-DCF:diskConfig": "AUTO"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:19:49.626749 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e12b2361-2fa8-46ca-9f57-5210779b49a1 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:49.636887 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e12b2361-2fa8-46ca-9f57-5210779b49a1 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:49.638360 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e12b2361-2fa8-46ca-9f57-5210779b49a1 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:49.640746 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e12b2361-2fa8-46ca-9f57-5210779b49a1 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:49.641401 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e12b2361-2fa8-46ca-9f57-5210779b49a1 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:49.751247 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-e12b2361-2fa8-46ca-9f57-5210779b49a1 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:19:49.752046 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-e12b2361-2fa8-46ca-9f57-5210779b49a1 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:19:49.752712 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-e12b2361-2fa8-46ca-9f57-5210779b49a1 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:19:49.757982 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-e12b2361-2fa8-46ca-9f57-5210779b49a1 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:19:49.757982 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-e12b2361-2fa8-46ca-9f57-5210779b49a1 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:19:49.980229 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e12b2361-2fa8-46ca-9f57-5210779b49a1 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:49.993065 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e12b2361-2fa8-46ca-9f57-5210779b49a1 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:49.995268 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e12b2361-2fa8-46ca-9f57-5210779b49a1 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:49.996563 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e12b2361-2fa8-46ca-9f57-5210779b49a1 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:49.997174 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e12b2361-2fa8-46ca-9f57-5210779b49a1 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:50.077000 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e12b2361-2fa8-46ca-9f57-5210779b49a1 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "POST /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18/action" status: 202 len: 1111 microversion: 2.1 time: 0.456436 Apr 16 21:19:50.077682 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1860/3590] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:19:49 2022] POST /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18/action => generated 1111 bytes in 458 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 16 21:19:50.094247 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f7b8220c-cb7a-4edd-b335-2f5697c50e0d tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:50.095514 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f7b8220c-cb7a-4edd-b335-2f5697c50e0d tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:50.109160 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f7b8220c-cb7a-4edd-b335-2f5697c50e0d tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:50.110201 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f7b8220c-cb7a-4edd-b335-2f5697c50e0d tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:50.111119 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f7b8220c-cb7a-4edd-b335-2f5697c50e0d tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:50.112655 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f7b8220c-cb7a-4edd-b335-2f5697c50e0d tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:50.302600 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f7b8220c-cb7a-4edd-b335-2f5697c50e0d tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:50.313390 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f7b8220c-cb7a-4edd-b335-2f5697c50e0d tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 200 len: 1516 microversion: 2.1 time: 0.225433 Apr 16 21:19:50.314465 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1731/3591] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:50 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 1516 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:50.477387 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c387d201-8e19-41aa-95bb-91bf891dd2b7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:50.477387 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c387d201-8e19-41aa-95bb-91bf891dd2b7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 1b86bdab-b733-4af5-b2a7-c997869b690c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:50.481680 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c387d201-8e19-41aa-95bb-91bf891dd2b7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:50.482850 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c387d201-8e19-41aa-95bb-91bf891dd2b7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:50.484826 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c387d201-8e19-41aa-95bb-91bf891dd2b7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:50.488839 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c387d201-8e19-41aa-95bb-91bf891dd2b7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:50.704392 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c387d201-8e19-41aa-95bb-91bf891dd2b7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:50.712585 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c387d201-8e19-41aa-95bb-91bf891dd2b7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/1b86bdab-b733-4af5-b2a7-c997869b690c" status: 200 len: 1273 microversion: 2.1 time: 0.247467 Apr 16 21:19:50.714020 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1861/3592] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:50 2022] GET /compute/v2.1/servers/1b86bdab-b733-4af5-b2a7-c997869b690c => generated 1273 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:51.330992 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4fd50afa-369c-41e0-ba19-37a9df36d72f tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:51.331625 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4fd50afa-369c-41e0-ba19-37a9df36d72f tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:51.340895 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4fd50afa-369c-41e0-ba19-37a9df36d72f tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:51.341394 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4fd50afa-369c-41e0-ba19-37a9df36d72f tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:51.342207 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4fd50afa-369c-41e0-ba19-37a9df36d72f tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:51.342652 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4fd50afa-369c-41e0-ba19-37a9df36d72f tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:51.557642 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4fd50afa-369c-41e0-ba19-37a9df36d72f tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:51.570225 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4fd50afa-369c-41e0-ba19-37a9df36d72f tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 200 len: 1516 microversion: 2.1 time: 0.242942 Apr 16 21:19:51.572035 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1732/3593] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:51 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 1516 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:19:51.729871 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2b80a31b-a418-4c0a-a509-5f1db1ce359f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:51.731083 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2b80a31b-a418-4c0a-a509-5f1db1ce359f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 1b86bdab-b733-4af5-b2a7-c997869b690c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:51.746768 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b80a31b-a418-4c0a-a509-5f1db1ce359f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:51.747431 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b80a31b-a418-4c0a-a509-5f1db1ce359f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:51.748428 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b80a31b-a418-4c0a-a509-5f1db1ce359f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:51.749027 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b80a31b-a418-4c0a-a509-5f1db1ce359f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:52.164093 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2b80a31b-a418-4c0a-a509-5f1db1ce359f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:52.172838 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2b80a31b-a418-4c0a-a509-5f1db1ce359f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/1b86bdab-b733-4af5-b2a7-c997869b690c" status: 200 len: 1315 microversion: 2.1 time: 0.447163 Apr 16 21:19:52.174154 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1862/3594] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:51 2022] GET /compute/v2.1/servers/1b86bdab-b733-4af5-b2a7-c997869b690c => generated 1315 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:52.588985 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7722b4a9-a38a-473a-a5ef-17d657fc03c4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:52.594987 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7722b4a9-a38a-473a-a5ef-17d657fc03c4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:52.597379 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7722b4a9-a38a-473a-a5ef-17d657fc03c4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:52.598059 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7722b4a9-a38a-473a-a5ef-17d657fc03c4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:52.599075 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7722b4a9-a38a-473a-a5ef-17d657fc03c4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:52.599727 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7722b4a9-a38a-473a-a5ef-17d657fc03c4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:52.800440 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7722b4a9-a38a-473a-a5ef-17d657fc03c4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:52.813647 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7722b4a9-a38a-473a-a5ef-17d657fc03c4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 200 len: 1516 microversion: 2.1 time: 0.228752 Apr 16 21:19:52.814949 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1733/3595] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:52 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 1516 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:53.199887 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6db48ba8-1f31-444c-b083-7ca5d6383ef1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:53.205381 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6db48ba8-1f31-444c-b083-7ca5d6383ef1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 1b86bdab-b733-4af5-b2a7-c997869b690c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:53.249493 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6db48ba8-1f31-444c-b083-7ca5d6383ef1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:53.250831 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6db48ba8-1f31-444c-b083-7ca5d6383ef1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:53.253824 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6db48ba8-1f31-444c-b083-7ca5d6383ef1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:53.254321 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6db48ba8-1f31-444c-b083-7ca5d6383ef1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:53.694002 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6db48ba8-1f31-444c-b083-7ca5d6383ef1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:53.702513 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6db48ba8-1f31-444c-b083-7ca5d6383ef1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/1b86bdab-b733-4af5-b2a7-c997869b690c" status: 200 len: 1315 microversion: 2.1 time: 0.515625 Apr 16 21:19:53.703372 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1863/3596] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:53 2022] GET /compute/v2.1/servers/1b86bdab-b733-4af5-b2a7-c997869b690c => generated 1315 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:53.832530 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-18602324-a2b2-4fea-803c-f20f06637d4f tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:53.833373 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-18602324-a2b2-4fea-803c-f20f06637d4f tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:53.844935 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-18602324-a2b2-4fea-803c-f20f06637d4f tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:53.845683 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-18602324-a2b2-4fea-803c-f20f06637d4f tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:53.847510 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-18602324-a2b2-4fea-803c-f20f06637d4f tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:53.848407 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-18602324-a2b2-4fea-803c-f20f06637d4f tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:53.865500 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-7a087187-6aa7-4cdd-85f3-f5615dfb36b7 req-96c23c5e-2d6f-4a50-a5a9-0aa070e84e33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b86bdab-b733-4af5-b2a7-c997869b690c", "tag": "70b96df0-3186-4dcf-ba26-08fa42867480"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:19:53.917576 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-7a087187-6aa7-4cdd-85f3-f5615dfb36b7 req-96c23c5e-2d6f-4a50-a5a9-0aa070e84e33 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:53.917576 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-7a087187-6aa7-4cdd-85f3-f5615dfb36b7 req-96c23c5e-2d6f-4a50-a5a9-0aa070e84e33 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:53.940414 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-7a087187-6aa7-4cdd-85f3-f5615dfb36b7 req-96c23c5e-2d6f-4a50-a5a9-0aa070e84e33 service nova] Creating event network-changed:70b96df0-3186-4dcf-ba26-08fa42867480 for instance 1b86bdab-b733-4af5-b2a7-c997869b690c on nch2-master-1 Apr 16 21:19:53.945976 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-7a087187-6aa7-4cdd-85f3-f5615dfb36b7 req-96c23c5e-2d6f-4a50-a5a9-0aa070e84e33 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087161 Apr 16 21:19:53.948240 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1864/3597] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:19:54.047804 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-18602324-a2b2-4fea-803c-f20f06637d4f tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:54.057747 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-18602324-a2b2-4fea-803c-f20f06637d4f tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 200 len: 1516 microversion: 2.1 time: 0.229923 Apr 16 21:19:54.067618 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1734/3598] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:53 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 1516 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:54.720715 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cfb4af1f-e6fc-4b71-b50d-3cb1c4149811 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:54.721424 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cfb4af1f-e6fc-4b71-b50d-3cb1c4149811 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 1b86bdab-b733-4af5-b2a7-c997869b690c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:54.732575 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cfb4af1f-e6fc-4b71-b50d-3cb1c4149811 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:54.735803 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cfb4af1f-e6fc-4b71-b50d-3cb1c4149811 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:54.735803 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cfb4af1f-e6fc-4b71-b50d-3cb1c4149811 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:54.735803 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cfb4af1f-e6fc-4b71-b50d-3cb1c4149811 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:54.995655 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cfb4af1f-e6fc-4b71-b50d-3cb1c4149811 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:55.026894 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cfb4af1f-e6fc-4b71-b50d-3cb1c4149811 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/1b86bdab-b733-4af5-b2a7-c997869b690c" status: 200 len: 1315 microversion: 2.1 time: 0.310002 Apr 16 21:19:55.029868 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1865/3599] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:54 2022] GET /compute/v2.1/servers/1b86bdab-b733-4af5-b2a7-c997869b690c => generated 1315 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:19:55.075786 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-85766d6f-b40f-4ca9-8548-5689172a727d tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:55.076440 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-85766d6f-b40f-4ca9-8548-5689172a727d tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:55.087804 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-85766d6f-b40f-4ca9-8548-5689172a727d tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:55.089624 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-85766d6f-b40f-4ca9-8548-5689172a727d tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:55.090654 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-85766d6f-b40f-4ca9-8548-5689172a727d tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:55.092735 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-85766d6f-b40f-4ca9-8548-5689172a727d tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:55.292971 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-85766d6f-b40f-4ca9-8548-5689172a727d tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:55.300747 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-85766d6f-b40f-4ca9-8548-5689172a727d tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 200 len: 1516 microversion: 2.1 time: 0.228844 Apr 16 21:19:55.306361 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1735/3600] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:55 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 1516 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:56.049955 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4cdcbc27-812e-4ba4-bf92-679744873182 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:56.052520 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4cdcbc27-812e-4ba4-bf92-679744873182 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 1b86bdab-b733-4af5-b2a7-c997869b690c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:56.061114 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4cdcbc27-812e-4ba4-bf92-679744873182 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:56.062006 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4cdcbc27-812e-4ba4-bf92-679744873182 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:56.063289 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4cdcbc27-812e-4ba4-bf92-679744873182 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:56.064035 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4cdcbc27-812e-4ba4-bf92-679744873182 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:56.271024 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4cdcbc27-812e-4ba4-bf92-679744873182 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:56.281595 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4cdcbc27-812e-4ba4-bf92-679744873182 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/1b86bdab-b733-4af5-b2a7-c997869b690c" status: 200 len: 1315 microversion: 2.1 time: 0.238760 Apr 16 21:19:56.282185 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1866/3601] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:56 2022] GET /compute/v2.1/servers/1b86bdab-b733-4af5-b2a7-c997869b690c => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:56.323151 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e1ad2d7c-e4f5-43c0-a760-826b86aa2ab0 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:56.323772 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e1ad2d7c-e4f5-43c0-a760-826b86aa2ab0 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:56.331742 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e1ad2d7c-e4f5-43c0-a760-826b86aa2ab0 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:56.332245 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e1ad2d7c-e4f5-43c0-a760-826b86aa2ab0 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:56.333246 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e1ad2d7c-e4f5-43c0-a760-826b86aa2ab0 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:56.333966 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e1ad2d7c-e4f5-43c0-a760-826b86aa2ab0 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:56.485375 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e1ad2d7c-e4f5-43c0-a760-826b86aa2ab0 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:56.493144 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e1ad2d7c-e4f5-43c0-a760-826b86aa2ab0 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 200 len: 1516 microversion: 2.1 time: 0.174230 Apr 16 21:19:56.494094 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1736/3602] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:56 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 1516 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:57.301194 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a98f5093-75ea-4c00-9faf-3273d08a6736 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:57.311226 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a98f5093-75ea-4c00-9faf-3273d08a6736 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 1b86bdab-b733-4af5-b2a7-c997869b690c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:57.313905 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a98f5093-75ea-4c00-9faf-3273d08a6736 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:57.314389 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a98f5093-75ea-4c00-9faf-3273d08a6736 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:57.315207 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a98f5093-75ea-4c00-9faf-3273d08a6736 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:57.319310 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a98f5093-75ea-4c00-9faf-3273d08a6736 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:57.511957 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b3078ef8-524d-431c-b8c1-83a2f2592a2b tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:57.512960 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b3078ef8-524d-431c-b8c1-83a2f2592a2b tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:57.531509 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b3078ef8-524d-431c-b8c1-83a2f2592a2b tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:57.532758 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b3078ef8-524d-431c-b8c1-83a2f2592a2b tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:57.533854 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b3078ef8-524d-431c-b8c1-83a2f2592a2b tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:57.534475 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b3078ef8-524d-431c-b8c1-83a2f2592a2b tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:57.899122 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b3078ef8-524d-431c-b8c1-83a2f2592a2b tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:57.910429 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b3078ef8-524d-431c-b8c1-83a2f2592a2b tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 200 len: 1516 microversion: 2.1 time: 0.403423 Apr 16 21:19:57.917284 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1737/3603] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:57 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 1516 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:19:58.084015 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a98f5093-75ea-4c00-9faf-3273d08a6736 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:58.097412 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a98f5093-75ea-4c00-9faf-3273d08a6736 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/1b86bdab-b733-4af5-b2a7-c997869b690c" status: 200 len: 1315 microversion: 2.1 time: 0.801064 Apr 16 21:19:58.108013 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1867/3604] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:57 2022] GET /compute/v2.1/servers/1b86bdab-b733-4af5-b2a7-c997869b690c => generated 1315 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:58.934347 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f84f0a8a-b704-4c58-9309-71a8fb4fb5a5 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:58.935693 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f84f0a8a-b704-4c58-9309-71a8fb4fb5a5 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:58.943344 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f84f0a8a-b704-4c58-9309-71a8fb4fb5a5 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:58.943831 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f84f0a8a-b704-4c58-9309-71a8fb4fb5a5 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:58.947530 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f84f0a8a-b704-4c58-9309-71a8fb4fb5a5 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:58.947530 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f84f0a8a-b704-4c58-9309-71a8fb4fb5a5 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:59.116104 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2bcc2241-bc6c-4478-b27a-b498e83d9275 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:19:59.116672 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2bcc2241-bc6c-4478-b27a-b498e83d9275 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 1b86bdab-b733-4af5-b2a7-c997869b690c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:19:59.129955 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f84f0a8a-b704-4c58-9309-71a8fb4fb5a5 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:59.137432 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2bcc2241-bc6c-4478-b27a-b498e83d9275 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:59.139244 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f84f0a8a-b704-4c58-9309-71a8fb4fb5a5 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 200 len: 1516 microversion: 2.1 time: 0.209910 Apr 16 21:19:59.140259 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1738/3605] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:58 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 1516 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:19:59.141008 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2bcc2241-bc6c-4478-b27a-b498e83d9275 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:59.142021 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2bcc2241-bc6c-4478-b27a-b498e83d9275 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:19:59.142483 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2bcc2241-bc6c-4478-b27a-b498e83d9275 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:19:59.499886 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2bcc2241-bc6c-4478-b27a-b498e83d9275 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:19:59.508101 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2bcc2241-bc6c-4478-b27a-b498e83d9275 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/1b86bdab-b733-4af5-b2a7-c997869b690c" status: 200 len: 1315 microversion: 2.1 time: 0.396919 Apr 16 21:19:59.508869 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1868/3606] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:19:59 2022] GET /compute/v2.1/servers/1b86bdab-b733-4af5-b2a7-c997869b690c => generated 1315 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:00.157550 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e3c3afe7-88e9-4f75-91bb-c26c0006d4d1 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:00.158751 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e3c3afe7-88e9-4f75-91bb-c26c0006d4d1 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:00.165548 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e3c3afe7-88e9-4f75-91bb-c26c0006d4d1 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:00.166467 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e3c3afe7-88e9-4f75-91bb-c26c0006d4d1 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:00.171323 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e3c3afe7-88e9-4f75-91bb-c26c0006d4d1 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:00.171935 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e3c3afe7-88e9-4f75-91bb-c26c0006d4d1 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:00.301795 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-656a0645-e6c3-47c0-ad86-cbaabff8857c tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1063940640", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "c28ab0a1-ee34-4f39-8488-5ad10778cbb1"}, {"uuid": "bf720063-38d8-45f4-aa0e-d4a5fcbcc769"}, {"uuid": "c28ab0a1-ee34-4f39-8488-5ad10778cbb1"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:20:00.389259 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e3c3afe7-88e9-4f75-91bb-c26c0006d4d1 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:00.391900 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-656a0645-e6c3-47c0-ad86-cbaabff8857c tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] validate_networks() for [('c28ab0a1-ee34-4f39-8488-5ad10778cbb1', None, None, None, None, None), ('bf720063-38d8-45f4-aa0e-d4a5fcbcc769', None, None, None, None, None), ('c28ab0a1-ee34-4f39-8488-5ad10778cbb1', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:20:00.397539 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e3c3afe7-88e9-4f75-91bb-c26c0006d4d1 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 200 len: 1516 microversion: 2.1 time: 0.245329 Apr 16 21:20:00.398312 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1739/3607] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:00 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 1516 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:00.495432 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-29ed9857-585d-4eb7-bb0a-4271a5302774 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:00.495984 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-29ed9857-585d-4eb7-bb0a-4271a5302774 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:00.512256 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-29ed9857-585d-4eb7-bb0a-4271a5302774 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:00.512723 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-29ed9857-585d-4eb7-bb0a-4271a5302774 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:00.513518 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-29ed9857-585d-4eb7-bb0a-4271a5302774 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:00.517792 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-29ed9857-585d-4eb7-bb0a-4271a5302774 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:00.573306 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-29ed9857-585d-4eb7-bb0a-4271a5302774 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:20:00.991913 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-29ed9857-585d-4eb7-bb0a-4271a5302774 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "DELETE /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140" status: 204 len: 0 microversion: 2.1 time: 0.506068 Apr 16 21:20:00.993348 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1740/3608] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:20:00 2022] DELETE /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:20:01.007605 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7b5f1afb-e152-49ae-b66e-49d4697f21c1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:01.008702 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7b5f1afb-e152-49ae-b66e-49d4697f21c1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 1b86bdab-b733-4af5-b2a7-c997869b690c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:01.015711 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7b5f1afb-e152-49ae-b66e-49d4697f21c1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:01.016648 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7b5f1afb-e152-49ae-b66e-49d4697f21c1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:01.017837 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7b5f1afb-e152-49ae-b66e-49d4697f21c1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:01.018991 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7b5f1afb-e152-49ae-b66e-49d4697f21c1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:01.236589 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7b5f1afb-e152-49ae-b66e-49d4697f21c1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:01.253025 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7b5f1afb-e152-49ae-b66e-49d4697f21c1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/1b86bdab-b733-4af5-b2a7-c997869b690c" status: 200 len: 1315 microversion: 2.1 time: 0.256526 Apr 16 21:20:01.256896 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1741/3609] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:00 2022] GET /compute/v2.1/servers/1b86bdab-b733-4af5-b2a7-c997869b690c => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:01.268008 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-3b832357-4003-4d6f-8f03-65cbe97e3eb4 req-9ebd194a-0789-48e9-991d-7a8bdab81c8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b86bdab-b733-4af5-b2a7-c997869b690c", "name": "network-vif-plugged", "status": "completed", "tag": "70b96df0-3186-4dcf-ba26-08fa42867480"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:20:01.286181 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-3b832357-4003-4d6f-8f03-65cbe97e3eb4 req-9ebd194a-0789-48e9-991d-7a8bdab81c8b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:01.287013 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-3b832357-4003-4d6f-8f03-65cbe97e3eb4 req-9ebd194a-0789-48e9-991d-7a8bdab81c8b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:01.307332 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-3b832357-4003-4d6f-8f03-65cbe97e3eb4 req-9ebd194a-0789-48e9-991d-7a8bdab81c8b service nova] Creating event network-vif-plugged:70b96df0-3186-4dcf-ba26-08fa42867480 for instance 1b86bdab-b733-4af5-b2a7-c997869b690c on nch2-master-1 Apr 16 21:20:01.319774 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-3b832357-4003-4d6f-8f03-65cbe97e3eb4 req-9ebd194a-0789-48e9-991d-7a8bdab81c8b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061437 Apr 16 21:20:01.321099 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1742/3610] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:20:01.329547 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2592d1ff-e185-4591-9821-1a477f429265 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:01.334309 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2592d1ff-e185-4591-9821-1a477f429265 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:01.348956 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2592d1ff-e185-4591-9821-1a477f429265 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:01.350325 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2592d1ff-e185-4591-9821-1a477f429265 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:01.361932 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2592d1ff-e185-4591-9821-1a477f429265 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:01.363612 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2592d1ff-e185-4591-9821-1a477f429265 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:01.569724 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2592d1ff-e185-4591-9821-1a477f429265 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:01.579814 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2592d1ff-e185-4591-9821-1a477f429265 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140" status: 200 len: 1509 microversion: 2.1 time: 0.255399 Apr 16 21:20:01.594627 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-656a0645-e6c3-47c0-ad86-cbaabff8857c tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:20:01.595145 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-656a0645-e6c3-47c0-ad86-cbaabff8857c tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:20:01.595580 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-656a0645-e6c3-47c0-ad86-cbaabff8857c tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:20:01.596027 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-656a0645-e6c3-47c0-ad86-cbaabff8857c tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:20:01.596480 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-656a0645-e6c3-47c0-ad86-cbaabff8857c tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:20:01.599579 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1743/3611] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:01 2022] GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140 => generated 1509 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:01.606197 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d59e175e-bb73-4efa-8044-f86d7dca8358 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:01.617294 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d59e175e-bb73-4efa-8044-f86d7dca8358 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:01.617686 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-656a0645-e6c3-47c0-ad86-cbaabff8857c tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:01.617686 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-656a0645-e6c3-47c0-ad86-cbaabff8857c tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:01.617686 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-656a0645-e6c3-47c0-ad86-cbaabff8857c tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:01.617893 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d59e175e-bb73-4efa-8044-f86d7dca8358 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:01.617966 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-656a0645-e6c3-47c0-ad86-cbaabff8857c tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:01.618561 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d59e175e-bb73-4efa-8044-f86d7dca8358 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:01.618561 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d59e175e-bb73-4efa-8044-f86d7dca8358 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:01.618561 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d59e175e-bb73-4efa-8044-f86d7dca8358 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:01.660787 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-656a0645-e6c3-47c0-ad86-cbaabff8857c tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Getting quotas for project c3457cd454b04246bb4adb154b41bbb2. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:20:01.667137 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-656a0645-e6c3-47c0-ad86-cbaabff8857c tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Getting quotas for user 836ed2bfadd94e2a81048a0621067b33 and project c3457cd454b04246bb4adb154b41bbb2. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:20:01.681440 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-656a0645-e6c3-47c0-ad86-cbaabff8857c tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:20:01.684097 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-656a0645-e6c3-47c0-ad86-cbaabff8857c tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 3834cb63-fcdb-46a3-a476-0ee952c105aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:20:01.804893 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d59e175e-bb73-4efa-8044-f86d7dca8358 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:01.816440 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d59e175e-bb73-4efa-8044-f86d7dca8358 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 200 len: 1516 microversion: 2.1 time: 0.215411 Apr 16 21:20:01.817233 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1744/3612] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:01 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 1516 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:01.843055 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-656a0645-e6c3-47c0-ad86-cbaabff8857c tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.545098 Apr 16 21:20:01.844119 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1869/3613] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:20:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:20:01.855014 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c5b589e2-bc36-4eb7-bd05-1a6d9abd0016 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:01.857818 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c5b589e2-bc36-4eb7-bd05-1a6d9abd0016 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 3834cb63-fcdb-46a3-a476-0ee952c105aa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:01.934039 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c5b589e2-bc36-4eb7-bd05-1a6d9abd0016 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:01.947448 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c5b589e2-bc36-4eb7-bd05-1a6d9abd0016 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa" status: 200 len: 1213 microversion: 2.1 time: 0.096191 Apr 16 21:20:01.952773 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1745/3614] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:01 2022] GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa => generated 1213 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:02.272940 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3151414a-ec6c-4292-972a-b13c06c9a606 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:02.273823 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3151414a-ec6c-4292-972a-b13c06c9a606 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 1b86bdab-b733-4af5-b2a7-c997869b690c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:02.280314 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3151414a-ec6c-4292-972a-b13c06c9a606 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:02.280797 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3151414a-ec6c-4292-972a-b13c06c9a606 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:02.281623 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3151414a-ec6c-4292-972a-b13c06c9a606 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:02.282030 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3151414a-ec6c-4292-972a-b13c06c9a606 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:02.432861 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3151414a-ec6c-4292-972a-b13c06c9a606 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:02.441231 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3151414a-ec6c-4292-972a-b13c06c9a606 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/1b86bdab-b733-4af5-b2a7-c997869b690c" status: 200 len: 1315 microversion: 2.1 time: 0.172175 Apr 16 21:20:02.443548 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1870/3615] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:02 2022] GET /compute/v2.1/servers/1b86bdab-b733-4af5-b2a7-c997869b690c => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:02.599420 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-13296dfd-44e6-4341-bbb1-4e5fc3c0e865 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:02.600970 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-13296dfd-44e6-4341-bbb1-4e5fc3c0e865 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:02.618611 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-13296dfd-44e6-4341-bbb1-4e5fc3c0e865 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:02.619097 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-13296dfd-44e6-4341-bbb1-4e5fc3c0e865 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:02.619892 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-13296dfd-44e6-4341-bbb1-4e5fc3c0e865 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:02.620746 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-13296dfd-44e6-4341-bbb1-4e5fc3c0e865 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:02.815775 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-13296dfd-44e6-4341-bbb1-4e5fc3c0e865 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:02.824449 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-13296dfd-44e6-4341-bbb1-4e5fc3c0e865 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140" status: 200 len: 1509 microversion: 2.1 time: 0.229827 Apr 16 21:20:02.825061 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1746/3616] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:02 2022] GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140 => generated 1509 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:02.839018 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b630f14b-3bb5-462b-86e5-8626ac1ff126 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:02.839877 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b630f14b-3bb5-462b-86e5-8626ac1ff126 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:02.847369 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b630f14b-3bb5-462b-86e5-8626ac1ff126 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:02.848200 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b630f14b-3bb5-462b-86e5-8626ac1ff126 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:02.849426 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b630f14b-3bb5-462b-86e5-8626ac1ff126 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:02.850123 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b630f14b-3bb5-462b-86e5-8626ac1ff126 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:02.967538 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b19e9eba-c16f-4e74-a10f-ac2a1415ecfa tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:02.969124 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b19e9eba-c16f-4e74-a10f-ac2a1415ecfa tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 3834cb63-fcdb-46a3-a476-0ee952c105aa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:03.019187 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b630f14b-3bb5-462b-86e5-8626ac1ff126 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:03.039538 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b630f14b-3bb5-462b-86e5-8626ac1ff126 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 200 len: 1516 microversion: 2.1 time: 0.200350 Apr 16 21:20:03.040233 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1871/3617] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:02 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 1516 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:03.059018 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b19e9eba-c16f-4e74-a10f-ac2a1415ecfa tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:03.066346 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b19e9eba-c16f-4e74-a10f-ac2a1415ecfa tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa" status: 200 len: 1213 microversion: 2.1 time: 0.105274 Apr 16 21:20:03.067104 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1747/3618] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:02 2022] GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa => generated 1213 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:20:03.475666 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d25a6c05-722d-46d7-a173-fdfa070ef6dd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:03.475666 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d25a6c05-722d-46d7-a173-fdfa070ef6dd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 1b86bdab-b733-4af5-b2a7-c997869b690c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:03.496576 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d25a6c05-722d-46d7-a173-fdfa070ef6dd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:03.498029 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d25a6c05-722d-46d7-a173-fdfa070ef6dd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:03.498029 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d25a6c05-722d-46d7-a173-fdfa070ef6dd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:03.498275 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d25a6c05-722d-46d7-a173-fdfa070ef6dd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:03.728680 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d25a6c05-722d-46d7-a173-fdfa070ef6dd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:03.736817 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d25a6c05-722d-46d7-a173-fdfa070ef6dd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/1b86bdab-b733-4af5-b2a7-c997869b690c" status: 200 len: 1501 microversion: 2.1 time: 0.275511 Apr 16 21:20:03.737988 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1872/3619] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:03 2022] GET /compute/v2.1/servers/1b86bdab-b733-4af5-b2a7-c997869b690c => generated 1501 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:03.756470 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1e662bc3-7db5-4b19-a69c-2a15a16d7b1a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:20:03.757545 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1e662bc3-7db5-4b19-a69c-2a15a16d7b1a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 1b86bdab-b733-4af5-b2a7-c997869b690c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:03.779860 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1e662bc3-7db5-4b19-a69c-2a15a16d7b1a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:03.785439 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1e662bc3-7db5-4b19-a69c-2a15a16d7b1a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:03.785439 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1e662bc3-7db5-4b19-a69c-2a15a16d7b1a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:03.785439 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1e662bc3-7db5-4b19-a69c-2a15a16d7b1a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:03.841432 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e2c2f363-29ca-4adc-a6d9-cbd38791a594 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:03.842081 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e2c2f363-29ca-4adc-a6d9-cbd38791a594 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:03.849356 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e2c2f363-29ca-4adc-a6d9-cbd38791a594 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:03.853184 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e2c2f363-29ca-4adc-a6d9-cbd38791a594 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:03.854120 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e2c2f363-29ca-4adc-a6d9-cbd38791a594 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:03.854513 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e2c2f363-29ca-4adc-a6d9-cbd38791a594 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:03.934380 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e2c2f363-29ca-4adc-a6d9-cbd38791a594 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:03.953909 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e2c2f363-29ca-4adc-a6d9-cbd38791a594 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140" status: 200 len: 1467 microversion: 2.1 time: 0.115173 Apr 16 21:20:03.965838 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1873/3620] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:03 2022] GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140 => generated 1467 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:20:03.973695 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-cd20e91f-54b6-4d4b-900b-a29ed8032ca8 req-32e79bb5-4a9e-40c0-a078-2dc547f9cd09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89f07150-d0ab-41c9-a9bf-692e9d9c5140", "name": "network-vif-deleted", "tag": "973bd67e-86f2-41a6-afe9-0081fe7b246c"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:20:03.987141 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-cd20e91f-54b6-4d4b-900b-a29ed8032ca8 req-32e79bb5-4a9e-40c0-a078-2dc547f9cd09 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:03.987622 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-cd20e91f-54b6-4d4b-900b-a29ed8032ca8 req-32e79bb5-4a9e-40c0-a078-2dc547f9cd09 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:04.001486 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.network.security_group_api [None req-1e662bc3-7db5-4b19-a69c-2a15a16d7b1a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Removing security group da529f6a-a022-4bd2-9716-5ae064118b8c from port 70b96df0-3186-4dcf-ba26-08fa42867480 Apr 16 21:20:04.006876 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-cd20e91f-54b6-4d4b-900b-a29ed8032ca8 req-32e79bb5-4a9e-40c0-a078-2dc547f9cd09 service nova] Creating event network-vif-deleted:973bd67e-86f2-41a6-afe9-0081fe7b246c for instance 89f07150-d0ab-41c9-a9bf-692e9d9c5140 on nch1-master-1 Apr 16 21:20:04.012815 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-cd20e91f-54b6-4d4b-900b-a29ed8032ca8 req-32e79bb5-4a9e-40c0-a078-2dc547f9cd09 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045476 Apr 16 21:20:04.013789 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1874/3621] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:20:04.062067 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cd10f1c6-1883-44d8-8d86-3d6b4530d7e2 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:04.063144 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cd10f1c6-1883-44d8-8d86-3d6b4530d7e2 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:04.070578 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cd10f1c6-1883-44d8-8d86-3d6b4530d7e2 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:04.071405 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cd10f1c6-1883-44d8-8d86-3d6b4530d7e2 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:04.078490 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cd10f1c6-1883-44d8-8d86-3d6b4530d7e2 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:04.079324 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cd10f1c6-1883-44d8-8d86-3d6b4530d7e2 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:04.262680 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cd10f1c6-1883-44d8-8d86-3d6b4530d7e2 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:04.271540 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cd10f1c6-1883-44d8-8d86-3d6b4530d7e2 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 200 len: 1516 microversion: 2.1 time: 0.217283 Apr 16 21:20:04.272718 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1875/3622] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:04 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 1516 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:20:04.280616 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c1fa7658-9771-4f9c-90b5-cc2034c92f50 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:04.281490 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c1fa7658-9771-4f9c-90b5-cc2034c92f50 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 3834cb63-fcdb-46a3-a476-0ee952c105aa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:04.289181 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c1fa7658-9771-4f9c-90b5-cc2034c92f50 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:04.294544 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c1fa7658-9771-4f9c-90b5-cc2034c92f50 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:04.294544 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c1fa7658-9771-4f9c-90b5-cc2034c92f50 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:04.294544 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c1fa7658-9771-4f9c-90b5-cc2034c92f50 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:04.374301 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c1fa7658-9771-4f9c-90b5-cc2034c92f50 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:04.382024 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c1fa7658-9771-4f9c-90b5-cc2034c92f50 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa" status: 200 len: 1265 microversion: 2.1 time: 0.107776 Apr 16 21:20:04.382814 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1876/3623] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:04 2022] GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa => generated 1265 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:04.683687 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1e662bc3-7db5-4b19-a69c-2a15a16d7b1a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "POST /compute/v2.1/servers/1b86bdab-b733-4af5-b2a7-c997869b690c/action" status: 202 len: 0 microversion: 2.1 time: 0.928253 Apr 16 21:20:04.683687 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1748/3624] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:20:03 2022] POST /compute/v2.1/servers/1b86bdab-b733-4af5-b2a7-c997869b690c/action => generated 0 bytes in 931 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:20:04.696632 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7131d4ea-5261-482d-9c12-2b5cc14f66d1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:04.697630 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7131d4ea-5261-482d-9c12-2b5cc14f66d1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 1b86bdab-b733-4af5-b2a7-c997869b690c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:04.705449 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7131d4ea-5261-482d-9c12-2b5cc14f66d1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:04.706162 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7131d4ea-5261-482d-9c12-2b5cc14f66d1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:04.707227 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7131d4ea-5261-482d-9c12-2b5cc14f66d1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:04.711813 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7131d4ea-5261-482d-9c12-2b5cc14f66d1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:04.817752 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7131d4ea-5261-482d-9c12-2b5cc14f66d1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:04.826755 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7131d4ea-5261-482d-9c12-2b5cc14f66d1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/1b86bdab-b733-4af5-b2a7-c997869b690c" status: 200 len: 1459 microversion: 2.1 time: 0.137828 Apr 16 21:20:04.827451 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1877/3625] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:04 2022] GET /compute/v2.1/servers/1b86bdab-b733-4af5-b2a7-c997869b690c => generated 1459 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:20:04.845469 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c349b7fd-2d32-461c-8eeb-b559f6cf5e52 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:04.854545 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c349b7fd-2d32-461c-8eeb-b559f6cf5e52 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:04.854545 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c349b7fd-2d32-461c-8eeb-b559f6cf5e52 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:04.855664 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c349b7fd-2d32-461c-8eeb-b559f6cf5e52 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:04.856748 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c349b7fd-2d32-461c-8eeb-b559f6cf5e52 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:04.857377 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c349b7fd-2d32-461c-8eeb-b559f6cf5e52 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:04.983160 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e701f539-86fc-4fd9-a00e-129386ea8236 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:04.984548 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e701f539-86fc-4fd9-a00e-129386ea8236 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:04.993787 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e701f539-86fc-4fd9-a00e-129386ea8236 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:04.994665 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e701f539-86fc-4fd9-a00e-129386ea8236 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:04.996462 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e701f539-86fc-4fd9-a00e-129386ea8236 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:04.997074 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e701f539-86fc-4fd9-a00e-129386ea8236 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:05.037417 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e701f539-86fc-4fd9-a00e-129386ea8236 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:05.037957 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e701f539-86fc-4fd9-a00e-129386ea8236 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:05.038650 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-e701f539-86fc-4fd9-a00e-129386ea8236 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lazy-loading 'fault' on Instance uuid 89f07150-d0ab-41c9-a9bf-692e9d9c5140 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:20:05.104820 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e701f539-86fc-4fd9-a00e-129386ea8236 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:05.113926 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e701f539-86fc-4fd9-a00e-129386ea8236 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140" status: 200 len: 1312 microversion: 2.1 time: 0.136103 Apr 16 21:20:05.122048 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1878/3626] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:04 2022] GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140 => generated 1312 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:05.187928 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c349b7fd-2d32-461c-8eeb-b559f6cf5e52 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:05.196230 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c349b7fd-2d32-461c-8eeb-b559f6cf5e52 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.356416 Apr 16 21:20:05.197637 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1749/3627] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:04 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:20:05.216965 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e930e322-b8f0-467e-8591-b8568fb49fc4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:05.217650 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e930e322-b8f0-467e-8591-b8568fb49fc4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:05.233782 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e930e322-b8f0-467e-8591-b8568fb49fc4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:05.234476 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e930e322-b8f0-467e-8591-b8568fb49fc4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:05.235793 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e930e322-b8f0-467e-8591-b8568fb49fc4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:05.236527 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e930e322-b8f0-467e-8591-b8568fb49fc4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:05.289804 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b62f1683-bcac-4cc6-8f70-6c6006fd80d7 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:05.290784 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b62f1683-bcac-4cc6-8f70-6c6006fd80d7 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:05.303039 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b62f1683-bcac-4cc6-8f70-6c6006fd80d7 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:05.308005 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b62f1683-bcac-4cc6-8f70-6c6006fd80d7 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:05.313057 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b62f1683-bcac-4cc6-8f70-6c6006fd80d7 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:05.313057 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b62f1683-bcac-4cc6-8f70-6c6006fd80d7 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:05.413735 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e930e322-b8f0-467e-8591-b8568fb49fc4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:05.436356 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e930e322-b8f0-467e-8591-b8568fb49fc4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.224235 Apr 16 21:20:05.437977 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1879/3628] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:05 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:05.453999 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5ffeaf1f-b46c-453d-91da-8ba87fb27d68 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:05.454749 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5ffeaf1f-b46c-453d-91da-8ba87fb27d68 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 3834cb63-fcdb-46a3-a476-0ee952c105aa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:05.461687 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5ffeaf1f-b46c-453d-91da-8ba87fb27d68 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:05.462168 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5ffeaf1f-b46c-453d-91da-8ba87fb27d68 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:05.463097 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5ffeaf1f-b46c-453d-91da-8ba87fb27d68 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:05.463627 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5ffeaf1f-b46c-453d-91da-8ba87fb27d68 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:05.521294 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b62f1683-bcac-4cc6-8f70-6c6006fd80d7 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:05.531118 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b62f1683-bcac-4cc6-8f70-6c6006fd80d7 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 200 len: 1516 microversion: 2.1 time: 0.245057 Apr 16 21:20:05.532030 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1750/3629] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:05 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 1516 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:05.541306 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a2781ff7-bef9-4170-b693-a89c6a71d4f2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:05.542544 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a2781ff7-bef9-4170-b693-a89c6a71d4f2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:05.546948 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5ffeaf1f-b46c-453d-91da-8ba87fb27d68 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:05.550112 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a2781ff7-bef9-4170-b693-a89c6a71d4f2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:05.550577 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a2781ff7-bef9-4170-b693-a89c6a71d4f2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:05.551575 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a2781ff7-bef9-4170-b693-a89c6a71d4f2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:05.552205 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a2781ff7-bef9-4170-b693-a89c6a71d4f2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:05.558989 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5ffeaf1f-b46c-453d-91da-8ba87fb27d68 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa" status: 200 len: 1271 microversion: 2.1 time: 0.119814 Apr 16 21:20:05.559972 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1880/3630] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:05 2022] GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa => generated 1271 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:05.773069 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a2781ff7-bef9-4170-b693-a89c6a71d4f2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:05.784241 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a2781ff7-bef9-4170-b693-a89c6a71d4f2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.250255 Apr 16 21:20:05.791552 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1751/3631] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:05 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:05.809012 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-63701c0c-66b6-4792-8324-da05bd2e80c1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:05.809655 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-63701c0c-66b6-4792-8324-da05bd2e80c1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:05.822752 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-63701c0c-66b6-4792-8324-da05bd2e80c1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:05.824626 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-63701c0c-66b6-4792-8324-da05bd2e80c1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:05.826988 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-63701c0c-66b6-4792-8324-da05bd2e80c1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:05.827973 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-63701c0c-66b6-4792-8324-da05bd2e80c1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:06.038885 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-52635612-1e71-46c8-9cc5-0f79e45de396 req-59e55d68-ea98-48fe-8010-a1d71a8c1282 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1b86bdab-b733-4af5-b2a7-c997869b690c", "tag": "70b96df0-3186-4dcf-ba26-08fa42867480"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:20:06.045710 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-63701c0c-66b6-4792-8324-da05bd2e80c1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:06.048915 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-52635612-1e71-46c8-9cc5-0f79e45de396 req-59e55d68-ea98-48fe-8010-a1d71a8c1282 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:06.049377 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-52635612-1e71-46c8-9cc5-0f79e45de396 req-59e55d68-ea98-48fe-8010-a1d71a8c1282 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:06.057553 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-63701c0c-66b6-4792-8324-da05bd2e80c1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.253959 Apr 16 21:20:06.059024 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1881/3632] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:05 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:06.062602 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-52635612-1e71-46c8-9cc5-0f79e45de396 req-59e55d68-ea98-48fe-8010-a1d71a8c1282 service nova] Creating event network-changed:70b96df0-3186-4dcf-ba26-08fa42867480 for instance 1b86bdab-b733-4af5-b2a7-c997869b690c on nch2-master-1 Apr 16 21:20:06.068550 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-52635612-1e71-46c8-9cc5-0f79e45de396 req-59e55d68-ea98-48fe-8010-a1d71a8c1282 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033206 Apr 16 21:20:06.071279 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1752/3633] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:20:06.131577 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e5f0d087-36f5-4808-a5aa-d12f7373f3c1 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:06.132615 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e5f0d087-36f5-4808-a5aa-d12f7373f3c1 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: 89f07150-d0ab-41c9-a9bf-692e9d9c5140] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:06.141543 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e5f0d087-36f5-4808-a5aa-d12f7373f3c1 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:06.147857 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e5f0d087-36f5-4808-a5aa-d12f7373f3c1 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:06.149570 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e5f0d087-36f5-4808-a5aa-d12f7373f3c1 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:06.152345 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e5f0d087-36f5-4808-a5aa-d12f7373f3c1 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:06.183741 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-e5f0d087-36f5-4808-a5aa-d12f7373f3c1 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] HTTP exception thrown: Instance 89f07150-d0ab-41c9-a9bf-692e9d9c5140 could not be found. Apr 16 21:20:06.184484 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e5f0d087-36f5-4808-a5aa-d12f7373f3c1 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Returning 404 to user: Instance 89f07150-d0ab-41c9-a9bf-692e9d9c5140 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:20:06.185580 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e5f0d087-36f5-4808-a5aa-d12f7373f3c1 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140" status: 404 len: 111 microversion: 2.1 time: 0.058501 Apr 16 21:20:06.186690 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1882/3634] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:06 2022] GET /compute/v2.1/servers/89f07150-d0ab-41c9-a9bf-692e9d9c5140 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:20:06.196547 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4f4ba025-9d50-4fca-ab09-3c5dbfa60d50 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:06.198532 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4f4ba025-9d50-4fca-ab09-3c5dbfa60d50 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: dc95a4d6-f40d-4087-91ae-3038926df942] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:06.216644 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4f4ba025-9d50-4fca-ab09-3c5dbfa60d50 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:06.216644 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4f4ba025-9d50-4fca-ab09-3c5dbfa60d50 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:06.218993 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4f4ba025-9d50-4fca-ab09-3c5dbfa60d50 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:06.219488 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4f4ba025-9d50-4fca-ab09-3c5dbfa60d50 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:06.258737 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-17280e99-2394-4227-940e-9e64600132cd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1479531413", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "f9e642b5-0144-4768-b572-192069e5751e"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:20:06.271160 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4f4ba025-9d50-4fca-ab09-3c5dbfa60d50 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: dc95a4d6-f40d-4087-91ae-3038926df942] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:20:06.345256 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-17280e99-2394-4227-940e-9e64600132cd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] validate_networks() for [('f9e642b5-0144-4768-b572-192069e5751e', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:20:06.716872 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4f4ba025-9d50-4fca-ab09-3c5dbfa60d50 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "DELETE /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942" status: 204 len: 0 microversion: 2.1 time: 0.525470 Apr 16 21:20:06.719108 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1753/3635] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:20:06 2022] DELETE /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:20:06.725979 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c1b9a7e0-7d01-4640-8710-2367bf034bca tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:06.726925 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c1b9a7e0-7d01-4640-8710-2367bf034bca tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:06.737854 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c1b9a7e0-7d01-4640-8710-2367bf034bca tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:06.738577 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c1b9a7e0-7d01-4640-8710-2367bf034bca tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:06.739562 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c1b9a7e0-7d01-4640-8710-2367bf034bca tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:06.740763 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c1b9a7e0-7d01-4640-8710-2367bf034bca tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:06.904026 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c1b9a7e0-7d01-4640-8710-2367bf034bca tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:06.912755 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c1b9a7e0-7d01-4640-8710-2367bf034bca tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 200 len: 1516 microversion: 2.1 time: 0.191465 Apr 16 21:20:06.916702 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1754/3636] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:06 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 1516 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:06.922660 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a2a9cd26-95fe-4bc6-b504-f2b5209c30cb tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:06.923606 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a2a9cd26-95fe-4bc6-b504-f2b5209c30cb tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 3834cb63-fcdb-46a3-a476-0ee952c105aa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:06.934479 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a2a9cd26-95fe-4bc6-b504-f2b5209c30cb tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:06.935239 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a2a9cd26-95fe-4bc6-b504-f2b5209c30cb tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:06.936990 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a2a9cd26-95fe-4bc6-b504-f2b5209c30cb tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:06.941324 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a2a9cd26-95fe-4bc6-b504-f2b5209c30cb tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:07.049486 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-17280e99-2394-4227-940e-9e64600132cd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:20:07.049933 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-17280e99-2394-4227-940e-9e64600132cd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:20:07.050434 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-17280e99-2394-4227-940e-9e64600132cd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:20:07.050848 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-17280e99-2394-4227-940e-9e64600132cd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:20:07.051268 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-17280e99-2394-4227-940e-9e64600132cd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:20:07.061085 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-17280e99-2394-4227-940e-9e64600132cd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:07.061844 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-17280e99-2394-4227-940e-9e64600132cd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:07.062850 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-17280e99-2394-4227-940e-9e64600132cd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:07.063775 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-17280e99-2394-4227-940e-9e64600132cd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:07.085817 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-17280e99-2394-4227-940e-9e64600132cd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Getting quotas for project ceac90e6c7024b4ea350bfa95e1b5249. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:20:07.090219 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-17280e99-2394-4227-940e-9e64600132cd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Getting quotas for user 6bb1c0cdf6274f118ebbe97829ddad65 and project ceac90e6c7024b4ea350bfa95e1b5249. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:20:07.102891 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-17280e99-2394-4227-940e-9e64600132cd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:20:07.105847 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-17280e99-2394-4227-940e-9e64600132cd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:20:07.107798 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a2a9cd26-95fe-4bc6-b504-f2b5209c30cb tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:07.114361 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a2a9cd26-95fe-4bc6-b504-f2b5209c30cb tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa" status: 200 len: 1334 microversion: 2.1 time: 0.196460 Apr 16 21:20:07.114952 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1755/3637] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:06 2022] GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa => generated 1334 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:07.127497 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-84dffb14-cabc-44c0-b0f5-564dd29ae5da tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:07.130790 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-84dffb14-cabc-44c0-b0f5-564dd29ae5da tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: dc95a4d6-f40d-4087-91ae-3038926df942] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:07.135437 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-84dffb14-cabc-44c0-b0f5-564dd29ae5da tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:07.136064 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-84dffb14-cabc-44c0-b0f5-564dd29ae5da tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:07.137206 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-84dffb14-cabc-44c0-b0f5-564dd29ae5da tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:07.139165 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-84dffb14-cabc-44c0-b0f5-564dd29ae5da tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:07.243397 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-17280e99-2394-4227-940e-9e64600132cd tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.988673 Apr 16 21:20:07.244086 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1883/3638] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:20:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 990 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:20:07.253501 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1ea7f77c-188f-4fe5-9eb9-41f800118b57 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:07.254288 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1ea7f77c-188f-4fe5-9eb9-41f800118b57 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] [instance: 3ea60a95-8b64-4410-a953-747f38619ffa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:07.262474 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1ea7f77c-188f-4fe5-9eb9-41f800118b57 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:07.266638 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1ea7f77c-188f-4fe5-9eb9-41f800118b57 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:07.267810 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1ea7f77c-188f-4fe5-9eb9-41f800118b57 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:07.268487 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1ea7f77c-188f-4fe5-9eb9-41f800118b57 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:07.302387 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-84dffb14-cabc-44c0-b0f5-564dd29ae5da tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:07.310653 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-84dffb14-cabc-44c0-b0f5-564dd29ae5da tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942" status: 200 len: 1521 microversion: 2.1 time: 0.188936 Apr 16 21:20:07.312522 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1756/3639] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:07 2022] GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:07.316029 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8b9490b2-e8ee-4e2f-ac3a-bd04564d6e88 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:07.316763 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8b9490b2-e8ee-4e2f-ac3a-bd04564d6e88 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:07.318308 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1ea7f77c-188f-4fe5-9eb9-41f800118b57 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] [instance: 3ea60a95-8b64-4410-a953-747f38619ffa] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:20:07.387332 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8b9490b2-e8ee-4e2f-ac3a-bd04564d6e88 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:07.394346 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8b9490b2-e8ee-4e2f-ac3a-bd04564d6e88 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d" status: 200 len: 1215 microversion: 2.1 time: 0.082095 Apr 16 21:20:07.394939 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1757/3640] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:07 2022] GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d => generated 1215 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:07.584729 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1ea7f77c-188f-4fe5-9eb9-41f800118b57 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3ea60a95-8b64-4410-a953-747f38619ffa" status: 204 len: 0 microversion: 2.1 time: 0.338750 Apr 16 21:20:07.585363 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1884/3641] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:20:07 2022] DELETE /compute/v2.1/servers/3ea60a95-8b64-4410-a953-747f38619ffa => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:20:07.593527 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1b2d61c2-7c68-4343-9bf7-e368defbeee8 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:07.594404 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1b2d61c2-7c68-4343-9bf7-e368defbeee8 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] [instance: 3ea60a95-8b64-4410-a953-747f38619ffa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:07.600492 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1b2d61c2-7c68-4343-9bf7-e368defbeee8 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:07.600958 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1b2d61c2-7c68-4343-9bf7-e368defbeee8 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:07.601743 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1b2d61c2-7c68-4343-9bf7-e368defbeee8 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:07.602191 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1b2d61c2-7c68-4343-9bf7-e368defbeee8 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:07.746075 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1b2d61c2-7c68-4343-9bf7-e368defbeee8 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495514ac1444f17b2b0fe5b8ba534b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cbfdc065da4c4b9f599d9cdd99496d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:07.753742 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1b2d61c2-7c68-4343-9bf7-e368defbeee8 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] 10.222.0.20 "GET /compute/v2.1/servers/3ea60a95-8b64-4410-a953-747f38619ffa" status: 200 len: 1514 microversion: 2.1 time: 0.164262 Apr 16 21:20:07.754411 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1758/3642] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:07 2022] GET /compute/v2.1/servers/3ea60a95-8b64-4410-a953-747f38619ffa => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:07.932505 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a62157a3-d617-42a8-9414-68757a161cc5 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:07.932505 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a62157a3-d617-42a8-9414-68757a161cc5 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:07.939078 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a62157a3-d617-42a8-9414-68757a161cc5 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:07.939543 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a62157a3-d617-42a8-9414-68757a161cc5 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:07.940373 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a62157a3-d617-42a8-9414-68757a161cc5 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:07.940822 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a62157a3-d617-42a8-9414-68757a161cc5 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:08.082014 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a62157a3-d617-42a8-9414-68757a161cc5 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:08.089683 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a62157a3-d617-42a8-9414-68757a161cc5 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 200 len: 1516 microversion: 2.1 time: 0.163851 Apr 16 21:20:08.090271 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1885/3643] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:07 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:08.130953 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-939df38f-4631-4bc3-a493-2554899e0a33 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:08.131571 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-939df38f-4631-4bc3-a493-2554899e0a33 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 3834cb63-fcdb-46a3-a476-0ee952c105aa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:08.138421 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-939df38f-4631-4bc3-a493-2554899e0a33 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:08.138883 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-939df38f-4631-4bc3-a493-2554899e0a33 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:08.139670 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-939df38f-4631-4bc3-a493-2554899e0a33 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:08.140119 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-939df38f-4631-4bc3-a493-2554899e0a33 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:08.280591 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-939df38f-4631-4bc3-a493-2554899e0a33 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:08.288046 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-939df38f-4631-4bc3-a493-2554899e0a33 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa" status: 200 len: 1334 microversion: 2.1 time: 0.161065 Apr 16 21:20:08.288658 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1759/3644] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:08 2022] GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa => generated 1334 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:08.328543 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-739168e3-305f-4997-b2de-d6899feaf50b tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:08.328543 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-739168e3-305f-4997-b2de-d6899feaf50b tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: dc95a4d6-f40d-4087-91ae-3038926df942] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:08.334355 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-739168e3-305f-4997-b2de-d6899feaf50b tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:08.334933 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-739168e3-305f-4997-b2de-d6899feaf50b tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:08.335739 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-739168e3-305f-4997-b2de-d6899feaf50b tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:08.336229 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-739168e3-305f-4997-b2de-d6899feaf50b tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:08.412112 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-00504f56-d3ae-451d-b95d-cc0db60dccfc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:08.412764 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-00504f56-d3ae-451d-b95d-cc0db60dccfc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:08.420876 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-00504f56-d3ae-451d-b95d-cc0db60dccfc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:08.421347 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-00504f56-d3ae-451d-b95d-cc0db60dccfc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:08.422191 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-00504f56-d3ae-451d-b95d-cc0db60dccfc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:08.422747 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-00504f56-d3ae-451d-b95d-cc0db60dccfc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:08.475858 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-739168e3-305f-4997-b2de-d6899feaf50b tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:08.484769 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-739168e3-305f-4997-b2de-d6899feaf50b tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942" status: 200 len: 1521 microversion: 2.1 time: 0.161678 Apr 16 21:20:08.485113 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-00504f56-d3ae-451d-b95d-cc0db60dccfc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:08.485357 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1886/3645] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:08 2022] GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:08.493049 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-00504f56-d3ae-451d-b95d-cc0db60dccfc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d" status: 200 len: 1219 microversion: 2.1 time: 0.084976 Apr 16 21:20:08.493629 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1760/3646] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:08 2022] GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:20:08.771952 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6ba8306a-3ef7-4f81-8b62-3f6d7ab05692 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:08.772601 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6ba8306a-3ef7-4f81-8b62-3f6d7ab05692 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] [instance: 3ea60a95-8b64-4410-a953-747f38619ffa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:08.779869 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6ba8306a-3ef7-4f81-8b62-3f6d7ab05692 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:08.780377 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6ba8306a-3ef7-4f81-8b62-3f6d7ab05692 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:08.781164 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6ba8306a-3ef7-4f81-8b62-3f6d7ab05692 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:08.781617 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6ba8306a-3ef7-4f81-8b62-3f6d7ab05692 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:08.921117 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6ba8306a-3ef7-4f81-8b62-3f6d7ab05692 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495514ac1444f17b2b0fe5b8ba534b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cbfdc065da4c4b9f599d9cdd99496d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:08.929666 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6ba8306a-3ef7-4f81-8b62-3f6d7ab05692 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] 10.222.0.20 "GET /compute/v2.1/servers/3ea60a95-8b64-4410-a953-747f38619ffa" status: 200 len: 1514 microversion: 2.1 time: 0.161480 Apr 16 21:20:08.939377 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1887/3647] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:08 2022] GET /compute/v2.1/servers/3ea60a95-8b64-4410-a953-747f38619ffa => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:09.106985 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6d1f41b9-639d-44e4-9ad5-6118cf76aec9 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:09.107648 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6d1f41b9-639d-44e4-9ad5-6118cf76aec9 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:09.113895 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6d1f41b9-639d-44e4-9ad5-6118cf76aec9 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:09.114291 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6d1f41b9-639d-44e4-9ad5-6118cf76aec9 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:09.115149 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6d1f41b9-639d-44e4-9ad5-6118cf76aec9 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:09.115601 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6d1f41b9-639d-44e4-9ad5-6118cf76aec9 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:09.255775 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6d1f41b9-639d-44e4-9ad5-6118cf76aec9 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:09.263931 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6d1f41b9-639d-44e4-9ad5-6118cf76aec9 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 200 len: 1516 microversion: 2.1 time: 0.160871 Apr 16 21:20:09.264535 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1761/3648] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:09 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 1516 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:09.304423 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6dc87326-a902-42c8-b5a0-cbb68c5ce677 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:09.305133 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6dc87326-a902-42c8-b5a0-cbb68c5ce677 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 3834cb63-fcdb-46a3-a476-0ee952c105aa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:09.311740 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6dc87326-a902-42c8-b5a0-cbb68c5ce677 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:09.312219 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6dc87326-a902-42c8-b5a0-cbb68c5ce677 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:09.312998 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6dc87326-a902-42c8-b5a0-cbb68c5ce677 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:09.313438 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6dc87326-a902-42c8-b5a0-cbb68c5ce677 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:09.508330 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-dc2bb3d5-cb28-4a6b-b00f-e0fcd6b8302a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:09.508330 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-dc2bb3d5-cb28-4a6b-b00f-e0fcd6b8302a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: dc95a4d6-f40d-4087-91ae-3038926df942] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:09.511268 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dc2bb3d5-cb28-4a6b-b00f-e0fcd6b8302a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:09.511731 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dc2bb3d5-cb28-4a6b-b00f-e0fcd6b8302a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:09.512728 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dc2bb3d5-cb28-4a6b-b00f-e0fcd6b8302a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:09.513342 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dc2bb3d5-cb28-4a6b-b00f-e0fcd6b8302a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:09.548147 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6dc87326-a902-42c8-b5a0-cbb68c5ce677 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:09.557040 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6dc87326-a902-42c8-b5a0-cbb68c5ce677 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa" status: 200 len: 1334 microversion: 2.1 time: 0.255901 Apr 16 21:20:09.558002 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1888/3649] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:09 2022] GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa => generated 1334 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:09.562784 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e4ed3f0a-15b8-4627-b615-bba5d8cde8c0 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:09.563591 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e4ed3f0a-15b8-4627-b615-bba5d8cde8c0 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:09.570587 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e4ed3f0a-15b8-4627-b615-bba5d8cde8c0 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:09.571300 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e4ed3f0a-15b8-4627-b615-bba5d8cde8c0 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:09.572137 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e4ed3f0a-15b8-4627-b615-bba5d8cde8c0 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:09.572612 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e4ed3f0a-15b8-4627-b615-bba5d8cde8c0 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:09.666561 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-dc2bb3d5-cb28-4a6b-b00f-e0fcd6b8302a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:09.674691 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-dc2bb3d5-cb28-4a6b-b00f-e0fcd6b8302a tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942" status: 200 len: 1521 microversion: 2.1 time: 0.175328 Apr 16 21:20:09.675279 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1762/3650] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:09 2022] GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:09.696798 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e4ed3f0a-15b8-4627-b615-bba5d8cde8c0 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:09.709160 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e4ed3f0a-15b8-4627-b615-bba5d8cde8c0 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d" status: 200 len: 1267 microversion: 2.1 time: 0.149637 Apr 16 21:20:09.718926 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1889/3651] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:09 2022] GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:09.947350 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-17b2d631-0469-4c3d-a1af-be564c237b58 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:09.948100 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-17b2d631-0469-4c3d-a1af-be564c237b58 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] [instance: 3ea60a95-8b64-4410-a953-747f38619ffa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:09.954721 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-17b2d631-0469-4c3d-a1af-be564c237b58 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:09.955190 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-17b2d631-0469-4c3d-a1af-be564c237b58 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:09.956784 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-17b2d631-0469-4c3d-a1af-be564c237b58 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:09.956784 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-17b2d631-0469-4c3d-a1af-be564c237b58 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:10.092287 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-02449da1-3c45-4cdc-a8df-d3882e3720be req-72e1ae0a-0f58-4f06-a098-99cd328c5ce2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ea60a95-8b64-4410-a953-747f38619ffa", "name": "network-vif-deleted", "tag": "da5c53cc-6d81-4340-85c9-4cb9fd280548"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:20:10.103806 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-02449da1-3c45-4cdc-a8df-d3882e3720be req-72e1ae0a-0f58-4f06-a098-99cd328c5ce2 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:10.104424 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-02449da1-3c45-4cdc-a8df-d3882e3720be req-72e1ae0a-0f58-4f06-a098-99cd328c5ce2 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:10.109680 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-17b2d631-0469-4c3d-a1af-be564c237b58 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495514ac1444f17b2b0fe5b8ba534b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cbfdc065da4c4b9f599d9cdd99496d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:10.117276 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-02449da1-3c45-4cdc-a8df-d3882e3720be req-72e1ae0a-0f58-4f06-a098-99cd328c5ce2 service nova] Creating event network-vif-deleted:da5c53cc-6d81-4340-85c9-4cb9fd280548 for instance 3ea60a95-8b64-4410-a953-747f38619ffa on nch2-master-1 Apr 16 21:20:10.117769 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-17b2d631-0469-4c3d-a1af-be564c237b58 tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] 10.222.0.20 "GET /compute/v2.1/servers/3ea60a95-8b64-4410-a953-747f38619ffa" status: 200 len: 1472 microversion: 2.1 time: 0.174610 Apr 16 21:20:10.119859 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1763/3652] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:09 2022] GET /compute/v2.1/servers/3ea60a95-8b64-4410-a953-747f38619ffa => generated 1472 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:10.148140 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-02449da1-3c45-4cdc-a8df-d3882e3720be req-72e1ae0a-0f58-4f06-a098-99cd328c5ce2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062411 Apr 16 21:20:10.150616 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1890/3653] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:20:10.281426 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1bdc9931-4eb9-4cce-8fcb-9a24f189db39 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:10.282818 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1bdc9931-4eb9-4cce-8fcb-9a24f189db39 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:10.289758 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1bdc9931-4eb9-4cce-8fcb-9a24f189db39 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:10.290322 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1bdc9931-4eb9-4cce-8fcb-9a24f189db39 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:10.298112 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1bdc9931-4eb9-4cce-8fcb-9a24f189db39 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:10.301053 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1bdc9931-4eb9-4cce-8fcb-9a24f189db39 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:10.581225 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3cde778a-ffa7-4d9a-b40e-c7cbc2326b2f tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:10.589230 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3cde778a-ffa7-4d9a-b40e-c7cbc2326b2f tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 3834cb63-fcdb-46a3-a476-0ee952c105aa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:10.590855 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3cde778a-ffa7-4d9a-b40e-c7cbc2326b2f tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:10.591992 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3cde778a-ffa7-4d9a-b40e-c7cbc2326b2f tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:10.593333 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3cde778a-ffa7-4d9a-b40e-c7cbc2326b2f tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:10.594182 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3cde778a-ffa7-4d9a-b40e-c7cbc2326b2f tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:10.702143 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1bdc9931-4eb9-4cce-8fcb-9a24f189db39 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:10.714606 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1bdc9931-4eb9-4cce-8fcb-9a24f189db39 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 200 len: 1516 microversion: 2.1 time: 0.437331 Apr 16 21:20:10.715352 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1764/3654] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:10 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 1516 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:10.726823 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-78f7a110-7834-47bb-a39a-c3af890c16bf tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:10.727580 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-78f7a110-7834-47bb-a39a-c3af890c16bf tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: dc95a4d6-f40d-4087-91ae-3038926df942] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:10.734635 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-78f7a110-7834-47bb-a39a-c3af890c16bf tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:10.735413 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-78f7a110-7834-47bb-a39a-c3af890c16bf tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:10.736400 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-78f7a110-7834-47bb-a39a-c3af890c16bf tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:10.737084 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-78f7a110-7834-47bb-a39a-c3af890c16bf tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:10.837075 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3cde778a-ffa7-4d9a-b40e-c7cbc2326b2f tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:10.848435 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3cde778a-ffa7-4d9a-b40e-c7cbc2326b2f tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa" status: 200 len: 1334 microversion: 2.1 time: 0.272174 Apr 16 21:20:10.851510 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1891/3655] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:10 2022] GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa => generated 1334 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:10.856442 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4e2b2045-4e14-4f2d-8717-c60d0cc71d16 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:10.857282 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4e2b2045-4e14-4f2d-8717-c60d0cc71d16 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:10.865612 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4e2b2045-4e14-4f2d-8717-c60d0cc71d16 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:10.866309 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4e2b2045-4e14-4f2d-8717-c60d0cc71d16 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:10.867248 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4e2b2045-4e14-4f2d-8717-c60d0cc71d16 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:10.867866 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4e2b2045-4e14-4f2d-8717-c60d0cc71d16 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:10.942323 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4e2b2045-4e14-4f2d-8717-c60d0cc71d16 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:10.951206 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4e2b2045-4e14-4f2d-8717-c60d0cc71d16 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d" status: 200 len: 1273 microversion: 2.1 time: 0.099848 Apr 16 21:20:10.952617 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1892/3656] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:10 2022] GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d => generated 1273 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:11.075800 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-78f7a110-7834-47bb-a39a-c3af890c16bf tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '929bcf59f4fb4eb7a8b76809cce91e6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff01c614d0ea4275b713b7e872342151', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:11.091963 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-78f7a110-7834-47bb-a39a-c3af890c16bf tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942" status: 200 len: 1521 microversion: 2.1 time: 0.375212 Apr 16 21:20:11.092709 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1765/3657] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:10 2022] GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942 => generated 1521 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:11.137051 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-18cbab1d-d819-404b-ac06-80c6ad08b2fa tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:11.137751 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-18cbab1d-d819-404b-ac06-80c6ad08b2fa tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] [instance: 3ea60a95-8b64-4410-a953-747f38619ffa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:11.144126 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-18cbab1d-d819-404b-ac06-80c6ad08b2fa tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:11.144742 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-18cbab1d-d819-404b-ac06-80c6ad08b2fa tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:11.145604 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-18cbab1d-d819-404b-ac06-80c6ad08b2fa tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:11.146052 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-18cbab1d-d819-404b-ac06-80c6ad08b2fa tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:11.187157 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-18cbab1d-d819-404b-ac06-80c6ad08b2fa tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:11.190466 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-18cbab1d-d819-404b-ac06-80c6ad08b2fa tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:11.190466 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-18cbab1d-d819-404b-ac06-80c6ad08b2fa tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lazy-loading 'fault' on Instance uuid 3ea60a95-8b64-4410-a953-747f38619ffa {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:20:11.198185 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-bd2933d7-d0e7-43e5-bac7-8f3af8d53f64 req-30677d01-49ef-4e97-99d9-0361ce576b8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc95a4d6-f40d-4087-91ae-3038926df942", "name": "network-vif-deleted", "tag": "ed5b9e7e-736b-4251-8d00-ad2beb4e1443"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:20:11.211915 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-bd2933d7-d0e7-43e5-bac7-8f3af8d53f64 req-30677d01-49ef-4e97-99d9-0361ce576b8e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:11.212406 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-bd2933d7-d0e7-43e5-bac7-8f3af8d53f64 req-30677d01-49ef-4e97-99d9-0361ce576b8e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:11.229958 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-bd2933d7-d0e7-43e5-bac7-8f3af8d53f64 req-30677d01-49ef-4e97-99d9-0361ce576b8e service nova] Creating event network-vif-deleted:ed5b9e7e-736b-4251-8d00-ad2beb4e1443 for instance dc95a4d6-f40d-4087-91ae-3038926df942 on nch1-master-1 Apr 16 21:20:11.247759 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-18cbab1d-d819-404b-ac06-80c6ad08b2fa tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7495514ac1444f17b2b0fe5b8ba534b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3cbfdc065da4c4b9f599d9cdd99496d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:11.269088 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-bd2933d7-d0e7-43e5-bac7-8f3af8d53f64 req-30677d01-49ef-4e97-99d9-0361ce576b8e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074439 Apr 16 21:20:11.270474 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1766/3658] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:20:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:20:11.274087 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-18cbab1d-d819-404b-ac06-80c6ad08b2fa tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] 10.222.0.20 "GET /compute/v2.1/servers/3ea60a95-8b64-4410-a953-747f38619ffa" status: 200 len: 1308 microversion: 2.1 time: 0.141364 Apr 16 21:20:11.275996 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1893/3659] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:11 2022] GET /compute/v2.1/servers/3ea60a95-8b64-4410-a953-747f38619ffa => generated 1308 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:11.737082 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-55092af7-3047-42da-9b81-f79bc06946a4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:11.738437 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-55092af7-3047-42da-9b81-f79bc06946a4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:11.761251 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-55092af7-3047-42da-9b81-f79bc06946a4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:11.761828 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-55092af7-3047-42da-9b81-f79bc06946a4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:11.762726 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-55092af7-3047-42da-9b81-f79bc06946a4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:11.783701 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-55092af7-3047-42da-9b81-f79bc06946a4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:11.873326 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cf84ddd5-b63f-48b6-8d0b-bfc7ce933d0f tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:11.873936 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cf84ddd5-b63f-48b6-8d0b-bfc7ce933d0f tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 3834cb63-fcdb-46a3-a476-0ee952c105aa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:11.908962 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cf84ddd5-b63f-48b6-8d0b-bfc7ce933d0f tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:11.910810 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cf84ddd5-b63f-48b6-8d0b-bfc7ce933d0f tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:11.915118 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cf84ddd5-b63f-48b6-8d0b-bfc7ce933d0f tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:11.919812 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cf84ddd5-b63f-48b6-8d0b-bfc7ce933d0f tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:12.171407 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-55092af7-3047-42da-9b81-f79bc06946a4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:12.184348 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-55092af7-3047-42da-9b81-f79bc06946a4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 200 len: 1516 microversion: 2.1 time: 0.454129 Apr 16 21:20:12.196968 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1767/3660] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:11 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 1516 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:12.207951 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f4cfecfc-e849-49c5-ad83-2ed836480479 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:12.211227 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f4cfecfc-e849-49c5-ad83-2ed836480479 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:12.222264 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f4cfecfc-e849-49c5-ad83-2ed836480479 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:12.223584 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f4cfecfc-e849-49c5-ad83-2ed836480479 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:12.225881 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cf84ddd5-b63f-48b6-8d0b-bfc7ce933d0f tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:12.226571 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f4cfecfc-e849-49c5-ad83-2ed836480479 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:12.227877 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f4cfecfc-e849-49c5-ad83-2ed836480479 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:12.237247 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cf84ddd5-b63f-48b6-8d0b-bfc7ce933d0f tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa" status: 200 len: 1355 microversion: 2.1 time: 0.374612 Apr 16 21:20:12.238007 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1894/3661] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:11 2022] GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa => generated 1355 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:12.253493 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-298e39fe-b445-4bdc-9341-daf62ad50a33 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:12.254597 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-298e39fe-b445-4bdc-9341-daf62ad50a33 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] [instance: dc95a4d6-f40d-4087-91ae-3038926df942] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:12.266273 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-298e39fe-b445-4bdc-9341-daf62ad50a33 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:12.266752 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-298e39fe-b445-4bdc-9341-daf62ad50a33 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:12.267859 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-298e39fe-b445-4bdc-9341-daf62ad50a33 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:12.268664 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-298e39fe-b445-4bdc-9341-daf62ad50a33 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:12.290149 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-298e39fe-b445-4bdc-9341-daf62ad50a33 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] HTTP exception thrown: Instance dc95a4d6-f40d-4087-91ae-3038926df942 could not be found. Apr 16 21:20:12.291135 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-298e39fe-b445-4bdc-9341-daf62ad50a33 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] Returning 404 to user: Instance dc95a4d6-f40d-4087-91ae-3038926df942 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:20:12.292477 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-298e39fe-b445-4bdc-9341-daf62ad50a33 tempest-ServerRescueNegativeTestJSON-1963714062 tempest-ServerRescueNegativeTestJSON-1963714062-project] 10.222.0.20 "GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942" status: 404 len: 111 microversion: 2.1 time: 0.053446 Apr 16 21:20:12.293337 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1895/3662] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:12 2022] GET /compute/v2.1/servers/dc95a4d6-f40d-4087-91ae-3038926df942 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:20:12.302767 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a60acaaa-536b-42db-b2da-6fd9f5d07afc tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:12.303959 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a60acaaa-536b-42db-b2da-6fd9f5d07afc tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] [instance: 3ea60a95-8b64-4410-a953-747f38619ffa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:12.315483 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a60acaaa-536b-42db-b2da-6fd9f5d07afc tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:12.316242 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a60acaaa-536b-42db-b2da-6fd9f5d07afc tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:12.317204 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a60acaaa-536b-42db-b2da-6fd9f5d07afc tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:12.317809 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a60acaaa-536b-42db-b2da-6fd9f5d07afc tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:12.333329 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-a60acaaa-536b-42db-b2da-6fd9f5d07afc tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] HTTP exception thrown: Instance 3ea60a95-8b64-4410-a953-747f38619ffa could not be found. Apr 16 21:20:12.335007 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a60acaaa-536b-42db-b2da-6fd9f5d07afc tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] Returning 404 to user: Instance 3ea60a95-8b64-4410-a953-747f38619ffa could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:20:12.335898 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a60acaaa-536b-42db-b2da-6fd9f5d07afc tempest-VolumesAdminNegativeTest-521471108 tempest-VolumesAdminNegativeTest-521471108-project] 10.222.0.20 "GET /compute/v2.1/servers/3ea60a95-8b64-4410-a953-747f38619ffa" status: 404 len: 111 microversion: 2.1 time: 0.037410 Apr 16 21:20:12.336523 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1896/3663] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:12 2022] GET /compute/v2.1/servers/3ea60a95-8b64-4410-a953-747f38619ffa => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:20:12.677170 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f4cfecfc-e849-49c5-ad83-2ed836480479 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:12.693220 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f4cfecfc-e849-49c5-ad83-2ed836480479 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d" status: 200 len: 1315 microversion: 2.1 time: 0.489386 Apr 16 21:20:12.694519 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1768/3664] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:12 2022] GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d => generated 1315 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:13.203436 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-aa2aae28-c501-40c8-8c9a-4bb1d45817e8 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:13.204075 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-aa2aae28-c501-40c8-8c9a-4bb1d45817e8 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:13.219922 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aa2aae28-c501-40c8-8c9a-4bb1d45817e8 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:13.220426 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aa2aae28-c501-40c8-8c9a-4bb1d45817e8 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:13.221265 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aa2aae28-c501-40c8-8c9a-4bb1d45817e8 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:13.221744 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aa2aae28-c501-40c8-8c9a-4bb1d45817e8 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:13.256352 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ae4922a5-f200-439f-8c9d-d3c1c9648ccb tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:13.256966 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ae4922a5-f200-439f-8c9d-d3c1c9648ccb tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 3834cb63-fcdb-46a3-a476-0ee952c105aa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:13.270697 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ae4922a5-f200-439f-8c9d-d3c1c9648ccb tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:13.271170 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ae4922a5-f200-439f-8c9d-d3c1c9648ccb tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:13.271975 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ae4922a5-f200-439f-8c9d-d3c1c9648ccb tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:13.272462 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ae4922a5-f200-439f-8c9d-d3c1c9648ccb tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:13.640107 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-aa2aae28-c501-40c8-8c9a-4bb1d45817e8 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:13.651392 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-aa2aae28-c501-40c8-8c9a-4bb1d45817e8 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 200 len: 1516 microversion: 2.1 time: 0.452665 Apr 16 21:20:13.658864 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1897/3665] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:13 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 1516 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:13.665720 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-f670f2cb-e40f-486c-94d7-387aec9eedd9 req-27191996-9728-4417-a72b-b2dfd830eb8d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3834cb63-fcdb-46a3-a476-0ee952c105aa", "tag": "d78dc7e0-d571-482d-8de8-d8cf3f516888"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:20:13.696482 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ae4922a5-f200-439f-8c9d-d3c1c9648ccb tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:13.707956 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-f670f2cb-e40f-486c-94d7-387aec9eedd9 req-27191996-9728-4417-a72b-b2dfd830eb8d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:13.712994 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-f670f2cb-e40f-486c-94d7-387aec9eedd9 req-27191996-9728-4417-a72b-b2dfd830eb8d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:13.720145 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ae4922a5-f200-439f-8c9d-d3c1c9648ccb tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa" status: 200 len: 1355 microversion: 2.1 time: 0.467494 Apr 16 21:20:13.723344 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1769/3666] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:13 2022] GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa => generated 1355 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:13.731321 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-a98e488b-7536-484c-b6c0-baf5e4cbf63a req-4411b34f-b1a6-4409-9f32-eab8180a3394 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d", "tag": "c7099d42-164b-4965-be5b-89015762dc0c"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:20:13.733026 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-f670f2cb-e40f-486c-94d7-387aec9eedd9 req-27191996-9728-4417-a72b-b2dfd830eb8d service nova] Creating event network-changed:d78dc7e0-d571-482d-8de8-d8cf3f516888 for instance 3834cb63-fcdb-46a3-a476-0ee952c105aa on nch1-master-1 Apr 16 21:20:13.745340 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-f670f2cb-e40f-486c-94d7-387aec9eedd9 req-27191996-9728-4417-a72b-b2dfd830eb8d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083965 Apr 16 21:20:13.745864 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-a98e488b-7536-484c-b6c0-baf5e4cbf63a req-4411b34f-b1a6-4409-9f32-eab8180a3394 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:13.746575 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1898/3667] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:20:13.747079 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-a98e488b-7536-484c-b6c0-baf5e4cbf63a req-4411b34f-b1a6-4409-9f32-eab8180a3394 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:13.754829 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-44ee99a8-7481-48c7-a3e1-8b684475c3c9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:13.756509 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-44ee99a8-7481-48c7-a3e1-8b684475c3c9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:13.766765 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-44ee99a8-7481-48c7-a3e1-8b684475c3c9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:13.767591 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-44ee99a8-7481-48c7-a3e1-8b684475c3c9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:13.768715 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-44ee99a8-7481-48c7-a3e1-8b684475c3c9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:13.769998 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-44ee99a8-7481-48c7-a3e1-8b684475c3c9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:13.780664 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-a98e488b-7536-484c-b6c0-baf5e4cbf63a req-4411b34f-b1a6-4409-9f32-eab8180a3394 service nova] Creating event network-changed:c7099d42-164b-4965-be5b-89015762dc0c for instance 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d on nch2-master-1 Apr 16 21:20:13.786305 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-a98e488b-7536-484c-b6c0-baf5e4cbf63a req-4411b34f-b1a6-4409-9f32-eab8180a3394 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061523 Apr 16 21:20:13.786986 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1770/3668] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:20:14.147597 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-44ee99a8-7481-48c7-a3e1-8b684475c3c9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:14.166742 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-44ee99a8-7481-48c7-a3e1-8b684475c3c9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d" status: 200 len: 1315 microversion: 2.1 time: 0.416937 Apr 16 21:20:14.167564 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1899/3669] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:13 2022] GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d => generated 1315 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:14.674974 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e9251199-8e0f-4d15-b5bc-1beeb1f42fd9 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:14.676297 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e9251199-8e0f-4d15-b5bc-1beeb1f42fd9 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:14.684597 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e9251199-8e0f-4d15-b5bc-1beeb1f42fd9 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:14.685855 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e9251199-8e0f-4d15-b5bc-1beeb1f42fd9 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:14.686824 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e9251199-8e0f-4d15-b5bc-1beeb1f42fd9 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:14.687952 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e9251199-8e0f-4d15-b5bc-1beeb1f42fd9 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:14.739731 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-313516f2-710e-42d5-a288-f17b6838861f tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:14.740926 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-313516f2-710e-42d5-a288-f17b6838861f tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 3834cb63-fcdb-46a3-a476-0ee952c105aa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:14.749224 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-313516f2-710e-42d5-a288-f17b6838861f tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:14.749692 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-313516f2-710e-42d5-a288-f17b6838861f tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:14.750578 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-313516f2-710e-42d5-a288-f17b6838861f tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:14.751191 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-313516f2-710e-42d5-a288-f17b6838861f tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:14.851033 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e9251199-8e0f-4d15-b5bc-1beeb1f42fd9 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:14.860987 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e9251199-8e0f-4d15-b5bc-1beeb1f42fd9 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 200 len: 1516 microversion: 2.1 time: 0.191600 Apr 16 21:20:14.874507 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1771/3670] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:14 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 1516 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:15.089143 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-313516f2-710e-42d5-a288-f17b6838861f tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:15.097709 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-313516f2-710e-42d5-a288-f17b6838861f tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa" status: 200 len: 1355 microversion: 2.1 time: 0.362657 Apr 16 21:20:15.099930 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1900/3671] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:14 2022] GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa => generated 1355 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:15.185470 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-57072d8b-4933-4507-a0dd-5cae7c150528 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:15.186239 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-57072d8b-4933-4507-a0dd-5cae7c150528 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:15.193652 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-57072d8b-4933-4507-a0dd-5cae7c150528 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:15.194072 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-57072d8b-4933-4507-a0dd-5cae7c150528 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:15.195082 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-57072d8b-4933-4507-a0dd-5cae7c150528 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:15.195537 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-57072d8b-4933-4507-a0dd-5cae7c150528 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:15.574669 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-57072d8b-4933-4507-a0dd-5cae7c150528 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:15.583563 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-57072d8b-4933-4507-a0dd-5cae7c150528 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d" status: 200 len: 1315 microversion: 2.1 time: 0.403177 Apr 16 21:20:15.584497 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1772/3672] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:15 2022] GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d => generated 1315 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:15.765821 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-f17f5b35-eaa1-4917-8397-a9e3006655c4 req-7b0225da-0230-40fd-a841-bcdfd06874db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3834cb63-fcdb-46a3-a476-0ee952c105aa", "tag": "73560328-fd39-40aa-a200-90cf4ec23b1a"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:20:15.775805 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-f17f5b35-eaa1-4917-8397-a9e3006655c4 req-7b0225da-0230-40fd-a841-bcdfd06874db service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:15.776404 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-f17f5b35-eaa1-4917-8397-a9e3006655c4 req-7b0225da-0230-40fd-a841-bcdfd06874db service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:15.789561 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-f17f5b35-eaa1-4917-8397-a9e3006655c4 req-7b0225da-0230-40fd-a841-bcdfd06874db service nova] Creating event network-changed:73560328-fd39-40aa-a200-90cf4ec23b1a for instance 3834cb63-fcdb-46a3-a476-0ee952c105aa on nch1-master-1 Apr 16 21:20:15.794952 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-f17f5b35-eaa1-4917-8397-a9e3006655c4 req-7b0225da-0230-40fd-a841-bcdfd06874db service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033062 Apr 16 21:20:15.796233 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1901/3673] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:20:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:20:15.879291 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-92a954b5-7157-441a-a888-18be034b8480 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:15.881894 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-92a954b5-7157-441a-a888-18be034b8480 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:15.895626 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-92a954b5-7157-441a-a888-18be034b8480 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:15.895626 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-92a954b5-7157-441a-a888-18be034b8480 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:15.897502 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-92a954b5-7157-441a-a888-18be034b8480 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:15.898048 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-92a954b5-7157-441a-a888-18be034b8480 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:16.121635 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-411a26fc-b576-4973-b1f1-f8fecb1998b9 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:16.122798 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-411a26fc-b576-4973-b1f1-f8fecb1998b9 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 3834cb63-fcdb-46a3-a476-0ee952c105aa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:16.141450 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-411a26fc-b576-4973-b1f1-f8fecb1998b9 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:16.142381 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-411a26fc-b576-4973-b1f1-f8fecb1998b9 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:16.143376 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-411a26fc-b576-4973-b1f1-f8fecb1998b9 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:16.146116 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-411a26fc-b576-4973-b1f1-f8fecb1998b9 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:16.333491 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-92a954b5-7157-441a-a888-18be034b8480 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:16.341109 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-92a954b5-7157-441a-a888-18be034b8480 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 200 len: 1516 microversion: 2.1 time: 0.466054 Apr 16 21:20:16.354662 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1773/3674] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:15 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 1516 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:16.535081 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-411a26fc-b576-4973-b1f1-f8fecb1998b9 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:16.552001 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-411a26fc-b576-4973-b1f1-f8fecb1998b9 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa" status: 200 len: 1355 microversion: 2.1 time: 0.436613 Apr 16 21:20:16.552877 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1902/3675] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:16 2022] GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa => generated 1355 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:20:16.601132 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-11c45c4f-fb7c-4e22-ba9a-fb6144e3c2fa tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:16.601720 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-11c45c4f-fb7c-4e22-ba9a-fb6144e3c2fa tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:16.608512 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-11c45c4f-fb7c-4e22-ba9a-fb6144e3c2fa tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:16.608961 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-11c45c4f-fb7c-4e22-ba9a-fb6144e3c2fa tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:16.616282 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-11c45c4f-fb7c-4e22-ba9a-fb6144e3c2fa tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:16.617001 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-11c45c4f-fb7c-4e22-ba9a-fb6144e3c2fa tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:17.198138 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-11c45c4f-fb7c-4e22-ba9a-fb6144e3c2fa tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:17.206033 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-11c45c4f-fb7c-4e22-ba9a-fb6144e3c2fa tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d" status: 200 len: 1315 microversion: 2.1 time: 0.608802 Apr 16 21:20:17.211120 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1774/3676] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:16 2022] GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d => generated 1315 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:17.361644 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a83ba1d2-f4a3-4362-919e-8d3d80e29005 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:17.362276 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a83ba1d2-f4a3-4362-919e-8d3d80e29005 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:17.372817 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a83ba1d2-f4a3-4362-919e-8d3d80e29005 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:17.373631 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a83ba1d2-f4a3-4362-919e-8d3d80e29005 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:17.374623 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a83ba1d2-f4a3-4362-919e-8d3d80e29005 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:17.375284 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a83ba1d2-f4a3-4362-919e-8d3d80e29005 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:17.569358 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-82510f61-4fde-4890-818a-7e693b57fbae tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:17.570367 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-82510f61-4fde-4890-818a-7e693b57fbae tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 3834cb63-fcdb-46a3-a476-0ee952c105aa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:17.577095 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-82510f61-4fde-4890-818a-7e693b57fbae tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:17.577815 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-82510f61-4fde-4890-818a-7e693b57fbae tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:17.578806 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-82510f61-4fde-4890-818a-7e693b57fbae tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:17.579408 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-82510f61-4fde-4890-818a-7e693b57fbae tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:17.902987 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-82510f61-4fde-4890-818a-7e693b57fbae tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:17.912457 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-82510f61-4fde-4890-818a-7e693b57fbae tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa" status: 200 len: 1355 microversion: 2.1 time: 0.347052 Apr 16 21:20:17.913344 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1775/3677] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:17 2022] GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa => generated 1355 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:17.919415 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-a8395262-da23-453c-bf13-4210e75a0771 req-1f0e62b1-626c-4ba5-a2f3-88a132462678 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3834cb63-fcdb-46a3-a476-0ee952c105aa", "tag": "1d3fe823-b5a6-4c8e-9cdc-00fb713b87ac"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:20:17.928438 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-a8395262-da23-453c-bf13-4210e75a0771 req-1f0e62b1-626c-4ba5-a2f3-88a132462678 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:17.929120 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-a8395262-da23-453c-bf13-4210e75a0771 req-1f0e62b1-626c-4ba5-a2f3-88a132462678 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:17.947452 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-a8395262-da23-453c-bf13-4210e75a0771 req-1f0e62b1-626c-4ba5-a2f3-88a132462678 service nova] Creating event network-changed:1d3fe823-b5a6-4c8e-9cdc-00fb713b87ac for instance 3834cb63-fcdb-46a3-a476-0ee952c105aa on nch1-master-1 Apr 16 21:20:17.954270 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-a8395262-da23-453c-bf13-4210e75a0771 req-1f0e62b1-626c-4ba5-a2f3-88a132462678 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039505 Apr 16 21:20:17.955418 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1776/3678] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:20:17.992961 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a83ba1d2-f4a3-4362-919e-8d3d80e29005 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:18.000680 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a83ba1d2-f4a3-4362-919e-8d3d80e29005 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 200 len: 1516 microversion: 2.1 time: 0.642911 Apr 16 21:20:18.001382 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1903/3679] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:17 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 1516 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:18.227519 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ee4b0f74-dc5b-41b6-8925-63aee0fc2590 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:18.228861 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ee4b0f74-dc5b-41b6-8925-63aee0fc2590 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:18.239046 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ee4b0f74-dc5b-41b6-8925-63aee0fc2590 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:18.240041 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ee4b0f74-dc5b-41b6-8925-63aee0fc2590 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:18.245465 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ee4b0f74-dc5b-41b6-8925-63aee0fc2590 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:18.245465 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ee4b0f74-dc5b-41b6-8925-63aee0fc2590 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:18.486171 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ee4b0f74-dc5b-41b6-8925-63aee0fc2590 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:18.500534 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ee4b0f74-dc5b-41b6-8925-63aee0fc2590 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d" status: 200 len: 1315 microversion: 2.1 time: 0.277044 Apr 16 21:20:18.501392 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1777/3680] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:18 2022] GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d => generated 1315 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:18.929348 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-70512c67-3c3f-4d26-9ac8-1ec37babb287 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:18.930048 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-70512c67-3c3f-4d26-9ac8-1ec37babb287 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 3834cb63-fcdb-46a3-a476-0ee952c105aa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:18.939994 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-70512c67-3c3f-4d26-9ac8-1ec37babb287 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:18.940494 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-70512c67-3c3f-4d26-9ac8-1ec37babb287 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:18.941301 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-70512c67-3c3f-4d26-9ac8-1ec37babb287 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:18.941748 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-70512c67-3c3f-4d26-9ac8-1ec37babb287 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:19.018877 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-970f454e-66c5-4107-b6d4-ef88f838125b tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:19.053069 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-970f454e-66c5-4107-b6d4-ef88f838125b tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:19.053069 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-970f454e-66c5-4107-b6d4-ef88f838125b tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:19.053069 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-970f454e-66c5-4107-b6d4-ef88f838125b tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:19.053069 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-970f454e-66c5-4107-b6d4-ef88f838125b tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:19.053069 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-970f454e-66c5-4107-b6d4-ef88f838125b tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:19.294254 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-70512c67-3c3f-4d26-9ac8-1ec37babb287 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:19.307516 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-70512c67-3c3f-4d26-9ac8-1ec37babb287 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa" status: 200 len: 1355 microversion: 2.1 time: 0.381918 Apr 16 21:20:19.319607 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1904/3681] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:18 2022] GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa => generated 1355 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:19.365708 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-970f454e-66c5-4107-b6d4-ef88f838125b tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:19.374378 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-970f454e-66c5-4107-b6d4-ef88f838125b tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 200 len: 1516 microversion: 2.1 time: 0.359868 Apr 16 21:20:19.377757 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1778/3682] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:19 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 1516 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:19.518102 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f2b66ee6-7469-4b25-9ddc-e6822c126419 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:19.518718 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f2b66ee6-7469-4b25-9ddc-e6822c126419 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:19.526918 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f2b66ee6-7469-4b25-9ddc-e6822c126419 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:19.527945 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f2b66ee6-7469-4b25-9ddc-e6822c126419 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:19.529685 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f2b66ee6-7469-4b25-9ddc-e6822c126419 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:19.530939 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f2b66ee6-7469-4b25-9ddc-e6822c126419 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:19.774939 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f2b66ee6-7469-4b25-9ddc-e6822c126419 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:19.783453 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f2b66ee6-7469-4b25-9ddc-e6822c126419 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d" status: 200 len: 1315 microversion: 2.1 time: 0.269758 Apr 16 21:20:19.784405 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1905/3683] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:19 2022] GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:20.326037 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-69f3ed9e-83d1-411f-9f11-d0ebd125c8d7 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:20.326936 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-69f3ed9e-83d1-411f-9f11-d0ebd125c8d7 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 3834cb63-fcdb-46a3-a476-0ee952c105aa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:20.334698 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-69f3ed9e-83d1-411f-9f11-d0ebd125c8d7 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:20.335762 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-69f3ed9e-83d1-411f-9f11-d0ebd125c8d7 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:20.336881 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-69f3ed9e-83d1-411f-9f11-d0ebd125c8d7 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:20.338158 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-69f3ed9e-83d1-411f-9f11-d0ebd125c8d7 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:20.395042 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b2a08a25-b1c3-457c-a297-821b09d1fbd1 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:20.396896 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b2a08a25-b1c3-457c-a297-821b09d1fbd1 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:20.406184 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b2a08a25-b1c3-457c-a297-821b09d1fbd1 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:20.406858 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b2a08a25-b1c3-457c-a297-821b09d1fbd1 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:20.407849 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b2a08a25-b1c3-457c-a297-821b09d1fbd1 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:20.408529 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b2a08a25-b1c3-457c-a297-821b09d1fbd1 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:20.558788 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b2a08a25-b1c3-457c-a297-821b09d1fbd1 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:20.567552 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b2a08a25-b1c3-457c-a297-821b09d1fbd1 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 200 len: 1522 microversion: 2.1 time: 0.177829 Apr 16 21:20:20.576718 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1906/3684] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:20 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:20:20.600564 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-69f3ed9e-83d1-411f-9f11-d0ebd125c8d7 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:20.611826 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-69f3ed9e-83d1-411f-9f11-d0ebd125c8d7 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa" status: 200 len: 1355 microversion: 2.1 time: 0.290873 Apr 16 21:20:20.612689 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1779/3685] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:20 2022] GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa => generated 1355 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:20.800361 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-691b4bbb-f8cb-46cc-ab63-992f4016a8cb tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:20.801154 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-691b4bbb-f8cb-46cc-ab63-992f4016a8cb tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:20.809975 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-691b4bbb-f8cb-46cc-ab63-992f4016a8cb tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:20.810455 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-691b4bbb-f8cb-46cc-ab63-992f4016a8cb tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:20.811390 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-691b4bbb-f8cb-46cc-ab63-992f4016a8cb tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:20.811997 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-691b4bbb-f8cb-46cc-ab63-992f4016a8cb tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:20.827378 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-d117b6bf-ef0b-4329-b9b9-daea109fd40f req-f0579932-5cef-4cbd-9abd-a11050e6a152 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d", "name": "network-vif-plugged", "status": "completed", "tag": "c7099d42-164b-4965-be5b-89015762dc0c"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:20:20.866996 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-d117b6bf-ef0b-4329-b9b9-daea109fd40f req-f0579932-5cef-4cbd-9abd-a11050e6a152 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:20.867575 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-d117b6bf-ef0b-4329-b9b9-daea109fd40f req-f0579932-5cef-4cbd-9abd-a11050e6a152 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:20.891202 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-d117b6bf-ef0b-4329-b9b9-daea109fd40f req-f0579932-5cef-4cbd-9abd-a11050e6a152 service nova] Creating event network-vif-plugged:c7099d42-164b-4965-be5b-89015762dc0c for instance 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d on nch2-master-1 Apr 16 21:20:20.898798 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-d117b6bf-ef0b-4329-b9b9-daea109fd40f req-f0579932-5cef-4cbd-9abd-a11050e6a152 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075511 Apr 16 21:20:20.899697 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1780/3686] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:20:21.105255 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-691b4bbb-f8cb-46cc-ab63-992f4016a8cb tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:21.117128 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-691b4bbb-f8cb-46cc-ab63-992f4016a8cb tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d" status: 200 len: 1315 microversion: 2.1 time: 0.320243 Apr 16 21:20:21.118035 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1907/3687] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:20 2022] GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d => generated 1315 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:21.586940 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-127236b1-c5f0-4d82-a8ce-840fcb3289db tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:21.588189 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-127236b1-c5f0-4d82-a8ce-840fcb3289db tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:21.597161 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-127236b1-c5f0-4d82-a8ce-840fcb3289db tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:21.597702 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-127236b1-c5f0-4d82-a8ce-840fcb3289db tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:21.598809 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-127236b1-c5f0-4d82-a8ce-840fcb3289db tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:21.599413 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-127236b1-c5f0-4d82-a8ce-840fcb3289db tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:21.634828 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bee89c19-1ae2-4a10-95b4-d51e75873be6 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:21.637875 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-bee89c19-1ae2-4a10-95b4-d51e75873be6 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 3834cb63-fcdb-46a3-a476-0ee952c105aa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:21.657392 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bee89c19-1ae2-4a10-95b4-d51e75873be6 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:21.657861 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bee89c19-1ae2-4a10-95b4-d51e75873be6 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:21.658656 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bee89c19-1ae2-4a10-95b4-d51e75873be6 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:21.659128 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bee89c19-1ae2-4a10-95b4-d51e75873be6 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:21.856255 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-bee89c19-1ae2-4a10-95b4-d51e75873be6 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:21.864337 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-bee89c19-1ae2-4a10-95b4-d51e75873be6 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa" status: 200 len: 1355 microversion: 2.1 time: 0.238878 Apr 16 21:20:21.864624 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-127236b1-c5f0-4d82-a8ce-840fcb3289db tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:21.876788 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1908/3688] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:21 2022] GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa => generated 1355 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:21.880338 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-127236b1-c5f0-4d82-a8ce-840fcb3289db tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 200 len: 1522 microversion: 2.1 time: 0.298535 Apr 16 21:20:21.881241 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1781/3689] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:21 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 1522 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:22.134897 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8dc128c7-d898-4e73-a86a-85bfd1d8ccc6 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:22.135669 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8dc128c7-d898-4e73-a86a-85bfd1d8ccc6 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:22.142209 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8dc128c7-d898-4e73-a86a-85bfd1d8ccc6 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:22.142964 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8dc128c7-d898-4e73-a86a-85bfd1d8ccc6 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:22.145116 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8dc128c7-d898-4e73-a86a-85bfd1d8ccc6 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:22.145696 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8dc128c7-d898-4e73-a86a-85bfd1d8ccc6 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:22.341832 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8dc128c7-d898-4e73-a86a-85bfd1d8ccc6 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:22.351406 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8dc128c7-d898-4e73-a86a-85bfd1d8ccc6 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d" status: 200 len: 1315 microversion: 2.1 time: 0.219930 Apr 16 21:20:22.362974 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1909/3690] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:22 2022] GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:22.882662 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-30db06fa-f581-41f0-bd33-7ec379ba86bb tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:22.884026 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-30db06fa-f581-41f0-bd33-7ec379ba86bb tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 3834cb63-fcdb-46a3-a476-0ee952c105aa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:22.897501 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-30db06fa-f581-41f0-bd33-7ec379ba86bb tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:22.897763 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a5dae475-3322-4493-bcf4-473618e67883 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:22.900561 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a5dae475-3322-4493-bcf4-473618e67883 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:22.901328 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-30db06fa-f581-41f0-bd33-7ec379ba86bb tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:22.903047 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-30db06fa-f581-41f0-bd33-7ec379ba86bb tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:22.905489 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-30db06fa-f581-41f0-bd33-7ec379ba86bb tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:22.908123 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a5dae475-3322-4493-bcf4-473618e67883 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:22.920983 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a5dae475-3322-4493-bcf4-473618e67883 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:22.922200 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a5dae475-3322-4493-bcf4-473618e67883 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:22.922881 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a5dae475-3322-4493-bcf4-473618e67883 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:23.138461 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a5dae475-3322-4493-bcf4-473618e67883 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:23.146759 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a5dae475-3322-4493-bcf4-473618e67883 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 200 len: 1522 microversion: 2.1 time: 0.252780 Apr 16 21:20:23.148047 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1910/3691] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:22 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:20:23.153026 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-28de6f53-a128-4da6-b10f-a166df85f8c4 req-87b46e89-35b2-4076-b162-323052b79207 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b0c963a-7042-4bca-9d87-6b90beed5f18", "name": "network-vif-unplugged", "status": "completed", "tag": "afda655b-bf23-4e30-b6df-18f670dcee9f"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:20:23.162888 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-28de6f53-a128-4da6-b10f-a166df85f8c4 req-87b46e89-35b2-4076-b162-323052b79207 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:23.163843 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-28de6f53-a128-4da6-b10f-a166df85f8c4 req-87b46e89-35b2-4076-b162-323052b79207 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:23.179131 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-28de6f53-a128-4da6-b10f-a166df85f8c4 req-87b46e89-35b2-4076-b162-323052b79207 service nova] Creating event network-vif-unplugged:afda655b-bf23-4e30-b6df-18f670dcee9f for instance 6b0c963a-7042-4bca-9d87-6b90beed5f18 on nch1-master-1 Apr 16 21:20:23.196046 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-28de6f53-a128-4da6-b10f-a166df85f8c4 req-87b46e89-35b2-4076-b162-323052b79207 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046494 Apr 16 21:20:23.197246 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1911/3692] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:20:23.239797 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-30db06fa-f581-41f0-bd33-7ec379ba86bb tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:23.249576 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-30db06fa-f581-41f0-bd33-7ec379ba86bb tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa" status: 200 len: 1355 microversion: 2.1 time: 0.371183 Apr 16 21:20:23.254814 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1782/3693] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:22 2022] GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa => generated 1355 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:23.369511 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-02172869-571c-4725-a1c5-3eed0b7c564f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:23.370225 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-02172869-571c-4725-a1c5-3eed0b7c564f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:23.380675 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-02172869-571c-4725-a1c5-3eed0b7c564f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:23.382381 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-02172869-571c-4725-a1c5-3eed0b7c564f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:23.383212 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-02172869-571c-4725-a1c5-3eed0b7c564f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:23.383662 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-02172869-571c-4725-a1c5-3eed0b7c564f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:23.623200 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-02172869-571c-4725-a1c5-3eed0b7c564f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:23.649269 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-30db06fa-f581-41f0-bd33-7ec379ba86bb tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:23.650334 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-02172869-571c-4725-a1c5-3eed0b7c564f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d" status: 200 len: 1501 microversion: 2.1 time: 0.278557 Apr 16 21:20:23.650852 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-30db06fa-f581-41f0-bd33-7ec379ba86bb tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001933 Apr 16 21:20:23.651248 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1783/3694] 10.222.0.20 () {56 vars in 885 bytes} [Sat Apr 16 21:20:23 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Apr 16 21:20:23.653271 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1912/3695] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:23 2022] GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d => generated 1501 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:23.671731 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c2fa5046-c8e4-4aa7-abfb-6f4dd6e3d2a9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:20:23.672827 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c2fa5046-c8e4-4aa7-abfb-6f4dd6e3d2a9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:23.682615 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c2fa5046-c8e4-4aa7-abfb-6f4dd6e3d2a9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:23.683390 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c2fa5046-c8e4-4aa7-abfb-6f4dd6e3d2a9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:23.684477 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c2fa5046-c8e4-4aa7-abfb-6f4dd6e3d2a9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:23.685164 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c2fa5046-c8e4-4aa7-abfb-6f4dd6e3d2a9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:23.913948 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c2fa5046-c8e4-4aa7-abfb-6f4dd6e3d2a9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "POST /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d/action" status: 202 len: 0 microversion: 2.1 time: 0.246031 Apr 16 21:20:23.926033 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a48c1d79-7552-4243-8df6-8b72b2f0d67c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:23.927396 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a48c1d79-7552-4243-8df6-8b72b2f0d67c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:23.932898 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1784/3696] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:20:23 2022] POST /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d/action => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:20:23.936661 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a48c1d79-7552-4243-8df6-8b72b2f0d67c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:23.937478 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a48c1d79-7552-4243-8df6-8b72b2f0d67c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:23.939812 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a48c1d79-7552-4243-8df6-8b72b2f0d67c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:23.940558 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a48c1d79-7552-4243-8df6-8b72b2f0d67c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:24.159438 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a48c1d79-7552-4243-8df6-8b72b2f0d67c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:24.166536 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-56bae6f1-f1a3-4b5f-8612-d0036c7c5954 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:24.173699 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-56bae6f1-f1a3-4b5f-8612-d0036c7c5954 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:24.173842 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a48c1d79-7552-4243-8df6-8b72b2f0d67c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d" status: 200 len: 1506 microversion: 2.1 time: 0.248390 Apr 16 21:20:24.173842 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1913/3697] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:23 2022] GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d => generated 1506 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:24.186355 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-56bae6f1-f1a3-4b5f-8612-d0036c7c5954 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:24.187059 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-56bae6f1-f1a3-4b5f-8612-d0036c7c5954 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:24.188105 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-56bae6f1-f1a3-4b5f-8612-d0036c7c5954 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:24.188818 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-56bae6f1-f1a3-4b5f-8612-d0036c7c5954 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:24.278159 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-624bcabe-c98d-44e3-ae9f-4366470c1277 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:24.279296 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-624bcabe-c98d-44e3-ae9f-4366470c1277 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 3834cb63-fcdb-46a3-a476-0ee952c105aa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:24.289154 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-624bcabe-c98d-44e3-ae9f-4366470c1277 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:24.289888 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-624bcabe-c98d-44e3-ae9f-4366470c1277 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:24.291179 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-624bcabe-c98d-44e3-ae9f-4366470c1277 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:24.291804 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-624bcabe-c98d-44e3-ae9f-4366470c1277 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:24.490061 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-624bcabe-c98d-44e3-ae9f-4366470c1277 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:24.500469 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-624bcabe-c98d-44e3-ae9f-4366470c1277 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa" status: 200 len: 1355 microversion: 2.1 time: 0.226961 Apr 16 21:20:24.501067 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1914/3698] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:24 2022] GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa => generated 1355 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:20:24.663830 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-56bae6f1-f1a3-4b5f-8612-d0036c7c5954 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:24.679582 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-56bae6f1-f1a3-4b5f-8612-d0036c7c5954 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 200 len: 1522 microversion: 2.1 time: 0.518036 Apr 16 21:20:24.682527 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1785/3699] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:24 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 1522 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:25.186548 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-52a4a305-9890-497e-a324-899f4596684a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:25.189704 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-52a4a305-9890-497e-a324-899f4596684a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:25.204382 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-52a4a305-9890-497e-a324-899f4596684a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:25.204869 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-52a4a305-9890-497e-a324-899f4596684a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:25.205671 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-52a4a305-9890-497e-a324-899f4596684a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:25.206116 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-52a4a305-9890-497e-a324-899f4596684a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:25.449030 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-52a4a305-9890-497e-a324-899f4596684a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:25.457427 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-52a4a305-9890-497e-a324-899f4596684a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d" status: 200 len: 1486 microversion: 2.1 time: 0.274964 Apr 16 21:20:25.461117 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1915/3700] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:25 2022] GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d => generated 1486 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:25.474969 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f796c931-242e-4fe8-8416-40fdffd41fd7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:20:25.475522 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f796c931-242e-4fe8-8416-40fdffd41fd7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:25.482678 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f796c931-242e-4fe8-8416-40fdffd41fd7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:25.483517 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f796c931-242e-4fe8-8416-40fdffd41fd7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:25.484721 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f796c931-242e-4fe8-8416-40fdffd41fd7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:25.485331 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f796c931-242e-4fe8-8416-40fdffd41fd7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:25.520306 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-76b43b73-376d-4c4a-9edc-1d64854316b0 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:25.521049 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-76b43b73-376d-4c4a-9edc-1d64854316b0 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 3834cb63-fcdb-46a3-a476-0ee952c105aa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:25.527469 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-f796c931-242e-4fe8-8416-40fdffd41fd7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lazy-loading 'flavor' on Instance uuid 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:20:25.540494 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-76b43b73-376d-4c4a-9edc-1d64854316b0 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:25.544481 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-76b43b73-376d-4c4a-9edc-1d64854316b0 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:25.549353 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-76b43b73-376d-4c4a-9edc-1d64854316b0 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:25.550113 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-76b43b73-376d-4c4a-9edc-1d64854316b0 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:25.857403 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-76b43b73-376d-4c4a-9edc-1d64854316b0 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:25.865391 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-76b43b73-376d-4c4a-9edc-1d64854316b0 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa" status: 200 len: 1355 microversion: 2.1 time: 0.351538 Apr 16 21:20:25.865988 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1916/3701] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:25 2022] GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa => generated 1355 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:25.879784 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b89792a2-db1e-4f69-a8d4-3ba87e1ecdfc tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:25.880767 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b89792a2-db1e-4f69-a8d4-3ba87e1ecdfc tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:25.901884 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b89792a2-db1e-4f69-a8d4-3ba87e1ecdfc tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:25.902356 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b89792a2-db1e-4f69-a8d4-3ba87e1ecdfc tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:25.903242 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b89792a2-db1e-4f69-a8d4-3ba87e1ecdfc tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:25.903949 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b89792a2-db1e-4f69-a8d4-3ba87e1ecdfc tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:26.091782 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b89792a2-db1e-4f69-a8d4-3ba87e1ecdfc tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:26.101812 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b89792a2-db1e-4f69-a8d4-3ba87e1ecdfc tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 200 len: 1522 microversion: 2.1 time: 0.234704 Apr 16 21:20:26.102617 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1917/3702] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:25 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:26.293243 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f796c931-242e-4fe8-8416-40fdffd41fd7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "POST /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d/action" status: 202 len: 0 microversion: 2.1 time: 0.821748 Apr 16 21:20:26.302953 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b008b847-9c7c-4a23-af02-ec392bba5133 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:26.304938 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b008b847-9c7c-4a23-af02-ec392bba5133 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:26.307715 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1786/3703] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:20:25 2022] POST /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d/action => generated 0 bytes in 824 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:20:26.328476 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b008b847-9c7c-4a23-af02-ec392bba5133 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:26.329270 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b008b847-9c7c-4a23-af02-ec392bba5133 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:26.330555 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b008b847-9c7c-4a23-af02-ec392bba5133 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:26.331227 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b008b847-9c7c-4a23-af02-ec392bba5133 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:26.526499 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b008b847-9c7c-4a23-af02-ec392bba5133 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:26.535651 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b008b847-9c7c-4a23-af02-ec392bba5133 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d" status: 200 len: 1492 microversion: 2.1 time: 0.237246 Apr 16 21:20:26.536863 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1918/3704] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:26 2022] GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d => generated 1492 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:20:26.886517 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b76a1d05-a5c2-46c8-ae54-b24b5c931eee tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:26.886517 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b76a1d05-a5c2-46c8-ae54-b24b5c931eee tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 3834cb63-fcdb-46a3-a476-0ee952c105aa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:26.891836 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b76a1d05-a5c2-46c8-ae54-b24b5c931eee tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:26.892425 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b76a1d05-a5c2-46c8-ae54-b24b5c931eee tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:26.893515 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b76a1d05-a5c2-46c8-ae54-b24b5c931eee tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:26.894143 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b76a1d05-a5c2-46c8-ae54-b24b5c931eee tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:27.124939 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-899b8397-5402-4b43-a0ac-20f4708fb100 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:27.125788 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-899b8397-5402-4b43-a0ac-20f4708fb100 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:27.137766 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-899b8397-5402-4b43-a0ac-20f4708fb100 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:27.138351 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-899b8397-5402-4b43-a0ac-20f4708fb100 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:27.139650 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-899b8397-5402-4b43-a0ac-20f4708fb100 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:27.142174 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-899b8397-5402-4b43-a0ac-20f4708fb100 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:27.372861 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b76a1d05-a5c2-46c8-ae54-b24b5c931eee tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:27.389472 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b76a1d05-a5c2-46c8-ae54-b24b5c931eee tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa" status: 200 len: 1355 microversion: 2.1 time: 0.510079 Apr 16 21:20:27.401376 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1787/3705] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:26 2022] GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa => generated 1355 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:27.554083 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2dd3b6a6-0e82-48dc-8326-bc3bfaab9c27 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:27.555409 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2dd3b6a6-0e82-48dc-8326-bc3bfaab9c27 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:27.565088 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2dd3b6a6-0e82-48dc-8326-bc3bfaab9c27 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:27.565567 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2dd3b6a6-0e82-48dc-8326-bc3bfaab9c27 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:27.566448 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2dd3b6a6-0e82-48dc-8326-bc3bfaab9c27 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:27.567075 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2dd3b6a6-0e82-48dc-8326-bc3bfaab9c27 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:27.693453 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-899b8397-5402-4b43-a0ac-20f4708fb100 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:27.725240 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-899b8397-5402-4b43-a0ac-20f4708fb100 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 200 len: 1522 microversion: 2.1 time: 0.603642 Apr 16 21:20:27.739133 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1919/3706] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:27 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 1522 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:27.858578 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2dd3b6a6-0e82-48dc-8326-bc3bfaab9c27 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:27.867956 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2dd3b6a6-0e82-48dc-8326-bc3bfaab9c27 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d" status: 200 len: 1492 microversion: 2.1 time: 0.318949 Apr 16 21:20:27.869816 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1788/3707] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:27 2022] GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d => generated 1492 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:28.409557 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7cea2258-6a31-4fcd-a62c-88cdb0494726 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:28.410605 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7cea2258-6a31-4fcd-a62c-88cdb0494726 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 3834cb63-fcdb-46a3-a476-0ee952c105aa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:28.422707 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7cea2258-6a31-4fcd-a62c-88cdb0494726 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:28.427552 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7cea2258-6a31-4fcd-a62c-88cdb0494726 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:28.427552 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7cea2258-6a31-4fcd-a62c-88cdb0494726 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:28.427552 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7cea2258-6a31-4fcd-a62c-88cdb0494726 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:28.743120 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a8298b56-0cdb-4df5-918a-225df6a5e9c5 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:28.744324 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a8298b56-0cdb-4df5-918a-225df6a5e9c5 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:28.766814 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a8298b56-0cdb-4df5-918a-225df6a5e9c5 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:28.767289 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a8298b56-0cdb-4df5-918a-225df6a5e9c5 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:28.768097 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a8298b56-0cdb-4df5-918a-225df6a5e9c5 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:28.768603 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a8298b56-0cdb-4df5-918a-225df6a5e9c5 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:28.905676 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7cea2258-6a31-4fcd-a62c-88cdb0494726 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:28.916013 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7cea2258-6a31-4fcd-a62c-88cdb0494726 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa" status: 200 len: 1355 microversion: 2.1 time: 0.512660 Apr 16 21:20:28.916632 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1920/3708] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:28 2022] GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa => generated 1355 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:28.943245 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5ad83407-424d-4394-8b51-91d1834ccc8c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:28.949897 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5ad83407-424d-4394-8b51-91d1834ccc8c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:28.964328 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5ad83407-424d-4394-8b51-91d1834ccc8c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:28.971218 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5ad83407-424d-4394-8b51-91d1834ccc8c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:28.972342 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5ad83407-424d-4394-8b51-91d1834ccc8c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:28.974406 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5ad83407-424d-4394-8b51-91d1834ccc8c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:29.104839 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a8298b56-0cdb-4df5-918a-225df6a5e9c5 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:29.113865 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a8298b56-0cdb-4df5-918a-225df6a5e9c5 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 200 len: 1522 microversion: 2.1 time: 0.374904 Apr 16 21:20:29.114458 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1789/3709] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:28 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 1522 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:20:29.273026 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7d17d287-6f89-4680-862b-b8b73152fffe tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-117323199", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "de9da8f1-3ad8-4653-830f-a88f9ba49f3e"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:20:29.301127 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5ad83407-424d-4394-8b51-91d1834ccc8c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:29.313123 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5ad83407-424d-4394-8b51-91d1834ccc8c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d" status: 200 len: 1513 microversion: 2.1 time: 0.375777 Apr 16 21:20:29.313738 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1921/3710] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:28 2022] GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d => generated 1513 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:29.329041 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-f8c37791-848c-4600-a79c-057b8812bbc1 req-10fcfdb8-a0c9-4fe2-90d7-c990a95198b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b0c963a-7042-4bca-9d87-6b90beed5f18", "name": "network-vif-plugged", "status": "completed", "tag": "afda655b-bf23-4e30-b6df-18f670dcee9f"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:20:29.358333 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-f8c37791-848c-4600-a79c-057b8812bbc1 req-10fcfdb8-a0c9-4fe2-90d7-c990a95198b5 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:29.358794 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-f8c37791-848c-4600-a79c-057b8812bbc1 req-10fcfdb8-a0c9-4fe2-90d7-c990a95198b5 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:29.392518 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-f8c37791-848c-4600-a79c-057b8812bbc1 req-10fcfdb8-a0c9-4fe2-90d7-c990a95198b5 service nova] Creating event network-vif-plugged:afda655b-bf23-4e30-b6df-18f670dcee9f for instance 6b0c963a-7042-4bca-9d87-6b90beed5f18 on nch1-master-1 Apr 16 21:20:29.420960 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-7d17d287-6f89-4680-862b-b8b73152fffe tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] validate_networks() for [('de9da8f1-3ad8-4653-830f-a88f9ba49f3e', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:20:29.427753 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-f8c37791-848c-4600-a79c-057b8812bbc1 req-10fcfdb8-a0c9-4fe2-90d7-c990a95198b5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099679 Apr 16 21:20:29.428753 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1922/3711] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:20:29.935368 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e309eee9-4555-4afe-9d66-7684a58b3483 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:29.936229 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e309eee9-4555-4afe-9d66-7684a58b3483 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 3834cb63-fcdb-46a3-a476-0ee952c105aa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:29.968757 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e309eee9-4555-4afe-9d66-7684a58b3483 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:29.969548 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e309eee9-4555-4afe-9d66-7684a58b3483 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:29.970796 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e309eee9-4555-4afe-9d66-7684a58b3483 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:29.972028 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e309eee9-4555-4afe-9d66-7684a58b3483 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:30.183150 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-7d17d287-6f89-4680-862b-b8b73152fffe tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:20:30.184480 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-7d17d287-6f89-4680-862b-b8b73152fffe tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:20:30.185141 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-7d17d287-6f89-4680-862b-b8b73152fffe tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:20:30.185732 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-7d17d287-6f89-4680-862b-b8b73152fffe tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:20:30.186415 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-7d17d287-6f89-4680-862b-b8b73152fffe tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:20:30.207388 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7d17d287-6f89-4680-862b-b8b73152fffe tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:30.210497 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7d17d287-6f89-4680-862b-b8b73152fffe tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:30.212823 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7d17d287-6f89-4680-862b-b8b73152fffe tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:30.213628 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7d17d287-6f89-4680-862b-b8b73152fffe tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:30.244536 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-7d17d287-6f89-4680-862b-b8b73152fffe tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Getting quotas for project 1fb0e213bd0d40ee9e832b54607028ab. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:20:30.255881 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-7d17d287-6f89-4680-862b-b8b73152fffe tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Getting quotas for user 4866b2c7b7d248539783664403807b09 and project 1fb0e213bd0d40ee9e832b54607028ab. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:20:30.277055 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7d17d287-6f89-4680-862b-b8b73152fffe tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:20:30.279945 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7d17d287-6f89-4680-862b-b8b73152fffe tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: 82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:20:30.417761 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7d17d287-6f89-4680-862b-b8b73152fffe tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.299341 Apr 16 21:20:30.419163 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1790/3712] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:20:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1304 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:20:30.429417 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d35dda74-493d-464c-bcc4-b665a3f4ec94 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:30.430385 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d35dda74-493d-464c-bcc4-b665a3f4ec94 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:30.439961 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d35dda74-493d-464c-bcc4-b665a3f4ec94 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:30.440673 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d35dda74-493d-464c-bcc4-b665a3f4ec94 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:30.441629 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d35dda74-493d-464c-bcc4-b665a3f4ec94 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:30.442234 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d35dda74-493d-464c-bcc4-b665a3f4ec94 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:30.610929 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e309eee9-4555-4afe-9d66-7684a58b3483 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:30.618065 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e309eee9-4555-4afe-9d66-7684a58b3483 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa" status: 200 len: 1355 microversion: 2.1 time: 0.686261 Apr 16 21:20:30.618065 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1923/3713] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:29 2022] GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa => generated 1355 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:20:30.621969 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e4a26af8-fb16-47d7-b6b1-e32ddd96095c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:30.622716 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e4a26af8-fb16-47d7-b6b1-e32ddd96095c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:30.630176 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e4a26af8-fb16-47d7-b6b1-e32ddd96095c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:30.630787 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e4a26af8-fb16-47d7-b6b1-e32ddd96095c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:30.631699 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e4a26af8-fb16-47d7-b6b1-e32ddd96095c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:30.632282 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e4a26af8-fb16-47d7-b6b1-e32ddd96095c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:30.835573 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e4a26af8-fb16-47d7-b6b1-e32ddd96095c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:30.845131 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e4a26af8-fb16-47d7-b6b1-e32ddd96095c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d" status: 200 len: 1513 microversion: 2.1 time: 0.227135 Apr 16 21:20:30.846152 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1924/3714] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:30 2022] GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d => generated 1513 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:30.850999 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d35dda74-493d-464c-bcc4-b665a3f4ec94 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:30.853630 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7bb3257e-d25e-4c75-98bb-a4041b2a4444 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:30.854418 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7bb3257e-d25e-4c75-98bb-a4041b2a4444 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: 82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:30.869133 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d35dda74-493d-464c-bcc4-b665a3f4ec94 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 200 len: 1522 microversion: 2.1 time: 0.440939 Apr 16 21:20:30.869133 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1791/3715] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:30 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 1522 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:30.940097 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7bb3257e-d25e-4c75-98bb-a4041b2a4444 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4866b2c7b7d248539783664403807b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb0e213bd0d40ee9e832b54607028ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:30.949162 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7bb3257e-d25e-4c75-98bb-a4041b2a4444 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] 10.222.0.20 "GET /compute/v2.1/servers/82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3" status: 200 len: 1223 microversion: 2.1 time: 0.101105 Apr 16 21:20:30.953383 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1925/3716] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:30 2022] GET /compute/v2.1/servers/82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3 => generated 1223 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:31.125442 ncdv-master-1 devstack@n-api.service[137409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 21:20:31.125442 ncdv-master-1 devstack@n-api.service[137409]: Sat Apr 16 21:20:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 21:20:31.633050 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-835bd645-5d36-4af2-9088-10f4e72f27a0 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:31.634619 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-835bd645-5d36-4af2-9088-10f4e72f27a0 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 3834cb63-fcdb-46a3-a476-0ee952c105aa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:31.656132 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-835bd645-5d36-4af2-9088-10f4e72f27a0 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:31.656132 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-835bd645-5d36-4af2-9088-10f4e72f27a0 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:31.656132 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-835bd645-5d36-4af2-9088-10f4e72f27a0 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:31.656132 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-835bd645-5d36-4af2-9088-10f4e72f27a0 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:31.678453 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-8acff3d3-aed9-4945-8ebc-1841e842523d req-8af88b50-e451-4d3a-9d78-3d826691276b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3834cb63-fcdb-46a3-a476-0ee952c105aa", "name": "network-vif-plugged", "status": "completed", "tag": "d78dc7e0-d571-482d-8de8-d8cf3f516888"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:20:31.693704 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-8acff3d3-aed9-4945-8ebc-1841e842523d req-8af88b50-e451-4d3a-9d78-3d826691276b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:31.694223 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-8acff3d3-aed9-4945-8ebc-1841e842523d req-8af88b50-e451-4d3a-9d78-3d826691276b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:31.709076 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-8acff3d3-aed9-4945-8ebc-1841e842523d req-8af88b50-e451-4d3a-9d78-3d826691276b service nova] Creating event network-vif-plugged:d78dc7e0-d571-482d-8de8-d8cf3f516888 for instance 3834cb63-fcdb-46a3-a476-0ee952c105aa on nch1-master-1 Apr 16 21:20:31.723346 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-8acff3d3-aed9-4945-8ebc-1841e842523d req-8af88b50-e451-4d3a-9d78-3d826691276b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055309 Apr 16 21:20:31.726592 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1926/3717] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:20:31.827405 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-835bd645-5d36-4af2-9088-10f4e72f27a0 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:31.835981 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-835bd645-5d36-4af2-9088-10f4e72f27a0 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa" status: 200 len: 1355 microversion: 2.1 time: 0.207538 Apr 16 21:20:31.846659 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1792/3718] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:31 2022] GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa => generated 1355 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:31.864272 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ee2ab7fe-ce93-4674-af4c-c5fa79a4ce2b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:31.865387 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ee2ab7fe-ce93-4674-af4c-c5fa79a4ce2b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:31.873397 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee2ab7fe-ce93-4674-af4c-c5fa79a4ce2b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:31.876421 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee2ab7fe-ce93-4674-af4c-c5fa79a4ce2b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:31.876421 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee2ab7fe-ce93-4674-af4c-c5fa79a4ce2b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:31.876421 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee2ab7fe-ce93-4674-af4c-c5fa79a4ce2b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:31.888678 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-793b11ef-8f0e-41b7-ad42-c59f546e67c7 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:31.889390 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-793b11ef-8f0e-41b7-ad42-c59f546e67c7 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:31.908200 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-793b11ef-8f0e-41b7-ad42-c59f546e67c7 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:31.908680 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-793b11ef-8f0e-41b7-ad42-c59f546e67c7 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:31.909656 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-793b11ef-8f0e-41b7-ad42-c59f546e67c7 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:31.910178 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-793b11ef-8f0e-41b7-ad42-c59f546e67c7 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:32.156910 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-793b11ef-8f0e-41b7-ad42-c59f546e67c7 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:32.174574 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-793b11ef-8f0e-41b7-ad42-c59f546e67c7 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 200 len: 1507 microversion: 2.1 time: 0.290846 Apr 16 21:20:32.181084 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1793/3719] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:31 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 1507 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:32.191706 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1f6dd679-8bbf-4c41-8c14-adafa594b3b5 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:32.193834 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1f6dd679-8bbf-4c41-8c14-adafa594b3b5 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: 82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:32.205752 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1f6dd679-8bbf-4c41-8c14-adafa594b3b5 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:32.205930 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ee2ab7fe-ce93-4674-af4c-c5fa79a4ce2b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:32.206357 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1f6dd679-8bbf-4c41-8c14-adafa594b3b5 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:32.207071 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1f6dd679-8bbf-4c41-8c14-adafa594b3b5 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:32.207844 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1f6dd679-8bbf-4c41-8c14-adafa594b3b5 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:32.224128 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ee2ab7fe-ce93-4674-af4c-c5fa79a4ce2b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d" status: 200 len: 1513 microversion: 2.1 time: 0.364749 Apr 16 21:20:32.224809 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1927/3720] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:31 2022] GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d => generated 1513 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:32.232079 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ad58fde8-2718-4737-af4a-2ae3b8bc73ba tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:32.233469 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ad58fde8-2718-4737-af4a-2ae3b8bc73ba tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:32.243357 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ad58fde8-2718-4737-af4a-2ae3b8bc73ba tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:32.244043 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ad58fde8-2718-4737-af4a-2ae3b8bc73ba tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:32.245535 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ad58fde8-2718-4737-af4a-2ae3b8bc73ba tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:32.246532 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ad58fde8-2718-4737-af4a-2ae3b8bc73ba tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:32.326248 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1f6dd679-8bbf-4c41-8c14-adafa594b3b5 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4866b2c7b7d248539783664403807b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb0e213bd0d40ee9e832b54607028ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:32.339220 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1f6dd679-8bbf-4c41-8c14-adafa594b3b5 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] 10.222.0.20 "GET /compute/v2.1/servers/82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3" status: 200 len: 1227 microversion: 2.1 time: 0.155936 Apr 16 21:20:32.365295 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1794/3721] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:32 2022] GET /compute/v2.1/servers/82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3 => generated 1227 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:32.547111 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ad58fde8-2718-4737-af4a-2ae3b8bc73ba tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:32.554936 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ad58fde8-2718-4737-af4a-2ae3b8bc73ba tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 200 len: 1507 microversion: 2.1 time: 0.328218 Apr 16 21:20:32.557035 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1928/3722] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:32 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 1507 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:32.578301 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9a5a858f-19b1-4104-888b-755eabd0520e tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:32.578301 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9a5a858f-19b1-4104-888b-755eabd0520e tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:32.582936 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9a5a858f-19b1-4104-888b-755eabd0520e tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:32.583328 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9a5a858f-19b1-4104-888b-755eabd0520e tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:32.584335 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9a5a858f-19b1-4104-888b-755eabd0520e tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:32.584933 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9a5a858f-19b1-4104-888b-755eabd0520e tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:32.620968 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9a5a858f-19b1-4104-888b-755eabd0520e tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:20:32.856787 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-57cb2299-db90-44d3-bb5b-5134a136be31 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:32.857503 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-57cb2299-db90-44d3-bb5b-5134a136be31 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 3834cb63-fcdb-46a3-a476-0ee952c105aa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:32.863964 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-57cb2299-db90-44d3-bb5b-5134a136be31 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:32.864746 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-57cb2299-db90-44d3-bb5b-5134a136be31 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:32.865773 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-57cb2299-db90-44d3-bb5b-5134a136be31 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:32.866318 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-57cb2299-db90-44d3-bb5b-5134a136be31 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:33.092676 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-57cb2299-db90-44d3-bb5b-5134a136be31 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:33.112583 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-57cb2299-db90-44d3-bb5b-5134a136be31 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa" status: 200 len: 1355 microversion: 2.1 time: 0.261519 Apr 16 21:20:33.114004 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1929/3723] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:32 2022] GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa => generated 1355 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:20:33.147565 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9a5a858f-19b1-4104-888b-755eabd0520e tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 204 len: 0 microversion: 2.1 time: 0.575981 Apr 16 21:20:33.147565 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1795/3724] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:20:32 2022] DELETE /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:20:33.241994 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-348e9f7c-f2d4-4ebc-a8b4-9f57f6315797 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:33.242926 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-348e9f7c-f2d4-4ebc-a8b4-9f57f6315797 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:33.254181 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-348e9f7c-f2d4-4ebc-a8b4-9f57f6315797 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:33.254847 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-348e9f7c-f2d4-4ebc-a8b4-9f57f6315797 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:33.258278 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-348e9f7c-f2d4-4ebc-a8b4-9f57f6315797 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:33.258969 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-348e9f7c-f2d4-4ebc-a8b4-9f57f6315797 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:33.361308 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-40aa31f9-f5a4-4bd3-b688-c9ce5c404727 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:33.363878 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-40aa31f9-f5a4-4bd3-b688-c9ce5c404727 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: 82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:33.390196 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-40aa31f9-f5a4-4bd3-b688-c9ce5c404727 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:33.396442 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-40aa31f9-f5a4-4bd3-b688-c9ce5c404727 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:33.398562 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-40aa31f9-f5a4-4bd3-b688-c9ce5c404727 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:33.405230 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-40aa31f9-f5a4-4bd3-b688-c9ce5c404727 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:33.539198 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-40aa31f9-f5a4-4bd3-b688-c9ce5c404727 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4866b2c7b7d248539783664403807b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb0e213bd0d40ee9e832b54607028ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:33.549979 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-40aa31f9-f5a4-4bd3-b688-c9ce5c404727 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] 10.222.0.20 "GET /compute/v2.1/servers/82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3" status: 200 len: 1275 microversion: 2.1 time: 0.193636 Apr 16 21:20:33.550586 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1796/3725] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:33 2022] GET /compute/v2.1/servers/82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3 => generated 1275 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:33.563608 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f68caa40-5044-4b49-b842-21d24c41c0c0 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-70051958", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "90b900dd-0d06-4537-95d8-47dd03c283fc"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:20:33.656581 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-348e9f7c-f2d4-4ebc-a8b4-9f57f6315797 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:33.663827 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-348e9f7c-f2d4-4ebc-a8b4-9f57f6315797 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d" status: 200 len: 1508 microversion: 2.1 time: 0.424765 Apr 16 21:20:33.675335 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1930/3726] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:33 2022] GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d => generated 1508 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:33.678405 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-f68caa40-5044-4b49-b842-21d24c41c0c0 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] validate_networks() for [('90b900dd-0d06-4537-95d8-47dd03c283fc', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:20:33.753524 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-971ffe77-8d83-4ac7-b775-29f2a3c32ac7 req-4ad90905-3ce1-47ec-b3c9-660bbddb45b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3834cb63-fcdb-46a3-a476-0ee952c105aa", "name": "network-vif-plugged", "status": "completed", "tag": "73560328-fd39-40aa-a200-90cf4ec23b1a"}, {"server_uuid": "3834cb63-fcdb-46a3-a476-0ee952c105aa", "name": "network-vif-plugged", "status": "completed", "tag": "1d3fe823-b5a6-4c8e-9cdc-00fb713b87ac"}, {"server_uuid": "8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d", "name": "network-vif-plugged", "status": "completed", "tag": "c7099d42-164b-4965-be5b-89015762dc0c"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:20:33.771593 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-971ffe77-8d83-4ac7-b775-29f2a3c32ac7 req-4ad90905-3ce1-47ec-b3c9-660bbddb45b7 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:33.772143 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-971ffe77-8d83-4ac7-b775-29f2a3c32ac7 req-4ad90905-3ce1-47ec-b3c9-660bbddb45b7 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:33.806385 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-971ffe77-8d83-4ac7-b775-29f2a3c32ac7 req-4ad90905-3ce1-47ec-b3c9-660bbddb45b7 service nova] Creating event network-vif-plugged:73560328-fd39-40aa-a200-90cf4ec23b1a for instance 3834cb63-fcdb-46a3-a476-0ee952c105aa on nch1-master-1 Apr 16 21:20:33.806909 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-971ffe77-8d83-4ac7-b775-29f2a3c32ac7 req-4ad90905-3ce1-47ec-b3c9-660bbddb45b7 service nova] Creating event network-vif-plugged:1d3fe823-b5a6-4c8e-9cdc-00fb713b87ac for instance 3834cb63-fcdb-46a3-a476-0ee952c105aa on nch1-master-1 Apr 16 21:20:33.813301 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-971ffe77-8d83-4ac7-b775-29f2a3c32ac7 req-4ad90905-3ce1-47ec-b3c9-660bbddb45b7 service nova] Creating event network-vif-plugged:c7099d42-164b-4965-be5b-89015762dc0c for instance 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d on nch2-master-1 Apr 16 21:20:33.835657 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-971ffe77-8d83-4ac7-b775-29f2a3c32ac7 req-4ad90905-3ce1-47ec-b3c9-660bbddb45b7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.087240 Apr 16 21:20:33.838565 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1931/3727] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:20:34.132651 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-41fc270a-afdd-405c-9aa7-93e750bb7be7 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:34.133352 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-41fc270a-afdd-405c-9aa7-93e750bb7be7 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 3834cb63-fcdb-46a3-a476-0ee952c105aa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:34.145226 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-41fc270a-afdd-405c-9aa7-93e750bb7be7 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:34.145982 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-41fc270a-afdd-405c-9aa7-93e750bb7be7 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:34.146995 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-41fc270a-afdd-405c-9aa7-93e750bb7be7 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:34.147634 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-41fc270a-afdd-405c-9aa7-93e750bb7be7 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:34.464536 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-41fc270a-afdd-405c-9aa7-93e750bb7be7 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:34.479967 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-41fc270a-afdd-405c-9aa7-93e750bb7be7 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa" status: 200 len: 1355 microversion: 2.1 time: 0.352678 Apr 16 21:20:34.498533 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1932/3728] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:34 2022] GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa => generated 1355 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:34.567908 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2b18d332-01a2-470a-99b7-fc943f1f693f tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:34.568800 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2b18d332-01a2-470a-99b7-fc943f1f693f tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: 82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:34.578447 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b18d332-01a2-470a-99b7-fc943f1f693f tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:34.583238 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b18d332-01a2-470a-99b7-fc943f1f693f tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:34.584534 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b18d332-01a2-470a-99b7-fc943f1f693f tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:34.585382 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b18d332-01a2-470a-99b7-fc943f1f693f tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:34.722853 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2b18d332-01a2-470a-99b7-fc943f1f693f tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4866b2c7b7d248539783664403807b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb0e213bd0d40ee9e832b54607028ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:34.733183 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2b18d332-01a2-470a-99b7-fc943f1f693f tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] 10.222.0.20 "GET /compute/v2.1/servers/82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3" status: 200 len: 1275 microversion: 2.1 time: 0.167743 Apr 16 21:20:34.734767 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1933/3729] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:34 2022] GET /compute/v2.1/servers/82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3 => generated 1275 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:34.741883 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3124bfd2-a3c5-402a-a40d-5b0dbf645b09 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:34.742722 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3124bfd2-a3c5-402a-a40d-5b0dbf645b09 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:34.762439 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3124bfd2-a3c5-402a-a40d-5b0dbf645b09 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:34.762439 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3124bfd2-a3c5-402a-a40d-5b0dbf645b09 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:34.762439 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3124bfd2-a3c5-402a-a40d-5b0dbf645b09 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:34.762439 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3124bfd2-a3c5-402a-a40d-5b0dbf645b09 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:35.042436 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3124bfd2-a3c5-402a-a40d-5b0dbf645b09 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:35.059860 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3124bfd2-a3c5-402a-a40d-5b0dbf645b09 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d" status: 200 len: 1508 microversion: 2.1 time: 0.323465 Apr 16 21:20:35.061019 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1934/3730] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:34 2022] GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d => generated 1508 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:35.122694 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-f68caa40-5044-4b49-b842-21d24c41c0c0 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:20:35.123307 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-f68caa40-5044-4b49-b842-21d24c41c0c0 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:20:35.123598 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-f68caa40-5044-4b49-b842-21d24c41c0c0 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:20:35.124014 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-f68caa40-5044-4b49-b842-21d24c41c0c0 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:20:35.125144 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-f68caa40-5044-4b49-b842-21d24c41c0c0 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:20:35.142866 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f68caa40-5044-4b49-b842-21d24c41c0c0 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:35.143323 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f68caa40-5044-4b49-b842-21d24c41c0c0 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:35.144139 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f68caa40-5044-4b49-b842-21d24c41c0c0 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:35.144606 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f68caa40-5044-4b49-b842-21d24c41c0c0 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:35.219987 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-f68caa40-5044-4b49-b842-21d24c41c0c0 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Getting quotas for project 14f08d6620b54fb597d356afc45617c7. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:20:35.240135 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-f68caa40-5044-4b49-b842-21d24c41c0c0 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Getting quotas for user aae8536e08dd4bfb88adc698e7a33d3b and project 14f08d6620b54fb597d356afc45617c7. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:20:35.285782 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f68caa40-5044-4b49-b842-21d24c41c0c0 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:20:35.289052 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f68caa40-5044-4b49-b842-21d24c41c0c0 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:20:35.447670 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f68caa40-5044-4b49-b842-21d24c41c0c0 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.894084 Apr 16 21:20:35.448826 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1797/3731] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:20:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:20:35.470746 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2096a51b-630d-45eb-b3c8-fc36ad7c61ac tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:35.471503 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2096a51b-630d-45eb-b3c8-fc36ad7c61ac tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:35.509522 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b8f91b08-1921-4f87-b826-a5b7be46e80b tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:35.510759 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b8f91b08-1921-4f87-b826-a5b7be46e80b tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 3834cb63-fcdb-46a3-a476-0ee952c105aa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:35.529040 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b8f91b08-1921-4f87-b826-a5b7be46e80b tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:35.529513 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b8f91b08-1921-4f87-b826-a5b7be46e80b tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:35.530313 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b8f91b08-1921-4f87-b826-a5b7be46e80b tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:35.530855 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b8f91b08-1921-4f87-b826-a5b7be46e80b tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:35.657686 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2096a51b-630d-45eb-b3c8-fc36ad7c61ac tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:35.667058 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2096a51b-630d-45eb-b3c8-fc36ad7c61ac tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7" status: 200 len: 1216 microversion: 2.1 time: 0.211411 Apr 16 21:20:35.669170 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1935/3732] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:35 2022] GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 => generated 1216 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:35.750871 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-716be390-cdd2-4833-bbbc-dab10fd287eb tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:35.751604 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-716be390-cdd2-4833-bbbc-dab10fd287eb tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: 82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:35.782883 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-716be390-cdd2-4833-bbbc-dab10fd287eb tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:35.786829 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-716be390-cdd2-4833-bbbc-dab10fd287eb tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:35.788339 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-716be390-cdd2-4833-bbbc-dab10fd287eb tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:35.791102 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-716be390-cdd2-4833-bbbc-dab10fd287eb tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:35.936942 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-716be390-cdd2-4833-bbbc-dab10fd287eb tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4866b2c7b7d248539783664403807b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb0e213bd0d40ee9e832b54607028ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:35.950251 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-716be390-cdd2-4833-bbbc-dab10fd287eb tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] 10.222.0.20 "GET /compute/v2.1/servers/82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3" status: 200 len: 1281 microversion: 2.1 time: 0.200323 Apr 16 21:20:35.950251 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1936/3733] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:35 2022] GET /compute/v2.1/servers/82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3 => generated 1281 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:20:36.079387 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-95af563a-fb27-4fe9-9d51-e4aefee1e65f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:36.080314 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-95af563a-fb27-4fe9-9d51-e4aefee1e65f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:36.092972 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-95af563a-fb27-4fe9-9d51-e4aefee1e65f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:36.095496 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-95af563a-fb27-4fe9-9d51-e4aefee1e65f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:36.096354 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-95af563a-fb27-4fe9-9d51-e4aefee1e65f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:36.096830 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-95af563a-fb27-4fe9-9d51-e4aefee1e65f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:36.387408 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-95af563a-fb27-4fe9-9d51-e4aefee1e65f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:36.416575 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-95af563a-fb27-4fe9-9d51-e4aefee1e65f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d" status: 200 len: 1508 microversion: 2.1 time: 0.342697 Apr 16 21:20:36.417695 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1937/3734] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:36 2022] GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d => generated 1508 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:36.440957 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b8f91b08-1921-4f87-b826-a5b7be46e80b tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:36.452489 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b8f91b08-1921-4f87-b826-a5b7be46e80b tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa" status: 200 len: 1355 microversion: 2.1 time: 0.949672 Apr 16 21:20:36.469642 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1798/3735] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:35 2022] GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa => generated 1355 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:20:36.632446 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-247d3eab-d221-42d3-bbc1-dd5572ff46ea req-fad0240f-21ff-4a11-8db8-e14e3a8f5f15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b0c963a-7042-4bca-9d87-6b90beed5f18", "name": "network-vif-deleted", "tag": "afda655b-bf23-4e30-b6df-18f670dcee9f"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:20:36.651882 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-247d3eab-d221-42d3-bbc1-dd5572ff46ea req-fad0240f-21ff-4a11-8db8-e14e3a8f5f15 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:36.654730 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-247d3eab-d221-42d3-bbc1-dd5572ff46ea req-fad0240f-21ff-4a11-8db8-e14e3a8f5f15 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:36.697382 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-553f2e59-88c4-427b-823b-cd231372ec30 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:36.699844 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-553f2e59-88c4-427b-823b-cd231372ec30 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:36.702177 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-247d3eab-d221-42d3-bbc1-dd5572ff46ea req-fad0240f-21ff-4a11-8db8-e14e3a8f5f15 service nova] Creating event network-vif-deleted:afda655b-bf23-4e30-b6df-18f670dcee9f for instance 6b0c963a-7042-4bca-9d87-6b90beed5f18 on nch1-master-1 Apr 16 21:20:36.729109 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-247d3eab-d221-42d3-bbc1-dd5572ff46ea req-fad0240f-21ff-4a11-8db8-e14e3a8f5f15 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096668 Apr 16 21:20:36.735954 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1938/3736] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:20:36.814099 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-553f2e59-88c4-427b-823b-cd231372ec30 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:36.830049 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-553f2e59-88c4-427b-823b-cd231372ec30 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7" status: 200 len: 1216 microversion: 2.1 time: 0.147204 Apr 16 21:20:36.830910 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1799/3737] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:36 2022] GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 => generated 1216 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:36.964084 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9aa179d1-6a41-4b89-b24b-97347e93e306 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:36.964913 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9aa179d1-6a41-4b89-b24b-97347e93e306 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: 82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:36.984196 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9aa179d1-6a41-4b89-b24b-97347e93e306 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:36.984736 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9aa179d1-6a41-4b89-b24b-97347e93e306 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:36.985597 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9aa179d1-6a41-4b89-b24b-97347e93e306 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:36.995057 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9aa179d1-6a41-4b89-b24b-97347e93e306 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:37.169570 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9aa179d1-6a41-4b89-b24b-97347e93e306 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4866b2c7b7d248539783664403807b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb0e213bd0d40ee9e832b54607028ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:37.182484 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9aa179d1-6a41-4b89-b24b-97347e93e306 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] 10.222.0.20 "GET /compute/v2.1/servers/82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3" status: 200 len: 1281 microversion: 2.1 time: 0.223091 Apr 16 21:20:37.183696 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1939/3738] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:36 2022] GET /compute/v2.1/servers/82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3 => generated 1281 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:37.436473 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0de20c75-bf67-40f3-af61-6637a9954e96 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:37.437022 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0de20c75-bf67-40f3-af61-6637a9954e96 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:37.470126 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0de20c75-bf67-40f3-af61-6637a9954e96 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:37.473118 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0de20c75-bf67-40f3-af61-6637a9954e96 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:37.473118 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0de20c75-bf67-40f3-af61-6637a9954e96 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:37.473687 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0de20c75-bf67-40f3-af61-6637a9954e96 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:37.473808 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7abbc649-c78c-4232-ae9e-2f90826afa2b tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:37.474592 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7abbc649-c78c-4232-ae9e-2f90826afa2b tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 3834cb63-fcdb-46a3-a476-0ee952c105aa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:37.485807 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7abbc649-c78c-4232-ae9e-2f90826afa2b tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:37.489014 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7abbc649-c78c-4232-ae9e-2f90826afa2b tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:37.491967 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7abbc649-c78c-4232-ae9e-2f90826afa2b tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:37.493906 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7abbc649-c78c-4232-ae9e-2f90826afa2b tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:37.877935 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0de20c75-bf67-40f3-af61-6637a9954e96 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:37.889980 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0de20c75-bf67-40f3-af61-6637a9954e96 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d" status: 200 len: 1508 microversion: 2.1 time: 0.459812 Apr 16 21:20:37.892754 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1800/3739] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:37 2022] GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d => generated 1508 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:37.898737 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2b7d8ab5-27cd-41b6-a27b-6719df968ea4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:37.900303 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2b7d8ab5-27cd-41b6-a27b-6719df968ea4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:37.921602 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2b7d8ab5-27cd-41b6-a27b-6719df968ea4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:37.923762 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2b7d8ab5-27cd-41b6-a27b-6719df968ea4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:37.925085 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2b7d8ab5-27cd-41b6-a27b-6719df968ea4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:37.928064 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2b7d8ab5-27cd-41b6-a27b-6719df968ea4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:37.960446 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7abbc649-c78c-4232-ae9e-2f90826afa2b tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:37.978748 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7abbc649-c78c-4232-ae9e-2f90826afa2b tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa" status: 200 len: 1804 microversion: 2.1 time: 0.509354 Apr 16 21:20:37.991835 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1940/3740] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:37 2022] GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa => generated 1804 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:38.016473 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b22d175d-06d5-4c97-b971-6a97527ccc15 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:38.019496 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b22d175d-06d5-4c97-b971-6a97527ccc15 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 3834cb63-fcdb-46a3-a476-0ee952c105aa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:38.034682 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b22d175d-06d5-4c97-b971-6a97527ccc15 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:38.039365 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b22d175d-06d5-4c97-b971-6a97527ccc15 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:38.039365 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b22d175d-06d5-4c97-b971-6a97527ccc15 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:38.039365 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b22d175d-06d5-4c97-b971-6a97527ccc15 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:38.131228 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b22d175d-06d5-4c97-b971-6a97527ccc15 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa/ips" status: 200 len: 217 microversion: 2.1 time: 0.136621 Apr 16 21:20:38.131754 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1941/3741] 10.222.0.20 () {58 vars in 1247 bytes} [Sat Apr 16 21:20:37 2022] GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa/ips => generated 217 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:20:38.169698 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2b4bae23-4e87-4e21-bf3e-606dd0a3c66e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:38.171394 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2b4bae23-4e87-4e21-bf3e-606dd0a3c66e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 3834cb63-fcdb-46a3-a476-0ee952c105aa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:38.176329 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2b7d8ab5-27cd-41b6-a27b-6719df968ea4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:38.188999 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2b7d8ab5-27cd-41b6-a27b-6719df968ea4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7" status: 200 len: 1268 microversion: 2.1 time: 0.290668 Apr 16 21:20:38.190275 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1801/3742] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:37 2022] GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 => generated 1268 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:38.201452 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b4bae23-4e87-4e21-bf3e-606dd0a3c66e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:38.202123 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b4bae23-4e87-4e21-bf3e-606dd0a3c66e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:38.203099 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b4bae23-4e87-4e21-bf3e-606dd0a3c66e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:38.203699 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b4bae23-4e87-4e21-bf3e-606dd0a3c66e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:38.207203 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ad81d785-3728-406e-aa06-423d6d86825a tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:38.211212 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ad81d785-3728-406e-aa06-423d6d86825a tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: 82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:38.236997 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ad81d785-3728-406e-aa06-423d6d86825a tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:38.237834 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ad81d785-3728-406e-aa06-423d6d86825a tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:38.239418 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ad81d785-3728-406e-aa06-423d6d86825a tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:38.243946 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ad81d785-3728-406e-aa06-423d6d86825a tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:38.272358 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2b4bae23-4e87-4e21-bf3e-606dd0a3c66e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 3834cb63-fcdb-46a3-a476-0ee952c105aa] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:20:38.647478 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2b4bae23-4e87-4e21-bf3e-606dd0a3c66e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa" status: 204 len: 0 microversion: 2.1 time: 0.496345 Apr 16 21:20:38.648379 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1942/3743] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:20:38 2022] DELETE /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa => generated 0 bytes in 499 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:20:38.658356 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-23e51afb-e0f7-4c83-9bf0-d30ad8b9ddac tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:38.659073 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-23e51afb-e0f7-4c83-9bf0-d30ad8b9ddac tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 3834cb63-fcdb-46a3-a476-0ee952c105aa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:38.683391 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-23e51afb-e0f7-4c83-9bf0-d30ad8b9ddac tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:38.688029 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-23e51afb-e0f7-4c83-9bf0-d30ad8b9ddac tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:38.691669 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-23e51afb-e0f7-4c83-9bf0-d30ad8b9ddac tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:38.694850 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-23e51afb-e0f7-4c83-9bf0-d30ad8b9ddac tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:38.913776 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ad81d785-3728-406e-aa06-423d6d86825a tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4866b2c7b7d248539783664403807b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb0e213bd0d40ee9e832b54607028ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:38.929868 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ad81d785-3728-406e-aa06-423d6d86825a tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] 10.222.0.20 "GET /compute/v2.1/servers/82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3" status: 200 len: 1323 microversion: 2.1 time: 0.727025 Apr 16 21:20:38.948627 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1802/3744] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:38 2022] GET /compute/v2.1/servers/82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3 => generated 1323 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:38.964074 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-988b9cc2-5aac-4a2b-9991-2bc96448bf13 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:38.971836 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-988b9cc2-5aac-4a2b-9991-2bc96448bf13 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:38.987423 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-988b9cc2-5aac-4a2b-9991-2bc96448bf13 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:38.991945 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-988b9cc2-5aac-4a2b-9991-2bc96448bf13 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:38.992832 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-988b9cc2-5aac-4a2b-9991-2bc96448bf13 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:38.999643 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-988b9cc2-5aac-4a2b-9991-2bc96448bf13 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:39.195373 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-23e51afb-e0f7-4c83-9bf0-d30ad8b9ddac tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:39.209809 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-23e51afb-e0f7-4c83-9bf0-d30ad8b9ddac tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa" status: 200 len: 1810 microversion: 2.1 time: 0.549431 Apr 16 21:20:39.222582 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1943/3745] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:38 2022] GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa => generated 1810 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:39.228388 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1bcaf7ba-f350-4e2a-97ab-ba6b00c7157d tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:39.236404 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1bcaf7ba-f350-4e2a-97ab-ba6b00c7157d tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:39.250004 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1bcaf7ba-f350-4e2a-97ab-ba6b00c7157d tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:39.251394 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1bcaf7ba-f350-4e2a-97ab-ba6b00c7157d tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:39.257792 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1bcaf7ba-f350-4e2a-97ab-ba6b00c7157d tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:39.258533 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1bcaf7ba-f350-4e2a-97ab-ba6b00c7157d tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:39.327483 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-988b9cc2-5aac-4a2b-9991-2bc96448bf13 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:39.336758 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-988b9cc2-5aac-4a2b-9991-2bc96448bf13 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d" status: 200 len: 1508 microversion: 2.1 time: 0.387891 Apr 16 21:20:39.340300 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1803/3746] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:38 2022] GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d => generated 1508 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:39.381383 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1bcaf7ba-f350-4e2a-97ab-ba6b00c7157d tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:39.420968 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1bcaf7ba-f350-4e2a-97ab-ba6b00c7157d tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7" status: 200 len: 1274 microversion: 2.1 time: 0.179356 Apr 16 21:20:39.420968 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1944/3747] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:39 2022] GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 => generated 1274 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:39.951730 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f9f33cff-79d2-4ff9-aed2-8d661227e5a4 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:39.953388 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f9f33cff-79d2-4ff9-aed2-8d661227e5a4 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: 82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:39.970900 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f9f33cff-79d2-4ff9-aed2-8d661227e5a4 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:39.975371 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f9f33cff-79d2-4ff9-aed2-8d661227e5a4 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:39.976857 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f9f33cff-79d2-4ff9-aed2-8d661227e5a4 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:39.977508 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f9f33cff-79d2-4ff9-aed2-8d661227e5a4 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:40.232989 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4c8918ab-8629-4528-99aa-a01dc4443f5b tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:40.234366 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4c8918ab-8629-4528-99aa-a01dc4443f5b tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 3834cb63-fcdb-46a3-a476-0ee952c105aa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:40.263206 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4c8918ab-8629-4528-99aa-a01dc4443f5b tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:40.278870 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4c8918ab-8629-4528-99aa-a01dc4443f5b tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:40.279992 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4c8918ab-8629-4528-99aa-a01dc4443f5b tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:40.280257 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4c8918ab-8629-4528-99aa-a01dc4443f5b tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:40.537476 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f9f33cff-79d2-4ff9-aed2-8d661227e5a4 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4866b2c7b7d248539783664403807b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb0e213bd0d40ee9e832b54607028ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:40.552070 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f9f33cff-79d2-4ff9-aed2-8d661227e5a4 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] 10.222.0.20 "GET /compute/v2.1/servers/82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3" status: 200 len: 1323 microversion: 2.1 time: 0.603819 Apr 16 21:20:40.560286 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1804/3748] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:39 2022] GET /compute/v2.1/servers/82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3 => generated 1323 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:40.570916 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-094a9e3e-de47-4c74-95a1-f4978a221144 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:40.571986 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-094a9e3e-de47-4c74-95a1-f4978a221144 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:40.586352 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-094a9e3e-de47-4c74-95a1-f4978a221144 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:40.590480 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-094a9e3e-de47-4c74-95a1-f4978a221144 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:40.591630 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-094a9e3e-de47-4c74-95a1-f4978a221144 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:40.592351 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-094a9e3e-de47-4c74-95a1-f4978a221144 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:40.747299 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4c8918ab-8629-4528-99aa-a01dc4443f5b tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:40.760139 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4c8918ab-8629-4528-99aa-a01dc4443f5b tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa" status: 200 len: 1810 microversion: 2.1 time: 0.535838 Apr 16 21:20:40.760758 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1945/3749] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:40 2022] GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa => generated 1810 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:40.765788 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3899e5aa-5c8b-460e-861b-508d5c4c5cae tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:40.766628 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3899e5aa-5c8b-460e-861b-508d5c4c5cae tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:40.775562 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3899e5aa-5c8b-460e-861b-508d5c4c5cae tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:40.776305 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3899e5aa-5c8b-460e-861b-508d5c4c5cae tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:40.777270 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3899e5aa-5c8b-460e-861b-508d5c4c5cae tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:40.777983 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3899e5aa-5c8b-460e-861b-508d5c4c5cae tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:41.271444 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-094a9e3e-de47-4c74-95a1-f4978a221144 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:41.279013 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3899e5aa-5c8b-460e-861b-508d5c4c5cae tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:41.289690 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3899e5aa-5c8b-460e-861b-508d5c4c5cae tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7" status: 200 len: 1316 microversion: 2.1 time: 0.527692 Apr 16 21:20:41.300667 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1946/3750] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:40 2022] GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 => generated 1316 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:41.303940 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-094a9e3e-de47-4c74-95a1-f4978a221144 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d" status: 200 len: 1508 microversion: 2.1 time: 0.738049 Apr 16 21:20:41.306228 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1805/3751] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:40 2022] GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d => generated 1508 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:41.557690 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-02c76a01-47e8-4e61-98c6-8d9221562338 req-1fd175bc-d412-44f3-9461-579a1bfd0158 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3", "tag": "18304df3-de06-42cd-8000-8170cb9494bf"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:20:41.573911 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-62ca7f8d-c804-4012-814b-be16d2922b7d tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:41.574806 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-62ca7f8d-c804-4012-814b-be16d2922b7d tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: 82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:41.579053 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-02c76a01-47e8-4e61-98c6-8d9221562338 req-1fd175bc-d412-44f3-9461-579a1bfd0158 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:41.579756 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-02c76a01-47e8-4e61-98c6-8d9221562338 req-1fd175bc-d412-44f3-9461-579a1bfd0158 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:41.596773 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-62ca7f8d-c804-4012-814b-be16d2922b7d tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:41.597512 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-62ca7f8d-c804-4012-814b-be16d2922b7d tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:41.598752 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-62ca7f8d-c804-4012-814b-be16d2922b7d tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:41.599490 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-62ca7f8d-c804-4012-814b-be16d2922b7d tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:41.606677 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-02c76a01-47e8-4e61-98c6-8d9221562338 req-1fd175bc-d412-44f3-9461-579a1bfd0158 service nova] Creating event network-changed:18304df3-de06-42cd-8000-8170cb9494bf for instance 82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3 on nch1-master-1 Apr 16 21:20:41.621278 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-02c76a01-47e8-4e61-98c6-8d9221562338 req-1fd175bc-d412-44f3-9461-579a1bfd0158 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065045 Apr 16 21:20:41.622435 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1947/3752] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:20:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:20:41.781527 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c4cd0c16-960d-4d70-a3ea-8a9fd6e964bb tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:41.782561 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c4cd0c16-960d-4d70-a3ea-8a9fd6e964bb tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 3834cb63-fcdb-46a3-a476-0ee952c105aa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:41.811421 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c4cd0c16-960d-4d70-a3ea-8a9fd6e964bb tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:41.812402 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c4cd0c16-960d-4d70-a3ea-8a9fd6e964bb tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:41.813885 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c4cd0c16-960d-4d70-a3ea-8a9fd6e964bb tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:41.816803 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c4cd0c16-960d-4d70-a3ea-8a9fd6e964bb tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:42.412852 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c4cd0c16-960d-4d70-a3ea-8a9fd6e964bb tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:42.432270 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c4cd0c16-960d-4d70-a3ea-8a9fd6e964bb tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa" status: 200 len: 1789 microversion: 2.1 time: 0.658151 Apr 16 21:20:42.433356 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1948/3753] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:41 2022] GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa => generated 1789 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:42.439020 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-485d13f0-6ac9-4b6a-ad52-5bfb2c007faf req-3236f9ff-ce4b-41a0-a062-0c90be80e55c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7", "tag": "a5c0f6ba-98bc-4711-85ee-04db4015c727"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:20:42.462994 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-485d13f0-6ac9-4b6a-ad52-5bfb2c007faf req-3236f9ff-ce4b-41a0-a062-0c90be80e55c service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:42.463633 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-485d13f0-6ac9-4b6a-ad52-5bfb2c007faf req-3236f9ff-ce4b-41a0-a062-0c90be80e55c service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:42.483983 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-485d13f0-6ac9-4b6a-ad52-5bfb2c007faf req-3236f9ff-ce4b-41a0-a062-0c90be80e55c service nova] Creating event network-changed:a5c0f6ba-98bc-4711-85ee-04db4015c727 for instance cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 on nch2-master-1 Apr 16 21:20:42.502034 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-485d13f0-6ac9-4b6a-ad52-5bfb2c007faf req-3236f9ff-ce4b-41a0-a062-0c90be80e55c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067103 Apr 16 21:20:42.502860 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1949/3754] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:20:42.515390 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-68c4a886-e90d-41c5-9c3d-96cb0e446b15 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:42.521186 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-68c4a886-e90d-41c5-9c3d-96cb0e446b15 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:42.538774 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-68c4a886-e90d-41c5-9c3d-96cb0e446b15 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:42.539242 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-68c4a886-e90d-41c5-9c3d-96cb0e446b15 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:42.540096 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-68c4a886-e90d-41c5-9c3d-96cb0e446b15 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:42.540575 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-68c4a886-e90d-41c5-9c3d-96cb0e446b15 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:42.842488 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-62ca7f8d-c804-4012-814b-be16d2922b7d tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4866b2c7b7d248539783664403807b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb0e213bd0d40ee9e832b54607028ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:42.855046 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-62ca7f8d-c804-4012-814b-be16d2922b7d tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] 10.222.0.20 "GET /compute/v2.1/servers/82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3" status: 200 len: 1323 microversion: 2.1 time: 1.288194 Apr 16 21:20:42.856222 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1806/3755] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:41 2022] GET /compute/v2.1/servers/82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3 => generated 1323 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:42.861151 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-10dacdcb-68ac-4b7e-9955-932b1cc5083b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:42.865945 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-10dacdcb-68ac-4b7e-9955-932b1cc5083b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:42.897346 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-10dacdcb-68ac-4b7e-9955-932b1cc5083b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:42.900415 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-10dacdcb-68ac-4b7e-9955-932b1cc5083b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:42.902495 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-10dacdcb-68ac-4b7e-9955-932b1cc5083b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:42.903140 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-10dacdcb-68ac-4b7e-9955-932b1cc5083b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:43.151040 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-68c4a886-e90d-41c5-9c3d-96cb0e446b15 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:43.166033 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-68c4a886-e90d-41c5-9c3d-96cb0e446b15 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7" status: 200 len: 1316 microversion: 2.1 time: 0.659833 Apr 16 21:20:43.167355 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1950/3756] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:42 2022] GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 => generated 1316 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:43.328050 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-10dacdcb-68ac-4b7e-9955-932b1cc5083b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:43.339846 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-10dacdcb-68ac-4b7e-9955-932b1cc5083b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d" status: 200 len: 1508 microversion: 2.1 time: 0.482329 Apr 16 21:20:43.340900 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1807/3757] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:42 2022] GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d => generated 1508 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:43.452989 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7ab0aaaa-0875-4716-9779-673ea6b84dca tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:43.456795 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7ab0aaaa-0875-4716-9779-673ea6b84dca tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 3834cb63-fcdb-46a3-a476-0ee952c105aa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:43.471353 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ab0aaaa-0875-4716-9779-673ea6b84dca tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:43.473639 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ab0aaaa-0875-4716-9779-673ea6b84dca tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:43.476738 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ab0aaaa-0875-4716-9779-673ea6b84dca tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:43.479001 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ab0aaaa-0875-4716-9779-673ea6b84dca tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:43.655432 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-839eefb1-76cf-49a1-aac8-d59a0c2cb819 req-a31dba36-5c3a-476b-acc5-e7a2bb0fb741 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3834cb63-fcdb-46a3-a476-0ee952c105aa", "name": "network-vif-deleted", "tag": "1d3fe823-b5a6-4c8e-9cdc-00fb713b87ac"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:20:43.678154 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-839eefb1-76cf-49a1-aac8-d59a0c2cb819 req-a31dba36-5c3a-476b-acc5-e7a2bb0fb741 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:43.681467 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-839eefb1-76cf-49a1-aac8-d59a0c2cb819 req-a31dba36-5c3a-476b-acc5-e7a2bb0fb741 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:43.724585 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-839eefb1-76cf-49a1-aac8-d59a0c2cb819 req-a31dba36-5c3a-476b-acc5-e7a2bb0fb741 service nova] Creating event network-vif-deleted:1d3fe823-b5a6-4c8e-9cdc-00fb713b87ac for instance 3834cb63-fcdb-46a3-a476-0ee952c105aa on nch1-master-1 Apr 16 21:20:43.743598 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-839eefb1-76cf-49a1-aac8-d59a0c2cb819 req-a31dba36-5c3a-476b-acc5-e7a2bb0fb741 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092747 Apr 16 21:20:43.746192 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1808/3758] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:20:43.883097 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7ab0aaaa-0875-4716-9779-673ea6b84dca tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:43.889962 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-171780a6-9d1b-4999-8372-3722083dc44d tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:43.891248 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-171780a6-9d1b-4999-8372-3722083dc44d tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: 82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:43.894338 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7ab0aaaa-0875-4716-9779-673ea6b84dca tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa" status: 200 len: 1789 microversion: 2.1 time: 0.447321 Apr 16 21:20:43.895003 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1951/3759] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:43 2022] GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa => generated 1789 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:43.906672 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-171780a6-9d1b-4999-8372-3722083dc44d tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:43.907205 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-171780a6-9d1b-4999-8372-3722083dc44d tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:43.908201 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-171780a6-9d1b-4999-8372-3722083dc44d tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:43.910995 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-171780a6-9d1b-4999-8372-3722083dc44d tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:44.185130 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-47df706a-6442-410b-8777-a563cbe0f4d5 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:44.186044 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-47df706a-6442-410b-8777-a563cbe0f4d5 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:44.205364 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-47df706a-6442-410b-8777-a563cbe0f4d5 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:44.206020 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-47df706a-6442-410b-8777-a563cbe0f4d5 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:44.208715 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-47df706a-6442-410b-8777-a563cbe0f4d5 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:44.209404 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-47df706a-6442-410b-8777-a563cbe0f4d5 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:44.495181 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-47df706a-6442-410b-8777-a563cbe0f4d5 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:44.505304 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-47df706a-6442-410b-8777-a563cbe0f4d5 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7" status: 200 len: 1316 microversion: 2.1 time: 0.324065 Apr 16 21:20:44.510277 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1952/3760] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:44 2022] GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 => generated 1316 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:20:44.517817 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8a849a27-5feb-462b-92f4-62d94192fedf tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:44.518723 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8a849a27-5feb-462b-92f4-62d94192fedf tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:44.528740 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8a849a27-5feb-462b-92f4-62d94192fedf tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:44.529477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8a849a27-5feb-462b-92f4-62d94192fedf tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:44.531054 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8a849a27-5feb-462b-92f4-62d94192fedf tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:44.531655 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8a849a27-5feb-462b-92f4-62d94192fedf tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:44.551426 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-171780a6-9d1b-4999-8372-3722083dc44d tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4866b2c7b7d248539783664403807b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb0e213bd0d40ee9e832b54607028ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:44.583319 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-171780a6-9d1b-4999-8372-3722083dc44d tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] 10.222.0.20 "GET /compute/v2.1/servers/82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3" status: 200 len: 1323 microversion: 2.1 time: 0.714330 Apr 16 21:20:44.592766 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1809/3761] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:43 2022] GET /compute/v2.1/servers/82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3 => generated 1323 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:20:44.917500 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-340eea9f-ffbf-44a9-9482-1067a2c61e0c tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:44.918780 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-340eea9f-ffbf-44a9-9482-1067a2c61e0c tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 3834cb63-fcdb-46a3-a476-0ee952c105aa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:44.938505 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-340eea9f-ffbf-44a9-9482-1067a2c61e0c tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:44.943038 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-340eea9f-ffbf-44a9-9482-1067a2c61e0c tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:44.950988 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-340eea9f-ffbf-44a9-9482-1067a2c61e0c tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:44.951653 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-340eea9f-ffbf-44a9-9482-1067a2c61e0c tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:45.046166 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-340eea9f-ffbf-44a9-9482-1067a2c61e0c tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:45.052705 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8a849a27-5feb-462b-92f4-62d94192fedf tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:45.054144 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-340eea9f-ffbf-44a9-9482-1067a2c61e0c tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa" status: 200 len: 1611 microversion: 2.1 time: 0.143219 Apr 16 21:20:45.055392 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1810/3762] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:44 2022] GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa => generated 1611 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:45.065289 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8a849a27-5feb-462b-92f4-62d94192fedf tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d" status: 200 len: 1508 microversion: 2.1 time: 0.553748 Apr 16 21:20:45.066115 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1953/3763] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:44 2022] GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d => generated 1508 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:45.528074 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-45f1bd7d-5996-4259-bc93-7d83b64eec1d tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:45.529472 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-45f1bd7d-5996-4259-bc93-7d83b64eec1d tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:45.559535 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-45f1bd7d-5996-4259-bc93-7d83b64eec1d tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:45.564294 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-45f1bd7d-5996-4259-bc93-7d83b64eec1d tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:45.566319 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-45f1bd7d-5996-4259-bc93-7d83b64eec1d tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:45.566814 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-45f1bd7d-5996-4259-bc93-7d83b64eec1d tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:45.604202 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2d323965-88e9-4128-b969-f7b95a9014a3 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:45.605445 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2d323965-88e9-4128-b969-f7b95a9014a3 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: 82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:45.619221 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2d323965-88e9-4128-b969-f7b95a9014a3 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:45.622446 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2d323965-88e9-4128-b969-f7b95a9014a3 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:45.623471 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2d323965-88e9-4128-b969-f7b95a9014a3 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:45.625073 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2d323965-88e9-4128-b969-f7b95a9014a3 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:45.817652 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-45f1bd7d-5996-4259-bc93-7d83b64eec1d tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:45.826029 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-45f1bd7d-5996-4259-bc93-7d83b64eec1d tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7" status: 200 len: 1316 microversion: 2.1 time: 0.304063 Apr 16 21:20:45.826660 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1811/3764] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:45 2022] GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 => generated 1316 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:45.831929 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-021752d2-2394-4449-9a01-91efbf435388 req-6a6fdf9e-ab75-4c93-9e18-88ff84c3c525 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3834cb63-fcdb-46a3-a476-0ee952c105aa", "name": "network-vif-deleted", "tag": "73560328-fd39-40aa-a200-90cf4ec23b1a"}, {"server_uuid": "3834cb63-fcdb-46a3-a476-0ee952c105aa", "name": "network-vif-deleted", "tag": "d78dc7e0-d571-482d-8de8-d8cf3f516888"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:20:45.841779 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-021752d2-2394-4449-9a01-91efbf435388 req-6a6fdf9e-ab75-4c93-9e18-88ff84c3c525 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:45.842232 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-021752d2-2394-4449-9a01-91efbf435388 req-6a6fdf9e-ab75-4c93-9e18-88ff84c3c525 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:45.855052 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-021752d2-2394-4449-9a01-91efbf435388 req-6a6fdf9e-ab75-4c93-9e18-88ff84c3c525 service nova] Creating event network-vif-deleted:73560328-fd39-40aa-a200-90cf4ec23b1a for instance 3834cb63-fcdb-46a3-a476-0ee952c105aa on nch1-master-1 Apr 16 21:20:45.855571 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-021752d2-2394-4449-9a01-91efbf435388 req-6a6fdf9e-ab75-4c93-9e18-88ff84c3c525 service nova] Creating event network-vif-deleted:d78dc7e0-d571-482d-8de8-d8cf3f516888 for instance 3834cb63-fcdb-46a3-a476-0ee952c105aa on nch1-master-1 Apr 16 21:20:45.860845 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-021752d2-2394-4449-9a01-91efbf435388 req-6a6fdf9e-ab75-4c93-9e18-88ff84c3c525 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032788 Apr 16 21:20:45.861558 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1812/3765] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:20:45 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:20:46.075318 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a48219fd-c2fc-4be9-b804-9271a3548376 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:46.076772 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a48219fd-c2fc-4be9-b804-9271a3548376 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 3834cb63-fcdb-46a3-a476-0ee952c105aa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:46.083427 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a48219fd-c2fc-4be9-b804-9271a3548376 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:46.083883 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a48219fd-c2fc-4be9-b804-9271a3548376 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:46.085537 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a48219fd-c2fc-4be9-b804-9271a3548376 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:46.085537 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a48219fd-c2fc-4be9-b804-9271a3548376 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:46.153991 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a48219fd-c2fc-4be9-b804-9271a3548376 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:46.154845 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a48219fd-c2fc-4be9-b804-9271a3548376 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:46.155551 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-a48219fd-c2fc-4be9-b804-9271a3548376 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lazy-loading 'fault' on Instance uuid 3834cb63-fcdb-46a3-a476-0ee952c105aa {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:20:46.213944 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a48219fd-c2fc-4be9-b804-9271a3548376 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:46.223351 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a48219fd-c2fc-4be9-b804-9271a3548376 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa" status: 200 len: 1303 microversion: 2.1 time: 0.152407 Apr 16 21:20:46.224145 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1813/3766] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:46 2022] GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa => generated 1303 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:20:46.230095 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-376c1dc4-78af-4a10-8f72-271f8fb8bea1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:46.231047 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-376c1dc4-78af-4a10-8f72-271f8fb8bea1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:46.237653 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-376c1dc4-78af-4a10-8f72-271f8fb8bea1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:46.238306 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-376c1dc4-78af-4a10-8f72-271f8fb8bea1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:46.239503 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-376c1dc4-78af-4a10-8f72-271f8fb8bea1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:46.240225 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-376c1dc4-78af-4a10-8f72-271f8fb8bea1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:46.387282 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2d323965-88e9-4128-b969-f7b95a9014a3 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4866b2c7b7d248539783664403807b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb0e213bd0d40ee9e832b54607028ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:46.398993 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-376c1dc4-78af-4a10-8f72-271f8fb8bea1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:46.403134 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2d323965-88e9-4128-b969-f7b95a9014a3 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] 10.222.0.20 "GET /compute/v2.1/servers/82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3" status: 200 len: 1323 microversion: 2.1 time: 0.802530 Apr 16 21:20:46.405409 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1954/3767] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:45 2022] GET /compute/v2.1/servers/82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3 => generated 1323 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:20:46.409186 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-376c1dc4-78af-4a10-8f72-271f8fb8bea1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d" status: 200 len: 1508 microversion: 2.1 time: 0.183833 Apr 16 21:20:46.420758 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1814/3768] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:46 2022] GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d => generated 1508 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:46.844782 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-828c394e-6f92-43b7-ac5a-52a379520588 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:46.846154 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-828c394e-6f92-43b7-ac5a-52a379520588 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:46.875042 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-828c394e-6f92-43b7-ac5a-52a379520588 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:46.876570 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-828c394e-6f92-43b7-ac5a-52a379520588 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:46.878001 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-828c394e-6f92-43b7-ac5a-52a379520588 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:46.881159 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-828c394e-6f92-43b7-ac5a-52a379520588 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:47.161028 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-828c394e-6f92-43b7-ac5a-52a379520588 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:47.201517 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-828c394e-6f92-43b7-ac5a-52a379520588 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7" status: 200 len: 1316 microversion: 2.1 time: 0.340782 Apr 16 21:20:47.204902 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1955/3769] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:46 2022] GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 => generated 1316 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:47.241614 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-60ded63a-1065-4977-98bc-45e72bb2ddce tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:47.243055 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-60ded63a-1065-4977-98bc-45e72bb2ddce tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 3834cb63-fcdb-46a3-a476-0ee952c105aa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:47.259263 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-60ded63a-1065-4977-98bc-45e72bb2ddce tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:47.259744 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-60ded63a-1065-4977-98bc-45e72bb2ddce tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:47.260875 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-60ded63a-1065-4977-98bc-45e72bb2ddce tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:47.261507 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-60ded63a-1065-4977-98bc-45e72bb2ddce tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:47.278395 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-60ded63a-1065-4977-98bc-45e72bb2ddce tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] HTTP exception thrown: Instance 3834cb63-fcdb-46a3-a476-0ee952c105aa could not be found. Apr 16 21:20:47.279256 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-60ded63a-1065-4977-98bc-45e72bb2ddce tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Returning 404 to user: Instance 3834cb63-fcdb-46a3-a476-0ee952c105aa could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:20:47.280299 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-60ded63a-1065-4977-98bc-45e72bb2ddce tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa" status: 404 len: 111 microversion: 2.1 time: 0.043566 Apr 16 21:20:47.281387 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1815/3770] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:47 2022] GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:20:47.427300 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a8578b3a-55fe-4231-a4ac-955ca94e657e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:47.427927 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a8578b3a-55fe-4231-a4ac-955ca94e657e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:47.437774 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a8578b3a-55fe-4231-a4ac-955ca94e657e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:47.439542 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a8578b3a-55fe-4231-a4ac-955ca94e657e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:47.443719 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a8578b3a-55fe-4231-a4ac-955ca94e657e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:47.444158 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-91451384-7d59-4dd9-b25d-a8495d9e4e2e tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:47.444648 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a8578b3a-55fe-4231-a4ac-955ca94e657e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:47.445876 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-91451384-7d59-4dd9-b25d-a8495d9e4e2e tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: 82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:47.464960 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-91451384-7d59-4dd9-b25d-a8495d9e4e2e tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:47.466972 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-91451384-7d59-4dd9-b25d-a8495d9e4e2e tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:47.468372 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-91451384-7d59-4dd9-b25d-a8495d9e4e2e tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:47.470840 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-91451384-7d59-4dd9-b25d-a8495d9e4e2e tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:47.679396 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-91451384-7d59-4dd9-b25d-a8495d9e4e2e tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4866b2c7b7d248539783664403807b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb0e213bd0d40ee9e832b54607028ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:47.695244 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-91451384-7d59-4dd9-b25d-a8495d9e4e2e tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] 10.222.0.20 "GET /compute/v2.1/servers/82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3" status: 200 len: 1323 microversion: 2.1 time: 0.277086 Apr 16 21:20:47.697049 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1956/3771] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:47 2022] GET /compute/v2.1/servers/82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3 => generated 1323 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:47.867089 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a8578b3a-55fe-4231-a4ac-955ca94e657e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:47.876417 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a8578b3a-55fe-4231-a4ac-955ca94e657e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d" status: 200 len: 1508 microversion: 2.1 time: 0.452914 Apr 16 21:20:47.886040 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1816/3772] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:47 2022] GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d => generated 1508 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:48.221899 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6ea8e027-4f43-4422-bf0f-f17446ebcb08 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:48.222516 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6ea8e027-4f43-4422-bf0f-f17446ebcb08 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:48.234507 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6ea8e027-4f43-4422-bf0f-f17446ebcb08 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:48.236015 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6ea8e027-4f43-4422-bf0f-f17446ebcb08 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:48.237054 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6ea8e027-4f43-4422-bf0f-f17446ebcb08 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:48.237834 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6ea8e027-4f43-4422-bf0f-f17446ebcb08 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:48.511113 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6ea8e027-4f43-4422-bf0f-f17446ebcb08 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:48.520152 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6ea8e027-4f43-4422-bf0f-f17446ebcb08 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7" status: 200 len: 1316 microversion: 2.1 time: 0.302956 Apr 16 21:20:48.521953 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1957/3773] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:48 2022] GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 => generated 1316 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:48.713585 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bf4f3cec-0f84-4012-bc2c-989669d078f0 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:48.714271 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bf4f3cec-0f84-4012-bc2c-989669d078f0 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: 82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:48.724969 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bf4f3cec-0f84-4012-bc2c-989669d078f0 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:48.725446 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bf4f3cec-0f84-4012-bc2c-989669d078f0 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:48.728107 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bf4f3cec-0f84-4012-bc2c-989669d078f0 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:48.730431 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bf4f3cec-0f84-4012-bc2c-989669d078f0 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:48.893265 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b4aaf899-21ed-416c-a5c9-2c35440f6932 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:48.894102 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b4aaf899-21ed-416c-a5c9-2c35440f6932 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:48.906161 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b4aaf899-21ed-416c-a5c9-2c35440f6932 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:48.906654 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b4aaf899-21ed-416c-a5c9-2c35440f6932 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:48.908146 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b4aaf899-21ed-416c-a5c9-2c35440f6932 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:48.908685 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b4aaf899-21ed-416c-a5c9-2c35440f6932 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:49.043513 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-bf4f3cec-0f84-4012-bc2c-989669d078f0 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4866b2c7b7d248539783664403807b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb0e213bd0d40ee9e832b54607028ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:49.068213 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bf4f3cec-0f84-4012-bc2c-989669d078f0 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] 10.222.0.20 "GET /compute/v2.1/servers/82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3" status: 200 len: 1323 microversion: 2.1 time: 0.359366 Apr 16 21:20:49.071489 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1817/3774] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:48 2022] GET /compute/v2.1/servers/82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3 => generated 1323 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:49.238138 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b4aaf899-21ed-416c-a5c9-2c35440f6932 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:49.247649 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b4aaf899-21ed-416c-a5c9-2c35440f6932 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d" status: 200 len: 1508 microversion: 2.1 time: 0.358350 Apr 16 21:20:49.248706 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1958/3775] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:48 2022] GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d => generated 1508 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:49.413299 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-e5258613-fc0e-4f10-9eeb-0c0508e7dae7 req-12d93397-a484-4f24-82ca-16cd77005971 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3", "name": "network-vif-plugged", "status": "completed", "tag": "18304df3-de06-42cd-8000-8170cb9494bf"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:20:49.428104 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-e5258613-fc0e-4f10-9eeb-0c0508e7dae7 req-12d93397-a484-4f24-82ca-16cd77005971 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:49.429905 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-e5258613-fc0e-4f10-9eeb-0c0508e7dae7 req-12d93397-a484-4f24-82ca-16cd77005971 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:49.468091 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-e5258613-fc0e-4f10-9eeb-0c0508e7dae7 req-12d93397-a484-4f24-82ca-16cd77005971 service nova] Creating event network-vif-plugged:18304df3-de06-42cd-8000-8170cb9494bf for instance 82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3 on nch1-master-1 Apr 16 21:20:49.484204 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-e5258613-fc0e-4f10-9eeb-0c0508e7dae7 req-12d93397-a484-4f24-82ca-16cd77005971 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072268 Apr 16 21:20:49.488682 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1818/3776] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:20:49.547141 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-74e81a05-364e-43b7-a4d1-407873a9934f tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:49.550161 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-74e81a05-364e-43b7-a4d1-407873a9934f tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:49.565281 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-74e81a05-364e-43b7-a4d1-407873a9934f tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:49.565958 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-74e81a05-364e-43b7-a4d1-407873a9934f tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:49.566929 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-74e81a05-364e-43b7-a4d1-407873a9934f tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:49.567699 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-74e81a05-364e-43b7-a4d1-407873a9934f tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:49.874873 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-74e81a05-364e-43b7-a4d1-407873a9934f tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:49.891444 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-74e81a05-364e-43b7-a4d1-407873a9934f tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7" status: 200 len: 1316 microversion: 2.1 time: 0.355513 Apr 16 21:20:49.892729 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1959/3777] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:49 2022] GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 => generated 1316 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:50.103370 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5d699ec0-1f8c-4cf2-9a01-4566e9bcc547 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:50.106455 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5d699ec0-1f8c-4cf2-9a01-4566e9bcc547 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: 82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:50.120041 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5d699ec0-1f8c-4cf2-9a01-4566e9bcc547 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:50.121136 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5d699ec0-1f8c-4cf2-9a01-4566e9bcc547 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:50.122243 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5d699ec0-1f8c-4cf2-9a01-4566e9bcc547 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:50.122864 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5d699ec0-1f8c-4cf2-9a01-4566e9bcc547 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:50.267311 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-74d95561-407d-4593-9d78-188773442df6 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:50.272723 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-74d95561-407d-4593-9d78-188773442df6 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:50.291966 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-74d95561-407d-4593-9d78-188773442df6 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:50.295425 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-74d95561-407d-4593-9d78-188773442df6 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:50.296966 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-74d95561-407d-4593-9d78-188773442df6 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:50.299104 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-74d95561-407d-4593-9d78-188773442df6 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:50.604212 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-74d95561-407d-4593-9d78-188773442df6 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:50.619278 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-74d95561-407d-4593-9d78-188773442df6 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d" status: 200 len: 1508 microversion: 2.1 time: 0.359053 Apr 16 21:20:50.620214 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1960/3778] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:50 2022] GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d => generated 1508 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:50.915218 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6ef311dd-94b6-44dc-a447-7aed53d203b4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:50.915218 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6ef311dd-94b6-44dc-a447-7aed53d203b4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:50.918933 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6ef311dd-94b6-44dc-a447-7aed53d203b4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:50.919471 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6ef311dd-94b6-44dc-a447-7aed53d203b4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:50.920972 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6ef311dd-94b6-44dc-a447-7aed53d203b4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:50.921446 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6ef311dd-94b6-44dc-a447-7aed53d203b4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:51.015004 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5d699ec0-1f8c-4cf2-9a01-4566e9bcc547 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4866b2c7b7d248539783664403807b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb0e213bd0d40ee9e832b54607028ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:51.035183 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5d699ec0-1f8c-4cf2-9a01-4566e9bcc547 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] 10.222.0.20 "GET /compute/v2.1/servers/82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3" status: 200 len: 1323 microversion: 2.1 time: 0.939615 Apr 16 21:20:51.035183 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1819/3779] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:50 2022] GET /compute/v2.1/servers/82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3 => generated 1323 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:51.062695 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6ef311dd-94b6-44dc-a447-7aed53d203b4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:51.076570 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6ef311dd-94b6-44dc-a447-7aed53d203b4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7" status: 200 len: 1316 microversion: 2.1 time: 0.168303 Apr 16 21:20:51.089030 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1961/3780] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:50 2022] GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 => generated 1316 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:20:51.609155 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-33e29e73-0e98-4b6c-be37-dda5ccfd92dc req-f2699687-04e0-4528-a4c7-ab65c170f7e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7", "name": "network-vif-plugged", "status": "completed", "tag": "a5c0f6ba-98bc-4711-85ee-04db4015c727"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:20:51.639211 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-33e29e73-0e98-4b6c-be37-dda5ccfd92dc req-f2699687-04e0-4528-a4c7-ab65c170f7e8 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:51.639684 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-33e29e73-0e98-4b6c-be37-dda5ccfd92dc req-f2699687-04e0-4528-a4c7-ab65c170f7e8 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:51.640830 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0e46ce32-6068-4286-ac83-60fa9769df88 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:51.642423 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0e46ce32-6068-4286-ac83-60fa9769df88 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:51.652481 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0e46ce32-6068-4286-ac83-60fa9769df88 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:51.660524 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0e46ce32-6068-4286-ac83-60fa9769df88 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:51.667485 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0e46ce32-6068-4286-ac83-60fa9769df88 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:51.676088 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0e46ce32-6068-4286-ac83-60fa9769df88 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:51.695045 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-33e29e73-0e98-4b6c-be37-dda5ccfd92dc req-f2699687-04e0-4528-a4c7-ab65c170f7e8 service nova] Creating event network-vif-plugged:a5c0f6ba-98bc-4711-85ee-04db4015c727 for instance cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 on nch2-master-1 Apr 16 21:20:51.712547 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-33e29e73-0e98-4b6c-be37-dda5ccfd92dc req-f2699687-04e0-4528-a4c7-ab65c170f7e8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107603 Apr 16 21:20:51.726124 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1820/3781] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:20:52.043704 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9ca64ffa-6430-4e2a-b67f-574fdf8a0969 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:52.044773 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9ca64ffa-6430-4e2a-b67f-574fdf8a0969 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: 82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:52.056597 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9ca64ffa-6430-4e2a-b67f-574fdf8a0969 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:52.058635 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9ca64ffa-6430-4e2a-b67f-574fdf8a0969 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:52.061070 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9ca64ffa-6430-4e2a-b67f-574fdf8a0969 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:52.063005 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9ca64ffa-6430-4e2a-b67f-574fdf8a0969 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:52.303351 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0e46ce32-6068-4286-ac83-60fa9769df88 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:52.312471 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0e46ce32-6068-4286-ac83-60fa9769df88 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d" status: 200 len: 1508 microversion: 2.1 time: 0.679150 Apr 16 21:20:52.313308 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1962/3782] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:51 2022] GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d => generated 1508 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:52.318684 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9656df0e-0907-4907-b1f4-f816daa0b0db tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:52.319681 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9656df0e-0907-4907-b1f4-f816daa0b0db tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:52.328776 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9656df0e-0907-4907-b1f4-f816daa0b0db tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:52.329370 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9656df0e-0907-4907-b1f4-f816daa0b0db tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:52.330293 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9656df0e-0907-4907-b1f4-f816daa0b0db tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:52.330986 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9656df0e-0907-4907-b1f4-f816daa0b0db tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:52.345134 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9ca64ffa-6430-4e2a-b67f-574fdf8a0969 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4866b2c7b7d248539783664403807b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb0e213bd0d40ee9e832b54607028ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:52.354587 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9ca64ffa-6430-4e2a-b67f-574fdf8a0969 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] 10.222.0.20 "GET /compute/v2.1/servers/82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3" status: 200 len: 1520 microversion: 2.1 time: 0.316521 Apr 16 21:20:52.355188 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1821/3783] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:52 2022] GET /compute/v2.1/servers/82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3 => generated 1520 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:20:52.373405 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-46bec15d-14f2-4b09-88d7-27fe84e39245 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Action: 'create', calling method: .version_select at 0x7fbb961cd160>, body: {"pool": null} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:20:52.604203 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9656df0e-0907-4907-b1f4-f816daa0b0db tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:52.615389 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9656df0e-0907-4907-b1f4-f816daa0b0db tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7" status: 200 len: 1316 microversion: 2.1 time: 0.300766 Apr 16 21:20:52.618620 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1963/3784] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:52 2022] GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 => generated 1316 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:53.333870 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-dcc00a78-252a-48f0-b30a-681f1664d9d3 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:20:53.335022 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-dcc00a78-252a-48f0-b30a-681f1664d9d3 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] [instance: 58b86589-e35e-4b91-b192-9f744516f66f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:53.344414 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dcc00a78-252a-48f0-b30a-681f1664d9d3 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:53.345069 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dcc00a78-252a-48f0-b30a-681f1664d9d3 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:53.348391 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dcc00a78-252a-48f0-b30a-681f1664d9d3 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:53.348391 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dcc00a78-252a-48f0-b30a-681f1664d9d3 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:53.401942 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-dcc00a78-252a-48f0-b30a-681f1664d9d3 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] 10.222.0.20 "POST /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f/action" status: 200 len: 24575 microversion: 2.1 time: 0.353390 Apr 16 21:20:53.403409 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1964/3785] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:20:53 2022] POST /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f/action => generated 24575 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 16 21:20:53.422832 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-01622dc9-935f-406e-b54e-8b6f43bc65cb tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:53.423327 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-01622dc9-935f-406e-b54e-8b6f43bc65cb tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:53.431482 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-01622dc9-935f-406e-b54e-8b6f43bc65cb tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:53.431956 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-01622dc9-935f-406e-b54e-8b6f43bc65cb tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:53.432981 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-01622dc9-935f-406e-b54e-8b6f43bc65cb tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:53.435033 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-01622dc9-935f-406e-b54e-8b6f43bc65cb tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:53.683393 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-01622dc9-935f-406e-b54e-8b6f43bc65cb tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:53.689596 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-01622dc9-935f-406e-b54e-8b6f43bc65cb tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d" status: 200 len: 1508 microversion: 2.1 time: 0.283885 Apr 16 21:20:53.690486 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1965/3786] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:53 2022] GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d => generated 1508 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:53.697367 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6fa55a49-fc4e-4448-bc90-221d94b5a8e3 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:53.698623 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6fa55a49-fc4e-4448-bc90-221d94b5a8e3 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] [instance: 58b86589-e35e-4b91-b192-9f744516f66f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:53.713342 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6fa55a49-fc4e-4448-bc90-221d94b5a8e3 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:53.714041 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6fa55a49-fc4e-4448-bc90-221d94b5a8e3 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:53.716282 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6fa55a49-fc4e-4448-bc90-221d94b5a8e3 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:53.716282 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6fa55a49-fc4e-4448-bc90-221d94b5a8e3 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:53.759258 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6fa55a49-fc4e-4448-bc90-221d94b5a8e3 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] [instance: 58b86589-e35e-4b91-b192-9f744516f66f] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:20:54.173304 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6fa55a49-fc4e-4448-bc90-221d94b5a8e3 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] 10.222.0.20 "DELETE /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f" status: 204 len: 0 microversion: 2.1 time: 0.481323 Apr 16 21:20:54.173904 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1966/3787] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:20:53 2022] DELETE /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f => generated 0 bytes in 483 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:20:54.182618 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6170dc6b-68ba-4dcb-b0ef-e9a472c6d3fc tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:54.183323 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6170dc6b-68ba-4dcb-b0ef-e9a472c6d3fc tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:54.191034 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6170dc6b-68ba-4dcb-b0ef-e9a472c6d3fc tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:54.191800 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6170dc6b-68ba-4dcb-b0ef-e9a472c6d3fc tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:54.192842 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6170dc6b-68ba-4dcb-b0ef-e9a472c6d3fc tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:54.193505 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6170dc6b-68ba-4dcb-b0ef-e9a472c6d3fc tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:54.636378 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6170dc6b-68ba-4dcb-b0ef-e9a472c6d3fc tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:54.647105 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6170dc6b-68ba-4dcb-b0ef-e9a472c6d3fc tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7" status: 200 len: 1316 microversion: 2.1 time: 0.469145 Apr 16 21:20:54.648275 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1967/3788] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:54 2022] GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 => generated 1316 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:54.653585 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8828bd1f-4e7c-4ee9-b872-7d398a04ffe3 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:54.654365 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8828bd1f-4e7c-4ee9-b872-7d398a04ffe3 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] [instance: 58b86589-e35e-4b91-b192-9f744516f66f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:54.660829 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8828bd1f-4e7c-4ee9-b872-7d398a04ffe3 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:54.661536 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8828bd1f-4e7c-4ee9-b872-7d398a04ffe3 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:54.662338 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8828bd1f-4e7c-4ee9-b872-7d398a04ffe3 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:54.662783 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8828bd1f-4e7c-4ee9-b872-7d398a04ffe3 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:55.054617 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8828bd1f-4e7c-4ee9-b872-7d398a04ffe3 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a6ff623974d4156a05a7bd3e3b3ed5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840fd4cbe2fd414bb97f14898bf9647d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:55.064262 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8828bd1f-4e7c-4ee9-b872-7d398a04ffe3 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] 10.222.0.20 "GET /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f" status: 200 len: 1607 microversion: 2.1 time: 0.414678 Apr 16 21:20:55.064976 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1968/3789] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:54 2022] GET /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f => generated 1607 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:55.070720 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-659a8d89-b3f8-4c73-99a5-0181021659e1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:55.071842 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-659a8d89-b3f8-4c73-99a5-0181021659e1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:55.080489 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-659a8d89-b3f8-4c73-99a5-0181021659e1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:55.081313 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-659a8d89-b3f8-4c73-99a5-0181021659e1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:55.083003 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-659a8d89-b3f8-4c73-99a5-0181021659e1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:55.083741 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-659a8d89-b3f8-4c73-99a5-0181021659e1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:55.404721 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-659a8d89-b3f8-4c73-99a5-0181021659e1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:55.414277 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-659a8d89-b3f8-4c73-99a5-0181021659e1 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d" status: 200 len: 1505 microversion: 2.1 time: 0.347813 Apr 16 21:20:55.415433 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1969/3790] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:55 2022] GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d => generated 1505 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:55.666855 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-34b2841b-ddbc-4c74-8527-aab9b4a745dc tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:55.668213 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-34b2841b-ddbc-4c74-8527-aab9b4a745dc tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:55.681083 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-34b2841b-ddbc-4c74-8527-aab9b4a745dc tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:55.681083 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-34b2841b-ddbc-4c74-8527-aab9b4a745dc tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:55.681083 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-34b2841b-ddbc-4c74-8527-aab9b4a745dc tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:55.681083 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-34b2841b-ddbc-4c74-8527-aab9b4a745dc tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:56.191328 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-34b2841b-ddbc-4c74-8527-aab9b4a745dc tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:56.206611 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-34b2841b-ddbc-4c74-8527-aab9b4a745dc tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7" status: 200 len: 1507 microversion: 2.1 time: 0.545670 Apr 16 21:20:56.207902 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1970/3791] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:55 2022] GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 => generated 1507 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:56.212936 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-46bec15d-14f2-4b09-88d7-27fe84e39245 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.842089 Apr 16 21:20:56.217614 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1822/3792] 10.222.0.20 () {60 vars in 1169 bytes} [Sat Apr 16 21:20:52 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3849 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:20:56.234271 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4577f430-bc3f-4b58-98ff-6d52e0fbbac8 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:56.237704 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4577f430-bc3f-4b58-98ff-6d52e0fbbac8 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] [instance: 58b86589-e35e-4b91-b192-9f744516f66f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:56.245944 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4577f430-bc3f-4b58-98ff-6d52e0fbbac8 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:56.248522 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-187bc84b-eafd-4f04-b221-fca7f9261cd4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:56.249157 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4577f430-bc3f-4b58-98ff-6d52e0fbbac8 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:56.249719 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-187bc84b-eafd-4f04-b221-fca7f9261cd4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:56.250388 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4577f430-bc3f-4b58-98ff-6d52e0fbbac8 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:56.251267 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4577f430-bc3f-4b58-98ff-6d52e0fbbac8 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:56.275145 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-187bc84b-eafd-4f04-b221-fca7f9261cd4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:56.275619 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-187bc84b-eafd-4f04-b221-fca7f9261cd4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:56.276450 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-187bc84b-eafd-4f04-b221-fca7f9261cd4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:56.276920 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-187bc84b-eafd-4f04-b221-fca7f9261cd4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:56.544576 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4577f430-bc3f-4b58-98ff-6d52e0fbbac8 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a6ff623974d4156a05a7bd3e3b3ed5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840fd4cbe2fd414bb97f14898bf9647d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:56.552808 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4577f430-bc3f-4b58-98ff-6d52e0fbbac8 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] 10.222.0.20 "GET /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f" status: 200 len: 1607 microversion: 2.1 time: 0.333871 Apr 16 21:20:56.553655 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1971/3793] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:56 2022] GET /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f => generated 1607 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:56.559923 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-11f3feb4-7312-481a-860a-8d2303163c9c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:56.560766 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-11f3feb4-7312-481a-860a-8d2303163c9c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:56.568670 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-11f3feb4-7312-481a-860a-8d2303163c9c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:56.569385 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-11f3feb4-7312-481a-860a-8d2303163c9c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:56.570344 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-11f3feb4-7312-481a-860a-8d2303163c9c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:56.571017 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-11f3feb4-7312-481a-860a-8d2303163c9c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:56.606378 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-187bc84b-eafd-4f04-b221-fca7f9261cd4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:56.614693 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-187bc84b-eafd-4f04-b221-fca7f9261cd4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7" status: 200 len: 1507 microversion: 2.1 time: 0.378200 Apr 16 21:20:56.615430 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1823/3794] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:56 2022] GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 => generated 1507 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:56.620378 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9ff9e631-b27b-4926-a672-2f1cac4da611 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1875552504", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "de9da8f1-3ad8-4653-830f-a88f9ba49f3e"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:20:56.708819 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-9ff9e631-b27b-4926-a672-2f1cac4da611 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] validate_networks() for [('de9da8f1-3ad8-4653-830f-a88f9ba49f3e', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:20:56.849196 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-11f3feb4-7312-481a-860a-8d2303163c9c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:56.859588 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-11f3feb4-7312-481a-860a-8d2303163c9c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d" status: 200 len: 1505 microversion: 2.1 time: 0.304474 Apr 16 21:20:56.876938 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1972/3795] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:56 2022] GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d => generated 1505 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:56.899406 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-dffe9998-c04a-4e56-aa24-723bf0586a46 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:20:56.902635 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-dffe9998-c04a-4e56-aa24-723bf0586a46 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:56.927648 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dffe9998-c04a-4e56-aa24-723bf0586a46 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:56.927648 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dffe9998-c04a-4e56-aa24-723bf0586a46 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:56.927648 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dffe9998-c04a-4e56-aa24-723bf0586a46 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:56.927648 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dffe9998-c04a-4e56-aa24-723bf0586a46 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:57.112659 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-dffe9998-c04a-4e56-aa24-723bf0586a46 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "PUT /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7" status: 200 len: 1079 microversion: 2.1 time: 0.233036 Apr 16 21:20:57.114473 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1973/3796] 10.222.0.20 () {60 vars in 1255 bytes} [Sat Apr 16 21:20:56 2022] PUT /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 => generated 1079 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:57.130494 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4da6e245-9188-4104-8bc0-1585f389bab8 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:57.131223 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4da6e245-9188-4104-8bc0-1585f389bab8 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:57.138819 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4da6e245-9188-4104-8bc0-1585f389bab8 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:57.139590 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4da6e245-9188-4104-8bc0-1585f389bab8 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:57.140482 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4da6e245-9188-4104-8bc0-1585f389bab8 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:57.141254 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4da6e245-9188-4104-8bc0-1585f389bab8 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:57.312624 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4da6e245-9188-4104-8bc0-1585f389bab8 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:57.338827 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4da6e245-9188-4104-8bc0-1585f389bab8 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7" status: 200 len: 1505 microversion: 2.1 time: 0.214961 Apr 16 21:20:57.355818 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1974/3797] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:57 2022] GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 => generated 1505 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:57.365722 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-2cf3f8a6-8340-4634-9714-03f6906badcc req-5a356adb-c876-494c-a3ee-1af12fbfda9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d", "name": "network-vif-unplugged", "status": "completed", "tag": "c7099d42-164b-4965-be5b-89015762dc0c"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:20:57.375558 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-2cf3f8a6-8340-4634-9714-03f6906badcc req-5a356adb-c876-494c-a3ee-1af12fbfda9e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:57.376027 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-2cf3f8a6-8340-4634-9714-03f6906badcc req-5a356adb-c876-494c-a3ee-1af12fbfda9e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:57.406648 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-2cf3f8a6-8340-4634-9714-03f6906badcc req-5a356adb-c876-494c-a3ee-1af12fbfda9e service nova] Creating event network-vif-unplugged:c7099d42-164b-4965-be5b-89015762dc0c for instance 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d on nch2-master-1 Apr 16 21:20:57.413631 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-2cf3f8a6-8340-4634-9714-03f6906badcc req-5a356adb-c876-494c-a3ee-1af12fbfda9e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053610 Apr 16 21:20:57.414631 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1975/3798] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:20:57.429055 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6ed163d3-700f-408f-b6cd-77340f67fb1b tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:57.430163 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6ed163d3-700f-408f-b6cd-77340f67fb1b tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:57.439084 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6ed163d3-700f-408f-b6cd-77340f67fb1b tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:57.441223 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6ed163d3-700f-408f-b6cd-77340f67fb1b tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:57.443076 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6ed163d3-700f-408f-b6cd-77340f67fb1b tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:57.444262 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6ed163d3-700f-408f-b6cd-77340f67fb1b tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:57.746543 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6ed163d3-700f-408f-b6cd-77340f67fb1b tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:57.756870 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6ed163d3-700f-408f-b6cd-77340f67fb1b tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7" status: 200 len: 1505 microversion: 2.1 time: 0.340125 Apr 16 21:20:57.758121 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1976/3799] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:57 2022] GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 => generated 1505 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:57.764865 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c28b76e8-9661-44ab-83e4-d26d3498c999 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:57.765719 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c28b76e8-9661-44ab-83e4-d26d3498c999 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] [instance: 58b86589-e35e-4b91-b192-9f744516f66f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:57.777131 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c28b76e8-9661-44ab-83e4-d26d3498c999 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:57.778504 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c28b76e8-9661-44ab-83e4-d26d3498c999 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:57.779606 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c28b76e8-9661-44ab-83e4-d26d3498c999 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:57.780388 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c28b76e8-9661-44ab-83e4-d26d3498c999 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:57.902545 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c28b76e8-9661-44ab-83e4-d26d3498c999 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a6ff623974d4156a05a7bd3e3b3ed5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840fd4cbe2fd414bb97f14898bf9647d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:57.913365 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c28b76e8-9661-44ab-83e4-d26d3498c999 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] 10.222.0.20 "GET /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f" status: 200 len: 1541 microversion: 2.1 time: 0.152923 Apr 16 21:20:57.914233 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1977/3800] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:57 2022] GET /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f => generated 1541 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:57.940056 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-eae3af70-02ef-43a8-980e-9c2c7bfc8bf8 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:20:57.942300 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-eae3af70-02ef-43a8-980e-9c2c7bfc8bf8 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:57.951311 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eae3af70-02ef-43a8-980e-9c2c7bfc8bf8 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:57.952032 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eae3af70-02ef-43a8-980e-9c2c7bfc8bf8 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:57.953011 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eae3af70-02ef-43a8-980e-9c2c7bfc8bf8 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:57.953866 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eae3af70-02ef-43a8-980e-9c2c7bfc8bf8 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:58.045171 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-eae3af70-02ef-43a8-980e-9c2c7bfc8bf8 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:20:58.045606 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-eae3af70-02ef-43a8-980e-9c2c7bfc8bf8 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:20:58.046090 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-eae3af70-02ef-43a8-980e-9c2c7bfc8bf8 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:20:58.046505 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-eae3af70-02ef-43a8-980e-9c2c7bfc8bf8 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:20:58.047100 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-eae3af70-02ef-43a8-980e-9c2c7bfc8bf8 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:20:58.259215 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-eae3af70-02ef-43a8-980e-9c2c7bfc8bf8 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:58.270342 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eae3af70-02ef-43a8-980e-9c2c7bfc8bf8 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:58.272207 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eae3af70-02ef-43a8-980e-9c2c7bfc8bf8 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:58.283558 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eae3af70-02ef-43a8-980e-9c2c7bfc8bf8 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:58.284199 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eae3af70-02ef-43a8-980e-9c2c7bfc8bf8 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:58.338455 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-eae3af70-02ef-43a8-980e-9c2c7bfc8bf8 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "POST /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7/action" status: 202 len: 1111 microversion: 2.1 time: 0.404326 Apr 16 21:20:58.342411 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1978/3801] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:20:57 2022] POST /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7/action => generated 1111 bytes in 406 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 16 21:20:58.346031 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-97fb6651-c9a6-4fea-82da-d3ecf2b40967 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:58.346800 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-97fb6651-c9a6-4fea-82da-d3ecf2b40967 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:58.360649 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-97fb6651-c9a6-4fea-82da-d3ecf2b40967 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:58.361286 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-97fb6651-c9a6-4fea-82da-d3ecf2b40967 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:58.362112 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-97fb6651-c9a6-4fea-82da-d3ecf2b40967 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:58.362556 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-97fb6651-c9a6-4fea-82da-d3ecf2b40967 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:58.537935 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-97fb6651-c9a6-4fea-82da-d3ecf2b40967 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:58.548394 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-97fb6651-c9a6-4fea-82da-d3ecf2b40967 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d" status: 200 len: 1508 microversion: 2.1 time: 0.206855 Apr 16 21:20:58.550256 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1979/3802] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:58 2022] GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d => generated 1508 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:58.556416 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a3e1cce0-b4e8-4906-a166-105129d70ea2 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:58.557237 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a3e1cce0-b4e8-4906-a166-105129d70ea2 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:58.564937 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a3e1cce0-b4e8-4906-a166-105129d70ea2 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:58.565827 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a3e1cce0-b4e8-4906-a166-105129d70ea2 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:58.566840 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a3e1cce0-b4e8-4906-a166-105129d70ea2 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:58.567451 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a3e1cce0-b4e8-4906-a166-105129d70ea2 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:58.732077 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-9ff9e631-b27b-4926-a672-2f1cac4da611 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:20:58.732923 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-9ff9e631-b27b-4926-a672-2f1cac4da611 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:20:58.733534 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-9ff9e631-b27b-4926-a672-2f1cac4da611 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:20:58.734399 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-9ff9e631-b27b-4926-a672-2f1cac4da611 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:20:58.735503 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-9ff9e631-b27b-4926-a672-2f1cac4da611 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:20:58.769362 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9ff9e631-b27b-4926-a672-2f1cac4da611 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:58.771951 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9ff9e631-b27b-4926-a672-2f1cac4da611 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:58.772914 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9ff9e631-b27b-4926-a672-2f1cac4da611 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:58.773366 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9ff9e631-b27b-4926-a672-2f1cac4da611 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:58.823538 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a3e1cce0-b4e8-4906-a166-105129d70ea2 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:58.839301 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a3e1cce0-b4e8-4906-a166-105129d70ea2 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7" status: 200 len: 1516 microversion: 2.1 time: 0.286354 Apr 16 21:20:58.841146 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1980/3803] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:58 2022] GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 => generated 1516 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:58.849083 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-9ff9e631-b27b-4926-a672-2f1cac4da611 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Getting quotas for project 1fb0e213bd0d40ee9e832b54607028ab. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:20:58.864597 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b4495b8b-ced3-4284-abf1-94ba6e06abcf tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:58.864597 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b4495b8b-ced3-4284-abf1-94ba6e06abcf tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:58.876274 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-9ff9e631-b27b-4926-a672-2f1cac4da611 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Getting quotas for user 4866b2c7b7d248539783664403807b09 and project 1fb0e213bd0d40ee9e832b54607028ab. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:20:58.880908 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b4495b8b-ced3-4284-abf1-94ba6e06abcf tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:58.881584 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b4495b8b-ced3-4284-abf1-94ba6e06abcf tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:58.885522 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b4495b8b-ced3-4284-abf1-94ba6e06abcf tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:58.886166 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b4495b8b-ced3-4284-abf1-94ba6e06abcf tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:58.908045 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9ff9e631-b27b-4926-a672-2f1cac4da611 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:20:58.912077 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9ff9e631-b27b-4926-a672-2f1cac4da611 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: e3675634-9fc5-4448-8b33-707bec3adaa5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:20:59.187807 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b4495b8b-ced3-4284-abf1-94ba6e06abcf tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:59.197117 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b4495b8b-ced3-4284-abf1-94ba6e06abcf tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.354729 Apr 16 21:20:59.197970 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1981/3804] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:58 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:59.214639 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-f75db2f1-5af1-41cf-841c-41e24af63242 req-3c6c2750-12d7-4e9e-9e88-a1f2d103c6d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58b86589-e35e-4b91-b192-9f744516f66f", "name": "network-vif-deleted", "tag": "3a37d159-26e4-4121-9cef-bb552002481b"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:20:59.245718 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-f75db2f1-5af1-41cf-841c-41e24af63242 req-3c6c2750-12d7-4e9e-9e88-a1f2d103c6d0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:59.246360 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-f75db2f1-5af1-41cf-841c-41e24af63242 req-3c6c2750-12d7-4e9e-9e88-a1f2d103c6d0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:59.251943 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9ff9e631-b27b-4926-a672-2f1cac4da611 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.633802 Apr 16 21:20:59.253006 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1824/3805] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:20:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:20:59.268331 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-f75db2f1-5af1-41cf-841c-41e24af63242 req-3c6c2750-12d7-4e9e-9e88-a1f2d103c6d0 service nova] Creating event network-vif-deleted:3a37d159-26e4-4121-9cef-bb552002481b for instance 58b86589-e35e-4b91-b192-9f744516f66f on nch1-master-1 Apr 16 21:20:59.271465 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-f75db2f1-5af1-41cf-841c-41e24af63242 req-3c6c2750-12d7-4e9e-9e88-a1f2d103c6d0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060935 Apr 16 21:20:59.272701 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1982/3806] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:20:59.279546 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-345ff931-5555-4e61-805c-1c39234d65db tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:59.281211 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-345ff931-5555-4e61-805c-1c39234d65db tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:59.292863 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-345ff931-5555-4e61-805c-1c39234d65db tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:59.292863 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-345ff931-5555-4e61-805c-1c39234d65db tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:59.292863 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-345ff931-5555-4e61-805c-1c39234d65db tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:59.293582 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-345ff931-5555-4e61-805c-1c39234d65db tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:59.304616 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ee996128-93cd-42df-a2ec-824a82fbb2a5 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:59.314440 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ee996128-93cd-42df-a2ec-824a82fbb2a5 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] [instance: 58b86589-e35e-4b91-b192-9f744516f66f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:59.334012 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ee996128-93cd-42df-a2ec-824a82fbb2a5 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:59.337961 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ee996128-93cd-42df-a2ec-824a82fbb2a5 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:59.339554 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ee996128-93cd-42df-a2ec-824a82fbb2a5 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:59.340784 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ee996128-93cd-42df-a2ec-824a82fbb2a5 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:59.529054 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-345ff931-5555-4e61-805c-1c39234d65db tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:59.541295 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-345ff931-5555-4e61-805c-1c39234d65db tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.267047 Apr 16 21:20:59.544322 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1983/3807] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:59 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:59.545319 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ee996128-93cd-42df-a2ec-824a82fbb2a5 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a6ff623974d4156a05a7bd3e3b3ed5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840fd4cbe2fd414bb97f14898bf9647d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:59.555556 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d1f58e23-e5cb-4c11-b88b-727e6b736082 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:59.555556 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d1f58e23-e5cb-4c11-b88b-727e6b736082 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: e3675634-9fc5-4448-8b33-707bec3adaa5] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:59.562688 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ee996128-93cd-42df-a2ec-824a82fbb2a5 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] 10.222.0.20 "GET /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f" status: 200 len: 1252 microversion: 2.1 time: 0.306864 Apr 16 21:20:59.563703 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1825/3808] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:59 2022] GET /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f => generated 1252 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:59.617029 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1c4f8372-18ea-4d15-a20b-fb85bb1d5ef6 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:59.618496 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1c4f8372-18ea-4d15-a20b-fb85bb1d5ef6 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:59.651357 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1c4f8372-18ea-4d15-a20b-fb85bb1d5ef6 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:59.652475 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1c4f8372-18ea-4d15-a20b-fb85bb1d5ef6 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:59.653916 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1c4f8372-18ea-4d15-a20b-fb85bb1d5ef6 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:59.654440 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1c4f8372-18ea-4d15-a20b-fb85bb1d5ef6 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:59.751978 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d1f58e23-e5cb-4c11-b88b-727e6b736082 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4866b2c7b7d248539783664403807b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb0e213bd0d40ee9e832b54607028ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:20:59.765154 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d1f58e23-e5cb-4c11-b88b-727e6b736082 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] 10.222.0.20 "GET /compute/v2.1/servers/e3675634-9fc5-4448-8b33-707bec3adaa5" status: 200 len: 1224 microversion: 2.1 time: 0.218717 Apr 16 21:20:59.788008 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1984/3809] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:59 2022] GET /compute/v2.1/servers/e3675634-9fc5-4448-8b33-707bec3adaa5 => generated 1224 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:20:59.858248 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-051e5ef5-48d6-4435-a002-7bf35ed46d93 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:20:59.863959 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-051e5ef5-48d6-4435-a002-7bf35ed46d93 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:20:59.870610 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-051e5ef5-48d6-4435-a002-7bf35ed46d93 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:59.872100 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-051e5ef5-48d6-4435-a002-7bf35ed46d93 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:20:59.873508 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-051e5ef5-48d6-4435-a002-7bf35ed46d93 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:20:59.874165 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-051e5ef5-48d6-4435-a002-7bf35ed46d93 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:00.128978 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-051e5ef5-48d6-4435-a002-7bf35ed46d93 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:00.145467 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-051e5ef5-48d6-4435-a002-7bf35ed46d93 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7" status: 200 len: 1516 microversion: 2.1 time: 0.291854 Apr 16 21:21:00.164887 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1985/3810] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:59 2022] GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 => generated 1516 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:00.189281 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6c0ee283-f7b1-4744-8d1d-03950955999e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-744178696", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "6e928b67-1907-4e0d-83cb-33b917672cad"}, {"uuid": "abffeed7-315f-4bbe-a4bb-d05524a3b4e1"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:21:00.225611 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1c4f8372-18ea-4d15-a20b-fb85bb1d5ef6 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:00.239047 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1c4f8372-18ea-4d15-a20b-fb85bb1d5ef6 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.665419 Apr 16 21:21:00.253610 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1826/3811] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:20:59 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:00.260849 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-67e4fa05-857f-45f1-bc0f-3e2ff2bd5735 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:00.261723 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-67e4fa05-857f-45f1-bc0f-3e2ff2bd5735 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:00.267531 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-6c0ee283-f7b1-4744-8d1d-03950955999e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] validate_networks() for [('6e928b67-1907-4e0d-83cb-33b917672cad', None, None, None, None, None), ('abffeed7-315f-4bbe-a4bb-d05524a3b4e1', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:21:00.269540 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-67e4fa05-857f-45f1-bc0f-3e2ff2bd5735 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:00.270218 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-67e4fa05-857f-45f1-bc0f-3e2ff2bd5735 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:00.271193 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-67e4fa05-857f-45f1-bc0f-3e2ff2bd5735 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:00.271802 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-67e4fa05-857f-45f1-bc0f-3e2ff2bd5735 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:00.576065 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-67e4fa05-857f-45f1-bc0f-3e2ff2bd5735 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:00.589951 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-67e4fa05-857f-45f1-bc0f-3e2ff2bd5735 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.331876 Apr 16 21:21:00.590703 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1827/3812] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:00 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:00.595994 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f5b1e24b-4ea3-48fe-a0e5-bb0191992675 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:00.596866 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f5b1e24b-4ea3-48fe-a0e5-bb0191992675 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] [instance: 58b86589-e35e-4b91-b192-9f744516f66f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:00.618963 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f5b1e24b-4ea3-48fe-a0e5-bb0191992675 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:00.624892 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f5b1e24b-4ea3-48fe-a0e5-bb0191992675 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:00.626371 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f5b1e24b-4ea3-48fe-a0e5-bb0191992675 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:00.628045 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f5b1e24b-4ea3-48fe-a0e5-bb0191992675 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:00.717552 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f5b1e24b-4ea3-48fe-a0e5-bb0191992675 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:00.719680 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f5b1e24b-4ea3-48fe-a0e5-bb0191992675 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:00.720207 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-f5b1e24b-4ea3-48fe-a0e5-bb0191992675 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lazy-loading 'fault' on Instance uuid 58b86589-e35e-4b91-b192-9f744516f66f {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:21:00.803768 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f5b1e24b-4ea3-48fe-a0e5-bb0191992675 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a6ff623974d4156a05a7bd3e3b3ed5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '840fd4cbe2fd414bb97f14898bf9647d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:00.812647 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f5b1e24b-4ea3-48fe-a0e5-bb0191992675 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] 10.222.0.20 "GET /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f" status: 200 len: 1211 microversion: 2.1 time: 0.220200 Apr 16 21:21:00.813973 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1828/3813] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:00 2022] GET /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f => generated 1211 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:00.820305 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-64444ca4-acc2-41b4-9d40-22dd884fe377 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:21:00.840728 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-64444ca4-acc2-41b4-9d40-22dd884fe377 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:00.841316 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-64444ca4-acc2-41b4-9d40-22dd884fe377 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:00.883401 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-64444ca4-acc2-41b4-9d40-22dd884fe377 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Going to try to stop instance {{(pid=137409) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 16 21:21:01.142361 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-64444ca4-acc2-41b4-9d40-22dd884fe377 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "POST /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa/action" status: 202 len: 0 microversion: 2.1 time: 0.326397 Apr 16 21:21:01.146242 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1829/3814] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:21:00 2022] POST /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa/action => generated 0 bytes in 329 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:21:01.166379 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-204f2023-1ce9-45ee-a323-6f503e4c1558 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:01.170899 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-204f2023-1ce9-45ee-a323-6f503e4c1558 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: e3675634-9fc5-4448-8b33-707bec3adaa5] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:01.182951 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-204f2023-1ce9-45ee-a323-6f503e4c1558 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:01.204080 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-204f2023-1ce9-45ee-a323-6f503e4c1558 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:01.204080 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-204f2023-1ce9-45ee-a323-6f503e4c1558 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:01.204080 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-204f2023-1ce9-45ee-a323-6f503e4c1558 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:01.292317 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-6c0ee283-f7b1-4744-8d1d-03950955999e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:21:01.293275 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-6c0ee283-f7b1-4744-8d1d-03950955999e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:21:01.301904 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-6c0ee283-f7b1-4744-8d1d-03950955999e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:21:01.304904 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-6c0ee283-f7b1-4744-8d1d-03950955999e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:21:01.307391 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-6c0ee283-f7b1-4744-8d1d-03950955999e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:21:01.307512 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-204f2023-1ce9-45ee-a323-6f503e4c1558 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4866b2c7b7d248539783664403807b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb0e213bd0d40ee9e832b54607028ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:01.318335 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-204f2023-1ce9-45ee-a323-6f503e4c1558 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] 10.222.0.20 "GET /compute/v2.1/servers/e3675634-9fc5-4448-8b33-707bec3adaa5" status: 200 len: 1220 microversion: 2.1 time: 0.171621 Apr 16 21:21:01.328724 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1830/3815] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:01 2022] GET /compute/v2.1/servers/e3675634-9fc5-4448-8b33-707bec3adaa5 => generated 1220 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:01.328724 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6b3f0b9a-29b0-4840-89fe-ad0c14417b4e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:01.333482 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6b3f0b9a-29b0-4840-89fe-ad0c14417b4e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:01.341829 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6c0ee283-f7b1-4744-8d1d-03950955999e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:01.344374 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6c0ee283-f7b1-4744-8d1d-03950955999e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:01.344998 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6b3f0b9a-29b0-4840-89fe-ad0c14417b4e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:01.345469 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6b3f0b9a-29b0-4840-89fe-ad0c14417b4e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:01.346277 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6b3f0b9a-29b0-4840-89fe-ad0c14417b4e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:01.346729 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6b3f0b9a-29b0-4840-89fe-ad0c14417b4e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:01.349240 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6c0ee283-f7b1-4744-8d1d-03950955999e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:01.353353 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6c0ee283-f7b1-4744-8d1d-03950955999e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:01.406293 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-6c0ee283-f7b1-4744-8d1d-03950955999e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Getting quotas for project c3457cd454b04246bb4adb154b41bbb2. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:21:01.418676 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-6c0ee283-f7b1-4744-8d1d-03950955999e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Getting quotas for user 836ed2bfadd94e2a81048a0621067b33 and project c3457cd454b04246bb4adb154b41bbb2. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:21:01.434022 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6c0ee283-f7b1-4744-8d1d-03950955999e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:21:01.436585 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6c0ee283-f7b1-4744-8d1d-03950955999e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 26d907a5-99ba-4b78-bfb6-bde24a77d9ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:21:01.584505 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6c0ee283-f7b1-4744-8d1d-03950955999e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.400776 Apr 16 21:21:01.590076 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1986/3816] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:21:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1403 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 16 21:21:01.601030 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5c65fb50-a925-4975-8ce9-d43c02f0e18f tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:01.601736 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5c65fb50-a925-4975-8ce9-d43c02f0e18f tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:01.612987 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5c65fb50-a925-4975-8ce9-d43c02f0e18f tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:01.613459 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5c65fb50-a925-4975-8ce9-d43c02f0e18f tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:01.614371 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5c65fb50-a925-4975-8ce9-d43c02f0e18f tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:01.614835 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5c65fb50-a925-4975-8ce9-d43c02f0e18f tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:01.615360 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6b3f0b9a-29b0-4840-89fe-ad0c14417b4e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:01.631476 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6b3f0b9a-29b0-4840-89fe-ad0c14417b4e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1680 microversion: 2.1 time: 0.308760 Apr 16 21:21:01.654305 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1831/3817] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:01 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1680 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:01.672209 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-15666e28-ef2c-449e-a671-925eac46f4b2 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:01.676708 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-15666e28-ef2c-449e-a671-925eac46f4b2 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 26d907a5-99ba-4b78-bfb6-bde24a77d9ca] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:01.796075 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5c65fb50-a925-4975-8ce9-d43c02f0e18f tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:01.803859 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5c65fb50-a925-4975-8ce9-d43c02f0e18f tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7" status: 200 len: 1516 microversion: 2.1 time: 0.217652 Apr 16 21:21:01.817356 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1987/3818] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:01 2022] GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 => generated 1516 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:01.830112 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9d89a46d-d4c7-46ff-9e5e-e299a7dab894 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:01.830892 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9d89a46d-d4c7-46ff-9e5e-e299a7dab894 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] [instance: 58b86589-e35e-4b91-b192-9f744516f66f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:01.839661 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-15666e28-ef2c-449e-a671-925eac46f4b2 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:01.841951 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9d89a46d-d4c7-46ff-9e5e-e299a7dab894 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:01.843777 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9d89a46d-d4c7-46ff-9e5e-e299a7dab894 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:01.845117 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9d89a46d-d4c7-46ff-9e5e-e299a7dab894 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:01.846490 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9d89a46d-d4c7-46ff-9e5e-e299a7dab894 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:01.857713 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-15666e28-ef2c-449e-a671-925eac46f4b2 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca" status: 200 len: 1212 microversion: 2.1 time: 0.200994 Apr 16 21:21:01.858361 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1832/3819] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:01 2022] GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca => generated 1212 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:01.883839 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-9d89a46d-d4c7-46ff-9e5e-e299a7dab894 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] HTTP exception thrown: Instance 58b86589-e35e-4b91-b192-9f744516f66f could not be found. Apr 16 21:21:01.892402 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9d89a46d-d4c7-46ff-9e5e-e299a7dab894 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Returning 404 to user: Instance 58b86589-e35e-4b91-b192-9f744516f66f could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:21:01.892402 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9d89a46d-d4c7-46ff-9e5e-e299a7dab894 tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] 10.222.0.20 "GET /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f" status: 404 len: 111 microversion: 2.1 time: 0.061898 Apr 16 21:21:01.892402 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1988/3820] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:01 2022] GET /compute/v2.1/servers/58b86589-e35e-4b91-b192-9f744516f66f => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:21:01.898146 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e65010a5-1f80-4382-a579-4d3099bdf8be tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] Calling method '.version_select at 0x7fbb962a6280>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:01.997632 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e65010a5-1f80-4382-a579-4d3099bdf8be tempest-ServersTestBootFromVolume-1004751907 tempest-ServersTestBootFromVolume-1004751907-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1500824956" status: 202 len: 0 microversion: 2.1 time: 0.103164 Apr 16 21:21:01.998881 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1833/3821] 10.222.0.20 () {58 vars in 1220 bytes} [Sat Apr 16 21:21:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1500824956 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:21:02.338617 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a5b42c92-90ea-4ccd-b552-ca1ebf9b07a4 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:02.339236 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a5b42c92-90ea-4ccd-b552-ca1ebf9b07a4 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: e3675634-9fc5-4448-8b33-707bec3adaa5] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:02.349266 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a5b42c92-90ea-4ccd-b552-ca1ebf9b07a4 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:02.352827 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a5b42c92-90ea-4ccd-b552-ca1ebf9b07a4 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:02.353862 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a5b42c92-90ea-4ccd-b552-ca1ebf9b07a4 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:02.354476 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a5b42c92-90ea-4ccd-b552-ca1ebf9b07a4 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:02.478082 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a5b42c92-90ea-4ccd-b552-ca1ebf9b07a4 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4866b2c7b7d248539783664403807b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb0e213bd0d40ee9e832b54607028ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:02.484709 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a5b42c92-90ea-4ccd-b552-ca1ebf9b07a4 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] 10.222.0.20 "GET /compute/v2.1/servers/e3675634-9fc5-4448-8b33-707bec3adaa5" status: 200 len: 1282 microversion: 2.1 time: 0.149892 Apr 16 21:21:02.494952 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1989/3822] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:02 2022] GET /compute/v2.1/servers/e3675634-9fc5-4448-8b33-707bec3adaa5 => generated 1282 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:02.671852 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2d83d3bd-8e15-499c-bfb6-64fb2d8b6e40 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:02.672507 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2d83d3bd-8e15-499c-bfb6-64fb2d8b6e40 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:02.680018 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2d83d3bd-8e15-499c-bfb6-64fb2d8b6e40 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:02.681796 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2d83d3bd-8e15-499c-bfb6-64fb2d8b6e40 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:02.681988 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2d83d3bd-8e15-499c-bfb6-64fb2d8b6e40 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:02.682619 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2d83d3bd-8e15-499c-bfb6-64fb2d8b6e40 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:02.825061 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-82d13dc9-e1e9-4b35-945b-fbe0e75e741f tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:02.826014 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-82d13dc9-e1e9-4b35-945b-fbe0e75e741f tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:02.839513 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-82d13dc9-e1e9-4b35-945b-fbe0e75e741f tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:02.840624 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-82d13dc9-e1e9-4b35-945b-fbe0e75e741f tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:02.842122 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-82d13dc9-e1e9-4b35-945b-fbe0e75e741f tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:02.842775 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-82d13dc9-e1e9-4b35-945b-fbe0e75e741f tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:03.091153 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2d83d3bd-8e15-499c-bfb6-64fb2d8b6e40 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:03.093144 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-82d13dc9-e1e9-4b35-945b-fbe0e75e741f tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:03.103601 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-82d13dc9-e1e9-4b35-945b-fbe0e75e741f tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7" status: 200 len: 1516 microversion: 2.1 time: 0.283914 Apr 16 21:21:03.105923 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2d83d3bd-8e15-499c-bfb6-64fb2d8b6e40 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1680 microversion: 2.1 time: 0.438104 Apr 16 21:21:03.106764 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1834/3823] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:02 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1680 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:03.120106 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ec9391cf-1809-4121-8746-d9f0d97aaa04 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:03.121170 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ec9391cf-1809-4121-8746-d9f0d97aaa04 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 26d907a5-99ba-4b78-bfb6-bde24a77d9ca] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:03.124010 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1990/3824] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:02 2022] GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 => generated 1516 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:03.131491 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ec9391cf-1809-4121-8746-d9f0d97aaa04 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:03.132735 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ec9391cf-1809-4121-8746-d9f0d97aaa04 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:03.133789 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ec9391cf-1809-4121-8746-d9f0d97aaa04 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:03.134457 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ec9391cf-1809-4121-8746-d9f0d97aaa04 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:03.280045 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ec9391cf-1809-4121-8746-d9f0d97aaa04 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:03.288526 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ec9391cf-1809-4121-8746-d9f0d97aaa04 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca" status: 200 len: 1216 microversion: 2.1 time: 0.179927 Apr 16 21:21:03.289128 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1835/3825] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:03 2022] GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca => generated 1216 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:03.502439 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bc7557cc-0e75-433d-86b5-ddb1c103a0cc tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:03.503064 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-bc7557cc-0e75-433d-86b5-ddb1c103a0cc tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: e3675634-9fc5-4448-8b33-707bec3adaa5] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:03.510039 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bc7557cc-0e75-433d-86b5-ddb1c103a0cc tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:03.514718 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bc7557cc-0e75-433d-86b5-ddb1c103a0cc tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:03.514718 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bc7557cc-0e75-433d-86b5-ddb1c103a0cc tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:03.514718 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bc7557cc-0e75-433d-86b5-ddb1c103a0cc tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:03.638095 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-bc7557cc-0e75-433d-86b5-ddb1c103a0cc tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4866b2c7b7d248539783664403807b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb0e213bd0d40ee9e832b54607028ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:03.648039 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-bc7557cc-0e75-433d-86b5-ddb1c103a0cc tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] 10.222.0.20 "GET /compute/v2.1/servers/e3675634-9fc5-4448-8b33-707bec3adaa5" status: 200 len: 1282 microversion: 2.1 time: 0.149308 Apr 16 21:21:03.665542 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1991/3826] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:03 2022] GET /compute/v2.1/servers/e3675634-9fc5-4448-8b33-707bec3adaa5 => generated 1282 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:04.137428 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4d8d4bce-0a77-4d70-bb49-2921da38afc2 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:04.138573 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8848aa9a-63ff-41d1-96cf-c54352d3052f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:04.139702 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4d8d4bce-0a77-4d70-bb49-2921da38afc2 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:04.141243 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8848aa9a-63ff-41d1-96cf-c54352d3052f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:04.170255 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4d8d4bce-0a77-4d70-bb49-2921da38afc2 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:04.170736 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4d8d4bce-0a77-4d70-bb49-2921da38afc2 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:04.173014 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8848aa9a-63ff-41d1-96cf-c54352d3052f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:04.173443 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8848aa9a-63ff-41d1-96cf-c54352d3052f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:04.176160 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4d8d4bce-0a77-4d70-bb49-2921da38afc2 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:04.176778 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4d8d4bce-0a77-4d70-bb49-2921da38afc2 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:04.177866 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8848aa9a-63ff-41d1-96cf-c54352d3052f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:04.184932 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8848aa9a-63ff-41d1-96cf-c54352d3052f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:04.724543 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8848aa9a-63ff-41d1-96cf-c54352d3052f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:04.734878 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8848aa9a-63ff-41d1-96cf-c54352d3052f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1680 microversion: 2.1 time: 0.614587 Apr 16 21:21:04.735813 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1836/3827] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:04 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1680 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:04.752944 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-83653931-45ed-4b9d-9016-21582d5a4cf7 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:04.754160 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-83653931-45ed-4b9d-9016-21582d5a4cf7 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 26d907a5-99ba-4b78-bfb6-bde24a77d9ca] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:04.761871 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-83653931-45ed-4b9d-9016-21582d5a4cf7 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:04.762406 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-83653931-45ed-4b9d-9016-21582d5a4cf7 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:04.763408 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-83653931-45ed-4b9d-9016-21582d5a4cf7 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:04.764202 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-83653931-45ed-4b9d-9016-21582d5a4cf7 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:04.854791 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4d8d4bce-0a77-4d70-bb49-2921da38afc2 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:04.863077 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4d8d4bce-0a77-4d70-bb49-2921da38afc2 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7" status: 200 len: 1516 microversion: 2.1 time: 0.737365 Apr 16 21:21:04.864067 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1992/3828] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:04 2022] GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 => generated 1516 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:04.869632 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d91bfae6-1ef5-47c7-b22f-8e27b1fc925e tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:04.870321 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d91bfae6-1ef5-47c7-b22f-8e27b1fc925e tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: e3675634-9fc5-4448-8b33-707bec3adaa5] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:04.876729 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d91bfae6-1ef5-47c7-b22f-8e27b1fc925e tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:04.877302 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d91bfae6-1ef5-47c7-b22f-8e27b1fc925e tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:04.878308 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d91bfae6-1ef5-47c7-b22f-8e27b1fc925e tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:04.878986 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d91bfae6-1ef5-47c7-b22f-8e27b1fc925e tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:04.897249 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-83653931-45ed-4b9d-9016-21582d5a4cf7 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:04.915423 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-83653931-45ed-4b9d-9016-21582d5a4cf7 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca" status: 200 len: 1282 microversion: 2.1 time: 0.176819 Apr 16 21:21:04.916693 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1837/3829] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:04 2022] GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca => generated 1282 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:05.246822 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d91bfae6-1ef5-47c7-b22f-8e27b1fc925e tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4866b2c7b7d248539783664403807b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb0e213bd0d40ee9e832b54607028ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:05.262677 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d91bfae6-1ef5-47c7-b22f-8e27b1fc925e tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] 10.222.0.20 "GET /compute/v2.1/servers/e3675634-9fc5-4448-8b33-707bec3adaa5" status: 200 len: 1324 microversion: 2.1 time: 0.397242 Apr 16 21:21:05.264671 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1993/3830] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:04 2022] GET /compute/v2.1/servers/e3675634-9fc5-4448-8b33-707bec3adaa5 => generated 1324 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:05.754247 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1a3d9f14-116b-4a00-b54f-309ef404e7cc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:05.754852 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1a3d9f14-116b-4a00-b54f-309ef404e7cc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:05.772292 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1a3d9f14-116b-4a00-b54f-309ef404e7cc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:05.772962 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1a3d9f14-116b-4a00-b54f-309ef404e7cc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:05.776631 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1a3d9f14-116b-4a00-b54f-309ef404e7cc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:05.779997 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1a3d9f14-116b-4a00-b54f-309ef404e7cc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:05.885549 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1763dca9-f6f9-4100-be94-49fe541146d6 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:05.886586 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1763dca9-f6f9-4100-be94-49fe541146d6 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:05.911533 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1763dca9-f6f9-4100-be94-49fe541146d6 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:05.911533 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1763dca9-f6f9-4100-be94-49fe541146d6 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:05.911533 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1763dca9-f6f9-4100-be94-49fe541146d6 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:05.911533 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1763dca9-f6f9-4100-be94-49fe541146d6 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:06.192153 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1763dca9-f6f9-4100-be94-49fe541146d6 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:06.200967 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1763dca9-f6f9-4100-be94-49fe541146d6 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7" status: 200 len: 1516 microversion: 2.1 time: 0.323769 Apr 16 21:21:06.202006 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1994/3831] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:05 2022] GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 => generated 1516 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:06.207311 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-57451018-5e75-48e5-ae03-7f66ff569115 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:06.208198 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-57451018-5e75-48e5-ae03-7f66ff569115 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 26d907a5-99ba-4b78-bfb6-bde24a77d9ca] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:06.217222 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-57451018-5e75-48e5-ae03-7f66ff569115 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:06.218088 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-57451018-5e75-48e5-ae03-7f66ff569115 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:06.219189 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-57451018-5e75-48e5-ae03-7f66ff569115 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:06.221514 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-57451018-5e75-48e5-ae03-7f66ff569115 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:06.231108 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1a3d9f14-116b-4a00-b54f-309ef404e7cc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:06.245399 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1a3d9f14-116b-4a00-b54f-309ef404e7cc tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1680 microversion: 2.1 time: 0.495232 Apr 16 21:21:06.246267 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1838/3832] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:05 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1680 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:06.285597 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-227e298e-b37b-47bc-8690-5832daa72f55 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:06.286969 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-227e298e-b37b-47bc-8690-5832daa72f55 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: e3675634-9fc5-4448-8b33-707bec3adaa5] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:06.295396 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-227e298e-b37b-47bc-8690-5832daa72f55 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:06.299386 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-227e298e-b37b-47bc-8690-5832daa72f55 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:06.302209 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-227e298e-b37b-47bc-8690-5832daa72f55 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:06.302209 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-227e298e-b37b-47bc-8690-5832daa72f55 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:06.309958 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-57451018-5e75-48e5-ae03-7f66ff569115 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:06.317335 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-57451018-5e75-48e5-ae03-7f66ff569115 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca" status: 200 len: 1270 microversion: 2.1 time: 0.114221 Apr 16 21:21:06.317956 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1995/3833] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:06 2022] GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca => generated 1270 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:06.475324 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-54e7f0cb-0c61-4fdb-b151-e5164a871a9f req-637e9530-4739-4faf-89ef-8e1b7f6c1cbd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3675634-9fc5-4448-8b33-707bec3adaa5", "tag": "b27f4ef2-9de6-4c41-9578-cab9cfbbe412"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:21:06.501058 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-54e7f0cb-0c61-4fdb-b151-e5164a871a9f req-637e9530-4739-4faf-89ef-8e1b7f6c1cbd service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:06.502005 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-54e7f0cb-0c61-4fdb-b151-e5164a871a9f req-637e9530-4739-4faf-89ef-8e1b7f6c1cbd service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:06.533416 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-54e7f0cb-0c61-4fdb-b151-e5164a871a9f req-637e9530-4739-4faf-89ef-8e1b7f6c1cbd service nova] Creating event network-changed:b27f4ef2-9de6-4c41-9578-cab9cfbbe412 for instance e3675634-9fc5-4448-8b33-707bec3adaa5 on nch1-master-1 Apr 16 21:21:06.542212 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-54e7f0cb-0c61-4fdb-b151-e5164a871a9f req-637e9530-4739-4faf-89ef-8e1b7f6c1cbd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069620 Apr 16 21:21:06.551683 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1996/3834] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:21:06.759238 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-227e298e-b37b-47bc-8690-5832daa72f55 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4866b2c7b7d248539783664403807b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb0e213bd0d40ee9e832b54607028ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:06.771330 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-227e298e-b37b-47bc-8690-5832daa72f55 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] 10.222.0.20 "GET /compute/v2.1/servers/e3675634-9fc5-4448-8b33-707bec3adaa5" status: 200 len: 1324 microversion: 2.1 time: 0.493004 Apr 16 21:21:06.771969 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1839/3835] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:06 2022] GET /compute/v2.1/servers/e3675634-9fc5-4448-8b33-707bec3adaa5 => generated 1324 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:07.221105 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-aee2defe-6d7d-4030-8771-61ad41a27680 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:07.222658 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-aee2defe-6d7d-4030-8771-61ad41a27680 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:07.240584 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aee2defe-6d7d-4030-8771-61ad41a27680 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:07.241466 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aee2defe-6d7d-4030-8771-61ad41a27680 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:07.243418 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aee2defe-6d7d-4030-8771-61ad41a27680 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:07.244328 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aee2defe-6d7d-4030-8771-61ad41a27680 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:07.266165 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a8c67a1b-8d40-48c7-aeac-77964b54cb5e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:07.270544 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a8c67a1b-8d40-48c7-aeac-77964b54cb5e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:07.280672 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a8c67a1b-8d40-48c7-aeac-77964b54cb5e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:07.283723 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a8c67a1b-8d40-48c7-aeac-77964b54cb5e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:07.283723 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a8c67a1b-8d40-48c7-aeac-77964b54cb5e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:07.283723 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a8c67a1b-8d40-48c7-aeac-77964b54cb5e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:07.546100 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-aee2defe-6d7d-4030-8771-61ad41a27680 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:07.554455 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-aee2defe-6d7d-4030-8771-61ad41a27680 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7" status: 200 len: 1516 microversion: 2.1 time: 0.339651 Apr 16 21:21:07.556189 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1997/3836] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:07 2022] GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 => generated 1516 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:07.574297 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1729b812-4542-461d-bd04-77ab12f712f9 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:07.574930 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1729b812-4542-461d-bd04-77ab12f712f9 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 26d907a5-99ba-4b78-bfb6-bde24a77d9ca] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:07.588826 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1729b812-4542-461d-bd04-77ab12f712f9 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:07.589806 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1729b812-4542-461d-bd04-77ab12f712f9 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:07.593102 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1729b812-4542-461d-bd04-77ab12f712f9 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:07.593764 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1729b812-4542-461d-bd04-77ab12f712f9 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:07.662842 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a8c67a1b-8d40-48c7-aeac-77964b54cb5e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:07.675897 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a8c67a1b-8d40-48c7-aeac-77964b54cb5e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1680 microversion: 2.1 time: 0.415277 Apr 16 21:21:07.677707 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1840/3837] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:07 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1680 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:21:07.788992 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ba96af86-68ce-4424-9e2e-d80440e35609 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:07.790311 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ba96af86-68ce-4424-9e2e-d80440e35609 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: e3675634-9fc5-4448-8b33-707bec3adaa5] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:07.799828 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ba96af86-68ce-4424-9e2e-d80440e35609 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:07.800571 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ba96af86-68ce-4424-9e2e-d80440e35609 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:07.801584 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ba96af86-68ce-4424-9e2e-d80440e35609 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:07.802480 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ba96af86-68ce-4424-9e2e-d80440e35609 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:07.940001 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1729b812-4542-461d-bd04-77ab12f712f9 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:07.950735 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1729b812-4542-461d-bd04-77ab12f712f9 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca" status: 200 len: 1312 microversion: 2.1 time: 0.393112 Apr 16 21:21:07.953811 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1998/3838] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:07 2022] GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca => generated 1312 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:08.215717 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ba96af86-68ce-4424-9e2e-d80440e35609 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4866b2c7b7d248539783664403807b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb0e213bd0d40ee9e832b54607028ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:08.229660 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ba96af86-68ce-4424-9e2e-d80440e35609 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] 10.222.0.20 "GET /compute/v2.1/servers/e3675634-9fc5-4448-8b33-707bec3adaa5" status: 200 len: 1324 microversion: 2.1 time: 0.444937 Apr 16 21:21:08.234798 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1841/3839] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:07 2022] GET /compute/v2.1/servers/e3675634-9fc5-4448-8b33-707bec3adaa5 => generated 1324 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:21:08.572744 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d89e42e9-c88d-45e4-91ae-a05963ca009e tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:08.574380 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d89e42e9-c88d-45e4-91ae-a05963ca009e tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:08.583107 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d89e42e9-c88d-45e4-91ae-a05963ca009e tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:08.586664 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d89e42e9-c88d-45e4-91ae-a05963ca009e tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:08.588022 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d89e42e9-c88d-45e4-91ae-a05963ca009e tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:08.588666 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d89e42e9-c88d-45e4-91ae-a05963ca009e tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:08.695392 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-df0a6f2a-510b-44cc-9cf8-b6ed6c6b2c84 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:08.698757 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-df0a6f2a-510b-44cc-9cf8-b6ed6c6b2c84 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:08.707073 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-df0a6f2a-510b-44cc-9cf8-b6ed6c6b2c84 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:08.707855 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-df0a6f2a-510b-44cc-9cf8-b6ed6c6b2c84 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:08.709500 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-df0a6f2a-510b-44cc-9cf8-b6ed6c6b2c84 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:08.714371 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-df0a6f2a-510b-44cc-9cf8-b6ed6c6b2c84 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:08.937816 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d89e42e9-c88d-45e4-91ae-a05963ca009e tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:08.949689 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d89e42e9-c88d-45e4-91ae-a05963ca009e tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7" status: 200 len: 1516 microversion: 2.1 time: 0.381501 Apr 16 21:21:08.950947 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 1999/3840] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:08 2022] GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 => generated 1516 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:08.970712 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a52275de-1c22-4122-a3e2-532b0ff77ac6 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:08.971357 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a52275de-1c22-4122-a3e2-532b0ff77ac6 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 26d907a5-99ba-4b78-bfb6-bde24a77d9ca] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:08.978578 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a52275de-1c22-4122-a3e2-532b0ff77ac6 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:08.980668 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a52275de-1c22-4122-a3e2-532b0ff77ac6 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:08.980668 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a52275de-1c22-4122-a3e2-532b0ff77ac6 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:08.981560 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a52275de-1c22-4122-a3e2-532b0ff77ac6 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:09.091013 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-df0a6f2a-510b-44cc-9cf8-b6ed6c6b2c84 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:09.098649 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-df0a6f2a-510b-44cc-9cf8-b6ed6c6b2c84 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1680 microversion: 2.1 time: 0.407279 Apr 16 21:21:09.114141 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1842/3841] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:08 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1680 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:09.250202 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e6ae81d2-458e-49f9-b449-509e102708ba tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:09.250829 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e6ae81d2-458e-49f9-b449-509e102708ba tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: e3675634-9fc5-4448-8b33-707bec3adaa5] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:09.259728 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e6ae81d2-458e-49f9-b449-509e102708ba tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:09.260278 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e6ae81d2-458e-49f9-b449-509e102708ba tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:09.261018 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e6ae81d2-458e-49f9-b449-509e102708ba tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:09.266623 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e6ae81d2-458e-49f9-b449-509e102708ba tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:09.520801 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e6ae81d2-458e-49f9-b449-509e102708ba tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4866b2c7b7d248539783664403807b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb0e213bd0d40ee9e832b54607028ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:09.535674 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e6ae81d2-458e-49f9-b449-509e102708ba tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] 10.222.0.20 "GET /compute/v2.1/servers/e3675634-9fc5-4448-8b33-707bec3adaa5" status: 200 len: 1324 microversion: 2.1 time: 0.289219 Apr 16 21:21:09.544495 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1843/3842] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:09 2022] GET /compute/v2.1/servers/e3675634-9fc5-4448-8b33-707bec3adaa5 => generated 1324 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:09.639732 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a52275de-1c22-4122-a3e2-532b0ff77ac6 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:09.663976 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a52275de-1c22-4122-a3e2-532b0ff77ac6 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca" status: 200 len: 1333 microversion: 2.1 time: 0.696013 Apr 16 21:21:09.692983 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2000/3843] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:08 2022] GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca => generated 1333 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:09.971362 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-eab75d0a-ae1f-467b-a5be-f86ab846da47 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:09.971362 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-eab75d0a-ae1f-467b-a5be-f86ab846da47 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:09.975621 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eab75d0a-ae1f-467b-a5be-f86ab846da47 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:09.976084 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eab75d0a-ae1f-467b-a5be-f86ab846da47 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:09.976928 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eab75d0a-ae1f-467b-a5be-f86ab846da47 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:09.989374 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eab75d0a-ae1f-467b-a5be-f86ab846da47 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:10.123861 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0c5f58a3-cf0e-48a9-8376-675e9fe75151 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:10.124649 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0c5f58a3-cf0e-48a9-8376-675e9fe75151 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:10.139471 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0c5f58a3-cf0e-48a9-8376-675e9fe75151 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:10.139949 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0c5f58a3-cf0e-48a9-8376-675e9fe75151 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:10.140815 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0c5f58a3-cf0e-48a9-8376-675e9fe75151 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:10.141254 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0c5f58a3-cf0e-48a9-8376-675e9fe75151 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:10.342381 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-eab75d0a-ae1f-467b-a5be-f86ab846da47 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:10.351438 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-eab75d0a-ae1f-467b-a5be-f86ab846da47 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7" status: 200 len: 1516 microversion: 2.1 time: 0.387727 Apr 16 21:21:10.355979 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1844/3844] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:09 2022] GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 => generated 1516 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:10.515862 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0c5f58a3-cf0e-48a9-8376-675e9fe75151 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:10.531514 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0c5f58a3-cf0e-48a9-8376-675e9fe75151 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1680 microversion: 2.1 time: 0.415163 Apr 16 21:21:10.532481 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2001/3845] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:10 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1680 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:21:10.562983 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-69bb2057-470d-4a4f-8888-f218d5cfffe6 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:10.564086 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-69bb2057-470d-4a4f-8888-f218d5cfffe6 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: e3675634-9fc5-4448-8b33-707bec3adaa5] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:10.573593 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-69bb2057-470d-4a4f-8888-f218d5cfffe6 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:10.574312 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-69bb2057-470d-4a4f-8888-f218d5cfffe6 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:10.575516 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-69bb2057-470d-4a4f-8888-f218d5cfffe6 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:10.576863 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-69bb2057-470d-4a4f-8888-f218d5cfffe6 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:10.685227 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-859ccd36-be38-4ed6-a4fa-2416176ed551 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:10.686466 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-859ccd36-be38-4ed6-a4fa-2416176ed551 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 26d907a5-99ba-4b78-bfb6-bde24a77d9ca] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:10.696772 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-859ccd36-be38-4ed6-a4fa-2416176ed551 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:10.697239 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-859ccd36-be38-4ed6-a4fa-2416176ed551 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:10.698049 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-859ccd36-be38-4ed6-a4fa-2416176ed551 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:10.700492 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-859ccd36-be38-4ed6-a4fa-2416176ed551 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:11.144539 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-859ccd36-be38-4ed6-a4fa-2416176ed551 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:11.165321 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-859ccd36-be38-4ed6-a4fa-2416176ed551 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca" status: 200 len: 1333 microversion: 2.1 time: 0.474539 Apr 16 21:21:11.170265 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2002/3846] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:10 2022] GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca => generated 1333 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:21:11.177160 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-61e633e7-702e-4913-9b34-b33f38600d74 req-b3eba56b-d12c-4641-885d-7e144da108b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26d907a5-99ba-4b78-bfb6-bde24a77d9ca", "tag": "15fd4ebd-e376-4ff7-a23e-3fcf24c60d16"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:21:11.188804 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-61e633e7-702e-4913-9b34-b33f38600d74 req-b3eba56b-d12c-4641-885d-7e144da108b5 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:11.189488 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-61e633e7-702e-4913-9b34-b33f38600d74 req-b3eba56b-d12c-4641-885d-7e144da108b5 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:11.203891 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-61e633e7-702e-4913-9b34-b33f38600d74 req-b3eba56b-d12c-4641-885d-7e144da108b5 service nova] Creating event network-changed:15fd4ebd-e376-4ff7-a23e-3fcf24c60d16 for instance 26d907a5-99ba-4b78-bfb6-bde24a77d9ca on nch2-master-1 Apr 16 21:21:11.209497 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-61e633e7-702e-4913-9b34-b33f38600d74 req-b3eba56b-d12c-4641-885d-7e144da108b5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037748 Apr 16 21:21:11.210699 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2003/3847] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:21:11.307505 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-69bb2057-470d-4a4f-8888-f218d5cfffe6 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4866b2c7b7d248539783664403807b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb0e213bd0d40ee9e832b54607028ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:11.324041 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-69bb2057-470d-4a4f-8888-f218d5cfffe6 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] 10.222.0.20 "GET /compute/v2.1/servers/e3675634-9fc5-4448-8b33-707bec3adaa5" status: 200 len: 1324 microversion: 2.1 time: 0.766402 Apr 16 21:21:11.325257 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1845/3848] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:10 2022] GET /compute/v2.1/servers/e3675634-9fc5-4448-8b33-707bec3adaa5 => generated 1324 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:11.375408 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a79971f4-f705-473b-91f6-d5fb6e8aef35 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:11.381078 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a79971f4-f705-473b-91f6-d5fb6e8aef35 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:11.391202 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a79971f4-f705-473b-91f6-d5fb6e8aef35 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:11.391674 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a79971f4-f705-473b-91f6-d5fb6e8aef35 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:11.393936 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a79971f4-f705-473b-91f6-d5fb6e8aef35 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:11.394390 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a79971f4-f705-473b-91f6-d5fb6e8aef35 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:11.555513 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-16804a16-44b4-4bfb-ba50-1f3173e2abb9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:11.557772 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-16804a16-44b4-4bfb-ba50-1f3173e2abb9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:11.572245 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-16804a16-44b4-4bfb-ba50-1f3173e2abb9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:11.576338 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-16804a16-44b4-4bfb-ba50-1f3173e2abb9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:11.577700 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-16804a16-44b4-4bfb-ba50-1f3173e2abb9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:11.578429 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-16804a16-44b4-4bfb-ba50-1f3173e2abb9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:11.725749 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a79971f4-f705-473b-91f6-d5fb6e8aef35 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:11.736040 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a79971f4-f705-473b-91f6-d5fb6e8aef35 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7" status: 200 len: 1516 microversion: 2.1 time: 0.370393 Apr 16 21:21:11.738275 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2004/3849] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:11 2022] GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 => generated 1516 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:11.860001 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-16804a16-44b4-4bfb-ba50-1f3173e2abb9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:11.871871 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-16804a16-44b4-4bfb-ba50-1f3173e2abb9 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1680 microversion: 2.1 time: 0.326442 Apr 16 21:21:11.882474 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1846/3850] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:11 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1680 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:12.183203 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b39fa390-23e5-4f7c-9ebb-c713d3f4ab30 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:12.184439 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b39fa390-23e5-4f7c-9ebb-c713d3f4ab30 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 26d907a5-99ba-4b78-bfb6-bde24a77d9ca] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:12.190968 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b39fa390-23e5-4f7c-9ebb-c713d3f4ab30 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:12.195350 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b39fa390-23e5-4f7c-9ebb-c713d3f4ab30 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:12.195350 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b39fa390-23e5-4f7c-9ebb-c713d3f4ab30 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:12.195350 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b39fa390-23e5-4f7c-9ebb-c713d3f4ab30 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:12.342088 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5f74941e-f230-44a6-9cbc-c4917651f1bd tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:12.342709 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5f74941e-f230-44a6-9cbc-c4917651f1bd tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: e3675634-9fc5-4448-8b33-707bec3adaa5] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:12.359637 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5f74941e-f230-44a6-9cbc-c4917651f1bd tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:12.360260 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5f74941e-f230-44a6-9cbc-c4917651f1bd tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:12.360992 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5f74941e-f230-44a6-9cbc-c4917651f1bd tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:12.361518 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5f74941e-f230-44a6-9cbc-c4917651f1bd tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:12.630682 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b39fa390-23e5-4f7c-9ebb-c713d3f4ab30 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:12.647305 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b39fa390-23e5-4f7c-9ebb-c713d3f4ab30 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca" status: 200 len: 1333 microversion: 2.1 time: 0.466693 Apr 16 21:21:12.647305 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2005/3851] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:12 2022] GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca => generated 1333 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:12.661943 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5f74941e-f230-44a6-9cbc-c4917651f1bd tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4866b2c7b7d248539783664403807b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb0e213bd0d40ee9e832b54607028ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:12.678382 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5f74941e-f230-44a6-9cbc-c4917651f1bd tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] 10.222.0.20 "GET /compute/v2.1/servers/e3675634-9fc5-4448-8b33-707bec3adaa5" status: 200 len: 1324 microversion: 2.1 time: 0.340657 Apr 16 21:21:12.691153 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1847/3852] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:12 2022] GET /compute/v2.1/servers/e3675634-9fc5-4448-8b33-707bec3adaa5 => generated 1324 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:12.755279 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8909ab51-b624-40c9-9924-1b2c6d954663 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:12.755893 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8909ab51-b624-40c9-9924-1b2c6d954663 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:12.764297 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8909ab51-b624-40c9-9924-1b2c6d954663 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:12.764782 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8909ab51-b624-40c9-9924-1b2c6d954663 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:12.765565 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8909ab51-b624-40c9-9924-1b2c6d954663 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:12.766009 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8909ab51-b624-40c9-9924-1b2c6d954663 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:12.908599 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-49cc6827-caaf-410e-8927-8b821d03ec00 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:12.911255 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-49cc6827-caaf-410e-8927-8b821d03ec00 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:12.923495 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-49cc6827-caaf-410e-8927-8b821d03ec00 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:12.924437 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-49cc6827-caaf-410e-8927-8b821d03ec00 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:12.925417 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-49cc6827-caaf-410e-8927-8b821d03ec00 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:12.926093 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-49cc6827-caaf-410e-8927-8b821d03ec00 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:13.058932 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8909ab51-b624-40c9-9924-1b2c6d954663 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:13.070498 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8909ab51-b624-40c9-9924-1b2c6d954663 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7" status: 200 len: 1516 microversion: 2.1 time: 0.318859 Apr 16 21:21:13.073207 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2006/3853] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:12 2022] GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 => generated 1516 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:13.081171 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-59e687f1-0033-468e-b4d5-b90fbe9cd480 req-91557c8f-198f-44b0-846d-322398f4070b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3675634-9fc5-4448-8b33-707bec3adaa5", "name": "network-vif-plugged", "status": "completed", "tag": "b27f4ef2-9de6-4c41-9578-cab9cfbbe412"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:21:13.098723 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-59e687f1-0033-468e-b4d5-b90fbe9cd480 req-91557c8f-198f-44b0-846d-322398f4070b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:13.102887 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-59e687f1-0033-468e-b4d5-b90fbe9cd480 req-91557c8f-198f-44b0-846d-322398f4070b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:13.133063 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-59e687f1-0033-468e-b4d5-b90fbe9cd480 req-91557c8f-198f-44b0-846d-322398f4070b service nova] Creating event network-vif-plugged:b27f4ef2-9de6-4c41-9578-cab9cfbbe412 for instance e3675634-9fc5-4448-8b33-707bec3adaa5 on nch1-master-1 Apr 16 21:21:13.146513 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-59e687f1-0033-468e-b4d5-b90fbe9cd480 req-91557c8f-198f-44b0-846d-322398f4070b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071279 Apr 16 21:21:13.148202 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2007/3854] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:21:13.161935 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-49cc6827-caaf-410e-8927-8b821d03ec00 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:13.171485 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-49cc6827-caaf-410e-8927-8b821d03ec00 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1657 microversion: 2.1 time: 0.276903 Apr 16 21:21:13.184104 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1848/3855] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:12 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1657 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:13.204251 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fb2121f9-2d06-4bc1-8211-6f94f666830f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:21:13.228609 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fb2121f9-2d06-4bc1-8211-6f94f666830f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:13.228609 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fb2121f9-2d06-4bc1-8211-6f94f666830f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:13.270226 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fb2121f9-2d06-4bc1-8211-6f94f666830f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Going to try to start instance {{(pid=137408) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 16 21:21:13.291313 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-fcb8f5d4-56df-491a-b128-3974c4976935 req-0f12a186-a99b-4543-924d-d63c5e7c7f82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26d907a5-99ba-4b78-bfb6-bde24a77d9ca", "tag": "30c99ab2-73f0-439e-9ac5-efccf5042446"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:21:13.310263 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-fcb8f5d4-56df-491a-b128-3974c4976935 req-0f12a186-a99b-4543-924d-d63c5e7c7f82 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:13.311038 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-fcb8f5d4-56df-491a-b128-3974c4976935 req-0f12a186-a99b-4543-924d-d63c5e7c7f82 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:13.338977 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-fcb8f5d4-56df-491a-b128-3974c4976935 req-0f12a186-a99b-4543-924d-d63c5e7c7f82 service nova] Creating event network-changed:30c99ab2-73f0-439e-9ac5-efccf5042446 for instance 26d907a5-99ba-4b78-bfb6-bde24a77d9ca on nch2-master-1 Apr 16 21:21:13.348375 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-fcb8f5d4-56df-491a-b128-3974c4976935 req-0f12a186-a99b-4543-924d-d63c5e7c7f82 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065809 Apr 16 21:21:13.352692 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1849/3856] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:21:13.539683 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fb2121f9-2d06-4bc1-8211-6f94f666830f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "POST /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa/action" status: 202 len: 0 microversion: 2.1 time: 0.342909 Apr 16 21:21:13.551341 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-253cb610-3e25-4ecb-bedb-f8dad85fb98a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:13.551985 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-253cb610-3e25-4ecb-bedb-f8dad85fb98a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:13.557500 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2008/3857] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:21:13 2022] POST /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa/action => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:21:13.559849 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-253cb610-3e25-4ecb-bedb-f8dad85fb98a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:13.566185 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-253cb610-3e25-4ecb-bedb-f8dad85fb98a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:13.566185 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-253cb610-3e25-4ecb-bedb-f8dad85fb98a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:13.566185 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-253cb610-3e25-4ecb-bedb-f8dad85fb98a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:13.664072 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f36d0914-5127-4664-afe7-1b518213a897 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:13.664810 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f36d0914-5127-4664-afe7-1b518213a897 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 26d907a5-99ba-4b78-bfb6-bde24a77d9ca] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:13.671327 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f36d0914-5127-4664-afe7-1b518213a897 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:13.671796 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f36d0914-5127-4664-afe7-1b518213a897 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:13.673259 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f36d0914-5127-4664-afe7-1b518213a897 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:13.673731 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f36d0914-5127-4664-afe7-1b518213a897 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:13.743731 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-253cb610-3e25-4ecb-bedb-f8dad85fb98a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:13.753033 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-253cb610-3e25-4ecb-bedb-f8dad85fb98a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1666 microversion: 2.1 time: 0.209246 Apr 16 21:21:13.753699 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1850/3858] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:13 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1666 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:21:13.767295 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-729aafbe-91fa-4851-a539-82f9c1d9e321 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:13.768073 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-729aafbe-91fa-4851-a539-82f9c1d9e321 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: e3675634-9fc5-4448-8b33-707bec3adaa5] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:13.776595 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-729aafbe-91fa-4851-a539-82f9c1d9e321 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:13.777482 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-729aafbe-91fa-4851-a539-82f9c1d9e321 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:13.778780 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-729aafbe-91fa-4851-a539-82f9c1d9e321 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:13.779357 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-729aafbe-91fa-4851-a539-82f9c1d9e321 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:13.874072 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f36d0914-5127-4664-afe7-1b518213a897 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:13.891747 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f36d0914-5127-4664-afe7-1b518213a897 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca" status: 200 len: 1333 microversion: 2.1 time: 0.231839 Apr 16 21:21:13.913002 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2009/3859] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:13 2022] GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca => generated 1333 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:14.089325 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-729aafbe-91fa-4851-a539-82f9c1d9e321 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4866b2c7b7d248539783664403807b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb0e213bd0d40ee9e832b54607028ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:14.092917 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c4cf4b95-0f25-4d53-9366-b3e513c9ec0d tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:14.093544 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c4cf4b95-0f25-4d53-9366-b3e513c9ec0d tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:14.097599 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-729aafbe-91fa-4851-a539-82f9c1d9e321 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] 10.222.0.20 "GET /compute/v2.1/servers/e3675634-9fc5-4448-8b33-707bec3adaa5" status: 200 len: 1324 microversion: 2.1 time: 0.334217 Apr 16 21:21:14.102486 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1851/3860] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:13 2022] GET /compute/v2.1/servers/e3675634-9fc5-4448-8b33-707bec3adaa5 => generated 1324 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:14.102622 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c4cf4b95-0f25-4d53-9366-b3e513c9ec0d tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:14.102716 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c4cf4b95-0f25-4d53-9366-b3e513c9ec0d tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:14.103469 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c4cf4b95-0f25-4d53-9366-b3e513c9ec0d tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:14.103954 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c4cf4b95-0f25-4d53-9366-b3e513c9ec0d tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:14.252319 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c4cf4b95-0f25-4d53-9366-b3e513c9ec0d tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:14.261198 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c4cf4b95-0f25-4d53-9366-b3e513c9ec0d tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7" status: 200 len: 1516 microversion: 2.1 time: 0.172402 Apr 16 21:21:14.265215 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2010/3861] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:14 2022] GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 => generated 1516 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:21:14.771719 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9b09a262-a5e0-4797-bc97-ff401232fbaa tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:14.772374 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9b09a262-a5e0-4797-bc97-ff401232fbaa tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:14.780526 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9b09a262-a5e0-4797-bc97-ff401232fbaa tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:14.780996 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9b09a262-a5e0-4797-bc97-ff401232fbaa tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:14.781888 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9b09a262-a5e0-4797-bc97-ff401232fbaa tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:14.782346 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9b09a262-a5e0-4797-bc97-ff401232fbaa tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:14.910466 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d04a148b-9ff0-43e9-85f0-92d89370b837 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:14.917305 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d04a148b-9ff0-43e9-85f0-92d89370b837 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 26d907a5-99ba-4b78-bfb6-bde24a77d9ca] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:14.928435 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d04a148b-9ff0-43e9-85f0-92d89370b837 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:14.928950 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d04a148b-9ff0-43e9-85f0-92d89370b837 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:14.930862 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d04a148b-9ff0-43e9-85f0-92d89370b837 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:14.931552 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d04a148b-9ff0-43e9-85f0-92d89370b837 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:15.028591 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9b09a262-a5e0-4797-bc97-ff401232fbaa tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:15.036089 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9b09a262-a5e0-4797-bc97-ff401232fbaa tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1666 microversion: 2.1 time: 0.269115 Apr 16 21:21:15.058768 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1852/3862] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:14 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1666 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:15.116406 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-da736739-6678-4746-8d2b-b0e23e85ee46 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:15.117029 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-da736739-6678-4746-8d2b-b0e23e85ee46 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: e3675634-9fc5-4448-8b33-707bec3adaa5] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:15.126333 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-da736739-6678-4746-8d2b-b0e23e85ee46 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:15.126991 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-da736739-6678-4746-8d2b-b0e23e85ee46 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:15.127795 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-da736739-6678-4746-8d2b-b0e23e85ee46 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:15.128277 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-da736739-6678-4746-8d2b-b0e23e85ee46 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:15.358515 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-da736739-6678-4746-8d2b-b0e23e85ee46 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4866b2c7b7d248539783664403807b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb0e213bd0d40ee9e832b54607028ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:15.366332 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-da736739-6678-4746-8d2b-b0e23e85ee46 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] 10.222.0.20 "GET /compute/v2.1/servers/e3675634-9fc5-4448-8b33-707bec3adaa5" status: 200 len: 1521 microversion: 2.1 time: 0.254215 Apr 16 21:21:15.366914 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1853/3863] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:15 2022] GET /compute/v2.1/servers/e3675634-9fc5-4448-8b33-707bec3adaa5 => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:21:15.372880 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b9f5ca42-b871-40fa-bc62-694884ff2c18 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:15.374056 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b9f5ca42-b871-40fa-bc62-694884ff2c18 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:15.384699 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b9f5ca42-b871-40fa-bc62-694884ff2c18 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:15.385791 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b9f5ca42-b871-40fa-bc62-694884ff2c18 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:15.387324 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b9f5ca42-b871-40fa-bc62-694884ff2c18 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:15.387999 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b9f5ca42-b871-40fa-bc62-694884ff2c18 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:15.429812 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d04a148b-9ff0-43e9-85f0-92d89370b837 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:15.438205 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d04a148b-9ff0-43e9-85f0-92d89370b837 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca" status: 200 len: 1333 microversion: 2.1 time: 0.532750 Apr 16 21:21:15.438789 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2011/3864] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:14 2022] GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca => generated 1333 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:15.443350 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a4e30db5-ca07-4c09-b70e-5fa974ef5a5f tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.1.61"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:21:15.444439 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a4e30db5-ca07-4c09-b70e-5fa974ef5a5f tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: 82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:15.451219 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a4e30db5-ca07-4c09-b70e-5fa974ef5a5f tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:15.451748 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a4e30db5-ca07-4c09-b70e-5fa974ef5a5f tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:15.452569 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a4e30db5-ca07-4c09-b70e-5fa974ef5a5f tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:15.453012 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a4e30db5-ca07-4c09-b70e-5fa974ef5a5f tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:15.506629 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a4e30db5-ca07-4c09-b70e-5fa974ef5a5f tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Acquired lock "refresh_cache-82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3" {{(pid=137408) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 16 21:21:15.548472 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b9f5ca42-b871-40fa-bc62-694884ff2c18 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:15.556707 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b9f5ca42-b871-40fa-bc62-694884ff2c18 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7" status: 200 len: 1516 microversion: 2.1 time: 0.188030 Apr 16 21:21:15.557506 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1854/3865] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:15 2022] GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 => generated 1516 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:16.066811 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1869c47b-dbb0-4364-ba85-a95223dc1a85 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:16.067762 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1869c47b-dbb0-4364-ba85-a95223dc1a85 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:16.075349 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1869c47b-dbb0-4364-ba85-a95223dc1a85 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:16.075867 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1869c47b-dbb0-4364-ba85-a95223dc1a85 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:16.076754 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1869c47b-dbb0-4364-ba85-a95223dc1a85 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:16.077260 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1869c47b-dbb0-4364-ba85-a95223dc1a85 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:16.305448 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1869c47b-dbb0-4364-ba85-a95223dc1a85 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:16.318142 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1869c47b-dbb0-4364-ba85-a95223dc1a85 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1666 microversion: 2.1 time: 0.256092 Apr 16 21:21:16.319098 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1855/3866] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:16 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1666 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:21:16.455222 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1920be7e-8319-4835-91e4-4bfccea11f33 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:16.456369 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1920be7e-8319-4835-91e4-4bfccea11f33 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 26d907a5-99ba-4b78-bfb6-bde24a77d9ca] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:16.467025 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1920be7e-8319-4835-91e4-4bfccea11f33 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:16.467531 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1920be7e-8319-4835-91e4-4bfccea11f33 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:16.468376 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1920be7e-8319-4835-91e4-4bfccea11f33 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:16.468829 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1920be7e-8319-4835-91e4-4bfccea11f33 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:16.695282 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1920be7e-8319-4835-91e4-4bfccea11f33 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:16.702869 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1920be7e-8319-4835-91e4-4bfccea11f33 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca" status: 200 len: 1333 microversion: 2.1 time: 0.251713 Apr 16 21:21:16.713028 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1856/3867] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:16 2022] GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca => generated 1333 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:21:16.718356 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-184ae467-c2e9-4f9f-89a6-240091bf9464 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:16.718975 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-184ae467-c2e9-4f9f-89a6-240091bf9464 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:16.725274 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-184ae467-c2e9-4f9f-89a6-240091bf9464 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:16.725964 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-184ae467-c2e9-4f9f-89a6-240091bf9464 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:16.726938 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-184ae467-c2e9-4f9f-89a6-240091bf9464 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:16.727606 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-184ae467-c2e9-4f9f-89a6-240091bf9464 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:16.888163 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-184ae467-c2e9-4f9f-89a6-240091bf9464 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:16.896037 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-184ae467-c2e9-4f9f-89a6-240091bf9464 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7" status: 200 len: 1516 microversion: 2.1 time: 0.181792 Apr 16 21:21:16.896656 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1857/3868] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:16 2022] GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 => generated 1516 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:17.337690 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c647af04-cc47-4a34-bbc0-5757345bfda5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:17.339753 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c647af04-cc47-4a34-bbc0-5757345bfda5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:17.360607 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c647af04-cc47-4a34-bbc0-5757345bfda5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:17.361533 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c647af04-cc47-4a34-bbc0-5757345bfda5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:17.363268 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c647af04-cc47-4a34-bbc0-5757345bfda5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:17.366973 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c647af04-cc47-4a34-bbc0-5757345bfda5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:17.591539 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c647af04-cc47-4a34-bbc0-5757345bfda5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:17.603399 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c647af04-cc47-4a34-bbc0-5757345bfda5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1666 microversion: 2.1 time: 0.271904 Apr 16 21:21:17.604017 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1858/3869] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:17 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1666 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:17.722052 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c3b19b81-56d4-4d77-83ed-dcf6dee76993 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:17.722052 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c3b19b81-56d4-4d77-83ed-dcf6dee76993 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 26d907a5-99ba-4b78-bfb6-bde24a77d9ca] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:17.729336 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c3b19b81-56d4-4d77-83ed-dcf6dee76993 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:17.729804 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c3b19b81-56d4-4d77-83ed-dcf6dee76993 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:17.730610 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c3b19b81-56d4-4d77-83ed-dcf6dee76993 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:17.736044 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c3b19b81-56d4-4d77-83ed-dcf6dee76993 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:18.052858 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c3b19b81-56d4-4d77-83ed-dcf6dee76993 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:18.066587 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c3b19b81-56d4-4d77-83ed-dcf6dee76993 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca" status: 200 len: 1333 microversion: 2.1 time: 0.350076 Apr 16 21:21:18.067192 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1859/3870] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:17 2022] GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca => generated 1333 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:21:18.079405 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3f8bddef-2f77-4f28-9fdc-03c3573269a6 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:18.080094 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3f8bddef-2f77-4f28-9fdc-03c3573269a6 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:18.100918 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3f8bddef-2f77-4f28-9fdc-03c3573269a6 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:18.102338 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3f8bddef-2f77-4f28-9fdc-03c3573269a6 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:18.103783 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3f8bddef-2f77-4f28-9fdc-03c3573269a6 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:18.104258 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3f8bddef-2f77-4f28-9fdc-03c3573269a6 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:18.403770 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3f8bddef-2f77-4f28-9fdc-03c3573269a6 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:18.425735 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3f8bddef-2f77-4f28-9fdc-03c3573269a6 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7" status: 200 len: 1516 microversion: 2.1 time: 0.355248 Apr 16 21:21:18.444934 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1860/3871] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:18 2022] GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 => generated 1516 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:18.620901 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a77f17c3-0983-4e20-9b2a-5db2dfcf159b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:18.621700 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a77f17c3-0983-4e20-9b2a-5db2dfcf159b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:18.629331 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a77f17c3-0983-4e20-9b2a-5db2dfcf159b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:18.630081 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a77f17c3-0983-4e20-9b2a-5db2dfcf159b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:18.631116 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a77f17c3-0983-4e20-9b2a-5db2dfcf159b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:18.631722 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a77f17c3-0983-4e20-9b2a-5db2dfcf159b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:18.844409 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-a4e30db5-ca07-4c09-b70e-5fa974ef5a5f tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: 82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3] Building network info cache for instance {{(pid=137408) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Apr 16 21:21:19.312098 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a77f17c3-0983-4e20-9b2a-5db2dfcf159b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:19.321867 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a77f17c3-0983-4e20-9b2a-5db2dfcf159b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1666 microversion: 2.1 time: 0.704788 Apr 16 21:21:19.327692 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1861/3872] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:18 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1666 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:19.341874 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-167bbbcd-8297-47ee-b90e-432287fa7f6e req-8738c105-9480-4d14-845d-2a730982b06f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3", "tag": "18304df3-de06-42cd-8000-8170cb9494bf"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:21:19.362329 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-167bbbcd-8297-47ee-b90e-432287fa7f6e req-8738c105-9480-4d14-845d-2a730982b06f service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:19.365991 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-167bbbcd-8297-47ee-b90e-432287fa7f6e req-8738c105-9480-4d14-845d-2a730982b06f service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:19.393203 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-167bbbcd-8297-47ee-b90e-432287fa7f6e req-8738c105-9480-4d14-845d-2a730982b06f service nova] Creating event network-changed:18304df3-de06-42cd-8000-8170cb9494bf for instance 82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3 on nch1-master-1 Apr 16 21:21:19.403998 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-167bbbcd-8297-47ee-b90e-432287fa7f6e req-8738c105-9480-4d14-845d-2a730982b06f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074649 Apr 16 21:21:19.409234 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1862/3873] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:21:19.414443 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-766f47e4-da1c-49c1-b6c5-26e2cdd46f89 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:19.416590 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-766f47e4-da1c-49c1-b6c5-26e2cdd46f89 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 26d907a5-99ba-4b78-bfb6-bde24a77d9ca] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:19.424209 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-766f47e4-da1c-49c1-b6c5-26e2cdd46f89 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:19.424803 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-766f47e4-da1c-49c1-b6c5-26e2cdd46f89 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:19.425962 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-766f47e4-da1c-49c1-b6c5-26e2cdd46f89 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:19.426418 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-766f47e4-da1c-49c1-b6c5-26e2cdd46f89 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:19.942765 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-a4e30db5-ca07-4c09-b70e-5fa974ef5a5f tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: 82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3] Updating instance_info_cache with network_info: [{"id": "18304df3-de06-42cd-8000-8170cb9494bf", "address": "fa:16:3e:cb:63:30", "network": {"id": "de9da8f1-3ad8-4653-830f-a88f9ba49f3e", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1020118585-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.1.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1fb0e213bd0d40ee9e832b54607028ab", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap18304df3-de", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137408) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Apr 16 21:21:20.031499 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a4e30db5-ca07-4c09-b70e-5fa974ef5a5f tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Releasing lock "refresh_cache-82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3" {{(pid=137408) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 16 21:21:20.033135 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a4e30db5-ca07-4c09-b70e-5fa974ef5a5f tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] 10.222.0.20 "POST /compute/v2.1/servers/82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3/action" status: 202 len: 0 microversion: 2.1 time: 4.593399 Apr 16 21:21:20.037839 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2012/3874] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:21:15 2022] POST /compute/v2.1/servers/82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3/action => generated 0 bytes in 4598 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Apr 16 21:21:20.043770 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5f388a64-2331-49a0-b4cf-bd9f3c56b552 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:20.051594 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5f388a64-2331-49a0-b4cf-bd9f3c56b552 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:20.073021 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5f388a64-2331-49a0-b4cf-bd9f3c56b552 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:20.076755 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5f388a64-2331-49a0-b4cf-bd9f3c56b552 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:20.079013 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5f388a64-2331-49a0-b4cf-bd9f3c56b552 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:20.081453 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5f388a64-2331-49a0-b4cf-bd9f3c56b552 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:20.193515 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-766f47e4-da1c-49c1-b6c5-26e2cdd46f89 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:20.204804 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-766f47e4-da1c-49c1-b6c5-26e2cdd46f89 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca" status: 200 len: 1333 microversion: 2.1 time: 0.797816 Apr 16 21:21:20.215008 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1863/3875] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:19 2022] GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca => generated 1333 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:20.220220 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d6d7945b-c509-4b35-b332-1d5c02b0f599 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Action: 'action', calling method: .version_select at 0x7fbb9d0b1310>, body: {"addFloatingIp": {"address": "172.35.1.61"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:21:20.233473 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d6d7945b-c509-4b35-b332-1d5c02b0f599 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: e3675634-9fc5-4448-8b33-707bec3adaa5] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:20.239753 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d6d7945b-c509-4b35-b332-1d5c02b0f599 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:20.240241 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d6d7945b-c509-4b35-b332-1d5c02b0f599 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:20.241056 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d6d7945b-c509-4b35-b332-1d5c02b0f599 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:20.241510 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d6d7945b-c509-4b35-b332-1d5c02b0f599 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:20.322314 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d6d7945b-c509-4b35-b332-1d5c02b0f599 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Acquired lock "refresh_cache-e3675634-9fc5-4448-8b33-707bec3adaa5" {{(pid=137409) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 16 21:21:20.389878 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5f388a64-2331-49a0-b4cf-bd9f3c56b552 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:20.399568 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5f388a64-2331-49a0-b4cf-bd9f3c56b552 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7" status: 200 len: 1516 microversion: 2.1 time: 0.360373 Apr 16 21:21:20.400544 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2013/3876] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:20 2022] GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 => generated 1516 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:20.406207 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ee7e9584-1acd-4048-90ff-855141454a00 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:20.407059 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ee7e9584-1acd-4048-90ff-855141454a00 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:20.414895 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee7e9584-1acd-4048-90ff-855141454a00 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:20.415356 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee7e9584-1acd-4048-90ff-855141454a00 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:20.416195 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee7e9584-1acd-4048-90ff-855141454a00 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:20.416859 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee7e9584-1acd-4048-90ff-855141454a00 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:20.835655 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ee7e9584-1acd-4048-90ff-855141454a00 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:20.845830 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ee7e9584-1acd-4048-90ff-855141454a00 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.444046 Apr 16 21:21:20.856965 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2014/3877] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:20 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:20.883464 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-415d6c4f-a90d-47e8-8a0e-3f2aeaca0df5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:20.884325 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-415d6c4f-a90d-47e8-8a0e-3f2aeaca0df5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:20.897593 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-415d6c4f-a90d-47e8-8a0e-3f2aeaca0df5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:20.899844 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-415d6c4f-a90d-47e8-8a0e-3f2aeaca0df5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:20.902546 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-415d6c4f-a90d-47e8-8a0e-3f2aeaca0df5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:20.905286 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-415d6c4f-a90d-47e8-8a0e-3f2aeaca0df5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:21.655221 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-415d6c4f-a90d-47e8-8a0e-3f2aeaca0df5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:21.664527 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-415d6c4f-a90d-47e8-8a0e-3f2aeaca0df5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.800774 Apr 16 21:21:21.669309 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2015/3878] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:20 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:21.685677 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-df43c794-212c-4d70-9818-3ff5622a4568 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:21.685677 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-df43c794-212c-4d70-9818-3ff5622a4568 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 26d907a5-99ba-4b78-bfb6-bde24a77d9ca] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:21.700495 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-df43c794-212c-4d70-9818-3ff5622a4568 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:21.702811 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-df43c794-212c-4d70-9818-3ff5622a4568 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:21.703650 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-df43c794-212c-4d70-9818-3ff5622a4568 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:21.704104 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-df43c794-212c-4d70-9818-3ff5622a4568 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:21.908911 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-df43c794-212c-4d70-9818-3ff5622a4568 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:21.922792 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-df43c794-212c-4d70-9818-3ff5622a4568 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca" status: 200 len: 1333 microversion: 2.1 time: 0.250410 Apr 16 21:21:21.924234 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2016/3879] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:21 2022] GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca => generated 1333 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:21.930460 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-13fa638d-ebd4-42bb-a60e-e991f418bbc4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:21.931482 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-13fa638d-ebd4-42bb-a60e-e991f418bbc4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:21.940994 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-13fa638d-ebd4-42bb-a60e-e991f418bbc4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:21.941825 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-13fa638d-ebd4-42bb-a60e-e991f418bbc4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:21.949133 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-13fa638d-ebd4-42bb-a60e-e991f418bbc4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:21.949133 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-13fa638d-ebd4-42bb-a60e-e991f418bbc4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:22.125393 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-13fa638d-ebd4-42bb-a60e-e991f418bbc4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:22.133687 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-13fa638d-ebd4-42bb-a60e-e991f418bbc4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7" status: 200 len: 1516 microversion: 2.1 time: 0.208096 Apr 16 21:21:22.135519 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2017/3880] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:21 2022] GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 => generated 1516 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:22.140605 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-166aa298-dcf9-4c05-8bc1-0295b8b28015 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:22.141396 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-166aa298-dcf9-4c05-8bc1-0295b8b28015 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:22.147610 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-166aa298-dcf9-4c05-8bc1-0295b8b28015 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:22.148291 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-166aa298-dcf9-4c05-8bc1-0295b8b28015 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:22.149803 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-166aa298-dcf9-4c05-8bc1-0295b8b28015 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:22.150400 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-166aa298-dcf9-4c05-8bc1-0295b8b28015 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:22.457100 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-166aa298-dcf9-4c05-8bc1-0295b8b28015 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:22.465323 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-166aa298-dcf9-4c05-8bc1-0295b8b28015 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.328412 Apr 16 21:21:22.474051 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2018/3881] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:22 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:22.481174 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-fc10ffac-8f96-4b71-a85d-5456e09cad5c req-31f7eca6-b944-4610-b10a-9c4ceb9904ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d907a5-99ba-4b78-bfb6-bde24a77d9ca", "name": "network-vif-plugged", "status": "completed", "tag": "15fd4ebd-e376-4ff7-a23e-3fcf24c60d16"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:21:22.493765 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-fc10ffac-8f96-4b71-a85d-5456e09cad5c req-31f7eca6-b944-4610-b10a-9c4ceb9904ad service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:22.495273 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-fc10ffac-8f96-4b71-a85d-5456e09cad5c req-31f7eca6-b944-4610-b10a-9c4ceb9904ad service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:22.515280 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-fc10ffac-8f96-4b71-a85d-5456e09cad5c req-31f7eca6-b944-4610-b10a-9c4ceb9904ad service nova] Creating event network-vif-plugged:15fd4ebd-e376-4ff7-a23e-3fcf24c60d16 for instance 26d907a5-99ba-4b78-bfb6-bde24a77d9ca on nch2-master-1 Apr 16 21:21:22.522320 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-fc10ffac-8f96-4b71-a85d-5456e09cad5c req-31f7eca6-b944-4610-b10a-9c4ceb9904ad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045802 Apr 16 21:21:22.523949 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2019/3882] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:21:22.533088 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3f70d04e-4398-4b5c-9dfb-8d484eef2e70 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:22.534293 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3f70d04e-4398-4b5c-9dfb-8d484eef2e70 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:22.547995 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3f70d04e-4398-4b5c-9dfb-8d484eef2e70 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:22.550077 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3f70d04e-4398-4b5c-9dfb-8d484eef2e70 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:22.551181 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3f70d04e-4398-4b5c-9dfb-8d484eef2e70 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:22.552627 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3f70d04e-4398-4b5c-9dfb-8d484eef2e70 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:22.780274 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3f70d04e-4398-4b5c-9dfb-8d484eef2e70 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:22.790025 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3f70d04e-4398-4b5c-9dfb-8d484eef2e70 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.263462 Apr 16 21:21:22.790636 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2020/3883] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:22 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:22.812490 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f56a00cb-de7e-47ac-a49b-16198b6dea26 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:22.813115 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f56a00cb-de7e-47ac-a49b-16198b6dea26 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:22.833745 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f56a00cb-de7e-47ac-a49b-16198b6dea26 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:22.834205 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f56a00cb-de7e-47ac-a49b-16198b6dea26 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:22.835015 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f56a00cb-de7e-47ac-a49b-16198b6dea26 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:22.836097 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f56a00cb-de7e-47ac-a49b-16198b6dea26 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:23.071218 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f56a00cb-de7e-47ac-a49b-16198b6dea26 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:23.083323 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f56a00cb-de7e-47ac-a49b-16198b6dea26 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.276518 Apr 16 21:21:23.087881 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2021/3884] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:22 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:23.098228 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1ed1210a-0996-4203-afd7-dbd19fa8ad49 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:23.099704 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1ed1210a-0996-4203-afd7-dbd19fa8ad49 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 26d907a5-99ba-4b78-bfb6-bde24a77d9ca] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:23.109423 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1ed1210a-0996-4203-afd7-dbd19fa8ad49 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:23.110305 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1ed1210a-0996-4203-afd7-dbd19fa8ad49 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:23.111504 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1ed1210a-0996-4203-afd7-dbd19fa8ad49 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:23.112522 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1ed1210a-0996-4203-afd7-dbd19fa8ad49 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:23.370272 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1ed1210a-0996-4203-afd7-dbd19fa8ad49 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:23.384981 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1ed1210a-0996-4203-afd7-dbd19fa8ad49 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca" status: 200 len: 1333 microversion: 2.1 time: 0.293839 Apr 16 21:21:23.385820 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2022/3885] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:23 2022] GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca => generated 1333 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:23.395993 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a83ce778-a7ad-41f7-97be-bd324ada81b6 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:21:23.396875 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a83ce778-a7ad-41f7-97be-bd324ada81b6 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:23.404474 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a83ce778-a7ad-41f7-97be-bd324ada81b6 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:23.404938 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a83ce778-a7ad-41f7-97be-bd324ada81b6 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:23.405881 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a83ce778-a7ad-41f7-97be-bd324ada81b6 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:23.406325 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a83ce778-a7ad-41f7-97be-bd324ada81b6 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:23.447398 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-a83ce778-a7ad-41f7-97be-bd324ada81b6 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lazy-loading 'flavor' on Instance uuid 98ca4f4e-246a-449b-b9fd-e1c17e119faa {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:21:23.872390 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a83ce778-a7ad-41f7-97be-bd324ada81b6 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "POST /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa/action" status: 202 len: 0 microversion: 2.1 time: 0.480305 Apr 16 21:21:23.876546 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2023/3886] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:21:23 2022] POST /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa/action => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:21:23.890757 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d893ef44-d52a-4e4f-8dc8-8e66f9d2eb33 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:23.894122 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d893ef44-d52a-4e4f-8dc8-8e66f9d2eb33 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:23.907358 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d893ef44-d52a-4e4f-8dc8-8e66f9d2eb33 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:23.908004 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d893ef44-d52a-4e4f-8dc8-8e66f9d2eb33 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:23.909201 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d893ef44-d52a-4e4f-8dc8-8e66f9d2eb33 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:23.909836 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d893ef44-d52a-4e4f-8dc8-8e66f9d2eb33 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:24.207867 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d893ef44-d52a-4e4f-8dc8-8e66f9d2eb33 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:24.231111 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d893ef44-d52a-4e4f-8dc8-8e66f9d2eb33 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7" status: 200 len: 1516 microversion: 2.1 time: 0.352424 Apr 16 21:21:24.235070 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2024/3887] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:23 2022] GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 => generated 1516 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:24.246890 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3d8390d5-e431-4a20-91de-2e48f11b7e87 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:24.248400 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3d8390d5-e431-4a20-91de-2e48f11b7e87 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:24.286836 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d8390d5-e431-4a20-91de-2e48f11b7e87 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:24.288081 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d8390d5-e431-4a20-91de-2e48f11b7e87 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:24.288935 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d8390d5-e431-4a20-91de-2e48f11b7e87 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:24.304640 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d8390d5-e431-4a20-91de-2e48f11b7e87 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:24.517868 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3d8390d5-e431-4a20-91de-2e48f11b7e87 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:24.527573 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3d8390d5-e431-4a20-91de-2e48f11b7e87 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1678 microversion: 2.1 time: 0.288893 Apr 16 21:21:24.529690 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2025/3888] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:24 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1678 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:24.534574 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9ac4ac7c-e1ed-4c51-bf92-f8f1de8203ea tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:24.535380 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9ac4ac7c-e1ed-4c51-bf92-f8f1de8203ea tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 26d907a5-99ba-4b78-bfb6-bde24a77d9ca] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:24.543379 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9ac4ac7c-e1ed-4c51-bf92-f8f1de8203ea tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:24.543884 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9ac4ac7c-e1ed-4c51-bf92-f8f1de8203ea tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:24.547826 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9ac4ac7c-e1ed-4c51-bf92-f8f1de8203ea tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:24.547826 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9ac4ac7c-e1ed-4c51-bf92-f8f1de8203ea tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:24.813864 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9ac4ac7c-e1ed-4c51-bf92-f8f1de8203ea tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:24.821784 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9ac4ac7c-e1ed-4c51-bf92-f8f1de8203ea tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca" status: 200 len: 1333 microversion: 2.1 time: 0.290708 Apr 16 21:21:24.822632 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2026/3889] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:24 2022] GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca => generated 1333 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:24.827711 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-a279605e-b991-4d89-a661-b54cded26848 req-7f4e912a-2b80-424c-a9db-7da5107b95ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d907a5-99ba-4b78-bfb6-bde24a77d9ca", "name": "network-vif-plugged", "status": "completed", "tag": "30c99ab2-73f0-439e-9ac5-efccf5042446"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:21:24.846544 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-a279605e-b991-4d89-a661-b54cded26848 req-7f4e912a-2b80-424c-a9db-7da5107b95ba service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:24.853131 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-a279605e-b991-4d89-a661-b54cded26848 req-7f4e912a-2b80-424c-a9db-7da5107b95ba service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:24.885553 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-a279605e-b991-4d89-a661-b54cded26848 req-7f4e912a-2b80-424c-a9db-7da5107b95ba service nova] Creating event network-vif-plugged:30c99ab2-73f0-439e-9ac5-efccf5042446 for instance 26d907a5-99ba-4b78-bfb6-bde24a77d9ca on nch2-master-1 Apr 16 21:21:24.902387 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-a279605e-b991-4d89-a661-b54cded26848 req-7f4e912a-2b80-424c-a9db-7da5107b95ba service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078192 Apr 16 21:21:24.903482 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2027/3890] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:21:25.253252 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9d875224-76b9-4c18-bbe2-b85887d6ffc4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:25.254078 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9d875224-76b9-4c18-bbe2-b85887d6ffc4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:25.267106 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9d875224-76b9-4c18-bbe2-b85887d6ffc4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:25.268038 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9d875224-76b9-4c18-bbe2-b85887d6ffc4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:25.268889 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9d875224-76b9-4c18-bbe2-b85887d6ffc4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:25.271333 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9d875224-76b9-4c18-bbe2-b85887d6ffc4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:25.662586 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9d875224-76b9-4c18-bbe2-b85887d6ffc4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:25.670855 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9d875224-76b9-4c18-bbe2-b85887d6ffc4 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7" status: 200 len: 1516 microversion: 2.1 time: 0.422164 Apr 16 21:21:25.673857 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2028/3891] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:25 2022] GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 => generated 1516 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:25.685405 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-44d05cbc-cf34-4d77-ae5f-bb94d29de9ce tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:25.688979 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-44d05cbc-cf34-4d77-ae5f-bb94d29de9ce tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:25.705347 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-44d05cbc-cf34-4d77-ae5f-bb94d29de9ce tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:25.706066 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-44d05cbc-cf34-4d77-ae5f-bb94d29de9ce tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:25.707288 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-44d05cbc-cf34-4d77-ae5f-bb94d29de9ce tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:25.707925 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-44d05cbc-cf34-4d77-ae5f-bb94d29de9ce tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:25.935145 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.network.neutron [None req-d6d7945b-c509-4b35-b332-1d5c02b0f599 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: e3675634-9fc5-4448-8b33-707bec3adaa5] re-assign floating IP 172.35.1.61 from instance 82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3 Apr 16 21:21:26.016865 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-d6d7945b-c509-4b35-b332-1d5c02b0f599 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: 82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3] Building network info cache for instance {{(pid=137409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Apr 16 21:21:26.081262 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-44d05cbc-cf34-4d77-ae5f-bb94d29de9ce tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:26.081262 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-44d05cbc-cf34-4d77-ae5f-bb94d29de9ce tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1661 microversion: 2.1 time: 0.403368 Apr 16 21:21:26.081262 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2029/3892] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:25 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1661 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:26.085610 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-81c95c9b-22d0-4a25-8555-b5fb7c24e1bb req-2829eec4-6967-4c9a-8b46-73ed29743ed3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3", "tag": "18304df3-de06-42cd-8000-8170cb9494bf"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:21:26.112980 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-81c95c9b-22d0-4a25-8555-b5fb7c24e1bb req-2829eec4-6967-4c9a-8b46-73ed29743ed3 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:26.116071 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-81c95c9b-22d0-4a25-8555-b5fb7c24e1bb req-2829eec4-6967-4c9a-8b46-73ed29743ed3 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:26.133572 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-81c95c9b-22d0-4a25-8555-b5fb7c24e1bb req-2829eec4-6967-4c9a-8b46-73ed29743ed3 service nova] Creating event network-changed:18304df3-de06-42cd-8000-8170cb9494bf for instance 82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3 on nch1-master-1 Apr 16 21:21:26.141605 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-81c95c9b-22d0-4a25-8555-b5fb7c24e1bb req-2829eec4-6967-4c9a-8b46-73ed29743ed3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059260 Apr 16 21:21:26.143180 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2030/3893] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:21:26.594299 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e31ea77e-2b26-49da-9244-9166246f5027 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Action: 'create', calling method: .version_select at 0x7fbb9ff4a700>, body: {"keypair": {"name": "tempest-keypair-909055094"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:21:26.616091 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-e31ea77e-2b26-49da-9244-9166246f5027 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Getting quotas for project f65ddd60eec74fb89e04d7e6354a2bc4. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:21:26.629332 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-e31ea77e-2b26-49da-9244-9166246f5027 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Getting quotas for user c9cb29db112b421ea4973953523bc249 and project f65ddd60eec74fb89e04d7e6354a2bc4. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:21:26.959462 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-e31ea77e-2b26-49da-9244-9166246f5027 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Getting quotas for project f65ddd60eec74fb89e04d7e6354a2bc4. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:21:26.965030 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-e31ea77e-2b26-49da-9244-9166246f5027 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Getting quotas for user c9cb29db112b421ea4973953523bc249 and project f65ddd60eec74fb89e04d7e6354a2bc4. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:21:26.982248 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e31ea77e-2b26-49da-9244-9166246f5027 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.837564 Apr 16 21:21:26.982859 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2031/3894] 10.222.0.20 () {60 vars in 1157 bytes} [Sat Apr 16 21:21:26 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:26.990566 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a6ce0439-332b-4af3-8820-2456b787cf42 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:26.991305 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a6ce0439-332b-4af3-8820-2456b787cf42 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 26d907a5-99ba-4b78-bfb6-bde24a77d9ca] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:26.998816 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a6ce0439-332b-4af3-8820-2456b787cf42 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:27.005061 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a6ce0439-332b-4af3-8820-2456b787cf42 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:27.005061 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a6ce0439-332b-4af3-8820-2456b787cf42 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:27.005061 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a6ce0439-332b-4af3-8820-2456b787cf42 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:27.335509 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-d6d7945b-c509-4b35-b332-1d5c02b0f599 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: 82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3] Updating instance_info_cache with network_info: [{"id": "18304df3-de06-42cd-8000-8170cb9494bf", "address": "fa:16:3e:cb:63:30", "network": {"id": "de9da8f1-3ad8-4653-830f-a88f9ba49f3e", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1020118585-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1fb0e213bd0d40ee9e832b54607028ab", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap18304df3-de", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Apr 16 21:21:27.380717 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-d6d7945b-c509-4b35-b332-1d5c02b0f599 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: e3675634-9fc5-4448-8b33-707bec3adaa5] Building network info cache for instance {{(pid=137409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Apr 16 21:21:27.436633 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a6ce0439-332b-4af3-8820-2456b787cf42 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:27.451270 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a6ce0439-332b-4af3-8820-2456b787cf42 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca" status: 200 len: 1333 microversion: 2.1 time: 0.465231 Apr 16 21:21:27.451910 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2032/3895] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:26 2022] GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca => generated 1333 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:27.467805 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c828d716-81d6-48d0-ae28-8584641186f2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:21:27.468762 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c828d716-81d6-48d0-ae28-8584641186f2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:27.484583 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c828d716-81d6-48d0-ae28-8584641186f2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:27.490669 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c828d716-81d6-48d0-ae28-8584641186f2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:27.490669 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c828d716-81d6-48d0-ae28-8584641186f2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:27.490669 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c828d716-81d6-48d0-ae28-8584641186f2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:27.783322 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c828d716-81d6-48d0-ae28-8584641186f2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "POST /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa/action" status: 202 len: 0 microversion: 2.1 time: 0.325479 Apr 16 21:21:27.784427 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2033/3896] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:21:27 2022] POST /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa/action => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:21:27.796478 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9ecef18c-72c8-406a-bbf3-0881862268a6 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:27.797552 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9ecef18c-72c8-406a-bbf3-0881862268a6 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:27.806604 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9ecef18c-72c8-406a-bbf3-0881862268a6 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:27.807260 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9ecef18c-72c8-406a-bbf3-0881862268a6 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:27.808288 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9ecef18c-72c8-406a-bbf3-0881862268a6 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:27.808956 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9ecef18c-72c8-406a-bbf3-0881862268a6 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:28.366806 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9ecef18c-72c8-406a-bbf3-0881862268a6 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:28.377749 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9ecef18c-72c8-406a-bbf3-0881862268a6 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7" status: 200 len: 1522 microversion: 2.1 time: 0.591787 Apr 16 21:21:28.378612 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2034/3897] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:27 2022] GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 => generated 1522 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:28.383674 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-588e402f-b5a9-42d4-9ed6-193e38bf6482 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:28.384581 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-588e402f-b5a9-42d4-9ed6-193e38bf6482 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:28.391414 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-588e402f-b5a9-42d4-9ed6-193e38bf6482 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:28.399484 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-588e402f-b5a9-42d4-9ed6-193e38bf6482 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:28.399484 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-588e402f-b5a9-42d4-9ed6-193e38bf6482 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:28.399484 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-588e402f-b5a9-42d4-9ed6-193e38bf6482 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:28.568564 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-d6d7945b-c509-4b35-b332-1d5c02b0f599 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: e3675634-9fc5-4448-8b33-707bec3adaa5] Updating instance_info_cache with network_info: [{"id": "b27f4ef2-9de6-4c41-9578-cab9cfbbe412", "address": "fa:16:3e:e2:56:46", "network": {"id": "de9da8f1-3ad8-4653-830f-a88f9ba49f3e", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1020118585-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.1.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1fb0e213bd0d40ee9e832b54607028ab", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb27f4ef2-9d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Apr 16 21:21:28.676908 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d6d7945b-c509-4b35-b332-1d5c02b0f599 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Releasing lock "refresh_cache-e3675634-9fc5-4448-8b33-707bec3adaa5" {{(pid=137409) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 16 21:21:28.678139 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d6d7945b-c509-4b35-b332-1d5c02b0f599 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] 10.222.0.20 "POST /compute/v2.1/servers/e3675634-9fc5-4448-8b33-707bec3adaa5/action" status: 202 len: 0 microversion: 2.1 time: 8.462058 Apr 16 21:21:28.679290 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1864/3898] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:21:20 2022] POST /compute/v2.1/servers/e3675634-9fc5-4448-8b33-707bec3adaa5/action => generated 0 bytes in 8464 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Apr 16 21:21:28.686170 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-d921c36b-6296-49a3-bbe5-ebefa7da54b0 req-09133bab-ae8f-4c9a-9ba3-ade82f371e02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3675634-9fc5-4448-8b33-707bec3adaa5", "tag": "b27f4ef2-9de6-4c41-9578-cab9cfbbe412"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:21:28.694116 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-588e402f-b5a9-42d4-9ed6-193e38bf6482 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:28.705804 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-588e402f-b5a9-42d4-9ed6-193e38bf6482 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1667 microversion: 2.1 time: 0.325917 Apr 16 21:21:28.707245 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2035/3899] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:28 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1667 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:28.714565 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2a82a8a6-52e1-49af-9ff4-fd34789d26ca tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:28.716947 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2a82a8a6-52e1-49af-9ff4-fd34789d26ca tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 26d907a5-99ba-4b78-bfb6-bde24a77d9ca] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:28.717218 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-d921c36b-6296-49a3-bbe5-ebefa7da54b0 req-09133bab-ae8f-4c9a-9ba3-ade82f371e02 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:28.717913 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-d921c36b-6296-49a3-bbe5-ebefa7da54b0 req-09133bab-ae8f-4c9a-9ba3-ade82f371e02 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:28.740094 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-d921c36b-6296-49a3-bbe5-ebefa7da54b0 req-09133bab-ae8f-4c9a-9ba3-ade82f371e02 service nova] Creating event network-changed:b27f4ef2-9de6-4c41-9578-cab9cfbbe412 for instance e3675634-9fc5-4448-8b33-707bec3adaa5 on nch1-master-1 Apr 16 21:21:28.743209 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2a82a8a6-52e1-49af-9ff4-fd34789d26ca tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:28.743673 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2a82a8a6-52e1-49af-9ff4-fd34789d26ca tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:28.744497 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2a82a8a6-52e1-49af-9ff4-fd34789d26ca tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:28.744940 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2a82a8a6-52e1-49af-9ff4-fd34789d26ca tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:28.759077 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-d921c36b-6296-49a3-bbe5-ebefa7da54b0 req-09133bab-ae8f-4c9a-9ba3-ade82f371e02 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077655 Apr 16 21:21:28.759795 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1865/3900] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:21:28.770044 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b5618ef5-0dad-4360-9a26-e982824a12dd tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.1.61"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:21:29.138487 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b5618ef5-0dad-4360-9a26-e982824a12dd tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: e3675634-9fc5-4448-8b33-707bec3adaa5] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:29.148785 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b5618ef5-0dad-4360-9a26-e982824a12dd tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:29.150049 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b5618ef5-0dad-4360-9a26-e982824a12dd tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:29.153624 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b5618ef5-0dad-4360-9a26-e982824a12dd tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:29.154242 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b5618ef5-0dad-4360-9a26-e982824a12dd tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:29.158671 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2a82a8a6-52e1-49af-9ff4-fd34789d26ca tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:29.167224 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2a82a8a6-52e1-49af-9ff4-fd34789d26ca tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca" status: 200 len: 1333 microversion: 2.1 time: 0.457957 Apr 16 21:21:29.189969 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2036/3901] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:28 2022] GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca => generated 1333 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:29.395058 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-aa2dcd98-969d-4fdd-98cb-916cc8fc220a tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:29.395905 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-aa2dcd98-969d-4fdd-98cb-916cc8fc220a tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:29.410820 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aa2dcd98-969d-4fdd-98cb-916cc8fc220a tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:29.422328 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aa2dcd98-969d-4fdd-98cb-916cc8fc220a tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:29.423514 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aa2dcd98-969d-4fdd-98cb-916cc8fc220a tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:29.424898 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aa2dcd98-969d-4fdd-98cb-916cc8fc220a tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:29.822476 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-b5618ef5-0dad-4360-9a26-e982824a12dd tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] HTTP exception thrown: Floating IP 172.35.1.61 is not associated with instance 82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3. Apr 16 21:21:29.822476 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b5618ef5-0dad-4360-9a26-e982824a12dd tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Returning 409 to user: Floating IP 172.35.1.61 is not associated with instance 82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:21:29.822476 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b5618ef5-0dad-4360-9a26-e982824a12dd tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] 10.222.0.20 "POST /compute/v2.1/servers/82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3/action" status: 409 len: 145 microversion: 2.1 time: 1.060653 Apr 16 21:21:29.823307 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1866/3902] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:21:28 2022] POST /compute/v2.1/servers/82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3/action => generated 145 bytes in 1062 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:21:29.829441 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ffcedd82-917e-45a3-9f60-14c36091bc7b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:29.832961 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ffcedd82-917e-45a3-9f60-14c36091bc7b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:29.846287 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ffcedd82-917e-45a3-9f60-14c36091bc7b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:29.847093 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ffcedd82-917e-45a3-9f60-14c36091bc7b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:29.852783 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ffcedd82-917e-45a3-9f60-14c36091bc7b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:29.853786 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ffcedd82-917e-45a3-9f60-14c36091bc7b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:29.897999 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-aa2dcd98-969d-4fdd-98cb-916cc8fc220a tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:29.910496 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-aa2dcd98-969d-4fdd-98cb-916cc8fc220a tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7" status: 200 len: 1522 microversion: 2.1 time: 0.519291 Apr 16 21:21:29.924531 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2037/3903] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:29 2022] GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 => generated 1522 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:29.937444 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-24e51501-32a3-4259-b037-04f0e87c1d75 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.1.61"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:21:30.259365 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-24e51501-32a3-4259-b037-04f0e87c1d75 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: e3675634-9fc5-4448-8b33-707bec3adaa5] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:30.267749 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-24e51501-32a3-4259-b037-04f0e87c1d75 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:30.268252 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-24e51501-32a3-4259-b037-04f0e87c1d75 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:30.269064 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-24e51501-32a3-4259-b037-04f0e87c1d75 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:30.269509 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-24e51501-32a3-4259-b037-04f0e87c1d75 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:30.572513 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ffcedd82-917e-45a3-9f60-14c36091bc7b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:30.584325 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ffcedd82-917e-45a3-9f60-14c36091bc7b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1667 microversion: 2.1 time: 0.756433 Apr 16 21:21:30.598372 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1867/3904] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:29 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1667 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:30.614516 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-c9e5d3c4-0f7f-49e4-8a9f-426e595f4ff3 req-e1a736b4-0624-4069-8863-dc64d68d05d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7", "name": "network-vif-unplugged", "status": "completed", "tag": "a5c0f6ba-98bc-4711-85ee-04db4015c727"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:21:30.625088 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-c9e5d3c4-0f7f-49e4-8a9f-426e595f4ff3 req-e1a736b4-0624-4069-8863-dc64d68d05d9 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:30.625782 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-c9e5d3c4-0f7f-49e4-8a9f-426e595f4ff3 req-e1a736b4-0624-4069-8863-dc64d68d05d9 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:30.654970 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-c9e5d3c4-0f7f-49e4-8a9f-426e595f4ff3 req-e1a736b4-0624-4069-8863-dc64d68d05d9 service nova] Creating event network-vif-unplugged:a5c0f6ba-98bc-4711-85ee-04db4015c727 for instance cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 on nch2-master-1 Apr 16 21:21:30.662113 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-c9e5d3c4-0f7f-49e4-8a9f-426e595f4ff3 req-e1a736b4-0624-4069-8863-dc64d68d05d9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061950 Apr 16 21:21:30.662729 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1868/3905] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:21:30.668564 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ccefb6f8-1d94-42c4-be44-f0bd11d044f8 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:30.671257 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ccefb6f8-1d94-42c4-be44-f0bd11d044f8 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 26d907a5-99ba-4b78-bfb6-bde24a77d9ca] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:30.696639 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ccefb6f8-1d94-42c4-be44-f0bd11d044f8 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:30.698378 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ccefb6f8-1d94-42c4-be44-f0bd11d044f8 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:30.699960 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ccefb6f8-1d94-42c4-be44-f0bd11d044f8 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:30.700583 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ccefb6f8-1d94-42c4-be44-f0bd11d044f8 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:30.836392 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-24e51501-32a3-4259-b037-04f0e87c1d75 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Acquired lock "refresh_cache-e3675634-9fc5-4448-8b33-707bec3adaa5" {{(pid=137408) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 16 21:21:31.046155 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ccefb6f8-1d94-42c4-be44-f0bd11d044f8 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:31.060976 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ccefb6f8-1d94-42c4-be44-f0bd11d044f8 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca" status: 200 len: 1667 microversion: 2.1 time: 0.396769 Apr 16 21:21:31.063107 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1869/3906] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:30 2022] GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca => generated 1667 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:31.071941 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1f32fae7-48e5-4a77-8da2-fad224d96816 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:31.079289 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1f32fae7-48e5-4a77-8da2-fad224d96816 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:31.094968 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1f32fae7-48e5-4a77-8da2-fad224d96816 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:31.099028 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1f32fae7-48e5-4a77-8da2-fad224d96816 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:31.099028 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1f32fae7-48e5-4a77-8da2-fad224d96816 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:31.099352 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1f32fae7-48e5-4a77-8da2-fad224d96816 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:31.288492 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1f32fae7-48e5-4a77-8da2-fad224d96816 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:31.296892 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1f32fae7-48e5-4a77-8da2-fad224d96816 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7" status: 200 len: 1522 microversion: 2.1 time: 0.231922 Apr 16 21:21:31.306694 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1870/3907] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:31 2022] GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:31.306694 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5bae4179-d246-414e-9185-e8bcd38ced68 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:31.306694 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5bae4179-d246-414e-9185-e8bcd38ced68 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 26d907a5-99ba-4b78-bfb6-bde24a77d9ca] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:31.311697 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5bae4179-d246-414e-9185-e8bcd38ced68 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:31.311697 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5bae4179-d246-414e-9185-e8bcd38ced68 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:31.311697 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5bae4179-d246-414e-9185-e8bcd38ced68 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:31.311697 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5bae4179-d246-414e-9185-e8bcd38ced68 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:31.339057 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5bae4179-d246-414e-9185-e8bcd38ced68 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca/ips" status: 200 len: 178 microversion: 2.1 time: 0.040153 Apr 16 21:21:31.341289 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1871/3908] 10.222.0.20 () {58 vars in 1247 bytes} [Sat Apr 16 21:21:31 2022] GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca/ips => generated 178 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:21:31.353066 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1129dd39-0fb9-439e-8a12-d169fee0299a tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:31.353587 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1129dd39-0fb9-439e-8a12-d169fee0299a tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 26d907a5-99ba-4b78-bfb6-bde24a77d9ca] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:31.359988 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1129dd39-0fb9-439e-8a12-d169fee0299a tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:31.361028 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1129dd39-0fb9-439e-8a12-d169fee0299a tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:31.362094 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1129dd39-0fb9-439e-8a12-d169fee0299a tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:31.362979 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1129dd39-0fb9-439e-8a12-d169fee0299a tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:31.424405 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1129dd39-0fb9-439e-8a12-d169fee0299a tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 26d907a5-99ba-4b78-bfb6-bde24a77d9ca] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:21:31.894005 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1129dd39-0fb9-439e-8a12-d169fee0299a tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "DELETE /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca" status: 204 len: 0 microversion: 2.1 time: 0.545011 Apr 16 21:21:31.895578 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1872/3909] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:21:31 2022] DELETE /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca => generated 0 bytes in 548 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:21:31.901919 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5bdd47d1-d78c-4bcd-b297-34be5512926a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:31.904698 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5bdd47d1-d78c-4bcd-b297-34be5512926a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:31.915094 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5bdd47d1-d78c-4bcd-b297-34be5512926a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:31.915971 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5bdd47d1-d78c-4bcd-b297-34be5512926a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:31.916980 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5bdd47d1-d78c-4bcd-b297-34be5512926a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:31.917434 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5bdd47d1-d78c-4bcd-b297-34be5512926a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:32.123098 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-24e51501-32a3-4259-b037-04f0e87c1d75 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: e3675634-9fc5-4448-8b33-707bec3adaa5] Building network info cache for instance {{(pid=137408) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Apr 16 21:21:32.223247 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5bdd47d1-d78c-4bcd-b297-34be5512926a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:32.232346 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5bdd47d1-d78c-4bcd-b297-34be5512926a tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1667 microversion: 2.1 time: 0.335228 Apr 16 21:21:32.233132 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1873/3910] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:31 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1667 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:32.237829 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-84276898-e5f4-45b7-bd31-49ebd6914ffc tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:32.239067 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-84276898-e5f4-45b7-bd31-49ebd6914ffc tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 26d907a5-99ba-4b78-bfb6-bde24a77d9ca] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:32.246221 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-84276898-e5f4-45b7-bd31-49ebd6914ffc tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:32.249447 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-84276898-e5f4-45b7-bd31-49ebd6914ffc tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:32.249447 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-84276898-e5f4-45b7-bd31-49ebd6914ffc tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:32.249447 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-84276898-e5f4-45b7-bd31-49ebd6914ffc tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:32.574619 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-84276898-e5f4-45b7-bd31-49ebd6914ffc tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:32.582436 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-84276898-e5f4-45b7-bd31-49ebd6914ffc tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca" status: 200 len: 1673 microversion: 2.1 time: 0.348115 Apr 16 21:21:32.583543 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1874/3911] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:32 2022] GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca => generated 1673 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:32.589255 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-60a37d5a-1ba4-4dd2-bd5c-ea7fbeb47396 req-79da4592-a724-4a78-aa2f-59c09f77cbbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3675634-9fc5-4448-8b33-707bec3adaa5", "tag": "b27f4ef2-9de6-4c41-9578-cab9cfbbe412"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:21:32.598018 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-60a37d5a-1ba4-4dd2-bd5c-ea7fbeb47396 req-79da4592-a724-4a78-aa2f-59c09f77cbbe service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:32.598770 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-60a37d5a-1ba4-4dd2-bd5c-ea7fbeb47396 req-79da4592-a724-4a78-aa2f-59c09f77cbbe service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:32.612069 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-60a37d5a-1ba4-4dd2-bd5c-ea7fbeb47396 req-79da4592-a724-4a78-aa2f-59c09f77cbbe service nova] Creating event network-changed:b27f4ef2-9de6-4c41-9578-cab9cfbbe412 for instance e3675634-9fc5-4448-8b33-707bec3adaa5 on nch1-master-1 Apr 16 21:21:32.617295 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-60a37d5a-1ba4-4dd2-bd5c-ea7fbeb47396 req-79da4592-a724-4a78-aa2f-59c09f77cbbe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032117 Apr 16 21:21:32.618209 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1875/3912] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:21:32.628337 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-07c42833-2dfe-4de3-9833-1fe460d865c2 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:32.632277 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-07c42833-2dfe-4de3-9833-1fe460d865c2 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:32.636274 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-07c42833-2dfe-4de3-9833-1fe460d865c2 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:32.637009 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-07c42833-2dfe-4de3-9833-1fe460d865c2 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:32.637879 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-07c42833-2dfe-4de3-9833-1fe460d865c2 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:32.638602 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-07c42833-2dfe-4de3-9833-1fe460d865c2 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:32.894267 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-24e51501-32a3-4259-b037-04f0e87c1d75 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: e3675634-9fc5-4448-8b33-707bec3adaa5] Updating instance_info_cache with network_info: [{"id": "b27f4ef2-9de6-4c41-9578-cab9cfbbe412", "address": "fa:16:3e:e2:56:46", "network": {"id": "de9da8f1-3ad8-4653-830f-a88f9ba49f3e", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1020118585-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1fb0e213bd0d40ee9e832b54607028ab", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb27f4ef2-9d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137408) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Apr 16 21:21:32.946900 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-07c42833-2dfe-4de3-9833-1fe460d865c2 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:32.960618 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-07c42833-2dfe-4de3-9833-1fe460d865c2 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7" status: 200 len: 1522 microversion: 2.1 time: 0.340873 Apr 16 21:21:32.961218 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1876/3913] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:32 2022] GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 => generated 1522 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:32.967761 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f0912759-6ff4-4cfa-b755-0d18cbf5cf81 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-392034196", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "3f5a2452-ba34-42bf-ba08-85ad7e322490"}], "security_groups": [{"name": "tempest-securitygroup--1074768357"}], "key_name": "tempest-keypair-909055094", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:21:33.053134 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-24e51501-32a3-4259-b037-04f0e87c1d75 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Releasing lock "refresh_cache-e3675634-9fc5-4448-8b33-707bec3adaa5" {{(pid=137408) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 16 21:21:33.053134 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-24e51501-32a3-4259-b037-04f0e87c1d75 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] 10.222.0.20 "POST /compute/v2.1/servers/e3675634-9fc5-4448-8b33-707bec3adaa5/action" status: 202 len: 0 microversion: 2.1 time: 3.120402 Apr 16 21:21:33.053134 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2038/3914] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:21:29 2022] POST /compute/v2.1/servers/e3675634-9fc5-4448-8b33-707bec3adaa5/action => generated 0 bytes in 3123 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Apr 16 21:21:33.062678 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4dbdc42e-9578-4824-9c73-9196eeda4a1a tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:33.063221 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4dbdc42e-9578-4824-9c73-9196eeda4a1a tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: e3675634-9fc5-4448-8b33-707bec3adaa5] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:33.082099 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4dbdc42e-9578-4824-9c73-9196eeda4a1a tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:33.082809 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4dbdc42e-9578-4824-9c73-9196eeda4a1a tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:33.083642 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4dbdc42e-9578-4824-9c73-9196eeda4a1a tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:33.085164 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4dbdc42e-9578-4824-9c73-9196eeda4a1a tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:33.133095 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4dbdc42e-9578-4824-9c73-9196eeda4a1a tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: e3675634-9fc5-4448-8b33-707bec3adaa5] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:21:33.175589 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-f0912759-6ff4-4cfa-b755-0d18cbf5cf81 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] validate_networks() for [('3f5a2452-ba34-42bf-ba08-85ad7e322490', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:21:33.497886 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4dbdc42e-9578-4824-9c73-9196eeda4a1a tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e3675634-9fc5-4448-8b33-707bec3adaa5" status: 204 len: 0 microversion: 2.1 time: 0.442865 Apr 16 21:21:33.498948 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2039/3915] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:21:33 2022] DELETE /compute/v2.1/servers/e3675634-9fc5-4448-8b33-707bec3adaa5 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:21:33.506504 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0fda5100-a31b-429d-a843-c3d483295017 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:33.507320 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0fda5100-a31b-429d-a843-c3d483295017 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:33.514415 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0fda5100-a31b-429d-a843-c3d483295017 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:33.518205 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0fda5100-a31b-429d-a843-c3d483295017 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:33.518205 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0fda5100-a31b-429d-a843-c3d483295017 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:33.518205 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0fda5100-a31b-429d-a843-c3d483295017 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:33.787928 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0fda5100-a31b-429d-a843-c3d483295017 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:33.788861 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-f0912759-6ff4-4cfa-b755-0d18cbf5cf81 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Getting quotas for project f65ddd60eec74fb89e04d7e6354a2bc4. Resources: dict_keys(['metadata_items']) {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:21:33.795554 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-f0912759-6ff4-4cfa-b755-0d18cbf5cf81 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Getting quotas for user c9cb29db112b421ea4973953523bc249 and project f65ddd60eec74fb89e04d7e6354a2bc4. Resources: dict_keys(['metadata_items']) {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:21:33.796313 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0fda5100-a31b-429d-a843-c3d483295017 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.294987 Apr 16 21:21:33.796488 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2040/3916] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:33 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:33.812209 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-01eff016-9aa9-40a7-b7cb-bf81ce45816a tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.1.61"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:21:33.814678 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-01eff016-9aa9-40a7-b7cb-bf81ce45816a tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: 82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:33.829041 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-01eff016-9aa9-40a7-b7cb-bf81ce45816a tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:33.829508 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-01eff016-9aa9-40a7-b7cb-bf81ce45816a tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:33.830309 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-01eff016-9aa9-40a7-b7cb-bf81ce45816a tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:33.830759 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-01eff016-9aa9-40a7-b7cb-bf81ce45816a tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:33.849455 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-f0912759-6ff4-4cfa-b755-0d18cbf5cf81 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:21:33.849903 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-f0912759-6ff4-4cfa-b755-0d18cbf5cf81 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:21:33.864841 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-f0912759-6ff4-4cfa-b755-0d18cbf5cf81 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:21:33.864841 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-f0912759-6ff4-4cfa-b755-0d18cbf5cf81 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:21:33.864841 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-f0912759-6ff4-4cfa-b755-0d18cbf5cf81 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:21:33.871637 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-01eff016-9aa9-40a7-b7cb-bf81ce45816a tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Acquired lock "refresh_cache-82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3" {{(pid=137408) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 16 21:21:33.886397 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f0912759-6ff4-4cfa-b755-0d18cbf5cf81 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:33.886887 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f0912759-6ff4-4cfa-b755-0d18cbf5cf81 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:33.887702 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f0912759-6ff4-4cfa-b755-0d18cbf5cf81 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:33.893560 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f0912759-6ff4-4cfa-b755-0d18cbf5cf81 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:33.923074 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-f0912759-6ff4-4cfa-b755-0d18cbf5cf81 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Getting quotas for project f65ddd60eec74fb89e04d7e6354a2bc4. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:21:33.930857 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-f0912759-6ff4-4cfa-b755-0d18cbf5cf81 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Getting quotas for user c9cb29db112b421ea4973953523bc249 and project f65ddd60eec74fb89e04d7e6354a2bc4. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:21:33.959733 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f0912759-6ff4-4cfa-b755-0d18cbf5cf81 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:21:33.962367 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f0912759-6ff4-4cfa-b755-0d18cbf5cf81 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] [instance: 5bb444da-2bc4-4d5b-9e65-6739d1f4edf4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:21:34.118828 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f0912759-6ff4-4cfa-b755-0d18cbf5cf81 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.155082 Apr 16 21:21:34.120081 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1877/3917] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:21:32 2022] POST /compute/v2.1/servers => generated 407 bytes in 1157 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:21:34.125984 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f8a14d73-940a-4611-97da-c885c8fe2307 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:34.126886 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f8a14d73-940a-4611-97da-c885c8fe2307 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 26d907a5-99ba-4b78-bfb6-bde24a77d9ca] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:34.135042 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f8a14d73-940a-4611-97da-c885c8fe2307 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:34.135787 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f8a14d73-940a-4611-97da-c885c8fe2307 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:34.136901 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f8a14d73-940a-4611-97da-c885c8fe2307 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:34.137549 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f8a14d73-940a-4611-97da-c885c8fe2307 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:34.353906 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f8a14d73-940a-4611-97da-c885c8fe2307 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:34.369838 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f8a14d73-940a-4611-97da-c885c8fe2307 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca" status: 200 len: 1673 microversion: 2.1 time: 0.248446 Apr 16 21:21:34.371223 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1878/3918] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:34 2022] GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca => generated 1673 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:34.381095 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8c5f1415-8853-45e5-a407-798937939757 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:34.381898 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8c5f1415-8853-45e5-a407-798937939757 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:34.388835 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8c5f1415-8853-45e5-a407-798937939757 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:34.390261 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8c5f1415-8853-45e5-a407-798937939757 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:34.391533 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8c5f1415-8853-45e5-a407-798937939757 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:34.392265 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8c5f1415-8853-45e5-a407-798937939757 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:34.541229 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8c5f1415-8853-45e5-a407-798937939757 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:34.551578 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8c5f1415-8853-45e5-a407-798937939757 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1670 microversion: 2.1 time: 0.178052 Apr 16 21:21:34.552284 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1879/3919] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:34 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1670 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:34.569537 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9ed564a7-8e62-41c2-8b7f-230115501031 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:34.570920 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9ed564a7-8e62-41c2-8b7f-230115501031 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:34.577977 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9ed564a7-8e62-41c2-8b7f-230115501031 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:34.578495 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9ed564a7-8e62-41c2-8b7f-230115501031 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:34.579460 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9ed564a7-8e62-41c2-8b7f-230115501031 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:34.579915 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9ed564a7-8e62-41c2-8b7f-230115501031 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:34.742774 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9ed564a7-8e62-41c2-8b7f-230115501031 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:34.750563 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9ed564a7-8e62-41c2-8b7f-230115501031 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7" status: 200 len: 1522 microversion: 2.1 time: 0.185129 Apr 16 21:21:34.751213 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1880/3920] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:34 2022] GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:34.756324 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-10f0afb8-07fb-4f40-a821-3ce44aa220e5 req-febc6cdc-4156-4879-ac26-8f5492f0d66e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7", "name": "network-vif-plugged", "status": "completed", "tag": "a5c0f6ba-98bc-4711-85ee-04db4015c727"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:21:34.764866 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-10f0afb8-07fb-4f40-a821-3ce44aa220e5 req-febc6cdc-4156-4879-ac26-8f5492f0d66e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:34.765592 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-10f0afb8-07fb-4f40-a821-3ce44aa220e5 req-febc6cdc-4156-4879-ac26-8f5492f0d66e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:34.780047 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-10f0afb8-07fb-4f40-a821-3ce44aa220e5 req-febc6cdc-4156-4879-ac26-8f5492f0d66e service nova] Creating event network-vif-plugged:a5c0f6ba-98bc-4711-85ee-04db4015c727 for instance cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 on nch2-master-1 Apr 16 21:21:34.786183 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-10f0afb8-07fb-4f40-a821-3ce44aa220e5 req-febc6cdc-4156-4879-ac26-8f5492f0d66e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033384 Apr 16 21:21:34.788393 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1881/3921] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:21:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:21:34.796516 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ab445d97-8f4a-40fc-8311-123f1f863bd6 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:34.797340 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ab445d97-8f4a-40fc-8311-123f1f863bd6 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] [instance: 5bb444da-2bc4-4d5b-9e65-6739d1f4edf4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:34.939244 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ab445d97-8f4a-40fc-8311-123f1f863bd6 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cb29db112b421ea4973953523bc249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ddd60eec74fb89e04d7e6354a2bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:34.953136 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ab445d97-8f4a-40fc-8311-123f1f863bd6 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb444da-2bc4-4d5b-9e65-6739d1f4edf4" status: 200 len: 1268 microversion: 2.1 time: 0.159469 Apr 16 21:21:34.953136 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1882/3922] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:34 2022] GET /compute/v2.1/servers/5bb444da-2bc4-4d5b-9e65-6739d1f4edf4 => generated 1268 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:34.989029 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e496bfca-953f-482c-a6ef-4195ec5077a5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:34.992217 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e496bfca-953f-482c-a6ef-4195ec5077a5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:35.011343 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e496bfca-953f-482c-a6ef-4195ec5077a5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:35.012288 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e496bfca-953f-482c-a6ef-4195ec5077a5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:35.013737 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e496bfca-953f-482c-a6ef-4195ec5077a5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:35.015894 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e496bfca-953f-482c-a6ef-4195ec5077a5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:35.074983 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e496bfca-953f-482c-a6ef-4195ec5077a5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:21:35.096969 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.compute.api [None req-e496bfca-953f-482c-a6ef-4195ec5077a5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] Working on deleting snapshot 60a7b448-794a-4a0c-b6a3-3f0d6563899b from shelved instance... Apr 16 21:21:36.705321 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-01eff016-9aa9-40a7-b7cb-bf81ce45816a tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: 82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3] Building network info cache for instance {{(pid=137408) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Apr 16 21:21:37.412537 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e496bfca-953f-482c-a6ef-4195ec5077a5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] Doing local delete in cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) {{(pid=137409) _delete /opt/stack/nova/nova/compute/api.py:2489}} Apr 16 21:21:37.414272 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e496bfca-953f-482c-a6ef-4195ec5077a5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:37.415119 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e496bfca-953f-482c-a6ef-4195ec5077a5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:37.415724 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.compute.api [None req-e496bfca-953f-482c-a6ef-4195ec5077a5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Apr 16 21:21:37.422134 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-e496bfca-953f-482c-a6ef-4195ec5077a5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] deallocate_for_instance() {{(pid=137409) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1789}} Apr 16 21:21:37.485171 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-01eff016-9aa9-40a7-b7cb-bf81ce45816a tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: 82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3] Updating instance_info_cache with network_info: [{"id": "18304df3-de06-42cd-8000-8170cb9494bf", "address": "fa:16:3e:cb:63:30", "network": {"id": "de9da8f1-3ad8-4653-830f-a88f9ba49f3e", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1020118585-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.1.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1fb0e213bd0d40ee9e832b54607028ab", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap18304df3-de", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137408) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Apr 16 21:21:37.590227 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-01eff016-9aa9-40a7-b7cb-bf81ce45816a tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Releasing lock "refresh_cache-82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3" {{(pid=137408) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 16 21:21:37.591350 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-01eff016-9aa9-40a7-b7cb-bf81ce45816a tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] 10.222.0.20 "POST /compute/v2.1/servers/82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3/action" status: 202 len: 0 microversion: 2.1 time: 3.790950 Apr 16 21:21:37.592545 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2041/3923] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:21:33 2022] POST /compute/v2.1/servers/82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3/action => generated 0 bytes in 3793 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Apr 16 21:21:37.599926 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-94afe2c8-4764-450f-9fa4-049a249a0ee0 req-8953d458-76f2-4fe5-abb7-4a1e72b5e8d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d907a5-99ba-4b78-bfb6-bde24a77d9ca", "name": "network-vif-deleted", "tag": "30c99ab2-73f0-439e-9ac5-efccf5042446"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:21:37.617759 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-94afe2c8-4764-450f-9fa4-049a249a0ee0 req-8953d458-76f2-4fe5-abb7-4a1e72b5e8d9 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:37.618593 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-94afe2c8-4764-450f-9fa4-049a249a0ee0 req-8953d458-76f2-4fe5-abb7-4a1e72b5e8d9 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:37.631162 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-94afe2c8-4764-450f-9fa4-049a249a0ee0 req-8953d458-76f2-4fe5-abb7-4a1e72b5e8d9 service nova] Creating event network-vif-deleted:30c99ab2-73f0-439e-9ac5-efccf5042446 for instance 26d907a5-99ba-4b78-bfb6-bde24a77d9ca on nch2-master-1 Apr 16 21:21:37.637415 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-94afe2c8-4764-450f-9fa4-049a249a0ee0 req-8953d458-76f2-4fe5-abb7-4a1e72b5e8d9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042919 Apr 16 21:21:37.638607 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2042/3924] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:21:37.647476 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0d37aacb-d4a5-488e-a1c5-c3913d007ebf tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:37.649641 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0d37aacb-d4a5-488e-a1c5-c3913d007ebf tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 26d907a5-99ba-4b78-bfb6-bde24a77d9ca] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:37.657279 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0d37aacb-d4a5-488e-a1c5-c3913d007ebf tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:37.658016 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0d37aacb-d4a5-488e-a1c5-c3913d007ebf tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:37.660564 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0d37aacb-d4a5-488e-a1c5-c3913d007ebf tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:37.660564 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0d37aacb-d4a5-488e-a1c5-c3913d007ebf tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:37.713142 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0d37aacb-d4a5-488e-a1c5-c3913d007ebf tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:37.715874 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0d37aacb-d4a5-488e-a1c5-c3913d007ebf tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:37.716400 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-0d37aacb-d4a5-488e-a1c5-c3913d007ebf tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lazy-loading 'fault' on Instance uuid 26d907a5-99ba-4b78-bfb6-bde24a77d9ca {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:21:37.805435 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0d37aacb-d4a5-488e-a1c5-c3913d007ebf tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836ed2bfadd94e2a81048a0621067b33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3457cd454b04246bb4adb154b41bbb2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:37.817475 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0d37aacb-d4a5-488e-a1c5-c3913d007ebf tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca" status: 200 len: 1302 microversion: 2.1 time: 0.176292 Apr 16 21:21:37.820441 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2043/3925] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:37 2022] GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca => generated 1302 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:37.832319 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-b62356e3-613a-4feb-a429-61640645fbc3 req-cd326738-c3a4-4bb2-887c-cb326ac9c3cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3675634-9fc5-4448-8b33-707bec3adaa5", "name": "network-vif-deleted", "tag": "b27f4ef2-9de6-4c41-9578-cab9cfbbe412"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:21:37.842584 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-b62356e3-613a-4feb-a429-61640645fbc3 req-cd326738-c3a4-4bb2-887c-cb326ac9c3cf service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:37.843347 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-b62356e3-613a-4feb-a429-61640645fbc3 req-cd326738-c3a4-4bb2-887c-cb326ac9c3cf service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:37.868206 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-b62356e3-613a-4feb-a429-61640645fbc3 req-cd326738-c3a4-4bb2-887c-cb326ac9c3cf service nova] Creating event network-vif-deleted:b27f4ef2-9de6-4c41-9578-cab9cfbbe412 for instance e3675634-9fc5-4448-8b33-707bec3adaa5 on nch1-master-1 Apr 16 21:21:37.875963 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-b62356e3-613a-4feb-a429-61640645fbc3 req-cd326738-c3a4-4bb2-887c-cb326ac9c3cf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052555 Apr 16 21:21:37.876863 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2044/3926] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:21:37.885050 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-114fe847-cdef-42db-8e49-faf8d6ecba18 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:37.885996 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-114fe847-cdef-42db-8e49-faf8d6ecba18 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:37.894714 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-114fe847-cdef-42db-8e49-faf8d6ecba18 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:37.895649 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-114fe847-cdef-42db-8e49-faf8d6ecba18 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:37.896645 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-114fe847-cdef-42db-8e49-faf8d6ecba18 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:37.897195 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-114fe847-cdef-42db-8e49-faf8d6ecba18 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:38.050842 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-114fe847-cdef-42db-8e49-faf8d6ecba18 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:38.064660 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-114fe847-cdef-42db-8e49-faf8d6ecba18 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7" status: 200 len: 1507 microversion: 2.1 time: 0.185705 Apr 16 21:21:38.068039 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2045/3927] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:37 2022] GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 => generated 1507 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:38.071341 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-20ca569b-bfb9-40a6-b3da-21651462c07a tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:38.072207 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-20ca569b-bfb9-40a6-b3da-21651462c07a tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] [instance: 5bb444da-2bc4-4d5b-9e65-6739d1f4edf4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:38.079049 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-20ca569b-bfb9-40a6-b3da-21651462c07a tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:38.079753 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-20ca569b-bfb9-40a6-b3da-21651462c07a tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:38.080909 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-20ca569b-bfb9-40a6-b3da-21651462c07a tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:38.081518 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-20ca569b-bfb9-40a6-b3da-21651462c07a tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:38.157877 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-20ca569b-bfb9-40a6-b3da-21651462c07a tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cb29db112b421ea4973953523bc249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ddd60eec74fb89e04d7e6354a2bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:38.166755 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-20ca569b-bfb9-40a6-b3da-21651462c07a tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb444da-2bc4-4d5b-9e65-6739d1f4edf4" status: 200 len: 1338 microversion: 2.1 time: 0.100228 Apr 16 21:21:38.169043 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2046/3928] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:38 2022] GET /compute/v2.1/servers/5bb444da-2bc4-4d5b-9e65-6739d1f4edf4 => generated 1338 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:38.174192 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-eac69825-a173-4743-b6fc-8b9c1312c873 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Calling method '.version_select at 0x7fbb95951ee0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:38.427916 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-eac69825-a173-4743-b6fc-8b9c1312c873 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] 10.222.0.20 "GET /compute/v2.1/os-floating-ips/d26b89ba-bd27-4880-bd68-19946248b0a6" status: 200 len: 184 microversion: 2.1 time: 0.257356 Apr 16 21:21:38.429084 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2047/3929] 10.222.0.20 () {58 vars in 1259 bytes} [Sat Apr 16 21:21:38 2022] GET /compute/v2.1/os-floating-ips/d26b89ba-bd27-4880-bd68-19946248b0a6 => generated 184 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:21:38.438320 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ab6ac25a-6316-4e0f-bb8f-ce80e281449c tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:38.440387 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ab6ac25a-6316-4e0f-bb8f-ce80e281449c tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:38.450078 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ab6ac25a-6316-4e0f-bb8f-ce80e281449c tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:38.451313 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ab6ac25a-6316-4e0f-bb8f-ce80e281449c tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:38.452730 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ab6ac25a-6316-4e0f-bb8f-ce80e281449c tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:38.453760 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ab6ac25a-6316-4e0f-bb8f-ce80e281449c tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:38.626718 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ab6ac25a-6316-4e0f-bb8f-ce80e281449c tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:38.635074 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ab6ac25a-6316-4e0f-bb8f-ce80e281449c tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7" status: 200 len: 1507 microversion: 2.1 time: 0.203425 Apr 16 21:21:38.646725 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2048/3930] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:38 2022] GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 => generated 1507 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:38.652577 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5334fa77-7f0f-47e7-a6b2-1c8ce19b5ec9 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.1.61"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:21:38.855335 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5334fa77-7f0f-47e7-a6b2-1c8ce19b5ec9 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: 82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:38.864374 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5334fa77-7f0f-47e7-a6b2-1c8ce19b5ec9 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:38.871742 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5334fa77-7f0f-47e7-a6b2-1c8ce19b5ec9 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:38.871742 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5334fa77-7f0f-47e7-a6b2-1c8ce19b5ec9 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:38.871742 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5334fa77-7f0f-47e7-a6b2-1c8ce19b5ec9 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:39.023704 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-e496bfca-953f-482c-a6ef-4195ec5077a5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] Updating instance_info_cache with network_info: [] {{(pid=137409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Apr 16 21:21:39.188709 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5334fa77-7f0f-47e7-a6b2-1c8ce19b5ec9 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Acquired lock "refresh_cache-82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3" {{(pid=137408) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 16 21:21:39.863596 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e496bfca-953f-482c-a6ef-4195ec5077a5 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d" status: 204 len: 0 microversion: 2.1 time: 4.910839 Apr 16 21:21:39.864998 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1883/3931] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:21:34 2022] DELETE /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d => generated 0 bytes in 4913 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:21:39.874335 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-000f9b3f-9637-43b1-848e-16f09f18d5ee tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:39.875295 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-000f9b3f-9637-43b1-848e-16f09f18d5ee tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:39.894743 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-000f9b3f-9637-43b1-848e-16f09f18d5ee tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:39.907088 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-000f9b3f-9637-43b1-848e-16f09f18d5ee tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:39.910561 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-000f9b3f-9637-43b1-848e-16f09f18d5ee tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:39.915363 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-000f9b3f-9637-43b1-848e-16f09f18d5ee tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:39.967361 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-000f9b3f-9637-43b1-848e-16f09f18d5ee tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:21:40.119973 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-5334fa77-7f0f-47e7-a6b2-1c8ce19b5ec9 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: 82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3] Building network info cache for instance {{(pid=137408) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Apr 16 21:21:40.390606 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-000f9b3f-9637-43b1-848e-16f09f18d5ee tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7" status: 204 len: 0 microversion: 2.1 time: 0.523584 Apr 16 21:21:40.391925 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1884/3932] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:21:39 2022] DELETE /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:21:40.413882 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-54409f86-a5c3-4fda-bdf1-14bb49c23e59 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:40.415251 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-54409f86-a5c3-4fda-bdf1-14bb49c23e59 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 26d907a5-99ba-4b78-bfb6-bde24a77d9ca] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:40.427836 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-54409f86-a5c3-4fda-bdf1-14bb49c23e59 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:40.428624 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-54409f86-a5c3-4fda-bdf1-14bb49c23e59 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:40.429691 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-54409f86-a5c3-4fda-bdf1-14bb49c23e59 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:40.430356 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-54409f86-a5c3-4fda-bdf1-14bb49c23e59 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:40.450688 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-54409f86-a5c3-4fda-bdf1-14bb49c23e59 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] HTTP exception thrown: Instance 26d907a5-99ba-4b78-bfb6-bde24a77d9ca could not be found. Apr 16 21:21:40.451517 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-54409f86-a5c3-4fda-bdf1-14bb49c23e59 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Returning 404 to user: Instance 26d907a5-99ba-4b78-bfb6-bde24a77d9ca could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:21:40.452423 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-54409f86-a5c3-4fda-bdf1-14bb49c23e59 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca" status: 404 len: 111 microversion: 2.1 time: 0.058573 Apr 16 21:21:40.453190 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1885/3933] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:40 2022] GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:21:40.462519 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cc6c67b0-07a0-4d51-83a8-f3c7d7913e3a tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:40.463632 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-cc6c67b0-07a0-4d51-83a8-f3c7d7913e3a tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] [instance: 5bb444da-2bc4-4d5b-9e65-6739d1f4edf4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:40.473484 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cc6c67b0-07a0-4d51-83a8-f3c7d7913e3a tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:40.474229 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cc6c67b0-07a0-4d51-83a8-f3c7d7913e3a tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:40.475199 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cc6c67b0-07a0-4d51-83a8-f3c7d7913e3a tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:40.475649 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cc6c67b0-07a0-4d51-83a8-f3c7d7913e3a tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:40.977944 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cc6c67b0-07a0-4d51-83a8-f3c7d7913e3a tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cb29db112b421ea4973953523bc249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ddd60eec74fb89e04d7e6354a2bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:40.990784 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cc6c67b0-07a0-4d51-83a8-f3c7d7913e3a tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb444da-2bc4-4d5b-9e65-6739d1f4edf4" status: 200 len: 1394 microversion: 2.1 time: 0.536162 Apr 16 21:21:40.993586 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1886/3934] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:40 2022] GET /compute/v2.1/servers/5bb444da-2bc4-4d5b-9e65-6739d1f4edf4 => generated 1394 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:41.006941 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-9a74cecc-212a-452d-b1e4-9fd85c4977e6 req-cb405c26-12c8-4f35-925f-e4410cfb5707 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26d907a5-99ba-4b78-bfb6-bde24a77d9ca", "name": "network-vif-deleted", "tag": "15fd4ebd-e376-4ff7-a23e-3fcf24c60d16"}, {"name": "network-changed", "server_uuid": "82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3", "tag": "18304df3-de06-42cd-8000-8170cb9494bf"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:21:41.020708 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-9a74cecc-212a-452d-b1e4-9fd85c4977e6 req-cb405c26-12c8-4f35-925f-e4410cfb5707 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:41.021449 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-9a74cecc-212a-452d-b1e4-9fd85c4977e6 req-cb405c26-12c8-4f35-925f-e4410cfb5707 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:41.037978 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-9a74cecc-212a-452d-b1e4-9fd85c4977e6 req-cb405c26-12c8-4f35-925f-e4410cfb5707 service nova] Creating event network-vif-deleted:15fd4ebd-e376-4ff7-a23e-3fcf24c60d16 for instance 26d907a5-99ba-4b78-bfb6-bde24a77d9ca on nch2-master-1 Apr 16 21:21:41.038933 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-9a74cecc-212a-452d-b1e4-9fd85c4977e6 req-cb405c26-12c8-4f35-925f-e4410cfb5707 service nova] Creating event network-changed:18304df3-de06-42cd-8000-8170cb9494bf for instance 82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3 on nch1-master-1 Apr 16 21:21:41.057131 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-9a74cecc-212a-452d-b1e4-9fd85c4977e6 req-cb405c26-12c8-4f35-925f-e4410cfb5707 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.061173 Apr 16 21:21:41.063538 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1887/3935] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:21:40 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:21:41.230369 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-5334fa77-7f0f-47e7-a6b2-1c8ce19b5ec9 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: 82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3] Updating instance_info_cache with network_info: [{"id": "18304df3-de06-42cd-8000-8170cb9494bf", "address": "fa:16:3e:cb:63:30", "network": {"id": "de9da8f1-3ad8-4653-830f-a88f9ba49f3e", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1020118585-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "1fb0e213bd0d40ee9e832b54607028ab", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap18304df3-de", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137408) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Apr 16 21:21:41.361732 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-74f3f149-7d86-4ef6-b7b3-c63f06dca8e7 tempest-PortsAdminExtendedAttrsTestJSON-1141860814 tempest-PortsAdminExtendedAttrsTestJSON-1141860814-project-admin] Calling method '.version_select at 0x7fbb9ffa6c10>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:41.363187 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:21:41.363187 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:21:41.364550 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-74f3f149-7d86-4ef6-b7b3-c63f06dca8e7 tempest-PortsAdminExtendedAttrsTestJSON-1141860814 tempest-PortsAdminExtendedAttrsTestJSON-1141860814-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:41.365208 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-74f3f149-7d86-4ef6-b7b3-c63f06dca8e7 tempest-PortsAdminExtendedAttrsTestJSON-1141860814 tempest-PortsAdminExtendedAttrsTestJSON-1141860814-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:41.400771 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5334fa77-7f0f-47e7-a6b2-1c8ce19b5ec9 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Releasing lock "refresh_cache-82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3" {{(pid=137408) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 16 21:21:41.402006 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5334fa77-7f0f-47e7-a6b2-1c8ce19b5ec9 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] 10.222.0.20 "POST /compute/v2.1/servers/82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3/action" status: 202 len: 0 microversion: 2.1 time: 2.754227 Apr 16 21:21:41.407019 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2049/3936] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:21:38 2022] POST /compute/v2.1/servers/82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3/action => generated 0 bytes in 2756 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Apr 16 21:21:41.411658 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-23e852c4-0041-469d-afbe-19e24d08c11e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:41.415890 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-23e852c4-0041-469d-afbe-19e24d08c11e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:41.435517 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-23e852c4-0041-469d-afbe-19e24d08c11e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:41.436916 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-23e852c4-0041-469d-afbe-19e24d08c11e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:41.438924 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-23e852c4-0041-469d-afbe-19e24d08c11e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:41.441569 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-74f3f149-7d86-4ef6-b7b3-c63f06dca8e7 tempest-PortsAdminExtendedAttrsTestJSON-1141860814 tempest-PortsAdminExtendedAttrsTestJSON-1141860814-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:41.442089 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-23e852c4-0041-469d-afbe-19e24d08c11e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:41.442853 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-74f3f149-7d86-4ef6-b7b3-c63f06dca8e7 tempest-PortsAdminExtendedAttrsTestJSON-1141860814 tempest-PortsAdminExtendedAttrsTestJSON-1141860814-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:41.459589 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-74f3f149-7d86-4ef6-b7b3-c63f06dca8e7 tempest-PortsAdminExtendedAttrsTestJSON-1141860814 tempest-PortsAdminExtendedAttrsTestJSON-1141860814-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:41.460412 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-74f3f149-7d86-4ef6-b7b3-c63f06dca8e7 tempest-PortsAdminExtendedAttrsTestJSON-1141860814 tempest-PortsAdminExtendedAttrsTestJSON-1141860814-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:41.469968 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-74f3f149-7d86-4ef6-b7b3-c63f06dca8e7 tempest-PortsAdminExtendedAttrsTestJSON-1141860814 tempest-PortsAdminExtendedAttrsTestJSON-1141860814-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.404000 Apr 16 21:21:41.471733 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1888/3937] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:21:41 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:21:41.472549 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-23e852c4-0041-469d-afbe-19e24d08c11e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] HTTP exception thrown: Instance 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d could not be found. Apr 16 21:21:41.473237 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-23e852c4-0041-469d-afbe-19e24d08c11e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Returning 404 to user: Instance 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:21:41.474312 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-23e852c4-0041-469d-afbe-19e24d08c11e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d" status: 404 len: 111 microversion: 2.1 time: 0.069394 Apr 16 21:21:41.475296 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2050/3938] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:41 2022] GET /compute/v2.1/servers/8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:21:41.478846 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-16c17b12-cb35-46c9-828c-be82db777f11 req-d717ac61-d6bc-4e3e-842e-eef35301afb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d", "name": "network-vif-deleted", "tag": "c7099d42-164b-4965-be5b-89015762dc0c"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:21:41.491553 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-16c17b12-cb35-46c9-828c-be82db777f11 req-d717ac61-d6bc-4e3e-842e-eef35301afb9 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:41.492249 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0dba245d-059e-4824-99b4-e85cdd785360 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1235849436", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "90b900dd-0d06-4537-95d8-47dd03c283fc"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:21:41.497084 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-16c17b12-cb35-46c9-828c-be82db777f11 req-d717ac61-d6bc-4e3e-842e-eef35301afb9 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:41.517473 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.compute.server_external_events [req-16c17b12-cb35-46c9-828c-be82db777f11 req-d717ac61-d6bc-4e3e-842e-eef35301afb9 service nova] Unable to find a host for instance 8d3fcbd2-3ad9-478c-9a70-9c42dfa7a01d. Dropping event network-vif-deleted {{(pid=137409) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Apr 16 21:21:41.517473 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-16c17b12-cb35-46c9-828c-be82db777f11 req-d717ac61-d6bc-4e3e-842e-eef35301afb9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.043138 Apr 16 21:21:41.532761 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1889/3939] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 61 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 16 21:21:41.543916 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1f8f22bc-40f9-434a-95bc-62a0f9200245 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:41.546670 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1f8f22bc-40f9-434a-95bc-62a0f9200245 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: e3675634-9fc5-4448-8b33-707bec3adaa5] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:41.556231 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1f8f22bc-40f9-434a-95bc-62a0f9200245 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:41.557035 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1f8f22bc-40f9-434a-95bc-62a0f9200245 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:41.559485 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1f8f22bc-40f9-434a-95bc-62a0f9200245 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:41.560279 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1f8f22bc-40f9-434a-95bc-62a0f9200245 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:41.596208 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-0dba245d-059e-4824-99b4-e85cdd785360 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] validate_networks() for [('90b900dd-0d06-4537-95d8-47dd03c283fc', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:21:41.599561 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-1f8f22bc-40f9-434a-95bc-62a0f9200245 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] HTTP exception thrown: Instance e3675634-9fc5-4448-8b33-707bec3adaa5 could not be found. Apr 16 21:21:41.603359 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1f8f22bc-40f9-434a-95bc-62a0f9200245 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Returning 404 to user: Instance e3675634-9fc5-4448-8b33-707bec3adaa5 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:21:41.604548 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1f8f22bc-40f9-434a-95bc-62a0f9200245 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e3675634-9fc5-4448-8b33-707bec3adaa5" status: 404 len: 111 microversion: 2.1 time: 0.070369 Apr 16 21:21:41.605836 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1890/3940] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:21:41 2022] DELETE /compute/v2.1/servers/e3675634-9fc5-4448-8b33-707bec3adaa5 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:21:41.612570 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c31218c6-fc0e-40c1-bcff-f1070c163851 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:41.613582 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c31218c6-fc0e-40c1-bcff-f1070c163851 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 1b86bdab-b733-4af5-b2a7-c997869b690c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:41.650028 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c31218c6-fc0e-40c1-bcff-f1070c163851 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:41.653428 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c31218c6-fc0e-40c1-bcff-f1070c163851 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:41.654518 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c31218c6-fc0e-40c1-bcff-f1070c163851 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:41.655245 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c31218c6-fc0e-40c1-bcff-f1070c163851 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:41.722303 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c31218c6-fc0e-40c1-bcff-f1070c163851 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 1b86bdab-b733-4af5-b2a7-c997869b690c] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:21:42.304335 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c31218c6-fc0e-40c1-bcff-f1070c163851 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1b86bdab-b733-4af5-b2a7-c997869b690c" status: 204 len: 0 microversion: 2.1 time: 0.696491 Apr 16 21:21:42.311086 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1891/3941] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:21:41 2022] DELETE /compute/v2.1/servers/1b86bdab-b733-4af5-b2a7-c997869b690c => generated 0 bytes in 698 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:21:42.312745 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fa7b9318-511f-4aad-beae-f6138507f544 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:42.313714 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-fa7b9318-511f-4aad-beae-f6138507f544 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: e3675634-9fc5-4448-8b33-707bec3adaa5] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:42.331931 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fa7b9318-511f-4aad-beae-f6138507f544 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:42.331931 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fa7b9318-511f-4aad-beae-f6138507f544 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:42.331931 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fa7b9318-511f-4aad-beae-f6138507f544 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:42.331931 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fa7b9318-511f-4aad-beae-f6138507f544 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:42.351440 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-fa7b9318-511f-4aad-beae-f6138507f544 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] HTTP exception thrown: Instance e3675634-9fc5-4448-8b33-707bec3adaa5 could not be found. Apr 16 21:21:42.360952 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fa7b9318-511f-4aad-beae-f6138507f544 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Returning 404 to user: Instance e3675634-9fc5-4448-8b33-707bec3adaa5 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:21:42.360952 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fa7b9318-511f-4aad-beae-f6138507f544 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] 10.222.0.20 "GET /compute/v2.1/servers/e3675634-9fc5-4448-8b33-707bec3adaa5" status: 404 len: 111 microversion: 2.1 time: 0.054279 Apr 16 21:21:42.361843 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1892/3942] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:42 2022] GET /compute/v2.1/servers/e3675634-9fc5-4448-8b33-707bec3adaa5 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:21:42.374034 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-aabcea59-e1d9-40b4-afc9-5c68fb0a79ed tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:42.374834 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-aabcea59-e1d9-40b4-afc9-5c68fb0a79ed tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] [instance: 5bb444da-2bc4-4d5b-9e65-6739d1f4edf4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:42.392231 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aabcea59-e1d9-40b4-afc9-5c68fb0a79ed tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:42.392860 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aabcea59-e1d9-40b4-afc9-5c68fb0a79ed tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:42.393804 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aabcea59-e1d9-40b4-afc9-5c68fb0a79ed tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:42.394264 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aabcea59-e1d9-40b4-afc9-5c68fb0a79ed tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:42.818450 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-aabcea59-e1d9-40b4-afc9-5c68fb0a79ed tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cb29db112b421ea4973953523bc249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ddd60eec74fb89e04d7e6354a2bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:42.829038 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-0dba245d-059e-4824-99b4-e85cdd785360 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:21:42.830423 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-0dba245d-059e-4824-99b4-e85cdd785360 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:21:42.831708 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-0dba245d-059e-4824-99b4-e85cdd785360 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:21:42.833256 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-0dba245d-059e-4824-99b4-e85cdd785360 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:21:42.837966 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-0dba245d-059e-4824-99b4-e85cdd785360 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:21:42.851294 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-aabcea59-e1d9-40b4-afc9-5c68fb0a79ed tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb444da-2bc4-4d5b-9e65-6739d1f4edf4" status: 200 len: 1394 microversion: 2.1 time: 0.482357 Apr 16 21:21:42.866059 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1893/3943] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:42 2022] GET /compute/v2.1/servers/5bb444da-2bc4-4d5b-9e65-6739d1f4edf4 => generated 1394 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:42.869278 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0dba245d-059e-4824-99b4-e85cdd785360 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:42.870027 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0dba245d-059e-4824-99b4-e85cdd785360 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:42.871265 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ddeb06a1-a210-4250-bb9f-2d52af2a96af tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:42.872381 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ddeb06a1-a210-4250-bb9f-2d52af2a96af tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 1b86bdab-b733-4af5-b2a7-c997869b690c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:42.872998 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0dba245d-059e-4824-99b4-e85cdd785360 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:42.873564 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0dba245d-059e-4824-99b4-e85cdd785360 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:42.880516 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ddeb06a1-a210-4250-bb9f-2d52af2a96af tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:42.884990 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ddeb06a1-a210-4250-bb9f-2d52af2a96af tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:42.884990 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ddeb06a1-a210-4250-bb9f-2d52af2a96af tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:42.884990 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ddeb06a1-a210-4250-bb9f-2d52af2a96af tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:42.904980 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-0dba245d-059e-4824-99b4-e85cdd785360 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Getting quotas for project 14f08d6620b54fb597d356afc45617c7. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:21:42.912429 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-0dba245d-059e-4824-99b4-e85cdd785360 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Getting quotas for user aae8536e08dd4bfb88adc698e7a33d3b and project 14f08d6620b54fb597d356afc45617c7. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:21:42.935182 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0dba245d-059e-4824-99b4-e85cdd785360 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:21:42.938722 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0dba245d-059e-4824-99b4-e85cdd785360 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 1d20fcd6-a9ae-4deb-a209-7bdfab320142] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:21:43.004196 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ddeb06a1-a210-4250-bb9f-2d52af2a96af tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:43.014168 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ddeb06a1-a210-4250-bb9f-2d52af2a96af tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/1b86bdab-b733-4af5-b2a7-c997869b690c" status: 200 len: 1465 microversion: 2.1 time: 0.146941 Apr 16 21:21:43.015578 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1894/3944] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:42 2022] GET /compute/v2.1/servers/1b86bdab-b733-4af5-b2a7-c997869b690c => generated 1465 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:43.024882 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f3cd2fcc-d4f2-4d0a-b19c-3319c6b85b79 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Calling method '.version_select at 0x7fbb96275af0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:43.101818 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0dba245d-059e-4824-99b4-e85cdd785360 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.624994 Apr 16 21:21:43.103360 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2051/3945] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:21:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:21:43.134776 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3f9362c0-ed22-4798-9f93-4a00554833fc tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:43.141113 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3f9362c0-ed22-4798-9f93-4a00554833fc tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 1d20fcd6-a9ae-4deb-a209-7bdfab320142] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:43.288142 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3f9362c0-ed22-4798-9f93-4a00554833fc tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:43.301616 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3f9362c0-ed22-4798-9f93-4a00554833fc tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142" status: 200 len: 1218 microversion: 2.1 time: 0.187182 Apr 16 21:21:43.302572 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2052/3946] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:43 2022] GET /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142 => generated 1218 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:43.321294 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-0ba64fbc-7cee-412a-8734-0579177f5c49 req-b7f810df-ad05-44d8-b7d2-2ae975dfada4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3", "tag": "18304df3-de06-42cd-8000-8170cb9494bf"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:21:43.333143 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-0ba64fbc-7cee-412a-8734-0579177f5c49 req-b7f810df-ad05-44d8-b7d2-2ae975dfada4 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:43.333143 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-0ba64fbc-7cee-412a-8734-0579177f5c49 req-b7f810df-ad05-44d8-b7d2-2ae975dfada4 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:43.363016 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-0ba64fbc-7cee-412a-8734-0579177f5c49 req-b7f810df-ad05-44d8-b7d2-2ae975dfada4 service nova] Creating event network-changed:18304df3-de06-42cd-8000-8170cb9494bf for instance 82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3 on nch1-master-1 Apr 16 21:21:43.377815 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-0ba64fbc-7cee-412a-8734-0579177f5c49 req-b7f810df-ad05-44d8-b7d2-2ae975dfada4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072263 Apr 16 21:21:43.379772 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2053/3947] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:21:43.610403 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-161bbeb3-e49e-42a4-b984-0c8ec8d867db req-d6798de3-4986-479d-96aa-fb9f1aa241fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bb444da-2bc4-4d5b-9e65-6739d1f4edf4", "tag": "8fc0e838-521f-4a5e-8f66-aa03b6fd079d"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:21:43.633618 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-161bbeb3-e49e-42a4-b984-0c8ec8d867db req-d6798de3-4986-479d-96aa-fb9f1aa241fb service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:43.633618 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-161bbeb3-e49e-42a4-b984-0c8ec8d867db req-d6798de3-4986-479d-96aa-fb9f1aa241fb service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:43.656128 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-161bbeb3-e49e-42a4-b984-0c8ec8d867db req-d6798de3-4986-479d-96aa-fb9f1aa241fb service nova] Creating event network-changed:8fc0e838-521f-4a5e-8f66-aa03b6fd079d for instance 5bb444da-2bc4-4d5b-9e65-6739d1f4edf4 on nch1-master-1 Apr 16 21:21:43.662905 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-161bbeb3-e49e-42a4-b984-0c8ec8d867db req-d6798de3-4986-479d-96aa-fb9f1aa241fb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057359 Apr 16 21:21:43.663521 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2054/3948] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:21:43.870360 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-20e197ab-5887-4fd2-af9e-03a47161b8a3 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:43.873963 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-20e197ab-5887-4fd2-af9e-03a47161b8a3 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] [instance: 5bb444da-2bc4-4d5b-9e65-6739d1f4edf4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:43.881534 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-20e197ab-5887-4fd2-af9e-03a47161b8a3 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:43.882355 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-20e197ab-5887-4fd2-af9e-03a47161b8a3 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:43.883418 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-20e197ab-5887-4fd2-af9e-03a47161b8a3 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:43.884085 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-20e197ab-5887-4fd2-af9e-03a47161b8a3 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:44.443270 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-20e197ab-5887-4fd2-af9e-03a47161b8a3 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cb29db112b421ea4973953523bc249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ddd60eec74fb89e04d7e6354a2bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:44.454269 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-20e197ab-5887-4fd2-af9e-03a47161b8a3 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb444da-2bc4-4d5b-9e65-6739d1f4edf4" status: 200 len: 1394 microversion: 2.1 time: 0.588998 Apr 16 21:21:44.455760 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2055/3949] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:43 2022] GET /compute/v2.1/servers/5bb444da-2bc4-4d5b-9e65-6739d1f4edf4 => generated 1394 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:21:44.466471 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-308d7cd0-0a8e-4820-830c-970bb22ca1c4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:44.469195 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-308d7cd0-0a8e-4820-830c-970bb22ca1c4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 1b86bdab-b733-4af5-b2a7-c997869b690c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:44.480543 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-308d7cd0-0a8e-4820-830c-970bb22ca1c4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:44.482099 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-308d7cd0-0a8e-4820-830c-970bb22ca1c4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:44.483784 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-308d7cd0-0a8e-4820-830c-970bb22ca1c4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:44.484566 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-308d7cd0-0a8e-4820-830c-970bb22ca1c4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:44.754843 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-308d7cd0-0a8e-4820-830c-970bb22ca1c4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:44.765876 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-308d7cd0-0a8e-4820-830c-970bb22ca1c4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/1b86bdab-b733-4af5-b2a7-c997869b690c" status: 200 len: 1465 microversion: 2.1 time: 0.308748 Apr 16 21:21:44.766485 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2056/3950] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:44 2022] GET /compute/v2.1/servers/1b86bdab-b733-4af5-b2a7-c997869b690c => generated 1465 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:44.775601 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ede17043-f271-4196-97b6-44f74d6e2547 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:44.777233 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ede17043-f271-4196-97b6-44f74d6e2547 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 1d20fcd6-a9ae-4deb-a209-7bdfab320142] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:44.803489 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ede17043-f271-4196-97b6-44f74d6e2547 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:44.803953 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ede17043-f271-4196-97b6-44f74d6e2547 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:44.804813 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ede17043-f271-4196-97b6-44f74d6e2547 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:44.810451 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ede17043-f271-4196-97b6-44f74d6e2547 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:45.010601 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f3cd2fcc-d4f2-4d0a-b19c-3319c6b85b79 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/d26b89ba-bd27-4880-bd68-19946248b0a6" status: 202 len: 0 microversion: 2.1 time: 1.989167 Apr 16 21:21:45.010601 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1895/3951] 10.222.0.20 () {58 vars in 1262 bytes} [Sat Apr 16 21:21:43 2022] DELETE /compute/v2.1/os-floating-ips/d26b89ba-bd27-4880-bd68-19946248b0a6 => generated 0 bytes in 1992 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:21:45.019368 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4399223f-23be-4148-bce3-089c39cdf013 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:45.019888 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4399223f-23be-4148-bce3-089c39cdf013 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: 82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:45.040928 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4399223f-23be-4148-bce3-089c39cdf013 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:45.041506 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4399223f-23be-4148-bce3-089c39cdf013 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:45.042830 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4399223f-23be-4148-bce3-089c39cdf013 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:45.043292 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4399223f-23be-4148-bce3-089c39cdf013 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:45.047633 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ede17043-f271-4196-97b6-44f74d6e2547 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:45.072435 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ede17043-f271-4196-97b6-44f74d6e2547 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142" status: 200 len: 1222 microversion: 2.1 time: 0.302472 Apr 16 21:21:45.076234 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2057/3952] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:44 2022] GET /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142 => generated 1222 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:45.080868 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4399223f-23be-4148-bce3-089c39cdf013 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: 82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:21:45.407779 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-d7faee17-4ea0-4911-ad87-aeb89d9360b4 req-046325ae-86bb-4840-ba01-d36d6c785f2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7", "name": "network-vif-deleted", "tag": "a5c0f6ba-98bc-4711-85ee-04db4015c727"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:21:45.445134 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-d7faee17-4ea0-4911-ad87-aeb89d9360b4 req-046325ae-86bb-4840-ba01-d36d6c785f2f service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:45.447602 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-d7faee17-4ea0-4911-ad87-aeb89d9360b4 req-046325ae-86bb-4840-ba01-d36d6c785f2f service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:45.481079 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-d7faee17-4ea0-4911-ad87-aeb89d9360b4 req-046325ae-86bb-4840-ba01-d36d6c785f2f service nova] Creating event network-vif-deleted:a5c0f6ba-98bc-4711-85ee-04db4015c727 for instance cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 on nch2-master-1 Apr 16 21:21:45.487897 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4399223f-23be-4148-bce3-089c39cdf013 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] 10.222.0.20 "DELETE /compute/v2.1/servers/82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3" status: 204 len: 0 microversion: 2.1 time: 0.474428 Apr 16 21:21:45.493567 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1896/3953] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:21:45 2022] DELETE /compute/v2.1/servers/82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:21:45.505648 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ebd98db4-6877-4948-a319-dd5f952e6368 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:45.514935 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ebd98db4-6877-4948-a319-dd5f952e6368 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] [instance: 5bb444da-2bc4-4d5b-9e65-6739d1f4edf4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:45.522431 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-d7faee17-4ea0-4911-ad87-aeb89d9360b4 req-046325ae-86bb-4840-ba01-d36d6c785f2f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130902 Apr 16 21:21:45.524685 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2058/3954] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:21:45.541134 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1b8bf66f-53ec-4425-8b07-9a4486fdb5c2 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:45.541258 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ebd98db4-6877-4948-a319-dd5f952e6368 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:45.541258 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ebd98db4-6877-4948-a319-dd5f952e6368 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:45.541428 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1b8bf66f-53ec-4425-8b07-9a4486fdb5c2 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: 82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:45.541534 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ebd98db4-6877-4948-a319-dd5f952e6368 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:45.543753 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ebd98db4-6877-4948-a319-dd5f952e6368 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:45.553806 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1b8bf66f-53ec-4425-8b07-9a4486fdb5c2 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:45.554621 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1b8bf66f-53ec-4425-8b07-9a4486fdb5c2 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:45.557825 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1b8bf66f-53ec-4425-8b07-9a4486fdb5c2 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:45.558621 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1b8bf66f-53ec-4425-8b07-9a4486fdb5c2 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:45.816444 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ebd98db4-6877-4948-a319-dd5f952e6368 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cb29db112b421ea4973953523bc249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ddd60eec74fb89e04d7e6354a2bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:45.828296 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ebd98db4-6877-4948-a319-dd5f952e6368 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb444da-2bc4-4d5b-9e65-6739d1f4edf4" status: 200 len: 1394 microversion: 2.1 time: 0.330578 Apr 16 21:21:45.828832 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1897/3955] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:45 2022] GET /compute/v2.1/servers/5bb444da-2bc4-4d5b-9e65-6739d1f4edf4 => generated 1394 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:45.834763 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e645409c-1f45-4ab8-a634-df8004a603df tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:45.835563 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e645409c-1f45-4ab8-a634-df8004a603df tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 1b86bdab-b733-4af5-b2a7-c997869b690c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:45.842758 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e645409c-1f45-4ab8-a634-df8004a603df tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:45.843219 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e645409c-1f45-4ab8-a634-df8004a603df tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:45.844013 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e645409c-1f45-4ab8-a634-df8004a603df tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:45.844816 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e645409c-1f45-4ab8-a634-df8004a603df tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:45.919823 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e645409c-1f45-4ab8-a634-df8004a603df tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:45.927723 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e645409c-1f45-4ab8-a634-df8004a603df tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/1b86bdab-b733-4af5-b2a7-c997869b690c" status: 200 len: 1300 microversion: 2.1 time: 0.097366 Apr 16 21:21:45.928332 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1898/3956] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:45 2022] GET /compute/v2.1/servers/1b86bdab-b733-4af5-b2a7-c997869b690c => generated 1300 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:45.943414 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-65be246f-e1e6-4040-9301-0b612e766b5d tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:45.943827 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-65be246f-e1e6-4040-9301-0b612e766b5d tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 26d907a5-99ba-4b78-bfb6-bde24a77d9ca] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:45.948773 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1b8bf66f-53ec-4425-8b07-9a4486fdb5c2 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4866b2c7b7d248539783664403807b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb0e213bd0d40ee9e832b54607028ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:45.951515 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-65be246f-e1e6-4040-9301-0b612e766b5d tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:45.952229 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-65be246f-e1e6-4040-9301-0b612e766b5d tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:45.954405 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-65be246f-e1e6-4040-9301-0b612e766b5d tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:45.955015 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-65be246f-e1e6-4040-9301-0b612e766b5d tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:45.960747 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1b8bf66f-53ec-4425-8b07-9a4486fdb5c2 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] 10.222.0.20 "GET /compute/v2.1/servers/82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3" status: 200 len: 1526 microversion: 2.1 time: 0.431635 Apr 16 21:21:45.972547 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2059/3957] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:45 2022] GET /compute/v2.1/servers/82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3 => generated 1526 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:45.973109 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-65be246f-e1e6-4040-9301-0b612e766b5d tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] HTTP exception thrown: Instance 26d907a5-99ba-4b78-bfb6-bde24a77d9ca could not be found. Apr 16 21:21:45.973921 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-65be246f-e1e6-4040-9301-0b612e766b5d tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Returning 404 to user: Instance 26d907a5-99ba-4b78-bfb6-bde24a77d9ca could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:21:45.974832 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-65be246f-e1e6-4040-9301-0b612e766b5d tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "DELETE /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca" status: 404 len: 111 microversion: 2.1 time: 0.036418 Apr 16 21:21:45.975398 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1899/3958] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:21:45 2022] DELETE /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:21:45.985335 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e380ef5d-040c-41ff-a0f4-3be48186458e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:45.986442 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e380ef5d-040c-41ff-a0f4-3be48186458e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 26d907a5-99ba-4b78-bfb6-bde24a77d9ca] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:45.997333 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e380ef5d-040c-41ff-a0f4-3be48186458e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:45.997948 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e380ef5d-040c-41ff-a0f4-3be48186458e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:45.999010 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e380ef5d-040c-41ff-a0f4-3be48186458e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:45.999526 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e380ef5d-040c-41ff-a0f4-3be48186458e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:46.033756 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-e380ef5d-040c-41ff-a0f4-3be48186458e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] HTTP exception thrown: Instance 26d907a5-99ba-4b78-bfb6-bde24a77d9ca could not be found. Apr 16 21:21:46.034596 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e380ef5d-040c-41ff-a0f4-3be48186458e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Returning 404 to user: Instance 26d907a5-99ba-4b78-bfb6-bde24a77d9ca could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:21:46.035880 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e380ef5d-040c-41ff-a0f4-3be48186458e tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca" status: 404 len: 111 microversion: 2.1 time: 0.056009 Apr 16 21:21:46.040654 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2060/3959] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:45 2022] GET /compute/v2.1/servers/26d907a5-99ba-4b78-bfb6-bde24a77d9ca => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:21:46.045309 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-736311cd-6387-435e-a7c3-bbdadc95b981 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:46.046399 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-736311cd-6387-435e-a7c3-bbdadc95b981 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 3834cb63-fcdb-46a3-a476-0ee952c105aa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:46.058035 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-736311cd-6387-435e-a7c3-bbdadc95b981 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:46.058035 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-736311cd-6387-435e-a7c3-bbdadc95b981 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:46.058035 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-736311cd-6387-435e-a7c3-bbdadc95b981 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:46.058035 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-736311cd-6387-435e-a7c3-bbdadc95b981 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:46.077357 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-736311cd-6387-435e-a7c3-bbdadc95b981 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] HTTP exception thrown: Instance 3834cb63-fcdb-46a3-a476-0ee952c105aa could not be found. Apr 16 21:21:46.078210 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-736311cd-6387-435e-a7c3-bbdadc95b981 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Returning 404 to user: Instance 3834cb63-fcdb-46a3-a476-0ee952c105aa could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:21:46.079680 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-736311cd-6387-435e-a7c3-bbdadc95b981 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa" status: 404 len: 111 microversion: 2.1 time: 0.038053 Apr 16 21:21:46.080948 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1900/3960] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:21:46 2022] DELETE /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:21:46.089547 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b3d313b5-0254-411d-9a69-3f8a6eb1b2a4 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:46.090043 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b3d313b5-0254-411d-9a69-3f8a6eb1b2a4 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] [instance: 3834cb63-fcdb-46a3-a476-0ee952c105aa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:46.094207 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c1d97ef4-61ef-4f5b-88dd-7f2dbc1c3856 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:46.094831 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c1d97ef4-61ef-4f5b-88dd-7f2dbc1c3856 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 1d20fcd6-a9ae-4deb-a209-7bdfab320142] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:46.102306 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c1d97ef4-61ef-4f5b-88dd-7f2dbc1c3856 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:46.102970 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c1d97ef4-61ef-4f5b-88dd-7f2dbc1c3856 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:46.104024 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b3d313b5-0254-411d-9a69-3f8a6eb1b2a4 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:46.104534 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b3d313b5-0254-411d-9a69-3f8a6eb1b2a4 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:46.104713 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c1d97ef4-61ef-4f5b-88dd-7f2dbc1c3856 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:46.105341 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b3d313b5-0254-411d-9a69-3f8a6eb1b2a4 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:46.105463 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c1d97ef4-61ef-4f5b-88dd-7f2dbc1c3856 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:46.105788 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b3d313b5-0254-411d-9a69-3f8a6eb1b2a4 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:46.135858 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-b3d313b5-0254-411d-9a69-3f8a6eb1b2a4 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] HTTP exception thrown: Instance 3834cb63-fcdb-46a3-a476-0ee952c105aa could not be found. Apr 16 21:21:46.136510 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b3d313b5-0254-411d-9a69-3f8a6eb1b2a4 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] Returning 404 to user: Instance 3834cb63-fcdb-46a3-a476-0ee952c105aa could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:21:46.137366 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b3d313b5-0254-411d-9a69-3f8a6eb1b2a4 tempest-ServersTestMultiNic-586548735 tempest-ServersTestMultiNic-586548735-project] 10.222.0.20 "GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa" status: 404 len: 111 microversion: 2.1 time: 0.052377 Apr 16 21:21:46.137935 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2061/3961] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:46 2022] GET /compute/v2.1/servers/3834cb63-fcdb-46a3-a476-0ee952c105aa => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:21:46.239586 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c1d97ef4-61ef-4f5b-88dd-7f2dbc1c3856 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:46.248544 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c1d97ef4-61ef-4f5b-88dd-7f2dbc1c3856 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142" status: 200 len: 1278 microversion: 2.1 time: 0.158176 Apr 16 21:21:46.255341 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1901/3962] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:46 2022] GET /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142 => generated 1278 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:46.846349 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cadcfc12-0c34-41b0-9b83-dd0848e620cb tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:46.847148 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cadcfc12-0c34-41b0-9b83-dd0848e620cb tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] [instance: 5bb444da-2bc4-4d5b-9e65-6739d1f4edf4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:46.855826 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cadcfc12-0c34-41b0-9b83-dd0848e620cb tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:46.861174 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cadcfc12-0c34-41b0-9b83-dd0848e620cb tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:46.861174 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cadcfc12-0c34-41b0-9b83-dd0848e620cb tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:46.861174 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cadcfc12-0c34-41b0-9b83-dd0848e620cb tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:46.944217 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c11f4444-0dd5-4635-951b-cfd167de4f47 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:46.945147 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c11f4444-0dd5-4635-951b-cfd167de4f47 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 1b86bdab-b733-4af5-b2a7-c997869b690c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:46.953518 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c11f4444-0dd5-4635-951b-cfd167de4f47 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:46.954266 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c11f4444-0dd5-4635-951b-cfd167de4f47 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:46.955267 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c11f4444-0dd5-4635-951b-cfd167de4f47 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:46.955878 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c11f4444-0dd5-4635-951b-cfd167de4f47 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:46.974629 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-c11f4444-0dd5-4635-951b-cfd167de4f47 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] HTTP exception thrown: Instance 1b86bdab-b733-4af5-b2a7-c997869b690c could not be found. Apr 16 21:21:46.975520 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c11f4444-0dd5-4635-951b-cfd167de4f47 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Returning 404 to user: Instance 1b86bdab-b733-4af5-b2a7-c997869b690c could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:21:46.976636 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c11f4444-0dd5-4635-951b-cfd167de4f47 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/1b86bdab-b733-4af5-b2a7-c997869b690c" status: 404 len: 111 microversion: 2.1 time: 0.036342 Apr 16 21:21:46.977722 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1902/3963] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:46 2022] GET /compute/v2.1/servers/1b86bdab-b733-4af5-b2a7-c997869b690c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:21:46.982555 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d1824a36-be35-4a48-aa99-8004e4c72622 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:46.983348 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d1824a36-be35-4a48-aa99-8004e4c72622 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: 82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:46.992914 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d1824a36-be35-4a48-aa99-8004e4c72622 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:46.992914 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d1824a36-be35-4a48-aa99-8004e4c72622 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:46.992914 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d1824a36-be35-4a48-aa99-8004e4c72622 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:46.992914 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d1824a36-be35-4a48-aa99-8004e4c72622 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:47.121863 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cadcfc12-0c34-41b0-9b83-dd0848e620cb tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cb29db112b421ea4973953523bc249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ddd60eec74fb89e04d7e6354a2bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:47.129749 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cadcfc12-0c34-41b0-9b83-dd0848e620cb tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb444da-2bc4-4d5b-9e65-6739d1f4edf4" status: 200 len: 1394 microversion: 2.1 time: 0.288451 Apr 16 21:21:47.130805 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2062/3964] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:46 2022] GET /compute/v2.1/servers/5bb444da-2bc4-4d5b-9e65-6739d1f4edf4 => generated 1394 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:47.137262 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8dbad7c1-2eff-47e5-9d54-35b6e0f0c55d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:47.137994 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8dbad7c1-2eff-47e5-9d54-35b6e0f0c55d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:47.144074 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8dbad7c1-2eff-47e5-9d54-35b6e0f0c55d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:47.144690 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8dbad7c1-2eff-47e5-9d54-35b6e0f0c55d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:47.145739 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8dbad7c1-2eff-47e5-9d54-35b6e0f0c55d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:47.146252 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8dbad7c1-2eff-47e5-9d54-35b6e0f0c55d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:47.174951 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8dbad7c1-2eff-47e5-9d54-35b6e0f0c55d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:21:47.333903 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d1824a36-be35-4a48-aa99-8004e4c72622 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4866b2c7b7d248539783664403807b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb0e213bd0d40ee9e832b54607028ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:47.344204 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d1824a36-be35-4a48-aa99-8004e4c72622 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] 10.222.0.20 "GET /compute/v2.1/servers/82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3" status: 200 len: 1526 microversion: 2.1 time: 0.364745 Apr 16 21:21:47.345466 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1903/3965] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:46 2022] GET /compute/v2.1/servers/82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3 => generated 1526 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:47.352874 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-80b03082-6559-41fd-a366-1698db248425 req-0a2edca6-fcd6-43df-bd7b-15fd800e7a2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bb444da-2bc4-4d5b-9e65-6739d1f4edf4", "name": "network-vif-plugged", "status": "completed", "tag": "8fc0e838-521f-4a5e-8f66-aa03b6fd079d"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:21:47.371916 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-80b03082-6559-41fd-a366-1698db248425 req-0a2edca6-fcd6-43df-bd7b-15fd800e7a2c service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:47.373588 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-80b03082-6559-41fd-a366-1698db248425 req-0a2edca6-fcd6-43df-bd7b-15fd800e7a2c service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:47.409196 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-80b03082-6559-41fd-a366-1698db248425 req-0a2edca6-fcd6-43df-bd7b-15fd800e7a2c service nova] Creating event network-vif-plugged:8fc0e838-521f-4a5e-8f66-aa03b6fd079d for instance 5bb444da-2bc4-4d5b-9e65-6739d1f4edf4 on nch1-master-1 Apr 16 21:21:47.418125 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-80b03082-6559-41fd-a366-1698db248425 req-0a2edca6-fcd6-43df-bd7b-15fd800e7a2c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070006 Apr 16 21:21:47.423362 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1904/3966] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:21:47.429788 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e359beed-489b-4e68-86bf-64ec410797fd tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:47.431621 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e359beed-489b-4e68-86bf-64ec410797fd tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 1d20fcd6-a9ae-4deb-a209-7bdfab320142] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:47.441341 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e359beed-489b-4e68-86bf-64ec410797fd tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:47.443462 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e359beed-489b-4e68-86bf-64ec410797fd tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:47.443820 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e359beed-489b-4e68-86bf-64ec410797fd tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:47.444882 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e359beed-489b-4e68-86bf-64ec410797fd tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:47.585574 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8dbad7c1-2eff-47e5-9d54-35b6e0f0c55d tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18" status: 204 len: 0 microversion: 2.1 time: 0.451824 Apr 16 21:21:47.587169 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2063/3967] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:21:47 2022] DELETE /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:21:47.598129 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-920c31cd-88b8-498f-add8-8660237979ca tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:47.599462 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-920c31cd-88b8-498f-add8-8660237979ca tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:47.610401 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-920c31cd-88b8-498f-add8-8660237979ca tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:47.611448 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-920c31cd-88b8-498f-add8-8660237979ca tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:47.612596 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-920c31cd-88b8-498f-add8-8660237979ca tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:47.613330 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-920c31cd-88b8-498f-add8-8660237979ca tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:47.843683 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e359beed-489b-4e68-86bf-64ec410797fd tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:47.856652 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e359beed-489b-4e68-86bf-64ec410797fd tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142" status: 200 len: 1318 microversion: 2.1 time: 0.429271 Apr 16 21:21:47.856652 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1905/3968] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:47 2022] GET /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142 => generated 1318 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:47.868515 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-79488786-ea98-4e45-b31d-3b33a0f4069e req-7274ee82-8da6-4ed6-a66f-171d677e87e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1b86bdab-b733-4af5-b2a7-c997869b690c", "name": "network-vif-deleted", "tag": "70b96df0-3186-4dcf-ba26-08fa42867480"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:21:47.876648 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-79488786-ea98-4e45-b31d-3b33a0f4069e req-7274ee82-8da6-4ed6-a66f-171d677e87e8 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:47.877176 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-79488786-ea98-4e45-b31d-3b33a0f4069e req-7274ee82-8da6-4ed6-a66f-171d677e87e8 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:47.889068 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-79488786-ea98-4e45-b31d-3b33a0f4069e req-7274ee82-8da6-4ed6-a66f-171d677e87e8 service nova] Creating event network-vif-deleted:70b96df0-3186-4dcf-ba26-08fa42867480 for instance 1b86bdab-b733-4af5-b2a7-c997869b690c on nch2-master-1 Apr 16 21:21:47.893898 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-79488786-ea98-4e45-b31d-3b33a0f4069e req-7274ee82-8da6-4ed6-a66f-171d677e87e8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033727 Apr 16 21:21:47.894546 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1906/3969] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:21:48.124683 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-cee8d4d1-1d24-4f8f-944f-af32c31cd908 req-7e73469b-b676-4abd-bc0f-0f47bb742ae9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3", "name": "network-vif-deleted", "tag": "18304df3-de06-42cd-8000-8170cb9494bf"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:21:48.139442 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-cee8d4d1-1d24-4f8f-944f-af32c31cd908 req-7e73469b-b676-4abd-bc0f-0f47bb742ae9 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:48.140489 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-cee8d4d1-1d24-4f8f-944f-af32c31cd908 req-7e73469b-b676-4abd-bc0f-0f47bb742ae9 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:48.157525 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-cee8d4d1-1d24-4f8f-944f-af32c31cd908 req-7e73469b-b676-4abd-bc0f-0f47bb742ae9 service nova] Creating event network-vif-deleted:18304df3-de06-42cd-8000-8170cb9494bf for instance 82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3 on nch1-master-1 Apr 16 21:21:48.165260 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-cee8d4d1-1d24-4f8f-944f-af32c31cd908 req-7e73469b-b676-4abd-bc0f-0f47bb742ae9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045129 Apr 16 21:21:48.166566 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1907/3970] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:21:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:21:48.175172 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a373b3ee-1a53-4d37-b8ed-791bedc1d533 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:48.175888 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a373b3ee-1a53-4d37-b8ed-791bedc1d533 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] [instance: 5bb444da-2bc4-4d5b-9e65-6739d1f4edf4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:48.186221 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a373b3ee-1a53-4d37-b8ed-791bedc1d533 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:48.186821 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a373b3ee-1a53-4d37-b8ed-791bedc1d533 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:48.191887 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a373b3ee-1a53-4d37-b8ed-791bedc1d533 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:48.191887 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a373b3ee-1a53-4d37-b8ed-791bedc1d533 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:48.203489 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-920c31cd-88b8-498f-add8-8660237979ca tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:48.217283 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-920c31cd-88b8-498f-add8-8660237979ca tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18" status: 200 len: 1508 microversion: 2.1 time: 0.624426 Apr 16 21:21:48.218602 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2064/3971] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:47 2022] GET /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18 => generated 1508 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:48.366667 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5c1772a4-8f62-4338-ae7d-e43fe60c9920 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:48.370930 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5c1772a4-8f62-4338-ae7d-e43fe60c9920 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: 82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:48.380437 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5c1772a4-8f62-4338-ae7d-e43fe60c9920 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:48.381226 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5c1772a4-8f62-4338-ae7d-e43fe60c9920 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:48.386887 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5c1772a4-8f62-4338-ae7d-e43fe60c9920 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:48.388102 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5c1772a4-8f62-4338-ae7d-e43fe60c9920 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:48.552300 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5c1772a4-8f62-4338-ae7d-e43fe60c9920 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4866b2c7b7d248539783664403807b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb0e213bd0d40ee9e832b54607028ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:48.552417 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a373b3ee-1a53-4d37-b8ed-791bedc1d533 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cb29db112b421ea4973953523bc249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ddd60eec74fb89e04d7e6354a2bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:48.552843 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5c1772a4-8f62-4338-ae7d-e43fe60c9920 tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] 10.222.0.20 "GET /compute/v2.1/servers/82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3" status: 200 len: 1308 microversion: 2.1 time: 0.176701 Apr 16 21:21:48.552843 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2065/3972] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:48 2022] GET /compute/v2.1/servers/82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3 => generated 1308 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:48.553009 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a373b3ee-1a53-4d37-b8ed-791bedc1d533 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb444da-2bc4-4d5b-9e65-6739d1f4edf4" status: 200 len: 1394 microversion: 2.1 time: 0.379597 Apr 16 21:21:48.557365 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1908/3973] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:48 2022] GET /compute/v2.1/servers/5bb444da-2bc4-4d5b-9e65-6739d1f4edf4 => generated 1394 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:48.873886 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-110bd207-aa72-4b8a-9802-5f7307f25b88 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:48.875449 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-110bd207-aa72-4b8a-9802-5f7307f25b88 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 1d20fcd6-a9ae-4deb-a209-7bdfab320142] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:48.883338 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-110bd207-aa72-4b8a-9802-5f7307f25b88 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:48.884042 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-110bd207-aa72-4b8a-9802-5f7307f25b88 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:48.885402 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-110bd207-aa72-4b8a-9802-5f7307f25b88 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:48.886010 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-110bd207-aa72-4b8a-9802-5f7307f25b88 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:49.222365 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-110bd207-aa72-4b8a-9802-5f7307f25b88 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:49.237090 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-67144230-f109-4de1-83c5-832f3c6db9a2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:49.243265 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-67144230-f109-4de1-83c5-832f3c6db9a2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:49.252101 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-110bd207-aa72-4b8a-9802-5f7307f25b88 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142" status: 200 len: 1318 microversion: 2.1 time: 0.379204 Apr 16 21:21:49.262222 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2066/3974] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:48 2022] GET /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142 => generated 1318 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:49.266970 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-67144230-f109-4de1-83c5-832f3c6db9a2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:49.268447 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-67144230-f109-4de1-83c5-832f3c6db9a2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:49.270211 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-67144230-f109-4de1-83c5-832f3c6db9a2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:49.272597 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-67144230-f109-4de1-83c5-832f3c6db9a2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:49.563451 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ff96687c-4699-4613-b17d-1e201ff0166b tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:49.564079 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ff96687c-4699-4613-b17d-1e201ff0166b tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] [instance: 82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:49.574387 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ff96687c-4699-4613-b17d-1e201ff0166b tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:49.575721 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ff96687c-4699-4613-b17d-1e201ff0166b tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:49.576894 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ff96687c-4699-4613-b17d-1e201ff0166b tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:49.578270 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ff96687c-4699-4613-b17d-1e201ff0166b tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:49.602092 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-ff96687c-4699-4613-b17d-1e201ff0166b tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] HTTP exception thrown: Instance 82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3 could not be found. Apr 16 21:21:49.602849 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ff96687c-4699-4613-b17d-1e201ff0166b tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] Returning 404 to user: Instance 82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:21:49.610671 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ff96687c-4699-4613-b17d-1e201ff0166b tempest-FloatingIPsAssociationTestJSON-566853709 tempest-FloatingIPsAssociationTestJSON-566853709-project] 10.222.0.20 "GET /compute/v2.1/servers/82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3" status: 404 len: 111 microversion: 2.1 time: 0.051630 Apr 16 21:21:49.612657 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2067/3975] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:49 2022] GET /compute/v2.1/servers/82374f32-eae1-4a0e-a79c-7ec0eb4cc0c3 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:21:49.662585 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-04522f0f-aef6-424c-98e4-4390ebf52bd4 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:49.702353 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-04522f0f-aef6-424c-98e4-4390ebf52bd4 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] [instance: 5bb444da-2bc4-4d5b-9e65-6739d1f4edf4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:49.725183 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-04522f0f-aef6-424c-98e4-4390ebf52bd4 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:49.727818 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-04522f0f-aef6-424c-98e4-4390ebf52bd4 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:49.731865 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-04522f0f-aef6-424c-98e4-4390ebf52bd4 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:49.751566 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-04522f0f-aef6-424c-98e4-4390ebf52bd4 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:49.866259 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-67144230-f109-4de1-83c5-832f3c6db9a2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:49.878200 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-67144230-f109-4de1-83c5-832f3c6db9a2 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18" status: 200 len: 1466 microversion: 2.1 time: 0.643928 Apr 16 21:21:49.887995 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1909/3976] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:49 2022] GET /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18 => generated 1466 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:49.931807 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-2637f00b-c089-44c5-b43a-73b9e245030c req-8513c626-5939-495d-b96d-841119170ee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18", "name": "network-vif-deleted", "tag": "880aed47-539f-4469-8060-4c63493e9b1d"}, {"name": "network-changed", "server_uuid": "1d20fcd6-a9ae-4deb-a209-7bdfab320142", "tag": "1777c8d6-fb38-4c45-b87c-5afbdc93eca8"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:21:49.952432 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-2637f00b-c089-44c5-b43a-73b9e245030c req-8513c626-5939-495d-b96d-841119170ee7 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:49.959749 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-2637f00b-c089-44c5-b43a-73b9e245030c req-8513c626-5939-495d-b96d-841119170ee7 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:49.986755 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-2637f00b-c089-44c5-b43a-73b9e245030c req-8513c626-5939-495d-b96d-841119170ee7 service nova] Creating event network-vif-deleted:880aed47-539f-4469-8060-4c63493e9b1d for instance 8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18 on nch2-master-1 Apr 16 21:21:49.988302 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-2637f00b-c089-44c5-b43a-73b9e245030c req-8513c626-5939-495d-b96d-841119170ee7 service nova] Creating event network-changed:1777c8d6-fb38-4c45-b87c-5afbdc93eca8 for instance 1d20fcd6-a9ae-4deb-a209-7bdfab320142 on nch2-master-1 Apr 16 21:21:50.009743 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-2637f00b-c089-44c5-b43a-73b9e245030c req-8513c626-5939-495d-b96d-841119170ee7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.082533 Apr 16 21:21:50.017111 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1910/3977] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:21:49 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:21:50.151012 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-04522f0f-aef6-424c-98e4-4390ebf52bd4 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cb29db112b421ea4973953523bc249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ddd60eec74fb89e04d7e6354a2bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:50.167523 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-04522f0f-aef6-424c-98e4-4390ebf52bd4 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb444da-2bc4-4d5b-9e65-6739d1f4edf4" status: 200 len: 1575 microversion: 2.1 time: 0.553253 Apr 16 21:21:50.168291 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2068/3978] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:49 2022] GET /compute/v2.1/servers/5bb444da-2bc4-4d5b-9e65-6739d1f4edf4 => generated 1575 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:50.187987 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0b5801dc-7f1b-4777-8107-be049056cff6 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:50.191188 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0b5801dc-7f1b-4777-8107-be049056cff6 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] [instance: 5bb444da-2bc4-4d5b-9e65-6739d1f4edf4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:50.224819 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0b5801dc-7f1b-4777-8107-be049056cff6 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:50.225938 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0b5801dc-7f1b-4777-8107-be049056cff6 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:50.228201 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0b5801dc-7f1b-4777-8107-be049056cff6 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:50.229589 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0b5801dc-7f1b-4777-8107-be049056cff6 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:50.272377 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-79cd8844-8f73-40dd-9f3e-534042c6da40 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:50.273082 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-79cd8844-8f73-40dd-9f3e-534042c6da40 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 1d20fcd6-a9ae-4deb-a209-7bdfab320142] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:50.281767 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-79cd8844-8f73-40dd-9f3e-534042c6da40 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:50.282646 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-79cd8844-8f73-40dd-9f3e-534042c6da40 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:50.284367 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-79cd8844-8f73-40dd-9f3e-534042c6da40 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:50.285015 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-79cd8844-8f73-40dd-9f3e-534042c6da40 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:50.349182 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0b5801dc-7f1b-4777-8107-be049056cff6 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb444da-2bc4-4d5b-9e65-6739d1f4edf4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.166974 Apr 16 21:21:50.350230 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1911/3979] 10.222.0.20 () {58 vars in 1274 bytes} [Sat Apr 16 21:21:50 2022] GET /compute/v2.1/servers/5bb444da-2bc4-4d5b-9e65-6739d1f4edf4/os-interface => generated 284 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:21:50.635865 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-79cd8844-8f73-40dd-9f3e-534042c6da40 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:50.644042 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-79cd8844-8f73-40dd-9f3e-534042c6da40 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142" status: 200 len: 1318 microversion: 2.1 time: 0.376349 Apr 16 21:21:50.658715 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2069/3980] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:50 2022] GET /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142 => generated 1318 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:50.895714 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e9249acc-5656-41cf-b188-56ac4545b2df tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:50.896490 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e9249acc-5656-41cf-b188-56ac4545b2df tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:50.903967 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e9249acc-5656-41cf-b188-56ac4545b2df tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:50.905281 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e9249acc-5656-41cf-b188-56ac4545b2df tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:50.906177 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e9249acc-5656-41cf-b188-56ac4545b2df tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:50.906880 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e9249acc-5656-41cf-b188-56ac4545b2df tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:50.922849 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-e9249acc-5656-41cf-b188-56ac4545b2df tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] HTTP exception thrown: Instance 8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18 could not be found. Apr 16 21:21:50.933250 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e9249acc-5656-41cf-b188-56ac4545b2df tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Returning 404 to user: Instance 8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:21:50.934596 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e9249acc-5656-41cf-b188-56ac4545b2df tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18" status: 404 len: 111 microversion: 2.1 time: 0.043541 Apr 16 21:21:50.935185 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1912/3981] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:50 2022] GET /compute/v2.1/servers/8ac8f9ac-ca67-4aab-a8e0-96e1b189ba18 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:21:50.944540 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6a321b8c-670b-4e67-b345-5c4a0b18cbd4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:50.945486 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6a321b8c-670b-4e67-b345-5c4a0b18cbd4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 999c16db-7916-4753-ae16-9ed72c8e6922] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:50.953188 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6a321b8c-670b-4e67-b345-5c4a0b18cbd4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:50.953919 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6a321b8c-670b-4e67-b345-5c4a0b18cbd4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:50.954953 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6a321b8c-670b-4e67-b345-5c4a0b18cbd4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:50.956918 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6a321b8c-670b-4e67-b345-5c4a0b18cbd4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:51.003602 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6a321b8c-670b-4e67-b345-5c4a0b18cbd4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 999c16db-7916-4753-ae16-9ed72c8e6922] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:21:51.281496 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6a321b8c-670b-4e67-b345-5c4a0b18cbd4 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "DELETE /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922" status: 204 len: 0 microversion: 2.1 time: 0.341541 Apr 16 21:21:51.282894 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2070/3982] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:21:50 2022] DELETE /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:21:51.291872 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f248c79b-86f1-4a44-969d-97debeb7703c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:51.292758 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f248c79b-86f1-4a44-969d-97debeb7703c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 999c16db-7916-4753-ae16-9ed72c8e6922] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:51.306839 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f248c79b-86f1-4a44-969d-97debeb7703c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:51.307412 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f248c79b-86f1-4a44-969d-97debeb7703c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:51.308475 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f248c79b-86f1-4a44-969d-97debeb7703c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:51.308986 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f248c79b-86f1-4a44-969d-97debeb7703c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:51.636876 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f248c79b-86f1-4a44-969d-97debeb7703c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:51.645993 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f248c79b-86f1-4a44-969d-97debeb7703c tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922" status: 200 len: 1494 microversion: 2.1 time: 0.358788 Apr 16 21:21:51.647210 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1913/3983] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:51 2022] GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922 => generated 1494 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:51.667678 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9a68ea8d-a5ca-4508-95e0-0c7263d71d59 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:51.667678 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9a68ea8d-a5ca-4508-95e0-0c7263d71d59 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 1d20fcd6-a9ae-4deb-a209-7bdfab320142] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:51.675060 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a68ea8d-a5ca-4508-95e0-0c7263d71d59 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:51.676506 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a68ea8d-a5ca-4508-95e0-0c7263d71d59 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:51.677741 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a68ea8d-a5ca-4508-95e0-0c7263d71d59 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:51.679511 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a68ea8d-a5ca-4508-95e0-0c7263d71d59 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:52.182556 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9a68ea8d-a5ca-4508-95e0-0c7263d71d59 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:52.193288 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9a68ea8d-a5ca-4508-95e0-0c7263d71d59 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142" status: 200 len: 1318 microversion: 2.1 time: 0.534009 Apr 16 21:21:52.194236 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2071/3984] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:51 2022] GET /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142 => generated 1318 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:52.676534 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cd43d68d-cc3c-4074-89b5-f9fd2d273d1e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:52.680045 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-cd43d68d-cc3c-4074-89b5-f9fd2d273d1e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 999c16db-7916-4753-ae16-9ed72c8e6922] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:52.698347 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cd43d68d-cc3c-4074-89b5-f9fd2d273d1e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:52.699129 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cd43d68d-cc3c-4074-89b5-f9fd2d273d1e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:52.701369 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cd43d68d-cc3c-4074-89b5-f9fd2d273d1e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:52.703050 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cd43d68d-cc3c-4074-89b5-f9fd2d273d1e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:53.072244 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cd43d68d-cc3c-4074-89b5-f9fd2d273d1e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:53.080865 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cd43d68d-cc3c-4074-89b5-f9fd2d273d1e tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922" status: 200 len: 1494 microversion: 2.1 time: 0.413829 Apr 16 21:21:53.082085 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1914/3985] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:52 2022] GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922 => generated 1494 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:53.209379 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1fb6c0f8-4c1f-42c0-8481-08f43957ec78 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:53.210875 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1fb6c0f8-4c1f-42c0-8481-08f43957ec78 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 1d20fcd6-a9ae-4deb-a209-7bdfab320142] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:53.227435 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1fb6c0f8-4c1f-42c0-8481-08f43957ec78 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:53.228223 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1fb6c0f8-4c1f-42c0-8481-08f43957ec78 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:53.230666 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1fb6c0f8-4c1f-42c0-8481-08f43957ec78 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:53.231318 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1fb6c0f8-4c1f-42c0-8481-08f43957ec78 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:53.712084 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-be6297fc-4c1a-4037-b214-92fec381d0ca req-c5bda391-7d20-4c37-b2a0-fff871998853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "999c16db-7916-4753-ae16-9ed72c8e6922", "name": "network-vif-deleted", "tag": "90cb3288-a22b-4ad5-a087-5f17138b5d8b"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:21:53.730336 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-be6297fc-4c1a-4037-b214-92fec381d0ca req-c5bda391-7d20-4c37-b2a0-fff871998853 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:53.732460 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-be6297fc-4c1a-4037-b214-92fec381d0ca req-c5bda391-7d20-4c37-b2a0-fff871998853 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:53.763885 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-be6297fc-4c1a-4037-b214-92fec381d0ca req-c5bda391-7d20-4c37-b2a0-fff871998853 service nova] Creating event network-vif-deleted:90cb3288-a22b-4ad5-a087-5f17138b5d8b for instance 999c16db-7916-4753-ae16-9ed72c8e6922 on nch1-master-1 Apr 16 21:21:53.770733 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-be6297fc-4c1a-4037-b214-92fec381d0ca req-c5bda391-7d20-4c37-b2a0-fff871998853 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065616 Apr 16 21:21:53.774109 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1915/3986] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:21:53.793223 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ed55d0e2-c2c3-4695-952a-d5a80dee2bb0 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:53.794451 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ed55d0e2-c2c3-4695-952a-d5a80dee2bb0 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] [instance: 5bb444da-2bc4-4d5b-9e65-6739d1f4edf4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:53.801616 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ed55d0e2-c2c3-4695-952a-d5a80dee2bb0 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:53.802371 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ed55d0e2-c2c3-4695-952a-d5a80dee2bb0 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:53.803473 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ed55d0e2-c2c3-4695-952a-d5a80dee2bb0 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:53.804126 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ed55d0e2-c2c3-4695-952a-d5a80dee2bb0 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:54.095358 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ed55d0e2-c2c3-4695-952a-d5a80dee2bb0 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cb29db112b421ea4973953523bc249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ddd60eec74fb89e04d7e6354a2bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:54.105942 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ed55d0e2-c2c3-4695-952a-d5a80dee2bb0 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb444da-2bc4-4d5b-9e65-6739d1f4edf4" status: 200 len: 1575 microversion: 2.1 time: 0.329664 Apr 16 21:21:54.106619 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1916/3987] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:53 2022] GET /compute/v2.1/servers/5bb444da-2bc4-4d5b-9e65-6739d1f4edf4 => generated 1575 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:54.121759 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c8842e6e-e61a-4a58-92d9-b5f6f3a072ce tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:54.122498 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c8842e6e-e61a-4a58-92d9-b5f6f3a072ce tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 999c16db-7916-4753-ae16-9ed72c8e6922] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:54.153858 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c8842e6e-e61a-4a58-92d9-b5f6f3a072ce tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:54.154373 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c8842e6e-e61a-4a58-92d9-b5f6f3a072ce tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:54.155210 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c8842e6e-e61a-4a58-92d9-b5f6f3a072ce tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:54.155665 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c8842e6e-e61a-4a58-92d9-b5f6f3a072ce tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:54.179303 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1fb6c0f8-4c1f-42c0-8481-08f43957ec78 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:54.188808 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1fb6c0f8-4c1f-42c0-8481-08f43957ec78 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142" status: 200 len: 1318 microversion: 2.1 time: 0.983187 Apr 16 21:21:54.189400 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2072/3988] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:53 2022] GET /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142 => generated 1318 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:54.250350 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c8842e6e-e61a-4a58-92d9-b5f6f3a072ce tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:54.251617 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c8842e6e-e61a-4a58-92d9-b5f6f3a072ce tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:54.252334 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-c8842e6e-e61a-4a58-92d9-b5f6f3a072ce tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lazy-loading 'fault' on Instance uuid 999c16db-7916-4753-ae16-9ed72c8e6922 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:21:54.534588 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c8842e6e-e61a-4a58-92d9-b5f6f3a072ce tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:54.542898 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c8842e6e-e61a-4a58-92d9-b5f6f3a072ce tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922" status: 200 len: 1304 microversion: 2.1 time: 0.435344 Apr 16 21:21:54.543646 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1917/3989] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:54 2022] GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922 => generated 1304 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:55.206609 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-58443c25-716d-4ca6-91bc-9ebbb522fc5e tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:55.208093 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-58443c25-716d-4ca6-91bc-9ebbb522fc5e tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 1d20fcd6-a9ae-4deb-a209-7bdfab320142] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:55.233002 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58443c25-716d-4ca6-91bc-9ebbb522fc5e tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:55.234823 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58443c25-716d-4ca6-91bc-9ebbb522fc5e tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:55.236133 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58443c25-716d-4ca6-91bc-9ebbb522fc5e tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:55.236696 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58443c25-716d-4ca6-91bc-9ebbb522fc5e tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:55.567114 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7c300e66-6f49-47bc-b9a4-78a5c7810f82 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:55.567943 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7c300e66-6f49-47bc-b9a4-78a5c7810f82 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 999c16db-7916-4753-ae16-9ed72c8e6922] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:55.580123 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7c300e66-6f49-47bc-b9a4-78a5c7810f82 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:55.582664 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7c300e66-6f49-47bc-b9a4-78a5c7810f82 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:55.583487 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7c300e66-6f49-47bc-b9a4-78a5c7810f82 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:55.583934 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7c300e66-6f49-47bc-b9a4-78a5c7810f82 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:55.600984 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-7c300e66-6f49-47bc-b9a4-78a5c7810f82 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] HTTP exception thrown: Instance 999c16db-7916-4753-ae16-9ed72c8e6922 could not be found. Apr 16 21:21:55.602474 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7c300e66-6f49-47bc-b9a4-78a5c7810f82 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Returning 404 to user: Instance 999c16db-7916-4753-ae16-9ed72c8e6922 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:21:55.603908 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7c300e66-6f49-47bc-b9a4-78a5c7810f82 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922" status: 404 len: 111 microversion: 2.1 time: 0.040766 Apr 16 21:21:55.605055 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1918/3990] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:55 2022] GET /compute/v2.1/servers/999c16db-7916-4753-ae16-9ed72c8e6922 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:21:55.620751 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2ebef5e4-87a9-49d8-a816-3b06130549d7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:55.621827 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2ebef5e4-87a9-49d8-a816-3b06130549d7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:55.640486 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2ebef5e4-87a9-49d8-a816-3b06130549d7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:55.641249 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2ebef5e4-87a9-49d8-a816-3b06130549d7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:55.642303 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2ebef5e4-87a9-49d8-a816-3b06130549d7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:55.644073 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2ebef5e4-87a9-49d8-a816-3b06130549d7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:55.647327 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-58443c25-716d-4ca6-91bc-9ebbb522fc5e tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:55.658335 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-58443c25-716d-4ca6-91bc-9ebbb522fc5e tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142" status: 200 len: 1318 microversion: 2.1 time: 0.456314 Apr 16 21:21:55.660398 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2073/3991] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:55 2022] GET /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142 => generated 1318 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:55.709154 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2ebef5e4-87a9-49d8-a816-3b06130549d7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:21:55.811362 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-753cd181-58a8-47ed-b168-59a5db9c3f16 req-17eb43da-79fa-40d4-9316-85afb0e8aebc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bb444da-2bc4-4d5b-9e65-6739d1f4edf4", "tag": "8fc0e838-521f-4a5e-8f66-aa03b6fd079d"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:21:55.831904 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-753cd181-58a8-47ed-b168-59a5db9c3f16 req-17eb43da-79fa-40d4-9316-85afb0e8aebc service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:55.834907 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-753cd181-58a8-47ed-b168-59a5db9c3f16 req-17eb43da-79fa-40d4-9316-85afb0e8aebc service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:55.870418 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-753cd181-58a8-47ed-b168-59a5db9c3f16 req-17eb43da-79fa-40d4-9316-85afb0e8aebc service nova] Creating event network-changed:8fc0e838-521f-4a5e-8f66-aa03b6fd079d for instance 5bb444da-2bc4-4d5b-9e65-6739d1f4edf4 on nch1-master-1 Apr 16 21:21:55.884490 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-753cd181-58a8-47ed-b168-59a5db9c3f16 req-17eb43da-79fa-40d4-9316-85afb0e8aebc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076782 Apr 16 21:21:55.890412 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2074/3992] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:21:56.149829 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2ebef5e4-87a9-49d8-a816-3b06130549d7 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "DELETE /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 204 len: 0 microversion: 2.1 time: 0.540481 Apr 16 21:21:56.150790 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1919/3993] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:21:55 2022] DELETE /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 0 bytes in 542 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:21:56.160965 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f6b2fead-f81f-4a52-961a-5dd1d578fcad tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:56.162972 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f6b2fead-f81f-4a52-961a-5dd1d578fcad tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:56.171788 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6b2fead-f81f-4a52-961a-5dd1d578fcad tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:56.172653 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6b2fead-f81f-4a52-961a-5dd1d578fcad tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:56.173821 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6b2fead-f81f-4a52-961a-5dd1d578fcad tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:56.174547 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6b2fead-f81f-4a52-961a-5dd1d578fcad tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:56.501667 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f6b2fead-f81f-4a52-961a-5dd1d578fcad tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:56.510847 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f6b2fead-f81f-4a52-961a-5dd1d578fcad tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1676 microversion: 2.1 time: 0.354802 Apr 16 21:21:56.521848 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2075/3994] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:56 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1676 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:56.630676 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-eb71faf3-7103-49c2-a823-1d3d337a2cbd req-aff93f43-0071-4cc1-841a-26e87e6b1764 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d20fcd6-a9ae-4deb-a209-7bdfab320142", "name": "network-vif-plugged", "status": "completed", "tag": "1777c8d6-fb38-4c45-b87c-5afbdc93eca8"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:21:56.641530 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-eb71faf3-7103-49c2-a823-1d3d337a2cbd req-aff93f43-0071-4cc1-841a-26e87e6b1764 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:56.642370 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-eb71faf3-7103-49c2-a823-1d3d337a2cbd req-aff93f43-0071-4cc1-841a-26e87e6b1764 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:56.654840 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-eb71faf3-7103-49c2-a823-1d3d337a2cbd req-aff93f43-0071-4cc1-841a-26e87e6b1764 service nova] Creating event network-vif-plugged:1777c8d6-fb38-4c45-b87c-5afbdc93eca8 for instance 1d20fcd6-a9ae-4deb-a209-7bdfab320142 on nch2-master-1 Apr 16 21:21:56.660337 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-eb71faf3-7103-49c2-a823-1d3d337a2cbd req-aff93f43-0071-4cc1-841a-26e87e6b1764 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037793 Apr 16 21:21:56.661937 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1920/3995] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:21:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:21:56.676903 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-36df9fc9-a9b5-45b2-a665-df49c57cb19c tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:56.678843 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-36df9fc9-a9b5-45b2-a665-df49c57cb19c tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 1d20fcd6-a9ae-4deb-a209-7bdfab320142] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:56.687541 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-36df9fc9-a9b5-45b2-a665-df49c57cb19c tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:56.688453 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-36df9fc9-a9b5-45b2-a665-df49c57cb19c tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:56.691445 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-36df9fc9-a9b5-45b2-a665-df49c57cb19c tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:56.691445 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-36df9fc9-a9b5-45b2-a665-df49c57cb19c tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:56.955948 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-36df9fc9-a9b5-45b2-a665-df49c57cb19c tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:56.971455 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-36df9fc9-a9b5-45b2-a665-df49c57cb19c tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142" status: 200 len: 1318 microversion: 2.1 time: 0.299005 Apr 16 21:21:56.977270 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2076/3996] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:56 2022] GET /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142 => generated 1318 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:57.529989 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-04f23b0c-84f1-4970-87db-756f961bef7b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:57.530709 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-04f23b0c-84f1-4970-87db-756f961bef7b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:57.540785 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-04f23b0c-84f1-4970-87db-756f961bef7b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:57.541308 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-04f23b0c-84f1-4970-87db-756f961bef7b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:57.542114 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-04f23b0c-84f1-4970-87db-756f961bef7b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:57.542570 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-04f23b0c-84f1-4970-87db-756f961bef7b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:57.867706 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-04f23b0c-84f1-4970-87db-756f961bef7b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:57.872077 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-04f23b0c-84f1-4970-87db-756f961bef7b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1676 microversion: 2.1 time: 0.347062 Apr 16 21:21:57.879988 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1921/3997] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:57 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1676 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:57.990657 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5d1f7b84-d3bd-406b-8dd5-ed3f475536e3 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:57.991278 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5d1f7b84-d3bd-406b-8dd5-ed3f475536e3 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 1d20fcd6-a9ae-4deb-a209-7bdfab320142] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:58.000328 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5d1f7b84-d3bd-406b-8dd5-ed3f475536e3 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:58.000795 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5d1f7b84-d3bd-406b-8dd5-ed3f475536e3 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:58.002071 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5d1f7b84-d3bd-406b-8dd5-ed3f475536e3 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:58.002524 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5d1f7b84-d3bd-406b-8dd5-ed3f475536e3 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:58.364750 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5d1f7b84-d3bd-406b-8dd5-ed3f475536e3 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:58.384792 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5d1f7b84-d3bd-406b-8dd5-ed3f475536e3 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142" status: 200 len: 1318 microversion: 2.1 time: 0.389540 Apr 16 21:21:58.384792 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2077/3998] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:57 2022] GET /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142 => generated 1318 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:58.892761 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b614b8a0-9528-4d9d-acbf-fa5d9d03bccb tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:58.899479 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b614b8a0-9528-4d9d-acbf-fa5d9d03bccb tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:58.927420 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b614b8a0-9528-4d9d-acbf-fa5d9d03bccb tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:58.928307 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b614b8a0-9528-4d9d-acbf-fa5d9d03bccb tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:58.931527 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b614b8a0-9528-4d9d-acbf-fa5d9d03bccb tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:58.932704 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b614b8a0-9528-4d9d-acbf-fa5d9d03bccb tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:59.052533 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b614b8a0-9528-4d9d-acbf-fa5d9d03bccb tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:59.077232 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b614b8a0-9528-4d9d-acbf-fa5d9d03bccb tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1608 microversion: 2.1 time: 0.190895 Apr 16 21:21:59.078126 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1922/3999] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:58 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1608 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:59.092399 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-d54b3ba8-de33-4ae1-94a2-503db631345e req-47552179-fbc0-4f0f-af6c-4e03ba1db4ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98ca4f4e-246a-449b-b9fd-e1c17e119faa", "name": "network-vif-deleted", "tag": "9bc5b971-3aa6-49d0-8b96-ab0e7cb12588"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:21:59.111905 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-d54b3ba8-de33-4ae1-94a2-503db631345e req-47552179-fbc0-4f0f-af6c-4e03ba1db4ec service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:59.112535 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-d54b3ba8-de33-4ae1-94a2-503db631345e req-47552179-fbc0-4f0f-af6c-4e03ba1db4ec service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:59.130046 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-d54b3ba8-de33-4ae1-94a2-503db631345e req-47552179-fbc0-4f0f-af6c-4e03ba1db4ec service nova] Creating event network-vif-deleted:9bc5b971-3aa6-49d0-8b96-ab0e7cb12588 for instance 98ca4f4e-246a-449b-b9fd-e1c17e119faa on nch2-master-1 Apr 16 21:21:59.139491 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-d54b3ba8-de33-4ae1-94a2-503db631345e req-47552179-fbc0-4f0f-af6c-4e03ba1db4ec service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052901 Apr 16 21:21:59.141515 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2078/4000] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:21:59.394503 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-90dddb96-1f6f-4a73-9856-e7f7ec10f436 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:59.395318 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-90dddb96-1f6f-4a73-9856-e7f7ec10f436 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 1d20fcd6-a9ae-4deb-a209-7bdfab320142] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:59.406515 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-90dddb96-1f6f-4a73-9856-e7f7ec10f436 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:59.407331 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-90dddb96-1f6f-4a73-9856-e7f7ec10f436 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:59.413436 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-90dddb96-1f6f-4a73-9856-e7f7ec10f436 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:59.413436 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-90dddb96-1f6f-4a73-9856-e7f7ec10f436 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:59.621850 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-90dddb96-1f6f-4a73-9856-e7f7ec10f436 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:59.631917 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-90dddb96-1f6f-4a73-9856-e7f7ec10f436 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142" status: 200 len: 1508 microversion: 2.1 time: 0.242258 Apr 16 21:21:59.635164 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1923/4001] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:59 2022] GET /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142 => generated 1508 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:59.653347 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bcdb6117-1ed1-420d-b923-3cd121615bbb tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:21:59.654069 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-bcdb6117-1ed1-420d-b923-3cd121615bbb tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 1d20fcd6-a9ae-4deb-a209-7bdfab320142] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:59.662398 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bcdb6117-1ed1-420d-b923-3cd121615bbb tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:59.663165 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bcdb6117-1ed1-420d-b923-3cd121615bbb tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:59.664794 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bcdb6117-1ed1-420d-b923-3cd121615bbb tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:59.665467 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bcdb6117-1ed1-420d-b923-3cd121615bbb tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:59.903968 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-bcdb6117-1ed1-420d-b923-3cd121615bbb tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:21:59.919652 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-bcdb6117-1ed1-420d-b923-3cd121615bbb tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142" status: 200 len: 1508 microversion: 2.1 time: 0.271749 Apr 16 21:21:59.933055 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2079/4002] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:21:59 2022] GET /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142 => generated 1508 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:21:59.938971 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d0ed5d07-1b70-40c0-9b43-c1ad780ec242 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:21:59.941074 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d0ed5d07-1b70-40c0-9b43-c1ad780ec242 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 1d20fcd6-a9ae-4deb-a209-7bdfab320142] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:21:59.960281 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d0ed5d07-1b70-40c0-9b43-c1ad780ec242 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:59.960754 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d0ed5d07-1b70-40c0-9b43-c1ad780ec242 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:21:59.961586 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d0ed5d07-1b70-40c0-9b43-c1ad780ec242 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:21:59.962032 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d0ed5d07-1b70-40c0-9b43-c1ad780ec242 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:00.095309 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-eb3c17a7-b821-4116-a519-424a4e3b77e8 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:00.096625 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-eb3c17a7-b821-4116-a519-424a4e3b77e8 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:00.107186 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eb3c17a7-b821-4116-a519-424a4e3b77e8 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:00.108382 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eb3c17a7-b821-4116-a519-424a4e3b77e8 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:00.109955 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eb3c17a7-b821-4116-a519-424a4e3b77e8 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:00.110490 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eb3c17a7-b821-4116-a519-424a4e3b77e8 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:00.126554 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d0ed5d07-1b70-40c0-9b43-c1ad780ec242 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "PUT /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142" status: 200 len: 1080 microversion: 2.1 time: 0.192903 Apr 16 21:22:00.127555 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1924/4003] 10.222.0.20 () {60 vars in 1255 bytes} [Sat Apr 16 21:21:59 2022] PUT /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142 => generated 1080 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:22:00.142318 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-940ebeee-0521-4a18-b859-26b933c323d7 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:00.150209 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-940ebeee-0521-4a18-b859-26b933c323d7 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 1d20fcd6-a9ae-4deb-a209-7bdfab320142] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:00.158500 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-940ebeee-0521-4a18-b859-26b933c323d7 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:00.159569 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-940ebeee-0521-4a18-b859-26b933c323d7 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:00.160703 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-940ebeee-0521-4a18-b859-26b933c323d7 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:00.165669 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-940ebeee-0521-4a18-b859-26b933c323d7 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:00.186322 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eb3c17a7-b821-4116-a519-424a4e3b77e8 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:00.186782 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eb3c17a7-b821-4116-a519-424a4e3b77e8 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:00.190693 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-eb3c17a7-b821-4116-a519-424a4e3b77e8 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lazy-loading 'fault' on Instance uuid 98ca4f4e-246a-449b-b9fd-e1c17e119faa {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:22:00.382608 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-eb3c17a7-b821-4116-a519-424a4e3b77e8 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6bb1c0cdf6274f118ebbe97829ddad65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ceac90e6c7024b4ea350bfa95e1b5249', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:00.390460 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-eb3c17a7-b821-4116-a519-424a4e3b77e8 tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 200 len: 1329 microversion: 2.1 time: 0.299046 Apr 16 21:22:00.393552 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2080/4004] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:22:00 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 1329 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:22:00.977143 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f56cd4dc-c972-4363-bb1a-b1a589067d7b tempest-AbsoluteLimitsNegativeTestJSON-474647021 tempest-AbsoluteLimitsNegativeTestJSON-474647021-project] Calling method '.version_select at 0x7fbb959b5040>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:00.988102 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f56cd4dc-c972-4363-bb1a-b1a589067d7b tempest-AbsoluteLimitsNegativeTestJSON-474647021 tempest-AbsoluteLimitsNegativeTestJSON-474647021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:00.988941 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f56cd4dc-c972-4363-bb1a-b1a589067d7b tempest-AbsoluteLimitsNegativeTestJSON-474647021 tempest-AbsoluteLimitsNegativeTestJSON-474647021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:00.989923 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f56cd4dc-c972-4363-bb1a-b1a589067d7b tempest-AbsoluteLimitsNegativeTestJSON-474647021 tempest-AbsoluteLimitsNegativeTestJSON-474647021-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:00.990530 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f56cd4dc-c972-4363-bb1a-b1a589067d7b tempest-AbsoluteLimitsNegativeTestJSON-474647021 tempest-AbsoluteLimitsNegativeTestJSON-474647021-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:01.018157 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f56cd4dc-c972-4363-bb1a-b1a589067d7b tempest-AbsoluteLimitsNegativeTestJSON-474647021 tempest-AbsoluteLimitsNegativeTestJSON-474647021-project] 10.222.0.20 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.224504 Apr 16 21:22:01.019398 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2081/4005] 10.222.0.20 () {58 vars in 1121 bytes} [Sat Apr 16 21:22:00 2022] GET /compute/v2.1/limits => generated 511 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:22:01.121920 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-940ebeee-0521-4a18-b859-26b933c323d7 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:01.129735 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-940ebeee-0521-4a18-b859-26b933c323d7 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142" status: 200 len: 1506 microversion: 2.1 time: 0.991693 Apr 16 21:22:01.131659 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1925/4006] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:22:00 2022] GET /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142 => generated 1506 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:22:01.152869 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2ea84c1f-22ec-4465-87d9-945b944406fe tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:01.154475 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2ea84c1f-22ec-4465-87d9-945b944406fe tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 1d20fcd6-a9ae-4deb-a209-7bdfab320142] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:01.172667 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4910f334-89b6-4779-82c5-eca5231507a1 tempest-AbsoluteLimitsNegativeTestJSON-474647021 tempest-AbsoluteLimitsNegativeTestJSON-474647021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-511999527", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:22:01.182384 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2ea84c1f-22ec-4465-87d9-945b944406fe tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:01.182867 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2ea84c1f-22ec-4465-87d9-945b944406fe tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:01.183675 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2ea84c1f-22ec-4465-87d9-945b944406fe tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:01.184123 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2ea84c1f-22ec-4465-87d9-945b944406fe tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:01.245578 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-4910f334-89b6-4779-82c5-eca5231507a1 tempest-AbsoluteLimitsNegativeTestJSON-474647021 tempest-AbsoluteLimitsNegativeTestJSON-474647021-project] validate_networks() for None {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:22:01.457055 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2ea84c1f-22ec-4465-87d9-945b944406fe tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:01.465991 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2ea84c1f-22ec-4465-87d9-945b944406fe tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142" status: 200 len: 1506 microversion: 2.1 time: 0.320012 Apr 16 21:22:01.466861 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2082/4007] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:22:01 2022] GET /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142 => generated 1506 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:22:01.492643 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-67c8a78a-2da1-478b-9ccf-680188cb413f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:01.493581 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-67c8a78a-2da1-478b-9ccf-680188cb413f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] [instance: 98ca4f4e-246a-449b-b9fd-e1c17e119faa] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:01.524422 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-67c8a78a-2da1-478b-9ccf-680188cb413f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:01.531987 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-67c8a78a-2da1-478b-9ccf-680188cb413f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:01.533783 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-67c8a78a-2da1-478b-9ccf-680188cb413f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:01.534427 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-67c8a78a-2da1-478b-9ccf-680188cb413f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:01.556432 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-67c8a78a-2da1-478b-9ccf-680188cb413f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] HTTP exception thrown: Instance 98ca4f4e-246a-449b-b9fd-e1c17e119faa could not be found. Apr 16 21:22:01.557469 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-67c8a78a-2da1-478b-9ccf-680188cb413f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Returning 404 to user: Instance 98ca4f4e-246a-449b-b9fd-e1c17e119faa could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:22:01.564958 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-67c8a78a-2da1-478b-9ccf-680188cb413f tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa" status: 404 len: 111 microversion: 2.1 time: 0.096704 Apr 16 21:22:01.569473 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2083/4008] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:22:01 2022] GET /compute/v2.1/servers/98ca4f4e-246a-449b-b9fd-e1c17e119faa => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:22:01.576003 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d62b6a32-5596-4a22-bdec-ff2c3100e884 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:22:01.577991 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d62b6a32-5596-4a22-bdec-ff2c3100e884 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 1d20fcd6-a9ae-4deb-a209-7bdfab320142] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:01.588971 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d62b6a32-5596-4a22-bdec-ff2c3100e884 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:01.591599 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d62b6a32-5596-4a22-bdec-ff2c3100e884 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:01.592732 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d62b6a32-5596-4a22-bdec-ff2c3100e884 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:01.595665 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d62b6a32-5596-4a22-bdec-ff2c3100e884 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:01.701792 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-4910f334-89b6-4779-82c5-eca5231507a1 tempest-AbsoluteLimitsNegativeTestJSON-474647021 tempest-AbsoluteLimitsNegativeTestJSON-474647021-project] Getting quotas for project 38cfeb8335d2448cbf97475956646005. Resources: dict_keys(['metadata_items']) {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:22:01.709118 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-4910f334-89b6-4779-82c5-eca5231507a1 tempest-AbsoluteLimitsNegativeTestJSON-474647021 tempest-AbsoluteLimitsNegativeTestJSON-474647021-project] Getting quotas for user 6e3fe2880d45472486a05192dfb95d38 and project 38cfeb8335d2448cbf97475956646005. Resources: dict_keys(['metadata_items']) {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:22:01.723999 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-4910f334-89b6-4779-82c5-eca5231507a1 tempest-AbsoluteLimitsNegativeTestJSON-474647021 tempest-AbsoluteLimitsNegativeTestJSON-474647021-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Apr 16 21:22:01.724931 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4910f334-89b6-4779-82c5-eca5231507a1 tempest-AbsoluteLimitsNegativeTestJSON-474647021 tempest-AbsoluteLimitsNegativeTestJSON-474647021-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:22:01.728031 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4910f334-89b6-4779-82c5-eca5231507a1 tempest-AbsoluteLimitsNegativeTestJSON-474647021 tempest-AbsoluteLimitsNegativeTestJSON-474647021-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.560422 Apr 16 21:22:01.729723 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1926/4009] 10.222.0.20 () {60 vars in 1147 bytes} [Sat Apr 16 21:22:01 2022] POST /compute/v2.1/servers => generated 87 bytes in 563 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:22:01.743238 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7eac1a43-9aba-4a79-9b7d-115a7ea9b64b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] Calling method '.version_select at 0x7fbb9575bdc0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:01.784482 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d62b6a32-5596-4a22-bdec-ff2c3100e884 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "PUT /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142" status: 200 len: 1082 microversion: 2.1 time: 0.213650 Apr 16 21:22:01.785695 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2084/4010] 10.222.0.20 () {60 vars in 1255 bytes} [Sat Apr 16 21:22:01 2022] PUT /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142 => generated 1082 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:22:01.800564 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c4461f62-93e7-4068-8b37-2d70df479755 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:01.801191 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c4461f62-93e7-4068-8b37-2d70df479755 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 1d20fcd6-a9ae-4deb-a209-7bdfab320142] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:01.814260 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c4461f62-93e7-4068-8b37-2d70df479755 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:01.814754 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c4461f62-93e7-4068-8b37-2d70df479755 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:01.815821 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c4461f62-93e7-4068-8b37-2d70df479755 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:01.818228 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c4461f62-93e7-4068-8b37-2d70df479755 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:01.855999 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7eac1a43-9aba-4a79-9b7d-115a7ea9b64b tempest-ServerActionsTestJSON-829689780 tempest-ServerActionsTestJSON-829689780-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1466075469" status: 202 len: 0 microversion: 2.1 time: 0.123878 Apr 16 21:22:01.857187 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1927/4011] 10.222.0.20 () {58 vars in 1220 bytes} [Sat Apr 16 21:22:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1466075469 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:22:02.190052 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c4461f62-93e7-4068-8b37-2d70df479755 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:02.207444 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c4461f62-93e7-4068-8b37-2d70df479755 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142" status: 200 len: 1508 microversion: 2.1 time: 0.411119 Apr 16 21:22:02.223203 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2085/4012] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:22:01 2022] GET /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142 => generated 1508 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:22:02.235659 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d7963eb9-c90f-4e93-831a-b71ed7fbab66 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:02.237009 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d7963eb9-c90f-4e93-831a-b71ed7fbab66 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 1d20fcd6-a9ae-4deb-a209-7bdfab320142] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:02.252663 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d7963eb9-c90f-4e93-831a-b71ed7fbab66 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:02.253051 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d7963eb9-c90f-4e93-831a-b71ed7fbab66 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:02.255680 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d7963eb9-c90f-4e93-831a-b71ed7fbab66 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:02.256348 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d7963eb9-c90f-4e93-831a-b71ed7fbab66 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:02.539678 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d7963eb9-c90f-4e93-831a-b71ed7fbab66 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:02.549586 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d7963eb9-c90f-4e93-831a-b71ed7fbab66 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142" status: 200 len: 1508 microversion: 2.1 time: 0.325339 Apr 16 21:22:02.550854 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1928/4013] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:22:02 2022] GET /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142 => generated 1508 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:22:02.567362 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b668795b-7e94-4982-9c8d-a1075bfaa227 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:02.568130 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b668795b-7e94-4982-9c8d-a1075bfaa227 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 1d20fcd6-a9ae-4deb-a209-7bdfab320142] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:02.579434 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b668795b-7e94-4982-9c8d-a1075bfaa227 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:02.580262 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b668795b-7e94-4982-9c8d-a1075bfaa227 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:02.583408 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b668795b-7e94-4982-9c8d-a1075bfaa227 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:02.584432 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b668795b-7e94-4982-9c8d-a1075bfaa227 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:02.661355 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b668795b-7e94-4982-9c8d-a1075bfaa227 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 1d20fcd6-a9ae-4deb-a209-7bdfab320142] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:22:03.049630 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b668795b-7e94-4982-9c8d-a1075bfaa227 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142" status: 204 len: 0 microversion: 2.1 time: 0.486920 Apr 16 21:22:03.057169 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2086/4014] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:22:02 2022] DELETE /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:22:03.062810 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3ac66dd7-378c-4ab2-83a4-e3b09728ad2c tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:03.063737 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3ac66dd7-378c-4ab2-83a4-e3b09728ad2c tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 1d20fcd6-a9ae-4deb-a209-7bdfab320142] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:03.071118 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3ac66dd7-378c-4ab2-83a4-e3b09728ad2c tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:03.071876 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3ac66dd7-378c-4ab2-83a4-e3b09728ad2c tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:03.073027 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3ac66dd7-378c-4ab2-83a4-e3b09728ad2c tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:03.073846 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3ac66dd7-378c-4ab2-83a4-e3b09728ad2c tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:03.108401 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3ac66dd7-378c-4ab2-83a4-e3b09728ad2c tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 1d20fcd6-a9ae-4deb-a209-7bdfab320142] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:22:03.218519 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.compute.api [None req-3ac66dd7-378c-4ab2-83a4-e3b09728ad2c tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 1d20fcd6-a9ae-4deb-a209-7bdfab320142] Instance is already in deleting state, ignoring this request Apr 16 21:22:03.219426 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3ac66dd7-378c-4ab2-83a4-e3b09728ad2c tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142" status: 204 len: 0 microversion: 2.1 time: 0.161518 Apr 16 21:22:03.223060 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1929/4015] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:22:03 2022] DELETE /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:22:03.228888 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-df20caeb-c6e5-4335-aa00-60a8ba70826e tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:03.229590 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-df20caeb-c6e5-4335-aa00-60a8ba70826e tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 1d20fcd6-a9ae-4deb-a209-7bdfab320142] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:03.248270 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-df20caeb-c6e5-4335-aa00-60a8ba70826e tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:03.249090 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-df20caeb-c6e5-4335-aa00-60a8ba70826e tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:03.250763 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-df20caeb-c6e5-4335-aa00-60a8ba70826e tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:03.251379 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-df20caeb-c6e5-4335-aa00-60a8ba70826e tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:03.534836 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-df20caeb-c6e5-4335-aa00-60a8ba70826e tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:03.548154 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-df20caeb-c6e5-4335-aa00-60a8ba70826e tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142" status: 200 len: 1514 microversion: 2.1 time: 0.323440 Apr 16 21:22:03.551934 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2087/4016] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:22:03 2022] GET /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142 => generated 1514 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:22:04.569671 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a03a7a3a-7e16-4382-805d-fb4cb2cccab0 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:04.570848 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a03a7a3a-7e16-4382-805d-fb4cb2cccab0 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 1d20fcd6-a9ae-4deb-a209-7bdfab320142] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:04.580415 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a03a7a3a-7e16-4382-805d-fb4cb2cccab0 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:04.583302 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a03a7a3a-7e16-4382-805d-fb4cb2cccab0 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:04.586278 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a03a7a3a-7e16-4382-805d-fb4cb2cccab0 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:04.593602 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a03a7a3a-7e16-4382-805d-fb4cb2cccab0 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:05.024166 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a03a7a3a-7e16-4382-805d-fb4cb2cccab0 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:05.037537 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a03a7a3a-7e16-4382-805d-fb4cb2cccab0 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142" status: 200 len: 1514 microversion: 2.1 time: 0.471817 Apr 16 21:22:05.040299 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1930/4017] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:22:04 2022] GET /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142 => generated 1514 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:22:05.756814 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-21b4c8c8-aae5-46b1-a40a-1dc4bdee9ef1 req-ac1f50be-b31a-4840-b3b4-5151410ec830 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d20fcd6-a9ae-4deb-a209-7bdfab320142", "name": "network-vif-deleted", "tag": "1777c8d6-fb38-4c45-b87c-5afbdc93eca8"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:22:05.777552 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-21b4c8c8-aae5-46b1-a40a-1dc4bdee9ef1 req-ac1f50be-b31a-4840-b3b4-5151410ec830 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:05.778263 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-21b4c8c8-aae5-46b1-a40a-1dc4bdee9ef1 req-ac1f50be-b31a-4840-b3b4-5151410ec830 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:05.801763 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-21b4c8c8-aae5-46b1-a40a-1dc4bdee9ef1 req-ac1f50be-b31a-4840-b3b4-5151410ec830 service nova] Creating event network-vif-deleted:1777c8d6-fb38-4c45-b87c-5afbdc93eca8 for instance 1d20fcd6-a9ae-4deb-a209-7bdfab320142 on nch2-master-1 Apr 16 21:22:05.809079 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-21b4c8c8-aae5-46b1-a40a-1dc4bdee9ef1 req-ac1f50be-b31a-4840-b3b4-5151410ec830 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056087 Apr 16 21:22:05.810258 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2088/4018] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:22:06.056573 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-16777880-1557-44e0-bebd-a8bdf6ef7514 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:06.059561 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-16777880-1557-44e0-bebd-a8bdf6ef7514 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 1d20fcd6-a9ae-4deb-a209-7bdfab320142] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:06.074196 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-16777880-1557-44e0-bebd-a8bdf6ef7514 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:06.074784 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-16777880-1557-44e0-bebd-a8bdf6ef7514 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:06.075694 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-16777880-1557-44e0-bebd-a8bdf6ef7514 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:06.076509 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-16777880-1557-44e0-bebd-a8bdf6ef7514 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:06.199180 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-16777880-1557-44e0-bebd-a8bdf6ef7514 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aae8536e08dd4bfb88adc698e7a33d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14f08d6620b54fb597d356afc45617c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:06.208283 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-16777880-1557-44e0-bebd-a8bdf6ef7514 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142" status: 200 len: 1303 microversion: 2.1 time: 0.156301 Apr 16 21:22:06.216298 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1931/4019] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:22:06 2022] GET /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142 => generated 1303 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:22:07.232068 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-83000d13-6ebb-44d0-87dc-065f7f1460fe tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:07.232868 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-83000d13-6ebb-44d0-87dc-065f7f1460fe tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 1d20fcd6-a9ae-4deb-a209-7bdfab320142] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:07.249102 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-83000d13-6ebb-44d0-87dc-065f7f1460fe tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:07.249621 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-83000d13-6ebb-44d0-87dc-065f7f1460fe tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:07.250464 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-83000d13-6ebb-44d0-87dc-065f7f1460fe tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:07.250916 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-83000d13-6ebb-44d0-87dc-065f7f1460fe tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:07.282946 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-83000d13-6ebb-44d0-87dc-065f7f1460fe tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] HTTP exception thrown: Instance 1d20fcd6-a9ae-4deb-a209-7bdfab320142 could not be found. Apr 16 21:22:07.283574 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-83000d13-6ebb-44d0-87dc-065f7f1460fe tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Returning 404 to user: Instance 1d20fcd6-a9ae-4deb-a209-7bdfab320142 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:22:07.286849 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-83000d13-6ebb-44d0-87dc-065f7f1460fe tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142" status: 404 len: 111 microversion: 2.1 time: 0.059932 Apr 16 21:22:07.290450 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2089/4020] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:22:07 2022] GET /compute/v2.1/servers/1d20fcd6-a9ae-4deb-a209-7bdfab320142 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:22:07.298521 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-24bf632a-0773-4550-9bcd-45340fcedd76 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:07.299318 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-24bf632a-0773-4550-9bcd-45340fcedd76 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:07.310640 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-24bf632a-0773-4550-9bcd-45340fcedd76 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:07.314828 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-24bf632a-0773-4550-9bcd-45340fcedd76 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:07.316410 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-24bf632a-0773-4550-9bcd-45340fcedd76 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:07.318970 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-24bf632a-0773-4550-9bcd-45340fcedd76 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:07.369699 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-24bf632a-0773-4550-9bcd-45340fcedd76 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] HTTP exception thrown: Instance cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 could not be found. Apr 16 21:22:07.371226 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-24bf632a-0773-4550-9bcd-45340fcedd76 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Returning 404 to user: Instance cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:22:07.374342 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-24bf632a-0773-4550-9bcd-45340fcedd76 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7" status: 404 len: 111 microversion: 2.1 time: 0.080415 Apr 16 21:22:07.375579 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1932/4021] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:22:07 2022] DELETE /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:22:07.384299 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-612b8071-d5dc-47c2-befe-2f5106a57253 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:07.385517 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-612b8071-d5dc-47c2-befe-2f5106a57253 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:07.392667 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-612b8071-d5dc-47c2-befe-2f5106a57253 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:07.398384 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-612b8071-d5dc-47c2-befe-2f5106a57253 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:07.399807 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-612b8071-d5dc-47c2-befe-2f5106a57253 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:07.400469 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-612b8071-d5dc-47c2-befe-2f5106a57253 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:07.422440 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-612b8071-d5dc-47c2-befe-2f5106a57253 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] HTTP exception thrown: Instance cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 could not be found. Apr 16 21:22:07.423325 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-612b8071-d5dc-47c2-befe-2f5106a57253 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Returning 404 to user: Instance cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:22:07.424369 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-612b8071-d5dc-47c2-befe-2f5106a57253 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7" status: 404 len: 111 microversion: 2.1 time: 0.044423 Apr 16 21:22:07.425425 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2090/4022] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:22:07 2022] GET /compute/v2.1/servers/cbf0549e-dfce-4b7d-bf5d-8de201cfd8e7 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:22:07.434628 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-20563048-055e-4465-a44e-4c1114185423 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:07.435284 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-20563048-055e-4465-a44e-4c1114185423 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:07.444400 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-20563048-055e-4465-a44e-4c1114185423 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:07.447874 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-20563048-055e-4465-a44e-4c1114185423 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:07.447874 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-20563048-055e-4465-a44e-4c1114185423 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:07.447874 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-20563048-055e-4465-a44e-4c1114185423 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:07.462549 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-20563048-055e-4465-a44e-4c1114185423 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] HTTP exception thrown: Instance 6b0c963a-7042-4bca-9d87-6b90beed5f18 could not be found. Apr 16 21:22:07.463843 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-20563048-055e-4465-a44e-4c1114185423 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Returning 404 to user: Instance 6b0c963a-7042-4bca-9d87-6b90beed5f18 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:22:07.465068 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-20563048-055e-4465-a44e-4c1114185423 tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 404 len: 111 microversion: 2.1 time: 0.035600 Apr 16 21:22:07.469620 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1933/4023] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:22:07 2022] DELETE /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:22:07.482527 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e9bf9013-1083-4a10-838b-e655fb3754ef tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:07.482527 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e9bf9013-1083-4a10-838b-e655fb3754ef tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] [instance: 6b0c963a-7042-4bca-9d87-6b90beed5f18] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:07.490875 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e9bf9013-1083-4a10-838b-e655fb3754ef tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:07.492881 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e9bf9013-1083-4a10-838b-e655fb3754ef tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:07.494053 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e9bf9013-1083-4a10-838b-e655fb3754ef tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:07.494685 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e9bf9013-1083-4a10-838b-e655fb3754ef tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:07.513917 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-e9bf9013-1083-4a10-838b-e655fb3754ef tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] HTTP exception thrown: Instance 6b0c963a-7042-4bca-9d87-6b90beed5f18 could not be found. Apr 16 21:22:07.516761 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e9bf9013-1083-4a10-838b-e655fb3754ef tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] Returning 404 to user: Instance 6b0c963a-7042-4bca-9d87-6b90beed5f18 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:22:07.518548 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e9bf9013-1083-4a10-838b-e655fb3754ef tempest-ServerDiskConfigTestJSON-1627274718 tempest-ServerDiskConfigTestJSON-1627274718-project] 10.222.0.20 "GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18" status: 404 len: 111 microversion: 2.1 time: 0.044090 Apr 16 21:22:07.523892 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2091/4024] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:22:07 2022] GET /compute/v2.1/servers/6b0c963a-7042-4bca-9d87-6b90beed5f18 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:22:09.216260 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9876be70-9ab5-45f2-b874-84825c860f75 tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] Action: 'create', calling method: .version_select at 0x7fbb96275ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1033348483", "description": "tempest-description-1384029365"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:22:09.936691 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9876be70-9ab5-45f2-b874-84825c860f75 tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.182177 Apr 16 21:22:09.937712 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1934/4025] 10.222.0.20 () {60 vars in 1179 bytes} [Sat Apr 16 21:22:08 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:22:09.949285 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-92647ffd-d474-4bbc-ac1c-931335ed3591 tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] Action: 'create', calling method: .version_select at 0x7fbb957a9b80>, body: {"security_group_rule": {"parent_group_id": "26076c25-da42-43ba-a286-4b843eea08c4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:22:10.868895 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-92647ffd-d474-4bbc-ac1c-931335ed3591 tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.924206 Apr 16 21:22:10.869481 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2092/4026] 10.222.0.20 () {60 vars in 1194 bytes} [Sat Apr 16 21:22:09 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:22:10.888103 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-06b60377-3b8c-4e5b-8a22-0a0d79990774 tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] Action: 'create', calling method: .version_select at 0x7fbb962bd1f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1431274232", "description": "tempest-description-1359445984"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:22:11.818599 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-06b60377-3b8c-4e5b-8a22-0a0d79990774 tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.940702 Apr 16 21:22:11.819355 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1935/4027] 10.222.0.20 () {60 vars in 1179 bytes} [Sat Apr 16 21:22:10 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:22:11.830689 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b2d5f704-a796-47d5-8fe7-e0665df2e7bc tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] Action: 'create', calling method: .version_select at 0x7fbb9592caf0>, body: {"security_group_rule": {"parent_group_id": "b789662f-5c93-4baf-9a7c-7169e4d229e8", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:22:13.111886 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b2d5f704-a796-47d5-8fe7-e0665df2e7bc tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 1.285392 Apr 16 21:22:13.114119 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2093/4028] 10.222.0.20 () {60 vars in 1194 bytes} [Sat Apr 16 21:22:11 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:22:13.128105 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a2e14267-d0c9-42aa-a6f7-2702cd9ccb60 tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] Action: 'create', calling method: .version_select at 0x7fbb95759040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-28085944", "description": "tempest-description-266218334"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:22:13.305879 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-efd11152-232c-4511-a335-e1abbe704a7d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:22:13.307260 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-efd11152-232c-4511-a335-e1abbe704a7d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:13.335906 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-efd11152-232c-4511-a335-e1abbe704a7d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:13.336510 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-efd11152-232c-4511-a335-e1abbe704a7d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:13.339732 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-efd11152-232c-4511-a335-e1abbe704a7d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:13.343898 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-efd11152-232c-4511-a335-e1abbe704a7d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:13.440552 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-efd11152-232c-4511-a335-e1abbe704a7d tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "POST /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7/action" status: 200 len: 32478 microversion: 2.32 time: 0.149440 Apr 16 21:22:13.442392 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2094/4029] 10.222.0.20 () {62 vars in 1318 bytes} [Sat Apr 16 21:22:13 2022] POST /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7/action => generated 32478 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:22:13.454351 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4f386129-ef46-4d28-8047-7d089af441a4 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:13.456354 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4f386129-ef46-4d28-8047-7d089af441a4 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:13.464068 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4f386129-ef46-4d28-8047-7d089af441a4 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:13.464801 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4f386129-ef46-4d28-8047-7d089af441a4 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:13.465789 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4f386129-ef46-4d28-8047-7d089af441a4 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:13.466942 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4f386129-ef46-4d28-8047-7d089af441a4 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:13.540770 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4f386129-ef46-4d28-8047-7d089af441a4 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:22:13.828982 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a2e14267-d0c9-42aa-a6f7-2702cd9ccb60 tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 0.706927 Apr 16 21:22:13.829795 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1936/4030] 10.222.0.20 () {60 vars in 1179 bytes} [Sat Apr 16 21:22:13 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:22:13.842825 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b04703cf-3b0c-4cbb-ae89-2799dcc4931f tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] Action: 'create', calling method: .version_select at 0x7fbb95760820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1516184880", "description": "tempest-description-1642395361"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:22:13.955980 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4f386129-ef46-4d28-8047-7d089af441a4 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 204 len: 0 microversion: 2.32 time: 0.507169 Apr 16 21:22:13.957422 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2095/4031] 10.222.0.20 () {60 vars in 1279 bytes} [Sat Apr 16 21:22:13 2022] DELETE /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 16 21:22:13.967865 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c70f5dea-6090-4c9a-9a22-c9a88cca3061 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:13.968618 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c70f5dea-6090-4c9a-9a22-c9a88cca3061 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:13.977404 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c70f5dea-6090-4c9a-9a22-c9a88cca3061 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:13.977868 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c70f5dea-6090-4c9a-9a22-c9a88cca3061 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:13.978667 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c70f5dea-6090-4c9a-9a22-c9a88cca3061 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:13.979112 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c70f5dea-6090-4c9a-9a22-c9a88cca3061 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:14.388419 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c70f5dea-6090-4c9a-9a22-c9a88cca3061 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:14.399577 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c70f5dea-6090-4c9a-9a22-c9a88cca3061 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:14.405444 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c70f5dea-6090-4c9a-9a22-c9a88cca3061 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:14.409348 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c70f5dea-6090-4c9a-9a22-c9a88cca3061 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 2946 microversion: 2.32 time: 0.446674 Apr 16 21:22:14.411804 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2096/4032] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:22:13 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 2946 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:22:14.508883 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b04703cf-3b0c-4cbb-ae89-2799dcc4931f tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.669850 Apr 16 21:22:14.510048 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1937/4033] 10.222.0.20 () {60 vars in 1179 bytes} [Sat Apr 16 21:22:13 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:22:14.521285 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f8613caa-1227-447f-8328-318c1a7debad tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] Action: 'create', calling method: .version_select at 0x7fbb9592c790>, body: {"security_group_rule": {"parent_group_id": "9f19fb15-c024-4e40-b9b0-e28d6b5f67aa", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "5e72bf24-612a-42c9-9634-4c0fbe4cd2a3"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:22:15.393551 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-25a8d2c3-7a17-4f5c-bed9-5cd8506786af tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-526025173", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "e3c0f8de-8e3f-4dcc-a30e-7bff8a86b568"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:22:15.486955 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-25a8d2c3-7a17-4f5c-bed9-5cd8506786af tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] validate_networks() for [('e3c0f8de-8e3f-4dcc-a30e-7bff8a86b568', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:22:15.860877 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f8613caa-1227-447f-8328-318c1a7debad tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.343635 Apr 16 21:22:15.861427 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2097/4034] 10.222.0.20 () {60 vars in 1194 bytes} [Sat Apr 16 21:22:14 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:22:15.871768 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d2d85392-4d62-45b8-9f76-0bf1e076b904 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:15.871768 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d2d85392-4d62-45b8-9f76-0bf1e076b904 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:15.886227 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d2d85392-4d62-45b8-9f76-0bf1e076b904 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:15.886688 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d2d85392-4d62-45b8-9f76-0bf1e076b904 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:15.887491 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d2d85392-4d62-45b8-9f76-0bf1e076b904 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:15.887937 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d2d85392-4d62-45b8-9f76-0bf1e076b904 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:16.291579 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d2d85392-4d62-45b8-9f76-0bf1e076b904 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:16.307638 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d2d85392-4d62-45b8-9f76-0bf1e076b904 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:16.309604 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d2d85392-4d62-45b8-9f76-0bf1e076b904 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:16.311214 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d2d85392-4d62-45b8-9f76-0bf1e076b904 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 2946 microversion: 2.32 time: 0.448833 Apr 16 21:22:16.312655 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2098/4035] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:22:15 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 2946 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:22:16.332831 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c188e96b-58ae-40b3-a8ac-31ddfa67ba38 tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] Action: 'create', calling method: .version_select at 0x7fbba001d8b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1725370440", "description": "tempest-description-702665887"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:22:16.942121 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c188e96b-58ae-40b3-a8ac-31ddfa67ba38 tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.628149 Apr 16 21:22:16.942732 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2099/4036] 10.222.0.20 () {60 vars in 1179 bytes} [Sat Apr 16 21:22:16 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:22:16.954172 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9efd8733-101a-4061-8726-d1aa574190ff tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] Action: 'create', calling method: .version_select at 0x7fbb95749280>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1625118632", "description": "tempest-description-2033291708"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:22:16.989376 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-25a8d2c3-7a17-4f5c-bed9-5cd8506786af tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:22:16.991239 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-25a8d2c3-7a17-4f5c-bed9-5cd8506786af tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:22:16.992316 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-25a8d2c3-7a17-4f5c-bed9-5cd8506786af tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:22:16.992780 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-25a8d2c3-7a17-4f5c-bed9-5cd8506786af tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:22:16.995059 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-25a8d2c3-7a17-4f5c-bed9-5cd8506786af tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:22:17.057745 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-25a8d2c3-7a17-4f5c-bed9-5cd8506786af tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:17.058291 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-25a8d2c3-7a17-4f5c-bed9-5cd8506786af tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:17.059237 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-25a8d2c3-7a17-4f5c-bed9-5cd8506786af tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:17.059698 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-25a8d2c3-7a17-4f5c-bed9-5cd8506786af tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:17.145966 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-25a8d2c3-7a17-4f5c-bed9-5cd8506786af tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Getting quotas for project 138f1e73cc64451395e6c21d31f3615b. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:22:17.176839 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-25a8d2c3-7a17-4f5c-bed9-5cd8506786af tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Getting quotas for user a3f82207271649bca28448b01b65d59f and project 138f1e73cc64451395e6c21d31f3615b. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:22:17.212963 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-25a8d2c3-7a17-4f5c-bed9-5cd8506786af tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:22:17.224468 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-25a8d2c3-7a17-4f5c-bed9-5cd8506786af tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] [instance: 0246e469-bac2-4e9f-bd3f-bd5e1e60618f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:22:17.415512 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-25a8d2c3-7a17-4f5c-bed9-5cd8506786af tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.270936 Apr 16 21:22:17.420032 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1938/4037] 10.222.0.20 () {62 vars in 1187 bytes} [Sat Apr 16 21:22:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2276 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Apr 16 21:22:17.429392 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3e42a5fa-fdcb-40f2-a70c-0c897462a985 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:17.444986 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3e42a5fa-fdcb-40f2-a70c-0c897462a985 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:17.454666 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e42a5fa-fdcb-40f2-a70c-0c897462a985 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:17.455803 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e42a5fa-fdcb-40f2-a70c-0c897462a985 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:17.457011 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e42a5fa-fdcb-40f2-a70c-0c897462a985 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:17.457986 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e42a5fa-fdcb-40f2-a70c-0c897462a985 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:18.030875 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9efd8733-101a-4061-8726-d1aa574190ff tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.080580 Apr 16 21:22:18.033068 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2100/4038] 10.222.0.20 () {60 vars in 1179 bytes} [Sat Apr 16 21:22:16 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:22:18.040139 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-70fa05dd-460f-4cca-ad0b-bb2c67ebb0fa tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:18.040805 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-70fa05dd-460f-4cca-ad0b-bb2c67ebb0fa tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] [instance: 0246e469-bac2-4e9f-bd3f-bd5e1e60618f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:18.078638 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3e42a5fa-fdcb-40f2-a70c-0c897462a985 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:18.088233 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3e42a5fa-fdcb-40f2-a70c-0c897462a985 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:18.089960 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3e42a5fa-fdcb-40f2-a70c-0c897462a985 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:18.091344 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3e42a5fa-fdcb-40f2-a70c-0c897462a985 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 2925 microversion: 2.32 time: 0.669938 Apr 16 21:22:18.091915 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1939/4039] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:22:17 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 2925 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:22:18.103842 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d3ddb9c2-26f6-4681-bf15-b058dbc1dc3f tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] Action: 'create', calling method: .version_select at 0x7fbb96275700>, body: {"security_group_rule": {"parent_group_id": "2609ebb3-4f67-48ae-a88a-3254a0b5eabd", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "5077c1ab-c69e-4e96-abaa-b94600a6bf34"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:22:18.208665 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-70fa05dd-460f-4cca-ad0b-bb2c67ebb0fa tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:18.216359 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-70fa05dd-460f-4cca-ad0b-bb2c67ebb0fa tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:18.217946 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-70fa05dd-460f-4cca-ad0b-bb2c67ebb0fa tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:18.236908 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-70fa05dd-460f-4cca-ad0b-bb2c67ebb0fa tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] 10.222.0.20 "GET /compute/v2.1/servers/0246e469-bac2-4e9f-bd3f-bd5e1e60618f" status: 200 len: 1258 microversion: 2.21 time: 0.183961 Apr 16 21:22:18.237654 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2101/4040] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:22:18 2022] GET /compute/v2.1/servers/0246e469-bac2-4e9f-bd3f-bd5e1e60618f => generated 1258 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:22:19.112005 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d3ddb9c2-26f6-4681-bf15-b058dbc1dc3f tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 1.014524 Apr 16 21:22:19.113636 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1940/4041] 10.222.0.20 () {60 vars in 1194 bytes} [Sat Apr 16 21:22:18 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:22:19.120228 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-e522519b-bd16-40b8-85d6-d4a2d8fc3781 req-00b4e344-090b-4ad7-b009-7ff53087ea3c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf669403-03eb-40c7-9a11-3d0422f708c7", "name": "network-vif-unplugged", "status": "completed", "tag": "89946b61-fbf7-4964-8abf-1d6403aac9ec"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:22:19.147190 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-26f7c132-6934-4abb-a146-a59957b30449 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Action: 'create', calling method: .version_select at 0x7fbb9ff7a280>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1154427883", "policies": ["affinity"]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:22:19.168903 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-e522519b-bd16-40b8-85d6-d4a2d8fc3781 req-00b4e344-090b-4ad7-b009-7ff53087ea3c service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:19.169367 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-e522519b-bd16-40b8-85d6-d4a2d8fc3781 req-00b4e344-090b-4ad7-b009-7ff53087ea3c service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:19.171812 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-26f7c132-6934-4abb-a146-a59957b30449 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Getting quotas for project 4030f0824ca84b97a7fef26a7384e775. Resources: {'server_groups'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:22:19.178849 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-26f7c132-6934-4abb-a146-a59957b30449 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Getting quotas for user 31ce0f9acbb14b538d7c10e56a9c7d98 and project 4030f0824ca84b97a7fef26a7384e775. Resources: {'server_groups'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:22:19.205189 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-e522519b-bd16-40b8-85d6-d4a2d8fc3781 req-00b4e344-090b-4ad7-b009-7ff53087ea3c service nova] Creating event network-vif-unplugged:89946b61-fbf7-4964-8abf-1d6403aac9ec for instance cf669403-03eb-40c7-9a11-3d0422f708c7 on nch2-master-1 Apr 16 21:22:19.222605 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-e522519b-bd16-40b8-85d6-d4a2d8fc3781 req-00b4e344-090b-4ad7-b009-7ff53087ea3c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107948 Apr 16 21:22:19.223237 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1941/4042] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:22:19.239285 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-18cd1d29-df57-4cf4-bef4-679cc56c6c8e tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:19.240005 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-18cd1d29-df57-4cf4-bef4-679cc56c6c8e tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:19.260607 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-18cd1d29-df57-4cf4-bef4-679cc56c6c8e tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:19.261321 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-18cd1d29-df57-4cf4-bef4-679cc56c6c8e tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:19.265194 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-18cd1d29-df57-4cf4-bef4-679cc56c6c8e tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:19.265841 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-18cd1d29-df57-4cf4-bef4-679cc56c6c8e tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:19.348800 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-26f7c132-6934-4abb-a146-a59957b30449 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Getting quotas for project 4030f0824ca84b97a7fef26a7384e775. Resources: {'server_groups'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:22:19.354419 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-26f7c132-6934-4abb-a146-a59957b30449 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Getting quotas for user 31ce0f9acbb14b538d7c10e56a9c7d98 and project 4030f0824ca84b97a7fef26a7384e775. Resources: {'server_groups'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:22:19.372038 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-26f7c132-6934-4abb-a146-a59957b30449 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.606490 Apr 16 21:22:19.378794 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2102/4043] 10.222.0.20 () {60 vars in 1173 bytes} [Sat Apr 16 21:22:18 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:22:19.401436 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f54c8019-a314-4066-aeeb-2bfea3e7e19b tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] Calling method '.version_select at 0x7fbb9592cc10>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:19.565961 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-18cd1d29-df57-4cf4-bef4-679cc56c6c8e tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:19.578465 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-18cd1d29-df57-4cf4-bef4-679cc56c6c8e tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:19.580817 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-18cd1d29-df57-4cf4-bef4-679cc56c6c8e tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:19.592952 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-18cd1d29-df57-4cf4-bef4-679cc56c6c8e tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 2859 microversion: 2.32 time: 0.357970 Apr 16 21:22:19.594140 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1942/4044] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:22:19 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 2859 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:22:19.603018 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-3447cb45-f5a4-4e01-8aa0-86c08087d987 req-2c881daa-86e9-4fee-b6cc-a112f9771239 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf669403-03eb-40c7-9a11-3d0422f708c7", "name": "network-vif-deleted", "tag": "c6438618-4e2e-4e98-a08e-fdf410282f72"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:22:19.617775 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-3447cb45-f5a4-4e01-8aa0-86c08087d987 req-2c881daa-86e9-4fee-b6cc-a112f9771239 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:19.618520 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-3447cb45-f5a4-4e01-8aa0-86c08087d987 req-2c881daa-86e9-4fee-b6cc-a112f9771239 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:19.660111 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-3447cb45-f5a4-4e01-8aa0-86c08087d987 req-2c881daa-86e9-4fee-b6cc-a112f9771239 service nova] Creating event network-vif-deleted:c6438618-4e2e-4e98-a08e-fdf410282f72 for instance cf669403-03eb-40c7-9a11-3d0422f708c7 on nch2-master-1 Apr 16 21:22:19.686773 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-3447cb45-f5a4-4e01-8aa0-86c08087d987 req-2c881daa-86e9-4fee-b6cc-a112f9771239 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082817 Apr 16 21:22:19.690691 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1943/4045] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:22:19.705831 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-53453f0c-e914-4f7e-b8da-1d89687f35b7 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:19.709285 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-53453f0c-e914-4f7e-b8da-1d89687f35b7 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] [instance: 0246e469-bac2-4e9f-bd3f-bd5e1e60618f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:19.723970 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-53453f0c-e914-4f7e-b8da-1d89687f35b7 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:19.724512 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-53453f0c-e914-4f7e-b8da-1d89687f35b7 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:19.726720 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-53453f0c-e914-4f7e-b8da-1d89687f35b7 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:19.727786 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-53453f0c-e914-4f7e-b8da-1d89687f35b7 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:19.894911 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-53453f0c-e914-4f7e-b8da-1d89687f35b7 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:19.910291 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-53453f0c-e914-4f7e-b8da-1d89687f35b7 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:19.910291 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-53453f0c-e914-4f7e-b8da-1d89687f35b7 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:19.910291 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-53453f0c-e914-4f7e-b8da-1d89687f35b7 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] 10.222.0.20 "GET /compute/v2.1/servers/0246e469-bac2-4e9f-bd3f-bd5e1e60618f" status: 200 len: 1310 microversion: 2.21 time: 0.215797 Apr 16 21:22:19.910748 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1944/4046] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:22:19 2022] GET /compute/v2.1/servers/0246e469-bac2-4e9f-bd3f-bd5e1e60618f => generated 1310 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:22:19.926755 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e60eea52-520d-4b2c-a733-423d6bed79bc tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Action: 'create', calling method: .version_select at 0x7fbb95758280>, body: {"server_group": {"name": "tempest-server-group-776337047", "policies": ["affinity"]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:22:19.944442 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-e60eea52-520d-4b2c-a733-423d6bed79bc tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Getting quotas for project 4030f0824ca84b97a7fef26a7384e775. Resources: {'server_groups'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:22:19.950469 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-e60eea52-520d-4b2c-a733-423d6bed79bc tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Getting quotas for user 31ce0f9acbb14b538d7c10e56a9c7d98 and project 4030f0824ca84b97a7fef26a7384e775. Resources: {'server_groups'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:22:20.068565 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-e60eea52-520d-4b2c-a733-423d6bed79bc tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Getting quotas for project 4030f0824ca84b97a7fef26a7384e775. Resources: {'server_groups'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:22:20.083772 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-e60eea52-520d-4b2c-a733-423d6bed79bc tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Getting quotas for user 31ce0f9acbb14b538d7c10e56a9c7d98 and project 4030f0824ca84b97a7fef26a7384e775. Resources: {'server_groups'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:22:20.087092 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f54c8019-a314-4066-aeeb-2bfea3e7e19b tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/5077c1ab-c69e-4e96-abaa-b94600a6bf34" status: 202 len: 0 microversion: 2.1 time: 0.696993 Apr 16 21:22:20.090685 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2103/4047] 10.222.0.20 () {58 vars in 1271 bytes} [Sat Apr 16 21:22:19 2022] DELETE /compute/v2.1/os-security-groups/5077c1ab-c69e-4e96-abaa-b94600a6bf34 => generated 0 bytes in 699 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:22:20.096651 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-58dade28-df24-4dab-8573-a68b0ea9d5b4 tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] Calling method '.version_select at 0x7fbb957b41f0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:20.121446 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e60eea52-520d-4b2c-a733-423d6bed79bc tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.200042 Apr 16 21:22:20.124657 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1945/4048] 10.222.0.20 () {60 vars in 1172 bytes} [Sat Apr 16 21:22:19 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:22:20.142716 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-00d1245a-af15-414f-8151-d0c1d3dfa29e tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Action: 'create', calling method: .version_select at 0x7fbb95758dc0>, body: {"server_group": {"name": "tempest-server-group-776337047", "policies": ["affinity"]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:22:20.190046 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-00d1245a-af15-414f-8151-d0c1d3dfa29e tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Getting quotas for project 4030f0824ca84b97a7fef26a7384e775. Resources: {'server_groups'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:22:20.203389 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-00d1245a-af15-414f-8151-d0c1d3dfa29e tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Getting quotas for user 31ce0f9acbb14b538d7c10e56a9c7d98 and project 4030f0824ca84b97a7fef26a7384e775. Resources: {'server_groups'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:22:20.250407 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-58dade28-df24-4dab-8573-a68b0ea9d5b4 tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/2609ebb3-4f67-48ae-a88a-3254a0b5eabd" status: 200 len: 247 microversion: 2.1 time: 0.157587 Apr 16 21:22:20.252162 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2104/4049] 10.222.0.20 () {58 vars in 1268 bytes} [Sat Apr 16 21:22:20 2022] GET /compute/v2.1/os-security-groups/2609ebb3-4f67-48ae-a88a-3254a0b5eabd => generated 247 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:22:20.275789 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c569b29b-a561-49ac-ae7c-71977db63c39 tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] Action: 'create', calling method: .version_select at 0x7fbb95761e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-761705519", "description": "tempest-description-1587519547"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:22:20.324815 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-00d1245a-af15-414f-8151-d0c1d3dfa29e tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Getting quotas for project 4030f0824ca84b97a7fef26a7384e775. Resources: {'server_groups'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:22:20.338197 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-00d1245a-af15-414f-8151-d0c1d3dfa29e tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Getting quotas for user 31ce0f9acbb14b538d7c10e56a9c7d98 and project 4030f0824ca84b97a7fef26a7384e775. Resources: {'server_groups'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:22:20.379601 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-00d1245a-af15-414f-8151-d0c1d3dfa29e tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.249428 Apr 16 21:22:20.380563 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1946/4050] 10.222.0.20 () {60 vars in 1172 bytes} [Sat Apr 16 21:22:20 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:22:20.424386 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d760440e-0d3a-4d37-bb95-5778cee5a2a6 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:20.583538 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d760440e-0d3a-4d37-bb95-5778cee5a2a6 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/45321737-bd1e-4548-90cb-83494ef5b6c2" status: 204 len: 0 microversion: 2.1 time: 0.196407 Apr 16 21:22:20.584122 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1947/4051] 10.222.0.20 () {58 vars in 1265 bytes} [Sat Apr 16 21:22:20 2022] DELETE /compute/v2.1/os-server-groups/45321737-bd1e-4548-90cb-83494ef5b6c2 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:22:20.593072 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-eef1ab14-1a6f-4e08-8e06-54cbbd3f10df tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:20.619705 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-eef1ab14-1a6f-4e08-8e06-54cbbd3f10df tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.030493 Apr 16 21:22:20.621321 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1948/4052] 10.222.0.20 () {58 vars in 1151 bytes} [Sat Apr 16 21:22:20 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:22:20.633508 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3e99fbc7-e537-410e-82c2-43b4e3fa74b0 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:20.635192 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3e99fbc7-e537-410e-82c2-43b4e3fa74b0 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:20.647719 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e99fbc7-e537-410e-82c2-43b4e3fa74b0 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:20.648756 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e99fbc7-e537-410e-82c2-43b4e3fa74b0 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:20.649564 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e99fbc7-e537-410e-82c2-43b4e3fa74b0 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:20.656221 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e99fbc7-e537-410e-82c2-43b4e3fa74b0 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:21.074887 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3e99fbc7-e537-410e-82c2-43b4e3fa74b0 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:21.089667 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3e99fbc7-e537-410e-82c2-43b4e3fa74b0 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:21.092193 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3e99fbc7-e537-410e-82c2-43b4e3fa74b0 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:21.093745 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3e99fbc7-e537-410e-82c2-43b4e3fa74b0 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 2700 microversion: 2.32 time: 0.470978 Apr 16 21:22:21.104876 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1949/4053] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:22:20 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 2700 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:22:21.111772 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c2943a57-226f-48ee-8787-5328b9dffce4 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:21.112016 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c569b29b-a561-49ac-ae7c-71977db63c39 tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.850393 Apr 16 21:22:21.120056 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2105/4054] 10.222.0.20 () {60 vars in 1179 bytes} [Sat Apr 16 21:22:20 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:22:21.135484 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7ef1ce10-e861-49ea-adf4-d88014a34434 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:21.136564 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7ef1ce10-e861-49ea-adf4-d88014a34434 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] [instance: 0246e469-bac2-4e9f-bd3f-bd5e1e60618f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:21.167572 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ef1ce10-e861-49ea-adf4-d88014a34434 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:21.183458 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ef1ce10-e861-49ea-adf4-d88014a34434 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:21.183458 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ef1ce10-e861-49ea-adf4-d88014a34434 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:21.183458 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ef1ce10-e861-49ea-adf4-d88014a34434 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:21.277164 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c2943a57-226f-48ee-8787-5328b9dffce4 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/5ed8e799-9770-4c0a-af19-ece9c0783a2a" status: 204 len: 0 microversion: 2.1 time: 0.174959 Apr 16 21:22:21.278211 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1950/4055] 10.222.0.20 () {58 vars in 1265 bytes} [Sat Apr 16 21:22:21 2022] DELETE /compute/v2.1/os-server-groups/5ed8e799-9770-4c0a-af19-ece9c0783a2a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:22:21.287023 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3e4dfd2e-f3ca-4edd-bf24-fdf2624e93fa tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] Action: 'create', calling method: .version_select at 0x7fbb95758c10>, body: {"security_group_rule": {"parent_group_id": "d039c2aa-9fac-40b3-a04d-62d0d344f07a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:22:21.350713 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7ef1ce10-e861-49ea-adf4-d88014a34434 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:21.364152 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7ef1ce10-e861-49ea-adf4-d88014a34434 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:21.372056 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7ef1ce10-e861-49ea-adf4-d88014a34434 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:21.374364 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7ef1ce10-e861-49ea-adf4-d88014a34434 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] 10.222.0.20 "GET /compute/v2.1/servers/0246e469-bac2-4e9f-bd3f-bd5e1e60618f" status: 200 len: 1316 microversion: 2.21 time: 0.252686 Apr 16 21:22:21.378879 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2106/4056] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:22:21 2022] GET /compute/v2.1/servers/0246e469-bac2-4e9f-bd3f-bd5e1e60618f => generated 1316 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:22:21.387795 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-3595385d-1785-461f-86f6-84d47976589f req-894e1dcf-fd34-4a06-aa7a-645d8a6ef325 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf669403-03eb-40c7-9a11-3d0422f708c7", "name": "network-vif-unplugged", "status": "completed", "tag": "90479900-4d72-46a0-92ee-feff9e50d619"}, {"server_uuid": "cf669403-03eb-40c7-9a11-3d0422f708c7", "name": "network-vif-unplugged", "status": "completed", "tag": "289d892c-efd8-4a45-8065-39c93c83ca97"}, {"server_uuid": "cf669403-03eb-40c7-9a11-3d0422f708c7", "name": "network-vif-unplugged", "status": "completed", "tag": "3e5cf556-52a6-4c25-b89c-a2b9dc0b4a62"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:22:21.420212 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-3595385d-1785-461f-86f6-84d47976589f req-894e1dcf-fd34-4a06-aa7a-645d8a6ef325 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:21.422622 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-3595385d-1785-461f-86f6-84d47976589f req-894e1dcf-fd34-4a06-aa7a-645d8a6ef325 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:21.450204 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-3595385d-1785-461f-86f6-84d47976589f req-894e1dcf-fd34-4a06-aa7a-645d8a6ef325 service nova] Creating event network-vif-unplugged:90479900-4d72-46a0-92ee-feff9e50d619 for instance cf669403-03eb-40c7-9a11-3d0422f708c7 on nch2-master-1 Apr 16 21:22:21.450730 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-3595385d-1785-461f-86f6-84d47976589f req-894e1dcf-fd34-4a06-aa7a-645d8a6ef325 service nova] Creating event network-vif-unplugged:289d892c-efd8-4a45-8065-39c93c83ca97 for instance cf669403-03eb-40c7-9a11-3d0422f708c7 on nch2-master-1 Apr 16 21:22:21.451880 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-3595385d-1785-461f-86f6-84d47976589f req-894e1dcf-fd34-4a06-aa7a-645d8a6ef325 service nova] Creating event network-vif-unplugged:3e5cf556-52a6-4c25-b89c-a2b9dc0b4a62 for instance cf669403-03eb-40c7-9a11-3d0422f708c7 on nch2-master-1 Apr 16 21:22:21.471628 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-3595385d-1785-461f-86f6-84d47976589f req-894e1dcf-fd34-4a06-aa7a-645d8a6ef325 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 531 microversion: 2.1 time: 0.091499 Apr 16 21:22:21.473467 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2107/4057] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 531 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:22:21.480092 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-29928b56-7030-4da4-87b0-0fba4d7a3bed tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:21.501160 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-29928b56-7030-4da4-87b0-0fba4d7a3bed tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.026280 Apr 16 21:22:21.502196 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2108/4058] 10.222.0.20 () {58 vars in 1151 bytes} [Sat Apr 16 21:22:21 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:22:21.522629 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-78bc6d19-7eaa-40fa-940d-e89cd44c68c1 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Action: 'create', calling method: .version_select at 0x7fbb95749f70>, body: {"server_group": {"name": "tempest-server-group-1785556997", "policies": ["affinity"]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:22:21.585438 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-78bc6d19-7eaa-40fa-940d-e89cd44c68c1 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Getting quotas for project 4030f0824ca84b97a7fef26a7384e775. Resources: {'server_groups'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:22:21.599584 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-78bc6d19-7eaa-40fa-940d-e89cd44c68c1 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Getting quotas for user 31ce0f9acbb14b538d7c10e56a9c7d98 and project 4030f0824ca84b97a7fef26a7384e775. Resources: {'server_groups'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:22:21.766390 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-78bc6d19-7eaa-40fa-940d-e89cd44c68c1 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Getting quotas for project 4030f0824ca84b97a7fef26a7384e775. Resources: {'server_groups'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:22:21.780945 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-78bc6d19-7eaa-40fa-940d-e89cd44c68c1 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Getting quotas for user 31ce0f9acbb14b538d7c10e56a9c7d98 and project 4030f0824ca84b97a7fef26a7384e775. Resources: {'server_groups'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:22:21.812525 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-78bc6d19-7eaa-40fa-940d-e89cd44c68c1 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.300825 Apr 16 21:22:21.818541 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2109/4059] 10.222.0.20 () {60 vars in 1172 bytes} [Sat Apr 16 21:22:21 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:22:21.829831 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-07b1d889-3dea-4ea7-b06e-290c890829e8 req-67408b36-403e-4042-8656-21151a4d6f0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf669403-03eb-40c7-9a11-3d0422f708c7", "name": "network-vif-deleted", "tag": "90479900-4d72-46a0-92ee-feff9e50d619"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:22:21.847376 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-07b1d889-3dea-4ea7-b06e-290c890829e8 req-67408b36-403e-4042-8656-21151a4d6f0b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:21.853005 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-07b1d889-3dea-4ea7-b06e-290c890829e8 req-67408b36-403e-4042-8656-21151a4d6f0b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:21.901707 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-07b1d889-3dea-4ea7-b06e-290c890829e8 req-67408b36-403e-4042-8656-21151a4d6f0b service nova] Creating event network-vif-deleted:90479900-4d72-46a0-92ee-feff9e50d619 for instance cf669403-03eb-40c7-9a11-3d0422f708c7 on nch2-master-1 Apr 16 21:22:21.918793 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-07b1d889-3dea-4ea7-b06e-290c890829e8 req-67408b36-403e-4042-8656-21151a4d6f0b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098815 Apr 16 21:22:21.921597 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2110/4060] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:22:21.932955 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4daf4ac8-1fb3-4f9f-8b7b-797fe143257f tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:22.056876 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4daf4ac8-1fb3-4f9f-8b7b-797fe143257f tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/98f6da04-d031-4bc2-87b4-411355710fc9" status: 204 len: 0 microversion: 2.1 time: 0.131010 Apr 16 21:22:22.056876 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2111/4061] 10.222.0.20 () {58 vars in 1265 bytes} [Sat Apr 16 21:22:21 2022] DELETE /compute/v2.1/os-server-groups/98f6da04-d031-4bc2-87b4-411355710fc9 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:22:22.067799 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-09bf153c-9508-469f-be6c-9271f1141305 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:22.110720 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-09bf153c-9508-469f-be6c-9271f1141305 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.046362 Apr 16 21:22:22.113723 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2112/4062] 10.222.0.20 () {58 vars in 1151 bytes} [Sat Apr 16 21:22:22 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:22:22.131093 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-46c2c185-2277-40fc-b0dd-3f8bc4c1736b tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:22.133760 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-46c2c185-2277-40fc-b0dd-3f8bc4c1736b tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:22.149833 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-46c2c185-2277-40fc-b0dd-3f8bc4c1736b tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:22.150722 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-46c2c185-2277-40fc-b0dd-3f8bc4c1736b tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:22.152029 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-46c2c185-2277-40fc-b0dd-3f8bc4c1736b tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:22.153102 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-46c2c185-2277-40fc-b0dd-3f8bc4c1736b tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:23.021000 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3e4dfd2e-f3ca-4edd-bf24-fdf2624e93fa tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.741849 Apr 16 21:22:23.022245 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1951/4063] 10.222.0.20 () {60 vars in 1194 bytes} [Sat Apr 16 21:22:21 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1744 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:22:23.029080 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-38f7635a-d2ea-48df-8781-5876ac06c615 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Action: 'create', calling method: .version_select at 0x7fbb95760160>, body: {"server_group": {"name": "tempest-server-group-1324330674", "policies": ["anti-affinity"]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:22:23.082380 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-38f7635a-d2ea-48df-8781-5876ac06c615 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Getting quotas for project 4030f0824ca84b97a7fef26a7384e775. Resources: {'server_groups'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:22:23.088661 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-38f7635a-d2ea-48df-8781-5876ac06c615 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Getting quotas for user 31ce0f9acbb14b538d7c10e56a9c7d98 and project 4030f0824ca84b97a7fef26a7384e775. Resources: {'server_groups'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:22:23.137933 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-46c2c185-2277-40fc-b0dd-3f8bc4c1736b tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:23.153102 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-46c2c185-2277-40fc-b0dd-3f8bc4c1736b tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:23.158063 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-46c2c185-2277-40fc-b0dd-3f8bc4c1736b tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:23.158063 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-46c2c185-2277-40fc-b0dd-3f8bc4c1736b tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 2368 microversion: 2.32 time: 1.042394 Apr 16 21:22:23.160443 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2113/4064] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:22:22 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 2368 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:22:23.168941 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6761a745-ac53-47e9-8fb0-86547449f9b8 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:23.174294 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6761a745-ac53-47e9-8fb0-86547449f9b8 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] [instance: 0246e469-bac2-4e9f-bd3f-bd5e1e60618f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:23.184220 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6761a745-ac53-47e9-8fb0-86547449f9b8 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:23.184692 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6761a745-ac53-47e9-8fb0-86547449f9b8 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:23.185501 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6761a745-ac53-47e9-8fb0-86547449f9b8 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:23.185940 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6761a745-ac53-47e9-8fb0-86547449f9b8 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:23.291335 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-38f7635a-d2ea-48df-8781-5876ac06c615 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Getting quotas for project 4030f0824ca84b97a7fef26a7384e775. Resources: {'server_groups'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:22:23.304517 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-38f7635a-d2ea-48df-8781-5876ac06c615 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Getting quotas for user 31ce0f9acbb14b538d7c10e56a9c7d98 and project 4030f0824ca84b97a7fef26a7384e775. Resources: {'server_groups'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:22:23.330486 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-38f7635a-d2ea-48df-8781-5876ac06c615 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.306479 Apr 16 21:22:23.331978 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1952/4065] 10.222.0.20 () {60 vars in 1172 bytes} [Sat Apr 16 21:22:23 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:22:23.340877 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a1323bbc-b451-42ff-b09b-09dcf55c778a tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:23.348208 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a1323bbc-b451-42ff-b09b-09dcf55c778a tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c9cb29db112b421ea4973953523bc249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ddd60eec74fb89e04d7e6354a2bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:23.349498 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a1323bbc-b451-42ff-b09b-09dcf55c778a tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Searching by: {'deleted': False, 'project_id': 'f65ddd60eec74fb89e04d7e6354a2bc4'} {{(pid=137409) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:22:23.361108 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a1323bbc-b451-42ff-b09b-09dcf55c778a tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:23.361822 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a1323bbc-b451-42ff-b09b-09dcf55c778a tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:23.363446 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a1323bbc-b451-42ff-b09b-09dcf55c778a tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:23.364534 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a1323bbc-b451-42ff-b09b-09dcf55c778a tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:23.403990 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.multi_cell_list [None req-a1323bbc-b451-42ff-b09b-09dcf55c778a tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 16 21:22:23.429668 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6761a745-ac53-47e9-8fb0-86547449f9b8 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:23.439549 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6761a745-ac53-47e9-8fb0-86547449f9b8 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:23.442104 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6761a745-ac53-47e9-8fb0-86547449f9b8 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:23.445695 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6761a745-ac53-47e9-8fb0-86547449f9b8 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] 10.222.0.20 "GET /compute/v2.1/servers/0246e469-bac2-4e9f-bd3f-bd5e1e60618f" status: 200 len: 1358 microversion: 2.21 time: 0.283772 Apr 16 21:22:23.446479 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2114/4066] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:22:23 2022] GET /compute/v2.1/servers/0246e469-bac2-4e9f-bd3f-bd5e1e60618f => generated 1358 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:22:23.450600 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a1323bbc-b451-42ff-b09b-09dcf55c778a tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.116771 Apr 16 21:22:23.451987 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1953/4067] 10.222.0.20 () {58 vars in 1124 bytes} [Sat Apr 16 21:22:23 2022] GET /compute/v2.1/servers => generated 333 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:22:23.463835 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-48adfe25-ad30-4559-bd38-fe93a9cb921c tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:23.466170 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4dff8f5a-949a-4d32-93a4-3a897eecdf43 tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] Action: 'create', calling method: .version_select at 0x7fbb957a9550>, body: {"security_group_rule": {"parent_group_id": "d039c2aa-9fac-40b3-a04d-62d0d344f07a", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:22:23.581398 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-48adfe25-ad30-4559-bd38-fe93a9cb921c tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/a9a8808a-edb1-40a6-93c2-dd5b3d2c886f" status: 204 len: 0 microversion: 2.1 time: 0.128186 Apr 16 21:22:23.583269 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1954/4068] 10.222.0.20 () {58 vars in 1265 bytes} [Sat Apr 16 21:22:23 2022] DELETE /compute/v2.1/os-server-groups/a9a8808a-edb1-40a6-93c2-dd5b3d2c886f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:22:23.589305 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-09603759-b140-4634-ad1e-e14b7fbf4736 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:23.611845 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-09603759-b140-4634-ad1e-e14b7fbf4736 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c9cb29db112b421ea4973953523bc249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ddd60eec74fb89e04d7e6354a2bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:23.615178 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-09603759-b140-4634-ad1e-e14b7fbf4736 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Searching by: {'deleted': False, 'project_id': 'f65ddd60eec74fb89e04d7e6354a2bc4'} {{(pid=137409) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:22:23.626077 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-09603759-b140-4634-ad1e-e14b7fbf4736 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:23.626559 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-09603759-b140-4634-ad1e-e14b7fbf4736 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:23.629636 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-09603759-b140-4634-ad1e-e14b7fbf4736 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:23.630365 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-09603759-b140-4634-ad1e-e14b7fbf4736 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:23.667853 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.multi_cell_list [None req-09603759-b140-4634-ad1e-e14b7fbf4736 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 16 21:22:23.807300 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-09603759-b140-4634-ad1e-e14b7fbf4736 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cb29db112b421ea4973953523bc249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ddd60eec74fb89e04d7e6354a2bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:23.824012 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-09603759-b140-4634-ad1e-e14b7fbf4736 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:23.824012 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-09603759-b140-4634-ad1e-e14b7fbf4736 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:24.079857 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-09603759-b140-4634-ad1e-e14b7fbf4736 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 1697 microversion: 2.1 time: 0.495002 Apr 16 21:22:24.095050 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1955/4069] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:22:23 2022] GET /compute/v2.1/servers/detail => generated 1697 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:22:24.095050 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-25c47fd3-34af-41fd-a1c3-fed9f97dc6bf tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:24.104952 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-25c47fd3-34af-41fd-a1c3-fed9f97dc6bf tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.022466 Apr 16 21:22:24.126137 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1956/4070] 10.222.0.20 () {58 vars in 1151 bytes} [Sat Apr 16 21:22:24 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:22:24.163990 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-8a822c6b-2191-4fb2-958e-30a08de9e96c req-c59dca03-c2a6-4fae-b7ae-ee7d5001e162 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf669403-03eb-40c7-9a11-3d0422f708c7", "name": "network-vif-deleted", "tag": "289d892c-efd8-4a45-8065-39c93c83ca97"}, {"server_uuid": "cf669403-03eb-40c7-9a11-3d0422f708c7", "name": "network-vif-deleted", "tag": "3e5cf556-52a6-4c25-b89c-a2b9dc0b4a62"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:22:24.188498 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-8a822c6b-2191-4fb2-958e-30a08de9e96c req-c59dca03-c2a6-4fae-b7ae-ee7d5001e162 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:24.189164 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-8a822c6b-2191-4fb2-958e-30a08de9e96c req-c59dca03-c2a6-4fae-b7ae-ee7d5001e162 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:24.210000 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-8a822c6b-2191-4fb2-958e-30a08de9e96c req-c59dca03-c2a6-4fae-b7ae-ee7d5001e162 service nova] Creating event network-vif-deleted:289d892c-efd8-4a45-8065-39c93c83ca97 for instance cf669403-03eb-40c7-9a11-3d0422f708c7 on nch2-master-1 Apr 16 21:22:24.211442 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-8a822c6b-2191-4fb2-958e-30a08de9e96c req-c59dca03-c2a6-4fae-b7ae-ee7d5001e162 service nova] Creating event network-vif-deleted:3e5cf556-52a6-4c25-b89c-a2b9dc0b4a62 for instance cf669403-03eb-40c7-9a11-3d0422f708c7 on nch2-master-1 Apr 16 21:22:24.219179 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-8a822c6b-2191-4fb2-958e-30a08de9e96c req-c59dca03-c2a6-4fae-b7ae-ee7d5001e162 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.082162 Apr 16 21:22:24.220238 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1957/4071] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:22:24.229030 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ec155227-1cfd-49e4-adaa-961d43763c12 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:24.256961 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ec155227-1cfd-49e4-adaa-961d43763c12 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] 10.222.0.20 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.033474 Apr 16 21:22:24.272218 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1958/4072] 10.222.0.20 () {58 vars in 1136 bytes} [Sat Apr 16 21:22:24 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:22:24.272218 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-222dd971-e6dd-408c-aea6-8f0f533c3e5e tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:24.272218 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-222dd971-e6dd-408c-aea6-8f0f533c3e5e tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:24.272956 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-222dd971-e6dd-408c-aea6-8f0f533c3e5e tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:24.273577 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-222dd971-e6dd-408c-aea6-8f0f533c3e5e tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:24.275647 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-222dd971-e6dd-408c-aea6-8f0f533c3e5e tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:24.276978 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-222dd971-e6dd-408c-aea6-8f0f533c3e5e tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:24.543594 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4dff8f5a-949a-4d32-93a4-3a897eecdf43 tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] 10.222.0.20 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 1.095238 Apr 16 21:22:24.544929 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2115/4073] 10.222.0.20 () {60 vars in 1194 bytes} [Sat Apr 16 21:22:23 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:22:24.550217 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-17f2b6b2-1222-41a3-9fe3-f3a7d459bec3 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-455083476", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "e79b49f9-c99f-4dd1-a2de-c4759fcd2a5c"}]}, "os:scheduler_hints": {"group": "0303882f-271b-4675-829f-dd13d7cb78b4"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:22:24.579322 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-222dd971-e6dd-408c-aea6-8f0f533c3e5e tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:24.593148 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-222dd971-e6dd-408c-aea6-8f0f533c3e5e tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:24.595887 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-222dd971-e6dd-408c-aea6-8f0f533c3e5e tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:24.596810 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-222dd971-e6dd-408c-aea6-8f0f533c3e5e tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 2323 microversion: 2.32 time: 0.336383 Apr 16 21:22:24.606223 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1959/4074] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:22:24 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 2323 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:22:24.613100 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-458a3697-2a1a-456a-86d5-eb774d65fcc7 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:24.614090 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-458a3697-2a1a-456a-86d5-eb774d65fcc7 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] [instance: 0246e469-bac2-4e9f-bd3f-bd5e1e60618f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:24.632517 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-17f2b6b2-1222-41a3-9fe3-f3a7d459bec3 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] validate_networks() for [('e79b49f9-c99f-4dd1-a2de-c4759fcd2a5c', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:22:24.643092 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-458a3697-2a1a-456a-86d5-eb774d65fcc7 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:24.644841 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-458a3697-2a1a-456a-86d5-eb774d65fcc7 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:24.646641 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-458a3697-2a1a-456a-86d5-eb774d65fcc7 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:24.647854 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-458a3697-2a1a-456a-86d5-eb774d65fcc7 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:24.926071 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-458a3697-2a1a-456a-86d5-eb774d65fcc7 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:24.937126 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-458a3697-2a1a-456a-86d5-eb774d65fcc7 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:24.938797 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-458a3697-2a1a-456a-86d5-eb774d65fcc7 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:24.940010 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-458a3697-2a1a-456a-86d5-eb774d65fcc7 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] 10.222.0.20 "GET /compute/v2.1/servers/0246e469-bac2-4e9f-bd3f-bd5e1e60618f" status: 200 len: 1358 microversion: 2.21 time: 0.332151 Apr 16 21:22:24.940894 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1960/4075] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:22:24 2022] GET /compute/v2.1/servers/0246e469-bac2-4e9f-bd3f-bd5e1e60618f => generated 1358 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:22:24.967201 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-041dbe69-b791-4949-8774-2a6da46ecd49 tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] Calling method '.version_select at 0x7fbb957600d0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:25.138019 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-041dbe69-b791-4949-8774-2a6da46ecd49 tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] 10.222.0.20 "GET /compute/v2.1/os-security-groups/d039c2aa-9fac-40b3-a04d-62d0d344f07a" status: 200 len: 664 microversion: 2.1 time: 0.183949 Apr 16 21:22:25.138707 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1961/4076] 10.222.0.20 () {58 vars in 1268 bytes} [Sat Apr 16 21:22:24 2022] GET /compute/v2.1/os-security-groups/d039c2aa-9fac-40b3-a04d-62d0d344f07a => generated 664 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:22:25.146456 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-22db5239-62a1-4d09-a9b7-912e8bc46c1b tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:25.146835 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-22db5239-62a1-4d09-a9b7-912e8bc46c1b tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] [instance: 5bb444da-2bc4-4d5b-9e65-6739d1f4edf4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:25.159394 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-22db5239-62a1-4d09-a9b7-912e8bc46c1b tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:25.159871 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-22db5239-62a1-4d09-a9b7-912e8bc46c1b tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:25.160823 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-22db5239-62a1-4d09-a9b7-912e8bc46c1b tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:25.161442 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-22db5239-62a1-4d09-a9b7-912e8bc46c1b tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:25.186507 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-17f2b6b2-1222-41a3-9fe3-f3a7d459bec3 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:22:25.186937 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-17f2b6b2-1222-41a3-9fe3-f3a7d459bec3 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:22:25.191267 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-17f2b6b2-1222-41a3-9fe3-f3a7d459bec3 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:22:25.191851 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-17f2b6b2-1222-41a3-9fe3-f3a7d459bec3 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:22:25.192335 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-17f2b6b2-1222-41a3-9fe3-f3a7d459bec3 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:22:25.222528 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-17f2b6b2-1222-41a3-9fe3-f3a7d459bec3 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:25.223594 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-17f2b6b2-1222-41a3-9fe3-f3a7d459bec3 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:25.225385 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-17f2b6b2-1222-41a3-9fe3-f3a7d459bec3 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:25.229211 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-17f2b6b2-1222-41a3-9fe3-f3a7d459bec3 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:25.237426 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-22db5239-62a1-4d09-a9b7-912e8bc46c1b tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] [instance: 5bb444da-2bc4-4d5b-9e65-6739d1f4edf4] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:22:25.262591 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-17f2b6b2-1222-41a3-9fe3-f3a7d459bec3 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Getting quotas for project 4030f0824ca84b97a7fef26a7384e775. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:22:25.270861 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-17f2b6b2-1222-41a3-9fe3-f3a7d459bec3 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Getting quotas for user 31ce0f9acbb14b538d7c10e56a9c7d98 and project 4030f0824ca84b97a7fef26a7384e775. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:22:25.298894 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-17f2b6b2-1222-41a3-9fe3-f3a7d459bec3 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:22:25.304400 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-17f2b6b2-1222-41a3-9fe3-f3a7d459bec3 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] [instance: 201e0019-00bc-43c6-ab2d-b899dc6a9010] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:22:25.469294 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-17f2b6b2-1222-41a3-9fe3-f3a7d459bec3 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=137408) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Apr 16 21:22:25.490033 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-17f2b6b2-1222-41a3-9fe3-f3a7d459bec3 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Getting quotas for project 4030f0824ca84b97a7fef26a7384e775. Resources: {'server_group_members'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:22:25.496087 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-17f2b6b2-1222-41a3-9fe3-f3a7d459bec3 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Getting quotas for user 31ce0f9acbb14b538d7c10e56a9c7d98 and project 4030f0824ca84b97a7fef26a7384e775. Resources: {'server_group_members'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:22:25.731987 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-17f2b6b2-1222-41a3-9fe3-f3a7d459bec3 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Getting quotas for project 4030f0824ca84b97a7fef26a7384e775. Resources: {'server_group_members'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:22:25.731987 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-17f2b6b2-1222-41a3-9fe3-f3a7d459bec3 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Getting quotas for user 31ce0f9acbb14b538d7c10e56a9c7d98 and project 4030f0824ca84b97a7fef26a7384e775. Resources: {'server_group_members'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:22:25.768326 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-17f2b6b2-1222-41a3-9fe3-f3a7d459bec3 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.222083 Apr 16 21:22:25.769197 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2116/4077] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:22:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1224 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:22:25.774653 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-4ad74618-c352-4a5a-99bd-e072f39b1423 req-824c5d37-f3f4-47ab-b6e2-48d36d0e0782 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0246e469-bac2-4e9f-bd3f-bd5e1e60618f", "tag": "fcb5802b-1192-4604-ab1c-b9b0448c90c4"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:22:25.782877 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-4ad74618-c352-4a5a-99bd-e072f39b1423 req-824c5d37-f3f4-47ab-b6e2-48d36d0e0782 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:25.789759 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-4ad74618-c352-4a5a-99bd-e072f39b1423 req-824c5d37-f3f4-47ab-b6e2-48d36d0e0782 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:25.794633 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-4ad74618-c352-4a5a-99bd-e072f39b1423 req-824c5d37-f3f4-47ab-b6e2-48d36d0e0782 service nova] Creating event network-changed:fcb5802b-1192-4604-ab1c-b9b0448c90c4 for instance 0246e469-bac2-4e9f-bd3f-bd5e1e60618f on nch2-master-1 Apr 16 21:22:25.799530 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-4ad74618-c352-4a5a-99bd-e072f39b1423 req-824c5d37-f3f4-47ab-b6e2-48d36d0e0782 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029140 Apr 16 21:22:25.800719 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2117/4078] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:22:25.812620 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1facf88b-385e-4f29-bcac-0c0317e360d7 tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] Calling method '.version_select at 0x7fbb957f7c10>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:25.842062 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-22db5239-62a1-4d09-a9b7-912e8bc46c1b tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5bb444da-2bc4-4d5b-9e65-6739d1f4edf4" status: 204 len: 0 microversion: 2.1 time: 0.702151 Apr 16 21:22:25.843470 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1962/4079] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:22:25 2022] DELETE /compute/v2.1/servers/5bb444da-2bc4-4d5b-9e65-6739d1f4edf4 => generated 0 bytes in 704 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:22:25.851079 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ce37bcb2-e38f-4655-9d31-2f50404c17ad tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:25.878613 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ce37bcb2-e38f-4655-9d31-2f50404c17ad tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:25.878613 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ce37bcb2-e38f-4655-9d31-2f50404c17ad tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:25.878613 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ce37bcb2-e38f-4655-9d31-2f50404c17ad tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:25.878613 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ce37bcb2-e38f-4655-9d31-2f50404c17ad tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:25.878613 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ce37bcb2-e38f-4655-9d31-2f50404c17ad tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:26.032216 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ce37bcb2-e38f-4655-9d31-2f50404c17ad tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:26.041928 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ce37bcb2-e38f-4655-9d31-2f50404c17ad tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:26.043456 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ce37bcb2-e38f-4655-9d31-2f50404c17ad tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:26.052426 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ce37bcb2-e38f-4655-9d31-2f50404c17ad tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1605 microversion: 2.32 time: 0.206949 Apr 16 21:22:26.052540 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1963/4080] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:22:25 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1605 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:22:26.057769 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cfdbc0f7-fad0-4c57-b15f-0d2a84559324 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:26.058883 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-cfdbc0f7-fad0-4c57-b15f-0d2a84559324 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] [instance: 201e0019-00bc-43c6-ab2d-b899dc6a9010] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:26.119262 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cfdbc0f7-fad0-4c57-b15f-0d2a84559324 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ce0f9acbb14b538d7c10e56a9c7d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030f0824ca84b97a7fef26a7384e775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:26.126285 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cfdbc0f7-fad0-4c57-b15f-0d2a84559324 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] 10.222.0.20 "GET /compute/v2.1/servers/201e0019-00bc-43c6-ab2d-b899dc6a9010" status: 200 len: 1212 microversion: 2.1 time: 0.072648 Apr 16 21:22:26.126872 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1964/4081] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:22:26 2022] GET /compute/v2.1/servers/201e0019-00bc-43c6-ab2d-b899dc6a9010 => generated 1212 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:22:26.131560 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0771ae0c-1dc0-4dc4-abb5-ff17e9e88307 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:26.132232 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0771ae0c-1dc0-4dc4-abb5-ff17e9e88307 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] [instance: 5bb444da-2bc4-4d5b-9e65-6739d1f4edf4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:26.138697 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0771ae0c-1dc0-4dc4-abb5-ff17e9e88307 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:26.139363 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0771ae0c-1dc0-4dc4-abb5-ff17e9e88307 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:26.140096 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0771ae0c-1dc0-4dc4-abb5-ff17e9e88307 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:26.140717 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0771ae0c-1dc0-4dc4-abb5-ff17e9e88307 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:26.154810 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1facf88b-385e-4f29-bcac-0c0317e360d7 tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-group-rules/b1dd70a9-fac6-46ef-9377-eb03914d2ad2" status: 202 len: 0 microversion: 2.1 time: 0.345771 Apr 16 21:22:26.154810 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2118/4082] 10.222.0.20 () {58 vars in 1286 bytes} [Sat Apr 16 21:22:25 2022] DELETE /compute/v2.1/os-security-group-rules/b1dd70a9-fac6-46ef-9377-eb03914d2ad2 => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:22:26.157229 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3458afa2-db3a-4ec4-aa9d-6e1f0e263cb4 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:26.158380 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3458afa2-db3a-4ec4-aa9d-6e1f0e263cb4 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] [instance: 0246e469-bac2-4e9f-bd3f-bd5e1e60618f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:26.168426 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3458afa2-db3a-4ec4-aa9d-6e1f0e263cb4 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:26.169012 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3458afa2-db3a-4ec4-aa9d-6e1f0e263cb4 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:26.174499 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3458afa2-db3a-4ec4-aa9d-6e1f0e263cb4 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:26.174499 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3458afa2-db3a-4ec4-aa9d-6e1f0e263cb4 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:26.285283 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0771ae0c-1dc0-4dc4-abb5-ff17e9e88307 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cb29db112b421ea4973953523bc249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ddd60eec74fb89e04d7e6354a2bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:26.293657 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0771ae0c-1dc0-4dc4-abb5-ff17e9e88307 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb444da-2bc4-4d5b-9e65-6739d1f4edf4" status: 200 len: 1700 microversion: 2.1 time: 0.165590 Apr 16 21:22:26.294242 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1965/4083] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:22:26 2022] GET /compute/v2.1/servers/5bb444da-2bc4-4d5b-9e65-6739d1f4edf4 => generated 1700 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:22:26.300189 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d313ccc1-5736-4504-be42-989599e04b28 tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] Calling method '.version_select at 0x7fbb95c741f0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:26.311371 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3458afa2-db3a-4ec4-aa9d-6e1f0e263cb4 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:26.320221 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3458afa2-db3a-4ec4-aa9d-6e1f0e263cb4 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:26.321759 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3458afa2-db3a-4ec4-aa9d-6e1f0e263cb4 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:26.322892 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3458afa2-db3a-4ec4-aa9d-6e1f0e263cb4 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] 10.222.0.20 "GET /compute/v2.1/servers/0246e469-bac2-4e9f-bd3f-bd5e1e60618f" status: 200 len: 1358 microversion: 2.21 time: 0.173167 Apr 16 21:22:26.323764 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2119/4084] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:22:26 2022] GET /compute/v2.1/servers/0246e469-bac2-4e9f-bd3f-bd5e1e60618f => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:22:26.328140 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-b0156690-ce1f-43b0-b310-0b8688af3ea6 req-e63930de-316e-4c3b-a691-473f5a2ae6aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf669403-03eb-40c7-9a11-3d0422f708c7", "name": "network-vif-deleted", "tag": "89946b61-fbf7-4964-8abf-1d6403aac9ec"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:22:26.337168 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-b0156690-ce1f-43b0-b310-0b8688af3ea6 req-e63930de-316e-4c3b-a691-473f5a2ae6aa service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:26.337675 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-b0156690-ce1f-43b0-b310-0b8688af3ea6 req-e63930de-316e-4c3b-a691-473f5a2ae6aa service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:26.348964 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-b0156690-ce1f-43b0-b310-0b8688af3ea6 req-e63930de-316e-4c3b-a691-473f5a2ae6aa service nova] Creating event network-vif-deleted:89946b61-fbf7-4964-8abf-1d6403aac9ec for instance cf669403-03eb-40c7-9a11-3d0422f708c7 on nch2-master-1 Apr 16 21:22:26.354535 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-b0156690-ce1f-43b0-b310-0b8688af3ea6 req-e63930de-316e-4c3b-a691-473f5a2ae6aa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029592 Apr 16 21:22:26.356060 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2120/4085] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:22:26.617831 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d313ccc1-5736-4504-be42-989599e04b28 tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/d039c2aa-9fac-40b3-a04d-62d0d344f07a" status: 202 len: 0 microversion: 2.1 time: 0.322102 Apr 16 21:22:26.618498 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1966/4086] 10.222.0.20 () {58 vars in 1271 bytes} [Sat Apr 16 21:22:26 2022] DELETE /compute/v2.1/os-security-groups/d039c2aa-9fac-40b3-a04d-62d0d344f07a => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:22:26.627136 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fc6c7695-d8ab-4e2c-838b-c7cce054fa0d tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] Calling method '.version_select at 0x7fbba004a310>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:26.651941 ncdv-master-1 devstack@n-api.service[137408]: DEBUG neutronclient.v2_0.client [None req-fc6c7695-d8ab-4e2c-838b-c7cce054fa0d tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 5077c1ab-c69e-4e96-abaa-b94600a6bf34 does not exist", "detail": ""}} {{(pid=137408) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Apr 16 21:22:26.651941 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.security_group_api [None req-fc6c7695-d8ab-4e2c-838b-c7cce054fa0d tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] Neutron security group 5077c1ab-c69e-4e96-abaa-b94600a6bf34 not found {{(pid=137408) get /opt/stack/nova/nova/network/security_group_api.py:313}} Apr 16 21:22:26.651941 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-fc6c7695-d8ab-4e2c-838b-c7cce054fa0d tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] HTTP exception thrown: Security group 5077c1ab-c69e-4e96-abaa-b94600a6bf34 does not exist Apr 16 21:22:26.651941 ncdv-master-1 devstack@n-api.service[137408]: Neutron server returns request_ids: ['req-e7033c51-799f-48e9-bbae-62497a18e6f3'] Apr 16 21:22:26.653147 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fc6c7695-d8ab-4e2c-838b-c7cce054fa0d tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] Returning 404 to user: Security group 5077c1ab-c69e-4e96-abaa-b94600a6bf34 does not exist Apr 16 21:22:26.653147 ncdv-master-1 devstack@n-api.service[137408]: Neutron server returns request_ids: ['req-e7033c51-799f-48e9-bbae-62497a18e6f3'] {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:22:26.653553 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fc6c7695-d8ab-4e2c-838b-c7cce054fa0d tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/5077c1ab-c69e-4e96-abaa-b94600a6bf34" status: 404 len: 194 microversion: 2.1 time: 0.030602 Apr 16 21:22:26.654183 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2121/4087] 10.222.0.20 () {58 vars in 1271 bytes} [Sat Apr 16 21:22:26 2022] DELETE /compute/v2.1/os-security-groups/5077c1ab-c69e-4e96-abaa-b94600a6bf34 => generated 194 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:22:26.662230 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-acf58a83-91a1-4980-953e-432365f070ae tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] Calling method '.version_select at 0x7fbb95790ee0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:26.952913 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-acf58a83-91a1-4980-953e-432365f070ae tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/2609ebb3-4f67-48ae-a88a-3254a0b5eabd" status: 202 len: 0 microversion: 2.1 time: 0.293661 Apr 16 21:22:26.954396 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1967/4088] 10.222.0.20 () {58 vars in 1271 bytes} [Sat Apr 16 21:22:26 2022] DELETE /compute/v2.1/os-security-groups/2609ebb3-4f67-48ae-a88a-3254a0b5eabd => generated 0 bytes in 297 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 16 21:22:26.973241 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-11c0e966-a567-4c27-a6d5-4968de478eda tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] Calling method '.version_select at 0x7fbb957525e0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:27.078976 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e9815687-a7ee-445a-8ddc-07cf5bcb8433 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:27.079994 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e9815687-a7ee-445a-8ddc-07cf5bcb8433 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:27.101775 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e9815687-a7ee-445a-8ddc-07cf5bcb8433 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:27.101775 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e9815687-a7ee-445a-8ddc-07cf5bcb8433 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:27.101775 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e9815687-a7ee-445a-8ddc-07cf5bcb8433 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:27.101775 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e9815687-a7ee-445a-8ddc-07cf5bcb8433 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:27.224711 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e9815687-a7ee-445a-8ddc-07cf5bcb8433 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:27.234357 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e9815687-a7ee-445a-8ddc-07cf5bcb8433 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:27.236239 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e9815687-a7ee-445a-8ddc-07cf5bcb8433 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:27.237620 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e9815687-a7ee-445a-8ddc-07cf5bcb8433 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1605 microversion: 2.32 time: 0.168258 Apr 16 21:22:27.238900 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1968/4089] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:22:27 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1605 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:22:27.246157 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3963f76b-5112-4682-a362-60169512b47f tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:27.247043 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3963f76b-5112-4682-a362-60169512b47f tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] [instance: 201e0019-00bc-43c6-ab2d-b899dc6a9010] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:27.253792 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3963f76b-5112-4682-a362-60169512b47f tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:27.254625 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3963f76b-5112-4682-a362-60169512b47f tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:27.255658 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3963f76b-5112-4682-a362-60169512b47f tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:27.256546 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3963f76b-5112-4682-a362-60169512b47f tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:27.347307 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3963f76b-5112-4682-a362-60169512b47f tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ce0f9acbb14b538d7c10e56a9c7d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030f0824ca84b97a7fef26a7384e775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:27.358061 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3963f76b-5112-4682-a362-60169512b47f tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] 10.222.0.20 "GET /compute/v2.1/servers/201e0019-00bc-43c6-ab2d-b899dc6a9010" status: 200 len: 1216 microversion: 2.1 time: 0.117839 Apr 16 21:22:27.358668 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1969/4090] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:22:27 2022] GET /compute/v2.1/servers/201e0019-00bc-43c6-ab2d-b899dc6a9010 => generated 1216 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:22:27.363558 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-629be5f0-30e2-4654-bc31-7f9493cae820 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:27.364576 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-629be5f0-30e2-4654-bc31-7f9493cae820 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] [instance: 5bb444da-2bc4-4d5b-9e65-6739d1f4edf4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:27.371110 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-629be5f0-30e2-4654-bc31-7f9493cae820 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:27.371778 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-629be5f0-30e2-4654-bc31-7f9493cae820 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:27.372763 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-629be5f0-30e2-4654-bc31-7f9493cae820 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:27.373568 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-629be5f0-30e2-4654-bc31-7f9493cae820 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:27.415999 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-11c0e966-a567-4c27-a6d5-4968de478eda tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/5e72bf24-612a-42c9-9634-4c0fbe4cd2a3" status: 202 len: 0 microversion: 2.1 time: 0.456925 Apr 16 21:22:27.416924 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2122/4091] 10.222.0.20 () {58 vars in 1271 bytes} [Sat Apr 16 21:22:26 2022] DELETE /compute/v2.1/os-security-groups/5e72bf24-612a-42c9-9634-4c0fbe4cd2a3 => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:22:27.444263 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e5b1f83b-b74a-46e5-8b71-a13de2c6ec59 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:27.446622 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e5b1f83b-b74a-46e5-8b71-a13de2c6ec59 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] [instance: 0246e469-bac2-4e9f-bd3f-bd5e1e60618f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:27.453787 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e5b1f83b-b74a-46e5-8b71-a13de2c6ec59 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:27.454463 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e5b1f83b-b74a-46e5-8b71-a13de2c6ec59 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:27.455519 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e5b1f83b-b74a-46e5-8b71-a13de2c6ec59 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:27.456596 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e5b1f83b-b74a-46e5-8b71-a13de2c6ec59 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:27.602964 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-629be5f0-30e2-4654-bc31-7f9493cae820 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cb29db112b421ea4973953523bc249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ddd60eec74fb89e04d7e6354a2bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:27.615932 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-629be5f0-30e2-4654-bc31-7f9493cae820 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb444da-2bc4-4d5b-9e65-6739d1f4edf4" status: 200 len: 1700 microversion: 2.1 time: 0.255358 Apr 16 21:22:27.627387 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1970/4092] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:22:27 2022] GET /compute/v2.1/servers/5bb444da-2bc4-4d5b-9e65-6739d1f4edf4 => generated 1700 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:22:27.633485 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0fe5c897-a4f9-44e4-ac8b-8471677e5270 tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] Calling method '.version_select at 0x7fbb95c873a0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:27.646833 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e5b1f83b-b74a-46e5-8b71-a13de2c6ec59 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:27.665486 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e5b1f83b-b74a-46e5-8b71-a13de2c6ec59 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:27.666970 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e5b1f83b-b74a-46e5-8b71-a13de2c6ec59 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:27.683226 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e5b1f83b-b74a-46e5-8b71-a13de2c6ec59 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] 10.222.0.20 "GET /compute/v2.1/servers/0246e469-bac2-4e9f-bd3f-bd5e1e60618f" status: 200 len: 1358 microversion: 2.21 time: 0.264384 Apr 16 21:22:27.693791 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2123/4093] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:22:27 2022] GET /compute/v2.1/servers/0246e469-bac2-4e9f-bd3f-bd5e1e60618f => generated 1358 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:22:28.258134 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-13cba03b-6d73-4af2-8b6d-769142669d04 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:28.259535 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-13cba03b-6d73-4af2-8b6d-769142669d04 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:28.289114 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-13cba03b-6d73-4af2-8b6d-769142669d04 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:28.289595 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-13cba03b-6d73-4af2-8b6d-769142669d04 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:28.290740 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-13cba03b-6d73-4af2-8b6d-769142669d04 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:28.291199 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-13cba03b-6d73-4af2-8b6d-769142669d04 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:28.333650 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-13cba03b-6d73-4af2-8b6d-769142669d04 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:28.334376 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-13cba03b-6d73-4af2-8b6d-769142669d04 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:28.334841 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-13cba03b-6d73-4af2-8b6d-769142669d04 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lazy-loading 'fault' on Instance uuid cf669403-03eb-40c7-9a11-3d0422f708c7 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:22:28.367915 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0fe5c897-a4f9-44e4-ac8b-8471677e5270 tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/9f19fb15-c024-4e40-b9b0-e28d6b5f67aa" status: 202 len: 0 microversion: 2.1 time: 0.738961 Apr 16 21:22:28.369724 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1971/4094] 10.222.0.20 () {58 vars in 1271 bytes} [Sat Apr 16 21:22:27 2022] DELETE /compute/v2.1/os-security-groups/9f19fb15-c024-4e40-b9b0-e28d6b5f67aa => generated 0 bytes in 741 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:22:28.375290 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7f2e0b8d-e976-4946-a19a-ca6dcb6bdda5 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:28.379678 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7f2e0b8d-e976-4946-a19a-ca6dcb6bdda5 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] [instance: 201e0019-00bc-43c6-ab2d-b899dc6a9010] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:28.379796 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-13cba03b-6d73-4af2-8b6d-769142669d04 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:28.384045 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7f2e0b8d-e976-4946-a19a-ca6dcb6bdda5 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:28.384544 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7f2e0b8d-e976-4946-a19a-ca6dcb6bdda5 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:28.385989 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7f2e0b8d-e976-4946-a19a-ca6dcb6bdda5 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:28.386448 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7f2e0b8d-e976-4946-a19a-ca6dcb6bdda5 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:28.388210 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-13cba03b-6d73-4af2-8b6d-769142669d04 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:28.389748 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-13cba03b-6d73-4af2-8b6d-769142669d04 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2420585eb37e469da0dab780bf553c2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce47d3657e50419183b9ee9cee309667', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:28.390940 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-13cba03b-6d73-4af2-8b6d-769142669d04 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 200 len: 1610 microversion: 2.32 time: 0.137474 Apr 16 21:22:28.391835 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2124/4095] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:22:28 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 1610 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:22:28.397159 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c45cbdf5-da87-4a17-92c3-340852fa7062 tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] Calling method '.version_select at 0x7fbb9592ce50>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:28.540428 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7f2e0b8d-e976-4946-a19a-ca6dcb6bdda5 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ce0f9acbb14b538d7c10e56a9c7d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030f0824ca84b97a7fef26a7384e775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:28.551513 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7f2e0b8d-e976-4946-a19a-ca6dcb6bdda5 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] 10.222.0.20 "GET /compute/v2.1/servers/201e0019-00bc-43c6-ab2d-b899dc6a9010" status: 200 len: 1264 microversion: 2.1 time: 0.180097 Apr 16 21:22:28.552601 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1972/4096] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:22:28 2022] GET /compute/v2.1/servers/201e0019-00bc-43c6-ab2d-b899dc6a9010 => generated 1264 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:22:28.637045 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-353158e4-6a6c-4471-a979-0046b9c0522c tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:28.638286 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-353158e4-6a6c-4471-a979-0046b9c0522c tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] [instance: 5bb444da-2bc4-4d5b-9e65-6739d1f4edf4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:28.646211 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-353158e4-6a6c-4471-a979-0046b9c0522c tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:28.648946 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-353158e4-6a6c-4471-a979-0046b9c0522c tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:28.650258 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-353158e4-6a6c-4471-a979-0046b9c0522c tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:28.651067 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-353158e4-6a6c-4471-a979-0046b9c0522c tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:28.779728 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-353158e4-6a6c-4471-a979-0046b9c0522c tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cb29db112b421ea4973953523bc249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ddd60eec74fb89e04d7e6354a2bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:28.787123 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-353158e4-6a6c-4471-a979-0046b9c0522c tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb444da-2bc4-4d5b-9e65-6739d1f4edf4" status: 200 len: 1632 microversion: 2.1 time: 0.156045 Apr 16 21:22:28.797522 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1973/4097] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:22:28 2022] GET /compute/v2.1/servers/5bb444da-2bc4-4d5b-9e65-6739d1f4edf4 => generated 1632 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:22:28.797522 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8b4058cc-1f93-4810-9e04-293a402285f0 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:28.797522 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8b4058cc-1f93-4810-9e04-293a402285f0 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] [instance: 0246e469-bac2-4e9f-bd3f-bd5e1e60618f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:28.799501 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8b4058cc-1f93-4810-9e04-293a402285f0 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:28.800155 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8b4058cc-1f93-4810-9e04-293a402285f0 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:28.801019 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8b4058cc-1f93-4810-9e04-293a402285f0 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:28.801426 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8b4058cc-1f93-4810-9e04-293a402285f0 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:28.893751 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c45cbdf5-da87-4a17-92c3-340852fa7062 tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/b789662f-5c93-4baf-9a7c-7169e4d229e8" status: 202 len: 0 microversion: 2.1 time: 0.494513 Apr 16 21:22:28.895494 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2125/4098] 10.222.0.20 () {58 vars in 1271 bytes} [Sat Apr 16 21:22:28 2022] DELETE /compute/v2.1/os-security-groups/b789662f-5c93-4baf-9a7c-7169e4d229e8 => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:22:28.910775 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c0c47d08-cb4b-4e5f-870a-7c039b3d2b77 tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] Calling method '.version_select at 0x7fbb96142280>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:29.402072 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c0c47d08-cb4b-4e5f-870a-7c039b3d2b77 tempest-SecurityGroupRulesTestJSON-873395825 tempest-SecurityGroupRulesTestJSON-873395825-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/26076c25-da42-43ba-a286-4b843eea08c4" status: 202 len: 0 microversion: 2.1 time: 0.500954 Apr 16 21:22:29.403469 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2126/4099] 10.222.0.20 () {58 vars in 1271 bytes} [Sat Apr 16 21:22:28 2022] DELETE /compute/v2.1/os-security-groups/26076c25-da42-43ba-a286-4b843eea08c4 => generated 0 bytes in 504 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:22:29.413376 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-92d10fca-b902-41ec-807c-f347fd0c8cb5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:29.413997 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-92d10fca-b902-41ec-807c-f347fd0c8cb5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] [instance: cf669403-03eb-40c7-9a11-3d0422f708c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:29.434301 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8b4058cc-1f93-4810-9e04-293a402285f0 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:29.446605 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8b4058cc-1f93-4810-9e04-293a402285f0 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:29.448208 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8b4058cc-1f93-4810-9e04-293a402285f0 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:29.449469 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8b4058cc-1f93-4810-9e04-293a402285f0 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] 10.222.0.20 "GET /compute/v2.1/servers/0246e469-bac2-4e9f-bd3f-bd5e1e60618f" status: 200 len: 1358 microversion: 2.21 time: 0.660706 Apr 16 21:22:29.452436 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-92d10fca-b902-41ec-807c-f347fd0c8cb5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:29.453163 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-92d10fca-b902-41ec-807c-f347fd0c8cb5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:29.455260 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-92d10fca-b902-41ec-807c-f347fd0c8cb5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:29.455896 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-92d10fca-b902-41ec-807c-f347fd0c8cb5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:29.471368 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1974/4100] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:22:28 2022] GET /compute/v2.1/servers/0246e469-bac2-4e9f-bd3f-bd5e1e60618f => generated 1358 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:22:29.501678 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-92d10fca-b902-41ec-807c-f347fd0c8cb5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] HTTP exception thrown: Instance cf669403-03eb-40c7-9a11-3d0422f708c7 could not be found. Apr 16 21:22:29.504600 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-92d10fca-b902-41ec-807c-f347fd0c8cb5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Returning 404 to user: Instance cf669403-03eb-40c7-9a11-3d0422f708c7 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:22:29.505899 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-92d10fca-b902-41ec-807c-f347fd0c8cb5 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7" status: 404 len: 111 microversion: 2.32 time: 0.098212 Apr 16 21:22:29.541611 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2127/4101] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:22:29 2022] GET /compute/v2.1/servers/cf669403-03eb-40c7-9a11-3d0422f708c7 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:22:29.570243 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a1e942e8-1890-4a25-a7d5-af036a3fdb05 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:29.570243 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a1e942e8-1890-4a25-a7d5-af036a3fdb05 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] [instance: 201e0019-00bc-43c6-ab2d-b899dc6a9010] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:29.577078 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a1e942e8-1890-4a25-a7d5-af036a3fdb05 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:29.577812 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a1e942e8-1890-4a25-a7d5-af036a3fdb05 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:29.578764 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a1e942e8-1890-4a25-a7d5-af036a3fdb05 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:29.581465 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a1e942e8-1890-4a25-a7d5-af036a3fdb05 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:29.586920 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4dcf10fd-e882-4ac6-9635-a00a5d3c2050 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] Calling method '.version_select at 0x7fbb958be820>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:29.684309 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a1e942e8-1890-4a25-a7d5-af036a3fdb05 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ce0f9acbb14b538d7c10e56a9c7d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030f0824ca84b97a7fef26a7384e775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:29.696763 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a1e942e8-1890-4a25-a7d5-af036a3fdb05 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] 10.222.0.20 "GET /compute/v2.1/servers/201e0019-00bc-43c6-ab2d-b899dc6a9010" status: 200 len: 1270 microversion: 2.1 time: 0.132172 Apr 16 21:22:29.710884 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1975/4102] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:22:29 2022] GET /compute/v2.1/servers/201e0019-00bc-43c6-ab2d-b899dc6a9010 => generated 1270 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:22:29.718383 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-94140044-ccf2-47a7-bc15-f0ca6ad44fbc req-c882a873-2235-4144-a0ef-424892573e44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bb444da-2bc4-4d5b-9e65-6739d1f4edf4", "name": "network-vif-deleted", "tag": "8fc0e838-521f-4a5e-8f66-aa03b6fd079d"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:22:29.720882 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4dcf10fd-e882-4ac6-9635-a00a5d3c2050 tempest-TaggedBootDevicesTest-916837742 tempest-TaggedBootDevicesTest-916837742-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1036026036" status: 204 len: 0 microversion: 2.32 time: 0.140538 Apr 16 21:22:29.726284 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2128/4103] 10.222.0.20 () {60 vars in 1261 bytes} [Sat Apr 16 21:22:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1036026036 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 16 21:22:29.735679 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-94140044-ccf2-47a7-bc15-f0ca6ad44fbc req-c882a873-2235-4144-a0ef-424892573e44 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:29.736713 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-94140044-ccf2-47a7-bc15-f0ca6ad44fbc req-c882a873-2235-4144-a0ef-424892573e44 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:29.760242 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-94140044-ccf2-47a7-bc15-f0ca6ad44fbc req-c882a873-2235-4144-a0ef-424892573e44 service nova] Creating event network-vif-deleted:8fc0e838-521f-4a5e-8f66-aa03b6fd079d for instance 5bb444da-2bc4-4d5b-9e65-6739d1f4edf4 on nch1-master-1 Apr 16 21:22:29.766177 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-94140044-ccf2-47a7-bc15-f0ca6ad44fbc req-c882a873-2235-4144-a0ef-424892573e44 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054016 Apr 16 21:22:29.768924 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1976/4104] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:22:29.805555 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0dc1e5eb-0669-4311-b762-c766053cd0c6 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:29.806186 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0dc1e5eb-0669-4311-b762-c766053cd0c6 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] [instance: 5bb444da-2bc4-4d5b-9e65-6739d1f4edf4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:29.815617 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0dc1e5eb-0669-4311-b762-c766053cd0c6 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:29.816223 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0dc1e5eb-0669-4311-b762-c766053cd0c6 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:29.817489 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0dc1e5eb-0669-4311-b762-c766053cd0c6 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:29.818208 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0dc1e5eb-0669-4311-b762-c766053cd0c6 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:29.961695 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0dc1e5eb-0669-4311-b762-c766053cd0c6 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cb29db112b421ea4973953523bc249', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f65ddd60eec74fb89e04d7e6354a2bc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:29.969595 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0dc1e5eb-0669-4311-b762-c766053cd0c6 tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb444da-2bc4-4d5b-9e65-6739d1f4edf4" status: 200 len: 1353 microversion: 2.1 time: 0.168769 Apr 16 21:22:29.970418 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2129/4105] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:22:29 2022] GET /compute/v2.1/servers/5bb444da-2bc4-4d5b-9e65-6739d1f4edf4 => generated 1353 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:22:30.475385 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d8fc5610-07f1-4bd3-8285-1378c756303b tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:30.476382 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d8fc5610-07f1-4bd3-8285-1378c756303b tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] [instance: 0246e469-bac2-4e9f-bd3f-bd5e1e60618f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:30.492119 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d8fc5610-07f1-4bd3-8285-1378c756303b tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:30.492615 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d8fc5610-07f1-4bd3-8285-1378c756303b tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:30.493483 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d8fc5610-07f1-4bd3-8285-1378c756303b tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:30.493999 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d8fc5610-07f1-4bd3-8285-1378c756303b tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:30.717497 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fb70f5b0-4443-47ec-ac00-2ea68db88e85 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:30.718093 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fb70f5b0-4443-47ec-ac00-2ea68db88e85 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] [instance: 201e0019-00bc-43c6-ab2d-b899dc6a9010] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:30.731867 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fb70f5b0-4443-47ec-ac00-2ea68db88e85 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:30.732665 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fb70f5b0-4443-47ec-ac00-2ea68db88e85 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:30.733755 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fb70f5b0-4443-47ec-ac00-2ea68db88e85 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:30.734427 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fb70f5b0-4443-47ec-ac00-2ea68db88e85 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:30.950431 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d8fc5610-07f1-4bd3-8285-1378c756303b tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:30.974548 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d8fc5610-07f1-4bd3-8285-1378c756303b tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:30.986406 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d8fc5610-07f1-4bd3-8285-1378c756303b tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:31.000583 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d8fc5610-07f1-4bd3-8285-1378c756303b tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] 10.222.0.20 "GET /compute/v2.1/servers/0246e469-bac2-4e9f-bd3f-bd5e1e60618f" status: 200 len: 1358 microversion: 2.21 time: 0.528515 Apr 16 21:22:31.003215 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1977/4106] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:22:30 2022] GET /compute/v2.1/servers/0246e469-bac2-4e9f-bd3f-bd5e1e60618f => generated 1358 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:22:31.012318 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-81fb07dd-d480-4035-9bbf-195ab98e91fa tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:31.017089 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-81fb07dd-d480-4035-9bbf-195ab98e91fa tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] [instance: 5bb444da-2bc4-4d5b-9e65-6739d1f4edf4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:31.036044 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-81fb07dd-d480-4035-9bbf-195ab98e91fa tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:31.038642 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-81fb07dd-d480-4035-9bbf-195ab98e91fa tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:31.041034 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-81fb07dd-d480-4035-9bbf-195ab98e91fa tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:31.041762 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-81fb07dd-d480-4035-9bbf-195ab98e91fa tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:31.060997 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fb70f5b0-4443-47ec-ac00-2ea68db88e85 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ce0f9acbb14b538d7c10e56a9c7d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030f0824ca84b97a7fef26a7384e775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:31.071167 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fb70f5b0-4443-47ec-ac00-2ea68db88e85 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] 10.222.0.20 "GET /compute/v2.1/servers/201e0019-00bc-43c6-ab2d-b899dc6a9010" status: 200 len: 1312 microversion: 2.1 time: 0.357602 Apr 16 21:22:31.072876 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2130/4107] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:22:30 2022] GET /compute/v2.1/servers/201e0019-00bc-43c6-ab2d-b899dc6a9010 => generated 1312 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:22:31.091229 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-81fb07dd-d480-4035-9bbf-195ab98e91fa tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] HTTP exception thrown: Instance 5bb444da-2bc4-4d5b-9e65-6739d1f4edf4 could not be found. Apr 16 21:22:31.091229 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-81fb07dd-d480-4035-9bbf-195ab98e91fa tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Returning 404 to user: Instance 5bb444da-2bc4-4d5b-9e65-6739d1f4edf4 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:22:31.091229 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-81fb07dd-d480-4035-9bbf-195ab98e91fa tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] 10.222.0.20 "GET /compute/v2.1/servers/5bb444da-2bc4-4d5b-9e65-6739d1f4edf4" status: 404 len: 111 microversion: 2.1 time: 0.082035 Apr 16 21:22:31.091229 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1978/4108] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:22:31 2022] GET /compute/v2.1/servers/5bb444da-2bc4-4d5b-9e65-6739d1f4edf4 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:22:31.097232 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5524e647-f183-4fbd-a8cd-01e6d433c40e tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] Calling method '.version_select at 0x7fbba001dd30>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:31.222500 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5524e647-f183-4fbd-a8cd-01e6d433c40e tempest-ServersTestJSON-484510919 tempest-ServersTestJSON-484510919-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-909055094" status: 202 len: 0 microversion: 2.1 time: 0.129243 Apr 16 21:22:31.227840 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2131/4109] 10.222.0.20 () {58 vars in 1217 bytes} [Sat Apr 16 21:22:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-909055094 => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:22:32.019004 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-abdff6b5-d455-4354-954b-596da61e37cf tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:32.019617 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-abdff6b5-d455-4354-954b-596da61e37cf tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] [instance: 0246e469-bac2-4e9f-bd3f-bd5e1e60618f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:32.027873 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-abdff6b5-d455-4354-954b-596da61e37cf tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:32.028497 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-abdff6b5-d455-4354-954b-596da61e37cf tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:32.029536 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-abdff6b5-d455-4354-954b-596da61e37cf tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:32.030048 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-abdff6b5-d455-4354-954b-596da61e37cf tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:32.090529 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d9d6e423-c8f0-4ce4-80cf-3931a3660236 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:32.091800 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d9d6e423-c8f0-4ce4-80cf-3931a3660236 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] [instance: 201e0019-00bc-43c6-ab2d-b899dc6a9010] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:32.103693 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d9d6e423-c8f0-4ce4-80cf-3931a3660236 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:32.106238 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d9d6e423-c8f0-4ce4-80cf-3931a3660236 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:32.106238 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d9d6e423-c8f0-4ce4-80cf-3931a3660236 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:32.106238 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d9d6e423-c8f0-4ce4-80cf-3931a3660236 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:32.353483 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d9d6e423-c8f0-4ce4-80cf-3931a3660236 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ce0f9acbb14b538d7c10e56a9c7d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030f0824ca84b97a7fef26a7384e775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:32.371038 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-abdff6b5-d455-4354-954b-596da61e37cf tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:32.376053 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d9d6e423-c8f0-4ce4-80cf-3931a3660236 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] 10.222.0.20 "GET /compute/v2.1/servers/201e0019-00bc-43c6-ab2d-b899dc6a9010" status: 200 len: 1312 microversion: 2.1 time: 0.290525 Apr 16 21:22:32.381201 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-abdff6b5-d455-4354-954b-596da61e37cf tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:32.388297 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-abdff6b5-d455-4354-954b-596da61e37cf tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:32.389939 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-abdff6b5-d455-4354-954b-596da61e37cf tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] 10.222.0.20 "GET /compute/v2.1/servers/0246e469-bac2-4e9f-bd3f-bd5e1e60618f" status: 200 len: 1358 microversion: 2.21 time: 0.374772 Apr 16 21:22:32.391389 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2132/4110] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:22:32 2022] GET /compute/v2.1/servers/201e0019-00bc-43c6-ab2d-b899dc6a9010 => generated 1312 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:22:32.393518 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1979/4111] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:22:32 2022] GET /compute/v2.1/servers/0246e469-bac2-4e9f-bd3f-bd5e1e60618f => generated 1358 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:22:32.867881 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-f02d9894-1dfa-4f91-b395-91d300e1d99b req-e6822625-6ab1-444b-ae95-d8ad70ba7691 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0246e469-bac2-4e9f-bd3f-bd5e1e60618f", "name": "network-vif-plugged", "status": "completed", "tag": "fcb5802b-1192-4604-ab1c-b9b0448c90c4"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:22:32.877814 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-f02d9894-1dfa-4f91-b395-91d300e1d99b req-e6822625-6ab1-444b-ae95-d8ad70ba7691 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:32.878714 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-f02d9894-1dfa-4f91-b395-91d300e1d99b req-e6822625-6ab1-444b-ae95-d8ad70ba7691 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:32.892367 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-f02d9894-1dfa-4f91-b395-91d300e1d99b req-e6822625-6ab1-444b-ae95-d8ad70ba7691 service nova] Creating event network-vif-plugged:fcb5802b-1192-4604-ab1c-b9b0448c90c4 for instance 0246e469-bac2-4e9f-bd3f-bd5e1e60618f on nch2-master-1 Apr 16 21:22:32.901547 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-f02d9894-1dfa-4f91-b395-91d300e1d99b req-e6822625-6ab1-444b-ae95-d8ad70ba7691 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035042 Apr 16 21:22:32.901547 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2133/4112] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:22:33.103935 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-01d7604f-0e98-469e-8ed8-37750cd342ed req-66fe74c0-7b11-4c14-a0d5-ca6710206095 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "201e0019-00bc-43c6-ab2d-b899dc6a9010", "tag": "530c695f-2423-40a9-8b15-e4419cb3ace0"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:22:33.112508 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-01d7604f-0e98-469e-8ed8-37750cd342ed req-66fe74c0-7b11-4c14-a0d5-ca6710206095 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:33.113175 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-01d7604f-0e98-469e-8ed8-37750cd342ed req-66fe74c0-7b11-4c14-a0d5-ca6710206095 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:33.130948 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-01d7604f-0e98-469e-8ed8-37750cd342ed req-66fe74c0-7b11-4c14-a0d5-ca6710206095 service nova] Creating event network-changed:530c695f-2423-40a9-8b15-e4419cb3ace0 for instance 201e0019-00bc-43c6-ab2d-b899dc6a9010 on nch1-master-1 Apr 16 21:22:33.132278 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-01d7604f-0e98-469e-8ed8-37750cd342ed req-66fe74c0-7b11-4c14-a0d5-ca6710206095 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.222856 Apr 16 21:22:33.133358 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1980/4113] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:22:33.395197 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3eafe68b-705c-4fb9-a02e-0168cd07b835 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:33.396599 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3eafe68b-705c-4fb9-a02e-0168cd07b835 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] [instance: 201e0019-00bc-43c6-ab2d-b899dc6a9010] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:33.411497 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4a2cb6a4-3832-4e62-9906-8738c124d214 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:33.412240 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4a2cb6a4-3832-4e62-9906-8738c124d214 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] [instance: 0246e469-bac2-4e9f-bd3f-bd5e1e60618f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:33.415921 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3eafe68b-705c-4fb9-a02e-0168cd07b835 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:33.416544 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3eafe68b-705c-4fb9-a02e-0168cd07b835 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:33.419391 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3eafe68b-705c-4fb9-a02e-0168cd07b835 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:33.419849 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3eafe68b-705c-4fb9-a02e-0168cd07b835 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:33.426160 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4a2cb6a4-3832-4e62-9906-8738c124d214 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:33.426574 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4a2cb6a4-3832-4e62-9906-8738c124d214 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:33.427618 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4a2cb6a4-3832-4e62-9906-8738c124d214 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:33.428253 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4a2cb6a4-3832-4e62-9906-8738c124d214 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:33.609474 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3eafe68b-705c-4fb9-a02e-0168cd07b835 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ce0f9acbb14b538d7c10e56a9c7d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030f0824ca84b97a7fef26a7384e775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:33.631256 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3eafe68b-705c-4fb9-a02e-0168cd07b835 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] 10.222.0.20 "GET /compute/v2.1/servers/201e0019-00bc-43c6-ab2d-b899dc6a9010" status: 200 len: 1312 microversion: 2.1 time: 0.240886 Apr 16 21:22:33.645466 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2134/4114] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:22:33 2022] GET /compute/v2.1/servers/201e0019-00bc-43c6-ab2d-b899dc6a9010 => generated 1312 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:22:34.091150 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4a2cb6a4-3832-4e62-9906-8738c124d214 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:34.101577 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4a2cb6a4-3832-4e62-9906-8738c124d214 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:34.103512 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4a2cb6a4-3832-4e62-9906-8738c124d214 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:34.104680 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4a2cb6a4-3832-4e62-9906-8738c124d214 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] 10.222.0.20 "GET /compute/v2.1/servers/0246e469-bac2-4e9f-bd3f-bd5e1e60618f" status: 200 len: 1358 microversion: 2.21 time: 0.697823 Apr 16 21:22:34.115399 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1981/4115] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:22:33 2022] GET /compute/v2.1/servers/0246e469-bac2-4e9f-bd3f-bd5e1e60618f => generated 1358 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:22:34.654419 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ca0ef242-97cb-40f0-9f47-1e67c137daac tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:34.660554 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ca0ef242-97cb-40f0-9f47-1e67c137daac tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] [instance: 201e0019-00bc-43c6-ab2d-b899dc6a9010] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:34.667020 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ca0ef242-97cb-40f0-9f47-1e67c137daac tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:34.667492 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ca0ef242-97cb-40f0-9f47-1e67c137daac tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:34.668325 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ca0ef242-97cb-40f0-9f47-1e67c137daac tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:34.668776 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ca0ef242-97cb-40f0-9f47-1e67c137daac tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:35.112752 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ca0ef242-97cb-40f0-9f47-1e67c137daac tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ce0f9acbb14b538d7c10e56a9c7d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030f0824ca84b97a7fef26a7384e775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:35.124555 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-00c28b46-83c3-4ac8-ae68-3a614b22ef9f tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:35.127377 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-00c28b46-83c3-4ac8-ae68-3a614b22ef9f tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] [instance: 0246e469-bac2-4e9f-bd3f-bd5e1e60618f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:35.162724 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ca0ef242-97cb-40f0-9f47-1e67c137daac tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] 10.222.0.20 "GET /compute/v2.1/servers/201e0019-00bc-43c6-ab2d-b899dc6a9010" status: 200 len: 1312 microversion: 2.1 time: 0.515786 Apr 16 21:22:35.169034 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2135/4116] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:22:34 2022] GET /compute/v2.1/servers/201e0019-00bc-43c6-ab2d-b899dc6a9010 => generated 1312 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:22:35.169212 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-00c28b46-83c3-4ac8-ae68-3a614b22ef9f tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:35.171878 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-00c28b46-83c3-4ac8-ae68-3a614b22ef9f tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:35.173030 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-00c28b46-83c3-4ac8-ae68-3a614b22ef9f tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:35.176392 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-00c28b46-83c3-4ac8-ae68-3a614b22ef9f tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:35.740953 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-00c28b46-83c3-4ac8-ae68-3a614b22ef9f tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:35.755206 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-00c28b46-83c3-4ac8-ae68-3a614b22ef9f tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:35.757830 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-00c28b46-83c3-4ac8-ae68-3a614b22ef9f tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:35.761930 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-00c28b46-83c3-4ac8-ae68-3a614b22ef9f tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] 10.222.0.20 "GET /compute/v2.1/servers/0246e469-bac2-4e9f-bd3f-bd5e1e60618f" status: 200 len: 1358 microversion: 2.21 time: 0.642053 Apr 16 21:22:35.763240 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1982/4117] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:22:35 2022] GET /compute/v2.1/servers/0246e469-bac2-4e9f-bd3f-bd5e1e60618f => generated 1358 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:22:36.180465 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-dccc23d0-f470-4828-a25f-76fe5e3fc9a0 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:36.181901 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-dccc23d0-f470-4828-a25f-76fe5e3fc9a0 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] [instance: 201e0019-00bc-43c6-ab2d-b899dc6a9010] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:36.198453 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dccc23d0-f470-4828-a25f-76fe5e3fc9a0 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:36.200823 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dccc23d0-f470-4828-a25f-76fe5e3fc9a0 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:36.201915 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dccc23d0-f470-4828-a25f-76fe5e3fc9a0 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:36.205795 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dccc23d0-f470-4828-a25f-76fe5e3fc9a0 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:36.780928 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3e482ddc-a74e-4430-b049-48f7b8d3d6b9 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:36.781635 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3e482ddc-a74e-4430-b049-48f7b8d3d6b9 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] [instance: 0246e469-bac2-4e9f-bd3f-bd5e1e60618f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:36.799613 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e482ddc-a74e-4430-b049-48f7b8d3d6b9 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:36.800385 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e482ddc-a74e-4430-b049-48f7b8d3d6b9 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:36.801346 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e482ddc-a74e-4430-b049-48f7b8d3d6b9 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:36.801800 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e482ddc-a74e-4430-b049-48f7b8d3d6b9 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:37.077823 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-dccc23d0-f470-4828-a25f-76fe5e3fc9a0 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ce0f9acbb14b538d7c10e56a9c7d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030f0824ca84b97a7fef26a7384e775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:37.091913 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-dccc23d0-f470-4828-a25f-76fe5e3fc9a0 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] 10.222.0.20 "GET /compute/v2.1/servers/201e0019-00bc-43c6-ab2d-b899dc6a9010" status: 200 len: 1312 microversion: 2.1 time: 0.915920 Apr 16 21:22:37.093707 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2136/4118] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:22:36 2022] GET /compute/v2.1/servers/201e0019-00bc-43c6-ab2d-b899dc6a9010 => generated 1312 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:22:37.467484 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3e482ddc-a74e-4430-b049-48f7b8d3d6b9 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:37.483283 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3e482ddc-a74e-4430-b049-48f7b8d3d6b9 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:37.496424 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3e482ddc-a74e-4430-b049-48f7b8d3d6b9 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:37.501457 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3e482ddc-a74e-4430-b049-48f7b8d3d6b9 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] 10.222.0.20 "GET /compute/v2.1/servers/0246e469-bac2-4e9f-bd3f-bd5e1e60618f" status: 200 len: 1551 microversion: 2.21 time: 0.721682 Apr 16 21:22:37.504591 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1983/4119] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:22:36 2022] GET /compute/v2.1/servers/0246e469-bac2-4e9f-bd3f-bd5e1e60618f => generated 1551 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:22:37.527051 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a0e85957-f28c-4541-9cf5-32996204eeca tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:37.527804 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a0e85957-f28c-4541-9cf5-32996204eeca tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] [instance: 0246e469-bac2-4e9f-bd3f-bd5e1e60618f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:37.536104 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a0e85957-f28c-4541-9cf5-32996204eeca tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:37.536583 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a0e85957-f28c-4541-9cf5-32996204eeca tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:37.537404 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a0e85957-f28c-4541-9cf5-32996204eeca tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:37.539896 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a0e85957-f28c-4541-9cf5-32996204eeca tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:37.580165 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a0e85957-f28c-4541-9cf5-32996204eeca tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] [instance: 0246e469-bac2-4e9f-bd3f-bd5e1e60618f] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:22:38.031349 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a0e85957-f28c-4541-9cf5-32996204eeca tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0246e469-bac2-4e9f-bd3f-bd5e1e60618f" status: 204 len: 0 microversion: 2.21 time: 0.508487 Apr 16 21:22:38.032219 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2137/4120] 10.222.0.20 () {60 vars in 1279 bytes} [Sat Apr 16 21:22:37 2022] DELETE /compute/v2.1/servers/0246e469-bac2-4e9f-bd3f-bd5e1e60618f => generated 0 bytes in 510 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 16 21:22:38.046886 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-680f266b-58ec-4b28-a901-43a1ec96bafd tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:38.048410 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-680f266b-58ec-4b28-a901-43a1ec96bafd tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] [instance: 0246e469-bac2-4e9f-bd3f-bd5e1e60618f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:38.071164 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-680f266b-58ec-4b28-a901-43a1ec96bafd tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:38.071857 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-680f266b-58ec-4b28-a901-43a1ec96bafd tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:38.075799 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-680f266b-58ec-4b28-a901-43a1ec96bafd tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:38.076292 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-680f266b-58ec-4b28-a901-43a1ec96bafd tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:38.111116 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c8dc6792-e9c7-4d98-8031-57a5dde4e16a tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:38.111823 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c8dc6792-e9c7-4d98-8031-57a5dde4e16a tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] [instance: 201e0019-00bc-43c6-ab2d-b899dc6a9010] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:38.131885 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c8dc6792-e9c7-4d98-8031-57a5dde4e16a tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:38.132258 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c8dc6792-e9c7-4d98-8031-57a5dde4e16a tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:38.133059 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c8dc6792-e9c7-4d98-8031-57a5dde4e16a tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:38.138598 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c8dc6792-e9c7-4d98-8031-57a5dde4e16a tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:38.352156 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-680f266b-58ec-4b28-a901-43a1ec96bafd tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:38.365205 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-680f266b-58ec-4b28-a901-43a1ec96bafd tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:38.371718 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-680f266b-58ec-4b28-a901-43a1ec96bafd tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:38.377973 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-680f266b-58ec-4b28-a901-43a1ec96bafd tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] 10.222.0.20 "GET /compute/v2.1/servers/0246e469-bac2-4e9f-bd3f-bd5e1e60618f" status: 200 len: 1557 microversion: 2.21 time: 0.337352 Apr 16 21:22:38.381099 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1984/4121] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:22:38 2022] GET /compute/v2.1/servers/0246e469-bac2-4e9f-bd3f-bd5e1e60618f => generated 1557 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:22:38.885084 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c8dc6792-e9c7-4d98-8031-57a5dde4e16a tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ce0f9acbb14b538d7c10e56a9c7d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030f0824ca84b97a7fef26a7384e775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:38.895333 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c8dc6792-e9c7-4d98-8031-57a5dde4e16a tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] 10.222.0.20 "GET /compute/v2.1/servers/201e0019-00bc-43c6-ab2d-b899dc6a9010" status: 200 len: 1312 microversion: 2.1 time: 0.788615 Apr 16 21:22:38.905041 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2138/4122] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:22:38 2022] GET /compute/v2.1/servers/201e0019-00bc-43c6-ab2d-b899dc6a9010 => generated 1312 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:22:39.403488 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f9571f40-38b7-47c3-81bf-76de530d5ebd tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:39.403488 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f9571f40-38b7-47c3-81bf-76de530d5ebd tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] [instance: 0246e469-bac2-4e9f-bd3f-bd5e1e60618f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:39.411200 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f9571f40-38b7-47c3-81bf-76de530d5ebd tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:39.411935 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f9571f40-38b7-47c3-81bf-76de530d5ebd tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:39.413867 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f9571f40-38b7-47c3-81bf-76de530d5ebd tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:39.414479 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f9571f40-38b7-47c3-81bf-76de530d5ebd tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:39.920880 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-99c82bbb-c84b-48e3-8c94-d38a8cab314d tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:39.921489 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-99c82bbb-c84b-48e3-8c94-d38a8cab314d tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] [instance: 201e0019-00bc-43c6-ab2d-b899dc6a9010] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:39.929054 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-99c82bbb-c84b-48e3-8c94-d38a8cab314d tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:39.929523 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-99c82bbb-c84b-48e3-8c94-d38a8cab314d tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:39.930361 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-99c82bbb-c84b-48e3-8c94-d38a8cab314d tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:39.930810 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-99c82bbb-c84b-48e3-8c94-d38a8cab314d tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:39.944686 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f9571f40-38b7-47c3-81bf-76de530d5ebd tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:39.960781 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f9571f40-38b7-47c3-81bf-76de530d5ebd tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:39.960781 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f9571f40-38b7-47c3-81bf-76de530d5ebd tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:39.963421 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f9571f40-38b7-47c3-81bf-76de530d5ebd tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] 10.222.0.20 "GET /compute/v2.1/servers/0246e469-bac2-4e9f-bd3f-bd5e1e60618f" status: 200 len: 1557 microversion: 2.21 time: 0.568894 Apr 16 21:22:39.966727 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1985/4123] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:22:39 2022] GET /compute/v2.1/servers/0246e469-bac2-4e9f-bd3f-bd5e1e60618f => generated 1557 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:22:39.976836 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-c0c6402f-a6e0-4e37-9274-d6f6f920fad8 req-f23368cf-c3a5-4c63-a6c3-06ba46d2c51d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "201e0019-00bc-43c6-ab2d-b899dc6a9010", "name": "network-vif-plugged", "status": "completed", "tag": "530c695f-2423-40a9-8b15-e4419cb3ace0"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:22:40.001012 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-c0c6402f-a6e0-4e37-9274-d6f6f920fad8 req-f23368cf-c3a5-4c63-a6c3-06ba46d2c51d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:40.001474 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-c0c6402f-a6e0-4e37-9274-d6f6f920fad8 req-f23368cf-c3a5-4c63-a6c3-06ba46d2c51d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:40.025744 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-c0c6402f-a6e0-4e37-9274-d6f6f920fad8 req-f23368cf-c3a5-4c63-a6c3-06ba46d2c51d service nova] Creating event network-vif-plugged:530c695f-2423-40a9-8b15-e4419cb3ace0 for instance 201e0019-00bc-43c6-ab2d-b899dc6a9010 on nch1-master-1 Apr 16 21:22:40.040154 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-c0c6402f-a6e0-4e37-9274-d6f6f920fad8 req-f23368cf-c3a5-4c63-a6c3-06ba46d2c51d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071758 Apr 16 21:22:40.040809 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1986/4124] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:22:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:22:40.316386 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-99c82bbb-c84b-48e3-8c94-d38a8cab314d tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ce0f9acbb14b538d7c10e56a9c7d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030f0824ca84b97a7fef26a7384e775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:40.337208 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-99c82bbb-c84b-48e3-8c94-d38a8cab314d tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] 10.222.0.20 "GET /compute/v2.1/servers/201e0019-00bc-43c6-ab2d-b899dc6a9010" status: 200 len: 1312 microversion: 2.1 time: 0.420112 Apr 16 21:22:40.341357 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2139/4125] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:22:39 2022] GET /compute/v2.1/servers/201e0019-00bc-43c6-ab2d-b899dc6a9010 => generated 1312 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:22:40.985263 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5309d1c8-c486-4c5d-9dd2-3cab1e861119 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:40.987227 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5309d1c8-c486-4c5d-9dd2-3cab1e861119 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] [instance: 0246e469-bac2-4e9f-bd3f-bd5e1e60618f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:40.995687 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5309d1c8-c486-4c5d-9dd2-3cab1e861119 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:40.997976 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5309d1c8-c486-4c5d-9dd2-3cab1e861119 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:40.997976 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5309d1c8-c486-4c5d-9dd2-3cab1e861119 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:40.998557 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5309d1c8-c486-4c5d-9dd2-3cab1e861119 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:41.357681 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-aac451d6-e4b3-46c0-a9a1-96340d5b5340 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:41.358776 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-aac451d6-e4b3-46c0-a9a1-96340d5b5340 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] [instance: 201e0019-00bc-43c6-ab2d-b899dc6a9010] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:41.392164 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aac451d6-e4b3-46c0-a9a1-96340d5b5340 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:41.392675 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aac451d6-e4b3-46c0-a9a1-96340d5b5340 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:41.396762 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aac451d6-e4b3-46c0-a9a1-96340d5b5340 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:41.400477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aac451d6-e4b3-46c0-a9a1-96340d5b5340 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:41.415249 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5309d1c8-c486-4c5d-9dd2-3cab1e861119 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:41.437238 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5309d1c8-c486-4c5d-9dd2-3cab1e861119 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:41.441572 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5309d1c8-c486-4c5d-9dd2-3cab1e861119 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:41.452351 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5309d1c8-c486-4c5d-9dd2-3cab1e861119 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] 10.222.0.20 "GET /compute/v2.1/servers/0246e469-bac2-4e9f-bd3f-bd5e1e60618f" status: 200 len: 1557 microversion: 2.21 time: 0.471494 Apr 16 21:22:41.463342 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1987/4126] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:22:40 2022] GET /compute/v2.1/servers/0246e469-bac2-4e9f-bd3f-bd5e1e60618f => generated 1557 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:22:41.768329 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-14387a14-8384-4355-b2e1-f4dd2fa25956 req-e212ba9b-d60d-43d9-be9b-84d011a1a175 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0246e469-bac2-4e9f-bd3f-bd5e1e60618f", "name": "network-vif-deleted", "tag": "fcb5802b-1192-4604-ab1c-b9b0448c90c4"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:22:41.792260 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-14387a14-8384-4355-b2e1-f4dd2fa25956 req-e212ba9b-d60d-43d9-be9b-84d011a1a175 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:41.792822 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-14387a14-8384-4355-b2e1-f4dd2fa25956 req-e212ba9b-d60d-43d9-be9b-84d011a1a175 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:41.814386 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-14387a14-8384-4355-b2e1-f4dd2fa25956 req-e212ba9b-d60d-43d9-be9b-84d011a1a175 service nova] Creating event network-vif-deleted:fcb5802b-1192-4604-ab1c-b9b0448c90c4 for instance 0246e469-bac2-4e9f-bd3f-bd5e1e60618f on nch2-master-1 Apr 16 21:22:41.830424 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-14387a14-8384-4355-b2e1-f4dd2fa25956 req-e212ba9b-d60d-43d9-be9b-84d011a1a175 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065819 Apr 16 21:22:41.831760 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1988/4127] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:22:42.312378 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-aac451d6-e4b3-46c0-a9a1-96340d5b5340 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ce0f9acbb14b538d7c10e56a9c7d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030f0824ca84b97a7fef26a7384e775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:42.321578 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-aac451d6-e4b3-46c0-a9a1-96340d5b5340 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] 10.222.0.20 "GET /compute/v2.1/servers/201e0019-00bc-43c6-ab2d-b899dc6a9010" status: 200 len: 1312 microversion: 2.1 time: 0.968480 Apr 16 21:22:42.322513 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2140/4128] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:22:41 2022] GET /compute/v2.1/servers/201e0019-00bc-43c6-ab2d-b899dc6a9010 => generated 1312 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:22:42.471326 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-71b49c1c-4e9e-4649-a168-531480bb0ab5 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:42.472673 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-71b49c1c-4e9e-4649-a168-531480bb0ab5 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] [instance: 0246e469-bac2-4e9f-bd3f-bd5e1e60618f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:42.481480 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-71b49c1c-4e9e-4649-a168-531480bb0ab5 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:42.482208 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-71b49c1c-4e9e-4649-a168-531480bb0ab5 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:42.483212 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-71b49c1c-4e9e-4649-a168-531480bb0ab5 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:42.483774 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-71b49c1c-4e9e-4649-a168-531480bb0ab5 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:42.526233 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-71b49c1c-4e9e-4649-a168-531480bb0ab5 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:42.526896 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-71b49c1c-4e9e-4649-a168-531480bb0ab5 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:42.529574 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-71b49c1c-4e9e-4649-a168-531480bb0ab5 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lazy-loading 'fault' on Instance uuid 0246e469-bac2-4e9f-bd3f-bd5e1e60618f {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:22:42.594920 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-71b49c1c-4e9e-4649-a168-531480bb0ab5 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:42.604284 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-71b49c1c-4e9e-4649-a168-531480bb0ab5 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:42.611264 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-71b49c1c-4e9e-4649-a168-531480bb0ab5 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3f82207271649bca28448b01b65d59f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '138f1e73cc64451395e6c21d31f3615b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:42.613011 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-71b49c1c-4e9e-4649-a168-531480bb0ab5 tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] 10.222.0.20 "GET /compute/v2.1/servers/0246e469-bac2-4e9f-bd3f-bd5e1e60618f" status: 200 len: 1348 microversion: 2.21 time: 0.145904 Apr 16 21:22:42.613839 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1989/4129] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:22:42 2022] GET /compute/v2.1/servers/0246e469-bac2-4e9f-bd3f-bd5e1e60618f => generated 1348 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:22:43.339256 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-accc844e-fd90-431e-ad18-9d96a07be6af tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:43.339894 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-accc844e-fd90-431e-ad18-9d96a07be6af tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] [instance: 201e0019-00bc-43c6-ab2d-b899dc6a9010] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:43.353626 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-accc844e-fd90-431e-ad18-9d96a07be6af tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:43.354092 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-accc844e-fd90-431e-ad18-9d96a07be6af tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:43.357253 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-accc844e-fd90-431e-ad18-9d96a07be6af tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:43.357955 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-accc844e-fd90-431e-ad18-9d96a07be6af tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:43.633030 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5de452eb-2998-494b-97d0-867c89bcc9ab tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:43.633715 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5de452eb-2998-494b-97d0-867c89bcc9ab tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] [instance: 0246e469-bac2-4e9f-bd3f-bd5e1e60618f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:43.647727 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5de452eb-2998-494b-97d0-867c89bcc9ab tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:43.650365 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5de452eb-2998-494b-97d0-867c89bcc9ab tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:43.651508 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5de452eb-2998-494b-97d0-867c89bcc9ab tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:43.651961 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5de452eb-2998-494b-97d0-867c89bcc9ab tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:43.672776 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-5de452eb-2998-494b-97d0-867c89bcc9ab tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] HTTP exception thrown: Instance 0246e469-bac2-4e9f-bd3f-bd5e1e60618f could not be found. Apr 16 21:22:43.673704 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5de452eb-2998-494b-97d0-867c89bcc9ab tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Returning 404 to user: Instance 0246e469-bac2-4e9f-bd3f-bd5e1e60618f could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:22:43.674753 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5de452eb-2998-494b-97d0-867c89bcc9ab tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] 10.222.0.20 "GET /compute/v2.1/servers/0246e469-bac2-4e9f-bd3f-bd5e1e60618f" status: 404 len: 111 microversion: 2.21 time: 0.047114 Apr 16 21:22:43.676055 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1990/4130] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:22:43 2022] GET /compute/v2.1/servers/0246e469-bac2-4e9f-bd3f-bd5e1e60618f => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:22:43.716389 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-680ad471-1c86-4e95-931a-1aa56801c81b tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Calling method '.version_select at 0x7fbb95758550>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:43.723137 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-680ad471-1c86-4e95-931a-1aa56801c81b tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] [instance: 0246e469-bac2-4e9f-bd3f-bd5e1e60618f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:43.741958 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-680ad471-1c86-4e95-931a-1aa56801c81b tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:43.744778 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-680ad471-1c86-4e95-931a-1aa56801c81b tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:43.751066 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-680ad471-1c86-4e95-931a-1aa56801c81b tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:43.751066 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-680ad471-1c86-4e95-931a-1aa56801c81b tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:43.900488 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-680ad471-1c86-4e95-931a-1aa56801c81b tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] 10.222.0.20 "GET /compute/v2.1/servers/0246e469-bac2-4e9f-bd3f-bd5e1e60618f/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.215042 Apr 16 21:22:43.901367 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1991/4131] 10.222.0.20 () {60 vars in 1336 bytes} [Sat Apr 16 21:22:43 2022] GET /compute/v2.1/servers/0246e469-bac2-4e9f-bd3f-bd5e1e60618f/os-instance-actions => generated 611 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:22:43.916957 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-26bb6f07-1b83-4ed5-a734-6854945ed0ca tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:43.917526 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-26bb6f07-1b83-4ed5-a734-6854945ed0ca tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] [instance: 0246e469-bac2-4e9f-bd3f-bd5e1e60618f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:43.924875 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-26bb6f07-1b83-4ed5-a734-6854945ed0ca tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:43.925612 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-26bb6f07-1b83-4ed5-a734-6854945ed0ca tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:43.926644 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-26bb6f07-1b83-4ed5-a734-6854945ed0ca tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:43.931509 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-accc844e-fd90-431e-ad18-9d96a07be6af tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ce0f9acbb14b538d7c10e56a9c7d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030f0824ca84b97a7fef26a7384e775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:43.935525 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-26bb6f07-1b83-4ed5-a734-6854945ed0ca tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:43.943097 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-accc844e-fd90-431e-ad18-9d96a07be6af tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] 10.222.0.20 "GET /compute/v2.1/servers/201e0019-00bc-43c6-ab2d-b899dc6a9010" status: 200 len: 1496 microversion: 2.1 time: 0.609229 Apr 16 21:22:43.944449 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2141/4132] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:22:43 2022] GET /compute/v2.1/servers/201e0019-00bc-43c6-ab2d-b899dc6a9010 => generated 1496 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:22:43.969580 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-31ef2bad-762e-4c38-be16-f88ac5404e8c tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:44.000584 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-26bb6f07-1b83-4ed5-a734-6854945ed0ca tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] HTTP exception thrown: Instance 0246e469-bac2-4e9f-bd3f-bd5e1e60618f could not be found. Apr 16 21:22:44.003643 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-26bb6f07-1b83-4ed5-a734-6854945ed0ca tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Returning 404 to user: Instance 0246e469-bac2-4e9f-bd3f-bd5e1e60618f could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:22:44.012436 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-26bb6f07-1b83-4ed5-a734-6854945ed0ca tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0246e469-bac2-4e9f-bd3f-bd5e1e60618f" status: 404 len: 111 microversion: 2.21 time: 0.097725 Apr 16 21:22:44.013067 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1992/4133] 10.222.0.20 () {60 vars in 1279 bytes} [Sat Apr 16 21:22:43 2022] DELETE /compute/v2.1/servers/0246e469-bac2-4e9f-bd3f-bd5e1e60618f => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 16 21:22:44.029525 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.compute.server_groups [None req-31ef2bad-762e-4c38-be16-f88ac5404e8c tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Querying cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) for 1 instances {{(pid=137408) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Apr 16 21:22:44.033975 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-31ef2bad-762e-4c38-be16-f88ac5404e8c tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:44.033975 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-31ef2bad-762e-4c38-be16-f88ac5404e8c tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:44.044578 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-89259ee8-8be5-453f-b1e6-508b2787d44c tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:44.044578 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-89259ee8-8be5-453f-b1e6-508b2787d44c tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] [instance: 0246e469-bac2-4e9f-bd3f-bd5e1e60618f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:44.074233 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-89259ee8-8be5-453f-b1e6-508b2787d44c tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:44.074751 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-89259ee8-8be5-453f-b1e6-508b2787d44c tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:44.075515 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-89259ee8-8be5-453f-b1e6-508b2787d44c tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:44.075964 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-89259ee8-8be5-453f-b1e6-508b2787d44c tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:44.079361 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-31ef2bad-762e-4c38-be16-f88ac5404e8c tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/0303882f-271b-4675-829f-dd13d7cb78b4" status: 200 len: 222 microversion: 2.1 time: 0.116946 Apr 16 21:22:44.080750 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2142/4134] 10.222.0.20 () {58 vars in 1262 bytes} [Sat Apr 16 21:22:43 2022] GET /compute/v2.1/os-server-groups/0303882f-271b-4675-829f-dd13d7cb78b4 => generated 222 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:22:44.102448 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-79250514-124a-49c8-8936-34c2c74a9f6a tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:44.105018 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-79250514-124a-49c8-8936-34c2c74a9f6a tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] [instance: 201e0019-00bc-43c6-ab2d-b899dc6a9010] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:44.112701 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-89259ee8-8be5-453f-b1e6-508b2787d44c tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] HTTP exception thrown: Instance 0246e469-bac2-4e9f-bd3f-bd5e1e60618f could not be found. Apr 16 21:22:44.113587 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-89259ee8-8be5-453f-b1e6-508b2787d44c tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] Returning 404 to user: Instance 0246e469-bac2-4e9f-bd3f-bd5e1e60618f could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:22:44.114695 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-89259ee8-8be5-453f-b1e6-508b2787d44c tempest-InstanceActionsV221TestJSON-732140678 tempest-InstanceActionsV221TestJSON-732140678-project] 10.222.0.20 "GET /compute/v2.1/servers/0246e469-bac2-4e9f-bd3f-bd5e1e60618f" status: 404 len: 111 microversion: 2.21 time: 0.095693 Apr 16 21:22:44.116970 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1993/4135] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:22:44 2022] GET /compute/v2.1/servers/0246e469-bac2-4e9f-bd3f-bd5e1e60618f => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:22:44.123208 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-79250514-124a-49c8-8936-34c2c74a9f6a tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:44.131409 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-79250514-124a-49c8-8936-34c2c74a9f6a tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:44.132564 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-79250514-124a-49c8-8936-34c2c74a9f6a tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:44.133108 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-79250514-124a-49c8-8936-34c2c74a9f6a tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:44.204437 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-79250514-124a-49c8-8936-34c2c74a9f6a tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] [instance: 201e0019-00bc-43c6-ab2d-b899dc6a9010] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:22:44.769281 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-79250514-124a-49c8-8936-34c2c74a9f6a tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] 10.222.0.20 "DELETE /compute/v2.1/servers/201e0019-00bc-43c6-ab2d-b899dc6a9010" status: 204 len: 0 microversion: 2.1 time: 0.681917 Apr 16 21:22:44.771573 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2143/4136] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:22:44 2022] DELETE /compute/v2.1/servers/201e0019-00bc-43c6-ab2d-b899dc6a9010 => generated 0 bytes in 685 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:22:44.781693 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e77d5b51-71a0-440e-89d7-a4eceaee9f71 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:44.782309 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e77d5b51-71a0-440e-89d7-a4eceaee9f71 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] [instance: 201e0019-00bc-43c6-ab2d-b899dc6a9010] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:44.793858 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e77d5b51-71a0-440e-89d7-a4eceaee9f71 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:44.794356 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e77d5b51-71a0-440e-89d7-a4eceaee9f71 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:44.800250 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e77d5b51-71a0-440e-89d7-a4eceaee9f71 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:44.800250 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e77d5b51-71a0-440e-89d7-a4eceaee9f71 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:44.842976 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-07805a53-81d7-4e07-8cbe-0793d3acffa4 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Action: 'create', calling method: .version_select at 0x7fbba001d8b0>, body: {"keypair": {"name": "tempest-keypair-416702426"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:22:44.895297 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-07805a53-81d7-4e07-8cbe-0793d3acffa4 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Getting quotas for project 8548f70297f04c1489783de67671dba2. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:22:44.932649 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-07805a53-81d7-4e07-8cbe-0793d3acffa4 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Getting quotas for user aa437260d34444efa2cef4ea34f57a03 and project 8548f70297f04c1489783de67671dba2. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:22:45.332772 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e77d5b51-71a0-440e-89d7-a4eceaee9f71 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ce0f9acbb14b538d7c10e56a9c7d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030f0824ca84b97a7fef26a7384e775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:45.341080 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e77d5b51-71a0-440e-89d7-a4eceaee9f71 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] 10.222.0.20 "GET /compute/v2.1/servers/201e0019-00bc-43c6-ab2d-b899dc6a9010" status: 200 len: 1502 microversion: 2.1 time: 0.564416 Apr 16 21:22:45.346340 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1994/4137] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:22:44 2022] GET /compute/v2.1/servers/201e0019-00bc-43c6-ab2d-b899dc6a9010 => generated 1502 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:22:45.465102 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-07805a53-81d7-4e07-8cbe-0793d3acffa4 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Getting quotas for project 8548f70297f04c1489783de67671dba2. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:22:45.470855 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-07805a53-81d7-4e07-8cbe-0793d3acffa4 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Getting quotas for user aa437260d34444efa2cef4ea34f57a03 and project 8548f70297f04c1489783de67671dba2. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:22:45.486783 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-07805a53-81d7-4e07-8cbe-0793d3acffa4 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.42 time: 0.648378 Apr 16 21:22:45.491259 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2144/4138] 10.222.0.20 () {62 vars in 1198 bytes} [Sat Apr 16 21:22:44 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 651 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 16 21:22:46.359240 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4e57f2c9-4a6a-4dee-afbd-75be720ca580 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:46.360341 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4e57f2c9-4a6a-4dee-afbd-75be720ca580 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] [instance: 201e0019-00bc-43c6-ab2d-b899dc6a9010] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:46.370869 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4e57f2c9-4a6a-4dee-afbd-75be720ca580 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:46.371340 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4e57f2c9-4a6a-4dee-afbd-75be720ca580 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:46.377953 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4e57f2c9-4a6a-4dee-afbd-75be720ca580 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:46.377953 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4e57f2c9-4a6a-4dee-afbd-75be720ca580 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:46.515714 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5c03ed3d-7b3d-4fe2-863f-571264f772a1 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Action: 'create', calling method: .version_select at 0x7fbb95c741f0>, body: {"keypair": {"name": "tempest-keypair-1745634766"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:22:46.547032 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-5c03ed3d-7b3d-4fe2-863f-571264f772a1 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Getting quotas for project 86582d8437084e4e95b3078888c21e23. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:22:46.558887 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-5c03ed3d-7b3d-4fe2-863f-571264f772a1 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Getting quotas for user 30c7e918d195437091a7d73821c0ed39 and project 86582d8437084e4e95b3078888c21e23. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:22:46.880302 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4e57f2c9-4a6a-4dee-afbd-75be720ca580 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ce0f9acbb14b538d7c10e56a9c7d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030f0824ca84b97a7fef26a7384e775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:46.888256 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4e57f2c9-4a6a-4dee-afbd-75be720ca580 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] 10.222.0.20 "GET /compute/v2.1/servers/201e0019-00bc-43c6-ab2d-b899dc6a9010" status: 200 len: 1502 microversion: 2.1 time: 0.533042 Apr 16 21:22:46.888829 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2145/4139] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:22:46 2022] GET /compute/v2.1/servers/201e0019-00bc-43c6-ab2d-b899dc6a9010 => generated 1502 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:22:47.132396 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-bca61664-ce8e-4f03-b287-33fc358b7c8a req-d3ee8d21-fcee-4f13-9a64-b21959bbd837 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "201e0019-00bc-43c6-ab2d-b899dc6a9010", "name": "network-vif-deleted", "tag": "530c695f-2423-40a9-8b15-e4419cb3ace0"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:22:47.144679 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-bca61664-ce8e-4f03-b287-33fc358b7c8a req-d3ee8d21-fcee-4f13-9a64-b21959bbd837 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:47.146331 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-bca61664-ce8e-4f03-b287-33fc358b7c8a req-d3ee8d21-fcee-4f13-9a64-b21959bbd837 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:47.209124 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-bca61664-ce8e-4f03-b287-33fc358b7c8a req-d3ee8d21-fcee-4f13-9a64-b21959bbd837 service nova] Creating event network-vif-deleted:530c695f-2423-40a9-8b15-e4419cb3ace0 for instance 201e0019-00bc-43c6-ab2d-b899dc6a9010 on nch1-master-1 Apr 16 21:22:47.221762 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-bca61664-ce8e-4f03-b287-33fc358b7c8a req-d3ee8d21-fcee-4f13-9a64-b21959bbd837 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101160 Apr 16 21:22:47.242017 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2146/4140] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:22:47.577201 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-5c03ed3d-7b3d-4fe2-863f-571264f772a1 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Getting quotas for project 86582d8437084e4e95b3078888c21e23. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:22:47.585363 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-5c03ed3d-7b3d-4fe2-863f-571264f772a1 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Getting quotas for user 30c7e918d195437091a7d73821c0ed39 and project 86582d8437084e4e95b3078888c21e23. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:22:47.605487 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5c03ed3d-7b3d-4fe2-863f-571264f772a1 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 1.536969 Apr 16 21:22:47.606287 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1995/4141] 10.222.0.20 () {60 vars in 1157 bytes} [Sat Apr 16 21:22:46 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 1538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:22:47.911366 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d2971cce-9f46-4e8c-9623-cb4cfb4d7c80 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:47.911366 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d2971cce-9f46-4e8c-9623-cb4cfb4d7c80 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] [instance: 201e0019-00bc-43c6-ab2d-b899dc6a9010] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:47.936576 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d2971cce-9f46-4e8c-9623-cb4cfb4d7c80 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:47.938172 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d2971cce-9f46-4e8c-9623-cb4cfb4d7c80 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:47.941310 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d2971cce-9f46-4e8c-9623-cb4cfb4d7c80 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:47.942328 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d2971cce-9f46-4e8c-9623-cb4cfb4d7c80 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:48.005070 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d2971cce-9f46-4e8c-9623-cb4cfb4d7c80 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:48.005529 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d2971cce-9f46-4e8c-9623-cb4cfb4d7c80 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:48.006180 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-d2971cce-9f46-4e8c-9623-cb4cfb4d7c80 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lazy-loading 'fault' on Instance uuid 201e0019-00bc-43c6-ab2d-b899dc6a9010 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:22:48.066151 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d2971cce-9f46-4e8c-9623-cb4cfb4d7c80 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '31ce0f9acbb14b538d7c10e56a9c7d98', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4030f0824ca84b97a7fef26a7384e775', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:48.074634 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d2971cce-9f46-4e8c-9623-cb4cfb4d7c80 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] 10.222.0.20 "GET /compute/v2.1/servers/201e0019-00bc-43c6-ab2d-b899dc6a9010" status: 200 len: 1302 microversion: 2.1 time: 0.172321 Apr 16 21:22:48.084823 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2147/4142] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:22:47 2022] GET /compute/v2.1/servers/201e0019-00bc-43c6-ab2d-b899dc6a9010 => generated 1302 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:22:49.092671 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4cba31a9-b3e0-4163-b473-66852a646674 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:49.093293 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4cba31a9-b3e0-4163-b473-66852a646674 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] [instance: 201e0019-00bc-43c6-ab2d-b899dc6a9010] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:49.110971 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4cba31a9-b3e0-4163-b473-66852a646674 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:49.111355 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4cba31a9-b3e0-4163-b473-66852a646674 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:49.112166 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4cba31a9-b3e0-4163-b473-66852a646674 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:49.112638 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4cba31a9-b3e0-4163-b473-66852a646674 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:49.169529 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-4cba31a9-b3e0-4163-b473-66852a646674 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] HTTP exception thrown: Instance 201e0019-00bc-43c6-ab2d-b899dc6a9010 could not be found. Apr 16 21:22:49.170223 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4cba31a9-b3e0-4163-b473-66852a646674 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Returning 404 to user: Instance 201e0019-00bc-43c6-ab2d-b899dc6a9010 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:22:49.172586 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4cba31a9-b3e0-4163-b473-66852a646674 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] 10.222.0.20 "GET /compute/v2.1/servers/201e0019-00bc-43c6-ab2d-b899dc6a9010" status: 404 len: 111 microversion: 2.1 time: 0.084101 Apr 16 21:22:49.175720 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1996/4143] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:22:49 2022] GET /compute/v2.1/servers/201e0019-00bc-43c6-ab2d-b899dc6a9010 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:22:49.185543 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a24c1944-7e10-4c3c-ab5f-a4516d9053bb tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:49.235987 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.compute.server_groups [None req-a24c1944-7e10-4c3c-ab5f-a4516d9053bb tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Querying cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) for 1 instances {{(pid=137408) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Apr 16 21:22:49.237024 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a24c1944-7e10-4c3c-ab5f-a4516d9053bb tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:49.237567 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a24c1944-7e10-4c3c-ab5f-a4516d9053bb tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:49.263823 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a24c1944-7e10-4c3c-ab5f-a4516d9053bb tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.082780 Apr 16 21:22:49.265260 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2148/4144] 10.222.0.20 () {58 vars in 1151 bytes} [Sat Apr 16 21:22:49 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:22:49.279413 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4ebc4511-fe2f-45db-a727-f2a933310a48 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:49.327418 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.compute.server_groups [None req-4ebc4511-fe2f-45db-a727-f2a933310a48 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Querying cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) for 1 instances {{(pid=137409) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Apr 16 21:22:49.332233 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4ebc4511-fe2f-45db-a727-f2a933310a48 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:49.338714 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4ebc4511-fe2f-45db-a727-f2a933310a48 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:49.364825 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4ebc4511-fe2f-45db-a727-f2a933310a48 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/0303882f-271b-4675-829f-dd13d7cb78b4" status: 200 len: 184 microversion: 2.1 time: 0.090589 Apr 16 21:22:49.370530 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1997/4145] 10.222.0.20 () {58 vars in 1262 bytes} [Sat Apr 16 21:22:49 2022] GET /compute/v2.1/os-server-groups/0303882f-271b-4675-829f-dd13d7cb78b4 => generated 184 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:22:49.383790 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-06e413b3-1c49-4b60-990b-a3efc8fdfcb8 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:49.384446 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-06e413b3-1c49-4b60-990b-a3efc8fdfcb8 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] [instance: 201e0019-00bc-43c6-ab2d-b899dc6a9010] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:49.391639 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-06e413b3-1c49-4b60-990b-a3efc8fdfcb8 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:49.392958 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-06e413b3-1c49-4b60-990b-a3efc8fdfcb8 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:49.393954 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-06e413b3-1c49-4b60-990b-a3efc8fdfcb8 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:49.394599 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-06e413b3-1c49-4b60-990b-a3efc8fdfcb8 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:49.418751 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-06e413b3-1c49-4b60-990b-a3efc8fdfcb8 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] HTTP exception thrown: Instance 201e0019-00bc-43c6-ab2d-b899dc6a9010 could not be found. Apr 16 21:22:49.419718 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-06e413b3-1c49-4b60-990b-a3efc8fdfcb8 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Returning 404 to user: Instance 201e0019-00bc-43c6-ab2d-b899dc6a9010 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:22:49.421099 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-06e413b3-1c49-4b60-990b-a3efc8fdfcb8 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] 10.222.0.20 "DELETE /compute/v2.1/servers/201e0019-00bc-43c6-ab2d-b899dc6a9010" status: 404 len: 111 microversion: 2.1 time: 0.043687 Apr 16 21:22:49.421971 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2149/4146] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:22:49 2022] DELETE /compute/v2.1/servers/201e0019-00bc-43c6-ab2d-b899dc6a9010 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:22:49.439550 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-481c7eb0-0edc-4081-ad17-ddba82725d20 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:49.440186 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-481c7eb0-0edc-4081-ad17-ddba82725d20 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] [instance: 201e0019-00bc-43c6-ab2d-b899dc6a9010] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:49.447303 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-481c7eb0-0edc-4081-ad17-ddba82725d20 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:49.447766 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-481c7eb0-0edc-4081-ad17-ddba82725d20 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:49.448669 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-481c7eb0-0edc-4081-ad17-ddba82725d20 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:49.449119 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-481c7eb0-0edc-4081-ad17-ddba82725d20 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:49.482647 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-481c7eb0-0edc-4081-ad17-ddba82725d20 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] HTTP exception thrown: Instance 201e0019-00bc-43c6-ab2d-b899dc6a9010 could not be found. Apr 16 21:22:49.483259 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-481c7eb0-0edc-4081-ad17-ddba82725d20 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Returning 404 to user: Instance 201e0019-00bc-43c6-ab2d-b899dc6a9010 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:22:49.484436 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-481c7eb0-0edc-4081-ad17-ddba82725d20 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] 10.222.0.20 "GET /compute/v2.1/servers/201e0019-00bc-43c6-ab2d-b899dc6a9010" status: 404 len: 111 microversion: 2.1 time: 0.048542 Apr 16 21:22:49.493303 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1998/4147] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:22:49 2022] GET /compute/v2.1/servers/201e0019-00bc-43c6-ab2d-b899dc6a9010 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:22:49.507838 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-23ea5350-4c76-4964-baa5-753be1611c1f tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:49.534433 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-23ea5350-4c76-4964-baa5-753be1611c1f tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] HTTP exception thrown: Instance group a9a8808a-edb1-40a6-93c2-dd5b3d2c886f could not be found. Apr 16 21:22:49.535061 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-23ea5350-4c76-4964-baa5-753be1611c1f tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Returning 404 to user: Instance group a9a8808a-edb1-40a6-93c2-dd5b3d2c886f could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:22:49.537946 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-23ea5350-4c76-4964-baa5-753be1611c1f tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/a9a8808a-edb1-40a6-93c2-dd5b3d2c886f" status: 404 len: 117 microversion: 2.1 time: 0.039820 Apr 16 21:22:49.540196 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2150/4148] 10.222.0.20 () {58 vars in 1265 bytes} [Sat Apr 16 21:22:49 2022] DELETE /compute/v2.1/os-server-groups/a9a8808a-edb1-40a6-93c2-dd5b3d2c886f => generated 117 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:22:49.548204 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-597e32d9-eac3-4553-8726-760f76360a70 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:49.564731 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-597e32d9-eac3-4553-8726-760f76360a70 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] HTTP exception thrown: Instance group 98f6da04-d031-4bc2-87b4-411355710fc9 could not be found. Apr 16 21:22:49.565464 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-597e32d9-eac3-4553-8726-760f76360a70 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Returning 404 to user: Instance group 98f6da04-d031-4bc2-87b4-411355710fc9 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:22:49.566331 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-597e32d9-eac3-4553-8726-760f76360a70 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/98f6da04-d031-4bc2-87b4-411355710fc9" status: 404 len: 117 microversion: 2.1 time: 0.022798 Apr 16 21:22:49.566908 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 1999/4149] 10.222.0.20 () {58 vars in 1265 bytes} [Sat Apr 16 21:22:49 2022] DELETE /compute/v2.1/os-server-groups/98f6da04-d031-4bc2-87b4-411355710fc9 => generated 117 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:22:49.575802 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7cd09dcd-9631-4b71-8923-c06c965d3798 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:49.591594 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-7cd09dcd-9631-4b71-8923-c06c965d3798 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] HTTP exception thrown: Instance group 5ed8e799-9770-4c0a-af19-ece9c0783a2a could not be found. Apr 16 21:22:49.592249 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7cd09dcd-9631-4b71-8923-c06c965d3798 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Returning 404 to user: Instance group 5ed8e799-9770-4c0a-af19-ece9c0783a2a could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:22:49.593062 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7cd09dcd-9631-4b71-8923-c06c965d3798 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/5ed8e799-9770-4c0a-af19-ece9c0783a2a" status: 404 len: 117 microversion: 2.1 time: 0.021280 Apr 16 21:22:49.599456 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2151/4150] 10.222.0.20 () {58 vars in 1265 bytes} [Sat Apr 16 21:22:49 2022] DELETE /compute/v2.1/os-server-groups/5ed8e799-9770-4c0a-af19-ece9c0783a2a => generated 117 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:22:49.603234 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4c63f775-3528-4475-9096-12ab2c215c77 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:49.614529 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-4c63f775-3528-4475-9096-12ab2c215c77 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] HTTP exception thrown: Instance group 45321737-bd1e-4548-90cb-83494ef5b6c2 could not be found. Apr 16 21:22:49.618096 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4c63f775-3528-4475-9096-12ab2c215c77 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Returning 404 to user: Instance group 45321737-bd1e-4548-90cb-83494ef5b6c2 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:22:49.619075 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4c63f775-3528-4475-9096-12ab2c215c77 tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/45321737-bd1e-4548-90cb-83494ef5b6c2" status: 404 len: 117 microversion: 2.1 time: 0.021314 Apr 16 21:22:49.620033 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2000/4151] 10.222.0.20 () {58 vars in 1265 bytes} [Sat Apr 16 21:22:49 2022] DELETE /compute/v2.1/os-server-groups/45321737-bd1e-4548-90cb-83494ef5b6c2 => generated 117 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:22:49.629335 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b9da98ff-aab3-44e6-bb54-f777575cff0a tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:49.759554 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b9da98ff-aab3-44e6-bb54-f777575cff0a tempest-ServerGroupTestJSON-2081775317 tempest-ServerGroupTestJSON-2081775317-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/0303882f-271b-4675-829f-dd13d7cb78b4" status: 204 len: 0 microversion: 2.1 time: 0.134611 Apr 16 21:22:49.760869 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2152/4152] 10.222.0.20 () {58 vars in 1265 bytes} [Sat Apr 16 21:22:49 2022] DELETE /compute/v2.1/os-server-groups/0303882f-271b-4675-829f-dd13d7cb78b4 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:22:49.782030 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d010e609-74a2-4aa1-b034-962930eb76b3 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1411794341", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "281ab511-837a-41be-9f7f-2b7357e9479c"}, {"port": "c1abc7d3-63c4-4e58-896c-5aa4b9a41054", "tag": "port-1"}, {"port": "5e9adf2d-0b03-4f92-88ae-35b824faa4fe", "tag": "port-2"}, {"uuid": "6d8e73d8-d6c7-4dd3-8e4f-4a076e97f1d7", "tag": "net-1"}, {"uuid": "6d8e73d8-d6c7-4dd3-8e4f-4a076e97f1d7"}, {"uuid": "e542be96-fc30-4cda-9476-07d2b2bc4e28", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "e542be96-fc30-4cda-9476-07d2b2bc4e28", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "0762402c-a0d6-4894-bf49-142a2b216d88", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "a5b02d5b-1ae7-485e-932d-d5a4cbbdf02c", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "4bf759bc-60a0-4375-9c3a-38f91859fd27", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--885836556"}], "key_name": "tempest-keypair-416702426", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:22:49.998806 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-d010e609-74a2-4aa1-b034-962930eb76b3 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] validate_networks() for [('281ab511-837a-41be-9f7f-2b7357e9479c', None, None, None, None, None), (None, None, 'c1abc7d3-63c4-4e58-896c-5aa4b9a41054', None, None, None), (None, None, '5e9adf2d-0b03-4f92-88ae-35b824faa4fe', None, None, None), ('6d8e73d8-d6c7-4dd3-8e4f-4a076e97f1d7', None, None, None, None, None), ('6d8e73d8-d6c7-4dd3-8e4f-4a076e97f1d7', None, None, None, None, None), ('e542be96-fc30-4cda-9476-07d2b2bc4e28', '10.2.2.100', None, None, None, None), ('e542be96-fc30-4cda-9476-07d2b2bc4e28', '10.2.2.200', None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:22:50.245789 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ae171cea-7db6-439e-9f3c-d4616d8ccf3e tempest-MultipleCreateNegativeTestJSON-554431931 tempest-MultipleCreateNegativeTestJSON-554431931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1449378835", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:22:50.247747 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-ae171cea-7db6-439e-9f3c-d4616d8ccf3e tempest-MultipleCreateNegativeTestJSON-554431931 tempest-MultipleCreateNegativeTestJSON-554431931-project] HTTP exception thrown: min_count must be <= max_count Apr 16 21:22:50.248355 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ae171cea-7db6-439e-9f3c-d4616d8ccf3e tempest-MultipleCreateNegativeTestJSON-554431931 tempest-MultipleCreateNegativeTestJSON-554431931-project] Returning 400 to user: min_count must be <= max_count {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:22:50.249774 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ae171cea-7db6-439e-9f3c-d4616d8ccf3e tempest-MultipleCreateNegativeTestJSON-554431931 tempest-MultipleCreateNegativeTestJSON-554431931-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.184121 Apr 16 21:22:50.256458 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2153/4153] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:22:50 2022] POST /compute/v2.1/servers => generated 74 bytes in 192 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Apr 16 21:22:50.316086 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-728bfdf1-278d-417c-88f6-e749bc622320 tempest-MultipleCreateNegativeTestJSON-554431931 tempest-MultipleCreateNegativeTestJSON-554431931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1708193316", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "max_count": 0}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:22:50.317614 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-728bfdf1-278d-417c-88f6-e749bc622320 tempest-MultipleCreateNegativeTestJSON-554431931 tempest-MultipleCreateNegativeTestJSON-554431931-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:22:50.318800 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-728bfdf1-278d-417c-88f6-e749bc622320 tempest-MultipleCreateNegativeTestJSON-554431931 tempest-MultipleCreateNegativeTestJSON-554431931-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.007480 Apr 16 21:22:50.319708 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2154/4154] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:22:50 2022] POST /compute/v2.1/servers => generated 130 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 16 21:22:50.387082 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-58409b48-4e0c-4f93-893e-7109a81319a5 tempest-MultipleCreateNegativeTestJSON-554431931 tempest-MultipleCreateNegativeTestJSON-554431931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1123833293", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "max_count": 2.5}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:22:50.389157 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-58409b48-4e0c-4f93-893e-7109a81319a5 tempest-MultipleCreateNegativeTestJSON-554431931 tempest-MultipleCreateNegativeTestJSON-554431931-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:22:50.390478 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-58409b48-4e0c-4f93-893e-7109a81319a5 tempest-MultipleCreateNegativeTestJSON-554431931 tempest-MultipleCreateNegativeTestJSON-554431931-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.008214 Apr 16 21:22:50.391215 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2155/4155] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:22:50 2022] POST /compute/v2.1/servers => generated 139 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 16 21:22:50.463944 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d43269ae-f634-44bc-a70d-41b2e4a670d6 tempest-MultipleCreateNegativeTestJSON-554431931 tempest-MultipleCreateNegativeTestJSON-554431931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-690362846", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "min_count": 0}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:22:50.466326 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d43269ae-f634-44bc-a70d-41b2e4a670d6 tempest-MultipleCreateNegativeTestJSON-554431931 tempest-MultipleCreateNegativeTestJSON-554431931-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:22:50.467684 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d43269ae-f634-44bc-a70d-41b2e4a670d6 tempest-MultipleCreateNegativeTestJSON-554431931 tempest-MultipleCreateNegativeTestJSON-554431931-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.009124 Apr 16 21:22:50.472750 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2156/4156] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:22:50 2022] POST /compute/v2.1/servers => generated 130 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:22:50.551287 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-402d2dbf-b0e1-4a93-8c5c-0b6a63631446 tempest-MultipleCreateNegativeTestJSON-554431931 tempest-MultipleCreateNegativeTestJSON-554431931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-888538107", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "min_count": 2.5}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:22:50.552925 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-402d2dbf-b0e1-4a93-8c5c-0b6a63631446 tempest-MultipleCreateNegativeTestJSON-554431931 tempest-MultipleCreateNegativeTestJSON-554431931-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:22:50.553779 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-402d2dbf-b0e1-4a93-8c5c-0b6a63631446 tempest-MultipleCreateNegativeTestJSON-554431931 tempest-MultipleCreateNegativeTestJSON-554431931-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.007414 Apr 16 21:22:50.554941 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2157/4157] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:22:50 2022] POST /compute/v2.1/servers => generated 139 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 16 21:22:52.673302 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-31e938e0-6fd8-4a29-b834-f5aef20eb568 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-811955249", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "5fb5cf29-8796-41a2-8375-e8062a5911ad"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:22:52.754688 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-31e938e0-6fd8-4a29-b834-f5aef20eb568 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] validate_networks() for [('5fb5cf29-8796-41a2-8375-e8062a5911ad', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:22:53.381522 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-31e938e0-6fd8-4a29-b834-f5aef20eb568 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:22:53.382464 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-31e938e0-6fd8-4a29-b834-f5aef20eb568 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:22:53.382956 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-31e938e0-6fd8-4a29-b834-f5aef20eb568 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:22:53.383375 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-31e938e0-6fd8-4a29-b834-f5aef20eb568 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:22:53.383839 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-31e938e0-6fd8-4a29-b834-f5aef20eb568 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:22:53.395423 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-31e938e0-6fd8-4a29-b834-f5aef20eb568 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:53.402769 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-31e938e0-6fd8-4a29-b834-f5aef20eb568 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:53.402769 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-31e938e0-6fd8-4a29-b834-f5aef20eb568 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:53.402769 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-31e938e0-6fd8-4a29-b834-f5aef20eb568 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:53.431786 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-31e938e0-6fd8-4a29-b834-f5aef20eb568 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Getting quotas for project 7caf6e59a47149a68cae6224fb2856e7. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:22:53.443083 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-31e938e0-6fd8-4a29-b834-f5aef20eb568 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Getting quotas for user e069f136dcb344b197f58ba47722f4d5 and project 7caf6e59a47149a68cae6224fb2856e7. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:22:53.458770 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-31e938e0-6fd8-4a29-b834-f5aef20eb568 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:22:53.462927 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-31e938e0-6fd8-4a29-b834-f5aef20eb568 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 4f303c2c-bb2f-4b3e-8d4f-a21552472a60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:22:53.690625 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-31e938e0-6fd8-4a29-b834-f5aef20eb568 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.416410 Apr 16 21:22:53.696457 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2158/4158] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:22:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1423 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:22:53.702417 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5b026305-cc43-44cb-aebc-e3bc4e728a64 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "c5dd6cd4-e61c-4a70-a23c-e5c99d6b19b1"}], "security_groups": [{"name": "tempest-securitygroup--1256487528"}], "key_name": "tempest-keypair-1745634766", "user_data": "}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:22:53.822614 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-5b026305-cc43-44cb-aebc-e3bc4e728a64 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] validate_networks() for [('c5dd6cd4-e61c-4a70-a23c-e5c99d6b19b1', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:22:54.141446 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-d010e609-74a2-4aa1-b034-962930eb76b3 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:22:54.141911 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-d010e609-74a2-4aa1-b034-962930eb76b3 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:22:54.142598 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-d010e609-74a2-4aa1-b034-962930eb76b3 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:22:54.143018 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-d010e609-74a2-4aa1-b034-962930eb76b3 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:22:54.143550 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-d010e609-74a2-4aa1-b034-962930eb76b3 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:22:54.159841 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d010e609-74a2-4aa1-b034-962930eb76b3 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:54.160487 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d010e609-74a2-4aa1-b034-962930eb76b3 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:54.161437 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d010e609-74a2-4aa1-b034-962930eb76b3 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:54.161888 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d010e609-74a2-4aa1-b034-962930eb76b3 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:54.183474 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-d010e609-74a2-4aa1-b034-962930eb76b3 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Getting quotas for project 8548f70297f04c1489783de67671dba2. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:22:54.189394 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-d010e609-74a2-4aa1-b034-962930eb76b3 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Getting quotas for user aa437260d34444efa2cef4ea34f57a03 and project 8548f70297f04c1489783de67671dba2. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:22:54.316114 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-5b026305-cc43-44cb-aebc-e3bc4e728a64 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:22:54.316611 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-5b026305-cc43-44cb-aebc-e3bc4e728a64 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:22:54.317116 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-5b026305-cc43-44cb-aebc-e3bc4e728a64 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:22:54.317741 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-5b026305-cc43-44cb-aebc-e3bc4e728a64 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:22:54.318160 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-5b026305-cc43-44cb-aebc-e3bc4e728a64 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:22:54.327304 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5b026305-cc43-44cb-aebc-e3bc4e728a64 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:54.327909 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5b026305-cc43-44cb-aebc-e3bc4e728a64 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:54.328849 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5b026305-cc43-44cb-aebc-e3bc4e728a64 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:54.329347 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5b026305-cc43-44cb-aebc-e3bc4e728a64 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:54.347598 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-5b026305-cc43-44cb-aebc-e3bc4e728a64 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Getting quotas for project 86582d8437084e4e95b3078888c21e23. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:22:54.353391 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-5b026305-cc43-44cb-aebc-e3bc4e728a64 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Getting quotas for user 30c7e918d195437091a7d73821c0ed39 and project 86582d8437084e4e95b3078888c21e23. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:22:54.362696 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d010e609-74a2-4aa1-b034-962930eb76b3 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:22:54.365485 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d010e609-74a2-4aa1-b034-962930eb76b3 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='0762402c-a0d6-4894-bf49-142a2b216d88',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='a5b02d5b-1ae7-485e-932d-d5a4cbbdf02c',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4bf759bc-60a0-4375-9c3a-38f91859fd27',volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:22:54.371440 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5b026305-cc43-44cb-aebc-e3bc4e728a64 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:22:54.373910 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5b026305-cc43-44cb-aebc-e3bc4e728a64 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] [instance: 084a71df-04de-416c-a9cb-4a4aacb94f86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:22:54.566268 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5b026305-cc43-44cb-aebc-e3bc4e728a64 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.868489 Apr 16 21:22:54.567057 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2159/4159] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:22:53 2022] POST /compute/v2.1/servers => generated 409 bytes in 870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:22:54.573076 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f7c80d15-2ac2-4f4e-8d89-1d48bc2d7a67 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:54.574493 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f7c80d15-2ac2-4f4e-8d89-1d48bc2d7a67 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 4f303c2c-bb2f-4b3e-8d4f-a21552472a60] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:54.636069 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f7c80d15-2ac2-4f4e-8d89-1d48bc2d7a67 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:54.645099 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f7c80d15-2ac2-4f4e-8d89-1d48bc2d7a67 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/4f303c2c-bb2f-4b3e-8d4f-a21552472a60" status: 200 len: 1214 microversion: 2.1 time: 0.076935 Apr 16 21:22:54.646529 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2160/4160] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:22:54 2022] GET /compute/v2.1/servers/4f303c2c-bb2f-4b3e-8d4f-a21552472a60 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:22:54.651903 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1946323c-6f29-46a0-bc17-278c5abeeb55 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:54.652909 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1946323c-6f29-46a0-bc17-278c5abeeb55 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] [instance: 084a71df-04de-416c-a9cb-4a4aacb94f86] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:54.745564 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1946323c-6f29-46a0-bc17-278c5abeeb55 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7e918d195437091a7d73821c0ed39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86582d8437084e4e95b3078888c21e23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:54.755842 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1946323c-6f29-46a0-bc17-278c5abeeb55 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] 10.222.0.20 "GET /compute/v2.1/servers/084a71df-04de-416c-a9cb-4a4aacb94f86" status: 200 len: 1226 microversion: 2.1 time: 0.107475 Apr 16 21:22:54.760296 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2161/4161] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:22:54 2022] GET /compute/v2.1/servers/084a71df-04de-416c-a9cb-4a4aacb94f86 => generated 1226 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:22:55.665568 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e61ca828-5437-49ae-a982-cd3ec0f5971c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:55.666367 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e61ca828-5437-49ae-a982-cd3ec0f5971c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 4f303c2c-bb2f-4b3e-8d4f-a21552472a60] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:55.674764 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e61ca828-5437-49ae-a982-cd3ec0f5971c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:55.675413 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e61ca828-5437-49ae-a982-cd3ec0f5971c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:55.691093 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e61ca828-5437-49ae-a982-cd3ec0f5971c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:55.694846 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e61ca828-5437-49ae-a982-cd3ec0f5971c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:55.837111 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d010e609-74a2-4aa1-b034-962930eb76b3 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.42 time: 6.059281 Apr 16 21:22:55.839933 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2001/4162] 10.222.0.20 () {62 vars in 1188 bytes} [Sat Apr 16 21:22:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 6063 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 16 21:22:55.850228 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cbaebb1e-07d4-4d68-987c-a4e44bbe1940 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:55.851883 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-cbaebb1e-07d4-4d68-987c-a4e44bbe1940 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] [instance: 084a71df-04de-416c-a9cb-4a4aacb94f86] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:55.877659 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e61ca828-5437-49ae-a982-cd3ec0f5971c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:55.923393 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e61ca828-5437-49ae-a982-cd3ec0f5971c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/4f303c2c-bb2f-4b3e-8d4f-a21552472a60" status: 200 len: 1218 microversion: 2.1 time: 0.262773 Apr 16 21:22:55.932905 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2162/4163] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:22:55 2022] GET /compute/v2.1/servers/4f303c2c-bb2f-4b3e-8d4f-a21552472a60 => generated 1218 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:22:55.949393 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-11a627f0-0f38-44cf-a1f0-84a5a912f286 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:55.953381 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-11a627f0-0f38-44cf-a1f0-84a5a912f286 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:55.975469 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cbaebb1e-07d4-4d68-987c-a4e44bbe1940 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7e918d195437091a7d73821c0ed39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86582d8437084e4e95b3078888c21e23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:55.983584 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cbaebb1e-07d4-4d68-987c-a4e44bbe1940 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] 10.222.0.20 "GET /compute/v2.1/servers/084a71df-04de-416c-a9cb-4a4aacb94f86" status: 200 len: 1226 microversion: 2.1 time: 0.142500 Apr 16 21:22:55.986915 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2002/4164] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:22:55 2022] GET /compute/v2.1/servers/084a71df-04de-416c-a9cb-4a4aacb94f86 => generated 1226 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:22:56.044326 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-11a627f0-0f38-44cf-a1f0-84a5a912f286 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:56.053913 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-11a627f0-0f38-44cf-a1f0-84a5a912f286 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:56.056634 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-11a627f0-0f38-44cf-a1f0-84a5a912f286 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:56.058427 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-11a627f0-0f38-44cf-a1f0-84a5a912f286 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1285 microversion: 2.42 time: 0.124470 Apr 16 21:22:56.067590 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2163/4165] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:22:55 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1285 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:22:56.953496 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7134edf3-acf5-4661-80f5-2dde8d3f9a49 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:56.955080 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7134edf3-acf5-4661-80f5-2dde8d3f9a49 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 4f303c2c-bb2f-4b3e-8d4f-a21552472a60] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:56.987777 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7134edf3-acf5-4661-80f5-2dde8d3f9a49 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:56.988322 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7134edf3-acf5-4661-80f5-2dde8d3f9a49 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:56.990529 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7134edf3-acf5-4661-80f5-2dde8d3f9a49 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:57.000190 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7134edf3-acf5-4661-80f5-2dde8d3f9a49 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:57.001491 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7218bf21-1198-425d-8b51-f47f1420eb42 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:57.002361 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7218bf21-1198-425d-8b51-f47f1420eb42 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] [instance: 084a71df-04de-416c-a9cb-4a4aacb94f86] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:57.014678 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7218bf21-1198-425d-8b51-f47f1420eb42 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:57.033428 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7218bf21-1198-425d-8b51-f47f1420eb42 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:57.041954 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7218bf21-1198-425d-8b51-f47f1420eb42 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:57.043667 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7218bf21-1198-425d-8b51-f47f1420eb42 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:57.153124 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7134edf3-acf5-4661-80f5-2dde8d3f9a49 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:57.167851 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7134edf3-acf5-4661-80f5-2dde8d3f9a49 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/4f303c2c-bb2f-4b3e-8d4f-a21552472a60" status: 200 len: 1274 microversion: 2.1 time: 0.218238 Apr 16 21:22:57.169631 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2003/4166] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:22:56 2022] GET /compute/v2.1/servers/4f303c2c-bb2f-4b3e-8d4f-a21552472a60 => generated 1274 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:22:57.176926 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-74a8b9d7-c9fa-49a2-944d-603fc99108a3 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:57.177877 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-74a8b9d7-c9fa-49a2-944d-603fc99108a3 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:57.227151 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7218bf21-1198-425d-8b51-f47f1420eb42 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7e918d195437091a7d73821c0ed39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86582d8437084e4e95b3078888c21e23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:57.237974 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7218bf21-1198-425d-8b51-f47f1420eb42 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] 10.222.0.20 "GET /compute/v2.1/servers/084a71df-04de-416c-a9cb-4a4aacb94f86" status: 200 len: 1278 microversion: 2.1 time: 0.241078 Apr 16 21:22:57.239525 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2164/4167] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:22:56 2022] GET /compute/v2.1/servers/084a71df-04de-416c-a9cb-4a4aacb94f86 => generated 1278 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:22:57.309047 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-74a8b9d7-c9fa-49a2-944d-603fc99108a3 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:57.333068 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-74a8b9d7-c9fa-49a2-944d-603fc99108a3 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:57.336901 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-74a8b9d7-c9fa-49a2-944d-603fc99108a3 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:57.338241 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-74a8b9d7-c9fa-49a2-944d-603fc99108a3 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1285 microversion: 2.42 time: 0.167231 Apr 16 21:22:57.366471 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2004/4168] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:22:57 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1285 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:22:58.185789 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fd60e481-feca-4b96-936c-7b183e15f627 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:58.186757 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fd60e481-feca-4b96-936c-7b183e15f627 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 4f303c2c-bb2f-4b3e-8d4f-a21552472a60] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:58.194152 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fd60e481-feca-4b96-936c-7b183e15f627 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:58.194613 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fd60e481-feca-4b96-936c-7b183e15f627 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:58.195394 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fd60e481-feca-4b96-936c-7b183e15f627 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:58.195832 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fd60e481-feca-4b96-936c-7b183e15f627 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:58.255108 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b2031dad-a130-44c5-b764-d0e03ab1a30f tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:58.255734 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b2031dad-a130-44c5-b764-d0e03ab1a30f tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] [instance: 084a71df-04de-416c-a9cb-4a4aacb94f86] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:58.263699 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b2031dad-a130-44c5-b764-d0e03ab1a30f tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:58.265492 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b2031dad-a130-44c5-b764-d0e03ab1a30f tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:58.266447 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b2031dad-a130-44c5-b764-d0e03ab1a30f tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:58.266943 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b2031dad-a130-44c5-b764-d0e03ab1a30f tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:58.304075 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fd60e481-feca-4b96-936c-7b183e15f627 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:58.312021 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fd60e481-feca-4b96-936c-7b183e15f627 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/4f303c2c-bb2f-4b3e-8d4f-a21552472a60" status: 200 len: 1272 microversion: 2.1 time: 0.129960 Apr 16 21:22:58.312937 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2165/4169] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:22:58 2022] GET /compute/v2.1/servers/4f303c2c-bb2f-4b3e-8d4f-a21552472a60 => generated 1272 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:22:58.346580 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b2031dad-a130-44c5-b764-d0e03ab1a30f tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7e918d195437091a7d73821c0ed39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86582d8437084e4e95b3078888c21e23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:58.365308 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b2031dad-a130-44c5-b764-d0e03ab1a30f tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] 10.222.0.20 "GET /compute/v2.1/servers/084a71df-04de-416c-a9cb-4a4aacb94f86" status: 200 len: 1284 microversion: 2.1 time: 0.113972 Apr 16 21:22:58.367435 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2005/4170] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:22:58 2022] GET /compute/v2.1/servers/084a71df-04de-416c-a9cb-4a4aacb94f86 => generated 1284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:22:58.373618 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-245d85fa-8e45-4572-9dd9-b67c80ade3bb tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:58.374556 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-245d85fa-8e45-4572-9dd9-b67c80ade3bb tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:58.382319 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-245d85fa-8e45-4572-9dd9-b67c80ade3bb tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:58.382788 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-245d85fa-8e45-4572-9dd9-b67c80ade3bb tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:58.383747 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-245d85fa-8e45-4572-9dd9-b67c80ade3bb tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:58.384276 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-245d85fa-8e45-4572-9dd9-b67c80ade3bb tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:58.513958 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-245d85fa-8e45-4572-9dd9-b67c80ade3bb tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:58.527521 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-245d85fa-8e45-4572-9dd9-b67c80ade3bb tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:58.530273 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-245d85fa-8e45-4572-9dd9-b67c80ade3bb tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:58.531769 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-245d85fa-8e45-4572-9dd9-b67c80ade3bb tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1527 microversion: 2.42 time: 0.162670 Apr 16 21:22:58.532930 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2166/4171] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:22:58 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1527 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:22:59.332701 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c8edc4c2-8ad0-43e4-9176-e9f2d8a28edd tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:59.333504 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c8edc4c2-8ad0-43e4-9176-e9f2d8a28edd tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 4f303c2c-bb2f-4b3e-8d4f-a21552472a60] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:59.341967 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c8edc4c2-8ad0-43e4-9176-e9f2d8a28edd tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:59.342718 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c8edc4c2-8ad0-43e4-9176-e9f2d8a28edd tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:59.343768 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c8edc4c2-8ad0-43e4-9176-e9f2d8a28edd tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:59.344487 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c8edc4c2-8ad0-43e4-9176-e9f2d8a28edd tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:59.392015 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-21627379-d924-44b9-b975-cdb5b7091a50 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:59.393424 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-21627379-d924-44b9-b975-cdb5b7091a50 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] [instance: 084a71df-04de-416c-a9cb-4a4aacb94f86] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:59.420753 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-21627379-d924-44b9-b975-cdb5b7091a50 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:59.423296 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-21627379-d924-44b9-b975-cdb5b7091a50 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:59.424367 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-21627379-d924-44b9-b975-cdb5b7091a50 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:59.426898 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-21627379-d924-44b9-b975-cdb5b7091a50 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:59.690002 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-21627379-d924-44b9-b975-cdb5b7091a50 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7e918d195437091a7d73821c0ed39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86582d8437084e4e95b3078888c21e23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:59.713614 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-21627379-d924-44b9-b975-cdb5b7091a50 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] 10.222.0.20 "GET /compute/v2.1/servers/084a71df-04de-416c-a9cb-4a4aacb94f86" status: 200 len: 1284 microversion: 2.1 time: 0.332348 Apr 16 21:22:59.720806 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2167/4172] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:22:59 2022] GET /compute/v2.1/servers/084a71df-04de-416c-a9cb-4a4aacb94f86 => generated 1284 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:22:59.734130 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-46e6f99a-424e-4c01-9a2c-f110b0f3791e tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:22:59.736873 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-46e6f99a-424e-4c01-9a2c-f110b0f3791e tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:22:59.751186 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-46e6f99a-424e-4c01-9a2c-f110b0f3791e tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:59.754954 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-46e6f99a-424e-4c01-9a2c-f110b0f3791e tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:59.755905 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-46e6f99a-424e-4c01-9a2c-f110b0f3791e tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:22:59.760733 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-46e6f99a-424e-4c01-9a2c-f110b0f3791e tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:22:59.937233 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-46e6f99a-424e-4c01-9a2c-f110b0f3791e tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:59.951577 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-46e6f99a-424e-4c01-9a2c-f110b0f3791e tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:59.955469 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-46e6f99a-424e-4c01-9a2c-f110b0f3791e tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:22:59.957363 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-46e6f99a-424e-4c01-9a2c-f110b0f3791e tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1583 microversion: 2.42 time: 0.233704 Apr 16 21:22:59.973836 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2168/4173] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:22:59 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1583 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:23:00.229561 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c8edc4c2-8ad0-43e4-9176-e9f2d8a28edd tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:00.239294 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c8edc4c2-8ad0-43e4-9176-e9f2d8a28edd tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/4f303c2c-bb2f-4b3e-8d4f-a21552472a60" status: 200 len: 1314 microversion: 2.1 time: 0.910751 Apr 16 21:23:00.240758 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2006/4174] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:22:59 2022] GET /compute/v2.1/servers/4f303c2c-bb2f-4b3e-8d4f-a21552472a60 => generated 1314 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:00.742849 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0c432783-c716-402c-96dc-089f9a4c4a22 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:00.744094 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0c432783-c716-402c-96dc-089f9a4c4a22 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] [instance: 084a71df-04de-416c-a9cb-4a4aacb94f86] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:00.755247 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0c432783-c716-402c-96dc-089f9a4c4a22 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:00.755892 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0c432783-c716-402c-96dc-089f9a4c4a22 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:00.756730 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0c432783-c716-402c-96dc-089f9a4c4a22 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:00.760310 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0c432783-c716-402c-96dc-089f9a4c4a22 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:00.978024 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0428725e-d248-4a65-ae52-dafe1ad2149f tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:00.979441 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0428725e-d248-4a65-ae52-dafe1ad2149f tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:00.986121 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0428725e-d248-4a65-ae52-dafe1ad2149f tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:00.996789 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0428725e-d248-4a65-ae52-dafe1ad2149f tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:00.997901 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0428725e-d248-4a65-ae52-dafe1ad2149f tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:00.998518 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0428725e-d248-4a65-ae52-dafe1ad2149f tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:01.075500 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0c432783-c716-402c-96dc-089f9a4c4a22 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7e918d195437091a7d73821c0ed39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86582d8437084e4e95b3078888c21e23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:01.094846 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0c432783-c716-402c-96dc-089f9a4c4a22 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] 10.222.0.20 "GET /compute/v2.1/servers/084a71df-04de-416c-a9cb-4a4aacb94f86" status: 200 len: 1352 microversion: 2.1 time: 0.358774 Apr 16 21:23:01.097663 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2169/4175] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:00 2022] GET /compute/v2.1/servers/084a71df-04de-416c-a9cb-4a4aacb94f86 => generated 1352 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:01.110102 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-af9982b2-eeda-4398-a96c-95209140bd88 req-4b562e20-d5eb-4eb7-b6f0-54768f900b19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f303c2c-bb2f-4b3e-8d4f-a21552472a60", "tag": "e5b0a37b-72e1-4f9a-a7ed-e6bf6cf1ef03"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:23:01.135641 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-af9982b2-eeda-4398-a96c-95209140bd88 req-4b562e20-d5eb-4eb7-b6f0-54768f900b19 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:01.136708 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-af9982b2-eeda-4398-a96c-95209140bd88 req-4b562e20-d5eb-4eb7-b6f0-54768f900b19 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:01.172824 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-af9982b2-eeda-4398-a96c-95209140bd88 req-4b562e20-d5eb-4eb7-b6f0-54768f900b19 service nova] Creating event network-changed:e5b0a37b-72e1-4f9a-a7ed-e6bf6cf1ef03 for instance 4f303c2c-bb2f-4b3e-8d4f-a21552472a60 on nch2-master-1 Apr 16 21:23:01.190126 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-af9982b2-eeda-4398-a96c-95209140bd88 req-4b562e20-d5eb-4eb7-b6f0-54768f900b19 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090981 Apr 16 21:23:01.195073 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2170/4176] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:23:01.264252 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7bad5af5-db6a-4aec-b2bc-0339e7fd14c8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:01.264949 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7bad5af5-db6a-4aec-b2bc-0339e7fd14c8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 4f303c2c-bb2f-4b3e-8d4f-a21552472a60] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:01.280035 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7bad5af5-db6a-4aec-b2bc-0339e7fd14c8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:01.280035 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7bad5af5-db6a-4aec-b2bc-0339e7fd14c8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:01.284355 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7bad5af5-db6a-4aec-b2bc-0339e7fd14c8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:01.288479 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7bad5af5-db6a-4aec-b2bc-0339e7fd14c8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:01.554828 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0428725e-d248-4a65-ae52-dafe1ad2149f tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:01.566553 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0428725e-d248-4a65-ae52-dafe1ad2149f tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:01.575338 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0428725e-d248-4a65-ae52-dafe1ad2149f tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:01.578035 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0428725e-d248-4a65-ae52-dafe1ad2149f tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1593 microversion: 2.42 time: 0.605153 Apr 16 21:23:01.580668 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2007/4177] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:23:00 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1593 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:23:01.774618 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7bad5af5-db6a-4aec-b2bc-0339e7fd14c8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:01.786182 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7bad5af5-db6a-4aec-b2bc-0339e7fd14c8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/4f303c2c-bb2f-4b3e-8d4f-a21552472a60" status: 200 len: 1314 microversion: 2.1 time: 0.529757 Apr 16 21:23:01.796809 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2171/4178] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:01 2022] GET /compute/v2.1/servers/4f303c2c-bb2f-4b3e-8d4f-a21552472a60 => generated 1314 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:02.112858 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fbfa6c06-00d7-47e7-af1e-81317998d49b tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:02.114773 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-fbfa6c06-00d7-47e7-af1e-81317998d49b tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] [instance: 084a71df-04de-416c-a9cb-4a4aacb94f86] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:02.129223 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fbfa6c06-00d7-47e7-af1e-81317998d49b tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:02.133930 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fbfa6c06-00d7-47e7-af1e-81317998d49b tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:02.133930 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fbfa6c06-00d7-47e7-af1e-81317998d49b tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:02.133930 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fbfa6c06-00d7-47e7-af1e-81317998d49b tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:02.569272 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-fbfa6c06-00d7-47e7-af1e-81317998d49b tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7e918d195437091a7d73821c0ed39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86582d8437084e4e95b3078888c21e23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:02.577804 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fbfa6c06-00d7-47e7-af1e-81317998d49b tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] 10.222.0.20 "GET /compute/v2.1/servers/084a71df-04de-416c-a9cb-4a4aacb94f86" status: 200 len: 1352 microversion: 2.1 time: 0.468732 Apr 16 21:23:02.580244 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2008/4179] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:02 2022] GET /compute/v2.1/servers/084a71df-04de-416c-a9cb-4a4aacb94f86 => generated 1352 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:02.601537 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f77e3561-1bb6-40a7-bc86-d35cd0164037 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:02.602179 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f77e3561-1bb6-40a7-bc86-d35cd0164037 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:02.609106 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f77e3561-1bb6-40a7-bc86-d35cd0164037 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:02.609556 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f77e3561-1bb6-40a7-bc86-d35cd0164037 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:02.610532 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f77e3561-1bb6-40a7-bc86-d35cd0164037 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:02.611149 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f77e3561-1bb6-40a7-bc86-d35cd0164037 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:02.766790 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f77e3561-1bb6-40a7-bc86-d35cd0164037 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:02.782591 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f77e3561-1bb6-40a7-bc86-d35cd0164037 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:02.784950 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f77e3561-1bb6-40a7-bc86-d35cd0164037 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:02.786548 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f77e3561-1bb6-40a7-bc86-d35cd0164037 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1593 microversion: 2.42 time: 0.191337 Apr 16 21:23:02.803339 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-07b71618-685e-4861-b438-2508a2823a0b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:02.804609 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-07b71618-685e-4861-b438-2508a2823a0b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 4f303c2c-bb2f-4b3e-8d4f-a21552472a60] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:02.814842 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-07b71618-685e-4861-b438-2508a2823a0b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:02.815513 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-07b71618-685e-4861-b438-2508a2823a0b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:02.816535 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-07b71618-685e-4861-b438-2508a2823a0b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:02.821095 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2172/4180] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:23:02 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1593 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:23:02.827800 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-07b71618-685e-4861-b438-2508a2823a0b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:03.127430 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-07b71618-685e-4861-b438-2508a2823a0b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:03.136023 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-07b71618-685e-4861-b438-2508a2823a0b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/4f303c2c-bb2f-4b3e-8d4f-a21552472a60" status: 200 len: 1314 microversion: 2.1 time: 0.336672 Apr 16 21:23:03.145807 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2009/4181] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:02 2022] GET /compute/v2.1/servers/4f303c2c-bb2f-4b3e-8d4f-a21552472a60 => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:03.496716 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-750cb4df-3b44-47c3-8070-104a18665da2 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-982014866", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "a9010da2-54fb-4a1a-8688-b01d319eafbe"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:23:03.565318 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-750cb4df-3b44-47c3-8070-104a18665da2 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] validate_networks() for [('a9010da2-54fb-4a1a-8688-b01d319eafbe', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:23:03.596066 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-dfa37c6a-fa79-4c1f-9c59-f44cc80e89aa tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:03.596637 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-dfa37c6a-fa79-4c1f-9c59-f44cc80e89aa tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] [instance: 084a71df-04de-416c-a9cb-4a4aacb94f86] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:03.610895 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dfa37c6a-fa79-4c1f-9c59-f44cc80e89aa tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:03.612791 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dfa37c6a-fa79-4c1f-9c59-f44cc80e89aa tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:03.613958 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dfa37c6a-fa79-4c1f-9c59-f44cc80e89aa tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:03.615321 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dfa37c6a-fa79-4c1f-9c59-f44cc80e89aa tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:03.860834 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-dfa37c6a-fa79-4c1f-9c59-f44cc80e89aa tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7e918d195437091a7d73821c0ed39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86582d8437084e4e95b3078888c21e23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:03.875507 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-dfa37c6a-fa79-4c1f-9c59-f44cc80e89aa tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] 10.222.0.20 "GET /compute/v2.1/servers/084a71df-04de-416c-a9cb-4a4aacb94f86" status: 200 len: 1352 microversion: 2.1 time: 0.283294 Apr 16 21:23:03.880152 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2010/4182] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:03 2022] GET /compute/v2.1/servers/084a71df-04de-416c-a9cb-4a4aacb94f86 => generated 1352 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:23:03.897356 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8d379ff6-3471-4b2b-be52-aa1893dab606 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:03.909669 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8d379ff6-3471-4b2b-be52-aa1893dab606 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:03.922318 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8d379ff6-3471-4b2b-be52-aa1893dab606 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:03.923169 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8d379ff6-3471-4b2b-be52-aa1893dab606 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:03.926432 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8d379ff6-3471-4b2b-be52-aa1893dab606 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:03.927892 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8d379ff6-3471-4b2b-be52-aa1893dab606 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:04.337195 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8d379ff6-3471-4b2b-be52-aa1893dab606 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:04.356273 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8d379ff6-3471-4b2b-be52-aa1893dab606 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:04.358138 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8d379ff6-3471-4b2b-be52-aa1893dab606 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:04.359533 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8d379ff6-3471-4b2b-be52-aa1893dab606 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1660 microversion: 2.42 time: 0.475172 Apr 16 21:23:04.360351 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2011/4183] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:23:03 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1660 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:23:04.375118 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7e71c079-1b03-4a95-a8ee-71d641204682 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:04.375765 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7e71c079-1b03-4a95-a8ee-71d641204682 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 4f303c2c-bb2f-4b3e-8d4f-a21552472a60] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:04.393334 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7e71c079-1b03-4a95-a8ee-71d641204682 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:04.393967 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7e71c079-1b03-4a95-a8ee-71d641204682 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:04.394871 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7e71c079-1b03-4a95-a8ee-71d641204682 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:04.395413 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7e71c079-1b03-4a95-a8ee-71d641204682 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:04.680206 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7e71c079-1b03-4a95-a8ee-71d641204682 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:04.692852 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7e71c079-1b03-4a95-a8ee-71d641204682 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/4f303c2c-bb2f-4b3e-8d4f-a21552472a60" status: 200 len: 1314 microversion: 2.1 time: 0.331164 Apr 16 21:23:04.705339 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2012/4184] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:04 2022] GET /compute/v2.1/servers/4f303c2c-bb2f-4b3e-8d4f-a21552472a60 => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:04.721072 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-78e61260-c5f3-4214-8d90-7278b700b5b7 req-9553bf0e-69d0-4f20-af52-2b44f7c4e71d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "084a71df-04de-416c-a9cb-4a4aacb94f86", "tag": "6b41dfa1-0a5b-4329-af9c-dd8f41337861"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:23:04.732684 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-78e61260-c5f3-4214-8d90-7278b700b5b7 req-9553bf0e-69d0-4f20-af52-2b44f7c4e71d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:04.734075 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-78e61260-c5f3-4214-8d90-7278b700b5b7 req-9553bf0e-69d0-4f20-af52-2b44f7c4e71d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:04.753355 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-78e61260-c5f3-4214-8d90-7278b700b5b7 req-9553bf0e-69d0-4f20-af52-2b44f7c4e71d service nova] Creating event network-changed:6b41dfa1-0a5b-4329-af9c-dd8f41337861 for instance 084a71df-04de-416c-a9cb-4a4aacb94f86 on nch2-master-1 Apr 16 21:23:04.763935 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-78e61260-c5f3-4214-8d90-7278b700b5b7 req-9553bf0e-69d0-4f20-af52-2b44f7c4e71d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048440 Apr 16 21:23:04.770564 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2013/4185] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:23:04.897544 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d155466a-9998-4914-9e8d-7e89cfe78f82 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:04.898492 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d155466a-9998-4914-9e8d-7e89cfe78f82 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] [instance: 084a71df-04de-416c-a9cb-4a4aacb94f86] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:04.906053 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d155466a-9998-4914-9e8d-7e89cfe78f82 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:04.906807 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d155466a-9998-4914-9e8d-7e89cfe78f82 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:04.907811 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d155466a-9998-4914-9e8d-7e89cfe78f82 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:04.908436 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d155466a-9998-4914-9e8d-7e89cfe78f82 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:05.331830 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d155466a-9998-4914-9e8d-7e89cfe78f82 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7e918d195437091a7d73821c0ed39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86582d8437084e4e95b3078888c21e23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:05.349711 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d155466a-9998-4914-9e8d-7e89cfe78f82 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] 10.222.0.20 "GET /compute/v2.1/servers/084a71df-04de-416c-a9cb-4a4aacb94f86" status: 200 len: 1352 microversion: 2.1 time: 0.456510 Apr 16 21:23:05.350948 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2014/4186] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:04 2022] GET /compute/v2.1/servers/084a71df-04de-416c-a9cb-4a4aacb94f86 => generated 1352 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:23:05.378331 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6d7d921c-dda1-4061-95f3-b3073c010816 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:05.379184 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6d7d921c-dda1-4061-95f3-b3073c010816 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:05.385491 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6d7d921c-dda1-4061-95f3-b3073c010816 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:05.386164 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6d7d921c-dda1-4061-95f3-b3073c010816 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:05.387113 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6d7d921c-dda1-4061-95f3-b3073c010816 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:05.387740 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6d7d921c-dda1-4061-95f3-b3073c010816 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:05.985671 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6d7d921c-dda1-4061-95f3-b3073c010816 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:06.001141 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6d7d921c-dda1-4061-95f3-b3073c010816 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:06.003929 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6d7d921c-dda1-4061-95f3-b3073c010816 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:06.005408 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6d7d921c-dda1-4061-95f3-b3073c010816 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1706 microversion: 2.42 time: 0.631001 Apr 16 21:23:06.012077 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2015/4187] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:23:05 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1706 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:23:06.019648 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-dc5bccb3-fb6c-4963-90ac-fb1afdfb9b24 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:06.028375 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-dc5bccb3-fb6c-4963-90ac-fb1afdfb9b24 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 4f303c2c-bb2f-4b3e-8d4f-a21552472a60] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:06.047665 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dc5bccb3-fb6c-4963-90ac-fb1afdfb9b24 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:06.051287 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dc5bccb3-fb6c-4963-90ac-fb1afdfb9b24 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:06.053640 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dc5bccb3-fb6c-4963-90ac-fb1afdfb9b24 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:06.053640 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dc5bccb3-fb6c-4963-90ac-fb1afdfb9b24 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:06.090598 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-750cb4df-3b44-47c3-8070-104a18665da2 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:23:06.091125 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-750cb4df-3b44-47c3-8070-104a18665da2 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:23:06.091880 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-750cb4df-3b44-47c3-8070-104a18665da2 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:23:06.092551 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-750cb4df-3b44-47c3-8070-104a18665da2 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:23:06.094568 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-750cb4df-3b44-47c3-8070-104a18665da2 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:23:06.111604 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-750cb4df-3b44-47c3-8070-104a18665da2 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:06.113279 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-750cb4df-3b44-47c3-8070-104a18665da2 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:06.117750 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-750cb4df-3b44-47c3-8070-104a18665da2 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:06.117750 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-750cb4df-3b44-47c3-8070-104a18665da2 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:06.154089 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-750cb4df-3b44-47c3-8070-104a18665da2 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Getting quotas for project 7d72b2bb3a304796bb144bc739ffcb5a. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:23:06.176040 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-750cb4df-3b44-47c3-8070-104a18665da2 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Getting quotas for user cf7ad620035e4c9f97da1a1b445437b1 and project 7d72b2bb3a304796bb144bc739ffcb5a. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:23:06.196654 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-750cb4df-3b44-47c3-8070-104a18665da2 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:23:06.199699 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-750cb4df-3b44-47c3-8070-104a18665da2 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] [instance: 19297dff-d106-4813-8970-b6342085961c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:23:06.346506 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-750cb4df-3b44-47c3-8070-104a18665da2 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.855311 Apr 16 21:23:06.350703 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2173/4188] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:23:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 2861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:23:06.362019 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4dabed86-21b5-4369-8cc0-34e09d268603 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:06.362645 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4dabed86-21b5-4369-8cc0-34e09d268603 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] [instance: 19297dff-d106-4813-8970-b6342085961c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:06.482213 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-dc5bccb3-fb6c-4963-90ac-fb1afdfb9b24 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:06.496094 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-dc5bccb3-fb6c-4963-90ac-fb1afdfb9b24 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/4f303c2c-bb2f-4b3e-8d4f-a21552472a60" status: 200 len: 1314 microversion: 2.1 time: 0.480040 Apr 16 21:23:06.501666 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2016/4189] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:06 2022] GET /compute/v2.1/servers/4f303c2c-bb2f-4b3e-8d4f-a21552472a60 => generated 1314 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:06.511795 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4dabed86-21b5-4369-8cc0-34e09d268603 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7ad620035e4c9f97da1a1b445437b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d72b2bb3a304796bb144bc739ffcb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:06.521391 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0145bdc8-15a8-4b3b-ac7c-d89eb8caf11c tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:06.521699 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4dabed86-21b5-4369-8cc0-34e09d268603 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] 10.222.0.20 "GET /compute/v2.1/servers/19297dff-d106-4813-8970-b6342085961c" status: 200 len: 1213 microversion: 2.1 time: 0.164930 Apr 16 21:23:06.527692 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0145bdc8-15a8-4b3b-ac7c-d89eb8caf11c tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] [instance: 084a71df-04de-416c-a9cb-4a4aacb94f86] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:06.532777 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2174/4190] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:06 2022] GET /compute/v2.1/servers/19297dff-d106-4813-8970-b6342085961c => generated 1213 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:06.549823 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0145bdc8-15a8-4b3b-ac7c-d89eb8caf11c tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:06.551103 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0145bdc8-15a8-4b3b-ac7c-d89eb8caf11c tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:06.559520 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0145bdc8-15a8-4b3b-ac7c-d89eb8caf11c tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:06.560461 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0145bdc8-15a8-4b3b-ac7c-d89eb8caf11c tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:07.035885 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f6246d7a-59a7-47ea-a5c8-4870f09d00f1 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:07.036841 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f6246d7a-59a7-47ea-a5c8-4870f09d00f1 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:07.047419 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6246d7a-59a7-47ea-a5c8-4870f09d00f1 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:07.048645 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6246d7a-59a7-47ea-a5c8-4870f09d00f1 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:07.049850 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6246d7a-59a7-47ea-a5c8-4870f09d00f1 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:07.056578 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6246d7a-59a7-47ea-a5c8-4870f09d00f1 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:07.563208 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f6246d7a-59a7-47ea-a5c8-4870f09d00f1 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:07.577099 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f6246d7a-59a7-47ea-a5c8-4870f09d00f1 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:07.579353 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f6246d7a-59a7-47ea-a5c8-4870f09d00f1 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:07.580907 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f6246d7a-59a7-47ea-a5c8-4870f09d00f1 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1706 microversion: 2.42 time: 0.551340 Apr 16 21:23:07.582075 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2175/4191] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:23:07 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1706 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:23:07.589151 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-debee830-8cdc-4203-b7a4-6ca3391479ad tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:07.593112 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-debee830-8cdc-4203-b7a4-6ca3391479ad tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 4f303c2c-bb2f-4b3e-8d4f-a21552472a60] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:07.606477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-debee830-8cdc-4203-b7a4-6ca3391479ad tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:07.607130 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-debee830-8cdc-4203-b7a4-6ca3391479ad tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:07.607943 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-debee830-8cdc-4203-b7a4-6ca3391479ad tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:07.608419 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-debee830-8cdc-4203-b7a4-6ca3391479ad tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:07.880628 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0145bdc8-15a8-4b3b-ac7c-d89eb8caf11c tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7e918d195437091a7d73821c0ed39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86582d8437084e4e95b3078888c21e23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:07.900918 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0145bdc8-15a8-4b3b-ac7c-d89eb8caf11c tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] 10.222.0.20 "GET /compute/v2.1/servers/084a71df-04de-416c-a9cb-4a4aacb94f86" status: 200 len: 1352 microversion: 2.1 time: 1.385868 Apr 16 21:23:07.902999 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2017/4192] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:06 2022] GET /compute/v2.1/servers/084a71df-04de-416c-a9cb-4a4aacb94f86 => generated 1352 bytes in 1389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:07.910200 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3e41d732-6add-4813-96ee-09d54f6150e1 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:07.911141 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3e41d732-6add-4813-96ee-09d54f6150e1 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] [instance: 19297dff-d106-4813-8970-b6342085961c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:07.920270 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e41d732-6add-4813-96ee-09d54f6150e1 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:07.923669 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e41d732-6add-4813-96ee-09d54f6150e1 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:07.923669 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e41d732-6add-4813-96ee-09d54f6150e1 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:07.923669 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e41d732-6add-4813-96ee-09d54f6150e1 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:07.991631 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-debee830-8cdc-4203-b7a4-6ca3391479ad tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:08.002556 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-debee830-8cdc-4203-b7a4-6ca3391479ad tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/4f303c2c-bb2f-4b3e-8d4f-a21552472a60" status: 200 len: 1314 microversion: 2.1 time: 0.418796 Apr 16 21:23:08.023227 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2176/4193] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:07 2022] GET /compute/v2.1/servers/4f303c2c-bb2f-4b3e-8d4f-a21552472a60 => generated 1314 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:08.075151 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3e41d732-6add-4813-96ee-09d54f6150e1 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7ad620035e4c9f97da1a1b445437b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d72b2bb3a304796bb144bc739ffcb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:08.094747 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3e41d732-6add-4813-96ee-09d54f6150e1 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] 10.222.0.20 "GET /compute/v2.1/servers/19297dff-d106-4813-8970-b6342085961c" status: 200 len: 1217 microversion: 2.1 time: 0.181885 Apr 16 21:23:08.104142 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2018/4194] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:07 2022] GET /compute/v2.1/servers/19297dff-d106-4813-8970-b6342085961c => generated 1217 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:08.600858 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f0b1d141-dccf-4e13-8f4c-40b61918ecc8 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:08.602251 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f0b1d141-dccf-4e13-8f4c-40b61918ecc8 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:08.618210 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f0b1d141-dccf-4e13-8f4c-40b61918ecc8 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:08.619081 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f0b1d141-dccf-4e13-8f4c-40b61918ecc8 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:08.620128 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f0b1d141-dccf-4e13-8f4c-40b61918ecc8 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:08.620857 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f0b1d141-dccf-4e13-8f4c-40b61918ecc8 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:08.920894 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6fba115d-36ac-4a68-86e2-7a487f8a7fed tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:08.922896 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6fba115d-36ac-4a68-86e2-7a487f8a7fed tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] [instance: 084a71df-04de-416c-a9cb-4a4aacb94f86] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:08.934838 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6fba115d-36ac-4a68-86e2-7a487f8a7fed tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:08.937622 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6fba115d-36ac-4a68-86e2-7a487f8a7fed tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:08.940469 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6fba115d-36ac-4a68-86e2-7a487f8a7fed tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:08.941034 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6fba115d-36ac-4a68-86e2-7a487f8a7fed tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:09.603449 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f0b1d141-dccf-4e13-8f4c-40b61918ecc8 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:09.615252 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f0b1d141-dccf-4e13-8f4c-40b61918ecc8 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:09.626809 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f0b1d141-dccf-4e13-8f4c-40b61918ecc8 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:09.628060 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f0b1d141-dccf-4e13-8f4c-40b61918ecc8 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1740 microversion: 2.42 time: 1.031178 Apr 16 21:23:09.640218 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2177/4195] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:23:08 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1740 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:23:09.656547 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-35981d25-3974-4eeb-8f23-9b21af2a57fd tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:09.657262 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-35981d25-3974-4eeb-8f23-9b21af2a57fd tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 4f303c2c-bb2f-4b3e-8d4f-a21552472a60] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:09.678864 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-35981d25-3974-4eeb-8f23-9b21af2a57fd tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:09.679336 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-35981d25-3974-4eeb-8f23-9b21af2a57fd tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:09.680142 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-35981d25-3974-4eeb-8f23-9b21af2a57fd tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:09.687134 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-35981d25-3974-4eeb-8f23-9b21af2a57fd tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:09.991231 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-35981d25-3974-4eeb-8f23-9b21af2a57fd tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:09.994439 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-35981d25-3974-4eeb-8f23-9b21af2a57fd tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/4f303c2c-bb2f-4b3e-8d4f-a21552472a60" status: 200 len: 1314 microversion: 2.1 time: 0.364649 Apr 16 21:23:10.005781 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2178/4196] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:09 2022] GET /compute/v2.1/servers/4f303c2c-bb2f-4b3e-8d4f-a21552472a60 => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:10.011572 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c68ee1c3-823a-4b58-9067-ee82ccaf43d3 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:10.012225 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c68ee1c3-823a-4b58-9067-ee82ccaf43d3 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] [instance: 19297dff-d106-4813-8970-b6342085961c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:10.019230 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c68ee1c3-823a-4b58-9067-ee82ccaf43d3 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:10.019966 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c68ee1c3-823a-4b58-9067-ee82ccaf43d3 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:10.021093 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c68ee1c3-823a-4b58-9067-ee82ccaf43d3 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:10.021736 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c68ee1c3-823a-4b58-9067-ee82ccaf43d3 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:10.096567 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c68ee1c3-823a-4b58-9067-ee82ccaf43d3 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7ad620035e4c9f97da1a1b445437b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d72b2bb3a304796bb144bc739ffcb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:10.110100 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c68ee1c3-823a-4b58-9067-ee82ccaf43d3 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] 10.222.0.20 "GET /compute/v2.1/servers/19297dff-d106-4813-8970-b6342085961c" status: 200 len: 1271 microversion: 2.1 time: 0.099823 Apr 16 21:23:10.110100 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2179/4197] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:10 2022] GET /compute/v2.1/servers/19297dff-d106-4813-8970-b6342085961c => generated 1271 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:10.396566 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-6c289327-0143-4d14-9b5b-d2775e3d76d8 req-5780c204-7b1a-479d-a934-9cba0f5a80a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f303c2c-bb2f-4b3e-8d4f-a21552472a60", "name": "network-vif-plugged", "status": "completed", "tag": "e5b0a37b-72e1-4f9a-a7ed-e6bf6cf1ef03"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:23:10.415561 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-6c289327-0143-4d14-9b5b-d2775e3d76d8 req-5780c204-7b1a-479d-a934-9cba0f5a80a4 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:10.417185 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-6c289327-0143-4d14-9b5b-d2775e3d76d8 req-5780c204-7b1a-479d-a934-9cba0f5a80a4 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:10.449444 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-6c289327-0143-4d14-9b5b-d2775e3d76d8 req-5780c204-7b1a-479d-a934-9cba0f5a80a4 service nova] Creating event network-vif-plugged:e5b0a37b-72e1-4f9a-a7ed-e6bf6cf1ef03 for instance 4f303c2c-bb2f-4b3e-8d4f-a21552472a60 on nch2-master-1 Apr 16 21:23:10.465043 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-6c289327-0143-4d14-9b5b-d2775e3d76d8 req-5780c204-7b1a-479d-a934-9cba0f5a80a4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.354284 Apr 16 21:23:10.466719 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2180/4198] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:23:10.481871 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6fba115d-36ac-4a68-86e2-7a487f8a7fed tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7e918d195437091a7d73821c0ed39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86582d8437084e4e95b3078888c21e23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:10.495705 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6fba115d-36ac-4a68-86e2-7a487f8a7fed tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] 10.222.0.20 "GET /compute/v2.1/servers/084a71df-04de-416c-a9cb-4a4aacb94f86" status: 200 len: 1352 microversion: 2.1 time: 1.574962 Apr 16 21:23:10.496886 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2019/4199] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:08 2022] GET /compute/v2.1/servers/084a71df-04de-416c-a9cb-4a4aacb94f86 => generated 1352 bytes in 1582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:10.656035 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-236b9e17-1fec-4252-9a32-8b66fd95f461 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:10.659212 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-236b9e17-1fec-4252-9a32-8b66fd95f461 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:10.715785 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-236b9e17-1fec-4252-9a32-8b66fd95f461 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:10.717105 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-236b9e17-1fec-4252-9a32-8b66fd95f461 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:10.718661 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-236b9e17-1fec-4252-9a32-8b66fd95f461 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:10.719347 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-236b9e17-1fec-4252-9a32-8b66fd95f461 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:11.009220 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-236b9e17-1fec-4252-9a32-8b66fd95f461 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:11.011476 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-37a19549-3a0d-42e7-ac47-1a1c4b08a4dc tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:11.012342 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-37a19549-3a0d-42e7-ac47-1a1c4b08a4dc tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 4f303c2c-bb2f-4b3e-8d4f-a21552472a60] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:11.019489 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-236b9e17-1fec-4252-9a32-8b66fd95f461 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:11.021565 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-236b9e17-1fec-4252-9a32-8b66fd95f461 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:11.023536 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-236b9e17-1fec-4252-9a32-8b66fd95f461 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1740 microversion: 2.42 time: 0.375556 Apr 16 21:23:11.033802 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2181/4200] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:23:10 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1740 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:23:11.037653 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-37a19549-3a0d-42e7-ac47-1a1c4b08a4dc tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:11.038621 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-37a19549-3a0d-42e7-ac47-1a1c4b08a4dc tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:11.040533 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-37a19549-3a0d-42e7-ac47-1a1c4b08a4dc tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:11.043492 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-37a19549-3a0d-42e7-ac47-1a1c4b08a4dc tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:11.126966 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-951c6a71-8c41-4c6f-908e-75e0dfc9411c tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:11.128109 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-951c6a71-8c41-4c6f-908e-75e0dfc9411c tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] [instance: 19297dff-d106-4813-8970-b6342085961c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:11.141939 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-951c6a71-8c41-4c6f-908e-75e0dfc9411c tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:11.142700 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-951c6a71-8c41-4c6f-908e-75e0dfc9411c tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:11.143652 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-951c6a71-8c41-4c6f-908e-75e0dfc9411c tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:11.144449 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-951c6a71-8c41-4c6f-908e-75e0dfc9411c tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:11.434909 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-951c6a71-8c41-4c6f-908e-75e0dfc9411c tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7ad620035e4c9f97da1a1b445437b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d72b2bb3a304796bb144bc739ffcb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:11.446655 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-951c6a71-8c41-4c6f-908e-75e0dfc9411c tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] 10.222.0.20 "GET /compute/v2.1/servers/19297dff-d106-4813-8970-b6342085961c" status: 200 len: 1271 microversion: 2.1 time: 0.323412 Apr 16 21:23:11.448507 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2182/4201] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:11 2022] GET /compute/v2.1/servers/19297dff-d106-4813-8970-b6342085961c => generated 1271 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:23:11.514837 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-16ba8d9a-2ec5-4b13-849c-1b868d3c2942 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:11.515701 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-16ba8d9a-2ec5-4b13-849c-1b868d3c2942 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] [instance: 084a71df-04de-416c-a9cb-4a4aacb94f86] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:11.531232 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-16ba8d9a-2ec5-4b13-849c-1b868d3c2942 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:11.532416 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-16ba8d9a-2ec5-4b13-849c-1b868d3c2942 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:11.537170 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-16ba8d9a-2ec5-4b13-849c-1b868d3c2942 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:11.540876 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-16ba8d9a-2ec5-4b13-849c-1b868d3c2942 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:11.951530 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-16ba8d9a-2ec5-4b13-849c-1b868d3c2942 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7e918d195437091a7d73821c0ed39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86582d8437084e4e95b3078888c21e23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:11.991632 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-16ba8d9a-2ec5-4b13-849c-1b868d3c2942 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] 10.222.0.20 "GET /compute/v2.1/servers/084a71df-04de-416c-a9cb-4a4aacb94f86" status: 200 len: 1352 microversion: 2.1 time: 0.481517 Apr 16 21:23:11.999230 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2183/4202] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:11 2022] GET /compute/v2.1/servers/084a71df-04de-416c-a9cb-4a4aacb94f86 => generated 1352 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:23:12.047911 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-dc3c4eeb-07d8-4f0a-969a-dae368e0101b tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:12.049821 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-dc3c4eeb-07d8-4f0a-969a-dae368e0101b tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:12.058145 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dc3c4eeb-07d8-4f0a-969a-dae368e0101b tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:12.063051 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dc3c4eeb-07d8-4f0a-969a-dae368e0101b tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:12.063051 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dc3c4eeb-07d8-4f0a-969a-dae368e0101b tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:12.063051 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dc3c4eeb-07d8-4f0a-969a-dae368e0101b tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:12.351964 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-37a19549-3a0d-42e7-ac47-1a1c4b08a4dc tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:12.361438 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-37a19549-3a0d-42e7-ac47-1a1c4b08a4dc tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/4f303c2c-bb2f-4b3e-8d4f-a21552472a60" status: 200 len: 1314 microversion: 2.1 time: 1.353782 Apr 16 21:23:12.368968 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2020/4203] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:11 2022] GET /compute/v2.1/servers/4f303c2c-bb2f-4b3e-8d4f-a21552472a60 => generated 1314 bytes in 1363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:12.436833 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-dc3c4eeb-07d8-4f0a-969a-dae368e0101b tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:12.469624 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5d1a99c1-ae88-4e3b-aa83-65fb386f9e23 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:12.474972 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5d1a99c1-ae88-4e3b-aa83-65fb386f9e23 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] [instance: 19297dff-d106-4813-8970-b6342085961c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:12.481234 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5d1a99c1-ae88-4e3b-aa83-65fb386f9e23 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:12.481733 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5d1a99c1-ae88-4e3b-aa83-65fb386f9e23 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:12.483124 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5d1a99c1-ae88-4e3b-aa83-65fb386f9e23 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:12.483782 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5d1a99c1-ae88-4e3b-aa83-65fb386f9e23 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:12.499212 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-dc3c4eeb-07d8-4f0a-969a-dae368e0101b tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:12.499212 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-dc3c4eeb-07d8-4f0a-969a-dae368e0101b tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:12.499212 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-dc3c4eeb-07d8-4f0a-969a-dae368e0101b tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1740 microversion: 2.42 time: 0.456794 Apr 16 21:23:12.507394 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2184/4204] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:23:12 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1740 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:23:13.016133 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b53cf7e4-bd3c-4c23-a9bc-ca6c355c1e8c tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:13.018090 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b53cf7e4-bd3c-4c23-a9bc-ca6c355c1e8c tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] [instance: 084a71df-04de-416c-a9cb-4a4aacb94f86] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:13.030867 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b53cf7e4-bd3c-4c23-a9bc-ca6c355c1e8c tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:13.042641 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b53cf7e4-bd3c-4c23-a9bc-ca6c355c1e8c tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:13.043823 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b53cf7e4-bd3c-4c23-a9bc-ca6c355c1e8c tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:13.044405 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b53cf7e4-bd3c-4c23-a9bc-ca6c355c1e8c tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:13.376553 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b53cf7e4-bd3c-4c23-a9bc-ca6c355c1e8c tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7e918d195437091a7d73821c0ed39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86582d8437084e4e95b3078888c21e23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:13.397015 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b53cf7e4-bd3c-4c23-a9bc-ca6c355c1e8c tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] 10.222.0.20 "GET /compute/v2.1/servers/084a71df-04de-416c-a9cb-4a4aacb94f86" status: 200 len: 1352 microversion: 2.1 time: 0.385714 Apr 16 21:23:13.401613 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2185/4205] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:13 2022] GET /compute/v2.1/servers/084a71df-04de-416c-a9cb-4a4aacb94f86 => generated 1352 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:23:13.413359 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-dde12845-bb62-43bc-98ee-e2d99c0d3de8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:13.414280 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-dde12845-bb62-43bc-98ee-e2d99c0d3de8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 4f303c2c-bb2f-4b3e-8d4f-a21552472a60] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:13.427766 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dde12845-bb62-43bc-98ee-e2d99c0d3de8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:13.432763 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dde12845-bb62-43bc-98ee-e2d99c0d3de8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:13.433918 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dde12845-bb62-43bc-98ee-e2d99c0d3de8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:13.435445 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dde12845-bb62-43bc-98ee-e2d99c0d3de8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:13.768626 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5d1a99c1-ae88-4e3b-aa83-65fb386f9e23 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7ad620035e4c9f97da1a1b445437b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d72b2bb3a304796bb144bc739ffcb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:13.780520 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5d1a99c1-ae88-4e3b-aa83-65fb386f9e23 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] 10.222.0.20 "GET /compute/v2.1/servers/19297dff-d106-4813-8970-b6342085961c" status: 200 len: 1313 microversion: 2.1 time: 1.319243 Apr 16 21:23:13.783253 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2021/4206] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:12 2022] GET /compute/v2.1/servers/19297dff-d106-4813-8970-b6342085961c => generated 1313 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:13.797516 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-880ca3f2-8723-4b99-846a-63b77df42fee tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:13.798403 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-880ca3f2-8723-4b99-846a-63b77df42fee tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:13.808530 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-880ca3f2-8723-4b99-846a-63b77df42fee tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:13.809630 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-880ca3f2-8723-4b99-846a-63b77df42fee tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:13.810639 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-880ca3f2-8723-4b99-846a-63b77df42fee tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:13.811870 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-880ca3f2-8723-4b99-846a-63b77df42fee tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:14.263146 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-dde12845-bb62-43bc-98ee-e2d99c0d3de8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:14.271447 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-dde12845-bb62-43bc-98ee-e2d99c0d3de8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/4f303c2c-bb2f-4b3e-8d4f-a21552472a60" status: 200 len: 1500 microversion: 2.1 time: 0.867322 Apr 16 21:23:14.272755 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2186/4207] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:13 2022] GET /compute/v2.1/servers/4f303c2c-bb2f-4b3e-8d4f-a21552472a60 => generated 1500 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:14.280713 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-0ab875dc-e41e-4b29-a7c5-d25872e2b10e req-ed1d2895-ede3-452a-a5c4-5a8e597e0ec0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "084a71df-04de-416c-a9cb-4a4aacb94f86", "name": "network-vif-plugged", "status": "completed", "tag": "6b41dfa1-0a5b-4329-af9c-dd8f41337861"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:23:14.290176 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-0ab875dc-e41e-4b29-a7c5-d25872e2b10e req-ed1d2895-ede3-452a-a5c4-5a8e597e0ec0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:14.290755 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-0ab875dc-e41e-4b29-a7c5-d25872e2b10e req-ed1d2895-ede3-452a-a5c4-5a8e597e0ec0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:14.303723 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-0ab875dc-e41e-4b29-a7c5-d25872e2b10e req-ed1d2895-ede3-452a-a5c4-5a8e597e0ec0 service nova] Creating event network-vif-plugged:6b41dfa1-0a5b-4329-af9c-dd8f41337861 for instance 084a71df-04de-416c-a9cb-4a4aacb94f86 on nch2-master-1 Apr 16 21:23:14.310046 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-0ab875dc-e41e-4b29-a7c5-d25872e2b10e req-ed1d2895-ede3-452a-a5c4-5a8e597e0ec0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035897 Apr 16 21:23:14.311232 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2187/4208] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:23:14.493066 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9eeb68fc-6f24-473f-8bdf-eddcf6b08f5b tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Action: 'create', calling method: .version_select at 0x7fbb956feb80>, body: {"keypair": {"name": "tempest-keypair-519619523"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:23:14.512789 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-9eeb68fc-6f24-473f-8bdf-eddcf6b08f5b tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Getting quotas for project d6f8dfa11e9b410cbbd59ffe32afeb26. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:23:14.519806 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-9eeb68fc-6f24-473f-8bdf-eddcf6b08f5b tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Getting quotas for user 37443a4e933a4873bb039b06efaec98f and project d6f8dfa11e9b410cbbd59ffe32afeb26. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:23:14.629766 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-880ca3f2-8723-4b99-846a-63b77df42fee tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:14.648430 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-880ca3f2-8723-4b99-846a-63b77df42fee tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:14.651572 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-880ca3f2-8723-4b99-846a-63b77df42fee tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:14.654654 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-880ca3f2-8723-4b99-846a-63b77df42fee tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1740 microversion: 2.42 time: 0.867974 Apr 16 21:23:14.656271 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2022/4209] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:23:13 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1740 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:23:14.661823 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-75033097-6b4e-47ed-a4af-5ed053887a61 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:14.663529 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-75033097-6b4e-47ed-a4af-5ed053887a61 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 4f303c2c-bb2f-4b3e-8d4f-a21552472a60] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:14.673811 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-75033097-6b4e-47ed-a4af-5ed053887a61 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:14.674811 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-75033097-6b4e-47ed-a4af-5ed053887a61 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:14.676088 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-75033097-6b4e-47ed-a4af-5ed053887a61 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:14.676910 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-75033097-6b4e-47ed-a4af-5ed053887a61 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:14.707559 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-75033097-6b4e-47ed-a4af-5ed053887a61 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 4f303c2c-bb2f-4b3e-8d4f-a21552472a60] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:23:14.784893 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-9eeb68fc-6f24-473f-8bdf-eddcf6b08f5b tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Getting quotas for project d6f8dfa11e9b410cbbd59ffe32afeb26. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:23:14.790266 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-9eeb68fc-6f24-473f-8bdf-eddcf6b08f5b tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Getting quotas for user 37443a4e933a4873bb039b06efaec98f and project d6f8dfa11e9b410cbbd59ffe32afeb26. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:23:14.808126 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9eeb68fc-6f24-473f-8bdf-eddcf6b08f5b tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.495212 Apr 16 21:23:14.808762 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2188/4210] 10.222.0.20 () {60 vars in 1157 bytes} [Sat Apr 16 21:23:14 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:14.813682 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b632dbb7-fd9a-4207-8ff5-9150473dea6f tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:14.815284 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b632dbb7-fd9a-4207-8ff5-9150473dea6f tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] [instance: 084a71df-04de-416c-a9cb-4a4aacb94f86] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:14.824275 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b632dbb7-fd9a-4207-8ff5-9150473dea6f tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:14.824958 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b632dbb7-fd9a-4207-8ff5-9150473dea6f tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:14.826480 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b632dbb7-fd9a-4207-8ff5-9150473dea6f tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:14.827464 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b632dbb7-fd9a-4207-8ff5-9150473dea6f tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:15.162359 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-75033097-6b4e-47ed-a4af-5ed053887a61 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4f303c2c-bb2f-4b3e-8d4f-a21552472a60" status: 204 len: 0 microversion: 2.1 time: 0.504003 Apr 16 21:23:15.163424 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2023/4211] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:23:14 2022] DELETE /compute/v2.1/servers/4f303c2c-bb2f-4b3e-8d4f-a21552472a60 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:23:15.169262 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5de80b62-6337-4740-8206-3d934027ac03 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:15.170018 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5de80b62-6337-4740-8206-3d934027ac03 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] [instance: 19297dff-d106-4813-8970-b6342085961c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:15.177248 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5de80b62-6337-4740-8206-3d934027ac03 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:15.178353 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5de80b62-6337-4740-8206-3d934027ac03 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:15.186930 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5de80b62-6337-4740-8206-3d934027ac03 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:15.187557 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5de80b62-6337-4740-8206-3d934027ac03 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:15.218653 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b632dbb7-fd9a-4207-8ff5-9150473dea6f tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7e918d195437091a7d73821c0ed39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86582d8437084e4e95b3078888c21e23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:15.227671 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b632dbb7-fd9a-4207-8ff5-9150473dea6f tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] 10.222.0.20 "GET /compute/v2.1/servers/084a71df-04de-416c-a9cb-4a4aacb94f86" status: 200 len: 1352 microversion: 2.1 time: 0.417602 Apr 16 21:23:15.241522 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2189/4212] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:14 2022] GET /compute/v2.1/servers/084a71df-04de-416c-a9cb-4a4aacb94f86 => generated 1352 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:15.246796 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7d4b1883-5702-46c0-99e4-98ced084fc64 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:15.247691 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7d4b1883-5702-46c0-99e4-98ced084fc64 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 4f303c2c-bb2f-4b3e-8d4f-a21552472a60] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:15.257066 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7d4b1883-5702-46c0-99e4-98ced084fc64 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:15.265326 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7d4b1883-5702-46c0-99e4-98ced084fc64 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:15.266050 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7d4b1883-5702-46c0-99e4-98ced084fc64 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:15.266703 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7d4b1883-5702-46c0-99e4-98ced084fc64 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:15.670744 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7d4b1883-5702-46c0-99e4-98ced084fc64 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:15.679455 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7d4b1883-5702-46c0-99e4-98ced084fc64 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/4f303c2c-bb2f-4b3e-8d4f-a21552472a60" status: 200 len: 1506 microversion: 2.1 time: 0.436539 Apr 16 21:23:15.689129 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2190/4213] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:15 2022] GET /compute/v2.1/servers/4f303c2c-bb2f-4b3e-8d4f-a21552472a60 => generated 1506 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:15.693845 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f4114e08-781b-41a2-ad58-6a9ae238409c tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:15.702699 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f4114e08-781b-41a2-ad58-6a9ae238409c tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:15.703519 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f4114e08-781b-41a2-ad58-6a9ae238409c tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:15.703981 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f4114e08-781b-41a2-ad58-6a9ae238409c tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:15.705205 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f4114e08-781b-41a2-ad58-6a9ae238409c tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:15.705817 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f4114e08-781b-41a2-ad58-6a9ae238409c tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:15.836950 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5de80b62-6337-4740-8206-3d934027ac03 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7ad620035e4c9f97da1a1b445437b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d72b2bb3a304796bb144bc739ffcb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:15.851267 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5de80b62-6337-4740-8206-3d934027ac03 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] 10.222.0.20 "GET /compute/v2.1/servers/19297dff-d106-4813-8970-b6342085961c" status: 200 len: 1313 microversion: 2.1 time: 0.684053 Apr 16 21:23:15.852101 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2024/4214] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:15 2022] GET /compute/v2.1/servers/19297dff-d106-4813-8970-b6342085961c => generated 1313 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:15.997268 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f4114e08-781b-41a2-ad58-6a9ae238409c tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:16.008152 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f4114e08-781b-41a2-ad58-6a9ae238409c tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:16.011116 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f4114e08-781b-41a2-ad58-6a9ae238409c tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:16.012938 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f4114e08-781b-41a2-ad58-6a9ae238409c tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1786 microversion: 2.42 time: 0.331211 Apr 16 21:23:16.025115 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2191/4215] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:23:15 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1786 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:23:16.258515 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f7c3a14b-362b-4c4e-a21f-fd87c25b4ab6 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:16.259345 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f7c3a14b-362b-4c4e-a21f-fd87c25b4ab6 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] [instance: 084a71df-04de-416c-a9cb-4a4aacb94f86] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:16.275523 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f7c3a14b-362b-4c4e-a21f-fd87c25b4ab6 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:16.276394 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f7c3a14b-362b-4c4e-a21f-fd87c25b4ab6 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:16.277717 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f7c3a14b-362b-4c4e-a21f-fd87c25b4ab6 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:16.278478 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f7c3a14b-362b-4c4e-a21f-fd87c25b4ab6 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:16.697342 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ddeda77d-90d9-4300-b46e-c59b6386e12c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:16.698070 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ddeda77d-90d9-4300-b46e-c59b6386e12c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 4f303c2c-bb2f-4b3e-8d4f-a21552472a60] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:16.705373 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ddeda77d-90d9-4300-b46e-c59b6386e12c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:16.706169 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ddeda77d-90d9-4300-b46e-c59b6386e12c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:16.707183 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ddeda77d-90d9-4300-b46e-c59b6386e12c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:16.707816 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ddeda77d-90d9-4300-b46e-c59b6386e12c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:16.760937 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f7c3a14b-362b-4c4e-a21f-fd87c25b4ab6 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7e918d195437091a7d73821c0ed39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86582d8437084e4e95b3078888c21e23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:16.775268 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f7c3a14b-362b-4c4e-a21f-fd87c25b4ab6 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] 10.222.0.20 "GET /compute/v2.1/servers/084a71df-04de-416c-a9cb-4a4aacb94f86" status: 200 len: 1352 microversion: 2.1 time: 0.521299 Apr 16 21:23:16.777490 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2025/4216] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:16 2022] GET /compute/v2.1/servers/084a71df-04de-416c-a9cb-4a4aacb94f86 => generated 1352 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:16.872994 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-84a003a2-a351-42f7-a459-3c6c3a966cc1 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:16.874166 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-84a003a2-a351-42f7-a459-3c6c3a966cc1 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] [instance: 19297dff-d106-4813-8970-b6342085961c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:16.881974 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-84a003a2-a351-42f7-a459-3c6c3a966cc1 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:16.882822 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-84a003a2-a351-42f7-a459-3c6c3a966cc1 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:16.884107 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-84a003a2-a351-42f7-a459-3c6c3a966cc1 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:16.884851 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-84a003a2-a351-42f7-a459-3c6c3a966cc1 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:17.032881 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ddeda77d-90d9-4300-b46e-c59b6386e12c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:17.044775 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ddeda77d-90d9-4300-b46e-c59b6386e12c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/4f303c2c-bb2f-4b3e-8d4f-a21552472a60" status: 200 len: 1506 microversion: 2.1 time: 0.351237 Apr 16 21:23:17.055821 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2192/4217] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:16 2022] GET /compute/v2.1/servers/4f303c2c-bb2f-4b3e-8d4f-a21552472a60 => generated 1506 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:17.066418 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-24469c0c-cb36-4bb9-b8cb-8fa779b9fbf8 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:17.067041 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-24469c0c-cb36-4bb9-b8cb-8fa779b9fbf8 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:17.077893 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-24469c0c-cb36-4bb9-b8cb-8fa779b9fbf8 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:17.084075 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-24469c0c-cb36-4bb9-b8cb-8fa779b9fbf8 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:17.084987 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-24469c0c-cb36-4bb9-b8cb-8fa779b9fbf8 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:17.085444 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-24469c0c-cb36-4bb9-b8cb-8fa779b9fbf8 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:17.331726 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-24469c0c-cb36-4bb9-b8cb-8fa779b9fbf8 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:17.351142 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-24469c0c-cb36-4bb9-b8cb-8fa779b9fbf8 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:17.354054 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-24469c0c-cb36-4bb9-b8cb-8fa779b9fbf8 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:17.356796 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-24469c0c-cb36-4bb9-b8cb-8fa779b9fbf8 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1786 microversion: 2.42 time: 0.299893 Apr 16 21:23:17.359579 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2193/4218] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:23:17 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1786 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:23:17.457129 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-3364dda2-8eac-4284-b121-0f3a988c188a req-8b1230e7-b7b8-474b-8093-0ea6046e27c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19297dff-d106-4813-8970-b6342085961c", "tag": "16b874a8-5a14-4da6-a274-1d8be8be2676"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:23:17.473870 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-3364dda2-8eac-4284-b121-0f3a988c188a req-8b1230e7-b7b8-474b-8093-0ea6046e27c3 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:17.474362 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-3364dda2-8eac-4284-b121-0f3a988c188a req-8b1230e7-b7b8-474b-8093-0ea6046e27c3 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:17.515289 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-3364dda2-8eac-4284-b121-0f3a988c188a req-8b1230e7-b7b8-474b-8093-0ea6046e27c3 service nova] Creating event network-changed:16b874a8-5a14-4da6-a274-1d8be8be2676 for instance 19297dff-d106-4813-8970-b6342085961c on nch1-master-1 Apr 16 21:23:17.524309 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-3364dda2-8eac-4284-b121-0f3a988c188a req-8b1230e7-b7b8-474b-8093-0ea6046e27c3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074979 Apr 16 21:23:17.526014 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2194/4219] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:23:17.795488 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-63ae9e92-005a-4597-b433-fe78aaf78d67 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:17.796606 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-63ae9e92-005a-4597-b433-fe78aaf78d67 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] [instance: 084a71df-04de-416c-a9cb-4a4aacb94f86] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:17.813060 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-63ae9e92-005a-4597-b433-fe78aaf78d67 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:17.816045 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-63ae9e92-005a-4597-b433-fe78aaf78d67 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:17.817071 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-63ae9e92-005a-4597-b433-fe78aaf78d67 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:17.820622 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-63ae9e92-005a-4597-b433-fe78aaf78d67 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:17.846131 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-84a003a2-a351-42f7-a459-3c6c3a966cc1 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7ad620035e4c9f97da1a1b445437b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d72b2bb3a304796bb144bc739ffcb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:17.866552 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-84a003a2-a351-42f7-a459-3c6c3a966cc1 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] 10.222.0.20 "GET /compute/v2.1/servers/19297dff-d106-4813-8970-b6342085961c" status: 200 len: 1313 microversion: 2.1 time: 0.992143 Apr 16 21:23:17.867490 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2026/4220] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:16 2022] GET /compute/v2.1/servers/19297dff-d106-4813-8970-b6342085961c => generated 1313 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:18.090569 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-63ae9e92-005a-4597-b433-fe78aaf78d67 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7e918d195437091a7d73821c0ed39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86582d8437084e4e95b3078888c21e23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:18.102881 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-63ae9e92-005a-4597-b433-fe78aaf78d67 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] 10.222.0.20 "GET /compute/v2.1/servers/084a71df-04de-416c-a9cb-4a4aacb94f86" status: 200 len: 1542 microversion: 2.1 time: 0.312921 Apr 16 21:23:18.112233 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2195/4221] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:17 2022] GET /compute/v2.1/servers/084a71df-04de-416c-a9cb-4a4aacb94f86 => generated 1542 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:18.125495 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0aae0d2b-1d37-4cdb-b664-0758eb948443 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:18.126544 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0aae0d2b-1d37-4cdb-b664-0758eb948443 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 4f303c2c-bb2f-4b3e-8d4f-a21552472a60] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:18.138049 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0aae0d2b-1d37-4cdb-b664-0758eb948443 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:18.138805 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0aae0d2b-1d37-4cdb-b664-0758eb948443 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:18.139764 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0aae0d2b-1d37-4cdb-b664-0758eb948443 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:18.140396 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0aae0d2b-1d37-4cdb-b664-0758eb948443 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:18.190959 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bedede5f-bcca-488e-88a2-6e825f1a26b1 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-816568403", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:23:18.261932 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-bedede5f-bcca-488e-88a2-6e825f1a26b1 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] validate_networks() for [('e30659b1-756c-4ef0-9573-8335ff004f46', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:23:18.563465 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0aae0d2b-1d37-4cdb-b664-0758eb948443 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:18.577901 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0aae0d2b-1d37-4cdb-b664-0758eb948443 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/4f303c2c-bb2f-4b3e-8d4f-a21552472a60" status: 200 len: 1506 microversion: 2.1 time: 0.470099 Apr 16 21:23:18.580274 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2196/4222] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:18 2022] GET /compute/v2.1/servers/4f303c2c-bb2f-4b3e-8d4f-a21552472a60 => generated 1506 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:18.598033 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9a8c7f82-d917-4aaf-afb5-b7c09b38db64 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:18.600808 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9a8c7f82-d917-4aaf-afb5-b7c09b38db64 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] [instance: 084a71df-04de-416c-a9cb-4a4aacb94f86] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:18.612449 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a8c7f82-d917-4aaf-afb5-b7c09b38db64 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:18.612449 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a8c7f82-d917-4aaf-afb5-b7c09b38db64 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:18.613613 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a8c7f82-d917-4aaf-afb5-b7c09b38db64 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:18.614227 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a8c7f82-d917-4aaf-afb5-b7c09b38db64 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:18.767476 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9a8c7f82-d917-4aaf-afb5-b7c09b38db64 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] 10.222.0.20 "GET /compute/v2.1/servers/084a71df-04de-416c-a9cb-4a4aacb94f86/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.175494 Apr 16 21:23:18.768114 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2197/4223] 10.222.0.20 () {58 vars in 1274 bytes} [Sat Apr 16 21:23:18 2022] GET /compute/v2.1/servers/084a71df-04de-416c-a9cb-4a4aacb94f86/os-interface => generated 285 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:23:18.774062 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e08925c0-1b5d-4f99-adab-8e743a7f7e4d tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:18.775380 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e08925c0-1b5d-4f99-adab-8e743a7f7e4d tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:18.788968 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e08925c0-1b5d-4f99-adab-8e743a7f7e4d tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:18.789679 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e08925c0-1b5d-4f99-adab-8e743a7f7e4d tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:18.790969 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e08925c0-1b5d-4f99-adab-8e743a7f7e4d tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:18.791796 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e08925c0-1b5d-4f99-adab-8e743a7f7e4d tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:19.783452 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e08925c0-1b5d-4f99-adab-8e743a7f7e4d tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:19.793114 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e08925c0-1b5d-4f99-adab-8e743a7f7e4d tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:19.796157 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e08925c0-1b5d-4f99-adab-8e743a7f7e4d tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:19.796157 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e08925c0-1b5d-4f99-adab-8e743a7f7e4d tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1832 microversion: 2.42 time: 1.026037 Apr 16 21:23:19.796157 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2198/4224] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:23:18 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1832 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:23:19.800704 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0c44b682-a992-41ab-b649-dc2b54844999 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:19.801501 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0c44b682-a992-41ab-b649-dc2b54844999 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] [instance: 19297dff-d106-4813-8970-b6342085961c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:19.808423 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0c44b682-a992-41ab-b649-dc2b54844999 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:19.809719 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0c44b682-a992-41ab-b649-dc2b54844999 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:19.810704 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0c44b682-a992-41ab-b649-dc2b54844999 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:19.811313 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0c44b682-a992-41ab-b649-dc2b54844999 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:20.046852 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-bedede5f-bcca-488e-88a2-6e825f1a26b1 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:23:20.048021 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-bedede5f-bcca-488e-88a2-6e825f1a26b1 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:23:20.048712 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-bedede5f-bcca-488e-88a2-6e825f1a26b1 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:23:20.049504 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-bedede5f-bcca-488e-88a2-6e825f1a26b1 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:23:20.050178 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-bedede5f-bcca-488e-88a2-6e825f1a26b1 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:23:20.062012 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bedede5f-bcca-488e-88a2-6e825f1a26b1 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:20.062715 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bedede5f-bcca-488e-88a2-6e825f1a26b1 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:20.063893 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bedede5f-bcca-488e-88a2-6e825f1a26b1 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:20.064691 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bedede5f-bcca-488e-88a2-6e825f1a26b1 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:20.087940 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-bedede5f-bcca-488e-88a2-6e825f1a26b1 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Getting quotas for project d5096c21fbfe41dd80379e0e3b6fb8d5. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:23:20.106167 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-bedede5f-bcca-488e-88a2-6e825f1a26b1 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Getting quotas for user 0cc8a2da85ec46948b5bc30ed7a363bc and project d5096c21fbfe41dd80379e0e3b6fb8d5. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:23:20.123347 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bedede5f-bcca-488e-88a2-6e825f1a26b1 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:23:20.126212 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bedede5f-bcca-488e-88a2-6e825f1a26b1 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:23:20.279101 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bedede5f-bcca-488e-88a2-6e825f1a26b1 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.295070 Apr 16 21:23:20.286103 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2027/4225] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:23:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 2304 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:23:20.296386 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-a11754e1-9638-43c1-93ac-28533f081bd7 req-bbe03d29-94b4-4bb4-b591-d2bc88de4191 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f303c2c-bb2f-4b3e-8d4f-a21552472a60", "name": "network-vif-deleted", "tag": "e5b0a37b-72e1-4f9a-a7ed-e6bf6cf1ef03"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:23:20.336725 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-a11754e1-9638-43c1-93ac-28533f081bd7 req-bbe03d29-94b4-4bb4-b591-d2bc88de4191 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:20.337199 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-a11754e1-9638-43c1-93ac-28533f081bd7 req-bbe03d29-94b4-4bb4-b591-d2bc88de4191 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:20.358916 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-a11754e1-9638-43c1-93ac-28533f081bd7 req-bbe03d29-94b4-4bb4-b591-d2bc88de4191 service nova] Creating event network-vif-deleted:e5b0a37b-72e1-4f9a-a7ed-e6bf6cf1ef03 for instance 4f303c2c-bb2f-4b3e-8d4f-a21552472a60 on nch2-master-1 Apr 16 21:23:20.367148 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-a11754e1-9638-43c1-93ac-28533f081bd7 req-bbe03d29-94b4-4bb4-b591-d2bc88de4191 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077234 Apr 16 21:23:20.368324 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2028/4226] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:23:20.373820 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0d3ba603-a0c0-4ebd-a024-b476a0edd189 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:20.374609 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0d3ba603-a0c0-4ebd-a024-b476a0edd189 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 4f303c2c-bb2f-4b3e-8d4f-a21552472a60] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:20.382958 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0d3ba603-a0c0-4ebd-a024-b476a0edd189 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:20.383487 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0d3ba603-a0c0-4ebd-a024-b476a0edd189 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:20.384665 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0d3ba603-a0c0-4ebd-a024-b476a0edd189 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:20.385309 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0d3ba603-a0c0-4ebd-a024-b476a0edd189 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:20.453405 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0d3ba603-a0c0-4ebd-a024-b476a0edd189 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:20.454173 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0d3ba603-a0c0-4ebd-a024-b476a0edd189 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:20.455293 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-0d3ba603-a0c0-4ebd-a024-b476a0edd189 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lazy-loading 'fault' on Instance uuid 4f303c2c-bb2f-4b3e-8d4f-a21552472a60 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:23:20.601698 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0d3ba603-a0c0-4ebd-a024-b476a0edd189 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:20.615477 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0d3ba603-a0c0-4ebd-a024-b476a0edd189 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/4f303c2c-bb2f-4b3e-8d4f-a21552472a60" status: 200 len: 1304 microversion: 2.1 time: 0.245653 Apr 16 21:23:20.617069 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2029/4227] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:20 2022] GET /compute/v2.1/servers/4f303c2c-bb2f-4b3e-8d4f-a21552472a60 => generated 1304 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:20.624835 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-454e18ca-d73f-4c96-b5f7-d6ff19459351 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:20.625699 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-454e18ca-d73f-4c96-b5f7-d6ff19459351 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:20.657210 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0c44b682-a992-41ab-b649-dc2b54844999 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7ad620035e4c9f97da1a1b445437b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d72b2bb3a304796bb144bc739ffcb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:20.669137 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0c44b682-a992-41ab-b649-dc2b54844999 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] 10.222.0.20 "GET /compute/v2.1/servers/19297dff-d106-4813-8970-b6342085961c" status: 200 len: 1313 microversion: 2.1 time: 0.871512 Apr 16 21:23:20.672299 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2199/4228] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:19 2022] GET /compute/v2.1/servers/19297dff-d106-4813-8970-b6342085961c => generated 1313 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:20.770721 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-454e18ca-d73f-4c96-b5f7-d6ff19459351 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc8a2da85ec46948b5bc30ed7a363bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5096c21fbfe41dd80379e0e3b6fb8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:20.778832 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-454e18ca-d73f-4c96-b5f7-d6ff19459351 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304" status: 200 len: 1222 microversion: 2.1 time: 0.157883 Apr 16 21:23:20.779975 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2030/4229] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:20 2022] GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304 => generated 1222 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:20.814220 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-61914d36-6a17-4e40-83e2-f80b33a75504 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:20.833127 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-61914d36-6a17-4e40-83e2-f80b33a75504 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:20.843788 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-61914d36-6a17-4e40-83e2-f80b33a75504 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:20.852303 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-61914d36-6a17-4e40-83e2-f80b33a75504 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:20.857744 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-61914d36-6a17-4e40-83e2-f80b33a75504 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:20.858220 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-61914d36-6a17-4e40-83e2-f80b33a75504 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:20.984628 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-26e40304-0a21-4ef4-9820-f1cd4d79c6df tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1050952694", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "26fd8c71-2108-482c-9702-fc8775f3578f"}], "security_groups": [{"name": "tempest-securitygroup--108506263"}], "key_name": "tempest-keypair-519619523", "user_data": "}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:23:21.395671 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-26e40304-0a21-4ef4-9820-f1cd4d79c6df tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] validate_networks() for [('26fd8c71-2108-482c-9702-fc8775f3578f', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:23:21.568240 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-61914d36-6a17-4e40-83e2-f80b33a75504 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:21.602392 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-61914d36-6a17-4e40-83e2-f80b33a75504 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:21.603917 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-61914d36-6a17-4e40-83e2-f80b33a75504 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:21.611227 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-61914d36-6a17-4e40-83e2-f80b33a75504 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1832 microversion: 2.42 time: 0.800837 Apr 16 21:23:21.611817 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2200/4230] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:23:20 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1832 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:23:21.634712 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4afd7857-c72e-48aa-82e4-3113e0a8f7ff tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:21.635379 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4afd7857-c72e-48aa-82e4-3113e0a8f7ff tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 4f303c2c-bb2f-4b3e-8d4f-a21552472a60] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:21.641558 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4afd7857-c72e-48aa-82e4-3113e0a8f7ff tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:21.642020 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4afd7857-c72e-48aa-82e4-3113e0a8f7ff tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:21.643635 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4afd7857-c72e-48aa-82e4-3113e0a8f7ff tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:21.644469 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4afd7857-c72e-48aa-82e4-3113e0a8f7ff tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:21.660792 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-4afd7857-c72e-48aa-82e4-3113e0a8f7ff tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] HTTP exception thrown: Instance 4f303c2c-bb2f-4b3e-8d4f-a21552472a60 could not be found. Apr 16 21:23:21.661684 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4afd7857-c72e-48aa-82e4-3113e0a8f7ff tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Returning 404 to user: Instance 4f303c2c-bb2f-4b3e-8d4f-a21552472a60 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:23:21.662816 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4afd7857-c72e-48aa-82e4-3113e0a8f7ff tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/4f303c2c-bb2f-4b3e-8d4f-a21552472a60" status: 404 len: 111 microversion: 2.1 time: 0.033033 Apr 16 21:23:21.664333 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2201/4231] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:21 2022] GET /compute/v2.1/servers/4f303c2c-bb2f-4b3e-8d4f-a21552472a60 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:23:21.708322 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6c3e2e40-0c06-411f-806d-a3512f339c06 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:21.714750 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6c3e2e40-0c06-411f-806d-a3512f339c06 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] [instance: 19297dff-d106-4813-8970-b6342085961c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:21.728110 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6c3e2e40-0c06-411f-806d-a3512f339c06 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:21.728674 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6c3e2e40-0c06-411f-806d-a3512f339c06 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:21.734962 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6c3e2e40-0c06-411f-806d-a3512f339c06 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:21.735625 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6c3e2e40-0c06-411f-806d-a3512f339c06 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:22.104650 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6c3e2e40-0c06-411f-806d-a3512f339c06 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7ad620035e4c9f97da1a1b445437b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d72b2bb3a304796bb144bc739ffcb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:22.113490 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6c3e2e40-0c06-411f-806d-a3512f339c06 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] 10.222.0.20 "GET /compute/v2.1/servers/19297dff-d106-4813-8970-b6342085961c" status: 200 len: 1313 microversion: 2.1 time: 0.413143 Apr 16 21:23:22.116477 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2202/4232] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:21 2022] GET /compute/v2.1/servers/19297dff-d106-4813-8970-b6342085961c => generated 1313 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:22.127341 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-73048935-6b51-400d-9087-53ead85ee6bb tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:22.127964 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-73048935-6b51-400d-9087-53ead85ee6bb tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:22.145635 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-73048935-6b51-400d-9087-53ead85ee6bb tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:22.146425 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-73048935-6b51-400d-9087-53ead85ee6bb tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:22.147438 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-73048935-6b51-400d-9087-53ead85ee6bb tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:22.147882 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-73048935-6b51-400d-9087-53ead85ee6bb tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:22.619526 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-73048935-6b51-400d-9087-53ead85ee6bb tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc8a2da85ec46948b5bc30ed7a363bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5096c21fbfe41dd80379e0e3b6fb8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:22.634080 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-73048935-6b51-400d-9087-53ead85ee6bb tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304" status: 200 len: 1218 microversion: 2.1 time: 0.515626 Apr 16 21:23:22.635033 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2203/4233] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:22 2022] GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304 => generated 1218 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:22.672556 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8441216d-0b46-473c-af30-b0e78f047b17 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1858848352", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "5fb5cf29-8796-41a2-8375-e8062a5911ad"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:23:22.761854 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-8441216d-0b46-473c-af30-b0e78f047b17 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] validate_networks() for [('5fb5cf29-8796-41a2-8375-e8062a5911ad', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:23:23.385593 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-26e40304-0a21-4ef4-9820-f1cd4d79c6df tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:23:23.390205 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-26e40304-0a21-4ef4-9820-f1cd4d79c6df tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:23:23.392482 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-26e40304-0a21-4ef4-9820-f1cd4d79c6df tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:23:23.393237 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-26e40304-0a21-4ef4-9820-f1cd4d79c6df tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:23:23.396001 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-26e40304-0a21-4ef4-9820-f1cd4d79c6df tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:23:23.446107 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-26e40304-0a21-4ef4-9820-f1cd4d79c6df tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:23.449342 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-26e40304-0a21-4ef4-9820-f1cd4d79c6df tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:23.450590 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-26e40304-0a21-4ef4-9820-f1cd4d79c6df tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:23.451235 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-26e40304-0a21-4ef4-9820-f1cd4d79c6df tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:23.514719 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-26e40304-0a21-4ef4-9820-f1cd4d79c6df tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Getting quotas for project d6f8dfa11e9b410cbbd59ffe32afeb26. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:23:23.524098 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-26e40304-0a21-4ef4-9820-f1cd4d79c6df tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Getting quotas for user 37443a4e933a4873bb039b06efaec98f and project d6f8dfa11e9b410cbbd59ffe32afeb26. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:23:23.557316 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-26e40304-0a21-4ef4-9820-f1cd4d79c6df tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:23:23.560640 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-26e40304-0a21-4ef4-9820-f1cd4d79c6df tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 8d623e8d-480f-48ef-b90c-04450df4aec8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:23:23.630751 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-8441216d-0b46-473c-af30-b0e78f047b17 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:23:23.632301 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-8441216d-0b46-473c-af30-b0e78f047b17 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:23:23.632913 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-8441216d-0b46-473c-af30-b0e78f047b17 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:23:23.633482 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-8441216d-0b46-473c-af30-b0e78f047b17 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:23:23.634015 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-8441216d-0b46-473c-af30-b0e78f047b17 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:23:23.664921 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8441216d-0b46-473c-af30-b0e78f047b17 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:23.665787 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8441216d-0b46-473c-af30-b0e78f047b17 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:23.666962 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8441216d-0b46-473c-af30-b0e78f047b17 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:23.667666 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8441216d-0b46-473c-af30-b0e78f047b17 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:23.689313 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-26e40304-0a21-4ef4-9820-f1cd4d79c6df tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.709276 Apr 16 21:23:23.690976 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2031/4234] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:23:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 2712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 16 21:23:23.696723 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-aaaf4ba8-869a-4843-9487-811385c6eace tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:23.697564 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-aaaf4ba8-869a-4843-9487-811385c6eace tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:23.704289 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aaaf4ba8-869a-4843-9487-811385c6eace tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:23.704953 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aaaf4ba8-869a-4843-9487-811385c6eace tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:23.705896 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aaaf4ba8-869a-4843-9487-811385c6eace tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:23.706729 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aaaf4ba8-869a-4843-9487-811385c6eace tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:23.712537 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-8441216d-0b46-473c-af30-b0e78f047b17 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Getting quotas for project 7caf6e59a47149a68cae6224fb2856e7. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:23:23.718925 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-8441216d-0b46-473c-af30-b0e78f047b17 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Getting quotas for user e069f136dcb344b197f58ba47722f4d5 and project 7caf6e59a47149a68cae6224fb2856e7. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:23:23.735653 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8441216d-0b46-473c-af30-b0e78f047b17 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:23:23.741731 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8441216d-0b46-473c-af30-b0e78f047b17 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3704be44-6fc4-4b14-b0c0-eb1388d807a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:23:23.925627 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8441216d-0b46-473c-af30-b0e78f047b17 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.289203 Apr 16 21:23:23.927479 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2204/4235] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:23:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1292 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:23:23.947104 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-4be22769-db0a-4f88-9a32-46fddf169350 req-8323855f-b98c-4b13-bdb6-748fdd7182a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "084a71df-04de-416c-a9cb-4a4aacb94f86", "tag": "6b41dfa1-0a5b-4329-af9c-dd8f41337861"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:23:24.000854 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-4be22769-db0a-4f88-9a32-46fddf169350 req-8323855f-b98c-4b13-bdb6-748fdd7182a1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:24.001340 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-4be22769-db0a-4f88-9a32-46fddf169350 req-8323855f-b98c-4b13-bdb6-748fdd7182a1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:24.019170 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-4be22769-db0a-4f88-9a32-46fddf169350 req-8323855f-b98c-4b13-bdb6-748fdd7182a1 service nova] Creating event network-changed:6b41dfa1-0a5b-4329-af9c-dd8f41337861 for instance 084a71df-04de-416c-a9cb-4a4aacb94f86 on nch2-master-1 Apr 16 21:23:24.036334 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-4be22769-db0a-4f88-9a32-46fddf169350 req-8323855f-b98c-4b13-bdb6-748fdd7182a1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099185 Apr 16 21:23:24.038694 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2205/4236] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:23:24.062161 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c1cd1097-c494-4508-82bc-04504762a19e tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:24.065056 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c1cd1097-c494-4508-82bc-04504762a19e tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] [instance: 19297dff-d106-4813-8970-b6342085961c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:24.076784 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c1cd1097-c494-4508-82bc-04504762a19e tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:24.078503 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c1cd1097-c494-4508-82bc-04504762a19e tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:24.080001 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c1cd1097-c494-4508-82bc-04504762a19e tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:24.080856 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c1cd1097-c494-4508-82bc-04504762a19e tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:24.343766 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-aaaf4ba8-869a-4843-9487-811385c6eace tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:24.364348 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-aaaf4ba8-869a-4843-9487-811385c6eace tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:24.366635 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-aaaf4ba8-869a-4843-9487-811385c6eace tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:24.368717 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-aaaf4ba8-869a-4843-9487-811385c6eace tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1832 microversion: 2.42 time: 0.675854 Apr 16 21:23:24.370042 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2032/4237] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:23:23 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1832 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:23:24.377432 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-93124e73-0b81-4c18-a6fb-b9d9e52215df req-b8aa1a26-7d1c-4c60-b0a6-7cf6abcdb6e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70e22cc6-e4af-4230-a480-bbbe6b60d462", "tag": "cc99d421-5515-41e3-bbf8-03443566d154"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:23:24.388720 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-93124e73-0b81-4c18-a6fb-b9d9e52215df req-b8aa1a26-7d1c-4c60-b0a6-7cf6abcdb6e1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:24.390862 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-93124e73-0b81-4c18-a6fb-b9d9e52215df req-b8aa1a26-7d1c-4c60-b0a6-7cf6abcdb6e1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:24.420315 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-93124e73-0b81-4c18-a6fb-b9d9e52215df req-b8aa1a26-7d1c-4c60-b0a6-7cf6abcdb6e1 service nova] Creating event network-changed:cc99d421-5515-41e3-bbf8-03443566d154 for instance 70e22cc6-e4af-4230-a480-bbbe6b60d462 on nch1-master-1 Apr 16 21:23:24.427954 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-93124e73-0b81-4c18-a6fb-b9d9e52215df req-b8aa1a26-7d1c-4c60-b0a6-7cf6abcdb6e1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055644 Apr 16 21:23:24.429181 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2033/4238] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:23:24.435826 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-76942b0c-c57b-4ee7-873f-ee534cff6795 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:24.438380 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-76942b0c-c57b-4ee7-873f-ee534cff6795 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:24.447810 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-76942b0c-c57b-4ee7-873f-ee534cff6795 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:24.448710 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-76942b0c-c57b-4ee7-873f-ee534cff6795 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:24.449554 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-76942b0c-c57b-4ee7-873f-ee534cff6795 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:24.456848 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-76942b0c-c57b-4ee7-873f-ee534cff6795 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:24.699514 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c1cd1097-c494-4508-82bc-04504762a19e tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7ad620035e4c9f97da1a1b445437b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d72b2bb3a304796bb144bc739ffcb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:24.708262 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c1cd1097-c494-4508-82bc-04504762a19e tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] 10.222.0.20 "GET /compute/v2.1/servers/19297dff-d106-4813-8970-b6342085961c" status: 200 len: 1313 microversion: 2.1 time: 0.666966 Apr 16 21:23:24.719357 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-76942b0c-c57b-4ee7-873f-ee534cff6795 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc8a2da85ec46948b5bc30ed7a363bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5096c21fbfe41dd80379e0e3b6fb8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:24.720078 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2206/4239] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:24 2022] GET /compute/v2.1/servers/19297dff-d106-4813-8970-b6342085961c => generated 1313 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:24.724495 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-76942b0c-c57b-4ee7-873f-ee534cff6795 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304" status: 200 len: 1280 microversion: 2.1 time: 0.293416 Apr 16 21:23:24.732108 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cdf58604-61b6-4e6f-b18a-117028929920 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:24.732108 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cdf58604-61b6-4e6f-b18a-117028929920 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 8d623e8d-480f-48ef-b90c-04450df4aec8] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:24.732453 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2034/4240] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:24 2022] GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304 => generated 1280 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:24.746876 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-430d5826-1ca6-45fd-ba3e-601dfc9999a5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:24.747862 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-430d5826-1ca6-45fd-ba3e-601dfc9999a5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3704be44-6fc4-4b14-b0c0-eb1388d807a5] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:24.887503 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cdf58604-61b6-4e6f-b18a-117028929920 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:24.893242 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cdf58604-61b6-4e6f-b18a-117028929920 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8" status: 200 len: 1241 microversion: 2.1 time: 0.170251 Apr 16 21:23:24.893824 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2207/4241] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:24 2022] GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8 => generated 1241 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:24.901150 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-25ccc47b-005d-405e-9832-9db2ac53439e req-24ea9243-1833-4bb9-9205-d810b19f9528 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19297dff-d106-4813-8970-b6342085961c", "name": "network-vif-plugged", "status": "completed", "tag": "16b874a8-5a14-4da6-a274-1d8be8be2676"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:23:24.924253 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-25ccc47b-005d-405e-9832-9db2ac53439e req-24ea9243-1833-4bb9-9205-d810b19f9528 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:24.928065 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-25ccc47b-005d-405e-9832-9db2ac53439e req-24ea9243-1833-4bb9-9205-d810b19f9528 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:24.953693 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-25ccc47b-005d-405e-9832-9db2ac53439e req-24ea9243-1833-4bb9-9205-d810b19f9528 service nova] Creating event network-vif-plugged:16b874a8-5a14-4da6-a274-1d8be8be2676 for instance 19297dff-d106-4813-8970-b6342085961c on nch1-master-1 Apr 16 21:23:24.961122 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-25ccc47b-005d-405e-9832-9db2ac53439e req-24ea9243-1833-4bb9-9205-d810b19f9528 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063479 Apr 16 21:23:24.961738 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2208/4242] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:23:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:23:25.013003 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-430d5826-1ca6-45fd-ba3e-601dfc9999a5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:25.032680 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-430d5826-1ca6-45fd-ba3e-601dfc9999a5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5" status: 200 len: 1215 microversion: 2.1 time: 0.295108 Apr 16 21:23:25.058056 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2035/4243] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:24 2022] GET /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5 => generated 1215 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:25.388111 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b727a7cf-5f94-47b2-8dd1-7997765ebc38 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:25.388860 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b727a7cf-5f94-47b2-8dd1-7997765ebc38 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:25.398852 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b727a7cf-5f94-47b2-8dd1-7997765ebc38 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:25.402406 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b727a7cf-5f94-47b2-8dd1-7997765ebc38 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:25.402406 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b727a7cf-5f94-47b2-8dd1-7997765ebc38 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:25.402406 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b727a7cf-5f94-47b2-8dd1-7997765ebc38 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:25.727206 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0a6a6d3a-7442-4744-ac1f-1fc156c6f43d tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:25.728953 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0a6a6d3a-7442-4744-ac1f-1fc156c6f43d tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] [instance: 19297dff-d106-4813-8970-b6342085961c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:25.768008 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0a6a6d3a-7442-4744-ac1f-1fc156c6f43d tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:25.777614 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0a6a6d3a-7442-4744-ac1f-1fc156c6f43d tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:25.784317 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0a6a6d3a-7442-4744-ac1f-1fc156c6f43d tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:25.785197 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0a6a6d3a-7442-4744-ac1f-1fc156c6f43d tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:25.800029 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b727a7cf-5f94-47b2-8dd1-7997765ebc38 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:25.821306 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b727a7cf-5f94-47b2-8dd1-7997765ebc38 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:25.823296 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b727a7cf-5f94-47b2-8dd1-7997765ebc38 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:25.825475 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b727a7cf-5f94-47b2-8dd1-7997765ebc38 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1832 microversion: 2.42 time: 0.441554 Apr 16 21:23:25.826601 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2209/4244] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:23:25 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1832 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:23:25.839166 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f9c84fc6-81bb-4e83-ad7d-2d55bde783e1 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:25.839829 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f9c84fc6-81bb-4e83-ad7d-2d55bde783e1 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:25.860038 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9c84fc6-81bb-4e83-ad7d-2d55bde783e1 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:25.861156 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9c84fc6-81bb-4e83-ad7d-2d55bde783e1 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:25.862073 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9c84fc6-81bb-4e83-ad7d-2d55bde783e1 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:25.862504 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9c84fc6-81bb-4e83-ad7d-2d55bde783e1 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:25.968261 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f9c84fc6-81bb-4e83-ad7d-2d55bde783e1 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc8a2da85ec46948b5bc30ed7a363bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5096c21fbfe41dd80379e0e3b6fb8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:25.982993 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f9c84fc6-81bb-4e83-ad7d-2d55bde783e1 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304" status: 200 len: 1280 microversion: 2.1 time: 0.154899 Apr 16 21:23:25.985036 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2210/4245] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:25 2022] GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304 => generated 1280 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:25.996249 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2df57869-0376-48a5-a64d-8bedde5c58dd tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:25.997183 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2df57869-0376-48a5-a64d-8bedde5c58dd tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 8d623e8d-480f-48ef-b90c-04450df4aec8] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:26.011927 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2df57869-0376-48a5-a64d-8bedde5c58dd tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:26.013483 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2df57869-0376-48a5-a64d-8bedde5c58dd tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:26.016682 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2df57869-0376-48a5-a64d-8bedde5c58dd tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:26.017444 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2df57869-0376-48a5-a64d-8bedde5c58dd tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:26.123192 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2df57869-0376-48a5-a64d-8bedde5c58dd tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:26.134470 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2df57869-0376-48a5-a64d-8bedde5c58dd tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8" status: 200 len: 1237 microversion: 2.1 time: 0.147964 Apr 16 21:23:26.144724 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2211/4246] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:25 2022] GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8 => generated 1237 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:26.149938 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-84e72275-489d-4eb0-8e00-7c9a588981aa tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:26.150560 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-84e72275-489d-4eb0-8e00-7c9a588981aa tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3704be44-6fc4-4b14-b0c0-eb1388d807a5] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:26.156944 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-84e72275-489d-4eb0-8e00-7c9a588981aa tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:26.157434 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-84e72275-489d-4eb0-8e00-7c9a588981aa tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:26.158398 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-84e72275-489d-4eb0-8e00-7c9a588981aa tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:26.159176 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-84e72275-489d-4eb0-8e00-7c9a588981aa tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:26.236363 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-84e72275-489d-4eb0-8e00-7c9a588981aa tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:26.246293 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-84e72275-489d-4eb0-8e00-7c9a588981aa tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5" status: 200 len: 1267 microversion: 2.1 time: 0.100116 Apr 16 21:23:26.247155 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2212/4247] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:26 2022] GET /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5 => generated 1267 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:26.531081 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0a6a6d3a-7442-4744-ac1f-1fc156c6f43d tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7ad620035e4c9f97da1a1b445437b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d72b2bb3a304796bb144bc739ffcb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:26.539276 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0a6a6d3a-7442-4744-ac1f-1fc156c6f43d tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] 10.222.0.20 "GET /compute/v2.1/servers/19297dff-d106-4813-8970-b6342085961c" status: 200 len: 1313 microversion: 2.1 time: 0.816994 Apr 16 21:23:26.540362 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2036/4248] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:25 2022] GET /compute/v2.1/servers/19297dff-d106-4813-8970-b6342085961c => generated 1313 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:26.845826 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7e7fa493-cfa5-4535-b314-a95a328a58ca tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:26.846480 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7e7fa493-cfa5-4535-b314-a95a328a58ca tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:26.860698 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7e7fa493-cfa5-4535-b314-a95a328a58ca tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:26.861240 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7e7fa493-cfa5-4535-b314-a95a328a58ca tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:26.862192 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7e7fa493-cfa5-4535-b314-a95a328a58ca tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:26.862654 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7e7fa493-cfa5-4535-b314-a95a328a58ca tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:26.948104 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-15a373b6-a12a-4906-9e21-60a10143649f req-081e01bb-b0fe-4f91-9efb-7923d754a320 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70e22cc6-e4af-4230-a480-bbbe6b60d462", "tag": "c1abc7d3-63c4-4e58-896c-5aa4b9a41054"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:23:26.961145 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-15a373b6-a12a-4906-9e21-60a10143649f req-081e01bb-b0fe-4f91-9efb-7923d754a320 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:26.967108 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-15a373b6-a12a-4906-9e21-60a10143649f req-081e01bb-b0fe-4f91-9efb-7923d754a320 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:27.001066 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-15a373b6-a12a-4906-9e21-60a10143649f req-081e01bb-b0fe-4f91-9efb-7923d754a320 service nova] Creating event network-changed:c1abc7d3-63c4-4e58-896c-5aa4b9a41054 for instance 70e22cc6-e4af-4230-a480-bbbe6b60d462 on nch1-master-1 Apr 16 21:23:27.023326 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-15a373b6-a12a-4906-9e21-60a10143649f req-081e01bb-b0fe-4f91-9efb-7923d754a320 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079544 Apr 16 21:23:27.024292 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2037/4249] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:23:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:23:27.031736 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1b9b8658-1d4f-451a-8d88-802ccfd8efed tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:27.032522 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1b9b8658-1d4f-451a-8d88-802ccfd8efed tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:27.051296 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1b9b8658-1d4f-451a-8d88-802ccfd8efed tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:27.051771 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1b9b8658-1d4f-451a-8d88-802ccfd8efed tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:27.056756 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1b9b8658-1d4f-451a-8d88-802ccfd8efed tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:27.060860 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1b9b8658-1d4f-451a-8d88-802ccfd8efed tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:27.471840 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1b9b8658-1d4f-451a-8d88-802ccfd8efed tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc8a2da85ec46948b5bc30ed7a363bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5096c21fbfe41dd80379e0e3b6fb8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:27.485483 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1b9b8658-1d4f-451a-8d88-802ccfd8efed tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304" status: 200 len: 1322 microversion: 2.1 time: 0.459931 Apr 16 21:23:27.486701 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2038/4250] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:27 2022] GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304 => generated 1322 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:27.491638 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6086075a-6b24-44af-8677-b69ecc4b3f26 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:27.492526 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6086075a-6b24-44af-8677-b69ecc4b3f26 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 8d623e8d-480f-48ef-b90c-04450df4aec8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:27.499152 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6086075a-6b24-44af-8677-b69ecc4b3f26 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:27.499865 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6086075a-6b24-44af-8677-b69ecc4b3f26 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:27.501014 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6086075a-6b24-44af-8677-b69ecc4b3f26 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:27.502905 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6086075a-6b24-44af-8677-b69ecc4b3f26 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:27.621724 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6086075a-6b24-44af-8677-b69ecc4b3f26 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:27.634904 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6086075a-6b24-44af-8677-b69ecc4b3f26 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8" status: 200 len: 1299 microversion: 2.1 time: 0.146872 Apr 16 21:23:27.635859 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2039/4251] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:27 2022] GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8 => generated 1299 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:27.643018 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-733ce047-0724-440b-9e38-a803acc4085d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:27.644018 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-733ce047-0724-440b-9e38-a803acc4085d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3704be44-6fc4-4b14-b0c0-eb1388d807a5] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:27.654143 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-733ce047-0724-440b-9e38-a803acc4085d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:27.655176 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-733ce047-0724-440b-9e38-a803acc4085d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:27.656796 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-733ce047-0724-440b-9e38-a803acc4085d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:27.658356 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-733ce047-0724-440b-9e38-a803acc4085d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:27.910516 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-733ce047-0724-440b-9e38-a803acc4085d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:27.922843 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-733ce047-0724-440b-9e38-a803acc4085d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5" status: 200 len: 1273 microversion: 2.1 time: 0.284990 Apr 16 21:23:27.934530 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2040/4252] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:27 2022] GET /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5 => generated 1273 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:27.939911 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-655896d5-42e6-496d-8470-016372d54688 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:27.940563 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-655896d5-42e6-496d-8470-016372d54688 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] [instance: 19297dff-d106-4813-8970-b6342085961c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:27.949027 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-655896d5-42e6-496d-8470-016372d54688 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:27.950597 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-655896d5-42e6-496d-8470-016372d54688 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:27.954016 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-655896d5-42e6-496d-8470-016372d54688 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:27.955019 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-655896d5-42e6-496d-8470-016372d54688 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:28.008804 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7e7fa493-cfa5-4535-b314-a95a328a58ca tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:28.020822 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7e7fa493-cfa5-4535-b314-a95a328a58ca tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:28.021488 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7e7fa493-cfa5-4535-b314-a95a328a58ca tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:28.023061 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7e7fa493-cfa5-4535-b314-a95a328a58ca tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1853 microversion: 2.42 time: 1.181411 Apr 16 21:23:28.024705 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2213/4253] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:23:26 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1853 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:23:28.286698 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-655896d5-42e6-496d-8470-016372d54688 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7ad620035e4c9f97da1a1b445437b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d72b2bb3a304796bb144bc739ffcb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:28.299848 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-655896d5-42e6-496d-8470-016372d54688 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] 10.222.0.20 "GET /compute/v2.1/servers/19297dff-d106-4813-8970-b6342085961c" status: 200 len: 1497 microversion: 2.1 time: 0.364103 Apr 16 21:23:28.300693 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2041/4254] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:27 2022] GET /compute/v2.1/servers/19297dff-d106-4813-8970-b6342085961c => generated 1497 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:28.509187 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-23714108-844c-4c49-b0fa-c64ce6029f4d tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:28.510595 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-23714108-844c-4c49-b0fa-c64ce6029f4d tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:28.519366 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-23714108-844c-4c49-b0fa-c64ce6029f4d tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:28.519838 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-23714108-844c-4c49-b0fa-c64ce6029f4d tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:28.520730 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-23714108-844c-4c49-b0fa-c64ce6029f4d tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:28.521182 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-23714108-844c-4c49-b0fa-c64ce6029f4d tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:28.654592 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d7029fc0-6d0a-47f1-bbe0-d722c6ac1cc6 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:28.655746 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d7029fc0-6d0a-47f1-bbe0-d722c6ac1cc6 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 8d623e8d-480f-48ef-b90c-04450df4aec8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:28.688972 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d7029fc0-6d0a-47f1-bbe0-d722c6ac1cc6 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:28.689430 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d7029fc0-6d0a-47f1-bbe0-d722c6ac1cc6 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:28.690298 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d7029fc0-6d0a-47f1-bbe0-d722c6ac1cc6 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:28.692326 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d7029fc0-6d0a-47f1-bbe0-d722c6ac1cc6 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:28.848347 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d7029fc0-6d0a-47f1-bbe0-d722c6ac1cc6 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:28.864655 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d7029fc0-6d0a-47f1-bbe0-d722c6ac1cc6 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8" status: 200 len: 1299 microversion: 2.1 time: 0.215462 Apr 16 21:23:28.874086 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2042/4255] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:28 2022] GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8 => generated 1299 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:28.936682 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-23714108-844c-4c49-b0fa-c64ce6029f4d tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc8a2da85ec46948b5bc30ed7a363bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5096c21fbfe41dd80379e0e3b6fb8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:28.940051 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-90d30346-e158-48ce-b9b1-f04c1d4a257b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:28.940701 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-90d30346-e158-48ce-b9b1-f04c1d4a257b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3704be44-6fc4-4b14-b0c0-eb1388d807a5] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:28.947544 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-23714108-844c-4c49-b0fa-c64ce6029f4d tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304" status: 200 len: 1322 microversion: 2.1 time: 0.448555 Apr 16 21:23:28.948772 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2214/4256] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:28 2022] GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304 => generated 1322 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:28.960427 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-90d30346-e158-48ce-b9b1-f04c1d4a257b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:28.960894 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-90d30346-e158-48ce-b9b1-f04c1d4a257b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:28.961687 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-90d30346-e158-48ce-b9b1-f04c1d4a257b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:28.962222 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-90d30346-e158-48ce-b9b1-f04c1d4a257b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:29.046223 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1e2b6a56-fd3b-4d1a-b51c-c8d339d6a347 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:29.047779 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1e2b6a56-fd3b-4d1a-b51c-c8d339d6a347 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:29.057278 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1e2b6a56-fd3b-4d1a-b51c-c8d339d6a347 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:29.058653 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1e2b6a56-fd3b-4d1a-b51c-c8d339d6a347 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:29.059831 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1e2b6a56-fd3b-4d1a-b51c-c8d339d6a347 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:29.060891 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1e2b6a56-fd3b-4d1a-b51c-c8d339d6a347 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:29.178424 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-90d30346-e158-48ce-b9b1-f04c1d4a257b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:29.189443 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-90d30346-e158-48ce-b9b1-f04c1d4a257b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5" status: 200 len: 1273 microversion: 2.1 time: 0.252872 Apr 16 21:23:29.191465 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2043/4257] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:28 2022] GET /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5 => generated 1273 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:29.214784 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-98e256d7-0a6d-4c53-85fd-f6a690ab4c32 req-40008fe6-c69d-4c1e-bde9-e56f85642fbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b36f160b-012c-42fa-8884-2d4f22c5f304", "tag": "fd85026d-38d7-4dbb-a085-fa40b89df53f"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:23:29.235169 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-98e256d7-0a6d-4c53-85fd-f6a690ab4c32 req-40008fe6-c69d-4c1e-bde9-e56f85642fbe service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:29.236262 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-98e256d7-0a6d-4c53-85fd-f6a690ab4c32 req-40008fe6-c69d-4c1e-bde9-e56f85642fbe service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:29.251318 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-98e256d7-0a6d-4c53-85fd-f6a690ab4c32 req-40008fe6-c69d-4c1e-bde9-e56f85642fbe service nova] Creating event network-changed:fd85026d-38d7-4dbb-a085-fa40b89df53f for instance b36f160b-012c-42fa-8884-2d4f22c5f304 on nch2-master-1 Apr 16 21:23:29.258991 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-98e256d7-0a6d-4c53-85fd-f6a690ab4c32 req-40008fe6-c69d-4c1e-bde9-e56f85642fbe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065464 Apr 16 21:23:29.260366 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2044/4258] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:23:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:23:29.379678 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-04e1e2ef-291b-4796-bf8f-934ef393810c tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:29.380482 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-04e1e2ef-291b-4796-bf8f-934ef393810c tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] [instance: 19297dff-d106-4813-8970-b6342085961c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:29.388962 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-04e1e2ef-291b-4796-bf8f-934ef393810c tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:29.389438 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-04e1e2ef-291b-4796-bf8f-934ef393810c tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:29.390241 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-04e1e2ef-291b-4796-bf8f-934ef393810c tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:29.390698 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-04e1e2ef-291b-4796-bf8f-934ef393810c tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:29.443846 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-04e1e2ef-291b-4796-bf8f-934ef393810c tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] [instance: 19297dff-d106-4813-8970-b6342085961c] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:23:29.574499 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1e2b6a56-fd3b-4d1a-b51c-c8d339d6a347 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:29.602731 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1e2b6a56-fd3b-4d1a-b51c-c8d339d6a347 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:29.604745 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1e2b6a56-fd3b-4d1a-b51c-c8d339d6a347 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:29.606820 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1e2b6a56-fd3b-4d1a-b51c-c8d339d6a347 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1874 microversion: 2.42 time: 0.567888 Apr 16 21:23:29.619163 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2215/4259] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:23:29 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1874 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:23:29.858778 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-04e1e2ef-291b-4796-bf8f-934ef393810c tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] 10.222.0.20 "DELETE /compute/v2.1/servers/19297dff-d106-4813-8970-b6342085961c" status: 204 len: 0 microversion: 2.1 time: 0.485584 Apr 16 21:23:29.859646 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2045/4260] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:23:29 2022] DELETE /compute/v2.1/servers/19297dff-d106-4813-8970-b6342085961c => generated 0 bytes in 488 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:23:29.869959 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-08c09fbd-1f02-4a02-bf33-ae9c37c14cc7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:29.870874 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-08c09fbd-1f02-4a02-bf33-ae9c37c14cc7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] [instance: 19297dff-d106-4813-8970-b6342085961c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:29.882485 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c54a623a-5826-4146-bc62-277cdfe9930d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:29.883299 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c54a623a-5826-4146-bc62-277cdfe9930d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 8d623e8d-480f-48ef-b90c-04450df4aec8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:29.887662 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-08c09fbd-1f02-4a02-bf33-ae9c37c14cc7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:29.888128 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-08c09fbd-1f02-4a02-bf33-ae9c37c14cc7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:29.888947 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-08c09fbd-1f02-4a02-bf33-ae9c37c14cc7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:29.889463 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-08c09fbd-1f02-4a02-bf33-ae9c37c14cc7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:29.898226 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c54a623a-5826-4146-bc62-277cdfe9930d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:29.898687 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c54a623a-5826-4146-bc62-277cdfe9930d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:29.899478 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c54a623a-5826-4146-bc62-277cdfe9930d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:29.900085 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c54a623a-5826-4146-bc62-277cdfe9930d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:30.265113 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-08c09fbd-1f02-4a02-bf33-ae9c37c14cc7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7ad620035e4c9f97da1a1b445437b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d72b2bb3a304796bb144bc739ffcb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:30.277807 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-08c09fbd-1f02-4a02-bf33-ae9c37c14cc7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] 10.222.0.20 "GET /compute/v2.1/servers/19297dff-d106-4813-8970-b6342085961c" status: 200 len: 1503 microversion: 2.1 time: 0.411712 Apr 16 21:23:30.278415 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2216/4261] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:29 2022] GET /compute/v2.1/servers/19297dff-d106-4813-8970-b6342085961c => generated 1503 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:30.291432 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b55cdab8-2f5e-4c2f-bc27-6bf172f8dc9a tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:30.292056 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b55cdab8-2f5e-4c2f-bc27-6bf172f8dc9a tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:30.304682 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b55cdab8-2f5e-4c2f-bc27-6bf172f8dc9a tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:30.305367 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b55cdab8-2f5e-4c2f-bc27-6bf172f8dc9a tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:30.306486 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b55cdab8-2f5e-4c2f-bc27-6bf172f8dc9a tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:30.307092 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b55cdab8-2f5e-4c2f-bc27-6bf172f8dc9a tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:30.562873 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c54a623a-5826-4146-bc62-277cdfe9930d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:30.570928 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c54a623a-5826-4146-bc62-277cdfe9930d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8" status: 200 len: 1366 microversion: 2.1 time: 0.693015 Apr 16 21:23:30.571520 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2046/4262] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:29 2022] GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8 => generated 1366 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:23:30.594020 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b506a136-074a-4465-899b-9f62e34978df tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:30.594020 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b506a136-074a-4465-899b-9f62e34978df tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3704be44-6fc4-4b14-b0c0-eb1388d807a5] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:30.594020 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b506a136-074a-4465-899b-9f62e34978df tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:30.594020 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b506a136-074a-4465-899b-9f62e34978df tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:30.594448 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b506a136-074a-4465-899b-9f62e34978df tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:30.595077 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b506a136-074a-4465-899b-9f62e34978df tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:30.709470 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b55cdab8-2f5e-4c2f-bc27-6bf172f8dc9a tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc8a2da85ec46948b5bc30ed7a363bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5096c21fbfe41dd80379e0e3b6fb8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:30.722558 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b55cdab8-2f5e-4c2f-bc27-6bf172f8dc9a tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304" status: 200 len: 1322 microversion: 2.1 time: 0.439892 Apr 16 21:23:30.725173 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2217/4263] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:30 2022] GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304 => generated 1322 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:30.731640 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8f963b2b-beaf-4723-84f1-71493246e5a9 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:30.732506 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8f963b2b-beaf-4723-84f1-71493246e5a9 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:30.741347 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8f963b2b-beaf-4723-84f1-71493246e5a9 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:30.742088 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8f963b2b-beaf-4723-84f1-71493246e5a9 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:30.743059 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8f963b2b-beaf-4723-84f1-71493246e5a9 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:30.743673 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8f963b2b-beaf-4723-84f1-71493246e5a9 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:30.852606 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b506a136-074a-4465-899b-9f62e34978df tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:30.863252 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b506a136-074a-4465-899b-9f62e34978df tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5" status: 200 len: 1315 microversion: 2.1 time: 0.281371 Apr 16 21:23:30.864261 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2047/4264] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:30 2022] GET /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5 => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:31.214391 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8f963b2b-beaf-4723-84f1-71493246e5a9 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:31.228867 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8f963b2b-beaf-4723-84f1-71493246e5a9 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:31.237560 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8f963b2b-beaf-4723-84f1-71493246e5a9 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:31.239211 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8f963b2b-beaf-4723-84f1-71493246e5a9 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1874 microversion: 2.42 time: 0.512910 Apr 16 21:23:31.241017 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2218/4265] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:23:30 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1874 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:23:31.299687 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-7b7412a6-ada1-4799-8d0e-fa80ba315950 req-3ab98698-317f-4490-bd57-2437b8f355f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70e22cc6-e4af-4230-a480-bbbe6b60d462", "tag": "5e9adf2d-0b03-4f92-88ae-35b824faa4fe"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:23:31.301982 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cf82c93a-bef5-4931-ad2c-0afee113cb5a tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:31.302757 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-cf82c93a-bef5-4931-ad2c-0afee113cb5a tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] [instance: 19297dff-d106-4813-8970-b6342085961c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:31.317173 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-7b7412a6-ada1-4799-8d0e-fa80ba315950 req-3ab98698-317f-4490-bd57-2437b8f355f1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:31.319380 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cf82c93a-bef5-4931-ad2c-0afee113cb5a tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:31.319881 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-7b7412a6-ada1-4799-8d0e-fa80ba315950 req-3ab98698-317f-4490-bd57-2437b8f355f1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:31.321342 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cf82c93a-bef5-4931-ad2c-0afee113cb5a tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:31.324511 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cf82c93a-bef5-4931-ad2c-0afee113cb5a tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:31.325161 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cf82c93a-bef5-4931-ad2c-0afee113cb5a tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:31.338950 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-7b7412a6-ada1-4799-8d0e-fa80ba315950 req-3ab98698-317f-4490-bd57-2437b8f355f1 service nova] Creating event network-changed:5e9adf2d-0b03-4f92-88ae-35b824faa4fe for instance 70e22cc6-e4af-4230-a480-bbbe6b60d462 on nch1-master-1 Apr 16 21:23:31.359761 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-7b7412a6-ada1-4799-8d0e-fa80ba315950 req-3ab98698-317f-4490-bd57-2437b8f355f1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063719 Apr 16 21:23:31.361956 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2219/4266] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:23:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:23:31.589457 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7d7df1f4-8f02-49d8-b3c7-bedb75e33a0c tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:31.590584 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7d7df1f4-8f02-49d8-b3c7-bedb75e33a0c tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 8d623e8d-480f-48ef-b90c-04450df4aec8] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:31.597522 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7d7df1f4-8f02-49d8-b3c7-bedb75e33a0c tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:31.598346 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7d7df1f4-8f02-49d8-b3c7-bedb75e33a0c tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:31.599409 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7d7df1f4-8f02-49d8-b3c7-bedb75e33a0c tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:31.600042 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7d7df1f4-8f02-49d8-b3c7-bedb75e33a0c tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:32.018467 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cf82c93a-bef5-4931-ad2c-0afee113cb5a tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7ad620035e4c9f97da1a1b445437b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d72b2bb3a304796bb144bc739ffcb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:32.053401 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7d7df1f4-8f02-49d8-b3c7-bedb75e33a0c tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:32.055901 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cf82c93a-bef5-4931-ad2c-0afee113cb5a tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] 10.222.0.20 "GET /compute/v2.1/servers/19297dff-d106-4813-8970-b6342085961c" status: 200 len: 1503 microversion: 2.1 time: 0.764538 Apr 16 21:23:32.059890 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2048/4267] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:31 2022] GET /compute/v2.1/servers/19297dff-d106-4813-8970-b6342085961c => generated 1503 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:32.066523 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5c6f97ef-151b-4d30-a038-1a3504524263 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:32.067391 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5c6f97ef-151b-4d30-a038-1a3504524263 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:32.069237 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7d7df1f4-8f02-49d8-b3c7-bedb75e33a0c tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8" status: 200 len: 1366 microversion: 2.1 time: 0.484251 Apr 16 21:23:32.071806 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2220/4268] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:31 2022] GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8 => generated 1366 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:32.075164 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5c6f97ef-151b-4d30-a038-1a3504524263 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:32.076028 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5c6f97ef-151b-4d30-a038-1a3504524263 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:32.077816 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5c6f97ef-151b-4d30-a038-1a3504524263 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:32.078094 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-036fcdfd-756e-403b-a8f3-978b775e1d16 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:32.078705 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5c6f97ef-151b-4d30-a038-1a3504524263 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:32.078825 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-036fcdfd-756e-403b-a8f3-978b775e1d16 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3704be44-6fc4-4b14-b0c0-eb1388d807a5] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:32.087207 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-036fcdfd-756e-403b-a8f3-978b775e1d16 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:32.088845 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-036fcdfd-756e-403b-a8f3-978b775e1d16 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:32.103183 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-036fcdfd-756e-403b-a8f3-978b775e1d16 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:32.103664 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-036fcdfd-756e-403b-a8f3-978b775e1d16 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:32.565402 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-036fcdfd-756e-403b-a8f3-978b775e1d16 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:32.575333 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-036fcdfd-756e-403b-a8f3-978b775e1d16 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5" status: 200 len: 1315 microversion: 2.1 time: 0.502111 Apr 16 21:23:32.588051 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2221/4269] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:32 2022] GET /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5 => generated 1315 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:32.588051 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d360a713-8ff3-4599-bfdf-9a2cec212ad5 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:32.588051 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d360a713-8ff3-4599-bfdf-9a2cec212ad5 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:32.593180 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d360a713-8ff3-4599-bfdf-9a2cec212ad5 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:32.593180 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d360a713-8ff3-4599-bfdf-9a2cec212ad5 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:32.593849 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d360a713-8ff3-4599-bfdf-9a2cec212ad5 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:32.594424 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d360a713-8ff3-4599-bfdf-9a2cec212ad5 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:33.207192 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d360a713-8ff3-4599-bfdf-9a2cec212ad5 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:33.221989 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d360a713-8ff3-4599-bfdf-9a2cec212ad5 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:33.231123 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d360a713-8ff3-4599-bfdf-9a2cec212ad5 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:33.232397 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d360a713-8ff3-4599-bfdf-9a2cec212ad5 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1874 microversion: 2.42 time: 0.652490 Apr 16 21:23:33.234577 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2222/4270] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:23:32 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1874 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:23:33.287040 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5c6f97ef-151b-4d30-a038-1a3504524263 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc8a2da85ec46948b5bc30ed7a363bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5096c21fbfe41dd80379e0e3b6fb8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:33.299784 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5c6f97ef-151b-4d30-a038-1a3504524263 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304" status: 200 len: 1322 microversion: 2.1 time: 1.238357 Apr 16 21:23:33.309668 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2049/4271] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:32 2022] GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304 => generated 1322 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:33.313736 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fa51c97b-0486-4ae7-9daf-2ef135861973 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:33.314368 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-fa51c97b-0486-4ae7-9daf-2ef135861973 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] [instance: 19297dff-d106-4813-8970-b6342085961c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:33.334842 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fa51c97b-0486-4ae7-9daf-2ef135861973 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:33.337394 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fa51c97b-0486-4ae7-9daf-2ef135861973 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:33.340307 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fa51c97b-0486-4ae7-9daf-2ef135861973 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:33.340833 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fa51c97b-0486-4ae7-9daf-2ef135861973 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:33.484817 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-ac188a4d-6b8a-482e-b019-92c7f59fed81 req-9855ce13-6a0d-44fd-801c-0fe4264018d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3704be44-6fc4-4b14-b0c0-eb1388d807a5", "tag": "f66da356-52f4-4b47-9500-04fa22ef8e21"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:23:33.499688 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-ac188a4d-6b8a-482e-b019-92c7f59fed81 req-9855ce13-6a0d-44fd-801c-0fe4264018d9 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:33.500461 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-ac188a4d-6b8a-482e-b019-92c7f59fed81 req-9855ce13-6a0d-44fd-801c-0fe4264018d9 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:33.517494 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-ac188a4d-6b8a-482e-b019-92c7f59fed81 req-9855ce13-6a0d-44fd-801c-0fe4264018d9 service nova] Creating event network-changed:f66da356-52f4-4b47-9500-04fa22ef8e21 for instance 3704be44-6fc4-4b14-b0c0-eb1388d807a5 on nch2-master-1 Apr 16 21:23:33.523910 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-ac188a4d-6b8a-482e-b019-92c7f59fed81 req-9855ce13-6a0d-44fd-801c-0fe4264018d9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.287880 Apr 16 21:23:33.525226 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2223/4272] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:23:33.533474 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-20e5aca0-baec-4d76-b55f-98cbba88bc07 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:33.534420 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-20e5aca0-baec-4d76-b55f-98cbba88bc07 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 8d623e8d-480f-48ef-b90c-04450df4aec8] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:33.545864 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-20e5aca0-baec-4d76-b55f-98cbba88bc07 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:33.546609 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-20e5aca0-baec-4d76-b55f-98cbba88bc07 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:33.547818 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-20e5aca0-baec-4d76-b55f-98cbba88bc07 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:33.548884 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-20e5aca0-baec-4d76-b55f-98cbba88bc07 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:33.901197 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-20e5aca0-baec-4d76-b55f-98cbba88bc07 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:33.910644 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-20e5aca0-baec-4d76-b55f-98cbba88bc07 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8" status: 200 len: 1366 microversion: 2.1 time: 0.383305 Apr 16 21:23:33.911825 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2224/4273] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:33 2022] GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8 => generated 1366 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:33.918229 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-c9aa5193-d613-4bdb-9212-a2acc5ed90e9 req-0db0fda9-1f08-4a22-9784-f4092819b02c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70e22cc6-e4af-4230-a480-bbbe6b60d462", "tag": "e161877a-3f6f-49a7-8aed-2eee986f2f68"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:23:33.929039 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-c9aa5193-d613-4bdb-9212-a2acc5ed90e9 req-0db0fda9-1f08-4a22-9784-f4092819b02c service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:33.929697 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-c9aa5193-d613-4bdb-9212-a2acc5ed90e9 req-0db0fda9-1f08-4a22-9784-f4092819b02c service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:33.956654 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-c9aa5193-d613-4bdb-9212-a2acc5ed90e9 req-0db0fda9-1f08-4a22-9784-f4092819b02c service nova] Creating event network-changed:e161877a-3f6f-49a7-8aed-2eee986f2f68 for instance 70e22cc6-e4af-4230-a480-bbbe6b60d462 on nch1-master-1 Apr 16 21:23:33.970019 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-c9aa5193-d613-4bdb-9212-a2acc5ed90e9 req-0db0fda9-1f08-4a22-9784-f4092819b02c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055610 Apr 16 21:23:33.973530 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2225/4274] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:23:33.981440 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-387c2a33-2769-489d-9dbd-51db30431bfd tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:33.983425 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-387c2a33-2769-489d-9dbd-51db30431bfd tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3704be44-6fc4-4b14-b0c0-eb1388d807a5] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:33.992821 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-387c2a33-2769-489d-9dbd-51db30431bfd tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:33.993874 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-387c2a33-2769-489d-9dbd-51db30431bfd tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:33.994857 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-387c2a33-2769-489d-9dbd-51db30431bfd tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:33.995959 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-387c2a33-2769-489d-9dbd-51db30431bfd tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:34.068394 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-fa51c97b-0486-4ae7-9daf-2ef135861973 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7ad620035e4c9f97da1a1b445437b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d72b2bb3a304796bb144bc739ffcb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:34.077114 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fa51c97b-0486-4ae7-9daf-2ef135861973 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] 10.222.0.20 "GET /compute/v2.1/servers/19297dff-d106-4813-8970-b6342085961c" status: 200 len: 1503 microversion: 2.1 time: 0.775699 Apr 16 21:23:34.078084 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2050/4275] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:33 2022] GET /compute/v2.1/servers/19297dff-d106-4813-8970-b6342085961c => generated 1503 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:34.189168 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-387c2a33-2769-489d-9dbd-51db30431bfd tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:34.200985 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-387c2a33-2769-489d-9dbd-51db30431bfd tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5" status: 200 len: 1315 microversion: 2.1 time: 0.224112 Apr 16 21:23:34.200985 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2226/4276] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:33 2022] GET /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5 => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:34.251032 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6dd25266-1f90-401f-998c-2478f0409048 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:34.251722 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6dd25266-1f90-401f-998c-2478f0409048 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:34.259269 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6dd25266-1f90-401f-998c-2478f0409048 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:34.259737 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6dd25266-1f90-401f-998c-2478f0409048 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:34.260566 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6dd25266-1f90-401f-998c-2478f0409048 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:34.261011 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6dd25266-1f90-401f-998c-2478f0409048 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:34.325183 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ce0c0de3-4bea-4838-a4bd-cfa01a6e6d8d tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:34.325800 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ce0c0de3-4bea-4838-a4bd-cfa01a6e6d8d tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:34.332744 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ce0c0de3-4bea-4838-a4bd-cfa01a6e6d8d tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:34.333218 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ce0c0de3-4bea-4838-a4bd-cfa01a6e6d8d tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:34.335341 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ce0c0de3-4bea-4838-a4bd-cfa01a6e6d8d tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:34.335796 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ce0c0de3-4bea-4838-a4bd-cfa01a6e6d8d tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:34.536579 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ce0c0de3-4bea-4838-a4bd-cfa01a6e6d8d tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc8a2da85ec46948b5bc30ed7a363bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5096c21fbfe41dd80379e0e3b6fb8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:34.545001 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ce0c0de3-4bea-4838-a4bd-cfa01a6e6d8d tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304" status: 200 len: 1322 microversion: 2.1 time: 0.223619 Apr 16 21:23:34.545955 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2227/4277] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:34 2022] GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304 => generated 1322 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:23:34.760741 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6dd25266-1f90-401f-998c-2478f0409048 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:34.770251 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6dd25266-1f90-401f-998c-2478f0409048 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:34.771932 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6dd25266-1f90-401f-998c-2478f0409048 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:34.775046 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6dd25266-1f90-401f-998c-2478f0409048 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1874 microversion: 2.42 time: 0.526075 Apr 16 21:23:34.775046 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2051/4278] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:23:34 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1874 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:23:34.930142 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e8b5ebd4-62cc-497a-9fd2-f0da3c50da1e tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:34.931940 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e8b5ebd4-62cc-497a-9fd2-f0da3c50da1e tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 8d623e8d-480f-48ef-b90c-04450df4aec8] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:34.960758 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e8b5ebd4-62cc-497a-9fd2-f0da3c50da1e tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:34.962513 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e8b5ebd4-62cc-497a-9fd2-f0da3c50da1e tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:34.967533 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e8b5ebd4-62cc-497a-9fd2-f0da3c50da1e tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:34.968407 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e8b5ebd4-62cc-497a-9fd2-f0da3c50da1e tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:35.096880 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2d970130-0e06-4a50-bd63-ff0492b750e0 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:35.097495 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2d970130-0e06-4a50-bd63-ff0492b750e0 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] [instance: 19297dff-d106-4813-8970-b6342085961c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:35.104967 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2d970130-0e06-4a50-bd63-ff0492b750e0 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:35.105663 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2d970130-0e06-4a50-bd63-ff0492b750e0 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:35.106702 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2d970130-0e06-4a50-bd63-ff0492b750e0 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:35.107557 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2d970130-0e06-4a50-bd63-ff0492b750e0 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:35.200032 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2d970130-0e06-4a50-bd63-ff0492b750e0 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:35.200890 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2d970130-0e06-4a50-bd63-ff0492b750e0 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:35.201575 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-2d970130-0e06-4a50-bd63-ff0492b750e0 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lazy-loading 'fault' on Instance uuid 19297dff-d106-4813-8970-b6342085961c {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:23:35.209258 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e8b5ebd4-62cc-497a-9fd2-f0da3c50da1e tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:35.225219 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e8b5ebd4-62cc-497a-9fd2-f0da3c50da1e tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8" status: 200 len: 1366 microversion: 2.1 time: 0.296654 Apr 16 21:23:35.235245 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2228/4279] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:34 2022] GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8 => generated 1366 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:35.241687 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a3857291-0484-4bb6-8f99-73d08bccd179 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:35.242691 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a3857291-0484-4bb6-8f99-73d08bccd179 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3704be44-6fc4-4b14-b0c0-eb1388d807a5] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:35.250935 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a3857291-0484-4bb6-8f99-73d08bccd179 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:35.255525 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a3857291-0484-4bb6-8f99-73d08bccd179 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:35.255525 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a3857291-0484-4bb6-8f99-73d08bccd179 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:35.255525 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a3857291-0484-4bb6-8f99-73d08bccd179 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:35.425882 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a3857291-0484-4bb6-8f99-73d08bccd179 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:35.439498 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a3857291-0484-4bb6-8f99-73d08bccd179 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5" status: 200 len: 1315 microversion: 2.1 time: 0.202487 Apr 16 21:23:35.440275 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2229/4280] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:35 2022] GET /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:35.542574 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-ddcb9785-2b33-4240-a5a8-18f54e3f1d08 req-b1aacdc6-129b-4b34-ac45-40b0d16aec00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d623e8d-480f-48ef-b90c-04450df4aec8", "tag": "459ce4bf-03df-40c1-b9aa-0e81a103ea05"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:23:35.552911 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-ddcb9785-2b33-4240-a5a8-18f54e3f1d08 req-b1aacdc6-129b-4b34-ac45-40b0d16aec00 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:35.554238 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-ddcb9785-2b33-4240-a5a8-18f54e3f1d08 req-b1aacdc6-129b-4b34-ac45-40b0d16aec00 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:35.566868 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-ddcb9785-2b33-4240-a5a8-18f54e3f1d08 req-b1aacdc6-129b-4b34-ac45-40b0d16aec00 service nova] Creating event network-changed:459ce4bf-03df-40c1-b9aa-0e81a103ea05 for instance 8d623e8d-480f-48ef-b90c-04450df4aec8 on nch2-master-1 Apr 16 21:23:35.572438 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-ddcb9785-2b33-4240-a5a8-18f54e3f1d08 req-b1aacdc6-129b-4b34-ac45-40b0d16aec00 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034288 Apr 16 21:23:35.573551 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2230/4281] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:23:35.580977 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4404dda9-2aa4-4898-af5e-2a87dadd9d08 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:35.580977 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4404dda9-2aa4-4898-af5e-2a87dadd9d08 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:35.584738 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2d970130-0e06-4a50-bd63-ff0492b750e0 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7ad620035e4c9f97da1a1b445437b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d72b2bb3a304796bb144bc739ffcb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:35.587848 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4404dda9-2aa4-4898-af5e-2a87dadd9d08 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:35.588534 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4404dda9-2aa4-4898-af5e-2a87dadd9d08 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:35.589567 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4404dda9-2aa4-4898-af5e-2a87dadd9d08 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:35.590295 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4404dda9-2aa4-4898-af5e-2a87dadd9d08 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:35.600296 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2d970130-0e06-4a50-bd63-ff0492b750e0 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] 10.222.0.20 "GET /compute/v2.1/servers/19297dff-d106-4813-8970-b6342085961c" status: 200 len: 1303 microversion: 2.1 time: 0.506190 Apr 16 21:23:35.611431 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2052/4282] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:35 2022] GET /compute/v2.1/servers/19297dff-d106-4813-8970-b6342085961c => generated 1303 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:23:35.745938 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4404dda9-2aa4-4898-af5e-2a87dadd9d08 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc8a2da85ec46948b5bc30ed7a363bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5096c21fbfe41dd80379e0e3b6fb8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:35.753350 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4404dda9-2aa4-4898-af5e-2a87dadd9d08 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304" status: 200 len: 1322 microversion: 2.1 time: 0.178252 Apr 16 21:23:35.754235 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2231/4283] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:35 2022] GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304 => generated 1322 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:35.791151 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e0279c08-4c09-4514-9589-41646a1f3923 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:35.791768 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e0279c08-4c09-4514-9589-41646a1f3923 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:35.797724 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e0279c08-4c09-4514-9589-41646a1f3923 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:35.798182 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e0279c08-4c09-4514-9589-41646a1f3923 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:35.798957 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e0279c08-4c09-4514-9589-41646a1f3923 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:35.799397 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e0279c08-4c09-4514-9589-41646a1f3923 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:36.060305 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-d2cbadd7-7a5f-41df-81e1-792e7e03bee4 req-9f937d58-6d7b-42bf-89e1-8d7fd996fb55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19297dff-d106-4813-8970-b6342085961c", "name": "network-vif-deleted", "tag": "16b874a8-5a14-4da6-a274-1d8be8be2676"}, {"name": "network-changed", "server_uuid": "70e22cc6-e4af-4230-a480-bbbe6b60d462", "tag": "c8475713-e26a-40c8-8213-0fa9fe87a721"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:23:36.077400 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-d2cbadd7-7a5f-41df-81e1-792e7e03bee4 req-9f937d58-6d7b-42bf-89e1-8d7fd996fb55 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:36.077860 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-d2cbadd7-7a5f-41df-81e1-792e7e03bee4 req-9f937d58-6d7b-42bf-89e1-8d7fd996fb55 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:36.097951 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-d2cbadd7-7a5f-41df-81e1-792e7e03bee4 req-9f937d58-6d7b-42bf-89e1-8d7fd996fb55 service nova] Creating event network-vif-deleted:16b874a8-5a14-4da6-a274-1d8be8be2676 for instance 19297dff-d106-4813-8970-b6342085961c on nch1-master-1 Apr 16 21:23:36.098464 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-d2cbadd7-7a5f-41df-81e1-792e7e03bee4 req-9f937d58-6d7b-42bf-89e1-8d7fd996fb55 service nova] Creating event network-changed:c8475713-e26a-40c8-8213-0fa9fe87a721 for instance 70e22cc6-e4af-4230-a480-bbbe6b60d462 on nch1-master-1 Apr 16 21:23:36.105838 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-d2cbadd7-7a5f-41df-81e1-792e7e03bee4 req-9f937d58-6d7b-42bf-89e1-8d7fd996fb55 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.052237 Apr 16 21:23:36.107016 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2232/4284] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:23:36.240966 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-dddf60fb-9667-4581-901e-05ed1c26b3ec tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:36.242181 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-dddf60fb-9667-4581-901e-05ed1c26b3ec tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 8d623e8d-480f-48ef-b90c-04450df4aec8] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:36.248407 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dddf60fb-9667-4581-901e-05ed1c26b3ec tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:36.248900 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dddf60fb-9667-4581-901e-05ed1c26b3ec tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:36.249840 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dddf60fb-9667-4581-901e-05ed1c26b3ec tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:36.250297 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dddf60fb-9667-4581-901e-05ed1c26b3ec tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:36.417834 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e0279c08-4c09-4514-9589-41646a1f3923 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:36.427193 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e0279c08-4c09-4514-9589-41646a1f3923 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:36.428935 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e0279c08-4c09-4514-9589-41646a1f3923 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:36.430109 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e0279c08-4c09-4514-9589-41646a1f3923 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1874 microversion: 2.42 time: 0.643126 Apr 16 21:23:36.433015 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2053/4285] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:23:35 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1874 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:23:36.455628 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-dddf60fb-9667-4581-901e-05ed1c26b3ec tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:36.461714 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-dddf60fb-9667-4581-901e-05ed1c26b3ec tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8" status: 200 len: 1366 microversion: 2.1 time: 0.225285 Apr 16 21:23:36.462010 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c2329aad-7f39-44c2-ba1a-79a92dc86270 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:36.462871 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c2329aad-7f39-44c2-ba1a-79a92dc86270 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3704be44-6fc4-4b14-b0c0-eb1388d807a5] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:36.466928 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2233/4286] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:36 2022] GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8 => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:36.471315 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c2329aad-7f39-44c2-ba1a-79a92dc86270 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:36.472654 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c2329aad-7f39-44c2-ba1a-79a92dc86270 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:36.473540 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c2329aad-7f39-44c2-ba1a-79a92dc86270 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:36.474067 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c2329aad-7f39-44c2-ba1a-79a92dc86270 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:36.622346 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ea9780ef-0a09-48e6-b69e-6af5143a4d39 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:36.623101 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ea9780ef-0a09-48e6-b69e-6af5143a4d39 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] [instance: 19297dff-d106-4813-8970-b6342085961c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:36.631128 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ea9780ef-0a09-48e6-b69e-6af5143a4d39 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:36.631606 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ea9780ef-0a09-48e6-b69e-6af5143a4d39 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:36.632496 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ea9780ef-0a09-48e6-b69e-6af5143a4d39 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:36.633085 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ea9780ef-0a09-48e6-b69e-6af5143a4d39 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:36.647319 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-ea9780ef-0a09-48e6-b69e-6af5143a4d39 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] HTTP exception thrown: Instance 19297dff-d106-4813-8970-b6342085961c could not be found. Apr 16 21:23:36.647933 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ea9780ef-0a09-48e6-b69e-6af5143a4d39 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Returning 404 to user: Instance 19297dff-d106-4813-8970-b6342085961c could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:23:36.648809 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ea9780ef-0a09-48e6-b69e-6af5143a4d39 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] 10.222.0.20 "GET /compute/v2.1/servers/19297dff-d106-4813-8970-b6342085961c" status: 404 len: 111 microversion: 2.1 time: 0.035543 Apr 16 21:23:36.649360 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2234/4287] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:36 2022] GET /compute/v2.1/servers/19297dff-d106-4813-8970-b6342085961c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:23:36.750640 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-93ecde19-c627-4a5f-8529-12bbc93d89f7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-213176754", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "a9010da2-54fb-4a1a-8688-b01d319eafbe"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:23:36.820626 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-93ecde19-c627-4a5f-8529-12bbc93d89f7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] validate_networks() for [('a9010da2-54fb-4a1a-8688-b01d319eafbe', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:23:36.901652 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c2329aad-7f39-44c2-ba1a-79a92dc86270 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:36.910592 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c2329aad-7f39-44c2-ba1a-79a92dc86270 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5" status: 200 len: 1315 microversion: 2.1 time: 0.454921 Apr 16 21:23:36.921270 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2054/4288] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:36 2022] GET /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5 => generated 1315 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:36.936275 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-43de2505-95d0-47c3-8b8e-6cbc6de95e49 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:36.937665 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-43de2505-95d0-47c3-8b8e-6cbc6de95e49 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:36.945233 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-43de2505-95d0-47c3-8b8e-6cbc6de95e49 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:36.946496 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-43de2505-95d0-47c3-8b8e-6cbc6de95e49 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:36.947533 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-43de2505-95d0-47c3-8b8e-6cbc6de95e49 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:36.948505 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-43de2505-95d0-47c3-8b8e-6cbc6de95e49 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:37.227568 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-43de2505-95d0-47c3-8b8e-6cbc6de95e49 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc8a2da85ec46948b5bc30ed7a363bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5096c21fbfe41dd80379e0e3b6fb8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:37.239204 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-43de2505-95d0-47c3-8b8e-6cbc6de95e49 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304" status: 200 len: 1322 microversion: 2.1 time: 0.316457 Apr 16 21:23:37.241205 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2055/4289] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:36 2022] GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304 => generated 1322 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:37.324557 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-93ecde19-c627-4a5f-8529-12bbc93d89f7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:23:37.325592 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-93ecde19-c627-4a5f-8529-12bbc93d89f7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:23:37.326483 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-93ecde19-c627-4a5f-8529-12bbc93d89f7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:23:37.327062 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-93ecde19-c627-4a5f-8529-12bbc93d89f7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:23:37.327668 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-93ecde19-c627-4a5f-8529-12bbc93d89f7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:23:37.341030 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-93ecde19-c627-4a5f-8529-12bbc93d89f7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:37.342604 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-93ecde19-c627-4a5f-8529-12bbc93d89f7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:37.344200 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-93ecde19-c627-4a5f-8529-12bbc93d89f7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:37.345640 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-93ecde19-c627-4a5f-8529-12bbc93d89f7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:37.374372 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-93ecde19-c627-4a5f-8529-12bbc93d89f7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Getting quotas for project 7d72b2bb3a304796bb144bc739ffcb5a. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:23:37.383267 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-93ecde19-c627-4a5f-8529-12bbc93d89f7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Getting quotas for user cf7ad620035e4c9f97da1a1b445437b1 and project 7d72b2bb3a304796bb144bc739ffcb5a. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:23:37.399822 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-93ecde19-c627-4a5f-8529-12bbc93d89f7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:23:37.402911 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-93ecde19-c627-4a5f-8529-12bbc93d89f7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] [instance: 06c0c0c5-19a1-4c21-b19e-a9878ab4f25e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:23:37.499077 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bd0519e4-e617-4431-8488-c06de9e9afdd tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-2055913433", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "c0253630-a638-41be-9085-59ec05c0d096"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:23:37.549564 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-93ecde19-c627-4a5f-8529-12bbc93d89f7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.801851 Apr 16 21:23:37.556717 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2235/4290] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:23:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 16 21:23:37.581741 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-e4db9ff2-3ef7-43ac-8037-e2f288f42e76 req-fa649b7c-aeea-457c-9060-cea2214052de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b36f160b-012c-42fa-8884-2d4f22c5f304", "name": "network-vif-plugged", "status": "completed", "tag": "fd85026d-38d7-4dbb-a085-fa40b89df53f"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:23:37.602425 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-bd0519e4-e617-4431-8488-c06de9e9afdd tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] validate_networks() for [('c0253630-a638-41be-9085-59ec05c0d096', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:23:37.618503 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-e4db9ff2-3ef7-43ac-8037-e2f288f42e76 req-fa649b7c-aeea-457c-9060-cea2214052de service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:37.627358 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-e4db9ff2-3ef7-43ac-8037-e2f288f42e76 req-fa649b7c-aeea-457c-9060-cea2214052de service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:37.663803 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-e4db9ff2-3ef7-43ac-8037-e2f288f42e76 req-fa649b7c-aeea-457c-9060-cea2214052de service nova] Creating event network-vif-plugged:fd85026d-38d7-4dbb-a085-fa40b89df53f for instance b36f160b-012c-42fa-8884-2d4f22c5f304 on nch2-master-1 Apr 16 21:23:37.674879 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-e4db9ff2-3ef7-43ac-8037-e2f288f42e76 req-fa649b7c-aeea-457c-9060-cea2214052de service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116820 Apr 16 21:23:37.678144 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2236/4291] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:23:37.696606 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ec1130c5-9318-4313-93e2-1a93f7a70c22 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:37.700031 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ec1130c5-9318-4313-93e2-1a93f7a70c22 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:37.719395 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ec1130c5-9318-4313-93e2-1a93f7a70c22 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:37.720199 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ec1130c5-9318-4313-93e2-1a93f7a70c22 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:37.721959 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ec1130c5-9318-4313-93e2-1a93f7a70c22 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:37.721959 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ec1130c5-9318-4313-93e2-1a93f7a70c22 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:38.090021 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ec1130c5-9318-4313-93e2-1a93f7a70c22 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:38.110016 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ec1130c5-9318-4313-93e2-1a93f7a70c22 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:38.112162 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ec1130c5-9318-4313-93e2-1a93f7a70c22 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:38.114207 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ec1130c5-9318-4313-93e2-1a93f7a70c22 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1874 microversion: 2.42 time: 0.434184 Apr 16 21:23:38.115455 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2237/4292] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:23:37 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1874 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:23:38.121550 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f9dbbaea-18eb-4ef4-86f2-ceadef385661 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:38.126173 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f9dbbaea-18eb-4ef4-86f2-ceadef385661 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 8d623e8d-480f-48ef-b90c-04450df4aec8] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:38.133722 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9dbbaea-18eb-4ef4-86f2-ceadef385661 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:38.134742 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9dbbaea-18eb-4ef4-86f2-ceadef385661 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:38.154621 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9dbbaea-18eb-4ef4-86f2-ceadef385661 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:38.155977 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9dbbaea-18eb-4ef4-86f2-ceadef385661 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:38.463243 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f9dbbaea-18eb-4ef4-86f2-ceadef385661 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:38.477480 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f9dbbaea-18eb-4ef4-86f2-ceadef385661 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8" status: 200 len: 1366 microversion: 2.1 time: 0.360467 Apr 16 21:23:38.479250 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2238/4293] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:38 2022] GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8 => generated 1366 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:38.485997 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-157e744e-5f92-4986-b795-24f6f30c4442 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:38.486879 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-157e744e-5f92-4986-b795-24f6f30c4442 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] [instance: 06c0c0c5-19a1-4c21-b19e-a9878ab4f25e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:38.561039 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-157e744e-5f92-4986-b795-24f6f30c4442 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7ad620035e4c9f97da1a1b445437b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d72b2bb3a304796bb144bc739ffcb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:38.568865 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-157e744e-5f92-4986-b795-24f6f30c4442 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] 10.222.0.20 "GET /compute/v2.1/servers/06c0c0c5-19a1-4c21-b19e-a9878ab4f25e" status: 200 len: 1213 microversion: 2.1 time: 0.087511 Apr 16 21:23:38.569458 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2239/4294] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:38 2022] GET /compute/v2.1/servers/06c0c0c5-19a1-4c21-b19e-a9878ab4f25e => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:38.580888 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3d487a4a-11af-49c2-babd-8cf65b7c6dfa tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:38.582818 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3d487a4a-11af-49c2-babd-8cf65b7c6dfa tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3704be44-6fc4-4b14-b0c0-eb1388d807a5] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:38.593746 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d487a4a-11af-49c2-babd-8cf65b7c6dfa tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:38.594555 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d487a4a-11af-49c2-babd-8cf65b7c6dfa tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:38.596227 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d487a4a-11af-49c2-babd-8cf65b7c6dfa tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:38.596889 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d487a4a-11af-49c2-babd-8cf65b7c6dfa tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:38.785424 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3d487a4a-11af-49c2-babd-8cf65b7c6dfa tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:38.794294 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3d487a4a-11af-49c2-babd-8cf65b7c6dfa tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5" status: 200 len: 1315 microversion: 2.1 time: 0.223542 Apr 16 21:23:38.794806 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2240/4295] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:38 2022] GET /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5 => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:38.801190 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-3459c01a-8b11-4f98-a91b-261d71a0cdcc req-ccaa5129-0b9c-4654-a6a8-1dd239fa92ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70e22cc6-e4af-4230-a480-bbbe6b60d462", "tag": "530c687e-6ccd-45ad-ad6e-7e4a0d9487ee"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:23:38.846611 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-3459c01a-8b11-4f98-a91b-261d71a0cdcc req-ccaa5129-0b9c-4654-a6a8-1dd239fa92ce service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:38.848356 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-3459c01a-8b11-4f98-a91b-261d71a0cdcc req-ccaa5129-0b9c-4654-a6a8-1dd239fa92ce service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:38.878619 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-3459c01a-8b11-4f98-a91b-261d71a0cdcc req-ccaa5129-0b9c-4654-a6a8-1dd239fa92ce service nova] Creating event network-changed:530c687e-6ccd-45ad-ad6e-7e4a0d9487ee for instance 70e22cc6-e4af-4230-a480-bbbe6b60d462 on nch1-master-1 Apr 16 21:23:38.891123 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-3459c01a-8b11-4f98-a91b-261d71a0cdcc req-ccaa5129-0b9c-4654-a6a8-1dd239fa92ce service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094905 Apr 16 21:23:38.893522 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2241/4296] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:23:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:23:38.899528 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-bd0519e4-e617-4431-8488-c06de9e9afdd tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:23:38.899998 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-bd0519e4-e617-4431-8488-c06de9e9afdd tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:23:38.900535 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-bd0519e4-e617-4431-8488-c06de9e9afdd tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:23:38.901107 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-bd0519e4-e617-4431-8488-c06de9e9afdd tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:23:38.901436 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-bd0519e4-e617-4431-8488-c06de9e9afdd tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:23:38.901902 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e81ef5f5-889c-44d4-b7cf-d69b65a2104a tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:38.903022 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e81ef5f5-889c-44d4-b7cf-d69b65a2104a tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:38.914974 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e81ef5f5-889c-44d4-b7cf-d69b65a2104a tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:38.915824 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e81ef5f5-889c-44d4-b7cf-d69b65a2104a tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:38.917253 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e81ef5f5-889c-44d4-b7cf-d69b65a2104a tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:38.918043 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e81ef5f5-889c-44d4-b7cf-d69b65a2104a tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:38.918981 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bd0519e4-e617-4431-8488-c06de9e9afdd tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:38.919554 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bd0519e4-e617-4431-8488-c06de9e9afdd tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:38.920404 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bd0519e4-e617-4431-8488-c06de9e9afdd tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:38.923702 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bd0519e4-e617-4431-8488-c06de9e9afdd tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:38.951124 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-bd0519e4-e617-4431-8488-c06de9e9afdd tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Getting quotas for project 90232777aaeb43de91ca009adce2f8ae. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:23:38.978622 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-bd0519e4-e617-4431-8488-c06de9e9afdd tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Getting quotas for user 4910a3e985a3489a8e2a86d9213525a7 and project 90232777aaeb43de91ca009adce2f8ae. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:23:38.996496 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bd0519e4-e617-4431-8488-c06de9e9afdd tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:23:39.004563 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bd0519e4-e617-4431-8488-c06de9e9afdd tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] [instance: c13c741a-7277-49dc-bb1f-b17e77c02c7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:23:39.162482 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bd0519e4-e617-4431-8488-c06de9e9afdd tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.919429 Apr 16 21:23:39.164217 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2056/4297] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:23:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:23:39.198082 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-923d02fa-8aa8-4032-b051-0d4e089e3540 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:39.200704 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-923d02fa-8aa8-4032-b051-0d4e089e3540 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:39.228683 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-923d02fa-8aa8-4032-b051-0d4e089e3540 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:39.229711 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-923d02fa-8aa8-4032-b051-0d4e089e3540 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:39.230881 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-923d02fa-8aa8-4032-b051-0d4e089e3540 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:39.231327 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-923d02fa-8aa8-4032-b051-0d4e089e3540 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:39.778423 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-923d02fa-8aa8-4032-b051-0d4e089e3540 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:39.796851 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-923d02fa-8aa8-4032-b051-0d4e089e3540 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:39.797411 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-923d02fa-8aa8-4032-b051-0d4e089e3540 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:39.798654 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-923d02fa-8aa8-4032-b051-0d4e089e3540 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1874 microversion: 2.42 time: 0.613781 Apr 16 21:23:39.817027 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2057/4298] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:23:39 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1874 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:23:39.822966 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d09b8b4f-73c7-49bc-8189-7bce3e0e26a8 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:39.823832 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d09b8b4f-73c7-49bc-8189-7bce3e0e26a8 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] [instance: c13c741a-7277-49dc-bb1f-b17e77c02c7b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:39.873184 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e81ef5f5-889c-44d4-b7cf-d69b65a2104a tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc8a2da85ec46948b5bc30ed7a363bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5096c21fbfe41dd80379e0e3b6fb8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:39.881736 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e81ef5f5-889c-44d4-b7cf-d69b65a2104a tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304" status: 200 len: 1322 microversion: 2.1 time: 0.986791 Apr 16 21:23:39.895294 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2242/4299] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:38 2022] GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304 => generated 1322 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:39.905617 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8667d012-b919-40b1-820b-b9251bcfa55a tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:39.906377 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8667d012-b919-40b1-820b-b9251bcfa55a tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 8d623e8d-480f-48ef-b90c-04450df4aec8] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:39.915440 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8667d012-b919-40b1-820b-b9251bcfa55a tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:39.916139 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8667d012-b919-40b1-820b-b9251bcfa55a tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:39.917042 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8667d012-b919-40b1-820b-b9251bcfa55a tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:39.917722 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8667d012-b919-40b1-820b-b9251bcfa55a tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:39.918070 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d09b8b4f-73c7-49bc-8189-7bce3e0e26a8 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4910a3e985a3489a8e2a86d9213525a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90232777aaeb43de91ca009adce2f8ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:39.930059 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d09b8b4f-73c7-49bc-8189-7bce3e0e26a8 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] 10.222.0.20 "GET /compute/v2.1/servers/c13c741a-7277-49dc-bb1f-b17e77c02c7b" status: 200 len: 1225 microversion: 2.1 time: 0.110772 Apr 16 21:23:39.935606 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2058/4300] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:39 2022] GET /compute/v2.1/servers/c13c741a-7277-49dc-bb1f-b17e77c02c7b => generated 1225 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:39.944609 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-202aa496-ef0e-4dd4-91c9-28e0d03da789 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:39.945431 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-202aa496-ef0e-4dd4-91c9-28e0d03da789 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] [instance: 06c0c0c5-19a1-4c21-b19e-a9878ab4f25e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:39.961256 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-202aa496-ef0e-4dd4-91c9-28e0d03da789 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:39.961986 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-202aa496-ef0e-4dd4-91c9-28e0d03da789 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:39.965442 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-202aa496-ef0e-4dd4-91c9-28e0d03da789 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:39.966155 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-202aa496-ef0e-4dd4-91c9-28e0d03da789 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:40.059056 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-202aa496-ef0e-4dd4-91c9-28e0d03da789 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7ad620035e4c9f97da1a1b445437b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d72b2bb3a304796bb144bc739ffcb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:40.064380 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-202aa496-ef0e-4dd4-91c9-28e0d03da789 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] 10.222.0.20 "GET /compute/v2.1/servers/06c0c0c5-19a1-4c21-b19e-a9878ab4f25e" status: 200 len: 1265 microversion: 2.1 time: 0.127154 Apr 16 21:23:40.074255 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2059/4301] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:39 2022] GET /compute/v2.1/servers/06c0c0c5-19a1-4c21-b19e-a9878ab4f25e => generated 1265 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:40.078182 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-a375e5f9-3118-48d2-b3b6-1b271ede5067 req-ec35c91c-8277-4bb0-8d58-aa4eb376fedc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d623e8d-480f-48ef-b90c-04450df4aec8", "name": "network-vif-plugged", "status": "completed", "tag": "459ce4bf-03df-40c1-b9aa-0e81a103ea05"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:23:40.090399 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-a375e5f9-3118-48d2-b3b6-1b271ede5067 req-ec35c91c-8277-4bb0-8d58-aa4eb376fedc service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:40.090863 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-a375e5f9-3118-48d2-b3b6-1b271ede5067 req-ec35c91c-8277-4bb0-8d58-aa4eb376fedc service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:40.103960 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-a375e5f9-3118-48d2-b3b6-1b271ede5067 req-ec35c91c-8277-4bb0-8d58-aa4eb376fedc service nova] Creating event network-vif-plugged:459ce4bf-03df-40c1-b9aa-0e81a103ea05 for instance 8d623e8d-480f-48ef-b90c-04450df4aec8 on nch2-master-1 Apr 16 21:23:40.110477 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-a375e5f9-3118-48d2-b3b6-1b271ede5067 req-ec35c91c-8277-4bb0-8d58-aa4eb376fedc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043836 Apr 16 21:23:40.111244 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2060/4302] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:23:40.140939 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b9225505-c9a0-4185-a4ef-d02949cc2b53 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:40.141770 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b9225505-c9a0-4185-a4ef-d02949cc2b53 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3704be44-6fc4-4b14-b0c0-eb1388d807a5] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:40.150042 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b9225505-c9a0-4185-a4ef-d02949cc2b53 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:40.150902 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b9225505-c9a0-4185-a4ef-d02949cc2b53 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:40.151704 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b9225505-c9a0-4185-a4ef-d02949cc2b53 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:40.152462 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b9225505-c9a0-4185-a4ef-d02949cc2b53 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:40.305746 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8667d012-b919-40b1-820b-b9251bcfa55a tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:40.321725 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8667d012-b919-40b1-820b-b9251bcfa55a tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8" status: 200 len: 1366 microversion: 2.1 time: 0.422781 Apr 16 21:23:40.324249 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2243/4303] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:39 2022] GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8 => generated 1366 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:40.513284 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b9225505-c9a0-4185-a4ef-d02949cc2b53 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:40.526134 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b9225505-c9a0-4185-a4ef-d02949cc2b53 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5" status: 200 len: 1315 microversion: 2.1 time: 0.398710 Apr 16 21:23:40.526746 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2061/4304] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:40 2022] GET /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5 => generated 1315 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:40.832345 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ce379c51-ea1c-459d-a7b0-e9f28c03a3e7 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:40.840120 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ce379c51-ea1c-459d-a7b0-e9f28c03a3e7 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:40.849737 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ce379c51-ea1c-459d-a7b0-e9f28c03a3e7 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:40.850451 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ce379c51-ea1c-459d-a7b0-e9f28c03a3e7 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:40.851595 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ce379c51-ea1c-459d-a7b0-e9f28c03a3e7 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:40.852335 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ce379c51-ea1c-459d-a7b0-e9f28c03a3e7 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:40.900898 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-81eefbbd-8b0c-4831-b511-64ae32ce6a04 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:40.901862 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-81eefbbd-8b0c-4831-b511-64ae32ce6a04 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:40.910252 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-81eefbbd-8b0c-4831-b511-64ae32ce6a04 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:40.910974 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-81eefbbd-8b0c-4831-b511-64ae32ce6a04 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:40.912494 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-81eefbbd-8b0c-4831-b511-64ae32ce6a04 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:40.913111 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-81eefbbd-8b0c-4831-b511-64ae32ce6a04 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:41.150196 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-81eefbbd-8b0c-4831-b511-64ae32ce6a04 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc8a2da85ec46948b5bc30ed7a363bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5096c21fbfe41dd80379e0e3b6fb8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:41.165203 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-81eefbbd-8b0c-4831-b511-64ae32ce6a04 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304" status: 200 len: 1517 microversion: 2.1 time: 0.270489 Apr 16 21:23:41.166373 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2062/4305] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:40 2022] GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304 => generated 1517 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:23:41.174040 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-5c9a0c5f-d24a-43f8-8906-c52ab2ad1ba7 req-83033c28-794b-4b97-9456-572cdce7541b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70e22cc6-e4af-4230-a480-bbbe6b60d462", "tag": "fdca9e15-fa18-4555-99b5-61429f002844"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:23:41.188701 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-5c9a0c5f-d24a-43f8-8906-c52ab2ad1ba7 req-83033c28-794b-4b97-9456-572cdce7541b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:41.189376 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-5c9a0c5f-d24a-43f8-8906-c52ab2ad1ba7 req-83033c28-794b-4b97-9456-572cdce7541b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:41.203867 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-5c9a0c5f-d24a-43f8-8906-c52ab2ad1ba7 req-83033c28-794b-4b97-9456-572cdce7541b service nova] Creating event network-changed:fdca9e15-fa18-4555-99b5-61429f002844 for instance 70e22cc6-e4af-4230-a480-bbbe6b60d462 on nch1-master-1 Apr 16 21:23:41.210247 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-5c9a0c5f-d24a-43f8-8906-c52ab2ad1ba7 req-83033c28-794b-4b97-9456-572cdce7541b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041159 Apr 16 21:23:41.211488 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2063/4306] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:23:41.220902 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-59150e06-8307-4b87-8a43-abded0bb612a tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:41.223356 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-59150e06-8307-4b87-8a43-abded0bb612a tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] [instance: c13c741a-7277-49dc-bb1f-b17e77c02c7b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:41.231448 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-59150e06-8307-4b87-8a43-abded0bb612a tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:41.232031 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-59150e06-8307-4b87-8a43-abded0bb612a tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:41.232205 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ce379c51-ea1c-459d-a7b0-e9f28c03a3e7 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:41.237333 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-59150e06-8307-4b87-8a43-abded0bb612a tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:41.237333 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-59150e06-8307-4b87-8a43-abded0bb612a tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:41.241913 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ce379c51-ea1c-459d-a7b0-e9f28c03a3e7 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:41.243402 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ce379c51-ea1c-459d-a7b0-e9f28c03a3e7 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:41.247686 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ce379c51-ea1c-459d-a7b0-e9f28c03a3e7 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1874 microversion: 2.42 time: 0.425956 Apr 16 21:23:41.248290 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2244/4307] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:23:40 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1874 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:23:41.256908 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0b5b15af-caf4-4b03-85a2-179c8616696c tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:41.257727 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0b5b15af-caf4-4b03-85a2-179c8616696c tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] [instance: 06c0c0c5-19a1-4c21-b19e-a9878ab4f25e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:41.267180 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0b5b15af-caf4-4b03-85a2-179c8616696c tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:41.267866 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0b5b15af-caf4-4b03-85a2-179c8616696c tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:41.273674 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0b5b15af-caf4-4b03-85a2-179c8616696c tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:41.274356 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0b5b15af-caf4-4b03-85a2-179c8616696c tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:41.386442 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-59150e06-8307-4b87-8a43-abded0bb612a tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4910a3e985a3489a8e2a86d9213525a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90232777aaeb43de91ca009adce2f8ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:41.397705 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-59150e06-8307-4b87-8a43-abded0bb612a tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] 10.222.0.20 "GET /compute/v2.1/servers/c13c741a-7277-49dc-bb1f-b17e77c02c7b" status: 200 len: 1229 microversion: 2.1 time: 0.183753 Apr 16 21:23:41.400399 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0b5b15af-caf4-4b03-85a2-179c8616696c tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7ad620035e4c9f97da1a1b445437b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d72b2bb3a304796bb144bc739ffcb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:41.410754 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2064/4308] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:41 2022] GET /compute/v2.1/servers/c13c741a-7277-49dc-bb1f-b17e77c02c7b => generated 1229 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:41.411595 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0b5b15af-caf4-4b03-85a2-179c8616696c tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] 10.222.0.20 "GET /compute/v2.1/servers/06c0c0c5-19a1-4c21-b19e-a9878ab4f25e" status: 200 len: 1271 microversion: 2.1 time: 0.158153 Apr 16 21:23:41.415020 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2245/4309] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:41 2022] GET /compute/v2.1/servers/06c0c0c5-19a1-4c21-b19e-a9878ab4f25e => generated 1271 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:41.427168 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-426a4412-8041-46af-b64f-4e1edca55aff tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:23:41.433766 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-426a4412-8041-46af-b64f-4e1edca55aff tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:41.434085 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-65934c8e-de72-4696-b7d8-781fdd646733 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:41.434085 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-65934c8e-de72-4696-b7d8-781fdd646733 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 8d623e8d-480f-48ef-b90c-04450df4aec8] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:41.436567 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-426a4412-8041-46af-b64f-4e1edca55aff tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:41.437120 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-426a4412-8041-46af-b64f-4e1edca55aff tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:41.437995 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-426a4412-8041-46af-b64f-4e1edca55aff tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:41.438661 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-426a4412-8041-46af-b64f-4e1edca55aff tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:41.445839 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-65934c8e-de72-4696-b7d8-781fdd646733 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:41.449116 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-65934c8e-de72-4696-b7d8-781fdd646733 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:41.450026 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-65934c8e-de72-4696-b7d8-781fdd646733 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:41.450907 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-65934c8e-de72-4696-b7d8-781fdd646733 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:41.472218 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-426a4412-8041-46af-b64f-4e1edca55aff tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lazy-loading 'flavor' on Instance uuid b36f160b-012c-42fa-8884-2d4f22c5f304 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:23:41.727453 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-65934c8e-de72-4696-b7d8-781fdd646733 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:41.738160 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-65934c8e-de72-4696-b7d8-781fdd646733 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8" status: 200 len: 1366 microversion: 2.1 time: 0.321879 Apr 16 21:23:41.739127 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2246/4310] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:41 2022] GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8 => generated 1366 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:41.747059 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-08c29848-155a-4f9e-9632-e4e58a36347d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:41.747944 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-08c29848-155a-4f9e-9632-e4e58a36347d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3704be44-6fc4-4b14-b0c0-eb1388d807a5] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:41.765619 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-08c29848-155a-4f9e-9632-e4e58a36347d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:41.765619 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-08c29848-155a-4f9e-9632-e4e58a36347d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:41.765619 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-08c29848-155a-4f9e-9632-e4e58a36347d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:41.766709 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-08c29848-155a-4f9e-9632-e4e58a36347d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:41.859850 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-426a4412-8041-46af-b64f-4e1edca55aff tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "POST /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304/action" status: 200 len: 32 microversion: 2.1 time: 0.446770 Apr 16 21:23:41.860949 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2065/4311] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:23:41 2022] POST /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304/action => generated 32 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:23:41.890381 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-36e414e6-b809-4d89-b76d-109f109d7cb2 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:41.893040 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-36e414e6-b809-4d89-b76d-109f109d7cb2 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:41.905909 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-36e414e6-b809-4d89-b76d-109f109d7cb2 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:41.906611 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-36e414e6-b809-4d89-b76d-109f109d7cb2 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:41.908147 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-36e414e6-b809-4d89-b76d-109f109d7cb2 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:41.908832 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-36e414e6-b809-4d89-b76d-109f109d7cb2 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:42.052036 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-08c29848-155a-4f9e-9632-e4e58a36347d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:42.065235 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-08c29848-155a-4f9e-9632-e4e58a36347d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5" status: 200 len: 1315 microversion: 2.1 time: 0.320392 Apr 16 21:23:42.065235 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2247/4312] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:41 2022] GET /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5 => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:42.250811 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-36e414e6-b809-4d89-b76d-109f109d7cb2 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc8a2da85ec46948b5bc30ed7a363bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5096c21fbfe41dd80379e0e3b6fb8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:42.259011 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-36e414e6-b809-4d89-b76d-109f109d7cb2 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304" status: 200 len: 1523 microversion: 2.1 time: 0.381757 Apr 16 21:23:42.268977 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-07cf515e-e39f-44bd-8741-6a9d0ea7a93e tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:42.268977 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-07cf515e-e39f-44bd-8741-6a9d0ea7a93e tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:42.269759 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2066/4313] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:41 2022] GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304 => generated 1523 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:42.273924 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-07cf515e-e39f-44bd-8741-6a9d0ea7a93e tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:42.275756 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-07cf515e-e39f-44bd-8741-6a9d0ea7a93e tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:42.277573 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-07cf515e-e39f-44bd-8741-6a9d0ea7a93e tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:42.278193 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-07cf515e-e39f-44bd-8741-6a9d0ea7a93e tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:42.431007 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-55b31700-a3eb-4788-b533-0a0735715bd8 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:42.435010 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-55b31700-a3eb-4788-b533-0a0735715bd8 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] [instance: c13c741a-7277-49dc-bb1f-b17e77c02c7b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:42.444402 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-55b31700-a3eb-4788-b533-0a0735715bd8 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:42.444868 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-55b31700-a3eb-4788-b533-0a0735715bd8 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:42.445720 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-55b31700-a3eb-4788-b533-0a0735715bd8 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:42.446361 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-55b31700-a3eb-4788-b533-0a0735715bd8 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:42.756809 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-07cf515e-e39f-44bd-8741-6a9d0ea7a93e tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:42.767036 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-07cf515e-e39f-44bd-8741-6a9d0ea7a93e tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:42.768886 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-07cf515e-e39f-44bd-8741-6a9d0ea7a93e tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:42.770489 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-07cf515e-e39f-44bd-8741-6a9d0ea7a93e tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1874 microversion: 2.42 time: 0.507706 Apr 16 21:23:42.771626 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2248/4314] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:23:42 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1874 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:23:42.779134 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e3b11fdc-5cee-4006-8cbf-1ff442b8588c tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:42.780000 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e3b11fdc-5cee-4006-8cbf-1ff442b8588c tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] [instance: 06c0c0c5-19a1-4c21-b19e-a9878ab4f25e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:42.786687 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e3b11fdc-5cee-4006-8cbf-1ff442b8588c tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:42.787945 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e3b11fdc-5cee-4006-8cbf-1ff442b8588c tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:42.789488 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e3b11fdc-5cee-4006-8cbf-1ff442b8588c tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:42.790133 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e3b11fdc-5cee-4006-8cbf-1ff442b8588c tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:42.848210 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-55b31700-a3eb-4788-b533-0a0735715bd8 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4910a3e985a3489a8e2a86d9213525a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90232777aaeb43de91ca009adce2f8ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:42.859974 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-55b31700-a3eb-4788-b533-0a0735715bd8 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] 10.222.0.20 "GET /compute/v2.1/servers/c13c741a-7277-49dc-bb1f-b17e77c02c7b" status: 200 len: 1285 microversion: 2.1 time: 0.435103 Apr 16 21:23:42.861188 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2067/4315] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:42 2022] GET /compute/v2.1/servers/c13c741a-7277-49dc-bb1f-b17e77c02c7b => generated 1285 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:42.871506 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1dc21221-8488-4123-8a2d-8d4cf21f49e5 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:42.872520 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1dc21221-8488-4123-8a2d-8d4cf21f49e5 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 8d623e8d-480f-48ef-b90c-04450df4aec8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:42.881355 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1dc21221-8488-4123-8a2d-8d4cf21f49e5 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:42.882239 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1dc21221-8488-4123-8a2d-8d4cf21f49e5 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:42.883294 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1dc21221-8488-4123-8a2d-8d4cf21f49e5 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:42.883968 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1dc21221-8488-4123-8a2d-8d4cf21f49e5 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:43.179089 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e3b11fdc-5cee-4006-8cbf-1ff442b8588c tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7ad620035e4c9f97da1a1b445437b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d72b2bb3a304796bb144bc739ffcb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:43.197638 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e3b11fdc-5cee-4006-8cbf-1ff442b8588c tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] 10.222.0.20 "GET /compute/v2.1/servers/06c0c0c5-19a1-4c21-b19e-a9878ab4f25e" status: 200 len: 1313 microversion: 2.1 time: 0.424585 Apr 16 21:23:43.199435 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2249/4316] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:42 2022] GET /compute/v2.1/servers/06c0c0c5-19a1-4c21-b19e-a9878ab4f25e => generated 1313 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:43.211442 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-deb00356-490e-4ec5-a804-77161aee21a0 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:43.212297 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-deb00356-490e-4ec5-a804-77161aee21a0 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3704be44-6fc4-4b14-b0c0-eb1388d807a5] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:43.223417 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-deb00356-490e-4ec5-a804-77161aee21a0 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:43.225544 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-deb00356-490e-4ec5-a804-77161aee21a0 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:43.225544 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-deb00356-490e-4ec5-a804-77161aee21a0 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:43.226804 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-deb00356-490e-4ec5-a804-77161aee21a0 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:43.294026 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1dc21221-8488-4123-8a2d-8d4cf21f49e5 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:43.308874 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1dc21221-8488-4123-8a2d-8d4cf21f49e5 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8" status: 200 len: 1556 microversion: 2.1 time: 0.445601 Apr 16 21:23:43.312353 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2068/4317] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:42 2022] GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8 => generated 1556 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:43.319742 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-f7d46c59-102a-45be-9b2a-a81c0b20432a req-170a7a12-2615-4d1c-a393-7c646ec0f3dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3704be44-6fc4-4b14-b0c0-eb1388d807a5", "name": "network-vif-plugged", "status": "completed", "tag": "f66da356-52f4-4b47-9500-04fa22ef8e21"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:23:43.328828 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-f7d46c59-102a-45be-9b2a-a81c0b20432a req-170a7a12-2615-4d1c-a393-7c646ec0f3dc service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:43.329603 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-f7d46c59-102a-45be-9b2a-a81c0b20432a req-170a7a12-2615-4d1c-a393-7c646ec0f3dc service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:43.345349 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-f7d46c59-102a-45be-9b2a-a81c0b20432a req-170a7a12-2615-4d1c-a393-7c646ec0f3dc service nova] Creating event network-vif-plugged:f66da356-52f4-4b47-9500-04fa22ef8e21 for instance 3704be44-6fc4-4b14-b0c0-eb1388d807a5 on nch2-master-1 Apr 16 21:23:43.354038 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-f7d46c59-102a-45be-9b2a-a81c0b20432a req-170a7a12-2615-4d1c-a393-7c646ec0f3dc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042394 Apr 16 21:23:43.355094 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2069/4318] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:23:43.362760 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b1e2c0cf-7e8c-4d55-94cf-a86292d691e0 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:43.363910 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b1e2c0cf-7e8c-4d55-94cf-a86292d691e0 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:43.371666 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b1e2c0cf-7e8c-4d55-94cf-a86292d691e0 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:43.372521 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b1e2c0cf-7e8c-4d55-94cf-a86292d691e0 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:43.373771 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b1e2c0cf-7e8c-4d55-94cf-a86292d691e0 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:43.374460 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b1e2c0cf-7e8c-4d55-94cf-a86292d691e0 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:43.484415 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-deb00356-490e-4ec5-a804-77161aee21a0 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:43.493187 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-deb00356-490e-4ec5-a804-77161aee21a0 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5" status: 200 len: 1315 microversion: 2.1 time: 0.291062 Apr 16 21:23:43.494057 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2250/4319] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:43 2022] GET /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5 => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:43.499482 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-63614d3f-67f2-48f3-9068-424422472992 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:43.499991 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-63614d3f-67f2-48f3-9068-424422472992 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 8d623e8d-480f-48ef-b90c-04450df4aec8] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:43.508385 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-63614d3f-67f2-48f3-9068-424422472992 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:43.508852 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-63614d3f-67f2-48f3-9068-424422472992 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:43.509642 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-63614d3f-67f2-48f3-9068-424422472992 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:43.510088 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-63614d3f-67f2-48f3-9068-424422472992 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:43.621754 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-63614d3f-67f2-48f3-9068-424422472992 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.126552 Apr 16 21:23:43.622450 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2251/4320] 10.222.0.20 () {58 vars in 1274 bytes} [Sat Apr 16 21:23:43 2022] GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8/os-interface => generated 284 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:23:43.790829 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9539514e-307b-4178-95f4-460d6c57089d tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:43.797104 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9539514e-307b-4178-95f4-460d6c57089d tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:43.803734 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9539514e-307b-4178-95f4-460d6c57089d tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:43.804468 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9539514e-307b-4178-95f4-460d6c57089d tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:43.805264 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9539514e-307b-4178-95f4-460d6c57089d tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:43.806088 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9539514e-307b-4178-95f4-460d6c57089d tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:43.856832 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b1e2c0cf-7e8c-4d55-94cf-a86292d691e0 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc8a2da85ec46948b5bc30ed7a363bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5096c21fbfe41dd80379e0e3b6fb8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:43.865303 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b1e2c0cf-7e8c-4d55-94cf-a86292d691e0 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304" status: 200 len: 1523 microversion: 2.1 time: 0.508298 Apr 16 21:23:43.866121 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2070/4321] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:43 2022] GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304 => generated 1523 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:43.881344 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a2549665-b9a3-46dd-a803-0545cebcce30 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:43.882199 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a2549665-b9a3-46dd-a803-0545cebcce30 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] [instance: c13c741a-7277-49dc-bb1f-b17e77c02c7b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:43.890787 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a2549665-b9a3-46dd-a803-0545cebcce30 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:43.892209 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a2549665-b9a3-46dd-a803-0545cebcce30 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:43.892209 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a2549665-b9a3-46dd-a803-0545cebcce30 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:43.894863 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a2549665-b9a3-46dd-a803-0545cebcce30 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:44.004676 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a2549665-b9a3-46dd-a803-0545cebcce30 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4910a3e985a3489a8e2a86d9213525a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90232777aaeb43de91ca009adce2f8ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:44.013310 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a2549665-b9a3-46dd-a803-0545cebcce30 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] 10.222.0.20 "GET /compute/v2.1/servers/c13c741a-7277-49dc-bb1f-b17e77c02c7b" status: 200 len: 1283 microversion: 2.1 time: 0.136894 Apr 16 21:23:44.014230 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2071/4322] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:43 2022] GET /compute/v2.1/servers/c13c741a-7277-49dc-bb1f-b17e77c02c7b => generated 1283 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:44.214957 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-545e0cfa-39b7-4451-8f74-400810f486e0 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:44.215591 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-545e0cfa-39b7-4451-8f74-400810f486e0 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] [instance: 06c0c0c5-19a1-4c21-b19e-a9878ab4f25e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:44.223300 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-545e0cfa-39b7-4451-8f74-400810f486e0 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:44.224632 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-545e0cfa-39b7-4451-8f74-400810f486e0 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:44.225678 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-545e0cfa-39b7-4451-8f74-400810f486e0 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:44.226313 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-545e0cfa-39b7-4451-8f74-400810f486e0 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:44.570409 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-545e0cfa-39b7-4451-8f74-400810f486e0 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7ad620035e4c9f97da1a1b445437b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d72b2bb3a304796bb144bc739ffcb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:44.579899 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-545e0cfa-39b7-4451-8f74-400810f486e0 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] 10.222.0.20 "GET /compute/v2.1/servers/06c0c0c5-19a1-4c21-b19e-a9878ab4f25e" status: 200 len: 1313 microversion: 2.1 time: 0.368726 Apr 16 21:23:44.581127 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2072/4323] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:44 2022] GET /compute/v2.1/servers/06c0c0c5-19a1-4c21-b19e-a9878ab4f25e => generated 1313 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:44.593980 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6680d213-d863-4372-ba10-eb2dc7d90c87 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:44.598129 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6680d213-d863-4372-ba10-eb2dc7d90c87 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3704be44-6fc4-4b14-b0c0-eb1388d807a5] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:44.604396 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6680d213-d863-4372-ba10-eb2dc7d90c87 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:44.606407 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6680d213-d863-4372-ba10-eb2dc7d90c87 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:44.607313 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6680d213-d863-4372-ba10-eb2dc7d90c87 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:44.607835 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6680d213-d863-4372-ba10-eb2dc7d90c87 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:44.643892 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9539514e-307b-4178-95f4-460d6c57089d tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:44.656774 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9539514e-307b-4178-95f4-460d6c57089d tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:44.658276 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9539514e-307b-4178-95f4-460d6c57089d tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:44.659473 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9539514e-307b-4178-95f4-460d6c57089d tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1874 microversion: 2.42 time: 0.873386 Apr 16 21:23:44.660035 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2252/4324] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:23:43 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1874 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:23:44.886369 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-79bd0245-57b3-4f52-94b6-009c2977da98 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:44.887018 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-79bd0245-57b3-4f52-94b6-009c2977da98 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:44.894324 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-79bd0245-57b3-4f52-94b6-009c2977da98 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:44.901486 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-79bd0245-57b3-4f52-94b6-009c2977da98 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:44.901486 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-79bd0245-57b3-4f52-94b6-009c2977da98 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:44.901486 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-79bd0245-57b3-4f52-94b6-009c2977da98 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:45.041574 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6680d213-d863-4372-ba10-eb2dc7d90c87 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:45.051564 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6680d213-d863-4372-ba10-eb2dc7d90c87 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5" status: 200 len: 1315 microversion: 2.1 time: 0.468154 Apr 16 21:23:45.053898 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2073/4325] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:44 2022] GET /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5 => generated 1315 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:45.059807 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-4b4fb1a2-2cbe-4740-ab00-bb00ee45fe5f req-6c209aaa-56bf-4837-9c5c-e5e5616dd173 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06c0c0c5-19a1-4c21-b19e-a9878ab4f25e", "tag": "43c7f7d0-e08b-46c8-ac83-10e7f6e09684"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:23:45.071900 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-4b4fb1a2-2cbe-4740-ab00-bb00ee45fe5f req-6c209aaa-56bf-4837-9c5c-e5e5616dd173 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:45.072660 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-4b4fb1a2-2cbe-4740-ab00-bb00ee45fe5f req-6c209aaa-56bf-4837-9c5c-e5e5616dd173 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:45.091795 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-4b4fb1a2-2cbe-4740-ab00-bb00ee45fe5f req-6c209aaa-56bf-4837-9c5c-e5e5616dd173 service nova] Creating event network-changed:43c7f7d0-e08b-46c8-ac83-10e7f6e09684 for instance 06c0c0c5-19a1-4c21-b19e-a9878ab4f25e on nch1-master-1 Apr 16 21:23:45.097097 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-4b4fb1a2-2cbe-4740-ab00-bb00ee45fe5f req-6c209aaa-56bf-4837-9c5c-e5e5616dd173 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041756 Apr 16 21:23:45.097880 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2074/4326] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:23:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:23:45.103553 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8e3c4e0f-6e47-43f5-b747-4667fa9ff007 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:45.104566 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8e3c4e0f-6e47-43f5-b747-4667fa9ff007 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] [instance: c13c741a-7277-49dc-bb1f-b17e77c02c7b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:45.111269 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8e3c4e0f-6e47-43f5-b747-4667fa9ff007 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:45.118882 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8e3c4e0f-6e47-43f5-b747-4667fa9ff007 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:45.118882 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8e3c4e0f-6e47-43f5-b747-4667fa9ff007 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:45.118882 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8e3c4e0f-6e47-43f5-b747-4667fa9ff007 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:45.154245 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-79bd0245-57b3-4f52-94b6-009c2977da98 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc8a2da85ec46948b5bc30ed7a363bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5096c21fbfe41dd80379e0e3b6fb8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:45.163525 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-79bd0245-57b3-4f52-94b6-009c2977da98 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304" status: 200 len: 1523 microversion: 2.1 time: 0.283318 Apr 16 21:23:45.165269 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2253/4327] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:44 2022] GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304 => generated 1523 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:45.604643 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-be27afea-4253-4120-9610-6d11e3ebe827 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:45.605433 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-be27afea-4253-4120-9610-6d11e3ebe827 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] [instance: 06c0c0c5-19a1-4c21-b19e-a9878ab4f25e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:45.617808 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-be27afea-4253-4120-9610-6d11e3ebe827 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:45.617808 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-be27afea-4253-4120-9610-6d11e3ebe827 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:45.617808 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-be27afea-4253-4120-9610-6d11e3ebe827 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:45.617808 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-be27afea-4253-4120-9610-6d11e3ebe827 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:45.866218 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8e3c4e0f-6e47-43f5-b747-4667fa9ff007 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4910a3e985a3489a8e2a86d9213525a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90232777aaeb43de91ca009adce2f8ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:45.876442 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8e3c4e0f-6e47-43f5-b747-4667fa9ff007 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] 10.222.0.20 "GET /compute/v2.1/servers/c13c741a-7277-49dc-bb1f-b17e77c02c7b" status: 200 len: 1325 microversion: 2.1 time: 0.776772 Apr 16 21:23:45.877549 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2075/4328] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:45 2022] GET /compute/v2.1/servers/c13c741a-7277-49dc-bb1f-b17e77c02c7b => generated 1325 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:45.882614 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-25123026-f35b-4c07-b2fa-9084330a9cb2 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:45.883609 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-25123026-f35b-4c07-b2fa-9084330a9cb2 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:45.890796 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-25123026-f35b-4c07-b2fa-9084330a9cb2 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:45.891669 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-25123026-f35b-4c07-b2fa-9084330a9cb2 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:45.892763 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-25123026-f35b-4c07-b2fa-9084330a9cb2 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:45.893723 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-25123026-f35b-4c07-b2fa-9084330a9cb2 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:46.257879 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-be27afea-4253-4120-9610-6d11e3ebe827 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7ad620035e4c9f97da1a1b445437b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d72b2bb3a304796bb144bc739ffcb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:46.266999 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-be27afea-4253-4120-9610-6d11e3ebe827 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] 10.222.0.20 "GET /compute/v2.1/servers/06c0c0c5-19a1-4c21-b19e-a9878ab4f25e" status: 200 len: 1313 microversion: 2.1 time: 0.672847 Apr 16 21:23:46.267906 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2254/4329] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:45 2022] GET /compute/v2.1/servers/06c0c0c5-19a1-4c21-b19e-a9878ab4f25e => generated 1313 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:46.273423 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e59edbb2-32ff-45e1-924b-8152fadae7e1 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:46.274314 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e59edbb2-32ff-45e1-924b-8152fadae7e1 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3704be44-6fc4-4b14-b0c0-eb1388d807a5] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:46.282138 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e59edbb2-32ff-45e1-924b-8152fadae7e1 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:46.282917 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e59edbb2-32ff-45e1-924b-8152fadae7e1 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:46.283931 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e59edbb2-32ff-45e1-924b-8152fadae7e1 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:46.284651 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e59edbb2-32ff-45e1-924b-8152fadae7e1 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:46.345733 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-25123026-f35b-4c07-b2fa-9084330a9cb2 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:46.357340 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-25123026-f35b-4c07-b2fa-9084330a9cb2 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:46.360761 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-25123026-f35b-4c07-b2fa-9084330a9cb2 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:46.365306 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-25123026-f35b-4c07-b2fa-9084330a9cb2 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1874 microversion: 2.42 time: 0.486552 Apr 16 21:23:46.366868 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2076/4330] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:23:45 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1874 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:23:46.373879 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d44b42ef-e555-487b-b973-e9e95fefe4ef tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:46.374796 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d44b42ef-e555-487b-b973-e9e95fefe4ef tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:46.385523 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d44b42ef-e555-487b-b973-e9e95fefe4ef tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:46.388645 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d44b42ef-e555-487b-b973-e9e95fefe4ef tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:46.389762 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d44b42ef-e555-487b-b973-e9e95fefe4ef tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:46.390444 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d44b42ef-e555-487b-b973-e9e95fefe4ef tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:46.672762 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e59edbb2-32ff-45e1-924b-8152fadae7e1 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:46.672762 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e59edbb2-32ff-45e1-924b-8152fadae7e1 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5" status: 200 len: 1502 microversion: 2.1 time: 0.311851 Apr 16 21:23:46.672762 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2255/4331] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:46 2022] GET /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5 => generated 1502 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:46.672762 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-f5f5bbe1-010f-43c6-a5b9-c630b902466e req-2fa7ce6e-9e8b-4892-94a3-e4017942df5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d623e8d-480f-48ef-b90c-04450df4aec8", "tag": "459ce4bf-03df-40c1-b9aa-0e81a103ea05"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:23:46.672762 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-f5f5bbe1-010f-43c6-a5b9-c630b902466e req-2fa7ce6e-9e8b-4892-94a3-e4017942df5e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:46.672762 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-f5f5bbe1-010f-43c6-a5b9-c630b902466e req-2fa7ce6e-9e8b-4892-94a3-e4017942df5e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:46.672762 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-f5f5bbe1-010f-43c6-a5b9-c630b902466e req-2fa7ce6e-9e8b-4892-94a3-e4017942df5e service nova] Creating event network-changed:459ce4bf-03df-40c1-b9aa-0e81a103ea05 for instance 8d623e8d-480f-48ef-b90c-04450df4aec8 on nch2-master-1 Apr 16 21:23:46.672762 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-f5f5bbe1-010f-43c6-a5b9-c630b902466e req-2fa7ce6e-9e8b-4892-94a3-e4017942df5e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069853 Apr 16 21:23:46.672762 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2256/4332] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:23:46.794398 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d44b42ef-e555-487b-b973-e9e95fefe4ef tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc8a2da85ec46948b5bc30ed7a363bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5096c21fbfe41dd80379e0e3b6fb8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:46.802468 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d44b42ef-e555-487b-b973-e9e95fefe4ef tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304" status: 200 len: 1523 microversion: 2.1 time: 0.434294 Apr 16 21:23:46.811860 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2077/4333] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:46 2022] GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304 => generated 1523 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:46.894689 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-81ac2c71-3b9d-4b68-b053-a4de36a572c0 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:46.906767 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-81ac2c71-3b9d-4b68-b053-a4de36a572c0 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] [instance: c13c741a-7277-49dc-bb1f-b17e77c02c7b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:46.922116 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-81ac2c71-3b9d-4b68-b053-a4de36a572c0 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:46.934571 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-81ac2c71-3b9d-4b68-b053-a4de36a572c0 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:46.935179 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-81ac2c71-3b9d-4b68-b053-a4de36a572c0 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:46.937678 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-81ac2c71-3b9d-4b68-b053-a4de36a572c0 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:47.201955 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-81ac2c71-3b9d-4b68-b053-a4de36a572c0 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4910a3e985a3489a8e2a86d9213525a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90232777aaeb43de91ca009adce2f8ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:47.219304 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-81ac2c71-3b9d-4b68-b053-a4de36a572c0 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] 10.222.0.20 "GET /compute/v2.1/servers/c13c741a-7277-49dc-bb1f-b17e77c02c7b" status: 200 len: 1325 microversion: 2.1 time: 0.326338 Apr 16 21:23:47.220498 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2257/4334] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:46 2022] GET /compute/v2.1/servers/c13c741a-7277-49dc-bb1f-b17e77c02c7b => generated 1325 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:47.289990 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e153f3ff-c810-427f-9c7e-29fdd221b6a7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:47.292327 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e153f3ff-c810-427f-9c7e-29fdd221b6a7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] [instance: 06c0c0c5-19a1-4c21-b19e-a9878ab4f25e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:47.301041 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e153f3ff-c810-427f-9c7e-29fdd221b6a7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:47.301911 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e153f3ff-c810-427f-9c7e-29fdd221b6a7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:47.303507 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e153f3ff-c810-427f-9c7e-29fdd221b6a7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:47.304338 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e153f3ff-c810-427f-9c7e-29fdd221b6a7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:47.384876 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0f953771-75fc-4a15-9e9a-8aa8ee55b190 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:47.389175 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0f953771-75fc-4a15-9e9a-8aa8ee55b190 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:47.397273 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0f953771-75fc-4a15-9e9a-8aa8ee55b190 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:47.397890 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0f953771-75fc-4a15-9e9a-8aa8ee55b190 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:47.398720 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0f953771-75fc-4a15-9e9a-8aa8ee55b190 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:47.400338 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0f953771-75fc-4a15-9e9a-8aa8ee55b190 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:47.775935 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0f953771-75fc-4a15-9e9a-8aa8ee55b190 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:47.789968 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0f953771-75fc-4a15-9e9a-8aa8ee55b190 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:47.791498 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0f953771-75fc-4a15-9e9a-8aa8ee55b190 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:47.794989 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0f953771-75fc-4a15-9e9a-8aa8ee55b190 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1874 microversion: 2.42 time: 0.413713 Apr 16 21:23:47.795609 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2258/4335] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:23:47 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1874 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:23:47.803434 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-30a81c67-6083-48d0-84e7-6f017b45814e req-bfc47e51-3b16-489a-aa70-eb9f1a6f373b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c13c741a-7277-49dc-bb1f-b17e77c02c7b", "tag": "fbff4a6d-61dd-45ec-9093-ac6f555b347a"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:23:47.810261 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e153f3ff-c810-427f-9c7e-29fdd221b6a7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7ad620035e4c9f97da1a1b445437b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d72b2bb3a304796bb144bc739ffcb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:47.822218 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e153f3ff-c810-427f-9c7e-29fdd221b6a7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] 10.222.0.20 "GET /compute/v2.1/servers/06c0c0c5-19a1-4c21-b19e-a9878ab4f25e" status: 200 len: 1313 microversion: 2.1 time: 0.536211 Apr 16 21:23:47.823286 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2078/4336] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:47 2022] GET /compute/v2.1/servers/06c0c0c5-19a1-4c21-b19e-a9878ab4f25e => generated 1313 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:47.827795 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-30a81c67-6083-48d0-84e7-6f017b45814e req-bfc47e51-3b16-489a-aa70-eb9f1a6f373b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:47.828594 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-30a81c67-6083-48d0-84e7-6f017b45814e req-bfc47e51-3b16-489a-aa70-eb9f1a6f373b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:47.835449 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-712ff100-4766-459e-855d-e17ebb7446b3 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:47.837814 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-712ff100-4766-459e-855d-e17ebb7446b3 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:47.841245 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-30a81c67-6083-48d0-84e7-6f017b45814e req-bfc47e51-3b16-489a-aa70-eb9f1a6f373b service nova] Creating event network-changed:fbff4a6d-61dd-45ec-9093-ac6f555b347a for instance c13c741a-7277-49dc-bb1f-b17e77c02c7b on nch1-master-1 Apr 16 21:23:47.849846 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-30a81c67-6083-48d0-84e7-6f017b45814e req-bfc47e51-3b16-489a-aa70-eb9f1a6f373b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052478 Apr 16 21:23:47.850768 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2259/4337] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:23:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:23:47.855292 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-712ff100-4766-459e-855d-e17ebb7446b3 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:47.856162 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-712ff100-4766-459e-855d-e17ebb7446b3 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:47.857279 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-712ff100-4766-459e-855d-e17ebb7446b3 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:47.859740 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-712ff100-4766-459e-855d-e17ebb7446b3 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:48.237692 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-788e0220-7519-4093-b8ff-48622cb09cb1 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:48.238315 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-788e0220-7519-4093-b8ff-48622cb09cb1 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] [instance: c13c741a-7277-49dc-bb1f-b17e77c02c7b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:48.245163 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-788e0220-7519-4093-b8ff-48622cb09cb1 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:48.245636 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-788e0220-7519-4093-b8ff-48622cb09cb1 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:48.246447 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-788e0220-7519-4093-b8ff-48622cb09cb1 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:48.246901 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-788e0220-7519-4093-b8ff-48622cb09cb1 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:48.515928 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-788e0220-7519-4093-b8ff-48622cb09cb1 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4910a3e985a3489a8e2a86d9213525a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90232777aaeb43de91ca009adce2f8ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:48.524740 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-788e0220-7519-4093-b8ff-48622cb09cb1 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] 10.222.0.20 "GET /compute/v2.1/servers/c13c741a-7277-49dc-bb1f-b17e77c02c7b" status: 200 len: 1325 microversion: 2.1 time: 0.291948 Apr 16 21:23:48.525482 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2260/4338] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:48 2022] GET /compute/v2.1/servers/c13c741a-7277-49dc-bb1f-b17e77c02c7b => generated 1325 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:23:48.634790 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-712ff100-4766-459e-855d-e17ebb7446b3 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc8a2da85ec46948b5bc30ed7a363bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5096c21fbfe41dd80379e0e3b6fb8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:48.647317 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-712ff100-4766-459e-855d-e17ebb7446b3 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304" status: 200 len: 1523 microversion: 2.1 time: 0.822501 Apr 16 21:23:48.648100 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2079/4339] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:47 2022] GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304 => generated 1523 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:48.814313 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ced0922c-437c-4449-8aff-51e44747fb41 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:48.814938 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ced0922c-437c-4449-8aff-51e44747fb41 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:48.822533 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ced0922c-437c-4449-8aff-51e44747fb41 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:48.822998 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ced0922c-437c-4449-8aff-51e44747fb41 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:48.823785 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ced0922c-437c-4449-8aff-51e44747fb41 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:48.824696 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ced0922c-437c-4449-8aff-51e44747fb41 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:48.845203 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-004da723-d22a-4b52-a5dc-01cb5827a537 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:48.847449 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-004da723-d22a-4b52-a5dc-01cb5827a537 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] [instance: 06c0c0c5-19a1-4c21-b19e-a9878ab4f25e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:48.856250 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-004da723-d22a-4b52-a5dc-01cb5827a537 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:48.857560 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-004da723-d22a-4b52-a5dc-01cb5827a537 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:48.858746 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-004da723-d22a-4b52-a5dc-01cb5827a537 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:48.859276 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-004da723-d22a-4b52-a5dc-01cb5827a537 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:49.124880 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ced0922c-437c-4449-8aff-51e44747fb41 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:49.126747 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-004da723-d22a-4b52-a5dc-01cb5827a537 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7ad620035e4c9f97da1a1b445437b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d72b2bb3a304796bb144bc739ffcb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:49.137123 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-004da723-d22a-4b52-a5dc-01cb5827a537 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] 10.222.0.20 "GET /compute/v2.1/servers/06c0c0c5-19a1-4c21-b19e-a9878ab4f25e" status: 200 len: 1313 microversion: 2.1 time: 0.297951 Apr 16 21:23:49.140511 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2080/4340] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:48 2022] GET /compute/v2.1/servers/06c0c0c5-19a1-4c21-b19e-a9878ab4f25e => generated 1313 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:49.142164 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ced0922c-437c-4449-8aff-51e44747fb41 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:49.143688 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ced0922c-437c-4449-8aff-51e44747fb41 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:49.145228 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ced0922c-437c-4449-8aff-51e44747fb41 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1874 microversion: 2.42 time: 0.335000 Apr 16 21:23:49.148966 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2261/4341] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:23:48 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1874 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:23:49.531517 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d2708744-bb8f-4666-80ab-4dc62d34f906 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dca42ec8-0b24-42de-b8c0-5aa35dcd8ac4"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:23:49.533007 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d2708744-bb8f-4666-80ab-4dc62d34f906 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3704be44-6fc4-4b14-b0c0-eb1388d807a5] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:49.541833 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d2708744-bb8f-4666-80ab-4dc62d34f906 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:49.542302 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d2708744-bb8f-4666-80ab-4dc62d34f906 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:49.543157 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d2708744-bb8f-4666-80ab-4dc62d34f906 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:49.543858 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d2708744-bb8f-4666-80ab-4dc62d34f906 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:49.544828 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-970fec66-b6cc-4ffc-8883-64011ac05aab tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:49.545699 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-970fec66-b6cc-4ffc-8883-64011ac05aab tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] [instance: c13c741a-7277-49dc-bb1f-b17e77c02c7b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:49.557893 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-970fec66-b6cc-4ffc-8883-64011ac05aab tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:49.558748 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-970fec66-b6cc-4ffc-8883-64011ac05aab tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:49.559865 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-970fec66-b6cc-4ffc-8883-64011ac05aab tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:49.560549 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-970fec66-b6cc-4ffc-8883-64011ac05aab tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:49.716987 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-970fec66-b6cc-4ffc-8883-64011ac05aab tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4910a3e985a3489a8e2a86d9213525a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90232777aaeb43de91ca009adce2f8ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:49.725089 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-970fec66-b6cc-4ffc-8883-64011ac05aab tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] 10.222.0.20 "GET /compute/v2.1/servers/c13c741a-7277-49dc-bb1f-b17e77c02c7b" status: 200 len: 1325 microversion: 2.1 time: 0.184779 Apr 16 21:23:49.725660 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2262/4342] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:49 2022] GET /compute/v2.1/servers/c13c741a-7277-49dc-bb1f-b17e77c02c7b => generated 1325 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:49.730115 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-aa00e6ad-dc95-4629-96ab-03e47df637cc tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:49.730717 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-aa00e6ad-dc95-4629-96ab-03e47df637cc tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:49.736200 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aa00e6ad-dc95-4629-96ab-03e47df637cc tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:49.736665 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aa00e6ad-dc95-4629-96ab-03e47df637cc tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:49.737631 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aa00e6ad-dc95-4629-96ab-03e47df637cc tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:49.738077 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aa00e6ad-dc95-4629-96ab-03e47df637cc tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:49.879566 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-aa00e6ad-dc95-4629-96ab-03e47df637cc tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc8a2da85ec46948b5bc30ed7a363bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5096c21fbfe41dd80379e0e3b6fb8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:49.886972 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-aa00e6ad-dc95-4629-96ab-03e47df637cc tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304" status: 200 len: 1523 microversion: 2.1 time: 0.160264 Apr 16 21:23:49.887556 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2263/4343] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:49 2022] GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:50.153269 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bf97e307-bde6-47a2-99f7-ae645c9c1ae2 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:50.153824 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-bf97e307-bde6-47a2-99f7-ae645c9c1ae2 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] [instance: 06c0c0c5-19a1-4c21-b19e-a9878ab4f25e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:50.159931 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bf97e307-bde6-47a2-99f7-ae645c9c1ae2 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:50.160428 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bf97e307-bde6-47a2-99f7-ae645c9c1ae2 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:50.161407 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bf97e307-bde6-47a2-99f7-ae645c9c1ae2 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:50.161888 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bf97e307-bde6-47a2-99f7-ae645c9c1ae2 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:50.257085 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d2708744-bb8f-4666-80ab-4dc62d34f906 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "POST /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.729863 Apr 16 21:23:50.258116 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2081/4344] 10.222.0.20 () {60 vars in 1322 bytes} [Sat Apr 16 21:23:49 2022] POST /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5/os-volume_attachments => generated 194 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:23:50.265037 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cec714e0-1460-4cab-95c2-4584f0774a80 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:50.265762 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-cec714e0-1460-4cab-95c2-4584f0774a80 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:50.275736 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cec714e0-1460-4cab-95c2-4584f0774a80 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:50.276776 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cec714e0-1460-4cab-95c2-4584f0774a80 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:50.277868 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cec714e0-1460-4cab-95c2-4584f0774a80 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:50.278331 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cec714e0-1460-4cab-95c2-4584f0774a80 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:50.344340 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-bf97e307-bde6-47a2-99f7-ae645c9c1ae2 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7ad620035e4c9f97da1a1b445437b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d72b2bb3a304796bb144bc739ffcb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:50.352379 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-bf97e307-bde6-47a2-99f7-ae645c9c1ae2 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] 10.222.0.20 "GET /compute/v2.1/servers/06c0c0c5-19a1-4c21-b19e-a9878ab4f25e" status: 200 len: 1313 microversion: 2.1 time: 0.203622 Apr 16 21:23:50.352960 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2264/4345] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:50 2022] GET /compute/v2.1/servers/06c0c0c5-19a1-4c21-b19e-a9878ab4f25e => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:50.489211 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cec714e0-1460-4cab-95c2-4584f0774a80 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:50.503592 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cec714e0-1460-4cab-95c2-4584f0774a80 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:50.505751 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cec714e0-1460-4cab-95c2-4584f0774a80 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:50.507100 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cec714e0-1460-4cab-95c2-4584f0774a80 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1874 microversion: 2.42 time: 0.247884 Apr 16 21:23:50.508025 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2082/4346] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:23:50 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1874 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:23:50.743820 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-eaee8fc9-c918-4709-a7cc-83eec7e34ea0 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:50.745066 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-eaee8fc9-c918-4709-a7cc-83eec7e34ea0 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] [instance: c13c741a-7277-49dc-bb1f-b17e77c02c7b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:50.751833 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eaee8fc9-c918-4709-a7cc-83eec7e34ea0 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:50.752615 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eaee8fc9-c918-4709-a7cc-83eec7e34ea0 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:50.753583 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eaee8fc9-c918-4709-a7cc-83eec7e34ea0 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:50.754197 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eaee8fc9-c918-4709-a7cc-83eec7e34ea0 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:50.904277 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bc7a143f-a5c0-404e-8e95-873949706618 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:50.907202 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bc7a143f-a5c0-404e-8e95-873949706618 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:50.913446 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bc7a143f-a5c0-404e-8e95-873949706618 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:50.914217 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bc7a143f-a5c0-404e-8e95-873949706618 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:50.915219 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bc7a143f-a5c0-404e-8e95-873949706618 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:50.915856 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bc7a143f-a5c0-404e-8e95-873949706618 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:51.212799 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-bc7a143f-a5c0-404e-8e95-873949706618 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc8a2da85ec46948b5bc30ed7a363bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5096c21fbfe41dd80379e0e3b6fb8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:51.222456 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bc7a143f-a5c0-404e-8e95-873949706618 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304" status: 200 len: 1523 microversion: 2.1 time: 0.322167 Apr 16 21:23:51.227113 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2083/4347] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:50 2022] GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304 => generated 1523 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:23:51.252139 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-eaee8fc9-c918-4709-a7cc-83eec7e34ea0 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4910a3e985a3489a8e2a86d9213525a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90232777aaeb43de91ca009adce2f8ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:51.261481 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-eaee8fc9-c918-4709-a7cc-83eec7e34ea0 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] 10.222.0.20 "GET /compute/v2.1/servers/c13c741a-7277-49dc-bb1f-b17e77c02c7b" status: 200 len: 1325 microversion: 2.1 time: 0.521988 Apr 16 21:23:51.264343 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2265/4348] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:50 2022] GET /compute/v2.1/servers/c13c741a-7277-49dc-bb1f-b17e77c02c7b => generated 1325 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:51.369947 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-88c1dc50-436b-4d07-8bfd-51e44e0e098b tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:51.370532 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-88c1dc50-436b-4d07-8bfd-51e44e0e098b tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] [instance: 06c0c0c5-19a1-4c21-b19e-a9878ab4f25e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:51.385397 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-88c1dc50-436b-4d07-8bfd-51e44e0e098b tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:51.385397 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-88c1dc50-436b-4d07-8bfd-51e44e0e098b tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:51.385397 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-88c1dc50-436b-4d07-8bfd-51e44e0e098b tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:51.385397 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-88c1dc50-436b-4d07-8bfd-51e44e0e098b tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:51.529466 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ede40046-ff6e-482f-b9fd-c716832ffd02 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:51.531143 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ede40046-ff6e-482f-b9fd-c716832ffd02 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:51.544377 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ede40046-ff6e-482f-b9fd-c716832ffd02 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:51.545244 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ede40046-ff6e-482f-b9fd-c716832ffd02 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:51.546441 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ede40046-ff6e-482f-b9fd-c716832ffd02 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:51.547228 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ede40046-ff6e-482f-b9fd-c716832ffd02 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:51.574887 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-88c1dc50-436b-4d07-8bfd-51e44e0e098b tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7ad620035e4c9f97da1a1b445437b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d72b2bb3a304796bb144bc739ffcb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:51.585128 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-88c1dc50-436b-4d07-8bfd-51e44e0e098b tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] 10.222.0.20 "GET /compute/v2.1/servers/06c0c0c5-19a1-4c21-b19e-a9878ab4f25e" status: 200 len: 1313 microversion: 2.1 time: 0.219751 Apr 16 21:23:51.587665 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2084/4349] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:51 2022] GET /compute/v2.1/servers/06c0c0c5-19a1-4c21-b19e-a9878ab4f25e => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:51.696101 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-5a6f1dec-0a34-4b20-b2df-3631efec6b7e req-6882cc2c-6200-4a7c-a60f-ba7493ed1713 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06c0c0c5-19a1-4c21-b19e-a9878ab4f25e", "name": "network-vif-plugged", "status": "completed", "tag": "43c7f7d0-e08b-46c8-ac83-10e7f6e09684"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:23:51.714450 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-5a6f1dec-0a34-4b20-b2df-3631efec6b7e req-6882cc2c-6200-4a7c-a60f-ba7493ed1713 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:51.716387 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-5a6f1dec-0a34-4b20-b2df-3631efec6b7e req-6882cc2c-6200-4a7c-a60f-ba7493ed1713 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:51.731277 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-5a6f1dec-0a34-4b20-b2df-3631efec6b7e req-6882cc2c-6200-4a7c-a60f-ba7493ed1713 service nova] Creating event network-vif-plugged:43c7f7d0-e08b-46c8-ac83-10e7f6e09684 for instance 06c0c0c5-19a1-4c21-b19e-a9878ab4f25e on nch1-master-1 Apr 16 21:23:51.736890 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-5a6f1dec-0a34-4b20-b2df-3631efec6b7e req-6882cc2c-6200-4a7c-a60f-ba7493ed1713 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047764 Apr 16 21:23:51.737570 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2085/4350] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:23:51.869695 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ede40046-ff6e-482f-b9fd-c716832ffd02 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:51.884721 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ede40046-ff6e-482f-b9fd-c716832ffd02 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:51.886628 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ede40046-ff6e-482f-b9fd-c716832ffd02 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:51.889177 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ede40046-ff6e-482f-b9fd-c716832ffd02 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1874 microversion: 2.42 time: 0.365253 Apr 16 21:23:51.901337 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2266/4351] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:23:51 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1874 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:23:52.241782 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7479779b-f0ff-4ff4-a19c-67f521b6fef3 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:52.242683 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7479779b-f0ff-4ff4-a19c-67f521b6fef3 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:52.248836 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7479779b-f0ff-4ff4-a19c-67f521b6fef3 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:52.249291 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7479779b-f0ff-4ff4-a19c-67f521b6fef3 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:52.250062 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7479779b-f0ff-4ff4-a19c-67f521b6fef3 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:52.250496 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7479779b-f0ff-4ff4-a19c-67f521b6fef3 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:52.282229 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-daaae128-0ee6-426c-b28f-15af2c1cc2f1 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:52.283476 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-daaae128-0ee6-426c-b28f-15af2c1cc2f1 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] [instance: c13c741a-7277-49dc-bb1f-b17e77c02c7b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:52.291604 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-daaae128-0ee6-426c-b28f-15af2c1cc2f1 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:52.292218 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-daaae128-0ee6-426c-b28f-15af2c1cc2f1 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:52.293227 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-daaae128-0ee6-426c-b28f-15af2c1cc2f1 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:52.293808 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-daaae128-0ee6-426c-b28f-15af2c1cc2f1 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:52.390590 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7479779b-f0ff-4ff4-a19c-67f521b6fef3 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc8a2da85ec46948b5bc30ed7a363bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5096c21fbfe41dd80379e0e3b6fb8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:52.399089 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7479779b-f0ff-4ff4-a19c-67f521b6fef3 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304" status: 200 len: 1523 microversion: 2.1 time: 0.163074 Apr 16 21:23:52.400660 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2086/4352] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:52 2022] GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:52.447595 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-daaae128-0ee6-426c-b28f-15af2c1cc2f1 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4910a3e985a3489a8e2a86d9213525a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90232777aaeb43de91ca009adce2f8ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:52.455167 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-daaae128-0ee6-426c-b28f-15af2c1cc2f1 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] 10.222.0.20 "GET /compute/v2.1/servers/c13c741a-7277-49dc-bb1f-b17e77c02c7b" status: 200 len: 1325 microversion: 2.1 time: 0.177347 Apr 16 21:23:52.455731 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2267/4353] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:52 2022] GET /compute/v2.1/servers/c13c741a-7277-49dc-bb1f-b17e77c02c7b => generated 1325 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:23:52.602973 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e8dee4ef-6f1b-49c5-9d2f-31801b7fa377 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:52.603846 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e8dee4ef-6f1b-49c5-9d2f-31801b7fa377 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] [instance: 06c0c0c5-19a1-4c21-b19e-a9878ab4f25e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:52.610186 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e8dee4ef-6f1b-49c5-9d2f-31801b7fa377 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:52.610647 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e8dee4ef-6f1b-49c5-9d2f-31801b7fa377 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:52.611774 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e8dee4ef-6f1b-49c5-9d2f-31801b7fa377 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:52.612432 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e8dee4ef-6f1b-49c5-9d2f-31801b7fa377 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:52.745002 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e8dee4ef-6f1b-49c5-9d2f-31801b7fa377 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7ad620035e4c9f97da1a1b445437b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d72b2bb3a304796bb144bc739ffcb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:52.753956 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e8dee4ef-6f1b-49c5-9d2f-31801b7fa377 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] 10.222.0.20 "GET /compute/v2.1/servers/06c0c0c5-19a1-4c21-b19e-a9878ab4f25e" status: 200 len: 1313 microversion: 2.1 time: 0.154935 Apr 16 21:23:52.754863 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2087/4354] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:52 2022] GET /compute/v2.1/servers/06c0c0c5-19a1-4c21-b19e-a9878ab4f25e => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:52.908598 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-aed05079-c20b-49d3-8f1a-f357e29023f0 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:52.909222 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-aed05079-c20b-49d3-8f1a-f357e29023f0 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:52.916385 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aed05079-c20b-49d3-8f1a-f357e29023f0 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:52.916861 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aed05079-c20b-49d3-8f1a-f357e29023f0 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:52.917663 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aed05079-c20b-49d3-8f1a-f357e29023f0 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:52.918119 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aed05079-c20b-49d3-8f1a-f357e29023f0 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:53.208475 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-aed05079-c20b-49d3-8f1a-f357e29023f0 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:53.218014 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-aed05079-c20b-49d3-8f1a-f357e29023f0 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:53.219578 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-aed05079-c20b-49d3-8f1a-f357e29023f0 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:53.220780 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-aed05079-c20b-49d3-8f1a-f357e29023f0 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1874 microversion: 2.42 time: 0.316211 Apr 16 21:23:53.221541 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2268/4355] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:23:52 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1874 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:23:53.416870 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6f1327f0-e5e9-469a-814d-b23649dc9d71 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:53.417487 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6f1327f0-e5e9-469a-814d-b23649dc9d71 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:53.424900 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6f1327f0-e5e9-469a-814d-b23649dc9d71 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:53.429650 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6f1327f0-e5e9-469a-814d-b23649dc9d71 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:53.429650 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6f1327f0-e5e9-469a-814d-b23649dc9d71 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:53.429650 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6f1327f0-e5e9-469a-814d-b23649dc9d71 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:53.476361 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-72c7485a-c481-40ec-814c-133f4b601049 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:53.477271 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-72c7485a-c481-40ec-814c-133f4b601049 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] [instance: c13c741a-7277-49dc-bb1f-b17e77c02c7b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:53.488659 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-72c7485a-c481-40ec-814c-133f4b601049 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:53.491857 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-72c7485a-c481-40ec-814c-133f4b601049 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:53.492991 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-72c7485a-c481-40ec-814c-133f4b601049 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:53.495626 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-72c7485a-c481-40ec-814c-133f4b601049 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:53.580528 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6f1327f0-e5e9-469a-814d-b23649dc9d71 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc8a2da85ec46948b5bc30ed7a363bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5096c21fbfe41dd80379e0e3b6fb8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:53.589070 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6f1327f0-e5e9-469a-814d-b23649dc9d71 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304" status: 200 len: 1523 microversion: 2.1 time: 0.176114 Apr 16 21:23:53.590636 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2088/4356] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:53 2022] GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304 => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:53.726952 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-72c7485a-c481-40ec-814c-133f4b601049 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4910a3e985a3489a8e2a86d9213525a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90232777aaeb43de91ca009adce2f8ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:53.734288 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-72c7485a-c481-40ec-814c-133f4b601049 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] 10.222.0.20 "GET /compute/v2.1/servers/c13c741a-7277-49dc-bb1f-b17e77c02c7b" status: 200 len: 1325 microversion: 2.1 time: 0.265353 Apr 16 21:23:53.734841 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2269/4357] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:53 2022] GET /compute/v2.1/servers/c13c741a-7277-49dc-bb1f-b17e77c02c7b => generated 1325 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:23:53.751184 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-7e872281-5f9d-4775-b642-54aa462d5c9c req-bb7ba730-fd17-4174-9049-c3619a4a0efd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c13c741a-7277-49dc-bb1f-b17e77c02c7b", "name": "network-vif-plugged", "status": "completed", "tag": "fbff4a6d-61dd-45ec-9093-ac6f555b347a"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:23:53.759455 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-7e872281-5f9d-4775-b642-54aa462d5c9c req-bb7ba730-fd17-4174-9049-c3619a4a0efd service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:53.759949 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-7e872281-5f9d-4775-b642-54aa462d5c9c req-bb7ba730-fd17-4174-9049-c3619a4a0efd service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:53.770607 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-7e872281-5f9d-4775-b642-54aa462d5c9c req-bb7ba730-fd17-4174-9049-c3619a4a0efd service nova] Creating event network-vif-plugged:fbff4a6d-61dd-45ec-9093-ac6f555b347a for instance c13c741a-7277-49dc-bb1f-b17e77c02c7b on nch1-master-1 Apr 16 21:23:53.771607 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f766053f-2ade-4ed9-8a22-11197c160f13 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:53.773950 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f766053f-2ade-4ed9-8a22-11197c160f13 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] [instance: 06c0c0c5-19a1-4c21-b19e-a9878ab4f25e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:53.776056 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-7e872281-5f9d-4775-b642-54aa462d5c9c req-bb7ba730-fd17-4174-9049-c3619a4a0efd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028564 Apr 16 21:23:53.776684 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2089/4358] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:23:53.780343 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f766053f-2ade-4ed9-8a22-11197c160f13 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:53.780810 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f766053f-2ade-4ed9-8a22-11197c160f13 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:53.781606 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f766053f-2ade-4ed9-8a22-11197c160f13 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:53.782053 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f766053f-2ade-4ed9-8a22-11197c160f13 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:54.016919 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f766053f-2ade-4ed9-8a22-11197c160f13 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7ad620035e4c9f97da1a1b445437b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d72b2bb3a304796bb144bc739ffcb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:54.025382 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f766053f-2ade-4ed9-8a22-11197c160f13 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] 10.222.0.20 "GET /compute/v2.1/servers/06c0c0c5-19a1-4c21-b19e-a9878ab4f25e" status: 200 len: 1497 microversion: 2.1 time: 0.258352 Apr 16 21:23:54.025961 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2270/4359] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:53 2022] GET /compute/v2.1/servers/06c0c0c5-19a1-4c21-b19e-a9878ab4f25e => generated 1497 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:23:54.241325 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ceb04640-d129-47f4-be31-65cd66dfce78 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:54.242034 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ceb04640-d129-47f4-be31-65cd66dfce78 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:54.253410 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ceb04640-d129-47f4-be31-65cd66dfce78 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:54.258326 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ceb04640-d129-47f4-be31-65cd66dfce78 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:54.258326 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ceb04640-d129-47f4-be31-65cd66dfce78 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:54.258326 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ceb04640-d129-47f4-be31-65cd66dfce78 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:54.483999 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ceb04640-d129-47f4-be31-65cd66dfce78 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:54.494582 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ceb04640-d129-47f4-be31-65cd66dfce78 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:54.496683 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ceb04640-d129-47f4-be31-65cd66dfce78 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:54.497955 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ceb04640-d129-47f4-be31-65cd66dfce78 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1874 microversion: 2.42 time: 0.261572 Apr 16 21:23:54.498698 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2090/4360] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:23:54 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1874 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:23:54.606167 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cf54ccaf-f6da-41f5-8b43-94eb81c97456 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:54.609599 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cf54ccaf-f6da-41f5-8b43-94eb81c97456 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:54.613340 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cf54ccaf-f6da-41f5-8b43-94eb81c97456 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:54.613806 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cf54ccaf-f6da-41f5-8b43-94eb81c97456 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:54.615783 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cf54ccaf-f6da-41f5-8b43-94eb81c97456 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:54.616334 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cf54ccaf-f6da-41f5-8b43-94eb81c97456 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:54.623363 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-064c5483-fcc6-4f2b-a444-16f7559c60e7 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:54.623869 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-064c5483-fcc6-4f2b-a444-16f7559c60e7 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3704be44-6fc4-4b14-b0c0-eb1388d807a5] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:54.629739 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-064c5483-fcc6-4f2b-a444-16f7559c60e7 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:54.630228 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-064c5483-fcc6-4f2b-a444-16f7559c60e7 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:54.631006 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-064c5483-fcc6-4f2b-a444-16f7559c60e7 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:54.631444 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-064c5483-fcc6-4f2b-a444-16f7559c60e7 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:54.659794 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-064c5483-fcc6-4f2b-a444-16f7559c60e7 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3704be44-6fc4-4b14-b0c0-eb1388d807a5] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:23:54.754636 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cf54ccaf-f6da-41f5-8b43-94eb81c97456 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc8a2da85ec46948b5bc30ed7a363bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5096c21fbfe41dd80379e0e3b6fb8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:54.762974 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cf54ccaf-f6da-41f5-8b43-94eb81c97456 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304" status: 200 len: 1523 microversion: 2.1 time: 0.160600 Apr 16 21:23:54.763845 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2271/4361] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:54 2022] GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:54.771431 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-00fa0a17-9ab9-4408-b2ec-6fcffb80be49 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:54.772486 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-00fa0a17-9ab9-4408-b2ec-6fcffb80be49 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] [instance: c13c741a-7277-49dc-bb1f-b17e77c02c7b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:54.779006 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-00fa0a17-9ab9-4408-b2ec-6fcffb80be49 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:54.779609 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-00fa0a17-9ab9-4408-b2ec-6fcffb80be49 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:54.780479 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-00fa0a17-9ab9-4408-b2ec-6fcffb80be49 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:54.781000 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-00fa0a17-9ab9-4408-b2ec-6fcffb80be49 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:54.922628 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-00fa0a17-9ab9-4408-b2ec-6fcffb80be49 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4910a3e985a3489a8e2a86d9213525a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90232777aaeb43de91ca009adce2f8ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:54.930173 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-00fa0a17-9ab9-4408-b2ec-6fcffb80be49 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] 10.222.0.20 "GET /compute/v2.1/servers/c13c741a-7277-49dc-bb1f-b17e77c02c7b" status: 200 len: 1325 microversion: 2.1 time: 0.165184 Apr 16 21:23:54.930733 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2272/4362] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:54 2022] GET /compute/v2.1/servers/c13c741a-7277-49dc-bb1f-b17e77c02c7b => generated 1325 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:54.939538 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-166960b1-7066-4e2c-8ae7-e6474922791d tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:54.940050 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-166960b1-7066-4e2c-8ae7-e6474922791d tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] [instance: 06c0c0c5-19a1-4c21-b19e-a9878ab4f25e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:54.945757 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-166960b1-7066-4e2c-8ae7-e6474922791d tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:54.946246 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-166960b1-7066-4e2c-8ae7-e6474922791d tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:54.947033 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-166960b1-7066-4e2c-8ae7-e6474922791d tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:54.947487 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-166960b1-7066-4e2c-8ae7-e6474922791d tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:54.948731 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-064c5483-fcc6-4f2b-a444-16f7559c60e7 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5" status: 204 len: 0 microversion: 2.1 time: 0.328800 Apr 16 21:23:54.949491 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2091/4363] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:23:54 2022] DELETE /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 16 21:23:54.957852 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-883aff68-8084-40bc-8b16-3c0f5d7b8ce6 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:54.959174 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-883aff68-8084-40bc-8b16-3c0f5d7b8ce6 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3704be44-6fc4-4b14-b0c0-eb1388d807a5] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:54.964983 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-883aff68-8084-40bc-8b16-3c0f5d7b8ce6 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:54.965415 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-883aff68-8084-40bc-8b16-3c0f5d7b8ce6 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:54.966178 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-883aff68-8084-40bc-8b16-3c0f5d7b8ce6 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:54.966617 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-883aff68-8084-40bc-8b16-3c0f5d7b8ce6 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:54.976127 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-166960b1-7066-4e2c-8ae7-e6474922791d tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] [instance: 06c0c0c5-19a1-4c21-b19e-a9878ab4f25e] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:23:55.140428 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-883aff68-8084-40bc-8b16-3c0f5d7b8ce6 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:55.148958 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-883aff68-8084-40bc-8b16-3c0f5d7b8ce6 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5" status: 200 len: 1554 microversion: 2.1 time: 0.195173 Apr 16 21:23:55.149565 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2092/4364] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:54 2022] GET /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5 => generated 1554 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:55.314306 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-166960b1-7066-4e2c-8ae7-e6474922791d tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] 10.222.0.20 "DELETE /compute/v2.1/servers/06c0c0c5-19a1-4c21-b19e-a9878ab4f25e" status: 204 len: 0 microversion: 2.1 time: 0.378134 Apr 16 21:23:55.323761 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3f41eb4e-e952-43f3-a7f6-482fdda05c41 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:55.324411 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3f41eb4e-e952-43f3-a7f6-482fdda05c41 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] [instance: 06c0c0c5-19a1-4c21-b19e-a9878ab4f25e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:55.325218 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2273/4365] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:23:54 2022] DELETE /compute/v2.1/servers/06c0c0c5-19a1-4c21-b19e-a9878ab4f25e => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:23:55.330890 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3f41eb4e-e952-43f3-a7f6-482fdda05c41 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:55.331351 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3f41eb4e-e952-43f3-a7f6-482fdda05c41 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:55.332123 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3f41eb4e-e952-43f3-a7f6-482fdda05c41 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:55.332595 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3f41eb4e-e952-43f3-a7f6-482fdda05c41 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:55.519135 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3d154ff0-191b-42ae-9a92-5d535288bccc tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:55.519912 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3d154ff0-191b-42ae-9a92-5d535288bccc tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:55.526746 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d154ff0-191b-42ae-9a92-5d535288bccc tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:55.527551 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d154ff0-191b-42ae-9a92-5d535288bccc tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:55.528439 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d154ff0-191b-42ae-9a92-5d535288bccc tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:55.528886 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d154ff0-191b-42ae-9a92-5d535288bccc tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:55.538315 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3f41eb4e-e952-43f3-a7f6-482fdda05c41 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7ad620035e4c9f97da1a1b445437b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d72b2bb3a304796bb144bc739ffcb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:55.552475 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3f41eb4e-e952-43f3-a7f6-482fdda05c41 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] 10.222.0.20 "GET /compute/v2.1/servers/06c0c0c5-19a1-4c21-b19e-a9878ab4f25e" status: 200 len: 1503 microversion: 2.1 time: 0.231468 Apr 16 21:23:55.554448 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2093/4366] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:55 2022] GET /compute/v2.1/servers/06c0c0c5-19a1-4c21-b19e-a9878ab4f25e => generated 1503 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:55.730814 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3d154ff0-191b-42ae-9a92-5d535288bccc tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:55.743406 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3d154ff0-191b-42ae-9a92-5d535288bccc tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:55.745315 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3d154ff0-191b-42ae-9a92-5d535288bccc tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:55.747146 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3d154ff0-191b-42ae-9a92-5d535288bccc tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1874 microversion: 2.42 time: 0.231966 Apr 16 21:23:55.748213 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2274/4367] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:23:55 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1874 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:23:55.783112 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7497b118-caad-45d6-a06e-b3effb9fd1b8 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:55.783728 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7497b118-caad-45d6-a06e-b3effb9fd1b8 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:55.790070 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7497b118-caad-45d6-a06e-b3effb9fd1b8 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:55.800986 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7497b118-caad-45d6-a06e-b3effb9fd1b8 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:55.800986 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7497b118-caad-45d6-a06e-b3effb9fd1b8 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:55.800986 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7497b118-caad-45d6-a06e-b3effb9fd1b8 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:55.948129 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7125de5b-f86c-48f3-81b8-cf865fdd8b38 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:55.949332 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7125de5b-f86c-48f3-81b8-cf865fdd8b38 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] [instance: c13c741a-7277-49dc-bb1f-b17e77c02c7b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:55.958083 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7125de5b-f86c-48f3-81b8-cf865fdd8b38 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:55.958571 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7125de5b-f86c-48f3-81b8-cf865fdd8b38 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:55.959674 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7125de5b-f86c-48f3-81b8-cf865fdd8b38 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:55.960310 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7125de5b-f86c-48f3-81b8-cf865fdd8b38 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:56.098557 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7125de5b-f86c-48f3-81b8-cf865fdd8b38 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4910a3e985a3489a8e2a86d9213525a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90232777aaeb43de91ca009adce2f8ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:56.106547 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7125de5b-f86c-48f3-81b8-cf865fdd8b38 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] 10.222.0.20 "GET /compute/v2.1/servers/c13c741a-7277-49dc-bb1f-b17e77c02c7b" status: 200 len: 1325 microversion: 2.1 time: 0.163371 Apr 16 21:23:56.107111 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2275/4368] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:55 2022] GET /compute/v2.1/servers/c13c741a-7277-49dc-bb1f-b17e77c02c7b => generated 1325 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:23:56.172049 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1f514853-964c-46f3-a97b-f6019d36e271 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:56.174200 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1f514853-964c-46f3-a97b-f6019d36e271 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3704be44-6fc4-4b14-b0c0-eb1388d807a5] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:56.190306 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1f514853-964c-46f3-a97b-f6019d36e271 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:56.190972 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1f514853-964c-46f3-a97b-f6019d36e271 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:56.191766 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1f514853-964c-46f3-a97b-f6019d36e271 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:56.192234 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1f514853-964c-46f3-a97b-f6019d36e271 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:56.282837 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7497b118-caad-45d6-a06e-b3effb9fd1b8 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc8a2da85ec46948b5bc30ed7a363bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5096c21fbfe41dd80379e0e3b6fb8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:56.290089 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7497b118-caad-45d6-a06e-b3effb9fd1b8 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304" status: 200 len: 1523 microversion: 2.1 time: 0.511182 Apr 16 21:23:56.290861 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2094/4369] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:55 2022] GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304 => generated 1523 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:56.334025 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1f514853-964c-46f3-a97b-f6019d36e271 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:56.341960 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1f514853-964c-46f3-a97b-f6019d36e271 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5" status: 200 len: 1554 microversion: 2.1 time: 0.174191 Apr 16 21:23:56.342609 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2276/4370] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:56 2022] GET /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5 => generated 1554 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:56.570861 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e6a5a9de-07be-42aa-9467-68b1e2ae08c7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:56.571575 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e6a5a9de-07be-42aa-9467-68b1e2ae08c7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] [instance: 06c0c0c5-19a1-4c21-b19e-a9878ab4f25e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:56.578420 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e6a5a9de-07be-42aa-9467-68b1e2ae08c7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:56.578877 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e6a5a9de-07be-42aa-9467-68b1e2ae08c7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:56.579654 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e6a5a9de-07be-42aa-9467-68b1e2ae08c7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:56.580092 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e6a5a9de-07be-42aa-9467-68b1e2ae08c7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:56.768298 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1b9b8e84-f250-445e-9355-b696d5da7047 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:56.769369 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1b9b8e84-f250-445e-9355-b696d5da7047 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:56.779195 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1b9b8e84-f250-445e-9355-b696d5da7047 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:56.779778 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1b9b8e84-f250-445e-9355-b696d5da7047 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:56.780607 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1b9b8e84-f250-445e-9355-b696d5da7047 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:56.781219 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1b9b8e84-f250-445e-9355-b696d5da7047 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:56.829133 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e6a5a9de-07be-42aa-9467-68b1e2ae08c7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7ad620035e4c9f97da1a1b445437b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d72b2bb3a304796bb144bc739ffcb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:56.841401 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e6a5a9de-07be-42aa-9467-68b1e2ae08c7 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] 10.222.0.20 "GET /compute/v2.1/servers/06c0c0c5-19a1-4c21-b19e-a9878ab4f25e" status: 200 len: 1503 microversion: 2.1 time: 0.273972 Apr 16 21:23:56.846177 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2095/4371] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:56 2022] GET /compute/v2.1/servers/06c0c0c5-19a1-4c21-b19e-a9878ab4f25e => generated 1503 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:57.026390 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1b9b8e84-f250-445e-9355-b696d5da7047 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:57.038832 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1b9b8e84-f250-445e-9355-b696d5da7047 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:57.040777 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1b9b8e84-f250-445e-9355-b696d5da7047 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:57.042510 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1b9b8e84-f250-445e-9355-b696d5da7047 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1874 microversion: 2.42 time: 0.280067 Apr 16 21:23:57.043596 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2277/4372] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:23:56 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1874 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:23:57.124381 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cd05bd61-231f-4ca7-9218-42d567c4db80 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:57.125239 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-cd05bd61-231f-4ca7-9218-42d567c4db80 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] [instance: c13c741a-7277-49dc-bb1f-b17e77c02c7b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:57.131856 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cd05bd61-231f-4ca7-9218-42d567c4db80 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:57.132742 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cd05bd61-231f-4ca7-9218-42d567c4db80 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:57.133529 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cd05bd61-231f-4ca7-9218-42d567c4db80 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:57.134143 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cd05bd61-231f-4ca7-9218-42d567c4db80 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:57.307909 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ad450bc5-9bf5-48f8-b3b1-1d66ff8ab2a9 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:57.310583 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ad450bc5-9bf5-48f8-b3b1-1d66ff8ab2a9 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:57.319268 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ad450bc5-9bf5-48f8-b3b1-1d66ff8ab2a9 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:57.319820 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ad450bc5-9bf5-48f8-b3b1-1d66ff8ab2a9 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:57.320864 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ad450bc5-9bf5-48f8-b3b1-1d66ff8ab2a9 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:57.322264 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ad450bc5-9bf5-48f8-b3b1-1d66ff8ab2a9 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:57.418115 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cd05bd61-231f-4ca7-9218-42d567c4db80 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4910a3e985a3489a8e2a86d9213525a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90232777aaeb43de91ca009adce2f8ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:57.425734 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cd05bd61-231f-4ca7-9218-42d567c4db80 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] 10.222.0.20 "GET /compute/v2.1/servers/c13c741a-7277-49dc-bb1f-b17e77c02c7b" status: 200 len: 1522 microversion: 2.1 time: 0.305547 Apr 16 21:23:57.426640 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2096/4373] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:57 2022] GET /compute/v2.1/servers/c13c741a-7277-49dc-bb1f-b17e77c02c7b => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:57.432120 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5e692666-6300-47f4-a83d-6df84f391f6f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:57.432970 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5e692666-6300-47f4-a83d-6df84f391f6f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3704be44-6fc4-4b14-b0c0-eb1388d807a5] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:57.439225 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5e692666-6300-47f4-a83d-6df84f391f6f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:57.439931 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5e692666-6300-47f4-a83d-6df84f391f6f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:57.441013 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5e692666-6300-47f4-a83d-6df84f391f6f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:57.441619 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5e692666-6300-47f4-a83d-6df84f391f6f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:57.575380 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ad450bc5-9bf5-48f8-b3b1-1d66ff8ab2a9 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc8a2da85ec46948b5bc30ed7a363bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5096c21fbfe41dd80379e0e3b6fb8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:57.588018 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ad450bc5-9bf5-48f8-b3b1-1d66ff8ab2a9 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304" status: 200 len: 1523 microversion: 2.1 time: 0.284319 Apr 16 21:23:57.589215 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2278/4374] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:57 2022] GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304 => generated 1523 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:57.595134 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fbc190be-2628-4f3d-8996-423b2d739028 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:57.595830 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fbc190be-2628-4f3d-8996-423b2d739028 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] [instance: c13c741a-7277-49dc-bb1f-b17e77c02c7b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:57.603596 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fbc190be-2628-4f3d-8996-423b2d739028 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:57.604053 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fbc190be-2628-4f3d-8996-423b2d739028 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:57.605108 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fbc190be-2628-4f3d-8996-423b2d739028 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:57.605566 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fbc190be-2628-4f3d-8996-423b2d739028 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:57.630037 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-fbc190be-2628-4f3d-8996-423b2d739028 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] HTTP exception thrown: Instance is not a member of specified network Apr 16 21:23:57.630791 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fbc190be-2628-4f3d-8996-423b2d739028 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Returning 404 to user: Instance is not a member of specified network {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:23:57.631866 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fbc190be-2628-4f3d-8996-423b2d739028 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] 10.222.0.20 "GET /compute/v2.1/servers/c13c741a-7277-49dc-bb1f-b17e77c02c7b/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.041461 Apr 16 21:23:57.633070 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2279/4375] 10.222.0.20 () {58 vars in 1271 bytes} [Sat Apr 16 21:23:57 2022] GET /compute/v2.1/servers/c13c741a-7277-49dc-bb1f-b17e77c02c7b/ips/invalid => generated 91 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:23:57.642389 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-820f64c0-c20f-41c1-845b-907bb1b79757 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:57.642950 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-820f64c0-c20f-41c1-845b-907bb1b79757 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Failed to fetch instance by id 999 {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2924}} Apr 16 21:23:57.643531 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-820f64c0-c20f-41c1-845b-907bb1b79757 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] HTTP exception thrown: Instance 999 could not be found. Apr 16 21:23:57.644161 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-820f64c0-c20f-41c1-845b-907bb1b79757 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Returning 404 to user: Instance 999 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:23:57.645234 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-820f64c0-c20f-41c1-845b-907bb1b79757 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] 10.222.0.20 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.007043 Apr 16 21:23:57.646245 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2280/4376] 10.222.0.20 () {58 vars in 1148 bytes} [Sat Apr 16 21:23:57 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 8 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Apr 16 21:23:57.654882 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-19201456-132e-4ea7-8e5b-b38644a73821 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:57.655727 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-19201456-132e-4ea7-8e5b-b38644a73821 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] [instance: c13c741a-7277-49dc-bb1f-b17e77c02c7b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:57.663708 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-19201456-132e-4ea7-8e5b-b38644a73821 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:57.664190 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-19201456-132e-4ea7-8e5b-b38644a73821 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:57.665000 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-19201456-132e-4ea7-8e5b-b38644a73821 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:57.665445 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-19201456-132e-4ea7-8e5b-b38644a73821 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:57.694238 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-19201456-132e-4ea7-8e5b-b38644a73821 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] [instance: c13c741a-7277-49dc-bb1f-b17e77c02c7b] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:23:57.733864 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5e692666-6300-47f4-a83d-6df84f391f6f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:57.744158 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5e692666-6300-47f4-a83d-6df84f391f6f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5" status: 200 len: 1554 microversion: 2.1 time: 0.315640 Apr 16 21:23:57.744757 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2097/4377] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:57 2022] GET /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5 => generated 1554 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:57.858938 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3abfa92c-5d43-485b-8e4a-c87961dd0755 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:57.859675 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3abfa92c-5d43-485b-8e4a-c87961dd0755 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] [instance: 06c0c0c5-19a1-4c21-b19e-a9878ab4f25e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:57.866980 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3abfa92c-5d43-485b-8e4a-c87961dd0755 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:57.867435 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3abfa92c-5d43-485b-8e4a-c87961dd0755 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:57.868234 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3abfa92c-5d43-485b-8e4a-c87961dd0755 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:57.868681 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3abfa92c-5d43-485b-8e4a-c87961dd0755 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:58.013624 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-19201456-132e-4ea7-8e5b-b38644a73821 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] 10.222.0.20 "DELETE /compute/v2.1/servers/c13c741a-7277-49dc-bb1f-b17e77c02c7b" status: 204 len: 0 microversion: 2.1 time: 0.362324 Apr 16 21:23:58.014218 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2281/4378] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:23:57 2022] DELETE /compute/v2.1/servers/c13c741a-7277-49dc-bb1f-b17e77c02c7b => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 16 21:23:58.024816 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-393edf98-27f1-427c-a066-d2338b8ff500 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:58.025686 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-393edf98-27f1-427c-a066-d2338b8ff500 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] [instance: c13c741a-7277-49dc-bb1f-b17e77c02c7b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:58.032453 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-393edf98-27f1-427c-a066-d2338b8ff500 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:58.033089 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-393edf98-27f1-427c-a066-d2338b8ff500 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:58.034024 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-393edf98-27f1-427c-a066-d2338b8ff500 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:58.034624 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-393edf98-27f1-427c-a066-d2338b8ff500 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:58.151059 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3abfa92c-5d43-485b-8e4a-c87961dd0755 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7ad620035e4c9f97da1a1b445437b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d72b2bb3a304796bb144bc739ffcb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:58.160481 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3abfa92c-5d43-485b-8e4a-c87961dd0755 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] 10.222.0.20 "GET /compute/v2.1/servers/06c0c0c5-19a1-4c21-b19e-a9878ab4f25e" status: 200 len: 1503 microversion: 2.1 time: 0.305400 Apr 16 21:23:58.171442 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2098/4379] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:57 2022] GET /compute/v2.1/servers/06c0c0c5-19a1-4c21-b19e-a9878ab4f25e => generated 1503 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:23:58.177214 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-23fba77f-86bd-4605-92a8-f763c4273c53 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:58.181982 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-23fba77f-86bd-4605-92a8-f763c4273c53 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:58.184402 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-23fba77f-86bd-4605-92a8-f763c4273c53 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:58.184868 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-23fba77f-86bd-4605-92a8-f763c4273c53 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:58.185667 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-23fba77f-86bd-4605-92a8-f763c4273c53 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:58.186167 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-23fba77f-86bd-4605-92a8-f763c4273c53 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:58.268777 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-393edf98-27f1-427c-a066-d2338b8ff500 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4910a3e985a3489a8e2a86d9213525a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90232777aaeb43de91ca009adce2f8ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:58.280059 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-393edf98-27f1-427c-a066-d2338b8ff500 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] 10.222.0.20 "GET /compute/v2.1/servers/c13c741a-7277-49dc-bb1f-b17e77c02c7b" status: 200 len: 1528 microversion: 2.1 time: 0.260531 Apr 16 21:23:58.291614 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2282/4380] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:58 2022] GET /compute/v2.1/servers/c13c741a-7277-49dc-bb1f-b17e77c02c7b => generated 1528 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:23:58.512503 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-7b68b995-9f76-473c-a99f-b68f85f8afd0 req-28b76f61-f838-4697-b69c-7ba2557742da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06c0c0c5-19a1-4c21-b19e-a9878ab4f25e", "name": "network-vif-deleted", "tag": "43c7f7d0-e08b-46c8-ac83-10e7f6e09684"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:23:58.525991 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-7b68b995-9f76-473c-a99f-b68f85f8afd0 req-28b76f61-f838-4697-b69c-7ba2557742da service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:58.527674 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-7b68b995-9f76-473c-a99f-b68f85f8afd0 req-28b76f61-f838-4697-b69c-7ba2557742da service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:58.546334 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-7b68b995-9f76-473c-a99f-b68f85f8afd0 req-28b76f61-f838-4697-b69c-7ba2557742da service nova] Creating event network-vif-deleted:43c7f7d0-e08b-46c8-ac83-10e7f6e09684 for instance 06c0c0c5-19a1-4c21-b19e-a9878ab4f25e on nch1-master-1 Apr 16 21:23:58.554333 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-7b68b995-9f76-473c-a99f-b68f85f8afd0 req-28b76f61-f838-4697-b69c-7ba2557742da service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045207 Apr 16 21:23:58.558224 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2283/4381] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:23:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:23:58.586585 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-23fba77f-86bd-4605-92a8-f763c4273c53 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:58.597422 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-23fba77f-86bd-4605-92a8-f763c4273c53 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:58.599477 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-23fba77f-86bd-4605-92a8-f763c4273c53 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:58.601295 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-23fba77f-86bd-4605-92a8-f763c4273c53 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1874 microversion: 2.42 time: 0.428446 Apr 16 21:23:58.602566 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2099/4382] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:23:58 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1874 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:23:58.606202 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cc3455ec-b683-4864-ac5f-7fac37720ec0 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:58.606913 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cc3455ec-b683-4864-ac5f-7fac37720ec0 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:58.618675 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cc3455ec-b683-4864-ac5f-7fac37720ec0 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:58.621122 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cc3455ec-b683-4864-ac5f-7fac37720ec0 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:58.621317 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cc3455ec-b683-4864-ac5f-7fac37720ec0 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:58.621612 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cc3455ec-b683-4864-ac5f-7fac37720ec0 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:58.761860 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8313e96f-8924-4138-b27f-339cdeac16e2 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:58.762653 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8313e96f-8924-4138-b27f-339cdeac16e2 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3704be44-6fc4-4b14-b0c0-eb1388d807a5] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:58.768827 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8313e96f-8924-4138-b27f-339cdeac16e2 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:58.769757 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8313e96f-8924-4138-b27f-339cdeac16e2 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:58.770773 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8313e96f-8924-4138-b27f-339cdeac16e2 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:58.774991 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8313e96f-8924-4138-b27f-339cdeac16e2 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:58.878313 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8313e96f-8924-4138-b27f-339cdeac16e2 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:58.889219 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8313e96f-8924-4138-b27f-339cdeac16e2 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5" status: 200 len: 1346 microversion: 2.1 time: 0.130973 Apr 16 21:23:58.900631 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2100/4383] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:58 2022] GET /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5 => generated 1346 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:23:59.162074 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cc3455ec-b683-4864-ac5f-7fac37720ec0 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc8a2da85ec46948b5bc30ed7a363bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5096c21fbfe41dd80379e0e3b6fb8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:59.171552 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cc3455ec-b683-4864-ac5f-7fac37720ec0 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304" status: 200 len: 1523 microversion: 2.1 time: 0.569743 Apr 16 21:23:59.180329 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2284/4384] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:58 2022] GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304 => generated 1523 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:59.194987 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4c3a1a4a-5051-4495-ac4e-62d5e5e002d3 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:59.198497 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4c3a1a4a-5051-4495-ac4e-62d5e5e002d3 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] [instance: 06c0c0c5-19a1-4c21-b19e-a9878ab4f25e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:59.204708 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4c3a1a4a-5051-4495-ac4e-62d5e5e002d3 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:59.205178 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4c3a1a4a-5051-4495-ac4e-62d5e5e002d3 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:59.206097 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4c3a1a4a-5051-4495-ac4e-62d5e5e002d3 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:59.213065 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4c3a1a4a-5051-4495-ac4e-62d5e5e002d3 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:59.300882 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2300e444-97ed-4309-b395-5868bf7e607f tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:59.302221 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2300e444-97ed-4309-b395-5868bf7e607f tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] [instance: c13c741a-7277-49dc-bb1f-b17e77c02c7b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:59.310031 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2300e444-97ed-4309-b395-5868bf7e607f tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:59.310440 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2300e444-97ed-4309-b395-5868bf7e607f tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:59.311367 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2300e444-97ed-4309-b395-5868bf7e607f tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:59.311963 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2300e444-97ed-4309-b395-5868bf7e607f tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:59.388794 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4c3a1a4a-5051-4495-ac4e-62d5e5e002d3 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf7ad620035e4c9f97da1a1b445437b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d72b2bb3a304796bb144bc739ffcb5a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:59.397532 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4c3a1a4a-5051-4495-ac4e-62d5e5e002d3 tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] 10.222.0.20 "GET /compute/v2.1/servers/06c0c0c5-19a1-4c21-b19e-a9878ab4f25e" status: 200 len: 1298 microversion: 2.1 time: 0.213831 Apr 16 21:23:59.398451 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2101/4385] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:59 2022] GET /compute/v2.1/servers/06c0c0c5-19a1-4c21-b19e-a9878ab4f25e => generated 1298 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:23:59.513995 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2300e444-97ed-4309-b395-5868bf7e607f tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4910a3e985a3489a8e2a86d9213525a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90232777aaeb43de91ca009adce2f8ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:59.523277 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2300e444-97ed-4309-b395-5868bf7e607f tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] 10.222.0.20 "GET /compute/v2.1/servers/c13c741a-7277-49dc-bb1f-b17e77c02c7b" status: 200 len: 1528 microversion: 2.1 time: 0.229349 Apr 16 21:23:59.523977 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2285/4386] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:59 2022] GET /compute/v2.1/servers/c13c741a-7277-49dc-bb1f-b17e77c02c7b => generated 1528 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:23:59.620860 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b464e2a9-a89a-4687-a28a-c92066812ddd tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:59.621612 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b464e2a9-a89a-4687-a28a-c92066812ddd tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:59.628422 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b464e2a9-a89a-4687-a28a-c92066812ddd tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:59.628890 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b464e2a9-a89a-4687-a28a-c92066812ddd tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:59.629678 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b464e2a9-a89a-4687-a28a-c92066812ddd tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:59.630150 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b464e2a9-a89a-4687-a28a-c92066812ddd tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:59.907106 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cb1cdcdd-b5bd-4f9f-9f4c-efb51d5e3f55 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:23:59.907698 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cb1cdcdd-b5bd-4f9f-9f4c-efb51d5e3f55 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3704be44-6fc4-4b14-b0c0-eb1388d807a5] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:23:59.914591 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cb1cdcdd-b5bd-4f9f-9f4c-efb51d5e3f55 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:59.915361 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cb1cdcdd-b5bd-4f9f-9f4c-efb51d5e3f55 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:59.916197 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cb1cdcdd-b5bd-4f9f-9f4c-efb51d5e3f55 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:59.916888 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cb1cdcdd-b5bd-4f9f-9f4c-efb51d5e3f55 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:59.927131 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b464e2a9-a89a-4687-a28a-c92066812ddd tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:59.936657 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b464e2a9-a89a-4687-a28a-c92066812ddd tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:59.938697 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b464e2a9-a89a-4687-a28a-c92066812ddd tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:23:59.940061 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b464e2a9-a89a-4687-a28a-c92066812ddd tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1874 microversion: 2.42 time: 0.323292 Apr 16 21:23:59.951936 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2102/4387] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:23:59 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1874 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:23:59.954125 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cb1cdcdd-b5bd-4f9f-9f4c-efb51d5e3f55 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:23:59.954589 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cb1cdcdd-b5bd-4f9f-9f4c-efb51d5e3f55 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:23:59.955044 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-cb1cdcdd-b5bd-4f9f-9f4c-efb51d5e3f55 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lazy-loading 'fault' on Instance uuid 3704be44-6fc4-4b14-b0c0-eb1388d807a5 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:23:59.998969 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cb1cdcdd-b5bd-4f9f-9f4c-efb51d5e3f55 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:00.007743 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cb1cdcdd-b5bd-4f9f-9f4c-efb51d5e3f55 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5" status: 200 len: 1351 microversion: 2.1 time: 0.104594 Apr 16 21:24:00.012218 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2286/4388] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:23:59 2022] GET /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5 => generated 1351 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:24:00.189642 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-98c45a94-2dff-4820-aecc-ec1abceca039 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:00.190408 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-98c45a94-2dff-4820-aecc-ec1abceca039 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:00.197492 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-98c45a94-2dff-4820-aecc-ec1abceca039 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:00.198024 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-98c45a94-2dff-4820-aecc-ec1abceca039 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:00.198907 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-98c45a94-2dff-4820-aecc-ec1abceca039 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:00.199365 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-98c45a94-2dff-4820-aecc-ec1abceca039 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:00.336517 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-98c45a94-2dff-4820-aecc-ec1abceca039 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc8a2da85ec46948b5bc30ed7a363bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5096c21fbfe41dd80379e0e3b6fb8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:00.344032 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-98c45a94-2dff-4820-aecc-ec1abceca039 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304" status: 200 len: 1523 microversion: 2.1 time: 0.158392 Apr 16 21:24:00.344637 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2103/4389] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:00 2022] GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:00.415709 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-40d4bc1d-3d2c-4d31-90e5-3042fd05f99f tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:00.417152 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-40d4bc1d-3d2c-4d31-90e5-3042fd05f99f tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] [instance: 06c0c0c5-19a1-4c21-b19e-a9878ab4f25e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:00.425798 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40d4bc1d-3d2c-4d31-90e5-3042fd05f99f tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:00.426302 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40d4bc1d-3d2c-4d31-90e5-3042fd05f99f tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:00.427853 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40d4bc1d-3d2c-4d31-90e5-3042fd05f99f tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:00.428329 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40d4bc1d-3d2c-4d31-90e5-3042fd05f99f tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:00.442420 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-40d4bc1d-3d2c-4d31-90e5-3042fd05f99f tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] HTTP exception thrown: Instance 06c0c0c5-19a1-4c21-b19e-a9878ab4f25e could not be found. Apr 16 21:24:00.443022 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-40d4bc1d-3d2c-4d31-90e5-3042fd05f99f tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] Returning 404 to user: Instance 06c0c0c5-19a1-4c21-b19e-a9878ab4f25e could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:24:00.443895 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-40d4bc1d-3d2c-4d31-90e5-3042fd05f99f tempest-VolumesActionsTest-311706575 tempest-VolumesActionsTest-311706575-project] 10.222.0.20 "GET /compute/v2.1/servers/06c0c0c5-19a1-4c21-b19e-a9878ab4f25e" status: 404 len: 111 microversion: 2.1 time: 0.032742 Apr 16 21:24:00.444484 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2287/4390] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:00 2022] GET /compute/v2.1/servers/06c0c0c5-19a1-4c21-b19e-a9878ab4f25e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:24:00.541269 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-37421b0e-dcb9-4623-b772-f761fa4ea82e tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:00.541883 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-37421b0e-dcb9-4623-b772-f761fa4ea82e tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] [instance: c13c741a-7277-49dc-bb1f-b17e77c02c7b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:00.547937 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-37421b0e-dcb9-4623-b772-f761fa4ea82e tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:00.548445 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-37421b0e-dcb9-4623-b772-f761fa4ea82e tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:00.552724 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-37421b0e-dcb9-4623-b772-f761fa4ea82e tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:00.552724 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-37421b0e-dcb9-4623-b772-f761fa4ea82e tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:00.572261 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-2b194a5f-c67b-4f15-932a-97316fb6fdbc req-7a3e5285-a179-4b7b-9bd5-489636e6bbfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3704be44-6fc4-4b14-b0c0-eb1388d807a5", "name": "network-vif-deleted", "tag": "f66da356-52f4-4b47-9500-04fa22ef8e21"}, {"server_uuid": "c13c741a-7277-49dc-bb1f-b17e77c02c7b", "name": "network-vif-deleted", "tag": "fbff4a6d-61dd-45ec-9093-ac6f555b347a"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:24:00.581754 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-37421b0e-dcb9-4623-b772-f761fa4ea82e tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:00.582214 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-37421b0e-dcb9-4623-b772-f761fa4ea82e tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:00.582671 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-37421b0e-dcb9-4623-b772-f761fa4ea82e tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lazy-loading 'fault' on Instance uuid c13c741a-7277-49dc-bb1f-b17e77c02c7b {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:24:00.587207 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-2b194a5f-c67b-4f15-932a-97316fb6fdbc req-7a3e5285-a179-4b7b-9bd5-489636e6bbfa service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:00.587662 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-2b194a5f-c67b-4f15-932a-97316fb6fdbc req-7a3e5285-a179-4b7b-9bd5-489636e6bbfa service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:00.601437 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-2b194a5f-c67b-4f15-932a-97316fb6fdbc req-7a3e5285-a179-4b7b-9bd5-489636e6bbfa service nova] Creating event network-vif-deleted:f66da356-52f4-4b47-9500-04fa22ef8e21 for instance 3704be44-6fc4-4b14-b0c0-eb1388d807a5 on nch2-master-1 Apr 16 21:24:00.604813 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-2b194a5f-c67b-4f15-932a-97316fb6fdbc req-7a3e5285-a179-4b7b-9bd5-489636e6bbfa service nova] Creating event network-vif-deleted:fbff4a6d-61dd-45ec-9093-ac6f555b347a for instance c13c741a-7277-49dc-bb1f-b17e77c02c7b on nch1-master-1 Apr 16 21:24:00.610385 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-2b194a5f-c67b-4f15-932a-97316fb6fdbc req-7a3e5285-a179-4b7b-9bd5-489636e6bbfa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.041746 Apr 16 21:24:00.611002 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2288/4391] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:24:00 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:24:00.638928 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-37421b0e-dcb9-4623-b772-f761fa4ea82e tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4910a3e985a3489a8e2a86d9213525a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90232777aaeb43de91ca009adce2f8ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:00.639850 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-37421b0e-dcb9-4623-b772-f761fa4ea82e tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] 10.222.0.20 "GET /compute/v2.1/servers/c13c741a-7277-49dc-bb1f-b17e77c02c7b" status: 200 len: 1315 microversion: 2.1 time: 0.102346 Apr 16 21:24:00.640437 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2104/4392] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:00 2022] GET /compute/v2.1/servers/c13c741a-7277-49dc-bb1f-b17e77c02c7b => generated 1315 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:24:00.970628 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1d33659a-cc4d-4b9d-bbbd-ffbc457320d4 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:00.971468 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1d33659a-cc4d-4b9d-bbbd-ffbc457320d4 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:00.978886 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1d33659a-cc4d-4b9d-bbbd-ffbc457320d4 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:00.979420 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1d33659a-cc4d-4b9d-bbbd-ffbc457320d4 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:00.980333 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1d33659a-cc4d-4b9d-bbbd-ffbc457320d4 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:00.980845 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1d33659a-cc4d-4b9d-bbbd-ffbc457320d4 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:01.030098 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-70bbe8cd-9f43-4212-a8b5-87a625c12e0f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:01.030717 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-70bbe8cd-9f43-4212-a8b5-87a625c12e0f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3704be44-6fc4-4b14-b0c0-eb1388d807a5] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:01.038172 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-70bbe8cd-9f43-4212-a8b5-87a625c12e0f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:01.038643 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-70bbe8cd-9f43-4212-a8b5-87a625c12e0f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:01.039433 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-70bbe8cd-9f43-4212-a8b5-87a625c12e0f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:01.039878 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-70bbe8cd-9f43-4212-a8b5-87a625c12e0f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:01.054229 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-70bbe8cd-9f43-4212-a8b5-87a625c12e0f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] HTTP exception thrown: Instance 3704be44-6fc4-4b14-b0c0-eb1388d807a5 could not be found. Apr 16 21:24:01.054857 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-70bbe8cd-9f43-4212-a8b5-87a625c12e0f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Returning 404 to user: Instance 3704be44-6fc4-4b14-b0c0-eb1388d807a5 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:24:01.055702 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-70bbe8cd-9f43-4212-a8b5-87a625c12e0f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5" status: 404 len: 111 microversion: 2.1 time: 0.030279 Apr 16 21:24:01.056290 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2105/4393] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:01 2022] GET /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:24:01.180804 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-64ab9abb-7b1f-4e91-b39f-f3fe7942a583 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:01.182075 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-64ab9abb-7b1f-4e91-b39f-f3fe7942a583 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3704be44-6fc4-4b14-b0c0-eb1388d807a5] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:01.191842 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-64ab9abb-7b1f-4e91-b39f-f3fe7942a583 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:01.192341 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-64ab9abb-7b1f-4e91-b39f-f3fe7942a583 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:01.193668 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-64ab9abb-7b1f-4e91-b39f-f3fe7942a583 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:01.194111 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-64ab9abb-7b1f-4e91-b39f-f3fe7942a583 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:01.209885 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-64ab9abb-7b1f-4e91-b39f-f3fe7942a583 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] HTTP exception thrown: Instance 3704be44-6fc4-4b14-b0c0-eb1388d807a5 could not be found. Apr 16 21:24:01.210648 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-64ab9abb-7b1f-4e91-b39f-f3fe7942a583 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Returning 404 to user: Instance 3704be44-6fc4-4b14-b0c0-eb1388d807a5 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:24:01.211660 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-64ab9abb-7b1f-4e91-b39f-f3fe7942a583 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035234 Apr 16 21:24:01.212759 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2106/4394] 10.222.0.20 () {58 vars in 1301 bytes} [Sat Apr 16 21:24:01 2022] GET /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:24:01.348574 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1d33659a-cc4d-4b9d-bbbd-ffbc457320d4 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:01.357979 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1d33659a-cc4d-4b9d-bbbd-ffbc457320d4 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:01.359756 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1d33659a-cc4d-4b9d-bbbd-ffbc457320d4 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:01.361423 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1d33659a-cc4d-4b9d-bbbd-ffbc457320d4 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1874 microversion: 2.42 time: 0.406044 Apr 16 21:24:01.362054 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-13292901-2855-45d9-8ee7-a9227e7f07b3 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:01.365054 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2289/4395] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:24:00 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1874 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:24:01.365190 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-13292901-2855-45d9-8ee7-a9227e7f07b3 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:01.370285 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-13292901-2855-45d9-8ee7-a9227e7f07b3 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:01.371067 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-13292901-2855-45d9-8ee7-a9227e7f07b3 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:01.372145 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-13292901-2855-45d9-8ee7-a9227e7f07b3 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:01.372616 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-13292901-2855-45d9-8ee7-a9227e7f07b3 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:01.389447 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-31db4e63-29d8-4037-bc5b-8df9c1f58492 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1192720773", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "5fb5cf29-8796-41a2-8375-e8062a5911ad"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:24:01.448090 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-31db4e63-29d8-4037-bc5b-8df9c1f58492 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] validate_networks() for [('5fb5cf29-8796-41a2-8375-e8062a5911ad', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:24:01.529487 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-13292901-2855-45d9-8ee7-a9227e7f07b3 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc8a2da85ec46948b5bc30ed7a363bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5096c21fbfe41dd80379e0e3b6fb8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:01.538006 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-13292901-2855-45d9-8ee7-a9227e7f07b3 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304" status: 200 len: 1523 microversion: 2.1 time: 0.181209 Apr 16 21:24:01.538800 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2107/4396] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:01 2022] GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304 => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:01.656984 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b0e9f3d6-a04d-4885-833f-1bdd8485b591 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:01.657829 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b0e9f3d6-a04d-4885-833f-1bdd8485b591 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] [instance: c13c741a-7277-49dc-bb1f-b17e77c02c7b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:01.666042 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b0e9f3d6-a04d-4885-833f-1bdd8485b591 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:01.666750 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b0e9f3d6-a04d-4885-833f-1bdd8485b591 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:01.667554 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b0e9f3d6-a04d-4885-833f-1bdd8485b591 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:01.668001 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b0e9f3d6-a04d-4885-833f-1bdd8485b591 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:01.688815 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-b0e9f3d6-a04d-4885-833f-1bdd8485b591 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] HTTP exception thrown: Instance c13c741a-7277-49dc-bb1f-b17e77c02c7b could not be found. Apr 16 21:24:01.689644 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b0e9f3d6-a04d-4885-833f-1bdd8485b591 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] Returning 404 to user: Instance c13c741a-7277-49dc-bb1f-b17e77c02c7b could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:24:01.690726 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b0e9f3d6-a04d-4885-833f-1bdd8485b591 tempest-ServerAddressesNegativeTestJSON-111133764 tempest-ServerAddressesNegativeTestJSON-111133764-project] 10.222.0.20 "GET /compute/v2.1/servers/c13c741a-7277-49dc-bb1f-b17e77c02c7b" status: 404 len: 111 microversion: 2.1 time: 0.038569 Apr 16 21:24:01.691285 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2108/4397] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:01 2022] GET /compute/v2.1/servers/c13c741a-7277-49dc-bb1f-b17e77c02c7b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:24:02.046365 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-31db4e63-29d8-4037-bc5b-8df9c1f58492 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:24:02.046878 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-31db4e63-29d8-4037-bc5b-8df9c1f58492 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:24:02.047273 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-31db4e63-29d8-4037-bc5b-8df9c1f58492 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:24:02.047695 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-31db4e63-29d8-4037-bc5b-8df9c1f58492 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:24:02.048120 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-31db4e63-29d8-4037-bc5b-8df9c1f58492 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:24:02.060754 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-31db4e63-29d8-4037-bc5b-8df9c1f58492 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:02.062084 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-31db4e63-29d8-4037-bc5b-8df9c1f58492 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:02.063147 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-31db4e63-29d8-4037-bc5b-8df9c1f58492 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:02.064407 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-31db4e63-29d8-4037-bc5b-8df9c1f58492 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:02.091382 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-31db4e63-29d8-4037-bc5b-8df9c1f58492 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Getting quotas for project 7caf6e59a47149a68cae6224fb2856e7. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:24:02.100423 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-31db4e63-29d8-4037-bc5b-8df9c1f58492 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Getting quotas for user e069f136dcb344b197f58ba47722f4d5 and project 7caf6e59a47149a68cae6224fb2856e7. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:24:02.135168 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-31db4e63-29d8-4037-bc5b-8df9c1f58492 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:24:02.146092 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-31db4e63-29d8-4037-bc5b-8df9c1f58492 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: a13152af-d062-4601-810e-ce65dd5479a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:24:02.382795 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b5de3366-a198-4440-8c48-195d1f02c5bf tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:02.383433 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b5de3366-a198-4440-8c48-195d1f02c5bf tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:02.385974 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-31db4e63-29d8-4037-bc5b-8df9c1f58492 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.997424 Apr 16 21:24:02.394079 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2290/4398] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:24:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1010 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 16 21:24:02.403118 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b5de3366-a198-4440-8c48-195d1f02c5bf tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:02.404829 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b5de3366-a198-4440-8c48-195d1f02c5bf tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:02.407522 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b5de3366-a198-4440-8c48-195d1f02c5bf tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:02.407996 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b5de3366-a198-4440-8c48-195d1f02c5bf tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:02.415335 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-171b0924-8916-4e1e-9ebd-81e1a41da6f8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:02.417944 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-171b0924-8916-4e1e-9ebd-81e1a41da6f8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: a13152af-d062-4601-810e-ce65dd5479a9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:02.553915 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-171b0924-8916-4e1e-9ebd-81e1a41da6f8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:02.561459 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-171b0924-8916-4e1e-9ebd-81e1a41da6f8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/a13152af-d062-4601-810e-ce65dd5479a9" status: 200 len: 1215 microversion: 2.1 time: 0.159921 Apr 16 21:24:02.563470 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2291/4399] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:02 2022] GET /compute/v2.1/servers/a13152af-d062-4601-810e-ce65dd5479a9 => generated 1215 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:24:02.567878 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-73468e8e-ddc7-43f6-bbda-e8279d5908c3 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:02.568849 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-73468e8e-ddc7-43f6-bbda-e8279d5908c3 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:02.594348 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-73468e8e-ddc7-43f6-bbda-e8279d5908c3 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:02.594830 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-73468e8e-ddc7-43f6-bbda-e8279d5908c3 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:02.595652 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-73468e8e-ddc7-43f6-bbda-e8279d5908c3 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:02.596100 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-73468e8e-ddc7-43f6-bbda-e8279d5908c3 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:02.861835 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-73468e8e-ddc7-43f6-bbda-e8279d5908c3 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc8a2da85ec46948b5bc30ed7a363bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5096c21fbfe41dd80379e0e3b6fb8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:02.870756 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-73468e8e-ddc7-43f6-bbda-e8279d5908c3 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304" status: 200 len: 1523 microversion: 2.1 time: 0.306576 Apr 16 21:24:02.871544 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2292/4400] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:02 2022] GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304 => generated 1523 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:02.896743 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ab6607e9-fad0-4d6c-ab1f-9fb2ce8462bf tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:02.897264 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ab6607e9-fad0-4d6c-ab1f-9fb2ce8462bf tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: a13152af-d062-4601-810e-ce65dd5479a9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:02.916427 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ab6607e9-fad0-4d6c-ab1f-9fb2ce8462bf tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: a13152af-d062-4601-810e-ce65dd5479a9] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:24:03.397841 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b5de3366-a198-4440-8c48-195d1f02c5bf tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:03.428647 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b5de3366-a198-4440-8c48-195d1f02c5bf tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:03.432063 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b5de3366-a198-4440-8c48-195d1f02c5bf tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:03.437166 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b5de3366-a198-4440-8c48-195d1f02c5bf tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1874 microversion: 2.42 time: 1.059335 Apr 16 21:24:03.439760 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2109/4401] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:24:02 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1874 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:24:03.449121 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-53ffe1e8-98ee-41bf-96e0-abe91c3a5192 req-deca058b-dace-468e-9623-1f1a5585acec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70e22cc6-e4af-4230-a480-bbbe6b60d462", "name": "network-vif-plugged", "status": "completed", "tag": "e161877a-3f6f-49a7-8aed-2eee986f2f68"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:24:03.461517 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-53ffe1e8-98ee-41bf-96e0-abe91c3a5192 req-deca058b-dace-468e-9623-1f1a5585acec service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:03.462233 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-53ffe1e8-98ee-41bf-96e0-abe91c3a5192 req-deca058b-dace-468e-9623-1f1a5585acec service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:03.480924 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-53ffe1e8-98ee-41bf-96e0-abe91c3a5192 req-deca058b-dace-468e-9623-1f1a5585acec service nova] Creating event network-vif-plugged:e161877a-3f6f-49a7-8aed-2eee986f2f68 for instance 70e22cc6-e4af-4230-a480-bbbe6b60d462 on nch1-master-1 Apr 16 21:24:03.488954 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-53ffe1e8-98ee-41bf-96e0-abe91c3a5192 req-deca058b-dace-468e-9623-1f1a5585acec service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047312 Apr 16 21:24:03.505583 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2110/4402] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:24:03.694115 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.scheduler.client.report [None req-ab6607e9-fad0-4d6c-ab1f-9fb2ce8462bf tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Deleted allocations for instance a13152af-d062-4601-810e-ce65dd5479a9 Apr 16 21:24:03.720476 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.compute.api [None req-ab6607e9-fad0-4d6c-ab1f-9fb2ce8462bf tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: a13152af-d062-4601-810e-ce65dd5479a9] Instance Mapping does not exist while attempting local delete cleanup. Apr 16 21:24:03.724983 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ab6607e9-fad0-4d6c-ab1f-9fb2ce8462bf tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a13152af-d062-4601-810e-ce65dd5479a9" status: 204 len: 0 microversion: 2.1 time: 0.834869 Apr 16 21:24:03.727009 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2293/4403] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:24:02 2022] DELETE /compute/v2.1/servers/a13152af-d062-4601-810e-ce65dd5479a9 => generated 0 bytes in 855 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:24:03.736826 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-48961ff8-c176-4a17-abef-0122d5f1a21e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:03.744145 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-48961ff8-c176-4a17-abef-0122d5f1a21e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: a13152af-d062-4601-810e-ce65dd5479a9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:03.748492 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-48961ff8-c176-4a17-abef-0122d5f1a21e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] HTTP exception thrown: Instance a13152af-d062-4601-810e-ce65dd5479a9 could not be found. Apr 16 21:24:03.751422 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-48961ff8-c176-4a17-abef-0122d5f1a21e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Returning 404 to user: Instance a13152af-d062-4601-810e-ce65dd5479a9 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:24:03.754520 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-48961ff8-c176-4a17-abef-0122d5f1a21e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/a13152af-d062-4601-810e-ce65dd5479a9" status: 404 len: 111 microversion: 2.1 time: 0.022927 Apr 16 21:24:03.757804 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2111/4404] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:03 2022] GET /compute/v2.1/servers/a13152af-d062-4601-810e-ce65dd5479a9 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:24:03.892935 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-21843621-2ad4-4f4b-8937-94f7fece7d17 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:03.894398 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-21843621-2ad4-4f4b-8937-94f7fece7d17 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:03.934363 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-21843621-2ad4-4f4b-8937-94f7fece7d17 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:03.935480 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-21843621-2ad4-4f4b-8937-94f7fece7d17 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:03.936457 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-21843621-2ad4-4f4b-8937-94f7fece7d17 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:03.937240 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-21843621-2ad4-4f4b-8937-94f7fece7d17 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:03.956911 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f3437cf2-0cad-4549-ae55-93ba19635f5d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2124039463", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "5fb5cf29-8796-41a2-8375-e8062a5911ad"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:24:04.036023 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-f3437cf2-0cad-4549-ae55-93ba19635f5d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] validate_networks() for [('5fb5cf29-8796-41a2-8375-e8062a5911ad', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:24:04.234421 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-21843621-2ad4-4f4b-8937-94f7fece7d17 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc8a2da85ec46948b5bc30ed7a363bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5096c21fbfe41dd80379e0e3b6fb8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:04.243140 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-21843621-2ad4-4f4b-8937-94f7fece7d17 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304" status: 200 len: 1523 microversion: 2.1 time: 0.357658 Apr 16 21:24:04.256430 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2294/4405] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:03 2022] GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304 => generated 1523 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:04.460747 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e4f084a1-a912-4532-b714-3701862ef6e5 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:04.462143 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e4f084a1-a912-4532-b714-3701862ef6e5 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:04.480303 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e4f084a1-a912-4532-b714-3701862ef6e5 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:04.481064 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e4f084a1-a912-4532-b714-3701862ef6e5 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:04.482048 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e4f084a1-a912-4532-b714-3701862ef6e5 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:04.482653 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e4f084a1-a912-4532-b714-3701862ef6e5 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:04.944906 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e4f084a1-a912-4532-b714-3701862ef6e5 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:04.960329 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e4f084a1-a912-4532-b714-3701862ef6e5 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:04.962602 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e4f084a1-a912-4532-b714-3701862ef6e5 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:04.964020 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e4f084a1-a912-4532-b714-3701862ef6e5 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1874 microversion: 2.42 time: 0.509555 Apr 16 21:24:04.965479 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2295/4406] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:24:04 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1874 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:24:05.264149 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b48baadd-d4a5-4f31-aeae-b4a5afeca533 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:05.265287 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b48baadd-d4a5-4f31-aeae-b4a5afeca533 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:05.277505 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b48baadd-d4a5-4f31-aeae-b4a5afeca533 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:05.280207 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b48baadd-d4a5-4f31-aeae-b4a5afeca533 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:05.281706 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b48baadd-d4a5-4f31-aeae-b4a5afeca533 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:05.282817 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b48baadd-d4a5-4f31-aeae-b4a5afeca533 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:05.350608 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-f3437cf2-0cad-4549-ae55-93ba19635f5d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:24:05.351863 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-f3437cf2-0cad-4549-ae55-93ba19635f5d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:24:05.352951 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-f3437cf2-0cad-4549-ae55-93ba19635f5d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:24:05.353602 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-f3437cf2-0cad-4549-ae55-93ba19635f5d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:24:05.354408 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-f3437cf2-0cad-4549-ae55-93ba19635f5d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:24:05.371577 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f3437cf2-0cad-4549-ae55-93ba19635f5d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:05.377160 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f3437cf2-0cad-4549-ae55-93ba19635f5d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:05.378589 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f3437cf2-0cad-4549-ae55-93ba19635f5d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:05.379215 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f3437cf2-0cad-4549-ae55-93ba19635f5d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:05.447285 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-f3437cf2-0cad-4549-ae55-93ba19635f5d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Getting quotas for project 7caf6e59a47149a68cae6224fb2856e7. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:24:05.463787 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-f3437cf2-0cad-4549-ae55-93ba19635f5d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Getting quotas for user e069f136dcb344b197f58ba47722f4d5 and project 7caf6e59a47149a68cae6224fb2856e7. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:24:05.480755 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f3437cf2-0cad-4549-ae55-93ba19635f5d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:24:05.483395 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f3437cf2-0cad-4549-ae55-93ba19635f5d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 2b015d8b-25ca-42b4-9080-9cc405ea1ad6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:24:05.772409 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f3437cf2-0cad-4549-ae55-93ba19635f5d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.820070 Apr 16 21:24:05.775172 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2112/4407] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:24:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 16 21:24:05.785092 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-6e86d092-d0a6-4dd9-8259-6d7e06f83356 req-fa7567b7-c8c9-423b-b0a8-360fa9e4fcd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70e22cc6-e4af-4230-a480-bbbe6b60d462", "name": "network-vif-plugged", "status": "completed", "tag": "530c687e-6ccd-45ad-ad6e-7e4a0d9487ee"}, {"server_uuid": "70e22cc6-e4af-4230-a480-bbbe6b60d462", "name": "network-vif-plugged", "status": "completed", "tag": "c8475713-e26a-40c8-8213-0fa9fe87a721"}, {"server_uuid": "70e22cc6-e4af-4230-a480-bbbe6b60d462", "name": "network-vif-plugged", "status": "completed", "tag": "fdca9e15-fa18-4555-99b5-61429f002844"}, {"server_uuid": "70e22cc6-e4af-4230-a480-bbbe6b60d462", "name": "network-vif-plugged", "status": "completed", "tag": "c1abc7d3-63c4-4e58-896c-5aa4b9a41054"}, {"server_uuid": "70e22cc6-e4af-4230-a480-bbbe6b60d462", "name": "network-vif-plugged", "status": "completed", "tag": "5e9adf2d-0b03-4f92-88ae-35b824faa4fe"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:24:05.842601 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-6e86d092-d0a6-4dd9-8259-6d7e06f83356 req-fa7567b7-c8c9-423b-b0a8-360fa9e4fcd5 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:05.843260 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-6e86d092-d0a6-4dd9-8259-6d7e06f83356 req-fa7567b7-c8c9-423b-b0a8-360fa9e4fcd5 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:05.875513 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-6e86d092-d0a6-4dd9-8259-6d7e06f83356 req-fa7567b7-c8c9-423b-b0a8-360fa9e4fcd5 service nova] Creating event network-vif-plugged:530c687e-6ccd-45ad-ad6e-7e4a0d9487ee for instance 70e22cc6-e4af-4230-a480-bbbe6b60d462 on nch1-master-1 Apr 16 21:24:05.877123 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-6e86d092-d0a6-4dd9-8259-6d7e06f83356 req-fa7567b7-c8c9-423b-b0a8-360fa9e4fcd5 service nova] Creating event network-vif-plugged:c8475713-e26a-40c8-8213-0fa9fe87a721 for instance 70e22cc6-e4af-4230-a480-bbbe6b60d462 on nch1-master-1 Apr 16 21:24:05.877665 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-6e86d092-d0a6-4dd9-8259-6d7e06f83356 req-fa7567b7-c8c9-423b-b0a8-360fa9e4fcd5 service nova] Creating event network-vif-plugged:fdca9e15-fa18-4555-99b5-61429f002844 for instance 70e22cc6-e4af-4230-a480-bbbe6b60d462 on nch1-master-1 Apr 16 21:24:05.878188 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-6e86d092-d0a6-4dd9-8259-6d7e06f83356 req-fa7567b7-c8c9-423b-b0a8-360fa9e4fcd5 service nova] Creating event network-vif-plugged:c1abc7d3-63c4-4e58-896c-5aa4b9a41054 for instance 70e22cc6-e4af-4230-a480-bbbe6b60d462 on nch1-master-1 Apr 16 21:24:05.882316 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-6e86d092-d0a6-4dd9-8259-6d7e06f83356 req-fa7567b7-c8c9-423b-b0a8-360fa9e4fcd5 service nova] Creating event network-vif-plugged:5e9adf2d-0b03-4f92-88ae-35b824faa4fe for instance 70e22cc6-e4af-4230-a480-bbbe6b60d462 on nch1-master-1 Apr 16 21:24:05.896821 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-6e86d092-d0a6-4dd9-8259-6d7e06f83356 req-fa7567b7-c8c9-423b-b0a8-360fa9e4fcd5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.116320 Apr 16 21:24:05.896821 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2113/4408] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:24:05.919473 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5ace8513-87ed-471e-8044-48ea6a676278 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:05.920302 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5ace8513-87ed-471e-8044-48ea6a676278 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 2b015d8b-25ca-42b4-9080-9cc405ea1ad6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:06.033545 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5ace8513-87ed-471e-8044-48ea6a676278 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:06.042961 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5ace8513-87ed-471e-8044-48ea6a676278 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/2b015d8b-25ca-42b4-9080-9cc405ea1ad6" status: 200 len: 1215 microversion: 2.1 time: 0.145719 Apr 16 21:24:06.044976 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2114/4409] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:05 2022] GET /compute/v2.1/servers/2b015d8b-25ca-42b4-9080-9cc405ea1ad6 => generated 1215 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:06.050036 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-31f676b3-a6a0-4527-942c-434af8676597 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:06.050916 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-31f676b3-a6a0-4527-942c-434af8676597 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:06.072213 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-31f676b3-a6a0-4527-942c-434af8676597 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:06.072904 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-31f676b3-a6a0-4527-942c-434af8676597 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:06.076786 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-31f676b3-a6a0-4527-942c-434af8676597 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:06.077914 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-31f676b3-a6a0-4527-942c-434af8676597 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:06.187852 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b48baadd-d4a5-4f31-aeae-b4a5afeca533 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc8a2da85ec46948b5bc30ed7a363bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5096c21fbfe41dd80379e0e3b6fb8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:06.196313 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b48baadd-d4a5-4f31-aeae-b4a5afeca533 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304" status: 200 len: 1523 microversion: 2.1 time: 0.936667 Apr 16 21:24:06.208822 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2296/4410] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:05 2022] GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304 => generated 1523 bytes in 950 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:06.454470 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-31f676b3-a6a0-4527-942c-434af8676597 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:06.468238 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-31f676b3-a6a0-4527-942c-434af8676597 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:06.470082 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-31f676b3-a6a0-4527-942c-434af8676597 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:06.471594 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-31f676b3-a6a0-4527-942c-434af8676597 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1874 microversion: 2.42 time: 0.425848 Apr 16 21:24:06.472749 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2115/4411] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:24:06 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1874 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:24:07.067547 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2208ad6c-0fb2-444a-a929-fbebbaf6d5cf tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:07.069737 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2208ad6c-0fb2-444a-a929-fbebbaf6d5cf tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 2b015d8b-25ca-42b4-9080-9cc405ea1ad6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:07.084329 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2208ad6c-0fb2-444a-a929-fbebbaf6d5cf tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:07.092354 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2208ad6c-0fb2-444a-a929-fbebbaf6d5cf tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:07.092354 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2208ad6c-0fb2-444a-a929-fbebbaf6d5cf tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:07.092354 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2208ad6c-0fb2-444a-a929-fbebbaf6d5cf tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:07.204067 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2208ad6c-0fb2-444a-a929-fbebbaf6d5cf tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:07.215248 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-528a12ac-8d06-4d4f-a23e-95e0564afe1e tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:07.216161 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-528a12ac-8d06-4d4f-a23e-95e0564afe1e tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:07.217997 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2208ad6c-0fb2-444a-a929-fbebbaf6d5cf tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/2b015d8b-25ca-42b4-9080-9cc405ea1ad6" status: 200 len: 1219 microversion: 2.1 time: 0.157474 Apr 16 21:24:07.226251 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-528a12ac-8d06-4d4f-a23e-95e0564afe1e tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:07.228436 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-528a12ac-8d06-4d4f-a23e-95e0564afe1e tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:07.229889 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-528a12ac-8d06-4d4f-a23e-95e0564afe1e tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:07.230316 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-528a12ac-8d06-4d4f-a23e-95e0564afe1e tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:07.231156 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2297/4412] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:07 2022] GET /compute/v2.1/servers/2b015d8b-25ca-42b4-9080-9cc405ea1ad6 => generated 1219 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:07.492482 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0d7ad01d-3eb8-469e-b3ed-acae6e57a981 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:07.492482 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0d7ad01d-3eb8-469e-b3ed-acae6e57a981 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:07.510229 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0d7ad01d-3eb8-469e-b3ed-acae6e57a981 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:07.511050 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0d7ad01d-3eb8-469e-b3ed-acae6e57a981 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:07.512725 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0d7ad01d-3eb8-469e-b3ed-acae6e57a981 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:07.513365 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0d7ad01d-3eb8-469e-b3ed-acae6e57a981 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:07.544717 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-528a12ac-8d06-4d4f-a23e-95e0564afe1e tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc8a2da85ec46948b5bc30ed7a363bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5096c21fbfe41dd80379e0e3b6fb8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:07.554254 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-528a12ac-8d06-4d4f-a23e-95e0564afe1e tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304" status: 200 len: 1523 microversion: 2.1 time: 0.342967 Apr 16 21:24:07.564677 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2116/4413] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:07 2022] GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304 => generated 1523 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:07.829924 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0d7ad01d-3eb8-469e-b3ed-acae6e57a981 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:07.843264 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0d7ad01d-3eb8-469e-b3ed-acae6e57a981 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:07.845065 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0d7ad01d-3eb8-469e-b3ed-acae6e57a981 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:07.846665 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0d7ad01d-3eb8-469e-b3ed-acae6e57a981 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1874 microversion: 2.42 time: 0.360379 Apr 16 21:24:07.847759 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2298/4414] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:24:07 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1874 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:24:07.927677 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-a9c38805-1387-4afd-87ce-416913a08beb req-39beb172-e7bc-4c1a-9ea6-32816245f86d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70e22cc6-e4af-4230-a480-bbbe6b60d462", "name": "network-vif-plugged", "status": "completed", "tag": "cc99d421-5515-41e3-bbf8-03443566d154"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:24:07.936656 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-a9c38805-1387-4afd-87ce-416913a08beb req-39beb172-e7bc-4c1a-9ea6-32816245f86d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:07.937186 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-a9c38805-1387-4afd-87ce-416913a08beb req-39beb172-e7bc-4c1a-9ea6-32816245f86d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:07.951564 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-a9c38805-1387-4afd-87ce-416913a08beb req-39beb172-e7bc-4c1a-9ea6-32816245f86d service nova] Creating event network-vif-plugged:cc99d421-5515-41e3-bbf8-03443566d154 for instance 70e22cc6-e4af-4230-a480-bbbe6b60d462 on nch1-master-1 Apr 16 21:24:07.982161 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-a9c38805-1387-4afd-87ce-416913a08beb req-39beb172-e7bc-4c1a-9ea6-32816245f86d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058858 Apr 16 21:24:07.983407 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2117/4415] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:24:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:24:08.235866 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f57c0199-8380-4262-a40e-c6eafbe5ca31 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:08.237670 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f57c0199-8380-4262-a40e-c6eafbe5ca31 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 2b015d8b-25ca-42b4-9080-9cc405ea1ad6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:08.245815 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f57c0199-8380-4262-a40e-c6eafbe5ca31 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:08.246443 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f57c0199-8380-4262-a40e-c6eafbe5ca31 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:08.247360 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f57c0199-8380-4262-a40e-c6eafbe5ca31 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:08.247819 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f57c0199-8380-4262-a40e-c6eafbe5ca31 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:08.346586 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f57c0199-8380-4262-a40e-c6eafbe5ca31 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:08.355092 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f57c0199-8380-4262-a40e-c6eafbe5ca31 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/2b015d8b-25ca-42b4-9080-9cc405ea1ad6" status: 200 len: 1267 microversion: 2.1 time: 0.123914 Apr 16 21:24:08.355672 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2299/4416] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:08 2022] GET /compute/v2.1/servers/2b015d8b-25ca-42b4-9080-9cc405ea1ad6 => generated 1267 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:08.571937 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d1e4d9f1-82a2-44c9-ada5-3fa04ca1a049 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:08.576438 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d1e4d9f1-82a2-44c9-ada5-3fa04ca1a049 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:08.590870 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d1e4d9f1-82a2-44c9-ada5-3fa04ca1a049 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:08.616384 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d1e4d9f1-82a2-44c9-ada5-3fa04ca1a049 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:08.621436 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d1e4d9f1-82a2-44c9-ada5-3fa04ca1a049 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:08.622417 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d1e4d9f1-82a2-44c9-ada5-3fa04ca1a049 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:08.786372 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a748fde1-b34a-459f-a09d-85837909d9bf tempest-ServerGroup264TestJSON-227011855 tempest-ServerGroup264TestJSON-227011855-project] Action: 'create', calling method: .version_select at 0x7fbb95683dc0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:24:08.808847 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-a748fde1-b34a-459f-a09d-85837909d9bf tempest-ServerGroup264TestJSON-227011855 tempest-ServerGroup264TestJSON-227011855-project] Getting quotas for project 4817d955b0eb48e4b6876ddcefde7ab2. Resources: {'server_groups'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:24:08.820722 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-a748fde1-b34a-459f-a09d-85837909d9bf tempest-ServerGroup264TestJSON-227011855 tempest-ServerGroup264TestJSON-227011855-project] Getting quotas for user 0564d23936d64721a5fe28586da93871 and project 4817d955b0eb48e4b6876ddcefde7ab2. Resources: {'server_groups'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:24:08.968938 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d1e4d9f1-82a2-44c9-ada5-3fa04ca1a049 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc8a2da85ec46948b5bc30ed7a363bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5096c21fbfe41dd80379e0e3b6fb8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:08.997221 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d1e4d9f1-82a2-44c9-ada5-3fa04ca1a049 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304" status: 200 len: 1523 microversion: 2.1 time: 0.424329 Apr 16 21:24:09.004035 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2118/4417] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:08 2022] GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304 => generated 1523 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:09.004478 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-a748fde1-b34a-459f-a09d-85837909d9bf tempest-ServerGroup264TestJSON-227011855 tempest-ServerGroup264TestJSON-227011855-project] Getting quotas for project 4817d955b0eb48e4b6876ddcefde7ab2. Resources: {'server_groups'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:24:09.012643 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c77b843b-e0e9-4f07-9f1a-3c12d0960e19 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:09.016890 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-a748fde1-b34a-459f-a09d-85837909d9bf tempest-ServerGroup264TestJSON-227011855 tempest-ServerGroup264TestJSON-227011855-project] Getting quotas for user 0564d23936d64721a5fe28586da93871 and project 4817d955b0eb48e4b6876ddcefde7ab2. Resources: {'server_groups'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:24:09.019673 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c77b843b-e0e9-4f07-9f1a-3c12d0960e19 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:09.038575 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c77b843b-e0e9-4f07-9f1a-3c12d0960e19 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:09.040388 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c77b843b-e0e9-4f07-9f1a-3c12d0960e19 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:09.048097 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c77b843b-e0e9-4f07-9f1a-3c12d0960e19 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:09.050297 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c77b843b-e0e9-4f07-9f1a-3c12d0960e19 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:09.065157 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a748fde1-b34a-459f-a09d-85837909d9bf tempest-ServerGroup264TestJSON-227011855 tempest-ServerGroup264TestJSON-227011855-project] 10.222.0.20 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.467518 Apr 16 21:24:09.066352 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2300/4418] 10.222.0.20 () {62 vars in 1213 bytes} [Sat Apr 16 21:24:08 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:24:09.076884 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f0e18495-1b21-4ed3-84b8-c3ae57f787f1 tempest-ServerGroup264TestJSON-227011855 tempest-ServerGroup264TestJSON-227011855-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:09.104074 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f0e18495-1b21-4ed3-84b8-c3ae57f787f1 tempest-ServerGroup264TestJSON-227011855 tempest-ServerGroup264TestJSON-227011855-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.031384 Apr 16 21:24:09.110532 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2301/4419] 10.222.0.20 () {60 vars in 1192 bytes} [Sat Apr 16 21:24:09 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 16 21:24:09.128503 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0284e65d-42a6-4a3c-9e32-c6771a1f9d34 tempest-ServerGroup264TestJSON-227011855 tempest-ServerGroup264TestJSON-227011855-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:09.149673 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0284e65d-42a6-4a3c-9e32-c6771a1f9d34 tempest-ServerGroup264TestJSON-227011855 tempest-ServerGroup264TestJSON-227011855-project] 10.222.0.20 "GET /compute/v2.1/os-server-groups/59ceb6f7-d242-4bdd-a4d3-10d89d591dcb" status: 200 len: 235 microversion: 2.64 time: 0.031086 Apr 16 21:24:09.151496 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2302/4420] 10.222.0.20 () {60 vars in 1303 bytes} [Sat Apr 16 21:24:09 2022] GET /compute/v2.1/os-server-groups/59ceb6f7-d242-4bdd-a4d3-10d89d591dcb => generated 235 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:24:09.165438 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8252b987-5cb2-4c18-a163-fd8dbfc9e0b0 tempest-ServerGroup264TestJSON-227011855 tempest-ServerGroup264TestJSON-227011855-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:09.288986 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8252b987-5cb2-4c18-a163-fd8dbfc9e0b0 tempest-ServerGroup264TestJSON-227011855 tempest-ServerGroup264TestJSON-227011855-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/59ceb6f7-d242-4bdd-a4d3-10d89d591dcb" status: 204 len: 0 microversion: 2.64 time: 0.129249 Apr 16 21:24:09.289752 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2303/4421] 10.222.0.20 () {60 vars in 1306 bytes} [Sat Apr 16 21:24:09 2022] DELETE /compute/v2.1/os-server-groups/59ceb6f7-d242-4bdd-a4d3-10d89d591dcb => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 16 21:24:09.300311 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4ad4be89-9ddb-4f12-b751-3aa66a1c5da5 tempest-ServerGroup264TestJSON-227011855 tempest-ServerGroup264TestJSON-227011855-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:09.314254 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-4ad4be89-9ddb-4f12-b751-3aa66a1c5da5 tempest-ServerGroup264TestJSON-227011855 tempest-ServerGroup264TestJSON-227011855-project] HTTP exception thrown: Instance group 59ceb6f7-d242-4bdd-a4d3-10d89d591dcb could not be found. Apr 16 21:24:09.318503 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4ad4be89-9ddb-4f12-b751-3aa66a1c5da5 tempest-ServerGroup264TestJSON-227011855 tempest-ServerGroup264TestJSON-227011855-project] Returning 404 to user: Instance group 59ceb6f7-d242-4bdd-a4d3-10d89d591dcb could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:24:09.319921 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4ad4be89-9ddb-4f12-b751-3aa66a1c5da5 tempest-ServerGroup264TestJSON-227011855 tempest-ServerGroup264TestJSON-227011855-project] 10.222.0.20 "DELETE /compute/v2.1/os-server-groups/59ceb6f7-d242-4bdd-a4d3-10d89d591dcb" status: 404 len: 117 microversion: 2.64 time: 0.023877 Apr 16 21:24:09.320701 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2304/4422] 10.222.0.20 () {60 vars in 1306 bytes} [Sat Apr 16 21:24:09 2022] DELETE /compute/v2.1/os-server-groups/59ceb6f7-d242-4bdd-a4d3-10d89d591dcb => generated 117 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:24:09.375442 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-69bc6672-856c-499c-b7d1-ac0e756871fc tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:09.376478 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-69bc6672-856c-499c-b7d1-ac0e756871fc tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 2b015d8b-25ca-42b4-9080-9cc405ea1ad6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:09.386797 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-69bc6672-856c-499c-b7d1-ac0e756871fc tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:09.389372 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-69bc6672-856c-499c-b7d1-ac0e756871fc tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:09.392050 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-69bc6672-856c-499c-b7d1-ac0e756871fc tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:09.394179 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-69bc6672-856c-499c-b7d1-ac0e756871fc tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:09.445135 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c77b843b-e0e9-4f07-9f1a-3c12d0960e19 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:09.454713 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c77b843b-e0e9-4f07-9f1a-3c12d0960e19 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:09.456248 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c77b843b-e0e9-4f07-9f1a-3c12d0960e19 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:09.457416 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c77b843b-e0e9-4f07-9f1a-3c12d0960e19 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1874 microversion: 2.42 time: 0.451277 Apr 16 21:24:09.466430 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2119/4423] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:24:09 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1874 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:24:09.532265 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-69bc6672-856c-499c-b7d1-ac0e756871fc tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:09.550609 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-69bc6672-856c-499c-b7d1-ac0e756871fc tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/2b015d8b-25ca-42b4-9080-9cc405ea1ad6" status: 200 len: 1273 microversion: 2.1 time: 0.181810 Apr 16 21:24:09.552297 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2305/4424] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:09 2022] GET /compute/v2.1/servers/2b015d8b-25ca-42b4-9080-9cc405ea1ad6 => generated 1273 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:10.022013 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9d328ec6-3cb6-47c3-beaf-dbd1f24e3fa4 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:10.022721 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9d328ec6-3cb6-47c3-beaf-dbd1f24e3fa4 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:10.038930 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9d328ec6-3cb6-47c3-beaf-dbd1f24e3fa4 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:10.040912 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9d328ec6-3cb6-47c3-beaf-dbd1f24e3fa4 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:10.044846 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9d328ec6-3cb6-47c3-beaf-dbd1f24e3fa4 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:10.049093 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9d328ec6-3cb6-47c3-beaf-dbd1f24e3fa4 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:10.414011 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9d328ec6-3cb6-47c3-beaf-dbd1f24e3fa4 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc8a2da85ec46948b5bc30ed7a363bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5096c21fbfe41dd80379e0e3b6fb8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:10.424743 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9d328ec6-3cb6-47c3-beaf-dbd1f24e3fa4 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304" status: 200 len: 1523 microversion: 2.1 time: 0.407446 Apr 16 21:24:10.428720 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2120/4425] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:10 2022] GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304 => generated 1523 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:10.486167 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f5fd0bfa-d72f-44db-8238-2d9263d97389 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:10.486857 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f5fd0bfa-d72f-44db-8238-2d9263d97389 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:10.508633 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f5fd0bfa-d72f-44db-8238-2d9263d97389 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:10.509102 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f5fd0bfa-d72f-44db-8238-2d9263d97389 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:10.510402 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f5fd0bfa-d72f-44db-8238-2d9263d97389 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:10.511426 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f5fd0bfa-d72f-44db-8238-2d9263d97389 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:10.576372 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-73c44c46-0218-49b1-8d24-82b87217a882 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:10.577379 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-73c44c46-0218-49b1-8d24-82b87217a882 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 2b015d8b-25ca-42b4-9080-9cc405ea1ad6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:10.587358 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-73c44c46-0218-49b1-8d24-82b87217a882 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:10.590741 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-73c44c46-0218-49b1-8d24-82b87217a882 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:10.591853 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-73c44c46-0218-49b1-8d24-82b87217a882 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:10.596742 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-73c44c46-0218-49b1-8d24-82b87217a882 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:10.899970 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f5fd0bfa-d72f-44db-8238-2d9263d97389 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:10.909433 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f5fd0bfa-d72f-44db-8238-2d9263d97389 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:10.913640 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f5fd0bfa-d72f-44db-8238-2d9263d97389 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:10.915230 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f5fd0bfa-d72f-44db-8238-2d9263d97389 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1874 microversion: 2.42 time: 0.433390 Apr 16 21:24:10.927259 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2306/4426] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:24:10 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1874 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:24:11.021453 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-73c44c46-0218-49b1-8d24-82b87217a882 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:11.062833 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-73c44c46-0218-49b1-8d24-82b87217a882 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/2b015d8b-25ca-42b4-9080-9cc405ea1ad6" status: 200 len: 1315 microversion: 2.1 time: 0.497579 Apr 16 21:24:11.107133 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2121/4427] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:10 2022] GET /compute/v2.1/servers/2b015d8b-25ca-42b4-9080-9cc405ea1ad6 => generated 1315 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:11.443196 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-eb248290-e34a-47b2-9532-c86918eafde2 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:11.444990 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-eb248290-e34a-47b2-9532-c86918eafde2 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:11.455419 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eb248290-e34a-47b2-9532-c86918eafde2 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:11.456268 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eb248290-e34a-47b2-9532-c86918eafde2 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:11.458418 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eb248290-e34a-47b2-9532-c86918eafde2 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:11.459469 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eb248290-e34a-47b2-9532-c86918eafde2 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:11.937900 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b63a1a0d-d22c-43d4-85eb-da73d9fbe41e tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:11.938533 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b63a1a0d-d22c-43d4-85eb-da73d9fbe41e tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:11.948922 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b63a1a0d-d22c-43d4-85eb-da73d9fbe41e tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:11.949388 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b63a1a0d-d22c-43d4-85eb-da73d9fbe41e tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:11.958859 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b63a1a0d-d22c-43d4-85eb-da73d9fbe41e tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:11.961132 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b63a1a0d-d22c-43d4-85eb-da73d9fbe41e tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:12.197503 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-eb248290-e34a-47b2-9532-c86918eafde2 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc8a2da85ec46948b5bc30ed7a363bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5096c21fbfe41dd80379e0e3b6fb8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:12.207160 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-eb248290-e34a-47b2-9532-c86918eafde2 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304" status: 200 len: 1523 microversion: 2.1 time: 0.768090 Apr 16 21:24:12.209903 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2307/4428] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:11 2022] GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304 => generated 1523 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:12.230734 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8d4502fe-7f55-4e8b-9b44-3753c8bde3d0 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:12.234667 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8d4502fe-7f55-4e8b-9b44-3753c8bde3d0 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 2b015d8b-25ca-42b4-9080-9cc405ea1ad6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:12.243287 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8d4502fe-7f55-4e8b-9b44-3753c8bde3d0 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:12.247005 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8d4502fe-7f55-4e8b-9b44-3753c8bde3d0 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:12.248032 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8d4502fe-7f55-4e8b-9b44-3753c8bde3d0 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:12.248665 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8d4502fe-7f55-4e8b-9b44-3753c8bde3d0 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:12.512678 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b63a1a0d-d22c-43d4-85eb-da73d9fbe41e tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:12.530289 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b63a1a0d-d22c-43d4-85eb-da73d9fbe41e tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:12.538847 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b63a1a0d-d22c-43d4-85eb-da73d9fbe41e tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:12.541841 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b63a1a0d-d22c-43d4-85eb-da73d9fbe41e tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 2832 microversion: 2.42 time: 0.611768 Apr 16 21:24:12.548697 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2122/4429] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:24:11 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 2832 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:24:12.565670 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8d4502fe-7f55-4e8b-9b44-3753c8bde3d0 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:12.570564 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-93f906f2-39d2-4f2c-887a-17d822659537 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:12.572927 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-93f906f2-39d2-4f2c-887a-17d822659537 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:12.584872 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8d4502fe-7f55-4e8b-9b44-3753c8bde3d0 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/2b015d8b-25ca-42b4-9080-9cc405ea1ad6" status: 200 len: 1315 microversion: 2.1 time: 0.361933 Apr 16 21:24:12.589091 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2308/4430] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:12 2022] GET /compute/v2.1/servers/2b015d8b-25ca-42b4-9080-9cc405ea1ad6 => generated 1315 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:12.594024 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-93f906f2-39d2-4f2c-887a-17d822659537 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:12.594024 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-93f906f2-39d2-4f2c-887a-17d822659537 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:12.594024 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-93f906f2-39d2-4f2c-887a-17d822659537 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:12.594024 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-93f906f2-39d2-4f2c-887a-17d822659537 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:12.738382 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-a9c6c591-8921-4f0d-b28d-f7dfb9c0dfc6 req-b8cbaf66-b5ad-4099-bc32-1643f81bbb7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b015d8b-25ca-42b4-9080-9cc405ea1ad6", "tag": "48255b0b-bf96-40f8-a7f4-40c646be8a37"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:24:12.762522 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-a9c6c591-8921-4f0d-b28d-f7dfb9c0dfc6 req-b8cbaf66-b5ad-4099-bc32-1643f81bbb7d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:12.762985 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-a9c6c591-8921-4f0d-b28d-f7dfb9c0dfc6 req-b8cbaf66-b5ad-4099-bc32-1643f81bbb7d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:12.808222 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-a9c6c591-8921-4f0d-b28d-f7dfb9c0dfc6 req-b8cbaf66-b5ad-4099-bc32-1643f81bbb7d service nova] Creating event network-changed:48255b0b-bf96-40f8-a7f4-40c646be8a37 for instance 2b015d8b-25ca-42b4-9080-9cc405ea1ad6 on nch1-master-1 Apr 16 21:24:12.820592 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-a9c6c591-8921-4f0d-b28d-f7dfb9c0dfc6 req-b8cbaf66-b5ad-4099-bc32-1643f81bbb7d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086761 Apr 16 21:24:12.822093 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2309/4431] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:24:13.227626 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-964fe062-1f13-47c7-92f6-cf4a035bcb21 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:13.228418 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-964fe062-1f13-47c7-92f6-cf4a035bcb21 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:13.241121 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-964fe062-1f13-47c7-92f6-cf4a035bcb21 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:13.241578 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-964fe062-1f13-47c7-92f6-cf4a035bcb21 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:13.244222 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-964fe062-1f13-47c7-92f6-cf4a035bcb21 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:13.245038 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-964fe062-1f13-47c7-92f6-cf4a035bcb21 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:13.348824 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-93f906f2-39d2-4f2c-887a-17d822659537 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.786757 Apr 16 21:24:13.358114 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2123/4432] 10.222.0.20 () {60 vars in 1315 bytes} [Sat Apr 16 21:24:12 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462/os-interface => generated 1831 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:24:13.503136 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-964fe062-1f13-47c7-92f6-cf4a035bcb21 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc8a2da85ec46948b5bc30ed7a363bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5096c21fbfe41dd80379e0e3b6fb8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:13.512244 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-964fe062-1f13-47c7-92f6-cf4a035bcb21 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304" status: 200 len: 1503 microversion: 2.1 time: 0.289648 Apr 16 21:24:13.512811 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2310/4433] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:13 2022] GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304 => generated 1503 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:13.529908 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ae037431-2f8e-428e-9ee1-9075ff2f2d78 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Action: 'create', calling method: .version_select at 0x7fbb95659f70>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1984036643", "description": "tempest-description-241076976"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:24:13.606244 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b11d6972-4d00-4f01-80be-b36e4d018946 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:13.606995 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b11d6972-4d00-4f01-80be-b36e4d018946 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 2b015d8b-25ca-42b4-9080-9cc405ea1ad6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:13.615058 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b11d6972-4d00-4f01-80be-b36e4d018946 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:13.615772 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b11d6972-4d00-4f01-80be-b36e4d018946 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:13.616594 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b11d6972-4d00-4f01-80be-b36e4d018946 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:13.617045 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b11d6972-4d00-4f01-80be-b36e4d018946 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:13.816356 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b11d6972-4d00-4f01-80be-b36e4d018946 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:13.827172 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b11d6972-4d00-4f01-80be-b36e4d018946 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/2b015d8b-25ca-42b4-9080-9cc405ea1ad6" status: 200 len: 1315 microversion: 2.1 time: 0.225335 Apr 16 21:24:13.828254 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2311/4434] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:13 2022] GET /compute/v2.1/servers/2b015d8b-25ca-42b4-9080-9cc405ea1ad6 => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:24:14.366555 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ae037431-2f8e-428e-9ee1-9075ff2f2d78 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "POST /compute/v2.1/os-security-groups" status: 200 len: 250 microversion: 2.1 time: 0.840662 Apr 16 21:24:14.367160 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2124/4435] 10.222.0.20 () {60 vars in 1179 bytes} [Sat Apr 16 21:24:13 2022] POST /compute/v2.1/os-security-groups => generated 250 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:24:14.397447 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7bc0e386-83d7-4998-aaec-386890a70ba8 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1984036643"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:24:14.400955 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7bc0e386-83d7-4998-aaec-386890a70ba8 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:14.420650 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7bc0e386-83d7-4998-aaec-386890a70ba8 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:14.421579 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7bc0e386-83d7-4998-aaec-386890a70ba8 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:14.429827 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7bc0e386-83d7-4998-aaec-386890a70ba8 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:14.433405 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7bc0e386-83d7-4998-aaec-386890a70ba8 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:14.666731 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.network.security_group_api [None req-7bc0e386-83d7-4998-aaec-386890a70ba8 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Adding security group 26968c5b-9466-4121-a076-5601408b759c to port fd85026d-38d7-4dbb-a085-fa40b89df53f Apr 16 21:24:14.843468 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ee9a665e-2b5f-48d1-82db-48aabdd4e9a2 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:14.844093 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ee9a665e-2b5f-48d1-82db-48aabdd4e9a2 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 2b015d8b-25ca-42b4-9080-9cc405ea1ad6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:14.858765 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ee9a665e-2b5f-48d1-82db-48aabdd4e9a2 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:14.859230 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ee9a665e-2b5f-48d1-82db-48aabdd4e9a2 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:14.860572 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ee9a665e-2b5f-48d1-82db-48aabdd4e9a2 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:14.861200 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ee9a665e-2b5f-48d1-82db-48aabdd4e9a2 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:15.109196 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ee9a665e-2b5f-48d1-82db-48aabdd4e9a2 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:15.119016 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ee9a665e-2b5f-48d1-82db-48aabdd4e9a2 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/2b015d8b-25ca-42b4-9080-9cc405ea1ad6" status: 200 len: 1315 microversion: 2.1 time: 0.278867 Apr 16 21:24:15.121886 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2125/4436] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:14 2022] GET /compute/v2.1/servers/2b015d8b-25ca-42b4-9080-9cc405ea1ad6 => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:24:15.482283 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7bc0e386-83d7-4998-aaec-386890a70ba8 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "POST /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304/action" status: 202 len: 0 microversion: 2.1 time: 1.105022 Apr 16 21:24:15.482903 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2312/4437] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:24:14 2022] POST /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304/action => generated 0 bytes in 1106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:24:15.492189 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9a35aaf9-62b3-4080-b746-0af06f1f1aef tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1984036643"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:24:15.492742 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9a35aaf9-62b3-4080-b746-0af06f1f1aef tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:15.503181 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9a35aaf9-62b3-4080-b746-0af06f1f1aef tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:15.503654 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9a35aaf9-62b3-4080-b746-0af06f1f1aef tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:15.504487 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9a35aaf9-62b3-4080-b746-0af06f1f1aef tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:15.505461 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9a35aaf9-62b3-4080-b746-0af06f1f1aef tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:15.507961 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-3c5feb8f-7b09-4eb4-939c-7a8f87ece0e7 req-6baa26cb-ec51-4d56-9198-99f8a79f14f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b36f160b-012c-42fa-8884-2d4f22c5f304", "tag": "fd85026d-38d7-4dbb-a085-fa40b89df53f"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:24:15.521399 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-3c5feb8f-7b09-4eb4-939c-7a8f87ece0e7 req-6baa26cb-ec51-4d56-9198-99f8a79f14f3 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:15.521855 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-3c5feb8f-7b09-4eb4-939c-7a8f87ece0e7 req-6baa26cb-ec51-4d56-9198-99f8a79f14f3 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:15.557639 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-3c5feb8f-7b09-4eb4-939c-7a8f87ece0e7 req-6baa26cb-ec51-4d56-9198-99f8a79f14f3 service nova] Creating event network-changed:fd85026d-38d7-4dbb-a085-fa40b89df53f for instance b36f160b-012c-42fa-8884-2d4f22c5f304 on nch2-master-1 Apr 16 21:24:15.579668 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-3c5feb8f-7b09-4eb4-939c-7a8f87ece0e7 req-6baa26cb-ec51-4d56-9198-99f8a79f14f3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074083 Apr 16 21:24:15.579668 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2313/4438] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:24:16.141226 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-56c312fb-626e-4c25-8e6a-8cdcd2cbbc49 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:16.142737 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-56c312fb-626e-4c25-8e6a-8cdcd2cbbc49 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 2b015d8b-25ca-42b4-9080-9cc405ea1ad6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:16.158106 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-56c312fb-626e-4c25-8e6a-8cdcd2cbbc49 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:16.162837 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-56c312fb-626e-4c25-8e6a-8cdcd2cbbc49 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:16.164259 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-56c312fb-626e-4c25-8e6a-8cdcd2cbbc49 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:16.164996 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-56c312fb-626e-4c25-8e6a-8cdcd2cbbc49 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:16.414499 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-56c312fb-626e-4c25-8e6a-8cdcd2cbbc49 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:16.424899 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-56c312fb-626e-4c25-8e6a-8cdcd2cbbc49 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/2b015d8b-25ca-42b4-9080-9cc405ea1ad6" status: 200 len: 1315 microversion: 2.1 time: 0.290883 Apr 16 21:24:16.437882 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2314/4439] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:16 2022] GET /compute/v2.1/servers/2b015d8b-25ca-42b4-9080-9cc405ea1ad6 => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:24:16.474623 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.network.security_group_api [None req-9a35aaf9-62b3-4080-b746-0af06f1f1aef tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Removing security group 26968c5b-9466-4121-a076-5601408b759c from port fd85026d-38d7-4dbb-a085-fa40b89df53f Apr 16 21:24:16.738805 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-614f1b86-3e3b-45c1-85c6-3d189a201d35 req-36cbdc71-f92f-450f-81bc-6ede340d3349 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70e22cc6-e4af-4230-a480-bbbe6b60d462", "tag": "cc99d421-5515-41e3-bbf8-03443566d154"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:24:16.760054 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-614f1b86-3e3b-45c1-85c6-3d189a201d35 req-36cbdc71-f92f-450f-81bc-6ede340d3349 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:16.760459 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-614f1b86-3e3b-45c1-85c6-3d189a201d35 req-36cbdc71-f92f-450f-81bc-6ede340d3349 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:16.849168 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-614f1b86-3e3b-45c1-85c6-3d189a201d35 req-36cbdc71-f92f-450f-81bc-6ede340d3349 service nova] Creating event network-changed:cc99d421-5515-41e3-bbf8-03443566d154 for instance 70e22cc6-e4af-4230-a480-bbbe6b60d462 on nch1-master-1 Apr 16 21:24:16.849168 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-614f1b86-3e3b-45c1-85c6-3d189a201d35 req-36cbdc71-f92f-450f-81bc-6ede340d3349 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078122 Apr 16 21:24:16.849168 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2315/4440] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:24:17.446666 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c9fcd1c4-dac4-4052-b922-a6bbc1c2421a tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:17.447713 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c9fcd1c4-dac4-4052-b922-a6bbc1c2421a tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 2b015d8b-25ca-42b4-9080-9cc405ea1ad6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:17.464488 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c9fcd1c4-dac4-4052-b922-a6bbc1c2421a tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:17.467165 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c9fcd1c4-dac4-4052-b922-a6bbc1c2421a tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:17.469107 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c9fcd1c4-dac4-4052-b922-a6bbc1c2421a tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:17.471616 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c9fcd1c4-dac4-4052-b922-a6bbc1c2421a tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:17.803165 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c9fcd1c4-dac4-4052-b922-a6bbc1c2421a tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:17.814707 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c9fcd1c4-dac4-4052-b922-a6bbc1c2421a tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/2b015d8b-25ca-42b4-9080-9cc405ea1ad6" status: 200 len: 1315 microversion: 2.1 time: 0.375482 Apr 16 21:24:17.815312 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2316/4441] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:17 2022] GET /compute/v2.1/servers/2b015d8b-25ca-42b4-9080-9cc405ea1ad6 => generated 1315 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:24:18.831174 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-387db632-9a91-48dc-8d5f-f035a3ae251d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:18.831884 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-387db632-9a91-48dc-8d5f-f035a3ae251d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 2b015d8b-25ca-42b4-9080-9cc405ea1ad6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:18.849728 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-387db632-9a91-48dc-8d5f-f035a3ae251d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:18.855846 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-387db632-9a91-48dc-8d5f-f035a3ae251d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:18.860822 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-387db632-9a91-48dc-8d5f-f035a3ae251d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:18.875727 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-387db632-9a91-48dc-8d5f-f035a3ae251d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:18.978405 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9a35aaf9-62b3-4080-b746-0af06f1f1aef tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "POST /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304/action" status: 202 len: 0 microversion: 2.1 time: 3.490397 Apr 16 21:24:18.979673 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2126/4442] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:24:15 2022] POST /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304/action => generated 0 bytes in 3492 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:24:18.999082 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2ff07cb6-de24-4c2c-8a22-c107e57ba73e tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Action: 'create', calling method: .version_select at 0x7fbb95632ee0>, body: {"pool": null} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:24:19.325999 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-387db632-9a91-48dc-8d5f-f035a3ae251d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:19.334079 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-387db632-9a91-48dc-8d5f-f035a3ae251d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/2b015d8b-25ca-42b4-9080-9cc405ea1ad6" status: 200 len: 1315 microversion: 2.1 time: 0.507042 Apr 16 21:24:19.337495 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2317/4443] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:18 2022] GET /compute/v2.1/servers/2b015d8b-25ca-42b4-9080-9cc405ea1ad6 => generated 1315 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:19.648092 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e111eab6-5d69-4f4b-aa1f-1fe3a9910bfc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-214614900", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "1b9ee265-bdab-4092-8071-c9bb95d911fb"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:24:19.731976 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-e111eab6-5d69-4f4b-aa1f-1fe3a9910bfc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] validate_networks() for [('1b9ee265-bdab-4092-8071-c9bb95d911fb', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:24:20.288445 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-e111eab6-5d69-4f4b-aa1f-1fe3a9910bfc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:24:20.293137 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-e111eab6-5d69-4f4b-aa1f-1fe3a9910bfc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:24:20.293865 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-e111eab6-5d69-4f4b-aa1f-1fe3a9910bfc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:24:20.294818 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-e111eab6-5d69-4f4b-aa1f-1fe3a9910bfc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:24:20.295826 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-e111eab6-5d69-4f4b-aa1f-1fe3a9910bfc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:24:20.330064 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e111eab6-5d69-4f4b-aa1f-1fe3a9910bfc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:20.331858 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e111eab6-5d69-4f4b-aa1f-1fe3a9910bfc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:20.335237 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e111eab6-5d69-4f4b-aa1f-1fe3a9910bfc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:20.337222 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e111eab6-5d69-4f4b-aa1f-1fe3a9910bfc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:20.362061 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-e111eab6-5d69-4f4b-aa1f-1fe3a9910bfc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Getting quotas for project d6dcd4e578e9420cb0aaa2dd0e43a280. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:24:20.368993 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-e111eab6-5d69-4f4b-aa1f-1fe3a9910bfc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Getting quotas for user 61eb0141ef744beeb2b9e1a6f25958fb and project d6dcd4e578e9420cb0aaa2dd0e43a280. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:24:20.388477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e111eab6-5d69-4f4b-aa1f-1fe3a9910bfc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:24:20.391034 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e111eab6-5d69-4f4b-aa1f-1fe3a9910bfc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:24:20.512828 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e111eab6-5d69-4f4b-aa1f-1fe3a9910bfc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.164844 Apr 16 21:24:20.527036 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2318/4444] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:24:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1180 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:24:20.540006 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-58c8f2b0-3ec7-4119-acd9-3354e31e9e5c req-9969421a-1ac8-4cb1-b370-def4e2f820c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b36f160b-012c-42fa-8884-2d4f22c5f304", "tag": "fd85026d-38d7-4dbb-a085-fa40b89df53f"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:24:20.559479 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-58c8f2b0-3ec7-4119-acd9-3354e31e9e5c req-9969421a-1ac8-4cb1-b370-def4e2f820c0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:20.560336 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-58c8f2b0-3ec7-4119-acd9-3354e31e9e5c req-9969421a-1ac8-4cb1-b370-def4e2f820c0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:20.610753 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-58c8f2b0-3ec7-4119-acd9-3354e31e9e5c req-9969421a-1ac8-4cb1-b370-def4e2f820c0 service nova] Creating event network-changed:fd85026d-38d7-4dbb-a085-fa40b89df53f for instance b36f160b-012c-42fa-8884-2d4f22c5f304 on nch2-master-1 Apr 16 21:24:20.628604 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-58c8f2b0-3ec7-4119-acd9-3354e31e9e5c req-9969421a-1ac8-4cb1-b370-def4e2f820c0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096810 Apr 16 21:24:20.632062 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2319/4445] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:24:20.657221 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-330cd18c-13d2-4907-86a2-6af37d7b1743 req-9027d7fd-3a37-43fd-a988-82e8ac74a924 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b015d8b-25ca-42b4-9080-9cc405ea1ad6", "name": "network-vif-plugged", "status": "completed", "tag": "48255b0b-bf96-40f8-a7f4-40c646be8a37"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:24:20.671351 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-330cd18c-13d2-4907-86a2-6af37d7b1743 req-9027d7fd-3a37-43fd-a988-82e8ac74a924 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:20.672004 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-330cd18c-13d2-4907-86a2-6af37d7b1743 req-9027d7fd-3a37-43fd-a988-82e8ac74a924 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:20.695242 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-330cd18c-13d2-4907-86a2-6af37d7b1743 req-9027d7fd-3a37-43fd-a988-82e8ac74a924 service nova] Creating event network-vif-plugged:48255b0b-bf96-40f8-a7f4-40c646be8a37 for instance 2b015d8b-25ca-42b4-9080-9cc405ea1ad6 on nch1-master-1 Apr 16 21:24:20.701886 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-330cd18c-13d2-4907-86a2-6af37d7b1743 req-9027d7fd-3a37-43fd-a988-82e8ac74a924 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067410 Apr 16 21:24:20.703086 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2320/4446] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:24:20.709435 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-73b60dfb-7bce-402b-8ac9-02ba7a73b640 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:20.711001 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-73b60dfb-7bce-402b-8ac9-02ba7a73b640 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 2b015d8b-25ca-42b4-9080-9cc405ea1ad6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:20.718502 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-73b60dfb-7bce-402b-8ac9-02ba7a73b640 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:20.718920 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-73b60dfb-7bce-402b-8ac9-02ba7a73b640 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:20.720163 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-73b60dfb-7bce-402b-8ac9-02ba7a73b640 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:20.720163 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-73b60dfb-7bce-402b-8ac9-02ba7a73b640 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:20.972463 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-73b60dfb-7bce-402b-8ac9-02ba7a73b640 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:20.998724 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-73b60dfb-7bce-402b-8ac9-02ba7a73b640 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/2b015d8b-25ca-42b4-9080-9cc405ea1ad6" status: 200 len: 1315 microversion: 2.1 time: 0.280444 Apr 16 21:24:20.998724 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2321/4447] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:20 2022] GET /compute/v2.1/servers/2b015d8b-25ca-42b4-9080-9cc405ea1ad6 => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:21.005349 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-38952422-0389-4648-93a0-74b15f1df5b6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:21.006298 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-38952422-0389-4648-93a0-74b15f1df5b6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:21.101403 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-38952422-0389-4648-93a0-74b15f1df5b6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:21.110959 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-38952422-0389-4648-93a0-74b15f1df5b6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1216 microversion: 2.1 time: 0.122123 Apr 16 21:24:21.124215 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2322/4448] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:20 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1216 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:21.923852 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2ff07cb6-de24-4c2c-8a22-c107e57ba73e tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.938311 Apr 16 21:24:21.924869 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2127/4449] 10.222.0.20 () {60 vars in 1169 bytes} [Sat Apr 16 21:24:18 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2941 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:24:21.938873 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c07ed13e-0ff2-411b-af05-6f01a5092434 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.35.1.152"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:24:21.951056 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c07ed13e-0ff2-411b-af05-6f01a5092434 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:21.966562 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c07ed13e-0ff2-411b-af05-6f01a5092434 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:21.967327 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c07ed13e-0ff2-411b-af05-6f01a5092434 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:21.968262 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c07ed13e-0ff2-411b-af05-6f01a5092434 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:21.968807 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c07ed13e-0ff2-411b-af05-6f01a5092434 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:21.996588 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c07ed13e-0ff2-411b-af05-6f01a5092434 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Acquired lock "refresh_cache-b36f160b-012c-42fa-8884-2d4f22c5f304" {{(pid=137408) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 16 21:24:22.007465 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3c1a2eee-f2c1-4e13-9911-df9e00d87c45 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:22.012647 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3c1a2eee-f2c1-4e13-9911-df9e00d87c45 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 2b015d8b-25ca-42b4-9080-9cc405ea1ad6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:22.015923 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3c1a2eee-f2c1-4e13-9911-df9e00d87c45 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:22.016637 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3c1a2eee-f2c1-4e13-9911-df9e00d87c45 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:22.018157 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3c1a2eee-f2c1-4e13-9911-df9e00d87c45 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:22.018838 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3c1a2eee-f2c1-4e13-9911-df9e00d87c45 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:22.273882 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3c1a2eee-f2c1-4e13-9911-df9e00d87c45 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:22.287855 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3c1a2eee-f2c1-4e13-9911-df9e00d87c45 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/2b015d8b-25ca-42b4-9080-9cc405ea1ad6" status: 200 len: 1315 microversion: 2.1 time: 0.286111 Apr 16 21:24:22.290958 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2128/4450] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:22 2022] GET /compute/v2.1/servers/2b015d8b-25ca-42b4-9080-9cc405ea1ad6 => generated 1315 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:22.306124 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-16f18848-a740-4737-b473-8fb7f80cc899 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:22.306124 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-16f18848-a740-4737-b473-8fb7f80cc899 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:22.313834 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-16f18848-a740-4737-b473-8fb7f80cc899 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:22.314542 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-16f18848-a740-4737-b473-8fb7f80cc899 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:22.315478 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-16f18848-a740-4737-b473-8fb7f80cc899 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:22.315917 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-16f18848-a740-4737-b473-8fb7f80cc899 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:22.401092 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-16f18848-a740-4737-b473-8fb7f80cc899 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:22.409527 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-16f18848-a740-4737-b473-8fb7f80cc899 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1220 microversion: 2.1 time: 0.117200 Apr 16 21:24:22.410422 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2129/4451] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:22 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1220 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:23.314565 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-aa8ae594-a51a-467c-8e39-15e4b320718c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:23.315282 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-aa8ae594-a51a-467c-8e39-15e4b320718c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 2b015d8b-25ca-42b4-9080-9cc405ea1ad6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:23.322658 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aa8ae594-a51a-467c-8e39-15e4b320718c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:23.323378 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aa8ae594-a51a-467c-8e39-15e4b320718c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:23.324363 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aa8ae594-a51a-467c-8e39-15e4b320718c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:23.325088 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aa8ae594-a51a-467c-8e39-15e4b320718c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:23.511350 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-aa8ae594-a51a-467c-8e39-15e4b320718c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:23.527657 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-aa8ae594-a51a-467c-8e39-15e4b320718c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/2b015d8b-25ca-42b4-9080-9cc405ea1ad6" status: 200 len: 1501 microversion: 2.1 time: 0.216850 Apr 16 21:24:23.529166 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2130/4452] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:23 2022] GET /compute/v2.1/servers/2b015d8b-25ca-42b4-9080-9cc405ea1ad6 => generated 1501 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:24:23.534003 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f04a7fdb-717f-4939-9b9f-d8b0fed022f0 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:23.534840 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f04a7fdb-717f-4939-9b9f-d8b0fed022f0 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:23.543284 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f04a7fdb-717f-4939-9b9f-d8b0fed022f0 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:23.544022 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f04a7fdb-717f-4939-9b9f-d8b0fed022f0 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:23.545189 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f04a7fdb-717f-4939-9b9f-d8b0fed022f0 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:23.545790 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f04a7fdb-717f-4939-9b9f-d8b0fed022f0 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:23.659411 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f04a7fdb-717f-4939-9b9f-d8b0fed022f0 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:23.677957 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f04a7fdb-717f-4939-9b9f-d8b0fed022f0 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1276 microversion: 2.1 time: 0.147531 Apr 16 21:24:23.681969 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2131/4453] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:23 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1276 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:23.701240 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f34c6a7f-f8d4-4e79-9392-4ef9e060b818 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:24:23.703017 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f34c6a7f-f8d4-4e79-9392-4ef9e060b818 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 2b015d8b-25ca-42b4-9080-9cc405ea1ad6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:23.713601 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f34c6a7f-f8d4-4e79-9392-4ef9e060b818 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:23.714370 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f34c6a7f-f8d4-4e79-9392-4ef9e060b818 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:23.715395 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f34c6a7f-f8d4-4e79-9392-4ef9e060b818 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:23.716015 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f34c6a7f-f8d4-4e79-9392-4ef9e060b818 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:24.030348 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f34c6a7f-f8d4-4e79-9392-4ef9e060b818 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "POST /compute/v2.1/servers/2b015d8b-25ca-42b4-9080-9cc405ea1ad6/action" status: 202 len: 0 microversion: 2.1 time: 0.343648 Apr 16 21:24:24.031373 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2132/4454] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:24:23 2022] POST /compute/v2.1/servers/2b015d8b-25ca-42b4-9080-9cc405ea1ad6/action => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:24:24.040706 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0b0e9640-c35c-4fd3-9336-db01a7a22ed3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:24.042577 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0b0e9640-c35c-4fd3-9336-db01a7a22ed3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 2b015d8b-25ca-42b4-9080-9cc405ea1ad6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:24.050302 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0b0e9640-c35c-4fd3-9336-db01a7a22ed3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:24.050778 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0b0e9640-c35c-4fd3-9336-db01a7a22ed3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:24.052665 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0b0e9640-c35c-4fd3-9336-db01a7a22ed3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:24.053169 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0b0e9640-c35c-4fd3-9336-db01a7a22ed3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:24.416252 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0b0e9640-c35c-4fd3-9336-db01a7a22ed3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:24.427197 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0b0e9640-c35c-4fd3-9336-db01a7a22ed3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/2b015d8b-25ca-42b4-9080-9cc405ea1ad6" status: 200 len: 1506 microversion: 2.1 time: 0.391505 Apr 16 21:24:24.437463 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2133/4455] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:24 2022] GET /compute/v2.1/servers/2b015d8b-25ca-42b4-9080-9cc405ea1ad6 => generated 1506 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:24.699606 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-89d009b5-8fb7-409a-9d52-554ec543cab6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:24.701369 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-89d009b5-8fb7-409a-9d52-554ec543cab6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:24.709382 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-89d009b5-8fb7-409a-9d52-554ec543cab6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:24.710109 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-89d009b5-8fb7-409a-9d52-554ec543cab6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:24.710903 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-89d009b5-8fb7-409a-9d52-554ec543cab6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:24.711348 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-89d009b5-8fb7-409a-9d52-554ec543cab6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:24.950413 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-89d009b5-8fb7-409a-9d52-554ec543cab6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:24.959848 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-c07ed13e-0ff2-411b-af05-6f01a5092434 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Building network info cache for instance {{(pid=137408) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Apr 16 21:24:24.971296 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-89d009b5-8fb7-409a-9d52-554ec543cab6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1316 microversion: 2.1 time: 0.276175 Apr 16 21:24:24.972430 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2134/4456] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:24 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1316 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:24:24.977142 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-631218ce-1fca-47b3-8edb-c44ed4ab3dbd req-aa863939-7643-44f8-972b-7ee5a875d812 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b36f160b-012c-42fa-8884-2d4f22c5f304", "tag": "fd85026d-38d7-4dbb-a085-fa40b89df53f"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:24:24.985466 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-631218ce-1fca-47b3-8edb-c44ed4ab3dbd req-aa863939-7643-44f8-972b-7ee5a875d812 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:24.988221 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-631218ce-1fca-47b3-8edb-c44ed4ab3dbd req-aa863939-7643-44f8-972b-7ee5a875d812 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:25.002123 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-631218ce-1fca-47b3-8edb-c44ed4ab3dbd req-aa863939-7643-44f8-972b-7ee5a875d812 service nova] Creating event network-changed:fd85026d-38d7-4dbb-a085-fa40b89df53f for instance b36f160b-012c-42fa-8884-2d4f22c5f304 on nch2-master-1 Apr 16 21:24:25.012980 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-631218ce-1fca-47b3-8edb-c44ed4ab3dbd req-aa863939-7643-44f8-972b-7ee5a875d812 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035465 Apr 16 21:24:25.014845 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2135/4457] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:24:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:24:25.451384 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-50bc9df2-11e1-4cb8-81e8-4cb36f685181 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:25.452860 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-50bc9df2-11e1-4cb8-81e8-4cb36f685181 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 2b015d8b-25ca-42b4-9080-9cc405ea1ad6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:25.464350 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-50bc9df2-11e1-4cb8-81e8-4cb36f685181 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:25.470126 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-50bc9df2-11e1-4cb8-81e8-4cb36f685181 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:25.473038 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-50bc9df2-11e1-4cb8-81e8-4cb36f685181 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:25.475799 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-50bc9df2-11e1-4cb8-81e8-4cb36f685181 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:25.794279 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-50bc9df2-11e1-4cb8-81e8-4cb36f685181 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:25.802285 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-50bc9df2-11e1-4cb8-81e8-4cb36f685181 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/2b015d8b-25ca-42b4-9080-9cc405ea1ad6" status: 200 len: 1486 microversion: 2.1 time: 0.355128 Apr 16 21:24:25.805157 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2136/4458] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:25 2022] GET /compute/v2.1/servers/2b015d8b-25ca-42b4-9080-9cc405ea1ad6 => generated 1486 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:25.823215 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-567e5527-b3d7-4de5-a961-4a9a18e0faae tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:25.829810 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-567e5527-b3d7-4de5-a961-4a9a18e0faae tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 2b015d8b-25ca-42b4-9080-9cc405ea1ad6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:25.836341 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-567e5527-b3d7-4de5-a961-4a9a18e0faae tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:25.837052 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-567e5527-b3d7-4de5-a961-4a9a18e0faae tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:25.838063 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-567e5527-b3d7-4de5-a961-4a9a18e0faae tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:25.838542 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-567e5527-b3d7-4de5-a961-4a9a18e0faae tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:25.893377 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-567e5527-b3d7-4de5-a961-4a9a18e0faae tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 2b015d8b-25ca-42b4-9080-9cc405ea1ad6] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:24:26.292522 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-567e5527-b3d7-4de5-a961-4a9a18e0faae tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2b015d8b-25ca-42b4-9080-9cc405ea1ad6" status: 204 len: 0 microversion: 2.1 time: 0.472026 Apr 16 21:24:26.293563 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2137/4459] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:24:25 2022] DELETE /compute/v2.1/servers/2b015d8b-25ca-42b4-9080-9cc405ea1ad6 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:24:26.306933 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f27092fe-b65c-499f-bdb8-25c7b762aa1e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:26.308302 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f27092fe-b65c-499f-bdb8-25c7b762aa1e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:26.325686 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f27092fe-b65c-499f-bdb8-25c7b762aa1e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:26.331631 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f27092fe-b65c-499f-bdb8-25c7b762aa1e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:26.331631 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f27092fe-b65c-499f-bdb8-25c7b762aa1e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:26.331631 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f27092fe-b65c-499f-bdb8-25c7b762aa1e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:26.620733 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-c07ed13e-0ff2-411b-af05-6f01a5092434 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Updating instance_info_cache with network_info: [{"id": "fd85026d-38d7-4dbb-a085-fa40b89df53f", "address": "fa:16:3e:0b:dd:2d", "network": {"id": "e30659b1-756c-4ef0-9573-8335ff004f46", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1086231345-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.35.1.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d5096c21fbfe41dd80379e0e3b6fb8d5", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapfd85026d-38", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137408) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Apr 16 21:24:26.726587 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c07ed13e-0ff2-411b-af05-6f01a5092434 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Releasing lock "refresh_cache-b36f160b-012c-42fa-8884-2d4f22c5f304" {{(pid=137408) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 16 21:24:26.727749 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c07ed13e-0ff2-411b-af05-6f01a5092434 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "POST /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304/action" status: 202 len: 0 microversion: 2.1 time: 4.795576 Apr 16 21:24:26.728961 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2323/4460] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:24:21 2022] POST /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304/action => generated 0 bytes in 4797 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Apr 16 21:24:26.735345 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9ec7ad31-b6fe-4cce-8c26-7775b91d2741 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:26.743513 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9ec7ad31-b6fe-4cce-8c26-7775b91d2741 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 2b015d8b-25ca-42b4-9080-9cc405ea1ad6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:26.752297 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f27092fe-b65c-499f-bdb8-25c7b762aa1e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:26.761493 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f27092fe-b65c-499f-bdb8-25c7b762aa1e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1316 microversion: 2.1 time: 0.464218 Apr 16 21:24:26.767095 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2138/4461] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:26 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1316 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:26.776370 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9ec7ad31-b6fe-4cce-8c26-7775b91d2741 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:26.777032 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9ec7ad31-b6fe-4cce-8c26-7775b91d2741 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:26.777856 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9ec7ad31-b6fe-4cce-8c26-7775b91d2741 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:26.778312 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9ec7ad31-b6fe-4cce-8c26-7775b91d2741 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:26.793516 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c8564b24-fe8b-475b-af5b-b0ba3531ac96 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.35.1.152"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:24:27.175356 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c8564b24-fe8b-475b-af5b-b0ba3531ac96 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:27.191070 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c8564b24-fe8b-475b-af5b-b0ba3531ac96 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:27.192127 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c8564b24-fe8b-475b-af5b-b0ba3531ac96 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:27.198361 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c8564b24-fe8b-475b-af5b-b0ba3531ac96 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:27.199109 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c8564b24-fe8b-475b-af5b-b0ba3531ac96 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:27.387765 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9ec7ad31-b6fe-4cce-8c26-7775b91d2741 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:27.396718 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9ec7ad31-b6fe-4cce-8c26-7775b91d2741 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/2b015d8b-25ca-42b4-9080-9cc405ea1ad6" status: 200 len: 1492 microversion: 2.1 time: 0.666249 Apr 16 21:24:27.398857 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2324/4462] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:26 2022] GET /compute/v2.1/servers/2b015d8b-25ca-42b4-9080-9cc405ea1ad6 => generated 1492 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:27.411982 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-53959d27-e717-48cc-9165-d38388934a7f req-12b2d306-8896-4b63-ad6b-48d26c6fdddf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daf189e2-7cb4-4dab-94cf-ffdceb314df7", "tag": "29f0877d-908a-47df-aa37-d5dcea212e40"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:24:27.432321 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-53959d27-e717-48cc-9165-d38388934a7f req-12b2d306-8896-4b63-ad6b-48d26c6fdddf service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:27.433066 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-53959d27-e717-48cc-9165-d38388934a7f req-12b2d306-8896-4b63-ad6b-48d26c6fdddf service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:27.449271 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-53959d27-e717-48cc-9165-d38388934a7f req-12b2d306-8896-4b63-ad6b-48d26c6fdddf service nova] Creating event network-changed:29f0877d-908a-47df-aa37-d5dcea212e40 for instance daf189e2-7cb4-4dab-94cf-ffdceb314df7 on nch2-master-1 Apr 16 21:24:27.455066 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-53959d27-e717-48cc-9165-d38388934a7f req-12b2d306-8896-4b63-ad6b-48d26c6fdddf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054801 Apr 16 21:24:27.456009 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2325/4463] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:24:27.732307 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c8564b24-fe8b-475b-af5b-b0ba3531ac96 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Acquired lock "refresh_cache-b36f160b-012c-42fa-8884-2d4f22c5f304" {{(pid=137409) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 16 21:24:27.783812 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9ffe4a16-e70a-4cca-89dc-046dbdd68a59 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:27.785325 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9ffe4a16-e70a-4cca-89dc-046dbdd68a59 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:27.810003 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9ffe4a16-e70a-4cca-89dc-046dbdd68a59 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:27.811059 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9ffe4a16-e70a-4cca-89dc-046dbdd68a59 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:27.812213 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9ffe4a16-e70a-4cca-89dc-046dbdd68a59 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:27.812832 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9ffe4a16-e70a-4cca-89dc-046dbdd68a59 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:28.239329 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9ffe4a16-e70a-4cca-89dc-046dbdd68a59 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:28.249337 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9ffe4a16-e70a-4cca-89dc-046dbdd68a59 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1316 microversion: 2.1 time: 0.469739 Apr 16 21:24:28.251655 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2326/4464] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:27 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1316 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:28.414266 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e77e6e5d-fc62-46df-af56-67be94862911 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:28.414878 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e77e6e5d-fc62-46df-af56-67be94862911 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 2b015d8b-25ca-42b4-9080-9cc405ea1ad6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:28.421954 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e77e6e5d-fc62-46df-af56-67be94862911 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:28.422407 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e77e6e5d-fc62-46df-af56-67be94862911 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:28.423210 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e77e6e5d-fc62-46df-af56-67be94862911 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:28.423659 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e77e6e5d-fc62-46df-af56-67be94862911 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:28.677833 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e77e6e5d-fc62-46df-af56-67be94862911 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:28.686311 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e77e6e5d-fc62-46df-af56-67be94862911 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/2b015d8b-25ca-42b4-9080-9cc405ea1ad6" status: 200 len: 1492 microversion: 2.1 time: 0.276468 Apr 16 21:24:28.691386 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2327/4465] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:28 2022] GET /compute/v2.1/servers/2b015d8b-25ca-42b4-9080-9cc405ea1ad6 => generated 1492 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:24:29.272308 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-10732c39-e308-4b09-9cde-9dc1004d8871 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:29.274641 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-10732c39-e308-4b09-9cde-9dc1004d8871 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:29.288847 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-10732c39-e308-4b09-9cde-9dc1004d8871 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:29.290117 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-10732c39-e308-4b09-9cde-9dc1004d8871 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:29.292019 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-10732c39-e308-4b09-9cde-9dc1004d8871 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:29.292731 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-10732c39-e308-4b09-9cde-9dc1004d8871 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:29.330255 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-c8564b24-fe8b-475b-af5b-b0ba3531ac96 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Building network info cache for instance {{(pid=137409) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}} Apr 16 21:24:29.695972 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-10732c39-e308-4b09-9cde-9dc1004d8871 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:29.711197 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-10732c39-e308-4b09-9cde-9dc1004d8871 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1316 microversion: 2.1 time: 0.444604 Apr 16 21:24:29.735452 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2328/4466] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:29 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1316 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:29.741908 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-527895c3-e075-4e9c-886a-6abc441f9d4b req-df8f2bc6-0042-4323-b1bc-b3dd48fd5192 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b015d8b-25ca-42b4-9080-9cc405ea1ad6", "name": "network-vif-deleted", "tag": "48255b0b-bf96-40f8-a7f4-40c646be8a37"}, {"name": "network-changed", "server_uuid": "b36f160b-012c-42fa-8884-2d4f22c5f304", "tag": "fd85026d-38d7-4dbb-a085-fa40b89df53f"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:24:29.754968 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-527895c3-e075-4e9c-886a-6abc441f9d4b req-df8f2bc6-0042-4323-b1bc-b3dd48fd5192 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:29.755928 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-527895c3-e075-4e9c-886a-6abc441f9d4b req-df8f2bc6-0042-4323-b1bc-b3dd48fd5192 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:29.790485 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-527895c3-e075-4e9c-886a-6abc441f9d4b req-df8f2bc6-0042-4323-b1bc-b3dd48fd5192 service nova] Creating event network-vif-deleted:48255b0b-bf96-40f8-a7f4-40c646be8a37 for instance 2b015d8b-25ca-42b4-9080-9cc405ea1ad6 on nch1-master-1 Apr 16 21:24:29.791674 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-527895c3-e075-4e9c-886a-6abc441f9d4b req-df8f2bc6-0042-4323-b1bc-b3dd48fd5192 service nova] Creating event network-changed:fd85026d-38d7-4dbb-a085-fa40b89df53f for instance b36f160b-012c-42fa-8884-2d4f22c5f304 on nch2-master-1 Apr 16 21:24:29.803529 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-527895c3-e075-4e9c-886a-6abc441f9d4b req-df8f2bc6-0042-4323-b1bc-b3dd48fd5192 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.065617 Apr 16 21:24:29.804963 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2329/4467] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:24:29.826048 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-784c3c90-b51a-49fa-b50a-b7d5c2552e6f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:29.827293 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-784c3c90-b51a-49fa-b50a-b7d5c2552e6f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 2b015d8b-25ca-42b4-9080-9cc405ea1ad6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:29.839154 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-784c3c90-b51a-49fa-b50a-b7d5c2552e6f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:29.840972 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-784c3c90-b51a-49fa-b50a-b7d5c2552e6f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:29.842937 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-784c3c90-b51a-49fa-b50a-b7d5c2552e6f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:29.843578 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-784c3c90-b51a-49fa-b50a-b7d5c2552e6f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:29.929663 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-784c3c90-b51a-49fa-b50a-b7d5c2552e6f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:29.930178 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-784c3c90-b51a-49fa-b50a-b7d5c2552e6f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:29.931040 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-784c3c90-b51a-49fa-b50a-b7d5c2552e6f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lazy-loading 'fault' on Instance uuid 2b015d8b-25ca-42b4-9080-9cc405ea1ad6 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:24:30.041477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-784c3c90-b51a-49fa-b50a-b7d5c2552e6f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:30.067105 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-784c3c90-b51a-49fa-b50a-b7d5c2552e6f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/2b015d8b-25ca-42b4-9080-9cc405ea1ad6" status: 200 len: 1305 microversion: 2.1 time: 0.260192 Apr 16 21:24:30.081360 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2330/4468] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:29 2022] GET /compute/v2.1/servers/2b015d8b-25ca-42b4-9080-9cc405ea1ad6 => generated 1305 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:30.624614 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-c8564b24-fe8b-475b-af5b-b0ba3531ac96 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Updating instance_info_cache with network_info: [{"id": "fd85026d-38d7-4dbb-a085-fa40b89df53f", "address": "fa:16:3e:0b:dd:2d", "network": {"id": "e30659b1-756c-4ef0-9573-8335ff004f46", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-1086231345-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "d5096c21fbfe41dd80379e0e3b6fb8d5", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapfd85026d-38", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=137409) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Apr 16 21:24:30.720576 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c8564b24-fe8b-475b-af5b-b0ba3531ac96 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Releasing lock "refresh_cache-b36f160b-012c-42fa-8884-2d4f22c5f304" {{(pid=137409) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 16 21:24:30.721387 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c8564b24-fe8b-475b-af5b-b0ba3531ac96 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "POST /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304/action" status: 202 len: 0 microversion: 2.1 time: 3.950839 Apr 16 21:24:30.722065 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2139/4469] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:24:26 2022] POST /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304/action => generated 0 bytes in 3954 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Apr 16 21:24:30.735039 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-015832f0-928f-416c-a638-933ef18ebaec tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:30.735827 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-015832f0-928f-416c-a638-933ef18ebaec tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:30.743354 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ca712e31-8b1e-4590-a994-dd33e5d5af80 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Calling method '.version_select at 0x7fbb95671280>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:30.757358 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-015832f0-928f-416c-a638-933ef18ebaec tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:30.757833 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-015832f0-928f-416c-a638-933ef18ebaec tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:30.758654 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-015832f0-928f-416c-a638-933ef18ebaec tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:30.765801 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-015832f0-928f-416c-a638-933ef18ebaec tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:31.225047 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-015832f0-928f-416c-a638-933ef18ebaec tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:31.234544 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-015832f0-928f-416c-a638-933ef18ebaec tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1316 microversion: 2.1 time: 0.508631 Apr 16 21:24:31.238946 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2331/4470] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:30 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1316 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:31.249538 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0534c19f-bd1a-429c-b18b-9f4973c2a7b4 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:31.251350 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0534c19f-bd1a-429c-b18b-9f4973c2a7b4 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 2b015d8b-25ca-42b4-9080-9cc405ea1ad6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:31.267900 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0534c19f-bd1a-429c-b18b-9f4973c2a7b4 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:31.268637 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0534c19f-bd1a-429c-b18b-9f4973c2a7b4 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:31.269646 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0534c19f-bd1a-429c-b18b-9f4973c2a7b4 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:31.270808 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0534c19f-bd1a-429c-b18b-9f4973c2a7b4 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:31.303641 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-0534c19f-bd1a-429c-b18b-9f4973c2a7b4 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] HTTP exception thrown: Instance 2b015d8b-25ca-42b4-9080-9cc405ea1ad6 could not be found. Apr 16 21:24:31.305444 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0534c19f-bd1a-429c-b18b-9f4973c2a7b4 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Returning 404 to user: Instance 2b015d8b-25ca-42b4-9080-9cc405ea1ad6 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:24:31.307684 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0534c19f-bd1a-429c-b18b-9f4973c2a7b4 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/2b015d8b-25ca-42b4-9080-9cc405ea1ad6" status: 404 len: 111 microversion: 2.1 time: 0.066459 Apr 16 21:24:31.309991 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2332/4471] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:31 2022] GET /compute/v2.1/servers/2b015d8b-25ca-42b4-9080-9cc405ea1ad6 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:24:31.460043 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-18a78d5c-cb66-48a5-965b-19a5f1fbc63c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-377186366", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "5fb5cf29-8796-41a2-8375-e8062a5911ad"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:24:31.563258 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-18a78d5c-cb66-48a5-965b-19a5f1fbc63c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] validate_networks() for [('5fb5cf29-8796-41a2-8375-e8062a5911ad', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:24:32.350315 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-18a78d5c-cb66-48a5-965b-19a5f1fbc63c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:24:32.352309 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-18a78d5c-cb66-48a5-965b-19a5f1fbc63c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:24:32.355372 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-18a78d5c-cb66-48a5-965b-19a5f1fbc63c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:24:32.355372 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-18a78d5c-cb66-48a5-965b-19a5f1fbc63c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:24:32.355372 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-18a78d5c-cb66-48a5-965b-19a5f1fbc63c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:24:32.364542 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-18a78d5c-cb66-48a5-965b-19a5f1fbc63c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:32.365254 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-18a78d5c-cb66-48a5-965b-19a5f1fbc63c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:32.366404 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-18a78d5c-cb66-48a5-965b-19a5f1fbc63c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:32.367021 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-18a78d5c-cb66-48a5-965b-19a5f1fbc63c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:32.387238 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-18a78d5c-cb66-48a5-965b-19a5f1fbc63c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Getting quotas for project 7caf6e59a47149a68cae6224fb2856e7. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:24:32.394276 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-18a78d5c-cb66-48a5-965b-19a5f1fbc63c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Getting quotas for user e069f136dcb344b197f58ba47722f4d5 and project 7caf6e59a47149a68cae6224fb2856e7. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:24:32.404343 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ca712e31-8b1e-4590-a994-dd33e5d5af80 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "DELETE /compute/v2.1/os-floating-ips/2488829b-5207-4eda-8c27-3e107d8b9d8e" status: 202 len: 0 microversion: 2.1 time: 1.672981 Apr 16 21:24:32.405263 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2140/4472] 10.222.0.20 () {58 vars in 1262 bytes} [Sat Apr 16 21:24:30 2022] DELETE /compute/v2.1/os-floating-ips/2488829b-5207-4eda-8c27-3e107d8b9d8e => generated 0 bytes in 1674 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:24:32.411248 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-af1b0cec-0916-4063-9157-28e0febc1539 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:32.412987 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-af1b0cec-0916-4063-9157-28e0febc1539 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:32.420659 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-af1b0cec-0916-4063-9157-28e0febc1539 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:32.421371 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-af1b0cec-0916-4063-9157-28e0febc1539 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:32.422188 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-18a78d5c-cb66-48a5-965b-19a5f1fbc63c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:24:32.422725 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-af1b0cec-0916-4063-9157-28e0febc1539 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:32.423383 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-af1b0cec-0916-4063-9157-28e0febc1539 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:32.425160 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-18a78d5c-cb66-48a5-965b-19a5f1fbc63c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:24:32.561964 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-18a78d5c-cb66-48a5-965b-19a5f1fbc63c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.108018 Apr 16 21:24:32.563605 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2333/4473] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:24:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1111 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 16 21:24:32.570068 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5091bf8f-ac90-4390-af88-cd582c4217c6 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Calling method '.version_select at 0x7fbb95c2fd30>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:32.571205 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-af1b0cec-0916-4063-9157-28e0febc1539 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:32.578776 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-af1b0cec-0916-4063-9157-28e0febc1539 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1316 microversion: 2.1 time: 0.172336 Apr 16 21:24:32.579486 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2141/4474] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:32 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1316 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:32.597104 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-71d6a5a7-7ffc-4401-80a5-9064faf8f794 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:32.597727 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-71d6a5a7-7ffc-4401-80a5-9064faf8f794 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:32.655909 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-71d6a5a7-7ffc-4401-80a5-9064faf8f794 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:32.663844 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-71d6a5a7-7ffc-4401-80a5-9064faf8f794 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1214 microversion: 2.1 time: 0.083263 Apr 16 21:24:32.664590 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2142/4475] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:32 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:32.866257 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5091bf8f-ac90-4390-af88-cd582c4217c6 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "DELETE /compute/v2.1/os-security-groups/26968c5b-9466-4121-a076-5601408b759c" status: 202 len: 0 microversion: 2.1 time: 0.299419 Apr 16 21:24:32.866257 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2334/4476] 10.222.0.20 () {58 vars in 1271 bytes} [Sat Apr 16 21:24:32 2022] DELETE /compute/v2.1/os-security-groups/26968c5b-9466-4121-a076-5601408b759c => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:24:32.874138 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1bc276ea-1256-4e0f-b650-5458130db890 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:32.874662 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1bc276ea-1256-4e0f-b650-5458130db890 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:32.880780 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1bc276ea-1256-4e0f-b650-5458130db890 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:32.881256 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1bc276ea-1256-4e0f-b650-5458130db890 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:32.882014 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1bc276ea-1256-4e0f-b650-5458130db890 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:32.882448 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1bc276ea-1256-4e0f-b650-5458130db890 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:32.912578 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1bc276ea-1256-4e0f-b650-5458130db890 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:24:33.330745 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1bc276ea-1256-4e0f-b650-5458130db890 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304" status: 204 len: 0 microversion: 2.1 time: 0.460628 Apr 16 21:24:33.331670 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2143/4477] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:24:32 2022] DELETE /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:24:33.341716 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7bdce5c1-a73f-48a9-a46b-b0db16541c20 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:33.342445 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7bdce5c1-a73f-48a9-a46b-b0db16541c20 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:33.354731 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7bdce5c1-a73f-48a9-a46b-b0db16541c20 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:33.355895 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7bdce5c1-a73f-48a9-a46b-b0db16541c20 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:33.357035 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7bdce5c1-a73f-48a9-a46b-b0db16541c20 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:33.357713 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7bdce5c1-a73f-48a9-a46b-b0db16541c20 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:33.511890 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7bdce5c1-a73f-48a9-a46b-b0db16541c20 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc8a2da85ec46948b5bc30ed7a363bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5096c21fbfe41dd80379e0e3b6fb8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:33.520843 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7bdce5c1-a73f-48a9-a46b-b0db16541c20 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304" status: 200 len: 1509 microversion: 2.1 time: 0.183738 Apr 16 21:24:33.521417 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2335/4478] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:33 2022] GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304 => generated 1509 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:33.595588 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8f02c78e-d51f-4d2c-9c8e-be1e3052de56 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:33.596331 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8f02c78e-d51f-4d2c-9c8e-be1e3052de56 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:33.603312 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8f02c78e-d51f-4d2c-9c8e-be1e3052de56 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:33.603776 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8f02c78e-d51f-4d2c-9c8e-be1e3052de56 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:33.604689 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8f02c78e-d51f-4d2c-9c8e-be1e3052de56 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:33.605131 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8f02c78e-d51f-4d2c-9c8e-be1e3052de56 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:33.694212 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f2a07c06-dc10-4fe4-bb5a-03c90b4a7af5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:33.694789 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f2a07c06-dc10-4fe4-bb5a-03c90b4a7af5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:33.752659 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f2a07c06-dc10-4fe4-bb5a-03c90b4a7af5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:33.760144 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f2a07c06-dc10-4fe4-bb5a-03c90b4a7af5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1214 microversion: 2.1 time: 0.082577 Apr 16 21:24:33.760742 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2336/4479] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:33 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:33.765752 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8f02c78e-d51f-4d2c-9c8e-be1e3052de56 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:33.774050 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8f02c78e-d51f-4d2c-9c8e-be1e3052de56 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1316 microversion: 2.1 time: 0.182772 Apr 16 21:24:33.774634 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2144/4480] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:33 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1316 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:24:34.538754 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-de3a3bc8-c0cf-45d9-9587-9fec33ab5d36 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:34.539367 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-de3a3bc8-c0cf-45d9-9587-9fec33ab5d36 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:34.547780 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-de3a3bc8-c0cf-45d9-9587-9fec33ab5d36 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:34.548270 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-de3a3bc8-c0cf-45d9-9587-9fec33ab5d36 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:34.549060 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-de3a3bc8-c0cf-45d9-9587-9fec33ab5d36 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:34.549625 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-de3a3bc8-c0cf-45d9-9587-9fec33ab5d36 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:34.695490 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-de3a3bc8-c0cf-45d9-9587-9fec33ab5d36 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc8a2da85ec46948b5bc30ed7a363bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5096c21fbfe41dd80379e0e3b6fb8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:34.703313 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-de3a3bc8-c0cf-45d9-9587-9fec33ab5d36 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304" status: 200 len: 1509 microversion: 2.1 time: 0.168527 Apr 16 21:24:34.703937 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2337/4481] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:34 2022] GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304 => generated 1509 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:34.777409 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c33eb04a-13de-4d8c-9559-61ffb1c243b4 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:34.778075 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c33eb04a-13de-4d8c-9559-61ffb1c243b4 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:34.784745 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c33eb04a-13de-4d8c-9559-61ffb1c243b4 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:34.785202 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c33eb04a-13de-4d8c-9559-61ffb1c243b4 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:34.786336 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c33eb04a-13de-4d8c-9559-61ffb1c243b4 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:34.786780 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c33eb04a-13de-4d8c-9559-61ffb1c243b4 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:34.791087 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-125b470c-8277-4531-a02c-53b1931a2435 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:34.791920 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-125b470c-8277-4531-a02c-53b1931a2435 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:34.798860 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-125b470c-8277-4531-a02c-53b1931a2435 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:34.799328 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-125b470c-8277-4531-a02c-53b1931a2435 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:34.800144 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-125b470c-8277-4531-a02c-53b1931a2435 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:34.800616 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-125b470c-8277-4531-a02c-53b1931a2435 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:34.857284 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c33eb04a-13de-4d8c-9559-61ffb1c243b4 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:34.871815 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c33eb04a-13de-4d8c-9559-61ffb1c243b4 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1266 microversion: 2.1 time: 0.093545 Apr 16 21:24:34.883392 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2145/4482] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:34 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1266 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:34.960489 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-125b470c-8277-4531-a02c-53b1931a2435 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:34.968060 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-125b470c-8277-4531-a02c-53b1931a2435 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1316 microversion: 2.1 time: 0.180901 Apr 16 21:24:34.968675 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2338/4483] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:34 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1316 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:24:35.541333 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-cfc36c1e-cda4-4a0e-8161-55d12e709f25 req-2b1447a3-49e3-4830-8fc2-9ec3183fbdc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daf189e2-7cb4-4dab-94cf-ffdceb314df7", "name": "network-vif-plugged", "status": "completed", "tag": "29f0877d-908a-47df-aa37-d5dcea212e40"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:24:35.550392 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-cfc36c1e-cda4-4a0e-8161-55d12e709f25 req-2b1447a3-49e3-4830-8fc2-9ec3183fbdc4 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:35.550988 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-cfc36c1e-cda4-4a0e-8161-55d12e709f25 req-2b1447a3-49e3-4830-8fc2-9ec3183fbdc4 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:35.563409 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-cfc36c1e-cda4-4a0e-8161-55d12e709f25 req-2b1447a3-49e3-4830-8fc2-9ec3183fbdc4 service nova] Creating event network-vif-plugged:29f0877d-908a-47df-aa37-d5dcea212e40 for instance daf189e2-7cb4-4dab-94cf-ffdceb314df7 on nch2-master-1 Apr 16 21:24:35.568703 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-cfc36c1e-cda4-4a0e-8161-55d12e709f25 req-2b1447a3-49e3-4830-8fc2-9ec3183fbdc4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031856 Apr 16 21:24:35.569836 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2146/4484] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:24:35.727059 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3dd74d9c-f57b-431a-8ac3-e94fe5d29041 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:35.727736 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3dd74d9c-f57b-431a-8ac3-e94fe5d29041 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:35.734497 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3dd74d9c-f57b-431a-8ac3-e94fe5d29041 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:35.734956 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3dd74d9c-f57b-431a-8ac3-e94fe5d29041 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:35.735751 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3dd74d9c-f57b-431a-8ac3-e94fe5d29041 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:35.736233 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3dd74d9c-f57b-431a-8ac3-e94fe5d29041 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:35.891247 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f660d093-3a52-438d-9b2f-8b4a361b750d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:35.891913 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f660d093-3a52-438d-9b2f-8b4a361b750d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:35.905501 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f660d093-3a52-438d-9b2f-8b4a361b750d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:35.906316 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f660d093-3a52-438d-9b2f-8b4a361b750d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:35.907371 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f660d093-3a52-438d-9b2f-8b4a361b750d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:35.908036 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f660d093-3a52-438d-9b2f-8b4a361b750d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:35.916596 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3dd74d9c-f57b-431a-8ac3-e94fe5d29041 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc8a2da85ec46948b5bc30ed7a363bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5096c21fbfe41dd80379e0e3b6fb8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:35.925823 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3dd74d9c-f57b-431a-8ac3-e94fe5d29041 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304" status: 200 len: 1509 microversion: 2.1 time: 0.209494 Apr 16 21:24:35.926949 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2339/4485] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:35 2022] GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304 => generated 1509 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:35.932141 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-92531557-518a-4330-a954-7c6e7e8089ea tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:35.932825 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-92531557-518a-4330-a954-7c6e7e8089ea tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] [instance: 084a71df-04de-416c-a9cb-4a4aacb94f86] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:35.940677 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-92531557-518a-4330-a954-7c6e7e8089ea tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:35.941131 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-92531557-518a-4330-a954-7c6e7e8089ea tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:35.942443 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-92531557-518a-4330-a954-7c6e7e8089ea tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:35.943036 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-92531557-518a-4330-a954-7c6e7e8089ea tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:35.972124 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-92531557-518a-4330-a954-7c6e7e8089ea tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] [instance: 084a71df-04de-416c-a9cb-4a4aacb94f86] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:24:36.131485 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f660d093-3a52-438d-9b2f-8b4a361b750d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:36.138918 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f660d093-3a52-438d-9b2f-8b4a361b750d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1272 microversion: 2.1 time: 0.252490 Apr 16 21:24:36.139594 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2147/4486] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:35 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1272 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:24:36.144505 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6b771a5f-3715-4d76-993e-12ef5707db66 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:36.145384 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6b771a5f-3715-4d76-993e-12ef5707db66 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:36.152586 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6b771a5f-3715-4d76-993e-12ef5707db66 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:36.153279 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6b771a5f-3715-4d76-993e-12ef5707db66 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:36.154287 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6b771a5f-3715-4d76-993e-12ef5707db66 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:36.154917 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6b771a5f-3715-4d76-993e-12ef5707db66 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:36.256260 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-92531557-518a-4330-a954-7c6e7e8089ea tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] 10.222.0.20 "DELETE /compute/v2.1/servers/084a71df-04de-416c-a9cb-4a4aacb94f86" status: 204 len: 0 microversion: 2.1 time: 0.327738 Apr 16 21:24:36.261225 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2340/4487] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:24:35 2022] DELETE /compute/v2.1/servers/084a71df-04de-416c-a9cb-4a4aacb94f86 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:24:36.274013 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-21349f68-b56f-4a70-b30f-0bbdc8e3ab9b tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:36.274847 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-21349f68-b56f-4a70-b30f-0bbdc8e3ab9b tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] [instance: 084a71df-04de-416c-a9cb-4a4aacb94f86] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:36.281635 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-21349f68-b56f-4a70-b30f-0bbdc8e3ab9b tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:36.282098 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-21349f68-b56f-4a70-b30f-0bbdc8e3ab9b tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:36.283040 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-21349f68-b56f-4a70-b30f-0bbdc8e3ab9b tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:36.283517 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-21349f68-b56f-4a70-b30f-0bbdc8e3ab9b tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:36.458168 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6b771a5f-3715-4d76-993e-12ef5707db66 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:36.477874 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6b771a5f-3715-4d76-993e-12ef5707db66 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1316 microversion: 2.1 time: 0.336900 Apr 16 21:24:36.478795 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2148/4488] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:36 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1316 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:36.510677 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-21349f68-b56f-4a70-b30f-0bbdc8e3ab9b tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7e918d195437091a7d73821c0ed39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86582d8437084e4e95b3078888c21e23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:36.522467 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-21349f68-b56f-4a70-b30f-0bbdc8e3ab9b tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] 10.222.0.20 "GET /compute/v2.1/servers/084a71df-04de-416c-a9cb-4a4aacb94f86" status: 200 len: 1665 microversion: 2.1 time: 0.258989 Apr 16 21:24:36.523741 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2341/4489] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:36 2022] GET /compute/v2.1/servers/084a71df-04de-416c-a9cb-4a4aacb94f86 => generated 1665 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:36.945491 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-eb576da7-4b7c-4e2c-9171-deaa156d0f09 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:36.946118 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-eb576da7-4b7c-4e2c-9171-deaa156d0f09 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:36.953088 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eb576da7-4b7c-4e2c-9171-deaa156d0f09 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:36.953756 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eb576da7-4b7c-4e2c-9171-deaa156d0f09 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:36.954746 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eb576da7-4b7c-4e2c-9171-deaa156d0f09 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:36.955542 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eb576da7-4b7c-4e2c-9171-deaa156d0f09 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:37.156651 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-48758289-517b-43a3-8b8c-6a914078e4db tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:37.157207 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-48758289-517b-43a3-8b8c-6a914078e4db tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:37.165022 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-48758289-517b-43a3-8b8c-6a914078e4db tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:37.165720 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-48758289-517b-43a3-8b8c-6a914078e4db tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:37.166741 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-48758289-517b-43a3-8b8c-6a914078e4db tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:37.167936 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-48758289-517b-43a3-8b8c-6a914078e4db tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:37.222236 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-eb576da7-4b7c-4e2c-9171-deaa156d0f09 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc8a2da85ec46948b5bc30ed7a363bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5096c21fbfe41dd80379e0e3b6fb8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:37.230670 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-eb576da7-4b7c-4e2c-9171-deaa156d0f09 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304" status: 200 len: 1509 microversion: 2.1 time: 0.289627 Apr 16 21:24:37.231597 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2149/4490] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:36 2022] GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304 => generated 1509 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:37.336729 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-418a3d75-04a2-41e9-bb31-0eec0131df5a req-fe09d6fb-9d39-4a3c-8e28-d036d5331581 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b36f160b-012c-42fa-8884-2d4f22c5f304", "name": "network-vif-deleted", "tag": "fd85026d-38d7-4dbb-a085-fa40b89df53f"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:24:37.345886 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-418a3d75-04a2-41e9-bb31-0eec0131df5a req-fe09d6fb-9d39-4a3c-8e28-d036d5331581 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:37.346444 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-418a3d75-04a2-41e9-bb31-0eec0131df5a req-fe09d6fb-9d39-4a3c-8e28-d036d5331581 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:37.357791 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-418a3d75-04a2-41e9-bb31-0eec0131df5a req-fe09d6fb-9d39-4a3c-8e28-d036d5331581 service nova] Creating event network-vif-deleted:fd85026d-38d7-4dbb-a085-fa40b89df53f for instance b36f160b-012c-42fa-8884-2d4f22c5f304 on nch2-master-1 Apr 16 21:24:37.363367 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-418a3d75-04a2-41e9-bb31-0eec0131df5a req-fe09d6fb-9d39-4a3c-8e28-d036d5331581 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031144 Apr 16 21:24:37.364324 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2150/4491] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:24:37.476019 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-48758289-517b-43a3-8b8c-6a914078e4db tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:37.486808 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-48758289-517b-43a3-8b8c-6a914078e4db tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1314 microversion: 2.1 time: 0.334270 Apr 16 21:24:37.487408 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2342/4492] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:37 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:37.495293 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0822004a-df38-4125-98a8-f2fedf07b486 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:37.496125 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0822004a-df38-4125-98a8-f2fedf07b486 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:37.502398 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0822004a-df38-4125-98a8-f2fedf07b486 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:37.507516 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0822004a-df38-4125-98a8-f2fedf07b486 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:37.507516 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0822004a-df38-4125-98a8-f2fedf07b486 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:37.507516 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0822004a-df38-4125-98a8-f2fedf07b486 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:37.542029 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bcbaed4a-5b37-481d-ae48-bf0b3f82764c tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:37.542806 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-bcbaed4a-5b37-481d-ae48-bf0b3f82764c tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] [instance: 084a71df-04de-416c-a9cb-4a4aacb94f86] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:37.549407 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bcbaed4a-5b37-481d-ae48-bf0b3f82764c tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:37.550521 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bcbaed4a-5b37-481d-ae48-bf0b3f82764c tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:37.551890 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bcbaed4a-5b37-481d-ae48-bf0b3f82764c tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:37.552379 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bcbaed4a-5b37-481d-ae48-bf0b3f82764c tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:37.739642 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0822004a-df38-4125-98a8-f2fedf07b486 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:37.748470 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0822004a-df38-4125-98a8-f2fedf07b486 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1316 microversion: 2.1 time: 0.257167 Apr 16 21:24:37.751459 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2151/4493] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:37 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1316 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:24:37.770461 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-bcbaed4a-5b37-481d-ae48-bf0b3f82764c tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7e918d195437091a7d73821c0ed39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86582d8437084e4e95b3078888c21e23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:37.779466 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-bcbaed4a-5b37-481d-ae48-bf0b3f82764c tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] 10.222.0.20 "GET /compute/v2.1/servers/084a71df-04de-416c-a9cb-4a4aacb94f86" status: 200 len: 1665 microversion: 2.1 time: 0.241879 Apr 16 21:24:37.780047 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2343/4494] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:37 2022] GET /compute/v2.1/servers/084a71df-04de-416c-a9cb-4a4aacb94f86 => generated 1665 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:38.003308 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-8b0a5285-8554-43ed-8544-97851b4ac8c0 req-8cedfd5f-80bc-4d2f-92f1-7d8f3a022a95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6aa577ae-2715-44de-93bb-d02db79533fb", "tag": "c79de46c-1a6f-418e-b267-0c88759e0458"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:24:38.017506 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-8b0a5285-8554-43ed-8544-97851b4ac8c0 req-8cedfd5f-80bc-4d2f-92f1-7d8f3a022a95 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:38.018089 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-8b0a5285-8554-43ed-8544-97851b4ac8c0 req-8cedfd5f-80bc-4d2f-92f1-7d8f3a022a95 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:38.031853 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-8b0a5285-8554-43ed-8544-97851b4ac8c0 req-8cedfd5f-80bc-4d2f-92f1-7d8f3a022a95 service nova] Creating event network-changed:c79de46c-1a6f-418e-b267-0c88759e0458 for instance 6aa577ae-2715-44de-93bb-d02db79533fb on nch1-master-1 Apr 16 21:24:38.037595 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-8b0a5285-8554-43ed-8544-97851b4ac8c0 req-8cedfd5f-80bc-4d2f-92f1-7d8f3a022a95 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038016 Apr 16 21:24:38.038828 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2152/4495] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:24:38.255927 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5022091f-b0ca-437e-aa33-278e115909bc tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:38.255927 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5022091f-b0ca-437e-aa33-278e115909bc tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:38.259006 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5022091f-b0ca-437e-aa33-278e115909bc tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:38.259866 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5022091f-b0ca-437e-aa33-278e115909bc tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:38.260963 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5022091f-b0ca-437e-aa33-278e115909bc tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:38.261552 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5022091f-b0ca-437e-aa33-278e115909bc tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:38.296762 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5022091f-b0ca-437e-aa33-278e115909bc tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:38.297727 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5022091f-b0ca-437e-aa33-278e115909bc tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:38.298127 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-5022091f-b0ca-437e-aa33-278e115909bc tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lazy-loading 'fault' on Instance uuid b36f160b-012c-42fa-8884-2d4f22c5f304 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:24:38.342213 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5022091f-b0ca-437e-aa33-278e115909bc tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0cc8a2da85ec46948b5bc30ed7a363bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5096c21fbfe41dd80379e0e3b6fb8d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:38.353655 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5022091f-b0ca-437e-aa33-278e115909bc tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304" status: 200 len: 1312 microversion: 2.1 time: 0.109160 Apr 16 21:24:38.354383 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2344/4496] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:38 2022] GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304 => generated 1312 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:38.503646 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e0514529-9111-4884-beb5-fd4cef73201c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:38.504524 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e0514529-9111-4884-beb5-fd4cef73201c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:38.511016 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e0514529-9111-4884-beb5-fd4cef73201c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:38.511414 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e0514529-9111-4884-beb5-fd4cef73201c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:38.512223 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e0514529-9111-4884-beb5-fd4cef73201c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:38.512726 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e0514529-9111-4884-beb5-fd4cef73201c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:38.766972 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-542dfaf0-df16-4831-a70e-51f7479655d4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:38.767502 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-542dfaf0-df16-4831-a70e-51f7479655d4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:38.775179 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-542dfaf0-df16-4831-a70e-51f7479655d4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:38.775867 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-542dfaf0-df16-4831-a70e-51f7479655d4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:38.776958 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-542dfaf0-df16-4831-a70e-51f7479655d4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:38.777569 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-542dfaf0-df16-4831-a70e-51f7479655d4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:38.827881 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e0514529-9111-4884-beb5-fd4cef73201c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:38.846493 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e0514529-9111-4884-beb5-fd4cef73201c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1314 microversion: 2.1 time: 0.347188 Apr 16 21:24:38.856609 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2153/4497] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:38 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:38.856609 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bb045d6f-4bcf-4ad1-95fb-5a9d721f0da0 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:38.856609 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bb045d6f-4bcf-4ad1-95fb-5a9d721f0da0 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] [instance: 084a71df-04de-416c-a9cb-4a4aacb94f86] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:38.859107 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bb045d6f-4bcf-4ad1-95fb-5a9d721f0da0 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:38.859572 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bb045d6f-4bcf-4ad1-95fb-5a9d721f0da0 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:38.860397 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bb045d6f-4bcf-4ad1-95fb-5a9d721f0da0 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:38.860835 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bb045d6f-4bcf-4ad1-95fb-5a9d721f0da0 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:39.072019 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-542dfaf0-df16-4831-a70e-51f7479655d4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:39.080560 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-542dfaf0-df16-4831-a70e-51f7479655d4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.317670 Apr 16 21:24:39.081487 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2345/4498] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:38 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:24:39.140214 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-441a9150-2486-4aba-8225-b41c4eed76bc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-970578539", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "1b9ee265-bdab-4092-8071-c9bb95d911fb"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:24:39.194155 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-441a9150-2486-4aba-8225-b41c4eed76bc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] validate_networks() for [('1b9ee265-bdab-4092-8071-c9bb95d911fb', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:24:39.208923 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-bb045d6f-4bcf-4ad1-95fb-5a9d721f0da0 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7e918d195437091a7d73821c0ed39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86582d8437084e4e95b3078888c21e23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:39.216737 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bb045d6f-4bcf-4ad1-95fb-5a9d721f0da0 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] 10.222.0.20 "GET /compute/v2.1/servers/084a71df-04de-416c-a9cb-4a4aacb94f86" status: 200 len: 1665 microversion: 2.1 time: 0.368547 Apr 16 21:24:39.217412 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2154/4499] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:38 2022] GET /compute/v2.1/servers/084a71df-04de-416c-a9cb-4a4aacb94f86 => generated 1665 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:39.372883 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-df4df9c8-82ad-42fd-9894-9b30df587767 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:39.373641 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-df4df9c8-82ad-42fd-9894-9b30df587767 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] [instance: b36f160b-012c-42fa-8884-2d4f22c5f304] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:39.380225 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-df4df9c8-82ad-42fd-9894-9b30df587767 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:39.381025 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-df4df9c8-82ad-42fd-9894-9b30df587767 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:39.382039 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-df4df9c8-82ad-42fd-9894-9b30df587767 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:39.382489 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-df4df9c8-82ad-42fd-9894-9b30df587767 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:39.398034 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-df4df9c8-82ad-42fd-9894-9b30df587767 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] HTTP exception thrown: Instance b36f160b-012c-42fa-8884-2d4f22c5f304 could not be found. Apr 16 21:24:39.398649 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-df4df9c8-82ad-42fd-9894-9b30df587767 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] Returning 404 to user: Instance b36f160b-012c-42fa-8884-2d4f22c5f304 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:24:39.399491 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-df4df9c8-82ad-42fd-9894-9b30df587767 tempest-ServerRescueTestJSONUnderV235-392317160 tempest-ServerRescueTestJSONUnderV235-392317160-project] 10.222.0.20 "GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304" status: 404 len: 111 microversion: 2.1 time: 0.031446 Apr 16 21:24:39.400426 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2155/4500] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:39 2022] GET /compute/v2.1/servers/b36f160b-012c-42fa-8884-2d4f22c5f304 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:24:39.819917 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-441a9150-2486-4aba-8225-b41c4eed76bc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:24:39.821114 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-441a9150-2486-4aba-8225-b41c4eed76bc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:24:39.822064 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-441a9150-2486-4aba-8225-b41c4eed76bc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:24:39.822966 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-441a9150-2486-4aba-8225-b41c4eed76bc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:24:39.823746 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-441a9150-2486-4aba-8225-b41c4eed76bc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:24:39.837032 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-441a9150-2486-4aba-8225-b41c4eed76bc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:39.837800 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-441a9150-2486-4aba-8225-b41c4eed76bc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:39.841513 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-441a9150-2486-4aba-8225-b41c4eed76bc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:39.842775 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-441a9150-2486-4aba-8225-b41c4eed76bc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:39.864280 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-826c124a-9086-402c-92ce-6dc68c4976b7 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:39.865309 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-826c124a-9086-402c-92ce-6dc68c4976b7 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:39.874186 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-826c124a-9086-402c-92ce-6dc68c4976b7 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:39.875758 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-826c124a-9086-402c-92ce-6dc68c4976b7 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:39.877069 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-826c124a-9086-402c-92ce-6dc68c4976b7 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:39.878167 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-826c124a-9086-402c-92ce-6dc68c4976b7 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:39.888126 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-441a9150-2486-4aba-8225-b41c4eed76bc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Getting quotas for project d6dcd4e578e9420cb0aaa2dd0e43a280. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:24:39.903598 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-441a9150-2486-4aba-8225-b41c4eed76bc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Getting quotas for user 61eb0141ef744beeb2b9e1a6f25958fb and project d6dcd4e578e9420cb0aaa2dd0e43a280. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:24:39.919089 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-441a9150-2486-4aba-8225-b41c4eed76bc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:24:39.932106 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-441a9150-2486-4aba-8225-b41c4eed76bc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: b2c8da69-77b6-4af4-87bc-bbf731043f9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:24:40.075719 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-441a9150-2486-4aba-8225-b41c4eed76bc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.939970 Apr 16 21:24:40.083149 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2346/4501] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:24:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:24:40.089942 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-d919de7f-5895-454a-aba5-53969c4e5861 req-9feec6d2-dd1d-4a45-ba69-34debe9836bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "084a71df-04de-416c-a9cb-4a4aacb94f86", "name": "network-vif-deleted", "tag": "6b41dfa1-0a5b-4329-af9c-dd8f41337861"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:24:40.098817 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-d919de7f-5895-454a-aba5-53969c4e5861 req-9feec6d2-dd1d-4a45-ba69-34debe9836bd service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:40.099323 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-d919de7f-5895-454a-aba5-53969c4e5861 req-9feec6d2-dd1d-4a45-ba69-34debe9836bd service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:40.118641 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-d919de7f-5895-454a-aba5-53969c4e5861 req-9feec6d2-dd1d-4a45-ba69-34debe9836bd service nova] Creating event network-vif-deleted:6b41dfa1-0a5b-4329-af9c-dd8f41337861 for instance 084a71df-04de-416c-a9cb-4a4aacb94f86 on nch2-master-1 Apr 16 21:24:40.126267 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-d919de7f-5895-454a-aba5-53969c4e5861 req-9feec6d2-dd1d-4a45-ba69-34debe9836bd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041833 Apr 16 21:24:40.127381 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2347/4502] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:24:40.136359 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0407fe25-aa20-4b54-954b-7022b2190cb2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:40.137529 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0407fe25-aa20-4b54-954b-7022b2190cb2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: b2c8da69-77b6-4af4-87bc-bbf731043f9f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:40.202957 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0407fe25-aa20-4b54-954b-7022b2190cb2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:40.211877 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0407fe25-aa20-4b54-954b-7022b2190cb2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/b2c8da69-77b6-4af4-87bc-bbf731043f9f" status: 200 len: 1216 microversion: 2.1 time: 0.082930 Apr 16 21:24:40.216435 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2348/4503] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:40 2022] GET /compute/v2.1/servers/b2c8da69-77b6-4af4-87bc-bbf731043f9f => generated 1216 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:40.234464 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6be5dcea-e5f9-4b52-ac81-9db5136f6350 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:40.236346 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6be5dcea-e5f9-4b52-ac81-9db5136f6350 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] [instance: 084a71df-04de-416c-a9cb-4a4aacb94f86] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:40.253453 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6be5dcea-e5f9-4b52-ac81-9db5136f6350 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:40.253453 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6be5dcea-e5f9-4b52-ac81-9db5136f6350 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:40.253453 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6be5dcea-e5f9-4b52-ac81-9db5136f6350 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:40.253453 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6be5dcea-e5f9-4b52-ac81-9db5136f6350 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:40.336532 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6be5dcea-e5f9-4b52-ac81-9db5136f6350 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30c7e918d195437091a7d73821c0ed39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86582d8437084e4e95b3078888c21e23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:40.345063 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6be5dcea-e5f9-4b52-ac81-9db5136f6350 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] 10.222.0.20 "GET /compute/v2.1/servers/084a71df-04de-416c-a9cb-4a4aacb94f86" status: 200 len: 1311 microversion: 2.1 time: 0.114328 Apr 16 21:24:40.345688 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2349/4504] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:40 2022] GET /compute/v2.1/servers/084a71df-04de-416c-a9cb-4a4aacb94f86 => generated 1311 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:24:40.714719 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-826c124a-9086-402c-92ce-6dc68c4976b7 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:40.723892 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-826c124a-9086-402c-92ce-6dc68c4976b7 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1314 microversion: 2.1 time: 0.864034 Apr 16 21:24:40.724509 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2156/4505] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:39 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1314 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:24:41.236598 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3d2cf5fb-528c-4fdd-836f-4ed34da0a2f6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:41.237762 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3d2cf5fb-528c-4fdd-836f-4ed34da0a2f6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: b2c8da69-77b6-4af4-87bc-bbf731043f9f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:41.246700 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d2cf5fb-528c-4fdd-836f-4ed34da0a2f6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:41.247149 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d2cf5fb-528c-4fdd-836f-4ed34da0a2f6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:41.247966 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d2cf5fb-528c-4fdd-836f-4ed34da0a2f6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:41.248454 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d2cf5fb-528c-4fdd-836f-4ed34da0a2f6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:41.322586 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3d2cf5fb-528c-4fdd-836f-4ed34da0a2f6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:41.330583 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3d2cf5fb-528c-4fdd-836f-4ed34da0a2f6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/b2c8da69-77b6-4af4-87bc-bbf731043f9f" status: 200 len: 1220 microversion: 2.1 time: 0.104648 Apr 16 21:24:41.331185 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2350/4506] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:41 2022] GET /compute/v2.1/servers/b2c8da69-77b6-4af4-87bc-bbf731043f9f => generated 1220 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:41.363671 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2508636f-9e9e-4702-8650-c7c474603b92 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:41.364819 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2508636f-9e9e-4702-8650-c7c474603b92 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] [instance: 084a71df-04de-416c-a9cb-4a4aacb94f86] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:41.371940 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2508636f-9e9e-4702-8650-c7c474603b92 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:41.372446 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2508636f-9e9e-4702-8650-c7c474603b92 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:41.373261 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2508636f-9e9e-4702-8650-c7c474603b92 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:41.373713 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2508636f-9e9e-4702-8650-c7c474603b92 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:41.399565 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-2508636f-9e9e-4702-8650-c7c474603b92 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] HTTP exception thrown: Instance 084a71df-04de-416c-a9cb-4a4aacb94f86 could not be found. Apr 16 21:24:41.400534 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2508636f-9e9e-4702-8650-c7c474603b92 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Returning 404 to user: Instance 084a71df-04de-416c-a9cb-4a4aacb94f86 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:24:41.401565 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2508636f-9e9e-4702-8650-c7c474603b92 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] 10.222.0.20 "GET /compute/v2.1/servers/084a71df-04de-416c-a9cb-4a4aacb94f86" status: 404 len: 111 microversion: 2.1 time: 0.044353 Apr 16 21:24:41.405523 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2157/4507] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:41 2022] GET /compute/v2.1/servers/084a71df-04de-416c-a9cb-4a4aacb94f86 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:24:41.411634 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b5564822-b318-4602-8e5c-a1aa75e9d983 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] Calling method '.version_select at 0x7fbb95c2f4c0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:41.504665 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b5564822-b318-4602-8e5c-a1aa75e9d983 tempest-ServersTestFqdnHostnames-1577650716 tempest-ServersTestFqdnHostnames-1577650716-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1745634766" status: 202 len: 0 microversion: 2.1 time: 0.097726 Apr 16 21:24:41.505344 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2351/4508] 10.222.0.20 () {58 vars in 1220 bytes} [Sat Apr 16 21:24:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1745634766 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:24:41.741520 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-502577b3-e15c-4fbf-9191-27589541f3fe tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:41.742734 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-502577b3-e15c-4fbf-9191-27589541f3fe tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:41.748957 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-502577b3-e15c-4fbf-9191-27589541f3fe tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:41.749632 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-502577b3-e15c-4fbf-9191-27589541f3fe tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:41.750433 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-502577b3-e15c-4fbf-9191-27589541f3fe tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:41.751524 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-502577b3-e15c-4fbf-9191-27589541f3fe tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:42.054842 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-502577b3-e15c-4fbf-9191-27589541f3fe tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:42.064258 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-502577b3-e15c-4fbf-9191-27589541f3fe tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1314 microversion: 2.1 time: 0.327143 Apr 16 21:24:42.064877 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2158/4509] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:41 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:42.362578 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-07213ec3-195c-4c10-9e2b-28e1c6b17a2a tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:42.363828 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-07213ec3-195c-4c10-9e2b-28e1c6b17a2a tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: b2c8da69-77b6-4af4-87bc-bbf731043f9f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:42.374565 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-07213ec3-195c-4c10-9e2b-28e1c6b17a2a tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:42.379954 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-07213ec3-195c-4c10-9e2b-28e1c6b17a2a tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:42.381093 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-07213ec3-195c-4c10-9e2b-28e1c6b17a2a tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:42.381920 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-07213ec3-195c-4c10-9e2b-28e1c6b17a2a tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:42.519686 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-07213ec3-195c-4c10-9e2b-28e1c6b17a2a tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:42.530801 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-07213ec3-195c-4c10-9e2b-28e1c6b17a2a tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/b2c8da69-77b6-4af4-87bc-bbf731043f9f" status: 200 len: 1276 microversion: 2.1 time: 0.186608 Apr 16 21:24:42.536391 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2352/4510] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:42 2022] GET /compute/v2.1/servers/b2c8da69-77b6-4af4-87bc-bbf731043f9f => generated 1276 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:43.082887 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-19a41351-0e8d-4235-80bf-5ed2d8e7b1a7 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:43.084307 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-19a41351-0e8d-4235-80bf-5ed2d8e7b1a7 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:43.092387 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-19a41351-0e8d-4235-80bf-5ed2d8e7b1a7 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:43.096261 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-19a41351-0e8d-4235-80bf-5ed2d8e7b1a7 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:43.096261 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-19a41351-0e8d-4235-80bf-5ed2d8e7b1a7 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:43.096261 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-19a41351-0e8d-4235-80bf-5ed2d8e7b1a7 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:43.558923 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7f9c9652-3ddd-443d-9653-0e44bf448b78 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:43.562842 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7f9c9652-3ddd-443d-9653-0e44bf448b78 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: b2c8da69-77b6-4af4-87bc-bbf731043f9f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:43.585169 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7f9c9652-3ddd-443d-9653-0e44bf448b78 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:43.586035 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7f9c9652-3ddd-443d-9653-0e44bf448b78 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:43.587386 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7f9c9652-3ddd-443d-9653-0e44bf448b78 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:43.588077 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7f9c9652-3ddd-443d-9653-0e44bf448b78 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:43.720668 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7f9c9652-3ddd-443d-9653-0e44bf448b78 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:43.731213 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7f9c9652-3ddd-443d-9653-0e44bf448b78 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/b2c8da69-77b6-4af4-87bc-bbf731043f9f" status: 200 len: 1274 microversion: 2.1 time: 0.182926 Apr 16 21:24:43.731799 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2353/4511] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:43 2022] GET /compute/v2.1/servers/b2c8da69-77b6-4af4-87bc-bbf731043f9f => generated 1274 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:43.758339 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-19a41351-0e8d-4235-80bf-5ed2d8e7b1a7 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:43.771938 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-19a41351-0e8d-4235-80bf-5ed2d8e7b1a7 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1314 microversion: 2.1 time: 0.693551 Apr 16 21:24:43.772722 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2159/4512] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:43 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1314 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:44.753204 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e3758ff2-ed37-466f-a43b-35dcf0ce8433 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:44.757611 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e3758ff2-ed37-466f-a43b-35dcf0ce8433 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: b2c8da69-77b6-4af4-87bc-bbf731043f9f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:44.771278 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e3758ff2-ed37-466f-a43b-35dcf0ce8433 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:44.772882 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e3758ff2-ed37-466f-a43b-35dcf0ce8433 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:44.774331 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e3758ff2-ed37-466f-a43b-35dcf0ce8433 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:44.775010 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e3758ff2-ed37-466f-a43b-35dcf0ce8433 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:44.789362 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b09de08a-8708-4f83-8713-776a927ddcbd tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:44.790615 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b09de08a-8708-4f83-8713-776a927ddcbd tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:44.801136 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b09de08a-8708-4f83-8713-776a927ddcbd tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:44.801596 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b09de08a-8708-4f83-8713-776a927ddcbd tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:44.807853 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b09de08a-8708-4f83-8713-776a927ddcbd tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:44.807853 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b09de08a-8708-4f83-8713-776a927ddcbd tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:45.211881 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b09de08a-8708-4f83-8713-776a927ddcbd tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:45.220015 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b09de08a-8708-4f83-8713-776a927ddcbd tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1314 microversion: 2.1 time: 0.434978 Apr 16 21:24:45.220892 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2160/4513] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:44 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1314 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:45.227277 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-fc754ec4-ceb8-476a-b454-858f7bf427bb req-27bbe174-5244-419e-a006-0b7fd4fc0b90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aa577ae-2715-44de-93bb-d02db79533fb", "name": "network-vif-plugged", "status": "completed", "tag": "c79de46c-1a6f-418e-b267-0c88759e0458"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:24:45.234919 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e3758ff2-ed37-466f-a43b-35dcf0ce8433 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:45.238726 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-fc754ec4-ceb8-476a-b454-858f7bf427bb req-27bbe174-5244-419e-a006-0b7fd4fc0b90 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:45.240037 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-fc754ec4-ceb8-476a-b454-858f7bf427bb req-27bbe174-5244-419e-a006-0b7fd4fc0b90 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:45.245082 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e3758ff2-ed37-466f-a43b-35dcf0ce8433 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/b2c8da69-77b6-4af4-87bc-bbf731043f9f" status: 200 len: 1316 microversion: 2.1 time: 0.500529 Apr 16 21:24:45.252040 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-fc754ec4-ceb8-476a-b454-858f7bf427bb req-27bbe174-5244-419e-a006-0b7fd4fc0b90 service nova] Creating event network-vif-plugged:c79de46c-1a6f-418e-b267-0c88759e0458 for instance 6aa577ae-2715-44de-93bb-d02db79533fb on nch1-master-1 Apr 16 21:24:45.255967 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2354/4514] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:44 2022] GET /compute/v2.1/servers/b2c8da69-77b6-4af4-87bc-bbf731043f9f => generated 1316 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:45.260616 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-fc754ec4-ceb8-476a-b454-858f7bf427bb req-27bbe174-5244-419e-a006-0b7fd4fc0b90 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036016 Apr 16 21:24:45.260616 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2161/4515] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:24:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:24:46.237744 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fee492ad-b169-448d-8583-677dfd5e6376 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:46.239076 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fee492ad-b169-448d-8583-677dfd5e6376 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:46.246818 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fee492ad-b169-448d-8583-677dfd5e6376 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:46.247525 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fee492ad-b169-448d-8583-677dfd5e6376 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:46.248529 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fee492ad-b169-448d-8583-677dfd5e6376 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:46.249145 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fee492ad-b169-448d-8583-677dfd5e6376 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:46.264676 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-00f8607a-f35c-40d1-b3af-f0792dd27e57 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:46.265872 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-00f8607a-f35c-40d1-b3af-f0792dd27e57 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: b2c8da69-77b6-4af4-87bc-bbf731043f9f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:46.272267 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-00f8607a-f35c-40d1-b3af-f0792dd27e57 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:46.272735 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-00f8607a-f35c-40d1-b3af-f0792dd27e57 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:46.273533 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-00f8607a-f35c-40d1-b3af-f0792dd27e57 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:46.273989 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-00f8607a-f35c-40d1-b3af-f0792dd27e57 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:46.557471 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fee492ad-b169-448d-8583-677dfd5e6376 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:46.568963 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fee492ad-b169-448d-8583-677dfd5e6376 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1314 microversion: 2.1 time: 0.334695 Apr 16 21:24:46.569938 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2355/4516] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:46 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:46.575045 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-2321c3d9-403a-470f-8ca3-e69c69566753 req-97cb26be-bf95-458c-9313-2752e006bba2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2c8da69-77b6-4af4-87bc-bbf731043f9f", "tag": "bf49cd01-b6d1-4305-b056-a5382b1d1716"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:24:46.585714 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-2321c3d9-403a-470f-8ca3-e69c69566753 req-97cb26be-bf95-458c-9313-2752e006bba2 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:46.586178 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-2321c3d9-403a-470f-8ca3-e69c69566753 req-97cb26be-bf95-458c-9313-2752e006bba2 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:46.598322 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-2321c3d9-403a-470f-8ca3-e69c69566753 req-97cb26be-bf95-458c-9313-2752e006bba2 service nova] Creating event network-changed:bf49cd01-b6d1-4305-b056-a5382b1d1716 for instance b2c8da69-77b6-4af4-87bc-bbf731043f9f on nch2-master-1 Apr 16 21:24:46.604187 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-2321c3d9-403a-470f-8ca3-e69c69566753 req-97cb26be-bf95-458c-9313-2752e006bba2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032667 Apr 16 21:24:46.605052 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2356/4517] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:24:47.068899 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-00f8607a-f35c-40d1-b3af-f0792dd27e57 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:47.077046 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-00f8607a-f35c-40d1-b3af-f0792dd27e57 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/b2c8da69-77b6-4af4-87bc-bbf731043f9f" status: 200 len: 1316 microversion: 2.1 time: 0.816460 Apr 16 21:24:47.077907 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2162/4518] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:46 2022] GET /compute/v2.1/servers/b2c8da69-77b6-4af4-87bc-bbf731043f9f => generated 1316 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:24:47.597669 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0bdb6de7-d9a8-4442-89d5-4ef18ad8fcea tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:47.599170 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0bdb6de7-d9a8-4442-89d5-4ef18ad8fcea tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:47.609727 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0bdb6de7-d9a8-4442-89d5-4ef18ad8fcea tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:47.610515 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0bdb6de7-d9a8-4442-89d5-4ef18ad8fcea tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:47.611501 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0bdb6de7-d9a8-4442-89d5-4ef18ad8fcea tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:47.612127 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0bdb6de7-d9a8-4442-89d5-4ef18ad8fcea tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:47.830437 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0bdb6de7-d9a8-4442-89d5-4ef18ad8fcea tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:47.841188 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0bdb6de7-d9a8-4442-89d5-4ef18ad8fcea tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1501 microversion: 2.1 time: 0.256647 Apr 16 21:24:47.842673 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2357/4519] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:47 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1501 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:47.858499 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-120aa85c-a67a-419e-b330-ba4a54020b8d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:24:47.859746 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-120aa85c-a67a-419e-b330-ba4a54020b8d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:47.867884 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-120aa85c-a67a-419e-b330-ba4a54020b8d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:47.868517 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-120aa85c-a67a-419e-b330-ba4a54020b8d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:47.870237 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-120aa85c-a67a-419e-b330-ba4a54020b8d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:47.870954 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-120aa85c-a67a-419e-b330-ba4a54020b8d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:47.899583 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-120aa85c-a67a-419e-b330-ba4a54020b8d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lazy-loading 'flavor' on Instance uuid 6aa577ae-2715-44de-93bb-d02db79533fb {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:24:48.095273 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8df86def-11e9-4e67-9c74-803105f90b40 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:48.096105 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8df86def-11e9-4e67-9c74-803105f90b40 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: b2c8da69-77b6-4af4-87bc-bbf731043f9f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:48.104703 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8df86def-11e9-4e67-9c74-803105f90b40 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:48.105409 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8df86def-11e9-4e67-9c74-803105f90b40 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:48.106206 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8df86def-11e9-4e67-9c74-803105f90b40 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:48.106708 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8df86def-11e9-4e67-9c74-803105f90b40 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:48.530184 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8df86def-11e9-4e67-9c74-803105f90b40 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:48.538701 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8df86def-11e9-4e67-9c74-803105f90b40 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/b2c8da69-77b6-4af4-87bc-bbf731043f9f" status: 200 len: 1316 microversion: 2.1 time: 0.447388 Apr 16 21:24:48.555087 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2358/4520] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:48 2022] GET /compute/v2.1/servers/b2c8da69-77b6-4af4-87bc-bbf731043f9f => generated 1316 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:48.786259 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-120aa85c-a67a-419e-b330-ba4a54020b8d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "POST /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb/action" status: 202 len: 0 microversion: 2.1 time: 0.931516 Apr 16 21:24:48.786967 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2163/4521] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:24:47 2022] POST /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb/action => generated 0 bytes in 933 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:24:48.795581 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4bbc691f-0e8c-495a-a887-5d57dc3efc9e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:48.796315 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4bbc691f-0e8c-495a-a887-5d57dc3efc9e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:48.806715 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4bbc691f-0e8c-495a-a887-5d57dc3efc9e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:48.806715 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4bbc691f-0e8c-495a-a887-5d57dc3efc9e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:48.806715 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4bbc691f-0e8c-495a-a887-5d57dc3efc9e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:48.806715 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4bbc691f-0e8c-495a-a887-5d57dc3efc9e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:49.117691 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4bbc691f-0e8c-495a-a887-5d57dc3efc9e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:49.136815 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4bbc691f-0e8c-495a-a887-5d57dc3efc9e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1507 microversion: 2.1 time: 0.344743 Apr 16 21:24:49.141118 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2359/4522] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:48 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1507 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:49.558012 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a309452f-5431-44ea-a3eb-b0aa0b7df06e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:49.558722 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a309452f-5431-44ea-a3eb-b0aa0b7df06e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: b2c8da69-77b6-4af4-87bc-bbf731043f9f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:49.565709 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a309452f-5431-44ea-a3eb-b0aa0b7df06e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:49.565842 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a309452f-5431-44ea-a3eb-b0aa0b7df06e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:49.566627 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a309452f-5431-44ea-a3eb-b0aa0b7df06e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:49.567100 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a309452f-5431-44ea-a3eb-b0aa0b7df06e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:49.713735 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a309452f-5431-44ea-a3eb-b0aa0b7df06e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:49.721383 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a309452f-5431-44ea-a3eb-b0aa0b7df06e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/b2c8da69-77b6-4af4-87bc-bbf731043f9f" status: 200 len: 1316 microversion: 2.1 time: 0.169946 Apr 16 21:24:49.721957 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2164/4523] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:49 2022] GET /compute/v2.1/servers/b2c8da69-77b6-4af4-87bc-bbf731043f9f => generated 1316 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:50.157777 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-12878ce1-6eb0-48ce-9962-ca26bebba3c6 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:50.158393 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-12878ce1-6eb0-48ce-9962-ca26bebba3c6 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:50.178693 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-12878ce1-6eb0-48ce-9962-ca26bebba3c6 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:50.184243 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-12878ce1-6eb0-48ce-9962-ca26bebba3c6 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:50.186622 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-12878ce1-6eb0-48ce-9962-ca26bebba3c6 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:50.189753 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-12878ce1-6eb0-48ce-9962-ca26bebba3c6 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:50.526827 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-12878ce1-6eb0-48ce-9962-ca26bebba3c6 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:50.535625 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-12878ce1-6eb0-48ce-9962-ca26bebba3c6 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1507 microversion: 2.1 time: 0.386028 Apr 16 21:24:50.536407 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2360/4524] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:50 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1507 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:50.738710 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f7646daf-e68f-4fb8-979b-3b6d8ba1f4e3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:50.740060 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f7646daf-e68f-4fb8-979b-3b6d8ba1f4e3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: b2c8da69-77b6-4af4-87bc-bbf731043f9f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:50.747281 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f7646daf-e68f-4fb8-979b-3b6d8ba1f4e3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:50.747883 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f7646daf-e68f-4fb8-979b-3b6d8ba1f4e3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:50.748694 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f7646daf-e68f-4fb8-979b-3b6d8ba1f4e3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:50.749161 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f7646daf-e68f-4fb8-979b-3b6d8ba1f4e3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:50.960372 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f7646daf-e68f-4fb8-979b-3b6d8ba1f4e3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:50.969726 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f7646daf-e68f-4fb8-979b-3b6d8ba1f4e3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/b2c8da69-77b6-4af4-87bc-bbf731043f9f" status: 200 len: 1316 microversion: 2.1 time: 0.235292 Apr 16 21:24:50.970538 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2165/4525] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:50 2022] GET /compute/v2.1/servers/b2c8da69-77b6-4af4-87bc-bbf731043f9f => generated 1316 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:51.553835 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b6dec107-1e8a-406d-8765-37934901127d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:51.554459 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b6dec107-1e8a-406d-8765-37934901127d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:51.563848 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b6dec107-1e8a-406d-8765-37934901127d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:51.564347 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b6dec107-1e8a-406d-8765-37934901127d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:51.565145 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b6dec107-1e8a-406d-8765-37934901127d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:51.565596 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b6dec107-1e8a-406d-8765-37934901127d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:51.633239 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c0108bec-7bbf-4854-82bb-4c96be8941a2 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-715525204", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": "none"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:24:51.709373 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-c0108bec-7bbf-4854-82bb-4c96be8941a2 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:24:51.709846 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-c0108bec-7bbf-4854-82bb-4c96be8941a2 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:24:51.710972 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-c0108bec-7bbf-4854-82bb-4c96be8941a2 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:24:51.711818 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-c0108bec-7bbf-4854-82bb-4c96be8941a2 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:24:51.712691 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-c0108bec-7bbf-4854-82bb-4c96be8941a2 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:24:51.742764 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c0108bec-7bbf-4854-82bb-4c96be8941a2 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:51.743224 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c0108bec-7bbf-4854-82bb-4c96be8941a2 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:51.744666 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c0108bec-7bbf-4854-82bb-4c96be8941a2 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:51.748367 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c0108bec-7bbf-4854-82bb-4c96be8941a2 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:51.771060 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-c0108bec-7bbf-4854-82bb-4c96be8941a2 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Getting quotas for project b56376483435432291c5c3beeeae3354. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:24:51.777277 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-c0108bec-7bbf-4854-82bb-4c96be8941a2 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Getting quotas for user 07270856a1734c7f9ee203d79aba637c and project b56376483435432291c5c3beeeae3354. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:24:51.790335 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c0108bec-7bbf-4854-82bb-4c96be8941a2 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:24:51.792719 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c0108bec-7bbf-4854-82bb-4c96be8941a2 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] [instance: e9cf01fa-c7fe-47d7-a81a-ce285977ece1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:24:51.853735 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b6dec107-1e8a-406d-8765-37934901127d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:51.861314 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b6dec107-1e8a-406d-8765-37934901127d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1507 microversion: 2.1 time: 0.311493 Apr 16 21:24:51.861896 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2166/4526] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:51 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1507 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:24:51.960624 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c0108bec-7bbf-4854-82bb-4c96be8941a2 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.488587 Apr 16 21:24:51.966728 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2361/4527] 10.222.0.20 () {62 vars in 1187 bytes} [Sat Apr 16 21:24:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 495 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 16 21:24:51.971861 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1b53b51e-2709-407b-a1a4-df7cead07936 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:51.973941 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1b53b51e-2709-407b-a1a4-df7cead07936 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] [instance: e9cf01fa-c7fe-47d7-a81a-ce285977ece1] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:51.987263 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-399888b6-9463-4049-a2c5-148aec43dbdf tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:51.988026 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-399888b6-9463-4049-a2c5-148aec43dbdf tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: b2c8da69-77b6-4af4-87bc-bbf731043f9f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:51.995045 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-399888b6-9463-4049-a2c5-148aec43dbdf tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:51.995508 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-399888b6-9463-4049-a2c5-148aec43dbdf tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:51.996322 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-399888b6-9463-4049-a2c5-148aec43dbdf tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:51.996764 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-399888b6-9463-4049-a2c5-148aec43dbdf tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:52.065239 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1b53b51e-2709-407b-a1a4-df7cead07936 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07270856a1734c7f9ee203d79aba637c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56376483435432291c5c3beeeae3354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:52.075237 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1b53b51e-2709-407b-a1a4-df7cead07936 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07270856a1734c7f9ee203d79aba637c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56376483435432291c5c3beeeae3354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:52.082943 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1b53b51e-2709-407b-a1a4-df7cead07936 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07270856a1734c7f9ee203d79aba637c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56376483435432291c5c3beeeae3354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:52.084404 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1b53b51e-2709-407b-a1a4-df7cead07936 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] 10.222.0.20 "GET /compute/v2.1/servers/e9cf01fa-c7fe-47d7-a81a-ce285977ece1" status: 200 len: 1280 microversion: 2.47 time: 0.116462 Apr 16 21:24:52.085395 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2167/4528] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:24:51 2022] GET /compute/v2.1/servers/e9cf01fa-c7fe-47d7-a81a-ce285977ece1 => generated 1280 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:24:52.194100 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-399888b6-9463-4049-a2c5-148aec43dbdf tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:52.205372 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-399888b6-9463-4049-a2c5-148aec43dbdf tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/b2c8da69-77b6-4af4-87bc-bbf731043f9f" status: 200 len: 1316 microversion: 2.1 time: 0.221861 Apr 16 21:24:52.213952 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2362/4529] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:51 2022] GET /compute/v2.1/servers/b2c8da69-77b6-4af4-87bc-bbf731043f9f => generated 1316 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:52.486525 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-af5cc606-e464-4d8b-b92e-c43502070f36 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-731240554", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "cce77d41-c216-4fdf-aff8-360b03003a07"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:24:52.555229 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-af5cc606-e464-4d8b-b92e-c43502070f36 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] validate_networks() for [('cce77d41-c216-4fdf-aff8-360b03003a07', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:24:52.881830 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ce47d4c3-2265-4ae6-959f-5be26d6b9085 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:52.881830 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ce47d4c3-2265-4ae6-959f-5be26d6b9085 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:52.890895 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ce47d4c3-2265-4ae6-959f-5be26d6b9085 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:52.891349 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ce47d4c3-2265-4ae6-959f-5be26d6b9085 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:52.892131 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ce47d4c3-2265-4ae6-959f-5be26d6b9085 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:52.892604 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ce47d4c3-2265-4ae6-959f-5be26d6b9085 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:53.026994 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ce47d4c3-2265-4ae6-959f-5be26d6b9085 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:53.035217 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ce47d4c3-2265-4ae6-959f-5be26d6b9085 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1507 microversion: 2.1 time: 0.160383 Apr 16 21:24:53.036770 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2363/4530] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:52 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:24:53.094833 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-af5cc606-e464-4d8b-b92e-c43502070f36 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:24:53.095356 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-af5cc606-e464-4d8b-b92e-c43502070f36 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:24:53.095739 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-af5cc606-e464-4d8b-b92e-c43502070f36 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:24:53.096530 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-af5cc606-e464-4d8b-b92e-c43502070f36 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:24:53.096687 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-af5cc606-e464-4d8b-b92e-c43502070f36 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:24:53.103554 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-573b87b2-5cf7-48a0-aac3-13a4b9daf382 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:53.104494 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-573b87b2-5cf7-48a0-aac3-13a4b9daf382 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] [instance: e9cf01fa-c7fe-47d7-a81a-ce285977ece1] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:53.106689 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-af5cc606-e464-4d8b-b92e-c43502070f36 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:53.107148 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-af5cc606-e464-4d8b-b92e-c43502070f36 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:53.107992 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-af5cc606-e464-4d8b-b92e-c43502070f36 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:53.108468 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-af5cc606-e464-4d8b-b92e-c43502070f36 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:53.110073 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-573b87b2-5cf7-48a0-aac3-13a4b9daf382 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:53.110531 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-573b87b2-5cf7-48a0-aac3-13a4b9daf382 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:53.111322 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-573b87b2-5cf7-48a0-aac3-13a4b9daf382 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:53.111776 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-573b87b2-5cf7-48a0-aac3-13a4b9daf382 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:53.127287 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-af5cc606-e464-4d8b-b92e-c43502070f36 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Getting quotas for project 81cb0c10ca81477bb8c44f27102b04fe. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:24:53.150739 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-af5cc606-e464-4d8b-b92e-c43502070f36 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Getting quotas for user f674be6ee5974219ac43d11adc2e33a0 and project 81cb0c10ca81477bb8c44f27102b04fe. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:24:53.150739 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-af5cc606-e464-4d8b-b92e-c43502070f36 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:24:53.150739 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-af5cc606-e464-4d8b-b92e-c43502070f36 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] [instance: 9c206aa5-5455-49ad-81ee-23ba46fc9d79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:24:53.176049 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-573b87b2-5cf7-48a0-aac3-13a4b9daf382 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07270856a1734c7f9ee203d79aba637c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56376483435432291c5c3beeeae3354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:53.185131 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-573b87b2-5cf7-48a0-aac3-13a4b9daf382 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07270856a1734c7f9ee203d79aba637c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56376483435432291c5c3beeeae3354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:53.186676 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-573b87b2-5cf7-48a0-aac3-13a4b9daf382 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07270856a1734c7f9ee203d79aba637c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56376483435432291c5c3beeeae3354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:53.188217 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-573b87b2-5cf7-48a0-aac3-13a4b9daf382 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] 10.222.0.20 "GET /compute/v2.1/servers/e9cf01fa-c7fe-47d7-a81a-ce285977ece1" status: 200 len: 1284 microversion: 2.47 time: 0.088719 Apr 16 21:24:53.188795 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2364/4531] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:24:53 2022] GET /compute/v2.1/servers/e9cf01fa-c7fe-47d7-a81a-ce285977ece1 => generated 1284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:24:53.225098 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-785a1a5c-1396-4d59-b17a-f0e221db72df tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:53.226765 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-785a1a5c-1396-4d59-b17a-f0e221db72df tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: b2c8da69-77b6-4af4-87bc-bbf731043f9f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:53.233260 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-785a1a5c-1396-4d59-b17a-f0e221db72df tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:53.233798 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-785a1a5c-1396-4d59-b17a-f0e221db72df tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:53.234668 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-785a1a5c-1396-4d59-b17a-f0e221db72df tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:53.235189 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-785a1a5c-1396-4d59-b17a-f0e221db72df tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:53.264470 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-af5cc606-e464-4d8b-b92e-c43502070f36 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 0.843439 Apr 16 21:24:53.265451 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2168/4532] 10.222.0.20 () {62 vars in 1187 bytes} [Sat Apr 16 21:24:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 845 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 16 21:24:53.282508 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1569643c-fec6-41c9-bb53-057a97771591 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:53.283380 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1569643c-fec6-41c9-bb53-057a97771591 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] [instance: 9c206aa5-5455-49ad-81ee-23ba46fc9d79] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:53.359355 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1569643c-fec6-41c9-bb53-057a97771591 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:53.368733 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1569643c-fec6-41c9-bb53-057a97771591 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:53.368915 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1569643c-fec6-41c9-bb53-057a97771591 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:53.370070 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1569643c-fec6-41c9-bb53-057a97771591 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] 10.222.0.20 "GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79" status: 200 len: 1261 microversion: 2.26 time: 0.097492 Apr 16 21:24:53.370629 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2169/4533] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:24:53 2022] GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79 => generated 1261 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:24:53.428719 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-785a1a5c-1396-4d59-b17a-f0e221db72df tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:53.436859 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-785a1a5c-1396-4d59-b17a-f0e221db72df tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/b2c8da69-77b6-4af4-87bc-bbf731043f9f" status: 200 len: 1316 microversion: 2.1 time: 0.217684 Apr 16 21:24:53.437457 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2365/4534] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:53 2022] GET /compute/v2.1/servers/b2c8da69-77b6-4af4-87bc-bbf731043f9f => generated 1316 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:53.672612 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-c92dcc02-e3a2-493b-a7ce-88998bbdfb6b req-20047a73-d4de-4884-bc7d-9ffdcfe4cdc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2c8da69-77b6-4af4-87bc-bbf731043f9f", "name": "network-vif-plugged", "status": "completed", "tag": "bf49cd01-b6d1-4305-b056-a5382b1d1716"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:24:53.685498 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-c92dcc02-e3a2-493b-a7ce-88998bbdfb6b req-20047a73-d4de-4884-bc7d-9ffdcfe4cdc4 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:53.686219 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-c92dcc02-e3a2-493b-a7ce-88998bbdfb6b req-20047a73-d4de-4884-bc7d-9ffdcfe4cdc4 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:53.699454 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-c92dcc02-e3a2-493b-a7ce-88998bbdfb6b req-20047a73-d4de-4884-bc7d-9ffdcfe4cdc4 service nova] Creating event network-vif-plugged:bf49cd01-b6d1-4305-b056-a5382b1d1716 for instance b2c8da69-77b6-4af4-87bc-bbf731043f9f on nch2-master-1 Apr 16 21:24:53.704829 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-c92dcc02-e3a2-493b-a7ce-88998bbdfb6b req-20047a73-d4de-4884-bc7d-9ffdcfe4cdc4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036080 Apr 16 21:24:53.705569 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2170/4535] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:24:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:24:54.055192 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-80629322-d82e-4d86-a66c-9da4e673df75 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:54.055928 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-80629322-d82e-4d86-a66c-9da4e673df75 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:54.063396 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-80629322-d82e-4d86-a66c-9da4e673df75 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:54.063863 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-80629322-d82e-4d86-a66c-9da4e673df75 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:54.064686 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-80629322-d82e-4d86-a66c-9da4e673df75 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:54.065158 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-80629322-d82e-4d86-a66c-9da4e673df75 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:54.209281 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e5422823-9906-4f6e-a586-aa3d4122c949 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:54.209987 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e5422823-9906-4f6e-a586-aa3d4122c949 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] [instance: e9cf01fa-c7fe-47d7-a81a-ce285977ece1] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:54.226191 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e5422823-9906-4f6e-a586-aa3d4122c949 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:54.226819 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e5422823-9906-4f6e-a586-aa3d4122c949 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:54.227763 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e5422823-9906-4f6e-a586-aa3d4122c949 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:54.228232 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e5422823-9906-4f6e-a586-aa3d4122c949 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:54.240772 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-80629322-d82e-4d86-a66c-9da4e673df75 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:54.258901 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-80629322-d82e-4d86-a66c-9da4e673df75 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1507 microversion: 2.1 time: 0.209300 Apr 16 21:24:54.260655 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2366/4536] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:54 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1507 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:54.345241 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e5422823-9906-4f6e-a586-aa3d4122c949 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07270856a1734c7f9ee203d79aba637c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56376483435432291c5c3beeeae3354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:54.355241 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e5422823-9906-4f6e-a586-aa3d4122c949 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07270856a1734c7f9ee203d79aba637c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56376483435432291c5c3beeeae3354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:54.355603 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e5422823-9906-4f6e-a586-aa3d4122c949 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07270856a1734c7f9ee203d79aba637c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56376483435432291c5c3beeeae3354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:54.356926 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e5422823-9906-4f6e-a586-aa3d4122c949 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] 10.222.0.20 "GET /compute/v2.1/servers/e9cf01fa-c7fe-47d7-a81a-ce285977ece1" status: 200 len: 1332 microversion: 2.47 time: 0.153563 Apr 16 21:24:54.358087 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2171/4537] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:24:54 2022] GET /compute/v2.1/servers/e9cf01fa-c7fe-47d7-a81a-ce285977ece1 => generated 1332 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:24:54.388511 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7eadb2f3-ee70-4b63-9c6b-1bcb4a3a60f9 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:54.389576 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7eadb2f3-ee70-4b63-9c6b-1bcb4a3a60f9 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] [instance: 9c206aa5-5455-49ad-81ee-23ba46fc9d79] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:54.450504 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7eadb2f3-ee70-4b63-9c6b-1bcb4a3a60f9 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:54.453126 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d1070c70-1b82-4b78-9f21-ac4aebb999b7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:54.453919 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d1070c70-1b82-4b78-9f21-ac4aebb999b7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: b2c8da69-77b6-4af4-87bc-bbf731043f9f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:54.459760 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7eadb2f3-ee70-4b63-9c6b-1bcb4a3a60f9 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:54.460222 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d1070c70-1b82-4b78-9f21-ac4aebb999b7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:54.460799 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d1070c70-1b82-4b78-9f21-ac4aebb999b7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:54.461548 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7eadb2f3-ee70-4b63-9c6b-1bcb4a3a60f9 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:54.461742 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d1070c70-1b82-4b78-9f21-ac4aebb999b7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:54.462269 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d1070c70-1b82-4b78-9f21-ac4aebb999b7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:54.462725 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7eadb2f3-ee70-4b63-9c6b-1bcb4a3a60f9 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] 10.222.0.20 "GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79" status: 200 len: 1261 microversion: 2.26 time: 0.078379 Apr 16 21:24:54.474362 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2367/4538] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:24:54 2022] GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79 => generated 1261 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:24:54.693304 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d1070c70-1b82-4b78-9f21-ac4aebb999b7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:54.705420 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d1070c70-1b82-4b78-9f21-ac4aebb999b7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/b2c8da69-77b6-4af4-87bc-bbf731043f9f" status: 200 len: 1316 microversion: 2.1 time: 0.251790 Apr 16 21:24:54.705420 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2172/4539] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:54 2022] GET /compute/v2.1/servers/b2c8da69-77b6-4af4-87bc-bbf731043f9f => generated 1316 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:24:55.277694 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6cd044f9-35be-4eae-9c1d-8dc66a42c347 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:55.278238 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6cd044f9-35be-4eae-9c1d-8dc66a42c347 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:55.285803 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6cd044f9-35be-4eae-9c1d-8dc66a42c347 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:55.286340 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6cd044f9-35be-4eae-9c1d-8dc66a42c347 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:55.287146 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6cd044f9-35be-4eae-9c1d-8dc66a42c347 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:55.287642 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6cd044f9-35be-4eae-9c1d-8dc66a42c347 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:55.378217 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-dcc283ba-c771-4ea6-a196-dc89d20db13c tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:55.379349 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-dcc283ba-c771-4ea6-a196-dc89d20db13c tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] [instance: e9cf01fa-c7fe-47d7-a81a-ce285977ece1] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:55.388207 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dcc283ba-c771-4ea6-a196-dc89d20db13c tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:55.388874 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dcc283ba-c771-4ea6-a196-dc89d20db13c tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:55.390053 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dcc283ba-c771-4ea6-a196-dc89d20db13c tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:55.390975 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dcc283ba-c771-4ea6-a196-dc89d20db13c tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:55.487567 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-dcc283ba-c771-4ea6-a196-dc89d20db13c tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07270856a1734c7f9ee203d79aba637c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56376483435432291c5c3beeeae3354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:55.497282 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-dcc283ba-c771-4ea6-a196-dc89d20db13c tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07270856a1734c7f9ee203d79aba637c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56376483435432291c5c3beeeae3354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:55.501770 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-dcc283ba-c771-4ea6-a196-dc89d20db13c tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07270856a1734c7f9ee203d79aba637c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56376483435432291c5c3beeeae3354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:55.501770 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-dcc283ba-c771-4ea6-a196-dc89d20db13c tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] 10.222.0.20 "GET /compute/v2.1/servers/e9cf01fa-c7fe-47d7-a81a-ce285977ece1" status: 200 len: 1338 microversion: 2.47 time: 0.127237 Apr 16 21:24:55.501770 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2173/4540] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:24:55 2022] GET /compute/v2.1/servers/e9cf01fa-c7fe-47d7-a81a-ce285977ece1 => generated 1338 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:24:55.506514 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6ddc1068-f99e-46ad-a642-67c551194ca9 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:55.507124 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6ddc1068-f99e-46ad-a642-67c551194ca9 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] [instance: 9c206aa5-5455-49ad-81ee-23ba46fc9d79] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:55.513634 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6ddc1068-f99e-46ad-a642-67c551194ca9 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:55.514090 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6ddc1068-f99e-46ad-a642-67c551194ca9 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:55.514873 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6ddc1068-f99e-46ad-a642-67c551194ca9 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:55.515323 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6ddc1068-f99e-46ad-a642-67c551194ca9 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:55.531463 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6cd044f9-35be-4eae-9c1d-8dc66a42c347 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:55.540676 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6cd044f9-35be-4eae-9c1d-8dc66a42c347 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1507 microversion: 2.1 time: 0.267250 Apr 16 21:24:55.541268 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2368/4541] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:55 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1507 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:55.588399 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6ddc1068-f99e-46ad-a642-67c551194ca9 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:55.597049 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6ddc1068-f99e-46ad-a642-67c551194ca9 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:55.598756 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6ddc1068-f99e-46ad-a642-67c551194ca9 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:55.599890 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6ddc1068-f99e-46ad-a642-67c551194ca9 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] 10.222.0.20 "GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79" status: 200 len: 1313 microversion: 2.26 time: 0.097507 Apr 16 21:24:55.600479 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2174/4542] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:24:55 2022] GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79 => generated 1313 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:24:55.718452 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ec453382-11b7-4e2f-b419-c9f3b8114f56 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:55.719072 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ec453382-11b7-4e2f-b419-c9f3b8114f56 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: b2c8da69-77b6-4af4-87bc-bbf731043f9f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:55.725525 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ec453382-11b7-4e2f-b419-c9f3b8114f56 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:55.726080 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ec453382-11b7-4e2f-b419-c9f3b8114f56 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:55.726913 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ec453382-11b7-4e2f-b419-c9f3b8114f56 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:55.727364 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ec453382-11b7-4e2f-b419-c9f3b8114f56 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:55.923427 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ec453382-11b7-4e2f-b419-c9f3b8114f56 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:55.932694 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ec453382-11b7-4e2f-b419-c9f3b8114f56 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/b2c8da69-77b6-4af4-87bc-bbf731043f9f" status: 200 len: 1504 microversion: 2.1 time: 0.218146 Apr 16 21:24:55.933289 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2369/4543] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:55 2022] GET /compute/v2.1/servers/b2c8da69-77b6-4af4-87bc-bbf731043f9f => generated 1504 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:55.953985 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-065afe0a-fd74-4ad2-8c90-71dd3c871f5c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:55.954490 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-065afe0a-fd74-4ad2-8c90-71dd3c871f5c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: b2c8da69-77b6-4af4-87bc-bbf731043f9f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:55.960739 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-065afe0a-fd74-4ad2-8c90-71dd3c871f5c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:55.961290 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-065afe0a-fd74-4ad2-8c90-71dd3c871f5c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:55.962167 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-065afe0a-fd74-4ad2-8c90-71dd3c871f5c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:55.962841 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-065afe0a-fd74-4ad2-8c90-71dd3c871f5c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:55.987971 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-065afe0a-fd74-4ad2-8c90-71dd3c871f5c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: b2c8da69-77b6-4af4-87bc-bbf731043f9f] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:24:56.297371 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-065afe0a-fd74-4ad2-8c90-71dd3c871f5c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b2c8da69-77b6-4af4-87bc-bbf731043f9f" status: 204 len: 0 microversion: 2.1 time: 0.346494 Apr 16 21:24:56.298003 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2175/4544] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:24:55 2022] DELETE /compute/v2.1/servers/b2c8da69-77b6-4af4-87bc-bbf731043f9f => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:24:56.306819 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-dc6636f2-3c07-43cd-a8c0-9329b71886e7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:56.307946 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-dc6636f2-3c07-43cd-a8c0-9329b71886e7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: b2c8da69-77b6-4af4-87bc-bbf731043f9f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:56.316149 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dc6636f2-3c07-43cd-a8c0-9329b71886e7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:56.316651 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dc6636f2-3c07-43cd-a8c0-9329b71886e7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:56.317495 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dc6636f2-3c07-43cd-a8c0-9329b71886e7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:56.318157 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dc6636f2-3c07-43cd-a8c0-9329b71886e7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:56.523783 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8e77595f-58a7-4d96-9365-3ca6133717d6 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:56.524798 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8e77595f-58a7-4d96-9365-3ca6133717d6 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] [instance: e9cf01fa-c7fe-47d7-a81a-ce285977ece1] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:56.531611 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8e77595f-58a7-4d96-9365-3ca6133717d6 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:56.532232 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8e77595f-58a7-4d96-9365-3ca6133717d6 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:56.533109 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8e77595f-58a7-4d96-9365-3ca6133717d6 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:56.533547 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8e77595f-58a7-4d96-9365-3ca6133717d6 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:56.537673 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-dc6636f2-3c07-43cd-a8c0-9329b71886e7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:56.546158 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-dc6636f2-3c07-43cd-a8c0-9329b71886e7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/b2c8da69-77b6-4af4-87bc-bbf731043f9f" status: 200 len: 1510 microversion: 2.1 time: 0.243933 Apr 16 21:24:56.546924 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2370/4545] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:56 2022] GET /compute/v2.1/servers/b2c8da69-77b6-4af4-87bc-bbf731043f9f => generated 1510 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:56.559743 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ac5463eb-8456-4e05-ac1b-a245a02fca71 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:56.559743 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ac5463eb-8456-4e05-ac1b-a245a02fca71 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:56.567256 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ac5463eb-8456-4e05-ac1b-a245a02fca71 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:56.567962 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ac5463eb-8456-4e05-ac1b-a245a02fca71 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:56.569022 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ac5463eb-8456-4e05-ac1b-a245a02fca71 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:56.569816 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ac5463eb-8456-4e05-ac1b-a245a02fca71 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:56.601450 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8e77595f-58a7-4d96-9365-3ca6133717d6 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07270856a1734c7f9ee203d79aba637c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56376483435432291c5c3beeeae3354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:56.609978 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8e77595f-58a7-4d96-9365-3ca6133717d6 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07270856a1734c7f9ee203d79aba637c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56376483435432291c5c3beeeae3354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:56.613255 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8e77595f-58a7-4d96-9365-3ca6133717d6 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07270856a1734c7f9ee203d79aba637c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56376483435432291c5c3beeeae3354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:56.614745 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8e77595f-58a7-4d96-9365-3ca6133717d6 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] 10.222.0.20 "GET /compute/v2.1/servers/e9cf01fa-c7fe-47d7-a81a-ce285977ece1" status: 200 len: 1338 microversion: 2.47 time: 0.095925 Apr 16 21:24:56.617787 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2176/4546] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:24:56 2022] GET /compute/v2.1/servers/e9cf01fa-c7fe-47d7-a81a-ce285977ece1 => generated 1338 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:24:56.620901 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-44ac3cb8-cc60-483f-b942-2d3e19d101af tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:56.621747 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-44ac3cb8-cc60-483f-b942-2d3e19d101af tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] [instance: 9c206aa5-5455-49ad-81ee-23ba46fc9d79] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:56.629047 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-44ac3cb8-cc60-483f-b942-2d3e19d101af tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:56.630355 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-44ac3cb8-cc60-483f-b942-2d3e19d101af tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:56.631386 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-44ac3cb8-cc60-483f-b942-2d3e19d101af tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:56.632048 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-44ac3cb8-cc60-483f-b942-2d3e19d101af tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:56.721578 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-44ac3cb8-cc60-483f-b942-2d3e19d101af tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:56.731520 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-44ac3cb8-cc60-483f-b942-2d3e19d101af tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:56.734586 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-44ac3cb8-cc60-483f-b942-2d3e19d101af tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:56.735013 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-44ac3cb8-cc60-483f-b942-2d3e19d101af tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] 10.222.0.20 "GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79" status: 200 len: 1313 microversion: 2.26 time: 0.118221 Apr 16 21:24:56.735907 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2177/4547] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:24:56 2022] GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79 => generated 1313 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:24:56.737420 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ac5463eb-8456-4e05-ac1b-a245a02fca71 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:56.762775 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ac5463eb-8456-4e05-ac1b-a245a02fca71 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1507 microversion: 2.1 time: 0.208551 Apr 16 21:24:56.763403 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2371/4548] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:56 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1507 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:57.564141 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-257d20e8-6da6-461b-9e69-1d1eed67a9a0 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:57.564811 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-257d20e8-6da6-461b-9e69-1d1eed67a9a0 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: b2c8da69-77b6-4af4-87bc-bbf731043f9f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:57.572336 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-257d20e8-6da6-461b-9e69-1d1eed67a9a0 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:57.574226 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-257d20e8-6da6-461b-9e69-1d1eed67a9a0 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:57.575361 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-257d20e8-6da6-461b-9e69-1d1eed67a9a0 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:57.575805 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-257d20e8-6da6-461b-9e69-1d1eed67a9a0 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:57.644130 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b8527380-4389-4f79-84d6-53ed5af04a7d tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:57.646481 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b8527380-4389-4f79-84d6-53ed5af04a7d tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] [instance: e9cf01fa-c7fe-47d7-a81a-ce285977ece1] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:57.659549 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b8527380-4389-4f79-84d6-53ed5af04a7d tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:57.662725 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b8527380-4389-4f79-84d6-53ed5af04a7d tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:57.666737 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b8527380-4389-4f79-84d6-53ed5af04a7d tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:57.667491 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b8527380-4389-4f79-84d6-53ed5af04a7d tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:57.771469 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b8527380-4389-4f79-84d6-53ed5af04a7d tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07270856a1734c7f9ee203d79aba637c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56376483435432291c5c3beeeae3354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:57.781124 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b8527380-4389-4f79-84d6-53ed5af04a7d tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07270856a1734c7f9ee203d79aba637c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56376483435432291c5c3beeeae3354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:57.783464 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b8527380-4389-4f79-84d6-53ed5af04a7d tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07270856a1734c7f9ee203d79aba637c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56376483435432291c5c3beeeae3354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:57.785554 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b8527380-4389-4f79-84d6-53ed5af04a7d tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] 10.222.0.20 "GET /compute/v2.1/servers/e9cf01fa-c7fe-47d7-a81a-ce285977ece1" status: 200 len: 1359 microversion: 2.47 time: 0.152181 Apr 16 21:24:57.788699 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2372/4549] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:24:57 2022] GET /compute/v2.1/servers/e9cf01fa-c7fe-47d7-a81a-ce285977ece1 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:24:57.791770 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-87b14dc0-46fd-46ce-be87-dbebeb7027b3 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:57.792759 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-87b14dc0-46fd-46ce-be87-dbebeb7027b3 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] [instance: 9c206aa5-5455-49ad-81ee-23ba46fc9d79] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:57.799282 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-87b14dc0-46fd-46ce-be87-dbebeb7027b3 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:57.799925 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-87b14dc0-46fd-46ce-be87-dbebeb7027b3 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:57.801028 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-87b14dc0-46fd-46ce-be87-dbebeb7027b3 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:57.802338 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-87b14dc0-46fd-46ce-be87-dbebeb7027b3 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:57.877197 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-87b14dc0-46fd-46ce-be87-dbebeb7027b3 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:57.886613 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-87b14dc0-46fd-46ce-be87-dbebeb7027b3 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:57.888132 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-87b14dc0-46fd-46ce-be87-dbebeb7027b3 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:57.891649 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-87b14dc0-46fd-46ce-be87-dbebeb7027b3 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] 10.222.0.20 "GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79" status: 200 len: 1319 microversion: 2.26 time: 0.104138 Apr 16 21:24:57.892278 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2373/4550] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:24:57 2022] GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79 => generated 1319 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:24:57.917749 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d470e96e-a716-4433-9198-cbe63f10e77b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:57.918770 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d470e96e-a716-4433-9198-cbe63f10e77b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:57.932694 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-257d20e8-6da6-461b-9e69-1d1eed67a9a0 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:57.945345 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-257d20e8-6da6-461b-9e69-1d1eed67a9a0 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/b2c8da69-77b6-4af4-87bc-bbf731043f9f" status: 200 len: 1510 microversion: 2.1 time: 0.385804 Apr 16 21:24:57.948337 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d470e96e-a716-4433-9198-cbe63f10e77b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:57.949600 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2178/4551] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:57 2022] GET /compute/v2.1/servers/b2c8da69-77b6-4af4-87bc-bbf731043f9f => generated 1510 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:57.950808 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d470e96e-a716-4433-9198-cbe63f10e77b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:57.952131 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d470e96e-a716-4433-9198-cbe63f10e77b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:57.954933 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d470e96e-a716-4433-9198-cbe63f10e77b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:57.963768 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c884d10d-fe33-4081-be8c-e3f8f361ee52 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-390387421"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:24:57.967022 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c884d10d-fe33-4081-be8c-e3f8f361ee52 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] [instance: e9cf01fa-c7fe-47d7-a81a-ce285977ece1] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:57.982080 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c884d10d-fe33-4081-be8c-e3f8f361ee52 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:57.982587 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c884d10d-fe33-4081-be8c-e3f8f361ee52 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:57.983384 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c884d10d-fe33-4081-be8c-e3f8f361ee52 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:57.983833 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c884d10d-fe33-4081-be8c-e3f8f361ee52 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:58.704390 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c884d10d-fe33-4081-be8c-e3f8f361ee52 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] 10.222.0.20 "POST /compute/v2.1/servers/e9cf01fa-c7fe-47d7-a81a-ce285977ece1/action" status: 202 len: 52 microversion: 2.47 time: 0.753130 Apr 16 21:24:58.705729 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2179/4552] 10.222.0.20 () {62 vars in 1318 bytes} [Sat Apr 16 21:24:57 2022] POST /compute/v2.1/servers/e9cf01fa-c7fe-47d7-a81a-ce285977ece1/action => generated 52 bytes in 756 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 16 21:24:58.718554 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d470e96e-a716-4433-9198-cbe63f10e77b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:58.727913 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-898a67d4-d917-4972-b9a2-b52a7739289c tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:58.728885 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-898a67d4-d917-4972-b9a2-b52a7739289c tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] [instance: e9cf01fa-c7fe-47d7-a81a-ce285977ece1] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:58.742263 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d470e96e-a716-4433-9198-cbe63f10e77b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1507 microversion: 2.1 time: 0.847498 Apr 16 21:24:58.743421 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2374/4553] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:57 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1507 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:58.758059 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-898a67d4-d917-4972-b9a2-b52a7739289c tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:58.758529 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-898a67d4-d917-4972-b9a2-b52a7739289c tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:58.764292 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-898a67d4-d917-4972-b9a2-b52a7739289c tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:58.764827 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-898a67d4-d917-4972-b9a2-b52a7739289c tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:58.812086 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-898a67d4-d917-4972-b9a2-b52a7739289c tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] [instance: e9cf01fa-c7fe-47d7-a81a-ce285977ece1] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:24:58.921312 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b152104c-525c-414e-8585-751d3189c8e6 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:58.934401 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b152104c-525c-414e-8585-751d3189c8e6 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] [instance: 9c206aa5-5455-49ad-81ee-23ba46fc9d79] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:58.939520 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b152104c-525c-414e-8585-751d3189c8e6 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:58.941877 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b152104c-525c-414e-8585-751d3189c8e6 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:58.944080 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b152104c-525c-414e-8585-751d3189c8e6 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:58.945056 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b152104c-525c-414e-8585-751d3189c8e6 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:59.045157 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b152104c-525c-414e-8585-751d3189c8e6 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:59.054085 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b152104c-525c-414e-8585-751d3189c8e6 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:59.056434 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b152104c-525c-414e-8585-751d3189c8e6 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:59.057609 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b152104c-525c-414e-8585-751d3189c8e6 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] 10.222.0.20 "GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79" status: 200 len: 1319 microversion: 2.26 time: 0.148597 Apr 16 21:24:59.058188 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2375/4554] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:24:58 2022] GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:24:59.063730 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e4c00378-cc60-4b0c-8377-9b71c25dd453 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:59.064378 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e4c00378-cc60-4b0c-8377-9b71c25dd453 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: b2c8da69-77b6-4af4-87bc-bbf731043f9f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:59.071632 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e4c00378-cc60-4b0c-8377-9b71c25dd453 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:59.072093 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e4c00378-cc60-4b0c-8377-9b71c25dd453 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:59.072898 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e4c00378-cc60-4b0c-8377-9b71c25dd453 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:59.073505 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e4c00378-cc60-4b0c-8377-9b71c25dd453 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:59.216007 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e4c00378-cc60-4b0c-8377-9b71c25dd453 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:59.224264 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e4c00378-cc60-4b0c-8377-9b71c25dd453 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/b2c8da69-77b6-4af4-87bc-bbf731043f9f" status: 200 len: 1510 microversion: 2.1 time: 0.165018 Apr 16 21:24:59.224831 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2376/4555] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:59 2022] GET /compute/v2.1/servers/b2c8da69-77b6-4af4-87bc-bbf731043f9f => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:24:59.470276 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-898a67d4-d917-4972-b9a2-b52a7739289c tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e9cf01fa-c7fe-47d7-a81a-ce285977ece1" status: 204 len: 0 microversion: 2.47 time: 0.755812 Apr 16 21:24:59.471169 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2180/4556] 10.222.0.20 () {60 vars in 1279 bytes} [Sat Apr 16 21:24:58 2022] DELETE /compute/v2.1/servers/e9cf01fa-c7fe-47d7-a81a-ce285977ece1 => generated 0 bytes in 758 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 16 21:24:59.480149 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-961fb604-5848-427a-94aa-86c174517cd1 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:59.487526 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-1ed8889e-f159-4539-84fd-79365f55063e req-69e791b8-6df9-4008-b4de-289e1b0cc33a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2c8da69-77b6-4af4-87bc-bbf731043f9f", "name": "network-vif-deleted", "tag": "bf49cd01-b6d1-4305-b056-a5382b1d1716"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:24:59.488006 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-961fb604-5848-427a-94aa-86c174517cd1 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] [instance: e9cf01fa-c7fe-47d7-a81a-ce285977ece1] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:59.499580 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-961fb604-5848-427a-94aa-86c174517cd1 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:59.502130 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-961fb604-5848-427a-94aa-86c174517cd1 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:59.504105 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-961fb604-5848-427a-94aa-86c174517cd1 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:59.505325 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-961fb604-5848-427a-94aa-86c174517cd1 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:59.506734 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-1ed8889e-f159-4539-84fd-79365f55063e req-69e791b8-6df9-4008-b4de-289e1b0cc33a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:59.510048 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-1ed8889e-f159-4539-84fd-79365f55063e req-69e791b8-6df9-4008-b4de-289e1b0cc33a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:59.531958 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-1ed8889e-f159-4539-84fd-79365f55063e req-69e791b8-6df9-4008-b4de-289e1b0cc33a service nova] Creating event network-vif-deleted:bf49cd01-b6d1-4305-b056-a5382b1d1716 for instance b2c8da69-77b6-4af4-87bc-bbf731043f9f on nch2-master-1 Apr 16 21:24:59.542989 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-1ed8889e-f159-4539-84fd-79365f55063e req-69e791b8-6df9-4008-b4de-289e1b0cc33a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059999 Apr 16 21:24:59.544333 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2181/4557] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:24:59.606816 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-961fb604-5848-427a-94aa-86c174517cd1 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07270856a1734c7f9ee203d79aba637c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56376483435432291c5c3beeeae3354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:59.615706 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-961fb604-5848-427a-94aa-86c174517cd1 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07270856a1734c7f9ee203d79aba637c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56376483435432291c5c3beeeae3354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:59.617508 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-961fb604-5848-427a-94aa-86c174517cd1 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07270856a1734c7f9ee203d79aba637c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56376483435432291c5c3beeeae3354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:24:59.618954 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-961fb604-5848-427a-94aa-86c174517cd1 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] 10.222.0.20 "GET /compute/v2.1/servers/e9cf01fa-c7fe-47d7-a81a-ce285977ece1" status: 200 len: 1365 microversion: 2.47 time: 0.142851 Apr 16 21:24:59.619916 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2377/4558] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:24:59 2022] GET /compute/v2.1/servers/e9cf01fa-c7fe-47d7-a81a-ce285977ece1 => generated 1365 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:24:59.761489 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-86ad4099-2d9f-4472-a944-94d48c00a53b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:24:59.762254 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-86ad4099-2d9f-4472-a944-94d48c00a53b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:24:59.768914 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-86ad4099-2d9f-4472-a944-94d48c00a53b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:59.769993 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-86ad4099-2d9f-4472-a944-94d48c00a53b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:24:59.771523 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-86ad4099-2d9f-4472-a944-94d48c00a53b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:24:59.773480 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-86ad4099-2d9f-4472-a944-94d48c00a53b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:00.061402 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-86ad4099-2d9f-4472-a944-94d48c00a53b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:00.069970 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-86ad4099-2d9f-4472-a944-94d48c00a53b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1507 microversion: 2.1 time: 0.314374 Apr 16 21:25:00.070775 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2182/4559] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:24:59 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1507 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:00.118079 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-23415376-4b2d-423e-9c05-b1226f86c9b9 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:00.118986 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-23415376-4b2d-423e-9c05-b1226f86c9b9 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] [instance: 9c206aa5-5455-49ad-81ee-23ba46fc9d79] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:00.125740 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-23415376-4b2d-423e-9c05-b1226f86c9b9 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:00.126200 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-23415376-4b2d-423e-9c05-b1226f86c9b9 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:00.127002 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-23415376-4b2d-423e-9c05-b1226f86c9b9 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:00.127455 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-23415376-4b2d-423e-9c05-b1226f86c9b9 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:00.241877 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c1b58b75-5498-4185-b855-0314b33b1935 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:00.242830 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c1b58b75-5498-4185-b855-0314b33b1935 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: b2c8da69-77b6-4af4-87bc-bbf731043f9f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:00.253910 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c1b58b75-5498-4185-b855-0314b33b1935 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:00.253910 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c1b58b75-5498-4185-b855-0314b33b1935 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:00.253910 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c1b58b75-5498-4185-b855-0314b33b1935 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:00.253910 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c1b58b75-5498-4185-b855-0314b33b1935 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:00.285671 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c1b58b75-5498-4185-b855-0314b33b1935 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:00.286244 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c1b58b75-5498-4185-b855-0314b33b1935 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:00.286783 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-c1b58b75-5498-4185-b855-0314b33b1935 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lazy-loading 'fault' on Instance uuid b2c8da69-77b6-4af4-87bc-bbf731043f9f {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:25:00.346650 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-23415376-4b2d-423e-9c05-b1226f86c9b9 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:00.355591 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-23415376-4b2d-423e-9c05-b1226f86c9b9 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:00.358212 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-23415376-4b2d-423e-9c05-b1226f86c9b9 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:00.359601 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-23415376-4b2d-423e-9c05-b1226f86c9b9 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] 10.222.0.20 "GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79" status: 200 len: 1361 microversion: 2.26 time: 0.246167 Apr 16 21:25:00.360892 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2378/4560] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:00 2022] GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79 => generated 1361 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:00.412336 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c1b58b75-5498-4185-b855-0314b33b1935 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:00.429884 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c1b58b75-5498-4185-b855-0314b33b1935 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/b2c8da69-77b6-4af4-87bc-bbf731043f9f" status: 200 len: 1306 microversion: 2.1 time: 0.191828 Apr 16 21:25:00.431266 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2183/4561] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:00 2022] GET /compute/v2.1/servers/b2c8da69-77b6-4af4-87bc-bbf731043f9f => generated 1306 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:00.638212 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9ab413d3-fc26-448d-9f70-ec251a34c2ed tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:00.638850 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9ab413d3-fc26-448d-9f70-ec251a34c2ed tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] [instance: e9cf01fa-c7fe-47d7-a81a-ce285977ece1] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:00.645900 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9ab413d3-fc26-448d-9f70-ec251a34c2ed tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:00.646374 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9ab413d3-fc26-448d-9f70-ec251a34c2ed tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:00.647185 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9ab413d3-fc26-448d-9f70-ec251a34c2ed tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:00.647627 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9ab413d3-fc26-448d-9f70-ec251a34c2ed tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:00.737294 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-25c322cc-82de-478f-bc21-4f888e818aee req-148c6dfd-3da7-4aab-bee2-e4820146a4c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c206aa5-5455-49ad-81ee-23ba46fc9d79", "tag": "edfa0ac5-33d0-466c-89bb-63c2070d6c89"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:00.740802 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9ab413d3-fc26-448d-9f70-ec251a34c2ed tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07270856a1734c7f9ee203d79aba637c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56376483435432291c5c3beeeae3354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:00.747765 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-25c322cc-82de-478f-bc21-4f888e818aee req-148c6dfd-3da7-4aab-bee2-e4820146a4c6 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:00.748289 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-25c322cc-82de-478f-bc21-4f888e818aee req-148c6dfd-3da7-4aab-bee2-e4820146a4c6 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:00.756544 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9ab413d3-fc26-448d-9f70-ec251a34c2ed tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07270856a1734c7f9ee203d79aba637c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56376483435432291c5c3beeeae3354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:00.757748 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9ab413d3-fc26-448d-9f70-ec251a34c2ed tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07270856a1734c7f9ee203d79aba637c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56376483435432291c5c3beeeae3354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:00.758932 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9ab413d3-fc26-448d-9f70-ec251a34c2ed tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] 10.222.0.20 "GET /compute/v2.1/servers/e9cf01fa-c7fe-47d7-a81a-ce285977ece1" status: 200 len: 1365 microversion: 2.47 time: 0.124704 Apr 16 21:25:00.759807 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2379/4562] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:00 2022] GET /compute/v2.1/servers/e9cf01fa-c7fe-47d7-a81a-ce285977ece1 => generated 1365 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:00.771414 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-25c322cc-82de-478f-bc21-4f888e818aee req-148c6dfd-3da7-4aab-bee2-e4820146a4c6 service nova] Creating event network-changed:edfa0ac5-33d0-466c-89bb-63c2070d6c89 for instance 9c206aa5-5455-49ad-81ee-23ba46fc9d79 on nch1-master-1 Apr 16 21:25:00.777599 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-25c322cc-82de-478f-bc21-4f888e818aee req-148c6dfd-3da7-4aab-bee2-e4820146a4c6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044588 Apr 16 21:25:00.778198 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2184/4563] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:25:01.086758 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c3b15ccb-7aa2-4682-aec4-fc58f69de9b1 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:01.087395 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c3b15ccb-7aa2-4682-aec4-fc58f69de9b1 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:01.093734 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3b15ccb-7aa2-4682-aec4-fc58f69de9b1 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:01.094409 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3b15ccb-7aa2-4682-aec4-fc58f69de9b1 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:01.095471 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3b15ccb-7aa2-4682-aec4-fc58f69de9b1 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:01.095984 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3b15ccb-7aa2-4682-aec4-fc58f69de9b1 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:01.324351 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c3b15ccb-7aa2-4682-aec4-fc58f69de9b1 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:01.332125 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c3b15ccb-7aa2-4682-aec4-fc58f69de9b1 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1507 microversion: 2.1 time: 0.249295 Apr 16 21:25:01.333547 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2380/4564] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:01 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1507 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:01.380512 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e220f7e4-9fbc-4982-a5e0-99ce592dd1f1 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:01.381406 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e220f7e4-9fbc-4982-a5e0-99ce592dd1f1 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] [instance: 9c206aa5-5455-49ad-81ee-23ba46fc9d79] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:01.391009 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e220f7e4-9fbc-4982-a5e0-99ce592dd1f1 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:01.391009 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e220f7e4-9fbc-4982-a5e0-99ce592dd1f1 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:01.391009 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e220f7e4-9fbc-4982-a5e0-99ce592dd1f1 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:01.391907 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e220f7e4-9fbc-4982-a5e0-99ce592dd1f1 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:01.447916 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-88425587-b639-4f88-9a1c-9df23706b696 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:01.448630 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-88425587-b639-4f88-9a1c-9df23706b696 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: b2c8da69-77b6-4af4-87bc-bbf731043f9f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:01.468663 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-88425587-b639-4f88-9a1c-9df23706b696 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:01.469333 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-88425587-b639-4f88-9a1c-9df23706b696 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:01.470641 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-88425587-b639-4f88-9a1c-9df23706b696 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:01.471307 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-88425587-b639-4f88-9a1c-9df23706b696 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:01.487867 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-88425587-b639-4f88-9a1c-9df23706b696 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] HTTP exception thrown: Instance b2c8da69-77b6-4af4-87bc-bbf731043f9f could not be found. Apr 16 21:25:01.489370 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-88425587-b639-4f88-9a1c-9df23706b696 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Returning 404 to user: Instance b2c8da69-77b6-4af4-87bc-bbf731043f9f could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:25:01.490929 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-88425587-b639-4f88-9a1c-9df23706b696 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/b2c8da69-77b6-4af4-87bc-bbf731043f9f" status: 404 len: 111 microversion: 2.1 time: 0.046934 Apr 16 21:25:01.492136 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2381/4565] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:01 2022] GET /compute/v2.1/servers/b2c8da69-77b6-4af4-87bc-bbf731043f9f => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:25:01.500672 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d5dd995c-da5c-471e-b854-f172a61e0d24 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:01.502521 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d5dd995c-da5c-471e-b854-f172a61e0d24 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:01.509891 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d5dd995c-da5c-471e-b854-f172a61e0d24 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:01.511933 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d5dd995c-da5c-471e-b854-f172a61e0d24 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:01.511933 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d5dd995c-da5c-471e-b854-f172a61e0d24 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:01.512550 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d5dd995c-da5c-471e-b854-f172a61e0d24 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:01.734998 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e220f7e4-9fbc-4982-a5e0-99ce592dd1f1 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:01.755106 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e220f7e4-9fbc-4982-a5e0-99ce592dd1f1 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:01.760106 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e220f7e4-9fbc-4982-a5e0-99ce592dd1f1 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:01.761375 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d5dd995c-da5c-471e-b854-f172a61e0d24 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:01.761718 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e220f7e4-9fbc-4982-a5e0-99ce592dd1f1 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] 10.222.0.20 "GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79" status: 200 len: 1361 microversion: 2.26 time: 0.386523 Apr 16 21:25:01.762487 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2185/4566] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:01 2022] GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79 => generated 1361 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:25:01.781786 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2e9acebd-f448-4810-9946-b5959d1801e3 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:01.782407 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2e9acebd-f448-4810-9946-b5959d1801e3 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] [instance: e9cf01fa-c7fe-47d7-a81a-ce285977ece1] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:01.783420 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d5dd995c-da5c-471e-b854-f172a61e0d24 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.286763 Apr 16 21:25:01.788239 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2382/4567] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:01 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:01.790520 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2e9acebd-f448-4810-9946-b5959d1801e3 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:01.791030 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2e9acebd-f448-4810-9946-b5959d1801e3 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:01.791828 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2e9acebd-f448-4810-9946-b5959d1801e3 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:01.792310 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2e9acebd-f448-4810-9946-b5959d1801e3 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:01.914675 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b05557d2-42fd-4ee3-88de-06da0f69f86e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "1b9ee265-bdab-4092-8071-c9bb95d911fb"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:01.915942 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b05557d2-42fd-4ee3-88de-06da0f69f86e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:25:01.916878 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b05557d2-42fd-4ee3-88de-06da0f69f86e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.007116 Apr 16 21:25:01.918762 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2383/4568] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:25:01 2022] POST /compute/v2.1/servers => generated 127 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:25:01.930175 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f27b983a-6f9b-4009-96eb-2654fdb5aa48 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:01.930962 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f27b983a-6f9b-4009-96eb-2654fdb5aa48 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:01.947894 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2e9acebd-f448-4810-9946-b5959d1801e3 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07270856a1734c7f9ee203d79aba637c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56376483435432291c5c3beeeae3354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:01.948702 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f27b983a-6f9b-4009-96eb-2654fdb5aa48 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:01.949302 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f27b983a-6f9b-4009-96eb-2654fdb5aa48 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:01.950237 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f27b983a-6f9b-4009-96eb-2654fdb5aa48 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:01.950927 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f27b983a-6f9b-4009-96eb-2654fdb5aa48 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:01.985911 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2e9acebd-f448-4810-9946-b5959d1801e3 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07270856a1734c7f9ee203d79aba637c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56376483435432291c5c3beeeae3354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:01.993249 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2e9acebd-f448-4810-9946-b5959d1801e3 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07270856a1734c7f9ee203d79aba637c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56376483435432291c5c3beeeae3354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:01.997509 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2e9acebd-f448-4810-9946-b5959d1801e3 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] 10.222.0.20 "GET /compute/v2.1/servers/e9cf01fa-c7fe-47d7-a81a-ce285977ece1" status: 200 len: 1365 microversion: 2.47 time: 0.220113 Apr 16 21:25:02.010446 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2186/4569] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:01 2022] GET /compute/v2.1/servers/e9cf01fa-c7fe-47d7-a81a-ce285977ece1 => generated 1365 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:02.015990 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ddc8f866-fa23-4e07-9bbb-2cd2792231ab tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:02.016729 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ddc8f866-fa23-4e07-9bbb-2cd2792231ab tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 8d623e8d-480f-48ef-b90c-04450df4aec8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:02.023925 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ddc8f866-fa23-4e07-9bbb-2cd2792231ab tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:02.024622 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ddc8f866-fa23-4e07-9bbb-2cd2792231ab tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:02.025610 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ddc8f866-fa23-4e07-9bbb-2cd2792231ab tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:02.026216 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ddc8f866-fa23-4e07-9bbb-2cd2792231ab tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:02.052938 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ddc8f866-fa23-4e07-9bbb-2cd2792231ab tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8/ips" status: 200 len: 150 microversion: 2.1 time: 0.040860 Apr 16 21:25:02.053822 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2187/4570] 10.222.0.20 () {58 vars in 1247 bytes} [Sat Apr 16 21:25:02 2022] GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8/ips => generated 150 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:25:02.170981 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f27b983a-6f9b-4009-96eb-2654fdb5aa48 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:02.179335 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f27b983a-6f9b-4009-96eb-2654fdb5aa48 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.253008 Apr 16 21:25:02.179921 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2384/4571] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:01 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:25:02.199106 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0ec2e546-567f-47de-9491-2f36353002d9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:02.200477 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0ec2e546-567f-47de-9491-2f36353002d9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:02.207121 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0ec2e546-567f-47de-9491-2f36353002d9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:02.208462 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0ec2e546-567f-47de-9491-2f36353002d9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:02.209418 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0ec2e546-567f-47de-9491-2f36353002d9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:02.210022 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0ec2e546-567f-47de-9491-2f36353002d9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:02.351286 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a3f849cf-60b0-407e-87f8-07bcb357b6a9 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:02.351890 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a3f849cf-60b0-407e-87f8-07bcb357b6a9 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:02.358677 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a3f849cf-60b0-407e-87f8-07bcb357b6a9 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:02.359358 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a3f849cf-60b0-407e-87f8-07bcb357b6a9 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:02.360159 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a3f849cf-60b0-407e-87f8-07bcb357b6a9 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:02.361284 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a3f849cf-60b0-407e-87f8-07bcb357b6a9 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:02.446550 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0ec2e546-567f-47de-9491-2f36353002d9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:02.454284 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0ec2e546-567f-47de-9491-2f36353002d9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.260403 Apr 16 21:25:02.454876 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2188/4572] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:02 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:02.568474 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a3f849cf-60b0-407e-87f8-07bcb357b6a9 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:02.577274 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a3f849cf-60b0-407e-87f8-07bcb357b6a9 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1507 microversion: 2.1 time: 0.230481 Apr 16 21:25:02.588333 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2385/4573] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:02 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1507 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:02.785513 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8336d04a-17dd-43a5-8fb2-28dacdc51c73 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:02.787278 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8336d04a-17dd-43a5-8fb2-28dacdc51c73 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] [instance: 9c206aa5-5455-49ad-81ee-23ba46fc9d79] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:02.804165 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8336d04a-17dd-43a5-8fb2-28dacdc51c73 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:02.804165 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8336d04a-17dd-43a5-8fb2-28dacdc51c73 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:02.804612 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8336d04a-17dd-43a5-8fb2-28dacdc51c73 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:02.805238 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8336d04a-17dd-43a5-8fb2-28dacdc51c73 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:03.017282 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6b0616c9-8f84-48bd-99a6-206f22c0e4f7 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:03.018301 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6b0616c9-8f84-48bd-99a6-206f22c0e4f7 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] [instance: e9cf01fa-c7fe-47d7-a81a-ce285977ece1] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:03.026069 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6b0616c9-8f84-48bd-99a6-206f22c0e4f7 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:03.031223 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6b0616c9-8f84-48bd-99a6-206f22c0e4f7 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:03.031223 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6b0616c9-8f84-48bd-99a6-206f22c0e4f7 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:03.031223 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6b0616c9-8f84-48bd-99a6-206f22c0e4f7 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:03.054152 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8336d04a-17dd-43a5-8fb2-28dacdc51c73 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:03.061351 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8336d04a-17dd-43a5-8fb2-28dacdc51c73 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:03.062905 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8336d04a-17dd-43a5-8fb2-28dacdc51c73 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:03.065006 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8336d04a-17dd-43a5-8fb2-28dacdc51c73 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] 10.222.0.20 "GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79" status: 200 len: 1361 microversion: 2.26 time: 0.285200 Apr 16 21:25:03.065898 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2189/4574] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:02 2022] GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79 => generated 1361 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:03.069700 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6b0616c9-8f84-48bd-99a6-206f22c0e4f7 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:03.070361 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6b0616c9-8f84-48bd-99a6-206f22c0e4f7 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:03.071602 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-6b0616c9-8f84-48bd-99a6-206f22c0e4f7 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lazy-loading 'fault' on Instance uuid e9cf01fa-c7fe-47d7-a81a-ce285977ece1 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:25:03.126510 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6b0616c9-8f84-48bd-99a6-206f22c0e4f7 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07270856a1734c7f9ee203d79aba637c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56376483435432291c5c3beeeae3354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:03.134939 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6b0616c9-8f84-48bd-99a6-206f22c0e4f7 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '07270856a1734c7f9ee203d79aba637c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56376483435432291c5c3beeeae3354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:03.136527 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6b0616c9-8f84-48bd-99a6-206f22c0e4f7 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '07270856a1734c7f9ee203d79aba637c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b56376483435432291c5c3beeeae3354', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:03.137719 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6b0616c9-8f84-48bd-99a6-206f22c0e4f7 tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] 10.222.0.20 "GET /compute/v2.1/servers/e9cf01fa-c7fe-47d7-a81a-ce285977ece1" status: 200 len: 1370 microversion: 2.47 time: 0.124701 Apr 16 21:25:03.138279 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2386/4575] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:03 2022] GET /compute/v2.1/servers/e9cf01fa-c7fe-47d7-a81a-ce285977ece1 => generated 1370 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:25:03.595401 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-583772f8-20e6-4fb4-b816-dd4094f89452 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:03.596236 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-583772f8-20e6-4fb4-b816-dd4094f89452 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:03.602989 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-583772f8-20e6-4fb4-b816-dd4094f89452 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:03.603456 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-583772f8-20e6-4fb4-b816-dd4094f89452 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:03.604534 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-583772f8-20e6-4fb4-b816-dd4094f89452 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:03.604985 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-583772f8-20e6-4fb4-b816-dd4094f89452 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:04.083945 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3a102aa8-eb03-4b1d-9eee-e171d1e5e41b tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:04.084912 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3a102aa8-eb03-4b1d-9eee-e171d1e5e41b tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] [instance: 9c206aa5-5455-49ad-81ee-23ba46fc9d79] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:04.091314 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3a102aa8-eb03-4b1d-9eee-e171d1e5e41b tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:04.091936 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3a102aa8-eb03-4b1d-9eee-e171d1e5e41b tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:04.093001 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3a102aa8-eb03-4b1d-9eee-e171d1e5e41b tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:04.093574 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3a102aa8-eb03-4b1d-9eee-e171d1e5e41b tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:04.111000 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-583772f8-20e6-4fb4-b816-dd4094f89452 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:04.119027 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-583772f8-20e6-4fb4-b816-dd4094f89452 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1507 microversion: 2.1 time: 0.528485 Apr 16 21:25:04.120416 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2190/4576] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:03 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1507 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:04.167987 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f00fa665-de45-4838-8a37-6591165b2bca tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:04.171821 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f00fa665-de45-4838-8a37-6591165b2bca tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] [instance: e9cf01fa-c7fe-47d7-a81a-ce285977ece1] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:04.203398 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f00fa665-de45-4838-8a37-6591165b2bca tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:04.204305 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f00fa665-de45-4838-8a37-6591165b2bca tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:04.208906 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f00fa665-de45-4838-8a37-6591165b2bca tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:04.209382 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f00fa665-de45-4838-8a37-6591165b2bca tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:04.256640 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-f00fa665-de45-4838-8a37-6591165b2bca tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] HTTP exception thrown: Instance e9cf01fa-c7fe-47d7-a81a-ce285977ece1 could not be found. Apr 16 21:25:04.258054 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f00fa665-de45-4838-8a37-6591165b2bca tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] Returning 404 to user: Instance e9cf01fa-c7fe-47d7-a81a-ce285977ece1 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:25:04.259882 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f00fa665-de45-4838-8a37-6591165b2bca tempest-ServersAaction247Test-7754274 tempest-ServersAaction247Test-7754274-project] 10.222.0.20 "GET /compute/v2.1/servers/e9cf01fa-c7fe-47d7-a81a-ce285977ece1" status: 404 len: 111 microversion: 2.47 time: 0.105918 Apr 16 21:25:04.261475 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2191/4577] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:04 2022] GET /compute/v2.1/servers/e9cf01fa-c7fe-47d7-a81a-ce285977ece1 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:25:04.338802 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3a102aa8-eb03-4b1d-9eee-e171d1e5e41b tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:04.347407 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3a102aa8-eb03-4b1d-9eee-e171d1e5e41b tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:04.349940 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3a102aa8-eb03-4b1d-9eee-e171d1e5e41b tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:04.352469 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3a102aa8-eb03-4b1d-9eee-e171d1e5e41b tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] 10.222.0.20 "GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79" status: 200 len: 1361 microversion: 2.26 time: 0.271995 Apr 16 21:25:04.352469 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2387/4578] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:04 2022] GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79 => generated 1361 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:25:05.137047 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2295328c-b7a8-41d7-adb2-e2093d196c0a tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:05.137662 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2295328c-b7a8-41d7-adb2-e2093d196c0a tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:05.144474 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2295328c-b7a8-41d7-adb2-e2093d196c0a tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:05.144930 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2295328c-b7a8-41d7-adb2-e2093d196c0a tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:05.146444 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2295328c-b7a8-41d7-adb2-e2093d196c0a tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:05.146888 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2295328c-b7a8-41d7-adb2-e2093d196c0a tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:05.372703 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-718ecde1-cb0e-4bf0-a106-38cd861db711 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:05.373323 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-718ecde1-cb0e-4bf0-a106-38cd861db711 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] [instance: 9c206aa5-5455-49ad-81ee-23ba46fc9d79] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:05.395522 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-718ecde1-cb0e-4bf0-a106-38cd861db711 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:05.397259 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-718ecde1-cb0e-4bf0-a106-38cd861db711 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:05.398782 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-718ecde1-cb0e-4bf0-a106-38cd861db711 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:05.399400 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-718ecde1-cb0e-4bf0-a106-38cd861db711 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:05.595891 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2295328c-b7a8-41d7-adb2-e2093d196c0a tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:05.609628 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2295328c-b7a8-41d7-adb2-e2093d196c0a tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1507 microversion: 2.1 time: 0.476713 Apr 16 21:25:05.610555 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2192/4579] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:05 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1507 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:05.620576 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-718ecde1-cb0e-4bf0-a106-38cd861db711 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:05.631268 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-718ecde1-cb0e-4bf0-a106-38cd861db711 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:05.632792 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-718ecde1-cb0e-4bf0-a106-38cd861db711 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:05.633977 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-718ecde1-cb0e-4bf0-a106-38cd861db711 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] 10.222.0.20 "GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79" status: 200 len: 1361 microversion: 2.26 time: 0.268029 Apr 16 21:25:05.634546 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2388/4580] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:05 2022] GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79 => generated 1361 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:05.769307 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4baf2ff5-46d1-4f63-8678-32260c6e5733 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1342714070", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "302aed6d-4327-400f-b1cc-7330052c22f1", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "1b9ee265-bdab-4092-8071-c9bb95d911fb"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:05.831295 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-4baf2ff5-46d1-4f63-8678-32260c6e5733 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] HTTP exception thrown: Block Device 302aed6d-4327-400f-b1cc-7330052c22f1 is not bootable. Apr 16 21:25:05.831912 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4baf2ff5-46d1-4f63-8678-32260c6e5733 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Returning 400 to user: Block Device 302aed6d-4327-400f-b1cc-7330052c22f1 is not bootable. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:25:05.833520 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4baf2ff5-46d1-4f63-8678-32260c6e5733 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.067446 Apr 16 21:25:05.834242 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2193/4581] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:25:05 2022] POST /compute/v2.1/servers => generated 110 bytes in 69 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:25:05.842515 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8e6c3eb0-2bb4-446a-8a4a-7d483384a5b9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:05.843181 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8e6c3eb0-2bb4-446a-8a4a-7d483384a5b9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:05.849864 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8e6c3eb0-2bb4-446a-8a4a-7d483384a5b9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:05.850516 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8e6c3eb0-2bb4-446a-8a4a-7d483384a5b9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:05.851455 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8e6c3eb0-2bb4-446a-8a4a-7d483384a5b9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:05.852041 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8e6c3eb0-2bb4-446a-8a4a-7d483384a5b9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:06.070748 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8e6c3eb0-2bb4-446a-8a4a-7d483384a5b9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:06.083322 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8e6c3eb0-2bb4-446a-8a4a-7d483384a5b9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.244651 Apr 16 21:25:06.103970 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-56a2b810-95db-4a33-b7f7-c9bc52f45f70 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:06.107647 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-56a2b810-95db-4a33-b7f7-c9bc52f45f70 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:06.108068 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2389/4582] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:05 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:06.112885 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-56a2b810-95db-4a33-b7f7-c9bc52f45f70 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:06.114314 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-56a2b810-95db-4a33-b7f7-c9bc52f45f70 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:06.115905 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-56a2b810-95db-4a33-b7f7-c9bc52f45f70 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:06.116577 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-56a2b810-95db-4a33-b7f7-c9bc52f45f70 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:06.206431 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4a2aba76-78d7-4972-b34c-75bb1a7b2c14 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a89555a4-c1fe-4512-9779-1ac4ed29f291"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:06.208569 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4a2aba76-78d7-4972-b34c-75bb1a7b2c14 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 8d623e8d-480f-48ef-b90c-04450df4aec8] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:06.215722 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4a2aba76-78d7-4972-b34c-75bb1a7b2c14 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:06.225596 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4a2aba76-78d7-4972-b34c-75bb1a7b2c14 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:06.225596 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4a2aba76-78d7-4972-b34c-75bb1a7b2c14 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:06.225596 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4a2aba76-78d7-4972-b34c-75bb1a7b2c14 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:06.325260 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-56a2b810-95db-4a33-b7f7-c9bc52f45f70 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:06.333538 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-56a2b810-95db-4a33-b7f7-c9bc52f45f70 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.235555 Apr 16 21:25:06.344552 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2194/4583] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:06 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:06.627494 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3dd54040-dfea-455c-9e1c-e3ea295f4d18 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:06.628152 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3dd54040-dfea-455c-9e1c-e3ea295f4d18 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:06.635414 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3dd54040-dfea-455c-9e1c-e3ea295f4d18 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:06.635884 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3dd54040-dfea-455c-9e1c-e3ea295f4d18 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:06.636718 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3dd54040-dfea-455c-9e1c-e3ea295f4d18 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:06.637195 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3dd54040-dfea-455c-9e1c-e3ea295f4d18 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:06.820723 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3dd54040-dfea-455c-9e1c-e3ea295f4d18 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:06.829968 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3dd54040-dfea-455c-9e1c-e3ea295f4d18 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1507 microversion: 2.1 time: 0.206346 Apr 16 21:25:06.831570 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2195/4584] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:06 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1507 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:06.837376 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-84db0f3c-6ce7-4236-b1e0-59ed6cc48ab9 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:06.838086 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-84db0f3c-6ce7-4236-b1e0-59ed6cc48ab9 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] [instance: 9c206aa5-5455-49ad-81ee-23ba46fc9d79] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:06.844706 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-84db0f3c-6ce7-4236-b1e0-59ed6cc48ab9 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:06.845536 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-84db0f3c-6ce7-4236-b1e0-59ed6cc48ab9 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:06.846741 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-84db0f3c-6ce7-4236-b1e0-59ed6cc48ab9 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:06.847440 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-84db0f3c-6ce7-4236-b1e0-59ed6cc48ab9 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:07.017004 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-84db0f3c-6ce7-4236-b1e0-59ed6cc48ab9 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:07.025048 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-84db0f3c-6ce7-4236-b1e0-59ed6cc48ab9 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:07.026841 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-84db0f3c-6ce7-4236-b1e0-59ed6cc48ab9 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:07.028208 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-84db0f3c-6ce7-4236-b1e0-59ed6cc48ab9 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] 10.222.0.20 "GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79" status: 200 len: 1361 microversion: 2.26 time: 0.195256 Apr 16 21:25:07.028955 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2196/4585] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:06 2022] GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79 => generated 1361 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:07.604375 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-60e0b482-9da3-48fb-9514-5ae231ed5d0c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-511703971", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": "none"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:07.658214 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-60e0b482-9da3-48fb-9514-5ae231ed5d0c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:25:07.659905 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-60e0b482-9da3-48fb-9514-5ae231ed5d0c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:25:07.659905 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-60e0b482-9da3-48fb-9514-5ae231ed5d0c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:25:07.659905 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-60e0b482-9da3-48fb-9514-5ae231ed5d0c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:25:07.660240 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-60e0b482-9da3-48fb-9514-5ae231ed5d0c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:25:07.669401 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-60e0b482-9da3-48fb-9514-5ae231ed5d0c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:07.669860 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-60e0b482-9da3-48fb-9514-5ae231ed5d0c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:07.670713 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-60e0b482-9da3-48fb-9514-5ae231ed5d0c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:07.671216 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-60e0b482-9da3-48fb-9514-5ae231ed5d0c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:07.688831 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-60e0b482-9da3-48fb-9514-5ae231ed5d0c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Getting quotas for project 94f6b07b308c4af99aaecfbf00e08590. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:25:07.694028 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-60e0b482-9da3-48fb-9514-5ae231ed5d0c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Getting quotas for user 6d933704fe0946419f1644c2f19b2431 and project 94f6b07b308c4af99aaecfbf00e08590. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:25:07.706572 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-60e0b482-9da3-48fb-9514-5ae231ed5d0c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:25:07.709525 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-60e0b482-9da3-48fb-9514-5ae231ed5d0c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] [instance: 5bec80bd-63c1-45bf-a379-98f4c375f318] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:25:07.950302 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-60e0b482-9da3-48fb-9514-5ae231ed5d0c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.529748 Apr 16 21:25:07.951123 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2197/4586] 10.222.0.20 () {62 vars in 1187 bytes} [Sat Apr 16 21:25:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 531 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 16 21:25:07.958595 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4b6183c7-7763-4b86-8725-55a4a56da6a5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:07.969095 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4b6183c7-7763-4b86-8725-55a4a56da6a5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:07.976112 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4b6183c7-7763-4b86-8725-55a4a56da6a5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:07.976593 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4b6183c7-7763-4b86-8725-55a4a56da6a5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:07.977380 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4b6183c7-7763-4b86-8725-55a4a56da6a5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:07.977855 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4b6183c7-7763-4b86-8725-55a4a56da6a5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:08.050884 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4a2aba76-78d7-4972-b34c-75bb1a7b2c14 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "POST /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.849605 Apr 16 21:25:08.056363 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2390/4587] 10.222.0.20 () {60 vars in 1322 bytes} [Sat Apr 16 21:25:06 2022] POST /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8/os-volume_attachments => generated 194 bytes in 1856 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:25:08.063058 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e9b4f34f-3139-416f-ba0f-18dc03a5a56b tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:08.063950 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e9b4f34f-3139-416f-ba0f-18dc03a5a56b tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] [instance: 5bec80bd-63c1-45bf-a379-98f4c375f318] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:08.139386 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e9b4f34f-3139-416f-ba0f-18dc03a5a56b tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:08.149215 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4b6183c7-7763-4b86-8725-55a4a56da6a5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:08.161692 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4b6183c7-7763-4b86-8725-55a4a56da6a5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1507 microversion: 2.1 time: 0.206340 Apr 16 21:25:08.161692 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2198/4588] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:07 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1507 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:08.164492 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e9b4f34f-3139-416f-ba0f-18dc03a5a56b tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:08.166139 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e9b4f34f-3139-416f-ba0f-18dc03a5a56b tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:08.167325 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e9b4f34f-3139-416f-ba0f-18dc03a5a56b tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] 10.222.0.20 "GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318" status: 200 len: 1277 microversion: 2.54 time: 0.109556 Apr 16 21:25:08.167889 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2391/4589] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:08 2022] GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318 => generated 1277 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:08.170286 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1806274d-e7a4-4901-9279-c3da06357b3d tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:08.171014 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1806274d-e7a4-4901-9279-c3da06357b3d tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] [instance: 9c206aa5-5455-49ad-81ee-23ba46fc9d79] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:08.177342 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1806274d-e7a4-4901-9279-c3da06357b3d tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:08.177818 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1806274d-e7a4-4901-9279-c3da06357b3d tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:08.178620 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1806274d-e7a4-4901-9279-c3da06357b3d tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:08.179090 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1806274d-e7a4-4901-9279-c3da06357b3d tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:08.328649 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1806274d-e7a4-4901-9279-c3da06357b3d tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:08.337050 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1806274d-e7a4-4901-9279-c3da06357b3d tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:08.338966 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1806274d-e7a4-4901-9279-c3da06357b3d tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:08.352563 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1806274d-e7a4-4901-9279-c3da06357b3d tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] 10.222.0.20 "GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79" status: 200 len: 1361 microversion: 2.26 time: 0.178257 Apr 16 21:25:08.352563 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2199/4590] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:08 2022] GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79 => generated 1361 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:09.023290 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-7f388225-dc67-45a7-b74a-eea1131af319 req-d11568c5-5bee-4d87-a8cb-812cdba49cfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c206aa5-5455-49ad-81ee-23ba46fc9d79", "name": "network-vif-plugged", "status": "completed", "tag": "edfa0ac5-33d0-466c-89bb-63c2070d6c89"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:09.033193 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-7f388225-dc67-45a7-b74a-eea1131af319 req-d11568c5-5bee-4d87-a8cb-812cdba49cfa service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:09.033845 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-7f388225-dc67-45a7-b74a-eea1131af319 req-d11568c5-5bee-4d87-a8cb-812cdba49cfa service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:09.046885 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-7f388225-dc67-45a7-b74a-eea1131af319 req-d11568c5-5bee-4d87-a8cb-812cdba49cfa service nova] Creating event network-vif-plugged:edfa0ac5-33d0-466c-89bb-63c2070d6c89 for instance 9c206aa5-5455-49ad-81ee-23ba46fc9d79 on nch1-master-1 Apr 16 21:25:09.052343 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-7f388225-dc67-45a7-b74a-eea1131af319 req-d11568c5-5bee-4d87-a8cb-812cdba49cfa service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033424 Apr 16 21:25:09.059103 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2392/4591] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:25:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:25:09.177467 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6ac7891a-0795-49b2-9711-411b004f2d0e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:09.178093 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6ac7891a-0795-49b2-9711-411b004f2d0e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:09.185721 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6ac7891a-0795-49b2-9711-411b004f2d0e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:09.186410 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6ac7891a-0795-49b2-9711-411b004f2d0e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:09.187177 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f6517a6e-b8b8-45e3-9b76-9c5f778402bd tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:09.187408 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6ac7891a-0795-49b2-9711-411b004f2d0e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:09.187857 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6ac7891a-0795-49b2-9711-411b004f2d0e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:09.188047 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f6517a6e-b8b8-45e3-9b76-9c5f778402bd tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] [instance: 5bec80bd-63c1-45bf-a379-98f4c375f318] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:09.275210 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f6517a6e-b8b8-45e3-9b76-9c5f778402bd tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:09.285494 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f6517a6e-b8b8-45e3-9b76-9c5f778402bd tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:09.285494 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f6517a6e-b8b8-45e3-9b76-9c5f778402bd tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:09.286855 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f6517a6e-b8b8-45e3-9b76-9c5f778402bd tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] 10.222.0.20 "GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318" status: 200 len: 1277 microversion: 2.54 time: 0.104387 Apr 16 21:25:09.287427 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2393/4592] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:09 2022] GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318 => generated 1277 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:25:09.362193 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1683bc69-71a9-402f-8c99-260e3e7dbb18 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:09.362819 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1683bc69-71a9-402f-8c99-260e3e7dbb18 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] [instance: 9c206aa5-5455-49ad-81ee-23ba46fc9d79] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:09.373797 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1683bc69-71a9-402f-8c99-260e3e7dbb18 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:09.375371 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1683bc69-71a9-402f-8c99-260e3e7dbb18 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:09.376405 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1683bc69-71a9-402f-8c99-260e3e7dbb18 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:09.377009 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1683bc69-71a9-402f-8c99-260e3e7dbb18 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:09.423837 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6ac7891a-0795-49b2-9711-411b004f2d0e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:09.437236 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6ac7891a-0795-49b2-9711-411b004f2d0e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1507 microversion: 2.1 time: 0.263614 Apr 16 21:25:09.442343 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2200/4593] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:09 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1507 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:09.574899 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1683bc69-71a9-402f-8c99-260e3e7dbb18 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:09.588411 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1683bc69-71a9-402f-8c99-260e3e7dbb18 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:09.596231 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1683bc69-71a9-402f-8c99-260e3e7dbb18 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:09.597388 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1683bc69-71a9-402f-8c99-260e3e7dbb18 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] 10.222.0.20 "GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79" status: 200 len: 1361 microversion: 2.26 time: 0.239321 Apr 16 21:25:09.597985 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2394/4594] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:09 2022] GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79 => generated 1361 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:25:10.313289 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6965ff3f-cde2-4ccd-b6b8-779a528efd96 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:10.314395 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6965ff3f-cde2-4ccd-b6b8-779a528efd96 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] [instance: 5bec80bd-63c1-45bf-a379-98f4c375f318] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:10.323167 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6965ff3f-cde2-4ccd-b6b8-779a528efd96 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:10.324955 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6965ff3f-cde2-4ccd-b6b8-779a528efd96 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:10.324955 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6965ff3f-cde2-4ccd-b6b8-779a528efd96 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:10.325609 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6965ff3f-cde2-4ccd-b6b8-779a528efd96 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:10.417468 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6965ff3f-cde2-4ccd-b6b8-779a528efd96 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:10.428066 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6965ff3f-cde2-4ccd-b6b8-779a528efd96 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:10.429906 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6965ff3f-cde2-4ccd-b6b8-779a528efd96 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:10.431579 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6965ff3f-cde2-4ccd-b6b8-779a528efd96 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] 10.222.0.20 "GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318" status: 200 len: 1329 microversion: 2.54 time: 0.128412 Apr 16 21:25:10.444076 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2201/4595] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:10 2022] GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318 => generated 1329 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:10.460324 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-611f6f3a-8a29-4468-b029-aa33039c7fa6 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:10.463118 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-611f6f3a-8a29-4468-b029-aa33039c7fa6 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:10.470703 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-611f6f3a-8a29-4468-b029-aa33039c7fa6 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:10.471131 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-611f6f3a-8a29-4468-b029-aa33039c7fa6 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:10.474120 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-611f6f3a-8a29-4468-b029-aa33039c7fa6 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:10.474120 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-611f6f3a-8a29-4468-b029-aa33039c7fa6 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:10.621121 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8a27c7eb-f444-498d-91e9-e993746d0086 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:10.621956 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8a27c7eb-f444-498d-91e9-e993746d0086 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] [instance: 9c206aa5-5455-49ad-81ee-23ba46fc9d79] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:10.636112 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8a27c7eb-f444-498d-91e9-e993746d0086 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:10.636975 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8a27c7eb-f444-498d-91e9-e993746d0086 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:10.638347 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8a27c7eb-f444-498d-91e9-e993746d0086 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:10.641482 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8a27c7eb-f444-498d-91e9-e993746d0086 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:10.859152 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8a27c7eb-f444-498d-91e9-e993746d0086 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:10.868841 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8a27c7eb-f444-498d-91e9-e993746d0086 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:10.870663 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8a27c7eb-f444-498d-91e9-e993746d0086 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:10.871859 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8a27c7eb-f444-498d-91e9-e993746d0086 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] 10.222.0.20 "GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79" status: 200 len: 1361 microversion: 2.26 time: 0.260407 Apr 16 21:25:10.876034 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2202/4596] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:10 2022] GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79 => generated 1361 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:25:10.881782 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fa2112a8-b533-4081-88ec-d9e51ca8ad11 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2084792220", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "88bbe9a7-19d2-4102-9634-058b7c590848", "destination_type": "local"}, {"source_type": "volume", "uuid": "f560b40e-0e82-4a5d-9c45-a6fbb242d16d", "destination_type": "invalid"}], "networks": [{"uuid": "1b9ee265-bdab-4092-8071-c9bb95d911fb"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:10.884135 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fa2112a8-b533-4081-88ec-d9e51ca8ad11 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:25:10.886086 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fa2112a8-b533-4081-88ec-d9e51ca8ad11 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.012041 Apr 16 21:25:10.886872 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2203/4597] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:25:10 2022] POST /compute/v2.1/servers => generated 155 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:25:10.907877 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-25aeba82-11c5-4216-9211-ce2199ad4bba tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:10.909160 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-25aeba82-11c5-4216-9211-ce2199ad4bba tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:10.921358 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-25aeba82-11c5-4216-9211-ce2199ad4bba tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:10.922147 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-25aeba82-11c5-4216-9211-ce2199ad4bba tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:10.923635 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-25aeba82-11c5-4216-9211-ce2199ad4bba tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:10.924493 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-25aeba82-11c5-4216-9211-ce2199ad4bba tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:11.166471 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-25aeba82-11c5-4216-9211-ce2199ad4bba tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:11.187535 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-25aeba82-11c5-4216-9211-ce2199ad4bba tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.295523 Apr 16 21:25:11.188690 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2204/4598] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:10 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:25:11.213315 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1f4b3513-7e87-4ad8-b64a-78056ea2873c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:11.215186 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1f4b3513-7e87-4ad8-b64a-78056ea2873c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:11.222401 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1f4b3513-7e87-4ad8-b64a-78056ea2873c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:11.223979 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1f4b3513-7e87-4ad8-b64a-78056ea2873c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:11.225305 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1f4b3513-7e87-4ad8-b64a-78056ea2873c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:11.226007 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1f4b3513-7e87-4ad8-b64a-78056ea2873c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:11.261175 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-611f6f3a-8a29-4468-b029-aa33039c7fa6 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:11.270769 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-611f6f3a-8a29-4468-b029-aa33039c7fa6 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1507 microversion: 2.1 time: 0.815117 Apr 16 21:25:11.287760 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2395/4599] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:10 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1507 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:11.458335 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1d58994c-b924-4bfb-ab85-362c92c17c56 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:11.461017 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1d58994c-b924-4bfb-ab85-362c92c17c56 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] [instance: 5bec80bd-63c1-45bf-a379-98f4c375f318] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:11.474317 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1d58994c-b924-4bfb-ab85-362c92c17c56 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:11.475091 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1d58994c-b924-4bfb-ab85-362c92c17c56 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:11.476099 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1d58994c-b924-4bfb-ab85-362c92c17c56 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:11.477503 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1d58994c-b924-4bfb-ab85-362c92c17c56 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:11.507442 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1f4b3513-7e87-4ad8-b64a-78056ea2873c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:11.518921 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1f4b3513-7e87-4ad8-b64a-78056ea2873c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.314805 Apr 16 21:25:11.518921 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2205/4600] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:11 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:11.589082 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-866a4493-fd30-4626-a980-d677456d44a7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2042017096", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "1b9ee265-bdab-4092-8071-c9bb95d911fb"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:11.590879 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-866a4493-fd30-4626-a980-d677456d44a7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:25:11.591895 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-866a4493-fd30-4626-a980-d677456d44a7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.008435 Apr 16 21:25:11.592778 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2206/4601] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:25:11 2022] POST /compute/v2.1/servers => generated 624 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:25:11.606341 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b7824c2e-cb71-4249-b2c7-856cd058d503 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:11.606341 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b7824c2e-cb71-4249-b2c7-856cd058d503 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:11.630227 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b7824c2e-cb71-4249-b2c7-856cd058d503 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:11.631131 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b7824c2e-cb71-4249-b2c7-856cd058d503 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:11.632499 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1d58994c-b924-4bfb-ab85-362c92c17c56 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:11.634038 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b7824c2e-cb71-4249-b2c7-856cd058d503 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:11.635559 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b7824c2e-cb71-4249-b2c7-856cd058d503 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:11.646796 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1d58994c-b924-4bfb-ab85-362c92c17c56 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:11.650145 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1d58994c-b924-4bfb-ab85-362c92c17c56 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:11.653746 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1d58994c-b924-4bfb-ab85-362c92c17c56 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] 10.222.0.20 "GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318" status: 200 len: 1337 microversion: 2.54 time: 0.198361 Apr 16 21:25:11.654591 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2396/4602] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:11 2022] GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318 => generated 1337 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:11.891587 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4c8dd4e8-3594-4400-907a-bd7806a8811e tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:11.892608 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4c8dd4e8-3594-4400-907a-bd7806a8811e tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] [instance: 9c206aa5-5455-49ad-81ee-23ba46fc9d79] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:11.896314 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b7824c2e-cb71-4249-b2c7-856cd058d503 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:11.903843 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4c8dd4e8-3594-4400-907a-bd7806a8811e tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:11.907701 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b7824c2e-cb71-4249-b2c7-856cd058d503 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.309832 Apr 16 21:25:11.909677 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4c8dd4e8-3594-4400-907a-bd7806a8811e tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:11.911938 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4c8dd4e8-3594-4400-907a-bd7806a8811e tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:11.912718 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4c8dd4e8-3594-4400-907a-bd7806a8811e tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:11.922969 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2207/4603] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:11 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:25:11.929129 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-06bc569a-3783-4eba-b194-5328752011d3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:11.932018 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-06bc569a-3783-4eba-b194-5328752011d3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:11.942937 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-06bc569a-3783-4eba-b194-5328752011d3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:11.943576 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-06bc569a-3783-4eba-b194-5328752011d3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:11.944587 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-06bc569a-3783-4eba-b194-5328752011d3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:11.945271 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-06bc569a-3783-4eba-b194-5328752011d3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:12.191228 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-06bc569a-3783-4eba-b194-5328752011d3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:12.202519 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-06bc569a-3783-4eba-b194-5328752011d3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.278322 Apr 16 21:25:12.203106 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2208/4604] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:11 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:12.266867 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-55ef0db4-23c9-4060-a9ed-bb6535d080ab tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "1b9ee265-bdab-4092-8071-c9bb95d911fb"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:12.268027 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-55ef0db4-23c9-4060-a9ed-bb6535d080ab tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:25:12.268816 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-55ef0db4-23c9-4060-a9ed-bb6535d080ab tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.006199 Apr 16 21:25:12.272915 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2209/4605] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:25:12 2022] POST /compute/v2.1/servers => generated 619 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:25:12.279755 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-04a4b110-5c12-4816-80a8-4a63fe7b4525 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:12.280947 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-04a4b110-5c12-4816-80a8-4a63fe7b4525 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:12.287930 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-04a4b110-5c12-4816-80a8-4a63fe7b4525 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:12.289814 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-04a4b110-5c12-4816-80a8-4a63fe7b4525 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:12.289814 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-04a4b110-5c12-4816-80a8-4a63fe7b4525 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:12.290088 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-04a4b110-5c12-4816-80a8-4a63fe7b4525 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:12.364275 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4c8dd4e8-3594-4400-907a-bd7806a8811e tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:12.375563 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4c8dd4e8-3594-4400-907a-bd7806a8811e tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:12.377972 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4c8dd4e8-3594-4400-907a-bd7806a8811e tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:12.380342 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4c8dd4e8-3594-4400-907a-bd7806a8811e tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] 10.222.0.20 "GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79" status: 200 len: 1545 microversion: 2.26 time: 0.492656 Apr 16 21:25:12.382160 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2397/4606] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:11 2022] GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79 => generated 1545 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:12.389680 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f37ca564-fa9b-4575-bd0e-91050948062e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:12.390586 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f37ca564-fa9b-4575-bd0e-91050948062e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:12.398745 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f37ca564-fa9b-4575-bd0e-91050948062e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:12.399660 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f37ca564-fa9b-4575-bd0e-91050948062e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:12.401142 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f37ca564-fa9b-4575-bd0e-91050948062e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:12.402371 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f37ca564-fa9b-4575-bd0e-91050948062e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:12.460101 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-04a4b110-5c12-4816-80a8-4a63fe7b4525 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:12.472663 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-04a4b110-5c12-4816-80a8-4a63fe7b4525 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.196673 Apr 16 21:25:12.486005 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2210/4607] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:12 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:25:12.494208 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0676d7db-3dd9-4b6d-b65f-cf67513da08a tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Calling method '.version_select at 0x7fbb9569d790>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:12.505168 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0676d7db-3dd9-4b6d-b65f-cf67513da08a tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:12.511048 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0676d7db-3dd9-4b6d-b65f-cf67513da08a tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:12.511048 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0676d7db-3dd9-4b6d-b65f-cf67513da08a tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] [instance: 9c206aa5-5455-49ad-81ee-23ba46fc9d79] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:12.514943 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0676d7db-3dd9-4b6d-b65f-cf67513da08a tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:12.515866 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0676d7db-3dd9-4b6d-b65f-cf67513da08a tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:12.517451 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0676d7db-3dd9-4b6d-b65f-cf67513da08a tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:12.518113 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0676d7db-3dd9-4b6d-b65f-cf67513da08a tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:12.561089 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0676d7db-3dd9-4b6d-b65f-cf67513da08a tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:12.561230 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0676d7db-3dd9-4b6d-b65f-cf67513da08a tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:12.575752 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0676d7db-3dd9-4b6d-b65f-cf67513da08a tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:12.576435 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0676d7db-3dd9-4b6d-b65f-cf67513da08a tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:12.645652 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-0676d7db-3dd9-4b6d-b65f-cf67513da08a tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lazy-loading 'flavor' on Instance uuid 9c206aa5-5455-49ad-81ee-23ba46fc9d79 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:25:12.662047 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0676d7db-3dd9-4b6d-b65f-cf67513da08a tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] 10.222.0.20 "PUT /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79/tags/tempest-tag-1843631741" status: 201 len: 0 microversion: 2.26 time: 0.174693 Apr 16 21:25:12.662714 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2211/4608] 10.222.0.20 () {62 vars in 1379 bytes} [Sat Apr 16 21:25:12 2022] PUT /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79/tags/tempest-tag-1843631741 => generated 0 bytes in 176 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Apr 16 21:25:12.674799 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4cb066b0-639e-4a79-b9dd-2a926f14fc1c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:12.674799 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4cb066b0-639e-4a79-b9dd-2a926f14fc1c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:12.680778 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4cb066b0-639e-4a79-b9dd-2a926f14fc1c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:12.681638 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4cb066b0-639e-4a79-b9dd-2a926f14fc1c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:12.682017 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4cb066b0-639e-4a79-b9dd-2a926f14fc1c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:12.682473 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4cb066b0-639e-4a79-b9dd-2a926f14fc1c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:12.689908 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f37ca564-fa9b-4575-bd0e-91050948062e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:12.698439 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f37ca564-fa9b-4575-bd0e-91050948062e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1507 microversion: 2.1 time: 0.314837 Apr 16 21:25:12.700683 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2398/4609] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:12 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1507 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:12.703916 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-40b65802-f0c4-4a48-bead-6dd08ec1a22b tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Action: 'create', calling method: .version_select at 0x7fbba000fca0>, body: {"keypair": {"name": "tempest-keypair-1672362320"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:12.718144 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-40b65802-f0c4-4a48-bead-6dd08ec1a22b tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Getting quotas for project d6f8dfa11e9b410cbbd59ffe32afeb26. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:25:12.724559 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-40b65802-f0c4-4a48-bead-6dd08ec1a22b tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Getting quotas for user 37443a4e933a4873bb039b06efaec98f and project d6f8dfa11e9b410cbbd59ffe32afeb26. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:25:12.822704 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4cb066b0-639e-4a79-b9dd-2a926f14fc1c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:12.830238 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4cb066b0-639e-4a79-b9dd-2a926f14fc1c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.162450 Apr 16 21:25:12.831176 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2212/4610] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:12 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:12.836527 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-85ba11d7-efd0-4fe0-a9b6-f8e6999db656 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Calling method '.version_select at 0x7fbb956ea310>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:12.843667 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-85ba11d7-efd0-4fe0-a9b6-f8e6999db656 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:12.844128 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-85ba11d7-efd0-4fe0-a9b6-f8e6999db656 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:12.857493 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-85ba11d7-efd0-4fe0-a9b6-f8e6999db656 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] 10.222.0.20 "GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79/tags/tempest-tag-1843631741" status: 204 len: 0 microversion: 2.26 time: 0.025182 Apr 16 21:25:12.861320 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2213/4611] 10.222.0.20 () {60 vars in 1360 bytes} [Sat Apr 16 21:25:12 2022] GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79/tags/tempest-tag-1843631741 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 16 21:25:12.863404 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e9c94b15-f806-4f2e-962d-16d635c33a41 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:12.864132 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e9c94b15-f806-4f2e-962d-16d635c33a41 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] [instance: 5bec80bd-63c1-45bf-a379-98f4c375f318] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:12.871565 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e9c94b15-f806-4f2e-962d-16d635c33a41 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:12.871565 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e9c94b15-f806-4f2e-962d-16d635c33a41 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:12.871565 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e9c94b15-f806-4f2e-962d-16d635c33a41 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:12.872270 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e9c94b15-f806-4f2e-962d-16d635c33a41 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:12.955221 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e9c94b15-f806-4f2e-962d-16d635c33a41 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:12.970330 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e9c94b15-f806-4f2e-962d-16d635c33a41 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:12.973893 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e9c94b15-f806-4f2e-962d-16d635c33a41 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:12.975881 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e9c94b15-f806-4f2e-962d-16d635c33a41 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] 10.222.0.20 "GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318" status: 200 len: 1335 microversion: 2.54 time: 0.116637 Apr 16 21:25:12.987962 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2214/4612] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:12 2022] GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318 => generated 1335 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:12.994051 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4527af0d-259c-4700-b52a-da7ae365565f tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Calling method '.version_select at 0x7fbb956ea3a0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:13.008096 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4527af0d-259c-4700-b52a-da7ae365565f tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:13.008593 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4527af0d-259c-4700-b52a-da7ae365565f tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:13.009252 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4527af0d-259c-4700-b52a-da7ae365565f tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] [instance: 9c206aa5-5455-49ad-81ee-23ba46fc9d79] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:13.015212 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4527af0d-259c-4700-b52a-da7ae365565f tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:13.015895 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4527af0d-259c-4700-b52a-da7ae365565f tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:13.016927 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4527af0d-259c-4700-b52a-da7ae365565f tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:13.017478 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4527af0d-259c-4700-b52a-da7ae365565f tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:13.046415 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4527af0d-259c-4700-b52a-da7ae365565f tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:13.047242 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4527af0d-259c-4700-b52a-da7ae365565f tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:13.070858 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-40b65802-f0c4-4a48-bead-6dd08ec1a22b tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Getting quotas for project d6f8dfa11e9b410cbbd59ffe32afeb26. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:25:13.076905 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-40b65802-f0c4-4a48-bead-6dd08ec1a22b tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Getting quotas for user 37443a4e933a4873bb039b06efaec98f and project d6f8dfa11e9b410cbbd59ffe32afeb26. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:25:13.094482 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-40b65802-f0c4-4a48-bead-6dd08ec1a22b tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.394063 Apr 16 21:25:13.095297 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2399/4613] 10.222.0.20 () {60 vars in 1157 bytes} [Sat Apr 16 21:25:12 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:13.101366 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-59148f45-8ce6-4b08-b91f-f2f4813c8f79 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2019629386", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": -1, "networks": [{"uuid": "1b9ee265-bdab-4092-8071-c9bb95d911fb"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:13.114402 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-59148f45-8ce6-4b08-b91f-f2f4813c8f79 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] HTTP exception thrown: Flavor -1 could not be found. Apr 16 21:25:13.114956 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-59148f45-8ce6-4b08-b91f-f2f4813c8f79 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:25:13.115990 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-59148f45-8ce6-4b08-b91f-f2f4813c8f79 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.019468 Apr 16 21:25:13.120349 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2400/4614] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:25:13 2022] POST /compute/v2.1/servers => generated 73 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Apr 16 21:25:13.126608 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cea6f048-6b66-4e83-a6aa-d683914c8f66 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:13.127229 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cea6f048-6b66-4e83-a6aa-d683914c8f66 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:13.135907 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cea6f048-6b66-4e83-a6aa-d683914c8f66 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:13.136808 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cea6f048-6b66-4e83-a6aa-d683914c8f66 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:13.137920 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cea6f048-6b66-4e83-a6aa-d683914c8f66 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:13.138377 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cea6f048-6b66-4e83-a6aa-d683914c8f66 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:13.177942 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-4527af0d-259c-4700-b52a-da7ae365565f tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lazy-loading 'flavor' on Instance uuid 9c206aa5-5455-49ad-81ee-23ba46fc9d79 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:25:13.194215 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4527af0d-259c-4700-b52a-da7ae365565f tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79/tags" status: 204 len: 0 microversion: 2.26 time: 0.205041 Apr 16 21:25:13.194928 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2215/4615] 10.222.0.20 () {60 vars in 1294 bytes} [Sat Apr 16 21:25:12 2022] DELETE /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79/tags => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 16 21:25:13.204060 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b733631e-884d-4b19-b6b6-aa9e830692fc tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Calling method '.version_select at 0x7fbb9569daf0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:13.212302 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b733631e-884d-4b19-b6b6-aa9e830692fc tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:13.213195 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b733631e-884d-4b19-b6b6-aa9e830692fc tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:13.222201 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b733631e-884d-4b19-b6b6-aa9e830692fc tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] 10.222.0.20 "GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79/tags" status: 200 len: 12 microversion: 2.26 time: 0.021907 Apr 16 21:25:13.227387 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2216/4616] 10.222.0.20 () {60 vars in 1291 bytes} [Sat Apr 16 21:25:13 2022] GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79/tags => generated 12 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:13.232323 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3e6dc466-c1eb-401f-832d-407aafe278c0 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Calling method '.version_select at 0x7fbb956eaca0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:13.240300 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e6dc466-c1eb-401f-832d-407aafe278c0 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:13.240761 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e6dc466-c1eb-401f-832d-407aafe278c0 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:13.241235 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3e6dc466-c1eb-401f-832d-407aafe278c0 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] [instance: 9c206aa5-5455-49ad-81ee-23ba46fc9d79] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:13.246664 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e6dc466-c1eb-401f-832d-407aafe278c0 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:13.247122 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e6dc466-c1eb-401f-832d-407aafe278c0 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:13.247892 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e6dc466-c1eb-401f-832d-407aafe278c0 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:13.248359 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e6dc466-c1eb-401f-832d-407aafe278c0 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:13.272047 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e6dc466-c1eb-401f-832d-407aafe278c0 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:13.272531 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e6dc466-c1eb-401f-832d-407aafe278c0 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:13.281588 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e6dc466-c1eb-401f-832d-407aafe278c0 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:13.282030 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e6dc466-c1eb-401f-832d-407aafe278c0 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:13.390894 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cea6f048-6b66-4e83-a6aa-d683914c8f66 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:13.401334 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cea6f048-6b66-4e83-a6aa-d683914c8f66 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.279824 Apr 16 21:25:13.402213 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2401/4617] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:13 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:13.419381 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-865d0a7a-942f-4aa8-89de-8caa0d49e673 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:13.420265 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-865d0a7a-942f-4aa8-89de-8caa0d49e673 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:13.426182 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-865d0a7a-942f-4aa8-89de-8caa0d49e673 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:13.426802 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-865d0a7a-942f-4aa8-89de-8caa0d49e673 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:13.427666 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-865d0a7a-942f-4aa8-89de-8caa0d49e673 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:13.428377 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-865d0a7a-942f-4aa8-89de-8caa0d49e673 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:13.429036 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-3e6dc466-c1eb-401f-832d-407aafe278c0 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lazy-loading 'flavor' on Instance uuid 9c206aa5-5455-49ad-81ee-23ba46fc9d79 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:25:13.450087 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3e6dc466-c1eb-401f-832d-407aafe278c0 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] 10.222.0.20 "PUT /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79/tags/tempest-tag-251201627" status: 201 len: 0 microversion: 2.26 time: 0.221603 Apr 16 21:25:13.451002 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2217/4618] 10.222.0.20 () {62 vars in 1376 bytes} [Sat Apr 16 21:25:13 2022] PUT /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79/tags/tempest-tag-251201627 => generated 0 bytes in 223 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Apr 16 21:25:13.464076 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-993e8926-1367-4602-97a0-5a26ef7cc032 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Calling method '.version_select at 0x7fbb956ea670>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:13.469099 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-993e8926-1367-4602-97a0-5a26ef7cc032 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:13.469555 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-993e8926-1367-4602-97a0-5a26ef7cc032 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:13.479720 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-993e8926-1367-4602-97a0-5a26ef7cc032 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] 10.222.0.20 "GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79/tags" status: 200 len: 35 microversion: 2.26 time: 0.023330 Apr 16 21:25:13.481003 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2218/4619] 10.222.0.20 () {60 vars in 1291 bytes} [Sat Apr 16 21:25:13 2022] GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79/tags => generated 35 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:13.491263 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b4714285-f7d0-4656-951c-912d6608ed24 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Calling method '.version_select at 0x7fbb95720040>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:13.499604 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b4714285-f7d0-4656-951c-912d6608ed24 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:13.500196 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b4714285-f7d0-4656-951c-912d6608ed24 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:13.500581 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b4714285-f7d0-4656-951c-912d6608ed24 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] [instance: 9c206aa5-5455-49ad-81ee-23ba46fc9d79] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:13.507007 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b4714285-f7d0-4656-951c-912d6608ed24 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:13.507464 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b4714285-f7d0-4656-951c-912d6608ed24 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:13.509788 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b4714285-f7d0-4656-951c-912d6608ed24 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:13.509788 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b4714285-f7d0-4656-951c-912d6608ed24 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:13.530147 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b4714285-f7d0-4656-951c-912d6608ed24 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:13.530784 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b4714285-f7d0-4656-951c-912d6608ed24 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:13.685897 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-b4714285-f7d0-4656-951c-912d6608ed24 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lazy-loading 'flavor' on Instance uuid 9c206aa5-5455-49ad-81ee-23ba46fc9d79 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:25:13.689072 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-865d0a7a-942f-4aa8-89de-8caa0d49e673 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:13.697758 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-865d0a7a-942f-4aa8-89de-8caa0d49e673 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.282340 Apr 16 21:25:13.698470 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2402/4620] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:13 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:25:13.711861 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b4714285-f7d0-4656-951c-912d6608ed24 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79/tags/tempest-tag-251201627" status: 204 len: 0 microversion: 2.26 time: 0.225025 Apr 16 21:25:13.715884 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2219/4621] 10.222.0.20 () {60 vars in 1360 bytes} [Sat Apr 16 21:25:13 2022] DELETE /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79/tags/tempest-tag-251201627 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 16 21:25:13.716939 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b4a2960d-1a79-4c4f-b92e-6a721b5a8e66 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:13.717653 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b4a2960d-1a79-4c4f-b92e-6a721b5a8e66 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:13.722542 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d13fecca-2038-4a67-98d9-9d83d56ad284 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Calling method '.version_select at 0x7fbb95716040>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:13.725084 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b4a2960d-1a79-4c4f-b92e-6a721b5a8e66 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:13.725957 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b4a2960d-1a79-4c4f-b92e-6a721b5a8e66 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:13.726798 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b4a2960d-1a79-4c4f-b92e-6a721b5a8e66 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:13.727520 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b4a2960d-1a79-4c4f-b92e-6a721b5a8e66 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:13.740373 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d13fecca-2038-4a67-98d9-9d83d56ad284 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:13.740973 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d13fecca-2038-4a67-98d9-9d83d56ad284 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:13.756844 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d13fecca-2038-4a67-98d9-9d83d56ad284 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] 10.222.0.20 "GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79/tags" status: 200 len: 12 microversion: 2.26 time: 0.038369 Apr 16 21:25:13.760211 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2220/4622] 10.222.0.20 () {60 vars in 1291 bytes} [Sat Apr 16 21:25:13 2022] GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79/tags => generated 12 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:13.769230 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fd92cac8-e0d0-4781-b63e-170a8078a16d tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-57250526", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "1b9ee265-bdab-4092-8071-c9bb95d911fb"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:13.770885 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fd92cac8-e0d0-4781-b63e-170a8078a16d tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:25:13.771730 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fd92cac8-e0d0-4781-b63e-170a8078a16d tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.007985 Apr 16 21:25:13.772454 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2221/4623] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:25:13 2022] POST /compute/v2.1/servers => generated 145 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:25:13.778307 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b3481dca-2abd-4058-a54b-82f54a6f8d77 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Calling method '.version_select at 0x7fbb955fa940>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:13.787607 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b3481dca-2abd-4058-a54b-82f54a6f8d77 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:13.788072 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b3481dca-2abd-4058-a54b-82f54a6f8d77 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:13.788588 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b3481dca-2abd-4058-a54b-82f54a6f8d77 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] [instance: 9c206aa5-5455-49ad-81ee-23ba46fc9d79] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:13.794846 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b3481dca-2abd-4058-a54b-82f54a6f8d77 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:13.795310 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b3481dca-2abd-4058-a54b-82f54a6f8d77 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:13.796104 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b3481dca-2abd-4058-a54b-82f54a6f8d77 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:13.797053 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b3481dca-2abd-4058-a54b-82f54a6f8d77 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:13.819882 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b3481dca-2abd-4058-a54b-82f54a6f8d77 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:13.820372 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b3481dca-2abd-4058-a54b-82f54a6f8d77 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:13.830899 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-b3481dca-2abd-4058-a54b-82f54a6f8d77 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lazy-loading 'flavor' on Instance uuid 9c206aa5-5455-49ad-81ee-23ba46fc9d79 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:25:13.845360 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b3481dca-2abd-4058-a54b-82f54a6f8d77 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79/tags" status: 204 len: 0 microversion: 2.26 time: 0.071743 Apr 16 21:25:13.846126 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2222/4624] 10.222.0.20 () {60 vars in 1294 bytes} [Sat Apr 16 21:25:13 2022] DELETE /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79/tags => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 16 21:25:13.854736 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bb24c92b-d168-49c4-911c-65a249e3b133 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:13.856159 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bb24c92b-d168-49c4-911c-65a249e3b133 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:13.862484 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bb24c92b-d168-49c4-911c-65a249e3b133 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:13.862944 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bb24c92b-d168-49c4-911c-65a249e3b133 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:13.864294 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bb24c92b-d168-49c4-911c-65a249e3b133 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:13.864801 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bb24c92b-d168-49c4-911c-65a249e3b133 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:13.977507 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b4a2960d-1a79-4c4f-b92e-6a721b5a8e66 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:13.985597 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b4a2960d-1a79-4c4f-b92e-6a721b5a8e66 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1507 microversion: 2.1 time: 0.273893 Apr 16 21:25:13.986263 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2403/4625] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:13 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1507 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:13.992213 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9bf7f093-6d72-45b9-ad4b-24310ca64007 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Calling method '.version_select at 0x7fbb9ff3baf0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:14.006683 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9bf7f093-6d72-45b9-ad4b-24310ca64007 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:14.009917 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9bf7f093-6d72-45b9-ad4b-24310ca64007 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:14.009917 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9bf7f093-6d72-45b9-ad4b-24310ca64007 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] [instance: 9c206aa5-5455-49ad-81ee-23ba46fc9d79] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:14.015253 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9bf7f093-6d72-45b9-ad4b-24310ca64007 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:14.015708 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9bf7f093-6d72-45b9-ad4b-24310ca64007 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:14.016573 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9bf7f093-6d72-45b9-ad4b-24310ca64007 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:14.017015 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9bf7f093-6d72-45b9-ad4b-24310ca64007 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:14.043618 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9bf7f093-6d72-45b9-ad4b-24310ca64007 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:14.044594 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9bf7f093-6d72-45b9-ad4b-24310ca64007 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:14.047540 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-bb24c92b-d168-49c4-911c-65a249e3b133 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:14.056074 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bb24c92b-d168-49c4-911c-65a249e3b133 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.205033 Apr 16 21:25:14.067572 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2223/4626] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:13 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:14.067572 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5060ae68-7f9e-4b7f-b85e-5205c32fcba8 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:14.067572 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5060ae68-7f9e-4b7f-b85e-5205c32fcba8 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] [instance: 5bec80bd-63c1-45bf-a379-98f4c375f318] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:14.070462 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5060ae68-7f9e-4b7f-b85e-5205c32fcba8 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:14.070932 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5060ae68-7f9e-4b7f-b85e-5205c32fcba8 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:14.071740 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5060ae68-7f9e-4b7f-b85e-5205c32fcba8 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:14.072206 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5060ae68-7f9e-4b7f-b85e-5205c32fcba8 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:14.073794 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9bf7f093-6d72-45b9-ad4b-24310ca64007 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:14.074260 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9bf7f093-6d72-45b9-ad4b-24310ca64007 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:14.143403 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5060ae68-7f9e-4b7f-b85e-5205c32fcba8 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:14.151717 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5060ae68-7f9e-4b7f-b85e-5205c32fcba8 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:14.153296 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5060ae68-7f9e-4b7f-b85e-5205c32fcba8 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:14.154464 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5060ae68-7f9e-4b7f-b85e-5205c32fcba8 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] 10.222.0.20 "GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318" status: 200 len: 1335 microversion: 2.54 time: 0.096802 Apr 16 21:25:14.166344 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2224/4627] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:14 2022] GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318 => generated 1335 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:14.166344 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d02cd29b-4f27-4f6c-899b-46358ce3dba7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:14.166344 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d02cd29b-4f27-4f6c-899b-46358ce3dba7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:14.168201 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d02cd29b-4f27-4f6c-899b-46358ce3dba7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:14.168662 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d02cd29b-4f27-4f6c-899b-46358ce3dba7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:14.169461 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d02cd29b-4f27-4f6c-899b-46358ce3dba7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:14.169909 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d02cd29b-4f27-4f6c-899b-46358ce3dba7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:14.236757 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-9bf7f093-6d72-45b9-ad4b-24310ca64007 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lazy-loading 'flavor' on Instance uuid 9c206aa5-5455-49ad-81ee-23ba46fc9d79 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:25:14.255432 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9bf7f093-6d72-45b9-ad4b-24310ca64007 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] 10.222.0.20 "PUT /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79/tags/tempest-tag-1311939467" status: 201 len: 0 microversion: 2.26 time: 0.267925 Apr 16 21:25:14.259758 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2404/4628] 10.222.0.20 () {62 vars in 1379 bytes} [Sat Apr 16 21:25:13 2022] PUT /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79/tags/tempest-tag-1311939467 => generated 0 bytes in 273 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Apr 16 21:25:14.269200 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-012f9f33-e763-49cc-9a08-b0ff75823980 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Calling method '.version_select at 0x7fbb9ff3bdc0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:14.278517 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-012f9f33-e763-49cc-9a08-b0ff75823980 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:14.279092 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-012f9f33-e763-49cc-9a08-b0ff75823980 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:14.279919 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-012f9f33-e763-49cc-9a08-b0ff75823980 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] [instance: 9c206aa5-5455-49ad-81ee-23ba46fc9d79] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:14.286217 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-012f9f33-e763-49cc-9a08-b0ff75823980 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:14.286820 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-012f9f33-e763-49cc-9a08-b0ff75823980 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:14.287796 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-012f9f33-e763-49cc-9a08-b0ff75823980 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:14.288362 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-012f9f33-e763-49cc-9a08-b0ff75823980 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:14.313303 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-012f9f33-e763-49cc-9a08-b0ff75823980 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:14.314012 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-012f9f33-e763-49cc-9a08-b0ff75823980 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:14.316479 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d02cd29b-4f27-4f6c-899b-46358ce3dba7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:14.324428 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-012f9f33-e763-49cc-9a08-b0ff75823980 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:14.326911 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-012f9f33-e763-49cc-9a08-b0ff75823980 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:14.327038 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d02cd29b-4f27-4f6c-899b-46358ce3dba7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.170288 Apr 16 21:25:14.337739 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2225/4629] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:14 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:14.381579 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1fc6e3a9-b599-45b8-a0d9-f756205518a4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1342939970", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:14.384784 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-1fc6e3a9-b599-45b8-a0d9-f756205518a4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Apr 16 21:25:14.387560 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1fc6e3a9-b599-45b8-a0d9-f756205518a4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:25:14.387560 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1fc6e3a9-b599-45b8-a0d9-f756205518a4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.008965 Apr 16 21:25:14.387560 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2226/4630] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:25:14 2022] POST /compute/v2.1/servers => generated 123 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 16 21:25:14.395733 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9e4a2e65-1d63-470a-aefb-44da8ac5dbf3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:14.396380 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9e4a2e65-1d63-470a-aefb-44da8ac5dbf3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:14.403714 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9e4a2e65-1d63-470a-aefb-44da8ac5dbf3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:14.404202 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9e4a2e65-1d63-470a-aefb-44da8ac5dbf3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:14.414254 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9e4a2e65-1d63-470a-aefb-44da8ac5dbf3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:14.416393 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9e4a2e65-1d63-470a-aefb-44da8ac5dbf3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:14.420114 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-012f9f33-e763-49cc-9a08-b0ff75823980 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lazy-loading 'flavor' on Instance uuid 9c206aa5-5455-49ad-81ee-23ba46fc9d79 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:25:14.438957 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-012f9f33-e763-49cc-9a08-b0ff75823980 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] 10.222.0.20 "PUT /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79/tags/tempest-tag-158360781" status: 201 len: 0 microversion: 2.26 time: 0.173350 Apr 16 21:25:14.440098 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2405/4631] 10.222.0.20 () {62 vars in 1376 bytes} [Sat Apr 16 21:25:14 2022] PUT /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79/tags/tempest-tag-158360781 => generated 0 bytes in 175 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Apr 16 21:25:14.449435 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3f6ec7f8-b589-4f0b-8dca-9f27e75374f5 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Calling method '.version_select at 0x7fbba001df70>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:14.458006 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3f6ec7f8-b589-4f0b-8dca-9f27e75374f5 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:14.458585 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3f6ec7f8-b589-4f0b-8dca-9f27e75374f5 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:14.459194 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3f6ec7f8-b589-4f0b-8dca-9f27e75374f5 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] [instance: 9c206aa5-5455-49ad-81ee-23ba46fc9d79] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:14.465339 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3f6ec7f8-b589-4f0b-8dca-9f27e75374f5 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:14.466101 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3f6ec7f8-b589-4f0b-8dca-9f27e75374f5 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:14.466648 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3f6ec7f8-b589-4f0b-8dca-9f27e75374f5 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:14.467437 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3f6ec7f8-b589-4f0b-8dca-9f27e75374f5 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:14.495646 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3f6ec7f8-b589-4f0b-8dca-9f27e75374f5 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:14.495646 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3f6ec7f8-b589-4f0b-8dca-9f27e75374f5 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:14.579183 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9e4a2e65-1d63-470a-aefb-44da8ac5dbf3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:14.587868 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9e4a2e65-1d63-470a-aefb-44da8ac5dbf3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.196720 Apr 16 21:25:14.588801 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2227/4632] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:14 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:25:14.609578 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4c092230-f316-474e-817a-ed4062db1a26 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:14.610324 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4c092230-f316-474e-817a-ed4062db1a26 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:14.611573 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-3f6ec7f8-b589-4f0b-8dca-9f27e75374f5 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lazy-loading 'flavor' on Instance uuid 9c206aa5-5455-49ad-81ee-23ba46fc9d79 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:25:14.618456 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4c092230-f316-474e-817a-ed4062db1a26 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:14.619246 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4c092230-f316-474e-817a-ed4062db1a26 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:14.620302 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4c092230-f316-474e-817a-ed4062db1a26 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:14.620944 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4c092230-f316-474e-817a-ed4062db1a26 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:14.655170 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3f6ec7f8-b589-4f0b-8dca-9f27e75374f5 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79/tags" status: 204 len: 0 microversion: 2.26 time: 0.210193 Apr 16 21:25:14.655985 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2406/4633] 10.222.0.20 () {60 vars in 1294 bytes} [Sat Apr 16 21:25:14 2022] DELETE /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79/tags => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 16 21:25:14.667424 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3f6097d7-964e-4411-a6fc-a5828a5ecd49 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Calling method '.version_select at 0x7fbba000fd30>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:14.703865 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3f6097d7-964e-4411-a6fc-a5828a5ecd49 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:14.705053 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3f6097d7-964e-4411-a6fc-a5828a5ecd49 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:14.715862 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3f6097d7-964e-4411-a6fc-a5828a5ecd49 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] 10.222.0.20 "GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79/tags" status: 200 len: 12 microversion: 2.26 time: 0.055578 Apr 16 21:25:14.716877 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2407/4634] 10.222.0.20 () {60 vars in 1291 bytes} [Sat Apr 16 21:25:14 2022] GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79/tags => generated 12 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:25:14.736624 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4b79d6ab-fda8-4872-aea7-039e072e9195 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Calling method '.version_select at 0x7fbb95c074c0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:14.745264 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4b79d6ab-fda8-4872-aea7-039e072e9195 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:14.745793 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4b79d6ab-fda8-4872-aea7-039e072e9195 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:14.746228 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4b79d6ab-fda8-4872-aea7-039e072e9195 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] [instance: 9c206aa5-5455-49ad-81ee-23ba46fc9d79] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:14.751786 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4b79d6ab-fda8-4872-aea7-039e072e9195 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:14.752335 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4b79d6ab-fda8-4872-aea7-039e072e9195 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:14.753162 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4b79d6ab-fda8-4872-aea7-039e072e9195 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:14.753756 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4b79d6ab-fda8-4872-aea7-039e072e9195 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:14.784072 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4b79d6ab-fda8-4872-aea7-039e072e9195 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:14.784953 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4b79d6ab-fda8-4872-aea7-039e072e9195 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:14.797509 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-4b79d6ab-fda8-4872-aea7-039e072e9195 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lazy-loading 'flavor' on Instance uuid 9c206aa5-5455-49ad-81ee-23ba46fc9d79 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:25:14.819824 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4b79d6ab-fda8-4872-aea7-039e072e9195 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79/tags" status: 204 len: 0 microversion: 2.26 time: 0.095788 Apr 16 21:25:14.820656 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2408/4635] 10.222.0.20 () {60 vars in 1294 bytes} [Sat Apr 16 21:25:14 2022] DELETE /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79/tags => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 16 21:25:14.830594 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-92b473c8-4dfb-4b8a-9956-61cabd4069d6 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Calling method '.version_select at 0x7fbb9ff3b9d0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:14.839571 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-92b473c8-4dfb-4b8a-9956-61cabd4069d6 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:14.840039 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-92b473c8-4dfb-4b8a-9956-61cabd4069d6 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:14.840584 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-92b473c8-4dfb-4b8a-9956-61cabd4069d6 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] [instance: 9c206aa5-5455-49ad-81ee-23ba46fc9d79] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:14.847312 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-92b473c8-4dfb-4b8a-9956-61cabd4069d6 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:14.848251 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-92b473c8-4dfb-4b8a-9956-61cabd4069d6 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:14.848841 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-92b473c8-4dfb-4b8a-9956-61cabd4069d6 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:14.849518 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-92b473c8-4dfb-4b8a-9956-61cabd4069d6 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:14.851160 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4c092230-f316-474e-817a-ed4062db1a26 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:14.861724 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4c092230-f316-474e-817a-ed4062db1a26 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.256533 Apr 16 21:25:14.869594 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2228/4636] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:14 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:14.873768 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-92b473c8-4dfb-4b8a-9956-61cabd4069d6 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:14.874295 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-92b473c8-4dfb-4b8a-9956-61cabd4069d6 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:14.884009 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-92b473c8-4dfb-4b8a-9956-61cabd4069d6 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:14.884564 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-92b473c8-4dfb-4b8a-9956-61cabd4069d6 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:14.921141 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2762c55f-bee3-499d-849f-9507406e801e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2114955005", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "key_name": "tempest-key-1546702523", "networks": [{"uuid": "1b9ee265-bdab-4092-8071-c9bb95d911fb"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:14.969599 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-92b473c8-4dfb-4b8a-9956-61cabd4069d6 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lazy-loading 'flavor' on Instance uuid 9c206aa5-5455-49ad-81ee-23ba46fc9d79 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:25:14.981692 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-2762c55f-bee3-499d-849f-9507406e801e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] validate_networks() for [('1b9ee265-bdab-4092-8071-c9bb95d911fb', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:25:14.993543 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-92b473c8-4dfb-4b8a-9956-61cabd4069d6 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] 10.222.0.20 "PUT /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79/tags/tempest-tag-850537474" status: 201 len: 0 microversion: 2.26 time: 0.167069 Apr 16 21:25:15.000059 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2409/4637] 10.222.0.20 () {62 vars in 1376 bytes} [Sat Apr 16 21:25:14 2022] PUT /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79/tags/tempest-tag-850537474 => generated 0 bytes in 169 msecs (HTTP/1.1 201) 10 headers in 485 bytes (2 switches on core 0) Apr 16 21:25:15.005470 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-40607ab8-4eb5-46bf-b085-20aaf7764d34 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:15.006251 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-40607ab8-4eb5-46bf-b085-20aaf7764d34 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:15.012513 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40607ab8-4eb5-46bf-b085-20aaf7764d34 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:15.013113 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40607ab8-4eb5-46bf-b085-20aaf7764d34 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:15.014053 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40607ab8-4eb5-46bf-b085-20aaf7764d34 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:15.014595 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40607ab8-4eb5-46bf-b085-20aaf7764d34 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:15.181420 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-2762c55f-bee3-499d-849f-9507406e801e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] HTTP exception thrown: Invalid key_name provided. Apr 16 21:25:15.182182 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2762c55f-bee3-499d-849f-9507406e801e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Returning 400 to user: Invalid key_name provided. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:25:15.183040 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2762c55f-bee3-499d-849f-9507406e801e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.266531 Apr 16 21:25:15.183898 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2229/4638] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:25:14 2022] POST /compute/v2.1/servers => generated 70 bytes in 268 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Apr 16 21:25:15.192801 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a7e474ed-11a3-4baa-891d-c0a725afebb4 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Calling method '.version_select at 0x7fbb9561baf0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:15.198629 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a7e474ed-11a3-4baa-891d-c0a725afebb4 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:15.199107 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a7e474ed-11a3-4baa-891d-c0a725afebb4 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:15.199597 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a7e474ed-11a3-4baa-891d-c0a725afebb4 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] [instance: 9c206aa5-5455-49ad-81ee-23ba46fc9d79] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:15.205181 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a7e474ed-11a3-4baa-891d-c0a725afebb4 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:15.205658 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a7e474ed-11a3-4baa-891d-c0a725afebb4 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:15.206448 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a7e474ed-11a3-4baa-891d-c0a725afebb4 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:15.206907 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a7e474ed-11a3-4baa-891d-c0a725afebb4 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:15.230555 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a7e474ed-11a3-4baa-891d-c0a725afebb4 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:15.231025 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a7e474ed-11a3-4baa-891d-c0a725afebb4 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:15.241719 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a7e474ed-11a3-4baa-891d-c0a725afebb4 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:15.241937 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a7e474ed-11a3-4baa-891d-c0a725afebb4 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:15.331181 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-a7e474ed-11a3-4baa-891d-c0a725afebb4 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lazy-loading 'flavor' on Instance uuid 9c206aa5-5455-49ad-81ee-23ba46fc9d79 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:25:15.331861 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-40607ab8-4eb5-46bf-b085-20aaf7764d34 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:15.344645 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-40607ab8-4eb5-46bf-b085-20aaf7764d34 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1528 microversion: 2.1 time: 0.343401 Apr 16 21:25:15.356002 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2410/4639] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:14 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1528 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:15.357100 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a7e474ed-11a3-4baa-891d-c0a725afebb4 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] 10.222.0.20 "PUT /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79/tags/tempest-tag-1341082223" status: 201 len: 0 microversion: 2.26 time: 0.172071 Apr 16 21:25:15.357902 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2230/4640] 10.222.0.20 () {62 vars in 1379 bytes} [Sat Apr 16 21:25:15 2022] PUT /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79/tags/tempest-tag-1341082223 => generated 0 bytes in 173 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Apr 16 21:25:15.361568 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e4252a38-86e9-49dc-9a22-3deb6dfb9237 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:15.362825 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e4252a38-86e9-49dc-9a22-3deb6dfb9237 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] [instance: 5bec80bd-63c1-45bf-a379-98f4c375f318] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:15.367687 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5c3167d3-96cf-454f-b097-ff8792b1c07a tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:15.368358 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5c3167d3-96cf-454f-b097-ff8792b1c07a tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:15.369837 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e4252a38-86e9-49dc-9a22-3deb6dfb9237 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:15.370889 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e4252a38-86e9-49dc-9a22-3deb6dfb9237 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:15.371638 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e4252a38-86e9-49dc-9a22-3deb6dfb9237 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:15.372088 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e4252a38-86e9-49dc-9a22-3deb6dfb9237 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:15.375313 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5c3167d3-96cf-454f-b097-ff8792b1c07a tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:15.376077 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5c3167d3-96cf-454f-b097-ff8792b1c07a tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:15.382793 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5c3167d3-96cf-454f-b097-ff8792b1c07a tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:15.382793 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5c3167d3-96cf-454f-b097-ff8792b1c07a tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:15.528875 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5c3167d3-96cf-454f-b097-ff8792b1c07a tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:15.539217 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5c3167d3-96cf-454f-b097-ff8792b1c07a tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.175950 Apr 16 21:25:15.539847 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2231/4641] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:15 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:15.558359 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-236d6032-9a8e-467b-879c-36221f8a3a27 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Action: 'update_all', calling method: .version_select at 0x7fbb95716040>, body: {"tags": ["tempest-tag-319890193", "tempest-tag-875155987"]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:15.567126 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-236d6032-9a8e-467b-879c-36221f8a3a27 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:15.567598 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-236d6032-9a8e-467b-879c-36221f8a3a27 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:15.568096 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-236d6032-9a8e-467b-879c-36221f8a3a27 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] [instance: 9c206aa5-5455-49ad-81ee-23ba46fc9d79] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:15.574335 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-236d6032-9a8e-467b-879c-36221f8a3a27 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:15.574801 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-236d6032-9a8e-467b-879c-36221f8a3a27 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:15.575604 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-236d6032-9a8e-467b-879c-36221f8a3a27 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:15.576123 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-236d6032-9a8e-467b-879c-36221f8a3a27 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:15.605073 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-236d6032-9a8e-467b-879c-36221f8a3a27 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:15.605772 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-236d6032-9a8e-467b-879c-36221f8a3a27 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:15.754512 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-236d6032-9a8e-467b-879c-36221f8a3a27 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lazy-loading 'flavor' on Instance uuid 9c206aa5-5455-49ad-81ee-23ba46fc9d79 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:25:15.764567 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e4252a38-86e9-49dc-9a22-3deb6dfb9237 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:15.771879 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-236d6032-9a8e-467b-879c-36221f8a3a27 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] 10.222.0.20 "PUT /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79/tags" status: 200 len: 60 microversion: 2.26 time: 0.217758 Apr 16 21:25:15.772560 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2232/4642] 10.222.0.20 () {62 vars in 1311 bytes} [Sat Apr 16 21:25:15 2022] PUT /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79/tags => generated 60 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:15.775797 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e4252a38-86e9-49dc-9a22-3deb6dfb9237 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:15.779633 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e4252a38-86e9-49dc-9a22-3deb6dfb9237 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:15.779803 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-01a386ef-8a52-4de2-aab7-dd9f50517dc1 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:15.779803 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-01a386ef-8a52-4de2-aab7-dd9f50517dc1 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:15.780476 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e4252a38-86e9-49dc-9a22-3deb6dfb9237 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] 10.222.0.20 "GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318" status: 200 len: 1335 microversion: 2.54 time: 0.422584 Apr 16 21:25:15.781382 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2411/4643] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:15 2022] GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318 => generated 1335 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:15.785275 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-01a386ef-8a52-4de2-aab7-dd9f50517dc1 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:15.786305 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-01a386ef-8a52-4de2-aab7-dd9f50517dc1 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:15.787110 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-01a386ef-8a52-4de2-aab7-dd9f50517dc1 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:15.787567 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-01a386ef-8a52-4de2-aab7-dd9f50517dc1 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:15.796962 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-93a05403-d9f4-4e72-9a30-d2f667fa6280 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Calling method '.version_select at 0x7fbb95c07550>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:15.805189 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-93a05403-d9f4-4e72-9a30-d2f667fa6280 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:15.805663 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-93a05403-d9f4-4e72-9a30-d2f667fa6280 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:15.814543 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-93a05403-d9f4-4e72-9a30-d2f667fa6280 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] 10.222.0.20 "GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79/tags" status: 200 len: 60 microversion: 2.26 time: 0.021634 Apr 16 21:25:15.815142 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2412/4644] 10.222.0.20 () {60 vars in 1291 bytes} [Sat Apr 16 21:25:15 2022] GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79/tags => generated 60 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:15.824469 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cc551d4a-0c4a-4e8d-afde-74d69d55bc9e tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Calling method '.version_select at 0x7fbb95752280>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:15.833112 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cc551d4a-0c4a-4e8d-afde-74d69d55bc9e tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:15.833303 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cc551d4a-0c4a-4e8d-afde-74d69d55bc9e tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:15.833789 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cc551d4a-0c4a-4e8d-afde-74d69d55bc9e tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] [instance: 9c206aa5-5455-49ad-81ee-23ba46fc9d79] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:15.839492 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cc551d4a-0c4a-4e8d-afde-74d69d55bc9e tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:15.840024 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cc551d4a-0c4a-4e8d-afde-74d69d55bc9e tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:15.840911 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cc551d4a-0c4a-4e8d-afde-74d69d55bc9e tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:15.841365 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cc551d4a-0c4a-4e8d-afde-74d69d55bc9e tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:15.869621 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cc551d4a-0c4a-4e8d-afde-74d69d55bc9e tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:15.870113 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cc551d4a-0c4a-4e8d-afde-74d69d55bc9e tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:15.933821 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-01a386ef-8a52-4de2-aab7-dd9f50517dc1 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:15.942193 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-cc551d4a-0c4a-4e8d-afde-74d69d55bc9e tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lazy-loading 'flavor' on Instance uuid 9c206aa5-5455-49ad-81ee-23ba46fc9d79 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:25:15.942407 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-01a386ef-8a52-4de2-aab7-dd9f50517dc1 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.168438 Apr 16 21:25:15.943738 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2233/4645] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:15 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:15.969328 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cc551d4a-0c4a-4e8d-afde-74d69d55bc9e tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79/tags" status: 204 len: 0 microversion: 2.26 time: 0.148540 Apr 16 21:25:15.970705 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2413/4646] 10.222.0.20 () {60 vars in 1294 bytes} [Sat Apr 16 21:25:15 2022] DELETE /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79/tags => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 16 21:25:15.983250 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0f9e4736-847c-4b24-b436-bd3fa8601575 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:15.983803 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0f9e4736-847c-4b24-b436-bd3fa8601575 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] [instance: 9c206aa5-5455-49ad-81ee-23ba46fc9d79] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:15.990885 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0f9e4736-847c-4b24-b436-bd3fa8601575 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:15.991394 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0f9e4736-847c-4b24-b436-bd3fa8601575 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:15.992252 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0f9e4736-847c-4b24-b436-bd3fa8601575 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:15.992708 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0f9e4736-847c-4b24-b436-bd3fa8601575 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:16.004368 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6ffbefd9-0c35-4747-b1dd-1ed95fe6a3ba tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-779187987", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "1b9ee265-bdab-4092-8071-c9bb95d911fb"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:16.024356 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0f9e4736-847c-4b24-b436-bd3fa8601575 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] [instance: 9c206aa5-5455-49ad-81ee-23ba46fc9d79] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:25:16.171691 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.security_group_api [None req-6ffbefd9-0c35-4747-b1dd-1ed95fe6a3ba tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Neutron security group does_not_exist not found {{(pid=137408) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Apr 16 21:25:16.172366 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-6ffbefd9-0c35-4747-b1dd-1ed95fe6a3ba tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Apr 16 21:25:16.173029 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6ffbefd9-0c35-4747-b1dd-1ed95fe6a3ba tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:25:16.173943 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6ffbefd9-0c35-4747-b1dd-1ed95fe6a3ba tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.173579 Apr 16 21:25:16.174528 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2414/4647] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:25:15 2022] POST /compute/v2.1/servers => generated 106 bytes in 175 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:25:16.183938 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-558a4418-4db8-4bdf-a5d0-f75e793545d2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:16.184581 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-558a4418-4db8-4bdf-a5d0-f75e793545d2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:16.190592 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-558a4418-4db8-4bdf-a5d0-f75e793545d2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:16.191057 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-558a4418-4db8-4bdf-a5d0-f75e793545d2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:16.192378 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-558a4418-4db8-4bdf-a5d0-f75e793545d2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:16.192825 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-558a4418-4db8-4bdf-a5d0-f75e793545d2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:16.390064 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0f9e4736-847c-4b24-b436-bd3fa8601575 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79" status: 204 len: 0 microversion: 2.26 time: 0.412267 Apr 16 21:25:16.391210 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2234/4648] 10.222.0.20 () {60 vars in 1279 bytes} [Sat Apr 16 21:25:15 2022] DELETE /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 16 21:25:16.399008 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9acbce57-8af3-4f4f-835c-179d1c5a4d6b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:16.399993 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9acbce57-8af3-4f4f-835c-179d1c5a4d6b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:16.407965 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9acbce57-8af3-4f4f-835c-179d1c5a4d6b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:16.408699 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9acbce57-8af3-4f4f-835c-179d1c5a4d6b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:16.409737 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9acbce57-8af3-4f4f-835c-179d1c5a4d6b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:16.410995 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9acbce57-8af3-4f4f-835c-179d1c5a4d6b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:16.493589 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-558a4418-4db8-4bdf-a5d0-f75e793545d2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:16.508056 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-558a4418-4db8-4bdf-a5d0-f75e793545d2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.329035 Apr 16 21:25:16.509286 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2415/4649] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:16 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:25:16.515335 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-87a95a0b-0443-4d82-b678-2c946dc416ce tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:16.516321 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-87a95a0b-0443-4d82-b678-2c946dc416ce tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] [instance: 9c206aa5-5455-49ad-81ee-23ba46fc9d79] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:16.524005 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-87a95a0b-0443-4d82-b678-2c946dc416ce tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:16.524929 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-87a95a0b-0443-4d82-b678-2c946dc416ce tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:16.525927 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-87a95a0b-0443-4d82-b678-2c946dc416ce tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:16.526858 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-87a95a0b-0443-4d82-b678-2c946dc416ce tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:16.565671 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9acbce57-8af3-4f4f-835c-179d1c5a4d6b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:16.573739 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9acbce57-8af3-4f4f-835c-179d1c5a4d6b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1528 microversion: 2.1 time: 0.181530 Apr 16 21:25:16.574571 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2235/4650] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:16 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1528 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:16.581759 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ab8a98fe-ea7f-4705-ae29-4522e5916cf8 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:16.582439 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ab8a98fe-ea7f-4705-ae29-4522e5916cf8 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:16.588448 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ab8a98fe-ea7f-4705-ae29-4522e5916cf8 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:16.588942 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ab8a98fe-ea7f-4705-ae29-4522e5916cf8 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:16.589817 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ab8a98fe-ea7f-4705-ae29-4522e5916cf8 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:16.590307 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ab8a98fe-ea7f-4705-ae29-4522e5916cf8 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:16.728364 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ab8a98fe-ea7f-4705-ae29-4522e5916cf8 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:16.735783 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ab8a98fe-ea7f-4705-ae29-4522e5916cf8 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.159994 Apr 16 21:25:16.736392 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2236/4651] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:16 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:16.771811 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-878b3d22-ded9-4488-b1da-c806f99620c6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:16.772485 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-878b3d22-ded9-4488-b1da-c806f99620c6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: 5c7e763a-1026-4f65-a839-8c1ca31515dd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:16.786201 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-878b3d22-ded9-4488-b1da-c806f99620c6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] HTTP exception thrown: Instance 5c7e763a-1026-4f65-a839-8c1ca31515dd could not be found. Apr 16 21:25:16.786944 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-878b3d22-ded9-4488-b1da-c806f99620c6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Returning 404 to user: Instance 5c7e763a-1026-4f65-a839-8c1ca31515dd could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:25:16.788416 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-878b3d22-ded9-4488-b1da-c806f99620c6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5c7e763a-1026-4f65-a839-8c1ca31515dd" status: 404 len: 111 microversion: 2.1 time: 0.027130 Apr 16 21:25:16.789516 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2237/4652] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:25:16 2022] DELETE /compute/v2.1/servers/5c7e763a-1026-4f65-a839-8c1ca31515dd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:25:16.806007 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4c66b8fe-8d34-472a-bea1-0ad85ffd9e32 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:16.808212 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4c66b8fe-8d34-472a-bea1-0ad85ffd9e32 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:16.821275 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4c66b8fe-8d34-472a-bea1-0ad85ffd9e32 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:16.821746 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4c66b8fe-8d34-472a-bea1-0ad85ffd9e32 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:16.822633 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4c66b8fe-8d34-472a-bea1-0ad85ffd9e32 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:16.823091 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4c66b8fe-8d34-472a-bea1-0ad85ffd9e32 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:16.825354 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-87a95a0b-0443-4d82-b678-2c946dc416ce tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:16.838626 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-87a95a0b-0443-4d82-b678-2c946dc416ce tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:16.841729 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-87a95a0b-0443-4d82-b678-2c946dc416ce tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:16.844020 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-87a95a0b-0443-4d82-b678-2c946dc416ce tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] 10.222.0.20 "GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79" status: 200 len: 1551 microversion: 2.26 time: 0.333183 Apr 16 21:25:16.845682 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2416/4653] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:16 2022] GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79 => generated 1551 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:16.852916 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fef6c98e-6c61-4198-b6c9-71fc19a3a6a3 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:16.854276 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fef6c98e-6c61-4198-b6c9-71fc19a3a6a3 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] [instance: 5bec80bd-63c1-45bf-a379-98f4c375f318] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:16.861679 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fef6c98e-6c61-4198-b6c9-71fc19a3a6a3 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:16.868308 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fef6c98e-6c61-4198-b6c9-71fc19a3a6a3 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:16.869876 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fef6c98e-6c61-4198-b6c9-71fc19a3a6a3 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:16.872981 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fef6c98e-6c61-4198-b6c9-71fc19a3a6a3 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:16.998292 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4c66b8fe-8d34-472a-bea1-0ad85ffd9e32 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:17.008548 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4c66b8fe-8d34-472a-bea1-0ad85ffd9e32 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.213513 Apr 16 21:25:17.015194 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fef6c98e-6c61-4198-b6c9-71fc19a3a6a3 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:17.023479 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2238/4654] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:16 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:17.025941 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fef6c98e-6c61-4198-b6c9-71fc19a3a6a3 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:17.027862 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fef6c98e-6c61-4198-b6c9-71fc19a3a6a3 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:17.029850 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fef6c98e-6c61-4198-b6c9-71fc19a3a6a3 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] 10.222.0.20 "GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318" status: 200 len: 1356 microversion: 2.54 time: 0.182916 Apr 16 21:25:17.030719 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2417/4655] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:16 2022] GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318 => generated 1356 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:17.031451 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5e982611-4918-4918-ac66-7f5c0dddc9ac tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:17.032086 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5e982611-4918-4918-ac66-7f5c0dddc9ac tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:17.050083 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5e982611-4918-4918-ac66-7f5c0dddc9ac tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:17.050626 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5e982611-4918-4918-ac66-7f5c0dddc9ac tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:17.051840 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0241358e-35ed-4646-96e2-cee8c571004f tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Action: 'create', calling method: .version_select at 0x7fbba000f550>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1765095927"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:17.052351 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5e982611-4918-4918-ac66-7f5c0dddc9ac tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:17.053199 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5e982611-4918-4918-ac66-7f5c0dddc9ac tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:17.070115 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-0241358e-35ed-4646-96e2-cee8c571004f tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Getting quotas for project 94f6b07b308c4af99aaecfbf00e08590. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:25:17.076854 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-0241358e-35ed-4646-96e2-cee8c571004f tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Getting quotas for user 6d933704fe0946419f1644c2f19b2431 and project 94f6b07b308c4af99aaecfbf00e08590. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:25:17.224103 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5e982611-4918-4918-ac66-7f5c0dddc9ac tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:17.245793 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5e982611-4918-4918-ac66-7f5c0dddc9ac tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.220478 Apr 16 21:25:17.246786 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2239/4656] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:17 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:17.263919 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0de2834f-835e-4129-ac0f-62d07ae03696 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:17.264667 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0de2834f-835e-4129-ac0f-62d07ae03696 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Failed to fetch instance by id 9223372036854775808 {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2924}} Apr 16 21:25:17.265263 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-0de2834f-835e-4129-ac0f-62d07ae03696 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Apr 16 21:25:17.266036 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0de2834f-835e-4129-ac0f-62d07ae03696 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:25:17.267451 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0de2834f-835e-4129-ac0f-62d07ae03696 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.008298 Apr 16 21:25:17.268063 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2240/4657] 10.222.0.20 () {58 vars in 1187 bytes} [Sat Apr 16 21:25:17 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 10 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Apr 16 21:25:17.276758 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e9bba4a9-ed07-481d-8952-f90ac19b09a2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:17.277577 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e9bba4a9-ed07-481d-8952-f90ac19b09a2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:17.283962 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e9bba4a9-ed07-481d-8952-f90ac19b09a2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:17.284713 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e9bba4a9-ed07-481d-8952-f90ac19b09a2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:17.286287 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e9bba4a9-ed07-481d-8952-f90ac19b09a2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:17.286894 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e9bba4a9-ed07-481d-8952-f90ac19b09a2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:17.451722 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e9bba4a9-ed07-481d-8952-f90ac19b09a2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:17.460992 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e9bba4a9-ed07-481d-8952-f90ac19b09a2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.187825 Apr 16 21:25:17.461898 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2241/4658] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:17 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:17.473491 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6947787b-2ffd-4c60-b079-b9d19675dee7 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-537034305", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "26fd8c71-2108-482c-9702-fc8775f3578f"}], "security_groups": [{"name": "tempest-securitygroup--197122296"}], "key_name": "tempest-keypair-1672362320", "user_data": "}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:17.624021 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-6947787b-2ffd-4c60-b079-b9d19675dee7 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] validate_networks() for [('26fd8c71-2108-482c-9702-fc8775f3578f', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:25:17.737977 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-0241358e-35ed-4646-96e2-cee8c571004f tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Getting quotas for project 94f6b07b308c4af99aaecfbf00e08590. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:25:17.747953 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-0241358e-35ed-4646-96e2-cee8c571004f tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Getting quotas for user 6d933704fe0946419f1644c2f19b2431 and project 94f6b07b308c4af99aaecfbf00e08590. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:25:17.758856 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0241358e-35ed-4646-96e2-cee8c571004f tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 2339 microversion: 2.54 time: 0.712081 Apr 16 21:25:17.759460 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2418/4659] 10.222.0.20 () {62 vars in 1198 bytes} [Sat Apr 16 21:25:17 2022] POST /compute/v2.1/os-keypairs => generated 2339 bytes in 713 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 16 21:25:17.764450 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1569b148-d0e9-4dd8-b4b4-3956be36c9fd tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:17.765176 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1569b148-d0e9-4dd8-b4b4-3956be36c9fd tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:17.773425 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1569b148-d0e9-4dd8-b4b4-3956be36c9fd tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:17.773923 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1569b148-d0e9-4dd8-b4b4-3956be36c9fd tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:17.774936 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1569b148-d0e9-4dd8-b4b4-3956be36c9fd tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:17.775400 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1569b148-d0e9-4dd8-b4b4-3956be36c9fd tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:18.007241 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1569b148-d0e9-4dd8-b4b4-3956be36c9fd tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:18.018660 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1569b148-d0e9-4dd8-b4b4-3956be36c9fd tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.257804 Apr 16 21:25:18.020284 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2419/4660] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:17 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:18.029824 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5a3d0783-adf0-4186-bcf0-37f8885273db tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:18.030828 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5a3d0783-adf0-4186-bcf0-37f8885273db tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:18.038859 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5a3d0783-adf0-4186-bcf0-37f8885273db tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:18.040903 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5a3d0783-adf0-4186-bcf0-37f8885273db tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:18.040903 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5a3d0783-adf0-4186-bcf0-37f8885273db tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:18.041155 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5a3d0783-adf0-4186-bcf0-37f8885273db tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:18.194252 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5a3d0783-adf0-4186-bcf0-37f8885273db tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:18.203996 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5a3d0783-adf0-4186-bcf0-37f8885273db tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1523 microversion: 2.1 time: 0.181606 Apr 16 21:25:18.212425 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2420/4661] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:18 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:18.214360 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-916bffa6-5034-4ebf-82ee-5218d4b9692c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1765095927", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:18.215976 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-916bffa6-5034-4ebf-82ee-5218d4b9692c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] [instance: 5bec80bd-63c1-45bf-a379-98f4c375f318] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:18.222662 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-916bffa6-5034-4ebf-82ee-5218d4b9692c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:18.223167 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-916bffa6-5034-4ebf-82ee-5218d4b9692c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:18.224792 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-916bffa6-5034-4ebf-82ee-5218d4b9692c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:18.224792 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-916bffa6-5034-4ebf-82ee-5218d4b9692c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:18.319065 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-916bffa6-5034-4ebf-82ee-5218d4b9692c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:25:18.319567 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-916bffa6-5034-4ebf-82ee-5218d4b9692c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:25:18.320096 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-916bffa6-5034-4ebf-82ee-5218d4b9692c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:25:18.320595 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-916bffa6-5034-4ebf-82ee-5218d4b9692c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:25:18.320929 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-916bffa6-5034-4ebf-82ee-5218d4b9692c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:25:18.374499 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-6947787b-2ffd-4c60-b079-b9d19675dee7 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:25:18.375423 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-6947787b-2ffd-4c60-b079-b9d19675dee7 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:25:18.376040 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-6947787b-2ffd-4c60-b079-b9d19675dee7 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:25:18.376572 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-6947787b-2ffd-4c60-b079-b9d19675dee7 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:25:18.377630 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-6947787b-2ffd-4c60-b079-b9d19675dee7 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:25:18.391148 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6947787b-2ffd-4c60-b079-b9d19675dee7 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:18.392164 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6947787b-2ffd-4c60-b079-b9d19675dee7 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:18.393385 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6947787b-2ffd-4c60-b079-b9d19675dee7 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:18.394086 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6947787b-2ffd-4c60-b079-b9d19675dee7 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:18.432248 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-6947787b-2ffd-4c60-b079-b9d19675dee7 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Getting quotas for project d6f8dfa11e9b410cbbd59ffe32afeb26. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:25:18.438023 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-6947787b-2ffd-4c60-b079-b9d19675dee7 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Getting quotas for user 37443a4e933a4873bb039b06efaec98f and project d6f8dfa11e9b410cbbd59ffe32afeb26. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:25:18.451736 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6947787b-2ffd-4c60-b079-b9d19675dee7 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:25:18.454360 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6947787b-2ffd-4c60-b079-b9d19675dee7 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 0c30b376-2903-4058-b436-4644778f3352] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:25:18.576100 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6947787b-2ffd-4c60-b079-b9d19675dee7 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.113013 Apr 16 21:25:18.589315 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2242/4662] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:25:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 1127 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:25:18.595881 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-afdc9288-562a-4983-bd54-3f01a3d4a590 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:18.598877 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-afdc9288-562a-4983-bd54-3f01a3d4a590 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] [instance: 9c206aa5-5455-49ad-81ee-23ba46fc9d79] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:18.619526 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-afdc9288-562a-4983-bd54-3f01a3d4a590 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:18.619993 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-afdc9288-562a-4983-bd54-3f01a3d4a590 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:18.625732 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-916bffa6-5034-4ebf-82ee-5218d4b9692c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] [instance: 5bec80bd-63c1-45bf-a379-98f4c375f318] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:18.641620 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-916bffa6-5034-4ebf-82ee-5218d4b9692c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:18.642158 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-916bffa6-5034-4ebf-82ee-5218d4b9692c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:18.643257 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-916bffa6-5034-4ebf-82ee-5218d4b9692c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:18.644845 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-916bffa6-5034-4ebf-82ee-5218d4b9692c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:18.645094 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-afdc9288-562a-4983-bd54-3f01a3d4a590 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:18.645316 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-afdc9288-562a-4983-bd54-3f01a3d4a590 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:18.716697 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-916bffa6-5034-4ebf-82ee-5218d4b9692c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] 10.222.0.20 "POST /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318/action" status: 202 len: 1139 microversion: 2.54 time: 0.510588 Apr 16 21:25:18.724136 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2421/4663] 10.222.0.20 () {62 vars in 1319 bytes} [Sat Apr 16 21:25:18 2022] POST /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318/action => generated 1139 bytes in 518 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Apr 16 21:25:18.745086 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e135fbdb-f2ee-406e-99e6-c900425b59d1 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:18.745756 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e135fbdb-f2ee-406e-99e6-c900425b59d1 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Failed to fetch instance by id -1 {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2924}} Apr 16 21:25:18.746443 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-e135fbdb-f2ee-406e-99e6-c900425b59d1 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] HTTP exception thrown: Instance -1 could not be found. Apr 16 21:25:18.747647 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e135fbdb-f2ee-406e-99e6-c900425b59d1 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Returning 404 to user: Instance -1 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:25:18.748695 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e135fbdb-f2ee-406e-99e6-c900425b59d1 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.023175 Apr 16 21:25:18.750329 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2422/4664] 10.222.0.20 () {58 vars in 1136 bytes} [Sat Apr 16 21:25:18 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:25:18.756869 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-873c8889-dae4-4dc1-89cb-05fb0946e958 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:18.758275 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-873c8889-dae4-4dc1-89cb-05fb0946e958 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 0c30b376-2903-4058-b436-4644778f3352] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:18.824937 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-afdc9288-562a-4983-bd54-3f01a3d4a590 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:18.834259 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-afdc9288-562a-4983-bd54-3f01a3d4a590 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:18.840971 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-afdc9288-562a-4983-bd54-3f01a3d4a590 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:18.843913 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-afdc9288-562a-4983-bd54-3f01a3d4a590 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] 10.222.0.20 "GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79" status: 200 len: 1509 microversion: 2.26 time: 0.252470 Apr 16 21:25:18.858350 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2243/4665] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:18 2022] GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79 => generated 1509 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:18.858579 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-873c8889-dae4-4dc1-89cb-05fb0946e958 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:18.860754 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-68b68bad-4f40-4a2c-8a2f-212929fced5e tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:18.861464 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-68b68bad-4f40-4a2c-8a2f-212929fced5e tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] [instance: 5bec80bd-63c1-45bf-a379-98f4c375f318] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:18.864043 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-873c8889-dae4-4dc1-89cb-05fb0946e958 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352" status: 200 len: 1241 microversion: 2.1 time: 0.112494 Apr 16 21:25:18.865583 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2423/4666] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:18 2022] GET /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352 => generated 1241 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:18.877637 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-464b7d5d-6951-4b64-803f-2e296694bf98 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:18.878517 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-464b7d5d-6951-4b64-803f-2e296694bf98 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:18.878937 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-68b68bad-4f40-4a2c-8a2f-212929fced5e tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:18.879445 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-68b68bad-4f40-4a2c-8a2f-212929fced5e tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:18.880283 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-68b68bad-4f40-4a2c-8a2f-212929fced5e tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:18.880746 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-68b68bad-4f40-4a2c-8a2f-212929fced5e tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:18.897739 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-464b7d5d-6951-4b64-803f-2e296694bf98 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:18.898535 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-464b7d5d-6951-4b64-803f-2e296694bf98 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:18.899799 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-464b7d5d-6951-4b64-803f-2e296694bf98 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:18.901374 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-464b7d5d-6951-4b64-803f-2e296694bf98 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:19.122193 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-68b68bad-4f40-4a2c-8a2f-212929fced5e tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:19.141742 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-68b68bad-4f40-4a2c-8a2f-212929fced5e tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:19.146360 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-68b68bad-4f40-4a2c-8a2f-212929fced5e tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:19.146360 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-68b68bad-4f40-4a2c-8a2f-212929fced5e tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] 10.222.0.20 "GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318" status: 200 len: 1408 microversion: 2.54 time: 0.295966 Apr 16 21:25:19.155038 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-464b7d5d-6951-4b64-803f-2e296694bf98 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:19.159330 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2244/4667] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:18 2022] GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318 => generated 1408 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:19.167908 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-464b7d5d-6951-4b64-803f-2e296694bf98 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.297900 Apr 16 21:25:19.168753 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2424/4668] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:18 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:19.197030 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6a1a2f3b-9e1d-4a26-9dda-c4ff50f564f1 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:19.200994 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6a1a2f3b-9e1d-4a26-9dda-c4ff50f564f1 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:19.211822 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-d12dc30c-eb57-4bd8-aecd-7def8808110f req-aa0e1aee-b062-4a2e-a5b0-42cde4c5d012 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aa577ae-2715-44de-93bb-d02db79533fb", "name": "network-vif-plugged", "status": "completed", "tag": "c79de46c-1a6f-418e-b267-0c88759e0458"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:19.222202 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6a1a2f3b-9e1d-4a26-9dda-c4ff50f564f1 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:19.226343 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6a1a2f3b-9e1d-4a26-9dda-c4ff50f564f1 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:19.228447 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6a1a2f3b-9e1d-4a26-9dda-c4ff50f564f1 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:19.231788 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6a1a2f3b-9e1d-4a26-9dda-c4ff50f564f1 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:19.241101 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-d12dc30c-eb57-4bd8-aecd-7def8808110f req-aa0e1aee-b062-4a2e-a5b0-42cde4c5d012 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:19.245781 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-d12dc30c-eb57-4bd8-aecd-7def8808110f req-aa0e1aee-b062-4a2e-a5b0-42cde4c5d012 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:19.274406 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-d12dc30c-eb57-4bd8-aecd-7def8808110f req-aa0e1aee-b062-4a2e-a5b0-42cde4c5d012 service nova] Creating event network-vif-plugged:c79de46c-1a6f-418e-b267-0c88759e0458 for instance 6aa577ae-2715-44de-93bb-d02db79533fb on nch1-master-1 Apr 16 21:25:19.291030 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-d12dc30c-eb57-4bd8-aecd-7def8808110f req-aa0e1aee-b062-4a2e-a5b0-42cde4c5d012 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102065 Apr 16 21:25:19.292396 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2245/4669] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:25:19.304388 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-88f04d26-93c3-432c-b931-a901caa26fca tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:19.305506 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-88f04d26-93c3-432c-b931-a901caa26fca tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:19.314677 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-88f04d26-93c3-432c-b931-a901caa26fca tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:19.315484 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-88f04d26-93c3-432c-b931-a901caa26fca tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:19.320077 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-88f04d26-93c3-432c-b931-a901caa26fca tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:19.321025 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-88f04d26-93c3-432c-b931-a901caa26fca tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:19.565437 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6a1a2f3b-9e1d-4a26-9dda-c4ff50f564f1 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:19.580388 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6a1a2f3b-9e1d-4a26-9dda-c4ff50f564f1 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.391021 Apr 16 21:25:19.595330 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2425/4670] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:19 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:25:19.604000 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-ddbd85f7-99db-4fd1-9fba-0451f90de588 req-58a67b6f-efce-4e83-821b-6562f7f6fd52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c206aa5-5455-49ad-81ee-23ba46fc9d79", "name": "network-vif-deleted", "tag": "edfa0ac5-33d0-466c-89bb-63c2070d6c89"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:19.616698 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-ddbd85f7-99db-4fd1-9fba-0451f90de588 req-58a67b6f-efce-4e83-821b-6562f7f6fd52 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:19.619299 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-ddbd85f7-99db-4fd1-9fba-0451f90de588 req-58a67b6f-efce-4e83-821b-6562f7f6fd52 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:19.665835 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-ddbd85f7-99db-4fd1-9fba-0451f90de588 req-58a67b6f-efce-4e83-821b-6562f7f6fd52 service nova] Creating event network-vif-deleted:edfa0ac5-33d0-466c-89bb-63c2070d6c89 for instance 9c206aa5-5455-49ad-81ee-23ba46fc9d79 on nch1-master-1 Apr 16 21:25:19.671947 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-ddbd85f7-99db-4fd1-9fba-0451f90de588 req-58a67b6f-efce-4e83-821b-6562f7f6fd52 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074211 Apr 16 21:25:19.672818 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2426/4671] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:25:19.680091 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1aa8df4b-7911-4ac1-92b2-2352cdc8a100 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:19.681157 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1aa8df4b-7911-4ac1-92b2-2352cdc8a100 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: b656ec7d-c666-4cdd-ad2a-ecf1f594b230] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:19.688002 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-1aa8df4b-7911-4ac1-92b2-2352cdc8a100 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] HTTP exception thrown: Instance b656ec7d-c666-4cdd-ad2a-ecf1f594b230 could not be found. Apr 16 21:25:19.688872 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1aa8df4b-7911-4ac1-92b2-2352cdc8a100 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Returning 404 to user: Instance b656ec7d-c666-4cdd-ad2a-ecf1f594b230 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:25:19.689912 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1aa8df4b-7911-4ac1-92b2-2352cdc8a100 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "POST /compute/v2.1/servers/b656ec7d-c666-4cdd-ad2a-ecf1f594b230/action" status: 404 len: 111 microversion: 2.1 time: 0.015660 Apr 16 21:25:19.694422 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2427/4672] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:25:19 2022] POST /compute/v2.1/servers/b656ec7d-c666-4cdd-ad2a-ecf1f594b230/action => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:25:19.701863 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-48fc43f3-5ced-488a-b085-4f90479863a7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:19.702739 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-48fc43f3-5ced-488a-b085-4f90479863a7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:19.711098 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-48fc43f3-5ced-488a-b085-4f90479863a7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:19.711976 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-48fc43f3-5ced-488a-b085-4f90479863a7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:19.713027 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-48fc43f3-5ced-488a-b085-4f90479863a7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:19.713636 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-48fc43f3-5ced-488a-b085-4f90479863a7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:19.714083 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-88f04d26-93c3-432c-b931-a901caa26fca tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:19.722459 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-88f04d26-93c3-432c-b931-a901caa26fca tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1523 microversion: 2.1 time: 0.428637 Apr 16 21:25:19.723949 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2246/4673] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:19 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1523 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:19.872469 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-915a5da7-17f9-4318-93f4-aec9a98ae6c6 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:19.873411 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-915a5da7-17f9-4318-93f4-aec9a98ae6c6 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] [instance: 9c206aa5-5455-49ad-81ee-23ba46fc9d79] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:19.881941 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-915a5da7-17f9-4318-93f4-aec9a98ae6c6 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:19.882629 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-915a5da7-17f9-4318-93f4-aec9a98ae6c6 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:19.883981 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-915a5da7-17f9-4318-93f4-aec9a98ae6c6 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:19.884629 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-915a5da7-17f9-4318-93f4-aec9a98ae6c6 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:19.895467 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-48fc43f3-5ced-488a-b085-4f90479863a7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:19.911917 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-48fc43f3-5ced-488a-b085-4f90479863a7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.216169 Apr 16 21:25:19.924950 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2428/4674] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:19 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:19.930474 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ccdc0eff-7f60-4a56-9d5b-6e9851f5a1e5 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:19.931232 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ccdc0eff-7f60-4a56-9d5b-6e9851f5a1e5 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 0c30b376-2903-4058-b436-4644778f3352] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:19.937812 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ccdc0eff-7f60-4a56-9d5b-6e9851f5a1e5 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:19.938655 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ccdc0eff-7f60-4a56-9d5b-6e9851f5a1e5 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:19.939755 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ccdc0eff-7f60-4a56-9d5b-6e9851f5a1e5 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:19.940488 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ccdc0eff-7f60-4a56-9d5b-6e9851f5a1e5 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:19.949701 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-915a5da7-17f9-4318-93f4-aec9a98ae6c6 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:19.950166 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-915a5da7-17f9-4318-93f4-aec9a98ae6c6 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:19.950677 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-915a5da7-17f9-4318-93f4-aec9a98ae6c6 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lazy-loading 'fault' on Instance uuid 9c206aa5-5455-49ad-81ee-23ba46fc9d79 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:25:20.032980 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ccdc0eff-7f60-4a56-9d5b-6e9851f5a1e5 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:20.039748 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-915a5da7-17f9-4318-93f4-aec9a98ae6c6 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:20.041102 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ccdc0eff-7f60-4a56-9d5b-6e9851f5a1e5 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352" status: 200 len: 1245 microversion: 2.1 time: 0.114862 Apr 16 21:25:20.044654 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2429/4675] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:19 2022] GET /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352 => generated 1245 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:20.053142 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7e312410-d3c8-43b5-9602-e120a2fdf32f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:20.056036 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7e312410-d3c8-43b5-9602-e120a2fdf32f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:20.064019 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7e312410-d3c8-43b5-9602-e120a2fdf32f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:20.071224 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-915a5da7-17f9-4318-93f4-aec9a98ae6c6 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:20.077190 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7e312410-d3c8-43b5-9602-e120a2fdf32f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:20.083068 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-915a5da7-17f9-4318-93f4-aec9a98ae6c6 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f674be6ee5974219ac43d11adc2e33a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cb0c10ca81477bb8c44f27102b04fe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:20.083229 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7e312410-d3c8-43b5-9602-e120a2fdf32f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:20.083322 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-915a5da7-17f9-4318-93f4-aec9a98ae6c6 tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] 10.222.0.20 "GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79" status: 200 len: 1351 microversion: 2.26 time: 0.218384 Apr 16 21:25:20.083405 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7e312410-d3c8-43b5-9602-e120a2fdf32f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:20.085318 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2247/4676] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:19 2022] GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79 => generated 1351 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:20.166508 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ed2df170-0220-4a62-a93d-1dacfa52ba87 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:20.167511 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ed2df170-0220-4a62-a93d-1dacfa52ba87 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] [instance: 5bec80bd-63c1-45bf-a379-98f4c375f318] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:20.174884 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ed2df170-0220-4a62-a93d-1dacfa52ba87 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:20.175694 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ed2df170-0220-4a62-a93d-1dacfa52ba87 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:20.176775 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ed2df170-0220-4a62-a93d-1dacfa52ba87 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:20.177391 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ed2df170-0220-4a62-a93d-1dacfa52ba87 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:20.285674 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ed2df170-0220-4a62-a93d-1dacfa52ba87 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:20.303775 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ed2df170-0220-4a62-a93d-1dacfa52ba87 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:20.305614 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ed2df170-0220-4a62-a93d-1dacfa52ba87 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:20.308591 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ed2df170-0220-4a62-a93d-1dacfa52ba87 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] 10.222.0.20 "GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318" status: 200 len: 1408 microversion: 2.54 time: 0.146633 Apr 16 21:25:20.309168 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2248/4677] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:20 2022] GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318 => generated 1408 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:20.346324 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7e312410-d3c8-43b5-9602-e120a2fdf32f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:20.354959 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7e312410-d3c8-43b5-9602-e120a2fdf32f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.309120 Apr 16 21:25:20.355922 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2430/4678] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:20 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:20.373036 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-88a1fa2b-4db4-4f43-9767-d7bcba454b5f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:20.374239 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-88a1fa2b-4db4-4f43-9767-d7bcba454b5f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: c4de7eb8-2acb-477b-88be-99dafabf4e8e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:20.380777 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-88a1fa2b-4db4-4f43-9767-d7bcba454b5f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] HTTP exception thrown: Instance c4de7eb8-2acb-477b-88be-99dafabf4e8e could not be found. Apr 16 21:25:20.381582 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-88a1fa2b-4db4-4f43-9767-d7bcba454b5f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Returning 404 to user: Instance c4de7eb8-2acb-477b-88be-99dafabf4e8e could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:25:20.382430 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-88a1fa2b-4db4-4f43-9767-d7bcba454b5f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "POST /compute/v2.1/servers/c4de7eb8-2acb-477b-88be-99dafabf4e8e/action" status: 404 len: 111 microversion: 2.1 time: 0.013364 Apr 16 21:25:20.386174 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2249/4679] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:25:20 2022] POST /compute/v2.1/servers/c4de7eb8-2acb-477b-88be-99dafabf4e8e/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:25:20.395471 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9ec583dc-723c-4ed4-b2de-a2f6717d525a tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:20.396448 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9ec583dc-723c-4ed4-b2de-a2f6717d525a tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:20.403034 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9ec583dc-723c-4ed4-b2de-a2f6717d525a tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:20.403768 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9ec583dc-723c-4ed4-b2de-a2f6717d525a tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:20.404809 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9ec583dc-723c-4ed4-b2de-a2f6717d525a tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:20.405587 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9ec583dc-723c-4ed4-b2de-a2f6717d525a tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:20.650662 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9ec583dc-723c-4ed4-b2de-a2f6717d525a tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:20.703129 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9ec583dc-723c-4ed4-b2de-a2f6717d525a tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.310210 Apr 16 21:25:20.706483 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2431/4680] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:20 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:20.725944 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ca65ef24-9f2c-46a2-a5f1-9d6ede8c6d6c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:20.727202 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ca65ef24-9f2c-46a2-a5f1-9d6ede8c6d6c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:20.740129 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6fc47497-f0ff-4364-a04d-f5d556a935c8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:20.740792 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6fc47497-f0ff-4364-a04d-f5d556a935c8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:20.741444 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ca65ef24-9f2c-46a2-a5f1-9d6ede8c6d6c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:20.741921 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ca65ef24-9f2c-46a2-a5f1-9d6ede8c6d6c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:20.742730 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ca65ef24-9f2c-46a2-a5f1-9d6ede8c6d6c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:20.743187 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ca65ef24-9f2c-46a2-a5f1-9d6ede8c6d6c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:20.748658 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6fc47497-f0ff-4364-a04d-f5d556a935c8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:20.749340 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6fc47497-f0ff-4364-a04d-f5d556a935c8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:20.750131 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6fc47497-f0ff-4364-a04d-f5d556a935c8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:20.750745 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6fc47497-f0ff-4364-a04d-f5d556a935c8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:20.926922 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6fc47497-f0ff-4364-a04d-f5d556a935c8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:20.947377 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6fc47497-f0ff-4364-a04d-f5d556a935c8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1523 microversion: 2.1 time: 0.211253 Apr 16 21:25:20.964118 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2432/4681] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:20 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1523 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:20.993351 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ca65ef24-9f2c-46a2-a5f1-9d6ede8c6d6c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:21.007793 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ca65ef24-9f2c-46a2-a5f1-9d6ede8c6d6c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.285989 Apr 16 21:25:21.009081 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2250/4682] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:20 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:21.025983 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8bc72c26-8916-4625-a7c5-2af313cc00e9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:21.027172 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8bc72c26-8916-4625-a7c5-2af313cc00e9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: f84dc2d2-0fe2-4f62-a660-ae33af88e475] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:21.036291 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-8bc72c26-8916-4625-a7c5-2af313cc00e9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] HTTP exception thrown: Instance f84dc2d2-0fe2-4f62-a660-ae33af88e475 could not be found. Apr 16 21:25:21.039282 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8bc72c26-8916-4625-a7c5-2af313cc00e9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Returning 404 to user: Instance f84dc2d2-0fe2-4f62-a660-ae33af88e475 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:25:21.040346 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8bc72c26-8916-4625-a7c5-2af313cc00e9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/f84dc2d2-0fe2-4f62-a660-ae33af88e475" status: 404 len: 111 microversion: 2.1 time: 0.018391 Apr 16 21:25:21.044756 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2433/4683] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:21 2022] GET /compute/v2.1/servers/f84dc2d2-0fe2-4f62-a660-ae33af88e475 => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:25:21.050017 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-dbdf9a0a-28e0-4c7d-808d-8d50db5576f4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:21.050661 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-dbdf9a0a-28e0-4c7d-808d-8d50db5576f4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:21.060019 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dbdf9a0a-28e0-4c7d-808d-8d50db5576f4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:21.060804 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dbdf9a0a-28e0-4c7d-808d-8d50db5576f4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:21.061620 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dbdf9a0a-28e0-4c7d-808d-8d50db5576f4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:21.061748 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ab7904ed-e519-4970-8883-331ed4fc9e24 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:21.062074 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dbdf9a0a-28e0-4c7d-808d-8d50db5576f4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:21.062311 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ab7904ed-e519-4970-8883-331ed4fc9e24 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 0c30b376-2903-4058-b436-4644778f3352] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:21.070945 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ab7904ed-e519-4970-8883-331ed4fc9e24 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:21.071565 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ab7904ed-e519-4970-8883-331ed4fc9e24 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:21.076722 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ab7904ed-e519-4970-8883-331ed4fc9e24 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:21.076722 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ab7904ed-e519-4970-8883-331ed4fc9e24 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:21.180758 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ab7904ed-e519-4970-8883-331ed4fc9e24 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:21.191287 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ab7904ed-e519-4970-8883-331ed4fc9e24 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352" status: 200 len: 1293 microversion: 2.1 time: 0.134089 Apr 16 21:25:21.193251 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2434/4684] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:21 2022] GET /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352 => generated 1293 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:25:21.199252 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7b500fab-5b2d-4e1b-aac3-79f007297d3c tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:21.200128 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7b500fab-5b2d-4e1b-aac3-79f007297d3c tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] [instance: 9c206aa5-5455-49ad-81ee-23ba46fc9d79] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:21.207327 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7b500fab-5b2d-4e1b-aac3-79f007297d3c tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:21.208257 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7b500fab-5b2d-4e1b-aac3-79f007297d3c tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:21.209381 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7b500fab-5b2d-4e1b-aac3-79f007297d3c tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:21.210030 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7b500fab-5b2d-4e1b-aac3-79f007297d3c tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:21.234097 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-7b500fab-5b2d-4e1b-aac3-79f007297d3c tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] HTTP exception thrown: Instance 9c206aa5-5455-49ad-81ee-23ba46fc9d79 could not be found. Apr 16 21:25:21.234737 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7b500fab-5b2d-4e1b-aac3-79f007297d3c tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] Returning 404 to user: Instance 9c206aa5-5455-49ad-81ee-23ba46fc9d79 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:25:21.238114 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7b500fab-5b2d-4e1b-aac3-79f007297d3c tempest-ServerTagsTestJSON-525482726 tempest-ServerTagsTestJSON-525482726-project] 10.222.0.20 "GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79" status: 404 len: 111 microversion: 2.26 time: 0.043064 Apr 16 21:25:21.243309 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2435/4685] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:21 2022] GET /compute/v2.1/servers/9c206aa5-5455-49ad-81ee-23ba46fc9d79 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:25:21.330086 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f678e8dc-78be-4095-a1e6-b36a69368f4b tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:21.332062 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f678e8dc-78be-4095-a1e6-b36a69368f4b tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] [instance: 5bec80bd-63c1-45bf-a379-98f4c375f318] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:21.340430 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f678e8dc-78be-4095-a1e6-b36a69368f4b tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:21.340893 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f678e8dc-78be-4095-a1e6-b36a69368f4b tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:21.341765 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f678e8dc-78be-4095-a1e6-b36a69368f4b tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:21.342362 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f678e8dc-78be-4095-a1e6-b36a69368f4b tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:21.448053 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f678e8dc-78be-4095-a1e6-b36a69368f4b tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:21.469068 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f678e8dc-78be-4095-a1e6-b36a69368f4b tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:21.474827 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f678e8dc-78be-4095-a1e6-b36a69368f4b tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:21.476162 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f678e8dc-78be-4095-a1e6-b36a69368f4b tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] 10.222.0.20 "GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318" status: 200 len: 1408 microversion: 2.54 time: 0.151551 Apr 16 21:25:21.476787 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2436/4686] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:21 2022] GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318 => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:25:21.971025 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cea68b1d-295e-4ef4-a9e9-806099c49d45 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:21.972287 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cea68b1d-295e-4ef4-a9e9-806099c49d45 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:21.986759 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cea68b1d-295e-4ef4-a9e9-806099c49d45 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:21.989141 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cea68b1d-295e-4ef4-a9e9-806099c49d45 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:21.990908 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cea68b1d-295e-4ef4-a9e9-806099c49d45 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:21.991542 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cea68b1d-295e-4ef4-a9e9-806099c49d45 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:22.008808 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-dbdf9a0a-28e0-4c7d-808d-8d50db5576f4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:22.022305 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-dbdf9a0a-28e0-4c7d-808d-8d50db5576f4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.976413 Apr 16 21:25:22.028221 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2251/4687] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:21 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:22.049686 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e096ab28-115e-4d68-8061-e653c0e6e746 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:22.050342 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e096ab28-115e-4d68-8061-e653c0e6e746 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:22.062623 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e096ab28-115e-4d68-8061-e653c0e6e746 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:22.063102 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e096ab28-115e-4d68-8061-e653c0e6e746 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:22.063939 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e096ab28-115e-4d68-8061-e653c0e6e746 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:22.064489 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e096ab28-115e-4d68-8061-e653c0e6e746 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:22.390900 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cea68b1d-295e-4ef4-a9e9-806099c49d45 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:22.399997 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cea68b1d-295e-4ef4-a9e9-806099c49d45 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1523 microversion: 2.1 time: 0.433482 Apr 16 21:25:22.402097 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2437/4688] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:21 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1523 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:22.414685 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d017fafe-9ef4-4c4b-aaec-63e546eb4063 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:22.419740 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d017fafe-9ef4-4c4b-aaec-63e546eb4063 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 0c30b376-2903-4058-b436-4644778f3352] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:22.478436 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d017fafe-9ef4-4c4b-aaec-63e546eb4063 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:22.479094 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d017fafe-9ef4-4c4b-aaec-63e546eb4063 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:22.491999 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d017fafe-9ef4-4c4b-aaec-63e546eb4063 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:22.493790 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d017fafe-9ef4-4c4b-aaec-63e546eb4063 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:22.587293 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e096ab28-115e-4d68-8061-e653c0e6e746 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:22.597753 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e096ab28-115e-4d68-8061-e653c0e6e746 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.552238 Apr 16 21:25:22.599221 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2252/4689] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:22 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:22.608771 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a9150a17-fa31-439f-954e-26ee58a1a3ad tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:22.613152 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a9150a17-fa31-439f-954e-26ee58a1a3ad tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] [instance: 5bec80bd-63c1-45bf-a379-98f4c375f318] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:22.626525 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a9150a17-fa31-439f-954e-26ee58a1a3ad tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:22.626525 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a9150a17-fa31-439f-954e-26ee58a1a3ad tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:22.626525 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a9150a17-fa31-439f-954e-26ee58a1a3ad tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:22.626960 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a9150a17-fa31-439f-954e-26ee58a1a3ad tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:22.629450 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d017fafe-9ef4-4c4b-aaec-63e546eb4063 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:22.648823 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d017fafe-9ef4-4c4b-aaec-63e546eb4063 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352" status: 200 len: 1299 microversion: 2.1 time: 0.244031 Apr 16 21:25:22.654326 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2438/4690] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:22 2022] GET /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352 => generated 1299 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:22.699176 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-739a33eb-cb33-4135-a806-dd39b0324847 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-412251863", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "1b9ee265-bdab-4092-8071-c9bb95d911fb"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:22.704676 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-739a33eb-cb33-4135-a806-dd39b0324847 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:25:22.704676 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-739a33eb-cb33-4135-a806-dd39b0324847 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.011914 Apr 16 21:25:22.708709 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2439/4691] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:25:22 2022] POST /compute/v2.1/servers => generated 139 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:25:22.734801 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d9249ab1-733a-433c-9697-5323b7ef16b3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:22.735389 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d9249ab1-733a-433c-9697-5323b7ef16b3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:22.754123 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d9249ab1-733a-433c-9697-5323b7ef16b3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:22.754431 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d9249ab1-733a-433c-9697-5323b7ef16b3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:22.755151 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d9249ab1-733a-433c-9697-5323b7ef16b3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:22.755601 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d9249ab1-733a-433c-9697-5323b7ef16b3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:22.827426 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a9150a17-fa31-439f-954e-26ee58a1a3ad tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:22.854846 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a9150a17-fa31-439f-954e-26ee58a1a3ad tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:22.864938 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a9150a17-fa31-439f-954e-26ee58a1a3ad tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:22.869888 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a9150a17-fa31-439f-954e-26ee58a1a3ad tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] 10.222.0.20 "GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318" status: 200 len: 1408 microversion: 2.54 time: 0.265994 Apr 16 21:25:22.872633 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2253/4692] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:22 2022] GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318 => generated 1408 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:22.948810 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d9249ab1-733a-433c-9697-5323b7ef16b3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:22.958157 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d9249ab1-733a-433c-9697-5323b7ef16b3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.245727 Apr 16 21:25:22.963314 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2440/4693] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:22 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:22.978813 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3ab30e22-05a4-420f-a49c-5d51559b910b tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:22.979441 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3ab30e22-05a4-420f-a49c-5d51559b910b tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:22.987001 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3ab30e22-05a4-420f-a49c-5d51559b910b tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:22.990742 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3ab30e22-05a4-420f-a49c-5d51559b910b tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:22.991565 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3ab30e22-05a4-420f-a49c-5d51559b910b tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:22.992280 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3ab30e22-05a4-420f-a49c-5d51559b910b tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:23.395798 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3ab30e22-05a4-420f-a49c-5d51559b910b tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:23.395798 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3ab30e22-05a4-420f-a49c-5d51559b910b tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.414246 Apr 16 21:25:23.395798 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2254/4694] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:22 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:23.419603 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9f811d19-8c7c-42b7-b591-f0fcc9427bd9 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:23.420467 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9f811d19-8c7c-42b7-b591-f0fcc9427bd9 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:23.434648 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9f811d19-8c7c-42b7-b591-f0fcc9427bd9 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:23.435248 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9f811d19-8c7c-42b7-b591-f0fcc9427bd9 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:23.436506 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9f811d19-8c7c-42b7-b591-f0fcc9427bd9 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:23.437055 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9f811d19-8c7c-42b7-b591-f0fcc9427bd9 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:23.518175 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5a012741-f282-41f4-a6af-39be47f6b135 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-116311202", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "1b9ee265-bdab-4092-8071-c9bb95d911fb"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:23.520671 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5a012741-f282-41f4-a6af-39be47f6b135 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:25:23.522176 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5a012741-f282-41f4-a6af-39be47f6b135 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.009804 Apr 16 21:25:23.526834 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2255/4695] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:25:23 2022] POST /compute/v2.1/servers => generated 133 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:25:23.533115 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2001cfff-ea7f-46fd-ace8-7a5a248311a4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:23.533871 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2001cfff-ea7f-46fd-ace8-7a5a248311a4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:23.542855 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2001cfff-ea7f-46fd-ace8-7a5a248311a4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:23.543266 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2001cfff-ea7f-46fd-ace8-7a5a248311a4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:23.544488 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2001cfff-ea7f-46fd-ace8-7a5a248311a4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:23.545314 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2001cfff-ea7f-46fd-ace8-7a5a248311a4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:23.607133 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9f811d19-8c7c-42b7-b591-f0fcc9427bd9 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:23.618394 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9f811d19-8c7c-42b7-b591-f0fcc9427bd9 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1523 microversion: 2.1 time: 0.203949 Apr 16 21:25:23.619316 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2441/4696] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:23 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1523 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:23.670560 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1e0aab8b-a3a0-4289-8d34-bb58085faa98 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:23.681534 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1e0aab8b-a3a0-4289-8d34-bb58085faa98 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 0c30b376-2903-4058-b436-4644778f3352] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:23.681534 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1e0aab8b-a3a0-4289-8d34-bb58085faa98 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:23.681534 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1e0aab8b-a3a0-4289-8d34-bb58085faa98 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:23.681534 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1e0aab8b-a3a0-4289-8d34-bb58085faa98 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:23.681534 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1e0aab8b-a3a0-4289-8d34-bb58085faa98 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:23.830085 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1e0aab8b-a3a0-4289-8d34-bb58085faa98 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:23.838260 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1e0aab8b-a3a0-4289-8d34-bb58085faa98 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352" status: 200 len: 1299 microversion: 2.1 time: 0.171527 Apr 16 21:25:23.840669 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2442/4697] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:23 2022] GET /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352 => generated 1299 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:25:23.888621 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fdda5334-a1f4-4d73-9f4b-c85f21755b80 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:23.889484 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fdda5334-a1f4-4d73-9f4b-c85f21755b80 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] [instance: 5bec80bd-63c1-45bf-a379-98f4c375f318] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:23.899594 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fdda5334-a1f4-4d73-9f4b-c85f21755b80 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:23.900053 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fdda5334-a1f4-4d73-9f4b-c85f21755b80 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:23.900931 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fdda5334-a1f4-4d73-9f4b-c85f21755b80 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:23.901376 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fdda5334-a1f4-4d73-9f4b-c85f21755b80 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:23.999646 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fdda5334-a1f4-4d73-9f4b-c85f21755b80 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:24.009976 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fdda5334-a1f4-4d73-9f4b-c85f21755b80 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:24.011830 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fdda5334-a1f4-4d73-9f4b-c85f21755b80 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:24.012849 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2001cfff-ea7f-46fd-ace8-7a5a248311a4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:24.013119 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fdda5334-a1f4-4d73-9f4b-c85f21755b80 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] 10.222.0.20 "GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318" status: 200 len: 1408 microversion: 2.54 time: 0.128416 Apr 16 21:25:24.024758 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2443/4698] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:23 2022] GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318 => generated 1408 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:24.038005 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2001cfff-ea7f-46fd-ace8-7a5a248311a4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.509593 Apr 16 21:25:24.048150 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2256/4699] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:23 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:24.067549 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-851ac2ba-7a83-4b68-99d2-2a62bab9bf7d tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:24.072587 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-851ac2ba-7a83-4b68-99d2-2a62bab9bf7d tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:24.083463 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-851ac2ba-7a83-4b68-99d2-2a62bab9bf7d tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:24.083933 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-851ac2ba-7a83-4b68-99d2-2a62bab9bf7d tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:24.086938 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-851ac2ba-7a83-4b68-99d2-2a62bab9bf7d tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:24.087413 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-851ac2ba-7a83-4b68-99d2-2a62bab9bf7d tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:24.306070 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-851ac2ba-7a83-4b68-99d2-2a62bab9bf7d tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:24.317107 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-851ac2ba-7a83-4b68-99d2-2a62bab9bf7d tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.254576 Apr 16 21:25:24.328205 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2444/4700] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:24 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:24.338326 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4d9e34f3-75cb-4924-a020-40cc8dd1638d tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:24.338957 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4d9e34f3-75cb-4924-a020-40cc8dd1638d tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: 0bc9ab5c-9981-4cbf-8cb0-f38ba5a8d004] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:24.345123 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-4d9e34f3-75cb-4924-a020-40cc8dd1638d tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] HTTP exception thrown: Instance 0bc9ab5c-9981-4cbf-8cb0-f38ba5a8d004 could not be found. Apr 16 21:25:24.345802 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4d9e34f3-75cb-4924-a020-40cc8dd1638d tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Returning 404 to user: Instance 0bc9ab5c-9981-4cbf-8cb0-f38ba5a8d004 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:25:24.346646 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4d9e34f3-75cb-4924-a020-40cc8dd1638d tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "POST /compute/v2.1/servers/0bc9ab5c-9981-4cbf-8cb0-f38ba5a8d004/action" status: 404 len: 111 microversion: 2.1 time: 0.012384 Apr 16 21:25:24.347259 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2257/4701] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:25:24 2022] POST /compute/v2.1/servers/0bc9ab5c-9981-4cbf-8cb0-f38ba5a8d004/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:25:24.366864 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a01e57dd-e60d-4d4f-b955-cede5f7f9252 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:24.367795 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a01e57dd-e60d-4d4f-b955-cede5f7f9252 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:24.378569 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a01e57dd-e60d-4d4f-b955-cede5f7f9252 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:24.379642 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a01e57dd-e60d-4d4f-b955-cede5f7f9252 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:24.380799 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a01e57dd-e60d-4d4f-b955-cede5f7f9252 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:24.381249 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a01e57dd-e60d-4d4f-b955-cede5f7f9252 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:24.586204 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a01e57dd-e60d-4d4f-b955-cede5f7f9252 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:24.600558 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a01e57dd-e60d-4d4f-b955-cede5f7f9252 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.246438 Apr 16 21:25:24.601973 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2445/4702] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:24 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:24.619686 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-504eb0a5-913b-4e82-989b-6b49102c4c4a tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:24.622325 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-504eb0a5-913b-4e82-989b-6b49102c4c4a tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:24.678225 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-54a0c86c-a289-49f0-8f97-0d9b29a01ae2 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:24.678911 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-54a0c86c-a289-49f0-8f97-0d9b29a01ae2 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:24.693350 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-504eb0a5-913b-4e82-989b-6b49102c4c4a tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:24.693852 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-504eb0a5-913b-4e82-989b-6b49102c4c4a tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:24.696290 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-504eb0a5-913b-4e82-989b-6b49102c4c4a tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:24.700498 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-504eb0a5-913b-4e82-989b-6b49102c4c4a tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:24.701026 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-54a0c86c-a289-49f0-8f97-0d9b29a01ae2 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:24.701647 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-54a0c86c-a289-49f0-8f97-0d9b29a01ae2 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:24.702452 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-54a0c86c-a289-49f0-8f97-0d9b29a01ae2 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:24.703748 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-54a0c86c-a289-49f0-8f97-0d9b29a01ae2 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:24.965963 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-54a0c86c-a289-49f0-8f97-0d9b29a01ae2 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:24.977563 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-54a0c86c-a289-49f0-8f97-0d9b29a01ae2 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1523 microversion: 2.1 time: 0.321706 Apr 16 21:25:24.988457 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2446/4703] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:24 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1523 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:24.994131 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2c7bc7d2-2a65-463a-a10c-93441031ffa4 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:24.994373 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2c7bc7d2-2a65-463a-a10c-93441031ffa4 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 0c30b376-2903-4058-b436-4644778f3352] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:25.017077 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2c7bc7d2-2a65-463a-a10c-93441031ffa4 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:25.017571 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2c7bc7d2-2a65-463a-a10c-93441031ffa4 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:25.018374 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2c7bc7d2-2a65-463a-a10c-93441031ffa4 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:25.019080 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2c7bc7d2-2a65-463a-a10c-93441031ffa4 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:25.208964 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2c7bc7d2-2a65-463a-a10c-93441031ffa4 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:25.213337 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-504eb0a5-913b-4e82-989b-6b49102c4c4a tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:25.234627 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2c7bc7d2-2a65-463a-a10c-93441031ffa4 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352" status: 200 len: 1366 microversion: 2.1 time: 0.244964 Apr 16 21:25:25.237112 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2447/4704] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:24 2022] GET /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352 => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:25.243945 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-504eb0a5-913b-4e82-989b-6b49102c4c4a tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.628844 Apr 16 21:25:25.246539 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e57a1cbd-6534-4222-ac70-49f691b73bd6 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:25.247643 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2258/4705] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:24 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:25.252551 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e57a1cbd-6534-4222-ac70-49f691b73bd6 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] [instance: 5bec80bd-63c1-45bf-a379-98f4c375f318] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:25.266158 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e57a1cbd-6534-4222-ac70-49f691b73bd6 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:25.266697 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e57a1cbd-6534-4222-ac70-49f691b73bd6 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:25.267518 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e57a1cbd-6534-4222-ac70-49f691b73bd6 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:25.267985 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e57a1cbd-6534-4222-ac70-49f691b73bd6 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:25.269532 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b6626c70-b046-4cd0-94e5-8740abdf3403 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:25.270343 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b6626c70-b046-4cd0-94e5-8740abdf3403 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:25.286165 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b6626c70-b046-4cd0-94e5-8740abdf3403 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:25.292391 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b6626c70-b046-4cd0-94e5-8740abdf3403 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:25.294503 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b6626c70-b046-4cd0-94e5-8740abdf3403 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:25.296740 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b6626c70-b046-4cd0-94e5-8740abdf3403 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:25.440768 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e57a1cbd-6534-4222-ac70-49f691b73bd6 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:25.453133 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e57a1cbd-6534-4222-ac70-49f691b73bd6 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:25.454649 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e57a1cbd-6534-4222-ac70-49f691b73bd6 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:25.460481 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e57a1cbd-6534-4222-ac70-49f691b73bd6 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] 10.222.0.20 "GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318" status: 200 len: 1408 microversion: 2.54 time: 0.222166 Apr 16 21:25:25.461590 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2448/4706] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:25 2022] GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318 => generated 1408 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:25.586245 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b6626c70-b046-4cd0-94e5-8740abdf3403 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "POST /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7/action" status: 202 len: 0 microversion: 2.1 time: 0.317413 Apr 16 21:25:25.591432 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2259/4707] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:25:25 2022] POST /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:25:25.596693 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3d096431-471d-49ca-8f25-c22ef5c14508 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:25.597585 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3d096431-471d-49ca-8f25-c22ef5c14508 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:25.615955 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d096431-471d-49ca-8f25-c22ef5c14508 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:25.616353 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d096431-471d-49ca-8f25-c22ef5c14508 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:25.617178 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d096431-471d-49ca-8f25-c22ef5c14508 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:25.617599 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d096431-471d-49ca-8f25-c22ef5c14508 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:25.930736 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3d096431-471d-49ca-8f25-c22ef5c14508 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:25.944606 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3d096431-471d-49ca-8f25-c22ef5c14508 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1509 microversion: 2.1 time: 0.350494 Apr 16 21:25:25.945676 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2449/4708] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:25 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1509 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:25.995490 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-338f4a71-fa11-4db7-8844-536f797151e9 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:25.996258 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-338f4a71-fa11-4db7-8844-536f797151e9 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:26.007601 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-338f4a71-fa11-4db7-8844-536f797151e9 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:26.008215 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-338f4a71-fa11-4db7-8844-536f797151e9 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:26.009095 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-338f4a71-fa11-4db7-8844-536f797151e9 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:26.009612 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-338f4a71-fa11-4db7-8844-536f797151e9 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:26.062038 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-63d17a22-dc12-4c02-927a-34039a27f1fd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1599167778", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": "none"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:26.138863 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-63d17a22-dc12-4c02-927a-34039a27f1fd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:25:26.139720 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-63d17a22-dc12-4c02-927a-34039a27f1fd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:25:26.140591 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-63d17a22-dc12-4c02-927a-34039a27f1fd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:25:26.141226 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-63d17a22-dc12-4c02-927a-34039a27f1fd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:25:26.141891 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-63d17a22-dc12-4c02-927a-34039a27f1fd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:25:26.153980 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-63d17a22-dc12-4c02-927a-34039a27f1fd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:26.154802 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-63d17a22-dc12-4c02-927a-34039a27f1fd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:26.155856 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-63d17a22-dc12-4c02-927a-34039a27f1fd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:26.156730 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-63d17a22-dc12-4c02-927a-34039a27f1fd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:26.191898 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-63d17a22-dc12-4c02-927a-34039a27f1fd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Getting quotas for project a919bcedab644defad61a065b44d7887. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:25:26.212622 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-63d17a22-dc12-4c02-927a-34039a27f1fd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Getting quotas for user 33a57bad127d445d9034befd4fcca951 and project a919bcedab644defad61a065b44d7887. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:25:26.233064 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-63d17a22-dc12-4c02-927a-34039a27f1fd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:25:26.236958 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-63d17a22-dc12-4c02-927a-34039a27f1fd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 0835efc3-f9dd-47f0-a085-1fa8aeea993f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:25:26.296250 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-338f4a71-fa11-4db7-8844-536f797151e9 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:26.304714 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-338f4a71-fa11-4db7-8844-536f797151e9 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1523 microversion: 2.1 time: 0.313171 Apr 16 21:25:26.305691 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2450/4709] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:25 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1523 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:25:26.312203 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bf89891d-e740-4acd-9a49-7fe94150a510 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:26.312203 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-bf89891d-e740-4acd-9a49-7fe94150a510 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 0c30b376-2903-4058-b436-4644778f3352] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:26.318090 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bf89891d-e740-4acd-9a49-7fe94150a510 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:26.318636 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bf89891d-e740-4acd-9a49-7fe94150a510 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:26.319532 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bf89891d-e740-4acd-9a49-7fe94150a510 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:26.320602 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bf89891d-e740-4acd-9a49-7fe94150a510 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:26.460730 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-63d17a22-dc12-4c02-927a-34039a27f1fd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.631045 Apr 16 21:25:26.461715 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2260/4710] 10.222.0.20 () {62 vars in 1187 bytes} [Sat Apr 16 21:25:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Apr 16 21:25:26.489411 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b599ace8-c005-4576-beb8-692d0123a6a4 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:26.490748 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b599ace8-c005-4576-beb8-692d0123a6a4 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 0835efc3-f9dd-47f0-a085-1fa8aeea993f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:26.562886 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-bf89891d-e740-4acd-9a49-7fe94150a510 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:26.571034 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-bf89891d-e740-4acd-9a49-7fe94150a510 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352" status: 200 len: 1366 microversion: 2.1 time: 0.264423 Apr 16 21:25:26.577879 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2451/4711] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:26 2022] GET /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352 => generated 1366 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:26.593542 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-09e09e34-3dd3-4786-8615-17ef547d55b4 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:26.594408 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-09e09e34-3dd3-4786-8615-17ef547d55b4 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] [instance: 5bec80bd-63c1-45bf-a379-98f4c375f318] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:26.601723 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-09e09e34-3dd3-4786-8615-17ef547d55b4 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:26.602196 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-09e09e34-3dd3-4786-8615-17ef547d55b4 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:26.603001 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-09e09e34-3dd3-4786-8615-17ef547d55b4 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:26.603454 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-09e09e34-3dd3-4786-8615-17ef547d55b4 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:26.698398 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-09e09e34-3dd3-4786-8615-17ef547d55b4 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:26.707968 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-09e09e34-3dd3-4786-8615-17ef547d55b4 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:26.709569 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-09e09e34-3dd3-4786-8615-17ef547d55b4 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:26.710878 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-09e09e34-3dd3-4786-8615-17ef547d55b4 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] 10.222.0.20 "GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318" status: 200 len: 1408 microversion: 2.54 time: 0.122078 Apr 16 21:25:26.722082 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b599ace8-c005-4576-beb8-692d0123a6a4 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:26.722511 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2452/4712] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:26 2022] GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318 => generated 1408 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:26.734470 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b599ace8-c005-4576-beb8-692d0123a6a4 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:26.736143 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b599ace8-c005-4576-beb8-692d0123a6a4 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:26.737247 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b599ace8-c005-4576-beb8-692d0123a6a4 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/0835efc3-f9dd-47f0-a085-1fa8aeea993f" status: 200 len: 1278 microversion: 2.47 time: 0.264380 Apr 16 21:25:26.741728 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2261/4713] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:26 2022] GET /compute/v2.1/servers/0835efc3-f9dd-47f0-a085-1fa8aeea993f => generated 1278 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:26.899751 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b40d3f25-bb13-4c11-89da-9d3cc3f1d8ec tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-744825528", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": "none"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:26.962134 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-54fd99ec-58c1-4a54-b9b3-f8d53c32e39a tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:26.962766 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-54fd99ec-58c1-4a54-b9b3-f8d53c32e39a tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:26.978779 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-54fd99ec-58c1-4a54-b9b3-f8d53c32e39a tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:26.979267 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-54fd99ec-58c1-4a54-b9b3-f8d53c32e39a tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:26.980083 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-54fd99ec-58c1-4a54-b9b3-f8d53c32e39a tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:26.980582 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-54fd99ec-58c1-4a54-b9b3-f8d53c32e39a tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:26.995009 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-b40d3f25-bb13-4c11-89da-9d3cc3f1d8ec tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:25:26.995492 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-b40d3f25-bb13-4c11-89da-9d3cc3f1d8ec tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:25:26.995914 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-b40d3f25-bb13-4c11-89da-9d3cc3f1d8ec tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:25:26.996372 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-b40d3f25-bb13-4c11-89da-9d3cc3f1d8ec tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:25:26.996797 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-b40d3f25-bb13-4c11-89da-9d3cc3f1d8ec tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:25:27.018469 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b40d3f25-bb13-4c11-89da-9d3cc3f1d8ec tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:27.020524 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b40d3f25-bb13-4c11-89da-9d3cc3f1d8ec tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:27.023425 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b40d3f25-bb13-4c11-89da-9d3cc3f1d8ec tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:27.024816 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b40d3f25-bb13-4c11-89da-9d3cc3f1d8ec tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:27.066928 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-b40d3f25-bb13-4c11-89da-9d3cc3f1d8ec tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Getting quotas for project a919bcedab644defad61a065b44d7887. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:25:27.074306 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-b40d3f25-bb13-4c11-89da-9d3cc3f1d8ec tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Getting quotas for user 33a57bad127d445d9034befd4fcca951 and project a919bcedab644defad61a065b44d7887. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:25:27.090838 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b40d3f25-bb13-4c11-89da-9d3cc3f1d8ec tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:25:27.094021 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b40d3f25-bb13-4c11-89da-9d3cc3f1d8ec tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:25:27.233250 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b40d3f25-bb13-4c11-89da-9d3cc3f1d8ec tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.338337 Apr 16 21:25:27.234284 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2453/4714] 10.222.0.20 () {62 vars in 1187 bytes} [Sat Apr 16 21:25:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 340 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 16 21:25:27.244554 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bfd3e2cb-2169-4ad3-9a2a-c9d772bc5ae7 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:27.245765 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-bfd3e2cb-2169-4ad3-9a2a-c9d772bc5ae7 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:27.267108 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-54fd99ec-58c1-4a54-b9b3-f8d53c32e39a tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:27.276012 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-54fd99ec-58c1-4a54-b9b3-f8d53c32e39a tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1489 microversion: 2.1 time: 0.317955 Apr 16 21:25:27.280468 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2262/4715] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:26 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1489 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:27.306768 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-72d9ae9e-4f00-4f05-8bcc-67dad1dae973 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:27.307314 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-72d9ae9e-4f00-4f05-8bcc-67dad1dae973 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:27.326767 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-72d9ae9e-4f00-4f05-8bcc-67dad1dae973 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:27.327555 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-72d9ae9e-4f00-4f05-8bcc-67dad1dae973 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:27.327729 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-bfd3e2cb-2169-4ad3-9a2a-c9d772bc5ae7 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "PUT /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce" status: 200 len: 991 microversion: 2.47 time: 0.083972 Apr 16 21:25:27.337861 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2454/4716] 10.222.0.20 () {62 vars in 1296 bytes} [Sat Apr 16 21:25:27 2022] PUT /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce => generated 991 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:25:27.338974 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-72d9ae9e-4f00-4f05-8bcc-67dad1dae973 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:27.339745 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-72d9ae9e-4f00-4f05-8bcc-67dad1dae973 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:27.344705 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ed6d3813-c45a-4c69-9604-0381a4dad5b5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:27.345485 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ed6d3813-c45a-4c69-9604-0381a4dad5b5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:27.363949 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ed6d3813-c45a-4c69-9604-0381a4dad5b5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:27.366010 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ed6d3813-c45a-4c69-9604-0381a4dad5b5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:27.366934 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ed6d3813-c45a-4c69-9604-0381a4dad5b5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:27.368340 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ed6d3813-c45a-4c69-9604-0381a4dad5b5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:27.397654 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-72d9ae9e-4f00-4f05-8bcc-67dad1dae973 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] HTTP exception thrown: Cannot 'pause' instance daf189e2-7cb4-4dab-94cf-ffdceb314df7 while it is in vm_state paused Apr 16 21:25:27.403637 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-72d9ae9e-4f00-4f05-8bcc-67dad1dae973 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Returning 409 to user: Cannot 'pause' instance daf189e2-7cb4-4dab-94cf-ffdceb314df7 while it is in vm_state paused {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:25:27.408961 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-72d9ae9e-4f00-4f05-8bcc-67dad1dae973 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "POST /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7/action" status: 409 len: 143 microversion: 2.1 time: 0.116465 Apr 16 21:25:27.412116 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2263/4717] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:25:27 2022] POST /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7/action => generated 143 bytes in 120 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:25:27.428205 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cc6eb7cd-0337-4183-a511-4bcfb0e82910 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:27.428853 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-cc6eb7cd-0337-4183-a511-4bcfb0e82910 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:27.529322 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cc6eb7cd-0337-4183-a511-4bcfb0e82910 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:27.539291 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cc6eb7cd-0337-4183-a511-4bcfb0e82910 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:27.543390 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cc6eb7cd-0337-4183-a511-4bcfb0e82910 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:27.546008 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cc6eb7cd-0337-4183-a511-4bcfb0e82910 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce" status: 200 len: 1277 microversion: 2.47 time: 0.129046 Apr 16 21:25:27.547191 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2264/4718] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:27 2022] GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce => generated 1277 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:27.553360 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f753feec-5b7a-4ff6-bb20-7cce8bae5ac2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:27.554150 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f753feec-5b7a-4ff6-bb20-7cce8bae5ac2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:27.568205 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f753feec-5b7a-4ff6-bb20-7cce8bae5ac2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:27.568965 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f753feec-5b7a-4ff6-bb20-7cce8bae5ac2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:27.569944 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f753feec-5b7a-4ff6-bb20-7cce8bae5ac2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:27.570560 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f753feec-5b7a-4ff6-bb20-7cce8bae5ac2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:27.700951 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ed6d3813-c45a-4c69-9604-0381a4dad5b5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:27.731584 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ed6d3813-c45a-4c69-9604-0381a4dad5b5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1523 microversion: 2.1 time: 0.401232 Apr 16 21:25:27.733498 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2455/4719] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:27 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1523 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:27.739471 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-9f3d7561-fccb-4899-83db-15709c793699 req-858d3e73-2e70-404d-8dbc-0d545d8316c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c30b376-2903-4058-b436-4644778f3352", "tag": "89aa2008-483c-4c5a-85b1-9f5656576e5b"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:27.749006 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-9f3d7561-fccb-4899-83db-15709c793699 req-858d3e73-2e70-404d-8dbc-0d545d8316c8 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:27.749721 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-9f3d7561-fccb-4899-83db-15709c793699 req-858d3e73-2e70-404d-8dbc-0d545d8316c8 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:27.762879 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-9f3d7561-fccb-4899-83db-15709c793699 req-858d3e73-2e70-404d-8dbc-0d545d8316c8 service nova] Creating event network-changed:89aa2008-483c-4c5a-85b1-9f5656576e5b for instance 0c30b376-2903-4058-b436-4644778f3352 on nch1-master-1 Apr 16 21:25:27.768856 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-9f3d7561-fccb-4899-83db-15709c793699 req-858d3e73-2e70-404d-8dbc-0d545d8316c8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033648 Apr 16 21:25:27.770300 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2456/4720] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:25:27.781476 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-87176bd8-7bc6-4d61-9f6b-893fb88d5be9 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:27.782578 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-87176bd8-7bc6-4d61-9f6b-893fb88d5be9 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 0c30b376-2903-4058-b436-4644778f3352] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:27.796840 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-87176bd8-7bc6-4d61-9f6b-893fb88d5be9 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:27.797591 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-87176bd8-7bc6-4d61-9f6b-893fb88d5be9 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:27.808290 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f753feec-5b7a-4ff6-bb20-7cce8bae5ac2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "POST /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7/action" status: 202 len: 0 microversion: 2.1 time: 0.259303 Apr 16 21:25:27.809294 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2265/4721] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:25:27 2022] POST /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:25:27.823235 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-87176bd8-7bc6-4d61-9f6b-893fb88d5be9 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:27.828048 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-87176bd8-7bc6-4d61-9f6b-893fb88d5be9 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:27.832418 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-160de140-14a8-42a1-ad23-7a9259fb28b0 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:27.834878 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-160de140-14a8-42a1-ad23-7a9259fb28b0 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] [instance: 5bec80bd-63c1-45bf-a379-98f4c375f318] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:27.852996 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-160de140-14a8-42a1-ad23-7a9259fb28b0 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:27.853399 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-160de140-14a8-42a1-ad23-7a9259fb28b0 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:27.854610 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-160de140-14a8-42a1-ad23-7a9259fb28b0 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:27.855423 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-160de140-14a8-42a1-ad23-7a9259fb28b0 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:28.078401 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-160de140-14a8-42a1-ad23-7a9259fb28b0 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:28.086599 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-87176bd8-7bc6-4d61-9f6b-893fb88d5be9 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:28.093352 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-160de140-14a8-42a1-ad23-7a9259fb28b0 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:28.099236 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-87176bd8-7bc6-4d61-9f6b-893fb88d5be9 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352" status: 200 len: 1366 microversion: 2.1 time: 0.324468 Apr 16 21:25:28.108732 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2457/4722] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:27 2022] GET /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352 => generated 1366 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:28.119178 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-160de140-14a8-42a1-ad23-7a9259fb28b0 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:28.119178 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-160de140-14a8-42a1-ad23-7a9259fb28b0 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] 10.222.0.20 "GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318" status: 200 len: 1408 microversion: 2.54 time: 0.291487 Apr 16 21:25:28.119178 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2266/4723] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:27 2022] GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318 => generated 1408 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:28.119490 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f96d260f-93c5-44f6-8cb9-70ffc994f3c9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:28.119490 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f96d260f-93c5-44f6-8cb9-70ffc994f3c9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:28.119490 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f96d260f-93c5-44f6-8cb9-70ffc994f3c9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:28.119490 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f96d260f-93c5-44f6-8cb9-70ffc994f3c9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:28.119966 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f96d260f-93c5-44f6-8cb9-70ffc994f3c9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:28.121482 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f96d260f-93c5-44f6-8cb9-70ffc994f3c9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:28.370755 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f96d260f-93c5-44f6-8cb9-70ffc994f3c9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:28.383299 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f96d260f-93c5-44f6-8cb9-70ffc994f3c9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1496 microversion: 2.1 time: 0.281186 Apr 16 21:25:28.420614 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2458/4724] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:28 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1496 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:28.567658 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8d99e88f-7159-4f44-b1ce-3b69d3b82fcb tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:28.568378 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8d99e88f-7159-4f44-b1ce-3b69d3b82fcb tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:28.575059 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8d99e88f-7159-4f44-b1ce-3b69d3b82fcb tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:28.575561 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8d99e88f-7159-4f44-b1ce-3b69d3b82fcb tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:28.576497 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8d99e88f-7159-4f44-b1ce-3b69d3b82fcb tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:28.576948 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8d99e88f-7159-4f44-b1ce-3b69d3b82fcb tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:28.698859 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8d99e88f-7159-4f44-b1ce-3b69d3b82fcb tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:28.706999 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8d99e88f-7159-4f44-b1ce-3b69d3b82fcb tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:28.708583 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8d99e88f-7159-4f44-b1ce-3b69d3b82fcb tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:28.709751 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8d99e88f-7159-4f44-b1ce-3b69d3b82fcb tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce" status: 200 len: 1281 microversion: 2.47 time: 0.146774 Apr 16 21:25:28.710313 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2267/4725] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:28 2022] GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce => generated 1281 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:28.751378 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a44ac3b7-2034-4e2a-a412-2a534d45d420 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:28.752353 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a44ac3b7-2034-4e2a-a412-2a534d45d420 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:28.770436 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a44ac3b7-2034-4e2a-a412-2a534d45d420 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:28.771098 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a44ac3b7-2034-4e2a-a412-2a534d45d420 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:28.771994 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a44ac3b7-2034-4e2a-a412-2a534d45d420 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:28.772912 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a44ac3b7-2034-4e2a-a412-2a534d45d420 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:28.932816 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a44ac3b7-2034-4e2a-a412-2a534d45d420 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:28.956721 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a44ac3b7-2034-4e2a-a412-2a534d45d420 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1523 microversion: 2.1 time: 0.210017 Apr 16 21:25:28.968139 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2459/4726] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:28 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1523 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:29.116249 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e80bdf19-197e-489b-b26d-f83e4b811b73 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:29.117024 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e80bdf19-197e-489b-b26d-f83e4b811b73 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 0c30b376-2903-4058-b436-4644778f3352] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:29.130262 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ae9cc9ed-e592-44ae-b58a-8cd267ab5090 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:29.134384 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ae9cc9ed-e592-44ae-b58a-8cd267ab5090 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] [instance: 5bec80bd-63c1-45bf-a379-98f4c375f318] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:29.134506 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e80bdf19-197e-489b-b26d-f83e4b811b73 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:29.137502 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e80bdf19-197e-489b-b26d-f83e4b811b73 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:29.138443 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e80bdf19-197e-489b-b26d-f83e4b811b73 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:29.141000 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ae9cc9ed-e592-44ae-b58a-8cd267ab5090 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:29.141610 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e80bdf19-197e-489b-b26d-f83e4b811b73 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:29.144829 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ae9cc9ed-e592-44ae-b58a-8cd267ab5090 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:29.145701 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ae9cc9ed-e592-44ae-b58a-8cd267ab5090 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:29.146160 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ae9cc9ed-e592-44ae-b58a-8cd267ab5090 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:29.213597 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ae9cc9ed-e592-44ae-b58a-8cd267ab5090 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:29.224596 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ae9cc9ed-e592-44ae-b58a-8cd267ab5090 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:29.226339 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ae9cc9ed-e592-44ae-b58a-8cd267ab5090 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:29.230495 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ae9cc9ed-e592-44ae-b58a-8cd267ab5090 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] 10.222.0.20 "GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318" status: 200 len: 1408 microversion: 2.54 time: 0.101546 Apr 16 21:25:29.230495 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2460/4727] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:29 2022] GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318 => generated 1408 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:29.406501 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e80bdf19-197e-489b-b26d-f83e4b811b73 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:29.414198 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e80bdf19-197e-489b-b26d-f83e4b811b73 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352" status: 200 len: 1366 microversion: 2.1 time: 0.302384 Apr 16 21:25:29.429162 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fa07cf09-8ade-4e45-a3c5-913bc4704064 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:29.429789 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fa07cf09-8ade-4e45-a3c5-913bc4704064 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:29.433238 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2268/4728] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:29 2022] GET /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352 => generated 1366 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:29.437687 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fa07cf09-8ade-4e45-a3c5-913bc4704064 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:29.438269 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fa07cf09-8ade-4e45-a3c5-913bc4704064 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:29.439176 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fa07cf09-8ade-4e45-a3c5-913bc4704064 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:29.439745 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fa07cf09-8ade-4e45-a3c5-913bc4704064 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:29.588756 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fa07cf09-8ade-4e45-a3c5-913bc4704064 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:29.597310 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fa07cf09-8ade-4e45-a3c5-913bc4704064 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.172472 Apr 16 21:25:29.598369 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2461/4729] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:29 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:29.615742 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-eadb0d77-962b-4b41-a3a0-e3dfb997c4f9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:29.617086 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-eadb0d77-962b-4b41-a3a0-e3dfb997c4f9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:29.623368 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eadb0d77-962b-4b41-a3a0-e3dfb997c4f9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:29.624063 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eadb0d77-962b-4b41-a3a0-e3dfb997c4f9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:29.624882 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eadb0d77-962b-4b41-a3a0-e3dfb997c4f9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:29.625516 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eadb0d77-962b-4b41-a3a0-e3dfb997c4f9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:29.728834 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c6f3f025-b579-4156-b313-306c32056a0e tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:29.729763 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c6f3f025-b579-4156-b313-306c32056a0e tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:29.752304 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c6f3f025-b579-4156-b313-306c32056a0e tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:29.753377 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c6f3f025-b579-4156-b313-306c32056a0e tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:29.754517 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c6f3f025-b579-4156-b313-306c32056a0e tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:29.755055 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c6f3f025-b579-4156-b313-306c32056a0e tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:29.848852 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-eadb0d77-962b-4b41-a3a0-e3dfb997c4f9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:29.874597 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-eadb0d77-962b-4b41-a3a0-e3dfb997c4f9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.263029 Apr 16 21:25:29.876927 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2269/4730] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:29 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:29.882438 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c6f3f025-b579-4156-b313-306c32056a0e tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:29.897734 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3f3df51d-ed20-44a9-80dc-0efcf11bf6dc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:29.902114 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3f3df51d-ed20-44a9-80dc-0efcf11bf6dc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: b2c8da69-77b6-4af4-87bc-bbf731043f9f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:29.903790 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c6f3f025-b579-4156-b313-306c32056a0e tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:29.909096 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c6f3f025-b579-4156-b313-306c32056a0e tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:29.911261 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c6f3f025-b579-4156-b313-306c32056a0e tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce" status: 200 len: 1281 microversion: 2.47 time: 0.187213 Apr 16 21:25:29.912560 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2462/4731] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:29 2022] GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce => generated 1281 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:25:29.921621 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3f3df51d-ed20-44a9-80dc-0efcf11bf6dc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:29.924763 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3f3df51d-ed20-44a9-80dc-0efcf11bf6dc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:29.926983 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3f3df51d-ed20-44a9-80dc-0efcf11bf6dc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:29.927659 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3f3df51d-ed20-44a9-80dc-0efcf11bf6dc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:29.944193 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-3f3df51d-ed20-44a9-80dc-0efcf11bf6dc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] HTTP exception thrown: Instance b2c8da69-77b6-4af4-87bc-bbf731043f9f could not be found. Apr 16 21:25:29.945195 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3f3df51d-ed20-44a9-80dc-0efcf11bf6dc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Returning 404 to user: Instance b2c8da69-77b6-4af4-87bc-bbf731043f9f could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:25:29.946390 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3f3df51d-ed20-44a9-80dc-0efcf11bf6dc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "POST /compute/v2.1/servers/b2c8da69-77b6-4af4-87bc-bbf731043f9f/action" status: 404 len: 111 microversion: 2.1 time: 0.056312 Apr 16 21:25:29.949913 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2270/4732] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:25:29 2022] POST /compute/v2.1/servers/b2c8da69-77b6-4af4-87bc-bbf731043f9f/action => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:25:29.959024 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-dd4ccbd7-b5f7-452f-b012-e330d5476fac tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:29.959921 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-dd4ccbd7-b5f7-452f-b012-e330d5476fac tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:29.967164 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dd4ccbd7-b5f7-452f-b012-e330d5476fac tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:29.968101 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dd4ccbd7-b5f7-452f-b012-e330d5476fac tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:29.969502 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dd4ccbd7-b5f7-452f-b012-e330d5476fac tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:29.970302 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dd4ccbd7-b5f7-452f-b012-e330d5476fac tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:29.975373 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d09a8f94-1c05-446d-b316-39cf38cd3fde tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:29.984648 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d09a8f94-1c05-446d-b316-39cf38cd3fde tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:30.007238 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d09a8f94-1c05-446d-b316-39cf38cd3fde tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:30.011279 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d09a8f94-1c05-446d-b316-39cf38cd3fde tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:30.012103 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d09a8f94-1c05-446d-b316-39cf38cd3fde tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:30.012589 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d09a8f94-1c05-446d-b316-39cf38cd3fde tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:30.186662 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-dd4ccbd7-b5f7-452f-b012-e330d5476fac tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:30.196799 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-dd4ccbd7-b5f7-452f-b012-e330d5476fac tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.244620 Apr 16 21:25:30.199029 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2463/4733] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:29 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:30.217534 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-16a74679-f7d8-4837-851a-cdd769f2815f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:30.218542 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-16a74679-f7d8-4837-851a-cdd769f2815f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:30.225645 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-16a74679-f7d8-4837-851a-cdd769f2815f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:30.226203 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-16a74679-f7d8-4837-851a-cdd769f2815f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:30.227853 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-16a74679-f7d8-4837-851a-cdd769f2815f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:30.228874 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-16a74679-f7d8-4837-851a-cdd769f2815f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:30.320502 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d09a8f94-1c05-446d-b316-39cf38cd3fde tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:30.336513 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d09a8f94-1c05-446d-b316-39cf38cd3fde tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1523 microversion: 2.1 time: 0.360432 Apr 16 21:25:30.336513 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2271/4734] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:29 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1523 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:25:30.347645 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c4fb1eab-da9e-46a9-8ba9-6681445fd998 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:30.356132 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c4fb1eab-da9e-46a9-8ba9-6681445fd998 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] [instance: 5bec80bd-63c1-45bf-a379-98f4c375f318] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:30.368354 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c4fb1eab-da9e-46a9-8ba9-6681445fd998 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:30.369482 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c4fb1eab-da9e-46a9-8ba9-6681445fd998 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:30.372500 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c4fb1eab-da9e-46a9-8ba9-6681445fd998 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:30.373031 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c4fb1eab-da9e-46a9-8ba9-6681445fd998 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:30.455576 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-16a74679-f7d8-4837-851a-cdd769f2815f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:30.475356 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-16a74679-f7d8-4837-851a-cdd769f2815f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.262149 Apr 16 21:25:30.477182 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2464/4735] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:30 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:25:30.481391 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-db08655b-733d-45b8-9d0e-0906ce09e469 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:30.482443 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-db08655b-733d-45b8-9d0e-0906ce09e469 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 0c30b376-2903-4058-b436-4644778f3352] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:30.488938 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-db08655b-733d-45b8-9d0e-0906ce09e469 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:30.489407 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-db08655b-733d-45b8-9d0e-0906ce09e469 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:30.490202 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-db08655b-733d-45b8-9d0e-0906ce09e469 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:30.490695 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-db08655b-733d-45b8-9d0e-0906ce09e469 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:30.534718 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c4fb1eab-da9e-46a9-8ba9-6681445fd998 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:30.570887 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c4fb1eab-da9e-46a9-8ba9-6681445fd998 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:30.575042 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c4fb1eab-da9e-46a9-8ba9-6681445fd998 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:30.577988 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c4fb1eab-da9e-46a9-8ba9-6681445fd998 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] 10.222.0.20 "GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318" status: 200 len: 1408 microversion: 2.54 time: 0.240604 Apr 16 21:25:30.579724 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2272/4736] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:30 2022] GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318 => generated 1408 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:30.586618 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fd24f319-4669-4a7f-a882-ba1ef326fee6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:30.591003 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-fd24f319-4669-4a7f-a882-ba1ef326fee6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: f554e96f-0d11-4176-9672-00f0e0b20629] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:30.594713 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-fd24f319-4669-4a7f-a882-ba1ef326fee6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] HTTP exception thrown: Instance f554e96f-0d11-4176-9672-00f0e0b20629 could not be found. Apr 16 21:25:30.596653 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fd24f319-4669-4a7f-a882-ba1ef326fee6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Returning 404 to user: Instance f554e96f-0d11-4176-9672-00f0e0b20629 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:25:30.598385 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fd24f319-4669-4a7f-a882-ba1ef326fee6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "POST /compute/v2.1/servers/f554e96f-0d11-4176-9672-00f0e0b20629/action" status: 404 len: 111 microversion: 2.1 time: 0.017321 Apr 16 21:25:30.599351 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2273/4737] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:25:30 2022] POST /compute/v2.1/servers/f554e96f-0d11-4176-9672-00f0e0b20629/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:25:30.619584 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d3510a6b-679e-40c1-9253-76eed9d75761 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:30.621120 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d3510a6b-679e-40c1-9253-76eed9d75761 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:30.629903 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d3510a6b-679e-40c1-9253-76eed9d75761 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:30.630894 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d3510a6b-679e-40c1-9253-76eed9d75761 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:30.631948 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d3510a6b-679e-40c1-9253-76eed9d75761 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:30.632661 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d3510a6b-679e-40c1-9253-76eed9d75761 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:30.743893 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-db08655b-733d-45b8-9d0e-0906ce09e469 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:30.755082 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-db08655b-733d-45b8-9d0e-0906ce09e469 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352" status: 200 len: 1366 microversion: 2.1 time: 0.275286 Apr 16 21:25:30.765335 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2465/4738] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:30 2022] GET /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352 => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:30.864552 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d3510a6b-679e-40c1-9253-76eed9d75761 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:30.875033 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d3510a6b-679e-40c1-9253-76eed9d75761 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.266044 Apr 16 21:25:30.875033 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2274/4739] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:30 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:30.892977 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2534232c-25bd-4cce-a78a-75b85c15a475 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:30.894735 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2534232c-25bd-4cce-a78a-75b85c15a475 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:30.902625 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2534232c-25bd-4cce-a78a-75b85c15a475 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:30.903081 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2534232c-25bd-4cce-a78a-75b85c15a475 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:30.904080 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2534232c-25bd-4cce-a78a-75b85c15a475 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:30.904773 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2534232c-25bd-4cce-a78a-75b85c15a475 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:30.931380 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7fc881cc-befb-4f2c-82b1-6049891c9d6e tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:30.931999 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7fc881cc-befb-4f2c-82b1-6049891c9d6e tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:30.944080 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7fc881cc-befb-4f2c-82b1-6049891c9d6e tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:30.946008 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7fc881cc-befb-4f2c-82b1-6049891c9d6e tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:30.947500 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7fc881cc-befb-4f2c-82b1-6049891c9d6e tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:30.948657 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7fc881cc-befb-4f2c-82b1-6049891c9d6e tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:31.111756 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7fc881cc-befb-4f2c-82b1-6049891c9d6e tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:31.136916 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7fc881cc-befb-4f2c-82b1-6049891c9d6e tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:31.140981 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7fc881cc-befb-4f2c-82b1-6049891c9d6e tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:31.142401 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7fc881cc-befb-4f2c-82b1-6049891c9d6e tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce" status: 200 len: 1329 microversion: 2.47 time: 0.215091 Apr 16 21:25:31.154022 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2275/4740] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:30 2022] GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce => generated 1329 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:31.206968 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2534232c-25bd-4cce-a78a-75b85c15a475 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:31.215435 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2534232c-25bd-4cce-a78a-75b85c15a475 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.326262 Apr 16 21:25:31.227056 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2466/4741] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:30 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:31.235244 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1fb719cd-6a96-4ac4-ba94-12158217f287 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:31.239286 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1fb719cd-6a96-4ac4-ba94-12158217f287 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: b2c8da69-77b6-4af4-87bc-bbf731043f9f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:31.244345 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1fb719cd-6a96-4ac4-ba94-12158217f287 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:31.244815 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1fb719cd-6a96-4ac4-ba94-12158217f287 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:31.245633 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1fb719cd-6a96-4ac4-ba94-12158217f287 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:31.246076 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1fb719cd-6a96-4ac4-ba94-12158217f287 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:31.262910 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-1fb719cd-6a96-4ac4-ba94-12158217f287 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] HTTP exception thrown: Instance b2c8da69-77b6-4af4-87bc-bbf731043f9f could not be found. Apr 16 21:25:31.263518 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1fb719cd-6a96-4ac4-ba94-12158217f287 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Returning 404 to user: Instance b2c8da69-77b6-4af4-87bc-bbf731043f9f could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:25:31.264395 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1fb719cd-6a96-4ac4-ba94-12158217f287 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "POST /compute/v2.1/servers/b2c8da69-77b6-4af4-87bc-bbf731043f9f/action" status: 404 len: 111 microversion: 2.1 time: 0.033884 Apr 16 21:25:31.265158 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2276/4742] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:25:31 2022] POST /compute/v2.1/servers/b2c8da69-77b6-4af4-87bc-bbf731043f9f/action => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:25:31.278734 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-60310385-c4c4-41a9-8fc0-87090eefd32b tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:31.278734 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-60310385-c4c4-41a9-8fc0-87090eefd32b tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:31.286113 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-60310385-c4c4-41a9-8fc0-87090eefd32b tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:31.286589 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-60310385-c4c4-41a9-8fc0-87090eefd32b tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:31.287390 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-60310385-c4c4-41a9-8fc0-87090eefd32b tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:31.287897 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-60310385-c4c4-41a9-8fc0-87090eefd32b tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:31.351941 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-00ed4e4f-7d97-4379-9672-dfd5c5e1bc69 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:31.352878 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-00ed4e4f-7d97-4379-9672-dfd5c5e1bc69 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:31.372363 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-00ed4e4f-7d97-4379-9672-dfd5c5e1bc69 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:31.374146 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-00ed4e4f-7d97-4379-9672-dfd5c5e1bc69 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:31.374146 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-00ed4e4f-7d97-4379-9672-dfd5c5e1bc69 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:31.374389 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-00ed4e4f-7d97-4379-9672-dfd5c5e1bc69 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:31.598758 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-60310385-c4c4-41a9-8fc0-87090eefd32b tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:31.609250 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-60310385-c4c4-41a9-8fc0-87090eefd32b tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.338396 Apr 16 21:25:31.610803 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2467/4743] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:31 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:25:31.615759 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e89c86ae-c01f-4cf9-a034-298c26978212 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:31.616428 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e89c86ae-c01f-4cf9-a034-298c26978212 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] [instance: 5bec80bd-63c1-45bf-a379-98f4c375f318] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:31.632610 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e89c86ae-c01f-4cf9-a034-298c26978212 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:31.633577 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e89c86ae-c01f-4cf9-a034-298c26978212 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:31.634441 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e89c86ae-c01f-4cf9-a034-298c26978212 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:31.635612 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e89c86ae-c01f-4cf9-a034-298c26978212 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:31.715915 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-00ed4e4f-7d97-4379-9672-dfd5c5e1bc69 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:31.729306 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-00ed4e4f-7d97-4379-9672-dfd5c5e1bc69 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1523 microversion: 2.1 time: 0.383336 Apr 16 21:25:31.742097 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2277/4744] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:31 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1523 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:25:31.748697 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7c811f85-01e3-4a3b-97fd-f493d1b35bba tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:31.756143 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7c811f85-01e3-4a3b-97fd-f493d1b35bba tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:31.758143 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e89c86ae-c01f-4cf9-a034-298c26978212 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:31.768446 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7c811f85-01e3-4a3b-97fd-f493d1b35bba tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:31.770785 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e89c86ae-c01f-4cf9-a034-298c26978212 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:31.771528 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7c811f85-01e3-4a3b-97fd-f493d1b35bba tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:31.772700 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e89c86ae-c01f-4cf9-a034-298c26978212 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:31.774023 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e89c86ae-c01f-4cf9-a034-298c26978212 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] 10.222.0.20 "GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318" status: 200 len: 1408 microversion: 2.54 time: 0.162239 Apr 16 21:25:31.775604 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7c811f85-01e3-4a3b-97fd-f493d1b35bba tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:31.776114 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7c811f85-01e3-4a3b-97fd-f493d1b35bba tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:31.790501 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2468/4745] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:31 2022] GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318 => generated 1408 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:31.797071 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4585a34e-482c-4ded-ac98-4b3e19750702 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:31.798052 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4585a34e-482c-4ded-ac98-4b3e19750702 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 0c30b376-2903-4058-b436-4644778f3352] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:31.806981 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4585a34e-482c-4ded-ac98-4b3e19750702 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:31.807815 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4585a34e-482c-4ded-ac98-4b3e19750702 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:31.809025 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4585a34e-482c-4ded-ac98-4b3e19750702 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:31.810371 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4585a34e-482c-4ded-ac98-4b3e19750702 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:32.015384 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7c811f85-01e3-4a3b-97fd-f493d1b35bba tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:32.027397 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7c811f85-01e3-4a3b-97fd-f493d1b35bba tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.282562 Apr 16 21:25:32.028215 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2278/4746] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:31 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:32.047111 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5e3c9b74-2f57-46ae-8961-b8910dc2037f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:32.056049 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4585a34e-482c-4ded-ac98-4b3e19750702 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:32.063601 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4585a34e-482c-4ded-ac98-4b3e19750702 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352" status: 200 len: 1366 microversion: 2.1 time: 0.271633 Apr 16 21:25:32.064410 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2469/4747] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:31 2022] GET /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352 => generated 1366 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:32.065324 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5e3c9b74-2f57-46ae-8961-b8910dc2037f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: 293e1b49-e8d2-4e1e-b1bc-e57a11f5db17] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:32.073508 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-5e3c9b74-2f57-46ae-8961-b8910dc2037f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] HTTP exception thrown: Instance 293e1b49-e8d2-4e1e-b1bc-e57a11f5db17 could not be found. Apr 16 21:25:32.073508 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5e3c9b74-2f57-46ae-8961-b8910dc2037f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Returning 404 to user: Instance 293e1b49-e8d2-4e1e-b1bc-e57a11f5db17 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:25:32.073508 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5e3c9b74-2f57-46ae-8961-b8910dc2037f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "POST /compute/v2.1/servers/293e1b49-e8d2-4e1e-b1bc-e57a11f5db17/action" status: 404 len: 111 microversion: 2.1 time: 0.030234 Apr 16 21:25:32.083167 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a9a62205-ebda-4042-9cc7-cad56b56f166 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:32.084037 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a9a62205-ebda-4042-9cc7-cad56b56f166 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:32.086249 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2279/4748] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:25:32 2022] POST /compute/v2.1/servers/293e1b49-e8d2-4e1e-b1bc-e57a11f5db17/action => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:25:32.091137 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9a62205-ebda-4042-9cc7-cad56b56f166 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:32.091585 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9a62205-ebda-4042-9cc7-cad56b56f166 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:32.092417 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9a62205-ebda-4042-9cc7-cad56b56f166 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:32.092871 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9a62205-ebda-4042-9cc7-cad56b56f166 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:32.165258 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-385b3cea-6323-48f2-a0ae-b073debf9459 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:32.165918 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-385b3cea-6323-48f2-a0ae-b073debf9459 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:32.175732 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-385b3cea-6323-48f2-a0ae-b073debf9459 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:32.176336 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-385b3cea-6323-48f2-a0ae-b073debf9459 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:32.177146 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-385b3cea-6323-48f2-a0ae-b073debf9459 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:32.184999 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-385b3cea-6323-48f2-a0ae-b073debf9459 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:32.287401 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a9a62205-ebda-4042-9cc7-cad56b56f166 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:32.296664 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a9a62205-ebda-4042-9cc7-cad56b56f166 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.217050 Apr 16 21:25:32.297783 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2470/4749] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:32 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:32.317310 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e7d0936a-f6fb-4677-9476-f174106f263b tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:32.317970 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e7d0936a-f6fb-4677-9476-f174106f263b tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:32.325778 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e7d0936a-f6fb-4677-9476-f174106f263b tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:32.326581 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e7d0936a-f6fb-4677-9476-f174106f263b tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:32.327859 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e7d0936a-f6fb-4677-9476-f174106f263b tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:32.328926 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e7d0936a-f6fb-4677-9476-f174106f263b tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:32.536737 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e7d0936a-f6fb-4677-9476-f174106f263b tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:32.549116 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e7d0936a-f6fb-4677-9476-f174106f263b tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.236402 Apr 16 21:25:32.550069 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2471/4750] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:32 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:32.574405 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1958c28f-3dcc-495e-90b1-8fa6dd54fbf1 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:32.578040 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1958c28f-3dcc-495e-90b1-8fa6dd54fbf1 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: feb1eb73-0cab-4fc8-aa2a-ab8f41202e36] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:32.581688 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-1958c28f-3dcc-495e-90b1-8fa6dd54fbf1 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] HTTP exception thrown: Instance feb1eb73-0cab-4fc8-aa2a-ab8f41202e36 could not be found. Apr 16 21:25:32.585198 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1958c28f-3dcc-495e-90b1-8fa6dd54fbf1 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Returning 404 to user: Instance feb1eb73-0cab-4fc8-aa2a-ab8f41202e36 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:25:32.586117 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1958c28f-3dcc-495e-90b1-8fa6dd54fbf1 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "POST /compute/v2.1/servers/feb1eb73-0cab-4fc8-aa2a-ab8f41202e36/action" status: 404 len: 111 microversion: 2.1 time: 0.015877 Apr 16 21:25:32.590117 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2472/4751] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:25:32 2022] POST /compute/v2.1/servers/feb1eb73-0cab-4fc8-aa2a-ab8f41202e36/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:25:32.595306 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4d1bce82-dc5d-4e9f-9b31-0c74018543df tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:32.595930 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4d1bce82-dc5d-4e9f-9b31-0c74018543df tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:32.610929 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4d1bce82-dc5d-4e9f-9b31-0c74018543df tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:32.614868 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4d1bce82-dc5d-4e9f-9b31-0c74018543df tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:32.615970 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4d1bce82-dc5d-4e9f-9b31-0c74018543df tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:32.616685 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4d1bce82-dc5d-4e9f-9b31-0c74018543df tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:32.667637 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-385b3cea-6323-48f2-a0ae-b073debf9459 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:32.690968 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-385b3cea-6323-48f2-a0ae-b073debf9459 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:32.693033 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-385b3cea-6323-48f2-a0ae-b073debf9459 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:32.703916 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-385b3cea-6323-48f2-a0ae-b073debf9459 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce" status: 200 len: 1347 microversion: 2.47 time: 0.539067 Apr 16 21:25:32.704361 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2280/4752] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:32 2022] GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce => generated 1347 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:25:32.749664 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-65dbd635-938f-47f7-b294-d7037d5201a3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:32.751034 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-65dbd635-938f-47f7-b294-d7037d5201a3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:32.759528 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-65dbd635-938f-47f7-b294-d7037d5201a3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:32.760000 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-65dbd635-938f-47f7-b294-d7037d5201a3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:32.773400 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-65dbd635-938f-47f7-b294-d7037d5201a3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:32.774142 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-65dbd635-938f-47f7-b294-d7037d5201a3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:32.837182 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4d1bce82-dc5d-4e9f-9b31-0c74018543df tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:32.844959 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4d1bce82-dc5d-4e9f-9b31-0c74018543df tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.253510 Apr 16 21:25:32.852839 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2473/4753] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:32 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:32.864804 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-23141b2a-9665-4c69-a9c7-377c675917d9 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:32.865477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-23141b2a-9665-4c69-a9c7-377c675917d9 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] [instance: 5bec80bd-63c1-45bf-a379-98f4c375f318] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:32.876986 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-23141b2a-9665-4c69-a9c7-377c675917d9 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:32.877450 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-23141b2a-9665-4c69-a9c7-377c675917d9 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:32.878245 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-23141b2a-9665-4c69-a9c7-377c675917d9 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:32.878765 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-23141b2a-9665-4c69-a9c7-377c675917d9 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:32.995041 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-23141b2a-9665-4c69-a9c7-377c675917d9 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:33.005656 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-23141b2a-9665-4c69-a9c7-377c675917d9 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:33.007208 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-23141b2a-9665-4c69-a9c7-377c675917d9 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:33.008437 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-23141b2a-9665-4c69-a9c7-377c675917d9 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] 10.222.0.20 "GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318" status: 200 len: 1408 microversion: 2.54 time: 0.158981 Apr 16 21:25:33.020072 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2474/4754] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:32 2022] GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:33.031378 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fd5a495e-cf15-46e3-94d6-04835d057812 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:33.032240 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fd5a495e-cf15-46e3-94d6-04835d057812 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:33.045492 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fd5a495e-cf15-46e3-94d6-04835d057812 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:33.045965 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fd5a495e-cf15-46e3-94d6-04835d057812 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:33.046778 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fd5a495e-cf15-46e3-94d6-04835d057812 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:33.047239 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fd5a495e-cf15-46e3-94d6-04835d057812 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:33.128364 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-65dbd635-938f-47f7-b294-d7037d5201a3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:33.136681 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-65dbd635-938f-47f7-b294-d7037d5201a3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1523 microversion: 2.1 time: 0.390663 Apr 16 21:25:33.138040 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2281/4755] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:32 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1523 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:25:33.146288 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-19edb2bf-be6f-4b00-9058-20072b59f725 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:33.147156 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-19edb2bf-be6f-4b00-9058-20072b59f725 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 0c30b376-2903-4058-b436-4644778f3352] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:33.184313 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-19edb2bf-be6f-4b00-9058-20072b59f725 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:33.185905 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-19edb2bf-be6f-4b00-9058-20072b59f725 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:33.189833 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-19edb2bf-be6f-4b00-9058-20072b59f725 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:33.191264 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-19edb2bf-be6f-4b00-9058-20072b59f725 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:33.386045 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fd5a495e-cf15-46e3-94d6-04835d057812 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:33.396156 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fd5a495e-cf15-46e3-94d6-04835d057812 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.386046 Apr 16 21:25:33.397212 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2475/4756] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:33 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:33.400453 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-19edb2bf-be6f-4b00-9058-20072b59f725 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:33.411630 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-19edb2bf-be6f-4b00-9058-20072b59f725 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352" status: 200 len: 1366 microversion: 2.1 time: 0.272265 Apr 16 21:25:33.415102 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-2b25ddc4-e429-416a-a8ea-1b5cf685888f req-47a14636-dea5-4698-a669-66488fc1f1cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c30b376-2903-4058-b436-4644778f3352", "name": "network-vif-plugged", "status": "completed", "tag": "89aa2008-483c-4c5a-85b1-9f5656576e5b"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:33.415921 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2282/4757] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:33 2022] GET /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352 => generated 1366 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:33.421088 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1c077520-0a5f-439e-baac-2af668441faf tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:33.421647 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1c077520-0a5f-439e-baac-2af668441faf tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:33.439429 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1c077520-0a5f-439e-baac-2af668441faf tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:33.439890 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1c077520-0a5f-439e-baac-2af668441faf tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:33.440711 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1c077520-0a5f-439e-baac-2af668441faf tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:33.441154 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1c077520-0a5f-439e-baac-2af668441faf tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:33.446273 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-2b25ddc4-e429-416a-a8ea-1b5cf685888f req-47a14636-dea5-4698-a669-66488fc1f1cf service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:33.446777 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-2b25ddc4-e429-416a-a8ea-1b5cf685888f req-47a14636-dea5-4698-a669-66488fc1f1cf service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:33.460864 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-2b25ddc4-e429-416a-a8ea-1b5cf685888f req-47a14636-dea5-4698-a669-66488fc1f1cf service nova] Creating event network-vif-plugged:89aa2008-483c-4c5a-85b1-9f5656576e5b for instance 0c30b376-2903-4058-b436-4644778f3352 on nch1-master-1 Apr 16 21:25:33.467818 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-2b25ddc4-e429-416a-a8ea-1b5cf685888f req-47a14636-dea5-4698-a669-66488fc1f1cf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059095 Apr 16 21:25:33.468585 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2476/4758] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:25:33.481743 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-1c077520-0a5f-439e-baac-2af668441faf tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] HTTP exception thrown: Cannot 'restore' instance daf189e2-7cb4-4dab-94cf-ffdceb314df7 while it is in vm_state active Apr 16 21:25:33.482352 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1c077520-0a5f-439e-baac-2af668441faf tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Returning 409 to user: Cannot 'restore' instance daf189e2-7cb4-4dab-94cf-ffdceb314df7 while it is in vm_state active {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:25:33.483201 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1c077520-0a5f-439e-baac-2af668441faf tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "POST /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7/action" status: 409 len: 145 microversion: 2.1 time: 0.066186 Apr 16 21:25:33.483929 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2283/4759] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:25:33 2022] POST /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7/action => generated 145 bytes in 67 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:25:33.492706 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-477ea443-11d5-405d-9331-25490ebddc2e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:33.494916 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-477ea443-11d5-405d-9331-25490ebddc2e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:33.501733 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-477ea443-11d5-405d-9331-25490ebddc2e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:33.502188 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-477ea443-11d5-405d-9331-25490ebddc2e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:33.502970 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-477ea443-11d5-405d-9331-25490ebddc2e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:33.503434 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-477ea443-11d5-405d-9331-25490ebddc2e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:33.700740 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-477ea443-11d5-405d-9331-25490ebddc2e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:33.711245 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-477ea443-11d5-405d-9331-25490ebddc2e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.222937 Apr 16 21:25:33.712115 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2477/4760] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:33 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:33.729693 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c8e5e9fb-b282-414d-b05e-f75a256bfdc0 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:33.729918 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b308cd7a-efa4-499c-ba0d-168174941747 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:33.729918 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b308cd7a-efa4-499c-ba0d-168174941747 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:33.730150 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c8e5e9fb-b282-414d-b05e-f75a256bfdc0 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:33.735638 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b308cd7a-efa4-499c-ba0d-168174941747 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:33.735838 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c8e5e9fb-b282-414d-b05e-f75a256bfdc0 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:33.736093 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b308cd7a-efa4-499c-ba0d-168174941747 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:33.736347 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c8e5e9fb-b282-414d-b05e-f75a256bfdc0 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:33.736891 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b308cd7a-efa4-499c-ba0d-168174941747 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:33.737130 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c8e5e9fb-b282-414d-b05e-f75a256bfdc0 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:33.737336 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b308cd7a-efa4-499c-ba0d-168174941747 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:33.737582 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c8e5e9fb-b282-414d-b05e-f75a256bfdc0 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:33.826523 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c8e5e9fb-b282-414d-b05e-f75a256bfdc0 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:33.835930 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c8e5e9fb-b282-414d-b05e-f75a256bfdc0 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:33.838830 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c8e5e9fb-b282-414d-b05e-f75a256bfdc0 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:33.840414 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c8e5e9fb-b282-414d-b05e-f75a256bfdc0 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce" status: 200 len: 1335 microversion: 2.47 time: 0.115505 Apr 16 21:25:33.844334 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2284/4761] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:33 2022] GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce => generated 1335 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:33.982834 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b308cd7a-efa4-499c-ba0d-168174941747 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:33.993600 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b308cd7a-efa4-499c-ba0d-168174941747 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.268233 Apr 16 21:25:33.994521 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2478/4762] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:33 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:34.013418 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8392e0f6-7daa-4a9c-9b87-ea42203f3895 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:34.013985 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8392e0f6-7daa-4a9c-9b87-ea42203f3895 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: e16346f9-2961-40f7-b066-06e33cd09751] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:34.026668 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-8392e0f6-7daa-4a9c-9b87-ea42203f3895 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] HTTP exception thrown: Instance e16346f9-2961-40f7-b066-06e33cd09751 could not be found. Apr 16 21:25:34.031504 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8392e0f6-7daa-4a9c-9b87-ea42203f3895 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Returning 404 to user: Instance e16346f9-2961-40f7-b066-06e33cd09751 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:25:34.031646 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c494fe40-88be-4368-b257-ff84ff7d875b tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:34.031646 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c494fe40-88be-4368-b257-ff84ff7d875b tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] [instance: 5bec80bd-63c1-45bf-a379-98f4c375f318] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:34.031826 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8392e0f6-7daa-4a9c-9b87-ea42203f3895 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "POST /compute/v2.1/servers/e16346f9-2961-40f7-b066-06e33cd09751/action" status: 404 len: 111 microversion: 2.1 time: 0.021450 Apr 16 21:25:34.031826 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2285/4763] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:25:34 2022] POST /compute/v2.1/servers/e16346f9-2961-40f7-b066-06e33cd09751/action => generated 111 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:25:34.044407 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a5d0c27b-274b-416e-b73e-87f9ba9616ca tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:34.045028 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a5d0c27b-274b-416e-b73e-87f9ba9616ca tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:34.045423 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c494fe40-88be-4368-b257-ff84ff7d875b tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:34.046051 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c494fe40-88be-4368-b257-ff84ff7d875b tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:34.050134 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c494fe40-88be-4368-b257-ff84ff7d875b tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:34.054264 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c494fe40-88be-4368-b257-ff84ff7d875b tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:34.054399 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a5d0c27b-274b-416e-b73e-87f9ba9616ca tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:34.054907 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a5d0c27b-274b-416e-b73e-87f9ba9616ca tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:34.055957 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a5d0c27b-274b-416e-b73e-87f9ba9616ca tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:34.057401 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a5d0c27b-274b-416e-b73e-87f9ba9616ca tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:34.140420 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c494fe40-88be-4368-b257-ff84ff7d875b tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:34.152613 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c494fe40-88be-4368-b257-ff84ff7d875b tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:34.154256 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c494fe40-88be-4368-b257-ff84ff7d875b tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:34.156471 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c494fe40-88be-4368-b257-ff84ff7d875b tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] 10.222.0.20 "GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318" status: 200 len: 1408 microversion: 2.54 time: 0.133086 Apr 16 21:25:34.172696 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2479/4764] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:34 2022] GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318 => generated 1408 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:34.178097 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6987d1c5-9fc9-4f90-bc06-f27392e134e5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:34.179026 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6987d1c5-9fc9-4f90-bc06-f27392e134e5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:34.186732 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6987d1c5-9fc9-4f90-bc06-f27392e134e5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:34.187541 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6987d1c5-9fc9-4f90-bc06-f27392e134e5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:34.188678 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6987d1c5-9fc9-4f90-bc06-f27392e134e5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:34.189135 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6987d1c5-9fc9-4f90-bc06-f27392e134e5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:34.377525 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a5d0c27b-274b-416e-b73e-87f9ba9616ca tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:34.385692 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a5d0c27b-274b-416e-b73e-87f9ba9616ca tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.346389 Apr 16 21:25:34.386390 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2286/4765] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:34 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:34.403814 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-047882b6-2962-48bc-bb51-8bd07dd1a96e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:34.404506 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-047882b6-2962-48bc-bb51-8bd07dd1a96e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:34.411135 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-047882b6-2962-48bc-bb51-8bd07dd1a96e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:34.411592 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-047882b6-2962-48bc-bb51-8bd07dd1a96e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:34.416239 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-047882b6-2962-48bc-bb51-8bd07dd1a96e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:34.416239 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-047882b6-2962-48bc-bb51-8bd07dd1a96e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:34.449317 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6987d1c5-9fc9-4f90-bc06-f27392e134e5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:34.458008 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6987d1c5-9fc9-4f90-bc06-f27392e134e5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1523 microversion: 2.1 time: 0.283249 Apr 16 21:25:34.458608 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2480/4766] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:34 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1523 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:34.463272 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5cc20f02-59f5-44c0-a12f-e4d72a616952 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:34.463886 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5cc20f02-59f5-44c0-a12f-e4d72a616952 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 0c30b376-2903-4058-b436-4644778f3352] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:34.470091 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5cc20f02-59f5-44c0-a12f-e4d72a616952 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:34.470545 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5cc20f02-59f5-44c0-a12f-e4d72a616952 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:34.471356 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5cc20f02-59f5-44c0-a12f-e4d72a616952 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:34.472087 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5cc20f02-59f5-44c0-a12f-e4d72a616952 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:34.563865 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-047882b6-2962-48bc-bb51-8bd07dd1a96e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:34.572340 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-047882b6-2962-48bc-bb51-8bd07dd1a96e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.172487 Apr 16 21:25:34.573220 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2287/4767] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:34 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:34.589188 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-42d60f65-8e50-4505-8601-d2a170012947 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:34.589815 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-42d60f65-8e50-4505-8601-d2a170012947 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:34.616151 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-42d60f65-8e50-4505-8601-d2a170012947 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:34.617671 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-42d60f65-8e50-4505-8601-d2a170012947 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:34.625970 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-42d60f65-8e50-4505-8601-d2a170012947 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:34.626540 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-42d60f65-8e50-4505-8601-d2a170012947 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:34.669015 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-42d60f65-8e50-4505-8601-d2a170012947 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] HTTP exception thrown: Cannot 'resume' instance daf189e2-7cb4-4dab-94cf-ffdceb314df7 while it is in vm_state active Apr 16 21:25:34.669628 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-42d60f65-8e50-4505-8601-d2a170012947 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Returning 409 to user: Cannot 'resume' instance daf189e2-7cb4-4dab-94cf-ffdceb314df7 while it is in vm_state active {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:25:34.670779 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-42d60f65-8e50-4505-8601-d2a170012947 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "POST /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7/action" status: 409 len: 144 microversion: 2.1 time: 0.085560 Apr 16 21:25:34.674282 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2288/4768] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:25:34 2022] POST /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7/action => generated 144 bytes in 87 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:25:34.680351 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-683d5325-80ab-44fb-969a-261e1b738cfa tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:34.681596 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-683d5325-80ab-44fb-969a-261e1b738cfa tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:34.688757 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-683d5325-80ab-44fb-969a-261e1b738cfa tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:34.690355 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-683d5325-80ab-44fb-969a-261e1b738cfa tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:34.690355 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-683d5325-80ab-44fb-969a-261e1b738cfa tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:34.690564 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-683d5325-80ab-44fb-969a-261e1b738cfa tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:34.709895 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5cc20f02-59f5-44c0-a12f-e4d72a616952 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:34.718375 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5cc20f02-59f5-44c0-a12f-e4d72a616952 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352" status: 200 len: 1366 microversion: 2.1 time: 0.258656 Apr 16 21:25:34.719176 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2481/4769] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:34 2022] GET /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352 => generated 1366 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:34.840088 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-683d5325-80ab-44fb-969a-261e1b738cfa tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:34.847988 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-683d5325-80ab-44fb-969a-261e1b738cfa tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.172341 Apr 16 21:25:34.849390 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2289/4770] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:34 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:34.864993 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-eb7b9a08-82ff-4b0f-87d8-bc519e402d29 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:34.867365 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-206bc346-08e3-4041-87bf-65f60510a40f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:34.867504 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-eb7b9a08-82ff-4b0f-87d8-bc519e402d29 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:34.867619 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-206bc346-08e3-4041-87bf-65f60510a40f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:34.873054 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eb7b9a08-82ff-4b0f-87d8-bc519e402d29 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:34.873823 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eb7b9a08-82ff-4b0f-87d8-bc519e402d29 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:34.875101 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eb7b9a08-82ff-4b0f-87d8-bc519e402d29 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:34.875236 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-206bc346-08e3-4041-87bf-65f60510a40f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:34.876487 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eb7b9a08-82ff-4b0f-87d8-bc519e402d29 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:34.876950 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-206bc346-08e3-4041-87bf-65f60510a40f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:34.878209 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-206bc346-08e3-4041-87bf-65f60510a40f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:34.879608 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-206bc346-08e3-4041-87bf-65f60510a40f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:34.967477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-eb7b9a08-82ff-4b0f-87d8-bc519e402d29 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:34.978049 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-eb7b9a08-82ff-4b0f-87d8-bc519e402d29 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:34.980363 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-eb7b9a08-82ff-4b0f-87d8-bc519e402d29 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:34.981587 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-eb7b9a08-82ff-4b0f-87d8-bc519e402d29 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce" status: 200 len: 1335 microversion: 2.47 time: 0.121254 Apr 16 21:25:34.982200 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2482/4771] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:34 2022] GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce => generated 1335 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:35.025860 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-206bc346-08e3-4041-87bf-65f60510a40f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:35.033870 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-206bc346-08e3-4041-87bf-65f60510a40f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.172131 Apr 16 21:25:35.034505 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2290/4772] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:34 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:35.137778 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e3033033-56a6-46c7-bdfd-19e938649fe4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "1b9ee265-bdab-4092-8071-c9bb95d911fb"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:35.139320 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e3033033-56a6-46c7-bdfd-19e938649fe4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:25:35.140235 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e3033033-56a6-46c7-bdfd-19e938649fe4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.006407 Apr 16 21:25:35.140963 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2483/4773] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:25:35 2022] POST /compute/v2.1/servers => generated 108 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:25:35.149817 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a3a3eb54-f565-44d0-a72f-52d6eade8795 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:35.150499 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a3a3eb54-f565-44d0-a72f-52d6eade8795 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:35.157698 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a3a3eb54-f565-44d0-a72f-52d6eade8795 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:35.158163 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a3a3eb54-f565-44d0-a72f-52d6eade8795 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:35.158966 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a3a3eb54-f565-44d0-a72f-52d6eade8795 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:35.159444 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a3a3eb54-f565-44d0-a72f-52d6eade8795 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:35.176396 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-38bc3c38-5e10-43e1-9ed5-832ea3af334e tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:35.177203 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-38bc3c38-5e10-43e1-9ed5-832ea3af334e tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] [instance: 5bec80bd-63c1-45bf-a379-98f4c375f318] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:35.185433 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-38bc3c38-5e10-43e1-9ed5-832ea3af334e tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:35.185892 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-38bc3c38-5e10-43e1-9ed5-832ea3af334e tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:35.186706 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-38bc3c38-5e10-43e1-9ed5-832ea3af334e tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:35.187156 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-38bc3c38-5e10-43e1-9ed5-832ea3af334e tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:35.314304 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a3a3eb54-f565-44d0-a72f-52d6eade8795 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:35.323735 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a3a3eb54-f565-44d0-a72f-52d6eade8795 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.177742 Apr 16 21:25:35.324706 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2291/4774] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:35 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:35.343924 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-999d617a-5868-4401-9cd2-6e5921225229 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:35.343924 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-999d617a-5868-4401-9cd2-6e5921225229 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:35.349798 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-999d617a-5868-4401-9cd2-6e5921225229 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:35.350371 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-999d617a-5868-4401-9cd2-6e5921225229 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:35.351291 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-999d617a-5868-4401-9cd2-6e5921225229 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:35.351813 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-999d617a-5868-4401-9cd2-6e5921225229 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:35.491413 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-999d617a-5868-4401-9cd2-6e5921225229 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:35.492568 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-38bc3c38-5e10-43e1-9ed5-832ea3af334e tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:35.499913 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-999d617a-5868-4401-9cd2-6e5921225229 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.161817 Apr 16 21:25:35.510627 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2292/4775] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:35 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:25:35.510754 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-38bc3c38-5e10-43e1-9ed5-832ea3af334e tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:35.510754 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-38bc3c38-5e10-43e1-9ed5-832ea3af334e tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:35.510754 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-38bc3c38-5e10-43e1-9ed5-832ea3af334e tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] 10.222.0.20 "GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318" status: 200 len: 1408 microversion: 2.54 time: 0.332783 Apr 16 21:25:35.510754 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2484/4776] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:35 2022] GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318 => generated 1408 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:35.516299 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-eb2878a0-06fe-4ccc-9827-6d02d20bcf1e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:35.516925 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-eb2878a0-06fe-4ccc-9827-6d02d20bcf1e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:35.521535 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-25523660-23cd-488b-a7ab-e5893d277e6c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:35.522206 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-25523660-23cd-488b-a7ab-e5893d277e6c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: 1da2c5f7-185c-49a1-ae1c-5272b6a19f2e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:35.523558 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eb2878a0-06fe-4ccc-9827-6d02d20bcf1e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:35.524031 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eb2878a0-06fe-4ccc-9827-6d02d20bcf1e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:35.525157 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eb2878a0-06fe-4ccc-9827-6d02d20bcf1e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:35.525311 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eb2878a0-06fe-4ccc-9827-6d02d20bcf1e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:35.528299 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-25523660-23cd-488b-a7ab-e5893d277e6c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] HTTP exception thrown: Instance 1da2c5f7-185c-49a1-ae1c-5272b6a19f2e could not be found. Apr 16 21:25:35.529157 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-25523660-23cd-488b-a7ab-e5893d277e6c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Returning 404 to user: Instance 1da2c5f7-185c-49a1-ae1c-5272b6a19f2e could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:25:35.530102 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-25523660-23cd-488b-a7ab-e5893d277e6c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "POST /compute/v2.1/servers/1da2c5f7-185c-49a1-ae1c-5272b6a19f2e/action" status: 404 len: 111 microversion: 2.1 time: 0.014124 Apr 16 21:25:35.530784 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2485/4777] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:25:35 2022] POST /compute/v2.1/servers/1da2c5f7-185c-49a1-ae1c-5272b6a19f2e/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:25:35.539445 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ec217844-a69e-42da-8231-321969b049b8 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:35.540056 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ec217844-a69e-42da-8231-321969b049b8 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:35.547266 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ec217844-a69e-42da-8231-321969b049b8 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:35.547814 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ec217844-a69e-42da-8231-321969b049b8 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:35.553176 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ec217844-a69e-42da-8231-321969b049b8 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:35.553176 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ec217844-a69e-42da-8231-321969b049b8 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:35.660154 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-eb2878a0-06fe-4ccc-9827-6d02d20bcf1e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:35.690371 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-eb2878a0-06fe-4ccc-9827-6d02d20bcf1e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1523 microversion: 2.1 time: 0.166901 Apr 16 21:25:35.690371 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2293/4778] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:35 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:35.736272 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9c7a125b-8cc5-4b99-8253-99315a3a2390 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:35.736963 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9c7a125b-8cc5-4b99-8253-99315a3a2390 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 0c30b376-2903-4058-b436-4644778f3352] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:35.743166 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9c7a125b-8cc5-4b99-8253-99315a3a2390 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:35.743638 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9c7a125b-8cc5-4b99-8253-99315a3a2390 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:35.744480 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9c7a125b-8cc5-4b99-8253-99315a3a2390 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:35.744925 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9c7a125b-8cc5-4b99-8253-99315a3a2390 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:35.756758 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ec217844-a69e-42da-8231-321969b049b8 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:35.764568 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ec217844-a69e-42da-8231-321969b049b8 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.229422 Apr 16 21:25:35.765367 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2486/4779] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:35 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:25:35.783427 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-16710d8c-8a4e-4857-81a2-b23953978175 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:35.784048 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-16710d8c-8a4e-4857-81a2-b23953978175 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:35.791153 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-16710d8c-8a4e-4857-81a2-b23953978175 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:35.791614 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-16710d8c-8a4e-4857-81a2-b23953978175 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:35.792466 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-16710d8c-8a4e-4857-81a2-b23953978175 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:35.792933 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-16710d8c-8a4e-4857-81a2-b23953978175 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:35.882952 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9c7a125b-8cc5-4b99-8253-99315a3a2390 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:35.895793 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9c7a125b-8cc5-4b99-8253-99315a3a2390 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352" status: 200 len: 1366 microversion: 2.1 time: 0.163562 Apr 16 21:25:35.896423 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2294/4780] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:35 2022] GET /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:25:35.999946 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2463a8c3-f963-4527-8abd-17b70578a611 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:36.000597 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2463a8c3-f963-4527-8abd-17b70578a611 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:36.007484 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2463a8c3-f963-4527-8abd-17b70578a611 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:36.008063 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2463a8c3-f963-4527-8abd-17b70578a611 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:36.008881 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2463a8c3-f963-4527-8abd-17b70578a611 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:36.009332 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2463a8c3-f963-4527-8abd-17b70578a611 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:36.016989 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-16710d8c-8a4e-4857-81a2-b23953978175 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:36.025974 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-16710d8c-8a4e-4857-81a2-b23953978175 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.246300 Apr 16 21:25:36.027110 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2487/4781] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:35 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:25:36.042468 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3b16c4e2-069e-4426-8859-06137711a6e6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:36.043015 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3b16c4e2-069e-4426-8859-06137711a6e6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:36.049187 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3b16c4e2-069e-4426-8859-06137711a6e6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:36.049851 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3b16c4e2-069e-4426-8859-06137711a6e6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:36.051053 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3b16c4e2-069e-4426-8859-06137711a6e6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:36.051518 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3b16c4e2-069e-4426-8859-06137711a6e6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:36.082846 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-3b16c4e2-069e-4426-8859-06137711a6e6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lazy-loading 'flavor' on Instance uuid daf189e2-7cb4-4dab-94cf-ffdceb314df7 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:25:36.092407 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2463a8c3-f963-4527-8abd-17b70578a611 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:36.101942 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2463a8c3-f963-4527-8abd-17b70578a611 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:36.104986 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2463a8c3-f963-4527-8abd-17b70578a611 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:36.116328 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2463a8c3-f963-4527-8abd-17b70578a611 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce" status: 200 len: 1335 microversion: 2.47 time: 0.110264 Apr 16 21:25:36.116328 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2295/4782] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:35 2022] GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce => generated 1335 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:25:36.522725 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-88bb18d1-9ce8-4446-ad0b-237144e7164d tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:36.523689 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-88bb18d1-9ce8-4446-ad0b-237144e7164d tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] [instance: 5bec80bd-63c1-45bf-a379-98f4c375f318] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:36.535502 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-88bb18d1-9ce8-4446-ad0b-237144e7164d tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:36.541371 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-88bb18d1-9ce8-4446-ad0b-237144e7164d tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:36.542250 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-88bb18d1-9ce8-4446-ad0b-237144e7164d tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:36.542713 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-88bb18d1-9ce8-4446-ad0b-237144e7164d tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:36.654085 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-88bb18d1-9ce8-4446-ad0b-237144e7164d tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:36.663057 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-88bb18d1-9ce8-4446-ad0b-237144e7164d tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:36.664681 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-88bb18d1-9ce8-4446-ad0b-237144e7164d tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:36.666056 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-88bb18d1-9ce8-4446-ad0b-237144e7164d tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] 10.222.0.20 "GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318" status: 200 len: 1408 microversion: 2.54 time: 0.147329 Apr 16 21:25:36.666637 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2296/4783] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:36 2022] GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318 => generated 1408 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:25:36.697633 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3a01da74-960b-4d03-b3bc-5acf2c57a31e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:36.698702 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3a01da74-960b-4d03-b3bc-5acf2c57a31e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:36.711275 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3a01da74-960b-4d03-b3bc-5acf2c57a31e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:36.711823 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3a01da74-960b-4d03-b3bc-5acf2c57a31e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:36.715384 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3a01da74-960b-4d03-b3bc-5acf2c57a31e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:36.715384 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3a01da74-960b-4d03-b3bc-5acf2c57a31e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:36.719567 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3b16c4e2-069e-4426-8859-06137711a6e6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "POST /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7/action" status: 202 len: 0 microversion: 2.1 time: 0.681032 Apr 16 21:25:36.720537 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2488/4784] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:25:36 2022] POST /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7/action => generated 0 bytes in 683 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:25:36.731608 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ecc63759-d63c-413f-88c0-4c76080b7af3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:36.732955 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ecc63759-d63c-413f-88c0-4c76080b7af3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:36.741431 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ecc63759-d63c-413f-88c0-4c76080b7af3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:36.742006 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ecc63759-d63c-413f-88c0-4c76080b7af3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:36.742915 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ecc63759-d63c-413f-88c0-4c76080b7af3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:36.743431 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ecc63759-d63c-413f-88c0-4c76080b7af3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:36.955635 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ecc63759-d63c-413f-88c0-4c76080b7af3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:36.964514 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ecc63759-d63c-413f-88c0-4c76080b7af3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1510 microversion: 2.1 time: 0.238129 Apr 16 21:25:36.965320 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2489/4785] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:36 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1510 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:36.979848 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-60116574-3e36-4008-97a8-1110884ba112 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:36.980500 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-60116574-3e36-4008-97a8-1110884ba112 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 0c30b376-2903-4058-b436-4644778f3352] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:36.987770 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-60116574-3e36-4008-97a8-1110884ba112 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:36.987770 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-60116574-3e36-4008-97a8-1110884ba112 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:36.988618 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-60116574-3e36-4008-97a8-1110884ba112 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:36.989769 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-60116574-3e36-4008-97a8-1110884ba112 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:37.001639 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3a01da74-960b-4d03-b3bc-5acf2c57a31e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:37.013375 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3a01da74-960b-4d03-b3bc-5acf2c57a31e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1505 microversion: 2.1 time: 0.320288 Apr 16 21:25:37.014241 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2297/4786] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:36 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1505 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:25:37.126224 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d4e35cd7-d630-46e9-8ca7-428abc3c2be1 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:37.127328 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d4e35cd7-d630-46e9-8ca7-428abc3c2be1 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:37.134399 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d4e35cd7-d630-46e9-8ca7-428abc3c2be1 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:37.134956 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d4e35cd7-d630-46e9-8ca7-428abc3c2be1 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:37.135913 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d4e35cd7-d630-46e9-8ca7-428abc3c2be1 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:37.136705 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d4e35cd7-d630-46e9-8ca7-428abc3c2be1 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:37.211436 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d4e35cd7-d630-46e9-8ca7-428abc3c2be1 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:37.219628 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d4e35cd7-d630-46e9-8ca7-428abc3c2be1 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:37.221235 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d4e35cd7-d630-46e9-8ca7-428abc3c2be1 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:37.223118 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d4e35cd7-d630-46e9-8ca7-428abc3c2be1 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce" status: 200 len: 1356 microversion: 2.47 time: 0.101814 Apr 16 21:25:37.234983 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2298/4787] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:37 2022] GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce => generated 1356 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:25:37.239092 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-60116574-3e36-4008-97a8-1110884ba112 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:37.242167 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f36ca70b-b24f-4e7a-a5d3-b3a3dc55a4df tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:37.243690 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f36ca70b-b24f-4e7a-a5d3-b3a3dc55a4df tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:37.248496 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-60116574-3e36-4008-97a8-1110884ba112 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352" status: 200 len: 1556 microversion: 2.1 time: 0.272390 Apr 16 21:25:37.249295 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2490/4788] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:36 2022] GET /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352 => generated 1556 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:37.250453 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f36ca70b-b24f-4e7a-a5d3-b3a3dc55a4df tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:37.250939 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f36ca70b-b24f-4e7a-a5d3-b3a3dc55a4df tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:37.251746 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f36ca70b-b24f-4e7a-a5d3-b3a3dc55a4df tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:37.252218 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f36ca70b-b24f-4e7a-a5d3-b3a3dc55a4df tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:37.265305 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6cf84615-c7c3-4ceb-b881-12ede6160701 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:37.265871 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6cf84615-c7c3-4ceb-b881-12ede6160701 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 0c30b376-2903-4058-b436-4644778f3352] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:37.272781 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6cf84615-c7c3-4ceb-b881-12ede6160701 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:37.282920 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6cf84615-c7c3-4ceb-b881-12ede6160701 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:37.282920 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6cf84615-c7c3-4ceb-b881-12ede6160701 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:37.282920 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6cf84615-c7c3-4ceb-b881-12ede6160701 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:37.345561 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-f36ca70b-b24f-4e7a-a5d3-b3a3dc55a4df tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:25:37.345966 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-f36ca70b-b24f-4e7a-a5d3-b3a3dc55a4df tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:25:37.346462 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-f36ca70b-b24f-4e7a-a5d3-b3a3dc55a4df tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:25:37.346891 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-f36ca70b-b24f-4e7a-a5d3-b3a3dc55a4df tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:25:37.347324 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-f36ca70b-b24f-4e7a-a5d3-b3a3dc55a4df tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:25:37.439672 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6cf84615-c7c3-4ceb-b881-12ede6160701 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.178285 Apr 16 21:25:37.440291 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2491/4789] 10.222.0.20 () {58 vars in 1274 bytes} [Sat Apr 16 21:25:37 2022] GET /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352/os-interface => generated 284 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:25:37.608389 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f36ca70b-b24f-4e7a-a5d3-b3a3dc55a4df tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:37.617460 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f36ca70b-b24f-4e7a-a5d3-b3a3dc55a4df tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:37.618424 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f36ca70b-b24f-4e7a-a5d3-b3a3dc55a4df tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:37.619483 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f36ca70b-b24f-4e7a-a5d3-b3a3dc55a4df tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:37.620762 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f36ca70b-b24f-4e7a-a5d3-b3a3dc55a4df tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:37.655267 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f36ca70b-b24f-4e7a-a5d3-b3a3dc55a4df tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "POST /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce/action" status: 202 len: 1078 microversion: 2.47 time: 0.418394 Apr 16 21:25:37.656062 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2299/4790] 10.222.0.20 () {62 vars in 1318 bytes} [Sat Apr 16 21:25:37 2022] POST /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce/action => generated 1078 bytes in 420 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Apr 16 21:25:37.677756 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3c4c3f2b-ae12-4b2a-8f0c-d591ed080023 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:37.678452 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3c4c3f2b-ae12-4b2a-8f0c-d591ed080023 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:37.691015 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c454519d-59ea-457b-bca5-583654b5fc6c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:37.692403 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c454519d-59ea-457b-bca5-583654b5fc6c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] [instance: 5bec80bd-63c1-45bf-a379-98f4c375f318] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:37.700076 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3c4c3f2b-ae12-4b2a-8f0c-d591ed080023 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:37.702179 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3c4c3f2b-ae12-4b2a-8f0c-d591ed080023 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:37.703099 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3c4c3f2b-ae12-4b2a-8f0c-d591ed080023 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:37.703522 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3c4c3f2b-ae12-4b2a-8f0c-d591ed080023 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:37.704650 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c454519d-59ea-457b-bca5-583654b5fc6c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:37.705125 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c454519d-59ea-457b-bca5-583654b5fc6c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:37.705923 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c454519d-59ea-457b-bca5-583654b5fc6c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:37.709062 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c454519d-59ea-457b-bca5-583654b5fc6c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:37.844606 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3c4c3f2b-ae12-4b2a-8f0c-d591ed080023 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:37.857075 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3c4c3f2b-ae12-4b2a-8f0c-d591ed080023 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:37.858729 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3c4c3f2b-ae12-4b2a-8f0c-d591ed080023 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:37.859972 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3c4c3f2b-ae12-4b2a-8f0c-d591ed080023 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce" status: 200 len: 1365 microversion: 2.47 time: 0.193089 Apr 16 21:25:37.861430 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2492/4791] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:37 2022] GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce => generated 1365 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:37.889446 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c454519d-59ea-457b-bca5-583654b5fc6c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:37.898186 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c454519d-59ea-457b-bca5-583654b5fc6c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:37.900150 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c454519d-59ea-457b-bca5-583654b5fc6c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:37.901644 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c454519d-59ea-457b-bca5-583654b5fc6c tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] 10.222.0.20 "GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318" status: 200 len: 1408 microversion: 2.54 time: 0.214510 Apr 16 21:25:37.909068 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2300/4792] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:37 2022] GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318 => generated 1408 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:25:37.983870 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-36538653-5bac-4873-9538-db64dacf51c3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:37.984863 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-36538653-5bac-4873-9538-db64dacf51c3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:37.993601 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-36538653-5bac-4873-9538-db64dacf51c3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:37.994073 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-36538653-5bac-4873-9538-db64dacf51c3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:37.994882 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-36538653-5bac-4873-9538-db64dacf51c3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:37.995335 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-36538653-5bac-4873-9538-db64dacf51c3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:38.036941 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b39f7608-4f46-4743-86ac-72155d62803b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:38.036941 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b39f7608-4f46-4743-86ac-72155d62803b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:38.047734 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b39f7608-4f46-4743-86ac-72155d62803b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:38.048278 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b39f7608-4f46-4743-86ac-72155d62803b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:38.049045 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b39f7608-4f46-4743-86ac-72155d62803b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:38.049864 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b39f7608-4f46-4743-86ac-72155d62803b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:38.218519 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-36538653-5bac-4873-9538-db64dacf51c3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:38.226956 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-36538653-5bac-4873-9538-db64dacf51c3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1510 microversion: 2.1 time: 0.247911 Apr 16 21:25:38.227724 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2493/4793] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:37 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1510 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:38.395383 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b39f7608-4f46-4743-86ac-72155d62803b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:38.403548 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b39f7608-4f46-4743-86ac-72155d62803b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1505 microversion: 2.1 time: 0.376334 Apr 16 21:25:38.404164 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2301/4794] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:38 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1505 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:38.880732 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9589e0f1-0f90-44e7-9efc-fd8af1a24f64 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:38.881745 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9589e0f1-0f90-44e7-9efc-fd8af1a24f64 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:38.888583 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9589e0f1-0f90-44e7-9efc-fd8af1a24f64 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:38.893562 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9589e0f1-0f90-44e7-9efc-fd8af1a24f64 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:38.893562 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9589e0f1-0f90-44e7-9efc-fd8af1a24f64 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:38.893562 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9589e0f1-0f90-44e7-9efc-fd8af1a24f64 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:38.921790 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7866c6cd-a925-456f-adca-5e76796d51df tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:38.922906 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7866c6cd-a925-456f-adca-5e76796d51df tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] [instance: 5bec80bd-63c1-45bf-a379-98f4c375f318] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:38.946716 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7866c6cd-a925-456f-adca-5e76796d51df tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:38.947597 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7866c6cd-a925-456f-adca-5e76796d51df tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:38.949222 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7866c6cd-a925-456f-adca-5e76796d51df tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:38.950043 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7866c6cd-a925-456f-adca-5e76796d51df tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:39.032293 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9589e0f1-0f90-44e7-9efc-fd8af1a24f64 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:39.042958 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9589e0f1-0f90-44e7-9efc-fd8af1a24f64 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:39.044707 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9589e0f1-0f90-44e7-9efc-fd8af1a24f64 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:39.046325 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9589e0f1-0f90-44e7-9efc-fd8af1a24f64 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce" status: 200 len: 1365 microversion: 2.47 time: 0.171338 Apr 16 21:25:39.047274 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2494/4795] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:38 2022] GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:39.053101 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-4e9f1243-2a10-4627-90f2-8e841ea5a3e0 req-ec0f24bb-aa5d-4465-a0ae-365777116bbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aa577ae-2715-44de-93bb-d02db79533fb", "name": "network-vif-unplugged", "status": "completed", "tag": "c79de46c-1a6f-418e-b267-0c88759e0458"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:39.064235 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-4e9f1243-2a10-4627-90f2-8e841ea5a3e0 req-ec0f24bb-aa5d-4465-a0ae-365777116bbc service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:39.064597 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-4e9f1243-2a10-4627-90f2-8e841ea5a3e0 req-ec0f24bb-aa5d-4465-a0ae-365777116bbc service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:39.077348 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-4e9f1243-2a10-4627-90f2-8e841ea5a3e0 req-ec0f24bb-aa5d-4465-a0ae-365777116bbc service nova] Creating event network-vif-unplugged:c79de46c-1a6f-418e-b267-0c88759e0458 for instance 6aa577ae-2715-44de-93bb-d02db79533fb on nch1-master-1 Apr 16 21:25:39.083000 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-4e9f1243-2a10-4627-90f2-8e841ea5a3e0 req-ec0f24bb-aa5d-4465-a0ae-365777116bbc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034381 Apr 16 21:25:39.083860 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2495/4796] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:25:39.093680 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-4e54e61d-77fb-4274-841e-842ed4be81c1 req-2a88538d-78b6-495b-a53d-f7cdc38ef822 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c30b376-2903-4058-b436-4644778f3352", "tag": "89aa2008-483c-4c5a-85b1-9f5656576e5b"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:39.098112 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-4e54e61d-77fb-4274-841e-842ed4be81c1 req-2a88538d-78b6-495b-a53d-f7cdc38ef822 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:39.098595 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-4e54e61d-77fb-4274-841e-842ed4be81c1 req-2a88538d-78b6-495b-a53d-f7cdc38ef822 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:39.120616 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-4e54e61d-77fb-4274-841e-842ed4be81c1 req-2a88538d-78b6-495b-a53d-f7cdc38ef822 service nova] Creating event network-changed:89aa2008-483c-4c5a-85b1-9f5656576e5b for instance 0c30b376-2903-4058-b436-4644778f3352 on nch1-master-1 Apr 16 21:25:39.130629 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-4e54e61d-77fb-4274-841e-842ed4be81c1 req-2a88538d-78b6-495b-a53d-f7cdc38ef822 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045006 Apr 16 21:25:39.132769 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2496/4797] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:25:39.148895 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7866c6cd-a925-456f-adca-5e76796d51df tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:39.164679 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7866c6cd-a925-456f-adca-5e76796d51df tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:39.168631 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7866c6cd-a925-456f-adca-5e76796d51df tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:39.168631 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7866c6cd-a925-456f-adca-5e76796d51df tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] 10.222.0.20 "GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318" status: 200 len: 1408 microversion: 2.54 time: 0.250610 Apr 16 21:25:39.169003 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2302/4798] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:38 2022] GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318 => generated 1408 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:39.251359 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-81e39781-8d07-4443-9c50-01a3d25b0ec2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:39.252064 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-81e39781-8d07-4443-9c50-01a3d25b0ec2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:39.261705 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-81e39781-8d07-4443-9c50-01a3d25b0ec2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:39.262172 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-81e39781-8d07-4443-9c50-01a3d25b0ec2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:39.262978 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-81e39781-8d07-4443-9c50-01a3d25b0ec2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:39.263961 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-81e39781-8d07-4443-9c50-01a3d25b0ec2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:39.425645 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-75b4a602-b92c-4cb7-aa81-a441fb0304da tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:39.427215 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-75b4a602-b92c-4cb7-aa81-a441fb0304da tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:39.434523 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-75b4a602-b92c-4cb7-aa81-a441fb0304da tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:39.435314 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-75b4a602-b92c-4cb7-aa81-a441fb0304da tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:39.436855 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-75b4a602-b92c-4cb7-aa81-a441fb0304da tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:39.437490 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-75b4a602-b92c-4cb7-aa81-a441fb0304da tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:39.454818 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-81e39781-8d07-4443-9c50-01a3d25b0ec2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:39.465022 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-81e39781-8d07-4443-9c50-01a3d25b0ec2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1510 microversion: 2.1 time: 0.223085 Apr 16 21:25:39.475802 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2497/4799] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:39 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1510 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:39.984718 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-75b4a602-b92c-4cb7-aa81-a441fb0304da tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:39.992319 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-75b4a602-b92c-4cb7-aa81-a441fb0304da tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 200 len: 1508 microversion: 2.1 time: 0.574574 Apr 16 21:25:39.993014 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2303/4800] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:39 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 1508 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:25:40.014290 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7daedf3a-c21c-40ec-aa7d-ac9e4e74dfd3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:40.014845 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7daedf3a-c21c-40ec-aa7d-ac9e4e74dfd3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:40.022603 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7daedf3a-c21c-40ec-aa7d-ac9e4e74dfd3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:40.023476 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7daedf3a-c21c-40ec-aa7d-ac9e4e74dfd3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:40.023984 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7daedf3a-c21c-40ec-aa7d-ac9e4e74dfd3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:40.024334 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7daedf3a-c21c-40ec-aa7d-ac9e4e74dfd3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:40.052800 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7daedf3a-c21c-40ec-aa7d-ac9e4e74dfd3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:25:40.065276 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ad88ce09-5314-4770-a663-6f356fe1ae01 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:40.065894 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ad88ce09-5314-4770-a663-6f356fe1ae01 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:40.069485 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.compute.api [None req-7daedf3a-c21c-40ec-aa7d-ac9e4e74dfd3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Working on deleting snapshot d20411ca-3acd-4c26-bba4-f0191d9b86e1 from shelved instance... Apr 16 21:25:40.072666 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ad88ce09-5314-4770-a663-6f356fe1ae01 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:40.073296 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ad88ce09-5314-4770-a663-6f356fe1ae01 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:40.074448 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ad88ce09-5314-4770-a663-6f356fe1ae01 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:40.075023 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ad88ce09-5314-4770-a663-6f356fe1ae01 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:40.174860 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ad88ce09-5314-4770-a663-6f356fe1ae01 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:40.187692 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ad88ce09-5314-4770-a663-6f356fe1ae01 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:40.190403 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ad88ce09-5314-4770-a663-6f356fe1ae01 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:40.193034 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ad88ce09-5314-4770-a663-6f356fe1ae01 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce" status: 200 len: 1365 microversion: 2.47 time: 0.131470 Apr 16 21:25:40.209927 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2304/4801] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:40 2022] GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:40.227622 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-20c9100e-9abe-4148-a31b-145ceda913db tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:40.228331 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-20c9100e-9abe-4148-a31b-145ceda913db tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] [instance: 5bec80bd-63c1-45bf-a379-98f4c375f318] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:40.243719 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-20c9100e-9abe-4148-a31b-145ceda913db tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:40.244226 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-20c9100e-9abe-4148-a31b-145ceda913db tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:40.248513 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-20c9100e-9abe-4148-a31b-145ceda913db tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:40.248513 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-20c9100e-9abe-4148-a31b-145ceda913db tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:40.329828 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-20c9100e-9abe-4148-a31b-145ceda913db tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:40.341213 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-20c9100e-9abe-4148-a31b-145ceda913db tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:40.343714 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-20c9100e-9abe-4148-a31b-145ceda913db tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:40.352580 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-20c9100e-9abe-4148-a31b-145ceda913db tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] 10.222.0.20 "GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318" status: 200 len: 1408 microversion: 2.54 time: 0.134626 Apr 16 21:25:40.352580 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2305/4802] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:40 2022] GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318 => generated 1408 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:40.483368 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-69d6a576-618a-4b4e-9845-6c14c06016e7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:40.484270 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-69d6a576-618a-4b4e-9845-6c14c06016e7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:40.491452 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-69d6a576-618a-4b4e-9845-6c14c06016e7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:40.491948 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-69d6a576-618a-4b4e-9845-6c14c06016e7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:40.492873 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-69d6a576-618a-4b4e-9845-6c14c06016e7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:40.493380 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-69d6a576-618a-4b4e-9845-6c14c06016e7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:40.625268 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-69d6a576-618a-4b4e-9845-6c14c06016e7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:40.633369 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-69d6a576-618a-4b4e-9845-6c14c06016e7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1510 microversion: 2.1 time: 0.154202 Apr 16 21:25:40.633952 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2306/4803] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:40 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:25:41.230662 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-34bf594e-687c-4cc4-b915-d2ff40b27616 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:41.231339 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-34bf594e-687c-4cc4-b915-d2ff40b27616 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:41.238977 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-34bf594e-687c-4cc4-b915-d2ff40b27616 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:41.239450 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-34bf594e-687c-4cc4-b915-d2ff40b27616 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:41.240294 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-34bf594e-687c-4cc4-b915-d2ff40b27616 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:41.240752 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-34bf594e-687c-4cc4-b915-d2ff40b27616 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:41.306381 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-34bf594e-687c-4cc4-b915-d2ff40b27616 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:41.314519 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-34bf594e-687c-4cc4-b915-d2ff40b27616 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:41.316037 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-34bf594e-687c-4cc4-b915-d2ff40b27616 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:41.317405 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-34bf594e-687c-4cc4-b915-d2ff40b27616 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce" status: 200 len: 1365 microversion: 2.47 time: 0.090706 Apr 16 21:25:41.318200 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2307/4804] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:41 2022] GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce => generated 1365 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:25:41.364819 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3076dbc2-e6aa-4955-9142-774f25805756 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:41.365441 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3076dbc2-e6aa-4955-9142-774f25805756 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] [instance: 5bec80bd-63c1-45bf-a379-98f4c375f318] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:41.371421 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3076dbc2-e6aa-4955-9142-774f25805756 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:41.371884 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3076dbc2-e6aa-4955-9142-774f25805756 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:41.372704 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3076dbc2-e6aa-4955-9142-774f25805756 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:41.373166 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3076dbc2-e6aa-4955-9142-774f25805756 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:41.439246 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3076dbc2-e6aa-4955-9142-774f25805756 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:41.445134 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3076dbc2-e6aa-4955-9142-774f25805756 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:41.446667 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3076dbc2-e6aa-4955-9142-774f25805756 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:41.447869 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3076dbc2-e6aa-4955-9142-774f25805756 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] 10.222.0.20 "GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318" status: 200 len: 1408 microversion: 2.54 time: 0.087064 Apr 16 21:25:41.448548 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2308/4805] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:41 2022] GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318 => generated 1408 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:25:41.650803 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8fd28892-a25d-4b2d-b66b-523829b62c7f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:41.652093 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8fd28892-a25d-4b2d-b66b-523829b62c7f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:41.659109 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8fd28892-a25d-4b2d-b66b-523829b62c7f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:41.659581 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8fd28892-a25d-4b2d-b66b-523829b62c7f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:41.660427 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8fd28892-a25d-4b2d-b66b-523829b62c7f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:41.660905 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8fd28892-a25d-4b2d-b66b-523829b62c7f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:41.689639 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7daedf3a-c21c-40ec-aa7d-ac9e4e74dfd3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Doing local delete in cell f8d025b3-2d37-4d38-9ad5-4c1987181ef2(cell1) {{(pid=137408) _delete /opt/stack/nova/nova/compute/api.py:2489}} Apr 16 21:25:41.691723 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7daedf3a-c21c-40ec-aa7d-ac9e4e74dfd3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:41.692210 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7daedf3a-c21c-40ec-aa7d-ac9e4e74dfd3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:41.693098 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.compute.api [None req-7daedf3a-c21c-40ec-aa7d-ac9e4e74dfd3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Apr 16 21:25:41.701464 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-7daedf3a-c21c-40ec-aa7d-ac9e4e74dfd3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] deallocate_for_instance() {{(pid=137408) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1789}} Apr 16 21:25:41.809178 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8fd28892-a25d-4b2d-b66b-523829b62c7f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:41.816861 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8fd28892-a25d-4b2d-b66b-523829b62c7f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1510 microversion: 2.1 time: 0.170571 Apr 16 21:25:41.817441 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2309/4806] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:41 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1510 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:42.291000 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-0bb4ada8-c125-4c60-8adb-d2b426ef8da0 req-83094c69-164b-45b3-9feb-8e2f3f5fa3b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6aa577ae-2715-44de-93bb-d02db79533fb", "name": "network-vif-deleted", "tag": "c79de46c-1a6f-418e-b267-0c88759e0458"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:42.302206 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-0bb4ada8-c125-4c60-8adb-d2b426ef8da0 req-83094c69-164b-45b3-9feb-8e2f3f5fa3b3 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:42.307708 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-0bb4ada8-c125-4c60-8adb-d2b426ef8da0 req-83094c69-164b-45b3-9feb-8e2f3f5fa3b3 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:42.317867 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.compute.server_external_events [req-0bb4ada8-c125-4c60-8adb-d2b426ef8da0 req-83094c69-164b-45b3-9feb-8e2f3f5fa3b3 service nova] Unable to find a host for instance 6aa577ae-2715-44de-93bb-d02db79533fb. Dropping event network-vif-deleted {{(pid=137409) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Apr 16 21:25:42.318837 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-0bb4ada8-c125-4c60-8adb-d2b426ef8da0 req-83094c69-164b-45b3-9feb-8e2f3f5fa3b3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.032251 Apr 16 21:25:42.319475 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2310/4807] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Apr 16 21:25:42.337475 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1dc0e7a6-f02c-47dd-8227-02d8b253c146 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:42.338107 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1dc0e7a6-f02c-47dd-8227-02d8b253c146 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:42.344324 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1dc0e7a6-f02c-47dd-8227-02d8b253c146 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:42.344797 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1dc0e7a6-f02c-47dd-8227-02d8b253c146 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:42.345623 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1dc0e7a6-f02c-47dd-8227-02d8b253c146 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:42.346074 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1dc0e7a6-f02c-47dd-8227-02d8b253c146 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:42.355629 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-7daedf3a-c21c-40ec-aa7d-ac9e4e74dfd3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Updating instance_info_cache with network_info: [] {{(pid=137408) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Apr 16 21:25:42.434291 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1dc0e7a6-f02c-47dd-8227-02d8b253c146 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:42.442903 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1dc0e7a6-f02c-47dd-8227-02d8b253c146 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:42.444578 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1dc0e7a6-f02c-47dd-8227-02d8b253c146 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:42.445776 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1dc0e7a6-f02c-47dd-8227-02d8b253c146 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce" status: 200 len: 1365 microversion: 2.47 time: 0.112841 Apr 16 21:25:42.446350 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2311/4808] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:42 2022] GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce => generated 1365 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:25:42.466824 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f5677902-af14-40c6-a026-faa3ba6db404 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:42.467686 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f5677902-af14-40c6-a026-faa3ba6db404 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] [instance: 5bec80bd-63c1-45bf-a379-98f4c375f318] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:42.474545 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f5677902-af14-40c6-a026-faa3ba6db404 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:42.475027 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f5677902-af14-40c6-a026-faa3ba6db404 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:42.475810 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f5677902-af14-40c6-a026-faa3ba6db404 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:42.476290 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f5677902-af14-40c6-a026-faa3ba6db404 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:42.540052 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f5677902-af14-40c6-a026-faa3ba6db404 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:42.548194 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f5677902-af14-40c6-a026-faa3ba6db404 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:42.549753 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f5677902-af14-40c6-a026-faa3ba6db404 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:42.550968 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f5677902-af14-40c6-a026-faa3ba6db404 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] 10.222.0.20 "GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318" status: 200 len: 1408 microversion: 2.54 time: 0.088002 Apr 16 21:25:42.551542 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2312/4809] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:42 2022] GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318 => generated 1408 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:25:42.833355 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2045cb1e-bcad-45fd-bc09-f616b28768f9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:42.834102 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2045cb1e-bcad-45fd-bc09-f616b28768f9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:42.849357 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2045cb1e-bcad-45fd-bc09-f616b28768f9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:42.849357 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2045cb1e-bcad-45fd-bc09-f616b28768f9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:42.849357 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2045cb1e-bcad-45fd-bc09-f616b28768f9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:42.849357 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2045cb1e-bcad-45fd-bc09-f616b28768f9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:42.987247 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2045cb1e-bcad-45fd-bc09-f616b28768f9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:42.995354 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2045cb1e-bcad-45fd-bc09-f616b28768f9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1510 microversion: 2.1 time: 0.165970 Apr 16 21:25:42.996152 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2313/4810] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:42 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1510 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:25:43.010619 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7daedf3a-c21c-40ec-aa7d-ac9e4e74dfd3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 204 len: 0 microversion: 2.1 time: 3.000314 Apr 16 21:25:43.014451 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2498/4811] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:25:40 2022] DELETE /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 0 bytes in 3002 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:25:43.021946 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3411d151-4a52-4f64-8a18-62e6c0cbdab3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:43.022516 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3411d151-4a52-4f64-8a18-62e6c0cbdab3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:43.028861 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3411d151-4a52-4f64-8a18-62e6c0cbdab3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:43.029403 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3411d151-4a52-4f64-8a18-62e6c0cbdab3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:43.030284 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3411d151-4a52-4f64-8a18-62e6c0cbdab3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:43.030851 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3411d151-4a52-4f64-8a18-62e6c0cbdab3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:43.045165 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-3411d151-4a52-4f64-8a18-62e6c0cbdab3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] HTTP exception thrown: Instance 6aa577ae-2715-44de-93bb-d02db79533fb could not be found. Apr 16 21:25:43.052752 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3411d151-4a52-4f64-8a18-62e6c0cbdab3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Returning 404 to user: Instance 6aa577ae-2715-44de-93bb-d02db79533fb could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:25:43.052752 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3411d151-4a52-4f64-8a18-62e6c0cbdab3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 404 len: 111 microversion: 2.1 time: 0.029427 Apr 16 21:25:43.052752 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2314/4812] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:43 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:25:43.158824 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7fdbfd95-5d1f-4ab0-8ae1-7984120dfc30 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-757353990", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "5fb5cf29-8796-41a2-8375-e8062a5911ad"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:43.211276 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-7fdbfd95-5d1f-4ab0-8ae1-7984120dfc30 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] validate_networks() for [('5fb5cf29-8796-41a2-8375-e8062a5911ad', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:25:43.465020 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-42c41b39-d6d5-40b7-b46f-49461e853d86 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:43.465679 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-42c41b39-d6d5-40b7-b46f-49461e853d86 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:43.473325 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-42c41b39-d6d5-40b7-b46f-49461e853d86 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:43.473800 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-42c41b39-d6d5-40b7-b46f-49461e853d86 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:43.474589 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-42c41b39-d6d5-40b7-b46f-49461e853d86 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:43.475341 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-42c41b39-d6d5-40b7-b46f-49461e853d86 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:43.551765 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-42c41b39-d6d5-40b7-b46f-49461e853d86 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:43.560069 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-42c41b39-d6d5-40b7-b46f-49461e853d86 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:43.562059 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-42c41b39-d6d5-40b7-b46f-49461e853d86 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:43.562862 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-42c41b39-d6d5-40b7-b46f-49461e853d86 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce" status: 200 len: 1365 microversion: 2.47 time: 0.102199 Apr 16 21:25:43.564656 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2315/4813] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:43 2022] GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce => generated 1365 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:43.578580 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ea5f4f4c-404d-4319-b062-3a2f167eb26a tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:43.579202 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ea5f4f4c-404d-4319-b062-3a2f167eb26a tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] [instance: 5bec80bd-63c1-45bf-a379-98f4c375f318] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:43.586305 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ea5f4f4c-404d-4319-b062-3a2f167eb26a tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:43.586772 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ea5f4f4c-404d-4319-b062-3a2f167eb26a tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:43.587569 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ea5f4f4c-404d-4319-b062-3a2f167eb26a tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:43.588021 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ea5f4f4c-404d-4319-b062-3a2f167eb26a tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:43.597211 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-7fdbfd95-5d1f-4ab0-8ae1-7984120dfc30 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:25:43.599245 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-7fdbfd95-5d1f-4ab0-8ae1-7984120dfc30 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:25:43.600496 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-7fdbfd95-5d1f-4ab0-8ae1-7984120dfc30 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:25:43.601264 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-7fdbfd95-5d1f-4ab0-8ae1-7984120dfc30 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:25:43.602091 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-7fdbfd95-5d1f-4ab0-8ae1-7984120dfc30 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:25:43.614510 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7fdbfd95-5d1f-4ab0-8ae1-7984120dfc30 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:43.615410 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7fdbfd95-5d1f-4ab0-8ae1-7984120dfc30 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:43.617011 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7fdbfd95-5d1f-4ab0-8ae1-7984120dfc30 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:43.621810 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7fdbfd95-5d1f-4ab0-8ae1-7984120dfc30 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:43.635699 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-7fdbfd95-5d1f-4ab0-8ae1-7984120dfc30 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Getting quotas for project 7caf6e59a47149a68cae6224fb2856e7. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:25:43.641197 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-7fdbfd95-5d1f-4ab0-8ae1-7984120dfc30 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Getting quotas for user e069f136dcb344b197f58ba47722f4d5 and project 7caf6e59a47149a68cae6224fb2856e7. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:25:43.652192 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ea5f4f4c-404d-4319-b062-3a2f167eb26a tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:43.654831 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7fdbfd95-5d1f-4ab0-8ae1-7984120dfc30 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:25:43.657501 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7fdbfd95-5d1f-4ab0-8ae1-7984120dfc30 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:25:43.661715 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ea5f4f4c-404d-4319-b062-3a2f167eb26a tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:43.662504 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ea5f4f4c-404d-4319-b062-3a2f167eb26a tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:43.663695 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ea5f4f4c-404d-4319-b062-3a2f167eb26a tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] 10.222.0.20 "GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318" status: 200 len: 1408 microversion: 2.54 time: 0.089005 Apr 16 21:25:43.664281 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2316/4814] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:43 2022] GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318 => generated 1408 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:43.774565 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7fdbfd95-5d1f-4ab0-8ae1-7984120dfc30 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.620690 Apr 16 21:25:43.775522 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2499/4815] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:25:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:25:43.786601 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cff26423-db7d-4d8b-9161-4995c47c2cf8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:43.787316 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-cff26423-db7d-4d8b-9161-4995c47c2cf8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:43.875276 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cff26423-db7d-4d8b-9161-4995c47c2cf8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:43.912086 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cff26423-db7d-4d8b-9161-4995c47c2cf8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 200 len: 1214 microversion: 2.1 time: 0.130021 Apr 16 21:25:43.923445 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2317/4816] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:43 2022] GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 1214 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:44.013757 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-dca35923-c3d6-4d26-b8aa-3802fcbaeac7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:44.014518 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-dca35923-c3d6-4d26-b8aa-3802fcbaeac7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:44.022842 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dca35923-c3d6-4d26-b8aa-3802fcbaeac7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:44.023313 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dca35923-c3d6-4d26-b8aa-3802fcbaeac7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:44.024350 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dca35923-c3d6-4d26-b8aa-3802fcbaeac7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:44.026237 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dca35923-c3d6-4d26-b8aa-3802fcbaeac7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:44.179713 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-dca35923-c3d6-4d26-b8aa-3802fcbaeac7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:44.188269 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-dca35923-c3d6-4d26-b8aa-3802fcbaeac7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1510 microversion: 2.1 time: 0.178981 Apr 16 21:25:44.189128 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2500/4817] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:44 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1510 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:44.580828 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2a7e2844-10f4-4012-8e20-319826b9fc55 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:44.581449 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2a7e2844-10f4-4012-8e20-319826b9fc55 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:44.588572 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2a7e2844-10f4-4012-8e20-319826b9fc55 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:44.589033 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2a7e2844-10f4-4012-8e20-319826b9fc55 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:44.589836 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2a7e2844-10f4-4012-8e20-319826b9fc55 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:44.590280 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2a7e2844-10f4-4012-8e20-319826b9fc55 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:44.663949 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2a7e2844-10f4-4012-8e20-319826b9fc55 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:44.672679 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2a7e2844-10f4-4012-8e20-319826b9fc55 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:44.674477 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2a7e2844-10f4-4012-8e20-319826b9fc55 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:44.675852 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2a7e2844-10f4-4012-8e20-319826b9fc55 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce" status: 200 len: 1365 microversion: 2.47 time: 0.099146 Apr 16 21:25:44.677026 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2318/4818] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:44 2022] GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce => generated 1365 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:44.682775 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-684265b6-abbe-4769-9a73-ea9af05c654f tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:44.683597 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-684265b6-abbe-4769-9a73-ea9af05c654f tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] [instance: 5bec80bd-63c1-45bf-a379-98f4c375f318] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:44.694071 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-684265b6-abbe-4769-9a73-ea9af05c654f tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:44.694541 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-684265b6-abbe-4769-9a73-ea9af05c654f tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:44.695336 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-684265b6-abbe-4769-9a73-ea9af05c654f tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:44.695821 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-684265b6-abbe-4769-9a73-ea9af05c654f tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:44.762916 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-684265b6-abbe-4769-9a73-ea9af05c654f tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:44.771796 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-684265b6-abbe-4769-9a73-ea9af05c654f tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:44.773355 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-684265b6-abbe-4769-9a73-ea9af05c654f tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:44.774539 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-684265b6-abbe-4769-9a73-ea9af05c654f tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] 10.222.0.20 "GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318" status: 200 len: 1408 microversion: 2.54 time: 0.095879 Apr 16 21:25:44.775106 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2501/4819] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:44 2022] GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318 => generated 1408 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:44.939480 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-957dcc70-a0d4-41ce-a48b-b5de8e8fd0fa tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:44.940364 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-957dcc70-a0d4-41ce-a48b-b5de8e8fd0fa tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:44.946624 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-957dcc70-a0d4-41ce-a48b-b5de8e8fd0fa tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:44.947133 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-957dcc70-a0d4-41ce-a48b-b5de8e8fd0fa tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:44.947954 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-957dcc70-a0d4-41ce-a48b-b5de8e8fd0fa tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:44.948559 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-957dcc70-a0d4-41ce-a48b-b5de8e8fd0fa tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:45.013097 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-957dcc70-a0d4-41ce-a48b-b5de8e8fd0fa tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:45.021780 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-957dcc70-a0d4-41ce-a48b-b5de8e8fd0fa tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 200 len: 1218 microversion: 2.1 time: 0.086435 Apr 16 21:25:45.022361 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2319/4820] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:44 2022] GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:45.206103 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0ca52cd8-9f97-4316-b83a-60c41eccfc6e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:45.207283 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0ca52cd8-9f97-4316-b83a-60c41eccfc6e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:45.214120 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0ca52cd8-9f97-4316-b83a-60c41eccfc6e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:45.214579 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0ca52cd8-9f97-4316-b83a-60c41eccfc6e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:45.215349 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0ca52cd8-9f97-4316-b83a-60c41eccfc6e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:45.215792 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0ca52cd8-9f97-4316-b83a-60c41eccfc6e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:45.346086 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0ca52cd8-9f97-4316-b83a-60c41eccfc6e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:45.354288 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0ca52cd8-9f97-4316-b83a-60c41eccfc6e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1510 microversion: 2.1 time: 0.152347 Apr 16 21:25:45.354856 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2502/4821] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:45 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1510 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:45.697427 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-edb98984-a54a-4a2a-806d-5e258572a9bd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:45.698806 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-edb98984-a54a-4a2a-806d-5e258572a9bd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:45.705479 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-edb98984-a54a-4a2a-806d-5e258572a9bd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:45.706338 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-edb98984-a54a-4a2a-806d-5e258572a9bd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:45.708072 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-edb98984-a54a-4a2a-806d-5e258572a9bd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:45.708743 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-edb98984-a54a-4a2a-806d-5e258572a9bd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:45.772512 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-edb98984-a54a-4a2a-806d-5e258572a9bd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:45.780955 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-edb98984-a54a-4a2a-806d-5e258572a9bd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:45.782580 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-edb98984-a54a-4a2a-806d-5e258572a9bd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:45.784027 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-edb98984-a54a-4a2a-806d-5e258572a9bd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce" status: 200 len: 1365 microversion: 2.47 time: 0.090565 Apr 16 21:25:45.784626 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2320/4822] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:45 2022] GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce => generated 1365 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:45.794051 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a0866932-0453-412c-b635-b72587e25163 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:45.794672 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a0866932-0453-412c-b635-b72587e25163 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] [instance: 5bec80bd-63c1-45bf-a379-98f4c375f318] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:45.801179 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a0866932-0453-412c-b635-b72587e25163 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:45.801639 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a0866932-0453-412c-b635-b72587e25163 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:45.802416 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a0866932-0453-412c-b635-b72587e25163 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:45.802855 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a0866932-0453-412c-b635-b72587e25163 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:45.884911 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a0866932-0453-412c-b635-b72587e25163 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:45.893235 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a0866932-0453-412c-b635-b72587e25163 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:45.895315 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a0866932-0453-412c-b635-b72587e25163 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:45.898488 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a0866932-0453-412c-b635-b72587e25163 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] 10.222.0.20 "GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318" status: 200 len: 1408 microversion: 2.54 time: 0.106312 Apr 16 21:25:45.898488 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2503/4823] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:45 2022] GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318 => generated 1408 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:46.039209 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c98dcb51-d945-405b-a880-b7d6c1a27e22 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:46.039847 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c98dcb51-d945-405b-a880-b7d6c1a27e22 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:46.045817 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c98dcb51-d945-405b-a880-b7d6c1a27e22 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:46.046274 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c98dcb51-d945-405b-a880-b7d6c1a27e22 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:46.047045 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c98dcb51-d945-405b-a880-b7d6c1a27e22 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:46.047491 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c98dcb51-d945-405b-a880-b7d6c1a27e22 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:46.123218 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c98dcb51-d945-405b-a880-b7d6c1a27e22 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:46.131546 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c98dcb51-d945-405b-a880-b7d6c1a27e22 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 200 len: 1210 microversion: 2.1 time: 0.096357 Apr 16 21:25:46.132121 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2321/4824] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:46 2022] GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 1210 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:46.371243 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-898304cc-6b9e-4716-b4da-497c3f5b70fb tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:46.371975 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-898304cc-6b9e-4716-b4da-497c3f5b70fb tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:46.380746 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-898304cc-6b9e-4716-b4da-497c3f5b70fb tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:46.381224 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-898304cc-6b9e-4716-b4da-497c3f5b70fb tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:46.382052 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-898304cc-6b9e-4716-b4da-497c3f5b70fb tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:46.382507 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-898304cc-6b9e-4716-b4da-497c3f5b70fb tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:46.534332 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-898304cc-6b9e-4716-b4da-497c3f5b70fb tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:46.542906 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-898304cc-6b9e-4716-b4da-497c3f5b70fb tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1510 microversion: 2.1 time: 0.175583 Apr 16 21:25:46.543546 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2504/4825] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:46 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1510 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:25:46.803320 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e9d0cb5c-cc4f-46b7-a933-2255858efec5 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:46.803948 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e9d0cb5c-cc4f-46b7-a933-2255858efec5 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:46.811363 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e9d0cb5c-cc4f-46b7-a933-2255858efec5 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:46.811837 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e9d0cb5c-cc4f-46b7-a933-2255858efec5 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:46.812676 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e9d0cb5c-cc4f-46b7-a933-2255858efec5 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:46.813368 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e9d0cb5c-cc4f-46b7-a933-2255858efec5 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:46.885117 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e9d0cb5c-cc4f-46b7-a933-2255858efec5 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:46.893324 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e9d0cb5c-cc4f-46b7-a933-2255858efec5 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:46.895545 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e9d0cb5c-cc4f-46b7-a933-2255858efec5 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:46.896786 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e9d0cb5c-cc4f-46b7-a933-2255858efec5 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce" status: 200 len: 1365 microversion: 2.47 time: 0.097693 Apr 16 21:25:46.897350 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2322/4826] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:46 2022] GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce => generated 1365 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:46.914811 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4b4d1b1a-6f4a-4b75-bfaa-27a3191b94d7 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:46.915658 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4b4d1b1a-6f4a-4b75-bfaa-27a3191b94d7 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] [instance: 5bec80bd-63c1-45bf-a379-98f4c375f318] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:46.921600 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4b4d1b1a-6f4a-4b75-bfaa-27a3191b94d7 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:46.922058 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4b4d1b1a-6f4a-4b75-bfaa-27a3191b94d7 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:46.922823 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4b4d1b1a-6f4a-4b75-bfaa-27a3191b94d7 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:46.923258 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4b4d1b1a-6f4a-4b75-bfaa-27a3191b94d7 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:46.989686 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4b4d1b1a-6f4a-4b75-bfaa-27a3191b94d7 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:46.997643 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4b4d1b1a-6f4a-4b75-bfaa-27a3191b94d7 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:46.999203 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4b4d1b1a-6f4a-4b75-bfaa-27a3191b94d7 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:47.000389 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4b4d1b1a-6f4a-4b75-bfaa-27a3191b94d7 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] 10.222.0.20 "GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318" status: 200 len: 1414 microversion: 2.54 time: 0.089405 Apr 16 21:25:47.000949 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2505/4827] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:46 2022] GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318 => generated 1414 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:47.149892 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2e8d1663-1052-4cf3-ac46-ae0c733b2c2c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:47.150552 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2e8d1663-1052-4cf3-ac46-ae0c733b2c2c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:47.156968 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2e8d1663-1052-4cf3-ac46-ae0c733b2c2c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:47.157525 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2e8d1663-1052-4cf3-ac46-ae0c733b2c2c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:47.158317 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2e8d1663-1052-4cf3-ac46-ae0c733b2c2c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:47.158927 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2e8d1663-1052-4cf3-ac46-ae0c733b2c2c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:47.230504 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2e8d1663-1052-4cf3-ac46-ae0c733b2c2c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:47.238634 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2e8d1663-1052-4cf3-ac46-ae0c733b2c2c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 200 len: 1274 microversion: 2.1 time: 0.092299 Apr 16 21:25:47.239228 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2323/4828] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:47 2022] GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 1274 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:47.560075 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-31b13344-e949-4c11-bf3a-1cb7a7d925b3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:47.560826 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-31b13344-e949-4c11-bf3a-1cb7a7d925b3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:47.568465 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-31b13344-e949-4c11-bf3a-1cb7a7d925b3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:47.568971 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-31b13344-e949-4c11-bf3a-1cb7a7d925b3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:47.569723 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-31b13344-e949-4c11-bf3a-1cb7a7d925b3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:47.570161 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-31b13344-e949-4c11-bf3a-1cb7a7d925b3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:47.702435 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-31b13344-e949-4c11-bf3a-1cb7a7d925b3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:47.710493 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-31b13344-e949-4c11-bf3a-1cb7a7d925b3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1510 microversion: 2.1 time: 0.154603 Apr 16 21:25:47.711079 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2506/4829] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:47 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:47.917187 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b151ad7a-afc5-42c5-85f2-ff581e1c8e70 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:47.918385 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b151ad7a-afc5-42c5-85f2-ff581e1c8e70 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:47.925298 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b151ad7a-afc5-42c5-85f2-ff581e1c8e70 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:47.926304 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b151ad7a-afc5-42c5-85f2-ff581e1c8e70 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:47.927100 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b151ad7a-afc5-42c5-85f2-ff581e1c8e70 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:47.927558 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b151ad7a-afc5-42c5-85f2-ff581e1c8e70 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:48.003836 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b151ad7a-afc5-42c5-85f2-ff581e1c8e70 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:48.014788 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b151ad7a-afc5-42c5-85f2-ff581e1c8e70 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:48.018266 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b151ad7a-afc5-42c5-85f2-ff581e1c8e70 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:48.028359 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b151ad7a-afc5-42c5-85f2-ff581e1c8e70 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce" status: 200 len: 1365 microversion: 2.47 time: 0.107318 Apr 16 21:25:48.028511 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-57231997-bfe1-46db-9c4c-52c666ef0802 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:48.028511 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-57231997-bfe1-46db-9c4c-52c666ef0802 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] [instance: 5bec80bd-63c1-45bf-a379-98f4c375f318] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:48.028511 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-57231997-bfe1-46db-9c4c-52c666ef0802 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:48.028902 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-57231997-bfe1-46db-9c4c-52c666ef0802 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:48.029478 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-57231997-bfe1-46db-9c4c-52c666ef0802 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:48.029658 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2324/4830] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:47 2022] GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce => generated 1365 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:48.030081 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-57231997-bfe1-46db-9c4c-52c666ef0802 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:48.104297 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-57231997-bfe1-46db-9c4c-52c666ef0802 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:48.113546 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-57231997-bfe1-46db-9c4c-52c666ef0802 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:48.118341 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-57231997-bfe1-46db-9c4c-52c666ef0802 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:48.118341 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-57231997-bfe1-46db-9c4c-52c666ef0802 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] 10.222.0.20 "GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318" status: 200 len: 1414 microversion: 2.54 time: 0.100887 Apr 16 21:25:48.118341 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2507/4831] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:48 2022] GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318 => generated 1414 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:48.259730 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ccfacb1a-2f82-4dfc-8743-b8fd5161137c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:48.260464 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ccfacb1a-2f82-4dfc-8743-b8fd5161137c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:48.266611 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ccfacb1a-2f82-4dfc-8743-b8fd5161137c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:48.267070 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ccfacb1a-2f82-4dfc-8743-b8fd5161137c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:48.267848 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ccfacb1a-2f82-4dfc-8743-b8fd5161137c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:48.268344 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ccfacb1a-2f82-4dfc-8743-b8fd5161137c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:48.356117 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ccfacb1a-2f82-4dfc-8743-b8fd5161137c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:48.365331 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ccfacb1a-2f82-4dfc-8743-b8fd5161137c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 200 len: 1274 microversion: 2.1 time: 0.109354 Apr 16 21:25:48.366046 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2325/4832] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:48 2022] GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 1274 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:25:48.728526 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3907e81d-3e70-49ee-a8b4-15d6f6154e92 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:48.729170 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3907e81d-3e70-49ee-a8b4-15d6f6154e92 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:48.736913 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3907e81d-3e70-49ee-a8b4-15d6f6154e92 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:48.738644 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3907e81d-3e70-49ee-a8b4-15d6f6154e92 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:48.739505 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3907e81d-3e70-49ee-a8b4-15d6f6154e92 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:48.739965 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3907e81d-3e70-49ee-a8b4-15d6f6154e92 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:49.051034 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-92e2048e-aa34-41d5-aa66-eab063670f6c tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:49.052304 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-92e2048e-aa34-41d5-aa66-eab063670f6c tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:49.058873 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-92e2048e-aa34-41d5-aa66-eab063670f6c tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:49.059340 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-92e2048e-aa34-41d5-aa66-eab063670f6c tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:49.060510 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-92e2048e-aa34-41d5-aa66-eab063670f6c tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:49.060955 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-92e2048e-aa34-41d5-aa66-eab063670f6c tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:49.147285 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-92e2048e-aa34-41d5-aa66-eab063670f6c tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:49.152058 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-92e2048e-aa34-41d5-aa66-eab063670f6c tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:49.153790 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-92e2048e-aa34-41d5-aa66-eab063670f6c tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:49.155134 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-92e2048e-aa34-41d5-aa66-eab063670f6c tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce" status: 200 len: 1365 microversion: 2.47 time: 0.117158 Apr 16 21:25:49.156210 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2326/4833] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:49 2022] GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce => generated 1365 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:49.165734 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-151b8bc6-2bf4-4642-ac91-1a249dc2f4f1 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:49.166413 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-151b8bc6-2bf4-4642-ac91-1a249dc2f4f1 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] [instance: 5bec80bd-63c1-45bf-a379-98f4c375f318] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:49.173190 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-151b8bc6-2bf4-4642-ac91-1a249dc2f4f1 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:49.178304 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-151b8bc6-2bf4-4642-ac91-1a249dc2f4f1 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:49.178304 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-151b8bc6-2bf4-4642-ac91-1a249dc2f4f1 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:49.178304 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-151b8bc6-2bf4-4642-ac91-1a249dc2f4f1 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:49.243681 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-151b8bc6-2bf4-4642-ac91-1a249dc2f4f1 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:49.251927 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-151b8bc6-2bf4-4642-ac91-1a249dc2f4f1 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:49.253663 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-151b8bc6-2bf4-4642-ac91-1a249dc2f4f1 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:49.255034 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-151b8bc6-2bf4-4642-ac91-1a249dc2f4f1 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] 10.222.0.20 "GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318" status: 200 len: 1414 microversion: 2.54 time: 0.097630 Apr 16 21:25:49.255599 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2327/4834] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:49 2022] GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318 => generated 1414 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:49.272577 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3907e81d-3e70-49ee-a8b4-15d6f6154e92 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:49.280327 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3907e81d-3e70-49ee-a8b4-15d6f6154e92 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1510 microversion: 2.1 time: 0.555878 Apr 16 21:25:49.280908 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2508/4835] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:48 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1510 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:49.384855 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-229d5d7e-7fde-4c8a-bc62-4c200a0d0c89 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:49.385483 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-229d5d7e-7fde-4c8a-bc62-4c200a0d0c89 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:49.391804 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-229d5d7e-7fde-4c8a-bc62-4c200a0d0c89 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:49.392310 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-229d5d7e-7fde-4c8a-bc62-4c200a0d0c89 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:49.393107 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-229d5d7e-7fde-4c8a-bc62-4c200a0d0c89 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:49.393654 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-229d5d7e-7fde-4c8a-bc62-4c200a0d0c89 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:49.461597 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-229d5d7e-7fde-4c8a-bc62-4c200a0d0c89 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:49.470284 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-229d5d7e-7fde-4c8a-bc62-4c200a0d0c89 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 200 len: 1272 microversion: 2.1 time: 0.089855 Apr 16 21:25:49.471237 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2328/4836] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:49 2022] GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 1272 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:50.176019 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-715a9aa4-9b3e-4c38-9739-82525db5def3 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:50.182248 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-715a9aa4-9b3e-4c38-9739-82525db5def3 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:50.201794 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-715a9aa4-9b3e-4c38-9739-82525db5def3 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:50.204733 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-715a9aa4-9b3e-4c38-9739-82525db5def3 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:50.207377 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-715a9aa4-9b3e-4c38-9739-82525db5def3 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:50.210805 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-715a9aa4-9b3e-4c38-9739-82525db5def3 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:50.274487 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d9e21bd5-de74-417d-a0ca-f59e0c32eff3 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:50.275507 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d9e21bd5-de74-417d-a0ca-f59e0c32eff3 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] [instance: 5bec80bd-63c1-45bf-a379-98f4c375f318] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:50.304715 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d9e21bd5-de74-417d-a0ca-f59e0c32eff3 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:50.305656 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d9e21bd5-de74-417d-a0ca-f59e0c32eff3 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:50.307306 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d9e21bd5-de74-417d-a0ca-f59e0c32eff3 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:50.308068 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d9e21bd5-de74-417d-a0ca-f59e0c32eff3 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:50.349509 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-715a9aa4-9b3e-4c38-9739-82525db5def3 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:50.361395 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-715a9aa4-9b3e-4c38-9739-82525db5def3 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:50.363872 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-715a9aa4-9b3e-4c38-9739-82525db5def3 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:50.368284 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-715a9aa4-9b3e-4c38-9739-82525db5def3 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce" status: 200 len: 1365 microversion: 2.47 time: 0.197789 Apr 16 21:25:50.370853 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2509/4837] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:50 2022] GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce => generated 1365 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:50.380129 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8e851cbb-8dd7-482c-b4e6-bc8693164140 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:50.380922 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8e851cbb-8dd7-482c-b4e6-bc8693164140 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:50.387395 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8e851cbb-8dd7-482c-b4e6-bc8693164140 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:50.388154 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8e851cbb-8dd7-482c-b4e6-bc8693164140 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:50.389321 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8e851cbb-8dd7-482c-b4e6-bc8693164140 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:50.389858 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8e851cbb-8dd7-482c-b4e6-bc8693164140 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:50.422827 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d9e21bd5-de74-417d-a0ca-f59e0c32eff3 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:50.439384 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d9e21bd5-de74-417d-a0ca-f59e0c32eff3 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:50.443972 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d9e21bd5-de74-417d-a0ca-f59e0c32eff3 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:50.445631 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d9e21bd5-de74-417d-a0ca-f59e0c32eff3 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] 10.222.0.20 "GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318" status: 200 len: 1399 microversion: 2.54 time: 0.175269 Apr 16 21:25:50.446871 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2329/4838] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:50 2022] GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318 => generated 1399 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:25:50.465310 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1d9d4810-e1f9-43a5-96a7-3975befae4da tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Calling method '.version_select at 0x7fbb9feaa4c0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:50.591526 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1d9d4810-e1f9-43a5-96a7-3975befae4da tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1765095927" status: 204 len: 0 microversion: 2.54 time: 0.131129 Apr 16 21:25:50.592420 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2330/4839] 10.222.0.20 () {60 vars in 1318 bytes} [Sat Apr 16 21:25:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1765095927 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 16 21:25:50.597377 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-21b85b17-7225-44c7-8187-d15518990653 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:50.599293 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-21b85b17-7225-44c7-8187-d15518990653 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:50.604744 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-21b85b17-7225-44c7-8187-d15518990653 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:50.605681 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-21b85b17-7225-44c7-8187-d15518990653 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:50.606090 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-21b85b17-7225-44c7-8187-d15518990653 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:50.606534 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-21b85b17-7225-44c7-8187-d15518990653 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:50.677674 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8e851cbb-8dd7-482c-b4e6-bc8693164140 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:50.688618 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8e851cbb-8dd7-482c-b4e6-bc8693164140 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1531 microversion: 2.1 time: 0.316475 Apr 16 21:25:50.689224 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2510/4840] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:50 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1531 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:50.696403 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-eed7b4b3-7dcb-487e-8e39-ceb41cbc3036 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:50.702151 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-eed7b4b3-7dcb-487e-8e39-ceb41cbc3036 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] [instance: 5bec80bd-63c1-45bf-a379-98f4c375f318] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:50.705133 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eed7b4b3-7dcb-487e-8e39-ceb41cbc3036 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:50.705602 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eed7b4b3-7dcb-487e-8e39-ceb41cbc3036 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:50.707632 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eed7b4b3-7dcb-487e-8e39-ceb41cbc3036 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:50.708084 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eed7b4b3-7dcb-487e-8e39-ceb41cbc3036 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:50.732976 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-eed7b4b3-7dcb-487e-8e39-ceb41cbc3036 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] [instance: 5bec80bd-63c1-45bf-a379-98f4c375f318] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:25:50.796052 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-21b85b17-7225-44c7-8187-d15518990653 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:50.805035 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-21b85b17-7225-44c7-8187-d15518990653 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 200 len: 1314 microversion: 2.1 time: 0.211783 Apr 16 21:25:50.806251 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2331/4841] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:50 2022] GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:51.065633 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-eed7b4b3-7dcb-487e-8e39-ceb41cbc3036 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318" status: 204 len: 0 microversion: 2.54 time: 0.374536 Apr 16 21:25:51.069255 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2511/4842] 10.222.0.20 () {60 vars in 1279 bytes} [Sat Apr 16 21:25:50 2022] DELETE /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 16 21:25:51.077195 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-44db27d4-cb6a-4336-b905-6d66a7381650 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:51.078355 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-44db27d4-cb6a-4336-b905-6d66a7381650 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] [instance: 5bec80bd-63c1-45bf-a379-98f4c375f318] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:51.088523 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-44db27d4-cb6a-4336-b905-6d66a7381650 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:51.089140 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-44db27d4-cb6a-4336-b905-6d66a7381650 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:51.090193 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-44db27d4-cb6a-4336-b905-6d66a7381650 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:51.090924 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-44db27d4-cb6a-4336-b905-6d66a7381650 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:51.308766 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-44db27d4-cb6a-4336-b905-6d66a7381650 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:51.319773 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-44db27d4-cb6a-4336-b905-6d66a7381650 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:51.322503 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-44db27d4-cb6a-4336-b905-6d66a7381650 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:51.323961 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-44db27d4-cb6a-4336-b905-6d66a7381650 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] 10.222.0.20 "GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318" status: 200 len: 1405 microversion: 2.54 time: 0.253275 Apr 16 21:25:51.324870 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2332/4843] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:51 2022] GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318 => generated 1405 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:25:51.358148 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-8ec3b98d-5a8a-4126-a972-aead9dcf306d req-fca387c7-9dc4-4fa7-951d-d0bfd1a1e86a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e13f52f-cb80-494c-8cc8-f785a71975e0", "tag": "7542af86-038e-4ed9-b3e1-69e05db5430f"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:51.377447 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-8ec3b98d-5a8a-4126-a972-aead9dcf306d req-fca387c7-9dc4-4fa7-951d-d0bfd1a1e86a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:51.377917 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-8ec3b98d-5a8a-4126-a972-aead9dcf306d req-fca387c7-9dc4-4fa7-951d-d0bfd1a1e86a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:51.389866 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-751b35de-36d2-4546-b17c-612250aaea0e tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:51.390754 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-751b35de-36d2-4546-b17c-612250aaea0e tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:51.399503 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-751b35de-36d2-4546-b17c-612250aaea0e tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:51.399975 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-751b35de-36d2-4546-b17c-612250aaea0e tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:51.407152 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-751b35de-36d2-4546-b17c-612250aaea0e tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:51.407630 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-751b35de-36d2-4546-b17c-612250aaea0e tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:51.438275 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-8ec3b98d-5a8a-4126-a972-aead9dcf306d req-fca387c7-9dc4-4fa7-951d-d0bfd1a1e86a service nova] Creating event network-changed:7542af86-038e-4ed9-b3e1-69e05db5430f for instance 3e13f52f-cb80-494c-8cc8-f785a71975e0 on nch2-master-1 Apr 16 21:25:51.446016 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-8ec3b98d-5a8a-4126-a972-aead9dcf306d req-fca387c7-9dc4-4fa7-951d-d0bfd1a1e86a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092229 Apr 16 21:25:51.449005 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2512/4844] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:25:51.528958 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-751b35de-36d2-4546-b17c-612250aaea0e tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:51.537693 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-751b35de-36d2-4546-b17c-612250aaea0e tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:51.539513 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-751b35de-36d2-4546-b17c-612250aaea0e tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:51.544565 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-751b35de-36d2-4546-b17c-612250aaea0e tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce" status: 200 len: 1365 microversion: 2.47 time: 0.154918 Apr 16 21:25:51.544565 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2333/4845] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:51 2022] GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:51.712793 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b21f4d14-a853-4daa-aaf7-35f33e781911 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:51.713555 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b21f4d14-a853-4daa-aaf7-35f33e781911 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:51.720694 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b21f4d14-a853-4daa-aaf7-35f33e781911 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:51.721212 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b21f4d14-a853-4daa-aaf7-35f33e781911 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:51.722341 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b21f4d14-a853-4daa-aaf7-35f33e781911 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:51.722784 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b21f4d14-a853-4daa-aaf7-35f33e781911 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:51.823199 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-67bc0802-3df2-4a26-b14a-5987d8c3605a tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:51.823820 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-67bc0802-3df2-4a26-b14a-5987d8c3605a tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:51.830177 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-67bc0802-3df2-4a26-b14a-5987d8c3605a tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:51.830641 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-67bc0802-3df2-4a26-b14a-5987d8c3605a tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:51.831578 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-67bc0802-3df2-4a26-b14a-5987d8c3605a tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:51.832024 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-67bc0802-3df2-4a26-b14a-5987d8c3605a tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:51.921225 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b21f4d14-a853-4daa-aaf7-35f33e781911 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:51.929824 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b21f4d14-a853-4daa-aaf7-35f33e781911 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1531 microversion: 2.1 time: 0.223516 Apr 16 21:25:51.930801 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2513/4846] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:51 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1531 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:51.995199 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-67bc0802-3df2-4a26-b14a-5987d8c3605a tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:52.013428 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-67bc0802-3df2-4a26-b14a-5987d8c3605a tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 200 len: 1314 microversion: 2.1 time: 0.194237 Apr 16 21:25:52.025045 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2334/4847] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:51 2022] GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:25:52.342912 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d085a31e-905e-4ac6-9702-dcc1b2b97fe6 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:52.343566 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d085a31e-905e-4ac6-9702-dcc1b2b97fe6 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] [instance: 5bec80bd-63c1-45bf-a379-98f4c375f318] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:52.350424 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d085a31e-905e-4ac6-9702-dcc1b2b97fe6 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:52.350893 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d085a31e-905e-4ac6-9702-dcc1b2b97fe6 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:52.351692 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d085a31e-905e-4ac6-9702-dcc1b2b97fe6 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:52.352138 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d085a31e-905e-4ac6-9702-dcc1b2b97fe6 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:52.432370 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d085a31e-905e-4ac6-9702-dcc1b2b97fe6 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:52.445713 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d085a31e-905e-4ac6-9702-dcc1b2b97fe6 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:52.447596 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d085a31e-905e-4ac6-9702-dcc1b2b97fe6 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:52.449234 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d085a31e-905e-4ac6-9702-dcc1b2b97fe6 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] 10.222.0.20 "GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318" status: 200 len: 1405 microversion: 2.54 time: 0.110307 Apr 16 21:25:52.450356 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2514/4848] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:52 2022] GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318 => generated 1405 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:52.563241 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7f2a2edc-2cb0-4c97-864f-caa5063f54ee tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:52.564009 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7f2a2edc-2cb0-4c97-864f-caa5063f54ee tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:52.571493 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7f2a2edc-2cb0-4c97-864f-caa5063f54ee tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:52.572078 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7f2a2edc-2cb0-4c97-864f-caa5063f54ee tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:52.572911 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7f2a2edc-2cb0-4c97-864f-caa5063f54ee tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:52.573363 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7f2a2edc-2cb0-4c97-864f-caa5063f54ee tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:52.642291 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7f2a2edc-2cb0-4c97-864f-caa5063f54ee tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:52.651512 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7f2a2edc-2cb0-4c97-864f-caa5063f54ee tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:52.653668 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7f2a2edc-2cb0-4c97-864f-caa5063f54ee tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:52.654889 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7f2a2edc-2cb0-4c97-864f-caa5063f54ee tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce" status: 200 len: 1365 microversion: 2.47 time: 0.097456 Apr 16 21:25:52.655450 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2335/4849] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:52 2022] GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce => generated 1365 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:25:52.950001 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5517ef5e-bc75-4514-b4ff-7e06cbad46e5 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:52.951177 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5517ef5e-bc75-4514-b4ff-7e06cbad46e5 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:52.972240 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5517ef5e-bc75-4514-b4ff-7e06cbad46e5 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:52.972240 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5517ef5e-bc75-4514-b4ff-7e06cbad46e5 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:52.972240 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5517ef5e-bc75-4514-b4ff-7e06cbad46e5 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:52.972587 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5517ef5e-bc75-4514-b4ff-7e06cbad46e5 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:53.031515 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-710d5039-7b63-4faf-ad40-0b37a24b9e40 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:53.032424 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-710d5039-7b63-4faf-ad40-0b37a24b9e40 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:53.041351 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-710d5039-7b63-4faf-ad40-0b37a24b9e40 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:53.042082 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-710d5039-7b63-4faf-ad40-0b37a24b9e40 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:53.043178 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-710d5039-7b63-4faf-ad40-0b37a24b9e40 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:53.043804 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-710d5039-7b63-4faf-ad40-0b37a24b9e40 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:53.128141 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5517ef5e-bc75-4514-b4ff-7e06cbad46e5 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:53.136699 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5517ef5e-bc75-4514-b4ff-7e06cbad46e5 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1531 microversion: 2.1 time: 0.192963 Apr 16 21:25:53.137288 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2515/4850] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:52 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1531 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:53.231487 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-710d5039-7b63-4faf-ad40-0b37a24b9e40 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:53.240286 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-710d5039-7b63-4faf-ad40-0b37a24b9e40 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 200 len: 1314 microversion: 2.1 time: 0.212696 Apr 16 21:25:53.240939 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2336/4851] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:53 2022] GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:25:53.468374 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4f1486cf-3cc6-450c-8955-e4513e0fe415 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:53.469084 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4f1486cf-3cc6-450c-8955-e4513e0fe415 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] [instance: 5bec80bd-63c1-45bf-a379-98f4c375f318] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:53.475920 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4f1486cf-3cc6-450c-8955-e4513e0fe415 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:53.476419 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4f1486cf-3cc6-450c-8955-e4513e0fe415 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:53.477204 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4f1486cf-3cc6-450c-8955-e4513e0fe415 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:53.477651 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4f1486cf-3cc6-450c-8955-e4513e0fe415 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:53.546649 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4f1486cf-3cc6-450c-8955-e4513e0fe415 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:53.555305 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4f1486cf-3cc6-450c-8955-e4513e0fe415 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:53.556873 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4f1486cf-3cc6-450c-8955-e4513e0fe415 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:53.558046 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4f1486cf-3cc6-450c-8955-e4513e0fe415 tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] 10.222.0.20 "GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318" status: 200 len: 1405 microversion: 2.54 time: 0.093863 Apr 16 21:25:53.558627 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2516/4852] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:53 2022] GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318 => generated 1405 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:53.674096 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-51dbafca-6262-452e-ab11-2a9c9ec7f81f tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:53.674786 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-51dbafca-6262-452e-ab11-2a9c9ec7f81f tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:53.682528 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-51dbafca-6262-452e-ab11-2a9c9ec7f81f tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:53.683061 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-51dbafca-6262-452e-ab11-2a9c9ec7f81f tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:53.683913 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-51dbafca-6262-452e-ab11-2a9c9ec7f81f tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:53.685148 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-51dbafca-6262-452e-ab11-2a9c9ec7f81f tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:53.789047 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-51dbafca-6262-452e-ab11-2a9c9ec7f81f tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:53.798043 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-51dbafca-6262-452e-ab11-2a9c9ec7f81f tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:53.799656 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-51dbafca-6262-452e-ab11-2a9c9ec7f81f tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:53.802460 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-51dbafca-6262-452e-ab11-2a9c9ec7f81f tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce" status: 200 len: 1365 microversion: 2.47 time: 0.132465 Apr 16 21:25:53.813483 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2337/4853] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:53 2022] GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce => generated 1365 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:53.836739 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-3d45a78a-cab1-4d8e-a807-0a0f9da5469f req-2cb57c08-13b2-439f-8878-b81e91a4528b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daf189e2-7cb4-4dab-94cf-ffdceb314df7", "name": "network-vif-plugged", "status": "completed", "tag": "29f0877d-908a-47df-aa37-d5dcea212e40"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:25:53.846242 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-3d45a78a-cab1-4d8e-a807-0a0f9da5469f req-2cb57c08-13b2-439f-8878-b81e91a4528b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:53.846452 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-3d45a78a-cab1-4d8e-a807-0a0f9da5469f req-2cb57c08-13b2-439f-8878-b81e91a4528b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:53.858025 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-3d45a78a-cab1-4d8e-a807-0a0f9da5469f req-2cb57c08-13b2-439f-8878-b81e91a4528b service nova] Creating event network-vif-plugged:29f0877d-908a-47df-aa37-d5dcea212e40 for instance daf189e2-7cb4-4dab-94cf-ffdceb314df7 on nch2-master-1 Apr 16 21:25:53.864233 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-3d45a78a-cab1-4d8e-a807-0a0f9da5469f req-2cb57c08-13b2-439f-8878-b81e91a4528b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030740 Apr 16 21:25:53.864942 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2517/4854] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:25:54.154919 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1080d22d-8c84-4571-b885-b68d16540fc9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:54.155474 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1080d22d-8c84-4571-b885-b68d16540fc9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:54.162072 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1080d22d-8c84-4571-b885-b68d16540fc9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:54.162531 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1080d22d-8c84-4571-b885-b68d16540fc9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:54.163374 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1080d22d-8c84-4571-b885-b68d16540fc9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:54.163825 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1080d22d-8c84-4571-b885-b68d16540fc9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:54.275703 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-424b68bc-d746-457d-97cf-ba46f6af16c9 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:54.277046 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-424b68bc-d746-457d-97cf-ba46f6af16c9 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:54.292953 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-424b68bc-d746-457d-97cf-ba46f6af16c9 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:54.298114 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-424b68bc-d746-457d-97cf-ba46f6af16c9 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:54.298114 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-424b68bc-d746-457d-97cf-ba46f6af16c9 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:54.298114 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-424b68bc-d746-457d-97cf-ba46f6af16c9 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:54.369002 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1080d22d-8c84-4571-b885-b68d16540fc9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:54.381854 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1080d22d-8c84-4571-b885-b68d16540fc9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1531 microversion: 2.1 time: 0.231175 Apr 16 21:25:54.384953 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2338/4855] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:54 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1531 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:25:54.452224 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-424b68bc-d746-457d-97cf-ba46f6af16c9 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:54.460519 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-424b68bc-d746-457d-97cf-ba46f6af16c9 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 200 len: 1314 microversion: 2.1 time: 0.197057 Apr 16 21:25:54.461112 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2518/4856] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:54 2022] GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:54.577593 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d26bdc21-bd20-4b62-b5eb-2950b1d7881f tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:54.578216 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d26bdc21-bd20-4b62-b5eb-2950b1d7881f tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] [instance: 5bec80bd-63c1-45bf-a379-98f4c375f318] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:54.585020 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d26bdc21-bd20-4b62-b5eb-2950b1d7881f tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:54.585371 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d26bdc21-bd20-4b62-b5eb-2950b1d7881f tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:54.586147 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d26bdc21-bd20-4b62-b5eb-2950b1d7881f tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:54.586596 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d26bdc21-bd20-4b62-b5eb-2950b1d7881f tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:54.686743 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d26bdc21-bd20-4b62-b5eb-2950b1d7881f tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:54.701124 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d26bdc21-bd20-4b62-b5eb-2950b1d7881f tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:54.704728 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d26bdc21-bd20-4b62-b5eb-2950b1d7881f tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:54.704728 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d26bdc21-bd20-4b62-b5eb-2950b1d7881f tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] 10.222.0.20 "GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318" status: 200 len: 1405 microversion: 2.54 time: 0.130520 Apr 16 21:25:54.716371 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2339/4857] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:54 2022] GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318 => generated 1405 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:54.821246 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9270e330-6997-45da-b1c3-15c0eab6b2ad tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:54.822009 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9270e330-6997-45da-b1c3-15c0eab6b2ad tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:54.829372 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9270e330-6997-45da-b1c3-15c0eab6b2ad tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:54.829838 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9270e330-6997-45da-b1c3-15c0eab6b2ad tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:54.830687 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9270e330-6997-45da-b1c3-15c0eab6b2ad tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:54.831137 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9270e330-6997-45da-b1c3-15c0eab6b2ad tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:54.908575 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9270e330-6997-45da-b1c3-15c0eab6b2ad tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:54.916681 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9270e330-6997-45da-b1c3-15c0eab6b2ad tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:54.918135 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9270e330-6997-45da-b1c3-15c0eab6b2ad tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:54.919344 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9270e330-6997-45da-b1c3-15c0eab6b2ad tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce" status: 200 len: 1365 microversion: 2.47 time: 0.102170 Apr 16 21:25:54.920384 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2519/4858] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:54 2022] GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce => generated 1365 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:55.401158 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7b1329b9-774f-480d-ace4-347355c16712 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:55.402378 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7b1329b9-774f-480d-ace4-347355c16712 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:55.410900 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7b1329b9-774f-480d-ace4-347355c16712 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:55.411582 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7b1329b9-774f-480d-ace4-347355c16712 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:55.412532 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7b1329b9-774f-480d-ace4-347355c16712 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:55.413093 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7b1329b9-774f-480d-ace4-347355c16712 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:55.479393 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a8468607-d297-4f3f-9a0f-06b0b9461835 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:55.480116 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a8468607-d297-4f3f-9a0f-06b0b9461835 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:55.486904 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a8468607-d297-4f3f-9a0f-06b0b9461835 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:55.487459 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a8468607-d297-4f3f-9a0f-06b0b9461835 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:55.488967 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a8468607-d297-4f3f-9a0f-06b0b9461835 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:55.489492 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a8468607-d297-4f3f-9a0f-06b0b9461835 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:55.704150 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7b1329b9-774f-480d-ace4-347355c16712 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:55.715602 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7b1329b9-774f-480d-ace4-347355c16712 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1531 microversion: 2.1 time: 0.318700 Apr 16 21:25:55.716585 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2340/4859] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:55 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1531 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:25:55.732013 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-33ac2f0b-337c-4bdf-b394-9b7f01f86a4d tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:55.732728 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-33ac2f0b-337c-4bdf-b394-9b7f01f86a4d tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] [instance: 5bec80bd-63c1-45bf-a379-98f4c375f318] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:55.740194 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-33ac2f0b-337c-4bdf-b394-9b7f01f86a4d tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:55.740783 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-33ac2f0b-337c-4bdf-b394-9b7f01f86a4d tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:55.741754 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-33ac2f0b-337c-4bdf-b394-9b7f01f86a4d tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:55.742396 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-33ac2f0b-337c-4bdf-b394-9b7f01f86a4d tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:55.797300 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a8468607-d297-4f3f-9a0f-06b0b9461835 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:55.811818 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a8468607-d297-4f3f-9a0f-06b0b9461835 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 200 len: 1314 microversion: 2.1 time: 0.337399 Apr 16 21:25:55.825016 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2520/4860] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:55 2022] GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:25:55.885581 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-33ac2f0b-337c-4bdf-b394-9b7f01f86a4d tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:55.901683 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-33ac2f0b-337c-4bdf-b394-9b7f01f86a4d tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:55.912576 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-33ac2f0b-337c-4bdf-b394-9b7f01f86a4d tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6d933704fe0946419f1644c2f19b2431', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94f6b07b308c4af99aaecfbf00e08590', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:55.914206 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-33ac2f0b-337c-4bdf-b394-9b7f01f86a4d tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] 10.222.0.20 "GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318" status: 200 len: 1405 microversion: 2.54 time: 0.186137 Apr 16 21:25:55.916483 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2341/4861] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:55 2022] GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318 => generated 1405 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:55.939204 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-74f2647d-90b5-4f70-86a6-21b68632eea3 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:55.939830 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-74f2647d-90b5-4f70-86a6-21b68632eea3 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:55.946966 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-74f2647d-90b5-4f70-86a6-21b68632eea3 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:55.947440 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-74f2647d-90b5-4f70-86a6-21b68632eea3 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:55.948267 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-74f2647d-90b5-4f70-86a6-21b68632eea3 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:55.948719 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-74f2647d-90b5-4f70-86a6-21b68632eea3 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:56.020327 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-74f2647d-90b5-4f70-86a6-21b68632eea3 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:56.029103 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-74f2647d-90b5-4f70-86a6-21b68632eea3 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:56.030617 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-74f2647d-90b5-4f70-86a6-21b68632eea3 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:56.032010 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-74f2647d-90b5-4f70-86a6-21b68632eea3 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce" status: 200 len: 1365 microversion: 2.47 time: 0.096804 Apr 16 21:25:56.032381 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2521/4862] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:55 2022] GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce => generated 1365 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:56.733544 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-735318b9-9657-4a15-89cf-68e2d96cbb25 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:56.734254 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-735318b9-9657-4a15-89cf-68e2d96cbb25 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:56.741662 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-735318b9-9657-4a15-89cf-68e2d96cbb25 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:56.742405 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-735318b9-9657-4a15-89cf-68e2d96cbb25 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:56.743317 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-735318b9-9657-4a15-89cf-68e2d96cbb25 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:56.743999 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-735318b9-9657-4a15-89cf-68e2d96cbb25 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:56.829885 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a655b8fe-9b8b-456b-96d0-c701a4b44227 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:56.830586 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a655b8fe-9b8b-456b-96d0-c701a4b44227 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:56.837190 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a655b8fe-9b8b-456b-96d0-c701a4b44227 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:56.837657 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a655b8fe-9b8b-456b-96d0-c701a4b44227 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:56.838444 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a655b8fe-9b8b-456b-96d0-c701a4b44227 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:56.838891 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a655b8fe-9b8b-456b-96d0-c701a4b44227 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:56.893416 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-735318b9-9657-4a15-89cf-68e2d96cbb25 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:56.899032 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-735318b9-9657-4a15-89cf-68e2d96cbb25 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1526 microversion: 2.1 time: 0.169600 Apr 16 21:25:56.899902 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2342/4863] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:56 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1526 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:25:56.934117 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-749f4c28-f21e-46f2-9bf1-cec9a98386ac tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:56.934903 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-749f4c28-f21e-46f2-9bf1-cec9a98386ac tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] [instance: 5bec80bd-63c1-45bf-a379-98f4c375f318] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:56.953529 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-749f4c28-f21e-46f2-9bf1-cec9a98386ac tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:56.955467 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-749f4c28-f21e-46f2-9bf1-cec9a98386ac tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:56.957500 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-749f4c28-f21e-46f2-9bf1-cec9a98386ac tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:56.959316 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-749f4c28-f21e-46f2-9bf1-cec9a98386ac tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:56.986832 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-749f4c28-f21e-46f2-9bf1-cec9a98386ac tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] HTTP exception thrown: Instance 5bec80bd-63c1-45bf-a379-98f4c375f318 could not be found. Apr 16 21:25:56.988075 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-749f4c28-f21e-46f2-9bf1-cec9a98386ac tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] Returning 404 to user: Instance 5bec80bd-63c1-45bf-a379-98f4c375f318 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:25:56.989225 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-749f4c28-f21e-46f2-9bf1-cec9a98386ac tempest-ServerShowV254Test-1840049008 tempest-ServerShowV254Test-1840049008-project] 10.222.0.20 "GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318" status: 404 len: 111 microversion: 2.54 time: 0.059526 Apr 16 21:25:56.993082 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2343/4864] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:56 2022] GET /compute/v2.1/servers/5bec80bd-63c1-45bf-a379-98f4c375f318 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 16 21:25:57.052202 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-196bc4cf-774b-4500-83cb-8b29b8eb54a7 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:57.053138 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-196bc4cf-774b-4500-83cb-8b29b8eb54a7 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:57.060802 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-196bc4cf-774b-4500-83cb-8b29b8eb54a7 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:57.062264 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-196bc4cf-774b-4500-83cb-8b29b8eb54a7 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:57.063350 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-196bc4cf-774b-4500-83cb-8b29b8eb54a7 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:57.065214 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-196bc4cf-774b-4500-83cb-8b29b8eb54a7 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:57.115047 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a655b8fe-9b8b-456b-96d0-c701a4b44227 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:57.127758 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a655b8fe-9b8b-456b-96d0-c701a4b44227 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 200 len: 1314 microversion: 2.1 time: 0.301639 Apr 16 21:25:57.131918 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2522/4865] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:56 2022] GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 1314 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:57.143564 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-196bc4cf-774b-4500-83cb-8b29b8eb54a7 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:57.152298 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-196bc4cf-774b-4500-83cb-8b29b8eb54a7 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:57.154107 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-196bc4cf-774b-4500-83cb-8b29b8eb54a7 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:57.156603 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-196bc4cf-774b-4500-83cb-8b29b8eb54a7 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce" status: 200 len: 1365 microversion: 2.47 time: 0.108738 Apr 16 21:25:57.157273 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2344/4866] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:57 2022] GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce => generated 1365 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:57.917531 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-174f2438-fbe3-435a-876b-a072f821003c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:57.918826 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-174f2438-fbe3-435a-876b-a072f821003c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:57.931926 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-174f2438-fbe3-435a-876b-a072f821003c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:57.932807 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-174f2438-fbe3-435a-876b-a072f821003c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:57.933877 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-174f2438-fbe3-435a-876b-a072f821003c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:57.935869 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-174f2438-fbe3-435a-876b-a072f821003c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:58.150714 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a4c6e4a4-5fc5-4c33-84e0-197371f1dc10 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:58.152147 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a4c6e4a4-5fc5-4c33-84e0-197371f1dc10 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:58.160102 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-174f2438-fbe3-435a-876b-a072f821003c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:58.173444 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-174f2438-fbe3-435a-876b-a072f821003c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1526 microversion: 2.1 time: 0.259700 Apr 16 21:25:58.177696 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a4c6e4a4-5fc5-4c33-84e0-197371f1dc10 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:58.178090 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a4c6e4a4-5fc5-4c33-84e0-197371f1dc10 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:58.178478 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2523/4867] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:57 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1526 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:58.182907 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a4c6e4a4-5fc5-4c33-84e0-197371f1dc10 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:58.183370 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a4c6e4a4-5fc5-4c33-84e0-197371f1dc10 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:58.189842 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ce8fafd0-f4b6-4a16-8760-3fbf0d1104a1 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:58.189972 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ce8fafd0-f4b6-4a16-8760-3fbf0d1104a1 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:58.214665 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ce8fafd0-f4b6-4a16-8760-3fbf0d1104a1 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:58.214665 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ce8fafd0-f4b6-4a16-8760-3fbf0d1104a1 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:58.214665 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ce8fafd0-f4b6-4a16-8760-3fbf0d1104a1 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:58.214665 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ce8fafd0-f4b6-4a16-8760-3fbf0d1104a1 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:58.327891 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ce8fafd0-f4b6-4a16-8760-3fbf0d1104a1 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:58.350588 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ce8fafd0-f4b6-4a16-8760-3fbf0d1104a1 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:58.353279 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ce8fafd0-f4b6-4a16-8760-3fbf0d1104a1 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:58.354933 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ce8fafd0-f4b6-4a16-8760-3fbf0d1104a1 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce" status: 200 len: 1365 microversion: 2.47 time: 0.175287 Apr 16 21:25:58.357161 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2524/4868] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:58 2022] GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:58.439694 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a4c6e4a4-5fc5-4c33-84e0-197371f1dc10 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:58.454935 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a4c6e4a4-5fc5-4c33-84e0-197371f1dc10 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 200 len: 1314 microversion: 2.1 time: 0.307217 Apr 16 21:25:58.468923 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2345/4869] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:58 2022] GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:59.196111 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c5f2e6f2-bec9-439f-b303-10424ce23ee7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:59.197020 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c5f2e6f2-bec9-439f-b303-10424ce23ee7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:59.208600 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c5f2e6f2-bec9-439f-b303-10424ce23ee7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:59.215718 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c5f2e6f2-bec9-439f-b303-10424ce23ee7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:59.217193 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c5f2e6f2-bec9-439f-b303-10424ce23ee7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:59.217555 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c5f2e6f2-bec9-439f-b303-10424ce23ee7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:59.374436 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fc249a3d-0f09-4d03-9723-c2b6832ca075 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:59.375718 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-fc249a3d-0f09-4d03-9723-c2b6832ca075 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:59.389647 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fc249a3d-0f09-4d03-9723-c2b6832ca075 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:59.390339 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fc249a3d-0f09-4d03-9723-c2b6832ca075 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:59.391337 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fc249a3d-0f09-4d03-9723-c2b6832ca075 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:59.391951 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fc249a3d-0f09-4d03-9723-c2b6832ca075 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:59.398085 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c5f2e6f2-bec9-439f-b303-10424ce23ee7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:59.412847 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c5f2e6f2-bec9-439f-b303-10424ce23ee7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1526 microversion: 2.1 time: 0.221570 Apr 16 21:25:59.415023 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2525/4870] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:59 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1526 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:25:59.479891 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-49caa845-3ade-469d-96b6-45e1575ebf97 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:25:59.480774 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-49caa845-3ade-469d-96b6-45e1575ebf97 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:25:59.492294 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-49caa845-3ade-469d-96b6-45e1575ebf97 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:59.501389 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-49caa845-3ade-469d-96b6-45e1575ebf97 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:59.504102 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-49caa845-3ade-469d-96b6-45e1575ebf97 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:25:59.508485 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-49caa845-3ade-469d-96b6-45e1575ebf97 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:25:59.553207 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-fc249a3d-0f09-4d03-9723-c2b6832ca075 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:59.563199 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-fc249a3d-0f09-4d03-9723-c2b6832ca075 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:59.568654 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-fc249a3d-0f09-4d03-9723-c2b6832ca075 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:59.571735 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fc249a3d-0f09-4d03-9723-c2b6832ca075 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce" status: 200 len: 1365 microversion: 2.47 time: 0.201295 Apr 16 21:25:59.576347 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2346/4871] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:25:59 2022] GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce => generated 1365 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:25:59.801130 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-49caa845-3ade-469d-96b6-45e1575ebf97 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:25:59.809956 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-49caa845-3ade-469d-96b6-45e1575ebf97 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 200 len: 1314 microversion: 2.1 time: 0.335460 Apr 16 21:25:59.815917 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2526/4872] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:25:59 2022] GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 1314 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:00.171517 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-caae6539-36df-43ae-b436-e5cae98156cb req-73e81746-94fa-49c0-8ab7-de76205ed989 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e13f52f-cb80-494c-8cc8-f785a71975e0", "name": "network-vif-plugged", "status": "completed", "tag": "7542af86-038e-4ed9-b3e1-69e05db5430f"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:26:00.185477 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-caae6539-36df-43ae-b436-e5cae98156cb req-73e81746-94fa-49c0-8ab7-de76205ed989 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:00.186403 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-caae6539-36df-43ae-b436-e5cae98156cb req-73e81746-94fa-49c0-8ab7-de76205ed989 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:00.204905 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-caae6539-36df-43ae-b436-e5cae98156cb req-73e81746-94fa-49c0-8ab7-de76205ed989 service nova] Creating event network-vif-plugged:7542af86-038e-4ed9-b3e1-69e05db5430f for instance 3e13f52f-cb80-494c-8cc8-f785a71975e0 on nch2-master-1 Apr 16 21:26:00.212420 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-caae6539-36df-43ae-b436-e5cae98156cb req-73e81746-94fa-49c0-8ab7-de76205ed989 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044884 Apr 16 21:26:00.219400 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2347/4873] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:26:00.370791 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-503048c5-1cf3-46e3-882a-07bfd05196cb tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-816904917", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": "none"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:26:00.436207 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e065cecf-e042-4754-a371-57de802aeeb2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:00.437710 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e065cecf-e042-4754-a371-57de802aeeb2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:00.456450 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e065cecf-e042-4754-a371-57de802aeeb2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:00.457565 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e065cecf-e042-4754-a371-57de802aeeb2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:00.459032 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e065cecf-e042-4754-a371-57de802aeeb2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:00.462837 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e065cecf-e042-4754-a371-57de802aeeb2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:00.495151 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-503048c5-1cf3-46e3-882a-07bfd05196cb tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:26:00.499595 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-503048c5-1cf3-46e3-882a-07bfd05196cb tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:26:00.499595 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-503048c5-1cf3-46e3-882a-07bfd05196cb tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:26:00.499595 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-503048c5-1cf3-46e3-882a-07bfd05196cb tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:26:00.499595 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-503048c5-1cf3-46e3-882a-07bfd05196cb tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:26:00.508313 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-503048c5-1cf3-46e3-882a-07bfd05196cb tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:00.509196 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-503048c5-1cf3-46e3-882a-07bfd05196cb tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:00.510258 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-503048c5-1cf3-46e3-882a-07bfd05196cb tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:00.510790 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-503048c5-1cf3-46e3-882a-07bfd05196cb tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:00.531588 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-503048c5-1cf3-46e3-882a-07bfd05196cb tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Getting quotas for project a3b868d01dc64436a62165eaba1c8da0. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:26:00.538139 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-503048c5-1cf3-46e3-882a-07bfd05196cb tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Getting quotas for user 8cd0508c29074deb8e68789231ac5da5 and project a3b868d01dc64436a62165eaba1c8da0. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:26:00.554027 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-503048c5-1cf3-46e3-882a-07bfd05196cb tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:26:00.556749 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-503048c5-1cf3-46e3-882a-07bfd05196cb tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:26:00.661717 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e065cecf-e042-4754-a371-57de802aeeb2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:00.669405 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e065cecf-e042-4754-a371-57de802aeeb2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1526 microversion: 2.1 time: 0.242203 Apr 16 21:26:00.695986 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2348/4874] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:00 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1526 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:26:00.700634 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1302083a-67e2-4527-9d5f-d091bb0577cb tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:00.701263 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1302083a-67e2-4527-9d5f-d091bb0577cb tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:00.707487 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1302083a-67e2-4527-9d5f-d091bb0577cb tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:00.707953 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1302083a-67e2-4527-9d5f-d091bb0577cb tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:00.708796 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1302083a-67e2-4527-9d5f-d091bb0577cb tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:00.709250 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1302083a-67e2-4527-9d5f-d091bb0577cb tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:00.726785 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-503048c5-1cf3-46e3-882a-07bfd05196cb tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.521320 Apr 16 21:26:00.729962 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2527/4875] 10.222.0.20 () {62 vars in 1187 bytes} [Sat Apr 16 21:26:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 526 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 16 21:26:00.745945 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d906a774-8ee5-4e82-a5f1-9b8f30000e86 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:00.746967 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d906a774-8ee5-4e82-a5f1-9b8f30000e86 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:00.806681 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1302083a-67e2-4527-9d5f-d091bb0577cb tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:00.815770 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1302083a-67e2-4527-9d5f-d091bb0577cb tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:00.827468 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1302083a-67e2-4527-9d5f-d091bb0577cb tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:00.837939 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1302083a-67e2-4527-9d5f-d091bb0577cb tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce" status: 200 len: 1365 microversion: 2.47 time: 0.141137 Apr 16 21:26:00.839810 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2349/4876] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:00 2022] GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce => generated 1365 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:26:00.861777 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-23189bc8-1291-4962-b2a5-776925b8ffc4 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:00.866687 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-23189bc8-1291-4962-b2a5-776925b8ffc4 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:00.876266 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-23189bc8-1291-4962-b2a5-776925b8ffc4 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:00.876870 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-23189bc8-1291-4962-b2a5-776925b8ffc4 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:00.877788 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-23189bc8-1291-4962-b2a5-776925b8ffc4 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:00.878367 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-23189bc8-1291-4962-b2a5-776925b8ffc4 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:00.896098 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d906a774-8ee5-4e82-a5f1-9b8f30000e86 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:00.908674 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d906a774-8ee5-4e82-a5f1-9b8f30000e86 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:00.915742 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d906a774-8ee5-4e82-a5f1-9b8f30000e86 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:00.917545 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d906a774-8ee5-4e82-a5f1-9b8f30000e86 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] 10.222.0.20 "GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2" status: 200 len: 1277 microversion: 2.57 time: 0.180975 Apr 16 21:26:00.919531 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2528/4877] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:00 2022] GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2 => generated 1277 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:26:01.085408 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-23189bc8-1291-4962-b2a5-776925b8ffc4 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:01.099830 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-23189bc8-1291-4962-b2a5-776925b8ffc4 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 200 len: 1314 microversion: 2.1 time: 0.243489 Apr 16 21:26:01.100487 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2350/4878] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:00 2022] GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:01.693962 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3347c9ef-d480-45d0-a9c7-345f81d55923 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:01.694582 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3347c9ef-d480-45d0-a9c7-345f81d55923 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:01.702162 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3347c9ef-d480-45d0-a9c7-345f81d55923 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:01.707920 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3347c9ef-d480-45d0-a9c7-345f81d55923 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:01.707920 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3347c9ef-d480-45d0-a9c7-345f81d55923 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:01.707920 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3347c9ef-d480-45d0-a9c7-345f81d55923 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:01.859213 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-79f13ec4-7e07-4b8d-bc7e-063422e09279 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:01.861555 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-79f13ec4-7e07-4b8d-bc7e-063422e09279 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:01.870798 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-79f13ec4-7e07-4b8d-bc7e-063422e09279 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:01.871357 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-79f13ec4-7e07-4b8d-bc7e-063422e09279 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:01.872244 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-79f13ec4-7e07-4b8d-bc7e-063422e09279 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:01.873086 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-79f13ec4-7e07-4b8d-bc7e-063422e09279 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:01.985414 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-79f13ec4-7e07-4b8d-bc7e-063422e09279 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:01.991151 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3347c9ef-d480-45d0-a9c7-345f81d55923 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:02.004614 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3347c9ef-d480-45d0-a9c7-345f81d55923 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1526 microversion: 2.1 time: 0.315058 Apr 16 21:26:02.007494 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2529/4879] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:01 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1526 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:02.020126 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-11e03ecf-6ddd-4ba4-a3f7-7491831df39a tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:02.021065 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-11e03ecf-6ddd-4ba4-a3f7-7491831df39a tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:02.049036 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-79f13ec4-7e07-4b8d-bc7e-063422e09279 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:02.057528 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-79f13ec4-7e07-4b8d-bc7e-063422e09279 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:02.060295 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-79f13ec4-7e07-4b8d-bc7e-063422e09279 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce" status: 200 len: 1365 microversion: 2.47 time: 0.203929 Apr 16 21:26:02.060295 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2351/4880] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:01 2022] GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce => generated 1365 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:26:02.124276 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b197e1fa-0d53-420e-93b6-ce6bc9978941 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:02.124911 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b197e1fa-0d53-420e-93b6-ce6bc9978941 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:02.134057 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b197e1fa-0d53-420e-93b6-ce6bc9978941 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:02.134706 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b197e1fa-0d53-420e-93b6-ce6bc9978941 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:02.135695 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b197e1fa-0d53-420e-93b6-ce6bc9978941 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:02.136151 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b197e1fa-0d53-420e-93b6-ce6bc9978941 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:02.157656 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-11e03ecf-6ddd-4ba4-a3f7-7491831df39a tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:02.179550 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-11e03ecf-6ddd-4ba4-a3f7-7491831df39a tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:02.181145 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-11e03ecf-6ddd-4ba4-a3f7-7491831df39a tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:02.182317 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-11e03ecf-6ddd-4ba4-a3f7-7491831df39a tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] 10.222.0.20 "GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2" status: 200 len: 1277 microversion: 2.57 time: 0.173435 Apr 16 21:26:02.187441 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2530/4881] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:02 2022] GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2 => generated 1277 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:26:02.380701 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b197e1fa-0d53-420e-93b6-ce6bc9978941 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:02.390388 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b197e1fa-0d53-420e-93b6-ce6bc9978941 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 200 len: 1314 microversion: 2.1 time: 0.270549 Apr 16 21:26:02.402369 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2352/4882] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:02 2022] GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:03.029196 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-32e0e9dd-2d10-4b3e-a332-3e637d721af5 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:03.031137 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-32e0e9dd-2d10-4b3e-a332-3e637d721af5 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:03.041045 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-32e0e9dd-2d10-4b3e-a332-3e637d721af5 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:03.050772 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-32e0e9dd-2d10-4b3e-a332-3e637d721af5 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:03.057612 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-32e0e9dd-2d10-4b3e-a332-3e637d721af5 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:03.057612 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-32e0e9dd-2d10-4b3e-a332-3e637d721af5 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:03.077704 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5167a25f-6f56-47a7-b35f-d85ce687648d tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:03.078555 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5167a25f-6f56-47a7-b35f-d85ce687648d tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:03.122377 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5167a25f-6f56-47a7-b35f-d85ce687648d tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:03.123158 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5167a25f-6f56-47a7-b35f-d85ce687648d tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:03.124150 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5167a25f-6f56-47a7-b35f-d85ce687648d tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:03.124633 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5167a25f-6f56-47a7-b35f-d85ce687648d tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:03.262156 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5167a25f-6f56-47a7-b35f-d85ce687648d tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:03.279626 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5167a25f-6f56-47a7-b35f-d85ce687648d tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:03.282418 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5167a25f-6f56-47a7-b35f-d85ce687648d tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:03.292612 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5167a25f-6f56-47a7-b35f-d85ce687648d tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce" status: 200 len: 1365 microversion: 2.47 time: 0.215499 Apr 16 21:26:03.297286 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2353/4883] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:03 2022] GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce => generated 1365 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:26:03.303060 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6a8aebd2-7d4b-414a-9d10-9a4a09b06dc2 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:03.305846 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6a8aebd2-7d4b-414a-9d10-9a4a09b06dc2 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:03.315591 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6a8aebd2-7d4b-414a-9d10-9a4a09b06dc2 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:03.316997 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6a8aebd2-7d4b-414a-9d10-9a4a09b06dc2 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:03.318065 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6a8aebd2-7d4b-414a-9d10-9a4a09b06dc2 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:03.318989 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6a8aebd2-7d4b-414a-9d10-9a4a09b06dc2 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:03.425733 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-32e0e9dd-2d10-4b3e-a332-3e637d721af5 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:03.440656 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-32e0e9dd-2d10-4b3e-a332-3e637d721af5 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1526 microversion: 2.1 time: 0.419028 Apr 16 21:26:03.441438 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2531/4884] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:03 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1526 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:03.460711 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-dcd2e82f-de3e-4199-b60c-76389e88bd3f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:03.460711 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-dcd2e82f-de3e-4199-b60c-76389e88bd3f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:03.475928 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dcd2e82f-de3e-4199-b60c-76389e88bd3f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:03.480665 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6a8aebd2-7d4b-414a-9d10-9a4a09b06dc2 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:03.484807 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dcd2e82f-de3e-4199-b60c-76389e88bd3f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:03.493512 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dcd2e82f-de3e-4199-b60c-76389e88bd3f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:03.494198 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dcd2e82f-de3e-4199-b60c-76389e88bd3f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:03.497820 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6a8aebd2-7d4b-414a-9d10-9a4a09b06dc2 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:03.504890 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6a8aebd2-7d4b-414a-9d10-9a4a09b06dc2 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:03.510421 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6a8aebd2-7d4b-414a-9d10-9a4a09b06dc2 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] 10.222.0.20 "GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2" status: 200 len: 1281 microversion: 2.57 time: 0.211520 Apr 16 21:26:03.517693 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2354/4885] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:03 2022] GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2 => generated 1281 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:26:03.737053 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-dcd2e82f-de3e-4199-b60c-76389e88bd3f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:03.746180 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-dcd2e82f-de3e-4199-b60c-76389e88bd3f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 200 len: 1501 microversion: 2.1 time: 0.300332 Apr 16 21:26:03.747378 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2532/4886] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:03 2022] GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 1501 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:03.765264 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e1f0a27c-b57a-432a-a812-25a00b23e31d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:26:03.773586 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e1f0a27c-b57a-432a-a812-25a00b23e31d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:03.778685 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e1f0a27c-b57a-432a-a812-25a00b23e31d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:03.805852 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e1f0a27c-b57a-432a-a812-25a00b23e31d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Going to try to stop instance {{(pid=137409) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 16 21:26:04.024856 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e1f0a27c-b57a-432a-a812-25a00b23e31d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "POST /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0/action" status: 202 len: 0 microversion: 2.1 time: 0.264460 Apr 16 21:26:04.028882 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2355/4887] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:26:03 2022] POST /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 16 21:26:04.034290 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1a6398cf-0dc6-4260-99a0-6e67401e166d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:04.035574 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1a6398cf-0dc6-4260-99a0-6e67401e166d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:04.062430 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1a6398cf-0dc6-4260-99a0-6e67401e166d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:04.067939 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1a6398cf-0dc6-4260-99a0-6e67401e166d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:04.067939 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1a6398cf-0dc6-4260-99a0-6e67401e166d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:04.067939 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1a6398cf-0dc6-4260-99a0-6e67401e166d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:04.317376 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-37df15fa-43e2-4bb5-8d71-d644ce914d3e tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:04.318171 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-37df15fa-43e2-4bb5-8d71-d644ce914d3e tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:04.329855 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1a6398cf-0dc6-4260-99a0-6e67401e166d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:04.334852 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-37df15fa-43e2-4bb5-8d71-d644ce914d3e tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:04.336340 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-37df15fa-43e2-4bb5-8d71-d644ce914d3e tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:04.339147 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1a6398cf-0dc6-4260-99a0-6e67401e166d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 200 len: 1511 microversion: 2.1 time: 0.309041 Apr 16 21:26:04.340228 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-37df15fa-43e2-4bb5-8d71-d644ce914d3e tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:04.340410 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2533/4888] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:04 2022] GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 1511 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:04.340938 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-37df15fa-43e2-4bb5-8d71-d644ce914d3e tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:04.458723 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-37df15fa-43e2-4bb5-8d71-d644ce914d3e tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:04.463990 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-036e74bd-d282-4e67-9e26-44bb1eb9069c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:04.464860 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-036e74bd-d282-4e67-9e26-44bb1eb9069c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:04.474603 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-036e74bd-d282-4e67-9e26-44bb1eb9069c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:04.475354 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-036e74bd-d282-4e67-9e26-44bb1eb9069c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:04.479373 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-036e74bd-d282-4e67-9e26-44bb1eb9069c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:04.480128 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-036e74bd-d282-4e67-9e26-44bb1eb9069c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:04.488398 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-37df15fa-43e2-4bb5-8d71-d644ce914d3e tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:04.493715 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-37df15fa-43e2-4bb5-8d71-d644ce914d3e tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:04.494471 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-37df15fa-43e2-4bb5-8d71-d644ce914d3e tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce" status: 200 len: 1365 microversion: 2.47 time: 0.184023 Apr 16 21:26:04.510910 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2356/4889] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:04 2022] GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce => generated 1365 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:26:04.537099 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-17e24d10-55d1-4262-8f71-d106458b8b65 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:04.537721 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-17e24d10-55d1-4262-8f71-d106458b8b65 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:04.544703 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-17e24d10-55d1-4262-8f71-d106458b8b65 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:04.545562 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-17e24d10-55d1-4262-8f71-d106458b8b65 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:04.546563 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-17e24d10-55d1-4262-8f71-d106458b8b65 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:04.547016 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-17e24d10-55d1-4262-8f71-d106458b8b65 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:04.652823 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-17e24d10-55d1-4262-8f71-d106458b8b65 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:04.672200 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-17e24d10-55d1-4262-8f71-d106458b8b65 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:04.684863 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-17e24d10-55d1-4262-8f71-d106458b8b65 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:04.686205 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-17e24d10-55d1-4262-8f71-d106458b8b65 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] 10.222.0.20 "GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2" status: 200 len: 1337 microversion: 2.57 time: 0.157524 Apr 16 21:26:04.700088 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2357/4890] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:04 2022] GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2 => generated 1337 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:26:04.715306 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-036e74bd-d282-4e67-9e26-44bb1eb9069c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:04.726474 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-036e74bd-d282-4e67-9e26-44bb1eb9069c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1526 microversion: 2.1 time: 0.270353 Apr 16 21:26:04.727937 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2534/4891] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:04 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1526 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:05.361530 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-16352fb5-8103-4be7-abe5-429d0224ea33 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:05.363606 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-16352fb5-8103-4be7-abe5-429d0224ea33 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:05.370916 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-16352fb5-8103-4be7-abe5-429d0224ea33 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:05.371404 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-16352fb5-8103-4be7-abe5-429d0224ea33 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:05.372207 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-16352fb5-8103-4be7-abe5-429d0224ea33 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:05.372836 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-16352fb5-8103-4be7-abe5-429d0224ea33 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:05.521020 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e9620ca8-cf74-4d33-9751-9f1356a3d776 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:05.521658 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e9620ca8-cf74-4d33-9751-9f1356a3d776 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:05.530615 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e9620ca8-cf74-4d33-9751-9f1356a3d776 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:05.531076 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e9620ca8-cf74-4d33-9751-9f1356a3d776 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:05.532091 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e9620ca8-cf74-4d33-9751-9f1356a3d776 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:05.532716 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e9620ca8-cf74-4d33-9751-9f1356a3d776 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:05.609993 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e9620ca8-cf74-4d33-9751-9f1356a3d776 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:05.619573 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e9620ca8-cf74-4d33-9751-9f1356a3d776 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:05.621842 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e9620ca8-cf74-4d33-9751-9f1356a3d776 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:05.623444 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e9620ca8-cf74-4d33-9751-9f1356a3d776 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce" status: 200 len: 1365 microversion: 2.47 time: 0.112614 Apr 16 21:26:05.624422 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2535/4892] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:05 2022] GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce => generated 1365 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:26:05.706183 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-16352fb5-8103-4be7-abe5-429d0224ea33 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:05.706183 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-16352fb5-8103-4be7-abe5-429d0224ea33 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 200 len: 1511 microversion: 2.1 time: 0.345747 Apr 16 21:26:05.706183 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2358/4893] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:05 2022] GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 1511 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:05.726481 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-33f2ac51-6735-4f52-beb3-51d6729a98d0 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:05.748896 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-33f2ac51-6735-4f52-beb3-51d6729a98d0 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:05.748896 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-33f2ac51-6735-4f52-beb3-51d6729a98d0 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:05.748896 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-33f2ac51-6735-4f52-beb3-51d6729a98d0 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:05.748896 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-33f2ac51-6735-4f52-beb3-51d6729a98d0 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:05.748896 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-33f2ac51-6735-4f52-beb3-51d6729a98d0 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:05.752297 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-daa43247-b2fa-4e0a-a49d-5a8964f075ae tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:05.752297 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-daa43247-b2fa-4e0a-a49d-5a8964f075ae tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:05.757945 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-daa43247-b2fa-4e0a-a49d-5a8964f075ae tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:05.758726 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-daa43247-b2fa-4e0a-a49d-5a8964f075ae tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:05.759730 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-daa43247-b2fa-4e0a-a49d-5a8964f075ae tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:05.760272 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-daa43247-b2fa-4e0a-a49d-5a8964f075ae tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:05.822232 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-33f2ac51-6735-4f52-beb3-51d6729a98d0 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:05.830725 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-33f2ac51-6735-4f52-beb3-51d6729a98d0 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:05.832359 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-33f2ac51-6735-4f52-beb3-51d6729a98d0 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:05.833735 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-33f2ac51-6735-4f52-beb3-51d6729a98d0 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] 10.222.0.20 "GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2" status: 200 len: 1335 microversion: 2.57 time: 0.117089 Apr 16 21:26:05.834504 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2536/4894] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:05 2022] GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2 => generated 1335 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:26:05.920434 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-daa43247-b2fa-4e0a-a49d-5a8964f075ae tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:05.928512 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-daa43247-b2fa-4e0a-a49d-5a8964f075ae tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1526 microversion: 2.1 time: 0.185429 Apr 16 21:26:05.929089 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2359/4895] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:05 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1526 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:26:06.643160 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ce1c41b2-5680-455c-8e97-cac2d0dda8e5 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:06.645009 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ce1c41b2-5680-455c-8e97-cac2d0dda8e5 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:06.657789 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ce1c41b2-5680-455c-8e97-cac2d0dda8e5 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:06.658792 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ce1c41b2-5680-455c-8e97-cac2d0dda8e5 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:06.660118 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ce1c41b2-5680-455c-8e97-cac2d0dda8e5 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:06.661046 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ce1c41b2-5680-455c-8e97-cac2d0dda8e5 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:06.724013 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2f36bca7-7c3d-4d0f-a101-0b2776e017ad tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:06.724834 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2f36bca7-7c3d-4d0f-a101-0b2776e017ad tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:06.738301 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2f36bca7-7c3d-4d0f-a101-0b2776e017ad tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:06.738773 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2f36bca7-7c3d-4d0f-a101-0b2776e017ad tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:06.739611 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2f36bca7-7c3d-4d0f-a101-0b2776e017ad tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:06.740065 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2f36bca7-7c3d-4d0f-a101-0b2776e017ad tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:06.752888 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ce1c41b2-5680-455c-8e97-cac2d0dda8e5 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:06.772671 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ce1c41b2-5680-455c-8e97-cac2d0dda8e5 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:06.772671 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ce1c41b2-5680-455c-8e97-cac2d0dda8e5 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:06.773584 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ce1c41b2-5680-455c-8e97-cac2d0dda8e5 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce" status: 200 len: 1365 microversion: 2.47 time: 0.134521 Apr 16 21:26:06.774765 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2537/4896] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:06 2022] GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce => generated 1365 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:26:06.856664 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9a6206ce-ae39-49b5-a56d-9fd7a5c4d0b3 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:06.862986 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9a6206ce-ae39-49b5-a56d-9fd7a5c4d0b3 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:06.874164 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a6206ce-ae39-49b5-a56d-9fd7a5c4d0b3 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:06.874919 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a6206ce-ae39-49b5-a56d-9fd7a5c4d0b3 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:06.875906 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a6206ce-ae39-49b5-a56d-9fd7a5c4d0b3 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:06.876586 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a6206ce-ae39-49b5-a56d-9fd7a5c4d0b3 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:06.999724 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2f36bca7-7c3d-4d0f-a101-0b2776e017ad tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:07.011690 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2f36bca7-7c3d-4d0f-a101-0b2776e017ad tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 200 len: 1511 microversion: 2.1 time: 0.292783 Apr 16 21:26:07.023379 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2360/4897] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:06 2022] GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 1511 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:07.029128 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-add0b5b9-9dbb-47e2-bcac-bdf638f387fe tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:07.030190 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-add0b5b9-9dbb-47e2-bcac-bdf638f387fe tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:07.039342 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-add0b5b9-9dbb-47e2-bcac-bdf638f387fe tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:07.040241 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-add0b5b9-9dbb-47e2-bcac-bdf638f387fe tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:07.041524 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-add0b5b9-9dbb-47e2-bcac-bdf638f387fe tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:07.042153 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-add0b5b9-9dbb-47e2-bcac-bdf638f387fe tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:07.273867 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-add0b5b9-9dbb-47e2-bcac-bdf638f387fe tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:07.284308 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-add0b5b9-9dbb-47e2-bcac-bdf638f387fe tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1526 microversion: 2.1 time: 0.259266 Apr 16 21:26:07.286024 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2361/4898] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:07 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1526 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:07.332641 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9a6206ce-ae39-49b5-a56d-9fd7a5c4d0b3 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:07.352208 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9a6206ce-ae39-49b5-a56d-9fd7a5c4d0b3 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:07.358183 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9a6206ce-ae39-49b5-a56d-9fd7a5c4d0b3 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:07.359988 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9a6206ce-ae39-49b5-a56d-9fd7a5c4d0b3 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] 10.222.0.20 "GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2" status: 200 len: 1335 microversion: 2.57 time: 0.510384 Apr 16 21:26:07.360703 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2538/4899] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:06 2022] GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2 => generated 1335 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:26:07.794818 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c57fb85b-61dd-4845-8e43-858762e605fd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:07.795450 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c57fb85b-61dd-4845-8e43-858762e605fd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:07.802568 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c57fb85b-61dd-4845-8e43-858762e605fd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:07.803505 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c57fb85b-61dd-4845-8e43-858762e605fd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:07.804614 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c57fb85b-61dd-4845-8e43-858762e605fd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:07.805069 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c57fb85b-61dd-4845-8e43-858762e605fd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:07.906503 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c57fb85b-61dd-4845-8e43-858762e605fd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:07.914837 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c57fb85b-61dd-4845-8e43-858762e605fd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:07.919905 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c57fb85b-61dd-4845-8e43-858762e605fd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:07.923105 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c57fb85b-61dd-4845-8e43-858762e605fd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce" status: 200 len: 1365 microversion: 2.47 time: 0.132202 Apr 16 21:26:07.925162 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2362/4900] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:07 2022] GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce => generated 1365 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:26:08.030247 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3a560b56-a2e3-44b2-b81a-90c0e50950be tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:08.031756 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3a560b56-a2e3-44b2-b81a-90c0e50950be tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:08.047262 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3a560b56-a2e3-44b2-b81a-90c0e50950be tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:08.048094 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3a560b56-a2e3-44b2-b81a-90c0e50950be tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:08.051922 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3a560b56-a2e3-44b2-b81a-90c0e50950be tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:08.052643 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3a560b56-a2e3-44b2-b81a-90c0e50950be tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:08.205637 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3a560b56-a2e3-44b2-b81a-90c0e50950be tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:08.215880 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3a560b56-a2e3-44b2-b81a-90c0e50950be tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 200 len: 1511 microversion: 2.1 time: 0.189945 Apr 16 21:26:08.216609 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2539/4901] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:08 2022] GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 1511 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:08.303723 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4b16fd5b-0c4d-4c1e-b69c-78f93f98ad6f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:08.304543 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4b16fd5b-0c4d-4c1e-b69c-78f93f98ad6f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:08.315558 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4b16fd5b-0c4d-4c1e-b69c-78f93f98ad6f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:08.316922 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4b16fd5b-0c4d-4c1e-b69c-78f93f98ad6f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:08.317955 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4b16fd5b-0c4d-4c1e-b69c-78f93f98ad6f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:08.319039 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4b16fd5b-0c4d-4c1e-b69c-78f93f98ad6f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:08.386014 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b96afc79-6a97-44df-bbb3-38eb57215a56 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:08.388332 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b96afc79-6a97-44df-bbb3-38eb57215a56 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:08.417581 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b96afc79-6a97-44df-bbb3-38eb57215a56 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:08.426923 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b96afc79-6a97-44df-bbb3-38eb57215a56 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:08.428212 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b96afc79-6a97-44df-bbb3-38eb57215a56 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:08.433673 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b96afc79-6a97-44df-bbb3-38eb57215a56 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:08.560988 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b96afc79-6a97-44df-bbb3-38eb57215a56 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:08.571392 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b96afc79-6a97-44df-bbb3-38eb57215a56 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:08.573534 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b96afc79-6a97-44df-bbb3-38eb57215a56 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:08.578093 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b96afc79-6a97-44df-bbb3-38eb57215a56 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] 10.222.0.20 "GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2" status: 200 len: 1335 microversion: 2.57 time: 0.197383 Apr 16 21:26:08.578093 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2540/4902] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:08 2022] GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2 => generated 1335 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:26:08.655373 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4b16fd5b-0c4d-4c1e-b69c-78f93f98ad6f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:08.683908 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4b16fd5b-0c4d-4c1e-b69c-78f93f98ad6f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1526 microversion: 2.1 time: 0.383685 Apr 16 21:26:08.688883 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2363/4903] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:08 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1526 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:08.943935 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c7cd90c4-af9b-4481-a29f-c7849bee8abc tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:08.944904 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c7cd90c4-af9b-4481-a29f-c7849bee8abc tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:08.951619 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c7cd90c4-af9b-4481-a29f-c7849bee8abc tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:08.952836 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c7cd90c4-af9b-4481-a29f-c7849bee8abc tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:08.954771 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c7cd90c4-af9b-4481-a29f-c7849bee8abc tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:08.955769 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c7cd90c4-af9b-4481-a29f-c7849bee8abc tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:09.028401 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c7cd90c4-af9b-4481-a29f-c7849bee8abc tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:09.038280 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c7cd90c4-af9b-4481-a29f-c7849bee8abc tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:09.041771 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c7cd90c4-af9b-4481-a29f-c7849bee8abc tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:09.043282 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c7cd90c4-af9b-4481-a29f-c7849bee8abc tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce" status: 200 len: 1365 microversion: 2.47 time: 0.103992 Apr 16 21:26:09.044029 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2541/4904] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:08 2022] GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce => generated 1365 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:26:09.233826 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b0f84ba8-60df-4f90-8059-63948ff40148 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:09.235063 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b0f84ba8-60df-4f90-8059-63948ff40148 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:09.243458 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b0f84ba8-60df-4f90-8059-63948ff40148 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:09.244203 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b0f84ba8-60df-4f90-8059-63948ff40148 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:09.245192 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b0f84ba8-60df-4f90-8059-63948ff40148 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:09.245643 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b0f84ba8-60df-4f90-8059-63948ff40148 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:09.435382 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b0f84ba8-60df-4f90-8059-63948ff40148 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:09.445169 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b0f84ba8-60df-4f90-8059-63948ff40148 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 200 len: 1511 microversion: 2.1 time: 0.215507 Apr 16 21:26:09.446433 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2364/4905] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:09 2022] GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 1511 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:09.594580 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b7f417df-e2de-4fa7-885b-9c2387b07675 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:09.595198 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b7f417df-e2de-4fa7-885b-9c2387b07675 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:09.602533 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b7f417df-e2de-4fa7-885b-9c2387b07675 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:09.602991 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b7f417df-e2de-4fa7-885b-9c2387b07675 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:09.603774 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b7f417df-e2de-4fa7-885b-9c2387b07675 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:09.604251 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b7f417df-e2de-4fa7-885b-9c2387b07675 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:09.714532 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b7f417df-e2de-4fa7-885b-9c2387b07675 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:09.714532 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b7f417df-e2de-4fa7-885b-9c2387b07675 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:09.714532 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b7f417df-e2de-4fa7-885b-9c2387b07675 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:09.714532 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b7f417df-e2de-4fa7-885b-9c2387b07675 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] 10.222.0.20 "GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2" status: 200 len: 1356 microversion: 2.57 time: 0.091156 Apr 16 21:26:09.714532 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2542/4906] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:09 2022] GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2 => generated 1356 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:26:09.715718 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-81af2668-3b0f-4a6e-891f-b10a6762e031 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:09.715718 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-81af2668-3b0f-4a6e-891f-b10a6762e031 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:09.715718 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-81af2668-3b0f-4a6e-891f-b10a6762e031 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:09.715718 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-81af2668-3b0f-4a6e-891f-b10a6762e031 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:09.715718 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-81af2668-3b0f-4a6e-891f-b10a6762e031 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:09.715718 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-81af2668-3b0f-4a6e-891f-b10a6762e031 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:09.732848 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-dec2ac89-c1ae-429b-8775-95a867a1f17b tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:26:09.734476 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-dec2ac89-c1ae-429b-8775-95a867a1f17b tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:09.740971 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dec2ac89-c1ae-429b-8775-95a867a1f17b tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:09.744816 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dec2ac89-c1ae-429b-8775-95a867a1f17b tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:09.744816 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dec2ac89-c1ae-429b-8775-95a867a1f17b tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:09.744816 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dec2ac89-c1ae-429b-8775-95a867a1f17b tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:09.818358 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-dec2ac89-c1ae-429b-8775-95a867a1f17b tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:26:09.818792 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-dec2ac89-c1ae-429b-8775-95a867a1f17b tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:26:09.819335 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-dec2ac89-c1ae-429b-8775-95a867a1f17b tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:26:09.819764 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-dec2ac89-c1ae-429b-8775-95a867a1f17b tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:26:09.820203 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-dec2ac89-c1ae-429b-8775-95a867a1f17b tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:26:09.965800 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-81af2668-3b0f-4a6e-891f-b10a6762e031 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:09.978188 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-81af2668-3b0f-4a6e-891f-b10a6762e031 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1526 microversion: 2.1 time: 0.276828 Apr 16 21:26:09.979092 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2365/4907] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:09 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1526 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:26:10.053290 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-dec2ac89-c1ae-429b-8775-95a867a1f17b tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:10.063870 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4718a4e4-8e83-4f5a-93b3-5e4585735831 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:10.064806 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4718a4e4-8e83-4f5a-93b3-5e4585735831 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:10.065496 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dec2ac89-c1ae-429b-8775-95a867a1f17b tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:10.066419 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dec2ac89-c1ae-429b-8775-95a867a1f17b tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:10.067941 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dec2ac89-c1ae-429b-8775-95a867a1f17b tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:10.068684 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dec2ac89-c1ae-429b-8775-95a867a1f17b tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:10.079263 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4718a4e4-8e83-4f5a-93b3-5e4585735831 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:10.079728 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4718a4e4-8e83-4f5a-93b3-5e4585735831 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:10.085825 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4718a4e4-8e83-4f5a-93b3-5e4585735831 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:10.086301 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4718a4e4-8e83-4f5a-93b3-5e4585735831 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:10.110561 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-dec2ac89-c1ae-429b-8775-95a867a1f17b tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] 10.222.0.20 "POST /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2/action" status: 202 len: 1137 microversion: 2.57 time: 0.381500 Apr 16 21:26:10.112715 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2543/4908] 10.222.0.20 () {62 vars in 1319 bytes} [Sat Apr 16 21:26:09 2022] POST /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2/action => generated 1137 bytes in 383 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Apr 16 21:26:10.132253 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-03f196d2-8e08-4b47-bcc6-0bb0915d12e8 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:10.133490 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-03f196d2-8e08-4b47-bcc6-0bb0915d12e8 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:10.140313 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-03f196d2-8e08-4b47-bcc6-0bb0915d12e8 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:10.141470 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-03f196d2-8e08-4b47-bcc6-0bb0915d12e8 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:10.142231 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-03f196d2-8e08-4b47-bcc6-0bb0915d12e8 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:10.142926 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-03f196d2-8e08-4b47-bcc6-0bb0915d12e8 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:10.173821 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4718a4e4-8e83-4f5a-93b3-5e4585735831 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:10.187586 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4718a4e4-8e83-4f5a-93b3-5e4585735831 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:10.189240 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4718a4e4-8e83-4f5a-93b3-5e4585735831 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:10.190986 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4718a4e4-8e83-4f5a-93b3-5e4585735831 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce" status: 200 len: 1365 microversion: 2.47 time: 0.131642 Apr 16 21:26:10.193066 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2366/4909] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:10 2022] GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce => generated 1365 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:26:10.215055 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-03f196d2-8e08-4b47-bcc6-0bb0915d12e8 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:10.232247 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-03f196d2-8e08-4b47-bcc6-0bb0915d12e8 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:10.234188 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-03f196d2-8e08-4b47-bcc6-0bb0915d12e8 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:10.236235 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-03f196d2-8e08-4b47-bcc6-0bb0915d12e8 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] 10.222.0.20 "GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2" status: 200 len: 1365 microversion: 2.57 time: 0.111037 Apr 16 21:26:10.250044 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2544/4910] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:10 2022] GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2 => generated 1365 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:26:10.464060 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-435c3903-51cb-488c-938b-938e70bdaebf tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:10.465515 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-435c3903-51cb-488c-938b-938e70bdaebf tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:10.475339 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-435c3903-51cb-488c-938b-938e70bdaebf tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:10.478343 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-435c3903-51cb-488c-938b-938e70bdaebf tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:10.479412 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-435c3903-51cb-488c-938b-938e70bdaebf tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:10.480241 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-435c3903-51cb-488c-938b-938e70bdaebf tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:10.673267 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-435c3903-51cb-488c-938b-938e70bdaebf tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:10.682334 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-435c3903-51cb-488c-938b-938e70bdaebf tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 200 len: 1511 microversion: 2.1 time: 0.222951 Apr 16 21:26:10.684702 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2367/4911] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:10 2022] GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 1511 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:10.995068 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-87d2ac80-d855-42a1-a924-72d106511763 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:10.995939 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-87d2ac80-d855-42a1-a924-72d106511763 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:11.003569 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-87d2ac80-d855-42a1-a924-72d106511763 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:11.004116 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-87d2ac80-d855-42a1-a924-72d106511763 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:11.005012 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-87d2ac80-d855-42a1-a924-72d106511763 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:11.005527 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-87d2ac80-d855-42a1-a924-72d106511763 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:11.211458 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-eb4acd08-3512-4686-97f5-eaa9f626ee20 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:11.212077 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-eb4acd08-3512-4686-97f5-eaa9f626ee20 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:11.218041 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eb4acd08-3512-4686-97f5-eaa9f626ee20 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:11.218502 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eb4acd08-3512-4686-97f5-eaa9f626ee20 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:11.219289 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eb4acd08-3512-4686-97f5-eaa9f626ee20 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:11.219737 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eb4acd08-3512-4686-97f5-eaa9f626ee20 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:11.238079 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-87d2ac80-d855-42a1-a924-72d106511763 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:11.246235 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-87d2ac80-d855-42a1-a924-72d106511763 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1526 microversion: 2.1 time: 0.255239 Apr 16 21:26:11.246812 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2545/4912] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:10 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1526 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:11.268110 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c271b805-4e98-49d2-ad73-44539c8a299c tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:11.269059 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c271b805-4e98-49d2-ad73-44539c8a299c tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:11.275135 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c271b805-4e98-49d2-ad73-44539c8a299c tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:11.279576 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c271b805-4e98-49d2-ad73-44539c8a299c tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:11.279576 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c271b805-4e98-49d2-ad73-44539c8a299c tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:11.279576 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c271b805-4e98-49d2-ad73-44539c8a299c tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:11.285816 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-eb4acd08-3512-4686-97f5-eaa9f626ee20 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:11.294904 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-eb4acd08-3512-4686-97f5-eaa9f626ee20 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:11.296645 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-eb4acd08-3512-4686-97f5-eaa9f626ee20 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:11.297845 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-eb4acd08-3512-4686-97f5-eaa9f626ee20 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce" status: 200 len: 1371 microversion: 2.47 time: 0.090376 Apr 16 21:26:11.298419 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2368/4913] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:11 2022] GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce => generated 1371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:26:11.363363 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c271b805-4e98-49d2-ad73-44539c8a299c tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:11.371859 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c271b805-4e98-49d2-ad73-44539c8a299c tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:11.373342 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c271b805-4e98-49d2-ad73-44539c8a299c tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:11.374539 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c271b805-4e98-49d2-ad73-44539c8a299c tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] 10.222.0.20 "GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2" status: 200 len: 1365 microversion: 2.57 time: 0.110360 Apr 16 21:26:11.375100 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2546/4914] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:11 2022] GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2 => generated 1365 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:26:11.708588 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-23caebd7-53df-4c72-9da9-a1a7e5b60246 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:11.709203 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-23caebd7-53df-4c72-9da9-a1a7e5b60246 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:11.716460 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-23caebd7-53df-4c72-9da9-a1a7e5b60246 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:11.716960 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-23caebd7-53df-4c72-9da9-a1a7e5b60246 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:11.717776 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-23caebd7-53df-4c72-9da9-a1a7e5b60246 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:11.718218 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-23caebd7-53df-4c72-9da9-a1a7e5b60246 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:11.887806 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-23caebd7-53df-4c72-9da9-a1a7e5b60246 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:11.895184 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-23caebd7-53df-4c72-9da9-a1a7e5b60246 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 200 len: 1511 microversion: 2.1 time: 0.190642 Apr 16 21:26:11.895769 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2369/4915] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:11 2022] GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 1511 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:26:12.265569 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1dccb215-6eb3-4955-8fdb-c9d9ecca9a4b tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:12.269567 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1dccb215-6eb3-4955-8fdb-c9d9ecca9a4b tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:12.281929 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1dccb215-6eb3-4955-8fdb-c9d9ecca9a4b tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:12.282389 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1dccb215-6eb3-4955-8fdb-c9d9ecca9a4b tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:12.283352 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1dccb215-6eb3-4955-8fdb-c9d9ecca9a4b tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:12.284228 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1dccb215-6eb3-4955-8fdb-c9d9ecca9a4b tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:12.319211 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-70924914-df9e-4777-91d8-9d2683d138ab tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:12.320070 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-70924914-df9e-4777-91d8-9d2683d138ab tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:12.327344 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-70924914-df9e-4777-91d8-9d2683d138ab tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:12.328152 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-70924914-df9e-4777-91d8-9d2683d138ab tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:12.329407 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-70924914-df9e-4777-91d8-9d2683d138ab tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:12.329861 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-70924914-df9e-4777-91d8-9d2683d138ab tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:12.413729 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-70924914-df9e-4777-91d8-9d2683d138ab tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:12.422441 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-70924914-df9e-4777-91d8-9d2683d138ab tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:12.424100 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-70924914-df9e-4777-91d8-9d2683d138ab tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:12.425492 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-70924914-df9e-4777-91d8-9d2683d138ab tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce" status: 200 len: 1371 microversion: 2.47 time: 0.110863 Apr 16 21:26:12.426346 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2370/4916] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:12 2022] GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce => generated 1371 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:26:12.438333 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a1a0c7d4-1089-4058-896b-174a2b2f616e tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:12.439021 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a1a0c7d4-1089-4058-896b-174a2b2f616e tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:12.445901 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a1a0c7d4-1089-4058-896b-174a2b2f616e tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:12.446490 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a1a0c7d4-1089-4058-896b-174a2b2f616e tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:12.447421 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a1a0c7d4-1089-4058-896b-174a2b2f616e tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:12.448031 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a1a0c7d4-1089-4058-896b-174a2b2f616e tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:12.518385 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1dccb215-6eb3-4955-8fdb-c9d9ecca9a4b tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:12.527962 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1dccb215-6eb3-4955-8fdb-c9d9ecca9a4b tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1508 microversion: 2.1 time: 0.267383 Apr 16 21:26:12.528940 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2547/4917] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:12 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1508 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:12.541034 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a1a0c7d4-1089-4058-896b-174a2b2f616e tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:12.553905 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a1a0c7d4-1089-4058-896b-174a2b2f616e tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:12.555627 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a1a0c7d4-1089-4058-896b-174a2b2f616e tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:12.557055 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a1a0c7d4-1089-4058-896b-174a2b2f616e tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] 10.222.0.20 "GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2" status: 200 len: 1365 microversion: 2.57 time: 0.129900 Apr 16 21:26:12.557956 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2371/4918] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:12 2022] GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2 => generated 1365 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:26:12.912922 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3df85e53-c828-4898-a92c-27cb53d987f3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:12.913541 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3df85e53-c828-4898-a92c-27cb53d987f3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:12.920091 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3df85e53-c828-4898-a92c-27cb53d987f3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:12.920585 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3df85e53-c828-4898-a92c-27cb53d987f3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:12.921395 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3df85e53-c828-4898-a92c-27cb53d987f3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:12.921803 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3df85e53-c828-4898-a92c-27cb53d987f3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:13.070316 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3df85e53-c828-4898-a92c-27cb53d987f3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:13.078059 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3df85e53-c828-4898-a92c-27cb53d987f3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 200 len: 1511 microversion: 2.1 time: 0.169122 Apr 16 21:26:13.078843 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2548/4919] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:12 2022] GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 1511 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:13.445292 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c3e01ff5-a90f-43b7-acee-2aa895611e3f tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:13.445934 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c3e01ff5-a90f-43b7-acee-2aa895611e3f tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:13.452835 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c3e01ff5-a90f-43b7-acee-2aa895611e3f tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:13.453292 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c3e01ff5-a90f-43b7-acee-2aa895611e3f tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:13.454076 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c3e01ff5-a90f-43b7-acee-2aa895611e3f tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:13.454518 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c3e01ff5-a90f-43b7-acee-2aa895611e3f tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:13.525534 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c3e01ff5-a90f-43b7-acee-2aa895611e3f tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:13.534996 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c3e01ff5-a90f-43b7-acee-2aa895611e3f tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:13.536575 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c3e01ff5-a90f-43b7-acee-2aa895611e3f tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:13.540410 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c3e01ff5-a90f-43b7-acee-2aa895611e3f tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce" status: 200 len: 1371 microversion: 2.47 time: 0.096897 Apr 16 21:26:13.540410 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2372/4920] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:13 2022] GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce => generated 1371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:26:13.546125 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5b0b408b-7c66-4696-a69f-1b197256a7c0 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:13.546797 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5b0b408b-7c66-4696-a69f-1b197256a7c0 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:13.553815 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5b0b408b-7c66-4696-a69f-1b197256a7c0 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:13.554280 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5b0b408b-7c66-4696-a69f-1b197256a7c0 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:13.555060 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5b0b408b-7c66-4696-a69f-1b197256a7c0 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:13.555506 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5b0b408b-7c66-4696-a69f-1b197256a7c0 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:13.576506 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b8c7839d-6b64-425a-aa26-1f5a0f743aa0 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:13.577172 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b8c7839d-6b64-425a-aa26-1f5a0f743aa0 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:13.585139 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b8c7839d-6b64-425a-aa26-1f5a0f743aa0 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:13.585612 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b8c7839d-6b64-425a-aa26-1f5a0f743aa0 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:13.586412 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b8c7839d-6b64-425a-aa26-1f5a0f743aa0 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:13.586869 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b8c7839d-6b64-425a-aa26-1f5a0f743aa0 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:13.652665 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b8c7839d-6b64-425a-aa26-1f5a0f743aa0 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:13.660003 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b8c7839d-6b64-425a-aa26-1f5a0f743aa0 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:13.661579 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b8c7839d-6b64-425a-aa26-1f5a0f743aa0 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:13.662768 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b8c7839d-6b64-425a-aa26-1f5a0f743aa0 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] 10.222.0.20 "GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2" status: 200 len: 1365 microversion: 2.57 time: 0.090393 Apr 16 21:26:13.663341 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2373/4921] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:13 2022] GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2 => generated 1365 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:26:13.692908 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5b0b408b-7c66-4696-a69f-1b197256a7c0 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:13.700618 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5b0b408b-7c66-4696-a69f-1b197256a7c0 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1508 microversion: 2.1 time: 0.158572 Apr 16 21:26:13.701228 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2549/4922] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:13 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:14.097773 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6ce3e1b7-51df-4850-b2db-b4e218877a21 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:14.098442 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6ce3e1b7-51df-4850-b2db-b4e218877a21 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:14.104690 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6ce3e1b7-51df-4850-b2db-b4e218877a21 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:14.105190 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6ce3e1b7-51df-4850-b2db-b4e218877a21 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:14.105983 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6ce3e1b7-51df-4850-b2db-b4e218877a21 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:14.106435 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6ce3e1b7-51df-4850-b2db-b4e218877a21 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:14.246353 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6ce3e1b7-51df-4850-b2db-b4e218877a21 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:14.254812 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6ce3e1b7-51df-4850-b2db-b4e218877a21 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 200 len: 1511 microversion: 2.1 time: 0.161068 Apr 16 21:26:14.255477 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2374/4923] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:14 2022] GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 1511 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:14.559544 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f5863b96-8575-407c-bc0f-101edecb942a tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:14.559544 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f5863b96-8575-407c-bc0f-101edecb942a tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:14.564181 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f5863b96-8575-407c-bc0f-101edecb942a tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:14.564764 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f5863b96-8575-407c-bc0f-101edecb942a tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:14.566075 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f5863b96-8575-407c-bc0f-101edecb942a tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:14.566542 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f5863b96-8575-407c-bc0f-101edecb942a tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:14.632116 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f5863b96-8575-407c-bc0f-101edecb942a tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:14.641024 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f5863b96-8575-407c-bc0f-101edecb942a tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:14.642537 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f5863b96-8575-407c-bc0f-101edecb942a tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:14.644290 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f5863b96-8575-407c-bc0f-101edecb942a tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce" status: 200 len: 1356 microversion: 2.47 time: 0.091736 Apr 16 21:26:14.645001 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2550/4924] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:14 2022] GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce => generated 1356 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:26:14.667991 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-aee0d714-f5ba-4ca0-afad-92a237b9eebd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:14.671432 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-aee0d714-f5ba-4ca0-afad-92a237b9eebd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:14.672339 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-aee0d714-f5ba-4ca0-afad-92a237b9eebd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Searching by: {'deleted': False, 'project_id': 'a919bcedab644defad61a065b44d7887'} {{(pid=137409) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 21:26:14.678609 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aee0d714-f5ba-4ca0-afad-92a237b9eebd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:14.679314 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aee0d714-f5ba-4ca0-afad-92a237b9eebd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:14.685402 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aee0d714-f5ba-4ca0-afad-92a237b9eebd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:14.685402 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aee0d714-f5ba-4ca0-afad-92a237b9eebd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:14.685692 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5bf5a932-edcc-4148-be41-ae3269687c3c tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:14.685692 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5bf5a932-edcc-4148-be41-ae3269687c3c tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:14.692268 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5bf5a932-edcc-4148-be41-ae3269687c3c tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:14.692834 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5bf5a932-edcc-4148-be41-ae3269687c3c tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:14.693627 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5bf5a932-edcc-4148-be41-ae3269687c3c tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:14.694836 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5bf5a932-edcc-4148-be41-ae3269687c3c tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:14.766966 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5bf5a932-edcc-4148-be41-ae3269687c3c tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:14.778060 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5bf5a932-edcc-4148-be41-ae3269687c3c tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:14.779577 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5bf5a932-edcc-4148-be41-ae3269687c3c tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:14.781689 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5bf5a932-edcc-4148-be41-ae3269687c3c tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] 10.222.0.20 "GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2" status: 200 len: 1365 microversion: 2.57 time: 0.103297 Apr 16 21:26:14.792720 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2551/4925] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:14 2022] GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2 => generated 1365 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:26:14.797446 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8add67c2-9e69-4bac-b702-677a5ec51c37 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:14.798120 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8add67c2-9e69-4bac-b702-677a5ec51c37 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:14.806485 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8add67c2-9e69-4bac-b702-677a5ec51c37 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:14.807217 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8add67c2-9e69-4bac-b702-677a5ec51c37 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:14.808808 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8add67c2-9e69-4bac-b702-677a5ec51c37 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:14.808935 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.multi_cell_list [None req-aee0d714-f5ba-4ca0-afad-92a237b9eebd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=137409) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 16 21:26:14.809958 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8add67c2-9e69-4bac-b702-677a5ec51c37 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:14.892295 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-aee0d714-f5ba-4ca0-afad-92a237b9eebd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:14.899587 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aee0d714-f5ba-4ca0-afad-92a237b9eebd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:14.900043 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aee0d714-f5ba-4ca0-afad-92a237b9eebd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:14.911303 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-aee0d714-f5ba-4ca0-afad-92a237b9eebd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:14.913244 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-aee0d714-f5ba-4ca0-afad-92a237b9eebd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:14.948612 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-aee0d714-f5ba-4ca0-afad-92a237b9eebd tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.284558 Apr 16 21:26:14.958704 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2375/4926] 10.222.0.20 () {60 vars in 1186 bytes} [Sat Apr 16 21:26:14 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:26:14.959856 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8add67c2-9e69-4bac-b702-677a5ec51c37 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:14.969333 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8add67c2-9e69-4bac-b702-677a5ec51c37 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1508 microversion: 2.1 time: 0.181498 Apr 16 21:26:14.969333 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2552/4927] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:14 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1508 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:14.979932 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ca04ff0a-0f12-4f2e-b665-868fe7857bcf tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:14.980387 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ca04ff0a-0f12-4f2e-b665-868fe7857bcf tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:14.986812 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ca04ff0a-0f12-4f2e-b665-868fe7857bcf tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:14.987898 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ca04ff0a-0f12-4f2e-b665-868fe7857bcf tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:14.988716 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ca04ff0a-0f12-4f2e-b665-868fe7857bcf tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:14.989159 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ca04ff0a-0f12-4f2e-b665-868fe7857bcf tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:15.015257 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ca04ff0a-0f12-4f2e-b665-868fe7857bcf tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:26:15.271984 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ea543aca-5474-4dce-bca3-3b68241492d2 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:15.272825 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ea543aca-5474-4dce-bca3-3b68241492d2 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:15.279677 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ea543aca-5474-4dce-bca3-3b68241492d2 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:15.280147 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ea543aca-5474-4dce-bca3-3b68241492d2 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:15.280975 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ea543aca-5474-4dce-bca3-3b68241492d2 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:15.281430 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ea543aca-5474-4dce-bca3-3b68241492d2 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:15.300746 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ca04ff0a-0f12-4f2e-b665-868fe7857bcf tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce" status: 204 len: 0 microversion: 2.47 time: 0.323181 Apr 16 21:26:15.306637 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2376/4928] 10.222.0.20 () {60 vars in 1279 bytes} [Sat Apr 16 21:26:14 2022] DELETE /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce => generated 0 bytes in 326 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 16 21:26:15.330138 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e55230c9-9b30-48af-b471-7be2aa2bbfa9 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:15.330138 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e55230c9-9b30-48af-b471-7be2aa2bbfa9 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:15.349200 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e55230c9-9b30-48af-b471-7be2aa2bbfa9 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:15.350483 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e55230c9-9b30-48af-b471-7be2aa2bbfa9 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:15.353055 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e55230c9-9b30-48af-b471-7be2aa2bbfa9 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:15.353055 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e55230c9-9b30-48af-b471-7be2aa2bbfa9 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:15.445995 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ea543aca-5474-4dce-bca3-3b68241492d2 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:15.454919 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ea543aca-5474-4dce-bca3-3b68241492d2 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 200 len: 1511 microversion: 2.1 time: 0.186975 Apr 16 21:26:15.456033 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2553/4929] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:15 2022] GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 1511 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:26:15.460989 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c9122bbf-7c6e-48aa-9919-48b57c427147 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:15.461499 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c9122bbf-7c6e-48aa-9919-48b57c427147 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 0c30b376-2903-4058-b436-4644778f3352] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:15.468396 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c9122bbf-7c6e-48aa-9919-48b57c427147 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:15.468707 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c9122bbf-7c6e-48aa-9919-48b57c427147 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:15.469103 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e55230c9-9b30-48af-b471-7be2aa2bbfa9 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:15.469501 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c9122bbf-7c6e-48aa-9919-48b57c427147 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:15.469948 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c9122bbf-7c6e-48aa-9919-48b57c427147 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:15.479625 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e55230c9-9b30-48af-b471-7be2aa2bbfa9 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:15.481161 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e55230c9-9b30-48af-b471-7be2aa2bbfa9 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:15.482634 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e55230c9-9b30-48af-b471-7be2aa2bbfa9 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce" status: 200 len: 1362 microversion: 2.47 time: 0.174616 Apr 16 21:26:15.494649 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2377/4930] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:15 2022] GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:26:15.507719 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c9122bbf-7c6e-48aa-9919-48b57c427147 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352/ips" status: 200 len: 150 microversion: 2.1 time: 0.050408 Apr 16 21:26:15.511360 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2554/4931] 10.222.0.20 () {58 vars in 1247 bytes} [Sat Apr 16 21:26:15 2022] GET /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352/ips => generated 150 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:26:15.521521 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-99f9fb2c-60ea-4265-831b-1cb5ec62e393 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a89555a4-c1fe-4512-9779-1ac4ed29f291"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:26:15.522658 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-99f9fb2c-60ea-4265-831b-1cb5ec62e393 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 0c30b376-2903-4058-b436-4644778f3352] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:15.529396 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-99f9fb2c-60ea-4265-831b-1cb5ec62e393 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:15.529856 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-99f9fb2c-60ea-4265-831b-1cb5ec62e393 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:15.530631 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-99f9fb2c-60ea-4265-831b-1cb5ec62e393 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:15.531070 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-99f9fb2c-60ea-4265-831b-1cb5ec62e393 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:15.611279 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-99f9fb2c-60ea-4265-831b-1cb5ec62e393 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] HTTP exception thrown: Invalid volume: volume a89555a4-c1fe-4512-9779-1ac4ed29f291 is already attached to instances: 8d623e8d-480f-48ef-b90c-04450df4aec8 Apr 16 21:26:15.611918 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-99f9fb2c-60ea-4265-831b-1cb5ec62e393 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Returning 400 to user: Invalid volume: volume a89555a4-c1fe-4512-9779-1ac4ed29f291 is already attached to instances: 8d623e8d-480f-48ef-b90c-04450df4aec8 {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:26:15.613343 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-99f9fb2c-60ea-4265-831b-1cb5ec62e393 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "POST /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095959 Apr 16 21:26:15.613885 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2378/4932] 10.222.0.20 () {60 vars in 1322 bytes} [Sat Apr 16 21:26:15 2022] POST /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:26:15.622268 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6a2012bb-d0ec-4ddc-a233-b98730d70437 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:15.622786 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6a2012bb-d0ec-4ddc-a233-b98730d70437 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 0c30b376-2903-4058-b436-4644778f3352] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:15.632261 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6a2012bb-d0ec-4ddc-a233-b98730d70437 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:15.632261 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6a2012bb-d0ec-4ddc-a233-b98730d70437 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:15.632261 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6a2012bb-d0ec-4ddc-a233-b98730d70437 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:15.632261 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6a2012bb-d0ec-4ddc-a233-b98730d70437 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:15.656712 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6a2012bb-d0ec-4ddc-a233-b98730d70437 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 0c30b376-2903-4058-b436-4644778f3352] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:26:15.801798 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3b30fea4-f261-4fef-abe2-be20d1694da8 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:15.802420 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3b30fea4-f261-4fef-abe2-be20d1694da8 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:15.809146 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3b30fea4-f261-4fef-abe2-be20d1694da8 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:15.809613 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3b30fea4-f261-4fef-abe2-be20d1694da8 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:15.810480 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3b30fea4-f261-4fef-abe2-be20d1694da8 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:15.810926 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3b30fea4-f261-4fef-abe2-be20d1694da8 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:15.885886 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3b30fea4-f261-4fef-abe2-be20d1694da8 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:15.898574 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3b30fea4-f261-4fef-abe2-be20d1694da8 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:15.900693 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3b30fea4-f261-4fef-abe2-be20d1694da8 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:15.903497 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3b30fea4-f261-4fef-abe2-be20d1694da8 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] 10.222.0.20 "GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2" status: 200 len: 1365 microversion: 2.57 time: 0.104926 Apr 16 21:26:15.903497 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2379/4933] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:15 2022] GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2 => generated 1365 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:26:15.908291 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-e60fb09c-9bcc-48c0-a410-01974e8b86bc req-e4b8b007-e531-4833-99d8-1d4784597fc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daf189e2-7cb4-4dab-94cf-ffdceb314df7", "name": "network-vif-unplugged", "status": "completed", "tag": "29f0877d-908a-47df-aa37-d5dcea212e40"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:26:15.917306 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-e60fb09c-9bcc-48c0-a410-01974e8b86bc req-e4b8b007-e531-4833-99d8-1d4784597fc7 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:15.917785 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-e60fb09c-9bcc-48c0-a410-01974e8b86bc req-e4b8b007-e531-4833-99d8-1d4784597fc7 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:15.929400 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.compute.server_external_events [req-e60fb09c-9bcc-48c0-a410-01974e8b86bc req-e4b8b007-e531-4833-99d8-1d4784597fc7 service nova] Unable to find a host for instance daf189e2-7cb4-4dab-94cf-ffdceb314df7. Dropping event network-vif-unplugged {{(pid=137409) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Apr 16 21:26:15.930590 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-e60fb09c-9bcc-48c0-a410-01974e8b86bc req-e4b8b007-e531-4833-99d8-1d4784597fc7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025688 Apr 16 21:26:15.931693 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2380/4934] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 28 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 16 21:26:15.982193 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-248dbf16-87a8-4d7a-86c9-9fd0c9a7d6c4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:15.982814 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-248dbf16-87a8-4d7a-86c9-9fd0c9a7d6c4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:15.989152 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-248dbf16-87a8-4d7a-86c9-9fd0c9a7d6c4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:15.989616 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-248dbf16-87a8-4d7a-86c9-9fd0c9a7d6c4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:15.990406 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-248dbf16-87a8-4d7a-86c9-9fd0c9a7d6c4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:15.990848 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-248dbf16-87a8-4d7a-86c9-9fd0c9a7d6c4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:16.021799 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6a2012bb-d0ec-4ddc-a233-b98730d70437 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352" status: 204 len: 0 microversion: 2.1 time: 0.403075 Apr 16 21:26:16.022398 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2555/4935] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:26:15 2022] DELETE /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:26:16.031449 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a9e68b97-cb4a-4b8e-b924-a7349cda3462 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:16.032111 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a9e68b97-cb4a-4b8e-b924-a7349cda3462 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 0c30b376-2903-4058-b436-4644778f3352] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:16.038918 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9e68b97-cb4a-4b8e-b924-a7349cda3462 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:16.039381 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9e68b97-cb4a-4b8e-b924-a7349cda3462 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:16.040165 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9e68b97-cb4a-4b8e-b924-a7349cda3462 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:16.040639 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9e68b97-cb4a-4b8e-b924-a7349cda3462 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:16.152045 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-248dbf16-87a8-4d7a-86c9-9fd0c9a7d6c4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:16.160305 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-248dbf16-87a8-4d7a-86c9-9fd0c9a7d6c4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1451 microversion: 2.1 time: 0.182067 Apr 16 21:26:16.161481 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2381/4936] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:15 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1451 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:16.176790 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1545b27c-2b9e-4542-9092-6e983764fe6d tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:16.177406 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1545b27c-2b9e-4542-9092-6e983764fe6d tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:16.178422 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a9e68b97-cb4a-4b8e-b924-a7349cda3462 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:16.183365 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1545b27c-2b9e-4542-9092-6e983764fe6d tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:16.183827 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1545b27c-2b9e-4542-9092-6e983764fe6d tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:16.184645 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1545b27c-2b9e-4542-9092-6e983764fe6d tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:16.185095 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1545b27c-2b9e-4542-9092-6e983764fe6d tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:16.186183 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a9e68b97-cb4a-4b8e-b924-a7349cda3462 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352" status: 200 len: 1681 microversion: 2.1 time: 0.158926 Apr 16 21:26:16.186764 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2556/4937] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:16 2022] GET /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:26:16.320894 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1545b27c-2b9e-4542-9092-6e983764fe6d tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:16.330498 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1545b27c-2b9e-4542-9092-6e983764fe6d tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1451 microversion: 2.1 time: 0.157390 Apr 16 21:26:16.331806 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2382/4938] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:16 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:26:16.379151 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-65260fde-5b89-4be7-a652-c5a14c4a6bc4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:26:16.379704 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-65260fde-5b89-4be7-a652-c5a14c4a6bc4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:16.386986 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-65260fde-5b89-4be7-a652-c5a14c4a6bc4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:16.387314 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-65260fde-5b89-4be7-a652-c5a14c4a6bc4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:16.388511 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-65260fde-5b89-4be7-a652-c5a14c4a6bc4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:16.388966 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-65260fde-5b89-4be7-a652-c5a14c4a6bc4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:16.413904 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-65260fde-5b89-4be7-a652-c5a14c4a6bc4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lazy-loading 'flavor' on Instance uuid daf189e2-7cb4-4dab-94cf-ffdceb314df7 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:26:16.426086 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-65260fde-5b89-4be7-a652-c5a14c4a6bc4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] HTTP exception thrown: Cannot 'shelve' instance daf189e2-7cb4-4dab-94cf-ffdceb314df7 while it is in vm_state shelved_offloaded Apr 16 21:26:16.426702 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-65260fde-5b89-4be7-a652-c5a14c4a6bc4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Returning 409 to user: Cannot 'shelve' instance daf189e2-7cb4-4dab-94cf-ffdceb314df7 while it is in vm_state shelved_offloaded {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:26:16.427712 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-65260fde-5b89-4be7-a652-c5a14c4a6bc4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "POST /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7/action" status: 409 len: 155 microversion: 2.1 time: 0.053845 Apr 16 21:26:16.428192 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2557/4939] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:26:16 2022] POST /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7/action => generated 155 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Apr 16 21:26:16.445498 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-972ff0dd-2143-468d-a43d-72885e1ecba1 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:26:16.446081 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-972ff0dd-2143-468d-a43d-72885e1ecba1 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:16.452538 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-972ff0dd-2143-468d-a43d-72885e1ecba1 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:16.453009 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-972ff0dd-2143-468d-a43d-72885e1ecba1 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:16.453791 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-972ff0dd-2143-468d-a43d-72885e1ecba1 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:16.454235 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-972ff0dd-2143-468d-a43d-72885e1ecba1 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:16.472615 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e3e02c99-9bf3-47e6-87d1-de5c9d5f8fe6 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:16.473392 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e3e02c99-9bf3-47e6-87d1-de5c9d5f8fe6 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:16.479930 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e3e02c99-9bf3-47e6-87d1-de5c9d5f8fe6 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:16.480534 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e3e02c99-9bf3-47e6-87d1-de5c9d5f8fe6 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:16.481390 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e3e02c99-9bf3-47e6-87d1-de5c9d5f8fe6 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:16.482032 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e3e02c99-9bf3-47e6-87d1-de5c9d5f8fe6 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:16.689886 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e3e02c99-9bf3-47e6-87d1-de5c9d5f8fe6 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:16.699199 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e3e02c99-9bf3-47e6-87d1-de5c9d5f8fe6 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 200 len: 1511 microversion: 2.1 time: 0.230662 Apr 16 21:26:16.699776 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2558/4940] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:16 2022] GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 1511 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:26:16.704671 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7514897c-fe06-4b64-ab39-fff5548c1742 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:16.710323 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7514897c-fe06-4b64-ab39-fff5548c1742 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:16.711763 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7514897c-fe06-4b64-ab39-fff5548c1742 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:16.712254 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7514897c-fe06-4b64-ab39-fff5548c1742 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:16.713049 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7514897c-fe06-4b64-ab39-fff5548c1742 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:16.713496 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7514897c-fe06-4b64-ab39-fff5548c1742 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:16.776000 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7514897c-fe06-4b64-ab39-fff5548c1742 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:16.784518 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7514897c-fe06-4b64-ab39-fff5548c1742 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:16.786098 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7514897c-fe06-4b64-ab39-fff5548c1742 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:16.787264 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7514897c-fe06-4b64-ab39-fff5548c1742 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce" status: 200 len: 1362 microversion: 2.47 time: 0.086265 Apr 16 21:26:16.787818 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2559/4941] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:16 2022] GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce => generated 1362 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:26:16.806535 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-972ff0dd-2143-468d-a43d-72885e1ecba1 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "POST /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7/action" status: 202 len: 0 microversion: 2.1 time: 0.364967 Apr 16 21:26:16.810055 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2383/4942] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:26:16 2022] POST /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7/action => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:26:16.815272 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5d1c906e-7eda-4066-be79-ab53c8c0b5a0 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:16.817958 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5d1c906e-7eda-4066-be79-ab53c8c0b5a0 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:16.822691 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5d1c906e-7eda-4066-be79-ab53c8c0b5a0 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:16.823151 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5d1c906e-7eda-4066-be79-ab53c8c0b5a0 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:16.823943 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5d1c906e-7eda-4066-be79-ab53c8c0b5a0 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:16.824463 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5d1c906e-7eda-4066-be79-ab53c8c0b5a0 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:16.925680 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cc37f4fd-b966-4693-89d0-7258a2b946f7 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:16.926304 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-cc37f4fd-b966-4693-89d0-7258a2b946f7 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:16.935427 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cc37f4fd-b966-4693-89d0-7258a2b946f7 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:16.935890 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cc37f4fd-b966-4693-89d0-7258a2b946f7 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:16.936705 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cc37f4fd-b966-4693-89d0-7258a2b946f7 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:16.937324 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cc37f4fd-b966-4693-89d0-7258a2b946f7 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:17.054683 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cc37f4fd-b966-4693-89d0-7258a2b946f7 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:17.065333 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cc37f4fd-b966-4693-89d0-7258a2b946f7 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:17.067513 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cc37f4fd-b966-4693-89d0-7258a2b946f7 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:17.068764 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cc37f4fd-b966-4693-89d0-7258a2b946f7 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] 10.222.0.20 "GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2" status: 200 len: 1365 microversion: 2.57 time: 0.147897 Apr 16 21:26:17.069630 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2384/4943] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:16 2022] GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:26:17.097275 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5d1c906e-7eda-4066-be79-ab53c8c0b5a0 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:17.106161 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5d1c906e-7eda-4066-be79-ab53c8c0b5a0 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1459 microversion: 2.1 time: 0.294795 Apr 16 21:26:17.107003 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2560/4944] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:16 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1459 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:26:17.209302 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-88d0f07c-499b-4975-a728-ba4a9f55cc49 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:17.209952 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-88d0f07c-499b-4975-a728-ba4a9f55cc49 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 0c30b376-2903-4058-b436-4644778f3352] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:17.216068 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-88d0f07c-499b-4975-a728-ba4a9f55cc49 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:17.216593 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-88d0f07c-499b-4975-a728-ba4a9f55cc49 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:17.217383 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-88d0f07c-499b-4975-a728-ba4a9f55cc49 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:17.217936 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-88d0f07c-499b-4975-a728-ba4a9f55cc49 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:17.717289 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-99db8243-34b4-4195-892b-5e29d561c247 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:17.717994 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-99db8243-34b4-4195-892b-5e29d561c247 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:17.725319 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-99db8243-34b4-4195-892b-5e29d561c247 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:17.725968 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-99db8243-34b4-4195-892b-5e29d561c247 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:17.727620 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-99db8243-34b4-4195-892b-5e29d561c247 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:17.728082 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-99db8243-34b4-4195-892b-5e29d561c247 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:17.748820 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-88d0f07c-499b-4975-a728-ba4a9f55cc49 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:17.757686 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-88d0f07c-499b-4975-a728-ba4a9f55cc49 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352" status: 200 len: 1681 microversion: 2.1 time: 0.551904 Apr 16 21:26:17.759231 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2385/4945] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:17 2022] GET /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352 => generated 1681 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:17.805684 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-70add755-bcc6-446a-af10-e835e1fcfb09 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:17.806310 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-70add755-bcc6-446a-af10-e835e1fcfb09 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:17.813285 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-70add755-bcc6-446a-af10-e835e1fcfb09 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:17.813819 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-70add755-bcc6-446a-af10-e835e1fcfb09 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:17.814533 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-70add755-bcc6-446a-af10-e835e1fcfb09 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:17.814982 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-70add755-bcc6-446a-af10-e835e1fcfb09 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:17.905169 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-70add755-bcc6-446a-af10-e835e1fcfb09 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:17.915851 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-70add755-bcc6-446a-af10-e835e1fcfb09 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:17.918062 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-70add755-bcc6-446a-af10-e835e1fcfb09 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:17.919241 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-70add755-bcc6-446a-af10-e835e1fcfb09 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce" status: 200 len: 1362 microversion: 2.47 time: 0.117530 Apr 16 21:26:17.919930 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2386/4946] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:17 2022] GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce => generated 1362 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:26:17.941775 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-99db8243-34b4-4195-892b-5e29d561c247 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:17.948071 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-99db8243-34b4-4195-892b-5e29d561c247 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 200 len: 1511 microversion: 2.1 time: 0.235004 Apr 16 21:26:17.948675 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2561/4947] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:17 2022] GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 1511 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:26:18.088069 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f0a35baa-7e44-404d-942d-3297afdf56d5 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:18.088978 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f0a35baa-7e44-404d-942d-3297afdf56d5 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:18.095875 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f0a35baa-7e44-404d-942d-3297afdf56d5 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:18.096375 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f0a35baa-7e44-404d-942d-3297afdf56d5 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:18.097246 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f0a35baa-7e44-404d-942d-3297afdf56d5 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:18.097696 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f0a35baa-7e44-404d-942d-3297afdf56d5 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:18.126859 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bc2de351-af6b-420b-9c63-04c29254a4b9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:18.128571 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-bc2de351-af6b-420b-9c63-04c29254a4b9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:18.136492 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bc2de351-af6b-420b-9c63-04c29254a4b9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:18.136968 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bc2de351-af6b-420b-9c63-04c29254a4b9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:18.137796 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bc2de351-af6b-420b-9c63-04c29254a4b9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:18.138315 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bc2de351-af6b-420b-9c63-04c29254a4b9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:18.187581 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f0a35baa-7e44-404d-942d-3297afdf56d5 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:18.201708 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f0a35baa-7e44-404d-942d-3297afdf56d5 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:18.203387 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f0a35baa-7e44-404d-942d-3297afdf56d5 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:18.204985 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f0a35baa-7e44-404d-942d-3297afdf56d5 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] 10.222.0.20 "GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2" status: 200 len: 1365 microversion: 2.57 time: 0.120950 Apr 16 21:26:18.206037 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2387/4948] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:18 2022] GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2 => generated 1365 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:26:18.340129 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-bc2de351-af6b-420b-9c63-04c29254a4b9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:18.349627 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-bc2de351-af6b-420b-9c63-04c29254a4b9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1459 microversion: 2.1 time: 0.226882 Apr 16 21:26:18.351973 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2562/4949] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:18 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1459 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:18.777143 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e6eb0d73-6b48-4f77-9caa-c1c815ad8a21 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:18.778281 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e6eb0d73-6b48-4f77-9caa-c1c815ad8a21 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 0c30b376-2903-4058-b436-4644778f3352] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:18.786543 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e6eb0d73-6b48-4f77-9caa-c1c815ad8a21 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:18.787277 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e6eb0d73-6b48-4f77-9caa-c1c815ad8a21 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:18.788261 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e6eb0d73-6b48-4f77-9caa-c1c815ad8a21 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:18.789025 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e6eb0d73-6b48-4f77-9caa-c1c815ad8a21 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:18.938121 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-42cd8073-d383-43c7-97be-7ee55947d39e tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:18.938835 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-42cd8073-d383-43c7-97be-7ee55947d39e tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 9838ce7c-364a-40b8-9a21-dc31a5e706ce] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:18.947359 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-42cd8073-d383-43c7-97be-7ee55947d39e tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:18.948163 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-42cd8073-d383-43c7-97be-7ee55947d39e tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:18.949229 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-42cd8073-d383-43c7-97be-7ee55947d39e tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:18.949917 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-42cd8073-d383-43c7-97be-7ee55947d39e tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:18.967363 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-42cd8073-d383-43c7-97be-7ee55947d39e tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] HTTP exception thrown: Instance 9838ce7c-364a-40b8-9a21-dc31a5e706ce could not be found. Apr 16 21:26:18.968465 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-42cd8073-d383-43c7-97be-7ee55947d39e tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Returning 404 to user: Instance 9838ce7c-364a-40b8-9a21-dc31a5e706ce could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:26:18.969445 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-42cd8073-d383-43c7-97be-7ee55947d39e tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce" status: 404 len: 111 microversion: 2.47 time: 0.035475 Apr 16 21:26:18.970319 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2563/4950] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:18 2022] GET /compute/v2.1/servers/9838ce7c-364a-40b8-9a21-dc31a5e706ce => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:26:18.978053 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-17f6363f-bd6f-460c-943f-9bbfd9f23e96 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:18.979093 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-17f6363f-bd6f-460c-943f-9bbfd9f23e96 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:18.989760 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-17f6363f-bd6f-460c-943f-9bbfd9f23e96 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:18.990699 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-17f6363f-bd6f-460c-943f-9bbfd9f23e96 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:18.991296 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-17f6363f-bd6f-460c-943f-9bbfd9f23e96 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:18.991935 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-17f6363f-bd6f-460c-943f-9bbfd9f23e96 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:19.033413 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e6eb0d73-6b48-4f77-9caa-c1c815ad8a21 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:19.043131 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e6eb0d73-6b48-4f77-9caa-c1c815ad8a21 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352" status: 200 len: 1681 microversion: 2.1 time: 0.270106 Apr 16 21:26:19.044095 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2388/4951] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:18 2022] GET /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352 => generated 1681 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:19.057565 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9dec3795-678a-4968-8491-4f68d3701f4f tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:19.060114 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9dec3795-678a-4968-8491-4f68d3701f4f tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 0835efc3-f9dd-47f0-a085-1fa8aeea993f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:19.069391 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9dec3795-678a-4968-8491-4f68d3701f4f tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:19.070307 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9dec3795-678a-4968-8491-4f68d3701f4f tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:19.071351 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9dec3795-678a-4968-8491-4f68d3701f4f tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:19.072008 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9dec3795-678a-4968-8491-4f68d3701f4f tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:19.110515 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9dec3795-678a-4968-8491-4f68d3701f4f tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 0835efc3-f9dd-47f0-a085-1fa8aeea993f] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:26:19.231365 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-17f6363f-bd6f-460c-943f-9bbfd9f23e96 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:19.243156 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-17f6363f-bd6f-460c-943f-9bbfd9f23e96 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 200 len: 1511 microversion: 2.1 time: 0.271406 Apr 16 21:26:19.249975 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2564/4952] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:18 2022] GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 1511 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:19.263036 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2b77e171-9703-41fc-ba72-4e78e350a27a tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:19.263627 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2b77e171-9703-41fc-ba72-4e78e350a27a tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:19.273953 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b77e171-9703-41fc-ba72-4e78e350a27a tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:19.276969 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b77e171-9703-41fc-ba72-4e78e350a27a tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:19.276969 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b77e171-9703-41fc-ba72-4e78e350a27a tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:19.276969 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b77e171-9703-41fc-ba72-4e78e350a27a tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:19.374641 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2b77e171-9703-41fc-ba72-4e78e350a27a tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:19.387172 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2b77e171-9703-41fc-ba72-4e78e350a27a tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:19.388850 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2b77e171-9703-41fc-ba72-4e78e350a27a tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:19.392192 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2b77e171-9703-41fc-ba72-4e78e350a27a tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] 10.222.0.20 "GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2" status: 200 len: 1365 microversion: 2.57 time: 0.145579 Apr 16 21:26:19.392192 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2565/4953] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:19 2022] GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2 => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:26:19.396625 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-632b5e5a-e6b3-4cb4-83f2-413c9ba24b24 req-6baa03e5-a390-4611-b187-fa7227ec1e31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c30b376-2903-4058-b436-4644778f3352", "name": "network-vif-deleted", "tag": "89aa2008-483c-4c5a-85b1-9f5656576e5b"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:26:19.407521 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-632b5e5a-e6b3-4cb4-83f2-413c9ba24b24 req-6baa03e5-a390-4611-b187-fa7227ec1e31 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:19.408043 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-632b5e5a-e6b3-4cb4-83f2-413c9ba24b24 req-6baa03e5-a390-4611-b187-fa7227ec1e31 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:19.427787 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-632b5e5a-e6b3-4cb4-83f2-413c9ba24b24 req-6baa03e5-a390-4611-b187-fa7227ec1e31 service nova] Creating event network-vif-deleted:89aa2008-483c-4c5a-85b1-9f5656576e5b for instance 0c30b376-2903-4058-b436-4644778f3352 on nch1-master-1 Apr 16 21:26:19.429525 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-632b5e5a-e6b3-4cb4-83f2-413c9ba24b24 req-6baa03e5-a390-4611-b187-fa7227ec1e31 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037500 Apr 16 21:26:19.430702 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2566/4954] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:26:19.437515 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b8648e48-f279-4334-acf8-b3485d4ba304 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:19.438464 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b8648e48-f279-4334-acf8-b3485d4ba304 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:19.445866 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b8648e48-f279-4334-acf8-b3485d4ba304 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:19.446325 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b8648e48-f279-4334-acf8-b3485d4ba304 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:19.447167 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b8648e48-f279-4334-acf8-b3485d4ba304 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:19.447626 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b8648e48-f279-4334-acf8-b3485d4ba304 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:19.538145 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9dec3795-678a-4968-8491-4f68d3701f4f tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0835efc3-f9dd-47f0-a085-1fa8aeea993f" status: 204 len: 0 microversion: 2.47 time: 0.492301 Apr 16 21:26:19.538362 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2389/4955] 10.222.0.20 () {60 vars in 1279 bytes} [Sat Apr 16 21:26:19 2022] DELETE /compute/v2.1/servers/0835efc3-f9dd-47f0-a085-1fa8aeea993f => generated 0 bytes in 494 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 16 21:26:19.557377 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5f8c8ddc-5a4a-416d-8db0-926d73e4abc0 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:19.563349 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5f8c8ddc-5a4a-416d-8db0-926d73e4abc0 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 0835efc3-f9dd-47f0-a085-1fa8aeea993f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:19.575723 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5f8c8ddc-5a4a-416d-8db0-926d73e4abc0 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:19.577036 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5f8c8ddc-5a4a-416d-8db0-926d73e4abc0 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:19.578092 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5f8c8ddc-5a4a-416d-8db0-926d73e4abc0 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:19.583240 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5f8c8ddc-5a4a-416d-8db0-926d73e4abc0 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:19.638913 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b8648e48-f279-4334-acf8-b3485d4ba304 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:19.648600 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b8648e48-f279-4334-acf8-b3485d4ba304 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1517 microversion: 2.1 time: 0.216496 Apr 16 21:26:19.655604 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2567/4956] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:19 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1517 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:19.770268 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5f8c8ddc-5a4a-416d-8db0-926d73e4abc0 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:19.785292 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5f8c8ddc-5a4a-416d-8db0-926d73e4abc0 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:19.787347 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5f8c8ddc-5a4a-416d-8db0-926d73e4abc0 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:19.788825 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5f8c8ddc-5a4a-416d-8db0-926d73e4abc0 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/0835efc3-f9dd-47f0-a085-1fa8aeea993f" status: 200 len: 1363 microversion: 2.47 time: 0.241681 Apr 16 21:26:19.791885 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2390/4957] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:19 2022] GET /compute/v2.1/servers/0835efc3-f9dd-47f0-a085-1fa8aeea993f => generated 1363 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:26:20.060042 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c85b5cef-75f3-4897-8f9e-cf76fbad300b tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:20.061462 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c85b5cef-75f3-4897-8f9e-cf76fbad300b tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 0c30b376-2903-4058-b436-4644778f3352] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:20.070127 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c85b5cef-75f3-4897-8f9e-cf76fbad300b tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:20.070601 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c85b5cef-75f3-4897-8f9e-cf76fbad300b tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:20.071395 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c85b5cef-75f3-4897-8f9e-cf76fbad300b tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:20.071836 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c85b5cef-75f3-4897-8f9e-cf76fbad300b tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:20.115737 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c85b5cef-75f3-4897-8f9e-cf76fbad300b tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:20.116291 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c85b5cef-75f3-4897-8f9e-cf76fbad300b tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:20.116822 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-c85b5cef-75f3-4897-8f9e-cf76fbad300b tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lazy-loading 'fault' on Instance uuid 0c30b376-2903-4058-b436-4644778f3352 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:26:20.162309 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c85b5cef-75f3-4897-8f9e-cf76fbad300b tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:20.170483 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c85b5cef-75f3-4897-8f9e-cf76fbad300b tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352" status: 200 len: 1331 microversion: 2.1 time: 0.114479 Apr 16 21:26:20.171070 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2568/4958] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:20 2022] GET /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352 => generated 1331 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:20.269535 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-994880b1-441f-408a-bbd0-d32cc1ff7656 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:20.270795 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-994880b1-441f-408a-bbd0-d32cc1ff7656 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:20.284280 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-994880b1-441f-408a-bbd0-d32cc1ff7656 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:20.284982 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-994880b1-441f-408a-bbd0-d32cc1ff7656 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:20.285989 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-994880b1-441f-408a-bbd0-d32cc1ff7656 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:20.286605 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-994880b1-441f-408a-bbd0-d32cc1ff7656 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:20.410116 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f1eeeb70-ea71-4956-ba8d-e6f924e69a37 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:20.410732 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f1eeeb70-ea71-4956-ba8d-e6f924e69a37 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:20.417564 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f1eeeb70-ea71-4956-ba8d-e6f924e69a37 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:20.418032 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f1eeeb70-ea71-4956-ba8d-e6f924e69a37 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:20.418836 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f1eeeb70-ea71-4956-ba8d-e6f924e69a37 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:20.419283 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f1eeeb70-ea71-4956-ba8d-e6f924e69a37 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:20.505165 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f1eeeb70-ea71-4956-ba8d-e6f924e69a37 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:20.517853 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f1eeeb70-ea71-4956-ba8d-e6f924e69a37 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:20.519769 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f1eeeb70-ea71-4956-ba8d-e6f924e69a37 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:20.522027 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f1eeeb70-ea71-4956-ba8d-e6f924e69a37 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] 10.222.0.20 "GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2" status: 200 len: 1365 microversion: 2.57 time: 0.115922 Apr 16 21:26:20.522879 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2569/4959] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:20 2022] GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2 => generated 1365 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:26:20.535195 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-994880b1-441f-408a-bbd0-d32cc1ff7656 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:20.542830 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-994880b1-441f-408a-bbd0-d32cc1ff7656 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 200 len: 1511 microversion: 2.1 time: 0.285265 Apr 16 21:26:20.543413 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2391/4960] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:20 2022] GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 1511 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:20.668022 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b574cd1c-5a6e-49cf-97a1-34cb2b67a135 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:20.668022 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b574cd1c-5a6e-49cf-97a1-34cb2b67a135 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:20.682852 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b574cd1c-5a6e-49cf-97a1-34cb2b67a135 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:20.683319 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b574cd1c-5a6e-49cf-97a1-34cb2b67a135 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:20.684132 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b574cd1c-5a6e-49cf-97a1-34cb2b67a135 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:20.684788 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b574cd1c-5a6e-49cf-97a1-34cb2b67a135 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:20.808328 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-80e11809-c272-46dd-a58b-6cce23f4c5c8 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:20.808970 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-80e11809-c272-46dd-a58b-6cce23f4c5c8 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 0835efc3-f9dd-47f0-a085-1fa8aeea993f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:20.815427 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-80e11809-c272-46dd-a58b-6cce23f4c5c8 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:20.816300 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-80e11809-c272-46dd-a58b-6cce23f4c5c8 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:20.817663 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-80e11809-c272-46dd-a58b-6cce23f4c5c8 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:20.818324 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-80e11809-c272-46dd-a58b-6cce23f4c5c8 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:20.834962 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b574cd1c-5a6e-49cf-97a1-34cb2b67a135 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:20.842460 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b574cd1c-5a6e-49cf-97a1-34cb2b67a135 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1517 microversion: 2.1 time: 0.179520 Apr 16 21:26:20.843035 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2570/4961] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:20 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1517 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:20.893717 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-80e11809-c272-46dd-a58b-6cce23f4c5c8 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:20.901994 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-80e11809-c272-46dd-a58b-6cce23f4c5c8 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:20.903506 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-80e11809-c272-46dd-a58b-6cce23f4c5c8 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:20.904706 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-80e11809-c272-46dd-a58b-6cce23f4c5c8 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/0835efc3-f9dd-47f0-a085-1fa8aeea993f" status: 200 len: 1363 microversion: 2.47 time: 0.100697 Apr 16 21:26:20.905276 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2392/4962] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:20 2022] GET /compute/v2.1/servers/0835efc3-f9dd-47f0-a085-1fa8aeea993f => generated 1363 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:26:21.187724 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a188560a-954d-4412-9e07-a0ab0234f3ac tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:21.188682 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a188560a-954d-4412-9e07-a0ab0234f3ac tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 0c30b376-2903-4058-b436-4644778f3352] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:21.196087 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a188560a-954d-4412-9e07-a0ab0234f3ac tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:21.196689 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a188560a-954d-4412-9e07-a0ab0234f3ac tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:21.197948 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a188560a-954d-4412-9e07-a0ab0234f3ac tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:21.198460 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a188560a-954d-4412-9e07-a0ab0234f3ac tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:21.232432 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a188560a-954d-4412-9e07-a0ab0234f3ac tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:21.233043 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a188560a-954d-4412-9e07-a0ab0234f3ac tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:21.233563 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-a188560a-954d-4412-9e07-a0ab0234f3ac tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lazy-loading 'fault' on Instance uuid 0c30b376-2903-4058-b436-4644778f3352 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:26:21.275294 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a188560a-954d-4412-9e07-a0ab0234f3ac tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:21.283045 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a188560a-954d-4412-9e07-a0ab0234f3ac tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352" status: 200 len: 1331 microversion: 2.1 time: 0.099248 Apr 16 21:26:21.283626 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2571/4963] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:21 2022] GET /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352 => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:21.457443 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-4aa8b4a0-7f4a-4b95-be52-e332fc65bc45 req-deb2cb41-7893-43eb-ad9a-0d55318fc4f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "daf189e2-7cb4-4dab-94cf-ffdceb314df7", "tag": "29f0877d-908a-47df-aa37-d5dcea212e40"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:26:21.467709 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-4aa8b4a0-7f4a-4b95-be52-e332fc65bc45 req-deb2cb41-7893-43eb-ad9a-0d55318fc4f3 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:21.468521 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-4aa8b4a0-7f4a-4b95-be52-e332fc65bc45 req-deb2cb41-7893-43eb-ad9a-0d55318fc4f3 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:21.480773 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-4aa8b4a0-7f4a-4b95-be52-e332fc65bc45 req-deb2cb41-7893-43eb-ad9a-0d55318fc4f3 service nova] Creating event network-changed:29f0877d-908a-47df-aa37-d5dcea212e40 for instance daf189e2-7cb4-4dab-94cf-ffdceb314df7 on nch1-master-1 Apr 16 21:26:21.485905 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-4aa8b4a0-7f4a-4b95-be52-e332fc65bc45 req-deb2cb41-7893-43eb-ad9a-0d55318fc4f3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033554 Apr 16 21:26:21.487079 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2393/4964] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:26:21.541217 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c4b48baf-b6de-48b9-957f-b38bd1e25cfe tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:21.542026 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c4b48baf-b6de-48b9-957f-b38bd1e25cfe tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:21.548062 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c4b48baf-b6de-48b9-957f-b38bd1e25cfe tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:21.548610 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c4b48baf-b6de-48b9-957f-b38bd1e25cfe tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:21.549421 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c4b48baf-b6de-48b9-957f-b38bd1e25cfe tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:21.549931 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c4b48baf-b6de-48b9-957f-b38bd1e25cfe tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:21.562711 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bac9cc41-b3fc-46f9-b1f8-1519628e5648 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:21.563521 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bac9cc41-b3fc-46f9-b1f8-1519628e5648 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:21.571723 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bac9cc41-b3fc-46f9-b1f8-1519628e5648 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:21.572355 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bac9cc41-b3fc-46f9-b1f8-1519628e5648 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:21.573391 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bac9cc41-b3fc-46f9-b1f8-1519628e5648 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:21.574605 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bac9cc41-b3fc-46f9-b1f8-1519628e5648 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:21.616036 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c4b48baf-b6de-48b9-957f-b38bd1e25cfe tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:21.624485 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c4b48baf-b6de-48b9-957f-b38bd1e25cfe tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:21.626265 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c4b48baf-b6de-48b9-957f-b38bd1e25cfe tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:21.627567 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c4b48baf-b6de-48b9-957f-b38bd1e25cfe tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] 10.222.0.20 "GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2" status: 200 len: 1365 microversion: 2.57 time: 0.090474 Apr 16 21:26:21.632207 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2572/4965] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:21 2022] GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2 => generated 1365 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:26:21.817333 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-bac9cc41-b3fc-46f9-b1f8-1519628e5648 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:21.825873 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bac9cc41-b3fc-46f9-b1f8-1519628e5648 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 200 len: 1511 microversion: 2.1 time: 0.267751 Apr 16 21:26:21.826466 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2394/4966] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:21 2022] GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 1511 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:21.859646 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-96a21780-593d-4527-8621-a9a7b5248174 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:21.860304 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-96a21780-593d-4527-8621-a9a7b5248174 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:21.868229 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-96a21780-593d-4527-8621-a9a7b5248174 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:21.868700 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-96a21780-593d-4527-8621-a9a7b5248174 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:21.869489 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-96a21780-593d-4527-8621-a9a7b5248174 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:21.869944 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-96a21780-593d-4527-8621-a9a7b5248174 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:21.923267 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3fed820b-536a-436d-9558-1340bd58837c tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:21.923906 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3fed820b-536a-436d-9558-1340bd58837c tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 0835efc3-f9dd-47f0-a085-1fa8aeea993f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:21.931923 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3fed820b-536a-436d-9558-1340bd58837c tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:21.932455 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3fed820b-536a-436d-9558-1340bd58837c tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:21.933346 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3fed820b-536a-436d-9558-1340bd58837c tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:21.933728 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3fed820b-536a-436d-9558-1340bd58837c tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:21.976886 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3fed820b-536a-436d-9558-1340bd58837c tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:21.977392 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3fed820b-536a-436d-9558-1340bd58837c tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:21.977806 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-3fed820b-536a-436d-9558-1340bd58837c tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lazy-loading 'fault' on Instance uuid 0835efc3-f9dd-47f0-a085-1fa8aeea993f {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:26:22.021356 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3fed820b-536a-436d-9558-1340bd58837c tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:22.030091 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3fed820b-536a-436d-9558-1340bd58837c tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:22.031738 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3fed820b-536a-436d-9558-1340bd58837c tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '33a57bad127d445d9034befd4fcca951', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a919bcedab644defad61a065b44d7887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:22.033075 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3fed820b-536a-436d-9558-1340bd58837c tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/0835efc3-f9dd-47f0-a085-1fa8aeea993f" status: 200 len: 1368 microversion: 2.47 time: 0.114108 Apr 16 21:26:22.045692 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2395/4967] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:21 2022] GET /compute/v2.1/servers/0835efc3-f9dd-47f0-a085-1fa8aeea993f => generated 1368 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:26:22.046144 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-96a21780-593d-4527-8621-a9a7b5248174 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:22.053990 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-96a21780-593d-4527-8621-a9a7b5248174 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1517 microversion: 2.1 time: 0.198243 Apr 16 21:26:22.054566 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2573/4968] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:21 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1517 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:22.300761 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-904f45ca-88a4-4d64-9590-97858aada6c0 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:22.301591 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-904f45ca-88a4-4d64-9590-97858aada6c0 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 0c30b376-2903-4058-b436-4644778f3352] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:22.308327 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-904f45ca-88a4-4d64-9590-97858aada6c0 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:22.309813 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-904f45ca-88a4-4d64-9590-97858aada6c0 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:22.311744 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-904f45ca-88a4-4d64-9590-97858aada6c0 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:22.314802 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-904f45ca-88a4-4d64-9590-97858aada6c0 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:22.338195 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-904f45ca-88a4-4d64-9590-97858aada6c0 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] HTTP exception thrown: Instance 0c30b376-2903-4058-b436-4644778f3352 could not be found. Apr 16 21:26:22.338987 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-904f45ca-88a4-4d64-9590-97858aada6c0 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Returning 404 to user: Instance 0c30b376-2903-4058-b436-4644778f3352 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:26:22.339992 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-904f45ca-88a4-4d64-9590-97858aada6c0 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352" status: 404 len: 111 microversion: 2.1 time: 0.043622 Apr 16 21:26:22.341018 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2396/4969] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:22 2022] GET /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:26:22.349705 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-da6d0bba-90e3-4361-963d-01278aae468f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '.version_select at 0x7fbb95c30550>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:22.463676 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-da6d0bba-90e3-4361-963d-01278aae468f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1672362320" status: 202 len: 0 microversion: 2.1 time: 0.113291 Apr 16 21:26:22.463676 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2574/4970] 10.222.0.20 () {58 vars in 1220 bytes} [Sat Apr 16 21:26:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1672362320 => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 16 21:26:22.649718 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ffe2fd68-c4e7-4b3e-baa3-1ce861c8fed5 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:22.651431 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ffe2fd68-c4e7-4b3e-baa3-1ce861c8fed5 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:22.663335 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ffe2fd68-c4e7-4b3e-baa3-1ce861c8fed5 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:22.671297 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ffe2fd68-c4e7-4b3e-baa3-1ce861c8fed5 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:22.675782 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ffe2fd68-c4e7-4b3e-baa3-1ce861c8fed5 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:22.676532 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ffe2fd68-c4e7-4b3e-baa3-1ce861c8fed5 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:22.846338 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-79cc8adf-df03-4f3b-bb35-f106f1799970 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:22.849683 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-79cc8adf-df03-4f3b-bb35-f106f1799970 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:22.864032 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-79cc8adf-df03-4f3b-bb35-f106f1799970 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:22.865700 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-79cc8adf-df03-4f3b-bb35-f106f1799970 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:22.868904 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-79cc8adf-df03-4f3b-bb35-f106f1799970 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:22.869578 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-79cc8adf-df03-4f3b-bb35-f106f1799970 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:22.927743 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ffe2fd68-c4e7-4b3e-baa3-1ce861c8fed5 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:22.957374 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ffe2fd68-c4e7-4b3e-baa3-1ce861c8fed5 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:22.958909 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ffe2fd68-c4e7-4b3e-baa3-1ce861c8fed5 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:22.960105 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ffe2fd68-c4e7-4b3e-baa3-1ce861c8fed5 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] 10.222.0.20 "GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2" status: 200 len: 1365 microversion: 2.57 time: 0.317188 Apr 16 21:26:23.002475 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2397/4971] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:22 2022] GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2 => generated 1365 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:26:23.059045 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2bd327c2-ef7f-4ad9-b218-3de2aab13f83 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:23.062778 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2bd327c2-ef7f-4ad9-b218-3de2aab13f83 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] [instance: 0835efc3-f9dd-47f0-a085-1fa8aeea993f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:23.080353 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2bd327c2-ef7f-4ad9-b218-3de2aab13f83 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:23.081818 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2bd327c2-ef7f-4ad9-b218-3de2aab13f83 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:23.087098 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2bd327c2-ef7f-4ad9-b218-3de2aab13f83 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:23.087762 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2bd327c2-ef7f-4ad9-b218-3de2aab13f83 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:23.108594 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-2bd327c2-ef7f-4ad9-b218-3de2aab13f83 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] HTTP exception thrown: Instance 0835efc3-f9dd-47f0-a085-1fa8aeea993f could not be found. Apr 16 21:26:23.109613 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2bd327c2-ef7f-4ad9-b218-3de2aab13f83 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] Returning 404 to user: Instance 0835efc3-f9dd-47f0-a085-1fa8aeea993f could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:26:23.110619 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2bd327c2-ef7f-4ad9-b218-3de2aab13f83 tempest-ServerShowV247Test-2091270190 tempest-ServerShowV247Test-2091270190-project] 10.222.0.20 "GET /compute/v2.1/servers/0835efc3-f9dd-47f0-a085-1fa8aeea993f" status: 404 len: 111 microversion: 2.47 time: 0.061795 Apr 16 21:26:23.112925 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2398/4972] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:23 2022] GET /compute/v2.1/servers/0835efc3-f9dd-47f0-a085-1fa8aeea993f => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 16 21:26:23.137078 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-58f3bda0-bba7-4405-b120-112a817b3943 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:23.141123 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-58f3bda0-bba7-4405-b120-112a817b3943 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:23.149893 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-58f3bda0-bba7-4405-b120-112a817b3943 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:23.150793 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-58f3bda0-bba7-4405-b120-112a817b3943 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:23.151993 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-58f3bda0-bba7-4405-b120-112a817b3943 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:23.152628 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-58f3bda0-bba7-4405-b120-112a817b3943 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:23.260949 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-79cc8adf-df03-4f3b-bb35-f106f1799970 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:23.276749 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-79cc8adf-df03-4f3b-bb35-f106f1799970 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 200 len: 1511 microversion: 2.1 time: 0.436919 Apr 16 21:26:23.278563 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2575/4973] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:22 2022] GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 1511 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:26:23.594423 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-58f3bda0-bba7-4405-b120-112a817b3943 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:23.604201 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-58f3bda0-bba7-4405-b120-112a817b3943 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1517 microversion: 2.1 time: 0.489915 Apr 16 21:26:23.605011 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2399/4974] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:23 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1517 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:24.014226 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-58c3a749-013d-4510-908a-fea0f67c1ded tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:24.014934 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-58c3a749-013d-4510-908a-fea0f67c1ded tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:24.029229 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58c3a749-013d-4510-908a-fea0f67c1ded tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:24.032848 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58c3a749-013d-4510-908a-fea0f67c1ded tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:24.032848 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58c3a749-013d-4510-908a-fea0f67c1ded tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:24.032848 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58c3a749-013d-4510-908a-fea0f67c1ded tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:24.168783 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-58c3a749-013d-4510-908a-fea0f67c1ded tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:24.189696 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-58c3a749-013d-4510-908a-fea0f67c1ded tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:24.204816 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-58c3a749-013d-4510-908a-fea0f67c1ded tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:24.204816 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-58c3a749-013d-4510-908a-fea0f67c1ded tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] 10.222.0.20 "GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2" status: 200 len: 1365 microversion: 2.57 time: 0.194447 Apr 16 21:26:24.204816 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2576/4975] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:24 2022] GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2 => generated 1365 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:26:24.217039 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c2acd2ec-85c9-422c-8255-6d04c442eb25 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:24.217637 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c2acd2ec-85c9-422c-8255-6d04c442eb25 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 8d623e8d-480f-48ef-b90c-04450df4aec8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:24.230112 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c2acd2ec-85c9-422c-8255-6d04c442eb25 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:24.230577 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c2acd2ec-85c9-422c-8255-6d04c442eb25 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:24.231382 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c2acd2ec-85c9-422c-8255-6d04c442eb25 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:24.232285 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c2acd2ec-85c9-422c-8255-6d04c442eb25 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:24.297485 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-96e828f0-3e78-45d2-a7dd-ca00c9f54dfd tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:24.298106 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-96e828f0-3e78-45d2-a7dd-ca00c9f54dfd tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:24.306788 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-96e828f0-3e78-45d2-a7dd-ca00c9f54dfd tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:24.307418 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-96e828f0-3e78-45d2-a7dd-ca00c9f54dfd tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:24.308856 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-96e828f0-3e78-45d2-a7dd-ca00c9f54dfd tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:24.309644 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-96e828f0-3e78-45d2-a7dd-ca00c9f54dfd tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:24.359032 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-c2acd2ec-85c9-422c-8255-6d04c442eb25 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lazy-loading 'services' on Instance uuid 8d623e8d-480f-48ef-b90c-04450df4aec8 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:26:24.546787 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-96e828f0-3e78-45d2-a7dd-ca00c9f54dfd tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:24.561454 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-96e828f0-3e78-45d2-a7dd-ca00c9f54dfd tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 200 len: 1511 microversion: 2.1 time: 0.267886 Apr 16 21:26:24.562360 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2577/4976] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:24 2022] GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 1511 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:24.605064 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c2acd2ec-85c9-422c-8255-6d04c442eb25 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8/os-volume_attachments/a89555a4-c1fe-4512-9779-1ac4ed29f291" status: 202 len: 0 microversion: 2.1 time: 0.395195 Apr 16 21:26:24.618871 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4916a4c2-c373-48f1-a9b7-02968f9b01c7 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:24.618871 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4916a4c2-c373-48f1-a9b7-02968f9b01c7 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 8d623e8d-480f-48ef-b90c-04450df4aec8] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:24.619423 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2400/4977] 10.222.0.20 () {58 vars in 1415 bytes} [Sat Apr 16 21:26:24 2022] DELETE /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8/os-volume_attachments/a89555a4-c1fe-4512-9779-1ac4ed29f291 => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:26:24.640914 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4916a4c2-c373-48f1-a9b7-02968f9b01c7 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:24.641372 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4916a4c2-c373-48f1-a9b7-02968f9b01c7 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:24.645469 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4916a4c2-c373-48f1-a9b7-02968f9b01c7 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:24.645469 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4916a4c2-c373-48f1-a9b7-02968f9b01c7 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:24.652890 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6d867717-474b-4e4d-9894-39c996c0fa56 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:24.653688 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6d867717-474b-4e4d-9894-39c996c0fa56 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:24.671404 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6d867717-474b-4e4d-9894-39c996c0fa56 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:24.672152 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6d867717-474b-4e4d-9894-39c996c0fa56 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:24.673179 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6d867717-474b-4e4d-9894-39c996c0fa56 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:24.673787 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6d867717-474b-4e4d-9894-39c996c0fa56 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:24.756770 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4916a4c2-c373-48f1-a9b7-02968f9b01c7 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.146179 Apr 16 21:26:24.760960 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2578/4978] 10.222.0.20 () {58 vars in 1301 bytes} [Sat Apr 16 21:26:24 2022] GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:26:24.935718 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6d867717-474b-4e4d-9894-39c996c0fa56 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:24.944394 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6d867717-474b-4e4d-9894-39c996c0fa56 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1517 microversion: 2.1 time: 0.322306 Apr 16 21:26:24.954379 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2401/4979] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:24 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1517 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:25.223509 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-db707db9-762e-4a4d-ab48-936e5dac7b9c tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:25.225529 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-db707db9-762e-4a4d-ab48-936e5dac7b9c tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:25.231350 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-db707db9-762e-4a4d-ab48-936e5dac7b9c tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:25.232028 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-db707db9-762e-4a4d-ab48-936e5dac7b9c tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:25.233128 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-db707db9-762e-4a4d-ab48-936e5dac7b9c tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:25.233741 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-db707db9-762e-4a4d-ab48-936e5dac7b9c tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:25.309445 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-db707db9-762e-4a4d-ab48-936e5dac7b9c tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:25.318845 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-db707db9-762e-4a4d-ab48-936e5dac7b9c tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:25.321197 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-db707db9-762e-4a4d-ab48-936e5dac7b9c tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:25.322740 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-db707db9-762e-4a4d-ab48-936e5dac7b9c tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] 10.222.0.20 "GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2" status: 200 len: 1365 microversion: 2.57 time: 0.103768 Apr 16 21:26:25.323789 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2579/4980] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:25 2022] GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2 => generated 1365 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:26:25.581026 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-eb102568-a355-4584-bd91-2897e348c213 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:25.581764 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-eb102568-a355-4584-bd91-2897e348c213 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:25.589385 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eb102568-a355-4584-bd91-2897e348c213 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:25.590156 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eb102568-a355-4584-bd91-2897e348c213 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:25.591505 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eb102568-a355-4584-bd91-2897e348c213 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:25.592249 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eb102568-a355-4584-bd91-2897e348c213 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:25.769040 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-89f31232-861c-4990-8039-f9880dbbaffc tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:25.770087 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-89f31232-861c-4990-8039-f9880dbbaffc tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 8d623e8d-480f-48ef-b90c-04450df4aec8] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:25.785730 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-89f31232-861c-4990-8039-f9880dbbaffc tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:25.787401 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-89f31232-861c-4990-8039-f9880dbbaffc tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:25.790957 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-89f31232-861c-4990-8039-f9880dbbaffc tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:25.791669 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-89f31232-861c-4990-8039-f9880dbbaffc tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:25.870830 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-89f31232-861c-4990-8039-f9880dbbaffc tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103137 Apr 16 21:26:25.874325 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2580/4981] 10.222.0.20 () {58 vars in 1301 bytes} [Sat Apr 16 21:26:25 2022] GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8/os-volume_attachments => generated 197 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:26:25.912286 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-eb102568-a355-4584-bd91-2897e348c213 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:25.936194 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-eb102568-a355-4584-bd91-2897e348c213 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 200 len: 1511 microversion: 2.1 time: 0.360721 Apr 16 21:26:25.946326 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2402/4982] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:25 2022] GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 1511 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:25.961252 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-da9cffde-c02e-4b0f-b40b-baf9c0c72413 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:25.961883 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-da9cffde-c02e-4b0f-b40b-baf9c0c72413 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:25.974636 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-da9cffde-c02e-4b0f-b40b-baf9c0c72413 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:25.974636 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-da9cffde-c02e-4b0f-b40b-baf9c0c72413 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:25.974636 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-da9cffde-c02e-4b0f-b40b-baf9c0c72413 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:25.975086 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-da9cffde-c02e-4b0f-b40b-baf9c0c72413 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:26.181985 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-da9cffde-c02e-4b0f-b40b-baf9c0c72413 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:26.191572 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-da9cffde-c02e-4b0f-b40b-baf9c0c72413 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1517 microversion: 2.1 time: 0.234499 Apr 16 21:26:26.192588 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2581/4983] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:25 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1517 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:26.343184 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f50dd414-c30a-4c68-ab80-6d4c3465ab97 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:26.343841 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f50dd414-c30a-4c68-ab80-6d4c3465ab97 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:26.350893 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f50dd414-c30a-4c68-ab80-6d4c3465ab97 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:26.351356 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f50dd414-c30a-4c68-ab80-6d4c3465ab97 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:26.352295 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f50dd414-c30a-4c68-ab80-6d4c3465ab97 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:26.352831 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f50dd414-c30a-4c68-ab80-6d4c3465ab97 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:26.484335 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f50dd414-c30a-4c68-ab80-6d4c3465ab97 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:26.496318 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f50dd414-c30a-4c68-ab80-6d4c3465ab97 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:26.497998 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f50dd414-c30a-4c68-ab80-6d4c3465ab97 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:26.499776 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f50dd414-c30a-4c68-ab80-6d4c3465ab97 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] 10.222.0.20 "GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2" status: 200 len: 1365 microversion: 2.57 time: 0.160727 Apr 16 21:26:26.507669 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2403/4984] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:26 2022] GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:26:26.895537 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d29a6dc3-db7a-4eda-a6d9-318243fb74a6 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:26.897102 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d29a6dc3-db7a-4eda-a6d9-318243fb74a6 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 8d623e8d-480f-48ef-b90c-04450df4aec8] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:26.927764 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d29a6dc3-db7a-4eda-a6d9-318243fb74a6 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:26.929594 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d29a6dc3-db7a-4eda-a6d9-318243fb74a6 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:26.930572 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d29a6dc3-db7a-4eda-a6d9-318243fb74a6 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:26.931035 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d29a6dc3-db7a-4eda-a6d9-318243fb74a6 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:26.959942 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-305f32b0-1bd8-4c40-867b-da0ba0c99920 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:26.960951 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-305f32b0-1bd8-4c40-867b-da0ba0c99920 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:26.988153 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-305f32b0-1bd8-4c40-867b-da0ba0c99920 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:26.989269 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-305f32b0-1bd8-4c40-867b-da0ba0c99920 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:26.990588 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-305f32b0-1bd8-4c40-867b-da0ba0c99920 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:26.992079 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-305f32b0-1bd8-4c40-867b-da0ba0c99920 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:27.023316 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d29a6dc3-db7a-4eda-a6d9-318243fb74a6 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.141051 Apr 16 21:26:27.039660 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2582/4985] 10.222.0.20 () {58 vars in 1301 bytes} [Sat Apr 16 21:26:26 2022] GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8/os-volume_attachments => generated 25 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:26:27.130009 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-281f7112-d34a-4c71-bcb2-ba5947d5f189 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:27.130544 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-281f7112-d34a-4c71-bcb2-ba5947d5f189 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 8d623e8d-480f-48ef-b90c-04450df4aec8] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:27.149333 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-281f7112-d34a-4c71-bcb2-ba5947d5f189 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:27.156292 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-281f7112-d34a-4c71-bcb2-ba5947d5f189 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:27.157497 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-281f7112-d34a-4c71-bcb2-ba5947d5f189 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:27.163343 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-305f32b0-1bd8-4c40-867b-da0ba0c99920 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:27.164914 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-281f7112-d34a-4c71-bcb2-ba5947d5f189 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:27.172561 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-305f32b0-1bd8-4c40-867b-da0ba0c99920 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 200 len: 1511 microversion: 2.1 time: 0.221370 Apr 16 21:26:27.173617 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2404/4986] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:26 2022] GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 1511 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:26:27.209076 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-475fa4fc-b0fe-4f5e-b577-fb468b6997a4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:27.209327 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-281f7112-d34a-4c71-bcb2-ba5947d5f189 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 8d623e8d-480f-48ef-b90c-04450df4aec8] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:26:27.210186 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-475fa4fc-b0fe-4f5e-b577-fb468b6997a4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:27.216807 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-475fa4fc-b0fe-4f5e-b577-fb468b6997a4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:27.217524 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-475fa4fc-b0fe-4f5e-b577-fb468b6997a4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:27.218501 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-475fa4fc-b0fe-4f5e-b577-fb468b6997a4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:27.219121 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-475fa4fc-b0fe-4f5e-b577-fb468b6997a4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:27.377273 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-475fa4fc-b0fe-4f5e-b577-fb468b6997a4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:27.397515 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-475fa4fc-b0fe-4f5e-b577-fb468b6997a4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1517 microversion: 2.1 time: 0.182507 Apr 16 21:26:27.397515 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2405/4987] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:27 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1517 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:26:27.527039 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3a0a2969-8e5e-46d4-a241-4a142fbaaf97 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:27.527668 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3a0a2969-8e5e-46d4-a241-4a142fbaaf97 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:27.534828 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3a0a2969-8e5e-46d4-a241-4a142fbaaf97 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:27.535391 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3a0a2969-8e5e-46d4-a241-4a142fbaaf97 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:27.536412 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3a0a2969-8e5e-46d4-a241-4a142fbaaf97 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:27.537049 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3a0a2969-8e5e-46d4-a241-4a142fbaaf97 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:27.613832 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3a0a2969-8e5e-46d4-a241-4a142fbaaf97 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:27.629248 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3a0a2969-8e5e-46d4-a241-4a142fbaaf97 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:27.631178 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3a0a2969-8e5e-46d4-a241-4a142fbaaf97 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:27.632566 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3a0a2969-8e5e-46d4-a241-4a142fbaaf97 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] 10.222.0.20 "GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2" status: 200 len: 1365 microversion: 2.57 time: 0.111074 Apr 16 21:26:27.640430 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2406/4988] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:27 2022] GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2 => generated 1365 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:26:27.750588 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-281f7112-d34a-4c71-bcb2-ba5947d5f189 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8" status: 204 len: 0 microversion: 2.1 time: 0.627986 Apr 16 21:26:27.758172 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2583/4989] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:26:27 2022] DELETE /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:26:27.759433 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8ba33143-b017-44ab-9723-ad2f0fcadf14 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:27.760065 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8ba33143-b017-44ab-9723-ad2f0fcadf14 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 8d623e8d-480f-48ef-b90c-04450df4aec8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:27.775920 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8ba33143-b017-44ab-9723-ad2f0fcadf14 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:27.777025 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8ba33143-b017-44ab-9723-ad2f0fcadf14 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:27.777839 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8ba33143-b017-44ab-9723-ad2f0fcadf14 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:27.778295 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8ba33143-b017-44ab-9723-ad2f0fcadf14 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:28.007399 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8ba33143-b017-44ab-9723-ad2f0fcadf14 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:28.016424 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8ba33143-b017-44ab-9723-ad2f0fcadf14 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8" status: 200 len: 1681 microversion: 2.1 time: 0.260582 Apr 16 21:26:28.017282 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2407/4990] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:27 2022] GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8 => generated 1681 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:28.192980 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1a0be374-0f6e-4d2a-bfbb-9047c229415f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:28.194568 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1a0be374-0f6e-4d2a-bfbb-9047c229415f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:28.203252 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1a0be374-0f6e-4d2a-bfbb-9047c229415f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:28.203938 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1a0be374-0f6e-4d2a-bfbb-9047c229415f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:28.205044 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1a0be374-0f6e-4d2a-bfbb-9047c229415f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:28.206517 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1a0be374-0f6e-4d2a-bfbb-9047c229415f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:28.406842 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a7c42255-9026-45f5-a544-0be69f0f524f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:28.407616 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a7c42255-9026-45f5-a544-0be69f0f524f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:28.418031 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a7c42255-9026-45f5-a544-0be69f0f524f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:28.422100 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a7c42255-9026-45f5-a544-0be69f0f524f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:28.422100 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a7c42255-9026-45f5-a544-0be69f0f524f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:28.422100 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a7c42255-9026-45f5-a544-0be69f0f524f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:28.461741 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1a0be374-0f6e-4d2a-bfbb-9047c229415f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:28.471423 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1a0be374-0f6e-4d2a-bfbb-9047c229415f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 200 len: 1511 microversion: 2.1 time: 0.284094 Apr 16 21:26:28.481870 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2584/4991] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:28 2022] GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 1511 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:28.610236 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a7c42255-9026-45f5-a544-0be69f0f524f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:28.622727 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a7c42255-9026-45f5-a544-0be69f0f524f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1517 microversion: 2.1 time: 0.221315 Apr 16 21:26:28.635889 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2408/4992] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:28 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1517 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:28.652252 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9bea130c-de22-43f6-bd08-a8269db24113 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:28.652895 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9bea130c-de22-43f6-bd08-a8269db24113 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:28.663348 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9bea130c-de22-43f6-bd08-a8269db24113 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:28.663820 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9bea130c-de22-43f6-bd08-a8269db24113 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:28.664692 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9bea130c-de22-43f6-bd08-a8269db24113 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:28.665133 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9bea130c-de22-43f6-bd08-a8269db24113 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:28.739078 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9bea130c-de22-43f6-bd08-a8269db24113 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:28.759386 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9bea130c-de22-43f6-bd08-a8269db24113 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:28.759386 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9bea130c-de22-43f6-bd08-a8269db24113 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:28.778283 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9bea130c-de22-43f6-bd08-a8269db24113 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] 10.222.0.20 "GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2" status: 200 len: 1365 microversion: 2.57 time: 0.130867 Apr 16 21:26:28.779332 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2585/4993] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:28 2022] GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2 => generated 1365 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:26:29.040285 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ea136fdd-8b4b-40a0-aa47-4fdf2e29f5ae tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:29.040285 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ea136fdd-8b4b-40a0-aa47-4fdf2e29f5ae tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 8d623e8d-480f-48ef-b90c-04450df4aec8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:29.079174 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ea136fdd-8b4b-40a0-aa47-4fdf2e29f5ae tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:29.079642 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ea136fdd-8b4b-40a0-aa47-4fdf2e29f5ae tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:29.083570 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ea136fdd-8b4b-40a0-aa47-4fdf2e29f5ae tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:29.085557 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ea136fdd-8b4b-40a0-aa47-4fdf2e29f5ae tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:29.296381 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ea136fdd-8b4b-40a0-aa47-4fdf2e29f5ae tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:29.306011 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ea136fdd-8b4b-40a0-aa47-4fdf2e29f5ae tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8" status: 200 len: 1681 microversion: 2.1 time: 0.274919 Apr 16 21:26:29.306604 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2409/4994] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:29 2022] GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8 => generated 1681 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:29.371032 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cba080e2-be67-4429-bbb5-e8561a2be7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-201760146", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "8f593006-a7a9-4abc-8409-1d78959e9c9f"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:26:29.440677 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-cba080e2-be67-4429-bbb5-e8561a2be7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] validate_networks() for [('8f593006-a7a9-4abc-8409-1d78959e9c9f', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:26:29.490073 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-46b8e1ad-27fd-43d3-be33-779fa1b2395d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:29.491045 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-46b8e1ad-27fd-43d3-be33-779fa1b2395d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:29.505509 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-46b8e1ad-27fd-43d3-be33-779fa1b2395d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:29.505973 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-46b8e1ad-27fd-43d3-be33-779fa1b2395d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:29.507192 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-46b8e1ad-27fd-43d3-be33-779fa1b2395d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:29.507452 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-46b8e1ad-27fd-43d3-be33-779fa1b2395d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:29.749031 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-46b8e1ad-27fd-43d3-be33-779fa1b2395d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:29.757533 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-46b8e1ad-27fd-43d3-be33-779fa1b2395d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 200 len: 1511 microversion: 2.1 time: 0.271851 Apr 16 21:26:29.758307 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2410/4995] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:29 2022] GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 1511 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:26:29.763212 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b33d3bce-7184-4285-8fa5-63d1abd9ec69 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:29.764545 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b33d3bce-7184-4285-8fa5-63d1abd9ec69 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:29.773577 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b33d3bce-7184-4285-8fa5-63d1abd9ec69 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:29.773577 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b33d3bce-7184-4285-8fa5-63d1abd9ec69 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:29.773577 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b33d3bce-7184-4285-8fa5-63d1abd9ec69 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:29.774283 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b33d3bce-7184-4285-8fa5-63d1abd9ec69 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:30.038757 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b33d3bce-7184-4285-8fa5-63d1abd9ec69 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:30.056425 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b33d3bce-7184-4285-8fa5-63d1abd9ec69 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1517 microversion: 2.1 time: 0.296733 Apr 16 21:26:30.057741 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2411/4996] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:29 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1517 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:30.068297 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-68a0a8f0-1086-48bb-8ebb-d807949c95d8 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:30.077342 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-68a0a8f0-1086-48bb-8ebb-d807949c95d8 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:30.093998 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-68a0a8f0-1086-48bb-8ebb-d807949c95d8 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:30.097558 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-68a0a8f0-1086-48bb-8ebb-d807949c95d8 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:30.097558 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-68a0a8f0-1086-48bb-8ebb-d807949c95d8 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:30.097558 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-68a0a8f0-1086-48bb-8ebb-d807949c95d8 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:30.198334 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-68a0a8f0-1086-48bb-8ebb-d807949c95d8 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:30.229887 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-68a0a8f0-1086-48bb-8ebb-d807949c95d8 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:30.231791 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-68a0a8f0-1086-48bb-8ebb-d807949c95d8 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:30.233332 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-68a0a8f0-1086-48bb-8ebb-d807949c95d8 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] 10.222.0.20 "GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2" status: 200 len: 1365 microversion: 2.57 time: 0.171027 Apr 16 21:26:30.235271 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2412/4997] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:30 2022] GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:26:30.325779 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7502c4e9-98e1-4d5b-b169-09d63f55e88d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:30.327030 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7502c4e9-98e1-4d5b-b169-09d63f55e88d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 8d623e8d-480f-48ef-b90c-04450df4aec8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:30.334712 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7502c4e9-98e1-4d5b-b169-09d63f55e88d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:30.335447 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7502c4e9-98e1-4d5b-b169-09d63f55e88d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:30.338842 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7502c4e9-98e1-4d5b-b169-09d63f55e88d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:30.339629 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7502c4e9-98e1-4d5b-b169-09d63f55e88d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:30.362176 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-cba080e2-be67-4429-bbb5-e8561a2be7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:26:30.362872 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-cba080e2-be67-4429-bbb5-e8561a2be7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:26:30.363408 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-cba080e2-be67-4429-bbb5-e8561a2be7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:26:30.363839 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-cba080e2-be67-4429-bbb5-e8561a2be7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:26:30.364302 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-cba080e2-be67-4429-bbb5-e8561a2be7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:26:30.373734 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cba080e2-be67-4429-bbb5-e8561a2be7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:30.374498 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cba080e2-be67-4429-bbb5-e8561a2be7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:30.375015 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cba080e2-be67-4429-bbb5-e8561a2be7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:30.375468 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cba080e2-be67-4429-bbb5-e8561a2be7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:30.395872 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-cba080e2-be67-4429-bbb5-e8561a2be7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Getting quotas for project 76fd883ad3944fcaaecdf2909120dc87. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:26:30.401741 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-cba080e2-be67-4429-bbb5-e8561a2be7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Getting quotas for user 5e71b35f438d4539a60a390e1ceec9cd and project 76fd883ad3944fcaaecdf2909120dc87. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:26:30.415193 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cba080e2-be67-4429-bbb5-e8561a2be7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:26:30.418316 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cba080e2-be67-4429-bbb5-e8561a2be7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1fbb0c9-4072-4260-859f-aadf53c653bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:26:30.485869 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7502c4e9-98e1-4d5b-b169-09d63f55e88d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:30.493874 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7502c4e9-98e1-4d5b-b169-09d63f55e88d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8" status: 200 len: 1681 microversion: 2.1 time: 0.174721 Apr 16 21:26:30.494775 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2413/4998] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:30 2022] GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8 => generated 1681 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:30.777566 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-887278ed-d1e0-47ee-9af8-705bd0c01211 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:30.778195 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-887278ed-d1e0-47ee-9af8-705bd0c01211 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:30.786135 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-887278ed-d1e0-47ee-9af8-705bd0c01211 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:30.786630 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-887278ed-d1e0-47ee-9af8-705bd0c01211 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:30.787429 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-887278ed-d1e0-47ee-9af8-705bd0c01211 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:30.787879 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-887278ed-d1e0-47ee-9af8-705bd0c01211 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:30.884982 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cba080e2-be67-4429-bbb5-e8561a2be7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.688593 Apr 16 21:26:30.888721 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2586/4999] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:26:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 1693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 16 21:26:30.907197 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-31a0e1a6-b973-4cfa-a2a9-f29ec08c3dc2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:30.913461 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-31a0e1a6-b973-4cfa-a2a9-f29ec08c3dc2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1fbb0c9-4072-4260-859f-aadf53c653bb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:31.020728 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-31a0e1a6-b973-4cfa-a2a9-f29ec08c3dc2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:31.032304 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-31a0e1a6-b973-4cfa-a2a9-f29ec08c3dc2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1fbb0c9-4072-4260-859f-aadf53c653bb" status: 200 len: 1192 microversion: 2.1 time: 0.127352 Apr 16 21:26:31.033390 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2587/5000] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:30 2022] GET /compute/v2.1/servers/b1fbb0c9-4072-4260-859f-aadf53c653bb => generated 1192 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:31.078353 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4ad67848-9a5a-4429-b5fc-99e7e07095f8 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:31.082984 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4ad67848-9a5a-4429-b5fc-99e7e07095f8 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:31.091962 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4ad67848-9a5a-4429-b5fc-99e7e07095f8 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:31.092685 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4ad67848-9a5a-4429-b5fc-99e7e07095f8 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:31.093715 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4ad67848-9a5a-4429-b5fc-99e7e07095f8 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:31.095086 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4ad67848-9a5a-4429-b5fc-99e7e07095f8 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:31.128892 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-887278ed-d1e0-47ee-9af8-705bd0c01211 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:31.139038 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-887278ed-d1e0-47ee-9af8-705bd0c01211 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 200 len: 1511 microversion: 2.1 time: 0.367018 Apr 16 21:26:31.150140 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2414/5001] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:30 2022] GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 1511 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:26:31.254480 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-84d524db-41da-4578-91ba-3a9dbece866f tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:31.255102 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-84d524db-41da-4578-91ba-3a9dbece866f tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:31.278404 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-84d524db-41da-4578-91ba-3a9dbece866f tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:31.279129 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-84d524db-41da-4578-91ba-3a9dbece866f tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:31.280286 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-84d524db-41da-4578-91ba-3a9dbece866f tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:31.281166 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-84d524db-41da-4578-91ba-3a9dbece866f tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:31.480487 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-84d524db-41da-4578-91ba-3a9dbece866f tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:31.497656 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-84d524db-41da-4578-91ba-3a9dbece866f tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:31.526631 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-84d524db-41da-4578-91ba-3a9dbece866f tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:31.526631 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-84d524db-41da-4578-91ba-3a9dbece866f tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] 10.222.0.20 "GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2" status: 200 len: 1365 microversion: 2.57 time: 0.252285 Apr 16 21:26:31.526631 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2415/5002] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:31 2022] GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2 => generated 1365 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:26:31.526631 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-50f55b81-3217-4932-b9a9-19229087d750 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:31.526631 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-50f55b81-3217-4932-b9a9-19229087d750 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 8d623e8d-480f-48ef-b90c-04450df4aec8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:31.529094 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-50f55b81-3217-4932-b9a9-19229087d750 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:31.529818 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-50f55b81-3217-4932-b9a9-19229087d750 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:31.530856 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-50f55b81-3217-4932-b9a9-19229087d750 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:31.531529 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-50f55b81-3217-4932-b9a9-19229087d750 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:31.660198 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-50f55b81-3217-4932-b9a9-19229087d750 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:31.677392 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-50f55b81-3217-4932-b9a9-19229087d750 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8" status: 200 len: 1614 microversion: 2.1 time: 0.162328 Apr 16 21:26:31.679386 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2416/5003] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:31 2022] GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8 => generated 1614 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:31.857681 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4ad67848-9a5a-4429-b5fc-99e7e07095f8 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:31.869818 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4ad67848-9a5a-4429-b5fc-99e7e07095f8 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1517 microversion: 2.1 time: 0.797217 Apr 16 21:26:31.871618 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2588/5004] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:31 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1517 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:26:31.917995 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-ea31d87f-cd14-4711-a255-39507a38c216 req-b6ec9848-e6f6-4029-9825-db7b914fa734 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d623e8d-480f-48ef-b90c-04450df4aec8", "name": "network-vif-deleted", "tag": "459ce4bf-03df-40c1-b9aa-0e81a103ea05"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:26:31.927453 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-ea31d87f-cd14-4711-a255-39507a38c216 req-b6ec9848-e6f6-4029-9825-db7b914fa734 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:31.927926 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-ea31d87f-cd14-4711-a255-39507a38c216 req-b6ec9848-e6f6-4029-9825-db7b914fa734 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:31.941802 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-ea31d87f-cd14-4711-a255-39507a38c216 req-b6ec9848-e6f6-4029-9825-db7b914fa734 service nova] Creating event network-vif-deleted:459ce4bf-03df-40c1-b9aa-0e81a103ea05 for instance 8d623e8d-480f-48ef-b90c-04450df4aec8 on nch2-master-1 Apr 16 21:26:31.947002 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-ea31d87f-cd14-4711-a255-39507a38c216 req-b6ec9848-e6f6-4029-9825-db7b914fa734 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033318 Apr 16 21:26:31.947609 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2417/5005] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:26:32.053957 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0c534873-29cd-48fa-99cd-6260110b1c42 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:32.059240 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0c534873-29cd-48fa-99cd-6260110b1c42 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1fbb0c9-4072-4260-859f-aadf53c653bb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:32.158882 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0c534873-29cd-48fa-99cd-6260110b1c42 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:32.159089 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c50e4ccd-a85f-4ca7-9a71-c2108aa20df1 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:32.159693 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c50e4ccd-a85f-4ca7-9a71-c2108aa20df1 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:32.170322 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0c534873-29cd-48fa-99cd-6260110b1c42 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1fbb0c9-4072-4260-859f-aadf53c653bb" status: 200 len: 1192 microversion: 2.1 time: 0.121785 Apr 16 21:26:32.171486 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2589/5006] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:32 2022] GET /compute/v2.1/servers/b1fbb0c9-4072-4260-859f-aadf53c653bb => generated 1192 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:32.183841 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c50e4ccd-a85f-4ca7-9a71-c2108aa20df1 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:32.184636 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c50e4ccd-a85f-4ca7-9a71-c2108aa20df1 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:32.185777 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c50e4ccd-a85f-4ca7-9a71-c2108aa20df1 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:32.186428 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c50e4ccd-a85f-4ca7-9a71-c2108aa20df1 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:32.328340 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c50e4ccd-a85f-4ca7-9a71-c2108aa20df1 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:32.336400 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c50e4ccd-a85f-4ca7-9a71-c2108aa20df1 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 200 len: 1511 microversion: 2.1 time: 0.183906 Apr 16 21:26:32.338965 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2418/5007] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:32 2022] GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 1511 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:32.521638 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e2dab9f2-ac6e-448c-8f01-8919dec57169 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:32.522427 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e2dab9f2-ac6e-448c-8f01-8919dec57169 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:32.530792 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e2dab9f2-ac6e-448c-8f01-8919dec57169 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:32.531259 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e2dab9f2-ac6e-448c-8f01-8919dec57169 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:32.532060 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e2dab9f2-ac6e-448c-8f01-8919dec57169 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:32.532584 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e2dab9f2-ac6e-448c-8f01-8919dec57169 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:32.616874 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e2dab9f2-ac6e-448c-8f01-8919dec57169 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:32.634685 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e2dab9f2-ac6e-448c-8f01-8919dec57169 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:32.636365 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e2dab9f2-ac6e-448c-8f01-8919dec57169 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:32.637555 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e2dab9f2-ac6e-448c-8f01-8919dec57169 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] 10.222.0.20 "GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2" status: 200 len: 1365 microversion: 2.57 time: 0.119847 Apr 16 21:26:32.638302 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2590/5008] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:32 2022] GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2 => generated 1365 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:26:32.697108 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-022cbb44-d0ea-492b-b39f-fbb9b8fca1e3 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:32.697739 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-022cbb44-d0ea-492b-b39f-fbb9b8fca1e3 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 8d623e8d-480f-48ef-b90c-04450df4aec8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:32.704001 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-022cbb44-d0ea-492b-b39f-fbb9b8fca1e3 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:32.704508 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-022cbb44-d0ea-492b-b39f-fbb9b8fca1e3 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:32.705369 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-022cbb44-d0ea-492b-b39f-fbb9b8fca1e3 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:32.705878 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-022cbb44-d0ea-492b-b39f-fbb9b8fca1e3 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:32.740719 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-022cbb44-d0ea-492b-b39f-fbb9b8fca1e3 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:32.741181 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-022cbb44-d0ea-492b-b39f-fbb9b8fca1e3 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:32.741662 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-022cbb44-d0ea-492b-b39f-fbb9b8fca1e3 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lazy-loading 'fault' on Instance uuid 8d623e8d-480f-48ef-b90c-04450df4aec8 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:26:32.782714 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-022cbb44-d0ea-492b-b39f-fbb9b8fca1e3 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:32.791256 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-022cbb44-d0ea-492b-b39f-fbb9b8fca1e3 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8" status: 200 len: 1331 microversion: 2.1 time: 0.098182 Apr 16 21:26:32.792051 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2419/5009] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:32 2022] GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8 => generated 1331 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:32.892042 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8d507797-46b5-4fc5-bd6f-55ae8be44873 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:32.894053 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8d507797-46b5-4fc5-bd6f-55ae8be44873 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:32.899063 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8d507797-46b5-4fc5-bd6f-55ae8be44873 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:32.899834 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8d507797-46b5-4fc5-bd6f-55ae8be44873 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:32.900656 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8d507797-46b5-4fc5-bd6f-55ae8be44873 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:32.901353 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8d507797-46b5-4fc5-bd6f-55ae8be44873 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:33.063588 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8d507797-46b5-4fc5-bd6f-55ae8be44873 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:33.071546 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8d507797-46b5-4fc5-bd6f-55ae8be44873 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1517 microversion: 2.1 time: 0.186040 Apr 16 21:26:33.072118 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2591/5010] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:32 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1517 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:33.186883 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-26ddc47d-0707-4056-96f4-19f38dd5ecc2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:33.187496 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-26ddc47d-0707-4056-96f4-19f38dd5ecc2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1fbb0c9-4072-4260-859f-aadf53c653bb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:33.195971 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-26ddc47d-0707-4056-96f4-19f38dd5ecc2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:33.196456 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-26ddc47d-0707-4056-96f4-19f38dd5ecc2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:33.197237 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-26ddc47d-0707-4056-96f4-19f38dd5ecc2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:33.206754 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-26ddc47d-0707-4056-96f4-19f38dd5ecc2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:33.353742 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8d203c19-bc51-4629-bba9-00b2fbcd7d82 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:33.354375 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8d203c19-bc51-4629-bba9-00b2fbcd7d82 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:33.360993 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8d203c19-bc51-4629-bba9-00b2fbcd7d82 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:33.361482 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8d203c19-bc51-4629-bba9-00b2fbcd7d82 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:33.362549 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8d203c19-bc51-4629-bba9-00b2fbcd7d82 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:33.363008 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8d203c19-bc51-4629-bba9-00b2fbcd7d82 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:33.507365 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8d203c19-bc51-4629-bba9-00b2fbcd7d82 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:33.516462 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8d203c19-bc51-4629-bba9-00b2fbcd7d82 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 200 len: 1511 microversion: 2.1 time: 0.166704 Apr 16 21:26:33.517060 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2592/5011] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:33 2022] GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 1511 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:26:33.597263 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-26ddc47d-0707-4056-96f4-19f38dd5ecc2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:33.604953 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-26ddc47d-0707-4056-96f4-19f38dd5ecc2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1fbb0c9-4072-4260-859f-aadf53c653bb" status: 200 len: 1196 microversion: 2.1 time: 0.421822 Apr 16 21:26:33.605862 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2420/5012] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:33 2022] GET /compute/v2.1/servers/b1fbb0c9-4072-4260-859f-aadf53c653bb => generated 1196 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:33.657014 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e4c992b9-a162-4528-ac52-b5a4764312e1 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:33.657662 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e4c992b9-a162-4528-ac52-b5a4764312e1 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:33.664959 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e4c992b9-a162-4528-ac52-b5a4764312e1 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:33.665416 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e4c992b9-a162-4528-ac52-b5a4764312e1 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:33.666197 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e4c992b9-a162-4528-ac52-b5a4764312e1 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:33.666648 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e4c992b9-a162-4528-ac52-b5a4764312e1 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:33.729121 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e4c992b9-a162-4528-ac52-b5a4764312e1 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:33.738635 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e4c992b9-a162-4528-ac52-b5a4764312e1 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:33.744690 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e4c992b9-a162-4528-ac52-b5a4764312e1 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:33.748096 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e4c992b9-a162-4528-ac52-b5a4764312e1 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] 10.222.0.20 "GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2" status: 200 len: 1365 microversion: 2.57 time: 0.093057 Apr 16 21:26:33.748096 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2593/5013] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:33 2022] GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2 => generated 1365 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:26:33.808827 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-17d6638d-5dfd-4b69-820b-be2cd6fd5c64 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:33.809447 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-17d6638d-5dfd-4b69-820b-be2cd6fd5c64 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 8d623e8d-480f-48ef-b90c-04450df4aec8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:33.816389 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-17d6638d-5dfd-4b69-820b-be2cd6fd5c64 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:33.817148 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-17d6638d-5dfd-4b69-820b-be2cd6fd5c64 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:33.817924 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-17d6638d-5dfd-4b69-820b-be2cd6fd5c64 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:33.818366 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-17d6638d-5dfd-4b69-820b-be2cd6fd5c64 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:33.832810 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-17d6638d-5dfd-4b69-820b-be2cd6fd5c64 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] HTTP exception thrown: Instance 8d623e8d-480f-48ef-b90c-04450df4aec8 could not be found. Apr 16 21:26:33.833419 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-17d6638d-5dfd-4b69-820b-be2cd6fd5c64 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Returning 404 to user: Instance 8d623e8d-480f-48ef-b90c-04450df4aec8 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:26:33.834252 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-17d6638d-5dfd-4b69-820b-be2cd6fd5c64 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8" status: 404 len: 111 microversion: 2.1 time: 0.029515 Apr 16 21:26:33.835059 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2421/5014] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:33 2022] GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:26:33.844594 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5480d2b9-fe22-4687-8978-1ef4c8e11c84 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '.version_select at 0x7fbb9ffebaf0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:33.948800 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5480d2b9-fe22-4687-8978-1ef4c8e11c84 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-519619523" status: 202 len: 0 microversion: 2.1 time: 0.108475 Apr 16 21:26:33.949451 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2594/5015] 10.222.0.20 () {58 vars in 1217 bytes} [Sat Apr 16 21:26:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-519619523 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:26:34.090357 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-09c16c61-d4b9-44c6-bc1c-a30ae3c05726 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:34.091170 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-09c16c61-d4b9-44c6-bc1c-a30ae3c05726 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:34.097875 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-09c16c61-d4b9-44c6-bc1c-a30ae3c05726 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:34.098433 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-09c16c61-d4b9-44c6-bc1c-a30ae3c05726 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:34.099574 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-09c16c61-d4b9-44c6-bc1c-a30ae3c05726 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:34.100392 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-09c16c61-d4b9-44c6-bc1c-a30ae3c05726 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:34.293992 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-09c16c61-d4b9-44c6-bc1c-a30ae3c05726 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:34.302168 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-09c16c61-d4b9-44c6-bc1c-a30ae3c05726 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1517 microversion: 2.1 time: 0.216823 Apr 16 21:26:34.302983 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2422/5016] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:34 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1517 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:34.535386 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-62fb5dd1-0484-4c34-beb4-ced2fa8acc0e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:34.536053 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-62fb5dd1-0484-4c34-beb4-ced2fa8acc0e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:34.543264 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-62fb5dd1-0484-4c34-beb4-ced2fa8acc0e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:34.543741 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-62fb5dd1-0484-4c34-beb4-ced2fa8acc0e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:34.544630 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-62fb5dd1-0484-4c34-beb4-ced2fa8acc0e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:34.545376 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-62fb5dd1-0484-4c34-beb4-ced2fa8acc0e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:34.622371 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-991f8fe5-3003-41a3-9883-eb746b505f1c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:34.623148 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-991f8fe5-3003-41a3-9883-eb746b505f1c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1fbb0c9-4072-4260-859f-aadf53c653bb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:34.630512 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-991f8fe5-3003-41a3-9883-eb746b505f1c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:34.631208 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-991f8fe5-3003-41a3-9883-eb746b505f1c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:34.631957 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-991f8fe5-3003-41a3-9883-eb746b505f1c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:34.632449 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-991f8fe5-3003-41a3-9883-eb746b505f1c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:34.736082 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-991f8fe5-3003-41a3-9883-eb746b505f1c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:34.743975 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-991f8fe5-3003-41a3-9883-eb746b505f1c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1fbb0c9-4072-4260-859f-aadf53c653bb" status: 200 len: 1262 microversion: 2.1 time: 0.125614 Apr 16 21:26:34.745917 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2423/5017] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:34 2022] GET /compute/v2.1/servers/b1fbb0c9-4072-4260-859f-aadf53c653bb => generated 1262 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:34.763934 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-62fb5dd1-0484-4c34-beb4-ced2fa8acc0e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:34.771487 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7d1c7a1a-b4fc-4dcf-bd4c-552c35f403d3 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:34.772113 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7d1c7a1a-b4fc-4dcf-bd4c-552c35f403d3 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:34.774746 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-62fb5dd1-0484-4c34-beb4-ced2fa8acc0e tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 200 len: 1511 microversion: 2.1 time: 0.243872 Apr 16 21:26:34.775574 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2595/5018] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:34 2022] GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 1511 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:34.779998 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7d1c7a1a-b4fc-4dcf-bd4c-552c35f403d3 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:34.779998 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7d1c7a1a-b4fc-4dcf-bd4c-552c35f403d3 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:34.780850 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7d1c7a1a-b4fc-4dcf-bd4c-552c35f403d3 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:34.781303 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7d1c7a1a-b4fc-4dcf-bd4c-552c35f403d3 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:34.861359 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7d1c7a1a-b4fc-4dcf-bd4c-552c35f403d3 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:34.870695 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7d1c7a1a-b4fc-4dcf-bd4c-552c35f403d3 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:34.872230 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7d1c7a1a-b4fc-4dcf-bd4c-552c35f403d3 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:34.873433 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7d1c7a1a-b4fc-4dcf-bd4c-552c35f403d3 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] 10.222.0.20 "GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2" status: 200 len: 1365 microversion: 2.57 time: 0.106582 Apr 16 21:26:34.874004 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2424/5019] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:34 2022] GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2 => generated 1365 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:26:34.988522 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3056c382-4c34-41cc-b34d-89cbf9ec42d2 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Action: 'create', calling method: .version_select at 0x7fbb95984550>, body: {"keypair": {"name": "tempest-keypair-1754429898"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:26:35.008643 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-3056c382-4c34-41cc-b34d-89cbf9ec42d2 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Getting quotas for project d6f8dfa11e9b410cbbd59ffe32afeb26. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:26:35.014703 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-3056c382-4c34-41cc-b34d-89cbf9ec42d2 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Getting quotas for user 37443a4e933a4873bb039b06efaec98f and project d6f8dfa11e9b410cbbd59ffe32afeb26. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:26:35.319517 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a8ddf627-b38e-4e87-a1fd-9e17bdf42527 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:35.320246 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a8ddf627-b38e-4e87-a1fd-9e17bdf42527 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:35.327387 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a8ddf627-b38e-4e87-a1fd-9e17bdf42527 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:35.327926 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a8ddf627-b38e-4e87-a1fd-9e17bdf42527 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:35.328831 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a8ddf627-b38e-4e87-a1fd-9e17bdf42527 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:35.329334 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a8ddf627-b38e-4e87-a1fd-9e17bdf42527 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:35.355454 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-3056c382-4c34-41cc-b34d-89cbf9ec42d2 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Getting quotas for project d6f8dfa11e9b410cbbd59ffe32afeb26. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:26:35.367069 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-3056c382-4c34-41cc-b34d-89cbf9ec42d2 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Getting quotas for user 37443a4e933a4873bb039b06efaec98f and project d6f8dfa11e9b410cbbd59ffe32afeb26. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:26:35.383367 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3056c382-4c34-41cc-b34d-89cbf9ec42d2 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.400728 Apr 16 21:26:35.383985 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2596/5020] 10.222.0.20 () {60 vars in 1157 bytes} [Sat Apr 16 21:26:34 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:35.556968 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a8ddf627-b38e-4e87-a1fd-9e17bdf42527 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:35.563168 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a8ddf627-b38e-4e87-a1fd-9e17bdf42527 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1517 microversion: 2.1 time: 0.248064 Apr 16 21:26:35.563849 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2425/5021] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:35 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1517 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:35.763200 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7cb8dd51-f34f-4518-b9b8-38e4d7d8736a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:35.763769 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7cb8dd51-f34f-4518-b9b8-38e4d7d8736a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1fbb0c9-4072-4260-859f-aadf53c653bb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:35.772423 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7cb8dd51-f34f-4518-b9b8-38e4d7d8736a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:35.773344 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7cb8dd51-f34f-4518-b9b8-38e4d7d8736a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:35.774309 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7cb8dd51-f34f-4518-b9b8-38e4d7d8736a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:35.774911 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7cb8dd51-f34f-4518-b9b8-38e4d7d8736a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:35.798164 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-578517f4-bab7-459c-a910-5ad74f21cf04 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:35.799261 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-578517f4-bab7-459c-a910-5ad74f21cf04 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:35.813216 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-578517f4-bab7-459c-a910-5ad74f21cf04 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:35.813827 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-578517f4-bab7-459c-a910-5ad74f21cf04 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:35.814746 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-578517f4-bab7-459c-a910-5ad74f21cf04 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:35.816768 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-578517f4-bab7-459c-a910-5ad74f21cf04 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:35.958253 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7cb8dd51-f34f-4518-b9b8-38e4d7d8736a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:35.966440 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7cb8dd51-f34f-4518-b9b8-38e4d7d8736a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1fbb0c9-4072-4260-859f-aadf53c653bb" status: 200 len: 1292 microversion: 2.1 time: 0.208641 Apr 16 21:26:35.976427 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2597/5022] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:35 2022] GET /compute/v2.1/servers/b1fbb0c9-4072-4260-859f-aadf53c653bb => generated 1292 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:35.981554 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-863f1358-cc3e-4a58-8dc9-0db00fdb721a tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:35.982199 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-863f1358-cc3e-4a58-8dc9-0db00fdb721a tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:36.000086 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-863f1358-cc3e-4a58-8dc9-0db00fdb721a tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:36.000817 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-863f1358-cc3e-4a58-8dc9-0db00fdb721a tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:36.001503 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-863f1358-cc3e-4a58-8dc9-0db00fdb721a tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:36.002245 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-863f1358-cc3e-4a58-8dc9-0db00fdb721a tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:36.034708 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-578517f4-bab7-459c-a910-5ad74f21cf04 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:36.043377 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-578517f4-bab7-459c-a910-5ad74f21cf04 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 200 len: 1488 microversion: 2.1 time: 0.250914 Apr 16 21:26:36.044602 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2426/5023] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:35 2022] GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 1488 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:36.061005 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-38e02563-47d5-4701-867d-9457b28a73e5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:36.061808 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-38e02563-47d5-4701-867d-9457b28a73e5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:36.068860 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-38e02563-47d5-4701-867d-9457b28a73e5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:36.069825 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-38e02563-47d5-4701-867d-9457b28a73e5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:36.070662 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-38e02563-47d5-4701-867d-9457b28a73e5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:36.071314 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-38e02563-47d5-4701-867d-9457b28a73e5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:36.092337 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-863f1358-cc3e-4a58-8dc9-0db00fdb721a tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:36.102263 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-38e02563-47d5-4701-867d-9457b28a73e5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:26:36.106987 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-863f1358-cc3e-4a58-8dc9-0db00fdb721a tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:36.109849 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-863f1358-cc3e-4a58-8dc9-0db00fdb721a tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:36.111078 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-863f1358-cc3e-4a58-8dc9-0db00fdb721a tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] 10.222.0.20 "GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2" status: 200 len: 1365 microversion: 2.57 time: 0.133573 Apr 16 21:26:36.121859 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2598/5024] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:35 2022] GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2 => generated 1365 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:26:36.497457 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-d5c54dde-73d0-41ca-85e7-4f64d0e3eef2 req-4c86b98d-3415-475c-aa09-670906a5a646 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1fbb0c9-4072-4260-859f-aadf53c653bb", "tag": "c0c5154e-e278-4526-8a07-42e809fbe3c8"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:26:36.507428 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-d5c54dde-73d0-41ca-85e7-4f64d0e3eef2 req-4c86b98d-3415-475c-aa09-670906a5a646 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:36.507921 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-d5c54dde-73d0-41ca-85e7-4f64d0e3eef2 req-4c86b98d-3415-475c-aa09-670906a5a646 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:36.531662 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-38e02563-47d5-4701-867d-9457b28a73e5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 204 len: 0 microversion: 2.1 time: 0.467474 Apr 16 21:26:36.532126 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-d5c54dde-73d0-41ca-85e7-4f64d0e3eef2 req-4c86b98d-3415-475c-aa09-670906a5a646 service nova] Creating event network-changed:c0c5154e-e278-4526-8a07-42e809fbe3c8 for instance b1fbb0c9-4072-4260-859f-aadf53c653bb on nch1-master-1 Apr 16 21:26:36.534085 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2427/5025] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:26:36 2022] DELETE /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:26:36.541233 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-d5c54dde-73d0-41ca-85e7-4f64d0e3eef2 req-4c86b98d-3415-475c-aa09-670906a5a646 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047843 Apr 16 21:26:36.546552 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-aff014ef-0095-4588-abda-335f25d1c4ec tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:36.547389 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-aff014ef-0095-4588-abda-335f25d1c4ec tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:36.548026 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2599/5026] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:26:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:26:36.582033 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1885d6dc-52ad-4d96-8241-14d49c5b66f8 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:36.582780 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1885d6dc-52ad-4d96-8241-14d49c5b66f8 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:36.588720 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aff014ef-0095-4588-abda-335f25d1c4ec tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:36.593976 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aff014ef-0095-4588-abda-335f25d1c4ec tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:36.593976 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aff014ef-0095-4588-abda-335f25d1c4ec tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:36.593976 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aff014ef-0095-4588-abda-335f25d1c4ec tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:36.599647 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1885d6dc-52ad-4d96-8241-14d49c5b66f8 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:36.600118 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1885d6dc-52ad-4d96-8241-14d49c5b66f8 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:36.600961 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1885d6dc-52ad-4d96-8241-14d49c5b66f8 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:36.601410 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1885d6dc-52ad-4d96-8241-14d49c5b66f8 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:36.777955 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1885d6dc-52ad-4d96-8241-14d49c5b66f8 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:36.795085 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1885d6dc-52ad-4d96-8241-14d49c5b66f8 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1517 microversion: 2.1 time: 0.217328 Apr 16 21:26:36.795683 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2600/5027] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:36 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1517 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:26:36.883385 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-aff014ef-0095-4588-abda-335f25d1c4ec tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:36.890973 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-aff014ef-0095-4588-abda-335f25d1c4ec tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 200 len: 1494 microversion: 2.1 time: 0.352606 Apr 16 21:26:36.891552 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2428/5028] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:36 2022] GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 1494 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:26:36.986950 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-87e35e89-9627-49a6-a8c6-98c7093819c5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:36.988274 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-87e35e89-9627-49a6-a8c6-98c7093819c5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1fbb0c9-4072-4260-859f-aadf53c653bb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:36.998004 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-87e35e89-9627-49a6-a8c6-98c7093819c5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:36.998517 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-87e35e89-9627-49a6-a8c6-98c7093819c5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:36.999316 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-87e35e89-9627-49a6-a8c6-98c7093819c5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:36.999769 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-87e35e89-9627-49a6-a8c6-98c7093819c5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:37.131802 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-99ce39ee-e666-4684-9bfa-b08f84353721 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:37.132850 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-99ce39ee-e666-4684-9bfa-b08f84353721 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:37.139050 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-99ce39ee-e666-4684-9bfa-b08f84353721 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:37.139703 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-99ce39ee-e666-4684-9bfa-b08f84353721 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:37.140695 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-99ce39ee-e666-4684-9bfa-b08f84353721 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:37.141309 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-99ce39ee-e666-4684-9bfa-b08f84353721 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:37.173728 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-87e35e89-9627-49a6-a8c6-98c7093819c5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:37.181171 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-87e35e89-9627-49a6-a8c6-98c7093819c5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1fbb0c9-4072-4260-859f-aadf53c653bb" status: 200 len: 1292 microversion: 2.1 time: 0.201238 Apr 16 21:26:37.181756 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2601/5029] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:36 2022] GET /compute/v2.1/servers/b1fbb0c9-4072-4260-859f-aadf53c653bb => generated 1292 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:37.228001 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-99ce39ee-e666-4684-9bfa-b08f84353721 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:37.236964 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-99ce39ee-e666-4684-9bfa-b08f84353721 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:37.238892 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-99ce39ee-e666-4684-9bfa-b08f84353721 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:37.240118 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-99ce39ee-e666-4684-9bfa-b08f84353721 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] 10.222.0.20 "GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2" status: 200 len: 1365 microversion: 2.57 time: 0.112619 Apr 16 21:26:37.240886 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2429/5030] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:37 2022] GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2 => generated 1365 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:26:37.645402 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-4c5e3692-f752-4795-b36c-1923abdfdd17 req-5af4effb-47de-4833-bfbf-a5f4578c94a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daf189e2-7cb4-4dab-94cf-ffdceb314df7", "name": "network-vif-plugged", "status": "completed", "tag": "29f0877d-908a-47df-aa37-d5dcea212e40"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:26:37.656587 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-4c5e3692-f752-4795-b36c-1923abdfdd17 req-5af4effb-47de-4833-bfbf-a5f4578c94a4 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:37.657400 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-4c5e3692-f752-4795-b36c-1923abdfdd17 req-5af4effb-47de-4833-bfbf-a5f4578c94a4 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:37.673023 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-4c5e3692-f752-4795-b36c-1923abdfdd17 req-5af4effb-47de-4833-bfbf-a5f4578c94a4 service nova] Creating event network-vif-plugged:29f0877d-908a-47df-aa37-d5dcea212e40 for instance daf189e2-7cb4-4dab-94cf-ffdceb314df7 on nch1-master-1 Apr 16 21:26:37.684355 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-4c5e3692-f752-4795-b36c-1923abdfdd17 req-5af4effb-47de-4833-bfbf-a5f4578c94a4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042438 Apr 16 21:26:37.685029 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2602/5031] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:26:37.812473 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e1ecee97-3316-486b-927a-90d138e281c9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:37.814140 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e1ecee97-3316-486b-927a-90d138e281c9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:37.821822 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e1ecee97-3316-486b-927a-90d138e281c9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:37.822507 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e1ecee97-3316-486b-927a-90d138e281c9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:37.823475 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e1ecee97-3316-486b-927a-90d138e281c9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:37.824088 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e1ecee97-3316-486b-927a-90d138e281c9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:37.911143 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e3a78265-4a68-40d8-b6e6-0938bc42682b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:37.912269 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e3a78265-4a68-40d8-b6e6-0938bc42682b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:37.918822 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e3a78265-4a68-40d8-b6e6-0938bc42682b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:37.924093 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e3a78265-4a68-40d8-b6e6-0938bc42682b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:37.924093 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e3a78265-4a68-40d8-b6e6-0938bc42682b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:37.924093 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e3a78265-4a68-40d8-b6e6-0938bc42682b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:37.968065 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e1ecee97-3316-486b-927a-90d138e281c9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:37.976223 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e1ecee97-3316-486b-927a-90d138e281c9 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1517 microversion: 2.1 time: 0.167624 Apr 16 21:26:37.976819 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2430/5032] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:37 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1517 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:26:38.198930 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-169df456-88a4-453a-8c47-b77b11bb8369 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:38.199839 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-169df456-88a4-453a-8c47-b77b11bb8369 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1fbb0c9-4072-4260-859f-aadf53c653bb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:38.202696 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e3a78265-4a68-40d8-b6e6-0938bc42682b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:38.207427 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-169df456-88a4-453a-8c47-b77b11bb8369 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:38.207971 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-169df456-88a4-453a-8c47-b77b11bb8369 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:38.209012 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-169df456-88a4-453a-8c47-b77b11bb8369 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:38.209587 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-169df456-88a4-453a-8c47-b77b11bb8369 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:38.214082 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e3a78265-4a68-40d8-b6e6-0938bc42682b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 200 len: 1494 microversion: 2.1 time: 0.308680 Apr 16 21:26:38.217722 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2603/5033] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:37 2022] GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 1494 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:26:38.260188 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-788f169c-3e11-498c-865d-e63069606b71 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:38.264249 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-788f169c-3e11-498c-865d-e63069606b71 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:38.267456 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-788f169c-3e11-498c-865d-e63069606b71 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:38.268539 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-788f169c-3e11-498c-865d-e63069606b71 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:38.269461 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-788f169c-3e11-498c-865d-e63069606b71 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:38.270089 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-788f169c-3e11-498c-865d-e63069606b71 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:38.367619 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-169df456-88a4-453a-8c47-b77b11bb8369 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:38.380024 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-169df456-88a4-453a-8c47-b77b11bb8369 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1fbb0c9-4072-4260-859f-aadf53c653bb" status: 200 len: 1292 microversion: 2.1 time: 0.181441 Apr 16 21:26:38.380024 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2431/5034] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:38 2022] GET /compute/v2.1/servers/b1fbb0c9-4072-4260-859f-aadf53c653bb => generated 1292 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:38.389160 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-788f169c-3e11-498c-865d-e63069606b71 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:38.398609 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-788f169c-3e11-498c-865d-e63069606b71 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:38.400408 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-788f169c-3e11-498c-865d-e63069606b71 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:38.402204 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-788f169c-3e11-498c-865d-e63069606b71 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] 10.222.0.20 "GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2" status: 200 len: 1365 microversion: 2.57 time: 0.146028 Apr 16 21:26:38.403321 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2604/5035] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:38 2022] GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2 => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:26:38.744755 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-cd016e6e-b246-4b67-910c-662cbd5eb7b1 req-eea7fa5c-8772-40c4-8097-195bbc568f47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e13f52f-cb80-494c-8cc8-f785a71975e0", "name": "network-vif-deleted", "tag": "7542af86-038e-4ed9-b3e1-69e05db5430f"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:26:38.759136 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-cd016e6e-b246-4b67-910c-662cbd5eb7b1 req-eea7fa5c-8772-40c4-8097-195bbc568f47 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:38.761356 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-cd016e6e-b246-4b67-910c-662cbd5eb7b1 req-eea7fa5c-8772-40c4-8097-195bbc568f47 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:38.773432 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-cd016e6e-b246-4b67-910c-662cbd5eb7b1 req-eea7fa5c-8772-40c4-8097-195bbc568f47 service nova] Creating event network-vif-deleted:7542af86-038e-4ed9-b3e1-69e05db5430f for instance 3e13f52f-cb80-494c-8cc8-f785a71975e0 on nch2-master-1 Apr 16 21:26:38.779742 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-cd016e6e-b246-4b67-910c-662cbd5eb7b1 req-eea7fa5c-8772-40c4-8097-195bbc568f47 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041939 Apr 16 21:26:38.784331 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2432/5036] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:26:38.994184 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-37b6a2da-0bd9-4401-8ccd-336e5846a1e5 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:38.995253 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-37b6a2da-0bd9-4401-8ccd-336e5846a1e5 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:39.002135 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-37b6a2da-0bd9-4401-8ccd-336e5846a1e5 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:39.002650 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-37b6a2da-0bd9-4401-8ccd-336e5846a1e5 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:39.003433 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-37b6a2da-0bd9-4401-8ccd-336e5846a1e5 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:39.003889 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-37b6a2da-0bd9-4401-8ccd-336e5846a1e5 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:39.206415 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-37b6a2da-0bd9-4401-8ccd-336e5846a1e5 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:39.222619 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-37b6a2da-0bd9-4401-8ccd-336e5846a1e5 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1517 microversion: 2.1 time: 0.233160 Apr 16 21:26:39.240219 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2605/5037] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:38 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1517 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:39.249960 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-99121b78-e77d-432e-a432-de6a8d7a4e34 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:39.254669 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-99121b78-e77d-432e-a432-de6a8d7a4e34 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:39.264719 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-99121b78-e77d-432e-a432-de6a8d7a4e34 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:39.265339 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-99121b78-e77d-432e-a432-de6a8d7a4e34 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:39.266480 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-99121b78-e77d-432e-a432-de6a8d7a4e34 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:39.267158 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-99121b78-e77d-432e-a432-de6a8d7a4e34 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:39.299937 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-99121b78-e77d-432e-a432-de6a8d7a4e34 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:39.300431 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-99121b78-e77d-432e-a432-de6a8d7a4e34 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:39.300892 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-99121b78-e77d-432e-a432-de6a8d7a4e34 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lazy-loading 'fault' on Instance uuid 3e13f52f-cb80-494c-8cc8-f785a71975e0 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:26:39.342150 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-99121b78-e77d-432e-a432-de6a8d7a4e34 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:39.350041 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-99121b78-e77d-432e-a432-de6a8d7a4e34 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 200 len: 1304 microversion: 2.1 time: 0.107840 Apr 16 21:26:39.352608 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2433/5038] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:39 2022] GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 1304 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:26:39.393652 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f5b04a53-58f8-4237-9bdf-396f486f7f6c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:39.394301 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f5b04a53-58f8-4237-9bdf-396f486f7f6c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1fbb0c9-4072-4260-859f-aadf53c653bb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:39.401283 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f5b04a53-58f8-4237-9bdf-396f486f7f6c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:39.404277 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f5b04a53-58f8-4237-9bdf-396f486f7f6c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:39.404277 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f5b04a53-58f8-4237-9bdf-396f486f7f6c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:39.404277 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f5b04a53-58f8-4237-9bdf-396f486f7f6c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:39.423878 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-eb8d6dbb-a5a4-41a0-9bbb-af9931d526d0 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:39.425500 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-eb8d6dbb-a5a4-41a0-9bbb-af9931d526d0 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:39.432750 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eb8d6dbb-a5a4-41a0-9bbb-af9931d526d0 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:39.438707 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eb8d6dbb-a5a4-41a0-9bbb-af9931d526d0 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:39.438707 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eb8d6dbb-a5a4-41a0-9bbb-af9931d526d0 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:39.438707 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eb8d6dbb-a5a4-41a0-9bbb-af9931d526d0 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:39.510835 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-eb8d6dbb-a5a4-41a0-9bbb-af9931d526d0 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:39.520791 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-eb8d6dbb-a5a4-41a0-9bbb-af9931d526d0 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:39.522724 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-eb8d6dbb-a5a4-41a0-9bbb-af9931d526d0 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:39.524190 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-eb8d6dbb-a5a4-41a0-9bbb-af9931d526d0 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] 10.222.0.20 "GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2" status: 200 len: 1365 microversion: 2.57 time: 0.105410 Apr 16 21:26:39.525130 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2434/5039] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:39 2022] GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2 => generated 1365 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:26:39.557858 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f5b04a53-58f8-4237-9bdf-396f486f7f6c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:39.570793 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3e5a1066-4cc6-4871-bd12-db936c0abc2f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-374931749", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "26fd8c71-2108-482c-9702-fc8775f3578f"}], "security_groups": [{"name": "tempest-securitygroup--1655225129"}], "key_name": "tempest-keypair-1754429898", "user_data": "}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:26:39.572448 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f5b04a53-58f8-4237-9bdf-396f486f7f6c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1fbb0c9-4072-4260-859f-aadf53c653bb" status: 200 len: 1292 microversion: 2.1 time: 0.183045 Apr 16 21:26:39.573140 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2606/5040] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:39 2022] GET /compute/v2.1/servers/b1fbb0c9-4072-4260-859f-aadf53c653bb => generated 1292 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:39.689838 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-3e5a1066-4cc6-4871-bd12-db936c0abc2f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] validate_networks() for [('26fd8c71-2108-482c-9702-fc8775f3578f', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:26:40.129229 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-3e5a1066-4cc6-4871-bd12-db936c0abc2f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:26:40.129726 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-3e5a1066-4cc6-4871-bd12-db936c0abc2f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:26:40.130213 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-3e5a1066-4cc6-4871-bd12-db936c0abc2f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:26:40.130678 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-3e5a1066-4cc6-4871-bd12-db936c0abc2f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:26:40.131090 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-3e5a1066-4cc6-4871-bd12-db936c0abc2f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:26:40.148351 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e5a1066-4cc6-4871-bd12-db936c0abc2f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:40.148351 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e5a1066-4cc6-4871-bd12-db936c0abc2f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:40.148866 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e5a1066-4cc6-4871-bd12-db936c0abc2f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:40.149307 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e5a1066-4cc6-4871-bd12-db936c0abc2f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:40.169019 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-3e5a1066-4cc6-4871-bd12-db936c0abc2f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Getting quotas for project d6f8dfa11e9b410cbbd59ffe32afeb26. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:26:40.176794 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-3e5a1066-4cc6-4871-bd12-db936c0abc2f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Getting quotas for user 37443a4e933a4873bb039b06efaec98f and project d6f8dfa11e9b410cbbd59ffe32afeb26. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:26:40.188572 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3e5a1066-4cc6-4871-bd12-db936c0abc2f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:26:40.191506 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3e5a1066-4cc6-4871-bd12-db936c0abc2f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 6eb61102-0483-413f-88b9-7519c852b7f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:26:40.246875 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a32f97cc-84bd-4db5-9a11-e205ae8804bc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:40.247518 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a32f97cc-84bd-4db5-9a11-e205ae8804bc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:40.255199 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a32f97cc-84bd-4db5-9a11-e205ae8804bc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:40.255750 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a32f97cc-84bd-4db5-9a11-e205ae8804bc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:40.256580 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a32f97cc-84bd-4db5-9a11-e205ae8804bc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:40.257027 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a32f97cc-84bd-4db5-9a11-e205ae8804bc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:40.335402 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3e5a1066-4cc6-4871-bd12-db936c0abc2f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.770747 Apr 16 21:26:40.342638 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2435/5041] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:26:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 778 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 16 21:26:40.347573 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1c248fec-4cc5-46aa-953f-0db4d4c0e934 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:40.348220 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1c248fec-4cc5-46aa-953f-0db4d4c0e934 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 6eb61102-0483-413f-88b9-7519c852b7f6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:40.420189 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1c248fec-4cc5-46aa-953f-0db4d4c0e934 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:40.427202 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1c248fec-4cc5-46aa-953f-0db4d4c0e934 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6" status: 200 len: 1241 microversion: 2.1 time: 0.083899 Apr 16 21:26:40.427782 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2436/5042] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:40 2022] GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6 => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:40.432897 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b6c4c26d-47ce-4a02-83c8-4b5a1d1931d5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:40.433779 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b6c4c26d-47ce-4a02-83c8-4b5a1d1931d5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:40.442576 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b6c4c26d-47ce-4a02-83c8-4b5a1d1931d5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:40.443236 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b6c4c26d-47ce-4a02-83c8-4b5a1d1931d5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:40.444006 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b6c4c26d-47ce-4a02-83c8-4b5a1d1931d5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:40.444620 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b6c4c26d-47ce-4a02-83c8-4b5a1d1931d5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:40.447506 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a32f97cc-84bd-4db5-9a11-e205ae8804bc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:40.458018 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a32f97cc-84bd-4db5-9a11-e205ae8804bc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1517 microversion: 2.1 time: 0.214883 Apr 16 21:26:40.468442 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2607/5043] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:40 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1517 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:26:40.468858 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-b6c4c26d-47ce-4a02-83c8-4b5a1d1931d5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] HTTP exception thrown: Instance 3e13f52f-cb80-494c-8cc8-f785a71975e0 could not be found. Apr 16 21:26:40.468858 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b6c4c26d-47ce-4a02-83c8-4b5a1d1931d5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Returning 404 to user: Instance 3e13f52f-cb80-494c-8cc8-f785a71975e0 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:26:40.468858 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b6c4c26d-47ce-4a02-83c8-4b5a1d1931d5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 404 len: 111 microversion: 2.1 time: 0.032314 Apr 16 21:26:40.468858 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2437/5044] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:40 2022] GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:26:40.543253 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-239c3ba3-2a3c-4a18-8c72-7164b4337f00 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:40.545109 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-239c3ba3-2a3c-4a18-8c72-7164b4337f00 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:40.558496 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-239c3ba3-2a3c-4a18-8c72-7164b4337f00 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:40.560091 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-239c3ba3-2a3c-4a18-8c72-7164b4337f00 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:40.563068 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-239c3ba3-2a3c-4a18-8c72-7164b4337f00 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:40.567184 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-239c3ba3-2a3c-4a18-8c72-7164b4337f00 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:40.589699 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-57cf85be-ca17-4243-a023-439b49aa157f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:40.590365 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-57cf85be-ca17-4243-a023-439b49aa157f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1fbb0c9-4072-4260-859f-aadf53c653bb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:40.602614 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-57cf85be-ca17-4243-a023-439b49aa157f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:40.603214 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-57cf85be-ca17-4243-a023-439b49aa157f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:40.604079 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-57cf85be-ca17-4243-a023-439b49aa157f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:40.604577 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-57cf85be-ca17-4243-a023-439b49aa157f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:40.648973 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-239c3ba3-2a3c-4a18-8c72-7164b4337f00 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:40.657850 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-239c3ba3-2a3c-4a18-8c72-7164b4337f00 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:40.660110 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-239c3ba3-2a3c-4a18-8c72-7164b4337f00 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:40.661323 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-239c3ba3-2a3c-4a18-8c72-7164b4337f00 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] 10.222.0.20 "GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2" status: 200 len: 1365 microversion: 2.57 time: 0.122427 Apr 16 21:26:40.661928 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2608/5045] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:40 2022] GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2 => generated 1365 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:26:40.673281 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-dfc8f8d3-d295-4189-9d74-e7b261933052 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-722928317", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "5fb5cf29-8796-41a2-8375-e8062a5911ad"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:26:40.725369 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-dfc8f8d3-d295-4189-9d74-e7b261933052 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] validate_networks() for [('5fb5cf29-8796-41a2-8375-e8062a5911ad', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:26:40.774473 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-57cf85be-ca17-4243-a023-439b49aa157f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:40.779144 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-57cf85be-ca17-4243-a023-439b49aa157f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1fbb0c9-4072-4260-859f-aadf53c653bb" status: 200 len: 1292 microversion: 2.1 time: 0.193332 Apr 16 21:26:40.779933 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2438/5046] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:40 2022] GET /compute/v2.1/servers/b1fbb0c9-4072-4260-859f-aadf53c653bb => generated 1292 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:41.185061 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-dfc8f8d3-d295-4189-9d74-e7b261933052 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:26:41.185319 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-dfc8f8d3-d295-4189-9d74-e7b261933052 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:26:41.185818 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-dfc8f8d3-d295-4189-9d74-e7b261933052 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:26:41.186431 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-dfc8f8d3-d295-4189-9d74-e7b261933052 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:26:41.186706 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-dfc8f8d3-d295-4189-9d74-e7b261933052 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:26:41.197423 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dfc8f8d3-d295-4189-9d74-e7b261933052 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:41.197813 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dfc8f8d3-d295-4189-9d74-e7b261933052 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:41.198628 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dfc8f8d3-d295-4189-9d74-e7b261933052 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:41.199519 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dfc8f8d3-d295-4189-9d74-e7b261933052 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:41.221853 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-dfc8f8d3-d295-4189-9d74-e7b261933052 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Getting quotas for project 7caf6e59a47149a68cae6224fb2856e7. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:26:41.228982 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-dfc8f8d3-d295-4189-9d74-e7b261933052 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Getting quotas for user e069f136dcb344b197f58ba47722f4d5 and project 7caf6e59a47149a68cae6224fb2856e7. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:26:41.246640 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-dfc8f8d3-d295-4189-9d74-e7b261933052 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:26:41.249365 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-dfc8f8d3-d295-4189-9d74-e7b261933052 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:26:41.272971 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-f0bb3925-db67-4463-b171-169d1ed768a1 req-6683fd17-0642-4f0a-91ba-ae65ecced774 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1fbb0c9-4072-4260-859f-aadf53c653bb", "name": "network-vif-plugged", "status": "completed", "tag": "c0c5154e-e278-4526-8a07-42e809fbe3c8"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:26:41.285798 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-f0bb3925-db67-4463-b171-169d1ed768a1 req-6683fd17-0642-4f0a-91ba-ae65ecced774 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:41.286173 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-f0bb3925-db67-4463-b171-169d1ed768a1 req-6683fd17-0642-4f0a-91ba-ae65ecced774 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:41.301375 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-f0bb3925-db67-4463-b171-169d1ed768a1 req-6683fd17-0642-4f0a-91ba-ae65ecced774 service nova] Creating event network-vif-plugged:c0c5154e-e278-4526-8a07-42e809fbe3c8 for instance b1fbb0c9-4072-4260-859f-aadf53c653bb on nch1-master-1 Apr 16 21:26:41.306332 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-f0bb3925-db67-4463-b171-169d1ed768a1 req-6683fd17-0642-4f0a-91ba-ae65ecced774 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039060 Apr 16 21:26:41.307057 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2439/5047] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:26:41.379914 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-dfc8f8d3-d295-4189-9d74-e7b261933052 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.716929 Apr 16 21:26:41.381355 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2609/5048] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:26:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:26:41.394084 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-dc98e0b5-cd64-4a7d-a60c-d5019011fa45 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:41.394807 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-dc98e0b5-cd64-4a7d-a60c-d5019011fa45 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:41.446573 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6fd2c562-dafa-4564-8ea2-0789b984541b tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:41.447302 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6fd2c562-dafa-4564-8ea2-0789b984541b tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 6eb61102-0483-413f-88b9-7519c852b7f6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:41.454341 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6fd2c562-dafa-4564-8ea2-0789b984541b tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:41.454983 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6fd2c562-dafa-4564-8ea2-0789b984541b tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:41.456932 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6fd2c562-dafa-4564-8ea2-0789b984541b tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:41.457385 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6fd2c562-dafa-4564-8ea2-0789b984541b tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:41.522483 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-dc98e0b5-cd64-4a7d-a60c-d5019011fa45 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:41.543313 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-dc98e0b5-cd64-4a7d-a60c-d5019011fa45 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11" status: 200 len: 1214 microversion: 2.1 time: 0.143896 Apr 16 21:26:41.543313 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2440/5049] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:41 2022] GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11 => generated 1214 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:41.543313 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1f549ccf-a9a6-421d-a886-c7b1a4c08333 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:41.543313 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1f549ccf-a9a6-421d-a886-c7b1a4c08333 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:41.554625 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1f549ccf-a9a6-421d-a886-c7b1a4c08333 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:41.555096 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1f549ccf-a9a6-421d-a886-c7b1a4c08333 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:41.555901 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1f549ccf-a9a6-421d-a886-c7b1a4c08333 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:41.556397 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1f549ccf-a9a6-421d-a886-c7b1a4c08333 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:41.579048 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6fd2c562-dafa-4564-8ea2-0789b984541b tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:41.590555 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6fd2c562-dafa-4564-8ea2-0789b984541b tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6" status: 200 len: 1245 microversion: 2.1 time: 0.149162 Apr 16 21:26:41.599147 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2610/5050] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:41 2022] GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6 => generated 1245 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:41.682046 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-88018e6f-4eb5-42ea-b9e3-9aa0360c1fde tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:41.682689 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-88018e6f-4eb5-42ea-b9e3-9aa0360c1fde tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:41.692131 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-88018e6f-4eb5-42ea-b9e3-9aa0360c1fde tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:41.697237 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-88018e6f-4eb5-42ea-b9e3-9aa0360c1fde tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:41.697237 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-88018e6f-4eb5-42ea-b9e3-9aa0360c1fde tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:41.697237 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-88018e6f-4eb5-42ea-b9e3-9aa0360c1fde tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:41.742269 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1f549ccf-a9a6-421d-a886-c7b1a4c08333 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:41.749739 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1f549ccf-a9a6-421d-a886-c7b1a4c08333 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1517 microversion: 2.1 time: 0.215763 Apr 16 21:26:41.750302 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2441/5051] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:41 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1517 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:41.758697 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-88018e6f-4eb5-42ea-b9e3-9aa0360c1fde tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:41.776360 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-88018e6f-4eb5-42ea-b9e3-9aa0360c1fde tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:41.776360 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-88018e6f-4eb5-42ea-b9e3-9aa0360c1fde tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:41.776360 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-88018e6f-4eb5-42ea-b9e3-9aa0360c1fde tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] 10.222.0.20 "GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2" status: 200 len: 1365 microversion: 2.57 time: 0.094151 Apr 16 21:26:41.776360 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2611/5052] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:41 2022] GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2 => generated 1365 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:26:41.796415 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0eec3e47-1333-42ba-947a-7346280adbd9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:41.797035 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0eec3e47-1333-42ba-947a-7346280adbd9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1fbb0c9-4072-4260-859f-aadf53c653bb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:41.803234 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0eec3e47-1333-42ba-947a-7346280adbd9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:41.803687 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0eec3e47-1333-42ba-947a-7346280adbd9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:41.804523 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0eec3e47-1333-42ba-947a-7346280adbd9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:41.804974 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0eec3e47-1333-42ba-947a-7346280adbd9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:41.937207 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0eec3e47-1333-42ba-947a-7346280adbd9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:41.945730 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0eec3e47-1333-42ba-947a-7346280adbd9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1fbb0c9-4072-4260-859f-aadf53c653bb" status: 200 len: 1292 microversion: 2.1 time: 0.153194 Apr 16 21:26:41.946679 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2442/5053] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:41 2022] GET /compute/v2.1/servers/b1fbb0c9-4072-4260-859f-aadf53c653bb => generated 1292 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:42.550716 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1c2cebf8-3087-4e3b-9e5f-6e7f25cbd7ff tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:42.551363 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1c2cebf8-3087-4e3b-9e5f-6e7f25cbd7ff tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:42.558102 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1c2cebf8-3087-4e3b-9e5f-6e7f25cbd7ff tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:42.558602 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1c2cebf8-3087-4e3b-9e5f-6e7f25cbd7ff tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:42.559376 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1c2cebf8-3087-4e3b-9e5f-6e7f25cbd7ff tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:42.559815 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1c2cebf8-3087-4e3b-9e5f-6e7f25cbd7ff tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:42.609816 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a8aa371b-0fac-49ee-9f4e-e3a139d02a03 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:42.615599 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a8aa371b-0fac-49ee-9f4e-e3a139d02a03 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 6eb61102-0483-413f-88b9-7519c852b7f6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:42.619934 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a8aa371b-0fac-49ee-9f4e-e3a139d02a03 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:42.620616 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a8aa371b-0fac-49ee-9f4e-e3a139d02a03 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:42.621598 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a8aa371b-0fac-49ee-9f4e-e3a139d02a03 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:42.622231 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a8aa371b-0fac-49ee-9f4e-e3a139d02a03 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:42.640452 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1c2cebf8-3087-4e3b-9e5f-6e7f25cbd7ff tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:42.648468 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1c2cebf8-3087-4e3b-9e5f-6e7f25cbd7ff tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11" status: 200 len: 1218 microversion: 2.1 time: 0.102145 Apr 16 21:26:42.649748 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2612/5054] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:42 2022] GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11 => generated 1218 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:42.694274 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a8aa371b-0fac-49ee-9f4e-e3a139d02a03 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:42.701682 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a8aa371b-0fac-49ee-9f4e-e3a139d02a03 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6" status: 200 len: 1293 microversion: 2.1 time: 0.096216 Apr 16 21:26:42.702255 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2443/5055] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:42 2022] GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6 => generated 1293 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:26:42.766850 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0175bb5d-3e69-4cd4-bdf9-60430ebbd5c3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:42.767488 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0175bb5d-3e69-4cd4-bdf9-60430ebbd5c3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:42.775158 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0175bb5d-3e69-4cd4-bdf9-60430ebbd5c3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:42.775722 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0175bb5d-3e69-4cd4-bdf9-60430ebbd5c3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:42.776813 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0175bb5d-3e69-4cd4-bdf9-60430ebbd5c3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:42.777257 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0175bb5d-3e69-4cd4-bdf9-60430ebbd5c3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:42.794121 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-df2b54e1-d4aa-4b33-9c7e-872ab56c1345 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:42.794909 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-df2b54e1-d4aa-4b33-9c7e-872ab56c1345 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:42.801139 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-df2b54e1-d4aa-4b33-9c7e-872ab56c1345 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:42.801688 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-df2b54e1-d4aa-4b33-9c7e-872ab56c1345 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:42.802582 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-df2b54e1-d4aa-4b33-9c7e-872ab56c1345 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:42.803106 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-df2b54e1-d4aa-4b33-9c7e-872ab56c1345 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:42.877896 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-df2b54e1-d4aa-4b33-9c7e-872ab56c1345 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:42.886068 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-df2b54e1-d4aa-4b33-9c7e-872ab56c1345 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:42.887683 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-df2b54e1-d4aa-4b33-9c7e-872ab56c1345 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:42.888910 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-df2b54e1-d4aa-4b33-9c7e-872ab56c1345 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] 10.222.0.20 "GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2" status: 200 len: 1383 microversion: 2.57 time: 0.099241 Apr 16 21:26:42.889479 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2444/5056] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:42 2022] GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2 => generated 1383 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:26:42.915474 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0175bb5d-3e69-4cd4-bdf9-60430ebbd5c3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:42.923363 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0175bb5d-3e69-4cd4-bdf9-60430ebbd5c3 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.160396 Apr 16 21:26:42.924019 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2613/5057] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:42 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:42.939556 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-348a8dd9-bc58-44ba-92a0-53b7c7087ab4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:42.940264 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-348a8dd9-bc58-44ba-92a0-53b7c7087ab4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:42.946306 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-348a8dd9-bc58-44ba-92a0-53b7c7087ab4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:42.946773 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-348a8dd9-bc58-44ba-92a0-53b7c7087ab4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:42.947822 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-348a8dd9-bc58-44ba-92a0-53b7c7087ab4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:42.948304 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-348a8dd9-bc58-44ba-92a0-53b7c7087ab4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:42.963283 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-376513b4-3c55-4724-bc28-b2634d37fb4c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:42.963995 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-376513b4-3c55-4724-bc28-b2634d37fb4c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1fbb0c9-4072-4260-859f-aadf53c653bb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:42.971042 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-376513b4-3c55-4724-bc28-b2634d37fb4c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:42.972180 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-376513b4-3c55-4724-bc28-b2634d37fb4c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:42.973121 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-376513b4-3c55-4724-bc28-b2634d37fb4c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:42.973575 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-376513b4-3c55-4724-bc28-b2634d37fb4c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:43.105816 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-348a8dd9-bc58-44ba-92a0-53b7c7087ab4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:43.114713 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-348a8dd9-bc58-44ba-92a0-53b7c7087ab4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.179082 Apr 16 21:26:43.116210 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2445/5058] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:42 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:43.141127 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-376513b4-3c55-4724-bc28-b2634d37fb4c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:43.144436 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2ba87e07-d8ba-4110-84e3-901f4f571a06 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:43.145047 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2ba87e07-d8ba-4110-84e3-901f4f571a06 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:43.151293 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-376513b4-3c55-4724-bc28-b2634d37fb4c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1fbb0c9-4072-4260-859f-aadf53c653bb" status: 200 len: 1473 microversion: 2.1 time: 0.191759 Apr 16 21:26:43.151473 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2ba87e07-d8ba-4110-84e3-901f4f571a06 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:43.151864 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2ba87e07-d8ba-4110-84e3-901f4f571a06 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:43.153668 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2614/5059] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:42 2022] GET /compute/v2.1/servers/b1fbb0c9-4072-4260-859f-aadf53c653bb => generated 1473 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:43.153808 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2ba87e07-d8ba-4110-84e3-901f4f571a06 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:43.153808 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2ba87e07-d8ba-4110-84e3-901f4f571a06 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:43.290643 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fb7266c3-89aa-4422-ae6b-6243daac6f6c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-231847600", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:26:43.306926 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2ba87e07-d8ba-4110-84e3-901f4f571a06 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:43.318094 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2ba87e07-d8ba-4110-84e3-901f4f571a06 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.174406 Apr 16 21:26:43.325128 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2446/5060] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:43 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:26:43.334761 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3ef38e39-dd07-4140-ab91-32e2c3f8a492 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:26:43.343510 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-3ef38e39-dd07-4140-ab91-32e2c3f8a492 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] HTTP exception thrown: Instance 5d7b348f-4e38-4d8a-a296-dbd26856e3b8 has no mapping to a cell. Apr 16 21:26:43.343806 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3ef38e39-dd07-4140-ab91-32e2c3f8a492 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Returning 404 to user: Instance 5d7b348f-4e38-4d8a-a296-dbd26856e3b8 has no mapping to a cell. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:26:43.344741 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3ef38e39-dd07-4140-ab91-32e2c3f8a492 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "POST /compute/v2.1/servers/5d7b348f-4e38-4d8a-a296-dbd26856e3b8/action" status: 404 len: 117 microversion: 2.1 time: 0.013857 Apr 16 21:26:43.345227 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2447/5061] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:26:43 2022] POST /compute/v2.1/servers/5d7b348f-4e38-4d8a-a296-dbd26856e3b8/action => generated 117 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:26:43.353888 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-13bb6d30-a9ca-4163-8d51-22ae477342c4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:43.356537 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-13bb6d30-a9ca-4163-8d51-22ae477342c4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:43.365388 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-13bb6d30-a9ca-4163-8d51-22ae477342c4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:43.365865 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-13bb6d30-a9ca-4163-8d51-22ae477342c4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:43.366684 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-13bb6d30-a9ca-4163-8d51-22ae477342c4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:43.367265 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-13bb6d30-a9ca-4163-8d51-22ae477342c4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:43.373343 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-fb7266c3-89aa-4422-ae6b-6243daac6f6c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] validate_networks() for [('8f593006-a7a9-4abc-8409-1d78959e9c9f', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:26:43.518764 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-13bb6d30-a9ca-4163-8d51-22ae477342c4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:43.525429 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-13bb6d30-a9ca-4163-8d51-22ae477342c4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.175190 Apr 16 21:26:43.526262 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2448/5062] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:43 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:26:43.542820 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-55432f3e-8da2-4402-a461-3ddd675897a4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:43.543331 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-55432f3e-8da2-4402-a461-3ddd675897a4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:43.549842 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-55432f3e-8da2-4402-a461-3ddd675897a4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:43.550309 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-55432f3e-8da2-4402-a461-3ddd675897a4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:43.551104 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-55432f3e-8da2-4402-a461-3ddd675897a4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:43.551605 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-55432f3e-8da2-4402-a461-3ddd675897a4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:43.696576 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-55432f3e-8da2-4402-a461-3ddd675897a4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:43.712076 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-55432f3e-8da2-4402-a461-3ddd675897a4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.173073 Apr 16 21:26:43.712766 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2449/5063] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:43 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:26:43.717796 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8d2a0205-711c-4859-ad2e-e2b29aa350db tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:43.718412 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8d2a0205-711c-4859-ad2e-e2b29aa350db tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:43.725275 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8d2a0205-711c-4859-ad2e-e2b29aa350db tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:43.725740 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8d2a0205-711c-4859-ad2e-e2b29aa350db tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:43.726529 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8d2a0205-711c-4859-ad2e-e2b29aa350db tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:43.727493 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8d2a0205-711c-4859-ad2e-e2b29aa350db tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:43.794897 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8d2a0205-711c-4859-ad2e-e2b29aa350db tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:43.797612 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-fb7266c3-89aa-4422-ae6b-6243daac6f6c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:26:43.798112 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-fb7266c3-89aa-4422-ae6b-6243daac6f6c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:26:43.798508 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-fb7266c3-89aa-4422-ae6b-6243daac6f6c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:26:43.799087 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-fb7266c3-89aa-4422-ae6b-6243daac6f6c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:26:43.799567 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-fb7266c3-89aa-4422-ae6b-6243daac6f6c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:26:43.803835 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8d2a0205-711c-4859-ad2e-e2b29aa350db tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11" status: 200 len: 1266 microversion: 2.1 time: 0.088975 Apr 16 21:26:43.803835 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2450/5064] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:43 2022] GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11 => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:43.808014 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0dc42f20-a9f5-4351-a0d9-949cf5a4506d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:43.808505 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fb7266c3-89aa-4422-ae6b-6243daac6f6c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:43.808677 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0dc42f20-a9f5-4351-a0d9-949cf5a4506d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 6eb61102-0483-413f-88b9-7519c852b7f6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:43.809082 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fb7266c3-89aa-4422-ae6b-6243daac6f6c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:43.809961 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fb7266c3-89aa-4422-ae6b-6243daac6f6c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:43.810484 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fb7266c3-89aa-4422-ae6b-6243daac6f6c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:43.814813 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0dc42f20-a9f5-4351-a0d9-949cf5a4506d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:43.815357 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0dc42f20-a9f5-4351-a0d9-949cf5a4506d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:43.816140 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0dc42f20-a9f5-4351-a0d9-949cf5a4506d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:43.816616 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0dc42f20-a9f5-4351-a0d9-949cf5a4506d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:43.827286 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-fb7266c3-89aa-4422-ae6b-6243daac6f6c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Getting quotas for project 76fd883ad3944fcaaecdf2909120dc87. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:26:43.833040 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-fb7266c3-89aa-4422-ae6b-6243daac6f6c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Getting quotas for user 5e71b35f438d4539a60a390e1ceec9cd and project 76fd883ad3944fcaaecdf2909120dc87. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:26:43.845247 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fb7266c3-89aa-4422-ae6b-6243daac6f6c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:26:43.848001 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fb7266c3-89aa-4422-ae6b-6243daac6f6c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 5fc44ff4-dc0c-4903-92e7-8c6c69cb1156] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:26:43.884285 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0dc42f20-a9f5-4351-a0d9-949cf5a4506d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:43.892061 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0dc42f20-a9f5-4351-a0d9-949cf5a4506d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6" status: 200 len: 1301 microversion: 2.1 time: 0.087656 Apr 16 21:26:43.892670 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2451/5065] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:43 2022] GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6 => generated 1301 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:43.897719 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0f4fc725-9866-4269-8d4a-7c489a62215e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:26:43.898252 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0f4fc725-9866-4269-8d4a-7c489a62215e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: 89a94590-d8ca-49a4-88b6-f8ccdcb0d64c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:43.903607 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-0f4fc725-9866-4269-8d4a-7c489a62215e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] HTTP exception thrown: Instance 89a94590-d8ca-49a4-88b6-f8ccdcb0d64c could not be found. Apr 16 21:26:43.904291 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0f4fc725-9866-4269-8d4a-7c489a62215e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Returning 404 to user: Instance 89a94590-d8ca-49a4-88b6-f8ccdcb0d64c could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:26:43.905101 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0f4fc725-9866-4269-8d4a-7c489a62215e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "POST /compute/v2.1/servers/89a94590-d8ca-49a4-88b6-f8ccdcb0d64c/action" status: 404 len: 111 microversion: 2.1 time: 0.010957 Apr 16 21:26:43.905640 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2452/5066] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:26:43 2022] POST /compute/v2.1/servers/89a94590-d8ca-49a4-88b6-f8ccdcb0d64c/action => generated 111 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:26:43.909948 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c384058f-705e-40e8-9bc5-ccd0cb4fcddf tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:43.911037 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c384058f-705e-40e8-9bc5-ccd0cb4fcddf tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:43.917880 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c384058f-705e-40e8-9bc5-ccd0cb4fcddf tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:43.918346 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c384058f-705e-40e8-9bc5-ccd0cb4fcddf tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:43.919114 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c384058f-705e-40e8-9bc5-ccd0cb4fcddf tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:43.919551 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c384058f-705e-40e8-9bc5-ccd0cb4fcddf tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:43.981275 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c384058f-705e-40e8-9bc5-ccd0cb4fcddf tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:43.989210 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c384058f-705e-40e8-9bc5-ccd0cb4fcddf tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:43.990762 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c384058f-705e-40e8-9bc5-ccd0cb4fcddf tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:43.991937 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c384058f-705e-40e8-9bc5-ccd0cb4fcddf tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] 10.222.0.20 "GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2" status: 200 len: 1371 microversion: 2.57 time: 0.085408 Apr 16 21:26:43.992501 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2453/5067] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:43 2022] GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2 => generated 1371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:26:43.996868 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f825186b-a73b-4ea3-9459-9411093aea74 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:43.997468 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f825186b-a73b-4ea3-9459-9411093aea74 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:44.003535 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f825186b-a73b-4ea3-9459-9411093aea74 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:44.007335 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f825186b-a73b-4ea3-9459-9411093aea74 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:44.007335 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f825186b-a73b-4ea3-9459-9411093aea74 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:44.007335 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f825186b-a73b-4ea3-9459-9411093aea74 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:44.066672 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fb7266c3-89aa-4422-ae6b-6243daac6f6c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.780292 Apr 16 21:26:44.068794 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2615/5068] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:26:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:26:44.082186 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1819ebf4-71a0-4148-a410-a1a415167121 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:44.082948 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1819ebf4-71a0-4148-a410-a1a415167121 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 5fc44ff4-dc0c-4903-92e7-8c6c69cb1156] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:44.102142 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1819ebf4-71a0-4148-a410-a1a415167121 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 5fc44ff4-dc0c-4903-92e7-8c6c69cb1156] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:26:44.147104 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f825186b-a73b-4ea3-9459-9411093aea74 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:44.154785 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f825186b-a73b-4ea3-9459-9411093aea74 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.161336 Apr 16 21:26:44.155359 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2454/5069] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:43 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:44.172044 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8f9a9c13-13b8-4fab-9185-c531b21cc33f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:44.172715 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8f9a9c13-13b8-4fab-9185-c531b21cc33f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:44.179561 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8f9a9c13-13b8-4fab-9185-c531b21cc33f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:44.180035 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8f9a9c13-13b8-4fab-9185-c531b21cc33f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:44.180864 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8f9a9c13-13b8-4fab-9185-c531b21cc33f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:44.181318 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8f9a9c13-13b8-4fab-9185-c531b21cc33f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:44.320651 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8f9a9c13-13b8-4fab-9185-c531b21cc33f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:44.328229 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8f9a9c13-13b8-4fab-9185-c531b21cc33f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.160017 Apr 16 21:26:44.328928 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2455/5070] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:44 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:26:44.344289 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-97cb5b69-b123-4e7d-8646-4b27ac1aaa00 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:26:44.344888 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-97cb5b69-b123-4e7d-8646-4b27ac1aaa00 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:44.350886 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-97cb5b69-b123-4e7d-8646-4b27ac1aaa00 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:44.351341 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-97cb5b69-b123-4e7d-8646-4b27ac1aaa00 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:44.352113 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-97cb5b69-b123-4e7d-8646-4b27ac1aaa00 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:44.352585 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-97cb5b69-b123-4e7d-8646-4b27ac1aaa00 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:44.378802 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-97cb5b69-b123-4e7d-8646-4b27ac1aaa00 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lazy-loading 'flavor' on Instance uuid daf189e2-7cb4-4dab-94cf-ffdceb314df7 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:26:44.452226 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1819ebf4-71a0-4148-a410-a1a415167121 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5fc44ff4-dc0c-4903-92e7-8c6c69cb1156" status: 204 len: 0 microversion: 2.1 time: 0.376993 Apr 16 21:26:44.455309 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2616/5071] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:26:44 2022] DELETE /compute/v2.1/servers/5fc44ff4-dc0c-4903-92e7-8c6c69cb1156 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:26:44.460886 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0140af49-2f82-40c5-b260-ade8bc0b22a2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:44.461492 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0140af49-2f82-40c5-b260-ade8bc0b22a2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 5fc44ff4-dc0c-4903-92e7-8c6c69cb1156] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:44.474667 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-0140af49-2f82-40c5-b260-ade8bc0b22a2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] HTTP exception thrown: Instance 5fc44ff4-dc0c-4903-92e7-8c6c69cb1156 could not be found. Apr 16 21:26:44.479047 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0140af49-2f82-40c5-b260-ade8bc0b22a2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Returning 404 to user: Instance 5fc44ff4-dc0c-4903-92e7-8c6c69cb1156 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:26:44.479047 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0140af49-2f82-40c5-b260-ade8bc0b22a2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/5fc44ff4-dc0c-4903-92e7-8c6c69cb1156" status: 404 len: 111 microversion: 2.1 time: 0.018993 Apr 16 21:26:44.479047 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2617/5072] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:44 2022] GET /compute/v2.1/servers/5fc44ff4-dc0c-4903-92e7-8c6c69cb1156 => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:26:44.524999 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-95f6179e-390f-474c-8b6f-96390700354c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1766985685", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "8f593006-a7a9-4abc-8409-1d78959e9c9f"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:26:44.578266 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-95f6179e-390f-474c-8b6f-96390700354c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] validate_networks() for [('8f593006-a7a9-4abc-8409-1d78959e9c9f', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:26:44.866436 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-97cb5b69-b123-4e7d-8646-4b27ac1aaa00 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "POST /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7/action" status: 202 len: 0 microversion: 2.1 time: 0.525668 Apr 16 21:26:44.870503 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2456/5073] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:26:44 2022] POST /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7/action => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 16 21:26:44.877220 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4bb7c7e5-55b9-4c5e-9c77-cbef90b378de tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:44.878213 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4bb7c7e5-55b9-4c5e-9c77-cbef90b378de tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:44.884847 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4bb7c7e5-55b9-4c5e-9c77-cbef90b378de tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:44.888232 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4bb7c7e5-55b9-4c5e-9c77-cbef90b378de tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:44.888232 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4bb7c7e5-55b9-4c5e-9c77-cbef90b378de tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:44.888232 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4bb7c7e5-55b9-4c5e-9c77-cbef90b378de tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:44.949597 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-95f6179e-390f-474c-8b6f-96390700354c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:26:44.950156 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-95f6179e-390f-474c-8b6f-96390700354c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:26:44.950517 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4bb7c7e5-55b9-4c5e-9c77-cbef90b378de tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:44.950697 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-95f6179e-390f-474c-8b6f-96390700354c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:26:44.950976 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-95f6179e-390f-474c-8b6f-96390700354c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:26:44.951397 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-95f6179e-390f-474c-8b6f-96390700354c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:26:44.958374 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4bb7c7e5-55b9-4c5e-9c77-cbef90b378de tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11" status: 200 len: 1266 microversion: 2.1 time: 0.085589 Apr 16 21:26:44.958951 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2457/5074] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:44 2022] GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11 => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:44.971961 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e76e4f1a-0e2c-46fb-855a-9bcf07bcace2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:44.972613 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e76e4f1a-0e2c-46fb-855a-9bcf07bcace2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:44.975758 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-95f6179e-390f-474c-8b6f-96390700354c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:44.976267 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-95f6179e-390f-474c-8b6f-96390700354c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:44.977134 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-95f6179e-390f-474c-8b6f-96390700354c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:44.977587 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-95f6179e-390f-474c-8b6f-96390700354c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:44.978978 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e76e4f1a-0e2c-46fb-855a-9bcf07bcace2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:44.979438 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e76e4f1a-0e2c-46fb-855a-9bcf07bcace2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:44.980255 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e76e4f1a-0e2c-46fb-855a-9bcf07bcace2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:44.980704 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e76e4f1a-0e2c-46fb-855a-9bcf07bcace2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:44.998118 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-95f6179e-390f-474c-8b6f-96390700354c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Getting quotas for project 76fd883ad3944fcaaecdf2909120dc87. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:26:45.003467 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-95f6179e-390f-474c-8b6f-96390700354c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Getting quotas for user 5e71b35f438d4539a60a390e1ceec9cd and project 76fd883ad3944fcaaecdf2909120dc87. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:26:45.017333 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-95f6179e-390f-474c-8b6f-96390700354c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:26:45.020284 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-95f6179e-390f-474c-8b6f-96390700354c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: fa0a30a4-6ada-4031-be8f-811c5b098de6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:26:45.117778 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e76e4f1a-0e2c-46fb-855a-9bcf07bcace2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:45.126125 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e76e4f1a-0e2c-46fb-855a-9bcf07bcace2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1512 microversion: 2.1 time: 0.166126 Apr 16 21:26:45.136680 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2458/5075] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:44 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1512 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:45.144161 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3488f195-b9c9-4adf-b9f2-d9f60645764e tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:45.148493 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3488f195-b9c9-4adf-b9f2-d9f60645764e tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 6eb61102-0483-413f-88b9-7519c852b7f6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:45.151301 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3488f195-b9c9-4adf-b9f2-d9f60645764e tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:45.151851 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3488f195-b9c9-4adf-b9f2-d9f60645764e tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:45.152825 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3488f195-b9c9-4adf-b9f2-d9f60645764e tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:45.153350 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3488f195-b9c9-4adf-b9f2-d9f60645764e tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:45.157338 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-95f6179e-390f-474c-8b6f-96390700354c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.636564 Apr 16 21:26:45.158229 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2618/5076] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:26:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 16 21:26:45.164369 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-423c78b1-8730-4670-b1e0-ccbd430c0700 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:45.165260 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-423c78b1-8730-4670-b1e0-ccbd430c0700 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:45.177856 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-423c78b1-8730-4670-b1e0-ccbd430c0700 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:45.180667 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-423c78b1-8730-4670-b1e0-ccbd430c0700 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:45.181921 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-423c78b1-8730-4670-b1e0-ccbd430c0700 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:45.183438 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-423c78b1-8730-4670-b1e0-ccbd430c0700 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:45.237820 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3488f195-b9c9-4adf-b9f2-d9f60645764e tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:45.245433 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3488f195-b9c9-4adf-b9f2-d9f60645764e tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6" status: 200 len: 1301 microversion: 2.1 time: 0.107648 Apr 16 21:26:45.254837 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2459/5077] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:45 2022] GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6 => generated 1301 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:45.254837 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c788a447-72fd-41bb-9690-7817881b96a7 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:45.254837 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c788a447-72fd-41bb-9690-7817881b96a7 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: fa0a30a4-6ada-4031-be8f-811c5b098de6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:45.342044 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c788a447-72fd-41bb-9690-7817881b96a7 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:45.352299 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c788a447-72fd-41bb-9690-7817881b96a7 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/fa0a30a4-6ada-4031-be8f-811c5b098de6" status: 200 len: 1221 microversion: 2.1 time: 0.104856 Apr 16 21:26:45.354002 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2460/5078] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:45 2022] GET /compute/v2.1/servers/fa0a30a4-6ada-4031-be8f-811c5b098de6 => generated 1221 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:45.369437 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-423c78b1-8730-4670-b1e0-ccbd430c0700 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:45.384872 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-423c78b1-8730-4670-b1e0-ccbd430c0700 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:45.388533 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-423c78b1-8730-4670-b1e0-ccbd430c0700 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:45.392491 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-423c78b1-8730-4670-b1e0-ccbd430c0700 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] 10.222.0.20 "GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2" status: 200 len: 1371 microversion: 2.57 time: 0.229717 Apr 16 21:26:45.393879 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2619/5079] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:45 2022] GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2 => generated 1371 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:26:45.975962 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a969da34-4eed-49cd-a557-de98216c7803 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:45.976667 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a969da34-4eed-49cd-a557-de98216c7803 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:45.983283 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a969da34-4eed-49cd-a557-de98216c7803 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:45.983753 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a969da34-4eed-49cd-a557-de98216c7803 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:45.984578 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a969da34-4eed-49cd-a557-de98216c7803 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:45.985031 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a969da34-4eed-49cd-a557-de98216c7803 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:46.070221 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a969da34-4eed-49cd-a557-de98216c7803 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:46.081160 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a969da34-4eed-49cd-a557-de98216c7803 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11" status: 200 len: 1274 microversion: 2.1 time: 0.109281 Apr 16 21:26:46.082197 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2461/5080] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:45 2022] GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11 => generated 1274 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:46.143971 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b894dda5-71d9-47b6-9a95-c615d6311874 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:46.144994 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b894dda5-71d9-47b6-9a95-c615d6311874 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:46.185074 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b894dda5-71d9-47b6-9a95-c615d6311874 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:46.185593 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b894dda5-71d9-47b6-9a95-c615d6311874 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:46.186445 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b894dda5-71d9-47b6-9a95-c615d6311874 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:46.186900 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b894dda5-71d9-47b6-9a95-c615d6311874 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:46.263928 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5b0cb676-e3e7-49ac-973d-caccf16958e4 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:46.264868 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5b0cb676-e3e7-49ac-973d-caccf16958e4 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 6eb61102-0483-413f-88b9-7519c852b7f6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:46.291980 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5b0cb676-e3e7-49ac-973d-caccf16958e4 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:46.293392 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5b0cb676-e3e7-49ac-973d-caccf16958e4 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:46.296966 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5b0cb676-e3e7-49ac-973d-caccf16958e4 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:46.297948 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5b0cb676-e3e7-49ac-973d-caccf16958e4 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:46.482005 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b894dda5-71d9-47b6-9a95-c615d6311874 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:46.491959 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b894dda5-71d9-47b6-9a95-c615d6311874 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1495 microversion: 2.1 time: 0.351299 Apr 16 21:26:46.493027 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2620/5081] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:46 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1495 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:46.498303 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4aa8de88-0481-40f0-8aa8-85527536e3bb tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:46.499369 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4aa8de88-0481-40f0-8aa8-85527536e3bb tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: fa0a30a4-6ada-4031-be8f-811c5b098de6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:46.507006 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4aa8de88-0481-40f0-8aa8-85527536e3bb tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:46.507680 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4aa8de88-0481-40f0-8aa8-85527536e3bb tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:46.508739 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4aa8de88-0481-40f0-8aa8-85527536e3bb tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:46.509602 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4aa8de88-0481-40f0-8aa8-85527536e3bb tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:46.623490 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5b0cb676-e3e7-49ac-973d-caccf16958e4 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:46.634815 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5b0cb676-e3e7-49ac-973d-caccf16958e4 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6" status: 200 len: 1367 microversion: 2.1 time: 0.375739 Apr 16 21:26:46.636995 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2462/5082] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:46 2022] GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6 => generated 1367 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:46.643852 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4aa8de88-0481-40f0-8aa8-85527536e3bb tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:46.653372 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-44b10001-a980-4139-a3f2-268ef195660d tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:46.653616 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4aa8de88-0481-40f0-8aa8-85527536e3bb tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/fa0a30a4-6ada-4031-be8f-811c5b098de6" status: 200 len: 1225 microversion: 2.1 time: 0.158665 Apr 16 21:26:46.654402 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2621/5083] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:46 2022] GET /compute/v2.1/servers/fa0a30a4-6ada-4031-be8f-811c5b098de6 => generated 1225 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:46.654536 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-44b10001-a980-4139-a3f2-268ef195660d tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:46.660801 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-44b10001-a980-4139-a3f2-268ef195660d tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:46.661516 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-44b10001-a980-4139-a3f2-268ef195660d tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:46.662546 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-44b10001-a980-4139-a3f2-268ef195660d tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:46.663220 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-44b10001-a980-4139-a3f2-268ef195660d tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:46.668284 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5b7493d4-2847-4011-9171-96edc7b2c47e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:26:46.668835 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5b7493d4-2847-4011-9171-96edc7b2c47e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:46.676694 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5b7493d4-2847-4011-9171-96edc7b2c47e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:46.677912 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5b7493d4-2847-4011-9171-96edc7b2c47e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:46.678739 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5b7493d4-2847-4011-9171-96edc7b2c47e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:46.679257 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5b7493d4-2847-4011-9171-96edc7b2c47e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:46.722167 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-5b7493d4-2847-4011-9171-96edc7b2c47e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lazy-loading 'flavor' on Instance uuid daf189e2-7cb4-4dab-94cf-ffdceb314df7 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:26:46.743110 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-5b7493d4-2847-4011-9171-96edc7b2c47e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] HTTP exception thrown: Cannot 'suspend' instance daf189e2-7cb4-4dab-94cf-ffdceb314df7 while it is in vm_state suspended Apr 16 21:26:46.748641 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5b7493d4-2847-4011-9171-96edc7b2c47e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Returning 409 to user: Cannot 'suspend' instance daf189e2-7cb4-4dab-94cf-ffdceb314df7 while it is in vm_state suspended {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:26:46.749546 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5b7493d4-2847-4011-9171-96edc7b2c47e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "POST /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7/action" status: 409 len: 148 microversion: 2.1 time: 0.092124 Apr 16 21:26:46.750272 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2622/5084] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:26:46 2022] POST /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7/action => generated 148 bytes in 95 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:26:46.758570 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ba270ea3-9b63-4d99-b5bf-0740ccd9c9ee tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:26:46.759234 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ba270ea3-9b63-4d99-b5bf-0740ccd9c9ee tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:46.765674 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ba270ea3-9b63-4d99-b5bf-0740ccd9c9ee tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:46.766253 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ba270ea3-9b63-4d99-b5bf-0740ccd9c9ee tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:46.767356 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ba270ea3-9b63-4d99-b5bf-0740ccd9c9ee tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:46.768507 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ba270ea3-9b63-4d99-b5bf-0740ccd9c9ee tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:46.846580 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-44b10001-a980-4139-a3f2-268ef195660d tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:46.859267 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-44b10001-a980-4139-a3f2-268ef195660d tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:46.861441 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-44b10001-a980-4139-a3f2-268ef195660d tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:46.862943 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-44b10001-a980-4139-a3f2-268ef195660d tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] 10.222.0.20 "GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2" status: 200 len: 1371 microversion: 2.57 time: 0.224413 Apr 16 21:26:46.863673 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2463/5085] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:46 2022] GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2 => generated 1371 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:26:47.099555 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f915c642-7d96-4fa2-bef1-700fab738db5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:47.100277 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f915c642-7d96-4fa2-bef1-700fab738db5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:47.103338 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ba270ea3-9b63-4d99-b5bf-0740ccd9c9ee tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "POST /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7/action" status: 202 len: 0 microversion: 2.1 time: 0.347739 Apr 16 21:26:47.105559 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2623/5086] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:26:46 2022] POST /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 16 21:26:47.112228 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f915c642-7d96-4fa2-bef1-700fab738db5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:47.118266 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e1a88239-2cd1-49f9-a8f2-1cd15ca15687 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:47.119404 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e1a88239-2cd1-49f9-a8f2-1cd15ca15687 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:47.127680 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f915c642-7d96-4fa2-bef1-700fab738db5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:47.139546 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f915c642-7d96-4fa2-bef1-700fab738db5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:47.139754 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e1a88239-2cd1-49f9-a8f2-1cd15ca15687 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:47.140133 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f915c642-7d96-4fa2-bef1-700fab738db5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:47.140789 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e1a88239-2cd1-49f9-a8f2-1cd15ca15687 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:47.141904 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e1a88239-2cd1-49f9-a8f2-1cd15ca15687 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:47.142539 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e1a88239-2cd1-49f9-a8f2-1cd15ca15687 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:47.500727 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f915c642-7d96-4fa2-bef1-700fab738db5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:47.510746 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f915c642-7d96-4fa2-bef1-700fab738db5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11" status: 200 len: 1314 microversion: 2.1 time: 0.414942 Apr 16 21:26:47.521162 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2464/5087] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:47 2022] GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11 => generated 1314 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:26:47.662150 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a0899340-9e73-4411-bf88-8f96bddf3edd tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:47.662978 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a0899340-9e73-4411-bf88-8f96bddf3edd tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 6eb61102-0483-413f-88b9-7519c852b7f6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:47.685540 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a0899340-9e73-4411-bf88-8f96bddf3edd tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:47.686410 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a0899340-9e73-4411-bf88-8f96bddf3edd tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:47.698194 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a0899340-9e73-4411-bf88-8f96bddf3edd tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:47.699993 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a0899340-9e73-4411-bf88-8f96bddf3edd tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:47.777423 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e1a88239-2cd1-49f9-a8f2-1cd15ca15687 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:47.788345 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e1a88239-2cd1-49f9-a8f2-1cd15ca15687 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1501 microversion: 2.1 time: 0.677628 Apr 16 21:26:47.789229 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2624/5088] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:47 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1501 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:47.796006 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a065a3e0-02f7-4f74-b3cb-b050ea97f79e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:47.796962 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a065a3e0-02f7-4f74-b3cb-b050ea97f79e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: fa0a30a4-6ada-4031-be8f-811c5b098de6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:47.807905 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a065a3e0-02f7-4f74-b3cb-b050ea97f79e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:47.807905 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a065a3e0-02f7-4f74-b3cb-b050ea97f79e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:47.807905 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a065a3e0-02f7-4f74-b3cb-b050ea97f79e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:47.807905 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a065a3e0-02f7-4f74-b3cb-b050ea97f79e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:47.918448 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a065a3e0-02f7-4f74-b3cb-b050ea97f79e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:47.931198 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a065a3e0-02f7-4f74-b3cb-b050ea97f79e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/fa0a30a4-6ada-4031-be8f-811c5b098de6" status: 200 len: 1273 microversion: 2.1 time: 0.140605 Apr 16 21:26:47.932198 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2625/5089] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:47 2022] GET /compute/v2.1/servers/fa0a30a4-6ada-4031-be8f-811c5b098de6 => generated 1273 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:47.937522 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1e005c39-604a-46d1-8011-ffe5805428ef tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:47.938414 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1e005c39-604a-46d1-8011-ffe5805428ef tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:47.952547 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1e005c39-604a-46d1-8011-ffe5805428ef tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:47.954128 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1e005c39-604a-46d1-8011-ffe5805428ef tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:47.955299 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1e005c39-604a-46d1-8011-ffe5805428ef tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:47.955991 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1e005c39-604a-46d1-8011-ffe5805428ef tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:48.048338 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1e005c39-604a-46d1-8011-ffe5805428ef tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:48.058161 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1e005c39-604a-46d1-8011-ffe5805428ef tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:48.060576 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1e005c39-604a-46d1-8011-ffe5805428ef tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:48.062147 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1e005c39-604a-46d1-8011-ffe5805428ef tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] 10.222.0.20 "GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2" status: 200 len: 1356 microversion: 2.57 time: 0.128538 Apr 16 21:26:48.072266 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2626/5090] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:47 2022] GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2 => generated 1356 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:26:48.094619 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c3dfd6c1-40be-49b9-9475-ea59ba8753db tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:48.095825 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c3dfd6c1-40be-49b9-9475-ea59ba8753db tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:48.103423 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3dfd6c1-40be-49b9-9475-ea59ba8753db tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:48.103891 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3dfd6c1-40be-49b9-9475-ea59ba8753db tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:48.104786 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3dfd6c1-40be-49b9-9475-ea59ba8753db tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:48.105304 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3dfd6c1-40be-49b9-9475-ea59ba8753db tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:48.143798 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c3dfd6c1-40be-49b9-9475-ea59ba8753db tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:26:48.488970 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a0899340-9e73-4411-bf88-8f96bddf3edd tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:48.512225 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a0899340-9e73-4411-bf88-8f96bddf3edd tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6" status: 200 len: 1367 microversion: 2.1 time: 0.855313 Apr 16 21:26:48.515465 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2465/5091] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:47 2022] GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6 => generated 1367 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:48.521594 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-f29aa070-8754-43e8-b80e-86d9993ae168 req-8c896cdd-23dc-45c1-86e6-d3f6a7a398ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6eb61102-0483-413f-88b9-7519c852b7f6", "tag": "bca26f6e-d4ea-42d6-97cb-5fabb9c3b713"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:26:48.531782 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-f29aa070-8754-43e8-b80e-86d9993ae168 req-8c896cdd-23dc-45c1-86e6-d3f6a7a398ef service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:48.532286 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-f29aa070-8754-43e8-b80e-86d9993ae168 req-8c896cdd-23dc-45c1-86e6-d3f6a7a398ef service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:48.546051 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-f29aa070-8754-43e8-b80e-86d9993ae168 req-8c896cdd-23dc-45c1-86e6-d3f6a7a398ef service nova] Creating event network-changed:bca26f6e-d4ea-42d6-97cb-5fabb9c3b713 for instance 6eb61102-0483-413f-88b9-7519c852b7f6 on nch2-master-1 Apr 16 21:26:48.552807 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-f29aa070-8754-43e8-b80e-86d9993ae168 req-8c896cdd-23dc-45c1-86e6-d3f6a7a398ef service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035648 Apr 16 21:26:48.558117 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2466/5092] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:26:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:26:48.561656 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-acf3e8f7-c44d-49d9-bb95-5820cfcb575d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:48.563076 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c3dfd6c1-40be-49b9-9475-ea59ba8753db tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2" status: 204 len: 0 microversion: 2.57 time: 0.472018 Apr 16 21:26:48.563607 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-acf3e8f7-c44d-49d9-bb95-5820cfcb575d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:48.567971 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2627/5093] 10.222.0.20 () {60 vars in 1279 bytes} [Sat Apr 16 21:26:48 2022] DELETE /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 16 21:26:48.572253 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-acf3e8f7-c44d-49d9-bb95-5820cfcb575d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:48.573020 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-acf3e8f7-c44d-49d9-bb95-5820cfcb575d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:48.574665 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-acf3e8f7-c44d-49d9-bb95-5820cfcb575d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:48.575351 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-acf3e8f7-c44d-49d9-bb95-5820cfcb575d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:48.590006 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-273ef7b0-93fc-4bd8-9b35-654c43cdc23f tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:48.591579 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-273ef7b0-93fc-4bd8-9b35-654c43cdc23f tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:48.606798 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-273ef7b0-93fc-4bd8-9b35-654c43cdc23f tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:48.608352 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-273ef7b0-93fc-4bd8-9b35-654c43cdc23f tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:48.609353 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-273ef7b0-93fc-4bd8-9b35-654c43cdc23f tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:48.609973 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-273ef7b0-93fc-4bd8-9b35-654c43cdc23f tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:48.748109 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-273ef7b0-93fc-4bd8-9b35-654c43cdc23f tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:48.758110 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-273ef7b0-93fc-4bd8-9b35-654c43cdc23f tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:48.759917 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-273ef7b0-93fc-4bd8-9b35-654c43cdc23f tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:48.761382 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-273ef7b0-93fc-4bd8-9b35-654c43cdc23f tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] 10.222.0.20 "GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2" status: 200 len: 1362 microversion: 2.57 time: 0.183924 Apr 16 21:26:48.762278 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2628/5094] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:48 2022] GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2 => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:26:48.805792 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e30205ff-2abe-473f-a287-c2294d38c16c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:48.806500 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e30205ff-2abe-473f-a287-c2294d38c16c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:48.812777 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e30205ff-2abe-473f-a287-c2294d38c16c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:48.813614 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e30205ff-2abe-473f-a287-c2294d38c16c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:48.814683 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e30205ff-2abe-473f-a287-c2294d38c16c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:48.831781 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e30205ff-2abe-473f-a287-c2294d38c16c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:49.014120 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-acf3e8f7-c44d-49d9-bb95-5820cfcb575d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:49.025149 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-acf3e8f7-c44d-49d9-bb95-5820cfcb575d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11" status: 200 len: 1314 microversion: 2.1 time: 0.469609 Apr 16 21:26:49.026257 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2467/5095] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:48 2022] GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11 => generated 1314 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:49.035422 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fa9dfb0b-a774-4bb5-ba5c-4fbffe479cf2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:49.035422 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-fa9dfb0b-a774-4bb5-ba5c-4fbffe479cf2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: fa0a30a4-6ada-4031-be8f-811c5b098de6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:49.044450 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fa9dfb0b-a774-4bb5-ba5c-4fbffe479cf2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:49.045034 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fa9dfb0b-a774-4bb5-ba5c-4fbffe479cf2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:49.045865 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fa9dfb0b-a774-4bb5-ba5c-4fbffe479cf2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:49.046502 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fa9dfb0b-a774-4bb5-ba5c-4fbffe479cf2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:49.087502 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e30205ff-2abe-473f-a287-c2294d38c16c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:49.096271 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e30205ff-2abe-473f-a287-c2294d38c16c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1501 microversion: 2.1 time: 0.294191 Apr 16 21:26:49.096972 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2629/5096] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:48 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1501 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:26:49.143451 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-fa9dfb0b-a774-4bb5-ba5c-4fbffe479cf2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:49.162430 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fa9dfb0b-a774-4bb5-ba5c-4fbffe479cf2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/fa0a30a4-6ada-4031-be8f-811c5b098de6" status: 200 len: 1279 microversion: 2.1 time: 0.134871 Apr 16 21:26:49.164268 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2468/5097] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:49 2022] GET /compute/v2.1/servers/fa0a30a4-6ada-4031-be8f-811c5b098de6 => generated 1279 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:49.405161 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-b6ade517-deea-4215-9b88-d472c3ee013f req-fdaf5964-dfc7-48b6-a05d-b4fbda00b906 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11", "tag": "4a2d54bf-9e95-4690-8351-2371d73d83d2"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:26:49.420285 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-b6ade517-deea-4215-9b88-d472c3ee013f req-fdaf5964-dfc7-48b6-a05d-b4fbda00b906 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:49.420738 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-b6ade517-deea-4215-9b88-d472c3ee013f req-fdaf5964-dfc7-48b6-a05d-b4fbda00b906 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:49.445211 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-b6ade517-deea-4215-9b88-d472c3ee013f req-fdaf5964-dfc7-48b6-a05d-b4fbda00b906 service nova] Creating event network-changed:4a2d54bf-9e95-4690-8351-2371d73d83d2 for instance ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11 on nch2-master-1 Apr 16 21:26:49.454967 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-b6ade517-deea-4215-9b88-d472c3ee013f req-fdaf5964-dfc7-48b6-a05d-b4fbda00b906 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053649 Apr 16 21:26:49.455915 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2630/5098] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:26:49.531325 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-271951a0-6aaf-48a0-9615-18eaab486908 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:49.532104 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-271951a0-6aaf-48a0-9615-18eaab486908 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 6eb61102-0483-413f-88b9-7519c852b7f6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:49.538644 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-271951a0-6aaf-48a0-9615-18eaab486908 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:49.542824 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-271951a0-6aaf-48a0-9615-18eaab486908 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:49.542824 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-271951a0-6aaf-48a0-9615-18eaab486908 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:49.542824 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-271951a0-6aaf-48a0-9615-18eaab486908 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:49.675843 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-271951a0-6aaf-48a0-9615-18eaab486908 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:49.684370 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-271951a0-6aaf-48a0-9615-18eaab486908 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6" status: 200 len: 1367 microversion: 2.1 time: 0.156939 Apr 16 21:26:49.693437 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2469/5099] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:49 2022] GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:49.789472 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b749c5c2-1f3d-4c6c-93c1-0e245be1ae89 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:49.790420 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b749c5c2-1f3d-4c6c-93c1-0e245be1ae89 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:49.813984 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b749c5c2-1f3d-4c6c-93c1-0e245be1ae89 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:49.814609 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b749c5c2-1f3d-4c6c-93c1-0e245be1ae89 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:49.819716 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b749c5c2-1f3d-4c6c-93c1-0e245be1ae89 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:49.819716 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b749c5c2-1f3d-4c6c-93c1-0e245be1ae89 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:49.902224 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b749c5c2-1f3d-4c6c-93c1-0e245be1ae89 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:49.907744 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b749c5c2-1f3d-4c6c-93c1-0e245be1ae89 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:49.909557 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b749c5c2-1f3d-4c6c-93c1-0e245be1ae89 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:49.910878 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b749c5c2-1f3d-4c6c-93c1-0e245be1ae89 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] 10.222.0.20 "GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2" status: 200 len: 1362 microversion: 2.57 time: 0.133525 Apr 16 21:26:49.911548 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2631/5100] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:49 2022] GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2 => generated 1362 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:26:50.042915 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f58f60eb-0beb-4ca0-90e6-594ec7747841 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:50.043573 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f58f60eb-0beb-4ca0-90e6-594ec7747841 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:50.049572 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f58f60eb-0beb-4ca0-90e6-594ec7747841 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:50.050037 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f58f60eb-0beb-4ca0-90e6-594ec7747841 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:50.050819 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f58f60eb-0beb-4ca0-90e6-594ec7747841 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:50.051267 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f58f60eb-0beb-4ca0-90e6-594ec7747841 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:50.114063 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-90b9470a-db5a-4c4a-b953-c8ef41f37dc4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:50.114980 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-90b9470a-db5a-4c4a-b953-c8ef41f37dc4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:50.127820 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-90b9470a-db5a-4c4a-b953-c8ef41f37dc4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:50.128615 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-90b9470a-db5a-4c4a-b953-c8ef41f37dc4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:50.130142 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-90b9470a-db5a-4c4a-b953-c8ef41f37dc4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:50.130434 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-90b9470a-db5a-4c4a-b953-c8ef41f37dc4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:50.300095 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-90b9470a-db5a-4c4a-b953-c8ef41f37dc4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:50.315978 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-90b9470a-db5a-4c4a-b953-c8ef41f37dc4 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1501 microversion: 2.1 time: 0.205710 Apr 16 21:26:50.317592 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2632/5101] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:50 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1501 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:26:50.322867 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cec8f202-92da-4ccf-801e-3fe8860abbe9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:50.330135 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cec8f202-92da-4ccf-801e-3fe8860abbe9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: fa0a30a4-6ada-4031-be8f-811c5b098de6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:50.330457 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f58f60eb-0beb-4ca0-90e6-594ec7747841 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:50.330611 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cec8f202-92da-4ccf-801e-3fe8860abbe9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:50.330611 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cec8f202-92da-4ccf-801e-3fe8860abbe9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:50.331163 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cec8f202-92da-4ccf-801e-3fe8860abbe9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:50.331611 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cec8f202-92da-4ccf-801e-3fe8860abbe9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:50.336192 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f58f60eb-0beb-4ca0-90e6-594ec7747841 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11" status: 200 len: 1314 microversion: 2.1 time: 0.297166 Apr 16 21:26:50.342673 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2470/5102] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:50 2022] GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11 => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:50.490534 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cec8f202-92da-4ccf-801e-3fe8860abbe9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:50.498172 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cec8f202-92da-4ccf-801e-3fe8860abbe9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/fa0a30a4-6ada-4031-be8f-811c5b098de6" status: 200 len: 1321 microversion: 2.1 time: 0.179798 Apr 16 21:26:50.498758 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2633/5103] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:50 2022] GET /compute/v2.1/servers/fa0a30a4-6ada-4031-be8f-811c5b098de6 => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:50.702996 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d0a68da2-eef8-4dca-977a-03315c38ab98 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:50.704306 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d0a68da2-eef8-4dca-977a-03315c38ab98 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 6eb61102-0483-413f-88b9-7519c852b7f6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:50.712699 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d0a68da2-eef8-4dca-977a-03315c38ab98 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:50.713466 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d0a68da2-eef8-4dca-977a-03315c38ab98 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:50.714478 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d0a68da2-eef8-4dca-977a-03315c38ab98 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:50.715043 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d0a68da2-eef8-4dca-977a-03315c38ab98 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:50.929891 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-16a26b48-f2dd-427c-8e0b-699263ec7901 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:50.931274 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-16a26b48-f2dd-427c-8e0b-699263ec7901 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:50.937582 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-16a26b48-f2dd-427c-8e0b-699263ec7901 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:50.938089 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-16a26b48-f2dd-427c-8e0b-699263ec7901 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:50.939344 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-16a26b48-f2dd-427c-8e0b-699263ec7901 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:50.940561 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-16a26b48-f2dd-427c-8e0b-699263ec7901 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:50.960341 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d0a68da2-eef8-4dca-977a-03315c38ab98 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:50.968742 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d0a68da2-eef8-4dca-977a-03315c38ab98 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6" status: 200 len: 1367 microversion: 2.1 time: 0.271039 Apr 16 21:26:50.969692 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2471/5104] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:50 2022] GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6 => generated 1367 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:51.011927 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-16a26b48-f2dd-427c-8e0b-699263ec7901 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:51.021356 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-16a26b48-f2dd-427c-8e0b-699263ec7901 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:51.023224 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-16a26b48-f2dd-427c-8e0b-699263ec7901 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:51.028289 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-16a26b48-f2dd-427c-8e0b-699263ec7901 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] 10.222.0.20 "GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2" status: 200 len: 1362 microversion: 2.57 time: 0.098793 Apr 16 21:26:51.028289 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2634/5105] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:50 2022] GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2 => generated 1362 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:26:51.339102 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2b2208f7-a35e-48d6-99b7-78639f9806fc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:51.339757 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2b2208f7-a35e-48d6-99b7-78639f9806fc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:51.347293 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2b2208f7-a35e-48d6-99b7-78639f9806fc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:51.347781 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2b2208f7-a35e-48d6-99b7-78639f9806fc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:51.348617 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2b2208f7-a35e-48d6-99b7-78639f9806fc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:51.349060 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2b2208f7-a35e-48d6-99b7-78639f9806fc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:51.355147 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2e0b974f-e199-4787-b8f7-0907d000ff0b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:51.355850 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2e0b974f-e199-4787-b8f7-0907d000ff0b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:51.365113 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2e0b974f-e199-4787-b8f7-0907d000ff0b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:51.366486 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2e0b974f-e199-4787-b8f7-0907d000ff0b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:51.370538 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2e0b974f-e199-4787-b8f7-0907d000ff0b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:51.370538 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2e0b974f-e199-4787-b8f7-0907d000ff0b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:51.559331 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2e0b974f-e199-4787-b8f7-0907d000ff0b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:51.567245 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2e0b974f-e199-4787-b8f7-0907d000ff0b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11" status: 200 len: 1314 microversion: 2.1 time: 0.216169 Apr 16 21:26:51.567836 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2635/5106] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:51 2022] GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:51.572670 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-be13e6fb-36f3-4d0b-ba9a-22e2c736472a req-0325c771-8263-4308-9ae7-4197aa9a426d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa0a30a4-6ada-4031-be8f-811c5b098de6", "tag": "53d5d264-62ff-47ee-8a34-f6400fde2daf"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:26:51.580986 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-be13e6fb-36f3-4d0b-ba9a-22e2c736472a req-0325c771-8263-4308-9ae7-4197aa9a426d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:51.581467 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-be13e6fb-36f3-4d0b-ba9a-22e2c736472a req-0325c771-8263-4308-9ae7-4197aa9a426d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:51.588920 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2b2208f7-a35e-48d6-99b7-78639f9806fc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:51.593999 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-be13e6fb-36f3-4d0b-ba9a-22e2c736472a req-0325c771-8263-4308-9ae7-4197aa9a426d service nova] Creating event network-changed:53d5d264-62ff-47ee-8a34-f6400fde2daf for instance fa0a30a4-6ada-4031-be8f-811c5b098de6 on nch1-master-1 Apr 16 21:26:51.601482 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2b2208f7-a35e-48d6-99b7-78639f9806fc tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.266191 Apr 16 21:26:51.602302 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2472/5107] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:51 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:51.607156 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-124b5a31-5eb6-416e-bf9d-5b8153ab645a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:51.607964 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-124b5a31-5eb6-416e-bf9d-5b8153ab645a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: fa0a30a4-6ada-4031-be8f-811c5b098de6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:51.609069 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-be13e6fb-36f3-4d0b-ba9a-22e2c736472a req-0325c771-8263-4308-9ae7-4197aa9a426d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033355 Apr 16 21:26:51.609767 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2636/5108] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:26:51.616610 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-124b5a31-5eb6-416e-bf9d-5b8153ab645a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:51.617163 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-124b5a31-5eb6-416e-bf9d-5b8153ab645a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:51.618344 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-124b5a31-5eb6-416e-bf9d-5b8153ab645a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:51.618801 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-124b5a31-5eb6-416e-bf9d-5b8153ab645a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:51.623286 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-550f4d28-fc82-476a-b86e-e44cd4be748e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:51.624108 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-550f4d28-fc82-476a-b86e-e44cd4be748e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:51.631844 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-550f4d28-fc82-476a-b86e-e44cd4be748e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:51.632737 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-550f4d28-fc82-476a-b86e-e44cd4be748e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:51.633790 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-550f4d28-fc82-476a-b86e-e44cd4be748e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:51.634342 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-550f4d28-fc82-476a-b86e-e44cd4be748e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:51.781208 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-550f4d28-fc82-476a-b86e-e44cd4be748e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:51.789917 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-550f4d28-fc82-476a-b86e-e44cd4be748e tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.172300 Apr 16 21:26:51.790582 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2637/5109] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:51 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:51.806526 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0135a757-5533-4932-86bb-7cebc7d5750b tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:26:51.807094 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0135a757-5533-4932-86bb-7cebc7d5750b tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: 127a22ee-2c0c-4f16-ae44-59cdf420aa29] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:51.812420 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-0135a757-5533-4932-86bb-7cebc7d5750b tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] HTTP exception thrown: Instance 127a22ee-2c0c-4f16-ae44-59cdf420aa29 could not be found. Apr 16 21:26:51.813014 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0135a757-5533-4932-86bb-7cebc7d5750b tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Returning 404 to user: Instance 127a22ee-2c0c-4f16-ae44-59cdf420aa29 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:26:51.813873 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0135a757-5533-4932-86bb-7cebc7d5750b tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "POST /compute/v2.1/servers/127a22ee-2c0c-4f16-ae44-59cdf420aa29/action" status: 404 len: 111 microversion: 2.1 time: 0.011365 Apr 16 21:26:51.814641 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2638/5110] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:26:51 2022] POST /compute/v2.1/servers/127a22ee-2c0c-4f16-ae44-59cdf420aa29/action => generated 111 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:26:51.829482 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-37e05441-ab8c-443d-aac5-ed3c10165dae tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:51.829482 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-37e05441-ab8c-443d-aac5-ed3c10165dae tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:51.829841 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-124b5a31-5eb6-416e-bf9d-5b8153ab645a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:51.835907 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-37e05441-ab8c-443d-aac5-ed3c10165dae tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:51.836397 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-37e05441-ab8c-443d-aac5-ed3c10165dae tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:51.837552 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-37e05441-ab8c-443d-aac5-ed3c10165dae tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:51.838179 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-37e05441-ab8c-443d-aac5-ed3c10165dae tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:51.838856 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-124b5a31-5eb6-416e-bf9d-5b8153ab645a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/fa0a30a4-6ada-4031-be8f-811c5b098de6" status: 200 len: 1321 microversion: 2.1 time: 0.235248 Apr 16 21:26:51.843178 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2473/5111] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:51 2022] GET /compute/v2.1/servers/fa0a30a4-6ada-4031-be8f-811c5b098de6 => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:51.969444 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-37e05441-ab8c-443d-aac5-ed3c10165dae tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:51.977633 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-37e05441-ab8c-443d-aac5-ed3c10165dae tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.154085 Apr 16 21:26:51.978208 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2639/5112] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:51 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:51.994908 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-dc565034-e5d7-4eed-913d-0a13055dca01 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:51.995803 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-dc565034-e5d7-4eed-913d-0a13055dca01 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 6eb61102-0483-413f-88b9-7519c852b7f6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:51.997618 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-84781cbd-a1e4-4432-92f3-69c2da8778b2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:51.998448 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-84781cbd-a1e4-4432-92f3-69c2da8778b2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:52.002100 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dc565034-e5d7-4eed-913d-0a13055dca01 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:52.002557 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dc565034-e5d7-4eed-913d-0a13055dca01 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:52.003515 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dc565034-e5d7-4eed-913d-0a13055dca01 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:52.004137 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dc565034-e5d7-4eed-913d-0a13055dca01 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:52.005090 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-84781cbd-a1e4-4432-92f3-69c2da8778b2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:52.005562 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-84781cbd-a1e4-4432-92f3-69c2da8778b2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:52.006348 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-84781cbd-a1e4-4432-92f3-69c2da8778b2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:52.006997 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-84781cbd-a1e4-4432-92f3-69c2da8778b2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:52.175461 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-dc565034-e5d7-4eed-913d-0a13055dca01 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:52.183635 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-dc565034-e5d7-4eed-913d-0a13055dca01 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6" status: 200 len: 1367 microversion: 2.1 time: 0.192674 Apr 16 21:26:52.193623 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2474/5113] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:51 2022] GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6 => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:52.198863 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-37c6f210-c747-45ff-81df-2fb9dbc44442 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:52.199832 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-37c6f210-c747-45ff-81df-2fb9dbc44442 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:52.206271 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-37c6f210-c747-45ff-81df-2fb9dbc44442 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:52.207077 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-37c6f210-c747-45ff-81df-2fb9dbc44442 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:52.207991 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-37c6f210-c747-45ff-81df-2fb9dbc44442 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:52.208704 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-37c6f210-c747-45ff-81df-2fb9dbc44442 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:52.216502 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-84781cbd-a1e4-4432-92f3-69c2da8778b2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:52.225624 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-84781cbd-a1e4-4432-92f3-69c2da8778b2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.231583 Apr 16 21:26:52.234449 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2640/5114] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:51 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:26:52.243977 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c6e8bcda-da2f-4ffc-928e-e2ac1773f61f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:26:52.244329 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c6e8bcda-da2f-4ffc-928e-e2ac1773f61f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:52.250965 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c6e8bcda-da2f-4ffc-928e-e2ac1773f61f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:52.251936 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c6e8bcda-da2f-4ffc-928e-e2ac1773f61f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:52.252316 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c6e8bcda-da2f-4ffc-928e-e2ac1773f61f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:52.252769 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c6e8bcda-da2f-4ffc-928e-e2ac1773f61f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:52.288216 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-c6e8bcda-da2f-4ffc-928e-e2ac1773f61f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] HTTP exception thrown: Cannot 'unpause' instance daf189e2-7cb4-4dab-94cf-ffdceb314df7 while it is in vm_state active Apr 16 21:26:52.288216 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c6e8bcda-da2f-4ffc-928e-e2ac1773f61f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Returning 409 to user: Cannot 'unpause' instance daf189e2-7cb4-4dab-94cf-ffdceb314df7 while it is in vm_state active {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:26:52.288216 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c6e8bcda-da2f-4ffc-928e-e2ac1773f61f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "POST /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7/action" status: 409 len: 145 microversion: 2.1 time: 0.043756 Apr 16 21:26:52.288216 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2641/5115] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:26:52 2022] POST /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7/action => generated 145 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Apr 16 21:26:52.293411 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-644c5239-d9ed-4c8b-81ca-b05505ff2234 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:52.294187 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-644c5239-d9ed-4c8b-81ca-b05505ff2234 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:52.300151 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-37c6f210-c747-45ff-81df-2fb9dbc44442 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:52.302274 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-644c5239-d9ed-4c8b-81ca-b05505ff2234 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:52.302773 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-644c5239-d9ed-4c8b-81ca-b05505ff2234 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:52.303630 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-644c5239-d9ed-4c8b-81ca-b05505ff2234 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:52.304141 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-644c5239-d9ed-4c8b-81ca-b05505ff2234 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:52.308479 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-37c6f210-c747-45ff-81df-2fb9dbc44442 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:52.323043 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-37c6f210-c747-45ff-81df-2fb9dbc44442 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8cd0508c29074deb8e68789231ac5da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b868d01dc64436a62165eaba1c8da0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:52.323043 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-37c6f210-c747-45ff-81df-2fb9dbc44442 tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] 10.222.0.20 "GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2" status: 200 len: 1362 microversion: 2.57 time: 0.116460 Apr 16 21:26:52.323043 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2475/5116] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:52 2022] GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2 => generated 1362 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:26:52.556472 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-644c5239-d9ed-4c8b-81ca-b05505ff2234 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:52.563887 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-644c5239-d9ed-4c8b-81ca-b05505ff2234 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.274555 Apr 16 21:26:52.564494 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2642/5117] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:52 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:26:52.582258 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8db9d79d-50c8-4953-a2e9-c865cac2bebd tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:52.582954 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8db9d79d-50c8-4953-a2e9-c865cac2bebd tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:52.584616 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c7ee3694-9bfe-494f-bad1-7ac526d5bfa8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:52.586006 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c7ee3694-9bfe-494f-bad1-7ac526d5bfa8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:52.590617 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8db9d79d-50c8-4953-a2e9-c865cac2bebd tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:52.591082 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8db9d79d-50c8-4953-a2e9-c865cac2bebd tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:52.591870 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8db9d79d-50c8-4953-a2e9-c865cac2bebd tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:52.592381 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8db9d79d-50c8-4953-a2e9-c865cac2bebd tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:52.592519 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c7ee3694-9bfe-494f-bad1-7ac526d5bfa8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:52.592958 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c7ee3694-9bfe-494f-bad1-7ac526d5bfa8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:52.594050 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c7ee3694-9bfe-494f-bad1-7ac526d5bfa8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:52.594698 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c7ee3694-9bfe-494f-bad1-7ac526d5bfa8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:52.765004 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8db9d79d-50c8-4953-a2e9-c865cac2bebd tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:52.774021 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8db9d79d-50c8-4953-a2e9-c865cac2bebd tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.195848 Apr 16 21:26:52.774835 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2476/5118] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:52 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:52.792109 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e0a19617-b3a5-4478-a0ff-4241934a9c1f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:26:52.792791 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e0a19617-b3a5-4478-a0ff-4241934a9c1f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: 03139cc5-8064-4312-a34a-ebabb1cfea7e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:52.798675 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-e0a19617-b3a5-4478-a0ff-4241934a9c1f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] HTTP exception thrown: Instance 03139cc5-8064-4312-a34a-ebabb1cfea7e could not be found. Apr 16 21:26:52.799589 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e0a19617-b3a5-4478-a0ff-4241934a9c1f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Returning 404 to user: Instance 03139cc5-8064-4312-a34a-ebabb1cfea7e could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:26:52.800675 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e0a19617-b3a5-4478-a0ff-4241934a9c1f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "POST /compute/v2.1/servers/03139cc5-8064-4312-a34a-ebabb1cfea7e/action" status: 404 len: 111 microversion: 2.1 time: 0.012700 Apr 16 21:26:52.801459 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2477/5119] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:26:52 2022] POST /compute/v2.1/servers/03139cc5-8064-4312-a34a-ebabb1cfea7e/action => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:26:52.809359 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d2527712-b9ad-476f-906b-ecf5b2f3782b tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:52.809966 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d2527712-b9ad-476f-906b-ecf5b2f3782b tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:52.816519 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d2527712-b9ad-476f-906b-ecf5b2f3782b tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:52.816984 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d2527712-b9ad-476f-906b-ecf5b2f3782b tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:52.817762 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d2527712-b9ad-476f-906b-ecf5b2f3782b tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:52.818455 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d2527712-b9ad-476f-906b-ecf5b2f3782b tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:52.890212 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c7ee3694-9bfe-494f-bad1-7ac526d5bfa8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:52.899526 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c7ee3694-9bfe-494f-bad1-7ac526d5bfa8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11" status: 200 len: 1314 microversion: 2.1 time: 0.318715 Apr 16 21:26:52.900664 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2643/5120] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:52 2022] GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11 => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:26:52.910043 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-45b7ccdf-e911-429c-a2b2-3bee96d7f8e8 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:52.910043 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-45b7ccdf-e911-429c-a2b2-3bee96d7f8e8 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: fa0a30a4-6ada-4031-be8f-811c5b098de6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:52.917066 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-45b7ccdf-e911-429c-a2b2-3bee96d7f8e8 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:52.917849 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-45b7ccdf-e911-429c-a2b2-3bee96d7f8e8 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:52.918852 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-45b7ccdf-e911-429c-a2b2-3bee96d7f8e8 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:52.919812 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-45b7ccdf-e911-429c-a2b2-3bee96d7f8e8 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:53.088766 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d2527712-b9ad-476f-906b-ecf5b2f3782b tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:53.099886 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d2527712-b9ad-476f-906b-ecf5b2f3782b tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.293960 Apr 16 21:26:53.101857 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2478/5121] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:52 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:26:53.124701 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-93562874-49ae-4f2d-a628-e6d281ac54ae tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:53.125484 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-93562874-49ae-4f2d-a628-e6d281ac54ae tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:53.134079 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-93562874-49ae-4f2d-a628-e6d281ac54ae tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:53.134932 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-93562874-49ae-4f2d-a628-e6d281ac54ae tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:53.135908 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-93562874-49ae-4f2d-a628-e6d281ac54ae tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:53.136553 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-93562874-49ae-4f2d-a628-e6d281ac54ae tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:53.250731 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-45b7ccdf-e911-429c-a2b2-3bee96d7f8e8 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:53.258863 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-45b7ccdf-e911-429c-a2b2-3bee96d7f8e8 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/fa0a30a4-6ada-4031-be8f-811c5b098de6" status: 200 len: 1321 microversion: 2.1 time: 0.356505 Apr 16 21:26:53.259483 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2644/5122] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:52 2022] GET /compute/v2.1/servers/fa0a30a4-6ada-4031-be8f-811c5b098de6 => generated 1321 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:53.259483 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6151d5a8-48d5-4905-930e-a8de96c38411 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:53.259483 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6151d5a8-48d5-4905-930e-a8de96c38411 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 6eb61102-0483-413f-88b9-7519c852b7f6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:53.271428 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6151d5a8-48d5-4905-930e-a8de96c38411 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:53.271882 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6151d5a8-48d5-4905-930e-a8de96c38411 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:53.272700 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6151d5a8-48d5-4905-930e-a8de96c38411 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:53.273147 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6151d5a8-48d5-4905-930e-a8de96c38411 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:53.438023 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-93562874-49ae-4f2d-a628-e6d281ac54ae tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:53.445998 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-93562874-49ae-4f2d-a628-e6d281ac54ae tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.331237 Apr 16 21:26:53.446589 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2479/5123] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:53 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:53.451527 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9f7a491e-76bd-4c57-b564-2b262a07c18d tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:53.452276 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9f7a491e-76bd-4c57-b564-2b262a07c18d tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] [instance: 4d7b59f5-8287-429b-9551-d5f21b96e0d2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:53.459957 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9f7a491e-76bd-4c57-b564-2b262a07c18d tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:53.460720 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9f7a491e-76bd-4c57-b564-2b262a07c18d tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:53.461691 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9f7a491e-76bd-4c57-b564-2b262a07c18d tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:53.462303 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9f7a491e-76bd-4c57-b564-2b262a07c18d tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:53.477620 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-9f7a491e-76bd-4c57-b564-2b262a07c18d tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] HTTP exception thrown: Instance 4d7b59f5-8287-429b-9551-d5f21b96e0d2 could not be found. Apr 16 21:26:53.482637 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9f7a491e-76bd-4c57-b564-2b262a07c18d tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] Returning 404 to user: Instance 4d7b59f5-8287-429b-9551-d5f21b96e0d2 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:26:53.482637 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9f7a491e-76bd-4c57-b564-2b262a07c18d tempest-ServerShowV257Test-327277580 tempest-ServerShowV257Test-327277580-project] 10.222.0.20 "GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2" status: 404 len: 111 microversion: 2.57 time: 0.031320 Apr 16 21:26:53.482637 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2480/5124] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:26:53 2022] GET /compute/v2.1/servers/4d7b59f5-8287-429b-9551-d5f21b96e0d2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:26:53.492329 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fb18ccd0-f482-4c92-af2a-7ea4e219f23c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:26:53.493387 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-fb18ccd0-f482-4c92-af2a-7ea4e219f23c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:53.510748 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fb18ccd0-f482-4c92-af2a-7ea4e219f23c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:53.510748 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fb18ccd0-f482-4c92-af2a-7ea4e219f23c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:53.510748 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fb18ccd0-f482-4c92-af2a-7ea4e219f23c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:53.510748 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fb18ccd0-f482-4c92-af2a-7ea4e219f23c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:53.521291 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6151d5a8-48d5-4905-930e-a8de96c38411 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:53.531156 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6151d5a8-48d5-4905-930e-a8de96c38411 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6" status: 200 len: 1367 microversion: 2.1 time: 0.270545 Apr 16 21:26:53.531750 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2645/5125] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:53 2022] GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6 => generated 1367 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:53.560854 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-fb18ccd0-f482-4c92-af2a-7ea4e219f23c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] HTTP exception thrown: Cannot 'unshelve' instance daf189e2-7cb4-4dab-94cf-ffdceb314df7 while it is in vm_state active Apr 16 21:26:53.562377 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fb18ccd0-f482-4c92-af2a-7ea4e219f23c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Returning 409 to user: Cannot 'unshelve' instance daf189e2-7cb4-4dab-94cf-ffdceb314df7 while it is in vm_state active {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:26:53.563361 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fb18ccd0-f482-4c92-af2a-7ea4e219f23c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "POST /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7/action" status: 409 len: 146 microversion: 2.1 time: 0.082772 Apr 16 21:26:53.572150 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2481/5126] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:26:53 2022] POST /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7/action => generated 146 bytes in 92 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:26:53.575622 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bff78cdd-f875-4027-88d8-430955fd7cb6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:53.576371 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-bff78cdd-f875-4027-88d8-430955fd7cb6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:53.588127 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bff78cdd-f875-4027-88d8-430955fd7cb6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:53.588913 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bff78cdd-f875-4027-88d8-430955fd7cb6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:53.589721 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bff78cdd-f875-4027-88d8-430955fd7cb6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:53.590202 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bff78cdd-f875-4027-88d8-430955fd7cb6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:53.725419 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-bff78cdd-f875-4027-88d8-430955fd7cb6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:53.732844 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-bff78cdd-f875-4027-88d8-430955fd7cb6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.163866 Apr 16 21:26:53.733411 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2646/5127] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:53 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:53.750160 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-292d10a2-6d5c-488d-8695-0e604ea75be1 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:53.751878 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-292d10a2-6d5c-488d-8695-0e604ea75be1 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:53.757732 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-292d10a2-6d5c-488d-8695-0e604ea75be1 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:53.758187 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-292d10a2-6d5c-488d-8695-0e604ea75be1 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:53.759009 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-292d10a2-6d5c-488d-8695-0e604ea75be1 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:53.759453 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-292d10a2-6d5c-488d-8695-0e604ea75be1 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:53.899192 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-292d10a2-6d5c-488d-8695-0e604ea75be1 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:53.907529 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-292d10a2-6d5c-488d-8695-0e604ea75be1 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.161097 Apr 16 21:26:53.908069 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2482/5128] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:53 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:53.918909 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fbf7fd41-146a-4ac3-a7c0-73af985b6992 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:53.919528 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fbf7fd41-146a-4ac3-a7c0-73af985b6992 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:53.924544 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1fd08fee-a8ef-4437-bf9a-d1b382c718bb tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1233529285_updated"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:26:53.926094 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1fd08fee-a8ef-4437-bf9a-d1b382c718bb tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: d2fb6b7d-8689-48b4-b73d-1779db565202] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:53.926462 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fbf7fd41-146a-4ac3-a7c0-73af985b6992 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:53.926969 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fbf7fd41-146a-4ac3-a7c0-73af985b6992 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:53.927964 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fbf7fd41-146a-4ac3-a7c0-73af985b6992 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:53.928435 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fbf7fd41-146a-4ac3-a7c0-73af985b6992 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:53.932458 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-1fd08fee-a8ef-4437-bf9a-d1b382c718bb tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] HTTP exception thrown: Instance d2fb6b7d-8689-48b4-b73d-1779db565202 could not be found. Apr 16 21:26:53.933117 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1fd08fee-a8ef-4437-bf9a-d1b382c718bb tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Returning 404 to user: Instance d2fb6b7d-8689-48b4-b73d-1779db565202 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:26:53.934138 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1fd08fee-a8ef-4437-bf9a-d1b382c718bb tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "PUT /compute/v2.1/servers/d2fb6b7d-8689-48b4-b73d-1779db565202" status: 404 len: 111 microversion: 2.1 time: 0.014169 Apr 16 21:26:53.934869 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2483/5129] 10.222.0.20 () {60 vars in 1255 bytes} [Sat Apr 16 21:26:53 2022] PUT /compute/v2.1/servers/d2fb6b7d-8689-48b4-b73d-1779db565202 => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:26:53.943252 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6dea7856-8466-4705-ad62-146c9b8e6b7f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:53.944404 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6dea7856-8466-4705-ad62-146c9b8e6b7f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:53.951618 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6dea7856-8466-4705-ad62-146c9b8e6b7f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:53.952391 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6dea7856-8466-4705-ad62-146c9b8e6b7f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:53.953327 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6dea7856-8466-4705-ad62-146c9b8e6b7f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:53.953882 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6dea7856-8466-4705-ad62-146c9b8e6b7f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:54.100802 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fbf7fd41-146a-4ac3-a7c0-73af985b6992 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:54.113438 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fbf7fd41-146a-4ac3-a7c0-73af985b6992 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11" status: 200 len: 1314 microversion: 2.1 time: 0.198478 Apr 16 21:26:54.114031 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2647/5130] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:53 2022] GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:54.192553 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6dea7856-8466-4705-ad62-146c9b8e6b7f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:54.201176 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6dea7856-8466-4705-ad62-146c9b8e6b7f tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.261878 Apr 16 21:26:54.201821 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2484/5131] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:53 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:26:54.218888 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-00e11a09-3f7a-469d-902e-18b4a1e787c5 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:54.219532 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-00e11a09-3f7a-469d-902e-18b4a1e787c5 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:54.227694 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-00e11a09-3f7a-469d-902e-18b4a1e787c5 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:54.228165 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-00e11a09-3f7a-469d-902e-18b4a1e787c5 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:54.229137 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-00e11a09-3f7a-469d-902e-18b4a1e787c5 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:54.229589 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-00e11a09-3f7a-469d-902e-18b4a1e787c5 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:54.276872 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-50853f2a-cc51-4460-b33c-357bc331e45c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:54.277557 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-50853f2a-cc51-4460-b33c-357bc331e45c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: fa0a30a4-6ada-4031-be8f-811c5b098de6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:54.285988 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-50853f2a-cc51-4460-b33c-357bc331e45c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:54.286483 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-50853f2a-cc51-4460-b33c-357bc331e45c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:54.287279 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-50853f2a-cc51-4460-b33c-357bc331e45c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:54.287731 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-50853f2a-cc51-4460-b33c-357bc331e45c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:54.425286 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-00e11a09-3f7a-469d-902e-18b4a1e787c5 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:54.433854 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-00e11a09-3f7a-469d-902e-18b4a1e787c5 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.218922 Apr 16 21:26:54.434902 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2648/5132] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:54 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:54.436685 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-50853f2a-cc51-4460-b33c-357bc331e45c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:54.445228 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-50853f2a-cc51-4460-b33c-357bc331e45c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/fa0a30a4-6ada-4031-be8f-811c5b098de6" status: 200 len: 1321 microversion: 2.1 time: 0.173228 Apr 16 21:26:54.452595 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2485/5133] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:54 2022] GET /compute/v2.1/servers/fa0a30a4-6ada-4031-be8f-811c5b098de6 => generated 1321 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:26:54.454510 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-506e8431-33f6-4461-a904-1a0bcfb6ecc2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:26:54.455918 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-506e8431-33f6-4461-a904-1a0bcfb6ecc2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:26:54.456911 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-506e8431-33f6-4461-a904-1a0bcfb6ecc2 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "PUT /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 400 len: 619 microversion: 2.1 time: 0.010386 Apr 16 21:26:54.460526 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2649/5134] 10.222.0.20 () {60 vars in 1256 bytes} [Sat Apr 16 21:26:54 2022] PUT /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 619 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:26:54.465740 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-61446db1-92b2-4a40-992d-622ee1e220e5 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:54.466496 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-61446db1-92b2-4a40-992d-622ee1e220e5 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:54.473202 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-61446db1-92b2-4a40-992d-622ee1e220e5 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:54.481292 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-61446db1-92b2-4a40-992d-622ee1e220e5 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:54.481292 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-61446db1-92b2-4a40-992d-622ee1e220e5 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:54.481292 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-61446db1-92b2-4a40-992d-622ee1e220e5 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:54.547929 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-40a2035a-3396-44ea-a674-c6c077dbb438 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:54.549528 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-40a2035a-3396-44ea-a674-c6c077dbb438 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 6eb61102-0483-413f-88b9-7519c852b7f6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:54.562468 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40a2035a-3396-44ea-a674-c6c077dbb438 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:54.564992 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40a2035a-3396-44ea-a674-c6c077dbb438 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:54.565915 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40a2035a-3396-44ea-a674-c6c077dbb438 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:54.566490 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40a2035a-3396-44ea-a674-c6c077dbb438 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:54.659250 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-61446db1-92b2-4a40-992d-622ee1e220e5 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:54.668489 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-61446db1-92b2-4a40-992d-622ee1e220e5 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.206631 Apr 16 21:26:54.669357 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2486/5135] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:54 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:26:54.687908 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-30aaec4d-40e2-44d9-9bef-bcd58a828f3a tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:54.691934 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-30aaec4d-40e2-44d9-9bef-bcd58a828f3a tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:54.698903 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-30aaec4d-40e2-44d9-9bef-bcd58a828f3a tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:54.705365 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-30aaec4d-40e2-44d9-9bef-bcd58a828f3a tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:54.705365 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-30aaec4d-40e2-44d9-9bef-bcd58a828f3a tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:54.705365 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-30aaec4d-40e2-44d9-9bef-bcd58a828f3a tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:54.790007 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-40a2035a-3396-44ea-a674-c6c077dbb438 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:54.798655 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-40a2035a-3396-44ea-a674-c6c077dbb438 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6" status: 200 len: 1367 microversion: 2.1 time: 0.254470 Apr 16 21:26:54.799992 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2650/5136] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:54 2022] GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6 => generated 1367 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:54.842660 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-30aaec4d-40e2-44d9-9bef-bcd58a828f3a tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:54.850926 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-30aaec4d-40e2-44d9-9bef-bcd58a828f3a tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.168111 Apr 16 21:26:54.851496 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2487/5137] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:54 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:54.867555 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-faf4d684-a908-433f-bd30-4fe0b9e74303 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:26:54.868849 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-faf4d684-a908-433f-bd30-4fe0b9e74303 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:26:54.869655 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-faf4d684-a908-433f-bd30-4fe0b9e74303 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "PUT /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 400 len: 108 microversion: 2.1 time: 0.006490 Apr 16 21:26:54.870187 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2651/5138] 10.222.0.20 () {60 vars in 1255 bytes} [Sat Apr 16 21:26:54 2022] PUT /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 108 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:26:54.878487 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8f04be42-5c54-441e-a247-8865d391aaf6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:54.879164 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8f04be42-5c54-441e-a247-8865d391aaf6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:54.885098 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8f04be42-5c54-441e-a247-8865d391aaf6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:54.885555 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8f04be42-5c54-441e-a247-8865d391aaf6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:54.886320 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8f04be42-5c54-441e-a247-8865d391aaf6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:54.886767 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8f04be42-5c54-441e-a247-8865d391aaf6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:55.023835 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8f04be42-5c54-441e-a247-8865d391aaf6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:55.031652 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8f04be42-5c54-441e-a247-8865d391aaf6 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1504 microversion: 2.1 time: 0.157093 Apr 16 21:26:55.032233 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2488/5139] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:54 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:55.136727 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e65e0c80-2870-4687-9e5c-04097f8b6be8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:55.137340 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e65e0c80-2870-4687-9e5c-04097f8b6be8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:55.144454 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e65e0c80-2870-4687-9e5c-04097f8b6be8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:55.145026 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e65e0c80-2870-4687-9e5c-04097f8b6be8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:55.145851 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e65e0c80-2870-4687-9e5c-04097f8b6be8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:55.146330 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e65e0c80-2870-4687-9e5c-04097f8b6be8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:55.311048 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e65e0c80-2870-4687-9e5c-04097f8b6be8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:55.328249 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e65e0c80-2870-4687-9e5c-04097f8b6be8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11" status: 200 len: 1314 microversion: 2.1 time: 0.195160 Apr 16 21:26:55.329018 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2652/5140] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:55 2022] GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:55.466857 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c974d4fc-980a-426b-a45b-e21fdba4c911 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:55.467467 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c974d4fc-980a-426b-a45b-e21fdba4c911 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: fa0a30a4-6ada-4031-be8f-811c5b098de6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:55.474035 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c974d4fc-980a-426b-a45b-e21fdba4c911 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:55.474492 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c974d4fc-980a-426b-a45b-e21fdba4c911 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:55.475261 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c974d4fc-980a-426b-a45b-e21fdba4c911 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:55.475706 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c974d4fc-980a-426b-a45b-e21fdba4c911 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:55.606435 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c974d4fc-980a-426b-a45b-e21fdba4c911 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:55.613683 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c974d4fc-980a-426b-a45b-e21fdba4c911 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/fa0a30a4-6ada-4031-be8f-811c5b098de6" status: 200 len: 1321 microversion: 2.1 time: 0.150776 Apr 16 21:26:55.614270 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2489/5141] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:55 2022] GET /compute/v2.1/servers/fa0a30a4-6ada-4031-be8f-811c5b098de6 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:55.817409 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-02f187cf-1b10-44b4-8ad4-123f3914c07d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:55.818086 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-02f187cf-1b10-44b4-8ad4-123f3914c07d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 6eb61102-0483-413f-88b9-7519c852b7f6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:55.825178 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-02f187cf-1b10-44b4-8ad4-123f3914c07d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:55.825926 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-02f187cf-1b10-44b4-8ad4-123f3914c07d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:55.826719 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-02f187cf-1b10-44b4-8ad4-123f3914c07d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:55.827163 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-02f187cf-1b10-44b4-8ad4-123f3914c07d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:55.961272 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-02f187cf-1b10-44b4-8ad4-123f3914c07d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:55.968771 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-02f187cf-1b10-44b4-8ad4-123f3914c07d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6" status: 200 len: 1367 microversion: 2.1 time: 0.156554 Apr 16 21:26:55.969345 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2653/5142] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:55 2022] GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:56.188166 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-58b18981-c5c6-4ba0-a1b4-d7a8012b8881 req-bb1879e6-0140-41b2-adf7-676be533f311 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6eb61102-0483-413f-88b9-7519c852b7f6", "name": "network-vif-plugged", "status": "completed", "tag": "bca26f6e-d4ea-42d6-97cb-5fabb9c3b713"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:26:56.197592 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-58b18981-c5c6-4ba0-a1b4-d7a8012b8881 req-bb1879e6-0140-41b2-adf7-676be533f311 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:56.198049 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-58b18981-c5c6-4ba0-a1b4-d7a8012b8881 req-bb1879e6-0140-41b2-adf7-676be533f311 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:56.215221 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-58b18981-c5c6-4ba0-a1b4-d7a8012b8881 req-bb1879e6-0140-41b2-adf7-676be533f311 service nova] Creating event network-vif-plugged:bca26f6e-d4ea-42d6-97cb-5fabb9c3b713 for instance 6eb61102-0483-413f-88b9-7519c852b7f6 on nch2-master-1 Apr 16 21:26:56.218400 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-58b18981-c5c6-4ba0-a1b4-d7a8012b8881 req-bb1879e6-0140-41b2-adf7-676be533f311 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034302 Apr 16 21:26:56.218990 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2490/5143] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:26:56.347717 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0ddc87a0-cb52-45af-a0c9-904c5bcb1ab2 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:56.348463 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0ddc87a0-cb52-45af-a0c9-904c5bcb1ab2 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:56.356327 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0ddc87a0-cb52-45af-a0c9-904c5bcb1ab2 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:56.357350 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0ddc87a0-cb52-45af-a0c9-904c5bcb1ab2 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:56.358481 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0ddc87a0-cb52-45af-a0c9-904c5bcb1ab2 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:56.359745 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0ddc87a0-cb52-45af-a0c9-904c5bcb1ab2 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:56.522066 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0ddc87a0-cb52-45af-a0c9-904c5bcb1ab2 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:56.530025 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0ddc87a0-cb52-45af-a0c9-904c5bcb1ab2 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11" status: 200 len: 1314 microversion: 2.1 time: 0.186700 Apr 16 21:26:56.530720 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2654/5144] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:56 2022] GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:56.631573 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a46296a1-181b-4631-a20d-3dd383a3fd41 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:56.632398 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a46296a1-181b-4631-a20d-3dd383a3fd41 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: fa0a30a4-6ada-4031-be8f-811c5b098de6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:56.640194 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a46296a1-181b-4631-a20d-3dd383a3fd41 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:56.640767 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a46296a1-181b-4631-a20d-3dd383a3fd41 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:56.641773 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a46296a1-181b-4631-a20d-3dd383a3fd41 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:56.642957 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a46296a1-181b-4631-a20d-3dd383a3fd41 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:56.860641 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a46296a1-181b-4631-a20d-3dd383a3fd41 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:56.870594 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a46296a1-181b-4631-a20d-3dd383a3fd41 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/fa0a30a4-6ada-4031-be8f-811c5b098de6" status: 200 len: 1321 microversion: 2.1 time: 0.243717 Apr 16 21:26:56.875261 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2491/5145] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:56 2022] GET /compute/v2.1/servers/fa0a30a4-6ada-4031-be8f-811c5b098de6 => generated 1321 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:56.989633 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-eb01b2f0-7df2-481b-a20c-7aa3fb64ecdc tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:56.991389 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-eb01b2f0-7df2-481b-a20c-7aa3fb64ecdc tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 6eb61102-0483-413f-88b9-7519c852b7f6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:57.003106 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eb01b2f0-7df2-481b-a20c-7aa3fb64ecdc tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:57.003686 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eb01b2f0-7df2-481b-a20c-7aa3fb64ecdc tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:57.004982 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eb01b2f0-7df2-481b-a20c-7aa3fb64ecdc tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:57.005797 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eb01b2f0-7df2-481b-a20c-7aa3fb64ecdc tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:57.225462 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-eb01b2f0-7df2-481b-a20c-7aa3fb64ecdc tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:57.233423 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-eb01b2f0-7df2-481b-a20c-7aa3fb64ecdc tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6" status: 200 len: 1367 microversion: 2.1 time: 0.250720 Apr 16 21:26:57.234308 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2655/5146] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:56 2022] GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6 => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:57.553297 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3217b093-88bb-417e-b35c-20e8115f0d82 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:57.553934 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3217b093-88bb-417e-b35c-20e8115f0d82 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:57.563088 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3217b093-88bb-417e-b35c-20e8115f0d82 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:57.563555 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3217b093-88bb-417e-b35c-20e8115f0d82 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:57.564967 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3217b093-88bb-417e-b35c-20e8115f0d82 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:57.565446 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3217b093-88bb-417e-b35c-20e8115f0d82 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:57.811630 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3217b093-88bb-417e-b35c-20e8115f0d82 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:57.825970 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3217b093-88bb-417e-b35c-20e8115f0d82 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11" status: 200 len: 1314 microversion: 2.1 time: 0.282557 Apr 16 21:26:57.828437 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2492/5147] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:57 2022] GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11 => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:26:57.888604 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1f06b217-5625-46a5-be3f-bdba93023ff6 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:57.889700 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1f06b217-5625-46a5-be3f-bdba93023ff6 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: fa0a30a4-6ada-4031-be8f-811c5b098de6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:57.897014 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1f06b217-5625-46a5-be3f-bdba93023ff6 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:57.897552 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1f06b217-5625-46a5-be3f-bdba93023ff6 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:57.898620 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1f06b217-5625-46a5-be3f-bdba93023ff6 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:57.899343 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1f06b217-5625-46a5-be3f-bdba93023ff6 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:58.059903 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1f06b217-5625-46a5-be3f-bdba93023ff6 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:58.069254 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1f06b217-5625-46a5-be3f-bdba93023ff6 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/fa0a30a4-6ada-4031-be8f-811c5b098de6" status: 200 len: 1321 microversion: 2.1 time: 0.184708 Apr 16 21:26:58.069837 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2656/5148] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:57 2022] GET /compute/v2.1/servers/fa0a30a4-6ada-4031-be8f-811c5b098de6 => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:26:58.236412 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-1f1d9396-5208-4445-a1c0-ba0baf2f57b7 req-a8777885-8644-44bc-8252-13533b2464f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa0a30a4-6ada-4031-be8f-811c5b098de6", "name": "network-vif-plugged", "status": "completed", "tag": "53d5d264-62ff-47ee-8a34-f6400fde2daf"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:26:58.252193 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-89658a30-70be-470a-a94f-ba0866b8c692 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:58.252193 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-89658a30-70be-470a-a94f-ba0866b8c692 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 6eb61102-0483-413f-88b9-7519c852b7f6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:58.261886 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-1f1d9396-5208-4445-a1c0-ba0baf2f57b7 req-a8777885-8644-44bc-8252-13533b2464f0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:58.266121 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-89658a30-70be-470a-a94f-ba0866b8c692 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:58.268493 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-89658a30-70be-470a-a94f-ba0866b8c692 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:58.271273 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-89658a30-70be-470a-a94f-ba0866b8c692 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:58.274144 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-1f1d9396-5208-4445-a1c0-ba0baf2f57b7 req-a8777885-8644-44bc-8252-13533b2464f0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:58.274478 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-89658a30-70be-470a-a94f-ba0866b8c692 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:58.309470 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-1f1d9396-5208-4445-a1c0-ba0baf2f57b7 req-a8777885-8644-44bc-8252-13533b2464f0 service nova] Creating event network-vif-plugged:53d5d264-62ff-47ee-8a34-f6400fde2daf for instance fa0a30a4-6ada-4031-be8f-811c5b098de6 on nch1-master-1 Apr 16 21:26:58.323213 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-1f1d9396-5208-4445-a1c0-ba0baf2f57b7 req-a8777885-8644-44bc-8252-13533b2464f0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084869 Apr 16 21:26:58.323213 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2493/5149] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:26:58.468420 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-89658a30-70be-470a-a94f-ba0866b8c692 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:58.480642 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-89658a30-70be-470a-a94f-ba0866b8c692 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6" status: 200 len: 1367 microversion: 2.1 time: 0.233565 Apr 16 21:26:58.481371 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2657/5150] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:58 2022] GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6 => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:26:58.846928 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bd36edc3-313e-42f3-b9a3-92c53ed1b89f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:58.847704 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bd36edc3-313e-42f3-b9a3-92c53ed1b89f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:58.854881 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bd36edc3-313e-42f3-b9a3-92c53ed1b89f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:58.855345 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bd36edc3-313e-42f3-b9a3-92c53ed1b89f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:58.856123 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bd36edc3-313e-42f3-b9a3-92c53ed1b89f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:58.856658 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bd36edc3-313e-42f3-b9a3-92c53ed1b89f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:59.054414 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-bd36edc3-313e-42f3-b9a3-92c53ed1b89f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:59.065381 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bd36edc3-313e-42f3-b9a3-92c53ed1b89f tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11" status: 200 len: 1314 microversion: 2.1 time: 0.221394 Apr 16 21:26:59.065381 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2494/5151] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:58 2022] GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:26:59.085981 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-496974c7-29ae-4ae1-a6c1-5515c22c09f6 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:59.086636 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-496974c7-29ae-4ae1-a6c1-5515c22c09f6 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: fa0a30a4-6ada-4031-be8f-811c5b098de6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:59.099982 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-496974c7-29ae-4ae1-a6c1-5515c22c09f6 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:59.099982 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-496974c7-29ae-4ae1-a6c1-5515c22c09f6 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:59.099982 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-496974c7-29ae-4ae1-a6c1-5515c22c09f6 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:59.099982 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-496974c7-29ae-4ae1-a6c1-5515c22c09f6 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:59.224513 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-496974c7-29ae-4ae1-a6c1-5515c22c09f6 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:26:59.232215 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-496974c7-29ae-4ae1-a6c1-5515c22c09f6 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/fa0a30a4-6ada-4031-be8f-811c5b098de6" status: 200 len: 1321 microversion: 2.1 time: 0.150321 Apr 16 21:26:59.232897 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2658/5152] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:59 2022] GET /compute/v2.1/servers/fa0a30a4-6ada-4031-be8f-811c5b098de6 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:26:59.499481 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ebfa086b-8164-4c07-98b8-bdf1414d0b8f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:26:59.500233 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ebfa086b-8164-4c07-98b8-bdf1414d0b8f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 6eb61102-0483-413f-88b9-7519c852b7f6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:26:59.508005 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ebfa086b-8164-4c07-98b8-bdf1414d0b8f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:59.508614 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ebfa086b-8164-4c07-98b8-bdf1414d0b8f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:26:59.509513 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ebfa086b-8164-4c07-98b8-bdf1414d0b8f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:26:59.510218 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ebfa086b-8164-4c07-98b8-bdf1414d0b8f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:00.084044 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-58e646f3-021f-4cf1-8ccb-bcd970aecb74 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:00.085047 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-58e646f3-021f-4cf1-8ccb-bcd970aecb74 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:00.093417 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58e646f3-021f-4cf1-8ccb-bcd970aecb74 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:00.094875 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58e646f3-021f-4cf1-8ccb-bcd970aecb74 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:00.096275 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58e646f3-021f-4cf1-8ccb-bcd970aecb74 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:00.096880 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58e646f3-021f-4cf1-8ccb-bcd970aecb74 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:00.122510 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ebfa086b-8164-4c07-98b8-bdf1414d0b8f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:00.136994 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ebfa086b-8164-4c07-98b8-bdf1414d0b8f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6" status: 200 len: 1558 microversion: 2.1 time: 0.642021 Apr 16 21:27:00.148950 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2495/5153] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:26:59 2022] GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6 => generated 1558 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:00.165846 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-72bd9fa9-6b07-4f96-a58a-17349bc4ffef tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:00.166641 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-72bd9fa9-6b07-4f96-a58a-17349bc4ffef tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 6eb61102-0483-413f-88b9-7519c852b7f6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:00.176980 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-72bd9fa9-6b07-4f96-a58a-17349bc4ffef tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:00.177791 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-72bd9fa9-6b07-4f96-a58a-17349bc4ffef tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:00.179598 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-72bd9fa9-6b07-4f96-a58a-17349bc4ffef tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:00.180304 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-72bd9fa9-6b07-4f96-a58a-17349bc4ffef tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:00.247379 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-58e646f3-021f-4cf1-8ccb-bcd970aecb74 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:00.256420 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-58e646f3-021f-4cf1-8ccb-bcd970aecb74 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11" status: 200 len: 1314 microversion: 2.1 time: 0.178339 Apr 16 21:27:00.266339 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2659/5154] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:00 2022] GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:00.273598 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fd0f7569-5fb1-45e7-b09d-9380d2a30279 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:00.274652 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fd0f7569-5fb1-45e7-b09d-9380d2a30279 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: fa0a30a4-6ada-4031-be8f-811c5b098de6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:00.281477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fd0f7569-5fb1-45e7-b09d-9380d2a30279 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:00.282079 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fd0f7569-5fb1-45e7-b09d-9380d2a30279 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:00.283002 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fd0f7569-5fb1-45e7-b09d-9380d2a30279 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:00.284075 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fd0f7569-5fb1-45e7-b09d-9380d2a30279 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:00.336148 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-72bd9fa9-6b07-4f96-a58a-17349bc4ffef tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.182569 Apr 16 21:27:00.336992 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2496/5155] 10.222.0.20 () {58 vars in 1274 bytes} [Sat Apr 16 21:27:00 2022] GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6/os-interface => generated 285 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:27:00.529201 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-d1119bfa-21cb-4e4c-b9df-f43c2b28aba8 req-74d75942-a774-423e-a716-b3dccec65743 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11", "name": "network-vif-plugged", "status": "completed", "tag": "4a2d54bf-9e95-4690-8351-2371d73d83d2"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:27:00.533269 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fd0f7569-5fb1-45e7-b09d-9380d2a30279 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:00.538447 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fd0f7569-5fb1-45e7-b09d-9380d2a30279 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/fa0a30a4-6ada-4031-be8f-811c5b098de6" status: 200 len: 1502 microversion: 2.1 time: 0.270765 Apr 16 21:27:00.539232 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2660/5156] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:00 2022] GET /compute/v2.1/servers/fa0a30a4-6ada-4031-be8f-811c5b098de6 => generated 1502 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:00.545815 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-d1119bfa-21cb-4e4c-b9df-f43c2b28aba8 req-74d75942-a774-423e-a716-b3dccec65743 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:00.546267 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-d1119bfa-21cb-4e4c-b9df-f43c2b28aba8 req-74d75942-a774-423e-a716-b3dccec65743 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:00.557186 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6d07c0cf-64d7-4442-8e99-50dea0752611 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:00.558308 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6d07c0cf-64d7-4442-8e99-50dea0752611 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: fa0a30a4-6ada-4031-be8f-811c5b098de6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:00.565931 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6d07c0cf-64d7-4442-8e99-50dea0752611 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:00.567311 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6d07c0cf-64d7-4442-8e99-50dea0752611 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:00.567843 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-d1119bfa-21cb-4e4c-b9df-f43c2b28aba8 req-74d75942-a774-423e-a716-b3dccec65743 service nova] Creating event network-vif-plugged:4a2d54bf-9e95-4690-8351-2371d73d83d2 for instance ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11 on nch2-master-1 Apr 16 21:27:00.568239 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6d07c0cf-64d7-4442-8e99-50dea0752611 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:00.568737 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6d07c0cf-64d7-4442-8e99-50dea0752611 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:00.575403 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-d1119bfa-21cb-4e4c-b9df-f43c2b28aba8 req-74d75942-a774-423e-a716-b3dccec65743 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060280 Apr 16 21:27:00.583238 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2497/5157] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:27:00.863522 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6d07c0cf-64d7-4442-8e99-50dea0752611 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:00.875306 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6d07c0cf-64d7-4442-8e99-50dea0752611 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/fa0a30a4-6ada-4031-be8f-811c5b098de6" status: 200 len: 1502 microversion: 2.1 time: 0.322770 Apr 16 21:27:00.879851 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2661/5158] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:00 2022] GET /compute/v2.1/servers/fa0a30a4-6ada-4031-be8f-811c5b098de6 => generated 1502 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:27:00.894162 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-af8945b3-104b-4017-8b6b-5cb73321c6db tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:00.894749 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-af8945b3-104b-4017-8b6b-5cb73321c6db tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: fa0a30a4-6ada-4031-be8f-811c5b098de6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:00.901458 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-af8945b3-104b-4017-8b6b-5cb73321c6db tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:00.906986 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-af8945b3-104b-4017-8b6b-5cb73321c6db tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:00.906986 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-af8945b3-104b-4017-8b6b-5cb73321c6db tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:00.906986 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-af8945b3-104b-4017-8b6b-5cb73321c6db tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:00.928668 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-af8945b3-104b-4017-8b6b-5cb73321c6db tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: fa0a30a4-6ada-4031-be8f-811c5b098de6] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:27:01.274610 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7a20cd9c-ca0d-45b5-a5f5-f780dc4feeee tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:01.275349 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7a20cd9c-ca0d-45b5-a5f5-f780dc4feeee tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:01.278690 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-af8945b3-104b-4017-8b6b-5cb73321c6db tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fa0a30a4-6ada-4031-be8f-811c5b098de6" status: 204 len: 0 microversion: 2.1 time: 0.389522 Apr 16 21:27:01.279275 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2498/5159] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:27:00 2022] DELETE /compute/v2.1/servers/fa0a30a4-6ada-4031-be8f-811c5b098de6 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:27:01.287012 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7a20cd9c-ca0d-45b5-a5f5-f780dc4feeee tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:01.287793 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7a20cd9c-ca0d-45b5-a5f5-f780dc4feeee tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:01.288895 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7a20cd9c-ca0d-45b5-a5f5-f780dc4feeee tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:01.289542 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7a20cd9c-ca0d-45b5-a5f5-f780dc4feeee tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:01.290114 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-23874aec-d5e3-4059-9125-44b7262f4b7a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:01.290816 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-23874aec-d5e3-4059-9125-44b7262f4b7a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: fa0a30a4-6ada-4031-be8f-811c5b098de6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:01.309540 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-23874aec-d5e3-4059-9125-44b7262f4b7a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:01.310563 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-23874aec-d5e3-4059-9125-44b7262f4b7a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:01.310951 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-23874aec-d5e3-4059-9125-44b7262f4b7a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:01.311457 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-23874aec-d5e3-4059-9125-44b7262f4b7a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:01.434248 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7a20cd9c-ca0d-45b5-a5f5-f780dc4feeee tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:01.443934 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7a20cd9c-ca0d-45b5-a5f5-f780dc4feeee tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11" status: 200 len: 1314 microversion: 2.1 time: 0.174028 Apr 16 21:27:01.461399 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2662/5160] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:01 2022] GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:01.603618 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-23874aec-d5e3-4059-9125-44b7262f4b7a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:01.611352 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-23874aec-d5e3-4059-9125-44b7262f4b7a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/fa0a30a4-6ada-4031-be8f-811c5b098de6" status: 200 len: 1508 microversion: 2.1 time: 0.325320 Apr 16 21:27:01.612283 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2499/5161] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:01 2022] GET /compute/v2.1/servers/fa0a30a4-6ada-4031-be8f-811c5b098de6 => generated 1508 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:01.779235 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4761e1eb-2273-4fb6-8cd6-c73267584176 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1983428534", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "f3ac398a-104b-41dd-96df-2204e2236e68"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:27:01.829750 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-4761e1eb-2273-4fb6-8cd6-c73267584176 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] validate_networks() for [('f3ac398a-104b-41dd-96df-2204e2236e68', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:27:02.013319 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-2d7316b7-28b5-477c-b11b-ddf08005ba3d req-8e9881d7-40a5-4fbd-ab34-fd1fc30ca0e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6eb61102-0483-413f-88b9-7519c852b7f6", "tag": "bca26f6e-d4ea-42d6-97cb-5fabb9c3b713"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:27:02.030066 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-2d7316b7-28b5-477c-b11b-ddf08005ba3d req-8e9881d7-40a5-4fbd-ab34-fd1fc30ca0e4 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:02.030066 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-2d7316b7-28b5-477c-b11b-ddf08005ba3d req-8e9881d7-40a5-4fbd-ab34-fd1fc30ca0e4 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:02.045641 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-2d7316b7-28b5-477c-b11b-ddf08005ba3d req-8e9881d7-40a5-4fbd-ab34-fd1fc30ca0e4 service nova] Creating event network-changed:bca26f6e-d4ea-42d6-97cb-5fabb9c3b713 for instance 6eb61102-0483-413f-88b9-7519c852b7f6 on nch2-master-1 Apr 16 21:27:02.051755 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-2d7316b7-28b5-477c-b11b-ddf08005ba3d req-8e9881d7-40a5-4fbd-ab34-fd1fc30ca0e4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042483 Apr 16 21:27:02.055765 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2500/5162] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:27:02.326873 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-4761e1eb-2273-4fb6-8cd6-c73267584176 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:27:02.327385 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-4761e1eb-2273-4fb6-8cd6-c73267584176 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:27:02.327777 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-4761e1eb-2273-4fb6-8cd6-c73267584176 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:27:02.328617 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-4761e1eb-2273-4fb6-8cd6-c73267584176 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:27:02.329048 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-4761e1eb-2273-4fb6-8cd6-c73267584176 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:27:02.344803 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4761e1eb-2273-4fb6-8cd6-c73267584176 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:02.345288 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4761e1eb-2273-4fb6-8cd6-c73267584176 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:02.346969 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4761e1eb-2273-4fb6-8cd6-c73267584176 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:02.347597 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4761e1eb-2273-4fb6-8cd6-c73267584176 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:02.373732 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-4761e1eb-2273-4fb6-8cd6-c73267584176 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Getting quotas for project 4319e24594eb450aa6aca572265ba4d0. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:27:02.381264 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-4761e1eb-2273-4fb6-8cd6-c73267584176 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Getting quotas for user bbdac15c5bdb45048cf00c1f7abc22ac and project 4319e24594eb450aa6aca572265ba4d0. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:27:02.396379 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4761e1eb-2273-4fb6-8cd6-c73267584176 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:27:02.399173 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4761e1eb-2273-4fb6-8cd6-c73267584176 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] [instance: 9c4793cc-6978-4051-a7e3-9536ff67ba7d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:27:02.463666 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1212e121-efe1-4834-8782-e699839a470a tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:02.465112 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1212e121-efe1-4834-8782-e699839a470a tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:02.471759 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1212e121-efe1-4834-8782-e699839a470a tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:02.472591 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1212e121-efe1-4834-8782-e699839a470a tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:02.473543 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1212e121-efe1-4834-8782-e699839a470a tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:02.474088 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1212e121-efe1-4834-8782-e699839a470a tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:02.538693 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4761e1eb-2273-4fb6-8cd6-c73267584176 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.898240 Apr 16 21:27:02.541180 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2663/5163] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:27:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 901 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:27:02.551097 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-faae11cf-ee5a-4389-9fcb-1f358d1216a4 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:02.557097 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-faae11cf-ee5a-4389-9fcb-1f358d1216a4 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] [instance: 9c4793cc-6978-4051-a7e3-9536ff67ba7d] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:02.676287 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-faae11cf-ee5a-4389-9fcb-1f358d1216a4 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdac15c5bdb45048cf00c1f7abc22ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4319e24594eb450aa6aca572265ba4d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:02.683514 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1212e121-efe1-4834-8782-e699839a470a tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:02.683947 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-faae11cf-ee5a-4389-9fcb-1f358d1216a4 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] 10.222.0.20 "GET /compute/v2.1/servers/9c4793cc-6978-4051-a7e3-9536ff67ba7d" status: 200 len: 1228 microversion: 2.1 time: 0.137389 Apr 16 21:27:02.685570 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2664/5164] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:02 2022] GET /compute/v2.1/servers/9c4793cc-6978-4051-a7e3-9536ff67ba7d => generated 1228 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:27:02.700698 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d36b47d9-dd70-49ba-b884-62cfb195b339 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:02.701560 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d36b47d9-dd70-49ba-b884-62cfb195b339 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: fa0a30a4-6ada-4031-be8f-811c5b098de6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:02.717813 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d36b47d9-dd70-49ba-b884-62cfb195b339 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:02.718403 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1212e121-efe1-4834-8782-e699839a470a tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11" status: 200 len: 1501 microversion: 2.1 time: 0.259019 Apr 16 21:27:02.718757 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d36b47d9-dd70-49ba-b884-62cfb195b339 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:02.725693 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2501/5165] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:02 2022] GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11 => generated 1501 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:27:02.725921 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d36b47d9-dd70-49ba-b884-62cfb195b339 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:02.726090 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d36b47d9-dd70-49ba-b884-62cfb195b339 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:02.739386 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a809ec97-c345-4d18-8532-af97a5ccb760 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:27:02.741823 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a809ec97-c345-4d18-8532-af97a5ccb760 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:02.757523 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a809ec97-c345-4d18-8532-af97a5ccb760 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:02.758424 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a809ec97-c345-4d18-8532-af97a5ccb760 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:02.763138 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a809ec97-c345-4d18-8532-af97a5ccb760 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:02.763820 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a809ec97-c345-4d18-8532-af97a5ccb760 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:02.806181 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-a809ec97-c345-4d18-8532-af97a5ccb760 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lazy-loading 'flavor' on Instance uuid ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:27:03.211571 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a809ec97-c345-4d18-8532-af97a5ccb760 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "POST /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11/action" status: 202 len: 0 microversion: 2.1 time: 0.478069 Apr 16 21:27:03.212864 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2502/5166] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:27:02 2022] POST /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11/action => generated 0 bytes in 480 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:27:03.228026 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e498361b-20a7-4136-b483-47585e968724 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:03.228852 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e498361b-20a7-4136-b483-47585e968724 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:03.243677 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e498361b-20a7-4136-b483-47585e968724 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:03.246238 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e498361b-20a7-4136-b483-47585e968724 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:03.249662 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e498361b-20a7-4136-b483-47585e968724 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:03.250128 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e498361b-20a7-4136-b483-47585e968724 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:03.398429 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d36b47d9-dd70-49ba-b884-62cfb195b339 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:03.411470 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d36b47d9-dd70-49ba-b884-62cfb195b339 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/fa0a30a4-6ada-4031-be8f-811c5b098de6" status: 200 len: 1508 microversion: 2.1 time: 0.717841 Apr 16 21:27:03.411470 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2665/5167] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:02 2022] GET /compute/v2.1/servers/fa0a30a4-6ada-4031-be8f-811c5b098de6 => generated 1508 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:03.463743 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e498361b-20a7-4136-b483-47585e968724 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:03.472041 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e498361b-20a7-4136-b483-47585e968724 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11" status: 200 len: 1509 microversion: 2.1 time: 0.252481 Apr 16 21:27:03.473120 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2503/5168] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:03 2022] GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11 => generated 1509 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:03.702641 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c7761974-00de-4303-8c57-82b04ecad156 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:03.703289 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c7761974-00de-4303-8c57-82b04ecad156 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] [instance: 9c4793cc-6978-4051-a7e3-9536ff67ba7d] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:03.760723 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c7761974-00de-4303-8c57-82b04ecad156 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdac15c5bdb45048cf00c1f7abc22ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4319e24594eb450aa6aca572265ba4d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:03.768346 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c7761974-00de-4303-8c57-82b04ecad156 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] 10.222.0.20 "GET /compute/v2.1/servers/9c4793cc-6978-4051-a7e3-9536ff67ba7d" status: 200 len: 1228 microversion: 2.1 time: 0.069556 Apr 16 21:27:03.769310 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2666/5169] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:03 2022] GET /compute/v2.1/servers/9c4793cc-6978-4051-a7e3-9536ff67ba7d => generated 1228 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:04.066803 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-c4916556-d6e9-4870-8f8d-50f0988e4cd8 req-985b4a32-795a-4bdd-b968-ede9a4c59234 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa0a30a4-6ada-4031-be8f-811c5b098de6", "name": "network-vif-deleted", "tag": "53d5d264-62ff-47ee-8a34-f6400fde2daf"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:27:04.075624 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-c4916556-d6e9-4870-8f8d-50f0988e4cd8 req-985b4a32-795a-4bdd-b968-ede9a4c59234 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:04.076085 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-c4916556-d6e9-4870-8f8d-50f0988e4cd8 req-985b4a32-795a-4bdd-b968-ede9a4c59234 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:04.086814 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-c4916556-d6e9-4870-8f8d-50f0988e4cd8 req-985b4a32-795a-4bdd-b968-ede9a4c59234 service nova] Creating event network-vif-deleted:53d5d264-62ff-47ee-8a34-f6400fde2daf for instance fa0a30a4-6ada-4031-be8f-811c5b098de6 on nch1-master-1 Apr 16 21:27:04.091640 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-c4916556-d6e9-4870-8f8d-50f0988e4cd8 req-985b4a32-795a-4bdd-b968-ede9a4c59234 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029186 Apr 16 21:27:04.092365 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2504/5170] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:27:04.427242 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-aadf3a75-dfa7-4653-8943-2c5d490561ab tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:04.427857 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-aadf3a75-dfa7-4653-8943-2c5d490561ab tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: fa0a30a4-6ada-4031-be8f-811c5b098de6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:04.435684 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aadf3a75-dfa7-4653-8943-2c5d490561ab tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:04.436230 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aadf3a75-dfa7-4653-8943-2c5d490561ab tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:04.437014 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aadf3a75-dfa7-4653-8943-2c5d490561ab tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:04.437459 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aadf3a75-dfa7-4653-8943-2c5d490561ab tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:04.469059 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aadf3a75-dfa7-4653-8943-2c5d490561ab tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:04.469686 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aadf3a75-dfa7-4653-8943-2c5d490561ab tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:04.470152 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-aadf3a75-dfa7-4653-8943-2c5d490561ab tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lazy-loading 'fault' on Instance uuid fa0a30a4-6ada-4031-be8f-811c5b098de6 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:27:04.489722 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b5fa2544-5e0f-400f-96a7-c7ffb2606b77 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:04.491266 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b5fa2544-5e0f-400f-96a7-c7ffb2606b77 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:04.498481 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b5fa2544-5e0f-400f-96a7-c7ffb2606b77 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:04.499145 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b5fa2544-5e0f-400f-96a7-c7ffb2606b77 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:04.500121 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b5fa2544-5e0f-400f-96a7-c7ffb2606b77 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:04.500750 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b5fa2544-5e0f-400f-96a7-c7ffb2606b77 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:04.512496 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-aadf3a75-dfa7-4653-8943-2c5d490561ab tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:04.520101 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-aadf3a75-dfa7-4653-8943-2c5d490561ab tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/fa0a30a4-6ada-4031-be8f-811c5b098de6" status: 200 len: 1311 microversion: 2.1 time: 0.098172 Apr 16 21:27:04.521003 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2667/5171] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:04 2022] GET /compute/v2.1/servers/fa0a30a4-6ada-4031-be8f-811c5b098de6 => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:04.640214 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b5fa2544-5e0f-400f-96a7-c7ffb2606b77 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:04.650171 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b5fa2544-5e0f-400f-96a7-c7ffb2606b77 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11" status: 200 len: 1492 microversion: 2.1 time: 0.162575 Apr 16 21:27:04.650171 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2505/5172] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:04 2022] GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11 => generated 1492 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:27:04.664509 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c0bcc0c2-cd74-4146-8d9c-758e614fc702 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:04.665014 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c0bcc0c2-cd74-4146-8d9c-758e614fc702 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:04.671538 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c0bcc0c2-cd74-4146-8d9c-758e614fc702 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:04.673376 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c0bcc0c2-cd74-4146-8d9c-758e614fc702 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:04.673376 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c0bcc0c2-cd74-4146-8d9c-758e614fc702 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:04.673376 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c0bcc0c2-cd74-4146-8d9c-758e614fc702 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:04.710469 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c0bcc0c2-cd74-4146-8d9c-758e614fc702 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:27:04.786293 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9bc67cc1-0c5b-4c04-b068-c3d0d03f582f tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:04.786907 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9bc67cc1-0c5b-4c04-b068-c3d0d03f582f tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] [instance: 9c4793cc-6978-4051-a7e3-9536ff67ba7d] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:04.792756 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9bc67cc1-0c5b-4c04-b068-c3d0d03f582f tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:04.793276 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9bc67cc1-0c5b-4c04-b068-c3d0d03f582f tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:04.794065 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9bc67cc1-0c5b-4c04-b068-c3d0d03f582f tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:04.794513 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9bc67cc1-0c5b-4c04-b068-c3d0d03f582f tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:04.859256 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9bc67cc1-0c5b-4c04-b068-c3d0d03f582f tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdac15c5bdb45048cf00c1f7abc22ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4319e24594eb450aa6aca572265ba4d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:04.866735 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9bc67cc1-0c5b-4c04-b068-c3d0d03f582f tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] 10.222.0.20 "GET /compute/v2.1/servers/9c4793cc-6978-4051-a7e3-9536ff67ba7d" status: 200 len: 1280 microversion: 2.1 time: 0.085030 Apr 16 21:27:04.876631 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2506/5173] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:04 2022] GET /compute/v2.1/servers/9c4793cc-6978-4051-a7e3-9536ff67ba7d => generated 1280 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:27:04.961816 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c0bcc0c2-cd74-4146-8d9c-758e614fc702 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11" status: 204 len: 0 microversion: 2.1 time: 0.300984 Apr 16 21:27:04.962340 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2668/5174] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:27:04 2022] DELETE /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:27:04.970808 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-83b12249-d457-4d75-b6b8-dc6d14433e6d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:04.971498 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-83b12249-d457-4d75-b6b8-dc6d14433e6d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:04.977743 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-83b12249-d457-4d75-b6b8-dc6d14433e6d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:04.978295 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-83b12249-d457-4d75-b6b8-dc6d14433e6d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:04.979094 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-83b12249-d457-4d75-b6b8-dc6d14433e6d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:04.979538 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-83b12249-d457-4d75-b6b8-dc6d14433e6d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:05.110760 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-83b12249-d457-4d75-b6b8-dc6d14433e6d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:05.119174 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-83b12249-d457-4d75-b6b8-dc6d14433e6d tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11" status: 200 len: 1498 microversion: 2.1 time: 0.152380 Apr 16 21:27:05.120846 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2507/5175] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:04 2022] GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11 => generated 1498 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:27:05.538058 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3b4bebe6-e9b8-408c-affb-ab6fad940280 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:05.538844 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3b4bebe6-e9b8-408c-affb-ab6fad940280 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: fa0a30a4-6ada-4031-be8f-811c5b098de6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:05.545221 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3b4bebe6-e9b8-408c-affb-ab6fad940280 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:05.546242 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3b4bebe6-e9b8-408c-affb-ab6fad940280 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:05.546488 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3b4bebe6-e9b8-408c-affb-ab6fad940280 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:05.546929 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3b4bebe6-e9b8-408c-affb-ab6fad940280 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:05.560939 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-3b4bebe6-e9b8-408c-affb-ab6fad940280 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] HTTP exception thrown: Instance fa0a30a4-6ada-4031-be8f-811c5b098de6 could not be found. Apr 16 21:27:05.561533 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3b4bebe6-e9b8-408c-affb-ab6fad940280 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Returning 404 to user: Instance fa0a30a4-6ada-4031-be8f-811c5b098de6 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:27:05.562350 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3b4bebe6-e9b8-408c-affb-ab6fad940280 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/fa0a30a4-6ada-4031-be8f-811c5b098de6" status: 404 len: 111 microversion: 2.1 time: 0.028877 Apr 16 21:27:05.562877 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2669/5176] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:05 2022] GET /compute/v2.1/servers/fa0a30a4-6ada-4031-be8f-811c5b098de6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:27:05.580299 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5b68881a-bd06-4efe-9313-b9404aa9e2d8 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Action: 'create', calling method: .version_select at 0x7fbb96489e50>, body: {"keypair": {"name": "tempest-key-2027983942"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:27:05.594291 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-5b68881a-bd06-4efe-9313-b9404aa9e2d8 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Getting quotas for project 76fd883ad3944fcaaecdf2909120dc87. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:27:05.599433 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-5b68881a-bd06-4efe-9313-b9404aa9e2d8 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Getting quotas for user 5e71b35f438d4539a60a390e1ceec9cd and project 76fd883ad3944fcaaecdf2909120dc87. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:27:05.883164 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-77eeed36-13ec-4eec-bd35-dea575a53605 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:05.883813 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-77eeed36-13ec-4eec-bd35-dea575a53605 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] [instance: 9c4793cc-6978-4051-a7e3-9536ff67ba7d] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:05.889756 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-77eeed36-13ec-4eec-bd35-dea575a53605 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:05.892433 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-77eeed36-13ec-4eec-bd35-dea575a53605 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:05.892433 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-77eeed36-13ec-4eec-bd35-dea575a53605 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:05.892433 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-77eeed36-13ec-4eec-bd35-dea575a53605 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:05.954118 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-77eeed36-13ec-4eec-bd35-dea575a53605 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdac15c5bdb45048cf00c1f7abc22ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4319e24594eb450aa6aca572265ba4d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:05.961750 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-77eeed36-13ec-4eec-bd35-dea575a53605 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] 10.222.0.20 "GET /compute/v2.1/servers/9c4793cc-6978-4051-a7e3-9536ff67ba7d" status: 200 len: 1288 microversion: 2.1 time: 0.082534 Apr 16 21:27:05.962346 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2670/5177] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:05 2022] GET /compute/v2.1/servers/9c4793cc-6978-4051-a7e3-9536ff67ba7d => generated 1288 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:27:05.977953 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-5b68881a-bd06-4efe-9313-b9404aa9e2d8 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Getting quotas for project 76fd883ad3944fcaaecdf2909120dc87. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:27:05.983058 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-5b68881a-bd06-4efe-9313-b9404aa9e2d8 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Getting quotas for user 5e71b35f438d4539a60a390e1ceec9cd and project 76fd883ad3944fcaaecdf2909120dc87. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:27:05.998157 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5b68881a-bd06-4efe-9313-b9404aa9e2d8 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2297 microversion: 2.1 time: 0.421802 Apr 16 21:27:05.999160 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2508/5178] 10.222.0.20 () {60 vars in 1157 bytes} [Sat Apr 16 21:27:05 2022] POST /compute/v2.1/os-keypairs => generated 2297 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:06.008406 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7ae9af69-9774-4131-bddc-b01c3785c33f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '.version_select at 0x7fbb964bcdc0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:06.011213 ncdv-master-1 devstack@n-api.service[137408]: WARNING oslo_db.sqlalchemy.utils [None req-7ae9af69-9774-4131-bddc-b01c3785c33f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Unique keys not in sort_keys. The sorting order may be unstable. Apr 16 21:27:06.016220 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7ae9af69-9774-4131-bddc-b01c3785c33f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/os-keypairs" status: 200 len: 545 microversion: 2.1 time: 0.011698 Apr 16 21:27:06.016752 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2671/5179] 10.222.0.20 () {58 vars in 1136 bytes} [Sat Apr 16 21:27:06 2022] GET /compute/v2.1/os-keypairs => generated 545 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:27:06.119084 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6befd481-c7d6-4e85-a4d5-c1ec5603d254 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-94273737", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "key_name": "tempest-key-2027983942", "networks": [{"uuid": "8f593006-a7a9-4abc-8409-1d78959e9c9f"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:27:06.137729 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-80d517fe-0df2-49db-83d7-ac866e7dc463 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:06.138521 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-80d517fe-0df2-49db-83d7-ac866e7dc463 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:06.144685 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-80d517fe-0df2-49db-83d7-ac866e7dc463 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:06.145146 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-80d517fe-0df2-49db-83d7-ac866e7dc463 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:06.145945 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-80d517fe-0df2-49db-83d7-ac866e7dc463 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:06.146597 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-80d517fe-0df2-49db-83d7-ac866e7dc463 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:06.173438 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-6befd481-c7d6-4e85-a4d5-c1ec5603d254 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] validate_networks() for [('8f593006-a7a9-4abc-8409-1d78959e9c9f', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:27:06.426265 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-80d517fe-0df2-49db-83d7-ac866e7dc463 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:06.437092 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-80d517fe-0df2-49db-83d7-ac866e7dc463 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11" status: 200 len: 1498 microversion: 2.1 time: 0.303522 Apr 16 21:27:06.438030 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2672/5180] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:06 2022] GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11 => generated 1498 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:27:06.595489 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-6befd481-c7d6-4e85-a4d5-c1ec5603d254 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:27:06.596047 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-6befd481-c7d6-4e85-a4d5-c1ec5603d254 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:27:06.596453 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-6befd481-c7d6-4e85-a4d5-c1ec5603d254 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:27:06.596921 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-6befd481-c7d6-4e85-a4d5-c1ec5603d254 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:27:06.597483 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-6befd481-c7d6-4e85-a4d5-c1ec5603d254 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:27:06.606315 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6befd481-c7d6-4e85-a4d5-c1ec5603d254 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:06.606772 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6befd481-c7d6-4e85-a4d5-c1ec5603d254 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:06.608042 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6befd481-c7d6-4e85-a4d5-c1ec5603d254 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:06.609590 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6befd481-c7d6-4e85-a4d5-c1ec5603d254 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:06.625463 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-6befd481-c7d6-4e85-a4d5-c1ec5603d254 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Getting quotas for project 76fd883ad3944fcaaecdf2909120dc87. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:27:06.631398 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-6befd481-c7d6-4e85-a4d5-c1ec5603d254 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Getting quotas for user 5e71b35f438d4539a60a390e1ceec9cd and project 76fd883ad3944fcaaecdf2909120dc87. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:27:06.646134 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6befd481-c7d6-4e85-a4d5-c1ec5603d254 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:27:06.648595 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6befd481-c7d6-4e85-a4d5-c1ec5603d254 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:27:06.824782 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6befd481-c7d6-4e85-a4d5-c1ec5603d254 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.709979 Apr 16 21:27:06.825839 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2509/5181] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:27:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:27:06.836971 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0bea3617-eb88-40bc-a7f7-0d3b162d179c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:06.837599 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0bea3617-eb88-40bc-a7f7-0d3b162d179c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:06.952959 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0bea3617-eb88-40bc-a7f7-0d3b162d179c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:06.962818 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0bea3617-eb88-40bc-a7f7-0d3b162d179c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1" status: 200 len: 1227 microversion: 2.1 time: 0.128773 Apr 16 21:27:06.962818 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2673/5182] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:06 2022] GET /compute/v2.1/servers/b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1 => generated 1227 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:06.979348 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-722aaeb8-c486-4331-94cb-a63624fbaa4e tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:06.980958 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-722aaeb8-c486-4331-94cb-a63624fbaa4e tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] [instance: 9c4793cc-6978-4051-a7e3-9536ff67ba7d] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:06.988074 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-722aaeb8-c486-4331-94cb-a63624fbaa4e tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:06.989163 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-722aaeb8-c486-4331-94cb-a63624fbaa4e tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:06.990067 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-722aaeb8-c486-4331-94cb-a63624fbaa4e tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:06.990638 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-722aaeb8-c486-4331-94cb-a63624fbaa4e tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:07.061523 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-722aaeb8-c486-4331-94cb-a63624fbaa4e tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdac15c5bdb45048cf00c1f7abc22ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4319e24594eb450aa6aca572265ba4d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:07.071087 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-722aaeb8-c486-4331-94cb-a63624fbaa4e tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] 10.222.0.20 "GET /compute/v2.1/servers/9c4793cc-6978-4051-a7e3-9536ff67ba7d" status: 200 len: 1286 microversion: 2.1 time: 0.095950 Apr 16 21:27:07.071730 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2510/5183] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:06 2022] GET /compute/v2.1/servers/9c4793cc-6978-4051-a7e3-9536ff67ba7d => generated 1286 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:27:07.454625 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-58d66c92-8944-4a46-8041-b2fa4917f5e0 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:07.455537 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-58d66c92-8944-4a46-8041-b2fa4917f5e0 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:07.468439 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58d66c92-8944-4a46-8041-b2fa4917f5e0 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:07.473981 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58d66c92-8944-4a46-8041-b2fa4917f5e0 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:07.473981 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58d66c92-8944-4a46-8041-b2fa4917f5e0 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:07.473981 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58d66c92-8944-4a46-8041-b2fa4917f5e0 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:07.590782 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-67f78cf0-d665-42f7-9b2e-0a0964378231 req-0addf358-9220-416e-8592-526ef41248b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11", "name": "network-vif-deleted", "tag": "4a2d54bf-9e95-4690-8351-2371d73d83d2"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:27:07.590972 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-58d66c92-8944-4a46-8041-b2fa4917f5e0 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:07.600187 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-58d66c92-8944-4a46-8041-b2fa4917f5e0 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11" status: 200 len: 1456 microversion: 2.1 time: 0.149415 Apr 16 21:27:07.602393 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2674/5184] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:07 2022] GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11 => generated 1456 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:07.611869 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-67f78cf0-d665-42f7-9b2e-0a0964378231 req-0addf358-9220-416e-8592-526ef41248b5 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:07.611869 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-67f78cf0-d665-42f7-9b2e-0a0964378231 req-0addf358-9220-416e-8592-526ef41248b5 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:07.621745 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-67f78cf0-d665-42f7-9b2e-0a0964378231 req-0addf358-9220-416e-8592-526ef41248b5 service nova] Creating event network-vif-deleted:4a2d54bf-9e95-4690-8351-2371d73d83d2 for instance ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11 on nch2-master-1 Apr 16 21:27:07.626759 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-67f78cf0-d665-42f7-9b2e-0a0964378231 req-0addf358-9220-416e-8592-526ef41248b5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039937 Apr 16 21:27:07.627418 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2511/5185] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:27:07.977961 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c857bdd0-a5e7-4f2c-bc29-becd6b95ecdf tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:07.978571 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c857bdd0-a5e7-4f2c-bc29-becd6b95ecdf tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:07.985759 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c857bdd0-a5e7-4f2c-bc29-becd6b95ecdf tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:07.986228 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c857bdd0-a5e7-4f2c-bc29-becd6b95ecdf tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:07.987101 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c857bdd0-a5e7-4f2c-bc29-becd6b95ecdf tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:07.987551 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c857bdd0-a5e7-4f2c-bc29-becd6b95ecdf tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:08.078749 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c857bdd0-a5e7-4f2c-bc29-becd6b95ecdf tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:08.088449 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c857bdd0-a5e7-4f2c-bc29-becd6b95ecdf tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1" status: 200 len: 1231 microversion: 2.1 time: 0.114250 Apr 16 21:27:08.092958 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-823e89c3-e0d6-4458-942d-719970a7d13d tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:08.094150 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-823e89c3-e0d6-4458-942d-719970a7d13d tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] [instance: 9c4793cc-6978-4051-a7e3-9536ff67ba7d] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:08.097816 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2675/5186] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:07 2022] GET /compute/v2.1/servers/b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1 => generated 1231 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:08.111663 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-823e89c3-e0d6-4458-942d-719970a7d13d tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:08.112460 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-823e89c3-e0d6-4458-942d-719970a7d13d tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:08.113288 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-823e89c3-e0d6-4458-942d-719970a7d13d tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:08.113965 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-823e89c3-e0d6-4458-942d-719970a7d13d tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:08.267528 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-823e89c3-e0d6-4458-942d-719970a7d13d tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdac15c5bdb45048cf00c1f7abc22ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4319e24594eb450aa6aca572265ba4d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:08.275214 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-823e89c3-e0d6-4458-942d-719970a7d13d tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] 10.222.0.20 "GET /compute/v2.1/servers/9c4793cc-6978-4051-a7e3-9536ff67ba7d" status: 200 len: 1328 microversion: 2.1 time: 0.190366 Apr 16 21:27:08.275789 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2512/5187] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:08 2022] GET /compute/v2.1/servers/9c4793cc-6978-4051-a7e3-9536ff67ba7d => generated 1328 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:08.620986 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-89e9d8c8-6482-4557-9ed7-733ede076471 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:08.621520 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-89e9d8c8-6482-4557-9ed7-733ede076471 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:08.630438 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-89e9d8c8-6482-4557-9ed7-733ede076471 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:08.630993 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-89e9d8c8-6482-4557-9ed7-733ede076471 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:08.631860 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-89e9d8c8-6482-4557-9ed7-733ede076471 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:08.632650 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-89e9d8c8-6482-4557-9ed7-733ede076471 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:08.667403 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-89e9d8c8-6482-4557-9ed7-733ede076471 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:08.667966 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-89e9d8c8-6482-4557-9ed7-733ede076471 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:08.668458 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-89e9d8c8-6482-4557-9ed7-733ede076471 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lazy-loading 'fault' on Instance uuid ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:27:08.740366 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-89e9d8c8-6482-4557-9ed7-733ede076471 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e069f136dcb344b197f58ba47722f4d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7caf6e59a47149a68cae6224fb2856e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:08.748247 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-89e9d8c8-6482-4557-9ed7-733ede076471 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11" status: 200 len: 1304 microversion: 2.1 time: 0.131163 Apr 16 21:27:08.748833 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2676/5188] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:08 2022] GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11 => generated 1304 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:09.104518 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4a611092-451c-4e55-a209-deadb42012ac tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:09.105119 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4a611092-451c-4e55-a209-deadb42012ac tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:09.111613 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4a611092-451c-4e55-a209-deadb42012ac tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:09.112070 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4a611092-451c-4e55-a209-deadb42012ac tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:09.112895 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4a611092-451c-4e55-a209-deadb42012ac tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:09.113339 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4a611092-451c-4e55-a209-deadb42012ac tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:09.175494 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4a611092-451c-4e55-a209-deadb42012ac tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:09.182859 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4a611092-451c-4e55-a209-deadb42012ac tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1" status: 200 len: 1279 microversion: 2.1 time: 0.082253 Apr 16 21:27:09.183422 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2513/5189] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:09 2022] GET /compute/v2.1/servers/b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1 => generated 1279 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:09.292527 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4372f97c-167f-4adf-9f54-596a3bc4d115 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:09.294088 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4372f97c-167f-4adf-9f54-596a3bc4d115 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] [instance: 9c4793cc-6978-4051-a7e3-9536ff67ba7d] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:09.301709 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4372f97c-167f-4adf-9f54-596a3bc4d115 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:09.302175 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4372f97c-167f-4adf-9f54-596a3bc4d115 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:09.303065 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4372f97c-167f-4adf-9f54-596a3bc4d115 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:09.303666 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4372f97c-167f-4adf-9f54-596a3bc4d115 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:09.457762 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4372f97c-167f-4adf-9f54-596a3bc4d115 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdac15c5bdb45048cf00c1f7abc22ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4319e24594eb450aa6aca572265ba4d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:09.468340 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4372f97c-167f-4adf-9f54-596a3bc4d115 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] 10.222.0.20 "GET /compute/v2.1/servers/9c4793cc-6978-4051-a7e3-9536ff67ba7d" status: 200 len: 1328 microversion: 2.1 time: 0.179848 Apr 16 21:27:09.468981 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2677/5190] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:09 2022] GET /compute/v2.1/servers/9c4793cc-6978-4051-a7e3-9536ff67ba7d => generated 1328 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:09.648035 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-02772f5c-12ec-4694-bc1f-b149055478d1 req-fbcf4a1d-7bd1-49f0-8d6a-f9473a148353 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c4793cc-6978-4051-a7e3-9536ff67ba7d", "tag": "dacc3b3f-c825-45b9-b755-3714d6cf5d5c"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:27:09.659274 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-02772f5c-12ec-4694-bc1f-b149055478d1 req-fbcf4a1d-7bd1-49f0-8d6a-f9473a148353 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:09.660006 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-02772f5c-12ec-4694-bc1f-b149055478d1 req-fbcf4a1d-7bd1-49f0-8d6a-f9473a148353 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:09.678644 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-02772f5c-12ec-4694-bc1f-b149055478d1 req-fbcf4a1d-7bd1-49f0-8d6a-f9473a148353 service nova] Creating event network-changed:dacc3b3f-c825-45b9-b755-3714d6cf5d5c for instance 9c4793cc-6978-4051-a7e3-9536ff67ba7d on nch2-master-1 Apr 16 21:27:09.686763 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-02772f5c-12ec-4694-bc1f-b149055478d1 req-fbcf4a1d-7bd1-49f0-8d6a-f9473a148353 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041977 Apr 16 21:27:09.688080 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2514/5191] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:27:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:27:09.766054 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6d0a365a-3662-4c70-9b68-93e6003880c4 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:09.766790 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6d0a365a-3662-4c70-9b68-93e6003880c4 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:09.773369 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6d0a365a-3662-4c70-9b68-93e6003880c4 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:09.773831 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6d0a365a-3662-4c70-9b68-93e6003880c4 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:09.774663 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6d0a365a-3662-4c70-9b68-93e6003880c4 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:09.775101 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6d0a365a-3662-4c70-9b68-93e6003880c4 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:09.789011 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-6d0a365a-3662-4c70-9b68-93e6003880c4 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] HTTP exception thrown: Instance ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11 could not be found. Apr 16 21:27:09.789616 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6d0a365a-3662-4c70-9b68-93e6003880c4 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Returning 404 to user: Instance ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:27:09.790451 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6d0a365a-3662-4c70-9b68-93e6003880c4 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11" status: 404 len: 111 microversion: 2.1 time: 0.028536 Apr 16 21:27:09.791008 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2678/5192] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:09 2022] GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:27:09.805397 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5d4ba265-6c36-478f-a5e9-020d304ab3dc tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:09.809985 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5d4ba265-6c36-478f-a5e9-020d304ab3dc tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:09.812155 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5d4ba265-6c36-478f-a5e9-020d304ab3dc tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:09.812650 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5d4ba265-6c36-478f-a5e9-020d304ab3dc tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:09.813446 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5d4ba265-6c36-478f-a5e9-020d304ab3dc tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:09.813923 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5d4ba265-6c36-478f-a5e9-020d304ab3dc tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:09.828362 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-5d4ba265-6c36-478f-a5e9-020d304ab3dc tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] HTTP exception thrown: Instance ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11 could not be found. Apr 16 21:27:09.828997 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5d4ba265-6c36-478f-a5e9-020d304ab3dc tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Returning 404 to user: Instance ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:27:09.829864 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5d4ba265-6c36-478f-a5e9-020d304ab3dc tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11" status: 404 len: 111 microversion: 2.1 time: 0.029090 Apr 16 21:27:09.830653 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2515/5193] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:27:09 2022] DELETE /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:27:09.838784 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b59b1d68-594d-4ade-a67e-66d6fa35324c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:09.839395 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b59b1d68-594d-4ade-a67e-66d6fa35324c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:09.846137 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b59b1d68-594d-4ade-a67e-66d6fa35324c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:09.846137 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b59b1d68-594d-4ade-a67e-66d6fa35324c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:09.846645 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b59b1d68-594d-4ade-a67e-66d6fa35324c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:09.847085 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b59b1d68-594d-4ade-a67e-66d6fa35324c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:09.860549 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-b59b1d68-594d-4ade-a67e-66d6fa35324c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] HTTP exception thrown: Instance ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11 could not be found. Apr 16 21:27:09.866739 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b59b1d68-594d-4ade-a67e-66d6fa35324c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Returning 404 to user: Instance ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:27:09.866739 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b59b1d68-594d-4ade-a67e-66d6fa35324c tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11" status: 404 len: 111 microversion: 2.1 time: 0.027802 Apr 16 21:27:09.866739 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2679/5194] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:09 2022] GET /compute/v2.1/servers/ce1699ea-ee4e-4c55-b2c0-dfa761d9ed11 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:27:09.873908 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e381a656-30a8-4f1e-90ea-5bd7d0a21f07 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:09.874666 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e381a656-30a8-4f1e-90ea-5bd7d0a21f07 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:09.881987 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e381a656-30a8-4f1e-90ea-5bd7d0a21f07 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:09.882485 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e381a656-30a8-4f1e-90ea-5bd7d0a21f07 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:09.883576 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e381a656-30a8-4f1e-90ea-5bd7d0a21f07 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:09.884013 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e381a656-30a8-4f1e-90ea-5bd7d0a21f07 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:09.899755 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-e381a656-30a8-4f1e-90ea-5bd7d0a21f07 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] HTTP exception thrown: Instance 3e13f52f-cb80-494c-8cc8-f785a71975e0 could not be found. Apr 16 21:27:09.900485 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e381a656-30a8-4f1e-90ea-5bd7d0a21f07 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Returning 404 to user: Instance 3e13f52f-cb80-494c-8cc8-f785a71975e0 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:27:09.901594 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e381a656-30a8-4f1e-90ea-5bd7d0a21f07 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 404 len: 111 microversion: 2.1 time: 0.032110 Apr 16 21:27:09.902154 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2516/5195] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:27:09 2022] DELETE /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:27:09.912757 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a011a8a6-96bd-43e8-a231-399701de18e5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:09.913425 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a011a8a6-96bd-43e8-a231-399701de18e5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3e13f52f-cb80-494c-8cc8-f785a71975e0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:09.920388 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a011a8a6-96bd-43e8-a231-399701de18e5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:09.920881 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a011a8a6-96bd-43e8-a231-399701de18e5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:09.922840 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a011a8a6-96bd-43e8-a231-399701de18e5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:09.923306 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a011a8a6-96bd-43e8-a231-399701de18e5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:09.938258 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-a011a8a6-96bd-43e8-a231-399701de18e5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] HTTP exception thrown: Instance 3e13f52f-cb80-494c-8cc8-f785a71975e0 could not be found. Apr 16 21:27:09.938909 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a011a8a6-96bd-43e8-a231-399701de18e5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Returning 404 to user: Instance 3e13f52f-cb80-494c-8cc8-f785a71975e0 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:27:09.940421 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a011a8a6-96bd-43e8-a231-399701de18e5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0" status: 404 len: 111 microversion: 2.1 time: 0.032770 Apr 16 21:27:09.940988 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2680/5196] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:09 2022] GET /compute/v2.1/servers/3e13f52f-cb80-494c-8cc8-f785a71975e0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:27:09.948999 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0459c8dc-855b-4e6b-ab9e-b3477329b7a8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:09.949543 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0459c8dc-855b-4e6b-ab9e-b3477329b7a8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:09.955673 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0459c8dc-855b-4e6b-ab9e-b3477329b7a8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:09.956255 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0459c8dc-855b-4e6b-ab9e-b3477329b7a8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:09.957194 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0459c8dc-855b-4e6b-ab9e-b3477329b7a8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:09.957646 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0459c8dc-855b-4e6b-ab9e-b3477329b7a8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:09.971715 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-0459c8dc-855b-4e6b-ab9e-b3477329b7a8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] HTTP exception thrown: Instance 6aa577ae-2715-44de-93bb-d02db79533fb could not be found. Apr 16 21:27:09.972351 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0459c8dc-855b-4e6b-ab9e-b3477329b7a8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Returning 404 to user: Instance 6aa577ae-2715-44de-93bb-d02db79533fb could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:27:09.973381 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0459c8dc-855b-4e6b-ab9e-b3477329b7a8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 404 len: 111 microversion: 2.1 time: 0.028116 Apr 16 21:27:09.973796 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2517/5197] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:27:09 2022] DELETE /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:27:09.981868 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-70a3d51a-a2c9-4347-9df2-b5984ce377e9 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:09.982493 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-70a3d51a-a2c9-4347-9df2-b5984ce377e9 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 6aa577ae-2715-44de-93bb-d02db79533fb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:09.989135 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-70a3d51a-a2c9-4347-9df2-b5984ce377e9 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:09.989580 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-70a3d51a-a2c9-4347-9df2-b5984ce377e9 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:09.990472 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-70a3d51a-a2c9-4347-9df2-b5984ce377e9 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:09.998861 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-70a3d51a-a2c9-4347-9df2-b5984ce377e9 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:10.004874 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-70a3d51a-a2c9-4347-9df2-b5984ce377e9 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] HTTP exception thrown: Instance 6aa577ae-2715-44de-93bb-d02db79533fb could not be found. Apr 16 21:27:10.005485 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-70a3d51a-a2c9-4347-9df2-b5984ce377e9 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Returning 404 to user: Instance 6aa577ae-2715-44de-93bb-d02db79533fb could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:27:10.006322 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-70a3d51a-a2c9-4347-9df2-b5984ce377e9 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb" status: 404 len: 111 microversion: 2.1 time: 0.028444 Apr 16 21:27:10.006860 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2681/5198] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:09 2022] GET /compute/v2.1/servers/6aa577ae-2715-44de-93bb-d02db79533fb => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:27:10.014836 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-789f38d5-5c10-4869-b434-bff82dfee3ad tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:10.015341 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-789f38d5-5c10-4869-b434-bff82dfee3ad tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 2b015d8b-25ca-42b4-9080-9cc405ea1ad6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:10.022166 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-789f38d5-5c10-4869-b434-bff82dfee3ad tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:10.022166 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-789f38d5-5c10-4869-b434-bff82dfee3ad tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:10.022888 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-789f38d5-5c10-4869-b434-bff82dfee3ad tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:10.023366 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-789f38d5-5c10-4869-b434-bff82dfee3ad tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:10.037179 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-789f38d5-5c10-4869-b434-bff82dfee3ad tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] HTTP exception thrown: Instance 2b015d8b-25ca-42b4-9080-9cc405ea1ad6 could not be found. Apr 16 21:27:10.037790 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-789f38d5-5c10-4869-b434-bff82dfee3ad tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Returning 404 to user: Instance 2b015d8b-25ca-42b4-9080-9cc405ea1ad6 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:27:10.038649 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-789f38d5-5c10-4869-b434-bff82dfee3ad tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2b015d8b-25ca-42b4-9080-9cc405ea1ad6" status: 404 len: 111 microversion: 2.1 time: 0.027722 Apr 16 21:27:10.042124 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2518/5199] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:27:10 2022] DELETE /compute/v2.1/servers/2b015d8b-25ca-42b4-9080-9cc405ea1ad6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:27:10.050590 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6f4d2db1-fe55-4e2e-b158-8b77c60794c8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:10.051635 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6f4d2db1-fe55-4e2e-b158-8b77c60794c8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 2b015d8b-25ca-42b4-9080-9cc405ea1ad6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:10.057414 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6f4d2db1-fe55-4e2e-b158-8b77c60794c8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:10.057874 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6f4d2db1-fe55-4e2e-b158-8b77c60794c8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:10.058655 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6f4d2db1-fe55-4e2e-b158-8b77c60794c8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:10.059098 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6f4d2db1-fe55-4e2e-b158-8b77c60794c8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:10.076055 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-6f4d2db1-fe55-4e2e-b158-8b77c60794c8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] HTTP exception thrown: Instance 2b015d8b-25ca-42b4-9080-9cc405ea1ad6 could not be found. Apr 16 21:27:10.077741 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6f4d2db1-fe55-4e2e-b158-8b77c60794c8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Returning 404 to user: Instance 2b015d8b-25ca-42b4-9080-9cc405ea1ad6 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:27:10.078269 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6f4d2db1-fe55-4e2e-b158-8b77c60794c8 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/2b015d8b-25ca-42b4-9080-9cc405ea1ad6" status: 404 len: 111 microversion: 2.1 time: 0.034300 Apr 16 21:27:10.078841 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2682/5200] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:10 2022] GET /compute/v2.1/servers/2b015d8b-25ca-42b4-9080-9cc405ea1ad6 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:27:10.087506 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2db26e61-0b78-4331-8268-68833df64ff7 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:10.088016 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2db26e61-0b78-4331-8268-68833df64ff7 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: a13152af-d062-4601-810e-ce65dd5479a9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:10.099885 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-2db26e61-0b78-4331-8268-68833df64ff7 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] HTTP exception thrown: Instance a13152af-d062-4601-810e-ce65dd5479a9 could not be found. Apr 16 21:27:10.101178 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2db26e61-0b78-4331-8268-68833df64ff7 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Returning 404 to user: Instance a13152af-d062-4601-810e-ce65dd5479a9 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:27:10.103092 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2db26e61-0b78-4331-8268-68833df64ff7 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "DELETE /compute/v2.1/servers/a13152af-d062-4601-810e-ce65dd5479a9" status: 404 len: 111 microversion: 2.1 time: 0.019520 Apr 16 21:27:10.104151 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2519/5201] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:27:10 2022] DELETE /compute/v2.1/servers/a13152af-d062-4601-810e-ce65dd5479a9 => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:27:10.114377 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b89971cd-067a-4b1c-ab5c-d8cd9ac4b353 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:10.115195 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b89971cd-067a-4b1c-ab5c-d8cd9ac4b353 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: a13152af-d062-4601-810e-ce65dd5479a9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:10.122210 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-b89971cd-067a-4b1c-ab5c-d8cd9ac4b353 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] HTTP exception thrown: Instance a13152af-d062-4601-810e-ce65dd5479a9 could not be found. Apr 16 21:27:10.122819 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b89971cd-067a-4b1c-ab5c-d8cd9ac4b353 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Returning 404 to user: Instance a13152af-d062-4601-810e-ce65dd5479a9 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:27:10.124132 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b89971cd-067a-4b1c-ab5c-d8cd9ac4b353 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/a13152af-d062-4601-810e-ce65dd5479a9" status: 404 len: 111 microversion: 2.1 time: 0.014635 Apr 16 21:27:10.125686 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2683/5202] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:10 2022] GET /compute/v2.1/servers/a13152af-d062-4601-810e-ce65dd5479a9 => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:27:10.200060 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8ad46ba1-e673-4d33-a994-6bbc2b5c6eb1 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:10.200725 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8ad46ba1-e673-4d33-a994-6bbc2b5c6eb1 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:10.218060 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8ad46ba1-e673-4d33-a994-6bbc2b5c6eb1 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:10.218749 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8ad46ba1-e673-4d33-a994-6bbc2b5c6eb1 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:10.219910 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8ad46ba1-e673-4d33-a994-6bbc2b5c6eb1 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:10.221645 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8ad46ba1-e673-4d33-a994-6bbc2b5c6eb1 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:10.488263 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-76712038-e67a-4477-9887-2f282aed2a21 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:10.489590 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-76712038-e67a-4477-9887-2f282aed2a21 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] [instance: 9c4793cc-6978-4051-a7e3-9536ff67ba7d] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:10.501030 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-76712038-e67a-4477-9887-2f282aed2a21 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:10.502277 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-76712038-e67a-4477-9887-2f282aed2a21 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:10.503977 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-76712038-e67a-4477-9887-2f282aed2a21 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:10.504718 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-76712038-e67a-4477-9887-2f282aed2a21 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:10.734802 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-76712038-e67a-4477-9887-2f282aed2a21 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdac15c5bdb45048cf00c1f7abc22ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4319e24594eb450aa6aca572265ba4d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:10.745565 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-76712038-e67a-4477-9887-2f282aed2a21 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] 10.222.0.20 "GET /compute/v2.1/servers/9c4793cc-6978-4051-a7e3-9536ff67ba7d" status: 200 len: 1328 microversion: 2.1 time: 0.263404 Apr 16 21:27:10.751376 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2684/5203] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:10 2022] GET /compute/v2.1/servers/9c4793cc-6978-4051-a7e3-9536ff67ba7d => generated 1328 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:10.766813 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8ad46ba1-e673-4d33-a994-6bbc2b5c6eb1 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:10.775054 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8ad46ba1-e673-4d33-a994-6bbc2b5c6eb1 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1" status: 200 len: 1327 microversion: 2.1 time: 0.579068 Apr 16 21:27:10.776832 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2520/5204] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:10 2022] GET /compute/v2.1/servers/b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1 => generated 1327 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:11.646878 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-711f6069-1ead-4c1d-9023-41400d9f3379 req-069b7b97-fee0-40e7-8704-42bc730e8b83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1", "tag": "c5d5b748-1ce8-407d-b157-4168cdd02e0f"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:27:11.659662 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-711f6069-1ead-4c1d-9023-41400d9f3379 req-069b7b97-fee0-40e7-8704-42bc730e8b83 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:11.660393 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-711f6069-1ead-4c1d-9023-41400d9f3379 req-069b7b97-fee0-40e7-8704-42bc730e8b83 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:11.684667 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-711f6069-1ead-4c1d-9023-41400d9f3379 req-069b7b97-fee0-40e7-8704-42bc730e8b83 service nova] Creating event network-changed:c5d5b748-1ce8-407d-b157-4168cdd02e0f for instance b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1 on nch1-master-1 Apr 16 21:27:11.690726 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-711f6069-1ead-4c1d-9023-41400d9f3379 req-069b7b97-fee0-40e7-8704-42bc730e8b83 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047424 Apr 16 21:27:11.692357 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2685/5205] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:27:11.761829 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ec72b681-88d2-44f9-9a83-8eb9400297ad tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:11.763183 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ec72b681-88d2-44f9-9a83-8eb9400297ad tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] [instance: 9c4793cc-6978-4051-a7e3-9536ff67ba7d] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:11.770143 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ec72b681-88d2-44f9-9a83-8eb9400297ad tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:11.770862 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ec72b681-88d2-44f9-9a83-8eb9400297ad tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:11.771757 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ec72b681-88d2-44f9-9a83-8eb9400297ad tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:11.772290 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ec72b681-88d2-44f9-9a83-8eb9400297ad tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:11.794305 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-08b980ed-00f1-4df7-8ff6-798f0252f7d8 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:11.795280 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-08b980ed-00f1-4df7-8ff6-798f0252f7d8 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:11.804116 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-08b980ed-00f1-4df7-8ff6-798f0252f7d8 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:11.805335 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-08b980ed-00f1-4df7-8ff6-798f0252f7d8 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:11.806394 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-08b980ed-00f1-4df7-8ff6-798f0252f7d8 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:11.807038 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-08b980ed-00f1-4df7-8ff6-798f0252f7d8 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:12.046821 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ec72b681-88d2-44f9-9a83-8eb9400297ad tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdac15c5bdb45048cf00c1f7abc22ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4319e24594eb450aa6aca572265ba4d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:12.055461 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ec72b681-88d2-44f9-9a83-8eb9400297ad tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] 10.222.0.20 "GET /compute/v2.1/servers/9c4793cc-6978-4051-a7e3-9536ff67ba7d" status: 200 len: 1328 microversion: 2.1 time: 0.297369 Apr 16 21:27:12.056046 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2521/5206] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:11 2022] GET /compute/v2.1/servers/9c4793cc-6978-4051-a7e3-9536ff67ba7d => generated 1328 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:12.277642 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-08b980ed-00f1-4df7-8ff6-798f0252f7d8 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:12.285779 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-08b980ed-00f1-4df7-8ff6-798f0252f7d8 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1" status: 200 len: 1327 microversion: 2.1 time: 0.495691 Apr 16 21:27:12.286368 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2686/5207] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:11 2022] GET /compute/v2.1/servers/b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1 => generated 1327 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:27:13.072421 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8a016866-e004-45aa-a323-8070a498dff2 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:13.073163 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8a016866-e004-45aa-a323-8070a498dff2 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] [instance: 9c4793cc-6978-4051-a7e3-9536ff67ba7d] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:13.080081 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8a016866-e004-45aa-a323-8070a498dff2 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:13.080571 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8a016866-e004-45aa-a323-8070a498dff2 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:13.081348 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8a016866-e004-45aa-a323-8070a498dff2 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:13.081791 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8a016866-e004-45aa-a323-8070a498dff2 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:13.212603 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8a016866-e004-45aa-a323-8070a498dff2 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdac15c5bdb45048cf00c1f7abc22ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4319e24594eb450aa6aca572265ba4d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:13.219978 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8a016866-e004-45aa-a323-8070a498dff2 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] 10.222.0.20 "GET /compute/v2.1/servers/9c4793cc-6978-4051-a7e3-9536ff67ba7d" status: 200 len: 1328 microversion: 2.1 time: 0.151597 Apr 16 21:27:13.221081 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2522/5208] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:13 2022] GET /compute/v2.1/servers/9c4793cc-6978-4051-a7e3-9536ff67ba7d => generated 1328 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:13.303368 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-20b754ca-1e30-486b-9f80-2ca3a6fc4af9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:13.304039 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-20b754ca-1e30-486b-9f80-2ca3a6fc4af9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:13.311422 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-20b754ca-1e30-486b-9f80-2ca3a6fc4af9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:13.312000 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-20b754ca-1e30-486b-9f80-2ca3a6fc4af9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:13.313318 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-20b754ca-1e30-486b-9f80-2ca3a6fc4af9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:13.313452 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-20b754ca-1e30-486b-9f80-2ca3a6fc4af9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:13.447265 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-20b754ca-1e30-486b-9f80-2ca3a6fc4af9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:13.455053 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-20b754ca-1e30-486b-9f80-2ca3a6fc4af9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1" status: 200 len: 1327 microversion: 2.1 time: 0.156439 Apr 16 21:27:13.455617 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2687/5209] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:13 2022] GET /compute/v2.1/servers/b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1 => generated 1327 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:14.238172 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-44c184d7-27c1-44ba-ae38-67b470a22379 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:14.239830 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-44c184d7-27c1-44ba-ae38-67b470a22379 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] [instance: 9c4793cc-6978-4051-a7e3-9536ff67ba7d] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:14.247356 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-44c184d7-27c1-44ba-ae38-67b470a22379 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:14.247847 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-44c184d7-27c1-44ba-ae38-67b470a22379 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:14.248738 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-44c184d7-27c1-44ba-ae38-67b470a22379 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:14.249203 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-44c184d7-27c1-44ba-ae38-67b470a22379 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:14.308129 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-e6c6beeb-aaae-4dca-ad71-b1e5ce2f08d4 req-4ea07711-8597-400a-beb2-b6f75b261c9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c4793cc-6978-4051-a7e3-9536ff67ba7d", "name": "network-vif-plugged", "status": "completed", "tag": "dacc3b3f-c825-45b9-b755-3714d6cf5d5c"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:27:14.315862 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-e6c6beeb-aaae-4dca-ad71-b1e5ce2f08d4 req-4ea07711-8597-400a-beb2-b6f75b261c9f service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:14.317591 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-e6c6beeb-aaae-4dca-ad71-b1e5ce2f08d4 req-4ea07711-8597-400a-beb2-b6f75b261c9f service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:14.328986 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-e6c6beeb-aaae-4dca-ad71-b1e5ce2f08d4 req-4ea07711-8597-400a-beb2-b6f75b261c9f service nova] Creating event network-vif-plugged:dacc3b3f-c825-45b9-b755-3714d6cf5d5c for instance 9c4793cc-6978-4051-a7e3-9536ff67ba7d on nch2-master-1 Apr 16 21:27:14.333936 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-e6c6beeb-aaae-4dca-ad71-b1e5ce2f08d4 req-4ea07711-8597-400a-beb2-b6f75b261c9f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034891 Apr 16 21:27:14.334592 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2688/5210] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:27:14.411400 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-44c184d7-27c1-44ba-ae38-67b470a22379 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdac15c5bdb45048cf00c1f7abc22ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4319e24594eb450aa6aca572265ba4d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:14.421047 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-44c184d7-27c1-44ba-ae38-67b470a22379 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] 10.222.0.20 "GET /compute/v2.1/servers/9c4793cc-6978-4051-a7e3-9536ff67ba7d" status: 200 len: 1328 microversion: 2.1 time: 0.187377 Apr 16 21:27:14.421634 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2523/5211] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:14 2022] GET /compute/v2.1/servers/9c4793cc-6978-4051-a7e3-9536ff67ba7d => generated 1328 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:14.471935 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-aaaba9e5-6fb9-4974-9633-c0ebca45f627 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:14.472692 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-aaaba9e5-6fb9-4974-9633-c0ebca45f627 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:14.479115 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aaaba9e5-6fb9-4974-9633-c0ebca45f627 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:14.479574 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aaaba9e5-6fb9-4974-9633-c0ebca45f627 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:14.480450 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aaaba9e5-6fb9-4974-9633-c0ebca45f627 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:14.480917 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aaaba9e5-6fb9-4974-9633-c0ebca45f627 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:14.613001 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-aaaba9e5-6fb9-4974-9633-c0ebca45f627 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:14.620517 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-aaaba9e5-6fb9-4974-9633-c0ebca45f627 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1" status: 200 len: 1327 microversion: 2.1 time: 0.152942 Apr 16 21:27:14.621209 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2689/5212] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:14 2022] GET /compute/v2.1/servers/b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1 => generated 1327 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:15.438777 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b1cdb483-92b7-48a4-a1fb-26a58256e471 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:15.440477 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b1cdb483-92b7-48a4-a1fb-26a58256e471 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] [instance: 9c4793cc-6978-4051-a7e3-9536ff67ba7d] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:15.447134 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b1cdb483-92b7-48a4-a1fb-26a58256e471 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:15.447588 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b1cdb483-92b7-48a4-a1fb-26a58256e471 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:15.448396 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b1cdb483-92b7-48a4-a1fb-26a58256e471 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:15.448839 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b1cdb483-92b7-48a4-a1fb-26a58256e471 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:15.592053 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b1cdb483-92b7-48a4-a1fb-26a58256e471 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdac15c5bdb45048cf00c1f7abc22ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4319e24594eb450aa6aca572265ba4d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:15.599488 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b1cdb483-92b7-48a4-a1fb-26a58256e471 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] 10.222.0.20 "GET /compute/v2.1/servers/9c4793cc-6978-4051-a7e3-9536ff67ba7d" status: 200 len: 1328 microversion: 2.1 time: 0.164663 Apr 16 21:27:15.600056 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2524/5213] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:15 2022] GET /compute/v2.1/servers/9c4793cc-6978-4051-a7e3-9536ff67ba7d => generated 1328 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:15.641051 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a9b994ce-3d56-4eef-91bb-c56e6dc1bf8b tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:15.641784 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a9b994ce-3d56-4eef-91bb-c56e6dc1bf8b tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:15.649623 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9b994ce-3d56-4eef-91bb-c56e6dc1bf8b tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:15.650195 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9b994ce-3d56-4eef-91bb-c56e6dc1bf8b tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:15.651338 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9b994ce-3d56-4eef-91bb-c56e6dc1bf8b tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:15.651856 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9b994ce-3d56-4eef-91bb-c56e6dc1bf8b tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:15.792195 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a9b994ce-3d56-4eef-91bb-c56e6dc1bf8b tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:15.802063 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a9b994ce-3d56-4eef-91bb-c56e6dc1bf8b tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1" status: 200 len: 1327 microversion: 2.1 time: 0.163757 Apr 16 21:27:15.802063 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2690/5214] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:15 2022] GET /compute/v2.1/servers/b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1 => generated 1327 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:15.833271 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-547768e4-4edd-4e64-bfd5-319fa864dc54 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:15.833786 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-547768e4-4edd-4e64-bfd5-319fa864dc54 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: b2c8da69-77b6-4af4-87bc-bbf731043f9f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:15.839848 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-547768e4-4edd-4e64-bfd5-319fa864dc54 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:15.840367 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-547768e4-4edd-4e64-bfd5-319fa864dc54 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:15.841148 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-547768e4-4edd-4e64-bfd5-319fa864dc54 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:15.841784 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-547768e4-4edd-4e64-bfd5-319fa864dc54 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:15.857265 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-547768e4-4edd-4e64-bfd5-319fa864dc54 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] HTTP exception thrown: Instance b2c8da69-77b6-4af4-87bc-bbf731043f9f could not be found. Apr 16 21:27:15.857925 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-547768e4-4edd-4e64-bfd5-319fa864dc54 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Returning 404 to user: Instance b2c8da69-77b6-4af4-87bc-bbf731043f9f could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:27:15.862977 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-547768e4-4edd-4e64-bfd5-319fa864dc54 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b2c8da69-77b6-4af4-87bc-bbf731043f9f" status: 404 len: 111 microversion: 2.1 time: 0.029778 Apr 16 21:27:15.862977 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2525/5215] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:27:15 2022] DELETE /compute/v2.1/servers/b2c8da69-77b6-4af4-87bc-bbf731043f9f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:27:15.868572 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9caa70e1-cbaf-4671-9423-d04fde82851c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:15.869347 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9caa70e1-cbaf-4671-9423-d04fde82851c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: b2c8da69-77b6-4af4-87bc-bbf731043f9f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:15.875934 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9caa70e1-cbaf-4671-9423-d04fde82851c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:15.876443 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9caa70e1-cbaf-4671-9423-d04fde82851c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:15.877925 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9caa70e1-cbaf-4671-9423-d04fde82851c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:15.878378 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9caa70e1-cbaf-4671-9423-d04fde82851c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:15.897872 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-9caa70e1-cbaf-4671-9423-d04fde82851c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] HTTP exception thrown: Instance b2c8da69-77b6-4af4-87bc-bbf731043f9f could not be found. Apr 16 21:27:15.898499 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9caa70e1-cbaf-4671-9423-d04fde82851c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Returning 404 to user: Instance b2c8da69-77b6-4af4-87bc-bbf731043f9f could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:27:15.899461 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9caa70e1-cbaf-4671-9423-d04fde82851c tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/b2c8da69-77b6-4af4-87bc-bbf731043f9f" status: 404 len: 111 microversion: 2.1 time: 0.035184 Apr 16 21:27:15.904028 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2691/5216] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:15 2022] GET /compute/v2.1/servers/b2c8da69-77b6-4af4-87bc-bbf731043f9f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:27:15.908652 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e94757db-54ab-4d62-a7d7-5f6e4d30c5da tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:15.910117 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e94757db-54ab-4d62-a7d7-5f6e4d30c5da tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:15.915288 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e94757db-54ab-4d62-a7d7-5f6e4d30c5da tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:15.915853 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e94757db-54ab-4d62-a7d7-5f6e4d30c5da tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:15.916665 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e94757db-54ab-4d62-a7d7-5f6e4d30c5da tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:15.917112 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e94757db-54ab-4d62-a7d7-5f6e4d30c5da tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:15.942590 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e94757db-54ab-4d62-a7d7-5f6e4d30c5da tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:27:16.225081 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e94757db-54ab-4d62-a7d7-5f6e4d30c5da tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "DELETE /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 204 len: 0 microversion: 2.1 time: 0.319927 Apr 16 21:27:16.225599 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2526/5217] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:27:15 2022] DELETE /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:27:16.234000 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f58c1afc-b71e-4737-a856-a49fed54f5d7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:16.234623 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f58c1afc-b71e-4737-a856-a49fed54f5d7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:16.241283 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f58c1afc-b71e-4737-a856-a49fed54f5d7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:16.241747 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f58c1afc-b71e-4737-a856-a49fed54f5d7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:16.242533 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f58c1afc-b71e-4737-a856-a49fed54f5d7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:16.242980 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f58c1afc-b71e-4737-a856-a49fed54f5d7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:16.372213 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f58c1afc-b71e-4737-a856-a49fed54f5d7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:16.379851 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f58c1afc-b71e-4737-a856-a49fed54f5d7 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1510 microversion: 2.1 time: 0.149927 Apr 16 21:27:16.380646 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2692/5218] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:16 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:16.616838 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-be63a5f2-4088-4296-bd0b-ac9564431135 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:16.617609 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-be63a5f2-4088-4296-bd0b-ac9564431135 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] [instance: 9c4793cc-6978-4051-a7e3-9536ff67ba7d] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:16.624438 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-be63a5f2-4088-4296-bd0b-ac9564431135 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:16.624986 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-be63a5f2-4088-4296-bd0b-ac9564431135 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:16.625767 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-be63a5f2-4088-4296-bd0b-ac9564431135 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:16.626214 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-be63a5f2-4088-4296-bd0b-ac9564431135 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:16.755953 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-be63a5f2-4088-4296-bd0b-ac9564431135 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdac15c5bdb45048cf00c1f7abc22ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4319e24594eb450aa6aca572265ba4d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:16.763416 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-be63a5f2-4088-4296-bd0b-ac9564431135 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] 10.222.0.20 "GET /compute/v2.1/servers/9c4793cc-6978-4051-a7e3-9536ff67ba7d" status: 200 len: 1529 microversion: 2.1 time: 0.150905 Apr 16 21:27:16.763982 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2527/5219] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:16 2022] GET /compute/v2.1/servers/9c4793cc-6978-4051-a7e3-9536ff67ba7d => generated 1529 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:16.780483 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a9309273-04f4-427c-8432-1e5b3ae59d35 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:16.781106 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a9309273-04f4-427c-8432-1e5b3ae59d35 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] [instance: 9c4793cc-6978-4051-a7e3-9536ff67ba7d] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:16.788589 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9309273-04f4-427c-8432-1e5b3ae59d35 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:16.789058 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9309273-04f4-427c-8432-1e5b3ae59d35 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:16.789832 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9309273-04f4-427c-8432-1e5b3ae59d35 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:16.790281 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9309273-04f4-427c-8432-1e5b3ae59d35 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:16.818530 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8f618c62-0916-49f3-a453-839263da8086 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:16.819179 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8f618c62-0916-49f3-a453-839263da8086 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:16.825286 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8f618c62-0916-49f3-a453-839263da8086 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:16.825746 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8f618c62-0916-49f3-a453-839263da8086 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:16.826526 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8f618c62-0916-49f3-a453-839263da8086 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:16.826974 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8f618c62-0916-49f3-a453-839263da8086 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:16.920212 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a9309273-04f4-427c-8432-1e5b3ae59d35 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdac15c5bdb45048cf00c1f7abc22ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4319e24594eb450aa6aca572265ba4d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:16.927959 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a9309273-04f4-427c-8432-1e5b3ae59d35 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] 10.222.0.20 "GET /compute/v2.1/servers/9c4793cc-6978-4051-a7e3-9536ff67ba7d" status: 200 len: 1529 microversion: 2.1 time: 0.151640 Apr 16 21:27:16.928565 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2693/5220] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:16 2022] GET /compute/v2.1/servers/9c4793cc-6978-4051-a7e3-9536ff67ba7d => generated 1529 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:16.968616 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8f618c62-0916-49f3-a453-839263da8086 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:16.976089 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8f618c62-0916-49f3-a453-839263da8086 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1" status: 200 len: 1327 microversion: 2.1 time: 0.161484 Apr 16 21:27:16.976645 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2528/5221] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:16 2022] GET /compute/v2.1/servers/b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1 => generated 1327 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:17.122663 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e9116073-d8b1-4a44-ba64-f8eb18ca73c3 tempest-ServersNegativeTestMultiTenantJSON-282504691 tempest-ServersNegativeTestMultiTenantJSON-282504691-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:17.123183 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e9116073-d8b1-4a44-ba64-f8eb18ca73c3 tempest-ServersNegativeTestMultiTenantJSON-282504691 tempest-ServersNegativeTestMultiTenantJSON-282504691-project] [instance: 9c4793cc-6978-4051-a7e3-9536ff67ba7d] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:17.129762 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e9116073-d8b1-4a44-ba64-f8eb18ca73c3 tempest-ServersNegativeTestMultiTenantJSON-282504691 tempest-ServersNegativeTestMultiTenantJSON-282504691-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:17.130455 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e9116073-d8b1-4a44-ba64-f8eb18ca73c3 tempest-ServersNegativeTestMultiTenantJSON-282504691 tempest-ServersNegativeTestMultiTenantJSON-282504691-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:17.131253 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e9116073-d8b1-4a44-ba64-f8eb18ca73c3 tempest-ServersNegativeTestMultiTenantJSON-282504691 tempest-ServersNegativeTestMultiTenantJSON-282504691-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:17.131701 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e9116073-d8b1-4a44-ba64-f8eb18ca73c3 tempest-ServersNegativeTestMultiTenantJSON-282504691 tempest-ServersNegativeTestMultiTenantJSON-282504691-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:17.145805 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-e9116073-d8b1-4a44-ba64-f8eb18ca73c3 tempest-ServersNegativeTestMultiTenantJSON-282504691 tempest-ServersNegativeTestMultiTenantJSON-282504691-project] HTTP exception thrown: Instance 9c4793cc-6978-4051-a7e3-9536ff67ba7d could not be found. Apr 16 21:27:17.146415 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e9116073-d8b1-4a44-ba64-f8eb18ca73c3 tempest-ServersNegativeTestMultiTenantJSON-282504691 tempest-ServersNegativeTestMultiTenantJSON-282504691-project] Returning 404 to user: Instance 9c4793cc-6978-4051-a7e3-9536ff67ba7d could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:27:17.147321 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e9116073-d8b1-4a44-ba64-f8eb18ca73c3 tempest-ServersNegativeTestMultiTenantJSON-282504691 tempest-ServersNegativeTestMultiTenantJSON-282504691-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9c4793cc-6978-4051-a7e3-9536ff67ba7d" status: 404 len: 111 microversion: 2.1 time: 0.202987 Apr 16 21:27:17.148096 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2694/5222] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:27:16 2022] DELETE /compute/v2.1/servers/9c4793cc-6978-4051-a7e3-9536ff67ba7d => generated 111 bytes in 204 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:27:17.157544 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ce5a964d-3288-4b3e-85e5-e6d924288eee tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:17.158197 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ce5a964d-3288-4b3e-85e5-e6d924288eee tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] [instance: 9c4793cc-6978-4051-a7e3-9536ff67ba7d] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:17.164217 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ce5a964d-3288-4b3e-85e5-e6d924288eee tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:17.164689 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ce5a964d-3288-4b3e-85e5-e6d924288eee tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:17.165473 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ce5a964d-3288-4b3e-85e5-e6d924288eee tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:17.165918 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ce5a964d-3288-4b3e-85e5-e6d924288eee tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:17.296919 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ce5a964d-3288-4b3e-85e5-e6d924288eee tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdac15c5bdb45048cf00c1f7abc22ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4319e24594eb450aa6aca572265ba4d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:17.304891 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ce5a964d-3288-4b3e-85e5-e6d924288eee tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] 10.222.0.20 "GET /compute/v2.1/servers/9c4793cc-6978-4051-a7e3-9536ff67ba7d" status: 200 len: 1529 microversion: 2.1 time: 0.151140 Apr 16 21:27:17.306073 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2529/5223] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:17 2022] GET /compute/v2.1/servers/9c4793cc-6978-4051-a7e3-9536ff67ba7d => generated 1529 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:27:17.322328 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c02e50b5-34f9-46c7-9003-9dda7c582f77 tempest-ServersNegativeTestMultiTenantJSON-282504691 tempest-ServersNegativeTestMultiTenantJSON-282504691-project] Action: 'update', calling method: >, body: {"server": {"name": "9c4793cc-6978-4051-a7e3-9536ff67ba7d_new"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:27:17.323553 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c02e50b5-34f9-46c7-9003-9dda7c582f77 tempest-ServersNegativeTestMultiTenantJSON-282504691 tempest-ServersNegativeTestMultiTenantJSON-282504691-project] [instance: 9c4793cc-6978-4051-a7e3-9536ff67ba7d] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:17.329511 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c02e50b5-34f9-46c7-9003-9dda7c582f77 tempest-ServersNegativeTestMultiTenantJSON-282504691 tempest-ServersNegativeTestMultiTenantJSON-282504691-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:17.330346 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c02e50b5-34f9-46c7-9003-9dda7c582f77 tempest-ServersNegativeTestMultiTenantJSON-282504691 tempest-ServersNegativeTestMultiTenantJSON-282504691-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:17.331126 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c02e50b5-34f9-46c7-9003-9dda7c582f77 tempest-ServersNegativeTestMultiTenantJSON-282504691 tempest-ServersNegativeTestMultiTenantJSON-282504691-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:17.331572 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c02e50b5-34f9-46c7-9003-9dda7c582f77 tempest-ServersNegativeTestMultiTenantJSON-282504691 tempest-ServersNegativeTestMultiTenantJSON-282504691-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:17.346726 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-c02e50b5-34f9-46c7-9003-9dda7c582f77 tempest-ServersNegativeTestMultiTenantJSON-282504691 tempest-ServersNegativeTestMultiTenantJSON-282504691-project] HTTP exception thrown: Instance 9c4793cc-6978-4051-a7e3-9536ff67ba7d could not be found. Apr 16 21:27:17.347328 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c02e50b5-34f9-46c7-9003-9dda7c582f77 tempest-ServersNegativeTestMultiTenantJSON-282504691 tempest-ServersNegativeTestMultiTenantJSON-282504691-project] Returning 404 to user: Instance 9c4793cc-6978-4051-a7e3-9536ff67ba7d could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:27:17.348185 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c02e50b5-34f9-46c7-9003-9dda7c582f77 tempest-ServersNegativeTestMultiTenantJSON-282504691 tempest-ServersNegativeTestMultiTenantJSON-282504691-project] 10.222.0.20 "PUT /compute/v2.1/servers/9c4793cc-6978-4051-a7e3-9536ff67ba7d" status: 404 len: 111 microversion: 2.1 time: 0.029937 Apr 16 21:27:17.348744 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2695/5224] 10.222.0.20 () {60 vars in 1255 bytes} [Sat Apr 16 21:27:17 2022] PUT /compute/v2.1/servers/9c4793cc-6978-4051-a7e3-9536ff67ba7d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:27:17.357662 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a96d227f-2027-4c56-9c66-96319e5a888d tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:17.358166 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a96d227f-2027-4c56-9c66-96319e5a888d tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] [instance: 9c4793cc-6978-4051-a7e3-9536ff67ba7d] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:17.364891 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a96d227f-2027-4c56-9c66-96319e5a888d tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:17.365351 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a96d227f-2027-4c56-9c66-96319e5a888d tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:17.366123 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a96d227f-2027-4c56-9c66-96319e5a888d tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:17.366567 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a96d227f-2027-4c56-9c66-96319e5a888d tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:17.390891 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a96d227f-2027-4c56-9c66-96319e5a888d tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] [instance: 9c4793cc-6978-4051-a7e3-9536ff67ba7d] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:27:17.397752 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f37b4485-cfa4-411d-8a45-031ea97fa1a8 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:17.401268 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f37b4485-cfa4-411d-8a45-031ea97fa1a8 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:17.407503 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f37b4485-cfa4-411d-8a45-031ea97fa1a8 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:17.407503 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f37b4485-cfa4-411d-8a45-031ea97fa1a8 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:17.407856 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f37b4485-cfa4-411d-8a45-031ea97fa1a8 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:17.408133 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f37b4485-cfa4-411d-8a45-031ea97fa1a8 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:17.544451 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f37b4485-cfa4-411d-8a45-031ea97fa1a8 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:17.552452 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f37b4485-cfa4-411d-8a45-031ea97fa1a8 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1510 microversion: 2.1 time: 0.158708 Apr 16 21:27:17.553038 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2696/5225] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:17 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:17.557766 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-d8259600-7293-4890-bf99-ca738a8bc113 req-d0230392-5498-45c9-9e26-a560019552fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1", "name": "network-vif-plugged", "status": "completed", "tag": "c5d5b748-1ce8-407d-b157-4168cdd02e0f"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:27:17.565915 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-d8259600-7293-4890-bf99-ca738a8bc113 req-d0230392-5498-45c9-9e26-a560019552fd service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:17.566363 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-d8259600-7293-4890-bf99-ca738a8bc113 req-d0230392-5498-45c9-9e26-a560019552fd service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:17.577271 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-d8259600-7293-4890-bf99-ca738a8bc113 req-d0230392-5498-45c9-9e26-a560019552fd service nova] Creating event network-vif-plugged:c5d5b748-1ce8-407d-b157-4168cdd02e0f for instance b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1 on nch1-master-1 Apr 16 21:27:17.582027 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-d8259600-7293-4890-bf99-ca738a8bc113 req-d0230392-5498-45c9-9e26-a560019552fd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027894 Apr 16 21:27:17.582957 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2697/5226] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:27:17.796124 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a96d227f-2027-4c56-9c66-96319e5a888d tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9c4793cc-6978-4051-a7e3-9536ff67ba7d" status: 204 len: 0 microversion: 2.1 time: 0.442078 Apr 16 21:27:17.796854 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2530/5227] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:27:17 2022] DELETE /compute/v2.1/servers/9c4793cc-6978-4051-a7e3-9536ff67ba7d => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:27:17.806713 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e9a1f634-bf2f-4bba-b647-3f882fd56a2e tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:17.807418 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e9a1f634-bf2f-4bba-b647-3f882fd56a2e tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] [instance: 9c4793cc-6978-4051-a7e3-9536ff67ba7d] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:17.813612 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e9a1f634-bf2f-4bba-b647-3f882fd56a2e tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:17.814109 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e9a1f634-bf2f-4bba-b647-3f882fd56a2e tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:17.814892 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e9a1f634-bf2f-4bba-b647-3f882fd56a2e tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:17.815370 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e9a1f634-bf2f-4bba-b647-3f882fd56a2e tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:17.950512 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e9a1f634-bf2f-4bba-b647-3f882fd56a2e tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdac15c5bdb45048cf00c1f7abc22ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4319e24594eb450aa6aca572265ba4d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:17.958169 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e9a1f634-bf2f-4bba-b647-3f882fd56a2e tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] 10.222.0.20 "GET /compute/v2.1/servers/9c4793cc-6978-4051-a7e3-9536ff67ba7d" status: 200 len: 1535 microversion: 2.1 time: 0.156403 Apr 16 21:27:17.958792 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2698/5228] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:17 2022] GET /compute/v2.1/servers/9c4793cc-6978-4051-a7e3-9536ff67ba7d => generated 1535 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:17.993888 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7dd21d02-12db-43e7-a78b-77cc65a9abd4 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:17.994763 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7dd21d02-12db-43e7-a78b-77cc65a9abd4 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:18.001065 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7dd21d02-12db-43e7-a78b-77cc65a9abd4 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:18.005663 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7dd21d02-12db-43e7-a78b-77cc65a9abd4 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:18.006460 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7dd21d02-12db-43e7-a78b-77cc65a9abd4 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:18.006908 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7dd21d02-12db-43e7-a78b-77cc65a9abd4 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:18.201952 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7dd21d02-12db-43e7-a78b-77cc65a9abd4 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:18.215157 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7dd21d02-12db-43e7-a78b-77cc65a9abd4 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1" status: 200 len: 1327 microversion: 2.1 time: 0.220721 Apr 16 21:27:18.216316 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2531/5229] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:17 2022] GET /compute/v2.1/servers/b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1 => generated 1327 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:18.571842 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-66f84db4-36c6-4212-a44b-8dcec81c1ecf tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:18.572820 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-66f84db4-36c6-4212-a44b-8dcec81c1ecf tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:18.581712 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-66f84db4-36c6-4212-a44b-8dcec81c1ecf tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:18.582432 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-66f84db4-36c6-4212-a44b-8dcec81c1ecf tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:18.583436 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-66f84db4-36c6-4212-a44b-8dcec81c1ecf tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:18.584207 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-66f84db4-36c6-4212-a44b-8dcec81c1ecf tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:18.661027 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-66f84db4-36c6-4212-a44b-8dcec81c1ecf tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61eb0141ef744beeb2b9e1a6f25958fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6dcd4e578e9420cb0aaa2dd0e43a280', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:18.668022 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-4b31dee1-5099-4e2c-a875-4849c2718b6f req-82b2594b-6119-412f-aaec-29d2ebbfe374 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "daf189e2-7cb4-4dab-94cf-ffdceb314df7", "name": "network-vif-deleted", "tag": "29f0877d-908a-47df-aa37-d5dcea212e40"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:27:18.668306 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-66f84db4-36c6-4212-a44b-8dcec81c1ecf tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 200 len: 1468 microversion: 2.1 time: 0.100812 Apr 16 21:27:18.668890 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2699/5230] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:18 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 1468 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:18.681286 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-4b31dee1-5099-4e2c-a875-4849c2718b6f req-82b2594b-6119-412f-aaec-29d2ebbfe374 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:18.682038 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-4b31dee1-5099-4e2c-a875-4849c2718b6f req-82b2594b-6119-412f-aaec-29d2ebbfe374 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:18.695869 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-4b31dee1-5099-4e2c-a875-4849c2718b6f req-82b2594b-6119-412f-aaec-29d2ebbfe374 service nova] Creating event network-vif-deleted:29f0877d-908a-47df-aa37-d5dcea212e40 for instance daf189e2-7cb4-4dab-94cf-ffdceb314df7 on nch1-master-1 Apr 16 21:27:18.700831 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-4b31dee1-5099-4e2c-a875-4849c2718b6f req-82b2594b-6119-412f-aaec-29d2ebbfe374 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036439 Apr 16 21:27:18.701645 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2532/5231] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:27:18.975087 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c241f7b0-2e6a-4cfd-91f7-a8023ee97362 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:18.975688 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c241f7b0-2e6a-4cfd-91f7-a8023ee97362 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] [instance: 9c4793cc-6978-4051-a7e3-9536ff67ba7d] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:18.982739 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c241f7b0-2e6a-4cfd-91f7-a8023ee97362 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:18.983194 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c241f7b0-2e6a-4cfd-91f7-a8023ee97362 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:18.984006 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c241f7b0-2e6a-4cfd-91f7-a8023ee97362 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:18.984554 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c241f7b0-2e6a-4cfd-91f7-a8023ee97362 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:19.132499 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c241f7b0-2e6a-4cfd-91f7-a8023ee97362 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdac15c5bdb45048cf00c1f7abc22ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4319e24594eb450aa6aca572265ba4d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:19.140484 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c241f7b0-2e6a-4cfd-91f7-a8023ee97362 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] 10.222.0.20 "GET /compute/v2.1/servers/9c4793cc-6978-4051-a7e3-9536ff67ba7d" status: 200 len: 1535 microversion: 2.1 time: 0.169253 Apr 16 21:27:19.141058 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2700/5232] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:18 2022] GET /compute/v2.1/servers/9c4793cc-6978-4051-a7e3-9536ff67ba7d => generated 1535 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:19.232923 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9c45fb1e-3559-4984-ab03-efb4789d1a8d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:19.233621 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9c45fb1e-3559-4984-ab03-efb4789d1a8d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:19.241422 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9c45fb1e-3559-4984-ab03-efb4789d1a8d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:19.242155 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9c45fb1e-3559-4984-ab03-efb4789d1a8d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:19.243124 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9c45fb1e-3559-4984-ab03-efb4789d1a8d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:19.243571 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9c45fb1e-3559-4984-ab03-efb4789d1a8d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:19.390602 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9c45fb1e-3559-4984-ab03-efb4789d1a8d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:19.398406 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9c45fb1e-3559-4984-ab03-efb4789d1a8d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1" status: 200 len: 1509 microversion: 2.1 time: 0.169672 Apr 16 21:27:19.399245 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2533/5233] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:19 2022] GET /compute/v2.1/servers/b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1 => generated 1509 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:19.416739 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4c0155bf-f0a9-4f2e-81b9-71b643eddff4 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:19.417692 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4c0155bf-f0a9-4f2e-81b9-71b643eddff4 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:19.425040 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4c0155bf-f0a9-4f2e-81b9-71b643eddff4 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:19.425781 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4c0155bf-f0a9-4f2e-81b9-71b643eddff4 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:19.426799 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4c0155bf-f0a9-4f2e-81b9-71b643eddff4 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:19.427257 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4c0155bf-f0a9-4f2e-81b9-71b643eddff4 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:19.673061 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4c0155bf-f0a9-4f2e-81b9-71b643eddff4 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:19.684603 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4c0155bf-f0a9-4f2e-81b9-71b643eddff4 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1" status: 200 len: 1509 microversion: 2.1 time: 0.272563 Apr 16 21:27:19.695994 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5af7ec61-c0da-446a-a736-1bbb3e9b8992 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:19.695994 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5af7ec61-c0da-446a-a736-1bbb3e9b8992 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] [instance: daf189e2-7cb4-4dab-94cf-ffdceb314df7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:19.696596 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2701/5234] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:19 2022] GET /compute/v2.1/servers/b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1 => generated 1509 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:19.701286 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5af7ec61-c0da-446a-a736-1bbb3e9b8992 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:19.701687 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5af7ec61-c0da-446a-a736-1bbb3e9b8992 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:19.710356 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5af7ec61-c0da-446a-a736-1bbb3e9b8992 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:19.711007 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5af7ec61-c0da-446a-a736-1bbb3e9b8992 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:19.711941 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ec2ae123-8af5-4e06-aeb4-ab4c82375cd9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:19.712794 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ec2ae123-8af5-4e06-aeb4-ab4c82375cd9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:19.719872 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ec2ae123-8af5-4e06-aeb4-ab4c82375cd9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:19.722217 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ec2ae123-8af5-4e06-aeb4-ab4c82375cd9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:19.723247 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ec2ae123-8af5-4e06-aeb4-ab4c82375cd9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:19.723862 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ec2ae123-8af5-4e06-aeb4-ab4c82375cd9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:19.729861 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-5af7ec61-c0da-446a-a736-1bbb3e9b8992 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] HTTP exception thrown: Instance daf189e2-7cb4-4dab-94cf-ffdceb314df7 could not be found. Apr 16 21:27:19.730489 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5af7ec61-c0da-446a-a736-1bbb3e9b8992 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] Returning 404 to user: Instance daf189e2-7cb4-4dab-94cf-ffdceb314df7 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:27:19.735363 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5af7ec61-c0da-446a-a736-1bbb3e9b8992 tempest-ServersNegativeTestJSON-1640489356 tempest-ServersNegativeTestJSON-1640489356-project] 10.222.0.20 "GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7" status: 404 len: 111 microversion: 2.1 time: 0.049511 Apr 16 21:27:19.735363 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2534/5235] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:19 2022] GET /compute/v2.1/servers/daf189e2-7cb4-4dab-94cf-ffdceb314df7 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:27:19.751649 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ec2ae123-8af5-4e06-aeb4-ab4c82375cd9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:27:19.846440 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e28292e3-c9c0-43a8-b2ef-6ea85878cfd5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:19.847225 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e28292e3-c9c0-43a8-b2ef-6ea85878cfd5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3704be44-6fc4-4b14-b0c0-eb1388d807a5] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:19.861975 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e28292e3-c9c0-43a8-b2ef-6ea85878cfd5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:19.863980 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e28292e3-c9c0-43a8-b2ef-6ea85878cfd5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:19.863980 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e28292e3-c9c0-43a8-b2ef-6ea85878cfd5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:19.864766 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e28292e3-c9c0-43a8-b2ef-6ea85878cfd5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:19.881344 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-e28292e3-c9c0-43a8-b2ef-6ea85878cfd5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] HTTP exception thrown: Instance 3704be44-6fc4-4b14-b0c0-eb1388d807a5 could not be found. Apr 16 21:27:19.881990 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e28292e3-c9c0-43a8-b2ef-6ea85878cfd5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Returning 404 to user: Instance 3704be44-6fc4-4b14-b0c0-eb1388d807a5 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:27:19.882839 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e28292e3-c9c0-43a8-b2ef-6ea85878cfd5 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5" status: 404 len: 111 microversion: 2.1 time: 0.041233 Apr 16 21:27:19.883394 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2535/5236] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:27:19 2022] DELETE /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:27:19.891285 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f3a1ffc6-5700-45a2-9f20-9b765ddc4a2b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:19.891891 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f3a1ffc6-5700-45a2-9f20-9b765ddc4a2b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 3704be44-6fc4-4b14-b0c0-eb1388d807a5] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:19.898882 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f3a1ffc6-5700-45a2-9f20-9b765ddc4a2b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:19.899473 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f3a1ffc6-5700-45a2-9f20-9b765ddc4a2b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:19.900427 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f3a1ffc6-5700-45a2-9f20-9b765ddc4a2b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:19.901213 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f3a1ffc6-5700-45a2-9f20-9b765ddc4a2b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:19.915867 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-f3a1ffc6-5700-45a2-9f20-9b765ddc4a2b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] HTTP exception thrown: Instance 3704be44-6fc4-4b14-b0c0-eb1388d807a5 could not be found. Apr 16 21:27:19.916624 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f3a1ffc6-5700-45a2-9f20-9b765ddc4a2b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Returning 404 to user: Instance 3704be44-6fc4-4b14-b0c0-eb1388d807a5 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:27:19.917561 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f3a1ffc6-5700-45a2-9f20-9b765ddc4a2b tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5" status: 404 len: 111 microversion: 2.1 time: 0.030140 Apr 16 21:27:19.918254 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2536/5237] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:19 2022] GET /compute/v2.1/servers/3704be44-6fc4-4b14-b0c0-eb1388d807a5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:27:19.927866 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-58342b01-3e7f-4592-8d0e-d8a776bf68f3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:19.927866 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-58342b01-3e7f-4592-8d0e-d8a776bf68f3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 4f303c2c-bb2f-4b3e-8d4f-a21552472a60] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:19.933314 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-58342b01-3e7f-4592-8d0e-d8a776bf68f3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:19.934204 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-58342b01-3e7f-4592-8d0e-d8a776bf68f3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:19.935087 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-58342b01-3e7f-4592-8d0e-d8a776bf68f3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:19.935665 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-58342b01-3e7f-4592-8d0e-d8a776bf68f3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:19.951208 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-58342b01-3e7f-4592-8d0e-d8a776bf68f3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] HTTP exception thrown: Instance 4f303c2c-bb2f-4b3e-8d4f-a21552472a60 could not be found. Apr 16 21:27:19.952019 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-58342b01-3e7f-4592-8d0e-d8a776bf68f3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Returning 404 to user: Instance 4f303c2c-bb2f-4b3e-8d4f-a21552472a60 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:27:19.953101 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-58342b01-3e7f-4592-8d0e-d8a776bf68f3 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4f303c2c-bb2f-4b3e-8d4f-a21552472a60" status: 404 len: 111 microversion: 2.1 time: 0.030791 Apr 16 21:27:19.953783 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2537/5238] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:27:19 2022] DELETE /compute/v2.1/servers/4f303c2c-bb2f-4b3e-8d4f-a21552472a60 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:27:19.966472 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-36469ffa-f50d-47ce-bb03-4b9c0952de80 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:19.967586 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-36469ffa-f50d-47ce-bb03-4b9c0952de80 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] [instance: 4f303c2c-bb2f-4b3e-8d4f-a21552472a60] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:19.982305 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-36469ffa-f50d-47ce-bb03-4b9c0952de80 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:19.982574 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-36469ffa-f50d-47ce-bb03-4b9c0952de80 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:19.983515 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-36469ffa-f50d-47ce-bb03-4b9c0952de80 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:19.984028 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-36469ffa-f50d-47ce-bb03-4b9c0952de80 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:20.003228 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-36469ffa-f50d-47ce-bb03-4b9c0952de80 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] HTTP exception thrown: Instance 4f303c2c-bb2f-4b3e-8d4f-a21552472a60 could not be found. Apr 16 21:27:20.003878 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-36469ffa-f50d-47ce-bb03-4b9c0952de80 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] Returning 404 to user: Instance 4f303c2c-bb2f-4b3e-8d4f-a21552472a60 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:27:20.005116 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-36469ffa-f50d-47ce-bb03-4b9c0952de80 tempest-DeleteServersTestJSON-2058819142 tempest-DeleteServersTestJSON-2058819142-project] 10.222.0.20 "GET /compute/v2.1/servers/4f303c2c-bb2f-4b3e-8d4f-a21552472a60" status: 404 len: 111 microversion: 2.1 time: 0.043226 Apr 16 21:27:20.006257 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2538/5239] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:19 2022] GET /compute/v2.1/servers/4f303c2c-bb2f-4b3e-8d4f-a21552472a60 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:27:20.085276 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-f9769672-1c36-42dd-887d-d61d6bc56544 req-c0cef135-509e-48a8-97c3-dd39631a90eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c4793cc-6978-4051-a7e3-9536ff67ba7d", "name": "network-vif-deleted", "tag": "dacc3b3f-c825-45b9-b755-3714d6cf5d5c"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:27:20.095982 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-f9769672-1c36-42dd-887d-d61d6bc56544 req-c0cef135-509e-48a8-97c3-dd39631a90eb service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:20.096628 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-f9769672-1c36-42dd-887d-d61d6bc56544 req-c0cef135-509e-48a8-97c3-dd39631a90eb service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:20.110252 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-f9769672-1c36-42dd-887d-d61d6bc56544 req-c0cef135-509e-48a8-97c3-dd39631a90eb service nova] Creating event network-vif-deleted:dacc3b3f-c825-45b9-b755-3714d6cf5d5c for instance 9c4793cc-6978-4051-a7e3-9536ff67ba7d on nch2-master-1 Apr 16 21:27:20.115429 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-f9769672-1c36-42dd-887d-d61d6bc56544 req-c0cef135-509e-48a8-97c3-dd39631a90eb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036581 Apr 16 21:27:20.116126 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2539/5240] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:27:20.125122 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ec2ae123-8af5-4e06-aeb4-ab4c82375cd9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1" status: 204 len: 0 microversion: 2.1 time: 0.426917 Apr 16 21:27:20.128256 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2702/5241] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:27:19 2022] DELETE /compute/v2.1/servers/b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:27:20.140648 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-669470a1-4624-402a-b74e-afb49051d82b tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:20.141385 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-669470a1-4624-402a-b74e-afb49051d82b tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:20.151244 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-669470a1-4624-402a-b74e-afb49051d82b tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:20.151760 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-669470a1-4624-402a-b74e-afb49051d82b tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:20.160667 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-432ed63e-1645-4c10-9987-a006f9d6614f tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:20.161631 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-432ed63e-1645-4c10-9987-a006f9d6614f tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] [instance: 9c4793cc-6978-4051-a7e3-9536ff67ba7d] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:20.165676 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-669470a1-4624-402a-b74e-afb49051d82b tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:20.168675 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-669470a1-4624-402a-b74e-afb49051d82b tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:20.175310 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-432ed63e-1645-4c10-9987-a006f9d6614f tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:20.175772 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-432ed63e-1645-4c10-9987-a006f9d6614f tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:20.176698 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-432ed63e-1645-4c10-9987-a006f9d6614f tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:20.177150 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-432ed63e-1645-4c10-9987-a006f9d6614f tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:20.283370 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-432ed63e-1645-4c10-9987-a006f9d6614f tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbdac15c5bdb45048cf00c1f7abc22ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4319e24594eb450aa6aca572265ba4d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:20.295391 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-432ed63e-1645-4c10-9987-a006f9d6614f tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] 10.222.0.20 "GET /compute/v2.1/servers/9c4793cc-6978-4051-a7e3-9536ff67ba7d" status: 200 len: 1493 microversion: 2.1 time: 0.139038 Apr 16 21:27:20.296237 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2703/5242] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:20 2022] GET /compute/v2.1/servers/9c4793cc-6978-4051-a7e3-9536ff67ba7d => generated 1493 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:20.493791 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-669470a1-4624-402a-b74e-afb49051d82b tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:20.502862 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-669470a1-4624-402a-b74e-afb49051d82b tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1" status: 200 len: 1515 microversion: 2.1 time: 0.369438 Apr 16 21:27:20.503678 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2540/5243] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:20 2022] GET /compute/v2.1/servers/b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1 => generated 1515 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:21.314725 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-74c809ba-67d0-4568-8e13-5b6ca9106f19 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:21.319275 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-74c809ba-67d0-4568-8e13-5b6ca9106f19 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] [instance: 9c4793cc-6978-4051-a7e3-9536ff67ba7d] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:21.324268 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-74c809ba-67d0-4568-8e13-5b6ca9106f19 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:21.325359 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-74c809ba-67d0-4568-8e13-5b6ca9106f19 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:21.335420 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-74c809ba-67d0-4568-8e13-5b6ca9106f19 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:21.335420 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-74c809ba-67d0-4568-8e13-5b6ca9106f19 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:21.343101 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-74c809ba-67d0-4568-8e13-5b6ca9106f19 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] HTTP exception thrown: Instance 9c4793cc-6978-4051-a7e3-9536ff67ba7d could not be found. Apr 16 21:27:21.344214 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-74c809ba-67d0-4568-8e13-5b6ca9106f19 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] Returning 404 to user: Instance 9c4793cc-6978-4051-a7e3-9536ff67ba7d could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:27:21.344671 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-74c809ba-67d0-4568-8e13-5b6ca9106f19 tempest-ServersNegativeTestMultiTenantJSON-1056688824 tempest-ServersNegativeTestMultiTenantJSON-1056688824-project] 10.222.0.20 "GET /compute/v2.1/servers/9c4793cc-6978-4051-a7e3-9536ff67ba7d" status: 404 len: 111 microversion: 2.1 time: 0.035670 Apr 16 21:27:21.345859 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2704/5244] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:21 2022] GET /compute/v2.1/servers/9c4793cc-6978-4051-a7e3-9536ff67ba7d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:27:21.522181 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a2449a63-93bf-4a51-96a0-9913bb5eb4fa tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:21.530698 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a2449a63-93bf-4a51-96a0-9913bb5eb4fa tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:21.534276 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a2449a63-93bf-4a51-96a0-9913bb5eb4fa tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:21.535649 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a2449a63-93bf-4a51-96a0-9913bb5eb4fa tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:21.536771 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a2449a63-93bf-4a51-96a0-9913bb5eb4fa tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:21.537457 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a2449a63-93bf-4a51-96a0-9913bb5eb4fa tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:21.864031 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a2449a63-93bf-4a51-96a0-9913bb5eb4fa tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:21.875445 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a2449a63-93bf-4a51-96a0-9913bb5eb4fa tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1" status: 200 len: 1515 microversion: 2.1 time: 0.358311 Apr 16 21:27:21.878098 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2541/5245] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:21 2022] GET /compute/v2.1/servers/b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1 => generated 1515 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:22.472917 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-0ae5c410-cac3-40ab-8915-8153b9ce8ef8 req-ed91c307-39cf-49c8-a0a3-e928c273d867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1", "name": "network-vif-deleted", "tag": "c5d5b748-1ce8-407d-b157-4168cdd02e0f"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:27:22.482859 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-0ae5c410-cac3-40ab-8915-8153b9ce8ef8 req-ed91c307-39cf-49c8-a0a3-e928c273d867 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:22.487122 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-0ae5c410-cac3-40ab-8915-8153b9ce8ef8 req-ed91c307-39cf-49c8-a0a3-e928c273d867 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:22.504078 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-0ae5c410-cac3-40ab-8915-8153b9ce8ef8 req-ed91c307-39cf-49c8-a0a3-e928c273d867 service nova] Creating event network-vif-deleted:c5d5b748-1ce8-407d-b157-4168cdd02e0f for instance b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1 on nch1-master-1 Apr 16 21:27:22.509995 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-0ae5c410-cac3-40ab-8915-8153b9ce8ef8 req-ed91c307-39cf-49c8-a0a3-e928c273d867 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041643 Apr 16 21:27:22.511700 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2705/5246] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:27:22.893527 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2d2e5f79-b4d2-4937-a623-3f64598521d2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:22.894148 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2d2e5f79-b4d2-4937-a623-3f64598521d2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:22.901513 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2d2e5f79-b4d2-4937-a623-3f64598521d2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:22.901976 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2d2e5f79-b4d2-4937-a623-3f64598521d2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:22.902765 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2d2e5f79-b4d2-4937-a623-3f64598521d2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:22.903215 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2d2e5f79-b4d2-4937-a623-3f64598521d2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:22.938458 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2d2e5f79-b4d2-4937-a623-3f64598521d2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:22.939018 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2d2e5f79-b4d2-4937-a623-3f64598521d2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:22.939490 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-2d2e5f79-b4d2-4937-a623-3f64598521d2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lazy-loading 'fault' on Instance uuid b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:27:22.999922 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2d2e5f79-b4d2-4937-a623-3f64598521d2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:23.009563 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2d2e5f79-b4d2-4937-a623-3f64598521d2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1" status: 200 len: 1317 microversion: 2.1 time: 0.120343 Apr 16 21:27:23.016267 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2542/5247] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:22 2022] GET /compute/v2.1/servers/b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1 => generated 1317 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:23.297356 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b81eebe3-ef7b-40ed-b785-ad37b820b997 tempest-QuotasTestJSON-1361990898 tempest-QuotasTestJSON-1361990898-project] Calling method '.version_select at 0x7fbb9594cd30>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:23.759594 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b81eebe3-ef7b-40ed-b785-ad37b820b997 tempest-QuotasTestJSON-1361990898 tempest-QuotasTestJSON-1361990898-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/f621db25b47c42dc9891d373b3d33f70/defaults" status: 200 len: 371 microversion: 2.1 time: 0.629968 Apr 16 21:27:23.760386 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2706/5248] 10.222.0.20 () {58 vars in 1268 bytes} [Sat Apr 16 21:27:23 2022] GET /compute/v2.1/os-quota-sets/f621db25b47c42dc9891d373b3d33f70/defaults => generated 371 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:27:23.771244 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f76daa47-6670-460c-8bbb-e3d40f6d6140 tempest-QuotasTestJSON-1361990898 tempest-QuotasTestJSON-1361990898-project] Calling method '.version_select at 0x7fbb964c1940>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:23.908341 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f76daa47-6670-460c-8bbb-e3d40f6d6140 tempest-QuotasTestJSON-1361990898 tempest-QuotasTestJSON-1361990898-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/f621db25b47c42dc9891d373b3d33f70" status: 200 len: 371 microversion: 2.1 time: 0.141459 Apr 16 21:27:23.909378 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2543/5249] 10.222.0.20 () {58 vars in 1241 bytes} [Sat Apr 16 21:27:23 2022] GET /compute/v2.1/os-quota-sets/f621db25b47c42dc9891d373b3d33f70 => generated 371 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:27:23.921101 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3bbf1a6c-396a-4afd-854c-ad00f935f5a3 tempest-QuotasTestJSON-1361990898 tempest-QuotasTestJSON-1361990898-project] Calling method '.version_select at 0x7fbb959b5280>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:23.984812 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3bbf1a6c-396a-4afd-854c-ad00f935f5a3 tempest-QuotasTestJSON-1361990898 tempest-QuotasTestJSON-1361990898-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/f621db25b47c42dc9891d373b3d33f70/defaults" status: 200 len: 371 microversion: 2.1 time: 0.067554 Apr 16 21:27:23.985414 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2707/5250] 10.222.0.20 () {58 vars in 1268 bytes} [Sat Apr 16 21:27:23 2022] GET /compute/v2.1/os-quota-sets/f621db25b47c42dc9891d373b3d33f70/defaults => generated 371 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:27:23.997754 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0f206f77-80f2-41f5-9514-fe4907d8415a tempest-QuotasTestJSON-1361990898 tempest-QuotasTestJSON-1361990898-project] Calling method '.version_select at 0x7fbb96570790>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:24.028060 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6f013653-9dd0-4972-9cb1-c22686d03d5c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:24.028804 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6f013653-9dd0-4972-9cb1-c22686d03d5c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:24.036335 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6f013653-9dd0-4972-9cb1-c22686d03d5c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:24.036875 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6f013653-9dd0-4972-9cb1-c22686d03d5c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:24.037742 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6f013653-9dd0-4972-9cb1-c22686d03d5c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:24.038385 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6f013653-9dd0-4972-9cb1-c22686d03d5c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:24.053549 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-6f013653-9dd0-4972-9cb1-c22686d03d5c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] HTTP exception thrown: Instance b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1 could not be found. Apr 16 21:27:24.054332 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6f013653-9dd0-4972-9cb1-c22686d03d5c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Returning 404 to user: Instance b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:27:24.055248 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6f013653-9dd0-4972-9cb1-c22686d03d5c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1" status: 404 len: 111 microversion: 2.1 time: 0.032189 Apr 16 21:27:24.059693 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2708/5251] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:24 2022] GET /compute/v2.1/servers/b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:27:24.065464 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-36fb55fb-58d3-4f38-8179-2fa5b48434f4 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '.version_select at 0x7fbb95a5ea60>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:24.152970 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-36fb55fb-58d3-4f38-8179-2fa5b48434f4 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-key-2027983942" status: 202 len: 0 microversion: 2.1 time: 0.091544 Apr 16 21:27:24.166243 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2709/5252] 10.222.0.20 () {58 vars in 1208 bytes} [Sat Apr 16 21:27:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-2027983942 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:27:24.209742 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0f206f77-80f2-41f5-9514-fe4907d8415a tempest-QuotasTestJSON-1361990898 tempest-QuotasTestJSON-1361990898-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/f621db25b47c42dc9891d373b3d33f70" status: 200 len: 371 microversion: 2.1 time: 0.215784 Apr 16 21:27:24.210334 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2544/5253] 10.222.0.20 () {58 vars in 1241 bytes} [Sat Apr 16 21:27:23 2022] GET /compute/v2.1/os-quota-sets/f621db25b47c42dc9891d373b3d33f70 => generated 371 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:27:24.222333 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-78e941b4-1304-47a0-ae4b-a436a87c1fed tempest-QuotasTestJSON-1361990898 tempest-QuotasTestJSON-1361990898-project] Calling method '.version_select at 0x7fbb959849d0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:24.287885 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-363f743a-4004-41bb-aa8a-c99a29fde7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1867966518", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "8f593006-a7a9-4abc-8409-1d78959e9c9f"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:27:24.346118 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-363f743a-4004-41bb-aa8a-c99a29fde7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] validate_networks() for [('8f593006-a7a9-4abc-8409-1d78959e9c9f', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:27:24.372843 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-78e941b4-1304-47a0-ae4b-a436a87c1fed tempest-QuotasTestJSON-1361990898 tempest-QuotasTestJSON-1361990898-project] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/f621db25b47c42dc9891d373b3d33f70?user_id=8b163cf45eb6468ea133a82e94bf52b3" status: 200 len: 371 microversion: 2.1 time: 0.155159 Apr 16 21:27:24.376993 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2710/5254] 10.222.0.20 () {58 vars in 1322 bytes} [Sat Apr 16 21:27:24 2022] GET /compute/v2.1/os-quota-sets/f621db25b47c42dc9891d373b3d33f70?user_id=8b163cf45eb6468ea133a82e94bf52b3 => generated 371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:27:24.782479 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-363f743a-4004-41bb-aa8a-c99a29fde7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:27:24.783657 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-363f743a-4004-41bb-aa8a-c99a29fde7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:27:24.784281 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-363f743a-4004-41bb-aa8a-c99a29fde7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:27:24.784866 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-363f743a-4004-41bb-aa8a-c99a29fde7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:27:24.785272 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-363f743a-4004-41bb-aa8a-c99a29fde7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:27:24.795014 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-363f743a-4004-41bb-aa8a-c99a29fde7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:24.798429 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-363f743a-4004-41bb-aa8a-c99a29fde7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:24.798429 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-363f743a-4004-41bb-aa8a-c99a29fde7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:24.798429 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-363f743a-4004-41bb-aa8a-c99a29fde7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:24.815290 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-363f743a-4004-41bb-aa8a-c99a29fde7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Getting quotas for project 76fd883ad3944fcaaecdf2909120dc87. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:27:24.820509 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-363f743a-4004-41bb-aa8a-c99a29fde7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Getting quotas for user 5e71b35f438d4539a60a390e1ceec9cd and project 76fd883ad3944fcaaecdf2909120dc87. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:27:24.839413 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-363f743a-4004-41bb-aa8a-c99a29fde7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:27:24.839413 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-363f743a-4004-41bb-aa8a-c99a29fde7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 5fee6363-9586-45b0-b643-e6dbd4652c80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:27:24.977935 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-363f743a-4004-41bb-aa8a-c99a29fde7e5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.695223 Apr 16 21:27:24.978803 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2545/5255] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:27:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 16 21:27:24.988722 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-56081ab1-dfc6-49b8-8143-af6cdde15a48 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:24.989344 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-56081ab1-dfc6-49b8-8143-af6cdde15a48 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 5fee6363-9586-45b0-b643-e6dbd4652c80] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:25.096280 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-56081ab1-dfc6-49b8-8143-af6cdde15a48 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:25.115554 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-56081ab1-dfc6-49b8-8143-af6cdde15a48 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/5fee6363-9586-45b0-b643-e6dbd4652c80" status: 200 len: 1209 microversion: 2.1 time: 0.122816 Apr 16 21:27:25.115554 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2711/5256] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:24 2022] GET /compute/v2.1/servers/5fee6363-9586-45b0-b643-e6dbd4652c80 => generated 1209 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:25.542538 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-33f718e5-71e9-4fe5-a08e-ece835c7075a tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-962478275", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "bc16800e-501c-4c30-be2d-29837ac4ee47"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:27:25.608581 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-33f718e5-71e9-4fe5-a08e-ece835c7075a tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] validate_networks() for [('bc16800e-501c-4c30-be2d-29837ac4ee47', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:27:26.103063 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-33f718e5-71e9-4fe5-a08e-ece835c7075a tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:27:26.103063 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-33f718e5-71e9-4fe5-a08e-ece835c7075a tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:27:26.103063 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-33f718e5-71e9-4fe5-a08e-ece835c7075a tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:27:26.103063 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-33f718e5-71e9-4fe5-a08e-ece835c7075a tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:27:26.103063 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-33f718e5-71e9-4fe5-a08e-ece835c7075a tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:27:26.118817 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-33f718e5-71e9-4fe5-a08e-ece835c7075a tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:26.119347 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-33f718e5-71e9-4fe5-a08e-ece835c7075a tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:26.124561 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-33f718e5-71e9-4fe5-a08e-ece835c7075a tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:26.125053 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-33f718e5-71e9-4fe5-a08e-ece835c7075a tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:26.126762 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7748b922-df13-4d1a-b629-4a3f7f4a6194 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:26.127897 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7748b922-df13-4d1a-b629-4a3f7f4a6194 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 5fee6363-9586-45b0-b643-e6dbd4652c80] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:26.141402 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7748b922-df13-4d1a-b629-4a3f7f4a6194 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:26.141402 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7748b922-df13-4d1a-b629-4a3f7f4a6194 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:26.143477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7748b922-df13-4d1a-b629-4a3f7f4a6194 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:26.143925 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7748b922-df13-4d1a-b629-4a3f7f4a6194 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:26.178912 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-33f718e5-71e9-4fe5-a08e-ece835c7075a tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Getting quotas for project 17dfe7c4a9684f7ea504997e112332f2. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:27:26.191421 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-33f718e5-71e9-4fe5-a08e-ece835c7075a tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Getting quotas for user 2a94f7988611413eae6103ea7d3ea293 and project 17dfe7c4a9684f7ea504997e112332f2. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:27:26.210898 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-33f718e5-71e9-4fe5-a08e-ece835c7075a tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:27:26.213777 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-33f718e5-71e9-4fe5-a08e-ece835c7075a tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] [instance: 09abc551-a98f-4553-b387-ec23b28a2190] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:27:26.253092 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7748b922-df13-4d1a-b629-4a3f7f4a6194 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:26.253530 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7748b922-df13-4d1a-b629-4a3f7f4a6194 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/5fee6363-9586-45b0-b643-e6dbd4652c80" status: 200 len: 1213 microversion: 2.1 time: 0.130906 Apr 16 21:27:26.254207 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2712/5257] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:26 2022] GET /compute/v2.1/servers/5fee6363-9586-45b0-b643-e6dbd4652c80 => generated 1213 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:26.423504 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-33f718e5-71e9-4fe5-a08e-ece835c7075a tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.028687 Apr 16 21:27:26.423504 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2546/5258] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:27:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1031 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:27:26.428461 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-696a7904-1153-4dc3-bf07-266263d0e533 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:26.429091 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-696a7904-1153-4dc3-bf07-266263d0e533 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] [instance: 09abc551-a98f-4553-b387-ec23b28a2190] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:26.530810 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-696a7904-1153-4dc3-bf07-266263d0e533 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a94f7988611413eae6103ea7d3ea293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dfe7c4a9684f7ea504997e112332f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:26.539001 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-696a7904-1153-4dc3-bf07-266263d0e533 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] 10.222.0.20 "GET /compute/v2.1/servers/09abc551-a98f-4553-b387-ec23b28a2190" status: 200 len: 1216 microversion: 2.1 time: 0.114584 Apr 16 21:27:26.542095 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2713/5259] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:26 2022] GET /compute/v2.1/servers/09abc551-a98f-4553-b387-ec23b28a2190 => generated 1216 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:26.723391 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cae83ce9-c868-430c-971f-fa4ad8676dba tempest-ExtensionsTest-610326169 tempest-ExtensionsTest-610326169-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:26.725139 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cae83ce9-c868-430c-971f-fa4ad8676dba tempest-ExtensionsTest-610326169 tempest-ExtensionsTest-610326169-project] 10.222.0.20 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.148042 Apr 16 21:27:26.725683 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2547/5260] 10.222.0.20 () {58 vars in 1169 bytes} [Sat Apr 16 21:27:26 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:27:26.735898 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-82f6d352-7f09-4066-bb97-3e016389b513 tempest-ExtensionsTest-610326169 tempest-ExtensionsTest-610326169-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:26.738212 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-82f6d352-7f09-4066-bb97-3e016389b513 tempest-ExtensionsTest-610326169 tempest-ExtensionsTest-610326169-project] 10.222.0.20 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.006369 Apr 16 21:27:26.739257 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2714/5261] 10.222.0.20 () {58 vars in 1133 bytes} [Sat Apr 16 21:27:26 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:27:27.273179 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ac2303ff-d476-4288-933d-4f22d3bde482 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:27.274410 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ac2303ff-d476-4288-933d-4f22d3bde482 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 5fee6363-9586-45b0-b643-e6dbd4652c80] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:27.281431 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ac2303ff-d476-4288-933d-4f22d3bde482 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:27.282140 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ac2303ff-d476-4288-933d-4f22d3bde482 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:27.283151 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ac2303ff-d476-4288-933d-4f22d3bde482 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:27.283788 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ac2303ff-d476-4288-933d-4f22d3bde482 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:27.394448 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ac2303ff-d476-4288-933d-4f22d3bde482 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:27.407417 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ac2303ff-d476-4288-933d-4f22d3bde482 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/5fee6363-9586-45b0-b643-e6dbd4652c80" status: 200 len: 1269 microversion: 2.1 time: 0.137642 Apr 16 21:27:27.408746 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2548/5262] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:27 2022] GET /compute/v2.1/servers/5fee6363-9586-45b0-b643-e6dbd4652c80 => generated 1269 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:27.560202 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6233db8a-c1e8-404f-9818-75b3115d24ac tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:27.561035 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6233db8a-c1e8-404f-9818-75b3115d24ac tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] [instance: 09abc551-a98f-4553-b387-ec23b28a2190] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:27.664190 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6233db8a-c1e8-404f-9818-75b3115d24ac tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a94f7988611413eae6103ea7d3ea293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dfe7c4a9684f7ea504997e112332f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:27.672132 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6233db8a-c1e8-404f-9818-75b3115d24ac tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] 10.222.0.20 "GET /compute/v2.1/servers/09abc551-a98f-4553-b387-ec23b28a2190" status: 200 len: 1216 microversion: 2.1 time: 0.117550 Apr 16 21:27:27.683372 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2715/5263] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:27 2022] GET /compute/v2.1/servers/09abc551-a98f-4553-b387-ec23b28a2190 => generated 1216 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:28.427306 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-47327143-4cdb-4bda-85c5-09338952de8d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:28.427770 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-47327143-4cdb-4bda-85c5-09338952de8d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 5fee6363-9586-45b0-b643-e6dbd4652c80] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:28.435021 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-47327143-4cdb-4bda-85c5-09338952de8d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:28.435714 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-47327143-4cdb-4bda-85c5-09338952de8d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:28.437593 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-47327143-4cdb-4bda-85c5-09338952de8d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:28.438230 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-47327143-4cdb-4bda-85c5-09338952de8d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:28.659157 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-47327143-4cdb-4bda-85c5-09338952de8d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:28.667801 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-47327143-4cdb-4bda-85c5-09338952de8d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/5fee6363-9586-45b0-b643-e6dbd4652c80" status: 200 len: 1309 microversion: 2.1 time: 0.244828 Apr 16 21:27:28.679101 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2549/5264] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:28 2022] GET /compute/v2.1/servers/5fee6363-9586-45b0-b643-e6dbd4652c80 => generated 1309 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:28.691602 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f5d6b384-388d-4796-8dc8-02c5f0c8e1be tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:28.692201 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f5d6b384-388d-4796-8dc8-02c5f0c8e1be tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] [instance: 09abc551-a98f-4553-b387-ec23b28a2190] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:28.701612 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f5d6b384-388d-4796-8dc8-02c5f0c8e1be tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:28.701862 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f5d6b384-388d-4796-8dc8-02c5f0c8e1be tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:28.702870 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f5d6b384-388d-4796-8dc8-02c5f0c8e1be tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:28.703605 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f5d6b384-388d-4796-8dc8-02c5f0c8e1be tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:28.777371 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f5d6b384-388d-4796-8dc8-02c5f0c8e1be tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a94f7988611413eae6103ea7d3ea293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dfe7c4a9684f7ea504997e112332f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:28.785670 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f5d6b384-388d-4796-8dc8-02c5f0c8e1be tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] 10.222.0.20 "GET /compute/v2.1/servers/09abc551-a98f-4553-b387-ec23b28a2190" status: 200 len: 1268 microversion: 2.1 time: 0.098637 Apr 16 21:27:28.788328 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2716/5265] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:28 2022] GET /compute/v2.1/servers/09abc551-a98f-4553-b387-ec23b28a2190 => generated 1268 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:29.686433 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-df45f1ef-b5fa-4ee8-bdd3-e83af04e177c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:29.687826 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-df45f1ef-b5fa-4ee8-bdd3-e83af04e177c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 5fee6363-9586-45b0-b643-e6dbd4652c80] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:29.705523 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-df45f1ef-b5fa-4ee8-bdd3-e83af04e177c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:29.706516 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-df45f1ef-b5fa-4ee8-bdd3-e83af04e177c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:29.707877 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-df45f1ef-b5fa-4ee8-bdd3-e83af04e177c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:29.709609 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-df45f1ef-b5fa-4ee8-bdd3-e83af04e177c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:29.822421 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-76501037-8774-474f-afcd-6ca017a6a6af tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:29.823686 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-76501037-8774-474f-afcd-6ca017a6a6af tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] [instance: 09abc551-a98f-4553-b387-ec23b28a2190] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:29.836025 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-76501037-8774-474f-afcd-6ca017a6a6af tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:29.836894 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-76501037-8774-474f-afcd-6ca017a6a6af tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:29.838361 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-76501037-8774-474f-afcd-6ca017a6a6af tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:29.839201 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-76501037-8774-474f-afcd-6ca017a6a6af tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:29.910851 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-76501037-8774-474f-afcd-6ca017a6a6af tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a94f7988611413eae6103ea7d3ea293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dfe7c4a9684f7ea504997e112332f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:29.920751 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-76501037-8774-474f-afcd-6ca017a6a6af tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] 10.222.0.20 "GET /compute/v2.1/servers/09abc551-a98f-4553-b387-ec23b28a2190" status: 200 len: 1274 microversion: 2.1 time: 0.120996 Apr 16 21:27:29.922004 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2717/5266] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:29 2022] GET /compute/v2.1/servers/09abc551-a98f-4553-b387-ec23b28a2190 => generated 1274 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:30.031087 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-df45f1ef-b5fa-4ee8-bdd3-e83af04e177c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:30.041050 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-df45f1ef-b5fa-4ee8-bdd3-e83af04e177c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/5fee6363-9586-45b0-b643-e6dbd4652c80" status: 200 len: 1309 microversion: 2.1 time: 0.359120 Apr 16 21:27:30.042126 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2550/5267] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:29 2022] GET /compute/v2.1/servers/5fee6363-9586-45b0-b643-e6dbd4652c80 => generated 1309 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:30.171541 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-065d5100-64cb-4b5b-9706-fb37a871a5ad req-471b3a42-3ba1-4020-82fb-25323eb4a9ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fee6363-9586-45b0-b643-e6dbd4652c80", "tag": "d10ac50b-d5ee-49cc-85a7-303e299725ee"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:27:30.180065 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-065d5100-64cb-4b5b-9706-fb37a871a5ad req-471b3a42-3ba1-4020-82fb-25323eb4a9ac service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:30.180567 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-065d5100-64cb-4b5b-9706-fb37a871a5ad req-471b3a42-3ba1-4020-82fb-25323eb4a9ac service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:30.192085 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-065d5100-64cb-4b5b-9706-fb37a871a5ad req-471b3a42-3ba1-4020-82fb-25323eb4a9ac service nova] Creating event network-changed:d10ac50b-d5ee-49cc-85a7-303e299725ee for instance 5fee6363-9586-45b0-b643-e6dbd4652c80 on nch1-master-1 Apr 16 21:27:30.196789 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-065d5100-64cb-4b5b-9706-fb37a871a5ad req-471b3a42-3ba1-4020-82fb-25323eb4a9ac service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028850 Apr 16 21:27:30.197730 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2718/5268] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:27:30.940059 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4d6bc29e-be26-4cfc-a491-d5d7b401c0f7 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:30.942472 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4d6bc29e-be26-4cfc-a491-d5d7b401c0f7 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] [instance: 09abc551-a98f-4553-b387-ec23b28a2190] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:30.950906 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4d6bc29e-be26-4cfc-a491-d5d7b401c0f7 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:30.951970 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4d6bc29e-be26-4cfc-a491-d5d7b401c0f7 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:30.953512 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4d6bc29e-be26-4cfc-a491-d5d7b401c0f7 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:30.955202 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4d6bc29e-be26-4cfc-a491-d5d7b401c0f7 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:31.061034 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-18a87c16-0ddb-45f3-8f93-341754b61eca tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:31.062020 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-18a87c16-0ddb-45f3-8f93-341754b61eca tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 5fee6363-9586-45b0-b643-e6dbd4652c80] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:31.068854 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-18a87c16-0ddb-45f3-8f93-341754b61eca tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:31.069439 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-18a87c16-0ddb-45f3-8f93-341754b61eca tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:31.070351 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-18a87c16-0ddb-45f3-8f93-341754b61eca tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:31.070907 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-18a87c16-0ddb-45f3-8f93-341754b61eca tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:31.202179 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4d6bc29e-be26-4cfc-a491-d5d7b401c0f7 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a94f7988611413eae6103ea7d3ea293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dfe7c4a9684f7ea504997e112332f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:31.210779 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4d6bc29e-be26-4cfc-a491-d5d7b401c0f7 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] 10.222.0.20 "GET /compute/v2.1/servers/09abc551-a98f-4553-b387-ec23b28a2190" status: 200 len: 1316 microversion: 2.1 time: 0.276138 Apr 16 21:27:31.211875 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2551/5269] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:30 2022] GET /compute/v2.1/servers/09abc551-a98f-4553-b387-ec23b28a2190 => generated 1316 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:31.253230 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-18a87c16-0ddb-45f3-8f93-341754b61eca tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:31.263927 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-18a87c16-0ddb-45f3-8f93-341754b61eca tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/5fee6363-9586-45b0-b643-e6dbd4652c80" status: 200 len: 1309 microversion: 2.1 time: 0.207965 Apr 16 21:27:31.264127 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2719/5270] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:31 2022] GET /compute/v2.1/servers/5fee6363-9586-45b0-b643-e6dbd4652c80 => generated 1309 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:32.211178 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-f8e309db-d86c-490a-92a6-c8ca66952392 req-a9b08d7e-86ec-4013-9bcd-05c1baeb205c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09abc551-a98f-4553-b387-ec23b28a2190", "tag": "71c9c3c9-4777-41ba-ac3e-634279e5bec9"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:27:32.219846 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-f8e309db-d86c-490a-92a6-c8ca66952392 req-a9b08d7e-86ec-4013-9bcd-05c1baeb205c service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:32.220871 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-f8e309db-d86c-490a-92a6-c8ca66952392 req-a9b08d7e-86ec-4013-9bcd-05c1baeb205c service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:32.227941 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-90624051-bce4-4c25-add9-39540b35faeb tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:32.228741 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-90624051-bce4-4c25-add9-39540b35faeb tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] [instance: 09abc551-a98f-4553-b387-ec23b28a2190] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:32.231837 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-f8e309db-d86c-490a-92a6-c8ca66952392 req-a9b08d7e-86ec-4013-9bcd-05c1baeb205c service nova] Creating event network-changed:71c9c3c9-4777-41ba-ac3e-634279e5bec9 for instance 09abc551-a98f-4553-b387-ec23b28a2190 on nch1-master-1 Apr 16 21:27:32.237006 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-90624051-bce4-4c25-add9-39540b35faeb tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:32.237420 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-f8e309db-d86c-490a-92a6-c8ca66952392 req-a9b08d7e-86ec-4013-9bcd-05c1baeb205c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029862 Apr 16 21:27:32.237616 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-90624051-bce4-4c25-add9-39540b35faeb tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:32.238360 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2552/5271] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:27:32.238601 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-90624051-bce4-4c25-add9-39540b35faeb tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:32.239056 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-90624051-bce4-4c25-add9-39540b35faeb tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:32.286896 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b62fa13c-84d1-447a-8bab-6430d1aa328d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:32.288465 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b62fa13c-84d1-447a-8bab-6430d1aa328d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 5fee6363-9586-45b0-b643-e6dbd4652c80] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:32.297977 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b62fa13c-84d1-447a-8bab-6430d1aa328d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:32.297977 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b62fa13c-84d1-447a-8bab-6430d1aa328d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:32.297977 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b62fa13c-84d1-447a-8bab-6430d1aa328d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:32.297977 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b62fa13c-84d1-447a-8bab-6430d1aa328d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:32.404569 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-90624051-bce4-4c25-add9-39540b35faeb tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a94f7988611413eae6103ea7d3ea293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dfe7c4a9684f7ea504997e112332f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:32.412780 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-90624051-bce4-4c25-add9-39540b35faeb tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] 10.222.0.20 "GET /compute/v2.1/servers/09abc551-a98f-4553-b387-ec23b28a2190" status: 200 len: 1316 microversion: 2.1 time: 0.188606 Apr 16 21:27:32.413600 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2720/5272] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:32 2022] GET /compute/v2.1/servers/09abc551-a98f-4553-b387-ec23b28a2190 => generated 1316 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:27:32.543194 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b62fa13c-84d1-447a-8bab-6430d1aa328d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:32.552292 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b62fa13c-84d1-447a-8bab-6430d1aa328d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/5fee6363-9586-45b0-b643-e6dbd4652c80" status: 200 len: 1309 microversion: 2.1 time: 0.275147 Apr 16 21:27:32.561904 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2553/5273] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:32 2022] GET /compute/v2.1/servers/5fee6363-9586-45b0-b643-e6dbd4652c80 => generated 1309 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:27:33.434770 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0da891b7-017c-4a71-a411-2dfa140de20d tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:33.437106 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0da891b7-017c-4a71-a411-2dfa140de20d tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] [instance: 09abc551-a98f-4553-b387-ec23b28a2190] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:33.447564 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0da891b7-017c-4a71-a411-2dfa140de20d tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:33.449270 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0da891b7-017c-4a71-a411-2dfa140de20d tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:33.449270 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0da891b7-017c-4a71-a411-2dfa140de20d tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:33.449738 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0da891b7-017c-4a71-a411-2dfa140de20d tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:33.570195 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7f4854f2-4a90-4424-9106-76bd1d4462db tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:33.571945 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7f4854f2-4a90-4424-9106-76bd1d4462db tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 5fee6363-9586-45b0-b643-e6dbd4652c80] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:33.579222 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7f4854f2-4a90-4424-9106-76bd1d4462db tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:33.580050 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7f4854f2-4a90-4424-9106-76bd1d4462db tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:33.581181 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7f4854f2-4a90-4424-9106-76bd1d4462db tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:33.581912 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7f4854f2-4a90-4424-9106-76bd1d4462db tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:33.628265 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0da891b7-017c-4a71-a411-2dfa140de20d tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a94f7988611413eae6103ea7d3ea293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dfe7c4a9684f7ea504997e112332f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:33.636533 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0da891b7-017c-4a71-a411-2dfa140de20d tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] 10.222.0.20 "GET /compute/v2.1/servers/09abc551-a98f-4553-b387-ec23b28a2190" status: 200 len: 1316 microversion: 2.1 time: 0.209365 Apr 16 21:27:33.637868 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2721/5274] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:33 2022] GET /compute/v2.1/servers/09abc551-a98f-4553-b387-ec23b28a2190 => generated 1316 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:33.729282 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7f4854f2-4a90-4424-9106-76bd1d4462db tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:33.737395 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7f4854f2-4a90-4424-9106-76bd1d4462db tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/5fee6363-9586-45b0-b643-e6dbd4652c80" status: 200 len: 1309 microversion: 2.1 time: 0.171455 Apr 16 21:27:33.737819 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2554/5275] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:33 2022] GET /compute/v2.1/servers/5fee6363-9586-45b0-b643-e6dbd4652c80 => generated 1309 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:34.654826 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7cb34daa-fb9b-4f1b-b549-72b5e4b2167c tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:34.655371 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7cb34daa-fb9b-4f1b-b549-72b5e4b2167c tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] [instance: 09abc551-a98f-4553-b387-ec23b28a2190] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:34.662475 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7cb34daa-fb9b-4f1b-b549-72b5e4b2167c tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:34.662968 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7cb34daa-fb9b-4f1b-b549-72b5e4b2167c tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:34.663752 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7cb34daa-fb9b-4f1b-b549-72b5e4b2167c tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:34.664231 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7cb34daa-fb9b-4f1b-b549-72b5e4b2167c tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:34.756635 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-229497ee-3a14-44c8-9719-06016824f0dd tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:34.757263 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-229497ee-3a14-44c8-9719-06016824f0dd tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 5fee6363-9586-45b0-b643-e6dbd4652c80] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:34.767325 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-229497ee-3a14-44c8-9719-06016824f0dd tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:34.767481 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-229497ee-3a14-44c8-9719-06016824f0dd tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:34.768392 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-229497ee-3a14-44c8-9719-06016824f0dd tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:34.768859 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-229497ee-3a14-44c8-9719-06016824f0dd tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:34.820490 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7cb34daa-fb9b-4f1b-b549-72b5e4b2167c tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a94f7988611413eae6103ea7d3ea293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dfe7c4a9684f7ea504997e112332f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:34.828911 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7cb34daa-fb9b-4f1b-b549-72b5e4b2167c tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] 10.222.0.20 "GET /compute/v2.1/servers/09abc551-a98f-4553-b387-ec23b28a2190" status: 200 len: 1316 microversion: 2.1 time: 0.178295 Apr 16 21:27:34.829537 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2722/5276] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:34 2022] GET /compute/v2.1/servers/09abc551-a98f-4553-b387-ec23b28a2190 => generated 1316 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:34.968703 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-229497ee-3a14-44c8-9719-06016824f0dd tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:34.979543 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-229497ee-3a14-44c8-9719-06016824f0dd tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/5fee6363-9586-45b0-b643-e6dbd4652c80" status: 200 len: 1309 microversion: 2.1 time: 0.228705 Apr 16 21:27:34.980235 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2555/5277] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:34 2022] GET /compute/v2.1/servers/5fee6363-9586-45b0-b643-e6dbd4652c80 => generated 1309 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:27:35.823526 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-04562ecd-1ca2-4b97-b156-05e07d451801 req-b4a11d10-51fa-4d2c-84d4-8599f0dd1e21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fee6363-9586-45b0-b643-e6dbd4652c80", "name": "network-vif-plugged", "status": "completed", "tag": "d10ac50b-d5ee-49cc-85a7-303e299725ee"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:27:35.833380 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-04562ecd-1ca2-4b97-b156-05e07d451801 req-b4a11d10-51fa-4d2c-84d4-8599f0dd1e21 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:35.833849 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-04562ecd-1ca2-4b97-b156-05e07d451801 req-b4a11d10-51fa-4d2c-84d4-8599f0dd1e21 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:35.845950 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-04562ecd-1ca2-4b97-b156-05e07d451801 req-b4a11d10-51fa-4d2c-84d4-8599f0dd1e21 service nova] Creating event network-vif-plugged:d10ac50b-d5ee-49cc-85a7-303e299725ee for instance 5fee6363-9586-45b0-b643-e6dbd4652c80 on nch1-master-1 Apr 16 21:27:35.846996 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7e4fe40f-def4-4577-a358-d74c01fe3619 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:35.848671 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7e4fe40f-def4-4577-a358-d74c01fe3619 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] [instance: 09abc551-a98f-4553-b387-ec23b28a2190] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:35.852324 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-04562ecd-1ca2-4b97-b156-05e07d451801 req-b4a11d10-51fa-4d2c-84d4-8599f0dd1e21 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032358 Apr 16 21:27:35.853514 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2723/5278] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:27:35.857635 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7e4fe40f-def4-4577-a358-d74c01fe3619 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:35.858108 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7e4fe40f-def4-4577-a358-d74c01fe3619 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:35.859217 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7e4fe40f-def4-4577-a358-d74c01fe3619 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:35.860324 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7e4fe40f-def4-4577-a358-d74c01fe3619 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:36.009233 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4cc278f7-172f-42f6-947f-1e79c08c0668 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:36.010000 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4cc278f7-172f-42f6-947f-1e79c08c0668 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 5fee6363-9586-45b0-b643-e6dbd4652c80] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:36.031331 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4cc278f7-172f-42f6-947f-1e79c08c0668 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:36.036891 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4cc278f7-172f-42f6-947f-1e79c08c0668 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:36.037778 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4cc278f7-172f-42f6-947f-1e79c08c0668 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:36.038232 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4cc278f7-172f-42f6-947f-1e79c08c0668 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:36.121643 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7e4fe40f-def4-4577-a358-d74c01fe3619 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a94f7988611413eae6103ea7d3ea293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dfe7c4a9684f7ea504997e112332f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:36.130238 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7e4fe40f-def4-4577-a358-d74c01fe3619 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] 10.222.0.20 "GET /compute/v2.1/servers/09abc551-a98f-4553-b387-ec23b28a2190" status: 200 len: 1316 microversion: 2.1 time: 0.288179 Apr 16 21:27:36.131646 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2556/5279] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:35 2022] GET /compute/v2.1/servers/09abc551-a98f-4553-b387-ec23b28a2190 => generated 1316 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:27:36.207732 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4cc278f7-172f-42f6-947f-1e79c08c0668 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:36.219300 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4cc278f7-172f-42f6-947f-1e79c08c0668 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/5fee6363-9586-45b0-b643-e6dbd4652c80" status: 200 len: 1309 microversion: 2.1 time: 0.222644 Apr 16 21:27:36.221033 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2724/5280] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:35 2022] GET /compute/v2.1/servers/5fee6363-9586-45b0-b643-e6dbd4652c80 => generated 1309 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:37.148610 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-da2071c3-f84b-4a19-b872-273b419b8efe tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:37.149229 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-da2071c3-f84b-4a19-b872-273b419b8efe tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] [instance: 09abc551-a98f-4553-b387-ec23b28a2190] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:37.156892 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-da2071c3-f84b-4a19-b872-273b419b8efe tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:37.157877 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-da2071c3-f84b-4a19-b872-273b419b8efe tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:37.158671 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-da2071c3-f84b-4a19-b872-273b419b8efe tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:37.159116 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-da2071c3-f84b-4a19-b872-273b419b8efe tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:37.240101 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-11f1c37d-d9e5-4ece-ac5d-59c5a19bd8d0 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:37.241872 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-11f1c37d-d9e5-4ece-ac5d-59c5a19bd8d0 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 5fee6363-9586-45b0-b643-e6dbd4652c80] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:37.248939 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-11f1c37d-d9e5-4ece-ac5d-59c5a19bd8d0 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:37.249625 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-11f1c37d-d9e5-4ece-ac5d-59c5a19bd8d0 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:37.255008 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-11f1c37d-d9e5-4ece-ac5d-59c5a19bd8d0 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:37.255008 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-11f1c37d-d9e5-4ece-ac5d-59c5a19bd8d0 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:37.321101 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-da2071c3-f84b-4a19-b872-273b419b8efe tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a94f7988611413eae6103ea7d3ea293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dfe7c4a9684f7ea504997e112332f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:37.329511 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-da2071c3-f84b-4a19-b872-273b419b8efe tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] 10.222.0.20 "GET /compute/v2.1/servers/09abc551-a98f-4553-b387-ec23b28a2190" status: 200 len: 1316 microversion: 2.1 time: 0.184857 Apr 16 21:27:37.330140 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2557/5281] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:37 2022] GET /compute/v2.1/servers/09abc551-a98f-4553-b387-ec23b28a2190 => generated 1316 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:37.427235 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-11f1c37d-d9e5-4ece-ac5d-59c5a19bd8d0 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:37.435503 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-11f1c37d-d9e5-4ece-ac5d-59c5a19bd8d0 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/5fee6363-9586-45b0-b643-e6dbd4652c80" status: 200 len: 1309 microversion: 2.1 time: 0.201827 Apr 16 21:27:37.436095 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2725/5282] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:37 2022] GET /compute/v2.1/servers/5fee6363-9586-45b0-b643-e6dbd4652c80 => generated 1309 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:37.892736 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-15a06c06-877f-4887-83fc-d9dcf2524a3c req-d34662a5-2705-4e8b-bac1-d861b69b8014 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09abc551-a98f-4553-b387-ec23b28a2190", "name": "network-vif-plugged", "status": "completed", "tag": "71c9c3c9-4777-41ba-ac3e-634279e5bec9"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:27:37.897534 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-15a06c06-877f-4887-83fc-d9dcf2524a3c req-d34662a5-2705-4e8b-bac1-d861b69b8014 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:37.897996 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-15a06c06-877f-4887-83fc-d9dcf2524a3c req-d34662a5-2705-4e8b-bac1-d861b69b8014 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:37.912940 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-15a06c06-877f-4887-83fc-d9dcf2524a3c req-d34662a5-2705-4e8b-bac1-d861b69b8014 service nova] Creating event network-vif-plugged:71c9c3c9-4777-41ba-ac3e-634279e5bec9 for instance 09abc551-a98f-4553-b387-ec23b28a2190 on nch1-master-1 Apr 16 21:27:37.919056 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-15a06c06-877f-4887-83fc-d9dcf2524a3c req-d34662a5-2705-4e8b-bac1-d861b69b8014 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032837 Apr 16 21:27:37.919056 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2558/5283] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:27:38.346234 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-395db7d5-3157-42e5-8683-2c1b8f3c4e7b tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:38.347498 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-395db7d5-3157-42e5-8683-2c1b8f3c4e7b tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] [instance: 09abc551-a98f-4553-b387-ec23b28a2190] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:38.354458 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-395db7d5-3157-42e5-8683-2c1b8f3c4e7b tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:38.354922 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-395db7d5-3157-42e5-8683-2c1b8f3c4e7b tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:38.355696 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-395db7d5-3157-42e5-8683-2c1b8f3c4e7b tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:38.356233 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-395db7d5-3157-42e5-8683-2c1b8f3c4e7b tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:38.453433 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-da11eb8f-ca2b-459f-8518-5369415f7e2e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:38.454267 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-da11eb8f-ca2b-459f-8518-5369415f7e2e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 5fee6363-9586-45b0-b643-e6dbd4652c80] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:38.460488 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-da11eb8f-ca2b-459f-8518-5369415f7e2e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:38.460922 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-da11eb8f-ca2b-459f-8518-5369415f7e2e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:38.461908 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-da11eb8f-ca2b-459f-8518-5369415f7e2e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:38.462525 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-da11eb8f-ca2b-459f-8518-5369415f7e2e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:38.503477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-395db7d5-3157-42e5-8683-2c1b8f3c4e7b tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a94f7988611413eae6103ea7d3ea293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dfe7c4a9684f7ea504997e112332f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:38.513404 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-395db7d5-3157-42e5-8683-2c1b8f3c4e7b tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] 10.222.0.20 "GET /compute/v2.1/servers/09abc551-a98f-4553-b387-ec23b28a2190" status: 200 len: 1316 microversion: 2.1 time: 0.171108 Apr 16 21:27:38.516214 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2726/5284] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:38 2022] GET /compute/v2.1/servers/09abc551-a98f-4553-b387-ec23b28a2190 => generated 1316 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:38.601851 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-da11eb8f-ca2b-459f-8518-5369415f7e2e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:38.609702 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-da11eb8f-ca2b-459f-8518-5369415f7e2e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/5fee6363-9586-45b0-b643-e6dbd4652c80" status: 200 len: 1491 microversion: 2.1 time: 0.161139 Apr 16 21:27:38.610282 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2559/5285] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:38 2022] GET /compute/v2.1/servers/5fee6363-9586-45b0-b643-e6dbd4652c80 => generated 1491 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:27:38.726047 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a9aa83d9-6d42-4f26-ba8e-23f6094a9c2e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1867966518", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "8f593006-a7a9-4abc-8409-1d78959e9c9f"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:27:38.781020 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-a9aa83d9-6d42-4f26-ba8e-23f6094a9c2e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] validate_networks() for [('8f593006-a7a9-4abc-8409-1d78959e9c9f', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:27:39.519093 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-a9aa83d9-6d42-4f26-ba8e-23f6094a9c2e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:27:39.520197 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-a9aa83d9-6d42-4f26-ba8e-23f6094a9c2e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:27:39.520838 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-a9aa83d9-6d42-4f26-ba8e-23f6094a9c2e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:27:39.526689 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-a9aa83d9-6d42-4f26-ba8e-23f6094a9c2e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:27:39.526689 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-a9aa83d9-6d42-4f26-ba8e-23f6094a9c2e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:27:39.531254 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6c0a8b1e-706f-4da9-8023-38af9e22cdde tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:39.531875 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6c0a8b1e-706f-4da9-8023-38af9e22cdde tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] [instance: 09abc551-a98f-4553-b387-ec23b28a2190] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:39.538930 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6c0a8b1e-706f-4da9-8023-38af9e22cdde tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:39.539394 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6c0a8b1e-706f-4da9-8023-38af9e22cdde tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:39.540304 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6c0a8b1e-706f-4da9-8023-38af9e22cdde tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:39.540648 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6c0a8b1e-706f-4da9-8023-38af9e22cdde tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:39.554077 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9aa83d9-6d42-4f26-ba8e-23f6094a9c2e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:39.554708 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9aa83d9-6d42-4f26-ba8e-23f6094a9c2e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:39.555527 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9aa83d9-6d42-4f26-ba8e-23f6094a9c2e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:39.555978 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9aa83d9-6d42-4f26-ba8e-23f6094a9c2e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:39.573622 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-a9aa83d9-6d42-4f26-ba8e-23f6094a9c2e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Getting quotas for project 76fd883ad3944fcaaecdf2909120dc87. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:27:39.579268 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-a9aa83d9-6d42-4f26-ba8e-23f6094a9c2e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Getting quotas for user 5e71b35f438d4539a60a390e1ceec9cd and project 76fd883ad3944fcaaecdf2909120dc87. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:27:39.594812 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a9aa83d9-6d42-4f26-ba8e-23f6094a9c2e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:27:39.597396 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a9aa83d9-6d42-4f26-ba8e-23f6094a9c2e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 0a92a902-c20e-44c0-a263-013ab10917cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:27:39.741564 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6c0a8b1e-706f-4da9-8023-38af9e22cdde tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a94f7988611413eae6103ea7d3ea293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dfe7c4a9684f7ea504997e112332f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:39.745369 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a9aa83d9-6d42-4f26-ba8e-23f6094a9c2e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.023056 Apr 16 21:27:39.746277 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2727/5286] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:27:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1025 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:27:39.753403 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6c0a8b1e-706f-4da9-8023-38af9e22cdde tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] 10.222.0.20 "GET /compute/v2.1/servers/09abc551-a98f-4553-b387-ec23b28a2190" status: 200 len: 1505 microversion: 2.1 time: 0.226234 Apr 16 21:27:39.754037 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2560/5287] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:39 2022] GET /compute/v2.1/servers/09abc551-a98f-4553-b387-ec23b28a2190 => generated 1505 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:27:39.771514 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a7c5c514-4a5d-4454-bbcf-76b22c905162 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:39.772535 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a7c5c514-4a5d-4454-bbcf-76b22c905162 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] [instance: 09abc551-a98f-4553-b387-ec23b28a2190] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:39.774393 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9c02c7ea-9cf3-44d0-b2b0-a4f10333360f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:39.775225 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9c02c7ea-9cf3-44d0-b2b0-a4f10333360f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 0a92a902-c20e-44c0-a263-013ab10917cf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:39.787447 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a7c5c514-4a5d-4454-bbcf-76b22c905162 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:39.790825 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a7c5c514-4a5d-4454-bbcf-76b22c905162 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:39.792497 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a7c5c514-4a5d-4454-bbcf-76b22c905162 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:39.794609 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a7c5c514-4a5d-4454-bbcf-76b22c905162 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:39.836951 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a7c5c514-4a5d-4454-bbcf-76b22c905162 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '2a94f7988611413eae6103ea7d3ea293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dfe7c4a9684f7ea504997e112332f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:39.840308 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a7c5c514-4a5d-4454-bbcf-76b22c905162 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] 10.222.0.20 "GET /compute/v2.1/servers/09abc551-a98f-4553-b387-ec23b28a2190/os-instance-actions/req-33f718e5-71e9-4fe5-a08e-ece835c7075a" status: 200 len: 313 microversion: 2.1 time: 0.071651 Apr 16 21:27:39.840308 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2561/5288] 10.222.0.20 () {58 vars in 1418 bytes} [Sat Apr 16 21:27:39 2022] GET /compute/v2.1/servers/09abc551-a98f-4553-b387-ec23b28a2190/os-instance-actions/req-33f718e5-71e9-4fe5-a08e-ece835c7075a => generated 313 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:27:39.852541 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5eff69f1-b647-46a3-b2d6-2348c60f5197 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:27:39.853943 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5eff69f1-b647-46a3-b2d6-2348c60f5197 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] [instance: 09abc551-a98f-4553-b387-ec23b28a2190] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:39.864700 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5eff69f1-b647-46a3-b2d6-2348c60f5197 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:39.864700 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5eff69f1-b647-46a3-b2d6-2348c60f5197 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:39.864700 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5eff69f1-b647-46a3-b2d6-2348c60f5197 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:39.864700 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5eff69f1-b647-46a3-b2d6-2348c60f5197 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:39.869785 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9c02c7ea-9cf3-44d0-b2b0-a4f10333360f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:39.879382 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9c02c7ea-9cf3-44d0-b2b0-a4f10333360f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/0a92a902-c20e-44c0-a263-013ab10917cf" status: 200 len: 1209 microversion: 2.1 time: 0.121262 Apr 16 21:27:39.881496 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2728/5289] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:39 2022] GET /compute/v2.1/servers/0a92a902-c20e-44c0-a263-013ab10917cf => generated 1209 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:40.172638 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5eff69f1-b647-46a3-b2d6-2348c60f5197 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] 10.222.0.20 "POST /compute/v2.1/servers/09abc551-a98f-4553-b387-ec23b28a2190/action" status: 202 len: 0 microversion: 2.1 time: 0.324175 Apr 16 21:27:40.177311 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2562/5290] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:27:39 2022] POST /compute/v2.1/servers/09abc551-a98f-4553-b387-ec23b28a2190/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:27:40.182477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-82cbdedf-bd63-4a76-8e15-118ee43985e5 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:40.183359 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-82cbdedf-bd63-4a76-8e15-118ee43985e5 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] [instance: 09abc551-a98f-4553-b387-ec23b28a2190] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:40.201869 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-82cbdedf-bd63-4a76-8e15-118ee43985e5 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:40.202584 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-82cbdedf-bd63-4a76-8e15-118ee43985e5 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:40.203646 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-82cbdedf-bd63-4a76-8e15-118ee43985e5 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:40.204372 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-82cbdedf-bd63-4a76-8e15-118ee43985e5 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:40.348849 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-82cbdedf-bd63-4a76-8e15-118ee43985e5 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a94f7988611413eae6103ea7d3ea293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dfe7c4a9684f7ea504997e112332f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:40.367975 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-82cbdedf-bd63-4a76-8e15-118ee43985e5 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] 10.222.0.20 "GET /compute/v2.1/servers/09abc551-a98f-4553-b387-ec23b28a2190" status: 200 len: 1507 microversion: 2.1 time: 0.188151 Apr 16 21:27:40.368801 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2729/5291] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:40 2022] GET /compute/v2.1/servers/09abc551-a98f-4553-b387-ec23b28a2190 => generated 1507 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:40.899532 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-20cd34f6-4b1f-4dd4-8b8a-9e8c50cf9946 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:40.901108 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-20cd34f6-4b1f-4dd4-8b8a-9e8c50cf9946 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 0a92a902-c20e-44c0-a263-013ab10917cf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:40.907754 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-20cd34f6-4b1f-4dd4-8b8a-9e8c50cf9946 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:40.908235 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-20cd34f6-4b1f-4dd4-8b8a-9e8c50cf9946 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:40.909018 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-20cd34f6-4b1f-4dd4-8b8a-9e8c50cf9946 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:40.909464 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-20cd34f6-4b1f-4dd4-8b8a-9e8c50cf9946 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:40.971676 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-20cd34f6-4b1f-4dd4-8b8a-9e8c50cf9946 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:40.979200 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-20cd34f6-4b1f-4dd4-8b8a-9e8c50cf9946 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/0a92a902-c20e-44c0-a263-013ab10917cf" status: 200 len: 1213 microversion: 2.1 time: 0.083975 Apr 16 21:27:40.979774 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2563/5292] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:40 2022] GET /compute/v2.1/servers/0a92a902-c20e-44c0-a263-013ab10917cf => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:41.392223 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b52c6c31-d6f8-4a41-81a3-92fa3d8422ae tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:41.394076 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b52c6c31-d6f8-4a41-81a3-92fa3d8422ae tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] [instance: 09abc551-a98f-4553-b387-ec23b28a2190] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:41.402486 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b52c6c31-d6f8-4a41-81a3-92fa3d8422ae tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:41.408257 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b52c6c31-d6f8-4a41-81a3-92fa3d8422ae tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:41.408257 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b52c6c31-d6f8-4a41-81a3-92fa3d8422ae tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:41.408257 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b52c6c31-d6f8-4a41-81a3-92fa3d8422ae tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:41.554127 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b52c6c31-d6f8-4a41-81a3-92fa3d8422ae tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a94f7988611413eae6103ea7d3ea293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dfe7c4a9684f7ea504997e112332f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:41.561662 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b52c6c31-d6f8-4a41-81a3-92fa3d8422ae tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] 10.222.0.20 "GET /compute/v2.1/servers/09abc551-a98f-4553-b387-ec23b28a2190" status: 200 len: 1512 microversion: 2.1 time: 0.173985 Apr 16 21:27:41.562326 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2730/5293] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:41 2022] GET /compute/v2.1/servers/09abc551-a98f-4553-b387-ec23b28a2190 => generated 1512 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:42.003475 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6178c5ee-d1ad-4ced-a42c-e144b59ea8ed tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:42.003942 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6178c5ee-d1ad-4ced-a42c-e144b59ea8ed tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 0a92a902-c20e-44c0-a263-013ab10917cf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:42.010349 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6178c5ee-d1ad-4ced-a42c-e144b59ea8ed tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:42.010803 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6178c5ee-d1ad-4ced-a42c-e144b59ea8ed tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:42.011599 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6178c5ee-d1ad-4ced-a42c-e144b59ea8ed tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:42.012420 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6178c5ee-d1ad-4ced-a42c-e144b59ea8ed tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:42.077781 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6178c5ee-d1ad-4ced-a42c-e144b59ea8ed tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:42.085831 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6178c5ee-d1ad-4ced-a42c-e144b59ea8ed tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/0a92a902-c20e-44c0-a263-013ab10917cf" status: 200 len: 1261 microversion: 2.1 time: 0.087572 Apr 16 21:27:42.086421 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2564/5294] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:41 2022] GET /compute/v2.1/servers/0a92a902-c20e-44c0-a263-013ab10917cf => generated 1261 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:42.581284 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-58a15639-306e-467c-9b43-0a6ceb8b3076 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:42.581909 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-58a15639-306e-467c-9b43-0a6ceb8b3076 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] [instance: 09abc551-a98f-4553-b387-ec23b28a2190] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:42.588871 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58a15639-306e-467c-9b43-0a6ceb8b3076 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:42.589335 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58a15639-306e-467c-9b43-0a6ceb8b3076 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:42.590121 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58a15639-306e-467c-9b43-0a6ceb8b3076 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:42.590567 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58a15639-306e-467c-9b43-0a6ceb8b3076 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:42.824089 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-58a15639-306e-467c-9b43-0a6ceb8b3076 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a94f7988611413eae6103ea7d3ea293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dfe7c4a9684f7ea504997e112332f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:42.844371 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-58a15639-306e-467c-9b43-0a6ceb8b3076 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] 10.222.0.20 "GET /compute/v2.1/servers/09abc551-a98f-4553-b387-ec23b28a2190" status: 200 len: 1505 microversion: 2.1 time: 0.258871 Apr 16 21:27:42.845416 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2731/5295] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:42 2022] GET /compute/v2.1/servers/09abc551-a98f-4553-b387-ec23b28a2190 => generated 1505 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:42.864546 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3a7e3f18-8f96-4683-bbf3-3c4a016ca0d5 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Calling method '.version_select at 0x7fbb96ca7c10>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:42.865330 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3a7e3f18-8f96-4683-bbf3-3c4a016ca0d5 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] [instance: 09abc551-a98f-4553-b387-ec23b28a2190] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:42.876762 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3a7e3f18-8f96-4683-bbf3-3c4a016ca0d5 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:42.879915 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3a7e3f18-8f96-4683-bbf3-3c4a016ca0d5 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:42.879915 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3a7e3f18-8f96-4683-bbf3-3c4a016ca0d5 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:42.879915 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3a7e3f18-8f96-4683-bbf3-3c4a016ca0d5 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:42.911893 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3a7e3f18-8f96-4683-bbf3-3c4a016ca0d5 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] 10.222.0.20 "GET /compute/v2.1/servers/09abc551-a98f-4553-b387-ec23b28a2190/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.051574 Apr 16 21:27:42.913026 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2565/5296] 10.222.0.20 () {58 vars in 1295 bytes} [Sat Apr 16 21:27:42 2022] GET /compute/v2.1/servers/09abc551-a98f-4553-b387-ec23b28a2190/os-instance-actions => generated 611 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:27:42.928649 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-99701ac9-079f-44ed-b9c4-4748443e1914 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:42.928649 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-99701ac9-079f-44ed-b9c4-4748443e1914 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] [instance: 09abc551-a98f-4553-b387-ec23b28a2190] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:42.936922 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-99701ac9-079f-44ed-b9c4-4748443e1914 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:42.937748 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-99701ac9-079f-44ed-b9c4-4748443e1914 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:42.939768 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-99701ac9-079f-44ed-b9c4-4748443e1914 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:42.940346 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-99701ac9-079f-44ed-b9c4-4748443e1914 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:42.969443 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-99701ac9-079f-44ed-b9c4-4748443e1914 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] [instance: 09abc551-a98f-4553-b387-ec23b28a2190] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:27:43.102958 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-05e7a981-28fd-4fda-80d9-0aae832edac1 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:43.103608 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-05e7a981-28fd-4fda-80d9-0aae832edac1 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 0a92a902-c20e-44c0-a263-013ab10917cf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:43.111366 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-05e7a981-28fd-4fda-80d9-0aae832edac1 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:43.127035 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-05e7a981-28fd-4fda-80d9-0aae832edac1 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:43.127035 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-05e7a981-28fd-4fda-80d9-0aae832edac1 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:43.127035 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-05e7a981-28fd-4fda-80d9-0aae832edac1 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:43.197958 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-05e7a981-28fd-4fda-80d9-0aae832edac1 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:43.208732 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-05e7a981-28fd-4fda-80d9-0aae832edac1 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/0a92a902-c20e-44c0-a263-013ab10917cf" status: 200 len: 1267 microversion: 2.1 time: 0.109412 Apr 16 21:27:43.209303 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2566/5297] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:43 2022] GET /compute/v2.1/servers/0a92a902-c20e-44c0-a263-013ab10917cf => generated 1267 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:27:43.284419 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-99701ac9-079f-44ed-b9c4-4748443e1914 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] 10.222.0.20 "DELETE /compute/v2.1/servers/09abc551-a98f-4553-b387-ec23b28a2190" status: 204 len: 0 microversion: 2.1 time: 0.362773 Apr 16 21:27:43.285253 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2732/5298] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:27:42 2022] DELETE /compute/v2.1/servers/09abc551-a98f-4553-b387-ec23b28a2190 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:27:43.296131 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9f177280-365b-4545-8c64-cb34d1c3b7e4 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:43.296478 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9f177280-365b-4545-8c64-cb34d1c3b7e4 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] [instance: 09abc551-a98f-4553-b387-ec23b28a2190] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:43.311309 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9f177280-365b-4545-8c64-cb34d1c3b7e4 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:43.313902 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9f177280-365b-4545-8c64-cb34d1c3b7e4 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:43.317365 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9f177280-365b-4545-8c64-cb34d1c3b7e4 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:43.317983 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9f177280-365b-4545-8c64-cb34d1c3b7e4 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:43.515937 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9f177280-365b-4545-8c64-cb34d1c3b7e4 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a94f7988611413eae6103ea7d3ea293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dfe7c4a9684f7ea504997e112332f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:43.527516 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9f177280-365b-4545-8c64-cb34d1c3b7e4 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] 10.222.0.20 "GET /compute/v2.1/servers/09abc551-a98f-4553-b387-ec23b28a2190" status: 200 len: 1511 microversion: 2.1 time: 0.237702 Apr 16 21:27:43.528114 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2567/5299] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:43 2022] GET /compute/v2.1/servers/09abc551-a98f-4553-b387-ec23b28a2190 => generated 1511 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:44.229110 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6018e629-fbfb-4926-afa1-3478cd82f3a9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:44.230480 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6018e629-fbfb-4926-afa1-3478cd82f3a9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 0a92a902-c20e-44c0-a263-013ab10917cf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:44.238372 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6018e629-fbfb-4926-afa1-3478cd82f3a9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:44.239242 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6018e629-fbfb-4926-afa1-3478cd82f3a9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:44.240223 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6018e629-fbfb-4926-afa1-3478cd82f3a9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:44.255019 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6018e629-fbfb-4926-afa1-3478cd82f3a9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:44.413593 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6018e629-fbfb-4926-afa1-3478cd82f3a9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:44.421930 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6018e629-fbfb-4926-afa1-3478cd82f3a9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/0a92a902-c20e-44c0-a263-013ab10917cf" status: 200 len: 1309 microversion: 2.1 time: 0.198858 Apr 16 21:27:44.422714 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2733/5300] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:44 2022] GET /compute/v2.1/servers/0a92a902-c20e-44c0-a263-013ab10917cf => generated 1309 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:44.550887 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4a6c070f-6fc5-49b2-9202-94745c0c0b34 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:44.551513 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4a6c070f-6fc5-49b2-9202-94745c0c0b34 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] [instance: 09abc551-a98f-4553-b387-ec23b28a2190] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:44.559335 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4a6c070f-6fc5-49b2-9202-94745c0c0b34 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:44.566480 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4a6c070f-6fc5-49b2-9202-94745c0c0b34 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:44.566480 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4a6c070f-6fc5-49b2-9202-94745c0c0b34 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:44.566480 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4a6c070f-6fc5-49b2-9202-94745c0c0b34 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:44.717565 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4a6c070f-6fc5-49b2-9202-94745c0c0b34 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a94f7988611413eae6103ea7d3ea293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dfe7c4a9684f7ea504997e112332f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:44.725714 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4a6c070f-6fc5-49b2-9202-94745c0c0b34 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] 10.222.0.20 "GET /compute/v2.1/servers/09abc551-a98f-4553-b387-ec23b28a2190" status: 200 len: 1511 microversion: 2.1 time: 0.183532 Apr 16 21:27:44.735381 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2568/5301] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:44 2022] GET /compute/v2.1/servers/09abc551-a98f-4553-b387-ec23b28a2190 => generated 1511 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:44.787243 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-aad33529-a77d-4806-85ce-58eecd056c78 req-62664bee-9fc0-4720-a5c2-f72d546f66d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a92a902-c20e-44c0-a263-013ab10917cf", "tag": "eaf83a7a-9efb-4182-ba3c-eac518b2605d"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:27:44.796560 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-aad33529-a77d-4806-85ce-58eecd056c78 req-62664bee-9fc0-4720-a5c2-f72d546f66d1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:44.797012 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-aad33529-a77d-4806-85ce-58eecd056c78 req-62664bee-9fc0-4720-a5c2-f72d546f66d1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:44.810364 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-aad33529-a77d-4806-85ce-58eecd056c78 req-62664bee-9fc0-4720-a5c2-f72d546f66d1 service nova] Creating event network-changed:eaf83a7a-9efb-4182-ba3c-eac518b2605d for instance 0a92a902-c20e-44c0-a263-013ab10917cf on nch2-master-1 Apr 16 21:27:44.816472 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-aad33529-a77d-4806-85ce-58eecd056c78 req-62664bee-9fc0-4720-a5c2-f72d546f66d1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037633 Apr 16 21:27:44.817150 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2734/5302] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:27:45.439544 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c7ec1e86-f3e3-429f-a76f-4b9ef2c7bb48 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:45.440160 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c7ec1e86-f3e3-429f-a76f-4b9ef2c7bb48 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 0a92a902-c20e-44c0-a263-013ab10917cf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:45.449676 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c7ec1e86-f3e3-429f-a76f-4b9ef2c7bb48 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:45.451669 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c7ec1e86-f3e3-429f-a76f-4b9ef2c7bb48 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:45.453766 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c7ec1e86-f3e3-429f-a76f-4b9ef2c7bb48 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:45.456148 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c7ec1e86-f3e3-429f-a76f-4b9ef2c7bb48 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:45.656735 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c7ec1e86-f3e3-429f-a76f-4b9ef2c7bb48 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:45.666786 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c7ec1e86-f3e3-429f-a76f-4b9ef2c7bb48 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/0a92a902-c20e-44c0-a263-013ab10917cf" status: 200 len: 1309 microversion: 2.1 time: 0.231651 Apr 16 21:27:45.672032 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2569/5303] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:45 2022] GET /compute/v2.1/servers/0a92a902-c20e-44c0-a263-013ab10917cf => generated 1309 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:45.678009 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-74d2cadc-8468-4999-b83e-38672ab61be8 req-ff26435b-9fde-4d32-95a4-26cfb9def6fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09abc551-a98f-4553-b387-ec23b28a2190", "name": "network-vif-deleted", "tag": "71c9c3c9-4777-41ba-ac3e-634279e5bec9"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:27:45.690246 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-74d2cadc-8468-4999-b83e-38672ab61be8 req-ff26435b-9fde-4d32-95a4-26cfb9def6fd service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:45.692450 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-74d2cadc-8468-4999-b83e-38672ab61be8 req-ff26435b-9fde-4d32-95a4-26cfb9def6fd service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:45.727205 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-74d2cadc-8468-4999-b83e-38672ab61be8 req-ff26435b-9fde-4d32-95a4-26cfb9def6fd service nova] Creating event network-vif-deleted:71c9c3c9-4777-41ba-ac3e-634279e5bec9 for instance 09abc551-a98f-4553-b387-ec23b28a2190 on nch1-master-1 Apr 16 21:27:45.739923 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-74d2cadc-8468-4999-b83e-38672ab61be8 req-ff26435b-9fde-4d32-95a4-26cfb9def6fd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.281610 Apr 16 21:27:45.742181 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2735/5304] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:27:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:27:45.742853 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-feb19630-456a-4e32-b35c-d585ef2575f2 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:45.743574 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-feb19630-456a-4e32-b35c-d585ef2575f2 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] [instance: 09abc551-a98f-4553-b387-ec23b28a2190] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:45.755847 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-feb19630-456a-4e32-b35c-d585ef2575f2 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:45.756677 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-feb19630-456a-4e32-b35c-d585ef2575f2 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:45.758957 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-feb19630-456a-4e32-b35c-d585ef2575f2 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:45.758957 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-feb19630-456a-4e32-b35c-d585ef2575f2 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:45.863570 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-feb19630-456a-4e32-b35c-d585ef2575f2 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a94f7988611413eae6103ea7d3ea293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dfe7c4a9684f7ea504997e112332f2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:45.871829 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-feb19630-456a-4e32-b35c-d585ef2575f2 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] 10.222.0.20 "GET /compute/v2.1/servers/09abc551-a98f-4553-b387-ec23b28a2190" status: 200 len: 1301 microversion: 2.1 time: 0.133032 Apr 16 21:27:45.872730 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2570/5305] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:45 2022] GET /compute/v2.1/servers/09abc551-a98f-4553-b387-ec23b28a2190 => generated 1301 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:27:46.688924 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fe227a4c-c704-49c6-8e6e-b7ac9ce1ae8b tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:46.689623 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fe227a4c-c704-49c6-8e6e-b7ac9ce1ae8b tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 0a92a902-c20e-44c0-a263-013ab10917cf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:46.696923 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fe227a4c-c704-49c6-8e6e-b7ac9ce1ae8b tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:46.697398 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fe227a4c-c704-49c6-8e6e-b7ac9ce1ae8b tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:46.698197 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fe227a4c-c704-49c6-8e6e-b7ac9ce1ae8b tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:46.698648 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fe227a4c-c704-49c6-8e6e-b7ac9ce1ae8b tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:46.828544 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fe227a4c-c704-49c6-8e6e-b7ac9ce1ae8b tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:46.840425 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fe227a4c-c704-49c6-8e6e-b7ac9ce1ae8b tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/0a92a902-c20e-44c0-a263-013ab10917cf" status: 200 len: 1309 microversion: 2.1 time: 0.155090 Apr 16 21:27:46.850960 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2736/5306] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:46 2022] GET /compute/v2.1/servers/0a92a902-c20e-44c0-a263-013ab10917cf => generated 1309 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:46.888687 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0ecd57b5-6238-437a-8561-0af2f7ca8449 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:46.896332 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0ecd57b5-6238-437a-8561-0af2f7ca8449 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] [instance: 09abc551-a98f-4553-b387-ec23b28a2190] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:46.896604 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0ecd57b5-6238-437a-8561-0af2f7ca8449 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:46.897092 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0ecd57b5-6238-437a-8561-0af2f7ca8449 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:46.897874 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0ecd57b5-6238-437a-8561-0af2f7ca8449 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:46.898329 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0ecd57b5-6238-437a-8561-0af2f7ca8449 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:46.913035 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-0ecd57b5-6238-437a-8561-0af2f7ca8449 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] HTTP exception thrown: Instance 09abc551-a98f-4553-b387-ec23b28a2190 could not be found. Apr 16 21:27:46.921672 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0ecd57b5-6238-437a-8561-0af2f7ca8449 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] Returning 404 to user: Instance 09abc551-a98f-4553-b387-ec23b28a2190 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:27:46.921672 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0ecd57b5-6238-437a-8561-0af2f7ca8449 tempest-InstanceActionsTestJSON-1827718224 tempest-InstanceActionsTestJSON-1827718224-project] 10.222.0.20 "GET /compute/v2.1/servers/09abc551-a98f-4553-b387-ec23b28a2190" status: 404 len: 111 microversion: 2.1 time: 0.030159 Apr 16 21:27:46.921672 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2571/5307] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:46 2022] GET /compute/v2.1/servers/09abc551-a98f-4553-b387-ec23b28a2190 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:27:47.857240 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7dd2b700-12a3-4b1c-a4d1-f57be84ed596 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:47.857866 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7dd2b700-12a3-4b1c-a4d1-f57be84ed596 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 0a92a902-c20e-44c0-a263-013ab10917cf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:47.864944 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7dd2b700-12a3-4b1c-a4d1-f57be84ed596 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:47.865398 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7dd2b700-12a3-4b1c-a4d1-f57be84ed596 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:47.866161 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7dd2b700-12a3-4b1c-a4d1-f57be84ed596 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:47.866603 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7dd2b700-12a3-4b1c-a4d1-f57be84ed596 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:48.008283 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7dd2b700-12a3-4b1c-a4d1-f57be84ed596 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:48.015725 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7dd2b700-12a3-4b1c-a4d1-f57be84ed596 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/0a92a902-c20e-44c0-a263-013ab10917cf" status: 200 len: 1309 microversion: 2.1 time: 0.162119 Apr 16 21:27:48.025679 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2737/5308] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:47 2022] GET /compute/v2.1/servers/0a92a902-c20e-44c0-a263-013ab10917cf => generated 1309 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:49.033759 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1cd530c3-8bd3-4a13-8963-3cebfc2fdb25 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:49.034383 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1cd530c3-8bd3-4a13-8963-3cebfc2fdb25 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 0a92a902-c20e-44c0-a263-013ab10917cf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:49.041317 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1cd530c3-8bd3-4a13-8963-3cebfc2fdb25 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:49.042022 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1cd530c3-8bd3-4a13-8963-3cebfc2fdb25 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:49.042868 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1cd530c3-8bd3-4a13-8963-3cebfc2fdb25 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:49.043620 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1cd530c3-8bd3-4a13-8963-3cebfc2fdb25 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:49.195200 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1cd530c3-8bd3-4a13-8963-3cebfc2fdb25 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:49.208998 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1cd530c3-8bd3-4a13-8963-3cebfc2fdb25 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/0a92a902-c20e-44c0-a263-013ab10917cf" status: 200 len: 1309 microversion: 2.1 time: 0.179521 Apr 16 21:27:49.209534 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2572/5309] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:49 2022] GET /compute/v2.1/servers/0a92a902-c20e-44c0-a263-013ab10917cf => generated 1309 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:50.236053 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2ed1e51f-4ae4-454a-a4bc-84f163c8dc2d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:50.236053 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2ed1e51f-4ae4-454a-a4bc-84f163c8dc2d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 0a92a902-c20e-44c0-a263-013ab10917cf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:50.240460 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2ed1e51f-4ae4-454a-a4bc-84f163c8dc2d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:50.242177 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2ed1e51f-4ae4-454a-a4bc-84f163c8dc2d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:50.243314 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2ed1e51f-4ae4-454a-a4bc-84f163c8dc2d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:50.243989 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2ed1e51f-4ae4-454a-a4bc-84f163c8dc2d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:50.409240 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2ed1e51f-4ae4-454a-a4bc-84f163c8dc2d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:50.419433 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2ed1e51f-4ae4-454a-a4bc-84f163c8dc2d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/0a92a902-c20e-44c0-a263-013ab10917cf" status: 200 len: 1309 microversion: 2.1 time: 0.192425 Apr 16 21:27:50.420305 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2738/5310] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:50 2022] GET /compute/v2.1/servers/0a92a902-c20e-44c0-a263-013ab10917cf => generated 1309 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:50.907602 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b9d1040d-ef24-4315-94e0-fb06567dea5e tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:27:50.914244 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b9d1040d-ef24-4315-94e0-fb06567dea5e tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:50.917387 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b9d1040d-ef24-4315-94e0-fb06567dea5e tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:50.918136 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b9d1040d-ef24-4315-94e0-fb06567dea5e tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:50.919457 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b9d1040d-ef24-4315-94e0-fb06567dea5e tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:50.920096 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b9d1040d-ef24-4315-94e0-fb06567dea5e tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:50.976142 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b9d1040d-ef24-4315-94e0-fb06567dea5e tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "POST /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462/action" status: 200 len: 24580 microversion: 2.42 time: 0.334739 Apr 16 21:27:50.976835 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2573/5311] 10.222.0.20 () {62 vars in 1318 bytes} [Sat Apr 16 21:27:50 2022] POST /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462/action => generated 24580 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:27:51.436959 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-71cada91-51db-4475-a63c-2caff705e987 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:51.437669 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-71cada91-51db-4475-a63c-2caff705e987 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 0a92a902-c20e-44c0-a263-013ab10917cf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:51.444742 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-71cada91-51db-4475-a63c-2caff705e987 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:51.445205 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-71cada91-51db-4475-a63c-2caff705e987 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:51.446417 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-71cada91-51db-4475-a63c-2caff705e987 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:51.446841 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-71cada91-51db-4475-a63c-2caff705e987 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:51.621277 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-71cada91-51db-4475-a63c-2caff705e987 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:51.629337 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-71cada91-51db-4475-a63c-2caff705e987 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/0a92a902-c20e-44c0-a263-013ab10917cf" status: 200 len: 1309 microversion: 2.1 time: 0.196033 Apr 16 21:27:51.631380 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2739/5312] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:51 2022] GET /compute/v2.1/servers/0a92a902-c20e-44c0-a263-013ab10917cf => generated 1309 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:52.580115 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-92a11880-b28e-480b-828e-fbbc06892426 req-257d9752-c9f4-4671-8a6d-f0e7e40dccc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a92a902-c20e-44c0-a263-013ab10917cf", "name": "network-vif-plugged", "status": "completed", "tag": "eaf83a7a-9efb-4182-ba3c-eac518b2605d"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:27:52.601030 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-92a11880-b28e-480b-828e-fbbc06892426 req-257d9752-c9f4-4671-8a6d-f0e7e40dccc0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:52.601030 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-92a11880-b28e-480b-828e-fbbc06892426 req-257d9752-c9f4-4671-8a6d-f0e7e40dccc0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:52.609753 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-92a11880-b28e-480b-828e-fbbc06892426 req-257d9752-c9f4-4671-8a6d-f0e7e40dccc0 service nova] Creating event network-vif-plugged:eaf83a7a-9efb-4182-ba3c-eac518b2605d for instance 0a92a902-c20e-44c0-a263-013ab10917cf on nch2-master-1 Apr 16 21:27:52.615406 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-92a11880-b28e-480b-828e-fbbc06892426 req-257d9752-c9f4-4671-8a6d-f0e7e40dccc0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039575 Apr 16 21:27:52.616136 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2574/5313] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:27:52.654306 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d48c634e-bbf9-4f13-8cd8-7c1cf22b9193 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:52.658517 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d48c634e-bbf9-4f13-8cd8-7c1cf22b9193 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 0a92a902-c20e-44c0-a263-013ab10917cf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:52.664323 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d48c634e-bbf9-4f13-8cd8-7c1cf22b9193 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:52.665118 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d48c634e-bbf9-4f13-8cd8-7c1cf22b9193 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:52.666306 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d48c634e-bbf9-4f13-8cd8-7c1cf22b9193 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:52.666867 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d48c634e-bbf9-4f13-8cd8-7c1cf22b9193 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:52.909516 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d48c634e-bbf9-4f13-8cd8-7c1cf22b9193 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:52.917326 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d48c634e-bbf9-4f13-8cd8-7c1cf22b9193 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/0a92a902-c20e-44c0-a263-013ab10917cf" status: 200 len: 1309 microversion: 2.1 time: 0.270465 Apr 16 21:27:52.918777 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2740/5314] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:52 2022] GET /compute/v2.1/servers/0a92a902-c20e-44c0-a263-013ab10917cf => generated 1309 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:53.047458 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2cd11b84-fb1a-469a-9c92-f36248d7440a tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-155328880", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "717edaa6-75b3-4b7d-b417-90ecdd617888"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:27:53.112502 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-2cd11b84-fb1a-469a-9c92-f36248d7440a tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] validate_networks() for [('717edaa6-75b3-4b7d-b417-90ecdd617888', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:27:53.471609 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-2cd11b84-fb1a-469a-9c92-f36248d7440a tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:27:53.472289 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-2cd11b84-fb1a-469a-9c92-f36248d7440a tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:27:53.472939 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-2cd11b84-fb1a-469a-9c92-f36248d7440a tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:27:53.473366 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-2cd11b84-fb1a-469a-9c92-f36248d7440a tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:27:53.473816 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-2cd11b84-fb1a-469a-9c92-f36248d7440a tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:27:53.484802 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2cd11b84-fb1a-469a-9c92-f36248d7440a tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:53.484802 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2cd11b84-fb1a-469a-9c92-f36248d7440a tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:53.484802 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2cd11b84-fb1a-469a-9c92-f36248d7440a tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:53.484802 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2cd11b84-fb1a-469a-9c92-f36248d7440a tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:53.502741 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-2cd11b84-fb1a-469a-9c92-f36248d7440a tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Getting quotas for project 6e5ed140aa524fbbab716a4dacfb8f01. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:27:53.508963 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-2cd11b84-fb1a-469a-9c92-f36248d7440a tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Getting quotas for user 9080d662d57448d8804703b4c201b77b and project 6e5ed140aa524fbbab716a4dacfb8f01. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:27:53.522198 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2cd11b84-fb1a-469a-9c92-f36248d7440a tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:27:53.524698 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2cd11b84-fb1a-469a-9c92-f36248d7440a tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] [instance: e50ad261-8551-407b-a56f-48b7f1a5389c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:27:53.705941 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2cd11b84-fb1a-469a-9c92-f36248d7440a tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.877680 Apr 16 21:27:53.717119 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2575/5315] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:27:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 16 21:27:53.718637 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-291263e2-263f-4ec3-99b4-c7a4e65d53a5 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:53.719406 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-291263e2-263f-4ec3-99b4-c7a4e65d53a5 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] [instance: e50ad261-8551-407b-a56f-48b7f1a5389c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:53.776357 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-291263e2-263f-4ec3-99b4-c7a4e65d53a5 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9080d662d57448d8804703b4c201b77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5ed140aa524fbbab716a4dacfb8f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:53.783684 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-291263e2-263f-4ec3-99b4-c7a4e65d53a5 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] 10.222.0.20 "GET /compute/v2.1/servers/e50ad261-8551-407b-a56f-48b7f1a5389c" status: 200 len: 1216 microversion: 2.1 time: 0.069422 Apr 16 21:27:53.785004 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2741/5316] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:53 2022] GET /compute/v2.1/servers/e50ad261-8551-407b-a56f-48b7f1a5389c => generated 1216 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:53.934646 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0f22f2b8-2abc-4b1d-a3b5-ab908c126fd4 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:53.935269 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0f22f2b8-2abc-4b1d-a3b5-ab908c126fd4 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 0a92a902-c20e-44c0-a263-013ab10917cf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:53.944292 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0f22f2b8-2abc-4b1d-a3b5-ab908c126fd4 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:53.944292 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0f22f2b8-2abc-4b1d-a3b5-ab908c126fd4 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:53.944694 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0f22f2b8-2abc-4b1d-a3b5-ab908c126fd4 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:53.945150 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0f22f2b8-2abc-4b1d-a3b5-ab908c126fd4 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:54.080363 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0f22f2b8-2abc-4b1d-a3b5-ab908c126fd4 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:54.095274 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0f22f2b8-2abc-4b1d-a3b5-ab908c126fd4 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/0a92a902-c20e-44c0-a263-013ab10917cf" status: 200 len: 1309 microversion: 2.1 time: 0.163912 Apr 16 21:27:54.097552 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2576/5317] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:53 2022] GET /compute/v2.1/servers/0a92a902-c20e-44c0-a263-013ab10917cf => generated 1309 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:54.801441 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4cb5f8d2-a00e-460a-a671-7891dc366faf tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:54.802069 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4cb5f8d2-a00e-460a-a671-7891dc366faf tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] [instance: e50ad261-8551-407b-a56f-48b7f1a5389c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:54.860948 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4cb5f8d2-a00e-460a-a671-7891dc366faf tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9080d662d57448d8804703b4c201b77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5ed140aa524fbbab716a4dacfb8f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:54.867538 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4cb5f8d2-a00e-460a-a671-7891dc366faf tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] 10.222.0.20 "GET /compute/v2.1/servers/e50ad261-8551-407b-a56f-48b7f1a5389c" status: 200 len: 1216 microversion: 2.1 time: 0.069982 Apr 16 21:27:54.868130 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2742/5318] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:54 2022] GET /compute/v2.1/servers/e50ad261-8551-407b-a56f-48b7f1a5389c => generated 1216 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:55.113794 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0fb2982c-2fdb-4172-968e-7e727d12c72f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:55.114374 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0fb2982c-2fdb-4172-968e-7e727d12c72f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 0a92a902-c20e-44c0-a263-013ab10917cf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:55.121409 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0fb2982c-2fdb-4172-968e-7e727d12c72f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:55.121868 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0fb2982c-2fdb-4172-968e-7e727d12c72f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:55.122656 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0fb2982c-2fdb-4172-968e-7e727d12c72f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:55.123103 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0fb2982c-2fdb-4172-968e-7e727d12c72f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:55.308838 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0fb2982c-2fdb-4172-968e-7e727d12c72f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:55.325828 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0fb2982c-2fdb-4172-968e-7e727d12c72f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/0a92a902-c20e-44c0-a263-013ab10917cf" status: 200 len: 1490 microversion: 2.1 time: 0.216265 Apr 16 21:27:55.332685 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2577/5319] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:55 2022] GET /compute/v2.1/servers/0a92a902-c20e-44c0-a263-013ab10917cf => generated 1490 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:55.346580 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8cf3cc1d-9f3d-4b01-bc04-29fbc4f62f5a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:55.348596 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8cf3cc1d-9f3d-4b01-bc04-29fbc4f62f5a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 5fee6363-9586-45b0-b643-e6dbd4652c80] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:55.355861 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8cf3cc1d-9f3d-4b01-bc04-29fbc4f62f5a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:55.357149 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8cf3cc1d-9f3d-4b01-bc04-29fbc4f62f5a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:55.358189 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8cf3cc1d-9f3d-4b01-bc04-29fbc4f62f5a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:55.358812 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8cf3cc1d-9f3d-4b01-bc04-29fbc4f62f5a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:55.505941 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8cf3cc1d-9f3d-4b01-bc04-29fbc4f62f5a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:55.513636 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8cf3cc1d-9f3d-4b01-bc04-29fbc4f62f5a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/5fee6363-9586-45b0-b643-e6dbd4652c80" status: 200 len: 1491 microversion: 2.1 time: 0.174446 Apr 16 21:27:55.514208 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2743/5320] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:55 2022] GET /compute/v2.1/servers/5fee6363-9586-45b0-b643-e6dbd4652c80 => generated 1491 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:27:55.531008 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-afa2cc31-c3df-409e-92bf-94ce57871f30 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:55.531623 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-afa2cc31-c3df-409e-92bf-94ce57871f30 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 0a92a902-c20e-44c0-a263-013ab10917cf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:55.538148 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-afa2cc31-c3df-409e-92bf-94ce57871f30 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:55.539319 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-afa2cc31-c3df-409e-92bf-94ce57871f30 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:55.541103 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-afa2cc31-c3df-409e-92bf-94ce57871f30 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:55.541907 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-afa2cc31-c3df-409e-92bf-94ce57871f30 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:55.680862 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-afa2cc31-c3df-409e-92bf-94ce57871f30 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:55.690603 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-afa2cc31-c3df-409e-92bf-94ce57871f30 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/0a92a902-c20e-44c0-a263-013ab10917cf" status: 200 len: 1490 microversion: 2.1 time: 0.163265 Apr 16 21:27:55.692143 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2578/5321] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:55 2022] GET /compute/v2.1/servers/0a92a902-c20e-44c0-a263-013ab10917cf => generated 1490 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:55.707320 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fa133365-7fb0-41c3-87ba-33d74216feff tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:55.707823 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fa133365-7fb0-41c3-87ba-33d74216feff tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 0a92a902-c20e-44c0-a263-013ab10917cf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:55.713810 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fa133365-7fb0-41c3-87ba-33d74216feff tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:55.714276 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fa133365-7fb0-41c3-87ba-33d74216feff tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:55.715052 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fa133365-7fb0-41c3-87ba-33d74216feff tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:55.715492 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fa133365-7fb0-41c3-87ba-33d74216feff tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:55.740100 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fa133365-7fb0-41c3-87ba-33d74216feff tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 0a92a902-c20e-44c0-a263-013ab10917cf] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:27:55.887840 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0f78fba3-5ad9-4a01-90b1-60663fe756ad tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:55.887840 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0f78fba3-5ad9-4a01-90b1-60663fe756ad tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] [instance: e50ad261-8551-407b-a56f-48b7f1a5389c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:55.893150 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0f78fba3-5ad9-4a01-90b1-60663fe756ad tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:55.893796 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0f78fba3-5ad9-4a01-90b1-60663fe756ad tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:55.894771 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0f78fba3-5ad9-4a01-90b1-60663fe756ad tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:55.895389 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0f78fba3-5ad9-4a01-90b1-60663fe756ad tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:55.965028 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0f78fba3-5ad9-4a01-90b1-60663fe756ad tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9080d662d57448d8804703b4c201b77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5ed140aa524fbbab716a4dacfb8f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:55.975830 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0f78fba3-5ad9-4a01-90b1-60663fe756ad tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] 10.222.0.20 "GET /compute/v2.1/servers/e50ad261-8551-407b-a56f-48b7f1a5389c" status: 200 len: 1268 microversion: 2.1 time: 0.095155 Apr 16 21:27:55.976501 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2579/5322] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:55 2022] GET /compute/v2.1/servers/e50ad261-8551-407b-a56f-48b7f1a5389c => generated 1268 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:56.110446 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fa133365-7fb0-41c3-87ba-33d74216feff tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0a92a902-c20e-44c0-a263-013ab10917cf" status: 204 len: 0 microversion: 2.1 time: 0.406663 Apr 16 21:27:56.112320 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2744/5323] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:27:55 2022] DELETE /compute/v2.1/servers/0a92a902-c20e-44c0-a263-013ab10917cf => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:27:56.121038 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6ab58e32-be2f-47d6-9623-80d4b9fe5e3f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:56.121747 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6ab58e32-be2f-47d6-9623-80d4b9fe5e3f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 0a92a902-c20e-44c0-a263-013ab10917cf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:56.130816 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6ab58e32-be2f-47d6-9623-80d4b9fe5e3f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:56.131282 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6ab58e32-be2f-47d6-9623-80d4b9fe5e3f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:56.132070 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6ab58e32-be2f-47d6-9623-80d4b9fe5e3f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:56.132585 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6ab58e32-be2f-47d6-9623-80d4b9fe5e3f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:56.266968 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6ab58e32-be2f-47d6-9623-80d4b9fe5e3f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:56.275456 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6ab58e32-be2f-47d6-9623-80d4b9fe5e3f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/0a92a902-c20e-44c0-a263-013ab10917cf" status: 200 len: 1496 microversion: 2.1 time: 0.159085 Apr 16 21:27:56.276621 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2580/5324] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:56 2022] GET /compute/v2.1/servers/0a92a902-c20e-44c0-a263-013ab10917cf => generated 1496 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:27:56.993720 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4d674347-41f1-4022-83a4-376f84b7d35e tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:56.994534 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4d674347-41f1-4022-83a4-376f84b7d35e tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] [instance: e50ad261-8551-407b-a56f-48b7f1a5389c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:57.006999 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4d674347-41f1-4022-83a4-376f84b7d35e tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:57.007538 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4d674347-41f1-4022-83a4-376f84b7d35e tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:57.008479 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4d674347-41f1-4022-83a4-376f84b7d35e tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:57.009056 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4d674347-41f1-4022-83a4-376f84b7d35e tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:57.072824 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4d674347-41f1-4022-83a4-376f84b7d35e tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9080d662d57448d8804703b4c201b77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5ed140aa524fbbab716a4dacfb8f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:57.081437 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4d674347-41f1-4022-83a4-376f84b7d35e tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] 10.222.0.20 "GET /compute/v2.1/servers/e50ad261-8551-407b-a56f-48b7f1a5389c" status: 200 len: 1274 microversion: 2.1 time: 0.091972 Apr 16 21:27:57.082002 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2745/5325] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:56 2022] GET /compute/v2.1/servers/e50ad261-8551-407b-a56f-48b7f1a5389c => generated 1274 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:57.293906 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d193feeb-d788-4482-97a5-91bea392eea4 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:57.294545 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d193feeb-d788-4482-97a5-91bea392eea4 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 0a92a902-c20e-44c0-a263-013ab10917cf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:57.301599 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d193feeb-d788-4482-97a5-91bea392eea4 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:57.302314 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d193feeb-d788-4482-97a5-91bea392eea4 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:57.303277 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d193feeb-d788-4482-97a5-91bea392eea4 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:57.303723 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d193feeb-d788-4482-97a5-91bea392eea4 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:57.679385 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d193feeb-d788-4482-97a5-91bea392eea4 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:57.701833 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d193feeb-d788-4482-97a5-91bea392eea4 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/0a92a902-c20e-44c0-a263-013ab10917cf" status: 200 len: 1496 microversion: 2.1 time: 0.411895 Apr 16 21:27:57.702860 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2581/5326] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:57 2022] GET /compute/v2.1/servers/0a92a902-c20e-44c0-a263-013ab10917cf => generated 1496 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:58.102640 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9d818a9e-4e9c-496a-b7aa-eb61d038ab1d tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:58.104023 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9d818a9e-4e9c-496a-b7aa-eb61d038ab1d tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] [instance: e50ad261-8551-407b-a56f-48b7f1a5389c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:58.110818 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9d818a9e-4e9c-496a-b7aa-eb61d038ab1d tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:58.112302 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9d818a9e-4e9c-496a-b7aa-eb61d038ab1d tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:58.113375 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9d818a9e-4e9c-496a-b7aa-eb61d038ab1d tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:58.114131 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9d818a9e-4e9c-496a-b7aa-eb61d038ab1d tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:58.375501 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-294fa6c9-f8d0-4b29-ab0e-9cd4b13cd51b req-81c60a4e-bc10-46c0-8a1b-ebe99c02bbb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a92a902-c20e-44c0-a263-013ab10917cf", "name": "network-vif-deleted", "tag": "eaf83a7a-9efb-4182-ba3c-eac518b2605d"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:27:58.395887 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-294fa6c9-f8d0-4b29-ab0e-9cd4b13cd51b req-81c60a4e-bc10-46c0-8a1b-ebe99c02bbb5 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:58.396383 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-294fa6c9-f8d0-4b29-ab0e-9cd4b13cd51b req-81c60a4e-bc10-46c0-8a1b-ebe99c02bbb5 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:58.449235 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-294fa6c9-f8d0-4b29-ab0e-9cd4b13cd51b req-81c60a4e-bc10-46c0-8a1b-ebe99c02bbb5 service nova] Creating event network-vif-deleted:eaf83a7a-9efb-4182-ba3c-eac518b2605d for instance 0a92a902-c20e-44c0-a263-013ab10917cf on nch2-master-1 Apr 16 21:27:58.459233 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-294fa6c9-f8d0-4b29-ab0e-9cd4b13cd51b req-81c60a4e-bc10-46c0-8a1b-ebe99c02bbb5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087356 Apr 16 21:27:58.461564 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2582/5327] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:27:58.466009 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9d818a9e-4e9c-496a-b7aa-eb61d038ab1d tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9080d662d57448d8804703b4c201b77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5ed140aa524fbbab716a4dacfb8f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:58.478459 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9d818a9e-4e9c-496a-b7aa-eb61d038ab1d tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] 10.222.0.20 "GET /compute/v2.1/servers/e50ad261-8551-407b-a56f-48b7f1a5389c" status: 200 len: 1316 microversion: 2.1 time: 0.382437 Apr 16 21:27:58.484559 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2746/5328] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:58 2022] GET /compute/v2.1/servers/e50ad261-8551-407b-a56f-48b7f1a5389c => generated 1316 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:58.734071 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1d24657b-6070-47fc-ab3a-b31bac63fa3d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:58.735405 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1d24657b-6070-47fc-ab3a-b31bac63fa3d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 0a92a902-c20e-44c0-a263-013ab10917cf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:58.751307 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1d24657b-6070-47fc-ab3a-b31bac63fa3d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:58.752494 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1d24657b-6070-47fc-ab3a-b31bac63fa3d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:58.753309 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1d24657b-6070-47fc-ab3a-b31bac63fa3d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:58.753853 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1d24657b-6070-47fc-ab3a-b31bac63fa3d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:58.896491 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1d24657b-6070-47fc-ab3a-b31bac63fa3d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:58.905711 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1d24657b-6070-47fc-ab3a-b31bac63fa3d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/0a92a902-c20e-44c0-a263-013ab10917cf" status: 200 len: 1294 microversion: 2.1 time: 0.190573 Apr 16 21:27:58.919904 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2583/5329] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:58 2022] GET /compute/v2.1/servers/0a92a902-c20e-44c0-a263-013ab10917cf => generated 1294 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:59.086093 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-af1e11c8-b909-406c-a6d4-d02043655048 req-b1e88474-2b27-45be-94b1-0abb3968219a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e50ad261-8551-407b-a56f-48b7f1a5389c", "tag": "3d9a4e8b-28a1-48e2-9811-5b84e7f1d2b3"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:27:59.094401 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-af1e11c8-b909-406c-a6d4-d02043655048 req-b1e88474-2b27-45be-94b1-0abb3968219a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:59.095141 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-af1e11c8-b909-406c-a6d4-d02043655048 req-b1e88474-2b27-45be-94b1-0abb3968219a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:59.106689 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-af1e11c8-b909-406c-a6d4-d02043655048 req-b1e88474-2b27-45be-94b1-0abb3968219a service nova] Creating event network-changed:3d9a4e8b-28a1-48e2-9811-5b84e7f1d2b3 for instance e50ad261-8551-407b-a56f-48b7f1a5389c on nch1-master-1 Apr 16 21:27:59.111811 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-af1e11c8-b909-406c-a6d4-d02043655048 req-b1e88474-2b27-45be-94b1-0abb3968219a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029767 Apr 16 21:27:59.112688 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2747/5330] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:27:59.496335 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d9cdc22f-9e1a-45bb-a695-04a90790fabb tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:59.496878 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d9cdc22f-9e1a-45bb-a695-04a90790fabb tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] [instance: e50ad261-8551-407b-a56f-48b7f1a5389c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:59.506299 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d9cdc22f-9e1a-45bb-a695-04a90790fabb tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:59.506760 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d9cdc22f-9e1a-45bb-a695-04a90790fabb tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:59.507740 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d9cdc22f-9e1a-45bb-a695-04a90790fabb tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:59.508546 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d9cdc22f-9e1a-45bb-a695-04a90790fabb tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:59.734222 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d9cdc22f-9e1a-45bb-a695-04a90790fabb tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9080d662d57448d8804703b4c201b77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5ed140aa524fbbab716a4dacfb8f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:27:59.742506 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d9cdc22f-9e1a-45bb-a695-04a90790fabb tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] 10.222.0.20 "GET /compute/v2.1/servers/e50ad261-8551-407b-a56f-48b7f1a5389c" status: 200 len: 1316 microversion: 2.1 time: 0.251424 Apr 16 21:27:59.751801 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2584/5331] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:59 2022] GET /compute/v2.1/servers/e50ad261-8551-407b-a56f-48b7f1a5389c => generated 1316 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:27:59.928286 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4bbdd9d4-4618-44e0-bbec-e61736229aa2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:59.929098 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4bbdd9d4-4618-44e0-bbec-e61736229aa2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 0a92a902-c20e-44c0-a263-013ab10917cf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:59.935803 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4bbdd9d4-4618-44e0-bbec-e61736229aa2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:59.936299 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4bbdd9d4-4618-44e0-bbec-e61736229aa2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:59.937123 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4bbdd9d4-4618-44e0-bbec-e61736229aa2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:59.937626 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4bbdd9d4-4618-44e0-bbec-e61736229aa2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:59.951241 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-4bbdd9d4-4618-44e0-bbec-e61736229aa2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] HTTP exception thrown: Instance 0a92a902-c20e-44c0-a263-013ab10917cf could not be found. Apr 16 21:27:59.951849 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4bbdd9d4-4618-44e0-bbec-e61736229aa2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Returning 404 to user: Instance 0a92a902-c20e-44c0-a263-013ab10917cf could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:27:59.952749 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4bbdd9d4-4618-44e0-bbec-e61736229aa2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/0a92a902-c20e-44c0-a263-013ab10917cf" status: 404 len: 111 microversion: 2.1 time: 0.029558 Apr 16 21:27:59.953311 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2748/5332] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:27:59 2022] GET /compute/v2.1/servers/0a92a902-c20e-44c0-a263-013ab10917cf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:27:59.962930 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d7a05c66-985e-44a2-8f51-669c719ea38a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:27:59.963344 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d7a05c66-985e-44a2-8f51-669c719ea38a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 5fee6363-9586-45b0-b643-e6dbd4652c80] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:27:59.969499 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d7a05c66-985e-44a2-8f51-669c719ea38a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:59.969982 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d7a05c66-985e-44a2-8f51-669c719ea38a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:59.971394 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d7a05c66-985e-44a2-8f51-669c719ea38a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:27:59.971837 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d7a05c66-985e-44a2-8f51-669c719ea38a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:27:59.995767 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d7a05c66-985e-44a2-8f51-669c719ea38a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 5fee6363-9586-45b0-b643-e6dbd4652c80] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:28:00.364370 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d7a05c66-985e-44a2-8f51-669c719ea38a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5fee6363-9586-45b0-b643-e6dbd4652c80" status: 204 len: 0 microversion: 2.1 time: 0.405014 Apr 16 21:28:00.364968 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2585/5333] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:27:59 2022] DELETE /compute/v2.1/servers/5fee6363-9586-45b0-b643-e6dbd4652c80 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:28:00.373283 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-38290ee3-1152-4e11-b69c-5d58296fc61e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:00.373899 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-38290ee3-1152-4e11-b69c-5d58296fc61e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 5fee6363-9586-45b0-b643-e6dbd4652c80] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:00.381197 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-38290ee3-1152-4e11-b69c-5d58296fc61e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:00.381659 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-38290ee3-1152-4e11-b69c-5d58296fc61e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:00.382443 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-38290ee3-1152-4e11-b69c-5d58296fc61e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:00.382889 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-38290ee3-1152-4e11-b69c-5d58296fc61e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:00.529087 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-38290ee3-1152-4e11-b69c-5d58296fc61e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:00.537105 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-38290ee3-1152-4e11-b69c-5d58296fc61e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/5fee6363-9586-45b0-b643-e6dbd4652c80" status: 200 len: 1497 microversion: 2.1 time: 0.167862 Apr 16 21:28:00.537708 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2749/5334] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:00 2022] GET /compute/v2.1/servers/5fee6363-9586-45b0-b643-e6dbd4652c80 => generated 1497 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:00.767904 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c7ce663a-a962-413d-a3a3-b5a2d373badf tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:00.768631 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c7ce663a-a962-413d-a3a3-b5a2d373badf tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] [instance: e50ad261-8551-407b-a56f-48b7f1a5389c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:00.775513 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c7ce663a-a962-413d-a3a3-b5a2d373badf tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:00.781304 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c7ce663a-a962-413d-a3a3-b5a2d373badf tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:00.781304 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c7ce663a-a962-413d-a3a3-b5a2d373badf tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:00.781304 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c7ce663a-a962-413d-a3a3-b5a2d373badf tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:00.921500 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c7ce663a-a962-413d-a3a3-b5a2d373badf tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9080d662d57448d8804703b4c201b77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5ed140aa524fbbab716a4dacfb8f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:00.931505 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c7ce663a-a962-413d-a3a3-b5a2d373badf tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] 10.222.0.20 "GET /compute/v2.1/servers/e50ad261-8551-407b-a56f-48b7f1a5389c" status: 200 len: 1316 microversion: 2.1 time: 0.166550 Apr 16 21:28:00.932007 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2586/5335] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:00 2022] GET /compute/v2.1/servers/e50ad261-8551-407b-a56f-48b7f1a5389c => generated 1316 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:01.559210 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-332a7e4a-f0c9-40d4-acb8-a8a18eca65de tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:01.563889 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-332a7e4a-f0c9-40d4-acb8-a8a18eca65de tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 5fee6363-9586-45b0-b643-e6dbd4652c80] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:01.573234 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-332a7e4a-f0c9-40d4-acb8-a8a18eca65de tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:01.573950 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-332a7e4a-f0c9-40d4-acb8-a8a18eca65de tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:01.574964 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-332a7e4a-f0c9-40d4-acb8-a8a18eca65de tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:01.575859 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-332a7e4a-f0c9-40d4-acb8-a8a18eca65de tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:01.729919 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-332a7e4a-f0c9-40d4-acb8-a8a18eca65de tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:01.738539 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-332a7e4a-f0c9-40d4-acb8-a8a18eca65de tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/5fee6363-9586-45b0-b643-e6dbd4652c80" status: 200 len: 1497 microversion: 2.1 time: 0.185446 Apr 16 21:28:01.739314 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2750/5336] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:01 2022] GET /compute/v2.1/servers/5fee6363-9586-45b0-b643-e6dbd4652c80 => generated 1497 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:02.023558 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fb58f98c-500d-41fd-b781-acfb5653c492 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:02.023558 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-fb58f98c-500d-41fd-b781-acfb5653c492 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] [instance: e50ad261-8551-407b-a56f-48b7f1a5389c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:02.023558 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fb58f98c-500d-41fd-b781-acfb5653c492 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:02.023558 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fb58f98c-500d-41fd-b781-acfb5653c492 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:02.023558 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fb58f98c-500d-41fd-b781-acfb5653c492 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:02.023558 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fb58f98c-500d-41fd-b781-acfb5653c492 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:02.148337 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-fb58f98c-500d-41fd-b781-acfb5653c492 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9080d662d57448d8804703b4c201b77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5ed140aa524fbbab716a4dacfb8f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:02.156810 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fb58f98c-500d-41fd-b781-acfb5653c492 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] 10.222.0.20 "GET /compute/v2.1/servers/e50ad261-8551-407b-a56f-48b7f1a5389c" status: 200 len: 1316 microversion: 2.1 time: 0.211015 Apr 16 21:28:02.157387 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2587/5337] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:01 2022] GET /compute/v2.1/servers/e50ad261-8551-407b-a56f-48b7f1a5389c => generated 1316 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:02.755760 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ac078886-ab5e-498a-83f8-0083e6fcd8f9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:02.756424 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ac078886-ab5e-498a-83f8-0083e6fcd8f9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 5fee6363-9586-45b0-b643-e6dbd4652c80] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:02.763332 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ac078886-ab5e-498a-83f8-0083e6fcd8f9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:02.763886 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ac078886-ab5e-498a-83f8-0083e6fcd8f9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:02.764787 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ac078886-ab5e-498a-83f8-0083e6fcd8f9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:02.765234 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ac078886-ab5e-498a-83f8-0083e6fcd8f9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:02.950250 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ac078886-ab5e-498a-83f8-0083e6fcd8f9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:02.961493 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ac078886-ab5e-498a-83f8-0083e6fcd8f9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/5fee6363-9586-45b0-b643-e6dbd4652c80" status: 200 len: 1497 microversion: 2.1 time: 0.209912 Apr 16 21:28:02.962560 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2751/5338] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:02 2022] GET /compute/v2.1/servers/5fee6363-9586-45b0-b643-e6dbd4652c80 => generated 1497 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:03.175488 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1d7ad87d-dc91-4fba-b85f-7e8a6a188e35 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:03.176797 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1d7ad87d-dc91-4fba-b85f-7e8a6a188e35 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] [instance: e50ad261-8551-407b-a56f-48b7f1a5389c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:03.183580 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1d7ad87d-dc91-4fba-b85f-7e8a6a188e35 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:03.184118 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1d7ad87d-dc91-4fba-b85f-7e8a6a188e35 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:03.185171 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1d7ad87d-dc91-4fba-b85f-7e8a6a188e35 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:03.185688 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1d7ad87d-dc91-4fba-b85f-7e8a6a188e35 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:03.384622 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1d7ad87d-dc91-4fba-b85f-7e8a6a188e35 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9080d662d57448d8804703b4c201b77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5ed140aa524fbbab716a4dacfb8f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:03.392896 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1d7ad87d-dc91-4fba-b85f-7e8a6a188e35 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] 10.222.0.20 "GET /compute/v2.1/servers/e50ad261-8551-407b-a56f-48b7f1a5389c" status: 200 len: 1316 microversion: 2.1 time: 0.222075 Apr 16 21:28:03.393639 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2588/5339] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:03 2022] GET /compute/v2.1/servers/e50ad261-8551-407b-a56f-48b7f1a5389c => generated 1316 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:03.570649 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-54e3ce98-105f-4ee3-b82f-573931d05fb4 req-d1b2ef6b-215c-4669-ba91-1c68239ff0c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fee6363-9586-45b0-b643-e6dbd4652c80", "name": "network-vif-deleted", "tag": "d10ac50b-d5ee-49cc-85a7-303e299725ee"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:28:03.586236 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-54e3ce98-105f-4ee3-b82f-573931d05fb4 req-d1b2ef6b-215c-4669-ba91-1c68239ff0c5 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:03.586236 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-54e3ce98-105f-4ee3-b82f-573931d05fb4 req-d1b2ef6b-215c-4669-ba91-1c68239ff0c5 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:03.593998 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-54e3ce98-105f-4ee3-b82f-573931d05fb4 req-d1b2ef6b-215c-4669-ba91-1c68239ff0c5 service nova] Creating event network-vif-deleted:d10ac50b-d5ee-49cc-85a7-303e299725ee for instance 5fee6363-9586-45b0-b643-e6dbd4652c80 on nch1-master-1 Apr 16 21:28:03.598452 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-54e3ce98-105f-4ee3-b82f-573931d05fb4 req-d1b2ef6b-215c-4669-ba91-1c68239ff0c5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031590 Apr 16 21:28:03.599350 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2752/5340] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:28:03.808765 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-2981c38d-496d-4c43-a489-1aa661515725 req-e53537bc-9af7-479f-8bc3-1b6f843118dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e50ad261-8551-407b-a56f-48b7f1a5389c", "name": "network-vif-plugged", "status": "completed", "tag": "3d9a4e8b-28a1-48e2-9811-5b84e7f1d2b3"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:28:03.816910 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-2981c38d-496d-4c43-a489-1aa661515725 req-e53537bc-9af7-479f-8bc3-1b6f843118dd service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:03.817365 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-2981c38d-496d-4c43-a489-1aa661515725 req-e53537bc-9af7-479f-8bc3-1b6f843118dd service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:03.829134 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-2981c38d-496d-4c43-a489-1aa661515725 req-e53537bc-9af7-479f-8bc3-1b6f843118dd service nova] Creating event network-vif-plugged:3d9a4e8b-28a1-48e2-9811-5b84e7f1d2b3 for instance e50ad261-8551-407b-a56f-48b7f1a5389c on nch1-master-1 Apr 16 21:28:03.834737 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-2981c38d-496d-4c43-a489-1aa661515725 req-e53537bc-9af7-479f-8bc3-1b6f843118dd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033005 Apr 16 21:28:03.835200 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2589/5341] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:28:03.980345 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5853c9c2-7e80-4e37-8ace-61a63efd5c03 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:03.983818 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5853c9c2-7e80-4e37-8ace-61a63efd5c03 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 5fee6363-9586-45b0-b643-e6dbd4652c80] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:03.987768 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5853c9c2-7e80-4e37-8ace-61a63efd5c03 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:03.988327 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5853c9c2-7e80-4e37-8ace-61a63efd5c03 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:03.989229 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5853c9c2-7e80-4e37-8ace-61a63efd5c03 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:03.989746 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5853c9c2-7e80-4e37-8ace-61a63efd5c03 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:04.020864 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5853c9c2-7e80-4e37-8ace-61a63efd5c03 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:04.021353 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5853c9c2-7e80-4e37-8ace-61a63efd5c03 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:04.021813 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-5853c9c2-7e80-4e37-8ace-61a63efd5c03 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lazy-loading 'fault' on Instance uuid 5fee6363-9586-45b0-b643-e6dbd4652c80 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:28:04.068066 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5853c9c2-7e80-4e37-8ace-61a63efd5c03 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:04.076558 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5853c9c2-7e80-4e37-8ace-61a63efd5c03 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/5fee6363-9586-45b0-b643-e6dbd4652c80" status: 200 len: 1299 microversion: 2.1 time: 0.101246 Apr 16 21:28:04.079923 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2753/5342] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:03 2022] GET /compute/v2.1/servers/5fee6363-9586-45b0-b643-e6dbd4652c80 => generated 1299 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:04.414129 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-43262e3f-4d75-4efe-a593-805bb7a048d8 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:04.424469 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-43262e3f-4d75-4efe-a593-805bb7a048d8 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] [instance: e50ad261-8551-407b-a56f-48b7f1a5389c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:04.436069 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-43262e3f-4d75-4efe-a593-805bb7a048d8 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:04.439107 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-43262e3f-4d75-4efe-a593-805bb7a048d8 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:04.441927 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-43262e3f-4d75-4efe-a593-805bb7a048d8 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:04.444216 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-43262e3f-4d75-4efe-a593-805bb7a048d8 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:04.632945 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-43262e3f-4d75-4efe-a593-805bb7a048d8 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9080d662d57448d8804703b4c201b77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5ed140aa524fbbab716a4dacfb8f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:04.642784 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-43262e3f-4d75-4efe-a593-805bb7a048d8 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] 10.222.0.20 "GET /compute/v2.1/servers/e50ad261-8551-407b-a56f-48b7f1a5389c" status: 200 len: 1316 microversion: 2.1 time: 0.236167 Apr 16 21:28:04.643438 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2590/5343] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:04 2022] GET /compute/v2.1/servers/e50ad261-8551-407b-a56f-48b7f1a5389c => generated 1316 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:05.103458 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c0a40bcb-5694-4fdd-bd58-f5a87f0a5d58 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:05.104116 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c0a40bcb-5694-4fdd-bd58-f5a87f0a5d58 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 5fee6363-9586-45b0-b643-e6dbd4652c80] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:05.112890 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c0a40bcb-5694-4fdd-bd58-f5a87f0a5d58 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:05.113297 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c0a40bcb-5694-4fdd-bd58-f5a87f0a5d58 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:05.114101 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c0a40bcb-5694-4fdd-bd58-f5a87f0a5d58 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:05.114549 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c0a40bcb-5694-4fdd-bd58-f5a87f0a5d58 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:05.130858 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-c0a40bcb-5694-4fdd-bd58-f5a87f0a5d58 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] HTTP exception thrown: Instance 5fee6363-9586-45b0-b643-e6dbd4652c80 could not be found. Apr 16 21:28:05.131463 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c0a40bcb-5694-4fdd-bd58-f5a87f0a5d58 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Returning 404 to user: Instance 5fee6363-9586-45b0-b643-e6dbd4652c80 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:28:05.132563 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c0a40bcb-5694-4fdd-bd58-f5a87f0a5d58 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/5fee6363-9586-45b0-b643-e6dbd4652c80" status: 404 len: 111 microversion: 2.1 time: 0.033544 Apr 16 21:28:05.133123 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2754/5344] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:05 2022] GET /compute/v2.1/servers/5fee6363-9586-45b0-b643-e6dbd4652c80 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:28:05.276186 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bb4f41b9-2d8b-43cd-93bc-64ae77318147 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-490825375", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "8f593006-a7a9-4abc-8409-1d78959e9c9f"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:28:05.337077 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-bb4f41b9-2d8b-43cd-93bc-64ae77318147 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] validate_networks() for [('8f593006-a7a9-4abc-8409-1d78959e9c9f', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:28:05.660488 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2298daf0-0150-4254-ad69-a22741b5168c tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:05.661114 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2298daf0-0150-4254-ad69-a22741b5168c tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] [instance: e50ad261-8551-407b-a56f-48b7f1a5389c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:05.674107 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2298daf0-0150-4254-ad69-a22741b5168c tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:05.678721 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2298daf0-0150-4254-ad69-a22741b5168c tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:05.678721 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2298daf0-0150-4254-ad69-a22741b5168c tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:05.678721 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2298daf0-0150-4254-ad69-a22741b5168c tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:05.795973 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-bb4f41b9-2d8b-43cd-93bc-64ae77318147 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:28:05.796531 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-bb4f41b9-2d8b-43cd-93bc-64ae77318147 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:28:05.799198 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-bb4f41b9-2d8b-43cd-93bc-64ae77318147 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:28:05.799198 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-bb4f41b9-2d8b-43cd-93bc-64ae77318147 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:28:05.799198 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-bb4f41b9-2d8b-43cd-93bc-64ae77318147 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:28:05.806357 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bb4f41b9-2d8b-43cd-93bc-64ae77318147 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:05.806911 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bb4f41b9-2d8b-43cd-93bc-64ae77318147 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:05.807784 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bb4f41b9-2d8b-43cd-93bc-64ae77318147 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:05.808322 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bb4f41b9-2d8b-43cd-93bc-64ae77318147 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:05.835369 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-bb4f41b9-2d8b-43cd-93bc-64ae77318147 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Getting quotas for project 76fd883ad3944fcaaecdf2909120dc87. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:28:05.841506 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-bb4f41b9-2d8b-43cd-93bc-64ae77318147 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Getting quotas for user 5e71b35f438d4539a60a390e1ceec9cd and project 76fd883ad3944fcaaecdf2909120dc87. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:28:05.869326 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bb4f41b9-2d8b-43cd-93bc-64ae77318147 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:28:05.879697 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bb4f41b9-2d8b-43cd-93bc-64ae77318147 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: cf7be0a6-93c6-4c84-93a1-014223a63aea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:28:05.887168 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2298daf0-0150-4254-ad69-a22741b5168c tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9080d662d57448d8804703b4c201b77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5ed140aa524fbbab716a4dacfb8f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:05.898407 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2298daf0-0150-4254-ad69-a22741b5168c tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] 10.222.0.20 "GET /compute/v2.1/servers/e50ad261-8551-407b-a56f-48b7f1a5389c" status: 200 len: 1505 microversion: 2.1 time: 0.241292 Apr 16 21:28:05.899398 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2755/5345] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:05 2022] GET /compute/v2.1/servers/e50ad261-8551-407b-a56f-48b7f1a5389c => generated 1505 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:05.916433 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c765b2dd-d747-4478-94c7-a2b644e1f959 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:05.916941 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c765b2dd-d747-4478-94c7-a2b644e1f959 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] [instance: e50ad261-8551-407b-a56f-48b7f1a5389c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:05.923387 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c765b2dd-d747-4478-94c7-a2b644e1f959 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:05.923915 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c765b2dd-d747-4478-94c7-a2b644e1f959 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:05.924739 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c765b2dd-d747-4478-94c7-a2b644e1f959 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:05.925206 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c765b2dd-d747-4478-94c7-a2b644e1f959 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:05.950020 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c765b2dd-d747-4478-94c7-a2b644e1f959 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] 10.222.0.20 "GET /compute/v2.1/servers/e50ad261-8551-407b-a56f-48b7f1a5389c/ips" status: 200 len: 109 microversion: 2.1 time: 0.037862 Apr 16 21:28:05.950611 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2756/5346] 10.222.0.20 () {58 vars in 1247 bytes} [Sat Apr 16 21:28:05 2022] GET /compute/v2.1/servers/e50ad261-8551-407b-a56f-48b7f1a5389c/ips => generated 109 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:28:05.962890 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-91efebf9-ea51-4636-b5db-9a0ab379df69 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:05.963391 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-91efebf9-ea51-4636-b5db-9a0ab379df69 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] [instance: e50ad261-8551-407b-a56f-48b7f1a5389c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:05.969384 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-91efebf9-ea51-4636-b5db-9a0ab379df69 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:05.969843 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-91efebf9-ea51-4636-b5db-9a0ab379df69 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:05.970827 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-91efebf9-ea51-4636-b5db-9a0ab379df69 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:05.971275 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-91efebf9-ea51-4636-b5db-9a0ab379df69 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:05.994922 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-91efebf9-ea51-4636-b5db-9a0ab379df69 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] 10.222.0.20 "GET /compute/v2.1/servers/e50ad261-8551-407b-a56f-48b7f1a5389c/ips" status: 200 len: 109 microversion: 2.1 time: 0.036207 Apr 16 21:28:05.995502 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2757/5347] 10.222.0.20 () {58 vars in 1247 bytes} [Sat Apr 16 21:28:05 2022] GET /compute/v2.1/servers/e50ad261-8551-407b-a56f-48b7f1a5389c/ips => generated 109 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:28:06.005218 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bb4f41b9-2d8b-43cd-93bc-64ae77318147 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.733253 Apr 16 21:28:06.006966 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-44295d90-6ce1-4560-8716-026ae38332ae tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:06.007478 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-44295d90-6ce1-4560-8716-026ae38332ae tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] [instance: e50ad261-8551-407b-a56f-48b7f1a5389c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:06.017043 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-44295d90-6ce1-4560-8716-026ae38332ae tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:06.017540 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-44295d90-6ce1-4560-8716-026ae38332ae tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:06.018336 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-44295d90-6ce1-4560-8716-026ae38332ae tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:06.018529 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2591/5348] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:28:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:28:06.018781 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-44295d90-6ce1-4560-8716-026ae38332ae tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:06.028663 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-41d086ab-21fe-4c41-8a85-dcdac0648bd5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:06.032821 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-41d086ab-21fe-4c41-8a85-dcdac0648bd5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: cf7be0a6-93c6-4c84-93a1-014223a63aea] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:06.051366 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-44295d90-6ce1-4560-8716-026ae38332ae tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] 10.222.0.20 "GET /compute/v2.1/servers/e50ad261-8551-407b-a56f-48b7f1a5389c/ips/tempest-ServerAddressesTestJSON-1145292408-network" status: 200 len: 94 microversion: 2.1 time: 0.047894 Apr 16 21:28:06.053970 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2758/5349] 10.222.0.20 () {58 vars in 1400 bytes} [Sat Apr 16 21:28:06 2022] GET /compute/v2.1/servers/e50ad261-8551-407b-a56f-48b7f1a5389c/ips/tempest-ServerAddressesTestJSON-1145292408-network => generated 94 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 16 21:28:06.076911 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0ee6b072-80b6-445d-999d-bba44384e187 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:06.077636 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0ee6b072-80b6-445d-999d-bba44384e187 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] [instance: e50ad261-8551-407b-a56f-48b7f1a5389c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:06.085806 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0ee6b072-80b6-445d-999d-bba44384e187 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:06.086546 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0ee6b072-80b6-445d-999d-bba44384e187 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:06.087484 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0ee6b072-80b6-445d-999d-bba44384e187 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:06.088399 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0ee6b072-80b6-445d-999d-bba44384e187 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:06.093467 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-41d086ab-21fe-4c41-8a85-dcdac0648bd5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:06.101824 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-41d086ab-21fe-4c41-8a85-dcdac0648bd5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea" status: 200 len: 1208 microversion: 2.1 time: 0.081798 Apr 16 21:28:06.102871 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2592/5350] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:06 2022] GET /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea => generated 1208 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:06.140296 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0ee6b072-80b6-445d-999d-bba44384e187 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] [instance: e50ad261-8551-407b-a56f-48b7f1a5389c] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:28:06.518984 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0ee6b072-80b6-445d-999d-bba44384e187 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e50ad261-8551-407b-a56f-48b7f1a5389c" status: 204 len: 0 microversion: 2.1 time: 0.448157 Apr 16 21:28:06.519693 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2759/5351] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:28:06 2022] DELETE /compute/v2.1/servers/e50ad261-8551-407b-a56f-48b7f1a5389c => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:28:06.528214 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-49b5daad-ff3f-44bc-846e-0832ff1ed113 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:06.528828 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-49b5daad-ff3f-44bc-846e-0832ff1ed113 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] [instance: e50ad261-8551-407b-a56f-48b7f1a5389c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:06.536249 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-49b5daad-ff3f-44bc-846e-0832ff1ed113 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:06.536707 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-49b5daad-ff3f-44bc-846e-0832ff1ed113 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:06.537510 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-49b5daad-ff3f-44bc-846e-0832ff1ed113 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:06.538049 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-49b5daad-ff3f-44bc-846e-0832ff1ed113 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:06.722148 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-49b5daad-ff3f-44bc-846e-0832ff1ed113 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9080d662d57448d8804703b4c201b77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5ed140aa524fbbab716a4dacfb8f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:06.735009 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-49b5daad-ff3f-44bc-846e-0832ff1ed113 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] 10.222.0.20 "GET /compute/v2.1/servers/e50ad261-8551-407b-a56f-48b7f1a5389c" status: 200 len: 1511 microversion: 2.1 time: 0.210716 Apr 16 21:28:06.735624 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2593/5352] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:06 2022] GET /compute/v2.1/servers/e50ad261-8551-407b-a56f-48b7f1a5389c => generated 1511 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:06.787173 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-32ceea42-0604-49f0-a2f7-7eb9cf1046ca tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:06.787981 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-32ceea42-0604-49f0-a2f7-7eb9cf1046ca tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 6eb61102-0483-413f-88b9-7519c852b7f6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:06.794170 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-32ceea42-0604-49f0-a2f7-7eb9cf1046ca tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:06.794670 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-32ceea42-0604-49f0-a2f7-7eb9cf1046ca tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:06.795522 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-32ceea42-0604-49f0-a2f7-7eb9cf1046ca tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:06.796150 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-32ceea42-0604-49f0-a2f7-7eb9cf1046ca tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:06.819971 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-32ceea42-0604-49f0-a2f7-7eb9cf1046ca tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6/ips" status: 200 len: 151 microversion: 2.1 time: 0.038860 Apr 16 21:28:06.820790 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2760/5353] 10.222.0.20 () {58 vars in 1247 bytes} [Sat Apr 16 21:28:06 2022] GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:28:07.120785 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d15577d1-3b77-4b86-985e-fc0cdf19c038 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:07.122301 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d15577d1-3b77-4b86-985e-fc0cdf19c038 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: cf7be0a6-93c6-4c84-93a1-014223a63aea] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:07.176020 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d15577d1-3b77-4b86-985e-fc0cdf19c038 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:07.183233 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d15577d1-3b77-4b86-985e-fc0cdf19c038 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea" status: 200 len: 1208 microversion: 2.1 time: 0.067360 Apr 16 21:28:07.183822 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2594/5354] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:07 2022] GET /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea => generated 1208 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:07.754225 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0383fe02-68cc-445e-8136-71f0042d10b2 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:07.754852 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0383fe02-68cc-445e-8136-71f0042d10b2 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] [instance: e50ad261-8551-407b-a56f-48b7f1a5389c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:07.761794 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0383fe02-68cc-445e-8136-71f0042d10b2 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:07.762255 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0383fe02-68cc-445e-8136-71f0042d10b2 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:07.763214 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0383fe02-68cc-445e-8136-71f0042d10b2 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:07.763805 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0383fe02-68cc-445e-8136-71f0042d10b2 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:07.965024 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0383fe02-68cc-445e-8136-71f0042d10b2 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9080d662d57448d8804703b4c201b77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5ed140aa524fbbab716a4dacfb8f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:07.973705 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0383fe02-68cc-445e-8136-71f0042d10b2 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] 10.222.0.20 "GET /compute/v2.1/servers/e50ad261-8551-407b-a56f-48b7f1a5389c" status: 200 len: 1511 microversion: 2.1 time: 0.224097 Apr 16 21:28:07.974548 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2761/5355] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:07 2022] GET /compute/v2.1/servers/e50ad261-8551-407b-a56f-48b7f1a5389c => generated 1511 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:08.204004 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a002650a-382a-43a5-ad3e-bec9cb2d0170 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:08.204004 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a002650a-382a-43a5-ad3e-bec9cb2d0170 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: cf7be0a6-93c6-4c84-93a1-014223a63aea] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:08.211522 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a002650a-382a-43a5-ad3e-bec9cb2d0170 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:08.212137 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a002650a-382a-43a5-ad3e-bec9cb2d0170 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:08.212972 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a002650a-382a-43a5-ad3e-bec9cb2d0170 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:08.213421 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a002650a-382a-43a5-ad3e-bec9cb2d0170 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:08.278229 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a002650a-382a-43a5-ad3e-bec9cb2d0170 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:08.287008 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a002650a-382a-43a5-ad3e-bec9cb2d0170 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea" status: 200 len: 1260 microversion: 2.1 time: 0.090023 Apr 16 21:28:08.287600 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2595/5356] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:08 2022] GET /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea => generated 1260 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:08.446600 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-8dc0a5d7-2ad4-4588-b3c2-e6a68a96ea20 req-e5249824-1740-4884-b705-5c5e34cde5ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e50ad261-8551-407b-a56f-48b7f1a5389c", "name": "network-vif-deleted", "tag": "3d9a4e8b-28a1-48e2-9811-5b84e7f1d2b3"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:28:08.459536 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-8dc0a5d7-2ad4-4588-b3c2-e6a68a96ea20 req-e5249824-1740-4884-b705-5c5e34cde5ec service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:08.459991 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-8dc0a5d7-2ad4-4588-b3c2-e6a68a96ea20 req-e5249824-1740-4884-b705-5c5e34cde5ec service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:08.471719 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-8dc0a5d7-2ad4-4588-b3c2-e6a68a96ea20 req-e5249824-1740-4884-b705-5c5e34cde5ec service nova] Creating event network-vif-deleted:3d9a4e8b-28a1-48e2-9811-5b84e7f1d2b3 for instance e50ad261-8551-407b-a56f-48b7f1a5389c on nch1-master-1 Apr 16 21:28:08.476582 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-8dc0a5d7-2ad4-4588-b3c2-e6a68a96ea20 req-e5249824-1740-4884-b705-5c5e34cde5ec service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033956 Apr 16 21:28:08.477701 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2762/5357] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:28:08.996449 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6ad63cfd-18b9-488d-80dc-ed60d82423d8 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:08.997464 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6ad63cfd-18b9-488d-80dc-ed60d82423d8 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] [instance: e50ad261-8551-407b-a56f-48b7f1a5389c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:09.003622 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6ad63cfd-18b9-488d-80dc-ed60d82423d8 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:09.004022 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6ad63cfd-18b9-488d-80dc-ed60d82423d8 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:09.004836 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6ad63cfd-18b9-488d-80dc-ed60d82423d8 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:09.005436 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6ad63cfd-18b9-488d-80dc-ed60d82423d8 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:09.058771 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6ad63cfd-18b9-488d-80dc-ed60d82423d8 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:09.059224 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6ad63cfd-18b9-488d-80dc-ed60d82423d8 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:09.061145 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-6ad63cfd-18b9-488d-80dc-ed60d82423d8 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lazy-loading 'fault' on Instance uuid e50ad261-8551-407b-a56f-48b7f1a5389c {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:28:09.108288 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6ad63cfd-18b9-488d-80dc-ed60d82423d8 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9080d662d57448d8804703b4c201b77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e5ed140aa524fbbab716a4dacfb8f01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:09.116879 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6ad63cfd-18b9-488d-80dc-ed60d82423d8 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] 10.222.0.20 "GET /compute/v2.1/servers/e50ad261-8551-407b-a56f-48b7f1a5389c" status: 200 len: 1306 microversion: 2.1 time: 0.129750 Apr 16 21:28:09.117711 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2596/5358] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:08 2022] GET /compute/v2.1/servers/e50ad261-8551-407b-a56f-48b7f1a5389c => generated 1306 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:09.308911 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-191d1b6d-3456-49b9-8670-43944b7455ff tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:09.309843 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-191d1b6d-3456-49b9-8670-43944b7455ff tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: cf7be0a6-93c6-4c84-93a1-014223a63aea] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:09.320320 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-191d1b6d-3456-49b9-8670-43944b7455ff tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:09.320751 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-191d1b6d-3456-49b9-8670-43944b7455ff tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:09.321587 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-191d1b6d-3456-49b9-8670-43944b7455ff tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:09.322012 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-191d1b6d-3456-49b9-8670-43944b7455ff tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:09.458706 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-191d1b6d-3456-49b9-8670-43944b7455ff tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:09.466234 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-191d1b6d-3456-49b9-8670-43944b7455ff tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea" status: 200 len: 1266 microversion: 2.1 time: 0.165030 Apr 16 21:28:09.466949 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2763/5359] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:09 2022] GET /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:28:09.782086 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f5e8e51b-6899-4118-8867-82b070faa316 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49d5fd0d-87e4-490a-a0d3-5f24e6948347"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:28:09.783248 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f5e8e51b-6899-4118-8867-82b070faa316 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 6eb61102-0483-413f-88b9-7519c852b7f6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:09.790789 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f5e8e51b-6899-4118-8867-82b070faa316 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:09.792117 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f5e8e51b-6899-4118-8867-82b070faa316 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:09.792949 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f5e8e51b-6899-4118-8867-82b070faa316 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:09.793392 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f5e8e51b-6899-4118-8867-82b070faa316 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:10.134227 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-caf8ccd4-cafa-40df-a4f3-2f6f2fc80ae1 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:10.134743 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-caf8ccd4-cafa-40df-a4f3-2f6f2fc80ae1 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] [instance: e50ad261-8551-407b-a56f-48b7f1a5389c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:10.146854 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-caf8ccd4-cafa-40df-a4f3-2f6f2fc80ae1 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:10.147457 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-caf8ccd4-cafa-40df-a4f3-2f6f2fc80ae1 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:10.148323 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-caf8ccd4-cafa-40df-a4f3-2f6f2fc80ae1 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:10.149288 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-caf8ccd4-cafa-40df-a4f3-2f6f2fc80ae1 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:10.163884 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-caf8ccd4-cafa-40df-a4f3-2f6f2fc80ae1 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] HTTP exception thrown: Instance e50ad261-8551-407b-a56f-48b7f1a5389c could not be found. Apr 16 21:28:10.164670 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-caf8ccd4-cafa-40df-a4f3-2f6f2fc80ae1 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] Returning 404 to user: Instance e50ad261-8551-407b-a56f-48b7f1a5389c could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:28:10.165527 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-caf8ccd4-cafa-40df-a4f3-2f6f2fc80ae1 tempest-ServerAddressesTestJSON-2030030070 tempest-ServerAddressesTestJSON-2030030070-project] 10.222.0.20 "GET /compute/v2.1/servers/e50ad261-8551-407b-a56f-48b7f1a5389c" status: 404 len: 111 microversion: 2.1 time: 0.035350 Apr 16 21:28:10.166387 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2764/5360] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:10 2022] GET /compute/v2.1/servers/e50ad261-8551-407b-a56f-48b7f1a5389c => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:28:10.494221 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-26068b25-db4b-4b1a-ae7b-9fc6339e1930 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:10.494921 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-26068b25-db4b-4b1a-ae7b-9fc6339e1930 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: cf7be0a6-93c6-4c84-93a1-014223a63aea] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:10.503129 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-26068b25-db4b-4b1a-ae7b-9fc6339e1930 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:10.503930 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-26068b25-db4b-4b1a-ae7b-9fc6339e1930 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:10.505205 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-26068b25-db4b-4b1a-ae7b-9fc6339e1930 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:10.505792 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-26068b25-db4b-4b1a-ae7b-9fc6339e1930 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:10.654652 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-26068b25-db4b-4b1a-ae7b-9fc6339e1930 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:10.662340 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-26068b25-db4b-4b1a-ae7b-9fc6339e1930 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea" status: 200 len: 1308 microversion: 2.1 time: 0.175575 Apr 16 21:28:10.663646 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2765/5361] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:10 2022] GET /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea => generated 1308 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:28:11.133093 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f5e8e51b-6899-4118-8867-82b070faa316 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "POST /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.354646 Apr 16 21:28:11.134097 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2597/5362] 10.222.0.20 () {60 vars in 1322 bytes} [Sat Apr 16 21:28:09 2022] POST /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6/os-volume_attachments => generated 194 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:28:11.181723 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-123634e1-fc89-4dfd-b76b-d16f03df3368 req-42db9aee-df2c-487b-92f2-db333662e886 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf7be0a6-93c6-4c84-93a1-014223a63aea", "tag": "0cb19ffe-8c4b-4615-9c83-7c856827ac47"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:28:11.196812 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-123634e1-fc89-4dfd-b76b-d16f03df3368 req-42db9aee-df2c-487b-92f2-db333662e886 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:11.197265 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-123634e1-fc89-4dfd-b76b-d16f03df3368 req-42db9aee-df2c-487b-92f2-db333662e886 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:11.209545 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-123634e1-fc89-4dfd-b76b-d16f03df3368 req-42db9aee-df2c-487b-92f2-db333662e886 service nova] Creating event network-changed:0cb19ffe-8c4b-4615-9c83-7c856827ac47 for instance cf7be0a6-93c6-4c84-93a1-014223a63aea on nch2-master-1 Apr 16 21:28:11.214470 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-123634e1-fc89-4dfd-b76b-d16f03df3368 req-42db9aee-df2c-487b-92f2-db333662e886 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036698 Apr 16 21:28:11.215187 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2766/5363] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:28:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:28:11.685041 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-55ec7d89-7ab0-47e0-b69a-b4c30055c368 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:11.685905 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-55ec7d89-7ab0-47e0-b69a-b4c30055c368 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: cf7be0a6-93c6-4c84-93a1-014223a63aea] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:11.710819 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-55ec7d89-7ab0-47e0-b69a-b4c30055c368 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:11.715256 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-55ec7d89-7ab0-47e0-b69a-b4c30055c368 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:11.718112 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-55ec7d89-7ab0-47e0-b69a-b4c30055c368 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:11.722744 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-55ec7d89-7ab0-47e0-b69a-b4c30055c368 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:12.024911 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-55ec7d89-7ab0-47e0-b69a-b4c30055c368 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:12.044200 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-55ec7d89-7ab0-47e0-b69a-b4c30055c368 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea" status: 200 len: 1308 microversion: 2.1 time: 0.367538 Apr 16 21:28:12.045888 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2598/5364] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:11 2022] GET /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea => generated 1308 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:13.067865 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a39fca5a-53eb-4e26-8687-d340ad594433 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:13.068612 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a39fca5a-53eb-4e26-8687-d340ad594433 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: cf7be0a6-93c6-4c84-93a1-014223a63aea] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:13.081322 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a39fca5a-53eb-4e26-8687-d340ad594433 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:13.081794 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a39fca5a-53eb-4e26-8687-d340ad594433 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:13.083442 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a39fca5a-53eb-4e26-8687-d340ad594433 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:13.085643 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a39fca5a-53eb-4e26-8687-d340ad594433 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:13.256057 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a39fca5a-53eb-4e26-8687-d340ad594433 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:13.263426 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a39fca5a-53eb-4e26-8687-d340ad594433 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea" status: 200 len: 1308 microversion: 2.1 time: 0.200958 Apr 16 21:28:13.263997 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2767/5365] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:13 2022] GET /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea => generated 1308 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:14.285054 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d34694d3-d3f4-47c3-9373-a99919b021f1 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:14.290448 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d34694d3-d3f4-47c3-9373-a99919b021f1 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: cf7be0a6-93c6-4c84-93a1-014223a63aea] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:14.295361 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d34694d3-d3f4-47c3-9373-a99919b021f1 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:14.296454 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d34694d3-d3f4-47c3-9373-a99919b021f1 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:14.298305 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d34694d3-d3f4-47c3-9373-a99919b021f1 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:14.298913 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d34694d3-d3f4-47c3-9373-a99919b021f1 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:14.488669 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d34694d3-d3f4-47c3-9373-a99919b021f1 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:14.508095 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d34694d3-d3f4-47c3-9373-a99919b021f1 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea" status: 200 len: 1308 microversion: 2.1 time: 0.230141 Apr 16 21:28:14.508970 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2599/5366] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:14 2022] GET /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea => generated 1308 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:15.525974 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-375068f6-9cd6-4169-9d5b-cd6be50273cd tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:15.526623 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-375068f6-9cd6-4169-9d5b-cd6be50273cd tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: cf7be0a6-93c6-4c84-93a1-014223a63aea] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:15.534563 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-375068f6-9cd6-4169-9d5b-cd6be50273cd tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:15.535029 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-375068f6-9cd6-4169-9d5b-cd6be50273cd tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:15.536792 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-375068f6-9cd6-4169-9d5b-cd6be50273cd tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:15.537336 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-375068f6-9cd6-4169-9d5b-cd6be50273cd tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:15.755503 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-375068f6-9cd6-4169-9d5b-cd6be50273cd tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:15.763156 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-375068f6-9cd6-4169-9d5b-cd6be50273cd tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea" status: 200 len: 1308 microversion: 2.1 time: 0.241642 Apr 16 21:28:15.763739 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2768/5367] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:15 2022] GET /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea => generated 1308 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:16.782761 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4f7028d6-ccee-4122-922a-43a893a12173 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:16.785787 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4f7028d6-ccee-4122-922a-43a893a12173 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: cf7be0a6-93c6-4c84-93a1-014223a63aea] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:16.805147 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4f7028d6-ccee-4122-922a-43a893a12173 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:16.805975 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4f7028d6-ccee-4122-922a-43a893a12173 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:16.806937 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4f7028d6-ccee-4122-922a-43a893a12173 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:16.807632 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4f7028d6-ccee-4122-922a-43a893a12173 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:17.156693 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4f7028d6-ccee-4122-922a-43a893a12173 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:17.167195 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4f7028d6-ccee-4122-922a-43a893a12173 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea" status: 200 len: 1308 microversion: 2.1 time: 0.390324 Apr 16 21:28:17.167803 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2600/5368] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:16 2022] GET /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea => generated 1308 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:17.967077 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4f183b2b-b2af-4789-a6e8-3016dc256879 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49d5fd0d-87e4-490a-a0d3-5f24e6948347"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:28:17.968785 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4f183b2b-b2af-4789-a6e8-3016dc256879 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 6eb61102-0483-413f-88b9-7519c852b7f6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:17.976279 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4f183b2b-b2af-4789-a6e8-3016dc256879 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:17.976949 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4f183b2b-b2af-4789-a6e8-3016dc256879 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:17.977893 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4f183b2b-b2af-4789-a6e8-3016dc256879 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:17.978476 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4f183b2b-b2af-4789-a6e8-3016dc256879 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:18.083022 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-4f183b2b-b2af-4789-a6e8-3016dc256879 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] HTTP exception thrown: Invalid volume: volume 49d5fd0d-87e4-490a-a0d3-5f24e6948347 is already attached to instances: 6eb61102-0483-413f-88b9-7519c852b7f6 Apr 16 21:28:18.083839 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4f183b2b-b2af-4789-a6e8-3016dc256879 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Returning 400 to user: Invalid volume: volume 49d5fd0d-87e4-490a-a0d3-5f24e6948347 is already attached to instances: 6eb61102-0483-413f-88b9-7519c852b7f6 {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:28:18.084880 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4f183b2b-b2af-4789-a6e8-3016dc256879 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "POST /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.122489 Apr 16 21:28:18.085964 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2769/5369] 10.222.0.20 () {60 vars in 1322 bytes} [Sat Apr 16 21:28:17 2022] POST /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6/os-volume_attachments => generated 174 bytes in 124 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 16 21:28:18.171205 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-98112fda-5512-4df5-a710-3434d2912c68 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:18.172345 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-98112fda-5512-4df5-a710-3434d2912c68 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 6eb61102-0483-413f-88b9-7519c852b7f6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:18.184527 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2aeed175-a74a-4e3f-86fa-daec9846a8d9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:18.185478 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2aeed175-a74a-4e3f-86fa-daec9846a8d9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: cf7be0a6-93c6-4c84-93a1-014223a63aea] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:18.191542 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-98112fda-5512-4df5-a710-3434d2912c68 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:18.194121 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2aeed175-a74a-4e3f-86fa-daec9846a8d9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:18.194532 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-98112fda-5512-4df5-a710-3434d2912c68 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:18.195657 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-98112fda-5512-4df5-a710-3434d2912c68 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:18.196376 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2aeed175-a74a-4e3f-86fa-daec9846a8d9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:18.197594 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-98112fda-5512-4df5-a710-3434d2912c68 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:18.200546 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2aeed175-a74a-4e3f-86fa-daec9846a8d9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:18.200932 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2aeed175-a74a-4e3f-86fa-daec9846a8d9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:18.313486 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-98112fda-5512-4df5-a710-3434d2912c68 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lazy-loading 'services' on Instance uuid 6eb61102-0483-413f-88b9-7519c852b7f6 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:28:18.471252 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2aeed175-a74a-4e3f-86fa-daec9846a8d9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:18.489593 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2aeed175-a74a-4e3f-86fa-daec9846a8d9 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea" status: 200 len: 1308 microversion: 2.1 time: 0.309304 Apr 16 21:28:18.490176 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2770/5370] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:18 2022] GET /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea => generated 1308 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:28:18.639980 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-98112fda-5512-4df5-a710-3434d2912c68 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6/os-volume_attachments/49d5fd0d-87e4-490a-a0d3-5f24e6948347" status: 202 len: 0 microversion: 2.1 time: 0.473824 Apr 16 21:28:18.641371 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2601/5371] 10.222.0.20 () {58 vars in 1415 bytes} [Sat Apr 16 21:28:18 2022] DELETE /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6/os-volume_attachments/49d5fd0d-87e4-490a-a0d3-5f24e6948347 => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:28:18.649928 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f3fb72d4-3734-400d-9a7d-b76f4e7f68b9 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:18.651411 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f3fb72d4-3734-400d-9a7d-b76f4e7f68b9 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 6eb61102-0483-413f-88b9-7519c852b7f6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:18.661516 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f3fb72d4-3734-400d-9a7d-b76f4e7f68b9 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:18.661978 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f3fb72d4-3734-400d-9a7d-b76f4e7f68b9 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:18.662809 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f3fb72d4-3734-400d-9a7d-b76f4e7f68b9 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:18.663229 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f3fb72d4-3734-400d-9a7d-b76f4e7f68b9 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:18.726917 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f3fb72d4-3734-400d-9a7d-b76f4e7f68b9 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080934 Apr 16 21:28:18.727489 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2771/5372] 10.222.0.20 () {58 vars in 1301 bytes} [Sat Apr 16 21:28:18 2022] GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:28:18.926982 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-f01ce048-e827-482a-b93e-f914ff1466a8 req-e94cbab0-053a-4b84-a5f3-1e77e11c2637 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf7be0a6-93c6-4c84-93a1-014223a63aea", "name": "network-vif-plugged", "status": "completed", "tag": "0cb19ffe-8c4b-4615-9c83-7c856827ac47"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:28:18.945748 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-f01ce048-e827-482a-b93e-f914ff1466a8 req-e94cbab0-053a-4b84-a5f3-1e77e11c2637 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:18.946426 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-f01ce048-e827-482a-b93e-f914ff1466a8 req-e94cbab0-053a-4b84-a5f3-1e77e11c2637 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:18.962180 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-f01ce048-e827-482a-b93e-f914ff1466a8 req-e94cbab0-053a-4b84-a5f3-1e77e11c2637 service nova] Creating event network-vif-plugged:0cb19ffe-8c4b-4615-9c83-7c856827ac47 for instance cf7be0a6-93c6-4c84-93a1-014223a63aea on nch2-master-1 Apr 16 21:28:18.983923 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-f01ce048-e827-482a-b93e-f914ff1466a8 req-e94cbab0-053a-4b84-a5f3-1e77e11c2637 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.273275 Apr 16 21:28:18.985862 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2602/5373] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:28:19.507222 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3a874474-bb3f-47ef-8621-19a4618e8d68 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:19.507824 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3a874474-bb3f-47ef-8621-19a4618e8d68 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: cf7be0a6-93c6-4c84-93a1-014223a63aea] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:19.517806 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3a874474-bb3f-47ef-8621-19a4618e8d68 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:19.519691 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3a874474-bb3f-47ef-8621-19a4618e8d68 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:19.520529 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3a874474-bb3f-47ef-8621-19a4618e8d68 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:19.520971 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3a874474-bb3f-47ef-8621-19a4618e8d68 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:19.739958 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9c6e6521-0303-4e84-b918-d1ee7c4ec3c6 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:19.741983 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9c6e6521-0303-4e84-b918-d1ee7c4ec3c6 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 6eb61102-0483-413f-88b9-7519c852b7f6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:19.766004 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9c6e6521-0303-4e84-b918-d1ee7c4ec3c6 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:19.766735 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9c6e6521-0303-4e84-b918-d1ee7c4ec3c6 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:19.767690 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9c6e6521-0303-4e84-b918-d1ee7c4ec3c6 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:19.768416 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9c6e6521-0303-4e84-b918-d1ee7c4ec3c6 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:19.829028 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9c6e6521-0303-4e84-b918-d1ee7c4ec3c6 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094027 Apr 16 21:28:19.840432 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2603/5374] 10.222.0.20 () {58 vars in 1301 bytes} [Sat Apr 16 21:28:19 2022] GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:28:19.840650 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3a874474-bb3f-47ef-8621-19a4618e8d68 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:19.849186 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3a874474-bb3f-47ef-8621-19a4618e8d68 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea" status: 200 len: 1308 microversion: 2.1 time: 0.346007 Apr 16 21:28:19.850119 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2772/5375] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:19 2022] GET /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea => generated 1308 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:20.847472 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e79d6817-d1ce-4233-b2fb-9abbda0103a1 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:20.850343 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e79d6817-d1ce-4233-b2fb-9abbda0103a1 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 6eb61102-0483-413f-88b9-7519c852b7f6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:20.869094 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-17237074-0b44-4703-b44a-a28a782aaf90 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:20.869864 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-17237074-0b44-4703-b44a-a28a782aaf90 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: cf7be0a6-93c6-4c84-93a1-014223a63aea] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:20.886444 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-17237074-0b44-4703-b44a-a28a782aaf90 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:20.887149 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-17237074-0b44-4703-b44a-a28a782aaf90 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:20.888951 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e79d6817-d1ce-4233-b2fb-9abbda0103a1 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:20.889241 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-17237074-0b44-4703-b44a-a28a782aaf90 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:20.895070 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-17237074-0b44-4703-b44a-a28a782aaf90 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:20.907652 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e79d6817-d1ce-4233-b2fb-9abbda0103a1 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:20.908699 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e79d6817-d1ce-4233-b2fb-9abbda0103a1 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:20.916533 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e79d6817-d1ce-4233-b2fb-9abbda0103a1 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:21.065991 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e79d6817-d1ce-4233-b2fb-9abbda0103a1 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.227339 Apr 16 21:28:21.068156 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2604/5376] 10.222.0.20 () {58 vars in 1301 bytes} [Sat Apr 16 21:28:20 2022] GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6/os-volume_attachments => generated 25 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:28:21.177926 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-46b07528-ea96-4f5d-9ece-f89c9d44834d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:21.178662 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-46b07528-ea96-4f5d-9ece-f89c9d44834d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 6eb61102-0483-413f-88b9-7519c852b7f6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:21.189483 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-46b07528-ea96-4f5d-9ece-f89c9d44834d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:21.192405 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-46b07528-ea96-4f5d-9ece-f89c9d44834d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:21.194189 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-46b07528-ea96-4f5d-9ece-f89c9d44834d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:21.197088 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-46b07528-ea96-4f5d-9ece-f89c9d44834d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:21.274069 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-46b07528-ea96-4f5d-9ece-f89c9d44834d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 6eb61102-0483-413f-88b9-7519c852b7f6] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:28:21.540779 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-17237074-0b44-4703-b44a-a28a782aaf90 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:21.578171 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-17237074-0b44-4703-b44a-a28a782aaf90 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea" status: 200 len: 1308 microversion: 2.1 time: 0.713366 Apr 16 21:28:21.578806 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2773/5377] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:20 2022] GET /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea => generated 1308 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:28:21.733789 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-46b07528-ea96-4f5d-9ece-f89c9d44834d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6" status: 204 len: 0 microversion: 2.1 time: 0.557392 Apr 16 21:28:21.733789 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2605/5378] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:28:21 2022] DELETE /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 16 21:28:21.745139 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b35aea4d-0c98-4887-ba62-e35df644da16 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:21.745820 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b35aea4d-0c98-4887-ba62-e35df644da16 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 6eb61102-0483-413f-88b9-7519c852b7f6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:21.780985 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b35aea4d-0c98-4887-ba62-e35df644da16 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:21.781655 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b35aea4d-0c98-4887-ba62-e35df644da16 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:21.782623 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b35aea4d-0c98-4887-ba62-e35df644da16 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:21.783223 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b35aea4d-0c98-4887-ba62-e35df644da16 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:22.064316 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b35aea4d-0c98-4887-ba62-e35df644da16 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:22.074292 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b35aea4d-0c98-4887-ba62-e35df644da16 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6" status: 200 len: 1683 microversion: 2.1 time: 0.337788 Apr 16 21:28:22.076414 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2774/5379] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:21 2022] GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6 => generated 1683 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:22.496201 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-807e1654-9739-4daf-9d38-ba714d154300 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-505294779", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:28:22.582078 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-807e1654-9739-4daf-9d38-ba714d154300 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] validate_networks() for [('65b90a12-c876-4ec9-bb69-11ab16e6830b', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:28:22.595481 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9759e69f-1683-461c-ac91-405b12102f42 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:22.596103 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9759e69f-1683-461c-ac91-405b12102f42 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: cf7be0a6-93c6-4c84-93a1-014223a63aea] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:22.608668 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9759e69f-1683-461c-ac91-405b12102f42 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:22.609124 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9759e69f-1683-461c-ac91-405b12102f42 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:22.611326 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9759e69f-1683-461c-ac91-405b12102f42 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:22.611773 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9759e69f-1683-461c-ac91-405b12102f42 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:23.101027 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9759e69f-1683-461c-ac91-405b12102f42 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:23.125520 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9759e69f-1683-461c-ac91-405b12102f42 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea" status: 200 len: 1490 microversion: 2.1 time: 0.533699 Apr 16 21:28:23.129575 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2775/5380] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:22 2022] GET /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea => generated 1490 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:28:23.157410 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ee644b80-4ef0-4b47-bfda-593984c7613b tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:23.159927 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ee644b80-4ef0-4b47-bfda-593984c7613b tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 6eb61102-0483-413f-88b9-7519c852b7f6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:23.174540 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee644b80-4ef0-4b47-bfda-593984c7613b tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:23.175946 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee644b80-4ef0-4b47-bfda-593984c7613b tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:23.177400 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee644b80-4ef0-4b47-bfda-593984c7613b tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:23.178926 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee644b80-4ef0-4b47-bfda-593984c7613b tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:23.419138 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-807e1654-9739-4daf-9d38-ba714d154300 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:28:23.419576 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-807e1654-9739-4daf-9d38-ba714d154300 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:28:23.420189 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-807e1654-9739-4daf-9d38-ba714d154300 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:28:23.425315 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-807e1654-9739-4daf-9d38-ba714d154300 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:28:23.425795 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-807e1654-9739-4daf-9d38-ba714d154300 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:28:23.472832 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-807e1654-9739-4daf-9d38-ba714d154300 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:23.474997 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-807e1654-9739-4daf-9d38-ba714d154300 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:23.476045 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-807e1654-9739-4daf-9d38-ba714d154300 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:23.479064 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-807e1654-9739-4daf-9d38-ba714d154300 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:23.537464 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-807e1654-9739-4daf-9d38-ba714d154300 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Getting quotas for project 52fd97392841411abbd1f748dff97f10. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:28:23.552110 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-807e1654-9739-4daf-9d38-ba714d154300 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Getting quotas for user f757f2aee71d4c3594cb45e10f3b9957 and project 52fd97392841411abbd1f748dff97f10. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:28:23.598290 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-807e1654-9739-4daf-9d38-ba714d154300 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:28:23.605483 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-807e1654-9739-4daf-9d38-ba714d154300 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: 5239bc09-9070-4897-8d6f-8084c2bab0b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:28:23.781351 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ee644b80-4ef0-4b47-bfda-593984c7613b tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:23.808004 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ee644b80-4ef0-4b47-bfda-593984c7613b tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6" status: 200 len: 1683 microversion: 2.1 time: 0.677146 Apr 16 21:28:23.809628 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2776/5381] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:23 2022] GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6 => generated 1683 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:23.827484 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ebe9a33a-68ac-41e2-9a8e-20aecd085e45 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:28:23.831591 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ebe9a33a-68ac-41e2-9a8e-20aecd085e45 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: cf7be0a6-93c6-4c84-93a1-014223a63aea] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:23.853238 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ebe9a33a-68ac-41e2-9a8e-20aecd085e45 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:23.855082 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ebe9a33a-68ac-41e2-9a8e-20aecd085e45 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:23.865203 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ebe9a33a-68ac-41e2-9a8e-20aecd085e45 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:23.865203 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ebe9a33a-68ac-41e2-9a8e-20aecd085e45 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:23.865475 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-807e1654-9739-4daf-9d38-ba714d154300 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.727877 Apr 16 21:28:23.873104 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2606/5382] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:28:22 2022] POST /compute/v2.1/servers => generated 383 bytes in 1734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:28:23.887149 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5dac3ae9-52a6-4f34-888b-572611eea7a0 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:23.892765 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5dac3ae9-52a6-4f34-888b-572611eea7a0 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: 5239bc09-9070-4897-8d6f-8084c2bab0b4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:24.067966 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ebe9a33a-68ac-41e2-9a8e-20aecd085e45 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "PUT /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea" status: 200 len: 1085 microversion: 2.1 time: 0.257047 Apr 16 21:28:24.078567 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2777/5383] 10.222.0.20 () {60 vars in 1255 bytes} [Sat Apr 16 21:28:23 2022] PUT /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea => generated 1085 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:24.097477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1b88e33b-86c8-44fe-9bb4-6fb86ef18bac tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:24.098241 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1b88e33b-86c8-44fe-9bb4-6fb86ef18bac tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: cf7be0a6-93c6-4c84-93a1-014223a63aea] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:24.120576 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1b88e33b-86c8-44fe-9bb4-6fb86ef18bac tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:24.122808 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1b88e33b-86c8-44fe-9bb4-6fb86ef18bac tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:24.123866 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1b88e33b-86c8-44fe-9bb4-6fb86ef18bac tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:24.126859 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1b88e33b-86c8-44fe-9bb4-6fb86ef18bac tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:24.210481 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5dac3ae9-52a6-4f34-888b-572611eea7a0 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:24.224797 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5dac3ae9-52a6-4f34-888b-572611eea7a0 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4" status: 200 len: 1213 microversion: 2.1 time: 0.343048 Apr 16 21:28:24.224797 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2607/5384] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:23 2022] GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4 => generated 1213 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:24.527446 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1b88e33b-86c8-44fe-9bb4-6fb86ef18bac tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:24.543223 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1b88e33b-86c8-44fe-9bb4-6fb86ef18bac tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea" status: 200 len: 1511 microversion: 2.1 time: 0.458607 Apr 16 21:28:24.543429 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2778/5385] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:24 2022] GET /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea => generated 1511 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:24.562754 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-068efae7-59f4-42e4-9c08-cf71410a28bf tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:24.563421 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-068efae7-59f4-42e4-9c08-cf71410a28bf tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: cf7be0a6-93c6-4c84-93a1-014223a63aea] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:24.578455 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-068efae7-59f4-42e4-9c08-cf71410a28bf tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:24.579967 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-068efae7-59f4-42e4-9c08-cf71410a28bf tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:24.581589 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-068efae7-59f4-42e4-9c08-cf71410a28bf tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:24.582469 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-068efae7-59f4-42e4-9c08-cf71410a28bf tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:24.826630 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d613aaee-05db-4c50-a0a7-aec8d0ffb470 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:24.827252 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d613aaee-05db-4c50-a0a7-aec8d0ffb470 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 6eb61102-0483-413f-88b9-7519c852b7f6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:24.836115 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d613aaee-05db-4c50-a0a7-aec8d0ffb470 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:24.838111 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d613aaee-05db-4c50-a0a7-aec8d0ffb470 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:24.838111 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d613aaee-05db-4c50-a0a7-aec8d0ffb470 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:24.848070 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d613aaee-05db-4c50-a0a7-aec8d0ffb470 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:25.026506 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d613aaee-05db-4c50-a0a7-aec8d0ffb470 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:25.034308 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d613aaee-05db-4c50-a0a7-aec8d0ffb470 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6" status: 200 len: 1615 microversion: 2.1 time: 0.211445 Apr 16 21:28:25.034897 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2779/5386] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:24 2022] GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6 => generated 1615 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:28:25.240523 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7b072d5a-8338-4475-bc35-0fd8b8b3f93d tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:25.242131 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7b072d5a-8338-4475-bc35-0fd8b8b3f93d tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: 5239bc09-9070-4897-8d6f-8084c2bab0b4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:25.537308 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-068efae7-59f4-42e4-9c08-cf71410a28bf tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:25.548323 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-068efae7-59f4-42e4-9c08-cf71410a28bf tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea" status: 200 len: 1511 microversion: 2.1 time: 0.992084 Apr 16 21:28:25.550192 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2608/5387] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:24 2022] GET /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea => generated 1511 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:25.566454 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f57f45cf-77a4-4f56-9e62-57e699cd3cd3 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:25.567681 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f57f45cf-77a4-4f56-9e62-57e699cd3cd3 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: cf7be0a6-93c6-4c84-93a1-014223a63aea] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:25.578321 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f57f45cf-77a4-4f56-9e62-57e699cd3cd3 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:25.579090 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f57f45cf-77a4-4f56-9e62-57e699cd3cd3 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:25.580603 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f57f45cf-77a4-4f56-9e62-57e699cd3cd3 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:25.582381 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f57f45cf-77a4-4f56-9e62-57e699cd3cd3 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:25.628542 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f57f45cf-77a4-4f56-9e62-57e699cd3cd3 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: cf7be0a6-93c6-4c84-93a1-014223a63aea] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:28:25.714297 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7b072d5a-8338-4475-bc35-0fd8b8b3f93d tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:25.725009 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7b072d5a-8338-4475-bc35-0fd8b8b3f93d tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4" status: 200 len: 1213 microversion: 2.1 time: 0.485673 Apr 16 21:28:25.731243 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2780/5388] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:25 2022] GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4 => generated 1213 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:28:25.763845 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-80ca58c0-b619-4871-b740-efe1190cba32 req-81252748-2ec8-4a81-8ab1-3aaf59260691 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6eb61102-0483-413f-88b9-7519c852b7f6", "name": "network-vif-deleted", "tag": "bca26f6e-d4ea-42d6-97cb-5fabb9c3b713"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:28:25.776817 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-80ca58c0-b619-4871-b740-efe1190cba32 req-81252748-2ec8-4a81-8ab1-3aaf59260691 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:25.777629 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-80ca58c0-b619-4871-b740-efe1190cba32 req-81252748-2ec8-4a81-8ab1-3aaf59260691 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:25.806324 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-80ca58c0-b619-4871-b740-efe1190cba32 req-81252748-2ec8-4a81-8ab1-3aaf59260691 service nova] Creating event network-vif-deleted:bca26f6e-d4ea-42d6-97cb-5fabb9c3b713 for instance 6eb61102-0483-413f-88b9-7519c852b7f6 on nch2-master-1 Apr 16 21:28:25.836115 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-80ca58c0-b619-4871-b740-efe1190cba32 req-81252748-2ec8-4a81-8ab1-3aaf59260691 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083866 Apr 16 21:28:25.843364 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2781/5389] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:28:26.063043 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-77133b1e-4321-4e37-8a48-c782437a640f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:26.063043 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-77133b1e-4321-4e37-8a48-c782437a640f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 6eb61102-0483-413f-88b9-7519c852b7f6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:26.139167 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-77133b1e-4321-4e37-8a48-c782437a640f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:26.146089 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-77133b1e-4321-4e37-8a48-c782437a640f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:26.154098 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-77133b1e-4321-4e37-8a48-c782437a640f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:26.154656 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-77133b1e-4321-4e37-8a48-c782437a640f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:26.244935 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f57f45cf-77a4-4f56-9e62-57e699cd3cd3 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea" status: 204 len: 0 microversion: 2.1 time: 0.682356 Apr 16 21:28:26.247005 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2609/5390] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:28:25 2022] DELETE /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea => generated 0 bytes in 685 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:28:26.258113 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-71af528d-c7ff-4e82-944f-66d80e2c9377 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:26.261432 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-71af528d-c7ff-4e82-944f-66d80e2c9377 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: cf7be0a6-93c6-4c84-93a1-014223a63aea] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:26.295735 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-71af528d-c7ff-4e82-944f-66d80e2c9377 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:26.296586 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-71af528d-c7ff-4e82-944f-66d80e2c9377 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:26.298970 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-71af528d-c7ff-4e82-944f-66d80e2c9377 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:26.301811 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-71af528d-c7ff-4e82-944f-66d80e2c9377 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:26.405932 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-77133b1e-4321-4e37-8a48-c782437a640f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:26.415109 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-77133b1e-4321-4e37-8a48-c782437a640f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6" status: 200 len: 1326 microversion: 2.1 time: 0.365682 Apr 16 21:28:26.421453 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2782/5391] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:26 2022] GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6 => generated 1326 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:26.610490 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-71af528d-c7ff-4e82-944f-66d80e2c9377 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:26.626949 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-71af528d-c7ff-4e82-944f-66d80e2c9377 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea" status: 200 len: 1517 microversion: 2.1 time: 0.369483 Apr 16 21:28:26.627649 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2610/5392] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:26 2022] GET /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea => generated 1517 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:28:26.746272 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1c66d6f5-9173-4528-a803-336178fcc227 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:26.746925 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1c66d6f5-9173-4528-a803-336178fcc227 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: 5239bc09-9070-4897-8d6f-8084c2bab0b4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:26.755161 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1c66d6f5-9173-4528-a803-336178fcc227 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:26.755619 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1c66d6f5-9173-4528-a803-336178fcc227 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:26.760076 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1c66d6f5-9173-4528-a803-336178fcc227 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:26.770306 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1c66d6f5-9173-4528-a803-336178fcc227 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:26.865689 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1c66d6f5-9173-4528-a803-336178fcc227 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:26.886271 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1c66d6f5-9173-4528-a803-336178fcc227 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4" status: 200 len: 1265 microversion: 2.1 time: 0.145052 Apr 16 21:28:26.888351 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2783/5393] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:26 2022] GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:27.434734 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9cac9b5a-8737-4e58-9c2c-d59dac693474 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:27.436057 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9cac9b5a-8737-4e58-9c2c-d59dac693474 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 6eb61102-0483-413f-88b9-7519c852b7f6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:27.457579 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9cac9b5a-8737-4e58-9c2c-d59dac693474 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:27.459989 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9cac9b5a-8737-4e58-9c2c-d59dac693474 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:27.459989 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9cac9b5a-8737-4e58-9c2c-d59dac693474 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:27.488203 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9cac9b5a-8737-4e58-9c2c-d59dac693474 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:27.569336 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9cac9b5a-8737-4e58-9c2c-d59dac693474 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:27.571468 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9cac9b5a-8737-4e58-9c2c-d59dac693474 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:27.572203 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-9cac9b5a-8737-4e58-9c2c-d59dac693474 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lazy-loading 'fault' on Instance uuid 6eb61102-0483-413f-88b9-7519c852b7f6 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:28:27.645213 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-81429e5c-87c5-4dd1-8051-6d991c112df3 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:27.647105 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-81429e5c-87c5-4dd1-8051-6d991c112df3 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: cf7be0a6-93c6-4c84-93a1-014223a63aea] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:27.656288 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-81429e5c-87c5-4dd1-8051-6d991c112df3 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:27.663524 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-81429e5c-87c5-4dd1-8051-6d991c112df3 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:27.663524 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-81429e5c-87c5-4dd1-8051-6d991c112df3 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:27.663524 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-81429e5c-87c5-4dd1-8051-6d991c112df3 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:27.859607 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9cac9b5a-8737-4e58-9c2c-d59dac693474 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:27.872408 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9cac9b5a-8737-4e58-9c2c-d59dac693474 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6" status: 200 len: 1331 microversion: 2.1 time: 0.442513 Apr 16 21:28:27.882867 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2611/5394] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:27 2022] GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6 => generated 1331 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:27.907757 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-897c30e3-2777-4808-8d14-667761c4a957 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:27.908409 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-897c30e3-2777-4808-8d14-667761c4a957 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: 5239bc09-9070-4897-8d6f-8084c2bab0b4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:27.929944 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-897c30e3-2777-4808-8d14-667761c4a957 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:27.930606 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-897c30e3-2777-4808-8d14-667761c4a957 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:27.931478 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-897c30e3-2777-4808-8d14-667761c4a957 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:27.931952 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-897c30e3-2777-4808-8d14-667761c4a957 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:28.116802 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-897c30e3-2777-4808-8d14-667761c4a957 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:28.124317 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-897c30e3-2777-4808-8d14-667761c4a957 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4" status: 200 len: 1271 microversion: 2.1 time: 0.219364 Apr 16 21:28:28.124950 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2612/5395] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:27 2022] GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4 => generated 1271 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:28.453712 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-81429e5c-87c5-4dd1-8051-6d991c112df3 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:28.469598 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-81429e5c-87c5-4dd1-8051-6d991c112df3 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea" status: 200 len: 1517 microversion: 2.1 time: 0.827826 Apr 16 21:28:28.470499 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2784/5396] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:27 2022] GET /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea => generated 1517 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:28.890817 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3a7651ad-dabe-4e61-93fb-213d80ff4f18 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:28.892043 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3a7651ad-dabe-4e61-93fb-213d80ff4f18 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 6eb61102-0483-413f-88b9-7519c852b7f6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:28.906602 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3a7651ad-dabe-4e61-93fb-213d80ff4f18 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:28.907356 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3a7651ad-dabe-4e61-93fb-213d80ff4f18 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:28.908680 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3a7651ad-dabe-4e61-93fb-213d80ff4f18 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:28.909504 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3a7651ad-dabe-4e61-93fb-213d80ff4f18 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:28.955469 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-3a7651ad-dabe-4e61-93fb-213d80ff4f18 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] HTTP exception thrown: Instance 6eb61102-0483-413f-88b9-7519c852b7f6 could not be found. Apr 16 21:28:28.957654 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3a7651ad-dabe-4e61-93fb-213d80ff4f18 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Returning 404 to user: Instance 6eb61102-0483-413f-88b9-7519c852b7f6 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:28:28.958867 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3a7651ad-dabe-4e61-93fb-213d80ff4f18 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6" status: 404 len: 111 microversion: 2.1 time: 0.071784 Apr 16 21:28:28.963534 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2613/5397] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:28 2022] GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:28:28.968118 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bebfdf76-1eae-49ef-8880-4a37bbdf99cb tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '.version_select at 0x7fbb95c30790>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:29.098715 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-bebfdf76-1eae-49ef-8880-4a37bbdf99cb tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1754429898" status: 202 len: 0 microversion: 2.1 time: 0.134325 Apr 16 21:28:29.102829 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2785/5398] 10.222.0.20 () {58 vars in 1220 bytes} [Sat Apr 16 21:28:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1754429898 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:28:29.146274 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9523e863-63be-404f-a06b-106111fdf8f7 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:29.147167 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9523e863-63be-404f-a06b-106111fdf8f7 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: 5239bc09-9070-4897-8d6f-8084c2bab0b4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:29.165559 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9523e863-63be-404f-a06b-106111fdf8f7 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:29.166620 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9523e863-63be-404f-a06b-106111fdf8f7 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:29.167905 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9523e863-63be-404f-a06b-106111fdf8f7 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:29.168526 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9523e863-63be-404f-a06b-106111fdf8f7 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:29.487134 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b2b33512-4a6c-4aac-84d0-1def7358487c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:29.488241 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b2b33512-4a6c-4aac-84d0-1def7358487c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: cf7be0a6-93c6-4c84-93a1-014223a63aea] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:29.512390 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b2b33512-4a6c-4aac-84d0-1def7358487c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:29.513207 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b2b33512-4a6c-4aac-84d0-1def7358487c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:29.514221 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b2b33512-4a6c-4aac-84d0-1def7358487c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:29.514890 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b2b33512-4a6c-4aac-84d0-1def7358487c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:29.730911 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9523e863-63be-404f-a06b-106111fdf8f7 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:29.740693 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9523e863-63be-404f-a06b-106111fdf8f7 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4" status: 200 len: 1313 microversion: 2.1 time: 0.601848 Apr 16 21:28:29.757352 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2614/5399] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:29 2022] GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4 => generated 1313 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:29.830139 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-23a2caea-329c-4785-95b3-a29a6a6d2cad req-207a9024-7995-45e8-be9c-2f47e4400c50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf7be0a6-93c6-4c84-93a1-014223a63aea", "name": "network-vif-deleted", "tag": "0cb19ffe-8c4b-4615-9c83-7c856827ac47"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:28:29.842233 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b2b33512-4a6c-4aac-84d0-1def7358487c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:29.846633 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-23a2caea-329c-4785-95b3-a29a6a6d2cad req-207a9024-7995-45e8-be9c-2f47e4400c50 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:29.847454 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-23a2caea-329c-4785-95b3-a29a6a6d2cad req-207a9024-7995-45e8-be9c-2f47e4400c50 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:29.881378 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b2b33512-4a6c-4aac-84d0-1def7358487c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea" status: 200 len: 1475 microversion: 2.1 time: 0.376390 Apr 16 21:28:29.882562 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2786/5400] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:29 2022] GET /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea => generated 1475 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:29.899501 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-23a2caea-329c-4785-95b3-a29a6a6d2cad req-207a9024-7995-45e8-be9c-2f47e4400c50 service nova] Creating event network-vif-deleted:0cb19ffe-8c4b-4615-9c83-7c856827ac47 for instance cf7be0a6-93c6-4c84-93a1-014223a63aea on nch2-master-1 Apr 16 21:28:29.931105 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-23a2caea-329c-4785-95b3-a29a6a6d2cad req-207a9024-7995-45e8-be9c-2f47e4400c50 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096560 Apr 16 21:28:29.932510 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2615/5401] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:28:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:28:30.758377 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-18f985f1-1426-4b65-bf25-b7632bdbbdc0 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:30.759018 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-18f985f1-1426-4b65-bf25-b7632bdbbdc0 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: 5239bc09-9070-4897-8d6f-8084c2bab0b4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:30.771203 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-18f985f1-1426-4b65-bf25-b7632bdbbdc0 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:30.771823 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-18f985f1-1426-4b65-bf25-b7632bdbbdc0 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:30.773360 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-18f985f1-1426-4b65-bf25-b7632bdbbdc0 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:30.775028 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-18f985f1-1426-4b65-bf25-b7632bdbbdc0 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:30.902633 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-892086d3-ae1e-44fc-afb9-1b56bf8317a5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:30.904145 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-892086d3-ae1e-44fc-afb9-1b56bf8317a5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: cf7be0a6-93c6-4c84-93a1-014223a63aea] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:30.911806 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-892086d3-ae1e-44fc-afb9-1b56bf8317a5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:30.912593 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-892086d3-ae1e-44fc-afb9-1b56bf8317a5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:30.913753 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-892086d3-ae1e-44fc-afb9-1b56bf8317a5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:30.914435 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-892086d3-ae1e-44fc-afb9-1b56bf8317a5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:30.960976 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-892086d3-ae1e-44fc-afb9-1b56bf8317a5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:30.961901 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-892086d3-ae1e-44fc-afb9-1b56bf8317a5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:30.962557 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-892086d3-ae1e-44fc-afb9-1b56bf8317a5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lazy-loading 'fault' on Instance uuid cf7be0a6-93c6-4c84-93a1-014223a63aea {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:28:31.043324 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-18f985f1-1426-4b65-bf25-b7632bdbbdc0 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:31.066913 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-18f985f1-1426-4b65-bf25-b7632bdbbdc0 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4" status: 200 len: 1313 microversion: 2.1 time: 0.298401 Apr 16 21:28:31.079821 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2787/5402] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:30 2022] GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4 => generated 1313 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:31.089242 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-892086d3-ae1e-44fc-afb9-1b56bf8317a5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:31.120661 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-892086d3-ae1e-44fc-afb9-1b56bf8317a5 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea" status: 200 len: 1319 microversion: 2.1 time: 0.219826 Apr 16 21:28:31.131700 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2616/5403] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:30 2022] GET /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea => generated 1319 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:28:31.484646 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-91c79f07-4d5c-48bb-b1e4-9501b496978f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Action: 'create', calling method: .version_select at 0x7fbb9566e700>, body: {"keypair": {"name": "tempest-keypair-446245177"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:28:31.526951 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-91c79f07-4d5c-48bb-b1e4-9501b496978f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Getting quotas for project d6f8dfa11e9b410cbbd59ffe32afeb26. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:28:31.532303 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-91c79f07-4d5c-48bb-b1e4-9501b496978f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Getting quotas for user 37443a4e933a4873bb039b06efaec98f and project d6f8dfa11e9b410cbbd59ffe32afeb26. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:28:31.730191 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-9092b364-d405-43c6-bc78-934cc5e395b6 req-f83d9793-9664-44ca-8980-011767283e87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5239bc09-9070-4897-8d6f-8084c2bab0b4", "tag": "f4d24ed3-2cac-4fe0-a31e-b2a60c5d5e0f"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:28:31.756200 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-9092b364-d405-43c6-bc78-934cc5e395b6 req-f83d9793-9664-44ca-8980-011767283e87 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:31.757175 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-9092b364-d405-43c6-bc78-934cc5e395b6 req-f83d9793-9664-44ca-8980-011767283e87 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:31.795455 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-9092b364-d405-43c6-bc78-934cc5e395b6 req-f83d9793-9664-44ca-8980-011767283e87 service nova] Creating event network-changed:f4d24ed3-2cac-4fe0-a31e-b2a60c5d5e0f for instance 5239bc09-9070-4897-8d6f-8084c2bab0b4 on nch1-master-1 Apr 16 21:28:31.808118 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-9092b364-d405-43c6-bc78-934cc5e395b6 req-f83d9793-9664-44ca-8980-011767283e87 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081892 Apr 16 21:28:31.809133 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2617/5404] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:28:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:28:31.936700 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-91c79f07-4d5c-48bb-b1e4-9501b496978f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Getting quotas for project d6f8dfa11e9b410cbbd59ffe32afeb26. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:28:31.957055 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-91c79f07-4d5c-48bb-b1e4-9501b496978f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Getting quotas for user 37443a4e933a4873bb039b06efaec98f and project d6f8dfa11e9b410cbbd59ffe32afeb26. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:28:31.985405 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-91c79f07-4d5c-48bb-b1e4-9501b496978f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.504570 Apr 16 21:28:31.994305 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2788/5405] 10.222.0.20 () {60 vars in 1157 bytes} [Sat Apr 16 21:28:31 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:32.088719 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b75b8dde-bf07-4d27-b1cb-f0d49d13e68d tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:32.090068 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b75b8dde-bf07-4d27-b1cb-f0d49d13e68d tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: 5239bc09-9070-4897-8d6f-8084c2bab0b4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:32.102360 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b75b8dde-bf07-4d27-b1cb-f0d49d13e68d tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:32.104005 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b75b8dde-bf07-4d27-b1cb-f0d49d13e68d tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:32.105098 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b75b8dde-bf07-4d27-b1cb-f0d49d13e68d tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:32.105909 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b75b8dde-bf07-4d27-b1cb-f0d49d13e68d tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:32.137935 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-527a513d-4a92-42bc-acbd-3d1216cc4b7c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:32.139649 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-527a513d-4a92-42bc-acbd-3d1216cc4b7c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: cf7be0a6-93c6-4c84-93a1-014223a63aea] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:32.152080 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-527a513d-4a92-42bc-acbd-3d1216cc4b7c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:32.156291 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-527a513d-4a92-42bc-acbd-3d1216cc4b7c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:32.157437 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-527a513d-4a92-42bc-acbd-3d1216cc4b7c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:32.163240 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-527a513d-4a92-42bc-acbd-3d1216cc4b7c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:32.179815 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-527a513d-4a92-42bc-acbd-3d1216cc4b7c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] HTTP exception thrown: Instance cf7be0a6-93c6-4c84-93a1-014223a63aea could not be found. Apr 16 21:28:32.180474 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-527a513d-4a92-42bc-acbd-3d1216cc4b7c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Returning 404 to user: Instance cf7be0a6-93c6-4c84-93a1-014223a63aea could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:28:32.181327 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-527a513d-4a92-42bc-acbd-3d1216cc4b7c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea" status: 404 len: 111 microversion: 2.1 time: 0.049201 Apr 16 21:28:32.182209 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2789/5406] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:32 2022] GET /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:28:32.315254 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cbdc6afd-78cb-4c53-b326-aa78194f51c0 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-951779300", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "8f593006-a7a9-4abc-8409-1d78959e9c9f"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:28:32.404153 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-cbdc6afd-78cb-4c53-b326-aa78194f51c0 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] validate_networks() for [('8f593006-a7a9-4abc-8409-1d78959e9c9f', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:28:32.525751 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b75b8dde-bf07-4d27-b1cb-f0d49d13e68d tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:32.535090 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b75b8dde-bf07-4d27-b1cb-f0d49d13e68d tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4" status: 200 len: 1313 microversion: 2.1 time: 0.451909 Apr 16 21:28:32.535690 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2618/5407] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:32 2022] GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4 => generated 1313 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:33.553115 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9c2c211f-7ba4-40ad-add1-9c804b3cc93d tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:33.554399 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9c2c211f-7ba4-40ad-add1-9c804b3cc93d tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: 5239bc09-9070-4897-8d6f-8084c2bab0b4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:33.562075 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9c2c211f-7ba4-40ad-add1-9c804b3cc93d tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:33.562847 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9c2c211f-7ba4-40ad-add1-9c804b3cc93d tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:33.563892 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9c2c211f-7ba4-40ad-add1-9c804b3cc93d tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:33.564520 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9c2c211f-7ba4-40ad-add1-9c804b3cc93d tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:33.792742 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9c2c211f-7ba4-40ad-add1-9c804b3cc93d tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:33.802120 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9c2c211f-7ba4-40ad-add1-9c804b3cc93d tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4" status: 200 len: 1313 microversion: 2.1 time: 0.252994 Apr 16 21:28:33.802296 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2619/5408] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:33 2022] GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4 => generated 1313 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:28:33.861250 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-cbdc6afd-78cb-4c53-b326-aa78194f51c0 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:28:33.861783 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-cbdc6afd-78cb-4c53-b326-aa78194f51c0 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:28:33.863166 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-cbdc6afd-78cb-4c53-b326-aa78194f51c0 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:28:33.864735 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-cbdc6afd-78cb-4c53-b326-aa78194f51c0 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:28:33.865319 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-cbdc6afd-78cb-4c53-b326-aa78194f51c0 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:28:33.892590 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cbdc6afd-78cb-4c53-b326-aa78194f51c0 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:33.895591 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cbdc6afd-78cb-4c53-b326-aa78194f51c0 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:33.896843 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cbdc6afd-78cb-4c53-b326-aa78194f51c0 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:33.897436 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cbdc6afd-78cb-4c53-b326-aa78194f51c0 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:33.924885 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-cbdc6afd-78cb-4c53-b326-aa78194f51c0 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Getting quotas for project 76fd883ad3944fcaaecdf2909120dc87. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:28:33.930875 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-cbdc6afd-78cb-4c53-b326-aa78194f51c0 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Getting quotas for user 5e71b35f438d4539a60a390e1ceec9cd and project 76fd883ad3944fcaaecdf2909120dc87. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:28:33.944603 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cbdc6afd-78cb-4c53-b326-aa78194f51c0 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:28:33.947102 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cbdc6afd-78cb-4c53-b326-aa78194f51c0 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:28:34.067302 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cbdc6afd-78cb-4c53-b326-aa78194f51c0 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.756039 Apr 16 21:28:34.068501 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2790/5409] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:28:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:28:34.082619 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-549903d4-f582-416a-b843-4089ed85a33a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:34.083259 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-549903d4-f582-416a-b843-4089ed85a33a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:34.162782 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-549903d4-f582-416a-b843-4089ed85a33a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:34.171177 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-549903d4-f582-416a-b843-4089ed85a33a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441" status: 200 len: 1208 microversion: 2.1 time: 0.095767 Apr 16 21:28:34.184434 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2620/5410] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:34 2022] GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 => generated 1208 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:34.819454 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7169ee39-279b-4604-a565-72d394f0b353 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:34.820059 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7169ee39-279b-4604-a565-72d394f0b353 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: 5239bc09-9070-4897-8d6f-8084c2bab0b4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:34.827005 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7169ee39-279b-4604-a565-72d394f0b353 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:34.827477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7169ee39-279b-4604-a565-72d394f0b353 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:34.828380 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7169ee39-279b-4604-a565-72d394f0b353 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:34.828834 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7169ee39-279b-4604-a565-72d394f0b353 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:35.190387 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e7e01cf7-68da-4caf-afe6-7e4dfa207e47 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:35.196909 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e7e01cf7-68da-4caf-afe6-7e4dfa207e47 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:35.214848 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e7e01cf7-68da-4caf-afe6-7e4dfa207e47 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:35.215316 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e7e01cf7-68da-4caf-afe6-7e4dfa207e47 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:35.216152 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e7e01cf7-68da-4caf-afe6-7e4dfa207e47 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:35.216642 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e7e01cf7-68da-4caf-afe6-7e4dfa207e47 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:35.309218 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7169ee39-279b-4604-a565-72d394f0b353 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:35.326789 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7169ee39-279b-4604-a565-72d394f0b353 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4" status: 200 len: 1313 microversion: 2.1 time: 0.511554 Apr 16 21:28:35.332318 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2791/5411] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:34 2022] GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4 => generated 1313 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:35.374668 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e7e01cf7-68da-4caf-afe6-7e4dfa207e47 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:35.392706 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e7e01cf7-68da-4caf-afe6-7e4dfa207e47 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441" status: 200 len: 1212 microversion: 2.1 time: 0.207952 Apr 16 21:28:35.398221 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2621/5412] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:35 2022] GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 => generated 1212 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:28:36.347299 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f5216d05-11fc-43ea-8cbd-16c1823ad615 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:36.348497 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f5216d05-11fc-43ea-8cbd-16c1823ad615 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: 5239bc09-9070-4897-8d6f-8084c2bab0b4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:36.355860 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f5216d05-11fc-43ea-8cbd-16c1823ad615 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:36.356589 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f5216d05-11fc-43ea-8cbd-16c1823ad615 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:36.359315 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f5216d05-11fc-43ea-8cbd-16c1823ad615 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:36.359315 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f5216d05-11fc-43ea-8cbd-16c1823ad615 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:36.416489 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e70e6a3b-85d8-48ff-af68-36a676780d29 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:36.418124 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e70e6a3b-85d8-48ff-af68-36a676780d29 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:36.492072 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e70e6a3b-85d8-48ff-af68-36a676780d29 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:36.492072 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e70e6a3b-85d8-48ff-af68-36a676780d29 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:36.492072 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e70e6a3b-85d8-48ff-af68-36a676780d29 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:36.492072 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e70e6a3b-85d8-48ff-af68-36a676780d29 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:36.584019 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e70e6a3b-85d8-48ff-af68-36a676780d29 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:36.593339 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e70e6a3b-85d8-48ff-af68-36a676780d29 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441" status: 200 len: 1260 microversion: 2.1 time: 0.181487 Apr 16 21:28:36.594820 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2622/5413] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:36 2022] GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 => generated 1260 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:28:37.216441 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f5216d05-11fc-43ea-8cbd-16c1823ad615 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:37.231928 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f5216d05-11fc-43ea-8cbd-16c1823ad615 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4" status: 200 len: 1313 microversion: 2.1 time: 0.887243 Apr 16 21:28:37.234071 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2792/5414] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:36 2022] GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4 => generated 1313 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:37.612400 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c9352c62-3658-4f0b-a7f6-ee6526de3a5a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:37.613651 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c9352c62-3658-4f0b-a7f6-ee6526de3a5a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:37.624994 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c9352c62-3658-4f0b-a7f6-ee6526de3a5a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:37.624994 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c9352c62-3658-4f0b-a7f6-ee6526de3a5a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:37.626995 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c9352c62-3658-4f0b-a7f6-ee6526de3a5a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:37.627660 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c9352c62-3658-4f0b-a7f6-ee6526de3a5a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:37.720243 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c9352c62-3658-4f0b-a7f6-ee6526de3a5a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:37.730946 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c9352c62-3658-4f0b-a7f6-ee6526de3a5a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441" status: 200 len: 1266 microversion: 2.1 time: 0.122957 Apr 16 21:28:37.731555 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2623/5415] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:37 2022] GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 => generated 1266 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:37.846059 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-9d0c1125-5f33-4fca-a05e-aad394da0984 req-af2e9cc8-c5f1-473a-b55b-57b611e40361 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5239bc09-9070-4897-8d6f-8084c2bab0b4", "name": "network-vif-plugged", "status": "completed", "tag": "f4d24ed3-2cac-4fe0-a31e-b2a60c5d5e0f"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:28:37.855391 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-9d0c1125-5f33-4fca-a05e-aad394da0984 req-af2e9cc8-c5f1-473a-b55b-57b611e40361 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:37.855944 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-9d0c1125-5f33-4fca-a05e-aad394da0984 req-af2e9cc8-c5f1-473a-b55b-57b611e40361 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:37.868903 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-9d0c1125-5f33-4fca-a05e-aad394da0984 req-af2e9cc8-c5f1-473a-b55b-57b611e40361 service nova] Creating event network-vif-plugged:f4d24ed3-2cac-4fe0-a31e-b2a60c5d5e0f for instance 5239bc09-9070-4897-8d6f-8084c2bab0b4 on nch1-master-1 Apr 16 21:28:37.876107 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-9d0c1125-5f33-4fca-a05e-aad394da0984 req-af2e9cc8-c5f1-473a-b55b-57b611e40361 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035881 Apr 16 21:28:37.876972 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2793/5416] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:28:38.131263 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-857cb93f-53cc-4bfd-acbd-6596db56072e tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1256349267", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "26fd8c71-2108-482c-9702-fc8775f3578f"}], "security_groups": [{"name": "tempest-securitygroup--1283956637"}], "key_name": "tempest-keypair-446245177", "user_data": "}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:28:38.250273 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0f5a59de-28e1-4a35-81cd-f2591d76107b tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:38.251451 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0f5a59de-28e1-4a35-81cd-f2591d76107b tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: 5239bc09-9070-4897-8d6f-8084c2bab0b4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:38.264695 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0f5a59de-28e1-4a35-81cd-f2591d76107b tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:38.265032 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0f5a59de-28e1-4a35-81cd-f2591d76107b tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:38.265916 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0f5a59de-28e1-4a35-81cd-f2591d76107b tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:38.266498 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0f5a59de-28e1-4a35-81cd-f2591d76107b tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:38.282682 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-857cb93f-53cc-4bfd-acbd-6596db56072e tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] validate_networks() for [('26fd8c71-2108-482c-9702-fc8775f3578f', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:28:38.506123 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0f5a59de-28e1-4a35-81cd-f2591d76107b tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:38.514065 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0f5a59de-28e1-4a35-81cd-f2591d76107b tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4" status: 200 len: 1313 microversion: 2.1 time: 0.268471 Apr 16 21:28:38.514718 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2794/5417] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:38 2022] GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4 => generated 1313 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:28:38.749085 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5f9c8457-7786-4aa0-aa25-478a95777ddb tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:38.749895 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5f9c8457-7786-4aa0-aa25-478a95777ddb tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:38.758386 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5f9c8457-7786-4aa0-aa25-478a95777ddb tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:38.761882 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5f9c8457-7786-4aa0-aa25-478a95777ddb tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:38.767460 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5f9c8457-7786-4aa0-aa25-478a95777ddb tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:38.768009 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5f9c8457-7786-4aa0-aa25-478a95777ddb tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:38.837818 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-857cb93f-53cc-4bfd-acbd-6596db56072e tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:28:38.838259 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-857cb93f-53cc-4bfd-acbd-6596db56072e tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:28:38.838745 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-857cb93f-53cc-4bfd-acbd-6596db56072e tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:28:38.839163 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-857cb93f-53cc-4bfd-acbd-6596db56072e tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:28:38.839692 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-857cb93f-53cc-4bfd-acbd-6596db56072e tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:28:38.853631 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-857cb93f-53cc-4bfd-acbd-6596db56072e tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:38.854257 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-857cb93f-53cc-4bfd-acbd-6596db56072e tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:38.855296 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-857cb93f-53cc-4bfd-acbd-6596db56072e tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:38.855796 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-857cb93f-53cc-4bfd-acbd-6596db56072e tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:38.881301 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-857cb93f-53cc-4bfd-acbd-6596db56072e tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Getting quotas for project d6f8dfa11e9b410cbbd59ffe32afeb26. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:28:38.902226 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-857cb93f-53cc-4bfd-acbd-6596db56072e tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Getting quotas for user 37443a4e933a4873bb039b06efaec98f and project d6f8dfa11e9b410cbbd59ffe32afeb26. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:28:38.934257 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-857cb93f-53cc-4bfd-acbd-6596db56072e tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:28:38.937872 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-857cb93f-53cc-4bfd-acbd-6596db56072e tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: eceddfa9-ecee-4523-825a-33cf91766dad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:28:39.118464 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-857cb93f-53cc-4bfd-acbd-6596db56072e tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.989610 Apr 16 21:28:39.119879 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2624/5418] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:28:38 2022] POST /compute/v2.1/servers => generated 402 bytes in 994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 16 21:28:39.130857 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0c71ed7e-d286-4698-b7c3-997b9e70d7fe tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:39.135456 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0c71ed7e-d286-4698-b7c3-997b9e70d7fe tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: eceddfa9-ecee-4523-825a-33cf91766dad] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:39.243068 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0c71ed7e-d286-4698-b7c3-997b9e70d7fe tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:39.253140 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0c71ed7e-d286-4698-b7c3-997b9e70d7fe tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad" status: 200 len: 1241 microversion: 2.1 time: 0.127183 Apr 16 21:28:39.262004 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2625/5419] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:39 2022] GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad => generated 1241 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:39.297123 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5f9c8457-7786-4aa0-aa25-478a95777ddb tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:39.310762 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5f9c8457-7786-4aa0-aa25-478a95777ddb tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441" status: 200 len: 1308 microversion: 2.1 time: 0.565484 Apr 16 21:28:39.312281 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2795/5420] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:38 2022] GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 => generated 1308 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:28:39.531131 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9560b9b8-56ba-402e-bfb4-34770ef3c146 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:39.531743 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9560b9b8-56ba-402e-bfb4-34770ef3c146 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: 5239bc09-9070-4897-8d6f-8084c2bab0b4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:39.547837 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9560b9b8-56ba-402e-bfb4-34770ef3c146 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:39.548541 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9560b9b8-56ba-402e-bfb4-34770ef3c146 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:39.549344 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9560b9b8-56ba-402e-bfb4-34770ef3c146 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:39.550354 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9560b9b8-56ba-402e-bfb4-34770ef3c146 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:39.967481 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9560b9b8-56ba-402e-bfb4-34770ef3c146 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:39.977975 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9560b9b8-56ba-402e-bfb4-34770ef3c146 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4" status: 200 len: 1499 microversion: 2.1 time: 0.449026 Apr 16 21:28:39.994733 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4f2db1ed-dc1b-4ab0-8e2b-1db39de34d18 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:28:39.995963 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4f2db1ed-dc1b-4ab0-8e2b-1db39de34d18 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: 5239bc09-9070-4897-8d6f-8084c2bab0b4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:40.000423 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2626/5421] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:39 2022] GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4 => generated 1499 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:28:40.003765 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4f2db1ed-dc1b-4ab0-8e2b-1db39de34d18 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:40.004423 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4f2db1ed-dc1b-4ab0-8e2b-1db39de34d18 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:40.005251 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4f2db1ed-dc1b-4ab0-8e2b-1db39de34d18 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:40.005847 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4f2db1ed-dc1b-4ab0-8e2b-1db39de34d18 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:40.030786 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-4f2db1ed-dc1b-4ab0-8e2b-1db39de34d18 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lazy-loading 'flavor' on Instance uuid 5239bc09-9070-4897-8d6f-8084c2bab0b4 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:28:40.271229 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-03983d93-e298-433c-84d8-3f4b399fca42 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:40.271750 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-03983d93-e298-433c-84d8-3f4b399fca42 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: eceddfa9-ecee-4523-825a-33cf91766dad] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:40.397935 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-03983d93-e298-433c-84d8-3f4b399fca42 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:40.413668 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-03983d93-e298-433c-84d8-3f4b399fca42 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad" status: 200 len: 1241 microversion: 2.1 time: 0.147284 Apr 16 21:28:40.414528 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2627/5422] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:40 2022] GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad => generated 1241 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:40.421503 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fe4f0402-0ebc-41f7-bae9-541f2538e1ab tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:40.423378 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-fe4f0402-0ebc-41f7-bae9-541f2538e1ab tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:40.431945 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fe4f0402-0ebc-41f7-bae9-541f2538e1ab tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:40.432505 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fe4f0402-0ebc-41f7-bae9-541f2538e1ab tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:40.435511 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fe4f0402-0ebc-41f7-bae9-541f2538e1ab tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:40.435511 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fe4f0402-0ebc-41f7-bae9-541f2538e1ab tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:40.565456 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4f2db1ed-dc1b-4ab0-8e2b-1db39de34d18 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "POST /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4/action" status: 200 len: 32 microversion: 2.1 time: 0.570350 Apr 16 21:28:40.583821 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2796/5423] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:28:39 2022] POST /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4/action => generated 32 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:28:40.601743 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8c95f4b5-586e-4457-9287-d8686d72792f tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:40.603935 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8c95f4b5-586e-4457-9287-d8686d72792f tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: 5239bc09-9070-4897-8d6f-8084c2bab0b4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:40.624693 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8c95f4b5-586e-4457-9287-d8686d72792f tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:40.629847 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8c95f4b5-586e-4457-9287-d8686d72792f tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:40.629847 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8c95f4b5-586e-4457-9287-d8686d72792f tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:40.629847 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8c95f4b5-586e-4457-9287-d8686d72792f tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:40.691080 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-fe4f0402-0ebc-41f7-bae9-541f2538e1ab tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:40.716613 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fe4f0402-0ebc-41f7-bae9-541f2538e1ab tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441" status: 200 len: 1308 microversion: 2.1 time: 0.299122 Apr 16 21:28:40.724257 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2628/5424] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:40 2022] GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 => generated 1308 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:41.050460 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-b59a8e87-eeb5-436b-a790-c8207a6a86ba req-23bc75cc-736d-42db-a2a6-f04d0bf9c3c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1589a50-e8ea-41a3-bf7e-c4b0d97ea441", "tag": "72e80f4a-33ee-4111-881b-80866aba5dc0"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:28:41.060416 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-b59a8e87-eeb5-436b-a790-c8207a6a86ba req-23bc75cc-736d-42db-a2a6-f04d0bf9c3c2 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:41.061995 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-b59a8e87-eeb5-436b-a790-c8207a6a86ba req-23bc75cc-736d-42db-a2a6-f04d0bf9c3c2 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:41.088849 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-b59a8e87-eeb5-436b-a790-c8207a6a86ba req-23bc75cc-736d-42db-a2a6-f04d0bf9c3c2 service nova] Creating event network-changed:72e80f4a-33ee-4111-881b-80866aba5dc0 for instance b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 on nch2-master-1 Apr 16 21:28:41.095509 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8c95f4b5-586e-4457-9287-d8686d72792f tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:41.102337 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-b59a8e87-eeb5-436b-a790-c8207a6a86ba req-23bc75cc-736d-42db-a2a6-f04d0bf9c3c2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.380210 Apr 16 21:28:41.103318 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2629/5425] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:28:41.109707 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8c95f4b5-586e-4457-9287-d8686d72792f tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4" status: 200 len: 1505 microversion: 2.1 time: 0.522502 Apr 16 21:28:41.110987 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2797/5426] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:40 2022] GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4 => generated 1505 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:41.435277 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8cd6c78b-7d78-4485-856d-6a74fa34bed8 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:41.438217 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8cd6c78b-7d78-4485-856d-6a74fa34bed8 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: eceddfa9-ecee-4523-825a-33cf91766dad] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:41.451767 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8cd6c78b-7d78-4485-856d-6a74fa34bed8 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:41.473118 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8cd6c78b-7d78-4485-856d-6a74fa34bed8 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:41.473118 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8cd6c78b-7d78-4485-856d-6a74fa34bed8 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:41.473118 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8cd6c78b-7d78-4485-856d-6a74fa34bed8 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:41.680537 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8cd6c78b-7d78-4485-856d-6a74fa34bed8 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:41.694522 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8cd6c78b-7d78-4485-856d-6a74fa34bed8 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad" status: 200 len: 1237 microversion: 2.1 time: 0.266846 Apr 16 21:28:41.697318 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2630/5427] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:41 2022] GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad => generated 1237 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:41.742164 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d5070fc0-d085-4109-ad7d-46d0fdad92f1 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:41.745503 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d5070fc0-d085-4109-ad7d-46d0fdad92f1 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:41.757229 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d5070fc0-d085-4109-ad7d-46d0fdad92f1 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:41.757696 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d5070fc0-d085-4109-ad7d-46d0fdad92f1 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:41.758788 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d5070fc0-d085-4109-ad7d-46d0fdad92f1 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:41.759779 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d5070fc0-d085-4109-ad7d-46d0fdad92f1 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:42.036819 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d5070fc0-d085-4109-ad7d-46d0fdad92f1 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:42.065715 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d5070fc0-d085-4109-ad7d-46d0fdad92f1 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441" status: 200 len: 1308 microversion: 2.1 time: 0.332549 Apr 16 21:28:42.068618 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2798/5428] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:41 2022] GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 => generated 1308 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:42.129105 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-887b18e0-587e-4ec2-85e0-6f97a7f320b0 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:42.130397 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-887b18e0-587e-4ec2-85e0-6f97a7f320b0 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: 5239bc09-9070-4897-8d6f-8084c2bab0b4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:42.140239 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-887b18e0-587e-4ec2-85e0-6f97a7f320b0 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:42.145384 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-887b18e0-587e-4ec2-85e0-6f97a7f320b0 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:42.148065 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-887b18e0-587e-4ec2-85e0-6f97a7f320b0 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:42.151048 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-887b18e0-587e-4ec2-85e0-6f97a7f320b0 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:42.448844 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-887b18e0-587e-4ec2-85e0-6f97a7f320b0 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:42.462907 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-887b18e0-587e-4ec2-85e0-6f97a7f320b0 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4" status: 200 len: 1505 microversion: 2.1 time: 0.339300 Apr 16 21:28:42.466019 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2631/5429] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:42 2022] GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4 => generated 1505 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:42.711156 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b12e5d65-e039-452b-92bb-86cbf2a9c015 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:42.712010 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b12e5d65-e039-452b-92bb-86cbf2a9c015 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: eceddfa9-ecee-4523-825a-33cf91766dad] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:42.720925 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b12e5d65-e039-452b-92bb-86cbf2a9c015 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:42.721532 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b12e5d65-e039-452b-92bb-86cbf2a9c015 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:42.722496 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b12e5d65-e039-452b-92bb-86cbf2a9c015 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:42.723084 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b12e5d65-e039-452b-92bb-86cbf2a9c015 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:42.796551 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b12e5d65-e039-452b-92bb-86cbf2a9c015 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:42.807247 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b12e5d65-e039-452b-92bb-86cbf2a9c015 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad" status: 200 len: 1293 microversion: 2.1 time: 0.097685 Apr 16 21:28:42.808100 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2799/5430] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:42 2022] GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad => generated 1293 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:43.084724 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8f7a4cd1-1eae-41fd-bf03-6168ea596a2a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:43.085580 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8f7a4cd1-1eae-41fd-bf03-6168ea596a2a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:43.096753 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8f7a4cd1-1eae-41fd-bf03-6168ea596a2a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:43.097306 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8f7a4cd1-1eae-41fd-bf03-6168ea596a2a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:43.098235 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8f7a4cd1-1eae-41fd-bf03-6168ea596a2a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:43.098947 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8f7a4cd1-1eae-41fd-bf03-6168ea596a2a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:43.262171 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5b8b2139-bcb8-489b-8fd0-c348e2cd2ace tempest-TestAggregatesBasicOps-1465434573 tempest-TestAggregatesBasicOps-1465434573-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-951216247", "availability_zone": "foo_zone"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:28:43.263806 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:28:43.263806 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:28:43.264819 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.aggregate [None req-5b8b2139-bcb8-489b-8fd0-c348e2cd2ace tempest-TestAggregatesBasicOps-1465434573 tempest-TestAggregatesBasicOps-1465434573-project-admin] Generated uuid 82da1b6b-a83b-4a6b-9d60-0d24438ad5ff for aggregate {{(pid=137409) create /opt/stack/nova/nova/objects/aggregate.py:298}} Apr 16 21:28:43.401773 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5b8b2139-bcb8-489b-8fd0-c348e2cd2ace tempest-TestAggregatesBasicOps-1465434573 tempest-TestAggregatesBasicOps-1465434573-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.332664 Apr 16 21:28:43.403123 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2632/5431] 10.222.0.20 () {60 vars in 1163 bytes} [Sat Apr 16 21:28:43 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:28:43.410219 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8f7a4cd1-1eae-41fd-bf03-6168ea596a2a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:43.415593 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6e1c1ea3-a3c4-495f-a69b-df61697aefb7 tempest-TestAggregatesBasicOps-1465434573 tempest-TestAggregatesBasicOps-1465434573-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:28:43.417933 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8f7a4cd1-1eae-41fd-bf03-6168ea596a2a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441" status: 200 len: 1308 microversion: 2.1 time: 0.337497 Apr 16 21:28:43.426817 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2800/5432] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:43 2022] GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 => generated 1308 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:28:43.428450 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:28:43.428450 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:28:43.488972 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1738f83c-095d-493d-b50e-fc9901e6080f tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:43.488972 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1738f83c-095d-493d-b50e-fc9901e6080f tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: 5239bc09-9070-4897-8d6f-8084c2bab0b4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:43.492886 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1738f83c-095d-493d-b50e-fc9901e6080f tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:43.493448 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1738f83c-095d-493d-b50e-fc9901e6080f tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:43.494480 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1738f83c-095d-493d-b50e-fc9901e6080f tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:43.494995 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1738f83c-095d-493d-b50e-fc9901e6080f tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:43.544717 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6e1c1ea3-a3c4-495f-a69b-df61697aefb7 tempest-TestAggregatesBasicOps-1465434573 tempest-TestAggregatesBasicOps-1465434573-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.134138 Apr 16 21:28:43.545532 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2633/5433] 10.222.0.20 () {60 vars in 1193 bytes} [Sat Apr 16 21:28:43 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:28:43.555592 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0b6d96df-48a6-4247-92ee-2d3101290096 tempest-TestAggregatesBasicOps-1465434573 tempest-TestAggregatesBasicOps-1465434573-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:43.557228 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:28:43.557228 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:28:43.558732 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0b6d96df-48a6-4247-92ee-2d3101290096 tempest-TestAggregatesBasicOps-1465434573 tempest-TestAggregatesBasicOps-1465434573-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:43.559505 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0b6d96df-48a6-4247-92ee-2d3101290096 tempest-TestAggregatesBasicOps-1465434573 tempest-TestAggregatesBasicOps-1465434573-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:43.560531 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0b6d96df-48a6-4247-92ee-2d3101290096 tempest-TestAggregatesBasicOps-1465434573 tempest-TestAggregatesBasicOps-1465434573-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:43.561129 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0b6d96df-48a6-4247-92ee-2d3101290096 tempest-TestAggregatesBasicOps-1465434573 tempest-TestAggregatesBasicOps-1465434573-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:43.594598 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0b6d96df-48a6-4247-92ee-2d3101290096 tempest-TestAggregatesBasicOps-1465434573 tempest-TestAggregatesBasicOps-1465434573-project-admin] 10.222.0.20 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.042603 Apr 16 21:28:43.595472 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2634/5434] 10.222.0.20 () {58 vars in 1175 bytes} [Sat Apr 16 21:28:43 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:28:43.660489 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c42d6a81-9091-4251-8baf-fc7265ab34d7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1068943972 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1068943972-project-admin] Calling method '.version_select at 0x7fbb95808670>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:43.666544 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:28:43.666544 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:28:43.668389 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c42d6a81-9091-4251-8baf-fc7265ab34d7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1068943972 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1068943972-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:43.668862 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c42d6a81-9091-4251-8baf-fc7265ab34d7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1068943972 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1068943972-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:43.684369 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c42d6a81-9091-4251-8baf-fc7265ab34d7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1068943972 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1068943972-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:43.684839 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c42d6a81-9091-4251-8baf-fc7265ab34d7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1068943972 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1068943972-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:43.695637 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c42d6a81-9091-4251-8baf-fc7265ab34d7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1068943972 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1068943972-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:43.696375 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c42d6a81-9091-4251-8baf-fc7265ab34d7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1068943972 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1068943972-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:43.703049 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c42d6a81-9091-4251-8baf-fc7265ab34d7 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1068943972 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1068943972-project-admin] 10.222.0.20 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.105582 Apr 16 21:28:43.703674 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2635/5435] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:28:43 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:28:43.708530 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-622fac9a-28c3-4c4b-aaca-67889a3cd4d0 tempest-TestAggregatesBasicOps-1465434573 tempest-TestAggregatesBasicOps-1465434573-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:43.709533 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:28:43.709533 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:28:43.717499 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-622fac9a-28c3-4c4b-aaca-67889a3cd4d0 tempest-TestAggregatesBasicOps-1465434573 tempest-TestAggregatesBasicOps-1465434573-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.012745 Apr 16 21:28:43.718277 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2636/5436] 10.222.0.20 () {58 vars in 1142 bytes} [Sat Apr 16 21:28:43 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:28:43.730115 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f6772fc7-1e7d-47b5-835e-a34df9e39ea4 tempest-TestAggregatesBasicOps-1465434573 tempest-TestAggregatesBasicOps-1465434573-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "nch1-master-1"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:28:43.731363 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:28:43.731363 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:28:43.740235 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f6772fc7-1e7d-47b5-835e-a34df9e39ea4 tempest-TestAggregatesBasicOps-1465434573 tempest-TestAggregatesBasicOps-1465434573-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:43.740730 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f6772fc7-1e7d-47b5-835e-a34df9e39ea4 tempest-TestAggregatesBasicOps-1465434573 tempest-TestAggregatesBasicOps-1465434573-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:43.761355 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1738f83c-095d-493d-b50e-fc9901e6080f tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:43.769580 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1738f83c-095d-493d-b50e-fc9901e6080f tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4" status: 200 len: 1505 microversion: 2.1 time: 0.289390 Apr 16 21:28:43.770386 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2801/5437] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:43 2022] GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4 => generated 1505 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:43.825120 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bd25893b-c944-4646-acae-0e02c5331c2a tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:43.825729 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-bd25893b-c944-4646-acae-0e02c5331c2a tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: eceddfa9-ecee-4523-825a-33cf91766dad] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:43.845183 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bd25893b-c944-4646-acae-0e02c5331c2a tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:43.845645 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bd25893b-c944-4646-acae-0e02c5331c2a tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:43.847130 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bd25893b-c944-4646-acae-0e02c5331c2a tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:43.847130 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bd25893b-c944-4646-acae-0e02c5331c2a tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:44.089913 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-bd25893b-c944-4646-acae-0e02c5331c2a tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:44.099347 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-bd25893b-c944-4646-acae-0e02c5331c2a tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad" status: 200 len: 1293 microversion: 2.1 time: 0.278199 Apr 16 21:28:44.122883 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2802/5438] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:43 2022] GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad => generated 1293 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:28:44.301157 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f6772fc7-1e7d-47b5-835e-a34df9e39ea4 tempest-TestAggregatesBasicOps-1465434573 tempest-TestAggregatesBasicOps-1465434573-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.574945 Apr 16 21:28:44.302825 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2637/5439] 10.222.0.20 () {60 vars in 1193 bytes} [Sat Apr 16 21:28:43 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:28:44.313959 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-379e1e05-7ced-4b5e-9532-0a74f0ec7b7b tempest-TestAggregatesBasicOps-1465434573 tempest-TestAggregatesBasicOps-1465434573-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:44.316503 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:28:44.316503 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:28:44.327064 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-379e1e05-7ced-4b5e-9532-0a74f0ec7b7b tempest-TestAggregatesBasicOps-1465434573 tempest-TestAggregatesBasicOps-1465434573-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.017731 Apr 16 21:28:44.328528 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2803/5440] 10.222.0.20 () {58 vars in 1151 bytes} [Sat Apr 16 21:28:44 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:28:44.343512 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b52963c0-e42d-45d7-9dd3-977051519c46 tempest-TestAggregatesBasicOps-1465434573 tempest-TestAggregatesBasicOps-1465434573-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-366655189", "availability_zone": "foo_zone"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:28:44.356780 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:28:44.356780 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:28:44.442490 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3c7062f9-3f33-48f9-9944-5e869a9b7fed tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:44.443261 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3c7062f9-3f33-48f9-9944-5e869a9b7fed tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:44.459396 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3c7062f9-3f33-48f9-9944-5e869a9b7fed tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:44.460273 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3c7062f9-3f33-48f9-9944-5e869a9b7fed tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:44.461291 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3c7062f9-3f33-48f9-9944-5e869a9b7fed tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:44.461912 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3c7062f9-3f33-48f9-9944-5e869a9b7fed tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:44.506844 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b52963c0-e42d-45d7-9dd3-977051519c46 tempest-TestAggregatesBasicOps-1465434573 tempest-TestAggregatesBasicOps-1465434573-project-admin] 10.222.0.20 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.172024 Apr 16 21:28:44.513080 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2638/5441] 10.222.0.20 () {60 vars in 1172 bytes} [Sat Apr 16 21:28:44 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:28:44.518330 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6b51f323-1a85-4b23-93c2-9046acb1f4cb tempest-TestAggregatesBasicOps-1465434573 tempest-TestAggregatesBasicOps-1465434573-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:28:44.519853 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:28:44.519853 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:28:44.607405 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6b51f323-1a85-4b23-93c2-9046acb1f4cb tempest-TestAggregatesBasicOps-1465434573 tempest-TestAggregatesBasicOps-1465434573-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.092941 Apr 16 21:28:44.608284 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2639/5442] 10.222.0.20 () {60 vars in 1193 bytes} [Sat Apr 16 21:28:44 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:28:44.619508 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-93b4a2be-5cbf-426b-871b-b6ea3a7b4be4 tempest-TestAggregatesBasicOps-1465434573 tempest-TestAggregatesBasicOps-1465434573-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:44.622567 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:28:44.622567 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:28:44.640609 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-93b4a2be-5cbf-426b-871b-b6ea3a7b4be4 tempest-TestAggregatesBasicOps-1465434573 tempest-TestAggregatesBasicOps-1465434573-project-admin] 10.222.0.20 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.025422 Apr 16 21:28:44.653432 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2640/5443] 10.222.0.20 () {58 vars in 1151 bytes} [Sat Apr 16 21:28:44 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:28:44.663097 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ecea24bb-261e-43e2-8a6a-13fae1a57f20 tempest-TestAggregatesBasicOps-1465434573 tempest-TestAggregatesBasicOps-1465434573-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nch1-master-1"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:28:44.666989 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:28:44.666989 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:28:44.696957 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ecea24bb-261e-43e2-8a6a-13fae1a57f20 tempest-TestAggregatesBasicOps-1465434573 tempest-TestAggregatesBasicOps-1465434573-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:44.698525 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ecea24bb-261e-43e2-8a6a-13fae1a57f20 tempest-TestAggregatesBasicOps-1465434573 tempest-TestAggregatesBasicOps-1465434573-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:44.792893 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3c7062f9-3f33-48f9-9944-5e869a9b7fed tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:44.802050 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3c7062f9-3f33-48f9-9944-5e869a9b7fed tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441" status: 200 len: 1308 microversion: 2.1 time: 0.364781 Apr 16 21:28:44.805962 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2804/5444] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:44 2022] GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 => generated 1308 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:44.820865 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e3dbca30-2874-4418-8928-c9ab1a788daf tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:44.821617 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e3dbca30-2874-4418-8928-c9ab1a788daf tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: 5239bc09-9070-4897-8d6f-8084c2bab0b4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:44.830751 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e3dbca30-2874-4418-8928-c9ab1a788daf tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:44.831396 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e3dbca30-2874-4418-8928-c9ab1a788daf tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:44.832274 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e3dbca30-2874-4418-8928-c9ab1a788daf tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:44.832729 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e3dbca30-2874-4418-8928-c9ab1a788daf tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:45.127984 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ecea24bb-261e-43e2-8a6a-13fae1a57f20 tempest-TestAggregatesBasicOps-1465434573 tempest-TestAggregatesBasicOps-1465434573-project-admin] 10.222.0.20 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.472721 Apr 16 21:28:45.128966 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2641/5445] 10.222.0.20 () {60 vars in 1193 bytes} [Sat Apr 16 21:28:44 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:28:45.141457 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-06254ce0-f397-4bda-b0e9-cf5a77cd1bce tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:45.142956 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-06254ce0-f397-4bda-b0e9-cf5a77cd1bce tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: eceddfa9-ecee-4523-825a-33cf91766dad] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:45.155459 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-06254ce0-f397-4bda-b0e9-cf5a77cd1bce tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:45.156407 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-06254ce0-f397-4bda-b0e9-cf5a77cd1bce tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:45.157595 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-06254ce0-f397-4bda-b0e9-cf5a77cd1bce tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:45.158295 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-06254ce0-f397-4bda-b0e9-cf5a77cd1bce tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:45.241304 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e3dbca30-2874-4418-8928-c9ab1a788daf tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:45.249637 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e3dbca30-2874-4418-8928-c9ab1a788daf tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4" status: 200 len: 1509 microversion: 2.1 time: 0.442554 Apr 16 21:28:45.252941 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2805/5446] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:44 2022] GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4 => generated 1509 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:45.266370 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9e426647-cefd-4d9d-a9a5-b8196284eb20 tempest-TestAggregatesBasicOps-1465434573 tempest-TestAggregatesBasicOps-1465434573-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:45.267507 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:28:45.267507 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:28:45.389893 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9e426647-cefd-4d9d-a9a5-b8196284eb20 tempest-TestAggregatesBasicOps-1465434573 tempest-TestAggregatesBasicOps-1465434573-project-admin] 10.222.0.20 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.134902 Apr 16 21:28:45.390613 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2806/5447] 10.222.0.20 () {58 vars in 1154 bytes} [Sat Apr 16 21:28:45 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Apr 16 21:28:45.660603 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-06254ce0-f397-4bda-b0e9-cf5a77cd1bce tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:45.676063 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-06254ce0-f397-4bda-b0e9-cf5a77cd1bce tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad" status: 200 len: 1299 microversion: 2.1 time: 0.545799 Apr 16 21:28:45.687639 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2642/5448] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:45 2022] GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad => generated 1299 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:45.820953 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9011ff59-603b-4896-9a79-3f6703d6cc9d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:45.821578 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9011ff59-603b-4896-9a79-3f6703d6cc9d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:45.837504 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9011ff59-603b-4896-9a79-3f6703d6cc9d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:45.838610 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9011ff59-603b-4896-9a79-3f6703d6cc9d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:45.840450 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9011ff59-603b-4896-9a79-3f6703d6cc9d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:45.841060 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9011ff59-603b-4896-9a79-3f6703d6cc9d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:46.269820 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4aedc878-faca-4e73-a2af-c123798ae712 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:46.270909 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4aedc878-faca-4e73-a2af-c123798ae712 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: 5239bc09-9070-4897-8d6f-8084c2bab0b4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:46.288765 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4aedc878-faca-4e73-a2af-c123798ae712 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:46.289259 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4aedc878-faca-4e73-a2af-c123798ae712 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:46.290123 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4aedc878-faca-4e73-a2af-c123798ae712 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:46.290548 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4aedc878-faca-4e73-a2af-c123798ae712 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:46.374491 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9011ff59-603b-4896-9a79-3f6703d6cc9d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:46.399018 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9011ff59-603b-4896-9a79-3f6703d6cc9d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441" status: 200 len: 1308 microversion: 2.1 time: 0.581392 Apr 16 21:28:46.400073 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2807/5449] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:45 2022] GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 => generated 1308 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:46.612154 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4aedc878-faca-4e73-a2af-c123798ae712 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:46.612154 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4aedc878-faca-4e73-a2af-c123798ae712 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4" status: 200 len: 1505 microversion: 2.1 time: 0.338252 Apr 16 21:28:46.612154 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2643/5450] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:46 2022] GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4 => generated 1505 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:28:46.693309 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c6287fd3-c2dc-4a02-9cff-ac960e847d11 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:46.694131 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c6287fd3-c2dc-4a02-9cff-ac960e847d11 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: eceddfa9-ecee-4523-825a-33cf91766dad] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:46.700448 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c6287fd3-c2dc-4a02-9cff-ac960e847d11 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:46.700990 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c6287fd3-c2dc-4a02-9cff-ac960e847d11 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:46.701790 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c6287fd3-c2dc-4a02-9cff-ac960e847d11 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:46.702233 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c6287fd3-c2dc-4a02-9cff-ac960e847d11 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:46.807413 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c6287fd3-c2dc-4a02-9cff-ac960e847d11 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:46.828426 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c6287fd3-c2dc-4a02-9cff-ac960e847d11 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad" status: 200 len: 1299 microversion: 2.1 time: 0.138875 Apr 16 21:28:46.840574 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2808/5451] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:46 2022] GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad => generated 1299 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:46.907052 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-1030ccde-ed36-44d3-905b-6e083313901a req-fcfdaa9b-6335-42ef-8af2-f8db72003c38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1589a50-e8ea-41a3-bf7e-c4b0d97ea441", "name": "network-vif-plugged", "status": "completed", "tag": "72e80f4a-33ee-4111-881b-80866aba5dc0"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:28:46.915922 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-1030ccde-ed36-44d3-905b-6e083313901a req-fcfdaa9b-6335-42ef-8af2-f8db72003c38 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:46.920474 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-1030ccde-ed36-44d3-905b-6e083313901a req-fcfdaa9b-6335-42ef-8af2-f8db72003c38 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:46.946435 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-1030ccde-ed36-44d3-905b-6e083313901a req-fcfdaa9b-6335-42ef-8af2-f8db72003c38 service nova] Creating event network-vif-plugged:72e80f4a-33ee-4111-881b-80866aba5dc0 for instance b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 on nch2-master-1 Apr 16 21:28:46.962631 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-1030ccde-ed36-44d3-905b-6e083313901a req-fcfdaa9b-6335-42ef-8af2-f8db72003c38 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055337 Apr 16 21:28:46.972588 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2644/5452] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:28:47.416356 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e7cba455-a84c-4c3c-96b1-e27a0e299fc0 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:47.417923 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e7cba455-a84c-4c3c-96b1-e27a0e299fc0 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:47.427910 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e7cba455-a84c-4c3c-96b1-e27a0e299fc0 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:47.428406 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e7cba455-a84c-4c3c-96b1-e27a0e299fc0 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:47.441132 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e7cba455-a84c-4c3c-96b1-e27a0e299fc0 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:47.441132 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e7cba455-a84c-4c3c-96b1-e27a0e299fc0 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:47.622017 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3869728d-ed99-4691-92d6-bbdce893361d tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:47.623011 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3869728d-ed99-4691-92d6-bbdce893361d tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: 5239bc09-9070-4897-8d6f-8084c2bab0b4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:47.635390 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3869728d-ed99-4691-92d6-bbdce893361d tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:47.635856 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3869728d-ed99-4691-92d6-bbdce893361d tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:47.636669 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3869728d-ed99-4691-92d6-bbdce893361d tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:47.637114 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3869728d-ed99-4691-92d6-bbdce893361d tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:47.817987 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e7cba455-a84c-4c3c-96b1-e27a0e299fc0 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:47.826261 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e7cba455-a84c-4c3c-96b1-e27a0e299fc0 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441" status: 200 len: 1308 microversion: 2.1 time: 0.413691 Apr 16 21:28:47.827114 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2809/5453] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:47 2022] GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 => generated 1308 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:28:47.847590 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0f26a4ab-e9ea-478a-90c2-14055f9466ca tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:47.848226 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0f26a4ab-e9ea-478a-90c2-14055f9466ca tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: eceddfa9-ecee-4523-825a-33cf91766dad] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:47.864460 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0f26a4ab-e9ea-478a-90c2-14055f9466ca tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:47.864921 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0f26a4ab-e9ea-478a-90c2-14055f9466ca tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:47.865719 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0f26a4ab-e9ea-478a-90c2-14055f9466ca tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:47.866159 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0f26a4ab-e9ea-478a-90c2-14055f9466ca tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:47.965731 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3869728d-ed99-4691-92d6-bbdce893361d tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:47.975108 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3869728d-ed99-4691-92d6-bbdce893361d tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4" status: 200 len: 1505 microversion: 2.1 time: 0.357674 Apr 16 21:28:47.975697 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2645/5454] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:47 2022] GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4 => generated 1505 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:28:48.182511 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0f26a4ab-e9ea-478a-90c2-14055f9466ca tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:48.190180 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0f26a4ab-e9ea-478a-90c2-14055f9466ca tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad" status: 200 len: 1367 microversion: 2.1 time: 0.347989 Apr 16 21:28:48.197498 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2810/5455] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:47 2022] GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad => generated 1367 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:48.853088 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1f039ac1-f92d-4280-a881-db777cc74dcf tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:48.857269 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1f039ac1-f92d-4280-a881-db777cc74dcf tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:48.870915 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1f039ac1-f92d-4280-a881-db777cc74dcf tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:48.873716 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1f039ac1-f92d-4280-a881-db777cc74dcf tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:48.874966 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1f039ac1-f92d-4280-a881-db777cc74dcf tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:48.875650 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1f039ac1-f92d-4280-a881-db777cc74dcf tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:48.994549 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-adcab9e7-e01f-4653-a0e8-ed24ba810e1a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:48.996658 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-adcab9e7-e01f-4653-a0e8-ed24ba810e1a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: 5239bc09-9070-4897-8d6f-8084c2bab0b4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:49.016742 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-adcab9e7-e01f-4653-a0e8-ed24ba810e1a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:49.017636 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-adcab9e7-e01f-4653-a0e8-ed24ba810e1a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:49.018737 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-adcab9e7-e01f-4653-a0e8-ed24ba810e1a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:49.019609 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-adcab9e7-e01f-4653-a0e8-ed24ba810e1a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:49.230448 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1f039ac1-f92d-4280-a881-db777cc74dcf tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:49.240941 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1f039ac1-f92d-4280-a881-db777cc74dcf tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441" status: 200 len: 1308 microversion: 2.1 time: 0.393029 Apr 16 21:28:49.243427 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2646/5456] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:48 2022] GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 => generated 1308 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:49.257524 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-71c2806c-91cd-4a46-96dd-aead288d1f15 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:49.258613 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-71c2806c-91cd-4a46-96dd-aead288d1f15 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: eceddfa9-ecee-4523-825a-33cf91766dad] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:49.282616 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-71c2806c-91cd-4a46-96dd-aead288d1f15 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:49.283097 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-71c2806c-91cd-4a46-96dd-aead288d1f15 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:49.284461 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-71c2806c-91cd-4a46-96dd-aead288d1f15 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:49.284916 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-71c2806c-91cd-4a46-96dd-aead288d1f15 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:49.454693 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-adcab9e7-e01f-4653-a0e8-ed24ba810e1a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:49.464749 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-adcab9e7-e01f-4653-a0e8-ed24ba810e1a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4" status: 200 len: 1505 microversion: 2.1 time: 0.475463 Apr 16 21:28:49.475236 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2811/5457] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:48 2022] GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4 => generated 1505 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:49.608704 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-71c2806c-91cd-4a46-96dd-aead288d1f15 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:49.616431 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-71c2806c-91cd-4a46-96dd-aead288d1f15 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad" status: 200 len: 1367 microversion: 2.1 time: 0.371805 Apr 16 21:28:49.618758 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2647/5458] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:49 2022] GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad => generated 1367 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:49.848543 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-8c3701b1-c435-4c42-8dcd-3ec114bbceff req-108f0ae7-a5a4-4e81-b369-26344aaf0638 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eceddfa9-ecee-4523-825a-33cf91766dad", "tag": "037fa6e8-a27a-4e66-a818-2f415b14f622"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:28:49.859440 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-8c3701b1-c435-4c42-8dcd-3ec114bbceff req-108f0ae7-a5a4-4e81-b369-26344aaf0638 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:49.860586 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-8c3701b1-c435-4c42-8dcd-3ec114bbceff req-108f0ae7-a5a4-4e81-b369-26344aaf0638 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:49.873729 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-8c3701b1-c435-4c42-8dcd-3ec114bbceff req-108f0ae7-a5a4-4e81-b369-26344aaf0638 service nova] Creating event network-changed:037fa6e8-a27a-4e66-a818-2f415b14f622 for instance eceddfa9-ecee-4523-825a-33cf91766dad on nch2-master-1 Apr 16 21:28:49.882123 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-8c3701b1-c435-4c42-8dcd-3ec114bbceff req-108f0ae7-a5a4-4e81-b369-26344aaf0638 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035897 Apr 16 21:28:49.882123 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2812/5459] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:28:50.260036 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ab4ec6c2-9821-4209-9154-579bc193c0d8 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:50.261308 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ab4ec6c2-9821-4209-9154-579bc193c0d8 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:50.271883 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ab4ec6c2-9821-4209-9154-579bc193c0d8 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:50.272702 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ab4ec6c2-9821-4209-9154-579bc193c0d8 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:50.273690 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ab4ec6c2-9821-4209-9154-579bc193c0d8 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:50.274323 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ab4ec6c2-9821-4209-9154-579bc193c0d8 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:50.473003 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ab4ec6c2-9821-4209-9154-579bc193c0d8 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:50.483630 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-439ccedf-4e60-46da-bec2-1855a4bbf9e3 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:50.484439 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-439ccedf-4e60-46da-bec2-1855a4bbf9e3 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: 5239bc09-9070-4897-8d6f-8084c2bab0b4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:50.493888 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ab4ec6c2-9821-4209-9154-579bc193c0d8 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441" status: 200 len: 1490 microversion: 2.1 time: 0.237803 Apr 16 21:28:50.494539 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2648/5460] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:50 2022] GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 => generated 1490 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:50.501686 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-439ccedf-4e60-46da-bec2-1855a4bbf9e3 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:50.502402 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-439ccedf-4e60-46da-bec2-1855a4bbf9e3 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:50.504845 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-439ccedf-4e60-46da-bec2-1855a4bbf9e3 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:50.505452 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-439ccedf-4e60-46da-bec2-1855a4bbf9e3 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:50.514251 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1b995143-79fd-46f0-8917-417846a44e55 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1784820305"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:28:50.515700 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1b995143-79fd-46f0-8917-417846a44e55 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:50.524149 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1b995143-79fd-46f0-8917-417846a44e55 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:50.524901 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1b995143-79fd-46f0-8917-417846a44e55 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:50.526520 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1b995143-79fd-46f0-8917-417846a44e55 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:50.527160 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1b995143-79fd-46f0-8917-417846a44e55 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:50.721063 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1b995143-79fd-46f0-8917-417846a44e55 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "PUT /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441" status: 200 len: 1076 microversion: 2.1 time: 0.209492 Apr 16 21:28:50.721998 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2649/5461] 10.222.0.20 () {60 vars in 1255 bytes} [Sat Apr 16 21:28:50 2022] PUT /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 => generated 1076 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:28:50.735408 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-29c58596-cacb-4a0b-9fe3-96024c24f895 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:50.737001 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-29c58596-cacb-4a0b-9fe3-96024c24f895 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: eceddfa9-ecee-4523-825a-33cf91766dad] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:50.745722 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-29c58596-cacb-4a0b-9fe3-96024c24f895 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:50.746832 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-29c58596-cacb-4a0b-9fe3-96024c24f895 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:50.747968 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-29c58596-cacb-4a0b-9fe3-96024c24f895 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:50.748523 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-29c58596-cacb-4a0b-9fe3-96024c24f895 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:50.973472 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-439ccedf-4e60-46da-bec2-1855a4bbf9e3 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:50.973914 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-29c58596-cacb-4a0b-9fe3-96024c24f895 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:50.990056 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-439ccedf-4e60-46da-bec2-1855a4bbf9e3 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4" status: 200 len: 1505 microversion: 2.1 time: 0.511032 Apr 16 21:28:51.006726 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2813/5462] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:50 2022] GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4 => generated 1505 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:51.008665 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-29c58596-cacb-4a0b-9fe3-96024c24f895 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad" status: 200 len: 1367 microversion: 2.1 time: 0.282191 Apr 16 21:28:51.009440 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2650/5463] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:50 2022] GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad => generated 1367 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:51.014194 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-19cae9ab-2a71-44a2-b14e-deb27c2a54f2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:51.015516 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-19cae9ab-2a71-44a2-b14e-deb27c2a54f2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:51.027381 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-19cae9ab-2a71-44a2-b14e-deb27c2a54f2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:51.027381 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-19cae9ab-2a71-44a2-b14e-deb27c2a54f2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:51.027381 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-19cae9ab-2a71-44a2-b14e-deb27c2a54f2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:51.027381 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-19cae9ab-2a71-44a2-b14e-deb27c2a54f2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:51.478792 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-19cae9ab-2a71-44a2-b14e-deb27c2a54f2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:51.487056 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-19cae9ab-2a71-44a2-b14e-deb27c2a54f2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441" status: 200 len: 1502 microversion: 2.1 time: 0.478880 Apr 16 21:28:51.487678 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2814/5464] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:51 2022] GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 => generated 1502 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:51.509603 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-48917eea-9047-47f4-a220-8c93ded046bc tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:51.510216 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-48917eea-9047-47f4-a220-8c93ded046bc tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:51.519921 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-48917eea-9047-47f4-a220-8c93ded046bc tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:51.521872 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-48917eea-9047-47f4-a220-8c93ded046bc tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:51.522665 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-48917eea-9047-47f4-a220-8c93ded046bc tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:51.523114 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-48917eea-9047-47f4-a220-8c93ded046bc tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:51.760694 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-48917eea-9047-47f4-a220-8c93ded046bc tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:51.769530 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-48917eea-9047-47f4-a220-8c93ded046bc tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441" status: 200 len: 1502 microversion: 2.1 time: 0.263886 Apr 16 21:28:51.770138 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2651/5465] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:51 2022] GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 => generated 1502 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:51.788202 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-479fa214-51bd-4581-8cfe-8b7cd58cbcce tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:28:51.814046 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-479fa214-51bd-4581-8cfe-8b7cd58cbcce tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:51.814519 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-479fa214-51bd-4581-8cfe-8b7cd58cbcce tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:51.839403 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-479fa214-51bd-4581-8cfe-8b7cd58cbcce tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Going to try to stop instance {{(pid=137408) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 16 21:28:52.012884 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-edf3dd5c-d9f5-47f0-8741-38018941a88a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:52.017647 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-edf3dd5c-d9f5-47f0-8741-38018941a88a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: 5239bc09-9070-4897-8d6f-8084c2bab0b4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:52.022089 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-edf3dd5c-d9f5-47f0-8741-38018941a88a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:52.022765 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-edf3dd5c-d9f5-47f0-8741-38018941a88a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:52.023772 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-edf3dd5c-d9f5-47f0-8741-38018941a88a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:52.024794 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-edf3dd5c-d9f5-47f0-8741-38018941a88a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:52.086619 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-479fa214-51bd-4581-8cfe-8b7cd58cbcce tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "POST /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441/action" status: 202 len: 0 microversion: 2.1 time: 0.302754 Apr 16 21:28:52.087864 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2815/5466] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:28:51 2022] POST /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:28:52.106802 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e1556c07-70f0-4be0-bf88-0e2d7f32e300 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:52.111209 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e1556c07-70f0-4be0-bf88-0e2d7f32e300 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: eceddfa9-ecee-4523-825a-33cf91766dad] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:52.115399 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e1556c07-70f0-4be0-bf88-0e2d7f32e300 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:52.116059 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e1556c07-70f0-4be0-bf88-0e2d7f32e300 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:52.116888 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e1556c07-70f0-4be0-bf88-0e2d7f32e300 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:52.117362 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e1556c07-70f0-4be0-bf88-0e2d7f32e300 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:52.207393 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-edf3dd5c-d9f5-47f0-8741-38018941a88a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:52.218271 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-edf3dd5c-d9f5-47f0-8741-38018941a88a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4" status: 200 len: 1505 microversion: 2.1 time: 0.210874 Apr 16 21:28:52.218942 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2652/5467] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:52 2022] GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4 => generated 1505 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:28:52.234450 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d06e3391-f9ff-435e-87b1-04dc3d61baff tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:52.235623 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d06e3391-f9ff-435e-87b1-04dc3d61baff tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:52.244302 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d06e3391-f9ff-435e-87b1-04dc3d61baff tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:52.244996 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d06e3391-f9ff-435e-87b1-04dc3d61baff tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:52.246271 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d06e3391-f9ff-435e-87b1-04dc3d61baff tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:52.247434 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d06e3391-f9ff-435e-87b1-04dc3d61baff tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:52.451265 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d06e3391-f9ff-435e-87b1-04dc3d61baff tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:52.460635 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d06e3391-f9ff-435e-87b1-04dc3d61baff tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441" status: 200 len: 1512 microversion: 2.1 time: 0.240362 Apr 16 21:28:52.461327 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2653/5468] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:52 2022] GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 => generated 1512 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:52.474255 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e1556c07-70f0-4be0-bf88-0e2d7f32e300 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:52.482525 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e1556c07-70f0-4be0-bf88-0e2d7f32e300 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad" status: 200 len: 1367 microversion: 2.1 time: 0.392375 Apr 16 21:28:52.483105 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2816/5469] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:52 2022] GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad => generated 1367 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:53.235068 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2de6f8d3-240b-4542-93e8-b4b06f73918a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:53.236435 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2de6f8d3-240b-4542-93e8-b4b06f73918a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: 5239bc09-9070-4897-8d6f-8084c2bab0b4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:53.243867 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2de6f8d3-240b-4542-93e8-b4b06f73918a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:53.244721 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2de6f8d3-240b-4542-93e8-b4b06f73918a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:53.245765 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2de6f8d3-240b-4542-93e8-b4b06f73918a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:53.246462 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2de6f8d3-240b-4542-93e8-b4b06f73918a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:53.480053 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9faadced-3791-49df-9abb-bc6884485c10 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:53.481506 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9faadced-3791-49df-9abb-bc6884485c10 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:53.488754 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9faadced-3791-49df-9abb-bc6884485c10 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:53.489220 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9faadced-3791-49df-9abb-bc6884485c10 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:53.490171 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9faadced-3791-49df-9abb-bc6884485c10 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:53.491228 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9faadced-3791-49df-9abb-bc6884485c10 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:53.573257 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2de6f8d3-240b-4542-93e8-b4b06f73918a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:53.582738 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2de6f8d3-240b-4542-93e8-b4b06f73918a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4" status: 200 len: 1505 microversion: 2.1 time: 0.351595 Apr 16 21:28:53.593643 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2654/5470] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:53 2022] GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4 => generated 1505 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:53.599009 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-438e5625-8713-41e5-99be-ffd2aa31bfbb tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:53.600674 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-438e5625-8713-41e5-99be-ffd2aa31bfbb tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: eceddfa9-ecee-4523-825a-33cf91766dad] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:53.606980 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-438e5625-8713-41e5-99be-ffd2aa31bfbb tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:53.607665 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-438e5625-8713-41e5-99be-ffd2aa31bfbb tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:53.608797 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-438e5625-8713-41e5-99be-ffd2aa31bfbb tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:53.609429 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-438e5625-8713-41e5-99be-ffd2aa31bfbb tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:53.724703 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9faadced-3791-49df-9abb-bc6884485c10 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:53.742533 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9faadced-3791-49df-9abb-bc6884485c10 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441" status: 200 len: 1512 microversion: 2.1 time: 0.257694 Apr 16 21:28:53.742533 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2817/5471] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:53 2022] GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 => generated 1512 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:28:53.915199 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-438e5625-8713-41e5-99be-ffd2aa31bfbb tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:53.922911 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-438e5625-8713-41e5-99be-ffd2aa31bfbb tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad" status: 200 len: 1367 microversion: 2.1 time: 0.327574 Apr 16 21:28:53.926473 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2655/5472] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:53 2022] GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad => generated 1367 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:54.600226 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-609aefff-359c-4051-9328-c43b0f820ca6 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:54.601552 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-609aefff-359c-4051-9328-c43b0f820ca6 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: 5239bc09-9070-4897-8d6f-8084c2bab0b4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:54.608271 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-609aefff-359c-4051-9328-c43b0f820ca6 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:54.609010 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-609aefff-359c-4051-9328-c43b0f820ca6 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:54.610046 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-609aefff-359c-4051-9328-c43b0f820ca6 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:54.610700 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-609aefff-359c-4051-9328-c43b0f820ca6 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:54.750815 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bfc9727b-1a69-4815-a5d3-86b431c88e35 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:54.752131 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bfc9727b-1a69-4815-a5d3-86b431c88e35 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:54.760579 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bfc9727b-1a69-4815-a5d3-86b431c88e35 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:54.761357 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bfc9727b-1a69-4815-a5d3-86b431c88e35 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:54.762322 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bfc9727b-1a69-4815-a5d3-86b431c88e35 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:54.762872 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bfc9727b-1a69-4815-a5d3-86b431c88e35 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:55.001583 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-609aefff-359c-4051-9328-c43b0f820ca6 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:55.010845 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-609aefff-359c-4051-9328-c43b0f820ca6 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4" status: 200 len: 1505 microversion: 2.1 time: 0.415140 Apr 16 21:28:55.011367 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2818/5473] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:54 2022] GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4 => generated 1505 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:55.024685 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d01cb8d9-0ee6-4b90-a5f8-e6f3fbdbc4cd tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:55.025306 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d01cb8d9-0ee6-4b90-a5f8-e6f3fbdbc4cd tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: eceddfa9-ecee-4523-825a-33cf91766dad] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:55.039181 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d01cb8d9-0ee6-4b90-a5f8-e6f3fbdbc4cd tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:55.041488 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d01cb8d9-0ee6-4b90-a5f8-e6f3fbdbc4cd tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:55.042673 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d01cb8d9-0ee6-4b90-a5f8-e6f3fbdbc4cd tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:55.043350 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d01cb8d9-0ee6-4b90-a5f8-e6f3fbdbc4cd tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:55.056962 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-bfc9727b-1a69-4815-a5d3-86b431c88e35 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:55.068324 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bfc9727b-1a69-4815-a5d3-86b431c88e35 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441" status: 200 len: 1512 microversion: 2.1 time: 0.322662 Apr 16 21:28:55.073823 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2656/5474] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:54 2022] GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 => generated 1512 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:55.425960 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d01cb8d9-0ee6-4b90-a5f8-e6f3fbdbc4cd tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:55.434098 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d01cb8d9-0ee6-4b90-a5f8-e6f3fbdbc4cd tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad" status: 200 len: 1367 microversion: 2.1 time: 0.417745 Apr 16 21:28:55.434682 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2819/5475] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:55 2022] GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad => generated 1367 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:56.029036 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d4952433-bc66-49f0-9f65-6b5c5089f3c4 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:56.030218 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d4952433-bc66-49f0-9f65-6b5c5089f3c4 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: 5239bc09-9070-4897-8d6f-8084c2bab0b4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:56.043638 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d4952433-bc66-49f0-9f65-6b5c5089f3c4 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:56.043638 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d4952433-bc66-49f0-9f65-6b5c5089f3c4 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:56.043638 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d4952433-bc66-49f0-9f65-6b5c5089f3c4 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:56.043638 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d4952433-bc66-49f0-9f65-6b5c5089f3c4 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:56.104933 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c9e3e3d8-fc51-4369-99a1-55901626da74 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:56.104933 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c9e3e3d8-fc51-4369-99a1-55901626da74 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:56.120933 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c9e3e3d8-fc51-4369-99a1-55901626da74 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:56.122085 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c9e3e3d8-fc51-4369-99a1-55901626da74 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:56.127657 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c9e3e3d8-fc51-4369-99a1-55901626da74 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:56.129473 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c9e3e3d8-fc51-4369-99a1-55901626da74 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:56.382957 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d4952433-bc66-49f0-9f65-6b5c5089f3c4 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:56.397015 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d4952433-bc66-49f0-9f65-6b5c5089f3c4 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4" status: 200 len: 1505 microversion: 2.1 time: 0.372135 Apr 16 21:28:56.409937 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2657/5476] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:56 2022] GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4 => generated 1505 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:56.453389 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-84b213ea-2c11-414e-a83f-8c74c4f294dc tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:56.454372 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-84b213ea-2c11-414e-a83f-8c74c4f294dc tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: eceddfa9-ecee-4523-825a-33cf91766dad] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:56.465063 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-84b213ea-2c11-414e-a83f-8c74c4f294dc tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:56.465863 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-84b213ea-2c11-414e-a83f-8c74c4f294dc tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:56.479846 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-84b213ea-2c11-414e-a83f-8c74c4f294dc tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:56.480716 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-84b213ea-2c11-414e-a83f-8c74c4f294dc tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:56.517231 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c9e3e3d8-fc51-4369-99a1-55901626da74 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:56.526642 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c9e3e3d8-fc51-4369-99a1-55901626da74 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441" status: 200 len: 1512 microversion: 2.1 time: 0.432126 Apr 16 21:28:56.530769 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2820/5477] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:56 2022] GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 => generated 1512 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:56.825440 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-84b213ea-2c11-414e-a83f-8c74c4f294dc tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:56.835070 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-84b213ea-2c11-414e-a83f-8c74c4f294dc tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad" status: 200 len: 1367 microversion: 2.1 time: 0.387916 Apr 16 21:28:56.839461 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2658/5478] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:56 2022] GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad => generated 1367 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:28:57.014749 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-611b57bb-06b9-492f-9778-55cb08e95e22 req-0e2deab3-ef34-4503-9cfe-6ff461d1c1ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eceddfa9-ecee-4523-825a-33cf91766dad", "name": "network-vif-plugged", "status": "completed", "tag": "037fa6e8-a27a-4e66-a818-2f415b14f622"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:28:57.029893 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-611b57bb-06b9-492f-9778-55cb08e95e22 req-0e2deab3-ef34-4503-9cfe-6ff461d1c1ea service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:57.030467 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-611b57bb-06b9-492f-9778-55cb08e95e22 req-0e2deab3-ef34-4503-9cfe-6ff461d1c1ea service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:57.053712 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-611b57bb-06b9-492f-9778-55cb08e95e22 req-0e2deab3-ef34-4503-9cfe-6ff461d1c1ea service nova] Creating event network-vif-plugged:037fa6e8-a27a-4e66-a818-2f415b14f622 for instance eceddfa9-ecee-4523-825a-33cf91766dad on nch2-master-1 Apr 16 21:28:57.061090 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-611b57bb-06b9-492f-9778-55cb08e95e22 req-0e2deab3-ef34-4503-9cfe-6ff461d1c1ea service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050367 Apr 16 21:28:57.064989 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2821/5479] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:28:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:28:57.417594 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-54c6ccf2-5ae5-456b-aa2d-b1a3c8c03435 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:57.422380 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-54c6ccf2-5ae5-456b-aa2d-b1a3c8c03435 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: 5239bc09-9070-4897-8d6f-8084c2bab0b4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:57.431726 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-54c6ccf2-5ae5-456b-aa2d-b1a3c8c03435 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:57.440253 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-54c6ccf2-5ae5-456b-aa2d-b1a3c8c03435 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:57.441353 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-54c6ccf2-5ae5-456b-aa2d-b1a3c8c03435 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:57.445195 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-54c6ccf2-5ae5-456b-aa2d-b1a3c8c03435 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:57.560257 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a3800650-544f-4bde-937d-2160a7cb7da7 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:57.561808 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a3800650-544f-4bde-937d-2160a7cb7da7 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:57.582491 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a3800650-544f-4bde-937d-2160a7cb7da7 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:57.583214 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a3800650-544f-4bde-937d-2160a7cb7da7 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:57.584248 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a3800650-544f-4bde-937d-2160a7cb7da7 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:57.587530 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a3800650-544f-4bde-937d-2160a7cb7da7 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:57.850146 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-54c6ccf2-5ae5-456b-aa2d-b1a3c8c03435 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:57.859270 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-54c6ccf2-5ae5-456b-aa2d-b1a3c8c03435 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4" status: 200 len: 1505 microversion: 2.1 time: 0.445240 Apr 16 21:28:57.860029 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2659/5480] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:57 2022] GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4 => generated 1505 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:57.866450 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9a19d2b6-1753-48e0-918e-bf4e11887601 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:57.867200 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9a19d2b6-1753-48e0-918e-bf4e11887601 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: eceddfa9-ecee-4523-825a-33cf91766dad] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:57.881255 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9a19d2b6-1753-48e0-918e-bf4e11887601 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:57.881887 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9a19d2b6-1753-48e0-918e-bf4e11887601 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:57.883109 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9a19d2b6-1753-48e0-918e-bf4e11887601 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:57.883934 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9a19d2b6-1753-48e0-918e-bf4e11887601 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:58.124276 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a3800650-544f-4bde-937d-2160a7cb7da7 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:58.139598 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a3800650-544f-4bde-937d-2160a7cb7da7 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441" status: 200 len: 1512 microversion: 2.1 time: 0.596421 Apr 16 21:28:58.141073 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2822/5481] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:57 2022] GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 => generated 1512 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:28:58.208536 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9a19d2b6-1753-48e0-918e-bf4e11887601 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:58.218427 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9a19d2b6-1753-48e0-918e-bf4e11887601 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad" status: 200 len: 1367 microversion: 2.1 time: 0.357113 Apr 16 21:28:58.233327 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2660/5482] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:57 2022] GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad => generated 1367 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:58.886391 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-51404ed7-132e-4039-b665-f67cec8bc927 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:58.887165 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-51404ed7-132e-4039-b665-f67cec8bc927 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: 5239bc09-9070-4897-8d6f-8084c2bab0b4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:58.895629 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-51404ed7-132e-4039-b665-f67cec8bc927 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:58.896478 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-51404ed7-132e-4039-b665-f67cec8bc927 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:58.897526 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-51404ed7-132e-4039-b665-f67cec8bc927 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:58.898335 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-51404ed7-132e-4039-b665-f67cec8bc927 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:59.169746 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-51404ed7-132e-4039-b665-f67cec8bc927 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:59.169949 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7cbcb4be-64e2-4dba-8f82-71c405238940 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:59.181289 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7cbcb4be-64e2-4dba-8f82-71c405238940 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:59.197568 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-51404ed7-132e-4039-b665-f67cec8bc927 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4" status: 200 len: 1505 microversion: 2.1 time: 0.315021 Apr 16 21:28:59.211420 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2823/5483] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:58 2022] GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4 => generated 1505 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:59.218982 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7cbcb4be-64e2-4dba-8f82-71c405238940 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:59.221998 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7cbcb4be-64e2-4dba-8f82-71c405238940 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:59.224517 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7cbcb4be-64e2-4dba-8f82-71c405238940 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:59.227047 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7cbcb4be-64e2-4dba-8f82-71c405238940 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:59.240682 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f4fbe9e4-166d-4eb2-b7eb-6b7a0f1b8d76 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:59.241516 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f4fbe9e4-166d-4eb2-b7eb-6b7a0f1b8d76 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: eceddfa9-ecee-4523-825a-33cf91766dad] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:59.266148 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f4fbe9e4-166d-4eb2-b7eb-6b7a0f1b8d76 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:59.266618 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f4fbe9e4-166d-4eb2-b7eb-6b7a0f1b8d76 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:59.267427 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f4fbe9e4-166d-4eb2-b7eb-6b7a0f1b8d76 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:59.267921 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f4fbe9e4-166d-4eb2-b7eb-6b7a0f1b8d76 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:59.516904 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7cbcb4be-64e2-4dba-8f82-71c405238940 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:59.528063 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7cbcb4be-64e2-4dba-8f82-71c405238940 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441" status: 200 len: 1512 microversion: 2.1 time: 0.374496 Apr 16 21:28:59.529812 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2661/5484] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:59 2022] GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 => generated 1512 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:28:59.553600 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f4fbe9e4-166d-4eb2-b7eb-6b7a0f1b8d76 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:28:59.562497 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f4fbe9e4-166d-4eb2-b7eb-6b7a0f1b8d76 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad" status: 200 len: 1558 microversion: 2.1 time: 0.327688 Apr 16 21:28:59.572918 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2824/5485] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:28:59 2022] GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad => generated 1558 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:28:59.580638 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1a914a08-63d2-4b32-89cc-c5fd06a280e4 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:28:59.581149 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1a914a08-63d2-4b32-89cc-c5fd06a280e4 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: eceddfa9-ecee-4523-825a-33cf91766dad] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:28:59.588461 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1a914a08-63d2-4b32-89cc-c5fd06a280e4 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:59.588923 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1a914a08-63d2-4b32-89cc-c5fd06a280e4 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:59.589835 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1a914a08-63d2-4b32-89cc-c5fd06a280e4 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:28:59.590464 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1a914a08-63d2-4b32-89cc-c5fd06a280e4 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:28:59.756738 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1a914a08-63d2-4b32-89cc-c5fd06a280e4 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.173536 Apr 16 21:28:59.756738 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2662/5486] 10.222.0.20 () {58 vars in 1274 bytes} [Sat Apr 16 21:28:59 2022] GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad/os-interface => generated 285 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:29:00.219705 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6cf78fae-2250-4ed2-a07b-29e555316d19 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:00.220424 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6cf78fae-2250-4ed2-a07b-29e555316d19 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: 5239bc09-9070-4897-8d6f-8084c2bab0b4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:00.239236 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6cf78fae-2250-4ed2-a07b-29e555316d19 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:00.242140 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6cf78fae-2250-4ed2-a07b-29e555316d19 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:00.243270 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6cf78fae-2250-4ed2-a07b-29e555316d19 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:00.243935 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6cf78fae-2250-4ed2-a07b-29e555316d19 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:00.553098 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6eaedabb-d436-4a75-92dd-602aee29d4fa tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:00.555494 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6eaedabb-d436-4a75-92dd-602aee29d4fa tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:00.563443 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6eaedabb-d436-4a75-92dd-602aee29d4fa tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:00.564124 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6eaedabb-d436-4a75-92dd-602aee29d4fa tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:00.566134 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6eaedabb-d436-4a75-92dd-602aee29d4fa tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:00.566923 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6eaedabb-d436-4a75-92dd-602aee29d4fa tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:00.766211 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6cf78fae-2250-4ed2-a07b-29e555316d19 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:00.777438 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6cf78fae-2250-4ed2-a07b-29e555316d19 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4" status: 200 len: 1505 microversion: 2.1 time: 0.561657 Apr 16 21:29:00.788935 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2825/5487] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:00 2022] GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4 => generated 1505 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:00.891020 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6eaedabb-d436-4a75-92dd-602aee29d4fa tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:00.909631 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6eaedabb-d436-4a75-92dd-602aee29d4fa tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441" status: 200 len: 1512 microversion: 2.1 time: 0.366256 Apr 16 21:29:00.910687 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2663/5488] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:00 2022] GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 => generated 1512 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:29:01.796640 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e51b4e95-c1fb-459e-9826-38017b7d1154 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:01.797337 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e51b4e95-c1fb-459e-9826-38017b7d1154 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: 5239bc09-9070-4897-8d6f-8084c2bab0b4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:01.805634 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e51b4e95-c1fb-459e-9826-38017b7d1154 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:01.805851 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e51b4e95-c1fb-459e-9826-38017b7d1154 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:01.806834 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e51b4e95-c1fb-459e-9826-38017b7d1154 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:01.807574 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e51b4e95-c1fb-459e-9826-38017b7d1154 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:01.926808 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5ae30f28-0f2e-4cd5-b437-d9581a2ab2ed tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:01.927483 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5ae30f28-0f2e-4cd5-b437-d9581a2ab2ed tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:01.935226 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5ae30f28-0f2e-4cd5-b437-d9581a2ab2ed tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:01.935715 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5ae30f28-0f2e-4cd5-b437-d9581a2ab2ed tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:01.936967 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5ae30f28-0f2e-4cd5-b437-d9581a2ab2ed tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:01.937546 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5ae30f28-0f2e-4cd5-b437-d9581a2ab2ed tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:02.136959 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e51b4e95-c1fb-459e-9826-38017b7d1154 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:02.164367 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e51b4e95-c1fb-459e-9826-38017b7d1154 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4" status: 200 len: 1505 microversion: 2.1 time: 0.359642 Apr 16 21:29:02.164367 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2826/5489] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:01 2022] GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4 => generated 1505 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:02.277308 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5ae30f28-0f2e-4cd5-b437-d9581a2ab2ed tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:02.290356 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5ae30f28-0f2e-4cd5-b437-d9581a2ab2ed tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441" status: 200 len: 1512 microversion: 2.1 time: 0.366102 Apr 16 21:29:02.296327 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2664/5490] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:01 2022] GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 => generated 1512 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:29:02.412188 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-78f88b18-db73-4a54-8a39-ea3302b3bf5e req-aae4aded-53df-4e0f-8ebd-62c84a8bde5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eceddfa9-ecee-4523-825a-33cf91766dad", "tag": "037fa6e8-a27a-4e66-a818-2f415b14f622"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:29:02.424068 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-78f88b18-db73-4a54-8a39-ea3302b3bf5e req-aae4aded-53df-4e0f-8ebd-62c84a8bde5a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:02.425347 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-78f88b18-db73-4a54-8a39-ea3302b3bf5e req-aae4aded-53df-4e0f-8ebd-62c84a8bde5a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:02.440813 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-78f88b18-db73-4a54-8a39-ea3302b3bf5e req-aae4aded-53df-4e0f-8ebd-62c84a8bde5a service nova] Creating event network-changed:037fa6e8-a27a-4e66-a818-2f415b14f622 for instance eceddfa9-ecee-4523-825a-33cf91766dad on nch2-master-1 Apr 16 21:29:02.446318 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-78f88b18-db73-4a54-8a39-ea3302b3bf5e req-aae4aded-53df-4e0f-8ebd-62c84a8bde5a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038393 Apr 16 21:29:02.447488 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2827/5491] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:29:03.173672 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-88656157-c71d-4248-9118-666643ec8ce8 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:03.175502 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-88656157-c71d-4248-9118-666643ec8ce8 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: 5239bc09-9070-4897-8d6f-8084c2bab0b4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:03.202253 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-88656157-c71d-4248-9118-666643ec8ce8 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:03.202874 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-88656157-c71d-4248-9118-666643ec8ce8 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:03.207350 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-88656157-c71d-4248-9118-666643ec8ce8 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:03.208058 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-88656157-c71d-4248-9118-666643ec8ce8 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:03.308324 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-830f8027-7b4d-4a2c-b130-7376cd057ad6 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:03.309063 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-830f8027-7b4d-4a2c-b130-7376cd057ad6 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:03.319525 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-830f8027-7b4d-4a2c-b130-7376cd057ad6 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:03.320017 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-830f8027-7b4d-4a2c-b130-7376cd057ad6 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:03.320906 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-830f8027-7b4d-4a2c-b130-7376cd057ad6 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:03.321368 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-830f8027-7b4d-4a2c-b130-7376cd057ad6 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:03.612780 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-88656157-c71d-4248-9118-666643ec8ce8 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:03.626136 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-88656157-c71d-4248-9118-666643ec8ce8 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4" status: 200 len: 1505 microversion: 2.1 time: 0.459161 Apr 16 21:29:03.627425 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2665/5492] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:03 2022] GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4 => generated 1505 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:03.881138 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-830f8027-7b4d-4a2c-b130-7376cd057ad6 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:03.892512 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-830f8027-7b4d-4a2c-b130-7376cd057ad6 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441" status: 200 len: 1512 microversion: 2.1 time: 0.589253 Apr 16 21:29:03.894722 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2828/5493] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:03 2022] GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 => generated 1512 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:04.643116 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cd416fe3-7b07-4603-a818-f6489c38c75b tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:04.643807 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-cd416fe3-7b07-4603-a818-f6489c38c75b tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: 5239bc09-9070-4897-8d6f-8084c2bab0b4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:04.652021 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cd416fe3-7b07-4603-a818-f6489c38c75b tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:04.652521 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cd416fe3-7b07-4603-a818-f6489c38c75b tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:04.653421 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cd416fe3-7b07-4603-a818-f6489c38c75b tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:04.653877 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cd416fe3-7b07-4603-a818-f6489c38c75b tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:04.897744 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cd416fe3-7b07-4603-a818-f6489c38c75b tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:04.913304 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-859ff5d8-e4e4-48ac-9b15-05714f1dd04e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:04.914951 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-859ff5d8-e4e4-48ac-9b15-05714f1dd04e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:04.921942 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cd416fe3-7b07-4603-a818-f6489c38c75b tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4" status: 200 len: 1505 microversion: 2.1 time: 0.282356 Apr 16 21:29:04.923255 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2666/5494] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:04 2022] GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4 => generated 1505 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:04.936390 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-859ff5d8-e4e4-48ac-9b15-05714f1dd04e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:04.937979 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-859ff5d8-e4e4-48ac-9b15-05714f1dd04e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:04.938524 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-859ff5d8-e4e4-48ac-9b15-05714f1dd04e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:04.939190 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-859ff5d8-e4e4-48ac-9b15-05714f1dd04e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:05.337526 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-859ff5d8-e4e4-48ac-9b15-05714f1dd04e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:05.346549 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-859ff5d8-e4e4-48ac-9b15-05714f1dd04e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441" status: 200 len: 1512 microversion: 2.1 time: 0.438798 Apr 16 21:29:05.352647 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2829/5495] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:04 2022] GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 => generated 1512 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:05.940755 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f9b6f22c-c7ea-4f27-9a4d-1fedb4dcc28f tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:05.941373 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f9b6f22c-c7ea-4f27-9a4d-1fedb4dcc28f tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: 5239bc09-9070-4897-8d6f-8084c2bab0b4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:05.953749 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f9b6f22c-c7ea-4f27-9a4d-1fedb4dcc28f tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:05.954456 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f9b6f22c-c7ea-4f27-9a4d-1fedb4dcc28f tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:05.955523 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f9b6f22c-c7ea-4f27-9a4d-1fedb4dcc28f tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:05.956125 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f9b6f22c-c7ea-4f27-9a4d-1fedb4dcc28f tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:06.122205 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f9b6f22c-c7ea-4f27-9a4d-1fedb4dcc28f tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:06.131909 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f9b6f22c-c7ea-4f27-9a4d-1fedb4dcc28f tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4" status: 200 len: 1505 microversion: 2.1 time: 0.195660 Apr 16 21:29:06.132803 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2667/5496] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:05 2022] GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4 => generated 1505 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:06.364528 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3d92ce2a-0614-4c7c-b120-24a13acd3fb7 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:06.365178 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3d92ce2a-0614-4c7c-b120-24a13acd3fb7 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:06.371895 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d92ce2a-0614-4c7c-b120-24a13acd3fb7 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:06.372333 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d92ce2a-0614-4c7c-b120-24a13acd3fb7 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:06.373126 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d92ce2a-0614-4c7c-b120-24a13acd3fb7 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:06.373573 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d92ce2a-0614-4c7c-b120-24a13acd3fb7 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:06.701093 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3d92ce2a-0614-4c7c-b120-24a13acd3fb7 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:06.711673 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3d92ce2a-0614-4c7c-b120-24a13acd3fb7 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441" status: 200 len: 1512 microversion: 2.1 time: 0.351579 Apr 16 21:29:06.712879 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2830/5497] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:06 2022] GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 => generated 1512 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:07.155413 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-698c03a5-ed6e-4711-9716-e3419ad4cb24 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:07.155903 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-698c03a5-ed6e-4711-9716-e3419ad4cb24 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: 5239bc09-9070-4897-8d6f-8084c2bab0b4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:07.187446 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-698c03a5-ed6e-4711-9716-e3419ad4cb24 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:07.193133 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-698c03a5-ed6e-4711-9716-e3419ad4cb24 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:07.194110 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-698c03a5-ed6e-4711-9716-e3419ad4cb24 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:07.195050 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-698c03a5-ed6e-4711-9716-e3419ad4cb24 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:07.453562 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-698c03a5-ed6e-4711-9716-e3419ad4cb24 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:07.462346 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-698c03a5-ed6e-4711-9716-e3419ad4cb24 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4" status: 200 len: 1505 microversion: 2.1 time: 0.317215 Apr 16 21:29:07.472041 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2668/5498] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:07 2022] GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4 => generated 1505 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:07.733662 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d7203aa4-a6ed-4e17-a9e0-27186c74c5b4 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:07.734291 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d7203aa4-a6ed-4e17-a9e0-27186c74c5b4 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:07.752827 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d7203aa4-a6ed-4e17-a9e0-27186c74c5b4 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:07.753306 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d7203aa4-a6ed-4e17-a9e0-27186c74c5b4 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:07.754087 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d7203aa4-a6ed-4e17-a9e0-27186c74c5b4 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:07.754532 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d7203aa4-a6ed-4e17-a9e0-27186c74c5b4 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:08.126839 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d7203aa4-a6ed-4e17-a9e0-27186c74c5b4 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:08.138176 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d7203aa4-a6ed-4e17-a9e0-27186c74c5b4 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441" status: 200 len: 1512 microversion: 2.1 time: 0.412348 Apr 16 21:29:08.139397 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2831/5499] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:07 2022] GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 => generated 1512 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:08.480019 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5fc01483-4651-4bc1-9655-a8508da58c6b tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:08.484548 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5fc01483-4651-4bc1-9655-a8508da58c6b tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: 5239bc09-9070-4897-8d6f-8084c2bab0b4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:08.488491 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5fc01483-4651-4bc1-9655-a8508da58c6b tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:08.489156 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5fc01483-4651-4bc1-9655-a8508da58c6b tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:08.490320 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5fc01483-4651-4bc1-9655-a8508da58c6b tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:08.490989 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5fc01483-4651-4bc1-9655-a8508da58c6b tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:08.762266 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5fc01483-4651-4bc1-9655-a8508da58c6b tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:08.776892 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5fc01483-4651-4bc1-9655-a8508da58c6b tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4" status: 200 len: 1505 microversion: 2.1 time: 0.301671 Apr 16 21:29:08.777494 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2669/5500] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:08 2022] GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4 => generated 1505 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:09.156785 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ffb0a70e-0f3f-46a4-ab46-57598dc8234d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:09.157405 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ffb0a70e-0f3f-46a4-ab46-57598dc8234d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:09.165619 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ffb0a70e-0f3f-46a4-ab46-57598dc8234d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:09.165978 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ffb0a70e-0f3f-46a4-ab46-57598dc8234d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:09.167253 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ffb0a70e-0f3f-46a4-ab46-57598dc8234d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:09.168017 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ffb0a70e-0f3f-46a4-ab46-57598dc8234d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:09.794521 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-30ef7a66-419a-409e-9655-ccda7da49b5c tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:09.795215 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-30ef7a66-419a-409e-9655-ccda7da49b5c tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: 5239bc09-9070-4897-8d6f-8084c2bab0b4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:09.810147 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-30ef7a66-419a-409e-9655-ccda7da49b5c tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:09.810619 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-30ef7a66-419a-409e-9655-ccda7da49b5c tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:09.816194 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-30ef7a66-419a-409e-9655-ccda7da49b5c tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:09.816651 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-30ef7a66-419a-409e-9655-ccda7da49b5c tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:09.862893 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ffb0a70e-0f3f-46a4-ab46-57598dc8234d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:09.874628 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ffb0a70e-0f3f-46a4-ab46-57598dc8234d tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441" status: 200 len: 1512 microversion: 2.1 time: 0.721683 Apr 16 21:29:09.875528 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2832/5501] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:09 2022] GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 => generated 1512 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:10.052030 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-30ef7a66-419a-409e-9655-ccda7da49b5c tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:10.061782 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-30ef7a66-419a-409e-9655-ccda7da49b5c tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4" status: 200 len: 1485 microversion: 2.1 time: 0.270375 Apr 16 21:29:10.063282 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2670/5502] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:09 2022] GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4 => generated 1485 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:29:10.192960 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-32247a94-900f-43d8-b206-2bd470cd88e3 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-2001184270", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:29:10.247829 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-32247a94-900f-43d8-b206-2bd470cd88e3 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] validate_networks() for [('65b90a12-c876-4ec9-bb69-11ab16e6830b', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:29:10.898167 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-825e228a-816d-4343-be63-f199a39c2188 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:10.898793 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-825e228a-816d-4343-be63-f199a39c2188 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:10.913380 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-825e228a-816d-4343-be63-f199a39c2188 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:10.914071 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-825e228a-816d-4343-be63-f199a39c2188 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:10.915550 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-825e228a-816d-4343-be63-f199a39c2188 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:10.917437 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-825e228a-816d-4343-be63-f199a39c2188 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:10.928836 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-32247a94-900f-43d8-b206-2bd470cd88e3 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:29:10.929787 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-32247a94-900f-43d8-b206-2bd470cd88e3 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:29:10.930573 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-32247a94-900f-43d8-b206-2bd470cd88e3 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:29:10.931259 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-32247a94-900f-43d8-b206-2bd470cd88e3 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:29:10.931809 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-32247a94-900f-43d8-b206-2bd470cd88e3 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:29:10.962060 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-32247a94-900f-43d8-b206-2bd470cd88e3 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:10.962654 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-32247a94-900f-43d8-b206-2bd470cd88e3 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:10.963635 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-32247a94-900f-43d8-b206-2bd470cd88e3 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:10.964202 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-32247a94-900f-43d8-b206-2bd470cd88e3 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:10.984864 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-32247a94-900f-43d8-b206-2bd470cd88e3 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Getting quotas for project 52fd97392841411abbd1f748dff97f10. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:29:10.991890 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-32247a94-900f-43d8-b206-2bd470cd88e3 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Getting quotas for user f757f2aee71d4c3594cb45e10f3b9957 and project 52fd97392841411abbd1f748dff97f10. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:29:11.008533 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-32247a94-900f-43d8-b206-2bd470cd88e3 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:29:11.011075 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-32247a94-900f-43d8-b206-2bd470cd88e3 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:29:11.165218 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-32247a94-900f-43d8-b206-2bd470cd88e3 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.976534 Apr 16 21:29:11.166793 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2833/5503] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:29:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 979 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:29:11.181077 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8fc5a3a8-10be-4971-bd61-0dc3273d1abc tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:11.181919 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8fc5a3a8-10be-4971-bd61-0dc3273d1abc tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:11.243136 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-825e228a-816d-4343-be63-f199a39c2188 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:11.255796 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8fc5a3a8-10be-4971-bd61-0dc3273d1abc tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:11.265938 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-825e228a-816d-4343-be63-f199a39c2188 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441" status: 200 len: 1512 microversion: 2.1 time: 0.376083 Apr 16 21:29:11.266864 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8fc5a3a8-10be-4971-bd61-0dc3273d1abc tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173" status: 200 len: 1214 microversion: 2.1 time: 0.088242 Apr 16 21:29:11.278741 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2834/5504] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:11 2022] GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173 => generated 1214 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:11.290010 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2671/5505] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:10 2022] GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 => generated 1512 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:12.284936 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5027cecd-f2d3-4c0e-add9-7def2ed050d9 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:12.285553 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5027cecd-f2d3-4c0e-add9-7def2ed050d9 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:12.292384 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5027cecd-f2d3-4c0e-add9-7def2ed050d9 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:12.292846 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5027cecd-f2d3-4c0e-add9-7def2ed050d9 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:12.293702 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5027cecd-f2d3-4c0e-add9-7def2ed050d9 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:12.294154 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5027cecd-f2d3-4c0e-add9-7def2ed050d9 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:12.294578 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-98764f56-8dcb-48e7-a7ba-bd41282f49ba tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:12.295199 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-98764f56-8dcb-48e7-a7ba-bd41282f49ba tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:12.304450 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-98764f56-8dcb-48e7-a7ba-bd41282f49ba tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:12.304450 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-98764f56-8dcb-48e7-a7ba-bd41282f49ba tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:12.304450 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-98764f56-8dcb-48e7-a7ba-bd41282f49ba tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:12.304900 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-98764f56-8dcb-48e7-a7ba-bd41282f49ba tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:12.389268 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5027cecd-f2d3-4c0e-add9-7def2ed050d9 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:12.401398 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5027cecd-f2d3-4c0e-add9-7def2ed050d9 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173" status: 200 len: 1218 microversion: 2.1 time: 0.118909 Apr 16 21:29:12.410197 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2835/5506] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:12 2022] GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173 => generated 1218 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:12.462672 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-98764f56-8dcb-48e7-a7ba-bd41282f49ba tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:12.474387 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-98764f56-8dcb-48e7-a7ba-bd41282f49ba tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441" status: 200 len: 1512 microversion: 2.1 time: 0.183133 Apr 16 21:29:12.476068 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2672/5507] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:12 2022] GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 => generated 1512 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:29:13.420210 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-dce0ab67-7ebf-4cff-89e8-c7a74f66708a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:13.422083 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-dce0ab67-7ebf-4cff-89e8-c7a74f66708a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:13.431212 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dce0ab67-7ebf-4cff-89e8-c7a74f66708a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:13.432070 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dce0ab67-7ebf-4cff-89e8-c7a74f66708a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:13.432914 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dce0ab67-7ebf-4cff-89e8-c7a74f66708a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:13.433366 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dce0ab67-7ebf-4cff-89e8-c7a74f66708a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:13.491438 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b6453670-11e3-4cad-b9c8-640dec1ab269 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:13.492056 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b6453670-11e3-4cad-b9c8-640dec1ab269 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:13.499144 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b6453670-11e3-4cad-b9c8-640dec1ab269 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:13.499809 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b6453670-11e3-4cad-b9c8-640dec1ab269 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:13.500811 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b6453670-11e3-4cad-b9c8-640dec1ab269 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:13.501575 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b6453670-11e3-4cad-b9c8-640dec1ab269 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:13.503784 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-dce0ab67-7ebf-4cff-89e8-c7a74f66708a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:13.530313 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-dce0ab67-7ebf-4cff-89e8-c7a74f66708a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173" status: 200 len: 1274 microversion: 2.1 time: 0.115878 Apr 16 21:29:13.532323 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2836/5508] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:13 2022] GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173 => generated 1274 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:13.683501 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b6453670-11e3-4cad-b9c8-640dec1ab269 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:13.693593 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b6453670-11e3-4cad-b9c8-640dec1ab269 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441" status: 200 len: 1512 microversion: 2.1 time: 0.205990 Apr 16 21:29:13.694198 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2673/5509] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:13 2022] GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 => generated 1512 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:29:14.550570 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d757c34a-6f1a-4347-9bc3-afae36ebad16 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:14.551364 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d757c34a-6f1a-4347-9bc3-afae36ebad16 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:14.559433 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d757c34a-6f1a-4347-9bc3-afae36ebad16 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:14.560231 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d757c34a-6f1a-4347-9bc3-afae36ebad16 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:14.564075 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d757c34a-6f1a-4347-9bc3-afae36ebad16 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:14.564075 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d757c34a-6f1a-4347-9bc3-afae36ebad16 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:14.712299 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-538d5441-ca37-4f56-bd6f-0f49cc409cd8 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:14.712912 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-538d5441-ca37-4f56-bd6f-0f49cc409cd8 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:14.721219 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-538d5441-ca37-4f56-bd6f-0f49cc409cd8 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:14.721767 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-538d5441-ca37-4f56-bd6f-0f49cc409cd8 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:14.722827 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-538d5441-ca37-4f56-bd6f-0f49cc409cd8 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:14.723353 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-538d5441-ca37-4f56-bd6f-0f49cc409cd8 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:14.822912 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d757c34a-6f1a-4347-9bc3-afae36ebad16 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:14.836045 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d757c34a-6f1a-4347-9bc3-afae36ebad16 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173" status: 200 len: 1314 microversion: 2.1 time: 0.289839 Apr 16 21:29:14.842555 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2837/5510] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:14 2022] GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:14.975246 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-538d5441-ca37-4f56-bd6f-0f49cc409cd8 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:14.987144 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-538d5441-ca37-4f56-bd6f-0f49cc409cd8 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441" status: 200 len: 1512 microversion: 2.1 time: 0.279740 Apr 16 21:29:14.997752 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2674/5511] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:14 2022] GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 => generated 1512 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:29:15.396009 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-06df7636-f932-4543-881e-94bf04a7dbfb req-3e1e8881-82c8-405a-9c02-1fe058470360 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d43b200a-d978-4ee2-a790-79639beb3173", "tag": "b76a8a29-6a6f-4de2-a6cf-ece487714c6e"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:29:15.404605 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-06df7636-f932-4543-881e-94bf04a7dbfb req-3e1e8881-82c8-405a-9c02-1fe058470360 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:15.405380 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-06df7636-f932-4543-881e-94bf04a7dbfb req-3e1e8881-82c8-405a-9c02-1fe058470360 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:15.416744 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-06df7636-f932-4543-881e-94bf04a7dbfb req-3e1e8881-82c8-405a-9c02-1fe058470360 service nova] Creating event network-changed:b76a8a29-6a6f-4de2-a6cf-ece487714c6e for instance d43b200a-d978-4ee2-a790-79639beb3173 on nch2-master-1 Apr 16 21:29:15.426329 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-06df7636-f932-4543-881e-94bf04a7dbfb req-3e1e8881-82c8-405a-9c02-1fe058470360 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031248 Apr 16 21:29:15.428679 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2838/5512] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:29:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:29:15.859029 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9c559673-2de1-44a8-8d80-1bef60c59a0a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:15.860575 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9c559673-2de1-44a8-8d80-1bef60c59a0a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:15.872327 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9c559673-2de1-44a8-8d80-1bef60c59a0a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:15.872327 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9c559673-2de1-44a8-8d80-1bef60c59a0a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:15.872327 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9c559673-2de1-44a8-8d80-1bef60c59a0a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:15.872327 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9c559673-2de1-44a8-8d80-1bef60c59a0a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:16.008453 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-74f65b8f-ad52-46b0-a0ef-80634d454543 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:16.009224 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-74f65b8f-ad52-46b0-a0ef-80634d454543 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:16.024731 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-74f65b8f-ad52-46b0-a0ef-80634d454543 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:16.026588 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-74f65b8f-ad52-46b0-a0ef-80634d454543 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:16.027783 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-74f65b8f-ad52-46b0-a0ef-80634d454543 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:16.029619 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-74f65b8f-ad52-46b0-a0ef-80634d454543 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:16.089507 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9c559673-2de1-44a8-8d80-1bef60c59a0a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:16.106562 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9c559673-2de1-44a8-8d80-1bef60c59a0a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173" status: 200 len: 1314 microversion: 2.1 time: 0.246899 Apr 16 21:29:16.116834 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2675/5513] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:15 2022] GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:16.281441 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-74f65b8f-ad52-46b0-a0ef-80634d454543 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:16.290469 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-74f65b8f-ad52-46b0-a0ef-80634d454543 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441" status: 200 len: 1512 microversion: 2.1 time: 0.287141 Apr 16 21:29:16.291337 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2839/5514] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:16 2022] GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 => generated 1512 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:29:17.125654 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c1beeeb8-702b-416b-b308-ad41ee2da17d tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:17.126349 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c1beeeb8-702b-416b-b308-ad41ee2da17d tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:17.133962 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c1beeeb8-702b-416b-b308-ad41ee2da17d tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:17.134507 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c1beeeb8-702b-416b-b308-ad41ee2da17d tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:17.135372 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c1beeeb8-702b-416b-b308-ad41ee2da17d tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:17.135892 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c1beeeb8-702b-416b-b308-ad41ee2da17d tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:17.310823 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e6de748e-b538-4047-91d5-ff0be663b5df tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:17.311708 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e6de748e-b538-4047-91d5-ff0be663b5df tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:17.319092 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e6de748e-b538-4047-91d5-ff0be663b5df tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:17.320294 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e6de748e-b538-4047-91d5-ff0be663b5df tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:17.321236 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e6de748e-b538-4047-91d5-ff0be663b5df tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:17.321816 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e6de748e-b538-4047-91d5-ff0be663b5df tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:17.347614 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c1beeeb8-702b-416b-b308-ad41ee2da17d tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:17.355666 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c1beeeb8-702b-416b-b308-ad41ee2da17d tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173" status: 200 len: 1314 microversion: 2.1 time: 0.233833 Apr 16 21:29:17.356276 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2676/5515] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:17 2022] GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:17.468208 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e6de748e-b538-4047-91d5-ff0be663b5df tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:17.476067 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e6de748e-b538-4047-91d5-ff0be663b5df tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441" status: 200 len: 1512 microversion: 2.1 time: 0.169160 Apr 16 21:29:17.485607 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2840/5516] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:17 2022] GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 => generated 1512 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:29:18.379306 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-448633d9-e81e-4870-84d8-507f61edbc59 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:18.380015 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-448633d9-e81e-4870-84d8-507f61edbc59 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:18.386715 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-448633d9-e81e-4870-84d8-507f61edbc59 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:18.387173 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-448633d9-e81e-4870-84d8-507f61edbc59 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:18.387950 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-448633d9-e81e-4870-84d8-507f61edbc59 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:18.388426 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-448633d9-e81e-4870-84d8-507f61edbc59 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:18.493279 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-843e4860-1246-4b5e-a292-dee5aefbcdb6 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:18.494510 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-843e4860-1246-4b5e-a292-dee5aefbcdb6 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:18.501313 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-843e4860-1246-4b5e-a292-dee5aefbcdb6 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:18.502310 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-843e4860-1246-4b5e-a292-dee5aefbcdb6 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:18.503115 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-843e4860-1246-4b5e-a292-dee5aefbcdb6 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:18.503727 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-843e4860-1246-4b5e-a292-dee5aefbcdb6 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:18.586321 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-448633d9-e81e-4870-84d8-507f61edbc59 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:18.597086 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-448633d9-e81e-4870-84d8-507f61edbc59 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173" status: 200 len: 1314 microversion: 2.1 time: 0.222092 Apr 16 21:29:18.597952 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2677/5517] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:18 2022] GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:18.717197 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-843e4860-1246-4b5e-a292-dee5aefbcdb6 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:18.725785 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-843e4860-1246-4b5e-a292-dee5aefbcdb6 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441" status: 200 len: 1512 microversion: 2.1 time: 0.236455 Apr 16 21:29:18.727603 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2841/5518] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:18 2022] GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 => generated 1512 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:29:19.615558 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2ce5930d-9a7b-428e-bcc5-97a81b9857c5 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:19.616211 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2ce5930d-9a7b-428e-bcc5-97a81b9857c5 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:19.623253 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2ce5930d-9a7b-428e-bcc5-97a81b9857c5 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:19.625212 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2ce5930d-9a7b-428e-bcc5-97a81b9857c5 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:19.626105 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2ce5930d-9a7b-428e-bcc5-97a81b9857c5 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:19.626562 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2ce5930d-9a7b-428e-bcc5-97a81b9857c5 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:19.746471 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-018a160e-4321-48ea-ae76-ecfd3d3e21b2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:19.747878 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-018a160e-4321-48ea-ae76-ecfd3d3e21b2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:19.758239 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-018a160e-4321-48ea-ae76-ecfd3d3e21b2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:19.759249 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-018a160e-4321-48ea-ae76-ecfd3d3e21b2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:19.760382 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-018a160e-4321-48ea-ae76-ecfd3d3e21b2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:19.761354 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-018a160e-4321-48ea-ae76-ecfd3d3e21b2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:19.795875 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2ce5930d-9a7b-428e-bcc5-97a81b9857c5 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:19.832482 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2ce5930d-9a7b-428e-bcc5-97a81b9857c5 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173" status: 200 len: 1314 microversion: 2.1 time: 0.221741 Apr 16 21:29:19.833618 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2678/5519] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:19 2022] GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:20.230950 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-018a160e-4321-48ea-ae76-ecfd3d3e21b2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:20.239442 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-018a160e-4321-48ea-ae76-ecfd3d3e21b2 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441" status: 200 len: 1489 microversion: 2.1 time: 0.498809 Apr 16 21:29:20.240005 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2842/5520] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:19 2022] GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 => generated 1489 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:20.260937 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3895b062-7f75-4dac-b07e-2897e1a58591 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-269208094"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:29:20.262182 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3895b062-7f75-4dac-b07e-2897e1a58591 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:20.268583 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3895b062-7f75-4dac-b07e-2897e1a58591 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:20.269052 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3895b062-7f75-4dac-b07e-2897e1a58591 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:20.269855 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3895b062-7f75-4dac-b07e-2897e1a58591 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:20.270308 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3895b062-7f75-4dac-b07e-2897e1a58591 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:20.443082 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3895b062-7f75-4dac-b07e-2897e1a58591 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "PUT /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441" status: 200 len: 1061 microversion: 2.1 time: 0.186070 Apr 16 21:29:20.444024 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2679/5521] 10.222.0.20 () {60 vars in 1255 bytes} [Sat Apr 16 21:29:20 2022] PUT /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 => generated 1061 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:20.458319 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-28c04fed-cd8d-416a-8f10-980dbc4075af tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:20.459153 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-28c04fed-cd8d-416a-8f10-980dbc4075af tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:20.465441 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-28c04fed-cd8d-416a-8f10-980dbc4075af tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:20.465913 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-28c04fed-cd8d-416a-8f10-980dbc4075af tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:20.466712 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-28c04fed-cd8d-416a-8f10-980dbc4075af tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:20.467162 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-28c04fed-cd8d-416a-8f10-980dbc4075af tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:20.628854 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-28c04fed-cd8d-416a-8f10-980dbc4075af tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:20.638712 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-28c04fed-cd8d-416a-8f10-980dbc4075af tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441" status: 200 len: 1488 microversion: 2.1 time: 0.184166 Apr 16 21:29:20.639798 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2843/5522] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:20 2022] GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 => generated 1488 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:20.655608 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-29df8c78-8cfc-486c-99c2-c4f5372121d7 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:20.656264 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-29df8c78-8cfc-486c-99c2-c4f5372121d7 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:20.664386 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-29df8c78-8cfc-486c-99c2-c4f5372121d7 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:20.665092 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-29df8c78-8cfc-486c-99c2-c4f5372121d7 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:20.665910 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-29df8c78-8cfc-486c-99c2-c4f5372121d7 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:20.666359 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-29df8c78-8cfc-486c-99c2-c4f5372121d7 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:20.819933 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-29df8c78-8cfc-486c-99c2-c4f5372121d7 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:20.828041 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-29df8c78-8cfc-486c-99c2-c4f5372121d7 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441" status: 200 len: 1488 microversion: 2.1 time: 0.176204 Apr 16 21:29:20.828715 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2680/5523] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:20 2022] GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 => generated 1488 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:29:20.846292 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-01595cc5-4f48-448a-b613-7656d284915f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:20.846880 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-01595cc5-4f48-448a-b613-7656d284915f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:20.852762 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8761b500-9d1a-4aa8-9faa-abcb39fc0a87 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:20.858437 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8761b500-9d1a-4aa8-9faa-abcb39fc0a87 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:20.858572 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-01595cc5-4f48-448a-b613-7656d284915f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:20.858572 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-01595cc5-4f48-448a-b613-7656d284915f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:20.858572 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-01595cc5-4f48-448a-b613-7656d284915f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:20.858572 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-01595cc5-4f48-448a-b613-7656d284915f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:20.861683 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8761b500-9d1a-4aa8-9faa-abcb39fc0a87 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:20.862326 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8761b500-9d1a-4aa8-9faa-abcb39fc0a87 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:20.863319 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8761b500-9d1a-4aa8-9faa-abcb39fc0a87 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:20.863993 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8761b500-9d1a-4aa8-9faa-abcb39fc0a87 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:20.912032 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-01595cc5-4f48-448a-b613-7656d284915f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:29:21.035722 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8761b500-9d1a-4aa8-9faa-abcb39fc0a87 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:21.048036 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8761b500-9d1a-4aa8-9faa-abcb39fc0a87 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173" status: 200 len: 1314 microversion: 2.1 time: 0.199850 Apr 16 21:29:21.067190 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2681/5524] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:20 2022] GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:29:21.083889 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-3ce0c61f-fcfd-473a-a81f-b13ba12fb7f7 req-609ba994-eb28-4805-bfa7-dbc34eb6d67f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d43b200a-d978-4ee2-a790-79639beb3173", "name": "network-vif-plugged", "status": "completed", "tag": "b76a8a29-6a6f-4de2-a6cf-ece487714c6e"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:29:21.094043 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-3ce0c61f-fcfd-473a-a81f-b13ba12fb7f7 req-609ba994-eb28-4805-bfa7-dbc34eb6d67f service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:21.094837 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-3ce0c61f-fcfd-473a-a81f-b13ba12fb7f7 req-609ba994-eb28-4805-bfa7-dbc34eb6d67f service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:21.125776 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-3ce0c61f-fcfd-473a-a81f-b13ba12fb7f7 req-609ba994-eb28-4805-bfa7-dbc34eb6d67f service nova] Creating event network-vif-plugged:b76a8a29-6a6f-4de2-a6cf-ece487714c6e for instance d43b200a-d978-4ee2-a790-79639beb3173 on nch2-master-1 Apr 16 21:29:21.140349 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-3ce0c61f-fcfd-473a-a81f-b13ba12fb7f7 req-609ba994-eb28-4805-bfa7-dbc34eb6d67f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069418 Apr 16 21:29:21.143449 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2682/5525] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:29:21.329838 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-01595cc5-4f48-448a-b613-7656d284915f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441" status: 204 len: 0 microversion: 2.1 time: 0.487943 Apr 16 21:29:21.335650 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2844/5526] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:29:20 2022] DELETE /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:29:21.344572 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5ecb0392-ad7f-4dc6-ba90-60e8e26cb163 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:21.346834 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5ecb0392-ad7f-4dc6-ba90-60e8e26cb163 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:21.357672 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5ecb0392-ad7f-4dc6-ba90-60e8e26cb163 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:21.358189 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5ecb0392-ad7f-4dc6-ba90-60e8e26cb163 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:21.359096 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5ecb0392-ad7f-4dc6-ba90-60e8e26cb163 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:21.359668 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5ecb0392-ad7f-4dc6-ba90-60e8e26cb163 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:21.614221 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5ecb0392-ad7f-4dc6-ba90-60e8e26cb163 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:21.640720 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5ecb0392-ad7f-4dc6-ba90-60e8e26cb163 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441" status: 200 len: 1494 microversion: 2.1 time: 0.300902 Apr 16 21:29:21.642088 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2683/5527] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:21 2022] GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 => generated 1494 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:22.067009 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-442e6bf8-71ef-4325-9fd1-aaa390333c0a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:22.067519 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-442e6bf8-71ef-4325-9fd1-aaa390333c0a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:22.084299 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-442e6bf8-71ef-4325-9fd1-aaa390333c0a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:22.088450 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-442e6bf8-71ef-4325-9fd1-aaa390333c0a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:22.088450 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-442e6bf8-71ef-4325-9fd1-aaa390333c0a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:22.088450 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-442e6bf8-71ef-4325-9fd1-aaa390333c0a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:22.288759 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-442e6bf8-71ef-4325-9fd1-aaa390333c0a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:22.297673 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-442e6bf8-71ef-4325-9fd1-aaa390333c0a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173" status: 200 len: 1314 microversion: 2.1 time: 0.236006 Apr 16 21:29:22.298726 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2845/5528] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:22 2022] GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:22.658702 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ada09df7-bbe4-4140-81e4-6d3b27b35798 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:22.661835 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ada09df7-bbe4-4140-81e4-6d3b27b35798 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:22.666232 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ada09df7-bbe4-4140-81e4-6d3b27b35798 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:22.666696 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ada09df7-bbe4-4140-81e4-6d3b27b35798 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:22.667524 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ada09df7-bbe4-4140-81e4-6d3b27b35798 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:22.667973 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ada09df7-bbe4-4140-81e4-6d3b27b35798 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:22.881539 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ada09df7-bbe4-4140-81e4-6d3b27b35798 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:22.897309 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ada09df7-bbe4-4140-81e4-6d3b27b35798 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441" status: 200 len: 1494 microversion: 2.1 time: 0.241701 Apr 16 21:29:22.898394 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2684/5529] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:22 2022] GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 => generated 1494 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:23.315438 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f910eca9-6172-40d3-a9f1-42afb2e51897 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:23.316065 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f910eca9-6172-40d3-a9f1-42afb2e51897 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:23.327853 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f910eca9-6172-40d3-a9f1-42afb2e51897 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:23.328346 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f910eca9-6172-40d3-a9f1-42afb2e51897 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:23.329151 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f910eca9-6172-40d3-a9f1-42afb2e51897 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:23.329600 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f910eca9-6172-40d3-a9f1-42afb2e51897 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:23.601481 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f910eca9-6172-40d3-a9f1-42afb2e51897 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:23.610555 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f910eca9-6172-40d3-a9f1-42afb2e51897 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173" status: 200 len: 1314 microversion: 2.1 time: 0.298865 Apr 16 21:29:23.611742 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2846/5530] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:23 2022] GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173 => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:23.714810 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-3d5e633d-2d06-4fd0-8e5a-aeff1b45a46f req-e38cab34-d62c-49a4-963a-bc94a218312d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1589a50-e8ea-41a3-bf7e-c4b0d97ea441", "name": "network-vif-deleted", "tag": "72e80f4a-33ee-4111-881b-80866aba5dc0"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:29:23.723619 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-3d5e633d-2d06-4fd0-8e5a-aeff1b45a46f req-e38cab34-d62c-49a4-963a-bc94a218312d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:23.724070 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-3d5e633d-2d06-4fd0-8e5a-aeff1b45a46f req-e38cab34-d62c-49a4-963a-bc94a218312d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:23.735016 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-3d5e633d-2d06-4fd0-8e5a-aeff1b45a46f req-e38cab34-d62c-49a4-963a-bc94a218312d service nova] Creating event network-vif-deleted:72e80f4a-33ee-4111-881b-80866aba5dc0 for instance b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 on nch2-master-1 Apr 16 21:29:23.744350 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-3d5e633d-2d06-4fd0-8e5a-aeff1b45a46f req-e38cab34-d62c-49a4-963a-bc94a218312d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033292 Apr 16 21:29:23.745362 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2685/5531] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:29:23.916382 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e1f60daf-082a-4109-ba6c-f2eb1d56f77b tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:23.917408 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e1f60daf-082a-4109-ba6c-f2eb1d56f77b tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:23.926350 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e1f60daf-082a-4109-ba6c-f2eb1d56f77b tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:23.928340 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e1f60daf-082a-4109-ba6c-f2eb1d56f77b tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:23.929475 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e1f60daf-082a-4109-ba6c-f2eb1d56f77b tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:23.931342 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e1f60daf-082a-4109-ba6c-f2eb1d56f77b tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:24.129806 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e1f60daf-082a-4109-ba6c-f2eb1d56f77b tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:24.138656 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e1f60daf-082a-4109-ba6c-f2eb1d56f77b tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441" status: 200 len: 1291 microversion: 2.1 time: 0.228740 Apr 16 21:29:24.143044 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2847/5532] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:23 2022] GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 => generated 1291 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:24.628724 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-09632d26-3ec7-45d0-b9f6-86f9d1c67c44 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:24.629668 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-09632d26-3ec7-45d0-b9f6-86f9d1c67c44 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:24.635741 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-09632d26-3ec7-45d0-b9f6-86f9d1c67c44 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:24.636317 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-09632d26-3ec7-45d0-b9f6-86f9d1c67c44 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:24.637210 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-09632d26-3ec7-45d0-b9f6-86f9d1c67c44 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:24.637932 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-09632d26-3ec7-45d0-b9f6-86f9d1c67c44 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:24.895226 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-09632d26-3ec7-45d0-b9f6-86f9d1c67c44 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:24.904899 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-09632d26-3ec7-45d0-b9f6-86f9d1c67c44 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173" status: 200 len: 1500 microversion: 2.1 time: 0.280385 Apr 16 21:29:24.912271 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2686/5533] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:24 2022] GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173 => generated 1500 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:24.925163 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d05bda2f-cea6-4fab-b7f0-8df883f4a6fa tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:29:24.926232 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d05bda2f-cea6-4fab-b7f0-8df883f4a6fa tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:24.933339 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d05bda2f-cea6-4fab-b7f0-8df883f4a6fa tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:24.933810 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d05bda2f-cea6-4fab-b7f0-8df883f4a6fa tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:24.934608 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d05bda2f-cea6-4fab-b7f0-8df883f4a6fa tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:24.935055 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d05bda2f-cea6-4fab-b7f0-8df883f4a6fa tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:24.964405 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-d05bda2f-cea6-4fab-b7f0-8df883f4a6fa tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lazy-loading 'flavor' on Instance uuid d43b200a-d978-4ee2-a790-79639beb3173 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:29:25.161219 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4db64287-7ac3-4585-b832-1ed0c28f9d25 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:25.161845 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4db64287-7ac3-4585-b832-1ed0c28f9d25 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:25.168675 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4db64287-7ac3-4585-b832-1ed0c28f9d25 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:25.169429 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4db64287-7ac3-4585-b832-1ed0c28f9d25 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:25.170933 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4db64287-7ac3-4585-b832-1ed0c28f9d25 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:25.171381 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4db64287-7ac3-4585-b832-1ed0c28f9d25 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:25.196454 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-4db64287-7ac3-4585-b832-1ed0c28f9d25 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] HTTP exception thrown: Instance b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 could not be found. Apr 16 21:29:25.198084 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4db64287-7ac3-4585-b832-1ed0c28f9d25 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Returning 404 to user: Instance b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:29:25.198951 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4db64287-7ac3-4585-b832-1ed0c28f9d25 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441" status: 404 len: 111 microversion: 2.1 time: 0.043836 Apr 16 21:29:25.199696 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2687/5534] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:25 2022] GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:29:25.225352 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e1d36312-75e9-41b1-b762-9cef3a27562a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:25.228288 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e1d36312-75e9-41b1-b762-9cef3a27562a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:25.237691 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e1d36312-75e9-41b1-b762-9cef3a27562a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:25.238067 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e1d36312-75e9-41b1-b762-9cef3a27562a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:25.238792 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e1d36312-75e9-41b1-b762-9cef3a27562a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:25.239241 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e1d36312-75e9-41b1-b762-9cef3a27562a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:25.258606 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d05bda2f-cea6-4fab-b7f0-8df883f4a6fa tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "POST /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173/action" status: 200 len: 32 microversion: 2.1 time: 0.337275 Apr 16 21:29:25.259234 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2848/5535] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:29:24 2022] POST /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173/action => generated 32 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:29:25.278220 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f0952981-e0a7-4d42-ae0b-73239519fb23 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:25.278952 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f0952981-e0a7-4d42-ae0b-73239519fb23 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:25.288471 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-e1d36312-75e9-41b1-b762-9cef3a27562a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] HTTP exception thrown: Instance b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 could not be found. Apr 16 21:29:25.288471 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e1d36312-75e9-41b1-b762-9cef3a27562a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Returning 404 to user: Instance b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:29:25.288471 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e1d36312-75e9-41b1-b762-9cef3a27562a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441" status: 404 len: 111 microversion: 2.1 time: 0.065562 Apr 16 21:29:25.291324 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f0952981-e0a7-4d42-ae0b-73239519fb23 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:25.291797 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f0952981-e0a7-4d42-ae0b-73239519fb23 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:25.292637 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f0952981-e0a7-4d42-ae0b-73239519fb23 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:25.293094 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f0952981-e0a7-4d42-ae0b-73239519fb23 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:25.296461 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2688/5536] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:29:25 2022] DELETE /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:29:25.307559 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ae7f32f7-8e5f-4315-9fef-89f20338a19f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:25.308305 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ae7f32f7-8e5f-4315-9fef-89f20338a19f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1589a50-e8ea-41a3-bf7e-c4b0d97ea441] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:25.315902 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ae7f32f7-8e5f-4315-9fef-89f20338a19f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:25.316422 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ae7f32f7-8e5f-4315-9fef-89f20338a19f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:25.317223 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ae7f32f7-8e5f-4315-9fef-89f20338a19f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:25.317666 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ae7f32f7-8e5f-4315-9fef-89f20338a19f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:25.338060 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-ae7f32f7-8e5f-4315-9fef-89f20338a19f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] HTTP exception thrown: Instance b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 could not be found. Apr 16 21:29:25.338675 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ae7f32f7-8e5f-4315-9fef-89f20338a19f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Returning 404 to user: Instance b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:29:25.342196 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ae7f32f7-8e5f-4315-9fef-89f20338a19f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441" status: 404 len: 111 microversion: 2.1 time: 0.038001 Apr 16 21:29:25.345042 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2689/5537] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:25 2022] GET /compute/v2.1/servers/b1589a50-e8ea-41a3-bf7e-c4b0d97ea441 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:29:25.350143 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d4abfe9a-3e07-4cf2-942c-a65164f31a5c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:25.350687 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d4abfe9a-3e07-4cf2-942c-a65164f31a5c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: cf7be0a6-93c6-4c84-93a1-014223a63aea] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:25.357350 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d4abfe9a-3e07-4cf2-942c-a65164f31a5c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:25.357807 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d4abfe9a-3e07-4cf2-942c-a65164f31a5c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:25.359991 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d4abfe9a-3e07-4cf2-942c-a65164f31a5c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:25.360706 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d4abfe9a-3e07-4cf2-942c-a65164f31a5c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:25.405653 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-d4abfe9a-3e07-4cf2-942c-a65164f31a5c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] HTTP exception thrown: Instance cf7be0a6-93c6-4c84-93a1-014223a63aea could not be found. Apr 16 21:29:25.405653 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d4abfe9a-3e07-4cf2-942c-a65164f31a5c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Returning 404 to user: Instance cf7be0a6-93c6-4c84-93a1-014223a63aea could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:29:25.405653 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d4abfe9a-3e07-4cf2-942c-a65164f31a5c tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea" status: 404 len: 111 microversion: 2.1 time: 0.055793 Apr 16 21:29:25.405653 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2690/5538] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:29:25 2022] DELETE /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:29:25.411577 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4c1b99ea-67e1-45ec-a95f-fb2a4c2ee8f6 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:25.412587 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4c1b99ea-67e1-45ec-a95f-fb2a4c2ee8f6 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: cf7be0a6-93c6-4c84-93a1-014223a63aea] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:25.419564 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4c1b99ea-67e1-45ec-a95f-fb2a4c2ee8f6 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:25.422888 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4c1b99ea-67e1-45ec-a95f-fb2a4c2ee8f6 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:25.422888 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4c1b99ea-67e1-45ec-a95f-fb2a4c2ee8f6 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:25.422888 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4c1b99ea-67e1-45ec-a95f-fb2a4c2ee8f6 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:25.437804 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-4c1b99ea-67e1-45ec-a95f-fb2a4c2ee8f6 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] HTTP exception thrown: Instance cf7be0a6-93c6-4c84-93a1-014223a63aea could not be found. Apr 16 21:29:25.438439 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4c1b99ea-67e1-45ec-a95f-fb2a4c2ee8f6 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Returning 404 to user: Instance cf7be0a6-93c6-4c84-93a1-014223a63aea could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:29:25.439847 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4c1b99ea-67e1-45ec-a95f-fb2a4c2ee8f6 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea" status: 404 len: 111 microversion: 2.1 time: 0.032024 Apr 16 21:29:25.440665 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2691/5539] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:25 2022] GET /compute/v2.1/servers/cf7be0a6-93c6-4c84-93a1-014223a63aea => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:29:25.449785 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-792bfa31-25d8-49c7-8b2e-081eedb28346 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:25.449785 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-792bfa31-25d8-49c7-8b2e-081eedb28346 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 0a92a902-c20e-44c0-a263-013ab10917cf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:25.455494 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-792bfa31-25d8-49c7-8b2e-081eedb28346 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:25.455898 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-792bfa31-25d8-49c7-8b2e-081eedb28346 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:25.456727 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-792bfa31-25d8-49c7-8b2e-081eedb28346 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:25.457187 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-792bfa31-25d8-49c7-8b2e-081eedb28346 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:25.472358 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-792bfa31-25d8-49c7-8b2e-081eedb28346 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] HTTP exception thrown: Instance 0a92a902-c20e-44c0-a263-013ab10917cf could not be found. Apr 16 21:29:25.472975 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-792bfa31-25d8-49c7-8b2e-081eedb28346 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Returning 404 to user: Instance 0a92a902-c20e-44c0-a263-013ab10917cf could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:29:25.473883 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-792bfa31-25d8-49c7-8b2e-081eedb28346 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0a92a902-c20e-44c0-a263-013ab10917cf" status: 404 len: 111 microversion: 2.1 time: 0.029363 Apr 16 21:29:25.474459 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2692/5540] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:29:25 2022] DELETE /compute/v2.1/servers/0a92a902-c20e-44c0-a263-013ab10917cf => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:29:25.482676 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-af16749d-9cee-4e48-ba29-fa8a87340ae7 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:25.483429 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-af16749d-9cee-4e48-ba29-fa8a87340ae7 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 0a92a902-c20e-44c0-a263-013ab10917cf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:25.490799 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-af16749d-9cee-4e48-ba29-fa8a87340ae7 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:25.491770 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-af16749d-9cee-4e48-ba29-fa8a87340ae7 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:25.492371 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-af16749d-9cee-4e48-ba29-fa8a87340ae7 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:25.492918 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-af16749d-9cee-4e48-ba29-fa8a87340ae7 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:25.508883 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-af16749d-9cee-4e48-ba29-fa8a87340ae7 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] HTTP exception thrown: Instance 0a92a902-c20e-44c0-a263-013ab10917cf could not be found. Apr 16 21:29:25.509656 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-af16749d-9cee-4e48-ba29-fa8a87340ae7 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Returning 404 to user: Instance 0a92a902-c20e-44c0-a263-013ab10917cf could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:29:25.510637 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-af16749d-9cee-4e48-ba29-fa8a87340ae7 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/0a92a902-c20e-44c0-a263-013ab10917cf" status: 404 len: 111 microversion: 2.1 time: 0.031996 Apr 16 21:29:25.514562 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2693/5541] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:25 2022] GET /compute/v2.1/servers/0a92a902-c20e-44c0-a263-013ab10917cf => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:29:25.521586 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8654ec75-6eae-4dbe-8e1e-ec99ed91e372 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:25.522162 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8654ec75-6eae-4dbe-8e1e-ec99ed91e372 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 5fee6363-9586-45b0-b643-e6dbd4652c80] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:25.529144 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8654ec75-6eae-4dbe-8e1e-ec99ed91e372 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:25.529736 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8654ec75-6eae-4dbe-8e1e-ec99ed91e372 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:25.530908 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8654ec75-6eae-4dbe-8e1e-ec99ed91e372 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:25.531458 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8654ec75-6eae-4dbe-8e1e-ec99ed91e372 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:25.548219 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-8654ec75-6eae-4dbe-8e1e-ec99ed91e372 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] HTTP exception thrown: Instance 5fee6363-9586-45b0-b643-e6dbd4652c80 could not be found. Apr 16 21:29:25.549505 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8654ec75-6eae-4dbe-8e1e-ec99ed91e372 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Returning 404 to user: Instance 5fee6363-9586-45b0-b643-e6dbd4652c80 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:29:25.550476 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8654ec75-6eae-4dbe-8e1e-ec99ed91e372 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5fee6363-9586-45b0-b643-e6dbd4652c80" status: 404 len: 111 microversion: 2.1 time: 0.034766 Apr 16 21:29:25.555716 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2694/5542] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:29:25 2022] DELETE /compute/v2.1/servers/5fee6363-9586-45b0-b643-e6dbd4652c80 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:29:25.561179 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-654af579-5159-47c0-bd71-b01a661905ad tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:25.567313 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-654af579-5159-47c0-bd71-b01a661905ad tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 5fee6363-9586-45b0-b643-e6dbd4652c80] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:25.573259 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-654af579-5159-47c0-bd71-b01a661905ad tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:25.573841 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-654af579-5159-47c0-bd71-b01a661905ad tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:25.574726 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-654af579-5159-47c0-bd71-b01a661905ad tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:25.575249 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-654af579-5159-47c0-bd71-b01a661905ad tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:25.594174 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-654af579-5159-47c0-bd71-b01a661905ad tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] HTTP exception thrown: Instance 5fee6363-9586-45b0-b643-e6dbd4652c80 could not be found. Apr 16 21:29:25.595717 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-654af579-5159-47c0-bd71-b01a661905ad tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Returning 404 to user: Instance 5fee6363-9586-45b0-b643-e6dbd4652c80 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:29:25.596206 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-654af579-5159-47c0-bd71-b01a661905ad tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/5fee6363-9586-45b0-b643-e6dbd4652c80" status: 404 len: 111 microversion: 2.1 time: 0.039262 Apr 16 21:29:25.600616 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2695/5543] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:25 2022] GET /compute/v2.1/servers/5fee6363-9586-45b0-b643-e6dbd4652c80 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:29:25.607211 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a1331ca0-d1ff-4a9f-8d13-c96bf6f9e21e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:25.608520 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a1331ca0-d1ff-4a9f-8d13-c96bf6f9e21e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:25.617117 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a1331ca0-d1ff-4a9f-8d13-c96bf6f9e21e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:25.617591 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a1331ca0-d1ff-4a9f-8d13-c96bf6f9e21e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:25.618675 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a1331ca0-d1ff-4a9f-8d13-c96bf6f9e21e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:25.619346 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a1331ca0-d1ff-4a9f-8d13-c96bf6f9e21e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:25.637532 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-a1331ca0-d1ff-4a9f-8d13-c96bf6f9e21e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] HTTP exception thrown: Instance b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1 could not be found. Apr 16 21:29:25.638149 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a1331ca0-d1ff-4a9f-8d13-c96bf6f9e21e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Returning 404 to user: Instance b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:29:25.639309 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a1331ca0-d1ff-4a9f-8d13-c96bf6f9e21e tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1" status: 404 len: 111 microversion: 2.1 time: 0.037577 Apr 16 21:29:25.639876 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2696/5544] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:29:25 2022] DELETE /compute/v2.1/servers/b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:29:25.648194 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-62ecd711-2268-4e49-87dd-ac0a45f6f6bd tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:25.655017 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-62ecd711-2268-4e49-87dd-ac0a45f6f6bd tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:25.663618 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-62ecd711-2268-4e49-87dd-ac0a45f6f6bd tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:25.664097 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-62ecd711-2268-4e49-87dd-ac0a45f6f6bd tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:25.665382 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-62ecd711-2268-4e49-87dd-ac0a45f6f6bd tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:25.665841 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-62ecd711-2268-4e49-87dd-ac0a45f6f6bd tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:25.696022 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-62ecd711-2268-4e49-87dd-ac0a45f6f6bd tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] HTTP exception thrown: Instance b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1 could not be found. Apr 16 21:29:25.697061 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-62ecd711-2268-4e49-87dd-ac0a45f6f6bd tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Returning 404 to user: Instance b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:29:25.698153 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-62ecd711-2268-4e49-87dd-ac0a45f6f6bd tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1" status: 404 len: 111 microversion: 2.1 time: 0.054076 Apr 16 21:29:25.702090 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2697/5545] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:25 2022] GET /compute/v2.1/servers/b7f627c8-5c10-4ba5-9ece-7f41c7d8d4e1 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:29:25.707495 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1e07eaf6-e9e9-41fa-a035-a8738b3d090a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:25.708160 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1e07eaf6-e9e9-41fa-a035-a8738b3d090a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: fa0a30a4-6ada-4031-be8f-811c5b098de6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:25.714980 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1e07eaf6-e9e9-41fa-a035-a8738b3d090a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:25.715683 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1e07eaf6-e9e9-41fa-a035-a8738b3d090a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:25.716772 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1e07eaf6-e9e9-41fa-a035-a8738b3d090a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:25.717280 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1e07eaf6-e9e9-41fa-a035-a8738b3d090a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:25.733786 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-1e07eaf6-e9e9-41fa-a035-a8738b3d090a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] HTTP exception thrown: Instance fa0a30a4-6ada-4031-be8f-811c5b098de6 could not be found. Apr 16 21:29:25.739473 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1e07eaf6-e9e9-41fa-a035-a8738b3d090a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Returning 404 to user: Instance fa0a30a4-6ada-4031-be8f-811c5b098de6 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:29:25.739473 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1e07eaf6-e9e9-41fa-a035-a8738b3d090a tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fa0a30a4-6ada-4031-be8f-811c5b098de6" status: 404 len: 111 microversion: 2.1 time: 0.032658 Apr 16 21:29:25.739473 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2698/5546] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:29:25 2022] DELETE /compute/v2.1/servers/fa0a30a4-6ada-4031-be8f-811c5b098de6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:29:25.739811 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f0952981-e0a7-4d42-ae0b-73239519fb23 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:25.746193 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b14b2f63-890e-4db1-871c-8dc4b931a6fb tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:25.746966 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b14b2f63-890e-4db1-871c-8dc4b931a6fb tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: fa0a30a4-6ada-4031-be8f-811c5b098de6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:25.752686 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f0952981-e0a7-4d42-ae0b-73239519fb23 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173" status: 200 len: 1506 microversion: 2.1 time: 0.487082 Apr 16 21:29:25.753434 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2849/5547] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:25 2022] GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173 => generated 1506 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:25.754140 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b14b2f63-890e-4db1-871c-8dc4b931a6fb tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:25.754671 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b14b2f63-890e-4db1-871c-8dc4b931a6fb tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:25.755469 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b14b2f63-890e-4db1-871c-8dc4b931a6fb tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:25.755909 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b14b2f63-890e-4db1-871c-8dc4b931a6fb tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:25.772665 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-b14b2f63-890e-4db1-871c-8dc4b931a6fb tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] HTTP exception thrown: Instance fa0a30a4-6ada-4031-be8f-811c5b098de6 could not be found. Apr 16 21:29:25.773272 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b14b2f63-890e-4db1-871c-8dc4b931a6fb tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Returning 404 to user: Instance fa0a30a4-6ada-4031-be8f-811c5b098de6 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:29:25.774122 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b14b2f63-890e-4db1-871c-8dc4b931a6fb tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/fa0a30a4-6ada-4031-be8f-811c5b098de6" status: 404 len: 111 microversion: 2.1 time: 0.031718 Apr 16 21:29:25.775045 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2699/5548] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:25 2022] GET /compute/v2.1/servers/fa0a30a4-6ada-4031-be8f-811c5b098de6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:29:25.784672 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ff6710f7-adcd-4347-af57-7efeb9a2fbe4 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:25.790389 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ff6710f7-adcd-4347-af57-7efeb9a2fbe4 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 5fc44ff4-dc0c-4903-92e7-8c6c69cb1156] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:25.791874 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-ff6710f7-adcd-4347-af57-7efeb9a2fbe4 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] HTTP exception thrown: Instance 5fc44ff4-dc0c-4903-92e7-8c6c69cb1156 could not be found. Apr 16 21:29:25.792521 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ff6710f7-adcd-4347-af57-7efeb9a2fbe4 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Returning 404 to user: Instance 5fc44ff4-dc0c-4903-92e7-8c6c69cb1156 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:29:25.793600 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ff6710f7-adcd-4347-af57-7efeb9a2fbe4 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5fc44ff4-dc0c-4903-92e7-8c6c69cb1156" status: 404 len: 111 microversion: 2.1 time: 0.013407 Apr 16 21:29:25.794357 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2850/5549] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:29:25 2022] DELETE /compute/v2.1/servers/5fc44ff4-dc0c-4903-92e7-8c6c69cb1156 => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:29:25.802965 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2318e958-7646-46b9-b42c-fa73ffe39f00 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:25.803579 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2318e958-7646-46b9-b42c-fa73ffe39f00 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: 5fc44ff4-dc0c-4903-92e7-8c6c69cb1156] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:25.811456 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-2318e958-7646-46b9-b42c-fa73ffe39f00 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] HTTP exception thrown: Instance 5fc44ff4-dc0c-4903-92e7-8c6c69cb1156 could not be found. Apr 16 21:29:25.812069 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2318e958-7646-46b9-b42c-fa73ffe39f00 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Returning 404 to user: Instance 5fc44ff4-dc0c-4903-92e7-8c6c69cb1156 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:29:25.813371 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2318e958-7646-46b9-b42c-fa73ffe39f00 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/5fc44ff4-dc0c-4903-92e7-8c6c69cb1156" status: 404 len: 111 microversion: 2.1 time: 0.014553 Apr 16 21:29:25.817148 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2700/5550] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:25 2022] GET /compute/v2.1/servers/5fc44ff4-dc0c-4903-92e7-8c6c69cb1156 => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:29:25.823015 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a0039732-4154-4753-9fc2-e35dcbd37e02 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:25.823537 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a0039732-4154-4753-9fc2-e35dcbd37e02 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1fbb0c9-4072-4260-859f-aadf53c653bb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:25.834139 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a0039732-4154-4753-9fc2-e35dcbd37e02 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:25.834636 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a0039732-4154-4753-9fc2-e35dcbd37e02 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:25.836381 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a0039732-4154-4753-9fc2-e35dcbd37e02 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:25.836842 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a0039732-4154-4753-9fc2-e35dcbd37e02 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:25.874141 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a0039732-4154-4753-9fc2-e35dcbd37e02 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1fbb0c9-4072-4260-859f-aadf53c653bb] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:29:26.194004 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a0039732-4154-4753-9fc2-e35dcbd37e02 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b1fbb0c9-4072-4260-859f-aadf53c653bb" status: 204 len: 0 microversion: 2.1 time: 0.374457 Apr 16 21:29:26.196307 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2851/5551] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:29:25 2022] DELETE /compute/v2.1/servers/b1fbb0c9-4072-4260-859f-aadf53c653bb => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:29:26.205291 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f29f7c0a-9685-464e-beda-9cbe2885e5cd tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:26.205896 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f29f7c0a-9685-464e-beda-9cbe2885e5cd tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1fbb0c9-4072-4260-859f-aadf53c653bb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:26.213778 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f29f7c0a-9685-464e-beda-9cbe2885e5cd tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:26.214469 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f29f7c0a-9685-464e-beda-9cbe2885e5cd tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:26.215433 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f29f7c0a-9685-464e-beda-9cbe2885e5cd tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:26.215872 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f29f7c0a-9685-464e-beda-9cbe2885e5cd tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:26.402650 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f29f7c0a-9685-464e-beda-9cbe2885e5cd tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:26.411635 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f29f7c0a-9685-464e-beda-9cbe2885e5cd tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1fbb0c9-4072-4260-859f-aadf53c653bb" status: 200 len: 1479 microversion: 2.1 time: 0.211237 Apr 16 21:29:26.422116 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2701/5552] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:26 2022] GET /compute/v2.1/servers/b1fbb0c9-4072-4260-859f-aadf53c653bb => generated 1479 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:29:26.773064 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-af9669a0-03fe-463c-a7b9-48afd4bbc683 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:26.774083 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-af9669a0-03fe-463c-a7b9-48afd4bbc683 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:26.781769 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-af9669a0-03fe-463c-a7b9-48afd4bbc683 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:26.782474 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-af9669a0-03fe-463c-a7b9-48afd4bbc683 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:26.784207 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-af9669a0-03fe-463c-a7b9-48afd4bbc683 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:26.785144 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-af9669a0-03fe-463c-a7b9-48afd4bbc683 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:27.157682 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-af9669a0-03fe-463c-a7b9-48afd4bbc683 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:27.169419 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-af9669a0-03fe-463c-a7b9-48afd4bbc683 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173" status: 200 len: 1506 microversion: 2.1 time: 0.402407 Apr 16 21:29:27.172554 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2852/5553] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:26 2022] GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173 => generated 1506 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:27.429939 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7dd25f6f-5f99-4412-ac0a-9e538ee28b43 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:27.430496 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7dd25f6f-5f99-4412-ac0a-9e538ee28b43 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1fbb0c9-4072-4260-859f-aadf53c653bb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:27.437225 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7dd25f6f-5f99-4412-ac0a-9e538ee28b43 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:27.437692 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7dd25f6f-5f99-4412-ac0a-9e538ee28b43 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:27.438475 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7dd25f6f-5f99-4412-ac0a-9e538ee28b43 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:27.438925 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7dd25f6f-5f99-4412-ac0a-9e538ee28b43 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:27.681159 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7dd25f6f-5f99-4412-ac0a-9e538ee28b43 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:27.697054 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7dd25f6f-5f99-4412-ac0a-9e538ee28b43 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1fbb0c9-4072-4260-859f-aadf53c653bb" status: 200 len: 1479 microversion: 2.1 time: 0.270994 Apr 16 21:29:27.697650 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2702/5554] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:27 2022] GET /compute/v2.1/servers/b1fbb0c9-4072-4260-859f-aadf53c653bb => generated 1479 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:28.193207 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ea29e696-e8fa-4296-ae8a-2f8d61946ef8 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:28.194743 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ea29e696-e8fa-4296-ae8a-2f8d61946ef8 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:28.233854 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-e7d74fb8-b2f2-49eb-bb42-7c0d4d818748 req-1c5913ec-7d54-4b62-833f-f3740fbab378 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1fbb0c9-4072-4260-859f-aadf53c653bb", "name": "network-vif-deleted", "tag": "c0c5154e-e278-4526-8a07-42e809fbe3c8"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:29:28.241625 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ea29e696-e8fa-4296-ae8a-2f8d61946ef8 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:28.242609 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ea29e696-e8fa-4296-ae8a-2f8d61946ef8 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:28.242871 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ea29e696-e8fa-4296-ae8a-2f8d61946ef8 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:28.245974 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ea29e696-e8fa-4296-ae8a-2f8d61946ef8 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:28.248012 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-e7d74fb8-b2f2-49eb-bb42-7c0d4d818748 req-1c5913ec-7d54-4b62-833f-f3740fbab378 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:28.250179 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-e7d74fb8-b2f2-49eb-bb42-7c0d4d818748 req-1c5913ec-7d54-4b62-833f-f3740fbab378 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:28.261503 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-e7d74fb8-b2f2-49eb-bb42-7c0d4d818748 req-1c5913ec-7d54-4b62-833f-f3740fbab378 service nova] Creating event network-vif-deleted:c0c5154e-e278-4526-8a07-42e809fbe3c8 for instance b1fbb0c9-4072-4260-859f-aadf53c653bb on nch1-master-1 Apr 16 21:29:28.268658 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-e7d74fb8-b2f2-49eb-bb42-7c0d4d818748 req-1c5913ec-7d54-4b62-833f-f3740fbab378 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056621 Apr 16 21:29:28.269702 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2703/5555] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:29:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:29:28.500315 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ea29e696-e8fa-4296-ae8a-2f8d61946ef8 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:28.507681 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ea29e696-e8fa-4296-ae8a-2f8d61946ef8 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173" status: 200 len: 1506 microversion: 2.1 time: 0.320146 Apr 16 21:29:28.508536 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2853/5556] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:28 2022] GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173 => generated 1506 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:28.717094 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-da4b0d51-8efe-4f5b-b74f-be9313fd505f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:28.718106 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-da4b0d51-8efe-4f5b-b74f-be9313fd505f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1fbb0c9-4072-4260-859f-aadf53c653bb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:28.740316 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-da4b0d51-8efe-4f5b-b74f-be9313fd505f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:28.742042 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-da4b0d51-8efe-4f5b-b74f-be9313fd505f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:28.743300 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-da4b0d51-8efe-4f5b-b74f-be9313fd505f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:28.744346 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-da4b0d51-8efe-4f5b-b74f-be9313fd505f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:28.788972 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-da4b0d51-8efe-4f5b-b74f-be9313fd505f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:28.789783 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-da4b0d51-8efe-4f5b-b74f-be9313fd505f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:28.790673 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-da4b0d51-8efe-4f5b-b74f-be9313fd505f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lazy-loading 'fault' on Instance uuid b1fbb0c9-4072-4260-859f-aadf53c653bb {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:29:28.845732 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-da4b0d51-8efe-4f5b-b74f-be9313fd505f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e71b35f438d4539a60a390e1ceec9cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76fd883ad3944fcaaecdf2909120dc87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:28.854002 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-da4b0d51-8efe-4f5b-b74f-be9313fd505f tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1fbb0c9-4072-4260-859f-aadf53c653bb" status: 200 len: 1282 microversion: 2.1 time: 0.142477 Apr 16 21:29:28.860968 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2704/5557] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:28 2022] GET /compute/v2.1/servers/b1fbb0c9-4072-4260-859f-aadf53c653bb => generated 1282 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:29.527039 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e79579cc-4b42-4f88-8e3a-bce83168e564 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:29.527039 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e79579cc-4b42-4f88-8e3a-bce83168e564 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:29.532122 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e79579cc-4b42-4f88-8e3a-bce83168e564 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:29.532742 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e79579cc-4b42-4f88-8e3a-bce83168e564 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:29.534127 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e79579cc-4b42-4f88-8e3a-bce83168e564 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:29.534649 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e79579cc-4b42-4f88-8e3a-bce83168e564 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:29.765760 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e79579cc-4b42-4f88-8e3a-bce83168e564 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:29.774185 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e79579cc-4b42-4f88-8e3a-bce83168e564 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173" status: 200 len: 1506 microversion: 2.1 time: 0.253749 Apr 16 21:29:29.774771 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2854/5558] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:29 2022] GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173 => generated 1506 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:29.871174 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d1a5def9-eb06-4854-b097-3590ea2b0535 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:29.871791 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d1a5def9-eb06-4854-b097-3590ea2b0535 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] [instance: b1fbb0c9-4072-4260-859f-aadf53c653bb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:29.881971 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d1a5def9-eb06-4854-b097-3590ea2b0535 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:29.882661 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d1a5def9-eb06-4854-b097-3590ea2b0535 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:29.883791 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d1a5def9-eb06-4854-b097-3590ea2b0535 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:29.884585 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d1a5def9-eb06-4854-b097-3590ea2b0535 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:29.906917 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-d1a5def9-eb06-4854-b097-3590ea2b0535 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] HTTP exception thrown: Instance b1fbb0c9-4072-4260-859f-aadf53c653bb could not be found. Apr 16 21:29:29.907730 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d1a5def9-eb06-4854-b097-3590ea2b0535 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] Returning 404 to user: Instance b1fbb0c9-4072-4260-859f-aadf53c653bb could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:29:29.908696 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d1a5def9-eb06-4854-b097-3590ea2b0535 tempest-ServersTestJSON-1617913082 tempest-ServersTestJSON-1617913082-project] 10.222.0.20 "GET /compute/v2.1/servers/b1fbb0c9-4072-4260-859f-aadf53c653bb" status: 404 len: 111 microversion: 2.1 time: 0.041482 Apr 16 21:29:29.910113 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2705/5559] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:29 2022] GET /compute/v2.1/servers/b1fbb0c9-4072-4260-859f-aadf53c653bb => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:29:30.790941 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3d8bb3c9-acf7-4059-9965-7f80d71a0baf tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:30.791559 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3d8bb3c9-acf7-4059-9965-7f80d71a0baf tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:30.804147 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d8bb3c9-acf7-4059-9965-7f80d71a0baf tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:30.805926 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d8bb3c9-acf7-4059-9965-7f80d71a0baf tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:30.806944 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d8bb3c9-acf7-4059-9965-7f80d71a0baf tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:30.807602 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d8bb3c9-acf7-4059-9965-7f80d71a0baf tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:31.046784 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3d8bb3c9-acf7-4059-9965-7f80d71a0baf tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:31.062440 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3d8bb3c9-acf7-4059-9965-7f80d71a0baf tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173" status: 200 len: 1506 microversion: 2.1 time: 0.274348 Apr 16 21:29:31.074963 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2855/5560] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:30 2022] GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173 => generated 1506 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:32.080770 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-61a7d366-5c2c-4835-af3a-91a16d20441a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:32.081420 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-61a7d366-5c2c-4835-af3a-91a16d20441a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:32.088897 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-61a7d366-5c2c-4835-af3a-91a16d20441a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:32.089358 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-61a7d366-5c2c-4835-af3a-91a16d20441a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:32.090187 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-61a7d366-5c2c-4835-af3a-91a16d20441a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:32.090665 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-61a7d366-5c2c-4835-af3a-91a16d20441a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:32.298842 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-61a7d366-5c2c-4835-af3a-91a16d20441a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:32.308621 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-61a7d366-5c2c-4835-af3a-91a16d20441a tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173" status: 200 len: 1506 microversion: 2.1 time: 0.232082 Apr 16 21:29:32.309340 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2706/5561] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:32 2022] GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173 => generated 1506 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:32.811410 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3d8bb3c9-acf7-4059-9965-7f80d71a0baf tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:32.812620 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3d8bb3c9-acf7-4059-9965-7f80d71a0baf tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002051 Apr 16 21:29:32.813724 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2856/5562] 10.222.0.20 () {56 vars in 885 bytes} [Sat Apr 16 21:29:32 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Apr 16 21:29:33.326310 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1f0ce78f-df50-4b4a-b10b-95933bff0691 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:33.326941 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1f0ce78f-df50-4b4a-b10b-95933bff0691 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:33.333893 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1f0ce78f-df50-4b4a-b10b-95933bff0691 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:33.334354 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1f0ce78f-df50-4b4a-b10b-95933bff0691 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:33.335193 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1f0ce78f-df50-4b4a-b10b-95933bff0691 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:33.335675 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1f0ce78f-df50-4b4a-b10b-95933bff0691 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:33.539375 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1f0ce78f-df50-4b4a-b10b-95933bff0691 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:33.547442 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1f0ce78f-df50-4b4a-b10b-95933bff0691 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173" status: 200 len: 1506 microversion: 2.1 time: 0.225124 Apr 16 21:29:33.548015 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2707/5563] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:33 2022] GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173 => generated 1506 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:34.566477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-70fd7d5f-ad87-42e6-9e89-f2dbbf1aa0fc tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:34.567092 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-70fd7d5f-ad87-42e6-9e89-f2dbbf1aa0fc tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:34.579390 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-70fd7d5f-ad87-42e6-9e89-f2dbbf1aa0fc tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:34.581945 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-70fd7d5f-ad87-42e6-9e89-f2dbbf1aa0fc tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:34.582839 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-70fd7d5f-ad87-42e6-9e89-f2dbbf1aa0fc tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:34.584498 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-70fd7d5f-ad87-42e6-9e89-f2dbbf1aa0fc tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:34.834768 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-70fd7d5f-ad87-42e6-9e89-f2dbbf1aa0fc tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:34.842579 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-70fd7d5f-ad87-42e6-9e89-f2dbbf1aa0fc tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173" status: 200 len: 1506 microversion: 2.1 time: 0.281221 Apr 16 21:29:34.854008 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2857/5564] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:34 2022] GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173 => generated 1506 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:35.860861 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-525d7d7b-1ef9-4065-ba60-39fc9efd22f5 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:35.861485 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-525d7d7b-1ef9-4065-ba60-39fc9efd22f5 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:35.868642 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-525d7d7b-1ef9-4065-ba60-39fc9efd22f5 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:35.869546 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-525d7d7b-1ef9-4065-ba60-39fc9efd22f5 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:35.870630 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-525d7d7b-1ef9-4065-ba60-39fc9efd22f5 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:35.871282 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-525d7d7b-1ef9-4065-ba60-39fc9efd22f5 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:36.043773 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-525d7d7b-1ef9-4065-ba60-39fc9efd22f5 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:36.053744 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-525d7d7b-1ef9-4065-ba60-39fc9efd22f5 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173" status: 200 len: 1506 microversion: 2.1 time: 0.195354 Apr 16 21:29:36.053744 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2708/5565] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:35 2022] GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173 => generated 1506 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:36.154017 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-dbf018c5-6c11-4bd4-b290-604bb9e03ca8 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1520119882", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:29:36.210880 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-dbf018c5-6c11-4bd4-b290-604bb9e03ca8 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] validate_networks() for None {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:29:36.954036 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-dbf018c5-6c11-4bd4-b290-604bb9e03ca8 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:29:36.954992 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-dbf018c5-6c11-4bd4-b290-604bb9e03ca8 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:29:36.955594 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-dbf018c5-6c11-4bd4-b290-604bb9e03ca8 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:29:36.955867 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-dbf018c5-6c11-4bd4-b290-604bb9e03ca8 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:29:36.959947 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-dbf018c5-6c11-4bd4-b290-604bb9e03ca8 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:29:36.965764 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dbf018c5-6c11-4bd4-b290-604bb9e03ca8 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:36.966233 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dbf018c5-6c11-4bd4-b290-604bb9e03ca8 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:36.967063 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dbf018c5-6c11-4bd4-b290-604bb9e03ca8 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:36.967506 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dbf018c5-6c11-4bd4-b290-604bb9e03ca8 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:36.984836 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-dbf018c5-6c11-4bd4-b290-604bb9e03ca8 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Getting quotas for project b9a42fbaedfa48bf9d1306ceb85b0e04. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:29:36.990150 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-dbf018c5-6c11-4bd4-b290-604bb9e03ca8 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Getting quotas for user cf6771a45e3242d6ad4883d3b6ef314f and project b9a42fbaedfa48bf9d1306ceb85b0e04. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:29:37.003317 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-dbf018c5-6c11-4bd4-b290-604bb9e03ca8 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:29:37.005353 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-dbf018c5-6c11-4bd4-b290-604bb9e03ca8 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] [instance: b8c6cc8f-9ac7-4753-aef9-c5ea71435c60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:29:37.070511 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-38f96117-25a0-4b5b-83ab-c8e5f9dc344d tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:37.071228 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-38f96117-25a0-4b5b-83ab-c8e5f9dc344d tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:37.082551 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-38f96117-25a0-4b5b-83ab-c8e5f9dc344d tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:37.083022 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-38f96117-25a0-4b5b-83ab-c8e5f9dc344d tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:37.083805 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-38f96117-25a0-4b5b-83ab-c8e5f9dc344d tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:37.084282 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-38f96117-25a0-4b5b-83ab-c8e5f9dc344d tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:37.214476 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-dbf018c5-6c11-4bd4-b290-604bb9e03ca8 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.066414 Apr 16 21:29:37.217368 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2858/5566] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:29:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 1071 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:29:37.233714 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1320ad45-5536-44d0-9997-2020c5cdcd88 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:37.235170 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1320ad45-5536-44d0-9997-2020c5cdcd88 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] [instance: b8c6cc8f-9ac7-4753-aef9-c5ea71435c60] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:37.297386 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-38f96117-25a0-4b5b-83ab-c8e5f9dc344d tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:37.305160 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-38f96117-25a0-4b5b-83ab-c8e5f9dc344d tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173" status: 200 len: 1506 microversion: 2.1 time: 0.238545 Apr 16 21:29:37.308590 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2709/5567] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:37 2022] GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173 => generated 1506 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:37.399787 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1320ad45-5536-44d0-9997-2020c5cdcd88 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6771a45e3242d6ad4883d3b6ef314f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a42fbaedfa48bf9d1306ceb85b0e04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:37.411464 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1320ad45-5536-44d0-9997-2020c5cdcd88 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] 10.222.0.20 "GET /compute/v2.1/servers/b8c6cc8f-9ac7-4753-aef9-c5ea71435c60" status: 200 len: 1215 microversion: 2.1 time: 0.184816 Apr 16 21:29:37.412150 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2859/5568] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:37 2022] GET /compute/v2.1/servers/b8c6cc8f-9ac7-4753-aef9-c5ea71435c60 => generated 1215 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:37.479636 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-aee6d70c-195a-4124-9c26-1f3acf75087e tempest-ComputeTenantNetworksTest-979505922 tempest-ComputeTenantNetworksTest-979505922-project] Calling method '.version_select at 0x7fbb964ff280>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:37.753056 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-aee6d70c-195a-4124-9c26-1f3acf75087e tempest-ComputeTenantNetworksTest-979505922 tempest-ComputeTenantNetworksTest-979505922-project] 10.222.0.20 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 0.409802 Apr 16 21:29:37.753056 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2710/5569] 10.222.0.20 () {58 vars in 1157 bytes} [Sat Apr 16 21:29:37 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:29:37.759151 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8aa320c7-f843-429c-8c42-bc779f89c6f2 tempest-ComputeTenantNetworksTest-979505922 tempest-ComputeTenantNetworksTest-979505922-project] Calling method '.version_select at 0x7fbb955c64c0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:37.931323 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8aa320c7-f843-429c-8c42-bc779f89c6f2 tempest-ComputeTenantNetworksTest-979505922 tempest-ComputeTenantNetworksTest-979505922-project] 10.222.0.20 "GET /compute/v2.1/os-tenant-networks/7f66969e-3fbf-420d-9b9f-3b66a208da76" status: 200 len: 140 microversion: 2.1 time: 0.176272 Apr 16 21:29:37.932013 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2860/5570] 10.222.0.20 () {58 vars in 1268 bytes} [Sat Apr 16 21:29:37 2022] GET /compute/v2.1/os-tenant-networks/7f66969e-3fbf-420d-9b9f-3b66a208da76 => generated 140 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:29:38.325708 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8522b5fb-e354-4b20-af11-26d076befff3 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:38.326333 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8522b5fb-e354-4b20-af11-26d076befff3 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:38.334329 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8522b5fb-e354-4b20-af11-26d076befff3 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:38.334799 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8522b5fb-e354-4b20-af11-26d076befff3 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:38.335852 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8522b5fb-e354-4b20-af11-26d076befff3 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:38.336479 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8522b5fb-e354-4b20-af11-26d076befff3 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:38.430501 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-08ae2b69-5ca7-4ff5-8ce3-6ef85ce4c95e tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:38.433069 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-08ae2b69-5ca7-4ff5-8ce3-6ef85ce4c95e tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] [instance: b8c6cc8f-9ac7-4753-aef9-c5ea71435c60] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:38.515283 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-08ae2b69-5ca7-4ff5-8ce3-6ef85ce4c95e tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6771a45e3242d6ad4883d3b6ef314f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a42fbaedfa48bf9d1306ceb85b0e04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:38.527774 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-08ae2b69-5ca7-4ff5-8ce3-6ef85ce4c95e tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] 10.222.0.20 "GET /compute/v2.1/servers/b8c6cc8f-9ac7-4753-aef9-c5ea71435c60" status: 200 len: 1215 microversion: 2.1 time: 0.102571 Apr 16 21:29:38.529836 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2861/5571] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:38 2022] GET /compute/v2.1/servers/b8c6cc8f-9ac7-4753-aef9-c5ea71435c60 => generated 1215 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:38.614495 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8522b5fb-e354-4b20-af11-26d076befff3 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:38.628022 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8522b5fb-e354-4b20-af11-26d076befff3 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173" status: 200 len: 1506 microversion: 2.1 time: 0.305038 Apr 16 21:29:38.628022 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2711/5572] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:38 2022] GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173 => generated 1506 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:39.547007 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c1bf4668-a013-43d9-8cbb-d0ceacfd6014 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:39.547638 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c1bf4668-a013-43d9-8cbb-d0ceacfd6014 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] [instance: b8c6cc8f-9ac7-4753-aef9-c5ea71435c60] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:39.569085 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c1bf4668-a013-43d9-8cbb-d0ceacfd6014 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:39.569543 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c1bf4668-a013-43d9-8cbb-d0ceacfd6014 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:39.570384 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c1bf4668-a013-43d9-8cbb-d0ceacfd6014 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:39.570907 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c1bf4668-a013-43d9-8cbb-d0ceacfd6014 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:39.646199 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-db9abb74-97bb-44be-b2f0-4cfd4ce4c85e tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:39.646832 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-db9abb74-97bb-44be-b2f0-4cfd4ce4c85e tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:39.664026 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-db9abb74-97bb-44be-b2f0-4cfd4ce4c85e tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:39.664452 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-db9abb74-97bb-44be-b2f0-4cfd4ce4c85e tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:39.665270 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-db9abb74-97bb-44be-b2f0-4cfd4ce4c85e tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:39.668672 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-db9abb74-97bb-44be-b2f0-4cfd4ce4c85e tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:39.830337 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c1bf4668-a013-43d9-8cbb-d0ceacfd6014 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6771a45e3242d6ad4883d3b6ef314f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a42fbaedfa48bf9d1306ceb85b0e04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:39.844486 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c1bf4668-a013-43d9-8cbb-d0ceacfd6014 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] 10.222.0.20 "GET /compute/v2.1/servers/b8c6cc8f-9ac7-4753-aef9-c5ea71435c60" status: 200 len: 1267 microversion: 2.1 time: 0.299759 Apr 16 21:29:39.847212 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2862/5573] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:39 2022] GET /compute/v2.1/servers/b8c6cc8f-9ac7-4753-aef9-c5ea71435c60 => generated 1267 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:40.014542 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-db9abb74-97bb-44be-b2f0-4cfd4ce4c85e tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:40.043596 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-db9abb74-97bb-44be-b2f0-4cfd4ce4c85e tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173" status: 200 len: 1506 microversion: 2.1 time: 0.404548 Apr 16 21:29:40.044719 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2712/5574] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:39 2022] GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173 => generated 1506 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:29:40.864157 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-826ef3f6-b949-4709-bce4-1f3577a54b67 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:40.864813 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-826ef3f6-b949-4709-bce4-1f3577a54b67 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] [instance: b8c6cc8f-9ac7-4753-aef9-c5ea71435c60] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:40.873281 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-826ef3f6-b949-4709-bce4-1f3577a54b67 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:40.874250 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-826ef3f6-b949-4709-bce4-1f3577a54b67 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:40.875211 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-826ef3f6-b949-4709-bce4-1f3577a54b67 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:40.875810 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-826ef3f6-b949-4709-bce4-1f3577a54b67 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:40.946069 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-826ef3f6-b949-4709-bce4-1f3577a54b67 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6771a45e3242d6ad4883d3b6ef314f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a42fbaedfa48bf9d1306ceb85b0e04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:40.955112 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-826ef3f6-b949-4709-bce4-1f3577a54b67 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] 10.222.0.20 "GET /compute/v2.1/servers/b8c6cc8f-9ac7-4753-aef9-c5ea71435c60" status: 200 len: 1273 microversion: 2.1 time: 0.095351 Apr 16 21:29:40.965121 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2863/5575] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:40 2022] GET /compute/v2.1/servers/b8c6cc8f-9ac7-4753-aef9-c5ea71435c60 => generated 1273 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:41.061709 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1d185570-20f1-47fb-bb92-94eba586f3eb tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:41.062933 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1d185570-20f1-47fb-bb92-94eba586f3eb tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:41.070552 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1d185570-20f1-47fb-bb92-94eba586f3eb tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:41.071247 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1d185570-20f1-47fb-bb92-94eba586f3eb tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:41.072241 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1d185570-20f1-47fb-bb92-94eba586f3eb tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:41.072840 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1d185570-20f1-47fb-bb92-94eba586f3eb tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:41.369320 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1d185570-20f1-47fb-bb92-94eba586f3eb tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:41.383935 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1d185570-20f1-47fb-bb92-94eba586f3eb tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173" status: 200 len: 1506 microversion: 2.1 time: 0.325971 Apr 16 21:29:41.394964 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2713/5576] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:41 2022] GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173 => generated 1506 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:41.973745 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0fe2c24c-eca0-4f1e-85b5-bbafd6141d0b tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:41.974372 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0fe2c24c-eca0-4f1e-85b5-bbafd6141d0b tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] [instance: b8c6cc8f-9ac7-4753-aef9-c5ea71435c60] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:41.991234 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0fe2c24c-eca0-4f1e-85b5-bbafd6141d0b tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:41.991767 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0fe2c24c-eca0-4f1e-85b5-bbafd6141d0b tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:41.992614 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0fe2c24c-eca0-4f1e-85b5-bbafd6141d0b tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:41.993065 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0fe2c24c-eca0-4f1e-85b5-bbafd6141d0b tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:42.341771 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0fe2c24c-eca0-4f1e-85b5-bbafd6141d0b tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6771a45e3242d6ad4883d3b6ef314f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a42fbaedfa48bf9d1306ceb85b0e04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:42.353029 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0fe2c24c-eca0-4f1e-85b5-bbafd6141d0b tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] 10.222.0.20 "GET /compute/v2.1/servers/b8c6cc8f-9ac7-4753-aef9-c5ea71435c60" status: 200 len: 1273 microversion: 2.1 time: 0.380347 Apr 16 21:29:42.355980 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2864/5577] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:41 2022] GET /compute/v2.1/servers/b8c6cc8f-9ac7-4753-aef9-c5ea71435c60 => generated 1273 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:42.401878 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-250c7221-f816-44ce-a6a2-6cc5465674f4 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:42.402496 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-250c7221-f816-44ce-a6a2-6cc5465674f4 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:42.414899 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-250c7221-f816-44ce-a6a2-6cc5465674f4 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:42.415373 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-250c7221-f816-44ce-a6a2-6cc5465674f4 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:42.416220 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-250c7221-f816-44ce-a6a2-6cc5465674f4 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:42.416677 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-250c7221-f816-44ce-a6a2-6cc5465674f4 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:42.660227 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-250c7221-f816-44ce-a6a2-6cc5465674f4 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:42.669745 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-250c7221-f816-44ce-a6a2-6cc5465674f4 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173" status: 200 len: 1506 microversion: 2.1 time: 0.271832 Apr 16 21:29:42.686210 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2714/5578] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:42 2022] GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173 => generated 1506 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:43.372354 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-09dac3db-19d7-48be-aa24-214b4b2d2032 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:43.373176 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-09dac3db-19d7-48be-aa24-214b4b2d2032 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] [instance: b8c6cc8f-9ac7-4753-aef9-c5ea71435c60] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:43.388259 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-09dac3db-19d7-48be-aa24-214b4b2d2032 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:43.389706 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-09dac3db-19d7-48be-aa24-214b4b2d2032 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:43.391947 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-09dac3db-19d7-48be-aa24-214b4b2d2032 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:43.393705 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-09dac3db-19d7-48be-aa24-214b4b2d2032 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:43.706518 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-25f3d430-1c61-46ef-88bb-a202e1438a24 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:43.707223 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-25f3d430-1c61-46ef-88bb-a202e1438a24 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:43.729070 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-25f3d430-1c61-46ef-88bb-a202e1438a24 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:43.730033 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-25f3d430-1c61-46ef-88bb-a202e1438a24 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:43.732477 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-25f3d430-1c61-46ef-88bb-a202e1438a24 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:43.734779 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-25f3d430-1c61-46ef-88bb-a202e1438a24 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:44.072611 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-25f3d430-1c61-46ef-88bb-a202e1438a24 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:44.087366 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-25f3d430-1c61-46ef-88bb-a202e1438a24 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173" status: 200 len: 1506 microversion: 2.1 time: 0.384476 Apr 16 21:29:44.092718 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2715/5579] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:43 2022] GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173 => generated 1506 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:44.266306 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-09dac3db-19d7-48be-aa24-214b4b2d2032 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6771a45e3242d6ad4883d3b6ef314f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a42fbaedfa48bf9d1306ceb85b0e04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:44.290483 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-09dac3db-19d7-48be-aa24-214b4b2d2032 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] 10.222.0.20 "GET /compute/v2.1/servers/b8c6cc8f-9ac7-4753-aef9-c5ea71435c60" status: 200 len: 1315 microversion: 2.1 time: 0.923044 Apr 16 21:29:44.291758 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2865/5580] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:43 2022] GET /compute/v2.1/servers/b8c6cc8f-9ac7-4753-aef9-c5ea71435c60 => generated 1315 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:45.107706 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f6059222-f50d-43a3-ad53-b7b27e83a4c4 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:45.109362 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f6059222-f50d-43a3-ad53-b7b27e83a4c4 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:45.126266 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f6059222-f50d-43a3-ad53-b7b27e83a4c4 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:45.127306 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f6059222-f50d-43a3-ad53-b7b27e83a4c4 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:45.132255 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f6059222-f50d-43a3-ad53-b7b27e83a4c4 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:45.132742 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f6059222-f50d-43a3-ad53-b7b27e83a4c4 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:45.308538 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1eece24d-8de6-4515-abeb-3e140ea85e0e tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:45.310002 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1eece24d-8de6-4515-abeb-3e140ea85e0e tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] [instance: b8c6cc8f-9ac7-4753-aef9-c5ea71435c60] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:45.324889 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1eece24d-8de6-4515-abeb-3e140ea85e0e tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:45.330860 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1eece24d-8de6-4515-abeb-3e140ea85e0e tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:45.330860 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1eece24d-8de6-4515-abeb-3e140ea85e0e tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:45.330860 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1eece24d-8de6-4515-abeb-3e140ea85e0e tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:45.478067 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f6059222-f50d-43a3-ad53-b7b27e83a4c4 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:45.489533 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f6059222-f50d-43a3-ad53-b7b27e83a4c4 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173" status: 200 len: 1506 microversion: 2.1 time: 0.389133 Apr 16 21:29:45.495537 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2716/5581] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:45 2022] GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173 => generated 1506 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:45.801357 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-bf6e55a3-aebe-45da-9f16-25db46037a70 req-11f84c64-2079-4763-a3f0-9fd44bf73268 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8c6cc8f-9ac7-4753-aef9-c5ea71435c60", "tag": "aaa13a69-2e18-4dd3-bc2c-f84607880394"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:29:45.829150 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-bf6e55a3-aebe-45da-9f16-25db46037a70 req-11f84c64-2079-4763-a3f0-9fd44bf73268 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:45.834886 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-bf6e55a3-aebe-45da-9f16-25db46037a70 req-11f84c64-2079-4763-a3f0-9fd44bf73268 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:45.853263 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-bf6e55a3-aebe-45da-9f16-25db46037a70 req-11f84c64-2079-4763-a3f0-9fd44bf73268 service nova] Creating event network-changed:aaa13a69-2e18-4dd3-bc2c-f84607880394 for instance b8c6cc8f-9ac7-4753-aef9-c5ea71435c60 on nch1-master-1 Apr 16 21:29:45.859402 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-bf6e55a3-aebe-45da-9f16-25db46037a70 req-11f84c64-2079-4763-a3f0-9fd44bf73268 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063240 Apr 16 21:29:45.865985 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2717/5582] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:29:45.866973 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1eece24d-8de6-4515-abeb-3e140ea85e0e tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6771a45e3242d6ad4883d3b6ef314f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a42fbaedfa48bf9d1306ceb85b0e04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:45.872108 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1eece24d-8de6-4515-abeb-3e140ea85e0e tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] 10.222.0.20 "GET /compute/v2.1/servers/b8c6cc8f-9ac7-4753-aef9-c5ea71435c60" status: 200 len: 1315 microversion: 2.1 time: 0.567419 Apr 16 21:29:45.877049 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2866/5583] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:45 2022] GET /compute/v2.1/servers/b8c6cc8f-9ac7-4753-aef9-c5ea71435c60 => generated 1315 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:46.508492 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b7d3ae0a-3bc8-4055-8e52-98c69a1542fe tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:46.512408 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b7d3ae0a-3bc8-4055-8e52-98c69a1542fe tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:46.520646 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b7d3ae0a-3bc8-4055-8e52-98c69a1542fe tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:46.521112 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b7d3ae0a-3bc8-4055-8e52-98c69a1542fe tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:46.521988 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b7d3ae0a-3bc8-4055-8e52-98c69a1542fe tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:46.522455 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b7d3ae0a-3bc8-4055-8e52-98c69a1542fe tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:46.842808 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b7d3ae0a-3bc8-4055-8e52-98c69a1542fe tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:46.872095 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b7d3ae0a-3bc8-4055-8e52-98c69a1542fe tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173" status: 200 len: 1506 microversion: 2.1 time: 0.364962 Apr 16 21:29:46.883905 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2718/5584] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:46 2022] GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173 => generated 1506 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:46.900711 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-76a8fe8f-6309-4713-aabd-0df7314262d1 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:46.900711 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-76a8fe8f-6309-4713-aabd-0df7314262d1 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] [instance: b8c6cc8f-9ac7-4753-aef9-c5ea71435c60] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:46.916728 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-76a8fe8f-6309-4713-aabd-0df7314262d1 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:46.918649 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-76a8fe8f-6309-4713-aabd-0df7314262d1 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:46.922879 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-76a8fe8f-6309-4713-aabd-0df7314262d1 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:46.925936 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-76a8fe8f-6309-4713-aabd-0df7314262d1 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:47.303873 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-76a8fe8f-6309-4713-aabd-0df7314262d1 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6771a45e3242d6ad4883d3b6ef314f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a42fbaedfa48bf9d1306ceb85b0e04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:47.314800 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-76a8fe8f-6309-4713-aabd-0df7314262d1 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] 10.222.0.20 "GET /compute/v2.1/servers/b8c6cc8f-9ac7-4753-aef9-c5ea71435c60" status: 200 len: 1315 microversion: 2.1 time: 0.424710 Apr 16 21:29:47.324540 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2867/5585] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:46 2022] GET /compute/v2.1/servers/b8c6cc8f-9ac7-4753-aef9-c5ea71435c60 => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:47.890935 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-eafa41a9-fe8f-4142-94d2-f30d6b7864d1 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:47.891857 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-eafa41a9-fe8f-4142-94d2-f30d6b7864d1 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:47.898778 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eafa41a9-fe8f-4142-94d2-f30d6b7864d1 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:47.899238 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eafa41a9-fe8f-4142-94d2-f30d6b7864d1 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:47.900015 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eafa41a9-fe8f-4142-94d2-f30d6b7864d1 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:47.900743 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eafa41a9-fe8f-4142-94d2-f30d6b7864d1 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:48.034225 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-eafa41a9-fe8f-4142-94d2-f30d6b7864d1 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:48.042037 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-eafa41a9-fe8f-4142-94d2-f30d6b7864d1 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173" status: 200 len: 1506 microversion: 2.1 time: 0.154955 Apr 16 21:29:48.042891 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2719/5586] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:47 2022] GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:48.332849 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ae8c55b9-4862-462d-957f-ae80ea43b1ed tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:48.333466 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ae8c55b9-4862-462d-957f-ae80ea43b1ed tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] [instance: b8c6cc8f-9ac7-4753-aef9-c5ea71435c60] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:48.340587 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ae8c55b9-4862-462d-957f-ae80ea43b1ed tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:48.341238 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ae8c55b9-4862-462d-957f-ae80ea43b1ed tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:48.342030 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ae8c55b9-4862-462d-957f-ae80ea43b1ed tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:48.342478 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ae8c55b9-4862-462d-957f-ae80ea43b1ed tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:48.685650 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ae8c55b9-4862-462d-957f-ae80ea43b1ed tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6771a45e3242d6ad4883d3b6ef314f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a42fbaedfa48bf9d1306ceb85b0e04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:48.694884 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ae8c55b9-4862-462d-957f-ae80ea43b1ed tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] 10.222.0.20 "GET /compute/v2.1/servers/b8c6cc8f-9ac7-4753-aef9-c5ea71435c60" status: 200 len: 1315 microversion: 2.1 time: 0.366662 Apr 16 21:29:48.695571 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2868/5587] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:48 2022] GET /compute/v2.1/servers/b8c6cc8f-9ac7-4753-aef9-c5ea71435c60 => generated 1315 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:49.061841 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-509721bc-f0b0-4d3b-bf10-977454db26f2 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:49.062558 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-509721bc-f0b0-4d3b-bf10-977454db26f2 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:49.070703 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-509721bc-f0b0-4d3b-bf10-977454db26f2 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:49.071167 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-509721bc-f0b0-4d3b-bf10-977454db26f2 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:49.071965 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-509721bc-f0b0-4d3b-bf10-977454db26f2 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:49.072456 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-509721bc-f0b0-4d3b-bf10-977454db26f2 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:49.270042 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-509721bc-f0b0-4d3b-bf10-977454db26f2 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:49.278982 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-509721bc-f0b0-4d3b-bf10-977454db26f2 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173" status: 200 len: 1506 microversion: 2.1 time: 0.223559 Apr 16 21:29:49.280720 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2720/5588] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:49 2022] GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173 => generated 1506 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:49.711805 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-964efd88-d954-4c78-b21e-01386777fa90 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:49.712453 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-964efd88-d954-4c78-b21e-01386777fa90 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] [instance: b8c6cc8f-9ac7-4753-aef9-c5ea71435c60] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:49.725155 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-964efd88-d954-4c78-b21e-01386777fa90 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:49.725835 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-964efd88-d954-4c78-b21e-01386777fa90 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:49.730379 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-964efd88-d954-4c78-b21e-01386777fa90 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:49.730379 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-964efd88-d954-4c78-b21e-01386777fa90 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:49.891522 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-964efd88-d954-4c78-b21e-01386777fa90 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6771a45e3242d6ad4883d3b6ef314f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a42fbaedfa48bf9d1306ceb85b0e04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:49.900496 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-964efd88-d954-4c78-b21e-01386777fa90 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] 10.222.0.20 "GET /compute/v2.1/servers/b8c6cc8f-9ac7-4753-aef9-c5ea71435c60" status: 200 len: 1315 microversion: 2.1 time: 0.192213 Apr 16 21:29:49.901095 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2869/5589] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:49 2022] GET /compute/v2.1/servers/b8c6cc8f-9ac7-4753-aef9-c5ea71435c60 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:50.296610 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-83b2d357-1cd9-407e-8e68-fcb262f3a238 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:50.297794 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-83b2d357-1cd9-407e-8e68-fcb262f3a238 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:50.305748 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-83b2d357-1cd9-407e-8e68-fcb262f3a238 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:50.306337 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-83b2d357-1cd9-407e-8e68-fcb262f3a238 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:50.307231 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-83b2d357-1cd9-407e-8e68-fcb262f3a238 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:50.307781 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-83b2d357-1cd9-407e-8e68-fcb262f3a238 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:50.509234 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-83b2d357-1cd9-407e-8e68-fcb262f3a238 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:50.521553 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-83b2d357-1cd9-407e-8e68-fcb262f3a238 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173" status: 200 len: 1506 microversion: 2.1 time: 0.224232 Apr 16 21:29:50.521553 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2721/5590] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:50 2022] GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173 => generated 1506 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:50.924957 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7ab2b4ff-8c64-4127-980b-c049bf677e01 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:50.925610 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7ab2b4ff-8c64-4127-980b-c049bf677e01 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] [instance: b8c6cc8f-9ac7-4753-aef9-c5ea71435c60] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:50.939000 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ab2b4ff-8c64-4127-980b-c049bf677e01 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:50.939000 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ab2b4ff-8c64-4127-980b-c049bf677e01 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:50.944163 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ab2b4ff-8c64-4127-980b-c049bf677e01 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:50.944163 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ab2b4ff-8c64-4127-980b-c049bf677e01 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:51.224432 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7ab2b4ff-8c64-4127-980b-c049bf677e01 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6771a45e3242d6ad4883d3b6ef314f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a42fbaedfa48bf9d1306ceb85b0e04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:51.247698 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7ab2b4ff-8c64-4127-980b-c049bf677e01 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] 10.222.0.20 "GET /compute/v2.1/servers/b8c6cc8f-9ac7-4753-aef9-c5ea71435c60" status: 200 len: 1315 microversion: 2.1 time: 0.333167 Apr 16 21:29:51.259566 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2870/5591] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:50 2022] GET /compute/v2.1/servers/b8c6cc8f-9ac7-4753-aef9-c5ea71435c60 => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:51.533380 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ac835733-981f-412e-8f2c-1b90b4ebd916 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:51.534007 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ac835733-981f-412e-8f2c-1b90b4ebd916 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:51.543294 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ac835733-981f-412e-8f2c-1b90b4ebd916 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:51.543294 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ac835733-981f-412e-8f2c-1b90b4ebd916 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:51.544127 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ac835733-981f-412e-8f2c-1b90b4ebd916 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:51.544645 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ac835733-981f-412e-8f2c-1b90b4ebd916 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:51.698297 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ac835733-981f-412e-8f2c-1b90b4ebd916 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:51.708275 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ac835733-981f-412e-8f2c-1b90b4ebd916 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173" status: 200 len: 1506 microversion: 2.1 time: 0.178924 Apr 16 21:29:51.718861 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2722/5592] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:51 2022] GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173 => generated 1506 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:52.265068 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4238e964-f2ff-4ed2-91f3-8c725a706444 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:52.265752 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4238e964-f2ff-4ed2-91f3-8c725a706444 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] [instance: b8c6cc8f-9ac7-4753-aef9-c5ea71435c60] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:52.272905 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4238e964-f2ff-4ed2-91f3-8c725a706444 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:52.273380 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4238e964-f2ff-4ed2-91f3-8c725a706444 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:52.274760 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4238e964-f2ff-4ed2-91f3-8c725a706444 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:52.275661 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4238e964-f2ff-4ed2-91f3-8c725a706444 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:52.547623 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4238e964-f2ff-4ed2-91f3-8c725a706444 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6771a45e3242d6ad4883d3b6ef314f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a42fbaedfa48bf9d1306ceb85b0e04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:52.563424 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4238e964-f2ff-4ed2-91f3-8c725a706444 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] 10.222.0.20 "GET /compute/v2.1/servers/b8c6cc8f-9ac7-4753-aef9-c5ea71435c60" status: 200 len: 1315 microversion: 2.1 time: 0.302254 Apr 16 21:29:52.569144 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2871/5593] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:52 2022] GET /compute/v2.1/servers/b8c6cc8f-9ac7-4753-aef9-c5ea71435c60 => generated 1315 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:52.726952 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2cecb9b1-b08f-4fac-9512-c602ed2f7f91 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:52.728105 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2cecb9b1-b08f-4fac-9512-c602ed2f7f91 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:52.737960 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2cecb9b1-b08f-4fac-9512-c602ed2f7f91 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:52.738945 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2cecb9b1-b08f-4fac-9512-c602ed2f7f91 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:52.740042 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2cecb9b1-b08f-4fac-9512-c602ed2f7f91 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:52.740740 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2cecb9b1-b08f-4fac-9512-c602ed2f7f91 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:53.187282 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2cecb9b1-b08f-4fac-9512-c602ed2f7f91 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:53.197161 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2cecb9b1-b08f-4fac-9512-c602ed2f7f91 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173" status: 200 len: 1506 microversion: 2.1 time: 0.472257 Apr 16 21:29:53.210001 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2723/5594] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:52 2022] GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173 => generated 1506 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:53.585581 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4be05130-f90f-4958-9287-0e12d7b91af0 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:53.587028 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4be05130-f90f-4958-9287-0e12d7b91af0 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] [instance: b8c6cc8f-9ac7-4753-aef9-c5ea71435c60] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:53.594059 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4be05130-f90f-4958-9287-0e12d7b91af0 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:53.600638 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4be05130-f90f-4958-9287-0e12d7b91af0 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:53.601795 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4be05130-f90f-4958-9287-0e12d7b91af0 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:53.603000 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4be05130-f90f-4958-9287-0e12d7b91af0 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:53.903621 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4be05130-f90f-4958-9287-0e12d7b91af0 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6771a45e3242d6ad4883d3b6ef314f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a42fbaedfa48bf9d1306ceb85b0e04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:53.915132 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4be05130-f90f-4958-9287-0e12d7b91af0 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] 10.222.0.20 "GET /compute/v2.1/servers/b8c6cc8f-9ac7-4753-aef9-c5ea71435c60" status: 200 len: 1315 microversion: 2.1 time: 0.333111 Apr 16 21:29:53.923638 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2872/5595] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:53 2022] GET /compute/v2.1/servers/b8c6cc8f-9ac7-4753-aef9-c5ea71435c60 => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:54.214829 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3760e72c-806c-46d6-b232-73d38a896670 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:54.216317 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3760e72c-806c-46d6-b232-73d38a896670 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:54.223986 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3760e72c-806c-46d6-b232-73d38a896670 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:54.224401 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3760e72c-806c-46d6-b232-73d38a896670 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:54.225185 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3760e72c-806c-46d6-b232-73d38a896670 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:54.225624 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3760e72c-806c-46d6-b232-73d38a896670 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:54.549452 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3760e72c-806c-46d6-b232-73d38a896670 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:54.559403 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3760e72c-806c-46d6-b232-73d38a896670 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173" status: 200 len: 1506 microversion: 2.1 time: 0.347846 Apr 16 21:29:54.560159 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2724/5596] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:54 2022] GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173 => generated 1506 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:54.746256 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-cec2a171-76a2-4f35-801f-13b1e3be981e req-28cf9a58-06a7-4853-8f43-19a8ca9e6002 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8c6cc8f-9ac7-4753-aef9-c5ea71435c60", "name": "network-vif-plugged", "status": "completed", "tag": "aaa13a69-2e18-4dd3-bc2c-f84607880394"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:29:54.797227 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-cec2a171-76a2-4f35-801f-13b1e3be981e req-28cf9a58-06a7-4853-8f43-19a8ca9e6002 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:54.798772 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-cec2a171-76a2-4f35-801f-13b1e3be981e req-28cf9a58-06a7-4853-8f43-19a8ca9e6002 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:54.812249 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-cec2a171-76a2-4f35-801f-13b1e3be981e req-28cf9a58-06a7-4853-8f43-19a8ca9e6002 service nova] Creating event network-vif-plugged:aaa13a69-2e18-4dd3-bc2c-f84607880394 for instance b8c6cc8f-9ac7-4753-aef9-c5ea71435c60 on nch1-master-1 Apr 16 21:29:54.817992 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-cec2a171-76a2-4f35-801f-13b1e3be981e req-28cf9a58-06a7-4853-8f43-19a8ca9e6002 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078732 Apr 16 21:29:54.822333 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2873/5597] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:29:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:29:54.934442 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2bcaa451-de63-45d8-97f9-195c2812d9cd tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:54.935053 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2bcaa451-de63-45d8-97f9-195c2812d9cd tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] [instance: b8c6cc8f-9ac7-4753-aef9-c5ea71435c60] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:54.941905 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2bcaa451-de63-45d8-97f9-195c2812d9cd tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:54.942357 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2bcaa451-de63-45d8-97f9-195c2812d9cd tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:54.943135 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2bcaa451-de63-45d8-97f9-195c2812d9cd tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:54.943609 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2bcaa451-de63-45d8-97f9-195c2812d9cd tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:55.266795 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2bcaa451-de63-45d8-97f9-195c2812d9cd tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6771a45e3242d6ad4883d3b6ef314f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a42fbaedfa48bf9d1306ceb85b0e04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:55.280001 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2bcaa451-de63-45d8-97f9-195c2812d9cd tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] 10.222.0.20 "GET /compute/v2.1/servers/b8c6cc8f-9ac7-4753-aef9-c5ea71435c60" status: 200 len: 1315 microversion: 2.1 time: 0.348753 Apr 16 21:29:55.281177 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2725/5598] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:54 2022] GET /compute/v2.1/servers/b8c6cc8f-9ac7-4753-aef9-c5ea71435c60 => generated 1315 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:55.579551 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-407a094e-e169-45d1-ba44-1c13a88cf2a0 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:55.580766 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-407a094e-e169-45d1-ba44-1c13a88cf2a0 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:55.590295 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-407a094e-e169-45d1-ba44-1c13a88cf2a0 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:55.590295 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-407a094e-e169-45d1-ba44-1c13a88cf2a0 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:55.590295 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-407a094e-e169-45d1-ba44-1c13a88cf2a0 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:55.590295 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-407a094e-e169-45d1-ba44-1c13a88cf2a0 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:55.779988 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-407a094e-e169-45d1-ba44-1c13a88cf2a0 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:55.792708 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-407a094e-e169-45d1-ba44-1c13a88cf2a0 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173" status: 200 len: 1486 microversion: 2.1 time: 0.217855 Apr 16 21:29:55.811451 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4bf05ebb-523f-45b1-b92b-a93fbc2186c9 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:29:55.812412 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4bf05ebb-523f-45b1-b92b-a93fbc2186c9 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:55.816755 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2874/5599] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:55 2022] GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173 => generated 1486 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:55.819863 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4bf05ebb-523f-45b1-b92b-a93fbc2186c9 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:55.820801 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4bf05ebb-523f-45b1-b92b-a93fbc2186c9 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:55.821846 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4bf05ebb-523f-45b1-b92b-a93fbc2186c9 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:55.823402 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4bf05ebb-523f-45b1-b92b-a93fbc2186c9 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:56.159758 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4bf05ebb-523f-45b1-b92b-a93fbc2186c9 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "POST /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173/action" status: 202 len: 0 microversion: 2.1 time: 0.352229 Apr 16 21:29:56.160369 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2726/5600] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:29:55 2022] POST /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173/action => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:29:56.168508 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-16fe1f07-fda4-427a-ad15-3e1070d37470 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:56.169232 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-16fe1f07-fda4-427a-ad15-3e1070d37470 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:56.176535 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-16fe1f07-fda4-427a-ad15-3e1070d37470 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:56.181937 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-16fe1f07-fda4-427a-ad15-3e1070d37470 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:56.181937 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-16fe1f07-fda4-427a-ad15-3e1070d37470 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:56.181937 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-16fe1f07-fda4-427a-ad15-3e1070d37470 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:56.300137 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-aa2aac47-a075-42c8-a7e4-5ce331dae17c tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:56.303535 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-aa2aac47-a075-42c8-a7e4-5ce331dae17c tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] [instance: b8c6cc8f-9ac7-4753-aef9-c5ea71435c60] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:56.336807 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aa2aac47-a075-42c8-a7e4-5ce331dae17c tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:56.337273 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aa2aac47-a075-42c8-a7e4-5ce331dae17c tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:56.342700 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aa2aac47-a075-42c8-a7e4-5ce331dae17c tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:56.343418 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aa2aac47-a075-42c8-a7e4-5ce331dae17c tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:56.533028 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-aa2aac47-a075-42c8-a7e4-5ce331dae17c tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6771a45e3242d6ad4883d3b6ef314f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a42fbaedfa48bf9d1306ceb85b0e04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:56.540934 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-aa2aac47-a075-42c8-a7e4-5ce331dae17c tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] 10.222.0.20 "GET /compute/v2.1/servers/b8c6cc8f-9ac7-4753-aef9-c5ea71435c60" status: 200 len: 1315 microversion: 2.1 time: 0.246426 Apr 16 21:29:56.541733 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2727/5601] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:56 2022] GET /compute/v2.1/servers/b8c6cc8f-9ac7-4753-aef9-c5ea71435c60 => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:56.876026 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-16fe1f07-fda4-427a-ad15-3e1070d37470 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:56.884142 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-16fe1f07-fda4-427a-ad15-3e1070d37470 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173" status: 200 len: 1494 microversion: 2.1 time: 0.719529 Apr 16 21:29:56.884855 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2875/5602] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:56 2022] GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173 => generated 1494 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:57.558027 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-564013d3-b53c-428c-80bc-35905b1dc7be tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:57.558726 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-564013d3-b53c-428c-80bc-35905b1dc7be tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] [instance: b8c6cc8f-9ac7-4753-aef9-c5ea71435c60] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:57.566849 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-564013d3-b53c-428c-80bc-35905b1dc7be tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:57.567268 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-564013d3-b53c-428c-80bc-35905b1dc7be tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:57.568054 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-564013d3-b53c-428c-80bc-35905b1dc7be tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:57.568520 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-564013d3-b53c-428c-80bc-35905b1dc7be tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:57.814309 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-564013d3-b53c-428c-80bc-35905b1dc7be tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6771a45e3242d6ad4883d3b6ef314f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a42fbaedfa48bf9d1306ceb85b0e04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:57.820623 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-564013d3-b53c-428c-80bc-35905b1dc7be tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] 10.222.0.20 "GET /compute/v2.1/servers/b8c6cc8f-9ac7-4753-aef9-c5ea71435c60" status: 200 len: 1464 microversion: 2.1 time: 0.266351 Apr 16 21:29:57.821496 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2728/5603] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:57 2022] GET /compute/v2.1/servers/b8c6cc8f-9ac7-4753-aef9-c5ea71435c60 => generated 1464 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:57.869038 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-77af7b00-b854-47a3-a350-710ed5bbdb3f tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:57.869787 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-77af7b00-b854-47a3-a350-710ed5bbdb3f tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] [instance: b8c6cc8f-9ac7-4753-aef9-c5ea71435c60] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:57.878707 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-77af7b00-b854-47a3-a350-710ed5bbdb3f tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:57.879813 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-77af7b00-b854-47a3-a350-710ed5bbdb3f tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:57.880963 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-77af7b00-b854-47a3-a350-710ed5bbdb3f tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:57.881902 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-77af7b00-b854-47a3-a350-710ed5bbdb3f tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:57.902516 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2d767824-834f-48b5-a5e3-38e74e15a4c7 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:57.903129 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2d767824-834f-48b5-a5e3-38e74e15a4c7 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:57.911706 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2d767824-834f-48b5-a5e3-38e74e15a4c7 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:57.912300 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2d767824-834f-48b5-a5e3-38e74e15a4c7 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:57.913339 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2d767824-834f-48b5-a5e3-38e74e15a4c7 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:57.914015 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2d767824-834f-48b5-a5e3-38e74e15a4c7 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:57.915569 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-77af7b00-b854-47a3-a350-710ed5bbdb3f tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] [instance: b8c6cc8f-9ac7-4753-aef9-c5ea71435c60] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:29:58.102640 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2d767824-834f-48b5-a5e3-38e74e15a4c7 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:58.113210 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2d767824-834f-48b5-a5e3-38e74e15a4c7 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173" status: 200 len: 1494 microversion: 2.1 time: 0.213336 Apr 16 21:29:58.113843 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2729/5604] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:57 2022] GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173 => generated 1494 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:29:58.273429 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-77af7b00-b854-47a3-a350-710ed5bbdb3f tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b8c6cc8f-9ac7-4753-aef9-c5ea71435c60" status: 204 len: 0 microversion: 2.1 time: 0.408977 Apr 16 21:29:58.274661 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2876/5605] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:29:57 2022] DELETE /compute/v2.1/servers/b8c6cc8f-9ac7-4753-aef9-c5ea71435c60 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:29:58.284247 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ed0348fe-f499-4b41-8114-e3992ae9ad43 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:58.284859 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ed0348fe-f499-4b41-8114-e3992ae9ad43 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] [instance: b8c6cc8f-9ac7-4753-aef9-c5ea71435c60] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:58.290757 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ed0348fe-f499-4b41-8114-e3992ae9ad43 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:58.291512 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ed0348fe-f499-4b41-8114-e3992ae9ad43 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:58.292367 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ed0348fe-f499-4b41-8114-e3992ae9ad43 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:58.292841 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ed0348fe-f499-4b41-8114-e3992ae9ad43 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:58.574728 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ed0348fe-f499-4b41-8114-e3992ae9ad43 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6771a45e3242d6ad4883d3b6ef314f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a42fbaedfa48bf9d1306ceb85b0e04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:58.585134 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ed0348fe-f499-4b41-8114-e3992ae9ad43 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] 10.222.0.20 "GET /compute/v2.1/servers/b8c6cc8f-9ac7-4753-aef9-c5ea71435c60" status: 200 len: 1470 microversion: 2.1 time: 0.305305 Apr 16 21:29:58.586254 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2730/5606] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:58 2022] GET /compute/v2.1/servers/b8c6cc8f-9ac7-4753-aef9-c5ea71435c60 => generated 1470 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:59.147408 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-adf057e8-8683-484d-b792-81f478669264 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:59.148928 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-adf057e8-8683-484d-b792-81f478669264 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:59.170639 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-adf057e8-8683-484d-b792-81f478669264 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:59.171342 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-adf057e8-8683-484d-b792-81f478669264 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:59.178288 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-adf057e8-8683-484d-b792-81f478669264 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:59.179028 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-adf057e8-8683-484d-b792-81f478669264 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:59.469408 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-adf057e8-8683-484d-b792-81f478669264 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:29:59.478943 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-adf057e8-8683-484d-b792-81f478669264 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173" status: 200 len: 1494 microversion: 2.1 time: 0.351272 Apr 16 21:29:59.486240 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2877/5607] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:59 2022] GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173 => generated 1494 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:29:59.604413 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1b5e05f5-1658-4ee2-877d-3903c5dd24bb tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:29:59.605788 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1b5e05f5-1658-4ee2-877d-3903c5dd24bb tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] [instance: b8c6cc8f-9ac7-4753-aef9-c5ea71435c60] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:29:59.613162 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1b5e05f5-1658-4ee2-877d-3903c5dd24bb tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:59.613964 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1b5e05f5-1658-4ee2-877d-3903c5dd24bb tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:29:59.615650 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1b5e05f5-1658-4ee2-877d-3903c5dd24bb tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:29:59.616392 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1b5e05f5-1658-4ee2-877d-3903c5dd24bb tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:00.179244 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1b5e05f5-1658-4ee2-877d-3903c5dd24bb tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6771a45e3242d6ad4883d3b6ef314f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a42fbaedfa48bf9d1306ceb85b0e04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:30:00.194346 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1b5e05f5-1658-4ee2-877d-3903c5dd24bb tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] 10.222.0.20 "GET /compute/v2.1/servers/b8c6cc8f-9ac7-4753-aef9-c5ea71435c60" status: 200 len: 1470 microversion: 2.1 time: 0.594769 Apr 16 21:30:00.195104 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2731/5608] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:29:59 2022] GET /compute/v2.1/servers/b8c6cc8f-9ac7-4753-aef9-c5ea71435c60 => generated 1470 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:30:00.503774 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-eaf7383e-d4da-4396-bf50-ee3e839a7dc7 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:30:00.504848 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-eaf7383e-d4da-4396-bf50-ee3e839a7dc7 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:30:00.512037 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eaf7383e-d4da-4396-bf50-ee3e839a7dc7 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:00.518266 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eaf7383e-d4da-4396-bf50-ee3e839a7dc7 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:00.521834 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eaf7383e-d4da-4396-bf50-ee3e839a7dc7 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:00.522531 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eaf7383e-d4da-4396-bf50-ee3e839a7dc7 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:00.837117 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-eaf7383e-d4da-4396-bf50-ee3e839a7dc7 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:30:00.847574 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-eaf7383e-d4da-4396-bf50-ee3e839a7dc7 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173" status: 200 len: 1500 microversion: 2.1 time: 0.348470 Apr 16 21:30:00.872200 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-db6e983b-afbc-4142-bcb0-68b5ab5397f9 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:30:00.872753 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-db6e983b-afbc-4142-bcb0-68b5ab5397f9 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:30:00.875535 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2878/5609] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:30:00 2022] GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173 => generated 1500 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:30:00.886188 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-db6e983b-afbc-4142-bcb0-68b5ab5397f9 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:00.886716 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-db6e983b-afbc-4142-bcb0-68b5ab5397f9 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:00.887550 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-db6e983b-afbc-4142-bcb0-68b5ab5397f9 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:00.891159 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-db6e983b-afbc-4142-bcb0-68b5ab5397f9 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:00.948836 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-db6e983b-afbc-4142-bcb0-68b5ab5397f9 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:30:01.216093 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3c85307f-9964-417e-bee8-4b5ca2e6aca8 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:30:01.216744 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3c85307f-9964-417e-bee8-4b5ca2e6aca8 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] [instance: b8c6cc8f-9ac7-4753-aef9-c5ea71435c60] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:30:01.246686 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3c85307f-9964-417e-bee8-4b5ca2e6aca8 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:01.247149 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3c85307f-9964-417e-bee8-4b5ca2e6aca8 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:01.247954 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3c85307f-9964-417e-bee8-4b5ca2e6aca8 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:01.248432 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3c85307f-9964-417e-bee8-4b5ca2e6aca8 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:01.373692 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-db6e983b-afbc-4142-bcb0-68b5ab5397f9 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173" status: 204 len: 0 microversion: 2.1 time: 0.505159 Apr 16 21:30:01.374292 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2732/5610] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:30:00 2022] DELETE /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:30:01.386845 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d183de8e-e6ed-4711-bdb3-4032f4df1ff9 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:30:01.387648 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d183de8e-e6ed-4711-bdb3-4032f4df1ff9 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:30:01.410214 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d183de8e-e6ed-4711-bdb3-4032f4df1ff9 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:01.410714 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d183de8e-e6ed-4711-bdb3-4032f4df1ff9 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:01.411562 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d183de8e-e6ed-4711-bdb3-4032f4df1ff9 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:01.412015 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d183de8e-e6ed-4711-bdb3-4032f4df1ff9 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:01.525854 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3c85307f-9964-417e-bee8-4b5ca2e6aca8 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6771a45e3242d6ad4883d3b6ef314f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a42fbaedfa48bf9d1306ceb85b0e04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:30:01.538665 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3c85307f-9964-417e-bee8-4b5ca2e6aca8 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] 10.222.0.20 "GET /compute/v2.1/servers/b8c6cc8f-9ac7-4753-aef9-c5ea71435c60" status: 200 len: 1428 microversion: 2.1 time: 0.328380 Apr 16 21:30:01.539258 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2879/5611] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:30:01 2022] GET /compute/v2.1/servers/b8c6cc8f-9ac7-4753-aef9-c5ea71435c60 => generated 1428 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:30:01.554521 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-3748f953-cfbf-4eea-8700-6f01d56c72d3 req-eae68379-fed6-4617-8e77-2471498306b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8c6cc8f-9ac7-4753-aef9-c5ea71435c60", "name": "network-vif-deleted", "tag": "aaa13a69-2e18-4dd3-bc2c-f84607880394"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:30:01.571937 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-3748f953-cfbf-4eea-8700-6f01d56c72d3 req-eae68379-fed6-4617-8e77-2471498306b0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:01.574938 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-3748f953-cfbf-4eea-8700-6f01d56c72d3 req-eae68379-fed6-4617-8e77-2471498306b0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:01.589038 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-3748f953-cfbf-4eea-8700-6f01d56c72d3 req-eae68379-fed6-4617-8e77-2471498306b0 service nova] Creating event network-vif-deleted:aaa13a69-2e18-4dd3-bc2c-f84607880394 for instance b8c6cc8f-9ac7-4753-aef9-c5ea71435c60 on nch1-master-1 Apr 16 21:30:01.597163 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-3748f953-cfbf-4eea-8700-6f01d56c72d3 req-eae68379-fed6-4617-8e77-2471498306b0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055648 Apr 16 21:30:01.600514 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2880/5612] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:30:01.700789 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d183de8e-e6ed-4711-bdb3-4032f4df1ff9 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:30:01.714069 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d183de8e-e6ed-4711-bdb3-4032f4df1ff9 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173" status: 200 len: 1506 microversion: 2.1 time: 0.334090 Apr 16 21:30:01.714945 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2733/5613] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:30:01 2022] GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173 => generated 1506 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:30:02.557637 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-34cf848a-7063-4a13-af80-4f39a8f34fb4 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:30:02.559514 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-34cf848a-7063-4a13-af80-4f39a8f34fb4 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] [instance: b8c6cc8f-9ac7-4753-aef9-c5ea71435c60] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:30:02.568002 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-34cf848a-7063-4a13-af80-4f39a8f34fb4 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:02.568560 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-34cf848a-7063-4a13-af80-4f39a8f34fb4 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:02.569916 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-34cf848a-7063-4a13-af80-4f39a8f34fb4 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:02.570486 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-34cf848a-7063-4a13-af80-4f39a8f34fb4 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:02.632406 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-34cf848a-7063-4a13-af80-4f39a8f34fb4 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:02.632870 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-34cf848a-7063-4a13-af80-4f39a8f34fb4 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:02.633335 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-34cf848a-7063-4a13-af80-4f39a8f34fb4 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lazy-loading 'fault' on Instance uuid b8c6cc8f-9ac7-4753-aef9-c5ea71435c60 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:30:02.705447 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-34cf848a-7063-4a13-af80-4f39a8f34fb4 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cf6771a45e3242d6ad4883d3b6ef314f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9a42fbaedfa48bf9d1306ceb85b0e04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:30:02.715174 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-34cf848a-7063-4a13-af80-4f39a8f34fb4 tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] 10.222.0.20 "GET /compute/v2.1/servers/b8c6cc8f-9ac7-4753-aef9-c5ea71435c60" status: 200 len: 1305 microversion: 2.1 time: 0.162437 Apr 16 21:30:02.716511 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2881/5614] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:30:02 2022] GET /compute/v2.1/servers/b8c6cc8f-9ac7-4753-aef9-c5ea71435c60 => generated 1305 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:30:02.732614 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-72acadc0-e3bf-4a0e-802e-8fb9d9cdcb7c tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:30:02.733300 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-72acadc0-e3bf-4a0e-802e-8fb9d9cdcb7c tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:30:02.741683 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-72acadc0-e3bf-4a0e-802e-8fb9d9cdcb7c tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:02.742435 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-72acadc0-e3bf-4a0e-802e-8fb9d9cdcb7c tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:02.743420 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-72acadc0-e3bf-4a0e-802e-8fb9d9cdcb7c tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:02.744024 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-72acadc0-e3bf-4a0e-802e-8fb9d9cdcb7c tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:02.956433 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-72acadc0-e3bf-4a0e-802e-8fb9d9cdcb7c tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:30:02.980427 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-72acadc0-e3bf-4a0e-802e-8fb9d9cdcb7c tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173" status: 200 len: 1506 microversion: 2.1 time: 0.251327 Apr 16 21:30:02.981032 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2734/5615] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:30:02 2022] GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173 => generated 1506 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:30:03.734594 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-00625838-9f1f-452b-abab-f98817d7facd tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:30:03.735822 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-00625838-9f1f-452b-abab-f98817d7facd tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] [instance: b8c6cc8f-9ac7-4753-aef9-c5ea71435c60] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:30:03.745221 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-00625838-9f1f-452b-abab-f98817d7facd tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:03.745686 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-00625838-9f1f-452b-abab-f98817d7facd tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:03.751718 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-00625838-9f1f-452b-abab-f98817d7facd tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:03.756278 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-00625838-9f1f-452b-abab-f98817d7facd tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:03.776770 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-00625838-9f1f-452b-abab-f98817d7facd tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] HTTP exception thrown: Instance b8c6cc8f-9ac7-4753-aef9-c5ea71435c60 could not be found. Apr 16 21:30:03.777642 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-00625838-9f1f-452b-abab-f98817d7facd tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] Returning 404 to user: Instance b8c6cc8f-9ac7-4753-aef9-c5ea71435c60 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:30:03.779212 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-00625838-9f1f-452b-abab-f98817d7facd tempest-VolumesNegativeTest-900060710 tempest-VolumesNegativeTest-900060710-project] 10.222.0.20 "GET /compute/v2.1/servers/b8c6cc8f-9ac7-4753-aef9-c5ea71435c60" status: 404 len: 111 microversion: 2.1 time: 0.049986 Apr 16 21:30:03.784467 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2882/5616] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:30:03 2022] GET /compute/v2.1/servers/b8c6cc8f-9ac7-4753-aef9-c5ea71435c60 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:30:03.998268 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-879e52de-380d-4a2a-8684-b30128aa9792 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:30:03.998962 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-879e52de-380d-4a2a-8684-b30128aa9792 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:30:04.011439 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-879e52de-380d-4a2a-8684-b30128aa9792 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:04.013085 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-879e52de-380d-4a2a-8684-b30128aa9792 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:04.014120 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-879e52de-380d-4a2a-8684-b30128aa9792 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:04.015541 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-879e52de-380d-4a2a-8684-b30128aa9792 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:04.402916 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-879e52de-380d-4a2a-8684-b30128aa9792 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:30:04.411717 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-879e52de-380d-4a2a-8684-b30128aa9792 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173" status: 200 len: 1506 microversion: 2.1 time: 0.418071 Apr 16 21:30:04.417874 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2735/5617] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:30:03 2022] GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173 => generated 1506 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:30:05.437587 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6d1a3931-bac2-4763-83b1-fa04c80568d2 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:30:05.438258 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6d1a3931-bac2-4763-83b1-fa04c80568d2 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:30:05.450222 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6d1a3931-bac2-4763-83b1-fa04c80568d2 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:05.455306 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6d1a3931-bac2-4763-83b1-fa04c80568d2 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:05.456542 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6d1a3931-bac2-4763-83b1-fa04c80568d2 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:05.457154 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6d1a3931-bac2-4763-83b1-fa04c80568d2 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:05.609154 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6d1a3931-bac2-4763-83b1-fa04c80568d2 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:30:05.617074 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6d1a3931-bac2-4763-83b1-fa04c80568d2 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173" status: 200 len: 1464 microversion: 2.1 time: 0.185700 Apr 16 21:30:05.618068 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2883/5618] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:30:05 2022] GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173 => generated 1464 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:30:05.637276 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-1fa4a970-d818-45c2-8cb3-2f1515d99f86 req-c8133154-a7fb-48a5-a4af-6a42192a0a7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d43b200a-d978-4ee2-a790-79639beb3173", "name": "network-vif-deleted", "tag": "b76a8a29-6a6f-4de2-a6cf-ece487714c6e"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:30:05.648657 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-1fa4a970-d818-45c2-8cb3-2f1515d99f86 req-c8133154-a7fb-48a5-a4af-6a42192a0a7b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:05.649668 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-1fa4a970-d818-45c2-8cb3-2f1515d99f86 req-c8133154-a7fb-48a5-a4af-6a42192a0a7b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:05.663743 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-1fa4a970-d818-45c2-8cb3-2f1515d99f86 req-c8133154-a7fb-48a5-a4af-6a42192a0a7b service nova] Creating event network-vif-deleted:b76a8a29-6a6f-4de2-a6cf-ece487714c6e for instance d43b200a-d978-4ee2-a790-79639beb3173 on nch2-master-1 Apr 16 21:30:05.672672 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-1fa4a970-d818-45c2-8cb3-2f1515d99f86 req-c8133154-a7fb-48a5-a4af-6a42192a0a7b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040701 Apr 16 21:30:05.674083 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2736/5619] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:30:06.648624 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cc05f7f2-f6bc-4d3d-a3f2-0d3bfdce1386 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:30:06.648624 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cc05f7f2-f6bc-4d3d-a3f2-0d3bfdce1386 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:30:06.648624 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cc05f7f2-f6bc-4d3d-a3f2-0d3bfdce1386 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:06.648624 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cc05f7f2-f6bc-4d3d-a3f2-0d3bfdce1386 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:06.648624 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cc05f7f2-f6bc-4d3d-a3f2-0d3bfdce1386 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:06.648624 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cc05f7f2-f6bc-4d3d-a3f2-0d3bfdce1386 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:06.678347 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cc05f7f2-f6bc-4d3d-a3f2-0d3bfdce1386 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:06.678892 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cc05f7f2-f6bc-4d3d-a3f2-0d3bfdce1386 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:06.679439 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-cc05f7f2-f6bc-4d3d-a3f2-0d3bfdce1386 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lazy-loading 'fault' on Instance uuid d43b200a-d978-4ee2-a790-79639beb3173 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:30:06.733273 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cc05f7f2-f6bc-4d3d-a3f2-0d3bfdce1386 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:30:06.741563 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cc05f7f2-f6bc-4d3d-a3f2-0d3bfdce1386 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173" status: 200 len: 1304 microversion: 2.1 time: 0.110575 Apr 16 21:30:06.742166 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2884/5620] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:30:06 2022] GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173 => generated 1304 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:30:07.759785 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3a90f7a0-9a8a-43db-b424-7df354a84a33 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:30:07.760640 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3a90f7a0-9a8a-43db-b424-7df354a84a33 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: d43b200a-d978-4ee2-a790-79639beb3173] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:30:07.768030 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3a90f7a0-9a8a-43db-b424-7df354a84a33 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:07.768807 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3a90f7a0-9a8a-43db-b424-7df354a84a33 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:07.769833 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3a90f7a0-9a8a-43db-b424-7df354a84a33 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:07.770353 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3a90f7a0-9a8a-43db-b424-7df354a84a33 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:07.784992 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-3a90f7a0-9a8a-43db-b424-7df354a84a33 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] HTTP exception thrown: Instance d43b200a-d978-4ee2-a790-79639beb3173 could not be found. Apr 16 21:30:07.785756 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3a90f7a0-9a8a-43db-b424-7df354a84a33 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Returning 404 to user: Instance d43b200a-d978-4ee2-a790-79639beb3173 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:30:07.786736 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3a90f7a0-9a8a-43db-b424-7df354a84a33 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173" status: 404 len: 111 microversion: 2.1 time: 0.031589 Apr 16 21:30:07.787417 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2737/5621] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:30:07 2022] GET /compute/v2.1/servers/d43b200a-d978-4ee2-a790-79639beb3173 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:30:07.795589 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-24b86948-979e-44a2-865d-b4682e86b177 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:30:07.796338 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-24b86948-979e-44a2-865d-b4682e86b177 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: 5239bc09-9070-4897-8d6f-8084c2bab0b4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:30:07.804875 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-24b86948-979e-44a2-865d-b4682e86b177 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:07.805437 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-24b86948-979e-44a2-865d-b4682e86b177 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:07.807487 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-24b86948-979e-44a2-865d-b4682e86b177 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:07.807952 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-24b86948-979e-44a2-865d-b4682e86b177 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:07.843592 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-24b86948-979e-44a2-865d-b4682e86b177 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: 5239bc09-9070-4897-8d6f-8084c2bab0b4] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:30:08.238326 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-24b86948-979e-44a2-865d-b4682e86b177 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4" status: 204 len: 0 microversion: 2.1 time: 0.446324 Apr 16 21:30:08.239242 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2885/5622] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:30:07 2022] DELETE /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 16 21:30:08.247409 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-908bf49e-2f2e-48e4-9b6e-991477e3b3c8 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:30:08.248384 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-908bf49e-2f2e-48e4-9b6e-991477e3b3c8 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: 5239bc09-9070-4897-8d6f-8084c2bab0b4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:30:08.258681 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-908bf49e-2f2e-48e4-9b6e-991477e3b3c8 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:08.259255 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-908bf49e-2f2e-48e4-9b6e-991477e3b3c8 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:08.262274 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-908bf49e-2f2e-48e4-9b6e-991477e3b3c8 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:08.262844 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-908bf49e-2f2e-48e4-9b6e-991477e3b3c8 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:08.914354 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-908bf49e-2f2e-48e4-9b6e-991477e3b3c8 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:30:08.923307 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-908bf49e-2f2e-48e4-9b6e-991477e3b3c8 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4" status: 200 len: 1491 microversion: 2.1 time: 0.679434 Apr 16 21:30:08.923928 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2738/5623] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:30:08 2022] GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4 => generated 1491 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:30:09.941695 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-572ddd87-261f-4725-9664-9dd510a45ce7 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:30:09.943415 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-572ddd87-261f-4725-9664-9dd510a45ce7 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: 5239bc09-9070-4897-8d6f-8084c2bab0b4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:30:09.955652 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-572ddd87-261f-4725-9664-9dd510a45ce7 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:09.956325 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-572ddd87-261f-4725-9664-9dd510a45ce7 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:09.957779 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-572ddd87-261f-4725-9664-9dd510a45ce7 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:09.957888 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-572ddd87-261f-4725-9664-9dd510a45ce7 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:11.182750 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-572ddd87-261f-4725-9664-9dd510a45ce7 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:30:11.195210 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-572ddd87-261f-4725-9664-9dd510a45ce7 tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4" status: 200 len: 1491 microversion: 2.1 time: 1.257159 Apr 16 21:30:11.212583 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2886/5624] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:30:09 2022] GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4 => generated 1491 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:30:11.223389 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-23f96a5d-6bea-4b77-9510-1f67c9fd9ada req-c1359a89-31f5-4ca4-93bd-de1bf6fe98bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5239bc09-9070-4897-8d6f-8084c2bab0b4", "name": "network-vif-deleted", "tag": "f4d24ed3-2cac-4fe0-a31e-b2a60c5d5e0f"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:30:11.238598 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-23f96a5d-6bea-4b77-9510-1f67c9fd9ada req-c1359a89-31f5-4ca4-93bd-de1bf6fe98bb service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:11.244346 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-23f96a5d-6bea-4b77-9510-1f67c9fd9ada req-c1359a89-31f5-4ca4-93bd-de1bf6fe98bb service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:11.270458 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-23f96a5d-6bea-4b77-9510-1f67c9fd9ada req-c1359a89-31f5-4ca4-93bd-de1bf6fe98bb service nova] Creating event network-vif-deleted:f4d24ed3-2cac-4fe0-a31e-b2a60c5d5e0f for instance 5239bc09-9070-4897-8d6f-8084c2bab0b4 on nch1-master-1 Apr 16 21:30:11.289250 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-23f96a5d-6bea-4b77-9510-1f67c9fd9ada req-c1359a89-31f5-4ca4-93bd-de1bf6fe98bb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065795 Apr 16 21:30:11.292245 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2739/5625] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:30:12.222982 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5d68b0d6-1e09-4b1d-9437-c4c1bceda00e tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:30:12.224141 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5d68b0d6-1e09-4b1d-9437-c4c1bceda00e tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: 5239bc09-9070-4897-8d6f-8084c2bab0b4] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:30:12.232090 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5d68b0d6-1e09-4b1d-9437-c4c1bceda00e tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:12.232761 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5d68b0d6-1e09-4b1d-9437-c4c1bceda00e tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:12.233706 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5d68b0d6-1e09-4b1d-9437-c4c1bceda00e tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:12.234296 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5d68b0d6-1e09-4b1d-9437-c4c1bceda00e tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:12.271652 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5d68b0d6-1e09-4b1d-9437-c4c1bceda00e tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:12.272402 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5d68b0d6-1e09-4b1d-9437-c4c1bceda00e tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:12.273010 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-5d68b0d6-1e09-4b1d-9437-c4c1bceda00e tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lazy-loading 'fault' on Instance uuid 5239bc09-9070-4897-8d6f-8084c2bab0b4 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:30:12.320968 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5d68b0d6-1e09-4b1d-9437-c4c1bceda00e tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f757f2aee71d4c3594cb45e10f3b9957', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52fd97392841411abbd1f748dff97f10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:30:12.330165 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5d68b0d6-1e09-4b1d-9437-c4c1bceda00e tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4" status: 200 len: 1303 microversion: 2.1 time: 0.110973 Apr 16 21:30:12.330814 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2887/5626] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:30:12 2022] GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4 => generated 1303 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:30:13.347635 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a2fdefb1-2366-4570-95df-8dbe4d3fcf2b tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:30:13.349206 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a2fdefb1-2366-4570-95df-8dbe4d3fcf2b tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] [instance: 5239bc09-9070-4897-8d6f-8084c2bab0b4] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:30:13.360501 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a2fdefb1-2366-4570-95df-8dbe4d3fcf2b tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:13.361195 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a2fdefb1-2366-4570-95df-8dbe4d3fcf2b tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:13.362283 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a2fdefb1-2366-4570-95df-8dbe4d3fcf2b tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:13.362878 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a2fdefb1-2366-4570-95df-8dbe4d3fcf2b tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:13.389321 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-a2fdefb1-2366-4570-95df-8dbe4d3fcf2b tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] HTTP exception thrown: Instance 5239bc09-9070-4897-8d6f-8084c2bab0b4 could not be found. Apr 16 21:30:13.389931 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a2fdefb1-2366-4570-95df-8dbe4d3fcf2b tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] Returning 404 to user: Instance 5239bc09-9070-4897-8d6f-8084c2bab0b4 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:30:13.390779 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a2fdefb1-2366-4570-95df-8dbe4d3fcf2b tempest-ServerRescueTestJSON-42460406 tempest-ServerRescueTestJSON-42460406-project] 10.222.0.20 "GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4" status: 404 len: 111 microversion: 2.1 time: 0.047491 Apr 16 21:30:13.391955 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2740/5627] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:30:13 2022] GET /compute/v2.1/servers/5239bc09-9070-4897-8d6f-8084c2bab0b4 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:30:15.409109 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-353adc73-7ea1-43a5-88b7-0567491d5ac3 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:30:15.411424 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-353adc73-7ea1-43a5-88b7-0567491d5ac3 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: eceddfa9-ecee-4523-825a-33cf91766dad] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:30:15.436146 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-353adc73-7ea1-43a5-88b7-0567491d5ac3 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:15.439076 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-353adc73-7ea1-43a5-88b7-0567491d5ac3 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:15.441542 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-353adc73-7ea1-43a5-88b7-0567491d5ac3 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:15.444486 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-353adc73-7ea1-43a5-88b7-0567491d5ac3 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:15.490367 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-353adc73-7ea1-43a5-88b7-0567491d5ac3 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad/ips" status: 200 len: 151 microversion: 2.1 time: 0.090459 Apr 16 21:30:15.491593 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2888/5628] 10.222.0.20 () {58 vars in 1247 bytes} [Sat Apr 16 21:30:15 2022] GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad/ips => generated 151 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:30:18.635675 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f96c710f-73c6-4acc-ad91-ad4e148cd312 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d395e17-7dd9-4d66-a088-40c6e23eeb95"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:30:18.637314 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f96c710f-73c6-4acc-ad91-ad4e148cd312 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: eceddfa9-ecee-4523-825a-33cf91766dad] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:30:18.651403 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f96c710f-73c6-4acc-ad91-ad4e148cd312 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:18.651403 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f96c710f-73c6-4acc-ad91-ad4e148cd312 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:18.653056 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f96c710f-73c6-4acc-ad91-ad4e148cd312 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:18.654469 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f96c710f-73c6-4acc-ad91-ad4e148cd312 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:19.674530 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f96c710f-73c6-4acc-ad91-ad4e148cd312 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "POST /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.037678 Apr 16 21:30:19.674530 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2741/5629] 10.222.0.20 () {60 vars in 1322 bytes} [Sat Apr 16 21:30:18 2022] POST /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad/os-volume_attachments => generated 194 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:30:24.515388 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-385eb934-c412-45c0-bb61-f131e14073ca tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:30:24.517201 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-385eb934-c412-45c0-bb61-f131e14073ca tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: eceddfa9-ecee-4523-825a-33cf91766dad] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:30:24.535232 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-385eb934-c412-45c0-bb61-f131e14073ca tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:24.535709 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-385eb934-c412-45c0-bb61-f131e14073ca tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:24.536552 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-385eb934-c412-45c0-bb61-f131e14073ca tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:24.537007 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-385eb934-c412-45c0-bb61-f131e14073ca tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:24.762585 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-385eb934-c412-45c0-bb61-f131e14073ca tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lazy-loading 'services' on Instance uuid eceddfa9-ecee-4523-825a-33cf91766dad {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:30:25.161239 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-385eb934-c412-45c0-bb61-f131e14073ca tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "DELETE /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad/os-volume_attachments/3d395e17-7dd9-4d66-a088-40c6e23eeb95" status: 202 len: 0 microversion: 2.1 time: 0.649174 Apr 16 21:30:25.162591 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2889/5630] 10.222.0.20 () {58 vars in 1415 bytes} [Sat Apr 16 21:30:24 2022] DELETE /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad/os-volume_attachments/3d395e17-7dd9-4d66-a088-40c6e23eeb95 => generated 0 bytes in 653 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 16 21:30:25.182326 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4f666559-a2c6-402b-af15-026d25ee6264 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:30:25.186914 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4f666559-a2c6-402b-af15-026d25ee6264 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: eceddfa9-ecee-4523-825a-33cf91766dad] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:30:25.206325 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4f666559-a2c6-402b-af15-026d25ee6264 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:25.210674 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4f666559-a2c6-402b-af15-026d25ee6264 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:25.211475 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4f666559-a2c6-402b-af15-026d25ee6264 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:25.212670 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4f666559-a2c6-402b-af15-026d25ee6264 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:25.282675 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4f666559-a2c6-402b-af15-026d25ee6264 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113993 Apr 16 21:30:25.283897 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2742/5631] 10.222.0.20 () {58 vars in 1301 bytes} [Sat Apr 16 21:30:25 2022] GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:30:26.298143 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d8a413c0-151c-4bdf-9d1e-e0541c2b4ee2 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:30:26.300702 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d8a413c0-151c-4bdf-9d1e-e0541c2b4ee2 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: eceddfa9-ecee-4523-825a-33cf91766dad] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:30:26.331795 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d8a413c0-151c-4bdf-9d1e-e0541c2b4ee2 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:26.332311 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d8a413c0-151c-4bdf-9d1e-e0541c2b4ee2 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:26.333165 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d8a413c0-151c-4bdf-9d1e-e0541c2b4ee2 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:26.335705 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d8a413c0-151c-4bdf-9d1e-e0541c2b4ee2 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:26.401950 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d8a413c0-151c-4bdf-9d1e-e0541c2b4ee2 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110835 Apr 16 21:30:26.402858 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2890/5632] 10.222.0.20 () {58 vars in 1301 bytes} [Sat Apr 16 21:30:26 2022] GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:30:27.414223 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e73967fc-6a54-404f-8a88-d59077e0e9e9 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:30:27.417532 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e73967fc-6a54-404f-8a88-d59077e0e9e9 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: eceddfa9-ecee-4523-825a-33cf91766dad] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:30:27.436055 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e73967fc-6a54-404f-8a88-d59077e0e9e9 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:27.436561 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e73967fc-6a54-404f-8a88-d59077e0e9e9 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:27.437379 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e73967fc-6a54-404f-8a88-d59077e0e9e9 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:27.438358 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e73967fc-6a54-404f-8a88-d59077e0e9e9 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:27.513504 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e73967fc-6a54-404f-8a88-d59077e0e9e9 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.101925 Apr 16 21:30:27.521345 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2743/5633] 10.222.0.20 () {58 vars in 1301 bytes} [Sat Apr 16 21:30:27 2022] GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad/os-volume_attachments => generated 25 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:30:27.615351 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7533d62b-ba2f-400b-9028-df5afadc42b1 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:30:27.616589 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7533d62b-ba2f-400b-9028-df5afadc42b1 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: eceddfa9-ecee-4523-825a-33cf91766dad] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:30:27.626938 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7533d62b-ba2f-400b-9028-df5afadc42b1 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:27.627670 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7533d62b-ba2f-400b-9028-df5afadc42b1 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:27.628525 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7533d62b-ba2f-400b-9028-df5afadc42b1 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:27.628970 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7533d62b-ba2f-400b-9028-df5afadc42b1 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:27.678828 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7533d62b-ba2f-400b-9028-df5afadc42b1 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: eceddfa9-ecee-4523-825a-33cf91766dad] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:30:28.198200 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7533d62b-ba2f-400b-9028-df5afadc42b1 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "DELETE /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad" status: 204 len: 0 microversion: 2.1 time: 0.587581 Apr 16 21:30:28.198813 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2891/5634] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:30:27 2022] DELETE /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad => generated 0 bytes in 589 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:30:28.218154 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-68947315-fda3-4e96-8ed4-111292091e89 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:30:28.218906 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-68947315-fda3-4e96-8ed4-111292091e89 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: eceddfa9-ecee-4523-825a-33cf91766dad] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:30:28.236627 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-68947315-fda3-4e96-8ed4-111292091e89 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:28.240330 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-68947315-fda3-4e96-8ed4-111292091e89 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:28.243553 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-68947315-fda3-4e96-8ed4-111292091e89 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:28.246342 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-68947315-fda3-4e96-8ed4-111292091e89 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:28.727516 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-68947315-fda3-4e96-8ed4-111292091e89 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:30:28.736489 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-68947315-fda3-4e96-8ed4-111292091e89 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad" status: 200 len: 1683 microversion: 2.1 time: 0.532748 Apr 16 21:30:28.741080 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2744/5635] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:30:28 2022] GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad => generated 1683 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:30:29.761529 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f3d2bfb8-b05f-4bd7-9622-e47a8ded7d8a tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:30:29.763278 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f3d2bfb8-b05f-4bd7-9622-e47a8ded7d8a tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: eceddfa9-ecee-4523-825a-33cf91766dad] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:30:29.771989 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f3d2bfb8-b05f-4bd7-9622-e47a8ded7d8a tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:29.772554 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f3d2bfb8-b05f-4bd7-9622-e47a8ded7d8a tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:29.781038 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f3d2bfb8-b05f-4bd7-9622-e47a8ded7d8a tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:29.781038 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f3d2bfb8-b05f-4bd7-9622-e47a8ded7d8a tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:30.018350 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f3d2bfb8-b05f-4bd7-9622-e47a8ded7d8a tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:30:30.027107 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f3d2bfb8-b05f-4bd7-9622-e47a8ded7d8a tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad" status: 200 len: 1683 microversion: 2.1 time: 0.272195 Apr 16 21:30:30.038814 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2892/5636] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:30:29 2022] GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad => generated 1683 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:30:31.045131 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0df0145c-2f30-4681-9de1-c9e243df5f2c tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:30:31.045915 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0df0145c-2f30-4681-9de1-c9e243df5f2c tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: eceddfa9-ecee-4523-825a-33cf91766dad] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:30:31.065717 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0df0145c-2f30-4681-9de1-c9e243df5f2c tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:31.065717 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0df0145c-2f30-4681-9de1-c9e243df5f2c tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:31.065717 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0df0145c-2f30-4681-9de1-c9e243df5f2c tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:31.065717 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0df0145c-2f30-4681-9de1-c9e243df5f2c tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:31.438217 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0df0145c-2f30-4681-9de1-c9e243df5f2c tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:30:31.438217 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0df0145c-2f30-4681-9de1-c9e243df5f2c tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad" status: 200 len: 1683 microversion: 2.1 time: 0.380935 Apr 16 21:30:31.439810 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2745/5637] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:30:31 2022] GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad => generated 1683 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:30:32.444505 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-58d289b0-6b33-4832-8d9c-3f0475c326d3 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:30:32.445875 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-58d289b0-6b33-4832-8d9c-3f0475c326d3 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: eceddfa9-ecee-4523-825a-33cf91766dad] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:30:32.464751 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58d289b0-6b33-4832-8d9c-3f0475c326d3 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:32.466123 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58d289b0-6b33-4832-8d9c-3f0475c326d3 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:32.467734 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58d289b0-6b33-4832-8d9c-3f0475c326d3 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:32.472312 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58d289b0-6b33-4832-8d9c-3f0475c326d3 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:32.685966 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-58d289b0-6b33-4832-8d9c-3f0475c326d3 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:30:32.697345 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-58d289b0-6b33-4832-8d9c-3f0475c326d3 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad" status: 200 len: 1615 microversion: 2.1 time: 0.258432 Apr 16 21:30:32.707807 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2893/5638] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:30:32 2022] GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad => generated 1615 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:30:33.240772 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-3b071401-45de-46ab-a0ac-f93b7e40c8d6 req-0feaccd9-6962-4b69-af9e-a47bcecadcac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eceddfa9-ecee-4523-825a-33cf91766dad", "name": "network-vif-deleted", "tag": "037fa6e8-a27a-4e66-a818-2f415b14f622"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:30:33.254156 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-3b071401-45de-46ab-a0ac-f93b7e40c8d6 req-0feaccd9-6962-4b69-af9e-a47bcecadcac service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:33.254600 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-3b071401-45de-46ab-a0ac-f93b7e40c8d6 req-0feaccd9-6962-4b69-af9e-a47bcecadcac service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:33.314726 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-3b071401-45de-46ab-a0ac-f93b7e40c8d6 req-0feaccd9-6962-4b69-af9e-a47bcecadcac service nova] Creating event network-vif-deleted:037fa6e8-a27a-4e66-a818-2f415b14f622 for instance eceddfa9-ecee-4523-825a-33cf91766dad on nch2-master-1 Apr 16 21:30:33.321333 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-3b071401-45de-46ab-a0ac-f93b7e40c8d6 req-0feaccd9-6962-4b69-af9e-a47bcecadcac service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084063 Apr 16 21:30:33.323604 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2746/5639] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:30:33.714873 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ba53cedb-514d-41f6-862c-91fe42352e4f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:30:33.723470 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ba53cedb-514d-41f6-862c-91fe42352e4f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: eceddfa9-ecee-4523-825a-33cf91766dad] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:30:33.748374 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ba53cedb-514d-41f6-862c-91fe42352e4f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:33.748868 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ba53cedb-514d-41f6-862c-91fe42352e4f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:33.749696 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ba53cedb-514d-41f6-862c-91fe42352e4f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:33.756060 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ba53cedb-514d-41f6-862c-91fe42352e4f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:33.858819 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ba53cedb-514d-41f6-862c-91fe42352e4f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:33.859296 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ba53cedb-514d-41f6-862c-91fe42352e4f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:33.863329 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-ba53cedb-514d-41f6-862c-91fe42352e4f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lazy-loading 'fault' on Instance uuid eceddfa9-ecee-4523-825a-33cf91766dad {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:30:34.281859 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ba53cedb-514d-41f6-862c-91fe42352e4f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37443a4e933a4873bb039b06efaec98f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6f8dfa11e9b410cbbd59ffe32afeb26', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:30:34.295380 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ba53cedb-514d-41f6-862c-91fe42352e4f tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad" status: 200 len: 1331 microversion: 2.1 time: 0.584147 Apr 16 21:30:34.306875 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2894/5640] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:30:33 2022] GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad => generated 1331 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:30:35.317196 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-894a4779-c7ab-4023-b2d8-13c7ba9c46a4 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:30:35.318470 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-894a4779-c7ab-4023-b2d8-13c7ba9c46a4 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: eceddfa9-ecee-4523-825a-33cf91766dad] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:30:35.327268 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-894a4779-c7ab-4023-b2d8-13c7ba9c46a4 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:35.329643 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-894a4779-c7ab-4023-b2d8-13c7ba9c46a4 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:35.330641 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-894a4779-c7ab-4023-b2d8-13c7ba9c46a4 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:35.331260 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-894a4779-c7ab-4023-b2d8-13c7ba9c46a4 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:35.372270 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-894a4779-c7ab-4023-b2d8-13c7ba9c46a4 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] HTTP exception thrown: Instance eceddfa9-ecee-4523-825a-33cf91766dad could not be found. Apr 16 21:30:35.373103 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-894a4779-c7ab-4023-b2d8-13c7ba9c46a4 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Returning 404 to user: Instance eceddfa9-ecee-4523-825a-33cf91766dad could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:30:35.374365 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-894a4779-c7ab-4023-b2d8-13c7ba9c46a4 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad" status: 404 len: 111 microversion: 2.1 time: 0.063009 Apr 16 21:30:35.377864 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2747/5641] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:30:35 2022] GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:30:35.387429 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1a1a17d2-985b-48ad-8fda-0777f3bcda67 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '.version_select at 0x7fbb95934550>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:30:35.468222 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1a1a17d2-985b-48ad-8fda-0777f3bcda67 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-446245177" status: 202 len: 0 microversion: 2.1 time: 0.086060 Apr 16 21:30:35.473420 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2895/5642] 10.222.0.20 () {58 vars in 1217 bytes} [Sat Apr 16 21:30:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-446245177 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:30:38.587910 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-949efb15-84d3-43d8-bef4-6c7c8e897d75 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Action: 'create', calling method: .version_select at 0x7fbb954c7430>, body: {"keypair": {"name": "tempest-keypair-441865800"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:30:38.622421 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-949efb15-84d3-43d8-bef4-6c7c8e897d75 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Getting quotas for project 7d3a8f4590014b8d9738bd3739f08c0c. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:30:38.630692 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-949efb15-84d3-43d8-bef4-6c7c8e897d75 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Getting quotas for user e007558161974720bb11a4e7588af0c8 and project 7d3a8f4590014b8d9738bd3739f08c0c. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:30:38.984868 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-949efb15-84d3-43d8-bef4-6c7c8e897d75 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Getting quotas for project 7d3a8f4590014b8d9738bd3739f08c0c. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:30:38.996116 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-949efb15-84d3-43d8-bef4-6c7c8e897d75 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Getting quotas for user e007558161974720bb11a4e7588af0c8 and project 7d3a8f4590014b8d9738bd3739f08c0c. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:30:39.029059 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-949efb15-84d3-43d8-bef4-6c7c8e897d75 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.580160 Apr 16 21:30:39.030454 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2748/5643] 10.222.0.20 () {62 vars in 1198 bytes} [Sat Apr 16 21:30:38 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 583 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 16 21:30:45.403150 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ab085757-fa20-43d0-a070-4b23d7d6e129 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1670502796", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "33417375-20a3-4356-abb1-47c6dcf1fa40"}], "security_groups": [{"name": "tempest-securitygroup--699765248"}], "key_name": "tempest-keypair-441865800", "user_data": "}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:30:45.616087 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-ab085757-fa20-43d0-a070-4b23d7d6e129 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] validate_networks() for [('33417375-20a3-4356-abb1-47c6dcf1fa40', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:30:46.500226 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-ab085757-fa20-43d0-a070-4b23d7d6e129 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:30:46.505827 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-ab085757-fa20-43d0-a070-4b23d7d6e129 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:30:46.505827 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-ab085757-fa20-43d0-a070-4b23d7d6e129 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:30:46.505827 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-ab085757-fa20-43d0-a070-4b23d7d6e129 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:30:46.505827 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-ab085757-fa20-43d0-a070-4b23d7d6e129 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:30:46.520010 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ab085757-fa20-43d0-a070-4b23d7d6e129 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:46.521741 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ab085757-fa20-43d0-a070-4b23d7d6e129 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:46.526656 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ab085757-fa20-43d0-a070-4b23d7d6e129 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:46.526656 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ab085757-fa20-43d0-a070-4b23d7d6e129 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:46.558427 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-ab085757-fa20-43d0-a070-4b23d7d6e129 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Getting quotas for project 7d3a8f4590014b8d9738bd3739f08c0c. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:30:46.567957 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-ab085757-fa20-43d0-a070-4b23d7d6e129 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Getting quotas for user e007558161974720bb11a4e7588af0c8 and project 7d3a8f4590014b8d9738bd3739f08c0c. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:30:46.586797 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ab085757-fa20-43d0-a070-4b23d7d6e129 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:30:46.589150 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ab085757-fa20-43d0-a070-4b23d7d6e129 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:30:46.811879 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ab085757-fa20-43d0-a070-4b23d7d6e129 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.416107 Apr 16 21:30:46.814071 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2896/5644] 10.222.0.20 () {62 vars in 1187 bytes} [Sat Apr 16 21:30:45 2022] POST /compute/v2.1/servers => generated 401 bytes in 1420 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 16 21:30:46.824897 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e836f34a-f85a-42c6-bcec-ce5d38510a35 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:30:46.825520 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e836f34a-f85a-42c6-bcec-ce5d38510a35 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:30:47.000803 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e836f34a-f85a-42c6-bcec-ce5d38510a35 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:30:47.009527 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e836f34a-f85a-42c6-bcec-ce5d38510a35 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:30:47.012078 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e836f34a-f85a-42c6-bcec-ce5d38510a35 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:30:47.013445 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e836f34a-f85a-42c6-bcec-ce5d38510a35 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1281 microversion: 2.20 time: 0.193448 Apr 16 21:30:47.026698 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2749/5645] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:30:46 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1281 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:30:47.967030 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-46cf25ae-5593-40e5-8403-90d6bf2d0acb tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:30:47.967553 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-46cf25ae-5593-40e5-8403-90d6bf2d0acb tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: eceddfa9-ecee-4523-825a-33cf91766dad] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:30:47.975568 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-46cf25ae-5593-40e5-8403-90d6bf2d0acb tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:47.976031 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-46cf25ae-5593-40e5-8403-90d6bf2d0acb tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:47.976849 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-46cf25ae-5593-40e5-8403-90d6bf2d0acb tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:47.977610 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-46cf25ae-5593-40e5-8403-90d6bf2d0acb tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:47.996002 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-46cf25ae-5593-40e5-8403-90d6bf2d0acb tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] HTTP exception thrown: Instance eceddfa9-ecee-4523-825a-33cf91766dad could not be found. Apr 16 21:30:47.996653 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-46cf25ae-5593-40e5-8403-90d6bf2d0acb tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Returning 404 to user: Instance eceddfa9-ecee-4523-825a-33cf91766dad could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:30:47.997507 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-46cf25ae-5593-40e5-8403-90d6bf2d0acb tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "DELETE /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad" status: 404 len: 111 microversion: 2.1 time: 0.034635 Apr 16 21:30:47.998069 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2897/5646] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:30:47 2022] DELETE /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:30:48.007487 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a28ad0fe-9d75-47ca-9d39-06e585628ec7 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:30:48.008660 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a28ad0fe-9d75-47ca-9d39-06e585628ec7 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: eceddfa9-ecee-4523-825a-33cf91766dad] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:30:48.022690 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a28ad0fe-9d75-47ca-9d39-06e585628ec7 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:48.023159 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a28ad0fe-9d75-47ca-9d39-06e585628ec7 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:48.024237 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a28ad0fe-9d75-47ca-9d39-06e585628ec7 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:48.024789 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a28ad0fe-9d75-47ca-9d39-06e585628ec7 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:48.037969 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-37cd81e0-f92b-4163-9a9c-72b0bd573622 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:30:48.041365 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-37cd81e0-f92b-4163-9a9c-72b0bd573622 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:30:48.043894 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-a28ad0fe-9d75-47ca-9d39-06e585628ec7 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] HTTP exception thrown: Instance eceddfa9-ecee-4523-825a-33cf91766dad could not be found. Apr 16 21:30:48.044717 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a28ad0fe-9d75-47ca-9d39-06e585628ec7 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Returning 404 to user: Instance eceddfa9-ecee-4523-825a-33cf91766dad could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:30:48.045668 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a28ad0fe-9d75-47ca-9d39-06e585628ec7 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad" status: 404 len: 111 microversion: 2.1 time: 0.042818 Apr 16 21:30:48.051657 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2750/5647] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:30:48 2022] GET /compute/v2.1/servers/eceddfa9-ecee-4523-825a-33cf91766dad => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:30:48.169203 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-37cd81e0-f92b-4163-9a9c-72b0bd573622 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:30:48.177130 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-37cd81e0-f92b-4163-9a9c-72b0bd573622 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:30:48.179195 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-37cd81e0-f92b-4163-9a9c-72b0bd573622 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:30:48.180559 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-37cd81e0-f92b-4163-9a9c-72b0bd573622 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1281 microversion: 2.20 time: 0.151372 Apr 16 21:30:48.191283 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2898/5648] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:30:48 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1281 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:30:49.200399 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-955430a9-158d-441f-b036-19b459407b7a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:30:49.201042 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-955430a9-158d-441f-b036-19b459407b7a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:30:49.218273 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-955430a9-158d-441f-b036-19b459407b7a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:49.219338 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-955430a9-158d-441f-b036-19b459407b7a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:49.220231 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-955430a9-158d-441f-b036-19b459407b7a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:49.221090 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-955430a9-158d-441f-b036-19b459407b7a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:49.387687 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-955430a9-158d-441f-b036-19b459407b7a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:30:49.397924 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-955430a9-158d-441f-b036-19b459407b7a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:30:49.405124 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-955430a9-158d-441f-b036-19b459407b7a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:30:49.405124 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-955430a9-158d-441f-b036-19b459407b7a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1333 microversion: 2.20 time: 0.206730 Apr 16 21:30:49.405124 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2751/5649] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:30:49 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1333 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:30:50.421487 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-317ebcc6-f3ec-43e9-974a-29fe21910092 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:30:50.422152 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-317ebcc6-f3ec-43e9-974a-29fe21910092 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:30:50.430819 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-317ebcc6-f3ec-43e9-974a-29fe21910092 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:50.431275 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-317ebcc6-f3ec-43e9-974a-29fe21910092 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:50.432083 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-317ebcc6-f3ec-43e9-974a-29fe21910092 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:50.432723 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-317ebcc6-f3ec-43e9-974a-29fe21910092 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:50.548276 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-317ebcc6-f3ec-43e9-974a-29fe21910092 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:30:50.556883 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-317ebcc6-f3ec-43e9-974a-29fe21910092 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:30:50.562209 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-317ebcc6-f3ec-43e9-974a-29fe21910092 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:30:50.566451 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-317ebcc6-f3ec-43e9-974a-29fe21910092 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1339 microversion: 2.20 time: 0.148084 Apr 16 21:30:50.577730 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2899/5650] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:30:50 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1339 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:30:51.587529 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9d562b38-7204-42d0-85e3-9156821e7659 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:30:51.588807 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9d562b38-7204-42d0-85e3-9156821e7659 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:30:51.603972 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9d562b38-7204-42d0-85e3-9156821e7659 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:51.607389 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9d562b38-7204-42d0-85e3-9156821e7659 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:51.608616 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9d562b38-7204-42d0-85e3-9156821e7659 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:51.612257 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9d562b38-7204-42d0-85e3-9156821e7659 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:51.977659 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9d562b38-7204-42d0-85e3-9156821e7659 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:30:51.989424 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9d562b38-7204-42d0-85e3-9156821e7659 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:30:51.990946 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9d562b38-7204-42d0-85e3-9156821e7659 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:30:51.992077 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9d562b38-7204-42d0-85e3-9156821e7659 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1406 microversion: 2.20 time: 0.409560 Apr 16 21:30:52.013713 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2752/5651] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:30:51 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1406 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:30:53.032436 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d9fbb455-48e0-4b7a-970e-d336ccba58ad tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:30:53.033947 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d9fbb455-48e0-4b7a-970e-d336ccba58ad tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:30:53.054377 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d9fbb455-48e0-4b7a-970e-d336ccba58ad tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:53.055795 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d9fbb455-48e0-4b7a-970e-d336ccba58ad tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:53.057548 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d9fbb455-48e0-4b7a-970e-d336ccba58ad tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:53.058219 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d9fbb455-48e0-4b7a-970e-d336ccba58ad tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:53.396534 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d9fbb455-48e0-4b7a-970e-d336ccba58ad tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:30:53.407425 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d9fbb455-48e0-4b7a-970e-d336ccba58ad tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:30:53.410035 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d9fbb455-48e0-4b7a-970e-d336ccba58ad tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:30:53.412514 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d9fbb455-48e0-4b7a-970e-d336ccba58ad tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1406 microversion: 2.20 time: 0.383731 Apr 16 21:30:53.413635 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2900/5652] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:30:53 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1406 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:30:53.691600 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-a5b64569-9a55-4450-a810-c93824adef34 req-7af67cfe-eebf-433b-8a6a-809d8c024983 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b86e6830-cedb-4d55-a3b2-997462319b30", "tag": "b966fc7e-0221-46eb-a92a-00d9f48a8a41"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:30:53.709224 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-a5b64569-9a55-4450-a810-c93824adef34 req-7af67cfe-eebf-433b-8a6a-809d8c024983 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:53.710279 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-a5b64569-9a55-4450-a810-c93824adef34 req-7af67cfe-eebf-433b-8a6a-809d8c024983 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:53.733533 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-a5b64569-9a55-4450-a810-c93824adef34 req-7af67cfe-eebf-433b-8a6a-809d8c024983 service nova] Creating event network-changed:b966fc7e-0221-46eb-a92a-00d9f48a8a41 for instance b86e6830-cedb-4d55-a3b2-997462319b30 on nch2-master-1 Apr 16 21:30:53.743652 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-a5b64569-9a55-4450-a810-c93824adef34 req-7af67cfe-eebf-433b-8a6a-809d8c024983 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056173 Apr 16 21:30:53.744279 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2753/5653] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:30:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:30:54.431481 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4b88b39d-66c8-44c6-a45c-04942aa5e0c4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:30:54.432115 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4b88b39d-66c8-44c6-a45c-04942aa5e0c4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:30:54.446631 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4b88b39d-66c8-44c6-a45c-04942aa5e0c4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:54.447098 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4b88b39d-66c8-44c6-a45c-04942aa5e0c4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:54.447918 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4b88b39d-66c8-44c6-a45c-04942aa5e0c4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:54.448414 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4b88b39d-66c8-44c6-a45c-04942aa5e0c4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:54.878817 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4b88b39d-66c8-44c6-a45c-04942aa5e0c4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:30:54.891125 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4b88b39d-66c8-44c6-a45c-04942aa5e0c4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:30:54.896663 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4b88b39d-66c8-44c6-a45c-04942aa5e0c4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:30:54.904791 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4b88b39d-66c8-44c6-a45c-04942aa5e0c4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1406 microversion: 2.20 time: 0.472549 Apr 16 21:30:54.904990 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2901/5654] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:30:54 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1406 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:30:55.921090 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0f78718e-ca31-4cfc-b2f1-8a90b01d0f79 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:30:55.924108 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0f78718e-ca31-4cfc-b2f1-8a90b01d0f79 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:30:55.934166 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0f78718e-ca31-4cfc-b2f1-8a90b01d0f79 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:55.935931 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0f78718e-ca31-4cfc-b2f1-8a90b01d0f79 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:55.938253 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0f78718e-ca31-4cfc-b2f1-8a90b01d0f79 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:55.940257 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0f78718e-ca31-4cfc-b2f1-8a90b01d0f79 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:56.252520 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0f78718e-ca31-4cfc-b2f1-8a90b01d0f79 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:30:56.271445 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0f78718e-ca31-4cfc-b2f1-8a90b01d0f79 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:30:56.298661 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0f78718e-ca31-4cfc-b2f1-8a90b01d0f79 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:30:56.300097 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0f78718e-ca31-4cfc-b2f1-8a90b01d0f79 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1406 microversion: 2.20 time: 0.385013 Apr 16 21:30:56.302666 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2754/5655] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:30:55 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1406 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:30:57.321397 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e25ea089-a7e0-4fbe-b64a-2746a48bb1de tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:30:57.322725 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e25ea089-a7e0-4fbe-b64a-2746a48bb1de tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:30:57.339660 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e25ea089-a7e0-4fbe-b64a-2746a48bb1de tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:57.340420 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e25ea089-a7e0-4fbe-b64a-2746a48bb1de tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:57.341594 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e25ea089-a7e0-4fbe-b64a-2746a48bb1de tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:57.342197 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e25ea089-a7e0-4fbe-b64a-2746a48bb1de tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:57.440109 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-dd6fd0b1-c181-4c50-ab57-262427b4864b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Action: 'create', calling method: .version_select at 0x7fbb95656dc0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1932535405"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:30:57.516548 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-dd6fd0b1-c181-4c50-ab57-262427b4864b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Getting quotas for project 0ee2ef9a941a429b82a89f7c8f71d45b. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:30:57.536699 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-dd6fd0b1-c181-4c50-ab57-262427b4864b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Getting quotas for user f27a0cf693a247bb87a8c12193fee719 and project 0ee2ef9a941a429b82a89f7c8f71d45b. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:30:57.630478 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e25ea089-a7e0-4fbe-b64a-2746a48bb1de tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:30:57.642950 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e25ea089-a7e0-4fbe-b64a-2746a48bb1de tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:30:57.646560 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e25ea089-a7e0-4fbe-b64a-2746a48bb1de tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:30:57.649687 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e25ea089-a7e0-4fbe-b64a-2746a48bb1de tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1406 microversion: 2.20 time: 0.334122 Apr 16 21:30:57.652730 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2755/5656] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:30:57 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1406 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:30:57.940452 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-dd6fd0b1-c181-4c50-ab57-262427b4864b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Getting quotas for project 0ee2ef9a941a429b82a89f7c8f71d45b. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:30:57.948880 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-dd6fd0b1-c181-4c50-ab57-262427b4864b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Getting quotas for user f27a0cf693a247bb87a8c12193fee719 and project 0ee2ef9a941a429b82a89f7c8f71d45b. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:30:57.973942 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-dd6fd0b1-c181-4c50-ab57-262427b4864b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 1.007586 Apr 16 21:30:57.976154 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2902/5657] 10.222.0.20 () {60 vars in 1157 bytes} [Sat Apr 16 21:30:56 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:30:58.222645 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-50f3cd22-4a47-4596-bd7f-598606e5eb01 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:30:58.223495 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-50f3cd22-4a47-4596-bd7f-598606e5eb01 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 6eb61102-0483-413f-88b9-7519c852b7f6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:30:58.230739 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-50f3cd22-4a47-4596-bd7f-598606e5eb01 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:58.231787 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-50f3cd22-4a47-4596-bd7f-598606e5eb01 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:58.232985 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-50f3cd22-4a47-4596-bd7f-598606e5eb01 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:58.233671 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-50f3cd22-4a47-4596-bd7f-598606e5eb01 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:58.257048 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-50f3cd22-4a47-4596-bd7f-598606e5eb01 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] HTTP exception thrown: Instance 6eb61102-0483-413f-88b9-7519c852b7f6 could not be found. Apr 16 21:30:58.257990 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-50f3cd22-4a47-4596-bd7f-598606e5eb01 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Returning 404 to user: Instance 6eb61102-0483-413f-88b9-7519c852b7f6 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:30:58.259312 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-50f3cd22-4a47-4596-bd7f-598606e5eb01 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6" status: 404 len: 111 microversion: 2.1 time: 0.041744 Apr 16 21:30:58.260670 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2756/5658] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:30:58 2022] DELETE /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:30:58.270078 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b3fb025b-9303-4018-9e8d-ce05ee28b9f1 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:30:58.270718 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b3fb025b-9303-4018-9e8d-ce05ee28b9f1 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 6eb61102-0483-413f-88b9-7519c852b7f6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:30:58.288551 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b3fb025b-9303-4018-9e8d-ce05ee28b9f1 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:58.289258 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b3fb025b-9303-4018-9e8d-ce05ee28b9f1 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:58.292949 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b3fb025b-9303-4018-9e8d-ce05ee28b9f1 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:58.294162 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b3fb025b-9303-4018-9e8d-ce05ee28b9f1 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:58.324687 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-b3fb025b-9303-4018-9e8d-ce05ee28b9f1 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] HTTP exception thrown: Instance 6eb61102-0483-413f-88b9-7519c852b7f6 could not be found. Apr 16 21:30:58.325553 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b3fb025b-9303-4018-9e8d-ce05ee28b9f1 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Returning 404 to user: Instance 6eb61102-0483-413f-88b9-7519c852b7f6 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:30:58.334143 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b3fb025b-9303-4018-9e8d-ce05ee28b9f1 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6" status: 404 len: 111 microversion: 2.1 time: 0.062100 Apr 16 21:30:58.336733 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2903/5659] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:30:58 2022] GET /compute/v2.1/servers/6eb61102-0483-413f-88b9-7519c852b7f6 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:30:58.348348 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f156bcfd-7089-43e8-b563-069c59b95d6d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:30:58.349978 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f156bcfd-7089-43e8-b563-069c59b95d6d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 0c30b376-2903-4058-b436-4644778f3352] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:30:58.369196 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f156bcfd-7089-43e8-b563-069c59b95d6d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:58.371872 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f156bcfd-7089-43e8-b563-069c59b95d6d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:58.373700 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f156bcfd-7089-43e8-b563-069c59b95d6d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:58.374173 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f156bcfd-7089-43e8-b563-069c59b95d6d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:58.399442 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-f156bcfd-7089-43e8-b563-069c59b95d6d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] HTTP exception thrown: Instance 0c30b376-2903-4058-b436-4644778f3352 could not be found. Apr 16 21:30:58.400606 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f156bcfd-7089-43e8-b563-069c59b95d6d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Returning 404 to user: Instance 0c30b376-2903-4058-b436-4644778f3352 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:30:58.402102 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f156bcfd-7089-43e8-b563-069c59b95d6d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352" status: 404 len: 111 microversion: 2.1 time: 0.061565 Apr 16 21:30:58.403199 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2757/5660] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:30:58 2022] DELETE /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:30:58.413183 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5719541b-9946-4852-b81d-bc61c2291c45 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:30:58.413823 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5719541b-9946-4852-b81d-bc61c2291c45 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 0c30b376-2903-4058-b436-4644778f3352] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:30:58.420758 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5719541b-9946-4852-b81d-bc61c2291c45 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:58.421224 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5719541b-9946-4852-b81d-bc61c2291c45 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:58.423169 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5719541b-9946-4852-b81d-bc61c2291c45 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:58.423859 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5719541b-9946-4852-b81d-bc61c2291c45 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:58.440262 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-5719541b-9946-4852-b81d-bc61c2291c45 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] HTTP exception thrown: Instance 0c30b376-2903-4058-b436-4644778f3352 could not be found. Apr 16 21:30:58.441697 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5719541b-9946-4852-b81d-bc61c2291c45 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Returning 404 to user: Instance 0c30b376-2903-4058-b436-4644778f3352 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:30:58.442855 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5719541b-9946-4852-b81d-bc61c2291c45 tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352" status: 404 len: 111 microversion: 2.1 time: 0.034757 Apr 16 21:30:58.444164 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2904/5661] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:30:58 2022] GET /compute/v2.1/servers/0c30b376-2903-4058-b436-4644778f3352 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:30:58.677400 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f5f118a2-9b80-4596-8158-4a641d171180 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:30:58.678037 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f5f118a2-9b80-4596-8158-4a641d171180 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:30:58.694425 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f5f118a2-9b80-4596-8158-4a641d171180 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:58.694832 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f5f118a2-9b80-4596-8158-4a641d171180 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:58.695654 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f5f118a2-9b80-4596-8158-4a641d171180 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:30:58.698162 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f5f118a2-9b80-4596-8158-4a641d171180 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:30:59.131998 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f5f118a2-9b80-4596-8158-4a641d171180 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:30:59.145902 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f5f118a2-9b80-4596-8158-4a641d171180 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:30:59.147625 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f5f118a2-9b80-4596-8158-4a641d171180 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:30:59.151973 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f5f118a2-9b80-4596-8158-4a641d171180 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1406 microversion: 2.20 time: 0.479695 Apr 16 21:30:59.153202 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2758/5662] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:30:58 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1406 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:31:00.171308 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fa9c4ec4-0414-4dd6-9d85-894cbdb51d5a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:00.172639 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fa9c4ec4-0414-4dd6-9d85-894cbdb51d5a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:31:00.179788 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fa9c4ec4-0414-4dd6-9d85-894cbdb51d5a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:00.180501 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fa9c4ec4-0414-4dd6-9d85-894cbdb51d5a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:00.181475 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fa9c4ec4-0414-4dd6-9d85-894cbdb51d5a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:00.181927 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fa9c4ec4-0414-4dd6-9d85-894cbdb51d5a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:00.453354 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fa9c4ec4-0414-4dd6-9d85-894cbdb51d5a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:00.484561 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fa9c4ec4-0414-4dd6-9d85-894cbdb51d5a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:00.488981 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fa9c4ec4-0414-4dd6-9d85-894cbdb51d5a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:00.493009 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fa9c4ec4-0414-4dd6-9d85-894cbdb51d5a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1406 microversion: 2.20 time: 0.324830 Apr 16 21:31:00.500295 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2905/5663] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:31:00 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1406 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:31:01.520792 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-125c41ac-1678-4d08-86ef-f964c2a00028 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:01.520792 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-125c41ac-1678-4d08-86ef-f964c2a00028 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:31:01.530104 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-125c41ac-1678-4d08-86ef-f964c2a00028 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:01.530568 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-125c41ac-1678-4d08-86ef-f964c2a00028 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:01.531929 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-125c41ac-1678-4d08-86ef-f964c2a00028 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:01.532563 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-125c41ac-1678-4d08-86ef-f964c2a00028 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:01.801369 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-ffc285fc-fa5e-4db8-bf7f-308752c05435 req-9a5170af-58b9-4cb8-95bc-6da09115cf85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b86e6830-cedb-4d55-a3b2-997462319b30", "name": "network-vif-plugged", "status": "completed", "tag": "b966fc7e-0221-46eb-a92a-00d9f48a8a41"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:31:01.815644 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-ffc285fc-fa5e-4db8-bf7f-308752c05435 req-9a5170af-58b9-4cb8-95bc-6da09115cf85 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:01.817421 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-ffc285fc-fa5e-4db8-bf7f-308752c05435 req-9a5170af-58b9-4cb8-95bc-6da09115cf85 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:01.837673 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-ffc285fc-fa5e-4db8-bf7f-308752c05435 req-9a5170af-58b9-4cb8-95bc-6da09115cf85 service nova] Creating event network-vif-plugged:b966fc7e-0221-46eb-a92a-00d9f48a8a41 for instance b86e6830-cedb-4d55-a3b2-997462319b30 on nch2-master-1 Apr 16 21:31:01.845407 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-ffc285fc-fa5e-4db8-bf7f-308752c05435 req-9a5170af-58b9-4cb8-95bc-6da09115cf85 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048155 Apr 16 21:31:01.846579 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2906/5664] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:31:02.273631 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-125c41ac-1678-4d08-86ef-f964c2a00028 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:02.283900 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-125c41ac-1678-4d08-86ef-f964c2a00028 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:02.285481 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-125c41ac-1678-4d08-86ef-f964c2a00028 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:02.287084 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-125c41ac-1678-4d08-86ef-f964c2a00028 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1406 microversion: 2.20 time: 0.770751 Apr 16 21:31:02.287603 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2759/5665] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:31:01 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1406 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:31:03.308374 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5706bd73-acab-4895-9a69-fa212eef2058 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:03.309713 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5706bd73-acab-4895-9a69-fa212eef2058 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:31:03.323455 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5706bd73-acab-4895-9a69-fa212eef2058 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:03.326085 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5706bd73-acab-4895-9a69-fa212eef2058 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:03.327379 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5706bd73-acab-4895-9a69-fa212eef2058 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:03.328767 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5706bd73-acab-4895-9a69-fa212eef2058 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:03.744094 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5706bd73-acab-4895-9a69-fa212eef2058 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:03.754200 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5706bd73-acab-4895-9a69-fa212eef2058 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:03.755755 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5706bd73-acab-4895-9a69-fa212eef2058 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:03.756937 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5706bd73-acab-4895-9a69-fa212eef2058 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1406 microversion: 2.20 time: 0.454869 Apr 16 21:31:03.757511 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2907/5666] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:31:03 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1406 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:31:04.775574 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7301ddab-07e5-439a-bd77-858ea892cead tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:04.776327 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7301ddab-07e5-439a-bd77-858ea892cead tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:31:04.787558 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7301ddab-07e5-439a-bd77-858ea892cead tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:04.788018 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7301ddab-07e5-439a-bd77-858ea892cead tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:04.794918 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7301ddab-07e5-439a-bd77-858ea892cead tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:04.796325 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7301ddab-07e5-439a-bd77-858ea892cead tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:05.248563 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7301ddab-07e5-439a-bd77-858ea892cead tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:05.262197 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7301ddab-07e5-439a-bd77-858ea892cead tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:05.263971 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7301ddab-07e5-439a-bd77-858ea892cead tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:05.277744 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7301ddab-07e5-439a-bd77-858ea892cead tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1598 microversion: 2.20 time: 0.506618 Apr 16 21:31:05.289085 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2760/5667] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:31:04 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1598 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:31:05.298294 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5d63de7f-70cf-4b81-9cbb-827f8e4daada tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:05.298810 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5d63de7f-70cf-4b81-9cbb-827f8e4daada tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:31:05.308676 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5d63de7f-70cf-4b81-9cbb-827f8e4daada tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:05.309241 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5d63de7f-70cf-4b81-9cbb-827f8e4daada tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:05.309966 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5d63de7f-70cf-4b81-9cbb-827f8e4daada tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:05.310419 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5d63de7f-70cf-4b81-9cbb-827f8e4daada tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:05.476584 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5d63de7f-70cf-4b81-9cbb-827f8e4daada tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.181348 Apr 16 21:31:05.477392 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2908/5668] 10.222.0.20 () {60 vars in 1315 bytes} [Sat Apr 16 21:31:05 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30/os-interface => generated 284 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:31:08.492995 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0899d014-0b14-4bc1-a194-bc662b1ff71d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:08.493494 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0899d014-0b14-4bc1-a194-bc662b1ff71d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 8d623e8d-480f-48ef-b90c-04450df4aec8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:31:08.501131 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0899d014-0b14-4bc1-a194-bc662b1ff71d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:08.501589 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0899d014-0b14-4bc1-a194-bc662b1ff71d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:08.502374 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0899d014-0b14-4bc1-a194-bc662b1ff71d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:08.502811 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0899d014-0b14-4bc1-a194-bc662b1ff71d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:08.527024 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-0899d014-0b14-4bc1-a194-bc662b1ff71d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] HTTP exception thrown: Instance 8d623e8d-480f-48ef-b90c-04450df4aec8 could not be found. Apr 16 21:31:08.527636 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0899d014-0b14-4bc1-a194-bc662b1ff71d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Returning 404 to user: Instance 8d623e8d-480f-48ef-b90c-04450df4aec8 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:31:08.535815 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0899d014-0b14-4bc1-a194-bc662b1ff71d tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8" status: 404 len: 111 microversion: 2.1 time: 0.039516 Apr 16 21:31:08.537412 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2761/5669] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:31:08 2022] DELETE /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:31:08.553080 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c5c9be42-0174-495b-9549-e3e3fd635ead tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:08.553698 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c5c9be42-0174-495b-9549-e3e3fd635ead tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] [instance: 8d623e8d-480f-48ef-b90c-04450df4aec8] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:31:08.564822 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c5c9be42-0174-495b-9549-e3e3fd635ead tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:08.565372 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c5c9be42-0174-495b-9549-e3e3fd635ead tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:08.566083 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c5c9be42-0174-495b-9549-e3e3fd635ead tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:08.566843 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c5c9be42-0174-495b-9549-e3e3fd635ead tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:08.629055 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-c5c9be42-0174-495b-9549-e3e3fd635ead tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] HTTP exception thrown: Instance 8d623e8d-480f-48ef-b90c-04450df4aec8 could not be found. Apr 16 21:31:08.630631 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c5c9be42-0174-495b-9549-e3e3fd635ead tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] Returning 404 to user: Instance 8d623e8d-480f-48ef-b90c-04450df4aec8 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:31:08.631651 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c5c9be42-0174-495b-9549-e3e3fd635ead tempest-AttachVolumeNegativeTest-1739448039 tempest-AttachVolumeNegativeTest-1739448039-project] 10.222.0.20 "GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8" status: 404 len: 111 microversion: 2.1 time: 0.085290 Apr 16 21:31:08.632773 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2909/5670] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:31:08 2022] GET /compute/v2.1/servers/8d623e8d-480f-48ef-b90c-04450df4aec8 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:31:09.116784 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ffefc3c0-1bfb-4072-817f-be5bca3ae96f tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:31:09.118118 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ffefc3c0-1bfb-4072-817f-be5bca3ae96f tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:31:09.126950 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ffefc3c0-1bfb-4072-817f-be5bca3ae96f tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:09.127723 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ffefc3c0-1bfb-4072-817f-be5bca3ae96f tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:09.128548 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ffefc3c0-1bfb-4072-817f-be5bca3ae96f tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:09.129308 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ffefc3c0-1bfb-4072-817f-be5bca3ae96f tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:09.267510 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ffefc3c0-1bfb-4072-817f-be5bca3ae96f tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "POST /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462/action" status: 200 len: 32487 microversion: 2.42 time: 0.157035 Apr 16 21:31:09.268207 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2762/5671] 10.222.0.20 () {62 vars in 1318 bytes} [Sat Apr 16 21:31:09 2022] POST /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462/action => generated 32487 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:31:09.281553 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0a92f85b-e095-4ae2-8c7b-9b6b0c079982 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:09.282612 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0a92f85b-e095-4ae2-8c7b-9b6b0c079982 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:31:09.289156 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0a92f85b-e095-4ae2-8c7b-9b6b0c079982 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:09.289836 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0a92f85b-e095-4ae2-8c7b-9b6b0c079982 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:09.290850 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0a92f85b-e095-4ae2-8c7b-9b6b0c079982 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:09.291460 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0a92f85b-e095-4ae2-8c7b-9b6b0c079982 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:09.338521 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0a92f85b-e095-4ae2-8c7b-9b6b0c079982 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:31:09.918561 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0a92f85b-e095-4ae2-8c7b-9b6b0c079982 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "DELETE /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 204 len: 0 microversion: 2.42 time: 0.641497 Apr 16 21:31:09.919547 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2910/5672] 10.222.0.20 () {60 vars in 1279 bytes} [Sat Apr 16 21:31:09 2022] DELETE /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 16 21:31:09.944914 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ba164e48-0124-467e-8eab-e9d9e1ae4b2e tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:09.946321 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ba164e48-0124-467e-8eab-e9d9e1ae4b2e tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:31:09.978464 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ba164e48-0124-467e-8eab-e9d9e1ae4b2e tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:09.988299 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ba164e48-0124-467e-8eab-e9d9e1ae4b2e tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:09.991010 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ba164e48-0124-467e-8eab-e9d9e1ae4b2e tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:09.992534 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ba164e48-0124-467e-8eab-e9d9e1ae4b2e tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:11.017167 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-c2f83bf6-5bea-445a-9817-2fe1e3567b37 req-774a2cc7-5dbd-499a-8167-000f66fa4376 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b86e6830-cedb-4d55-a3b2-997462319b30", "tag": "b966fc7e-0221-46eb-a92a-00d9f48a8a41"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:31:11.032549 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-c2f83bf6-5bea-445a-9817-2fe1e3567b37 req-774a2cc7-5dbd-499a-8167-000f66fa4376 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:11.033370 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-c2f83bf6-5bea-445a-9817-2fe1e3567b37 req-774a2cc7-5dbd-499a-8167-000f66fa4376 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:11.047932 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-c2f83bf6-5bea-445a-9817-2fe1e3567b37 req-774a2cc7-5dbd-499a-8167-000f66fa4376 service nova] Creating event network-changed:b966fc7e-0221-46eb-a92a-00d9f48a8a41 for instance b86e6830-cedb-4d55-a3b2-997462319b30 on nch2-master-1 Apr 16 21:31:11.055250 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-c2f83bf6-5bea-445a-9817-2fe1e3567b37 req-774a2cc7-5dbd-499a-8167-000f66fa4376 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042162 Apr 16 21:31:11.057396 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2911/5673] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:31:11.133366 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ba164e48-0124-467e-8eab-e9d9e1ae4b2e tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:11.152051 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ba164e48-0124-467e-8eab-e9d9e1ae4b2e tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:11.156289 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ba164e48-0124-467e-8eab-e9d9e1ae4b2e tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:11.156289 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ba164e48-0124-467e-8eab-e9d9e1ae4b2e tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 2955 microversion: 2.42 time: 1.224124 Apr 16 21:31:11.156897 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2763/5674] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:31:09 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 2955 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:31:12.177131 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a592aac3-9047-4c56-8a5b-2225915924af tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:12.178675 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a592aac3-9047-4c56-8a5b-2225915924af tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:31:12.196052 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a592aac3-9047-4c56-8a5b-2225915924af tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:12.196979 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a592aac3-9047-4c56-8a5b-2225915924af tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:12.198004 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a592aac3-9047-4c56-8a5b-2225915924af tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:12.198666 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a592aac3-9047-4c56-8a5b-2225915924af tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:13.287883 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a592aac3-9047-4c56-8a5b-2225915924af tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:13.300378 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a592aac3-9047-4c56-8a5b-2225915924af tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:13.302002 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a592aac3-9047-4c56-8a5b-2225915924af tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:13.303602 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a592aac3-9047-4c56-8a5b-2225915924af tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 2955 microversion: 2.42 time: 1.130901 Apr 16 21:31:13.304310 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2912/5675] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:31:12 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 2955 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:31:14.326402 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7d25f5ee-88b5-4ba7-a5f7-2ecc1bc6057c tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:14.328279 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7d25f5ee-88b5-4ba7-a5f7-2ecc1bc6057c tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:31:14.345692 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7d25f5ee-88b5-4ba7-a5f7-2ecc1bc6057c tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:14.346430 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7d25f5ee-88b5-4ba7-a5f7-2ecc1bc6057c tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:14.347881 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7d25f5ee-88b5-4ba7-a5f7-2ecc1bc6057c tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:14.348531 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7d25f5ee-88b5-4ba7-a5f7-2ecc1bc6057c tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:14.695930 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-06191f28-f174-4c5a-8da6-d1a4ea5e2a86 req-4ec15c9b-f00f-438a-acc1-c4b261d097c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70e22cc6-e4af-4230-a480-bbbe6b60d462", "name": "network-vif-unplugged", "status": "completed", "tag": "c8475713-e26a-40c8-8213-0fa9fe87a721"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:31:14.708718 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-06191f28-f174-4c5a-8da6-d1a4ea5e2a86 req-4ec15c9b-f00f-438a-acc1-c4b261d097c2 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:14.709899 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-06191f28-f174-4c5a-8da6-d1a4ea5e2a86 req-4ec15c9b-f00f-438a-acc1-c4b261d097c2 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:14.724953 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-06191f28-f174-4c5a-8da6-d1a4ea5e2a86 req-4ec15c9b-f00f-438a-acc1-c4b261d097c2 service nova] Creating event network-vif-unplugged:c8475713-e26a-40c8-8213-0fa9fe87a721 for instance 70e22cc6-e4af-4230-a480-bbbe6b60d462 on nch1-master-1 Apr 16 21:31:14.732121 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-06191f28-f174-4c5a-8da6-d1a4ea5e2a86 req-4ec15c9b-f00f-438a-acc1-c4b261d097c2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040685 Apr 16 21:31:14.734753 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2913/5676] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:31:15.289438 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7d25f5ee-88b5-4ba7-a5f7-2ecc1bc6057c tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:15.310401 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7d25f5ee-88b5-4ba7-a5f7-2ecc1bc6057c tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:15.312605 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7d25f5ee-88b5-4ba7-a5f7-2ecc1bc6057c tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:15.326583 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7d25f5ee-88b5-4ba7-a5f7-2ecc1bc6057c tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 2955 microversion: 2.42 time: 0.993704 Apr 16 21:31:15.326583 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2764/5677] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:31:14 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 2955 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:31:16.354072 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4f49e8a2-5c49-4dae-af76-32b7b22fad97 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:16.356680 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4f49e8a2-5c49-4dae-af76-32b7b22fad97 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:31:16.379630 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4f49e8a2-5c49-4dae-af76-32b7b22fad97 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:16.380430 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4f49e8a2-5c49-4dae-af76-32b7b22fad97 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:16.381441 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4f49e8a2-5c49-4dae-af76-32b7b22fad97 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:16.382052 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4f49e8a2-5c49-4dae-af76-32b7b22fad97 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:16.840040 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4f49e8a2-5c49-4dae-af76-32b7b22fad97 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:16.855876 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4f49e8a2-5c49-4dae-af76-32b7b22fad97 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:16.861019 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4f49e8a2-5c49-4dae-af76-32b7b22fad97 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:16.863481 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4f49e8a2-5c49-4dae-af76-32b7b22fad97 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 2934 microversion: 2.42 time: 0.532462 Apr 16 21:31:16.876239 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2914/5678] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:31:16 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 2934 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:31:16.889013 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-2944902c-74ce-4894-b744-bccf694f0658 req-df0a5a78-6ab4-46b3-a750-27593c1b35f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70e22cc6-e4af-4230-a480-bbbe6b60d462", "name": "network-vif-unplugged", "status": "completed", "tag": "530c687e-6ccd-45ad-ad6e-7e4a0d9487ee"}, {"server_uuid": "70e22cc6-e4af-4230-a480-bbbe6b60d462", "name": "network-vif-unplugged", "status": "completed", "tag": "e161877a-3f6f-49a7-8aed-2eee986f2f68"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:31:16.899077 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-2944902c-74ce-4894-b744-bccf694f0658 req-df0a5a78-6ab4-46b3-a750-27593c1b35f1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:16.903183 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-2944902c-74ce-4894-b744-bccf694f0658 req-df0a5a78-6ab4-46b3-a750-27593c1b35f1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:16.929784 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-2944902c-74ce-4894-b744-bccf694f0658 req-df0a5a78-6ab4-46b3-a750-27593c1b35f1 service nova] Creating event network-vif-unplugged:530c687e-6ccd-45ad-ad6e-7e4a0d9487ee for instance 70e22cc6-e4af-4230-a480-bbbe6b60d462 on nch1-master-1 Apr 16 21:31:16.930306 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-2944902c-74ce-4894-b744-bccf694f0658 req-df0a5a78-6ab4-46b3-a750-27593c1b35f1 service nova] Creating event network-vif-unplugged:e161877a-3f6f-49a7-8aed-2eee986f2f68 for instance 70e22cc6-e4af-4230-a480-bbbe6b60d462 on nch1-master-1 Apr 16 21:31:16.949930 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-2944902c-74ce-4894-b744-bccf694f0658 req-df0a5a78-6ab4-46b3-a750-27593c1b35f1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.077063 Apr 16 21:31:16.965222 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2765/5679] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:31:17.898623 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-397f8411-f44a-4070-9e3e-2e225648e10f tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:17.899814 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-397f8411-f44a-4070-9e3e-2e225648e10f tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:31:17.913266 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-397f8411-f44a-4070-9e3e-2e225648e10f tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:17.921049 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-397f8411-f44a-4070-9e3e-2e225648e10f tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:17.922625 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-397f8411-f44a-4070-9e3e-2e225648e10f tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:17.923197 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-397f8411-f44a-4070-9e3e-2e225648e10f tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:18.487497 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-397f8411-f44a-4070-9e3e-2e225648e10f tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:18.518868 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-397f8411-f44a-4070-9e3e-2e225648e10f tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:18.521064 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-397f8411-f44a-4070-9e3e-2e225648e10f tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:18.535598 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-397f8411-f44a-4070-9e3e-2e225648e10f tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 2913 microversion: 2.42 time: 0.640911 Apr 16 21:31:18.538876 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2915/5680] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:31:17 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 2913 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:31:19.051843 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-19817841-5437-4125-b175-4ae711d034e6 req-4508edf2-93d9-4a41-a549-d8f1cc796b9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70e22cc6-e4af-4230-a480-bbbe6b60d462", "name": "network-vif-unplugged", "status": "completed", "tag": "fdca9e15-fa18-4555-99b5-61429f002844"}, {"server_uuid": "70e22cc6-e4af-4230-a480-bbbe6b60d462", "name": "network-vif-unplugged", "status": "completed", "tag": "cc99d421-5515-41e3-bbf8-03443566d154"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:31:19.081697 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-19817841-5437-4125-b175-4ae711d034e6 req-4508edf2-93d9-4a41-a549-d8f1cc796b9d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:19.082173 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-19817841-5437-4125-b175-4ae711d034e6 req-4508edf2-93d9-4a41-a549-d8f1cc796b9d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:19.111125 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-19817841-5437-4125-b175-4ae711d034e6 req-4508edf2-93d9-4a41-a549-d8f1cc796b9d service nova] Creating event network-vif-unplugged:fdca9e15-fa18-4555-99b5-61429f002844 for instance 70e22cc6-e4af-4230-a480-bbbe6b60d462 on nch1-master-1 Apr 16 21:31:19.111692 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-19817841-5437-4125-b175-4ae711d034e6 req-4508edf2-93d9-4a41-a549-d8f1cc796b9d service nova] Creating event network-vif-unplugged:cc99d421-5515-41e3-bbf8-03443566d154 for instance 70e22cc6-e4af-4230-a480-bbbe6b60d462 on nch1-master-1 Apr 16 21:31:19.120665 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-19817841-5437-4125-b175-4ae711d034e6 req-4508edf2-93d9-4a41-a549-d8f1cc796b9d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 358 microversion: 2.1 time: 0.074337 Apr 16 21:31:19.122223 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2766/5681] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 358 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:31:19.559315 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c3dc7ae1-0301-456d-badc-11e908886f9c tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:19.560084 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c3dc7ae1-0301-456d-badc-11e908886f9c tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:31:19.580881 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3dc7ae1-0301-456d-badc-11e908886f9c tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:19.582257 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3dc7ae1-0301-456d-badc-11e908886f9c tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:19.587960 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3dc7ae1-0301-456d-badc-11e908886f9c tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:19.591515 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3dc7ae1-0301-456d-badc-11e908886f9c tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:20.194811 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c3dc7ae1-0301-456d-badc-11e908886f9c tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:20.206583 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c3dc7ae1-0301-456d-badc-11e908886f9c tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:20.206583 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c3dc7ae1-0301-456d-badc-11e908886f9c tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:20.207826 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c3dc7ae1-0301-456d-badc-11e908886f9c tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 2913 microversion: 2.42 time: 0.652633 Apr 16 21:31:20.216995 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2916/5682] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:31:19 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 2913 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:31:21.107090 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-8494d1db-4cb1-4495-9fe4-a680a79c7991 req-35e10a20-4c41-43a2-a417-e4f4bc66a4ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70e22cc6-e4af-4230-a480-bbbe6b60d462", "name": "network-vif-deleted", "tag": "fdca9e15-fa18-4555-99b5-61429f002844"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:31:21.126163 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-8494d1db-4cb1-4495-9fe4-a680a79c7991 req-35e10a20-4c41-43a2-a417-e4f4bc66a4ef service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:21.127957 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-8494d1db-4cb1-4495-9fe4-a680a79c7991 req-35e10a20-4c41-43a2-a417-e4f4bc66a4ef service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:21.151966 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-8494d1db-4cb1-4495-9fe4-a680a79c7991 req-35e10a20-4c41-43a2-a417-e4f4bc66a4ef service nova] Creating event network-vif-deleted:fdca9e15-fa18-4555-99b5-61429f002844 for instance 70e22cc6-e4af-4230-a480-bbbe6b60d462 on nch1-master-1 Apr 16 21:31:21.168225 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-8494d1db-4cb1-4495-9fe4-a680a79c7991 req-35e10a20-4c41-43a2-a417-e4f4bc66a4ef service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066401 Apr 16 21:31:21.176366 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2767/5683] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:31:21.240381 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0321fed4-606a-4c17-92b7-3d6e1537a611 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:21.242203 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0321fed4-606a-4c17-92b7-3d6e1537a611 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:31:21.255679 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0321fed4-606a-4c17-92b7-3d6e1537a611 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:21.256578 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0321fed4-606a-4c17-92b7-3d6e1537a611 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:21.259441 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0321fed4-606a-4c17-92b7-3d6e1537a611 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:21.260657 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0321fed4-606a-4c17-92b7-3d6e1537a611 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:21.616380 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0321fed4-606a-4c17-92b7-3d6e1537a611 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:21.636841 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0321fed4-606a-4c17-92b7-3d6e1537a611 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:21.641520 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0321fed4-606a-4c17-92b7-3d6e1537a611 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:21.648053 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0321fed4-606a-4c17-92b7-3d6e1537a611 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 2753 microversion: 2.42 time: 0.407290 Apr 16 21:31:21.649769 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2917/5684] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:31:21 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 2753 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:31:22.670859 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e31dfb15-9717-4021-b98a-978eb1747711 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:22.672098 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e31dfb15-9717-4021-b98a-978eb1747711 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:31:22.690058 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e31dfb15-9717-4021-b98a-978eb1747711 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:22.690465 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e31dfb15-9717-4021-b98a-978eb1747711 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:22.691267 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e31dfb15-9717-4021-b98a-978eb1747711 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:22.691720 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e31dfb15-9717-4021-b98a-978eb1747711 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:23.291580 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e31dfb15-9717-4021-b98a-978eb1747711 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:23.335219 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e31dfb15-9717-4021-b98a-978eb1747711 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:23.337624 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e31dfb15-9717-4021-b98a-978eb1747711 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:23.344491 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e31dfb15-9717-4021-b98a-978eb1747711 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 2753 microversion: 2.42 time: 0.677298 Apr 16 21:31:23.346940 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2768/5685] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:31:22 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 2753 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:31:23.707329 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-48ca9d49-e090-41d8-8f89-a1c45558fca5 tempest-VolumesGetTestJSON-104499336 tempest-VolumesGetTestJSON-104499336-project] Action: 'create', calling method: .version_select at 0x7fbb9593d040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2002100770", "metadata": {"Type": "work"}}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:31:24.366763 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b3b6ee4c-109f-431c-9e23-453dc1ceac54 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:24.367965 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b3b6ee4c-109f-431c-9e23-453dc1ceac54 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:31:24.382996 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b3b6ee4c-109f-431c-9e23-453dc1ceac54 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:24.383512 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b3b6ee4c-109f-431c-9e23-453dc1ceac54 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:24.384353 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b3b6ee4c-109f-431c-9e23-453dc1ceac54 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:24.391108 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b3b6ee4c-109f-431c-9e23-453dc1ceac54 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:24.567322 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-48ca9d49-e090-41d8-8f89-a1c45558fca5 tempest-VolumesGetTestJSON-104499336 tempest-VolumesGetTestJSON-104499336-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 346 microversion: 2.1 time: 1.120412 Apr 16 21:31:24.568520 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2918/5686] 10.222.0.20 () {60 vars in 1155 bytes} [Sat Apr 16 21:31:23 2022] POST /compute/v2.1/os-volumes => generated 346 bytes in 1123 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 16 21:31:24.588259 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a8dce0fa-a4f2-477d-9215-052e6857c225 tempest-VolumesGetTestJSON-104499336 tempest-VolumesGetTestJSON-104499336-project] Calling method '.version_select at 0x7fbb955a9dc0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:24.680878 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a8dce0fa-a4f2-477d-9215-052e6857c225 tempest-VolumesGetTestJSON-104499336 tempest-VolumesGetTestJSON-104499336-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/5221184f-a588-4b9c-a8d4-80bc2be5e2ed" status: 200 len: 346 microversion: 2.1 time: 0.101719 Apr 16 21:31:24.682617 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2919/5687] 10.222.0.20 () {58 vars in 1244 bytes} [Sat Apr 16 21:31:24 2022] GET /compute/v2.1/os-volumes/5221184f-a588-4b9c-a8d4-80bc2be5e2ed => generated 346 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:31:25.376059 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-7d38d291-804c-4506-95e4-cfb1dc57279a req-5e6be8e6-d091-496e-9ecd-1f0a4c0a357d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70e22cc6-e4af-4230-a480-bbbe6b60d462", "name": "network-vif-deleted", "tag": "cc99d421-5515-41e3-bbf8-03443566d154"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:31:25.419417 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-7d38d291-804c-4506-95e4-cfb1dc57279a req-5e6be8e6-d091-496e-9ecd-1f0a4c0a357d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:25.421592 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-7d38d291-804c-4506-95e4-cfb1dc57279a req-5e6be8e6-d091-496e-9ecd-1f0a4c0a357d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:25.455787 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-7d38d291-804c-4506-95e4-cfb1dc57279a req-5e6be8e6-d091-496e-9ecd-1f0a4c0a357d service nova] Creating event network-vif-deleted:cc99d421-5515-41e3-bbf8-03443566d154 for instance 70e22cc6-e4af-4230-a480-bbbe6b60d462 on nch1-master-1 Apr 16 21:31:25.471103 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-7d38d291-804c-4506-95e4-cfb1dc57279a req-5e6be8e6-d091-496e-9ecd-1f0a4c0a357d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095516 Apr 16 21:31:25.473045 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2920/5688] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:31:25.598801 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b3b6ee4c-109f-431c-9e23-453dc1ceac54 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:25.624489 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b3b6ee4c-109f-431c-9e23-453dc1ceac54 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:25.627747 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b3b6ee4c-109f-431c-9e23-453dc1ceac54 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:25.641323 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b3b6ee4c-109f-431c-9e23-453dc1ceac54 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 2707 microversion: 2.42 time: 1.275326 Apr 16 21:31:25.642000 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2769/5689] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:31:24 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 2707 bytes in 1280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:31:25.694340 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7d7395c2-c3f2-42a6-a0be-dac9eb07c014 tempest-VolumesGetTestJSON-104499336 tempest-VolumesGetTestJSON-104499336-project] Calling method '.version_select at 0x7fbb955a9430>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:25.778650 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7d7395c2-c3f2-42a6-a0be-dac9eb07c014 tempest-VolumesGetTestJSON-104499336 tempest-VolumesGetTestJSON-104499336-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/5221184f-a588-4b9c-a8d4-80bc2be5e2ed" status: 200 len: 346 microversion: 2.1 time: 0.088984 Apr 16 21:31:25.779830 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2921/5690] 10.222.0.20 () {58 vars in 1244 bytes} [Sat Apr 16 21:31:25 2022] GET /compute/v2.1/os-volumes/5221184f-a588-4b9c-a8d4-80bc2be5e2ed => generated 346 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:31:26.672318 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6f8c8b16-5595-4dd3-b769-f42103fe4c09 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:26.676422 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6f8c8b16-5595-4dd3-b769-f42103fe4c09 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:31:26.697147 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6f8c8b16-5595-4dd3-b769-f42103fe4c09 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:26.704383 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6f8c8b16-5595-4dd3-b769-f42103fe4c09 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:26.707724 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6f8c8b16-5595-4dd3-b769-f42103fe4c09 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:26.708203 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6f8c8b16-5595-4dd3-b769-f42103fe4c09 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:26.799048 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-31a7f6c4-935a-4ef6-b0e1-985e8a0b325f tempest-VolumesGetTestJSON-104499336 tempest-VolumesGetTestJSON-104499336-project] Calling method '.version_select at 0x7fbb9594f1f0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:26.908510 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-31a7f6c4-935a-4ef6-b0e1-985e8a0b325f tempest-VolumesGetTestJSON-104499336 tempest-VolumesGetTestJSON-104499336-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/5221184f-a588-4b9c-a8d4-80bc2be5e2ed" status: 200 len: 347 microversion: 2.1 time: 0.120265 Apr 16 21:31:26.909371 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2922/5691] 10.222.0.20 () {58 vars in 1244 bytes} [Sat Apr 16 21:31:26 2022] GET /compute/v2.1/os-volumes/5221184f-a588-4b9c-a8d4-80bc2be5e2ed => generated 347 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:31:26.928389 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e25ec482-8f40-431a-a834-df881fd33f44 tempest-VolumesGetTestJSON-104499336 tempest-VolumesGetTestJSON-104499336-project] Calling method '.version_select at 0x7fbb955a9790>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:27.034705 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e25ec482-8f40-431a-a834-df881fd33f44 tempest-VolumesGetTestJSON-104499336 tempest-VolumesGetTestJSON-104499336-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/5221184f-a588-4b9c-a8d4-80bc2be5e2ed" status: 200 len: 347 microversion: 2.1 time: 0.110344 Apr 16 21:31:27.035285 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2923/5692] 10.222.0.20 () {58 vars in 1244 bytes} [Sat Apr 16 21:31:26 2022] GET /compute/v2.1/os-volumes/5221184f-a588-4b9c-a8d4-80bc2be5e2ed => generated 347 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:31:27.047393 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1aefff68-0154-4bac-b03e-08b682426882 tempest-VolumesGetTestJSON-104499336 tempest-VolumesGetTestJSON-104499336-project] Calling method '.version_select at 0x7fbb9593d550>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:27.286508 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1aefff68-0154-4bac-b03e-08b682426882 tempest-VolumesGetTestJSON-104499336 tempest-VolumesGetTestJSON-104499336-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/5221184f-a588-4b9c-a8d4-80bc2be5e2ed" status: 202 len: 0 microversion: 2.1 time: 0.243137 Apr 16 21:31:27.287265 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2924/5693] 10.222.0.20 () {58 vars in 1247 bytes} [Sat Apr 16 21:31:27 2022] DELETE /compute/v2.1/os-volumes/5221184f-a588-4b9c-a8d4-80bc2be5e2ed => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 16 21:31:27.296271 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9732df3d-6395-462a-9ca6-6225a661261a tempest-VolumesGetTestJSON-104499336 tempest-VolumesGetTestJSON-104499336-project] Calling method '.version_select at 0x7fbb9594f700>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:27.387947 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9732df3d-6395-462a-9ca6-6225a661261a tempest-VolumesGetTestJSON-104499336 tempest-VolumesGetTestJSON-104499336-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/5221184f-a588-4b9c-a8d4-80bc2be5e2ed" status: 200 len: 346 microversion: 2.1 time: 0.096648 Apr 16 21:31:27.401544 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2925/5694] 10.222.0.20 () {58 vars in 1244 bytes} [Sat Apr 16 21:31:27 2022] GET /compute/v2.1/os-volumes/5221184f-a588-4b9c-a8d4-80bc2be5e2ed => generated 346 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:31:27.548496 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-f5f64a35-99e8-4427-9e66-fe7f9496e404 req-928b8a16-50a5-4cf7-a5b4-af2d21d3b611 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70e22cc6-e4af-4230-a480-bbbe6b60d462", "name": "network-vif-deleted", "tag": "c8475713-e26a-40c8-8213-0fa9fe87a721"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:31:27.572785 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-f5f64a35-99e8-4427-9e66-fe7f9496e404 req-928b8a16-50a5-4cf7-a5b4-af2d21d3b611 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:27.576416 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-f5f64a35-99e8-4427-9e66-fe7f9496e404 req-928b8a16-50a5-4cf7-a5b4-af2d21d3b611 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:27.599546 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6f8c8b16-5595-4dd3-b769-f42103fe4c09 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:27.612466 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6f8c8b16-5595-4dd3-b769-f42103fe4c09 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:27.614879 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6f8c8b16-5595-4dd3-b769-f42103fe4c09 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:27.621514 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-f5f64a35-99e8-4427-9e66-fe7f9496e404 req-928b8a16-50a5-4cf7-a5b4-af2d21d3b611 service nova] Creating event network-vif-deleted:c8475713-e26a-40c8-8213-0fa9fe87a721 for instance 70e22cc6-e4af-4230-a480-bbbe6b60d462 on nch1-master-1 Apr 16 21:31:27.621788 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6f8c8b16-5595-4dd3-b769-f42103fe4c09 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 2417 microversion: 2.42 time: 0.951674 Apr 16 21:31:27.624452 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2770/5695] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:31:26 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 2417 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:31:27.631055 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-f5f64a35-99e8-4427-9e66-fe7f9496e404 req-928b8a16-50a5-4cf7-a5b4-af2d21d3b611 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087092 Apr 16 21:31:27.636916 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2926/5696] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:31:28.080127 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4032f90f-a46a-493f-8224-3745ca5a92ec tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1568576949", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "f9436375-f402-4a5b-aa69-a7409c8adda4"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1932535405", "security_groups": [{"name": "tempest-secgroup-smoke-1111301264"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:31:28.406360 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-4032f90f-a46a-493f-8224-3745ca5a92ec tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] validate_networks() for [('f9436375-f402-4a5b-aa69-a7409c8adda4', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:31:28.407604 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ad8fe702-a588-4fba-b4f3-8253010ca6a0 tempest-VolumesGetTestJSON-104499336 tempest-VolumesGetTestJSON-104499336-project] Calling method '.version_select at 0x7fbb955a9dc0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:28.510671 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ad8fe702-a588-4fba-b4f3-8253010ca6a0 tempest-VolumesGetTestJSON-104499336 tempest-VolumesGetTestJSON-104499336-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/5221184f-a588-4b9c-a8d4-80bc2be5e2ed" status: 200 len: 346 microversion: 2.1 time: 0.111463 Apr 16 21:31:28.511267 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2927/5697] 10.222.0.20 () {58 vars in 1244 bytes} [Sat Apr 16 21:31:28 2022] GET /compute/v2.1/os-volumes/5221184f-a588-4b9c-a8d4-80bc2be5e2ed => generated 346 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:31:28.645129 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8343bad6-6be0-454e-97f5-0daa28015eec tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:28.646222 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8343bad6-6be0-454e-97f5-0daa28015eec tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:31:28.659375 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8343bad6-6be0-454e-97f5-0daa28015eec tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:28.661330 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8343bad6-6be0-454e-97f5-0daa28015eec tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:28.664645 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8343bad6-6be0-454e-97f5-0daa28015eec tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:28.665870 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8343bad6-6be0-454e-97f5-0daa28015eec tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:29.445340 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8343bad6-6be0-454e-97f5-0daa28015eec tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:29.465114 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8343bad6-6be0-454e-97f5-0daa28015eec tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:29.469907 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8343bad6-6be0-454e-97f5-0daa28015eec tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:29.471223 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8343bad6-6be0-454e-97f5-0daa28015eec tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 2257 microversion: 2.42 time: 0.832058 Apr 16 21:31:29.480872 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2928/5698] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:31:28 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 2257 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:31:29.528372 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-56508095-232d-4582-9052-a2a72ca71de1 tempest-VolumesGetTestJSON-104499336 tempest-VolumesGetTestJSON-104499336-project] Calling method '.version_select at 0x7fbb956b7dc0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:29.624070 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-56508095-232d-4582-9052-a2a72ca71de1 tempest-VolumesGetTestJSON-104499336 tempest-VolumesGetTestJSON-104499336-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/5221184f-a588-4b9c-a8d4-80bc2be5e2ed" status: 200 len: 346 microversion: 2.1 time: 0.104175 Apr 16 21:31:29.624777 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2929/5699] 10.222.0.20 () {58 vars in 1244 bytes} [Sat Apr 16 21:31:29 2022] GET /compute/v2.1/os-volumes/5221184f-a588-4b9c-a8d4-80bc2be5e2ed => generated 346 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:31:30.002917 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-034efd01-3674-4ec0-9685-e5ee4a64f029 req-cbb93320-b906-4cb5-b1f3-dd03d642269e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70e22cc6-e4af-4230-a480-bbbe6b60d462", "name": "network-vif-deleted", "tag": "530c687e-6ccd-45ad-ad6e-7e4a0d9487ee"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:31:30.026044 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-034efd01-3674-4ec0-9685-e5ee4a64f029 req-cbb93320-b906-4cb5-b1f3-dd03d642269e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:30.028510 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-034efd01-3674-4ec0-9685-e5ee4a64f029 req-cbb93320-b906-4cb5-b1f3-dd03d642269e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:30.075800 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-034efd01-3674-4ec0-9685-e5ee4a64f029 req-cbb93320-b906-4cb5-b1f3-dd03d642269e service nova] Creating event network-vif-deleted:530c687e-6ccd-45ad-ad6e-7e4a0d9487ee for instance 70e22cc6-e4af-4230-a480-bbbe6b60d462 on nch1-master-1 Apr 16 21:31:30.088433 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-034efd01-3674-4ec0-9685-e5ee4a64f029 req-cbb93320-b906-4cb5-b1f3-dd03d642269e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089251 Apr 16 21:31:30.093984 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2930/5700] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:31:30.497105 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7d46bde4-6b5f-44a1-b23c-a539547b2584 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:30.498102 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7d46bde4-6b5f-44a1-b23c-a539547b2584 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:31:30.515706 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7d46bde4-6b5f-44a1-b23c-a539547b2584 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:30.518319 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7d46bde4-6b5f-44a1-b23c-a539547b2584 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:30.518319 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7d46bde4-6b5f-44a1-b23c-a539547b2584 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:30.518319 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7d46bde4-6b5f-44a1-b23c-a539547b2584 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:30.920541 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-4032f90f-a46a-493f-8224-3745ca5a92ec tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:31:30.921841 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-4032f90f-a46a-493f-8224-3745ca5a92ec tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:31:30.922828 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-4032f90f-a46a-493f-8224-3745ca5a92ec tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:31:30.928414 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-4032f90f-a46a-493f-8224-3745ca5a92ec tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:31:30.929094 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-4032f90f-a46a-493f-8224-3745ca5a92ec tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:31:30.955468 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4032f90f-a46a-493f-8224-3745ca5a92ec tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:30.959750 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4032f90f-a46a-493f-8224-3745ca5a92ec tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:30.960900 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4032f90f-a46a-493f-8224-3745ca5a92ec tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:30.961622 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4032f90f-a46a-493f-8224-3745ca5a92ec tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:31.025395 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-4032f90f-a46a-493f-8224-3745ca5a92ec tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Getting quotas for project 0ee2ef9a941a429b82a89f7c8f71d45b. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:31:31.037961 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-4032f90f-a46a-493f-8224-3745ca5a92ec tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Getting quotas for user f27a0cf693a247bb87a8c12193fee719 and project 0ee2ef9a941a429b82a89f7c8f71d45b. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:31:31.062789 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4032f90f-a46a-493f-8224-3745ca5a92ec tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:31:31.066863 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4032f90f-a46a-493f-8224-3745ca5a92ec tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:31:31.163819 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7d46bde4-6b5f-44a1-b23c-a539547b2584 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:31.175433 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7d46bde4-6b5f-44a1-b23c-a539547b2584 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:31.177082 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7d46bde4-6b5f-44a1-b23c-a539547b2584 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:31.178335 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7d46bde4-6b5f-44a1-b23c-a539547b2584 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 2053 microversion: 2.42 time: 0.687577 Apr 16 21:31:31.179273 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2931/5701] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:31:30 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 2053 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:31:31.184605 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e22b4257-1735-4dd3-8503-898d5ebad697 tempest-VolumesGetTestJSON-104499336 tempest-VolumesGetTestJSON-104499336-project] Calling method '.version_select at 0x7fbb959baf70>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:31.191963 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4032f90f-a46a-493f-8224-3745ca5a92ec tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.116609 Apr 16 21:31:31.207513 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2771/5702] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:31:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 3133 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:31:31.222681 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6d2bb2ba-13ff-4d53-bdd1-382abbb0e2dc tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:31.223628 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6d2bb2ba-13ff-4d53-bdd1-382abbb0e2dc tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:31:31.302966 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e22b4257-1735-4dd3-8503-898d5ebad697 tempest-VolumesGetTestJSON-104499336 tempest-VolumesGetTestJSON-104499336-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/5221184f-a588-4b9c-a8d4-80bc2be5e2ed" status: 200 len: 346 microversion: 2.1 time: 0.122123 Apr 16 21:31:31.303723 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2932/5703] 10.222.0.20 () {58 vars in 1244 bytes} [Sat Apr 16 21:31:31 2022] GET /compute/v2.1/os-volumes/5221184f-a588-4b9c-a8d4-80bc2be5e2ed => generated 346 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:31:31.463694 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6d2bb2ba-13ff-4d53-bdd1-382abbb0e2dc tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:31.480377 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6d2bb2ba-13ff-4d53-bdd1-382abbb0e2dc tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1267 microversion: 2.1 time: 0.258649 Apr 16 21:31:31.491066 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2772/5704] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:31:31 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1267 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:31:32.135542 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-cd888ff8-8771-4570-a11d-3f43d2786d4a req-826b3129-93e7-4d57-8e54-500edc7f1695 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70e22cc6-e4af-4230-a480-bbbe6b60d462", "name": "network-vif-deleted", "tag": "e161877a-3f6f-49a7-8aed-2eee986f2f68"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:31:32.170295 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-cd888ff8-8771-4570-a11d-3f43d2786d4a req-826b3129-93e7-4d57-8e54-500edc7f1695 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:32.176337 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-cd888ff8-8771-4570-a11d-3f43d2786d4a req-826b3129-93e7-4d57-8e54-500edc7f1695 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:32.199535 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6f6ae33f-ccfd-402b-9e3b-922de90cbdd7 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:32.200161 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6f6ae33f-ccfd-402b-9e3b-922de90cbdd7 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:31:32.211840 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6f6ae33f-ccfd-402b-9e3b-922de90cbdd7 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:32.212340 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6f6ae33f-ccfd-402b-9e3b-922de90cbdd7 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:32.220734 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6f6ae33f-ccfd-402b-9e3b-922de90cbdd7 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:32.221383 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6f6ae33f-ccfd-402b-9e3b-922de90cbdd7 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:32.234631 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-cd888ff8-8771-4570-a11d-3f43d2786d4a req-826b3129-93e7-4d57-8e54-500edc7f1695 service nova] Creating event network-vif-deleted:e161877a-3f6f-49a7-8aed-2eee986f2f68 for instance 70e22cc6-e4af-4230-a480-bbbe6b60d462 on nch1-master-1 Apr 16 21:31:32.250752 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-cd888ff8-8771-4570-a11d-3f43d2786d4a req-826b3129-93e7-4d57-8e54-500edc7f1695 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119226 Apr 16 21:31:32.255550 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2933/5705] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:31:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:31:32.321014 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7b77b865-a40e-44c8-8a9f-bcf578306988 tempest-VolumesGetTestJSON-104499336 tempest-VolumesGetTestJSON-104499336-project] Calling method '.version_select at 0x7fbb959ba940>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:32.371738 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-7b77b865-a40e-44c8-8a9f-bcf578306988 tempest-VolumesGetTestJSON-104499336 tempest-VolumesGetTestJSON-104499336-project] HTTP exception thrown: Volume 5221184f-a588-4b9c-a8d4-80bc2be5e2ed could not be found. Apr 16 21:31:32.372813 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7b77b865-a40e-44c8-8a9f-bcf578306988 tempest-VolumesGetTestJSON-104499336 tempest-VolumesGetTestJSON-104499336-project] Returning 404 to user: Volume 5221184f-a588-4b9c-a8d4-80bc2be5e2ed could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:31:32.373846 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7b77b865-a40e-44c8-8a9f-bcf578306988 tempest-VolumesGetTestJSON-104499336 tempest-VolumesGetTestJSON-104499336-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/5221184f-a588-4b9c-a8d4-80bc2be5e2ed" status: 404 len: 109 microversion: 2.1 time: 0.062549 Apr 16 21:31:32.377579 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2934/5706] 10.222.0.20 () {58 vars in 1244 bytes} [Sat Apr 16 21:31:32 2022] GET /compute/v2.1/os-volumes/5221184f-a588-4b9c-a8d4-80bc2be5e2ed => generated 109 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:31:32.402977 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6f6ae33f-ccfd-402b-9e3b-922de90cbdd7 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:32.424855 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6f6ae33f-ccfd-402b-9e3b-922de90cbdd7 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:32.427575 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6f6ae33f-ccfd-402b-9e3b-922de90cbdd7 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:32.431791 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6f6ae33f-ccfd-402b-9e3b-922de90cbdd7 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1604 microversion: 2.42 time: 0.234670 Apr 16 21:31:32.433853 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2773/5707] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:31:32 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1604 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:31:32.509683 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a6d7af29-bc83-482f-84b9-612a37e9cbef tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:32.509683 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a6d7af29-bc83-482f-84b9-612a37e9cbef tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:31:32.728108 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a6d7af29-bc83-482f-84b9-612a37e9cbef tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:32.735499 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a6d7af29-bc83-482f-84b9-612a37e9cbef tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1267 microversion: 2.1 time: 0.240874 Apr 16 21:31:32.738346 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2935/5708] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:31:32 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1267 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:31:33.454999 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9bd7fc2f-86eb-4d9c-971c-e4fb74f7479c tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:33.454999 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9bd7fc2f-86eb-4d9c-971c-e4fb74f7479c tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:31:33.465073 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9bd7fc2f-86eb-4d9c-971c-e4fb74f7479c tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:33.465873 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9bd7fc2f-86eb-4d9c-971c-e4fb74f7479c tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:33.467613 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9bd7fc2f-86eb-4d9c-971c-e4fb74f7479c tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:33.469122 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9bd7fc2f-86eb-4d9c-971c-e4fb74f7479c tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:33.526507 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9bd7fc2f-86eb-4d9c-971c-e4fb74f7479c tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:33.527931 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9bd7fc2f-86eb-4d9c-971c-e4fb74f7479c tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:33.528602 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-9bd7fc2f-86eb-4d9c-971c-e4fb74f7479c tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lazy-loading 'fault' on Instance uuid 70e22cc6-e4af-4230-a480-bbbe6b60d462 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:31:33.754604 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6b6aada5-e7d4-4db8-8609-1a3cb21ba67a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:33.756434 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6b6aada5-e7d4-4db8-8609-1a3cb21ba67a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:31:33.776259 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6b6aada5-e7d4-4db8-8609-1a3cb21ba67a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:33.776941 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6b6aada5-e7d4-4db8-8609-1a3cb21ba67a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:33.793072 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9bd7fc2f-86eb-4d9c-971c-e4fb74f7479c tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:33.803284 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9bd7fc2f-86eb-4d9c-971c-e4fb74f7479c tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:33.812623 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9bd7fc2f-86eb-4d9c-971c-e4fb74f7479c tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'aa437260d34444efa2cef4ea34f57a03', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8548f70297f04c1489783de67671dba2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:33.814331 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9bd7fc2f-86eb-4d9c-971c-e4fb74f7479c tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 200 len: 1609 microversion: 2.42 time: 0.367296 Apr 16 21:31:33.817060 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6b6aada5-e7d4-4db8-8609-1a3cb21ba67a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:33.817619 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2774/5709] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:31:33 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 1609 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:31:33.829354 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6b6aada5-e7d4-4db8-8609-1a3cb21ba67a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.039s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:34.005230 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6b6aada5-e7d4-4db8-8609-1a3cb21ba67a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:34.016052 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6b6aada5-e7d4-4db8-8609-1a3cb21ba67a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1319 microversion: 2.1 time: 0.266062 Apr 16 21:31:34.020313 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2936/5710] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:31:33 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1319 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:31:34.838508 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d643088e-2a93-4ecc-9bf1-bd345bdecab5 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:34.839448 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d643088e-2a93-4ecc-9bf1-bd345bdecab5 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] [instance: 70e22cc6-e4af-4230-a480-bbbe6b60d462] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:31:34.858047 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d643088e-2a93-4ecc-9bf1-bd345bdecab5 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:34.864198 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d643088e-2a93-4ecc-9bf1-bd345bdecab5 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:34.864198 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d643088e-2a93-4ecc-9bf1-bd345bdecab5 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:34.864198 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d643088e-2a93-4ecc-9bf1-bd345bdecab5 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:34.907062 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-d643088e-2a93-4ecc-9bf1-bd345bdecab5 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] HTTP exception thrown: Instance 70e22cc6-e4af-4230-a480-bbbe6b60d462 could not be found. Apr 16 21:31:34.908007 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d643088e-2a93-4ecc-9bf1-bd345bdecab5 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Returning 404 to user: Instance 70e22cc6-e4af-4230-a480-bbbe6b60d462 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:31:34.909720 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d643088e-2a93-4ecc-9bf1-bd345bdecab5 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462" status: 404 len: 111 microversion: 2.42 time: 0.076962 Apr 16 21:31:34.914040 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2775/5711] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:31:34 2022] GET /compute/v2.1/servers/70e22cc6-e4af-4230-a480-bbbe6b60d462 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:31:34.927388 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6bb12c00-e19e-4053-a2c1-6f845da9b657 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] Calling method '.version_select at 0x7fbb956b7790>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:35.019432 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6bb12c00-e19e-4053-a2c1-6f845da9b657 tempest-TaggedBootDevicesTest_v242-1122505264 tempest-TaggedBootDevicesTest_v242-1122505264-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-416702426" status: 204 len: 0 microversion: 2.42 time: 0.100558 Apr 16 21:31:35.021084 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2937/5712] 10.222.0.20 () {60 vars in 1258 bytes} [Sat Apr 16 21:31:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-416702426 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 16 21:31:35.059466 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-861b77ee-2926-442a-ae7a-815a67e42dc6 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:35.062109 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-861b77ee-2926-442a-ae7a-815a67e42dc6 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:31:35.070717 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-861b77ee-2926-442a-ae7a-815a67e42dc6 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:35.071468 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-861b77ee-2926-442a-ae7a-815a67e42dc6 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:35.072696 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-861b77ee-2926-442a-ae7a-815a67e42dc6 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:35.073876 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-861b77ee-2926-442a-ae7a-815a67e42dc6 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:35.368230 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-861b77ee-2926-442a-ae7a-815a67e42dc6 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:35.381593 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-861b77ee-2926-442a-ae7a-815a67e42dc6 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1325 microversion: 2.1 time: 0.342592 Apr 16 21:31:35.383221 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2776/5713] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:31:35 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1325 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:31:36.409849 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-aca69660-26f8-4c88-82ce-07cc965fb1e0 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:36.411060 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-aca69660-26f8-4c88-82ce-07cc965fb1e0 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:31:36.418283 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aca69660-26f8-4c88-82ce-07cc965fb1e0 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:36.418987 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aca69660-26f8-4c88-82ce-07cc965fb1e0 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:36.420393 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aca69660-26f8-4c88-82ce-07cc965fb1e0 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:36.421010 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aca69660-26f8-4c88-82ce-07cc965fb1e0 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:36.542377 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-aca69660-26f8-4c88-82ce-07cc965fb1e0 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:36.562540 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-aca69660-26f8-4c88-82ce-07cc965fb1e0 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1325 microversion: 2.1 time: 0.166677 Apr 16 21:31:36.564093 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2938/5714] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:31:36 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1325 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:31:37.588890 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9daaa79b-8ee3-4ba2-80e2-dbc5acaa2c7b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:37.589519 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9daaa79b-8ee3-4ba2-80e2-dbc5acaa2c7b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:31:37.600789 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9daaa79b-8ee3-4ba2-80e2-dbc5acaa2c7b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:37.601253 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9daaa79b-8ee3-4ba2-80e2-dbc5acaa2c7b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:37.606432 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9daaa79b-8ee3-4ba2-80e2-dbc5acaa2c7b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:37.607152 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9daaa79b-8ee3-4ba2-80e2-dbc5acaa2c7b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:37.965930 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9daaa79b-8ee3-4ba2-80e2-dbc5acaa2c7b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:37.980072 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9daaa79b-8ee3-4ba2-80e2-dbc5acaa2c7b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1393 microversion: 2.1 time: 0.394947 Apr 16 21:31:37.982502 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2777/5715] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:31:37 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1393 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:31:39.003986 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-46fb9372-a686-4e30-90c1-925642c053b6 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:39.006735 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-46fb9372-a686-4e30-90c1-925642c053b6 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:31:39.046089 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-46fb9372-a686-4e30-90c1-925642c053b6 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:39.046089 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-46fb9372-a686-4e30-90c1-925642c053b6 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:39.046089 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-46fb9372-a686-4e30-90c1-925642c053b6 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:39.046089 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-46fb9372-a686-4e30-90c1-925642c053b6 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:39.381460 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-46fb9372-a686-4e30-90c1-925642c053b6 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:39.390733 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-46fb9372-a686-4e30-90c1-925642c053b6 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1393 microversion: 2.1 time: 0.394615 Apr 16 21:31:39.395481 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2939/5716] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:31:38 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1393 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:31:39.565281 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-51a35530-4ab1-4355-841b-45ef035bffe9 req-938159a3-1f36-4f44-86ee-28a81e610bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebff90b9-4ca5-4301-b5d7-4c1e92b16457", "tag": "f0531494-4be1-4c6b-bed4-5ffd32fa231d"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:31:39.584127 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-51a35530-4ab1-4355-841b-45ef035bffe9 req-938159a3-1f36-4f44-86ee-28a81e610bc7 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:39.584620 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-51a35530-4ab1-4355-841b-45ef035bffe9 req-938159a3-1f36-4f44-86ee-28a81e610bc7 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:39.604365 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-51a35530-4ab1-4355-841b-45ef035bffe9 req-938159a3-1f36-4f44-86ee-28a81e610bc7 service nova] Creating event network-changed:f0531494-4be1-4c6b-bed4-5ffd32fa231d for instance ebff90b9-4ca5-4301-b5d7-4c1e92b16457 on nch1-master-1 Apr 16 21:31:39.609784 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-51a35530-4ab1-4355-841b-45ef035bffe9 req-938159a3-1f36-4f44-86ee-28a81e610bc7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054883 Apr 16 21:31:39.610387 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2778/5717] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:31:40.411349 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ddf50172-4837-4669-a507-e66457f25db1 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:40.412642 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ddf50172-4837-4669-a507-e66457f25db1 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:31:40.425023 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ddf50172-4837-4669-a507-e66457f25db1 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:40.430384 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ddf50172-4837-4669-a507-e66457f25db1 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:40.431568 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ddf50172-4837-4669-a507-e66457f25db1 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:40.432207 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ddf50172-4837-4669-a507-e66457f25db1 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:40.783924 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ddf50172-4837-4669-a507-e66457f25db1 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:40.797502 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ddf50172-4837-4669-a507-e66457f25db1 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1393 microversion: 2.1 time: 0.390164 Apr 16 21:31:40.814017 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2940/5718] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:31:40 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1393 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:31:41.838421 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4b82196a-cb3f-46fd-8864-ad88b22c9cb7 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:41.842184 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4b82196a-cb3f-46fd-8864-ad88b22c9cb7 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:31:41.851670 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4b82196a-cb3f-46fd-8864-ad88b22c9cb7 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:41.852403 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4b82196a-cb3f-46fd-8864-ad88b22c9cb7 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:41.854671 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4b82196a-cb3f-46fd-8864-ad88b22c9cb7 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:41.855295 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4b82196a-cb3f-46fd-8864-ad88b22c9cb7 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:42.370270 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4b82196a-cb3f-46fd-8864-ad88b22c9cb7 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:42.387281 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4b82196a-cb3f-46fd-8864-ad88b22c9cb7 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1393 microversion: 2.1 time: 0.562443 Apr 16 21:31:42.392313 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2779/5719] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:31:41 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1393 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:31:43.411748 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5d8785ca-2267-4a8a-bc51-6ed3b9ca3bee tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:43.414878 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5d8785ca-2267-4a8a-bc51-6ed3b9ca3bee tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:31:43.430145 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5d8785ca-2267-4a8a-bc51-6ed3b9ca3bee tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:43.431004 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5d8785ca-2267-4a8a-bc51-6ed3b9ca3bee tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:43.432050 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5d8785ca-2267-4a8a-bc51-6ed3b9ca3bee tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:43.432754 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5d8785ca-2267-4a8a-bc51-6ed3b9ca3bee tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:44.232220 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5d8785ca-2267-4a8a-bc51-6ed3b9ca3bee tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:44.249865 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5d8785ca-2267-4a8a-bc51-6ed3b9ca3bee tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1393 microversion: 2.1 time: 0.843903 Apr 16 21:31:44.251086 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2941/5720] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:31:43 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1393 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:31:45.269399 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-db6dcf8d-ac09-46fc-94cb-ddb1e1994473 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:45.270840 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-db6dcf8d-ac09-46fc-94cb-ddb1e1994473 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:31:45.294345 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-db6dcf8d-ac09-46fc-94cb-ddb1e1994473 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:45.301436 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-db6dcf8d-ac09-46fc-94cb-ddb1e1994473 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:45.302522 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-db6dcf8d-ac09-46fc-94cb-ddb1e1994473 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:45.302973 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-db6dcf8d-ac09-46fc-94cb-ddb1e1994473 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:45.870309 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-db6dcf8d-ac09-46fc-94cb-ddb1e1994473 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:45.879374 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-db6dcf8d-ac09-46fc-94cb-ddb1e1994473 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1393 microversion: 2.1 time: 0.616227 Apr 16 21:31:45.879968 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2780/5721] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:31:45 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1393 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:31:46.896866 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f78b142f-de5c-4bf8-84bb-84ff0a3d0d72 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:46.898515 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f78b142f-de5c-4bf8-84bb-84ff0a3d0d72 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:31:46.906467 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f78b142f-de5c-4bf8-84bb-84ff0a3d0d72 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:46.907195 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f78b142f-de5c-4bf8-84bb-84ff0a3d0d72 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:46.908946 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f78b142f-de5c-4bf8-84bb-84ff0a3d0d72 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:46.909553 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f78b142f-de5c-4bf8-84bb-84ff0a3d0d72 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:47.204052 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f78b142f-de5c-4bf8-84bb-84ff0a3d0d72 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:47.216052 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f78b142f-de5c-4bf8-84bb-84ff0a3d0d72 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1393 microversion: 2.1 time: 0.322651 Apr 16 21:31:47.225409 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2942/5722] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:31:46 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1393 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:31:47.454358 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-c886220e-e9b1-4ebc-a961-0b61dc8b9ee3 req-15d7e399-4517-44ea-b880-0345a3f072bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebff90b9-4ca5-4301-b5d7-4c1e92b16457", "name": "network-vif-plugged", "status": "completed", "tag": "f0531494-4be1-4c6b-bed4-5ffd32fa231d"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:31:47.466198 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-c886220e-e9b1-4ebc-a961-0b61dc8b9ee3 req-15d7e399-4517-44ea-b880-0345a3f072bd service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:47.467567 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-c886220e-e9b1-4ebc-a961-0b61dc8b9ee3 req-15d7e399-4517-44ea-b880-0345a3f072bd service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:47.495312 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-c886220e-e9b1-4ebc-a961-0b61dc8b9ee3 req-15d7e399-4517-44ea-b880-0345a3f072bd service nova] Creating event network-vif-plugged:f0531494-4be1-4c6b-bed4-5ffd32fa231d for instance ebff90b9-4ca5-4301-b5d7-4c1e92b16457 on nch1-master-1 Apr 16 21:31:47.504150 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-c886220e-e9b1-4ebc-a961-0b61dc8b9ee3 req-15d7e399-4517-44ea-b880-0345a3f072bd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053853 Apr 16 21:31:47.505382 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2781/5723] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:31:48.233610 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ebd4e11c-20d7-4b68-83e5-2dc37f25af42 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:48.235197 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ebd4e11c-20d7-4b68-83e5-2dc37f25af42 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:31:48.258452 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ebd4e11c-20d7-4b68-83e5-2dc37f25af42 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:48.262891 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ebd4e11c-20d7-4b68-83e5-2dc37f25af42 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:48.263741 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ebd4e11c-20d7-4b68-83e5-2dc37f25af42 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:48.264913 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ebd4e11c-20d7-4b68-83e5-2dc37f25af42 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:48.600521 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ebd4e11c-20d7-4b68-83e5-2dc37f25af42 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:48.609526 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ebd4e11c-20d7-4b68-83e5-2dc37f25af42 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1393 microversion: 2.1 time: 0.380213 Apr 16 21:31:48.611811 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2943/5724] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:31:48 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1393 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:31:49.629778 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f7f035c5-848f-4a64-ad90-64a926b204e3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:49.631589 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f7f035c5-848f-4a64-ad90-64a926b204e3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:31:49.646383 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f7f035c5-848f-4a64-ad90-64a926b204e3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:49.646383 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f7f035c5-848f-4a64-ad90-64a926b204e3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:49.650026 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f7f035c5-848f-4a64-ad90-64a926b204e3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:49.654062 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f7f035c5-848f-4a64-ad90-64a926b204e3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:50.174338 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f7f035c5-848f-4a64-ad90-64a926b204e3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:50.185813 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f7f035c5-848f-4a64-ad90-64a926b204e3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1566 microversion: 2.1 time: 0.561194 Apr 16 21:31:50.187444 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2782/5725] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:31:49 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1566 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:31:50.212933 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9aebe6a5-62df-4546-a9a2-4e98a53ddbf2 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:50.214407 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9aebe6a5-62df-4546-a9a2-4e98a53ddbf2 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:31:50.226851 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9aebe6a5-62df-4546-a9a2-4e98a53ddbf2 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:50.227348 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9aebe6a5-62df-4546-a9a2-4e98a53ddbf2 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:50.228210 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9aebe6a5-62df-4546-a9a2-4e98a53ddbf2 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:50.230178 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9aebe6a5-62df-4546-a9a2-4e98a53ddbf2 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:50.706467 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9aebe6a5-62df-4546-a9a2-4e98a53ddbf2 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:50.720655 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9aebe6a5-62df-4546-a9a2-4e98a53ddbf2 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1566 microversion: 2.1 time: 0.514595 Apr 16 21:31:50.732340 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2944/5726] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:31:50 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1566 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:31:55.895919 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1c1b878e-a405-4b0b-ac48-3081c28b7754 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:31:55.899180 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1c1b878e-a405-4b0b-ac48-3081c28b7754 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:31:55.918000 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1c1b878e-a405-4b0b-ac48-3081c28b7754 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:55.918928 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1c1b878e-a405-4b0b-ac48-3081c28b7754 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:55.919855 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-64a3576a-688d-4082-a774-d61ffc890ef6 req-97579b2b-234d-465f-9482-00b71bc95fff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebff90b9-4ca5-4301-b5d7-4c1e92b16457", "tag": "f0531494-4be1-4c6b-bed4-5ffd32fa231d"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:31:55.920455 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1c1b878e-a405-4b0b-ac48-3081c28b7754 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:55.921642 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1c1b878e-a405-4b0b-ac48-3081c28b7754 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:55.931900 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-64a3576a-688d-4082-a774-d61ffc890ef6 req-97579b2b-234d-465f-9482-00b71bc95fff service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:31:55.932390 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-64a3576a-688d-4082-a774-d61ffc890ef6 req-97579b2b-234d-465f-9482-00b71bc95fff service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:31:55.966852 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-64a3576a-688d-4082-a774-d61ffc890ef6 req-97579b2b-234d-465f-9482-00b71bc95fff service nova] Creating event network-changed:f0531494-4be1-4c6b-bed4-5ffd32fa231d for instance ebff90b9-4ca5-4301-b5d7-4c1e92b16457 on nch1-master-1 Apr 16 21:31:55.973049 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-64a3576a-688d-4082-a774-d61ffc890ef6 req-97579b2b-234d-465f-9482-00b71bc95fff service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056819 Apr 16 21:31:55.974136 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2945/5727] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:31:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:31:57.263820 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1c1b878e-a405-4b0b-ac48-3081c28b7754 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:31:57.285489 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1c1b878e-a405-4b0b-ac48-3081c28b7754 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1566 microversion: 2.1 time: 1.395939 Apr 16 21:31:57.288573 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2783/5728] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:31:55 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1566 bytes in 1400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:32:12.868401 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2a8a779a-360f-4eab-baed-ddb9aa18d2b3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:32:12.869385 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2a8a779a-360f-4eab-baed-ddb9aa18d2b3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:12.881449 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2a8a779a-360f-4eab-baed-ddb9aa18d2b3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:12.881913 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2a8a779a-360f-4eab-baed-ddb9aa18d2b3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:12.882729 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2a8a779a-360f-4eab-baed-ddb9aa18d2b3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:12.883183 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2a8a779a-360f-4eab-baed-ddb9aa18d2b3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:12.982436 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2a8a779a-360f-4eab-baed-ddb9aa18d2b3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "POST /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457/action" status: 200 len: 24571 microversion: 2.1 time: 0.119864 Apr 16 21:32:12.983943 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2946/5729] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:32:12 2022] POST /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457/action => generated 24571 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:32:13.403796 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0ee46104-c489-4662-b78a-b1518fbfbc02 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:13.404842 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0ee46104-c489-4662-b78a-b1518fbfbc02 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:13.421022 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0ee46104-c489-4662-b78a-b1518fbfbc02 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:13.421764 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0ee46104-c489-4662-b78a-b1518fbfbc02 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:13.422794 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0ee46104-c489-4662-b78a-b1518fbfbc02 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:13.423487 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0ee46104-c489-4662-b78a-b1518fbfbc02 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:13.470697 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0ee46104-c489-4662-b78a-b1518fbfbc02 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30/ips" status: 200 len: 151 microversion: 2.20 time: 0.071069 Apr 16 21:32:13.474421 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2784/5730] 10.222.0.20 () {60 vars in 1288 bytes} [Sat Apr 16 21:32:13 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30/ips => generated 151 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:32:16.965404 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ee6e94e2-1156-4ad3-8a43-33bf165bd54c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:32:16.966958 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ee6e94e2-1156-4ad3-8a43-33bf165bd54c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:16.990805 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee6e94e2-1156-4ad3-8a43-33bf165bd54c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:16.992463 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee6e94e2-1156-4ad3-8a43-33bf165bd54c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:16.993305 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee6e94e2-1156-4ad3-8a43-33bf165bd54c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:16.999679 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee6e94e2-1156-4ad3-8a43-33bf165bd54c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:17.155569 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-ee6e94e2-1156-4ad3-8a43-33bf165bd54c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lazy-loading 'flavor' on Instance uuid b86e6830-cedb-4d55-a3b2-997462319b30 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:32:18.270668 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ee6e94e2-1156-4ad3-8a43-33bf165bd54c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "POST /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30/action" status: 202 len: 0 microversion: 2.20 time: 1.309689 Apr 16 21:32:18.271869 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2947/5731] 10.222.0.20 () {62 vars in 1318 bytes} [Sat Apr 16 21:32:16 2022] POST /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30/action => generated 0 bytes in 1312 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:32:18.281151 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7bccbdff-9a5a-494d-acd7-54b48c2a3d3e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:18.282401 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7bccbdff-9a5a-494d-acd7-54b48c2a3d3e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:18.289959 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7bccbdff-9a5a-494d-acd7-54b48c2a3d3e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:18.289959 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7bccbdff-9a5a-494d-acd7-54b48c2a3d3e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:18.290751 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7bccbdff-9a5a-494d-acd7-54b48c2a3d3e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:18.291205 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7bccbdff-9a5a-494d-acd7-54b48c2a3d3e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:19.008857 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7bccbdff-9a5a-494d-acd7-54b48c2a3d3e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:19.017473 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7bccbdff-9a5a-494d-acd7-54b48c2a3d3e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:19.021361 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7bccbdff-9a5a-494d-acd7-54b48c2a3d3e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:19.023049 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7bccbdff-9a5a-494d-acd7-54b48c2a3d3e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1722 microversion: 2.20 time: 0.746531 Apr 16 21:32:19.024247 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2785/5732] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:32:18 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1722 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:32:20.043431 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5a8155bc-ca0e-4943-9a01-e6c5f1679fdf tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:20.048462 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5a8155bc-ca0e-4943-9a01-e6c5f1679fdf tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:20.069134 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5a8155bc-ca0e-4943-9a01-e6c5f1679fdf tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:20.069614 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5a8155bc-ca0e-4943-9a01-e6c5f1679fdf tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:20.073212 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5a8155bc-ca0e-4943-9a01-e6c5f1679fdf tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:20.074510 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5a8155bc-ca0e-4943-9a01-e6c5f1679fdf tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:20.541378 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5a8155bc-ca0e-4943-9a01-e6c5f1679fdf tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:20.562058 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5a8155bc-ca0e-4943-9a01-e6c5f1679fdf tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:20.564736 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5a8155bc-ca0e-4943-9a01-e6c5f1679fdf tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:20.565968 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5a8155bc-ca0e-4943-9a01-e6c5f1679fdf tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1722 microversion: 2.20 time: 0.527004 Apr 16 21:32:20.567384 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2948/5733] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:32:20 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1722 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:32:21.590849 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fc2bb435-5c53-4583-826a-706049d06dc6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:21.593273 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-fc2bb435-5c53-4583-826a-706049d06dc6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:21.607135 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fc2bb435-5c53-4583-826a-706049d06dc6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:21.607135 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fc2bb435-5c53-4583-826a-706049d06dc6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:21.608036 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fc2bb435-5c53-4583-826a-706049d06dc6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:21.608036 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fc2bb435-5c53-4583-826a-706049d06dc6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:22.038139 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-fc2bb435-5c53-4583-826a-706049d06dc6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:22.064893 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-fc2bb435-5c53-4583-826a-706049d06dc6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:22.075508 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-fc2bb435-5c53-4583-826a-706049d06dc6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:22.077173 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fc2bb435-5c53-4583-826a-706049d06dc6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1722 microversion: 2.20 time: 0.496317 Apr 16 21:32:22.080217 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2786/5734] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:32:21 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1722 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:32:23.101486 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7c5b3cef-9104-4269-9b4f-6208cb9aae74 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:23.102886 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7c5b3cef-9104-4269-9b4f-6208cb9aae74 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:23.117443 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7c5b3cef-9104-4269-9b4f-6208cb9aae74 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:23.122444 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7c5b3cef-9104-4269-9b4f-6208cb9aae74 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:23.125078 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7c5b3cef-9104-4269-9b4f-6208cb9aae74 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:23.126835 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7c5b3cef-9104-4269-9b4f-6208cb9aae74 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:23.830054 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7c5b3cef-9104-4269-9b4f-6208cb9aae74 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:23.842638 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7c5b3cef-9104-4269-9b4f-6208cb9aae74 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:23.845847 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7c5b3cef-9104-4269-9b4f-6208cb9aae74 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:23.849403 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7c5b3cef-9104-4269-9b4f-6208cb9aae74 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1722 microversion: 2.20 time: 0.755208 Apr 16 21:32:23.857738 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2949/5735] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:32:23 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1722 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:32:23.933153 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4ca4f7d0-e845-4f06-98a6-2aaed0e560fa tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:23.934287 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4ca4f7d0-e845-4f06-98a6-2aaed0e560fa tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:23.947762 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4ca4f7d0-e845-4f06-98a6-2aaed0e560fa tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:23.951080 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4ca4f7d0-e845-4f06-98a6-2aaed0e560fa tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:23.952416 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4ca4f7d0-e845-4f06-98a6-2aaed0e560fa tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:23.953136 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4ca4f7d0-e845-4f06-98a6-2aaed0e560fa tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:24.885239 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-42e533ff-c7e6-48ce-8f2d-54800cac11cb tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:24.885883 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-42e533ff-c7e6-48ce-8f2d-54800cac11cb tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:24.899620 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-42e533ff-c7e6-48ce-8f2d-54800cac11cb tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:24.900398 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-42e533ff-c7e6-48ce-8f2d-54800cac11cb tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:24.901216 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-42e533ff-c7e6-48ce-8f2d-54800cac11cb tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:24.901672 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-42e533ff-c7e6-48ce-8f2d-54800cac11cb tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:25.119020 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4ca4f7d0-e845-4f06-98a6-2aaed0e560fa tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1836 microversion: 2.1 time: 1.189647 Apr 16 21:32:25.121693 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2787/5736] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:32:23 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1836 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:32:25.142001 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6923319a-a883-4d75-a721-a25733ea05ee tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:25.144302 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6923319a-a883-4d75-a721-a25733ea05ee tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:25.174155 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6923319a-a883-4d75-a721-a25733ea05ee tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:25.176568 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6923319a-a883-4d75-a721-a25733ea05ee tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:25.182187 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6923319a-a883-4d75-a721-a25733ea05ee tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:25.183824 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6923319a-a883-4d75-a721-a25733ea05ee tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:25.266965 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-42e533ff-c7e6-48ce-8f2d-54800cac11cb tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:25.283085 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-42e533ff-c7e6-48ce-8f2d-54800cac11cb tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:25.284724 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-42e533ff-c7e6-48ce-8f2d-54800cac11cb tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:25.286498 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-42e533ff-c7e6-48ce-8f2d-54800cac11cb tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1722 microversion: 2.20 time: 0.405138 Apr 16 21:32:25.287203 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2950/5737] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:32:24 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1722 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:32:26.111173 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6923319a-a883-4d75-a721-a25733ea05ee tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:26.121530 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6923319a-a883-4d75-a721-a25733ea05ee tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1685 microversion: 2.1 time: 0.985896 Apr 16 21:32:26.122196 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2788/5738] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:32:25 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1685 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:32:26.220399 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-05ee10f7-0a31-4b87-963c-b53d3360ddea tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:32:26.223283 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-05ee10f7-0a31-4b87-963c-b53d3360ddea tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:26.247877 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-05ee10f7-0a31-4b87-963c-b53d3360ddea tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:26.249942 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-05ee10f7-0a31-4b87-963c-b53d3360ddea tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:26.252746 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-05ee10f7-0a31-4b87-963c-b53d3360ddea tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:26.255702 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-05ee10f7-0a31-4b87-963c-b53d3360ddea tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:26.311860 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f9c1c392-6aa8-417d-a0fb-3e6a50b634c9 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:26.312892 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f9c1c392-6aa8-417d-a0fb-3e6a50b634c9 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:26.338969 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-05ee10f7-0a31-4b87-963c-b53d3360ddea tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "POST /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457/action" status: 200 len: 32645 microversion: 2.1 time: 0.120863 Apr 16 21:32:26.343289 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f9c1c392-6aa8-417d-a0fb-3e6a50b634c9 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:26.344147 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f9c1c392-6aa8-417d-a0fb-3e6a50b634c9 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:26.348623 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2951/5739] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:32:26 2022] POST /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457/action => generated 32645 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:32:26.349153 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f9c1c392-6aa8-417d-a0fb-3e6a50b634c9 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:26.349728 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f9c1c392-6aa8-417d-a0fb-3e6a50b634c9 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:26.496897 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5956c1e8-a05f-4557-b7a9-9ffb20e7a548 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:32:26.497743 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5956c1e8-a05f-4557-b7a9-9ffb20e7a548 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:26.514362 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5956c1e8-a05f-4557-b7a9-9ffb20e7a548 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:26.515149 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5956c1e8-a05f-4557-b7a9-9ffb20e7a548 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:26.517925 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5956c1e8-a05f-4557-b7a9-9ffb20e7a548 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:26.518685 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5956c1e8-a05f-4557-b7a9-9ffb20e7a548 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:26.616579 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5956c1e8-a05f-4557-b7a9-9ffb20e7a548 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'e96e42d9b66345579624d33c2caee061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b1d1209bf34874a82a0c9ee0081e9e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:26.617202 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5956c1e8-a05f-4557-b7a9-9ffb20e7a548 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] flavor_id is None. Assuming migration. {{(pid=137408) resize /opt/stack/nova/nova/compute/api.py:4140}} Apr 16 21:32:26.617652 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5956c1e8-a05f-4557-b7a9-9ffb20e7a548 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=137408) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 16 21:32:26.872460 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f9c1c392-6aa8-417d-a0fb-3e6a50b634c9 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:26.881332 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f9c1c392-6aa8-417d-a0fb-3e6a50b634c9 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:26.887576 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f9c1c392-6aa8-417d-a0fb-3e6a50b634c9 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:26.891659 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f9c1c392-6aa8-417d-a0fb-3e6a50b634c9 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1722 microversion: 2.20 time: 0.584698 Apr 16 21:32:26.895324 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2789/5740] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:32:26 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1722 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:32:27.598294 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5956c1e8-a05f-4557-b7a9-9ffb20e7a548 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457/action" status: 202 len: 0 microversion: 2.1 time: 1.105972 Apr 16 21:32:27.602787 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2952/5741] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:32:26 2022] POST /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457/action => generated 0 bytes in 1111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:32:27.612556 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-55e068a9-1585-4ce5-87f7-4423c2350574 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:27.613895 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-55e068a9-1585-4ce5-87f7-4423c2350574 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:27.622156 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-55e068a9-1585-4ce5-87f7-4423c2350574 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:27.622973 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-55e068a9-1585-4ce5-87f7-4423c2350574 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:27.623949 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-55e068a9-1585-4ce5-87f7-4423c2350574 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:27.624764 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-55e068a9-1585-4ce5-87f7-4423c2350574 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:27.886549 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-55e068a9-1585-4ce5-87f7-4423c2350574 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:27.896048 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-55e068a9-1585-4ce5-87f7-4423c2350574 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1694 microversion: 2.1 time: 0.288704 Apr 16 21:32:27.908954 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2790/5742] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:32:27 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1694 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:32:27.915546 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a9c2a3b6-996d-4feb-bb83-aa435fa4d4e7 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:27.916413 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a9c2a3b6-996d-4feb-bb83-aa435fa4d4e7 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:27.929072 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9c2a3b6-996d-4feb-bb83-aa435fa4d4e7 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:27.929913 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9c2a3b6-996d-4feb-bb83-aa435fa4d4e7 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:27.931246 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9c2a3b6-996d-4feb-bb83-aa435fa4d4e7 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:27.932088 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9c2a3b6-996d-4feb-bb83-aa435fa4d4e7 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:28.294284 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a9c2a3b6-996d-4feb-bb83-aa435fa4d4e7 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:28.306818 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a9c2a3b6-996d-4feb-bb83-aa435fa4d4e7 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:28.313014 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a9c2a3b6-996d-4feb-bb83-aa435fa4d4e7 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:28.314272 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a9c2a3b6-996d-4feb-bb83-aa435fa4d4e7 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1722 microversion: 2.20 time: 0.403410 Apr 16 21:32:28.314892 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2953/5743] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:32:27 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1722 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:32:28.929977 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-596f500d-a67b-4f46-b8bc-cab45c60af88 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:28.930606 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-596f500d-a67b-4f46-b8bc-cab45c60af88 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:28.952434 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-596f500d-a67b-4f46-b8bc-cab45c60af88 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:28.953071 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-596f500d-a67b-4f46-b8bc-cab45c60af88 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:28.953981 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-596f500d-a67b-4f46-b8bc-cab45c60af88 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:28.954422 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-596f500d-a67b-4f46-b8bc-cab45c60af88 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:29.333997 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f6c26cb5-9c7e-4647-b587-1bfc0894edb6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:29.334701 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f6c26cb5-9c7e-4647-b587-1bfc0894edb6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:29.357668 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6c26cb5-9c7e-4647-b587-1bfc0894edb6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:29.358369 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6c26cb5-9c7e-4647-b587-1bfc0894edb6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:29.361226 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6c26cb5-9c7e-4647-b587-1bfc0894edb6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:29.361884 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6c26cb5-9c7e-4647-b587-1bfc0894edb6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:29.610556 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-596f500d-a67b-4f46-b8bc-cab45c60af88 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:29.625308 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-596f500d-a67b-4f46-b8bc-cab45c60af88 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1694 microversion: 2.1 time: 0.703899 Apr 16 21:32:29.639462 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2791/5744] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:32:28 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1694 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:32:30.319915 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f6c26cb5-9c7e-4647-b587-1bfc0894edb6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:30.350177 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f6c26cb5-9c7e-4647-b587-1bfc0894edb6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:30.351781 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f6c26cb5-9c7e-4647-b587-1bfc0894edb6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:30.360036 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f6c26cb5-9c7e-4647-b587-1bfc0894edb6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1722 microversion: 2.20 time: 1.030304 Apr 16 21:32:30.364769 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2954/5745] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:32:29 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1722 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:32:30.645760 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-64ba651d-5a08-4a22-8361-4ed1dd1e1acb tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:30.646385 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-64ba651d-5a08-4a22-8361-4ed1dd1e1acb tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:30.655943 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-64ba651d-5a08-4a22-8361-4ed1dd1e1acb tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:30.657095 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-64ba651d-5a08-4a22-8361-4ed1dd1e1acb tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:30.657997 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-64ba651d-5a08-4a22-8361-4ed1dd1e1acb tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:30.658513 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-64ba651d-5a08-4a22-8361-4ed1dd1e1acb tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:31.309281 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-64ba651d-5a08-4a22-8361-4ed1dd1e1acb tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:31.327952 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-64ba651d-5a08-4a22-8361-4ed1dd1e1acb tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1694 microversion: 2.1 time: 0.684592 Apr 16 21:32:31.332732 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2792/5746] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:32:30 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1694 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:32:31.382156 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5a71038f-dbc9-40a8-b4ab-6be15b5d71bd tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:31.383339 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5a71038f-dbc9-40a8-b4ab-6be15b5d71bd tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:31.391551 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5a71038f-dbc9-40a8-b4ab-6be15b5d71bd tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:31.392360 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5a71038f-dbc9-40a8-b4ab-6be15b5d71bd tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:31.394983 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5a71038f-dbc9-40a8-b4ab-6be15b5d71bd tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:31.395638 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5a71038f-dbc9-40a8-b4ab-6be15b5d71bd tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:31.696120 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5a71038f-dbc9-40a8-b4ab-6be15b5d71bd tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:31.710354 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5a71038f-dbc9-40a8-b4ab-6be15b5d71bd tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:31.712717 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5a71038f-dbc9-40a8-b4ab-6be15b5d71bd tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:31.715196 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5a71038f-dbc9-40a8-b4ab-6be15b5d71bd tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1743 microversion: 2.20 time: 0.337256 Apr 16 21:32:31.716372 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2955/5747] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:32:31 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1743 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:32:32.055491 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6818a364-be78-46a3-9330-a2848cdd1d76 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1081616522", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "1beb4ec8-1c21-4d51-8bea-7d6c54b461fd"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:32:32.159353 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-6818a364-be78-46a3-9330-a2848cdd1d76 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] validate_networks() for [('1beb4ec8-1c21-4d51-8bea-7d6c54b461fd', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:32:32.348134 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c9c60c94-45f7-4a6c-86ed-a0dde2595668 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:32.348933 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c9c60c94-45f7-4a6c-86ed-a0dde2595668 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:32.362661 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c9c60c94-45f7-4a6c-86ed-a0dde2595668 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:32.363139 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c9c60c94-45f7-4a6c-86ed-a0dde2595668 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:32.363954 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c9c60c94-45f7-4a6c-86ed-a0dde2595668 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:32.364438 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c9c60c94-45f7-4a6c-86ed-a0dde2595668 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:32.869064 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c9c60c94-45f7-4a6c-86ed-a0dde2595668 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:32.878749 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c9c60c94-45f7-4a6c-86ed-a0dde2595668 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1694 microversion: 2.1 time: 0.534523 Apr 16 21:32:32.899888 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2956/5748] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:32:32 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1694 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:32:32.905166 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-6ec8998c-6756-431d-bfc2-df1525571328 req-9d2bbfd0-53be-4cee-9d29-ede744ca4035 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b86e6830-cedb-4d55-a3b2-997462319b30", "name": "network-vif-plugged", "status": "completed", "tag": "b966fc7e-0221-46eb-a92a-00d9f48a8a41"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:32:32.924325 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-6ec8998c-6756-431d-bfc2-df1525571328 req-9d2bbfd0-53be-4cee-9d29-ede744ca4035 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:32.924795 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-6ec8998c-6756-431d-bfc2-df1525571328 req-9d2bbfd0-53be-4cee-9d29-ede744ca4035 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:32.950079 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-6ec8998c-6756-431d-bfc2-df1525571328 req-9d2bbfd0-53be-4cee-9d29-ede744ca4035 service nova] Creating event network-vif-plugged:b966fc7e-0221-46eb-a92a-00d9f48a8a41 for instance b86e6830-cedb-4d55-a3b2-997462319b30 on nch2-master-1 Apr 16 21:32:32.967829 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-6ec8998c-6756-431d-bfc2-df1525571328 req-9d2bbfd0-53be-4cee-9d29-ede744ca4035 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066318 Apr 16 21:32:32.968491 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2957/5749] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:32:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:32:32.973807 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e12878e7-03d9-4641-bbdc-f504d42fef57 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:32.974533 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e12878e7-03d9-4641-bbdc-f504d42fef57 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:32.987823 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e12878e7-03d9-4641-bbdc-f504d42fef57 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:32.988333 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e12878e7-03d9-4641-bbdc-f504d42fef57 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:32.989145 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e12878e7-03d9-4641-bbdc-f504d42fef57 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:32.989603 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e12878e7-03d9-4641-bbdc-f504d42fef57 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:33.308518 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e12878e7-03d9-4641-bbdc-f504d42fef57 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:33.324504 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e12878e7-03d9-4641-bbdc-f504d42fef57 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:33.327687 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e12878e7-03d9-4641-bbdc-f504d42fef57 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:33.329194 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e12878e7-03d9-4641-bbdc-f504d42fef57 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1743 microversion: 2.20 time: 0.359424 Apr 16 21:32:33.344600 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2958/5750] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:32:32 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1743 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:32:33.696486 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-6818a364-be78-46a3-9330-a2848cdd1d76 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:32:33.697011 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-6818a364-be78-46a3-9330-a2848cdd1d76 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:32:33.697435 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-6818a364-be78-46a3-9330-a2848cdd1d76 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:32:33.697890 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-6818a364-be78-46a3-9330-a2848cdd1d76 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:32:33.698301 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-6818a364-be78-46a3-9330-a2848cdd1d76 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:32:33.714937 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6818a364-be78-46a3-9330-a2848cdd1d76 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:33.715398 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6818a364-be78-46a3-9330-a2848cdd1d76 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:33.716259 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6818a364-be78-46a3-9330-a2848cdd1d76 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:33.717287 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6818a364-be78-46a3-9330-a2848cdd1d76 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:33.762492 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-6818a364-be78-46a3-9330-a2848cdd1d76 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Getting quotas for project 85e899913f3f46e2b9ed44d5d6082195. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:32:33.776414 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-6818a364-be78-46a3-9330-a2848cdd1d76 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Getting quotas for user c637fe804de14ee5986e914a3e0c9329 and project 85e899913f3f46e2b9ed44d5d6082195. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:32:33.795441 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6818a364-be78-46a3-9330-a2848cdd1d76 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:32:33.797783 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6818a364-be78-46a3-9330-a2848cdd1d76 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] [instance: 8ea5d86a-4000-4ae6-81f2-3b2232b06db0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:32:33.910248 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-98b34155-0a16-4236-af54-6af5931a0da0 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:33.911530 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-98b34155-0a16-4236-af54-6af5931a0da0 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:33.926448 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6818a364-be78-46a3-9330-a2848cdd1d76 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.082498 Apr 16 21:32:33.928307 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2793/5751] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:32:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2085 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:32:33.933778 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-98b34155-0a16-4236-af54-6af5931a0da0 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:33.935582 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-98b34155-0a16-4236-af54-6af5931a0da0 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:33.936884 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-98b34155-0a16-4236-af54-6af5931a0da0 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:33.938580 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-eacbae2f-0c9e-472a-9e6a-69240d6643b9 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:33.941140 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-98b34155-0a16-4236-af54-6af5931a0da0 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:33.941287 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-eacbae2f-0c9e-472a-9e6a-69240d6643b9 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] [instance: 8ea5d86a-4000-4ae6-81f2-3b2232b06db0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:34.309301 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-98b34155-0a16-4236-af54-6af5931a0da0 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:34.320991 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-98b34155-0a16-4236-af54-6af5931a0da0 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1694 microversion: 2.1 time: 0.415703 Apr 16 21:32:34.323686 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2959/5752] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:32:33 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1694 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:32:34.349831 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fa0c0be0-af0f-4da2-9dcd-0098f94b6be6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:34.352510 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fa0c0be0-af0f-4da2-9dcd-0098f94b6be6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:34.359557 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fa0c0be0-af0f-4da2-9dcd-0098f94b6be6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:34.360269 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fa0c0be0-af0f-4da2-9dcd-0098f94b6be6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:34.361068 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fa0c0be0-af0f-4da2-9dcd-0098f94b6be6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:34.361509 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fa0c0be0-af0f-4da2-9dcd-0098f94b6be6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:34.437575 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-eacbae2f-0c9e-472a-9e6a-69240d6643b9 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c637fe804de14ee5986e914a3e0c9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85e899913f3f46e2b9ed44d5d6082195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:34.449351 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-eacbae2f-0c9e-472a-9e6a-69240d6643b9 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] 10.222.0.20 "GET /compute/v2.1/servers/8ea5d86a-4000-4ae6-81f2-3b2232b06db0" status: 200 len: 1225 microversion: 2.1 time: 0.516025 Apr 16 21:32:34.450670 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2794/5753] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:32:33 2022] GET /compute/v2.1/servers/8ea5d86a-4000-4ae6-81f2-3b2232b06db0 => generated 1225 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:32:35.084641 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fa0c0be0-af0f-4da2-9dcd-0098f94b6be6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:35.099303 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fa0c0be0-af0f-4da2-9dcd-0098f94b6be6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:35.101056 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fa0c0be0-af0f-4da2-9dcd-0098f94b6be6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:35.102201 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fa0c0be0-af0f-4da2-9dcd-0098f94b6be6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1743 microversion: 2.20 time: 0.756166 Apr 16 21:32:35.107080 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2960/5754] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:32:34 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1743 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:32:35.340517 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fd1fa3c4-fa74-480d-9b54-bdadd47a5c29 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:35.342439 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-fd1fa3c4-fa74-480d-9b54-bdadd47a5c29 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:35.369418 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fd1fa3c4-fa74-480d-9b54-bdadd47a5c29 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:35.370406 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fd1fa3c4-fa74-480d-9b54-bdadd47a5c29 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:35.374553 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fd1fa3c4-fa74-480d-9b54-bdadd47a5c29 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:35.375263 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fd1fa3c4-fa74-480d-9b54-bdadd47a5c29 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:35.467184 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3a8116bf-5cda-4294-99d1-37a8505e0e60 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:35.467985 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3a8116bf-5cda-4294-99d1-37a8505e0e60 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] [instance: 8ea5d86a-4000-4ae6-81f2-3b2232b06db0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:35.480946 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3a8116bf-5cda-4294-99d1-37a8505e0e60 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:35.481612 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3a8116bf-5cda-4294-99d1-37a8505e0e60 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:35.482616 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3a8116bf-5cda-4294-99d1-37a8505e0e60 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:35.488609 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3a8116bf-5cda-4294-99d1-37a8505e0e60 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:35.842774 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-fd1fa3c4-fa74-480d-9b54-bdadd47a5c29 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:35.852574 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fd1fa3c4-fa74-480d-9b54-bdadd47a5c29 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1699 microversion: 2.1 time: 0.516860 Apr 16 21:32:35.853180 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2795/5755] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:32:35 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1699 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:32:35.984513 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3a8116bf-5cda-4294-99d1-37a8505e0e60 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c637fe804de14ee5986e914a3e0c9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85e899913f3f46e2b9ed44d5d6082195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:35.996027 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3a8116bf-5cda-4294-99d1-37a8505e0e60 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] 10.222.0.20 "GET /compute/v2.1/servers/8ea5d86a-4000-4ae6-81f2-3b2232b06db0" status: 200 len: 1229 microversion: 2.1 time: 0.533397 Apr 16 21:32:35.996662 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2961/5756] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:32:35 2022] GET /compute/v2.1/servers/8ea5d86a-4000-4ae6-81f2-3b2232b06db0 => generated 1229 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:32:36.133247 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ce05dd05-283e-46e5-ba87-f60d24e59166 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:36.138950 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ce05dd05-283e-46e5-ba87-f60d24e59166 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:36.148349 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ce05dd05-283e-46e5-ba87-f60d24e59166 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:36.148816 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ce05dd05-283e-46e5-ba87-f60d24e59166 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:36.153256 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ce05dd05-283e-46e5-ba87-f60d24e59166 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:36.153940 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ce05dd05-283e-46e5-ba87-f60d24e59166 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:36.767843 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ce05dd05-283e-46e5-ba87-f60d24e59166 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:36.786503 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ce05dd05-283e-46e5-ba87-f60d24e59166 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:36.787395 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ce05dd05-283e-46e5-ba87-f60d24e59166 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:36.789888 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ce05dd05-283e-46e5-ba87-f60d24e59166 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1738 microversion: 2.20 time: 0.665391 Apr 16 21:32:36.790829 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2796/5757] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:32:36 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1738 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:32:36.874716 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9c26c1d9-c4c2-4f8e-81a7-020be085e7f1 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:36.874716 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9c26c1d9-c4c2-4f8e-81a7-020be085e7f1 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:36.885623 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9c26c1d9-c4c2-4f8e-81a7-020be085e7f1 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:36.886613 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9c26c1d9-c4c2-4f8e-81a7-020be085e7f1 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:36.887643 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9c26c1d9-c4c2-4f8e-81a7-020be085e7f1 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:36.889337 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9c26c1d9-c4c2-4f8e-81a7-020be085e7f1 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:37.013059 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-108d586f-aa96-4cfc-963e-50c19deb4089 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:37.014086 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-108d586f-aa96-4cfc-963e-50c19deb4089 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] [instance: 8ea5d86a-4000-4ae6-81f2-3b2232b06db0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:37.022667 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-108d586f-aa96-4cfc-963e-50c19deb4089 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:37.029764 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-108d586f-aa96-4cfc-963e-50c19deb4089 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:37.031076 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-108d586f-aa96-4cfc-963e-50c19deb4089 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:37.033095 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-108d586f-aa96-4cfc-963e-50c19deb4089 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:37.173361 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-108d586f-aa96-4cfc-963e-50c19deb4089 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c637fe804de14ee5986e914a3e0c9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85e899913f3f46e2b9ed44d5d6082195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:37.185589 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-108d586f-aa96-4cfc-963e-50c19deb4089 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] 10.222.0.20 "GET /compute/v2.1/servers/8ea5d86a-4000-4ae6-81f2-3b2232b06db0" status: 200 len: 1285 microversion: 2.1 time: 0.176215 Apr 16 21:32:37.188589 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2797/5758] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:32:37 2022] GET /compute/v2.1/servers/8ea5d86a-4000-4ae6-81f2-3b2232b06db0 => generated 1285 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:32:37.587083 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9c26c1d9-c4c2-4f8e-81a7-020be085e7f1 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:37.601351 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9c26c1d9-c4c2-4f8e-81a7-020be085e7f1 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1699 microversion: 2.1 time: 0.734124 Apr 16 21:32:37.617825 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2962/5759] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:32:36 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1699 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:32:37.813927 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-68359418-b4e7-4522-849b-69ebdb06bdaf tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:37.814542 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-68359418-b4e7-4522-849b-69ebdb06bdaf tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:37.830958 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-68359418-b4e7-4522-849b-69ebdb06bdaf tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:37.831707 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-68359418-b4e7-4522-849b-69ebdb06bdaf tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:37.832761 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-68359418-b4e7-4522-849b-69ebdb06bdaf tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:37.833212 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-68359418-b4e7-4522-849b-69ebdb06bdaf tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:38.206456 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a7db355d-5e8a-4ddc-9f3f-f835f475a918 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:38.208057 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a7db355d-5e8a-4ddc-9f3f-f835f475a918 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] [instance: 8ea5d86a-4000-4ae6-81f2-3b2232b06db0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:38.216396 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a7db355d-5e8a-4ddc-9f3f-f835f475a918 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:38.225873 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a7db355d-5e8a-4ddc-9f3f-f835f475a918 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:38.229799 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a7db355d-5e8a-4ddc-9f3f-f835f475a918 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:38.230333 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a7db355d-5e8a-4ddc-9f3f-f835f475a918 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:38.235197 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-68359418-b4e7-4522-849b-69ebdb06bdaf tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:38.260106 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-68359418-b4e7-4522-849b-69ebdb06bdaf tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:38.269074 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-68359418-b4e7-4522-849b-69ebdb06bdaf tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:38.276258 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-68359418-b4e7-4522-849b-69ebdb06bdaf tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1738 microversion: 2.20 time: 0.465953 Apr 16 21:32:38.280149 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2798/5760] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:32:37 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1738 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:32:38.393412 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a7db355d-5e8a-4ddc-9f3f-f835f475a918 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c637fe804de14ee5986e914a3e0c9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85e899913f3f46e2b9ed44d5d6082195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:38.415967 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a7db355d-5e8a-4ddc-9f3f-f835f475a918 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] 10.222.0.20 "GET /compute/v2.1/servers/8ea5d86a-4000-4ae6-81f2-3b2232b06db0" status: 200 len: 1283 microversion: 2.1 time: 0.211489 Apr 16 21:32:38.419069 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2963/5761] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:32:38 2022] GET /compute/v2.1/servers/8ea5d86a-4000-4ae6-81f2-3b2232b06db0 => generated 1283 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:32:38.631953 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4bf58ea5-d596-4ebe-9c22-5f8211827961 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:38.632767 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4bf58ea5-d596-4ebe-9c22-5f8211827961 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:38.646360 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4bf58ea5-d596-4ebe-9c22-5f8211827961 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:38.647166 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4bf58ea5-d596-4ebe-9c22-5f8211827961 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:38.652037 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4bf58ea5-d596-4ebe-9c22-5f8211827961 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:38.652037 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4bf58ea5-d596-4ebe-9c22-5f8211827961 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:39.181866 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4bf58ea5-d596-4ebe-9c22-5f8211827961 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:39.193361 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4bf58ea5-d596-4ebe-9c22-5f8211827961 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1699 microversion: 2.1 time: 0.576464 Apr 16 21:32:39.195385 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2799/5762] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:32:38 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1699 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:32:39.299916 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c162de38-23a4-41b7-861d-9ec33049256f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:39.300684 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c162de38-23a4-41b7-861d-9ec33049256f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:39.319825 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c162de38-23a4-41b7-861d-9ec33049256f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:39.322086 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c162de38-23a4-41b7-861d-9ec33049256f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:39.327467 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c162de38-23a4-41b7-861d-9ec33049256f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:39.328385 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c162de38-23a4-41b7-861d-9ec33049256f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:39.436757 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-255cb155-aacc-49db-b759-deb9d235425c tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:39.438015 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-255cb155-aacc-49db-b759-deb9d235425c tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] [instance: 8ea5d86a-4000-4ae6-81f2-3b2232b06db0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:39.449009 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-255cb155-aacc-49db-b759-deb9d235425c tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:39.449470 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-255cb155-aacc-49db-b759-deb9d235425c tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:39.450264 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-255cb155-aacc-49db-b759-deb9d235425c tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:39.458315 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-255cb155-aacc-49db-b759-deb9d235425c tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:39.955993 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-255cb155-aacc-49db-b759-deb9d235425c tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c637fe804de14ee5986e914a3e0c9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85e899913f3f46e2b9ed44d5d6082195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:39.963589 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-255cb155-aacc-49db-b759-deb9d235425c tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] 10.222.0.20 "GET /compute/v2.1/servers/8ea5d86a-4000-4ae6-81f2-3b2232b06db0" status: 200 len: 1325 microversion: 2.1 time: 0.534083 Apr 16 21:32:39.964376 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2800/5763] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:32:39 2022] GET /compute/v2.1/servers/8ea5d86a-4000-4ae6-81f2-3b2232b06db0 => generated 1325 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:32:40.081970 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c162de38-23a4-41b7-861d-9ec33049256f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:40.090497 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c162de38-23a4-41b7-861d-9ec33049256f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:40.092817 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c162de38-23a4-41b7-861d-9ec33049256f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:40.095483 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c162de38-23a4-41b7-861d-9ec33049256f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1738 microversion: 2.20 time: 0.800481 Apr 16 21:32:40.100142 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2964/5764] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:32:39 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1738 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:32:40.213146 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-42a593a0-38c5-4541-a334-64a1f393e68c tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:40.213675 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-42a593a0-38c5-4541-a334-64a1f393e68c tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:40.222053 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-42a593a0-38c5-4541-a334-64a1f393e68c tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:40.222515 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-42a593a0-38c5-4541-a334-64a1f393e68c tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:40.227874 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-42a593a0-38c5-4541-a334-64a1f393e68c tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:40.228586 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-42a593a0-38c5-4541-a334-64a1f393e68c tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:40.984608 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-db10ac4c-32b9-4f87-91fa-9e04d3ac18d2 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:40.985228 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-db10ac4c-32b9-4f87-91fa-9e04d3ac18d2 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] [instance: 8ea5d86a-4000-4ae6-81f2-3b2232b06db0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:41.007310 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-db10ac4c-32b9-4f87-91fa-9e04d3ac18d2 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:41.008088 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-db10ac4c-32b9-4f87-91fa-9e04d3ac18d2 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:41.009101 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-db10ac4c-32b9-4f87-91fa-9e04d3ac18d2 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:41.009748 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-db10ac4c-32b9-4f87-91fa-9e04d3ac18d2 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:41.241523 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-42a593a0-38c5-4541-a334-64a1f393e68c tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:41.255624 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-42a593a0-38c5-4541-a334-64a1f393e68c tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1699 microversion: 2.1 time: 1.047000 Apr 16 21:32:41.256976 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2801/5765] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:32:40 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1699 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:32:41.263644 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-97fd3082-5733-4f03-89eb-127765713ea6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:41.267353 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-97fd3082-5733-4f03-89eb-127765713ea6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:41.282600 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-97fd3082-5733-4f03-89eb-127765713ea6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:41.283067 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-97fd3082-5733-4f03-89eb-127765713ea6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:41.283859 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-97fd3082-5733-4f03-89eb-127765713ea6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:41.286584 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-97fd3082-5733-4f03-89eb-127765713ea6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:41.877228 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-db10ac4c-32b9-4f87-91fa-9e04d3ac18d2 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c637fe804de14ee5986e914a3e0c9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85e899913f3f46e2b9ed44d5d6082195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:41.891121 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-db10ac4c-32b9-4f87-91fa-9e04d3ac18d2 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] 10.222.0.20 "GET /compute/v2.1/servers/8ea5d86a-4000-4ae6-81f2-3b2232b06db0" status: 200 len: 1325 microversion: 2.1 time: 0.910267 Apr 16 21:32:41.891748 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2965/5766] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:32:40 2022] GET /compute/v2.1/servers/8ea5d86a-4000-4ae6-81f2-3b2232b06db0 => generated 1325 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:32:42.025259 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-97fd3082-5733-4f03-89eb-127765713ea6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:42.037717 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-97fd3082-5733-4f03-89eb-127765713ea6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:42.040112 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-97fd3082-5733-4f03-89eb-127765713ea6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:42.041793 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-97fd3082-5733-4f03-89eb-127765713ea6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1738 microversion: 2.20 time: 0.783618 Apr 16 21:32:42.042749 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2802/5767] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:32:41 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1738 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:32:42.273729 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-73914f50-0783-4ffc-b7ab-723e8db1ad5b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:42.276458 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-73914f50-0783-4ffc-b7ab-723e8db1ad5b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:42.301599 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-73914f50-0783-4ffc-b7ab-723e8db1ad5b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:42.302288 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-73914f50-0783-4ffc-b7ab-723e8db1ad5b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:42.304486 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-73914f50-0783-4ffc-b7ab-723e8db1ad5b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:42.308294 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-73914f50-0783-4ffc-b7ab-723e8db1ad5b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:42.644309 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-ea54164e-cdcb-4488-9da8-b3cdc9d7aa71 req-f75afe4b-1b84-4ca3-a491-396e417f27e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ea5d86a-4000-4ae6-81f2-3b2232b06db0", "tag": "b28326fa-0cd8-494d-8422-4348cddbe7a4"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:32:42.667665 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-ea54164e-cdcb-4488-9da8-b3cdc9d7aa71 req-f75afe4b-1b84-4ca3-a491-396e417f27e9 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:42.696464 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-ea54164e-cdcb-4488-9da8-b3cdc9d7aa71 req-f75afe4b-1b84-4ca3-a491-396e417f27e9 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:42.733713 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-ea54164e-cdcb-4488-9da8-b3cdc9d7aa71 req-f75afe4b-1b84-4ca3-a491-396e417f27e9 service nova] Creating event network-changed:b28326fa-0cd8-494d-8422-4348cddbe7a4 for instance 8ea5d86a-4000-4ae6-81f2-3b2232b06db0 on nch1-master-1 Apr 16 21:32:42.756864 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-ea54164e-cdcb-4488-9da8-b3cdc9d7aa71 req-f75afe4b-1b84-4ca3-a491-396e417f27e9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105201 Apr 16 21:32:42.759392 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2803/5768] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:32:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:32:42.911318 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a53378a6-5240-49b9-8c50-fadf2bcd9b3e tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:42.912715 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a53378a6-5240-49b9-8c50-fadf2bcd9b3e tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] [instance: 8ea5d86a-4000-4ae6-81f2-3b2232b06db0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:42.927906 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a53378a6-5240-49b9-8c50-fadf2bcd9b3e tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:42.928429 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a53378a6-5240-49b9-8c50-fadf2bcd9b3e tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:42.929277 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a53378a6-5240-49b9-8c50-fadf2bcd9b3e tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:42.944837 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a53378a6-5240-49b9-8c50-fadf2bcd9b3e tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:43.159143 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-73914f50-0783-4ffc-b7ab-723e8db1ad5b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:43.168051 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-73914f50-0783-4ffc-b7ab-723e8db1ad5b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1699 microversion: 2.1 time: 0.898386 Apr 16 21:32:43.175232 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2966/5769] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:32:42 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1699 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:32:43.193191 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-51411d65-a71d-4afd-ac6d-cd0daae27a33 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:43.198368 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-51411d65-a71d-4afd-ac6d-cd0daae27a33 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:43.225749 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-51411d65-a71d-4afd-ac6d-cd0daae27a33 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:43.227802 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-51411d65-a71d-4afd-ac6d-cd0daae27a33 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:43.230219 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-51411d65-a71d-4afd-ac6d-cd0daae27a33 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:43.234465 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-51411d65-a71d-4afd-ac6d-cd0daae27a33 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:43.653048 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-51411d65-a71d-4afd-ac6d-cd0daae27a33 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:43.662644 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-51411d65-a71d-4afd-ac6d-cd0daae27a33 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:43.671280 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-51411d65-a71d-4afd-ac6d-cd0daae27a33 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:43.672926 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-51411d65-a71d-4afd-ac6d-cd0daae27a33 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1738 microversion: 2.20 time: 0.496572 Apr 16 21:32:43.673761 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2967/5770] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:32:43 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1738 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:32:43.805097 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a53378a6-5240-49b9-8c50-fadf2bcd9b3e tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c637fe804de14ee5986e914a3e0c9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85e899913f3f46e2b9ed44d5d6082195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:43.813516 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a53378a6-5240-49b9-8c50-fadf2bcd9b3e tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] 10.222.0.20 "GET /compute/v2.1/servers/8ea5d86a-4000-4ae6-81f2-3b2232b06db0" status: 200 len: 1325 microversion: 2.1 time: 0.907553 Apr 16 21:32:43.827649 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2804/5771] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:32:42 2022] GET /compute/v2.1/servers/8ea5d86a-4000-4ae6-81f2-3b2232b06db0 => generated 1325 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:32:44.197048 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2d5837ee-534c-406d-ad80-b2fca95d4ec7 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:44.210326 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2d5837ee-534c-406d-ad80-b2fca95d4ec7 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:44.224040 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2d5837ee-534c-406d-ad80-b2fca95d4ec7 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:44.224977 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2d5837ee-534c-406d-ad80-b2fca95d4ec7 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:44.226989 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2d5837ee-534c-406d-ad80-b2fca95d4ec7 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:44.227716 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2d5837ee-534c-406d-ad80-b2fca95d4ec7 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:44.689773 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2d5837ee-534c-406d-ad80-b2fca95d4ec7 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:44.692909 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0c744c1f-44aa-482a-a7de-a78e28d91e4a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:44.693543 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0c744c1f-44aa-482a-a7de-a78e28d91e4a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:44.697879 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2d5837ee-534c-406d-ad80-b2fca95d4ec7 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1699 microversion: 2.1 time: 0.507425 Apr 16 21:32:44.702621 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2968/5772] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:32:44 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1699 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:32:44.706147 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0c744c1f-44aa-482a-a7de-a78e28d91e4a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:44.708790 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0c744c1f-44aa-482a-a7de-a78e28d91e4a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:44.714061 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0c744c1f-44aa-482a-a7de-a78e28d91e4a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:44.714061 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0c744c1f-44aa-482a-a7de-a78e28d91e4a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:44.831409 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-dba31ec4-44aa-4cd2-a56e-0ef4d61ff82d tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:44.832235 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-dba31ec4-44aa-4cd2-a56e-0ef4d61ff82d tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] [instance: 8ea5d86a-4000-4ae6-81f2-3b2232b06db0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:44.842349 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dba31ec4-44aa-4cd2-a56e-0ef4d61ff82d tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:44.847501 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dba31ec4-44aa-4cd2-a56e-0ef4d61ff82d tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:44.848371 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dba31ec4-44aa-4cd2-a56e-0ef4d61ff82d tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:44.853417 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dba31ec4-44aa-4cd2-a56e-0ef4d61ff82d tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:45.184958 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-dba31ec4-44aa-4cd2-a56e-0ef4d61ff82d tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c637fe804de14ee5986e914a3e0c9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85e899913f3f46e2b9ed44d5d6082195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:45.198203 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-dba31ec4-44aa-4cd2-a56e-0ef4d61ff82d tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] 10.222.0.20 "GET /compute/v2.1/servers/8ea5d86a-4000-4ae6-81f2-3b2232b06db0" status: 200 len: 1325 microversion: 2.1 time: 0.370598 Apr 16 21:32:45.201889 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2969/5773] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:32:44 2022] GET /compute/v2.1/servers/8ea5d86a-4000-4ae6-81f2-3b2232b06db0 => generated 1325 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:32:45.719128 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-24b01484-7504-4ee2-afcc-e8a50e92cc6d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:45.719825 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-24b01484-7504-4ee2-afcc-e8a50e92cc6d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:45.736592 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-24b01484-7504-4ee2-afcc-e8a50e92cc6d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:45.737069 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-24b01484-7504-4ee2-afcc-e8a50e92cc6d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:45.739395 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-24b01484-7504-4ee2-afcc-e8a50e92cc6d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:45.744989 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-24b01484-7504-4ee2-afcc-e8a50e92cc6d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:45.858877 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0c744c1f-44aa-482a-a7de-a78e28d91e4a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:45.873039 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0c744c1f-44aa-482a-a7de-a78e28d91e4a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:45.874691 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0c744c1f-44aa-482a-a7de-a78e28d91e4a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:45.875904 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0c744c1f-44aa-482a-a7de-a78e28d91e4a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1738 microversion: 2.20 time: 1.187713 Apr 16 21:32:45.876813 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2805/5774] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:32:44 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1738 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:32:46.081459 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-24b01484-7504-4ee2-afcc-e8a50e92cc6d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:46.089455 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-24b01484-7504-4ee2-afcc-e8a50e92cc6d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1699 microversion: 2.1 time: 0.377803 Apr 16 21:32:46.100371 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2970/5775] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:32:45 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1699 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:32:46.214938 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c1f24fa2-37bd-4016-9e60-b75a48703efc tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:46.215978 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c1f24fa2-37bd-4016-9e60-b75a48703efc tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] [instance: 8ea5d86a-4000-4ae6-81f2-3b2232b06db0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:46.232925 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c1f24fa2-37bd-4016-9e60-b75a48703efc tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:46.232925 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c1f24fa2-37bd-4016-9e60-b75a48703efc tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:46.232925 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c1f24fa2-37bd-4016-9e60-b75a48703efc tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:46.232925 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c1f24fa2-37bd-4016-9e60-b75a48703efc tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:46.549831 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c1f24fa2-37bd-4016-9e60-b75a48703efc tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c637fe804de14ee5986e914a3e0c9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85e899913f3f46e2b9ed44d5d6082195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:46.558970 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c1f24fa2-37bd-4016-9e60-b75a48703efc tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] 10.222.0.20 "GET /compute/v2.1/servers/8ea5d86a-4000-4ae6-81f2-3b2232b06db0" status: 200 len: 1325 microversion: 2.1 time: 0.347731 Apr 16 21:32:46.563451 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2806/5776] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:32:46 2022] GET /compute/v2.1/servers/8ea5d86a-4000-4ae6-81f2-3b2232b06db0 => generated 1325 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:32:46.894602 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b6ef2cda-4f01-407e-91b8-af012274472b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:46.896940 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b6ef2cda-4f01-407e-91b8-af012274472b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:46.909503 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b6ef2cda-4f01-407e-91b8-af012274472b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:46.909971 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b6ef2cda-4f01-407e-91b8-af012274472b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:46.910848 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b6ef2cda-4f01-407e-91b8-af012274472b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:46.911236 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b6ef2cda-4f01-407e-91b8-af012274472b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:47.112026 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-78b285a7-272e-4e9b-9c80-fe0d4bb91353 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:47.112894 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-78b285a7-272e-4e9b-9c80-fe0d4bb91353 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:47.136617 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-78b285a7-272e-4e9b-9c80-fe0d4bb91353 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:47.137153 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-78b285a7-272e-4e9b-9c80-fe0d4bb91353 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:47.138248 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-78b285a7-272e-4e9b-9c80-fe0d4bb91353 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:47.138901 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-78b285a7-272e-4e9b-9c80-fe0d4bb91353 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:47.454976 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b6ef2cda-4f01-407e-91b8-af012274472b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:47.470742 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b6ef2cda-4f01-407e-91b8-af012274472b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:47.479637 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b6ef2cda-4f01-407e-91b8-af012274472b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:47.484270 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b6ef2cda-4f01-407e-91b8-af012274472b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1738 microversion: 2.20 time: 0.592961 Apr 16 21:32:47.489135 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2971/5777] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:32:46 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1738 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:32:47.580079 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fe9a9e60-201e-4129-bf5c-8bb5d386c89a tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:47.580876 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fe9a9e60-201e-4129-bf5c-8bb5d386c89a tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] [instance: 8ea5d86a-4000-4ae6-81f2-3b2232b06db0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:47.592442 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fe9a9e60-201e-4129-bf5c-8bb5d386c89a tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:47.598641 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fe9a9e60-201e-4129-bf5c-8bb5d386c89a tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:47.599923 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fe9a9e60-201e-4129-bf5c-8bb5d386c89a tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:47.600592 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fe9a9e60-201e-4129-bf5c-8bb5d386c89a tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:47.666518 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-78b285a7-272e-4e9b-9c80-fe0d4bb91353 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:47.683291 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-78b285a7-272e-4e9b-9c80-fe0d4bb91353 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1699 microversion: 2.1 time: 0.578718 Apr 16 21:32:47.684954 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2807/5778] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:32:47 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1699 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:32:47.945184 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fe9a9e60-201e-4129-bf5c-8bb5d386c89a tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c637fe804de14ee5986e914a3e0c9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85e899913f3f46e2b9ed44d5d6082195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:47.956272 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fe9a9e60-201e-4129-bf5c-8bb5d386c89a tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] 10.222.0.20 "GET /compute/v2.1/servers/8ea5d86a-4000-4ae6-81f2-3b2232b06db0" status: 200 len: 1325 microversion: 2.1 time: 0.381130 Apr 16 21:32:47.957217 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2972/5779] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:32:47 2022] GET /compute/v2.1/servers/8ea5d86a-4000-4ae6-81f2-3b2232b06db0 => generated 1325 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:32:48.505483 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8fdaded0-b8cf-4233-80ab-01cbeeb29292 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:48.506063 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8fdaded0-b8cf-4233-80ab-01cbeeb29292 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:48.512771 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8fdaded0-b8cf-4233-80ab-01cbeeb29292 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:48.513892 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8fdaded0-b8cf-4233-80ab-01cbeeb29292 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:48.514671 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8fdaded0-b8cf-4233-80ab-01cbeeb29292 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:48.515120 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8fdaded0-b8cf-4233-80ab-01cbeeb29292 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:48.681394 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8fdaded0-b8cf-4233-80ab-01cbeeb29292 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:48.690264 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8fdaded0-b8cf-4233-80ab-01cbeeb29292 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:48.692502 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8fdaded0-b8cf-4233-80ab-01cbeeb29292 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:48.699213 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8fdaded0-b8cf-4233-80ab-01cbeeb29292 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1738 microversion: 2.20 time: 0.192343 Apr 16 21:32:48.699213 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2808/5780] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:32:48 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1738 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:32:48.704757 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-db5055cb-c5ee-4c12-b85d-fcef23225378 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:48.705544 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-db5055cb-c5ee-4c12-b85d-fcef23225378 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:48.711953 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-db5055cb-c5ee-4c12-b85d-fcef23225378 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:48.712460 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-db5055cb-c5ee-4c12-b85d-fcef23225378 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:48.713374 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-db5055cb-c5ee-4c12-b85d-fcef23225378 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:48.713814 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-db5055cb-c5ee-4c12-b85d-fcef23225378 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:48.981076 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3a7ed032-8785-46ca-b5ce-f56861707759 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:48.981708 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3a7ed032-8785-46ca-b5ce-f56861707759 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] [instance: 8ea5d86a-4000-4ae6-81f2-3b2232b06db0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:48.994817 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3a7ed032-8785-46ca-b5ce-f56861707759 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:48.995349 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3a7ed032-8785-46ca-b5ce-f56861707759 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:48.996438 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3a7ed032-8785-46ca-b5ce-f56861707759 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:48.997083 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3a7ed032-8785-46ca-b5ce-f56861707759 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:49.139923 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-db5055cb-c5ee-4c12-b85d-fcef23225378 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:49.154197 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-db5055cb-c5ee-4c12-b85d-fcef23225378 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1699 microversion: 2.1 time: 0.455447 Apr 16 21:32:49.155828 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2973/5781] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:32:48 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1699 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:32:49.553137 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3a7ed032-8785-46ca-b5ce-f56861707759 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c637fe804de14ee5986e914a3e0c9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85e899913f3f46e2b9ed44d5d6082195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:49.568989 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3a7ed032-8785-46ca-b5ce-f56861707759 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] 10.222.0.20 "GET /compute/v2.1/servers/8ea5d86a-4000-4ae6-81f2-3b2232b06db0" status: 200 len: 1325 microversion: 2.1 time: 0.594007 Apr 16 21:32:49.579891 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2809/5782] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:32:48 2022] GET /compute/v2.1/servers/8ea5d86a-4000-4ae6-81f2-3b2232b06db0 => generated 1325 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:32:49.719120 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-96ba4fcb-e294-4baa-8557-3513a4ec99e6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:49.720141 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-96ba4fcb-e294-4baa-8557-3513a4ec99e6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:49.730007 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-96ba4fcb-e294-4baa-8557-3513a4ec99e6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:49.730482 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-96ba4fcb-e294-4baa-8557-3513a4ec99e6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:49.731291 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-96ba4fcb-e294-4baa-8557-3513a4ec99e6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:49.732287 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-96ba4fcb-e294-4baa-8557-3513a4ec99e6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:50.172575 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9de0539c-745d-472b-8779-b370c235fbd6 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:50.173713 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9de0539c-745d-472b-8779-b370c235fbd6 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:50.185157 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9de0539c-745d-472b-8779-b370c235fbd6 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:50.185874 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9de0539c-745d-472b-8779-b370c235fbd6 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:50.188855 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9de0539c-745d-472b-8779-b370c235fbd6 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:50.188855 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9de0539c-745d-472b-8779-b370c235fbd6 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:50.397505 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-96ba4fcb-e294-4baa-8557-3513a4ec99e6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:50.410052 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-96ba4fcb-e294-4baa-8557-3513a4ec99e6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:50.415168 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-96ba4fcb-e294-4baa-8557-3513a4ec99e6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:50.416623 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-96ba4fcb-e294-4baa-8557-3513a4ec99e6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1738 microversion: 2.20 time: 0.708194 Apr 16 21:32:50.417707 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2974/5783] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:32:49 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1738 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:32:50.587009 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c4d30e43-8bec-450e-ac76-b7ae247f74d5 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:50.587973 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c4d30e43-8bec-450e-ac76-b7ae247f74d5 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] [instance: 8ea5d86a-4000-4ae6-81f2-3b2232b06db0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:50.599208 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c4d30e43-8bec-450e-ac76-b7ae247f74d5 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:50.603800 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c4d30e43-8bec-450e-ac76-b7ae247f74d5 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:50.607390 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c4d30e43-8bec-450e-ac76-b7ae247f74d5 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:50.611704 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c4d30e43-8bec-450e-ac76-b7ae247f74d5 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:50.760830 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9de0539c-745d-472b-8779-b370c235fbd6 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:50.781393 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9de0539c-745d-472b-8779-b370c235fbd6 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1699 microversion: 2.1 time: 0.609470 Apr 16 21:32:50.782800 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2810/5784] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:32:50 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1699 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:32:51.165419 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c4d30e43-8bec-450e-ac76-b7ae247f74d5 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c637fe804de14ee5986e914a3e0c9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85e899913f3f46e2b9ed44d5d6082195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:51.179940 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c4d30e43-8bec-450e-ac76-b7ae247f74d5 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] 10.222.0.20 "GET /compute/v2.1/servers/8ea5d86a-4000-4ae6-81f2-3b2232b06db0" status: 200 len: 1325 microversion: 2.1 time: 0.592978 Apr 16 21:32:51.180637 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2975/5785] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:32:50 2022] GET /compute/v2.1/servers/8ea5d86a-4000-4ae6-81f2-3b2232b06db0 => generated 1325 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:32:51.437025 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e14662b0-69b6-427b-9da4-431c1aa9979b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:51.437712 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e14662b0-69b6-427b-9da4-431c1aa9979b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:51.452143 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e14662b0-69b6-427b-9da4-431c1aa9979b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:51.453148 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e14662b0-69b6-427b-9da4-431c1aa9979b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:51.455307 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e14662b0-69b6-427b-9da4-431c1aa9979b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:51.456702 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e14662b0-69b6-427b-9da4-431c1aa9979b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:51.612298 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-07636be8-6520-4d40-a022-8aa3dc9a350c req-f0e20935-3f8d-41c3-975f-f853072d3b8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ea5d86a-4000-4ae6-81f2-3b2232b06db0", "name": "network-vif-plugged", "status": "completed", "tag": "b28326fa-0cd8-494d-8422-4348cddbe7a4"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:32:51.629751 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-07636be8-6520-4d40-a022-8aa3dc9a350c req-f0e20935-3f8d-41c3-975f-f853072d3b8f service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:51.630427 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-07636be8-6520-4d40-a022-8aa3dc9a350c req-f0e20935-3f8d-41c3-975f-f853072d3b8f service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:51.660148 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-07636be8-6520-4d40-a022-8aa3dc9a350c req-f0e20935-3f8d-41c3-975f-f853072d3b8f service nova] Creating event network-vif-plugged:b28326fa-0cd8-494d-8422-4348cddbe7a4 for instance 8ea5d86a-4000-4ae6-81f2-3b2232b06db0 on nch1-master-1 Apr 16 21:32:51.671343 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-07636be8-6520-4d40-a022-8aa3dc9a350c req-f0e20935-3f8d-41c3-975f-f853072d3b8f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063716 Apr 16 21:32:51.674775 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2976/5786] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:32:51.800567 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6685c984-8fe7-4cc4-b872-a98c787f3102 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:51.801275 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6685c984-8fe7-4cc4-b872-a98c787f3102 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:51.812799 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6685c984-8fe7-4cc4-b872-a98c787f3102 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:51.815214 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6685c984-8fe7-4cc4-b872-a98c787f3102 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:51.816245 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6685c984-8fe7-4cc4-b872-a98c787f3102 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:51.819136 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6685c984-8fe7-4cc4-b872-a98c787f3102 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:52.114422 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e14662b0-69b6-427b-9da4-431c1aa9979b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:52.140399 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e14662b0-69b6-427b-9da4-431c1aa9979b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:52.146751 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e14662b0-69b6-427b-9da4-431c1aa9979b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:52.149489 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e14662b0-69b6-427b-9da4-431c1aa9979b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1738 microversion: 2.20 time: 0.716239 Apr 16 21:32:52.151899 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2811/5787] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:32:51 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1738 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:32:52.202945 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e5a51533-aa73-4920-93a0-710f2e63478c tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:52.205209 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e5a51533-aa73-4920-93a0-710f2e63478c tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] [instance: 8ea5d86a-4000-4ae6-81f2-3b2232b06db0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:52.221927 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e5a51533-aa73-4920-93a0-710f2e63478c tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:52.224020 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e5a51533-aa73-4920-93a0-710f2e63478c tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:52.226340 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e5a51533-aa73-4920-93a0-710f2e63478c tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:52.228373 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e5a51533-aa73-4920-93a0-710f2e63478c tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:52.690950 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e5a51533-aa73-4920-93a0-710f2e63478c tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c637fe804de14ee5986e914a3e0c9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85e899913f3f46e2b9ed44d5d6082195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:52.699526 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e5a51533-aa73-4920-93a0-710f2e63478c tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] 10.222.0.20 "GET /compute/v2.1/servers/8ea5d86a-4000-4ae6-81f2-3b2232b06db0" status: 200 len: 1325 microversion: 2.1 time: 0.506976 Apr 16 21:32:52.700143 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2812/5788] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:32:52 2022] GET /compute/v2.1/servers/8ea5d86a-4000-4ae6-81f2-3b2232b06db0 => generated 1325 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:32:52.936601 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6685c984-8fe7-4cc4-b872-a98c787f3102 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:52.951411 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6685c984-8fe7-4cc4-b872-a98c787f3102 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1699 microversion: 2.1 time: 1.155109 Apr 16 21:32:52.961220 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2977/5789] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:32:51 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1699 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:32:53.170188 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c147b80e-f741-4233-a267-78dd2737390c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:53.171909 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c147b80e-f741-4233-a267-78dd2737390c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:53.193701 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c147b80e-f741-4233-a267-78dd2737390c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:53.196723 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c147b80e-f741-4233-a267-78dd2737390c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:53.198373 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c147b80e-f741-4233-a267-78dd2737390c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:53.201230 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c147b80e-f741-4233-a267-78dd2737390c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:53.684600 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c147b80e-f741-4233-a267-78dd2737390c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:53.697246 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c147b80e-f741-4233-a267-78dd2737390c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:53.699012 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c147b80e-f741-4233-a267-78dd2737390c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:53.701531 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c147b80e-f741-4233-a267-78dd2737390c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1738 microversion: 2.20 time: 0.537643 Apr 16 21:32:53.702616 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2813/5790] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:32:53 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1738 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:32:53.717977 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-db4d224c-30f1-4a88-86c5-c916cdffd8c5 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:53.722139 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-db4d224c-30f1-4a88-86c5-c916cdffd8c5 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] [instance: 8ea5d86a-4000-4ae6-81f2-3b2232b06db0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:53.730357 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-db4d224c-30f1-4a88-86c5-c916cdffd8c5 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:53.731437 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-db4d224c-30f1-4a88-86c5-c916cdffd8c5 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:53.732994 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-db4d224c-30f1-4a88-86c5-c916cdffd8c5 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:53.733607 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-db4d224c-30f1-4a88-86c5-c916cdffd8c5 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:53.968532 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b5b4f808-85de-4054-892b-f5ea7d7d29c3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:53.969162 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b5b4f808-85de-4054-892b-f5ea7d7d29c3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:53.986447 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b5b4f808-85de-4054-892b-f5ea7d7d29c3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:53.986928 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b5b4f808-85de-4054-892b-f5ea7d7d29c3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:53.987743 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b5b4f808-85de-4054-892b-f5ea7d7d29c3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:53.988205 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b5b4f808-85de-4054-892b-f5ea7d7d29c3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:54.452903 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b5b4f808-85de-4054-892b-f5ea7d7d29c3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:54.452903 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b5b4f808-85de-4054-892b-f5ea7d7d29c3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1699 microversion: 2.1 time: 0.473294 Apr 16 21:32:54.452903 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2814/5791] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:32:53 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1699 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:32:54.697814 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-db4d224c-30f1-4a88-86c5-c916cdffd8c5 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c637fe804de14ee5986e914a3e0c9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85e899913f3f46e2b9ed44d5d6082195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:54.716697 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-db4d224c-30f1-4a88-86c5-c916cdffd8c5 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] 10.222.0.20 "GET /compute/v2.1/servers/8ea5d86a-4000-4ae6-81f2-3b2232b06db0" status: 200 len: 1522 microversion: 2.1 time: 1.003282 Apr 16 21:32:54.719167 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2978/5792] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:32:53 2022] GET /compute/v2.1/servers/8ea5d86a-4000-4ae6-81f2-3b2232b06db0 => generated 1522 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:32:54.721909 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d65f0d1a-2157-4ce5-bd3f-dd4697b6a55b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:54.722779 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d65f0d1a-2157-4ce5-bd3f-dd4697b6a55b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:54.746408 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3532db24-12b5-4eeb-a784-f310a097525c tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:54.747938 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3532db24-12b5-4eeb-a784-f310a097525c tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] [instance: 8ea5d86a-4000-4ae6-81f2-3b2232b06db0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:54.756135 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d65f0d1a-2157-4ce5-bd3f-dd4697b6a55b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:54.757538 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3532db24-12b5-4eeb-a784-f310a097525c tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:54.758173 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3532db24-12b5-4eeb-a784-f310a097525c tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:54.758890 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d65f0d1a-2157-4ce5-bd3f-dd4697b6a55b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:54.759667 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3532db24-12b5-4eeb-a784-f310a097525c tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:54.760424 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3532db24-12b5-4eeb-a784-f310a097525c tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:54.765383 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d65f0d1a-2157-4ce5-bd3f-dd4697b6a55b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:54.766755 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d65f0d1a-2157-4ce5-bd3f-dd4697b6a55b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:54.835382 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-3532db24-12b5-4eeb-a784-f310a097525c tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] HTTP exception thrown: Action 999 not found Apr 16 21:32:54.836014 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3532db24-12b5-4eeb-a784-f310a097525c tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Returning 404 to user: Action 999 not found {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:32:54.837553 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3532db24-12b5-4eeb-a784-f310a097525c tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] 10.222.0.20 "GET /compute/v2.1/servers/8ea5d86a-4000-4ae6-81f2-3b2232b06db0/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.105059 Apr 16 21:32:54.839726 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2979/5793] 10.222.0.20 () {58 vars in 1307 bytes} [Sat Apr 16 21:32:54 2022] GET /compute/v2.1/servers/8ea5d86a-4000-4ae6-81f2-3b2232b06db0/os-instance-actions/999 => generated 66 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:32:54.853822 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-69e9a0e2-ab4e-4ed3-892a-992759933ab7 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Calling method '.version_select at 0x7fbb9594f820>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:54.854638 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-69e9a0e2-ab4e-4ed3-892a-992759933ab7 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] [instance: 13a76ac8-b084-4ae1-be1b-fb7046fd2b26] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:54.867258 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-69e9a0e2-ab4e-4ed3-892a-992759933ab7 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] HTTP exception thrown: Instance 13a76ac8-b084-4ae1-be1b-fb7046fd2b26 could not be found. Apr 16 21:32:54.868099 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-69e9a0e2-ab4e-4ed3-892a-992759933ab7 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Returning 404 to user: Instance 13a76ac8-b084-4ae1-be1b-fb7046fd2b26 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:32:54.869133 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-69e9a0e2-ab4e-4ed3-892a-992759933ab7 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] 10.222.0.20 "GET /compute/v2.1/servers/13a76ac8-b084-4ae1-be1b-fb7046fd2b26/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.023338 Apr 16 21:32:54.870425 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2980/5794] 10.222.0.20 () {58 vars in 1295 bytes} [Sat Apr 16 21:32:54 2022] GET /compute/v2.1/servers/13a76ac8-b084-4ae1-be1b-fb7046fd2b26/os-instance-actions => generated 111 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:32:54.881770 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a12608d2-3d31-4cdf-b2d1-0472b75cecc7 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:54.882814 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a12608d2-3d31-4cdf-b2d1-0472b75cecc7 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] [instance: 8ea5d86a-4000-4ae6-81f2-3b2232b06db0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:54.895680 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a12608d2-3d31-4cdf-b2d1-0472b75cecc7 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:54.899435 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a12608d2-3d31-4cdf-b2d1-0472b75cecc7 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:54.899435 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a12608d2-3d31-4cdf-b2d1-0472b75cecc7 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:54.899435 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a12608d2-3d31-4cdf-b2d1-0472b75cecc7 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:54.933669 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a12608d2-3d31-4cdf-b2d1-0472b75cecc7 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] [instance: 8ea5d86a-4000-4ae6-81f2-3b2232b06db0] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:32:55.138152 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d65f0d1a-2157-4ce5-bd3f-dd4697b6a55b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:55.160672 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d65f0d1a-2157-4ce5-bd3f-dd4697b6a55b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:55.164398 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d65f0d1a-2157-4ce5-bd3f-dd4697b6a55b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:55.170492 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d65f0d1a-2157-4ce5-bd3f-dd4697b6a55b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1738 microversion: 2.20 time: 0.453239 Apr 16 21:32:55.186344 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2815/5795] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:32:54 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1738 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:32:55.459024 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ca43c2a6-035b-43f6-b855-0dc19150f431 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:55.460315 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ca43c2a6-035b-43f6-b855-0dc19150f431 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:55.473411 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ca43c2a6-035b-43f6-b855-0dc19150f431 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:55.473873 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ca43c2a6-035b-43f6-b855-0dc19150f431 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:55.474668 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ca43c2a6-035b-43f6-b855-0dc19150f431 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:55.475111 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ca43c2a6-035b-43f6-b855-0dc19150f431 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:55.625535 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a12608d2-3d31-4cdf-b2d1-0472b75cecc7 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8ea5d86a-4000-4ae6-81f2-3b2232b06db0" status: 204 len: 0 microversion: 2.1 time: 0.749210 Apr 16 21:32:55.626433 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2981/5796] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:32:54 2022] DELETE /compute/v2.1/servers/8ea5d86a-4000-4ae6-81f2-3b2232b06db0 => generated 0 bytes in 751 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:32:55.634749 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ac857545-ef2f-4f97-bdfe-4d7028eaf36b tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:55.635469 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ac857545-ef2f-4f97-bdfe-4d7028eaf36b tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] [instance: 8ea5d86a-4000-4ae6-81f2-3b2232b06db0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:55.653232 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ac857545-ef2f-4f97-bdfe-4d7028eaf36b tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:55.668900 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ac857545-ef2f-4f97-bdfe-4d7028eaf36b tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:55.669989 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ac857545-ef2f-4f97-bdfe-4d7028eaf36b tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:55.670466 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ac857545-ef2f-4f97-bdfe-4d7028eaf36b tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:55.922637 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ac857545-ef2f-4f97-bdfe-4d7028eaf36b tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c637fe804de14ee5986e914a3e0c9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85e899913f3f46e2b9ed44d5d6082195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:55.943656 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ac857545-ef2f-4f97-bdfe-4d7028eaf36b tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] 10.222.0.20 "GET /compute/v2.1/servers/8ea5d86a-4000-4ae6-81f2-3b2232b06db0" status: 200 len: 1528 microversion: 2.1 time: 0.313084 Apr 16 21:32:55.947210 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2982/5797] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:32:55 2022] GET /compute/v2.1/servers/8ea5d86a-4000-4ae6-81f2-3b2232b06db0 => generated 1528 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:32:56.191491 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-138ae3f1-e79c-483f-b9f1-856b2e174dd6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:56.192436 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-138ae3f1-e79c-483f-b9f1-856b2e174dd6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:56.203770 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-138ae3f1-e79c-483f-b9f1-856b2e174dd6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:56.209877 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-138ae3f1-e79c-483f-b9f1-856b2e174dd6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:56.209877 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-138ae3f1-e79c-483f-b9f1-856b2e174dd6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:56.210822 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-138ae3f1-e79c-483f-b9f1-856b2e174dd6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:56.543785 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ca43c2a6-035b-43f6-b855-0dc19150f431 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:56.555344 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ca43c2a6-035b-43f6-b855-0dc19150f431 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1699 microversion: 2.1 time: 1.100149 Apr 16 21:32:56.558387 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2816/5798] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:32:55 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1699 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:32:56.831044 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-138ae3f1-e79c-483f-b9f1-856b2e174dd6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:56.849693 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-138ae3f1-e79c-483f-b9f1-856b2e174dd6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:56.852469 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-138ae3f1-e79c-483f-b9f1-856b2e174dd6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:56.861567 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-138ae3f1-e79c-483f-b9f1-856b2e174dd6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1738 microversion: 2.20 time: 0.669915 Apr 16 21:32:56.864883 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2983/5799] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:32:56 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1738 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:32:56.964134 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b9e0cb11-3053-42e4-bab6-3ee219c7996a tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:56.965053 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b9e0cb11-3053-42e4-bab6-3ee219c7996a tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] [instance: 8ea5d86a-4000-4ae6-81f2-3b2232b06db0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:56.986839 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b9e0cb11-3053-42e4-bab6-3ee219c7996a tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:56.989159 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b9e0cb11-3053-42e4-bab6-3ee219c7996a tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:56.990356 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b9e0cb11-3053-42e4-bab6-3ee219c7996a tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:56.990974 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b9e0cb11-3053-42e4-bab6-3ee219c7996a tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:57.531254 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b9e0cb11-3053-42e4-bab6-3ee219c7996a tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c637fe804de14ee5986e914a3e0c9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85e899913f3f46e2b9ed44d5d6082195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:57.546149 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b9e0cb11-3053-42e4-bab6-3ee219c7996a tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] 10.222.0.20 "GET /compute/v2.1/servers/8ea5d86a-4000-4ae6-81f2-3b2232b06db0" status: 200 len: 1528 microversion: 2.1 time: 0.584248 Apr 16 21:32:57.547022 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2817/5800] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:32:56 2022] GET /compute/v2.1/servers/8ea5d86a-4000-4ae6-81f2-3b2232b06db0 => generated 1528 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:32:57.576725 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-158d8fa8-67bb-4e6a-be1d-94e6b50177bb tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:57.577435 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-158d8fa8-67bb-4e6a-be1d-94e6b50177bb tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:57.599371 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-158d8fa8-67bb-4e6a-be1d-94e6b50177bb tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:57.601857 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-158d8fa8-67bb-4e6a-be1d-94e6b50177bb tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:57.604746 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-158d8fa8-67bb-4e6a-be1d-94e6b50177bb tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:57.609510 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-158d8fa8-67bb-4e6a-be1d-94e6b50177bb tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:57.887110 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-449d0526-9d54-4ddb-8468-444b9945ff06 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:57.888411 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-449d0526-9d54-4ddb-8468-444b9945ff06 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:57.922292 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-449d0526-9d54-4ddb-8468-444b9945ff06 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:57.922768 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-449d0526-9d54-4ddb-8468-444b9945ff06 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:57.923572 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-449d0526-9d54-4ddb-8468-444b9945ff06 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:57.929632 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-449d0526-9d54-4ddb-8468-444b9945ff06 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:57.999508 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-158d8fa8-67bb-4e6a-be1d-94e6b50177bb tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:58.011951 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-158d8fa8-67bb-4e6a-be1d-94e6b50177bb tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1699 microversion: 2.1 time: 0.441220 Apr 16 21:32:58.013573 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2984/5801] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:32:57 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1699 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:32:58.548769 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-449d0526-9d54-4ddb-8468-444b9945ff06 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:58.562808 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b8c2af52-d107-4465-a8b9-50805ccec431 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:58.563521 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-449d0526-9d54-4ddb-8468-444b9945ff06 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:58.563829 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b8c2af52-d107-4465-a8b9-50805ccec431 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] [instance: 8ea5d86a-4000-4ae6-81f2-3b2232b06db0] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:58.569300 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-449d0526-9d54-4ddb-8468-444b9945ff06 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:58.574101 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-449d0526-9d54-4ddb-8468-444b9945ff06 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1738 microversion: 2.20 time: 0.693840 Apr 16 21:32:58.574821 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b8c2af52-d107-4465-a8b9-50805ccec431 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:58.579286 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2818/5802] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:32:57 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1738 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:32:58.584913 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b8c2af52-d107-4465-a8b9-50805ccec431 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:58.594945 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b8c2af52-d107-4465-a8b9-50805ccec431 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:58.595737 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b8c2af52-d107-4465-a8b9-50805ccec431 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:59.037316 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-59ebd607-2bb1-4c08-b68b-1dedf7b78b60 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:59.038154 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-59ebd607-2bb1-4c08-b68b-1dedf7b78b60 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:59.060418 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-59ebd607-2bb1-4c08-b68b-1dedf7b78b60 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:59.061403 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-59ebd607-2bb1-4c08-b68b-1dedf7b78b60 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:59.063781 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-59ebd607-2bb1-4c08-b68b-1dedf7b78b60 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:59.064701 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-59ebd607-2bb1-4c08-b68b-1dedf7b78b60 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:59.581159 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-59ebd607-2bb1-4c08-b68b-1dedf7b78b60 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:32:59.597773 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-59ebd607-2bb1-4c08-b68b-1dedf7b78b60 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1698 microversion: 2.1 time: 0.568008 Apr 16 21:32:59.598978 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2819/5803] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:32:59 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1698 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:32:59.892756 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-bc893036-5fab-4b9b-93e0-91119af6fc50 req-cc18a2dc-9884-483a-8c52-401ce81969b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ea5d86a-4000-4ae6-81f2-3b2232b06db0", "name": "network-vif-deleted", "tag": "b28326fa-0cd8-494d-8422-4348cddbe7a4"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:32:59.908687 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-bc893036-5fab-4b9b-93e0-91119af6fc50 req-cc18a2dc-9884-483a-8c52-401ce81969b9 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:59.909409 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-bc893036-5fab-4b9b-93e0-91119af6fc50 req-cc18a2dc-9884-483a-8c52-401ce81969b9 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:59.932830 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-bc893036-5fab-4b9b-93e0-91119af6fc50 req-cc18a2dc-9884-483a-8c52-401ce81969b9 service nova] Creating event network-vif-deleted:b28326fa-0cd8-494d-8422-4348cddbe7a4 for instance 8ea5d86a-4000-4ae6-81f2-3b2232b06db0 on nch1-master-1 Apr 16 21:32:59.955005 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-bc893036-5fab-4b9b-93e0-91119af6fc50 req-cc18a2dc-9884-483a-8c52-401ce81969b9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.342517 Apr 16 21:32:59.958976 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2820/5804] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:32:59.973358 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3263a9a5-0db3-4ad5-9ec8-8854d9191331 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:32:59.974137 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3263a9a5-0db3-4ad5-9ec8-8854d9191331 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:32:59.981622 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3263a9a5-0db3-4ad5-9ec8-8854d9191331 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:59.982096 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3263a9a5-0db3-4ad5-9ec8-8854d9191331 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:32:59.983081 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3263a9a5-0db3-4ad5-9ec8-8854d9191331 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:32:59.983951 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3263a9a5-0db3-4ad5-9ec8-8854d9191331 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:00.119015 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b8c2af52-d107-4465-a8b9-50805ccec431 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c637fe804de14ee5986e914a3e0c9329', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '85e899913f3f46e2b9ed44d5d6082195', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:00.127574 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b8c2af52-d107-4465-a8b9-50805ccec431 tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] 10.222.0.20 "GET /compute/v2.1/servers/8ea5d86a-4000-4ae6-81f2-3b2232b06db0" status: 200 len: 1528 microversion: 2.1 time: 1.568447 Apr 16 21:33:00.128909 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2985/5805] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:32:58 2022] GET /compute/v2.1/servers/8ea5d86a-4000-4ae6-81f2-3b2232b06db0 => generated 1528 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:33:00.368599 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3263a9a5-0db3-4ad5-9ec8-8854d9191331 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:00.375647 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3263a9a5-0db3-4ad5-9ec8-8854d9191331 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:00.377938 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3263a9a5-0db3-4ad5-9ec8-8854d9191331 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:00.379323 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3263a9a5-0db3-4ad5-9ec8-8854d9191331 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1720 microversion: 2.20 time: 0.419157 Apr 16 21:33:00.381119 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2821/5806] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:32:59 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1720 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:33:00.643769 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e27eff0f-649f-4b06-bb08-b315d2ab474a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:00.644567 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e27eff0f-649f-4b06-bb08-b315d2ab474a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:00.664248 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e27eff0f-649f-4b06-bb08-b315d2ab474a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:00.666096 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e27eff0f-649f-4b06-bb08-b315d2ab474a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:00.668731 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e27eff0f-649f-4b06-bb08-b315d2ab474a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:00.670256 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e27eff0f-649f-4b06-bb08-b315d2ab474a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:01.148441 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-742b30fa-8d06-4827-9d5d-70127bbcdefe tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:01.151242 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-742b30fa-8d06-4827-9d5d-70127bbcdefe tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] [instance: 8ea5d86a-4000-4ae6-81f2-3b2232b06db0] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:01.173730 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-742b30fa-8d06-4827-9d5d-70127bbcdefe tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:01.174197 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-742b30fa-8d06-4827-9d5d-70127bbcdefe tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:01.175002 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-742b30fa-8d06-4827-9d5d-70127bbcdefe tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:01.175984 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-742b30fa-8d06-4827-9d5d-70127bbcdefe tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:01.624947 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e27eff0f-649f-4b06-bb08-b315d2ab474a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:01.645415 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e27eff0f-649f-4b06-bb08-b315d2ab474a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1698 microversion: 2.1 time: 1.029847 Apr 16 21:33:01.646293 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2986/5807] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:33:00 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1698 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:33:01.666133 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-150f4dcd-cabe-4fbe-a53e-e18f26747373 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:01.666930 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-150f4dcd-cabe-4fbe-a53e-e18f26747373 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:01.699138 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-150f4dcd-cabe-4fbe-a53e-e18f26747373 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:01.704313 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-150f4dcd-cabe-4fbe-a53e-e18f26747373 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:01.705628 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-150f4dcd-cabe-4fbe-a53e-e18f26747373 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:01.708329 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-150f4dcd-cabe-4fbe-a53e-e18f26747373 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:01.739484 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-742b30fa-8d06-4827-9d5d-70127bbcdefe tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] HTTP exception thrown: Instance 8ea5d86a-4000-4ae6-81f2-3b2232b06db0 could not be found. Apr 16 21:33:01.741011 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-742b30fa-8d06-4827-9d5d-70127bbcdefe tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] Returning 404 to user: Instance 8ea5d86a-4000-4ae6-81f2-3b2232b06db0 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:33:01.741991 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-742b30fa-8d06-4827-9d5d-70127bbcdefe tempest-InstanceActionsNegativeTestJSON-2080393680 tempest-InstanceActionsNegativeTestJSON-2080393680-project] 10.222.0.20 "GET /compute/v2.1/servers/8ea5d86a-4000-4ae6-81f2-3b2232b06db0" status: 404 len: 111 microversion: 2.1 time: 0.600826 Apr 16 21:33:01.746729 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2822/5808] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:33:01 2022] GET /compute/v2.1/servers/8ea5d86a-4000-4ae6-81f2-3b2232b06db0 => generated 111 bytes in 606 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:33:01.767323 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-f4868578-2029-475d-bd8b-fe70d7d5544a req-5eac6f62-0d92-45c9-a120-c38ae7f8a67b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebff90b9-4ca5-4301-b5d7-4c1e92b16457", "name": "network-vif-unplugged", "status": "completed", "tag": "f0531494-4be1-4c6b-bed4-5ffd32fa231d"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:33:01.778094 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-f4868578-2029-475d-bd8b-fe70d7d5544a req-5eac6f62-0d92-45c9-a120-c38ae7f8a67b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:01.779617 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-f4868578-2029-475d-bd8b-fe70d7d5544a req-5eac6f62-0d92-45c9-a120-c38ae7f8a67b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:01.793780 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-f4868578-2029-475d-bd8b-fe70d7d5544a req-5eac6f62-0d92-45c9-a120-c38ae7f8a67b service nova] Creating event network-vif-unplugged:f0531494-4be1-4c6b-bed4-5ffd32fa231d for instance ebff90b9-4ca5-4301-b5d7-4c1e92b16457 on nch2-master-1 Apr 16 21:33:01.807178 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [req-f4868578-2029-475d-bd8b-fe70d7d5544a req-5eac6f62-0d92-45c9-a120-c38ae7f8a67b service nova] Instance ebff90b9-4ca5-4301-b5d7-4c1e92b16457 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137409) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 16 21:33:01.840588 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-f4868578-2029-475d-bd8b-fe70d7d5544a req-5eac6f62-0d92-45c9-a120-c38ae7f8a67b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078348 Apr 16 21:33:01.844834 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2823/5809] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:33:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:33:02.339186 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-a3aa4072-d3eb-46d5-b7d0-3470acb8db0f req-9d74b773-b88f-4895-81a5-90338143331b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b86e6830-cedb-4d55-a3b2-997462319b30", "name": "network-vif-unplugged", "status": "completed", "tag": "b966fc7e-0221-46eb-a92a-00d9f48a8a41"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:33:02.383251 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-a3aa4072-d3eb-46d5-b7d0-3470acb8db0f req-9d74b773-b88f-4895-81a5-90338143331b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:02.383729 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-a3aa4072-d3eb-46d5-b7d0-3470acb8db0f req-9d74b773-b88f-4895-81a5-90338143331b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:02.420707 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-a3aa4072-d3eb-46d5-b7d0-3470acb8db0f req-9d74b773-b88f-4895-81a5-90338143331b service nova] Creating event network-vif-unplugged:b966fc7e-0221-46eb-a92a-00d9f48a8a41 for instance b86e6830-cedb-4d55-a3b2-997462319b30 on nch2-master-1 Apr 16 21:33:02.429728 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-a3aa4072-d3eb-46d5-b7d0-3470acb8db0f req-9d74b773-b88f-4895-81a5-90338143331b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.118937 Apr 16 21:33:02.431640 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2824/5810] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:33:02.448998 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-150f4dcd-cabe-4fbe-a53e-e18f26747373 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:02.463629 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-150f4dcd-cabe-4fbe-a53e-e18f26747373 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:02.465812 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-150f4dcd-cabe-4fbe-a53e-e18f26747373 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:02.472296 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-150f4dcd-cabe-4fbe-a53e-e18f26747373 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1720 microversion: 2.20 time: 0.813217 Apr 16 21:33:02.488775 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2987/5811] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:33:01 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1720 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:33:02.671609 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-682d4b72-1570-4c01-874a-79220b192cec tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:02.672520 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-682d4b72-1570-4c01-874a-79220b192cec tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:02.682838 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-682d4b72-1570-4c01-874a-79220b192cec tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:02.684328 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-682d4b72-1570-4c01-874a-79220b192cec tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:02.687896 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-682d4b72-1570-4c01-874a-79220b192cec tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:02.688601 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-682d4b72-1570-4c01-874a-79220b192cec tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:03.513579 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fc3d7719-c8bc-4fdd-bfbd-b0142c3ee2a3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:03.526871 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fc3d7719-c8bc-4fdd-bfbd-b0142c3ee2a3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:03.575024 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fc3d7719-c8bc-4fdd-bfbd-b0142c3ee2a3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:03.576323 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fc3d7719-c8bc-4fdd-bfbd-b0142c3ee2a3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:03.577198 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fc3d7719-c8bc-4fdd-bfbd-b0142c3ee2a3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:03.588592 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fc3d7719-c8bc-4fdd-bfbd-b0142c3ee2a3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:03.733956 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-682d4b72-1570-4c01-874a-79220b192cec tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:03.750166 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-682d4b72-1570-4c01-874a-79220b192cec tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1698 microversion: 2.1 time: 1.085230 Apr 16 21:33:03.753682 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2825/5812] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:33:02 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1698 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:33:04.737287 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fc3d7719-c8bc-4fdd-bfbd-b0142c3ee2a3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:04.760328 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fc3d7719-c8bc-4fdd-bfbd-b0142c3ee2a3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:04.770386 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2518edf6-aaec-4776-b884-98c3724fb463 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:04.771264 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2518edf6-aaec-4776-b884-98c3724fb463 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:04.772021 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fc3d7719-c8bc-4fdd-bfbd-b0142c3ee2a3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:04.781610 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fc3d7719-c8bc-4fdd-bfbd-b0142c3ee2a3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1720 microversion: 2.20 time: 1.286821 Apr 16 21:33:04.784785 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2988/5813] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:33:03 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1720 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:33:04.787599 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2518edf6-aaec-4776-b884-98c3724fb463 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:04.789033 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2518edf6-aaec-4776-b884-98c3724fb463 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:04.791607 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2518edf6-aaec-4776-b884-98c3724fb463 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:04.794089 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2518edf6-aaec-4776-b884-98c3724fb463 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:04.805921 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-ae0936d0-3ca2-4cac-baed-5d7cdd532d2a req-cb91f346-1ad6-49ab-9c6c-04f73476b03c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebff90b9-4ca5-4301-b5d7-4c1e92b16457", "tag": "f0531494-4be1-4c6b-bed4-5ffd32fa231d"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:33:04.823723 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-ae0936d0-3ca2-4cac-baed-5d7cdd532d2a req-cb91f346-1ad6-49ab-9c6c-04f73476b03c service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:04.824503 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-ae0936d0-3ca2-4cac-baed-5d7cdd532d2a req-cb91f346-1ad6-49ab-9c6c-04f73476b03c service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:04.866161 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-ae0936d0-3ca2-4cac-baed-5d7cdd532d2a req-cb91f346-1ad6-49ab-9c6c-04f73476b03c service nova] Creating event network-changed:f0531494-4be1-4c6b-bed4-5ffd32fa231d for instance ebff90b9-4ca5-4301-b5d7-4c1e92b16457 on nch2-master-1 Apr 16 21:33:04.879546 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [req-ae0936d0-3ca2-4cac-baed-5d7cdd532d2a req-cb91f346-1ad6-49ab-9c6c-04f73476b03c service nova] Instance ebff90b9-4ca5-4301-b5d7-4c1e92b16457 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 16 21:33:04.926983 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-ae0936d0-3ca2-4cac-baed-5d7cdd532d2a req-cb91f346-1ad6-49ab-9c6c-04f73476b03c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139502 Apr 16 21:33:04.934212 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2989/5814] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:33:05.227978 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2518edf6-aaec-4776-b884-98c3724fb463 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:05.236221 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2518edf6-aaec-4776-b884-98c3724fb463 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1698 microversion: 2.1 time: 0.470034 Apr 16 21:33:05.241940 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2826/5815] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:33:04 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1698 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:33:05.803290 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-aa4cfb13-2b96-4191-b801-6bc5332e450e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:05.804103 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-aa4cfb13-2b96-4191-b801-6bc5332e450e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:05.815061 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aa4cfb13-2b96-4191-b801-6bc5332e450e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:05.815845 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aa4cfb13-2b96-4191-b801-6bc5332e450e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:05.816856 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aa4cfb13-2b96-4191-b801-6bc5332e450e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:05.817493 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aa4cfb13-2b96-4191-b801-6bc5332e450e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:06.261636 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c7a1e03e-10a6-4276-add6-20f41f51c5e7 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:06.262240 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c7a1e03e-10a6-4276-add6-20f41f51c5e7 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:06.279684 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c7a1e03e-10a6-4276-add6-20f41f51c5e7 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:06.280146 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c7a1e03e-10a6-4276-add6-20f41f51c5e7 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:06.283664 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c7a1e03e-10a6-4276-add6-20f41f51c5e7 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:06.284991 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c7a1e03e-10a6-4276-add6-20f41f51c5e7 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:06.429189 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-aa4cfb13-2b96-4191-b801-6bc5332e450e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:06.450786 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-aa4cfb13-2b96-4191-b801-6bc5332e450e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:06.459038 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-aa4cfb13-2b96-4191-b801-6bc5332e450e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:06.461110 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-aa4cfb13-2b96-4191-b801-6bc5332e450e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1663 microversion: 2.20 time: 0.662928 Apr 16 21:33:06.463383 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2990/5816] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:33:05 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1663 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:33:06.499677 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d0864587-f8f8-4e4f-8919-fd48075c3e71 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "53ad134b-66f9-4d7f-b696-56f6d63b72e9"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:33:06.501111 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d0864587-f8f8-4e4f-8919-fd48075c3e71 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:06.515925 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d0864587-f8f8-4e4f-8919-fd48075c3e71 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:06.516762 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d0864587-f8f8-4e4f-8919-fd48075c3e71 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:06.518173 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d0864587-f8f8-4e4f-8919-fd48075c3e71 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:06.521247 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d0864587-f8f8-4e4f-8919-fd48075c3e71 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:06.753686 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c7a1e03e-10a6-4276-add6-20f41f51c5e7 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:06.763752 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c7a1e03e-10a6-4276-add6-20f41f51c5e7 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1698 microversion: 2.1 time: 0.510412 Apr 16 21:33:06.764377 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2827/5817] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:33:06 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1698 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:33:07.693868 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d0864587-f8f8-4e4f-8919-fd48075c3e71 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "POST /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.216895 Apr 16 21:33:07.695016 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2991/5818] 10.222.0.20 () {62 vars in 1363 bytes} [Sat Apr 16 21:33:06 2022] POST /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30/os-volume_attachments => generated 188 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 16 21:33:07.781089 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8caddda5-fd6d-4af2-8415-99beb52b9c19 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:07.781550 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8caddda5-fd6d-4af2-8415-99beb52b9c19 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:07.791052 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8caddda5-fd6d-4af2-8415-99beb52b9c19 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:07.791528 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8caddda5-fd6d-4af2-8415-99beb52b9c19 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:07.794589 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8caddda5-fd6d-4af2-8415-99beb52b9c19 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:07.798548 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8caddda5-fd6d-4af2-8415-99beb52b9c19 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:07.864938 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-23a8ce65-9a85-4f80-b4a2-11e7a9d69ee0 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:33:07.868662 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-23a8ce65-9a85-4f80-b4a2-11e7a9d69ee0 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:07.884412 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-23a8ce65-9a85-4f80-b4a2-11e7a9d69ee0 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:07.885178 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-23a8ce65-9a85-4f80-b4a2-11e7a9d69ee0 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:07.886274 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-23a8ce65-9a85-4f80-b4a2-11e7a9d69ee0 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:07.887181 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-23a8ce65-9a85-4f80-b4a2-11e7a9d69ee0 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:08.299675 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8caddda5-fd6d-4af2-8415-99beb52b9c19 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:08.321912 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8caddda5-fd6d-4af2-8415-99beb52b9c19 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1696 microversion: 2.1 time: 0.542988 Apr 16 21:33:08.323913 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2828/5819] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:33:07 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1696 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:33:08.449639 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-23a8ce65-9a85-4f80-b4a2-11e7a9d69ee0 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "POST /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30/action" status: 202 len: 0 microversion: 2.20 time: 0.585547 Apr 16 21:33:08.453196 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2992/5820] 10.222.0.20 () {62 vars in 1318 bytes} [Sat Apr 16 21:33:07 2022] POST /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30/action => generated 0 bytes in 593 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 16 21:33:08.462852 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b6a8a822-4642-465f-8ca2-e2b0e95bf84a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:08.464826 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b6a8a822-4642-465f-8ca2-e2b0e95bf84a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:08.477193 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b6a8a822-4642-465f-8ca2-e2b0e95bf84a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:08.484466 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b6a8a822-4642-465f-8ca2-e2b0e95bf84a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:08.484466 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b6a8a822-4642-465f-8ca2-e2b0e95bf84a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:08.484466 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b6a8a822-4642-465f-8ca2-e2b0e95bf84a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:09.345714 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-24c8d779-d2b4-42c2-8806-21cc537c4a2d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:09.347279 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-24c8d779-d2b4-42c2-8806-21cc537c4a2d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:09.355218 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-24c8d779-d2b4-42c2-8806-21cc537c4a2d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:09.356034 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-24c8d779-d2b4-42c2-8806-21cc537c4a2d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:09.357400 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-24c8d779-d2b4-42c2-8806-21cc537c4a2d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:09.358034 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-24c8d779-d2b4-42c2-8806-21cc537c4a2d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:09.610747 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b6a8a822-4642-465f-8ca2-e2b0e95bf84a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:09.621582 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b6a8a822-4642-465f-8ca2-e2b0e95bf84a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:09.623796 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b6a8a822-4642-465f-8ca2-e2b0e95bf84a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:09.633986 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b6a8a822-4642-465f-8ca2-e2b0e95bf84a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1749 microversion: 2.20 time: 1.173502 Apr 16 21:33:09.633986 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2829/5821] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:33:08 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1749 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:33:10.087162 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-24c8d779-d2b4-42c2-8806-21cc537c4a2d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:10.103189 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-24c8d779-d2b4-42c2-8806-21cc537c4a2d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1696 microversion: 2.1 time: 0.762910 Apr 16 21:33:10.104421 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2993/5822] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:33:09 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1696 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:33:10.650721 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d89989e6-3e81-4f0b-b688-8ff2ac5a96ea tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:10.652838 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d89989e6-3e81-4f0b-b688-8ff2ac5a96ea tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:10.668490 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d89989e6-3e81-4f0b-b688-8ff2ac5a96ea tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:10.674849 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d89989e6-3e81-4f0b-b688-8ff2ac5a96ea tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:10.675963 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d89989e6-3e81-4f0b-b688-8ff2ac5a96ea tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:10.676617 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d89989e6-3e81-4f0b-b688-8ff2ac5a96ea tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:11.122800 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-46f69657-babf-4a34-ae1d-8edc0ce5d528 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:11.124058 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d89989e6-3e81-4f0b-b688-8ff2ac5a96ea tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:11.124737 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-46f69657-babf-4a34-ae1d-8edc0ce5d528 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:11.136822 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d89989e6-3e81-4f0b-b688-8ff2ac5a96ea tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:11.138699 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d89989e6-3e81-4f0b-b688-8ff2ac5a96ea tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:11.140071 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d89989e6-3e81-4f0b-b688-8ff2ac5a96ea tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1749 microversion: 2.20 time: 0.493634 Apr 16 21:33:11.140841 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-46f69657-babf-4a34-ae1d-8edc0ce5d528 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:11.141703 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-46f69657-babf-4a34-ae1d-8edc0ce5d528 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:11.143554 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-46f69657-babf-4a34-ae1d-8edc0ce5d528 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:11.144434 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-46f69657-babf-4a34-ae1d-8edc0ce5d528 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:11.152942 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2830/5823] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:33:10 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1749 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:33:11.623127 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-46f69657-babf-4a34-ae1d-8edc0ce5d528 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:11.650208 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-46f69657-babf-4a34-ae1d-8edc0ce5d528 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1693 microversion: 2.1 time: 0.530630 Apr 16 21:33:11.653445 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2994/5824] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:33:11 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1693 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:33:11.670031 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ae3c5049-2c49-4e7f-8b8c-9969d829327e tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:33:11.672898 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ae3c5049-2c49-4e7f-8b8c-9969d829327e tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:11.687612 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ae3c5049-2c49-4e7f-8b8c-9969d829327e tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:11.688081 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ae3c5049-2c49-4e7f-8b8c-9969d829327e tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:11.689216 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ae3c5049-2c49-4e7f-8b8c-9969d829327e tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:11.689371 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ae3c5049-2c49-4e7f-8b8c-9969d829327e tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:11.968787 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ae3c5049-2c49-4e7f-8b8c-9969d829327e tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "POST /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457/action" status: 204 len: 0 microversion: 2.1 time: 0.302695 Apr 16 21:33:11.972961 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2831/5825] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:33:11 2022] POST /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457/action => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:33:11.998473 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-24a2edfd-9db0-40fe-b9cf-5f7d5da106f7 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:11.999397 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-24a2edfd-9db0-40fe-b9cf-5f7d5da106f7 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:12.055389 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-24a2edfd-9db0-40fe-b9cf-5f7d5da106f7 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:12.056659 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-24a2edfd-9db0-40fe-b9cf-5f7d5da106f7 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:12.059518 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-24a2edfd-9db0-40fe-b9cf-5f7d5da106f7 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:12.062339 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-24a2edfd-9db0-40fe-b9cf-5f7d5da106f7 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:12.160672 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-df6efbea-0d45-4360-932b-cf7476d659ec tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:12.161754 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-df6efbea-0d45-4360-932b-cf7476d659ec tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:12.181792 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-df6efbea-0d45-4360-932b-cf7476d659ec tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:12.182283 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-df6efbea-0d45-4360-932b-cf7476d659ec tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:12.183106 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-df6efbea-0d45-4360-932b-cf7476d659ec tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:12.183555 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-df6efbea-0d45-4360-932b-cf7476d659ec tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:12.476246 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-24a2edfd-9db0-40fe-b9cf-5f7d5da106f7 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:12.489275 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-24a2edfd-9db0-40fe-b9cf-5f7d5da106f7 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1693 microversion: 2.1 time: 0.514709 Apr 16 21:33:12.492131 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2995/5826] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:33:11 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1693 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:33:12.951053 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-df6efbea-0d45-4360-932b-cf7476d659ec tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:12.962608 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-df6efbea-0d45-4360-932b-cf7476d659ec tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:12.965451 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-df6efbea-0d45-4360-932b-cf7476d659ec tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:12.968025 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-df6efbea-0d45-4360-932b-cf7476d659ec tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1751 microversion: 2.20 time: 0.812470 Apr 16 21:33:12.980950 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2832/5827] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:33:12 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1751 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:33:13.275394 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-72fa814e-0297-4872-8d5f-58644415579b tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1666397336", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "e901a3c5-8548-4fed-98c9-44e660df2fa1"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:33:13.366547 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-72fa814e-0297-4872-8d5f-58644415579b tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] validate_networks() for [('e901a3c5-8548-4fed-98c9-44e660df2fa1', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:33:13.530789 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3bfceaa8-d8e8-4c25-8cbf-547b5ffc08b8 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:13.532387 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3bfceaa8-d8e8-4c25-8cbf-547b5ffc08b8 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:13.539409 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3bfceaa8-d8e8-4c25-8cbf-547b5ffc08b8 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:13.540231 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3bfceaa8-d8e8-4c25-8cbf-547b5ffc08b8 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:13.541232 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3bfceaa8-d8e8-4c25-8cbf-547b5ffc08b8 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:13.542047 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3bfceaa8-d8e8-4c25-8cbf-547b5ffc08b8 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:13.978802 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-72fa814e-0297-4872-8d5f-58644415579b tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:33:13.979748 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-72fa814e-0297-4872-8d5f-58644415579b tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:33:13.980423 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-72fa814e-0297-4872-8d5f-58644415579b tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:33:13.981005 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-72fa814e-0297-4872-8d5f-58644415579b tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:33:13.981523 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-72fa814e-0297-4872-8d5f-58644415579b tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:33:13.993649 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-72fa814e-0297-4872-8d5f-58644415579b tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:13.997638 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-72fa814e-0297-4872-8d5f-58644415579b tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:13.997638 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-72fa814e-0297-4872-8d5f-58644415579b tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:13.997638 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-72fa814e-0297-4872-8d5f-58644415579b tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:14.036752 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-72fa814e-0297-4872-8d5f-58644415579b tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Getting quotas for project 4f6fb0a879f54d85895e6b63f3b5ee5f. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:33:14.045027 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-72fa814e-0297-4872-8d5f-58644415579b tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Getting quotas for user bd17fc3dd855491cae4fa8119e9aeb50 and project 4f6fb0a879f54d85895e6b63f3b5ee5f. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:33:14.061175 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-72fa814e-0297-4872-8d5f-58644415579b tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:33:14.063667 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-72fa814e-0297-4872-8d5f-58644415579b tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] [instance: 4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:33:14.272298 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3bfceaa8-d8e8-4c25-8cbf-547b5ffc08b8 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:14.286805 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3bfceaa8-d8e8-4c25-8cbf-547b5ffc08b8 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1693 microversion: 2.1 time: 0.778406 Apr 16 21:33:14.287418 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2833/5828] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:33:13 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1693 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:33:14.292549 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a7d80e13-fe7c-4746-a501-40954c85b7d7 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:14.293175 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a7d80e13-fe7c-4746-a501-40954c85b7d7 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:14.300142 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a7d80e13-fe7c-4746-a501-40954c85b7d7 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:14.300708 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a7d80e13-fe7c-4746-a501-40954c85b7d7 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:14.301532 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a7d80e13-fe7c-4746-a501-40954c85b7d7 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:14.301988 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a7d80e13-fe7c-4746-a501-40954c85b7d7 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:14.528448 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a7d80e13-fe7c-4746-a501-40954c85b7d7 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:14.539665 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a7d80e13-fe7c-4746-a501-40954c85b7d7 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:14.542737 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a7d80e13-fe7c-4746-a501-40954c85b7d7 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:14.545276 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a7d80e13-fe7c-4746-a501-40954c85b7d7 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1807 microversion: 2.20 time: 0.256554 Apr 16 21:33:14.546137 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2834/5829] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:33:14 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1807 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:33:14.558591 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-2b4692aa-1717-41a6-9da7-077b57b444e6 req-1783ff21-bcc2-4a48-9374-14e1e179696d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebff90b9-4ca5-4301-b5d7-4c1e92b16457", "name": "network-vif-plugged", "status": "completed", "tag": "f0531494-4be1-4c6b-bed4-5ffd32fa231d"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:33:14.578991 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-2b4692aa-1717-41a6-9da7-077b57b444e6 req-1783ff21-bcc2-4a48-9374-14e1e179696d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:14.579602 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-2b4692aa-1717-41a6-9da7-077b57b444e6 req-1783ff21-bcc2-4a48-9374-14e1e179696d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:14.596589 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-2b4692aa-1717-41a6-9da7-077b57b444e6 req-1783ff21-bcc2-4a48-9374-14e1e179696d service nova] Creating event network-vif-plugged:f0531494-4be1-4c6b-bed4-5ffd32fa231d for instance ebff90b9-4ca5-4301-b5d7-4c1e92b16457 on nch2-master-1 Apr 16 21:33:14.604081 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [req-2b4692aa-1717-41a6-9da7-077b57b444e6 req-1783ff21-bcc2-4a48-9374-14e1e179696d service nova] Instance ebff90b9-4ca5-4301-b5d7-4c1e92b16457 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137409) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 16 21:33:14.621924 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-2b4692aa-1717-41a6-9da7-077b57b444e6 req-1783ff21-bcc2-4a48-9374-14e1e179696d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074075 Apr 16 21:33:14.623287 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2835/5830] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:33:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:33:14.703385 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-72fa814e-0297-4872-8d5f-58644415579b tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.698925 Apr 16 21:33:14.716784 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2996/5831] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:33:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1713 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:33:14.725753 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c563ccb5-8418-4409-883b-f7706d6d33df tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:14.726629 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c563ccb5-8418-4409-883b-f7706d6d33df tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] [instance: 4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:14.901698 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c563ccb5-8418-4409-883b-f7706d6d33df tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd17fc3dd855491cae4fa8119e9aeb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6fb0a879f54d85895e6b63f3b5ee5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:14.912019 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c563ccb5-8418-4409-883b-f7706d6d33df tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] 10.222.0.20 "GET /compute/v2.1/servers/4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816" status: 200 len: 1216 microversion: 2.1 time: 0.192303 Apr 16 21:33:14.913257 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2836/5832] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:33:14 2022] GET /compute/v2.1/servers/4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816 => generated 1216 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:33:15.306367 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6b03b217-3fd3-4c0d-849e-eee749f9701c tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:15.307268 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6b03b217-3fd3-4c0d-849e-eee749f9701c tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:15.317986 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6b03b217-3fd3-4c0d-849e-eee749f9701c tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:15.318794 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6b03b217-3fd3-4c0d-849e-eee749f9701c tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:15.319853 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6b03b217-3fd3-4c0d-849e-eee749f9701c tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:15.321226 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6b03b217-3fd3-4c0d-849e-eee749f9701c tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:15.567857 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3d2337b6-fc25-4d24-bcdb-56e3453a2d70 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:15.569091 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3d2337b6-fc25-4d24-bcdb-56e3453a2d70 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:15.598126 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3d2337b6-fc25-4d24-bcdb-56e3453a2d70 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:15.599586 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3d2337b6-fc25-4d24-bcdb-56e3453a2d70 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:15.601524 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3d2337b6-fc25-4d24-bcdb-56e3453a2d70 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:15.608216 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3d2337b6-fc25-4d24-bcdb-56e3453a2d70 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:15.653546 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6b03b217-3fd3-4c0d-849e-eee749f9701c tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:15.661918 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6b03b217-3fd3-4c0d-849e-eee749f9701c tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1693 microversion: 2.1 time: 0.359792 Apr 16 21:33:15.662792 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2997/5833] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:33:15 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1693 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:33:15.937971 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2234cc3c-9791-4288-b00f-cfe581a854f1 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:15.938612 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2234cc3c-9791-4288-b00f-cfe581a854f1 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] [instance: 4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:16.067525 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3d2337b6-fc25-4d24-bcdb-56e3453a2d70 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:16.079068 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3d2337b6-fc25-4d24-bcdb-56e3453a2d70 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:16.082120 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3d2337b6-fc25-4d24-bcdb-56e3453a2d70 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:16.084849 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3d2337b6-fc25-4d24-bcdb-56e3453a2d70 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1807 microversion: 2.20 time: 0.521163 Apr 16 21:33:16.085930 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2837/5834] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:33:15 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1807 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:33:16.173247 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2234cc3c-9791-4288-b00f-cfe581a854f1 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd17fc3dd855491cae4fa8119e9aeb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6fb0a879f54d85895e6b63f3b5ee5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:16.180879 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2234cc3c-9791-4288-b00f-cfe581a854f1 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] 10.222.0.20 "GET /compute/v2.1/servers/4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816" status: 200 len: 1216 microversion: 2.1 time: 0.255153 Apr 16 21:33:16.195593 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2998/5835] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:33:15 2022] GET /compute/v2.1/servers/4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816 => generated 1216 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:33:16.680212 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-53d86f30-f1d8-41db-bf9b-8c40fc9c3a6b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:16.683069 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-53d86f30-f1d8-41db-bf9b-8c40fc9c3a6b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:16.702313 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-53d86f30-f1d8-41db-bf9b-8c40fc9c3a6b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:16.706013 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-53d86f30-f1d8-41db-bf9b-8c40fc9c3a6b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:16.710580 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-53d86f30-f1d8-41db-bf9b-8c40fc9c3a6b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:16.714855 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-53d86f30-f1d8-41db-bf9b-8c40fc9c3a6b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:17.104786 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2930aed4-9539-4dca-bbc4-a565383bcf1d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:17.105459 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2930aed4-9539-4dca-bbc4-a565383bcf1d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:17.129732 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2930aed4-9539-4dca-bbc4-a565383bcf1d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:17.130485 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2930aed4-9539-4dca-bbc4-a565383bcf1d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:17.133022 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2930aed4-9539-4dca-bbc4-a565383bcf1d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:17.152988 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2930aed4-9539-4dca-bbc4-a565383bcf1d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:17.362983 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-53d86f30-f1d8-41db-bf9b-8c40fc9c3a6b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:17.376092 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-53d86f30-f1d8-41db-bf9b-8c40fc9c3a6b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1685 microversion: 2.1 time: 0.699975 Apr 16 21:33:17.386228 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2838/5836] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:33:16 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1685 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:33:17.393461 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-dba125b4-0d60-45e8-aecc-8d22231e3b73 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:17.394264 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-dba125b4-0d60-45e8-aecc-8d22231e3b73 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] [instance: 4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:17.400990 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dba125b4-0d60-45e8-aecc-8d22231e3b73 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:17.401706 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dba125b4-0d60-45e8-aecc-8d22231e3b73 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:17.402680 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dba125b4-0d60-45e8-aecc-8d22231e3b73 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:17.403326 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dba125b4-0d60-45e8-aecc-8d22231e3b73 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:17.517477 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-dba125b4-0d60-45e8-aecc-8d22231e3b73 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd17fc3dd855491cae4fa8119e9aeb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6fb0a879f54d85895e6b63f3b5ee5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:17.555092 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-dba125b4-0d60-45e8-aecc-8d22231e3b73 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] 10.222.0.20 "GET /compute/v2.1/servers/4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816" status: 200 len: 1268 microversion: 2.1 time: 0.164954 Apr 16 21:33:17.558318 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2839/5837] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:33:17 2022] GET /compute/v2.1/servers/4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816 => generated 1268 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:33:17.686422 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2930aed4-9539-4dca-bbc4-a565383bcf1d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:17.707024 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2930aed4-9539-4dca-bbc4-a565383bcf1d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:17.707024 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2930aed4-9539-4dca-bbc4-a565383bcf1d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:17.707934 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2930aed4-9539-4dca-bbc4-a565383bcf1d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1807 microversion: 2.20 time: 0.607132 Apr 16 21:33:17.713522 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 2999/5838] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:33:17 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1807 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:33:18.589436 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6bcd8841-2123-43d0-9695-cb3ecd83b755 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:18.591840 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6bcd8841-2123-43d0-9695-cb3ecd83b755 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] [instance: 4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:18.611827 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6bcd8841-2123-43d0-9695-cb3ecd83b755 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:18.615400 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6bcd8841-2123-43d0-9695-cb3ecd83b755 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:18.615400 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6bcd8841-2123-43d0-9695-cb3ecd83b755 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:18.615972 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6bcd8841-2123-43d0-9695-cb3ecd83b755 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:18.739117 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6d30731e-6267-4bf2-978a-8ba904797c67 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:18.739743 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6d30731e-6267-4bf2-978a-8ba904797c67 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:18.751963 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6d30731e-6267-4bf2-978a-8ba904797c67 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:18.752732 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6d30731e-6267-4bf2-978a-8ba904797c67 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:18.753746 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6d30731e-6267-4bf2-978a-8ba904797c67 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:18.757239 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6d30731e-6267-4bf2-978a-8ba904797c67 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:18.801942 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6bcd8841-2123-43d0-9695-cb3ecd83b755 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd17fc3dd855491cae4fa8119e9aeb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6fb0a879f54d85895e6b63f3b5ee5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:18.814295 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6bcd8841-2123-43d0-9695-cb3ecd83b755 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] 10.222.0.20 "GET /compute/v2.1/servers/4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816" status: 200 len: 1274 microversion: 2.1 time: 0.240691 Apr 16 21:33:18.816257 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2840/5839] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:33:18 2022] GET /compute/v2.1/servers/4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816 => generated 1274 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:33:19.133734 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6d30731e-6267-4bf2-978a-8ba904797c67 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:19.152860 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6d30731e-6267-4bf2-978a-8ba904797c67 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:19.155656 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6d30731e-6267-4bf2-978a-8ba904797c67 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:19.158565 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6d30731e-6267-4bf2-978a-8ba904797c67 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1807 microversion: 2.20 time: 0.423738 Apr 16 21:33:19.160698 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3000/5840] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:33:18 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1807 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:33:19.834375 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8b523bbc-a60d-42dc-b75d-93ec0958a12a tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:19.835016 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8b523bbc-a60d-42dc-b75d-93ec0958a12a tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] [instance: 4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:19.845635 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8b523bbc-a60d-42dc-b75d-93ec0958a12a tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:19.848781 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8b523bbc-a60d-42dc-b75d-93ec0958a12a tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:19.849786 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8b523bbc-a60d-42dc-b75d-93ec0958a12a tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:19.850406 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8b523bbc-a60d-42dc-b75d-93ec0958a12a tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:20.178485 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8a807608-639e-4926-9ba9-853ab3256195 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:20.179100 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8a807608-639e-4926-9ba9-853ab3256195 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:20.190203 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8a807608-639e-4926-9ba9-853ab3256195 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:20.192739 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8a807608-639e-4926-9ba9-853ab3256195 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:20.195965 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8a807608-639e-4926-9ba9-853ab3256195 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:20.205873 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8a807608-639e-4926-9ba9-853ab3256195 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:20.335928 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8b523bbc-a60d-42dc-b75d-93ec0958a12a tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd17fc3dd855491cae4fa8119e9aeb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6fb0a879f54d85895e6b63f3b5ee5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:20.382822 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8b523bbc-a60d-42dc-b75d-93ec0958a12a tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] 10.222.0.20 "GET /compute/v2.1/servers/4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816" status: 200 len: 1274 microversion: 2.1 time: 0.548956 Apr 16 21:33:20.384906 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2841/5841] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:33:19 2022] GET /compute/v2.1/servers/4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816 => generated 1274 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:33:20.471150 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8a807608-639e-4926-9ba9-853ab3256195 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:20.488189 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8a807608-639e-4926-9ba9-853ab3256195 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:20.490022 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8a807608-639e-4926-9ba9-853ab3256195 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:20.491287 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8a807608-639e-4926-9ba9-853ab3256195 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1807 microversion: 2.20 time: 0.316638 Apr 16 21:33:20.492150 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3001/5842] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:33:20 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1807 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:33:21.407888 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1615c603-498b-4f9b-935e-82f9de90fcc9 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:21.409125 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1615c603-498b-4f9b-935e-82f9de90fcc9 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] [instance: 4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:21.417122 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1615c603-498b-4f9b-935e-82f9de90fcc9 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:21.418332 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1615c603-498b-4f9b-935e-82f9de90fcc9 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:21.429539 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1615c603-498b-4f9b-935e-82f9de90fcc9 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:21.430167 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1615c603-498b-4f9b-935e-82f9de90fcc9 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:21.529051 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-94abb862-115a-4ff6-9bae-19d5170a9d6a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:21.530450 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-94abb862-115a-4ff6-9bae-19d5170a9d6a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:21.548467 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-94abb862-115a-4ff6-9bae-19d5170a9d6a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:21.549310 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-94abb862-115a-4ff6-9bae-19d5170a9d6a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:21.550304 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-94abb862-115a-4ff6-9bae-19d5170a9d6a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:21.550939 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-94abb862-115a-4ff6-9bae-19d5170a9d6a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:22.115280 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-94abb862-115a-4ff6-9bae-19d5170a9d6a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:22.140438 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-94abb862-115a-4ff6-9bae-19d5170a9d6a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:22.146695 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-94abb862-115a-4ff6-9bae-19d5170a9d6a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:22.148364 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-94abb862-115a-4ff6-9bae-19d5170a9d6a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1807 microversion: 2.20 time: 0.625399 Apr 16 21:33:22.151622 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3002/5843] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:33:21 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1807 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:33:22.231529 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1615c603-498b-4f9b-935e-82f9de90fcc9 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd17fc3dd855491cae4fa8119e9aeb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6fb0a879f54d85895e6b63f3b5ee5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:22.254586 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1615c603-498b-4f9b-935e-82f9de90fcc9 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] 10.222.0.20 "GET /compute/v2.1/servers/4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816" status: 200 len: 1316 microversion: 2.1 time: 0.850513 Apr 16 21:33:22.263796 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2842/5844] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:33:21 2022] GET /compute/v2.1/servers/4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816 => generated 1316 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:33:23.175242 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fed12946-1a1e-48af-a673-6a3dc2064498 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:23.175872 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fed12946-1a1e-48af-a673-6a3dc2064498 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:23.219383 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fed12946-1a1e-48af-a673-6a3dc2064498 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:23.224932 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fed12946-1a1e-48af-a673-6a3dc2064498 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:23.233932 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fed12946-1a1e-48af-a673-6a3dc2064498 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:23.235333 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fed12946-1a1e-48af-a673-6a3dc2064498 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:23.289087 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-883c332e-ba78-4f00-b251-7c9274f93813 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:23.289870 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-883c332e-ba78-4f00-b251-7c9274f93813 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] [instance: 4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:23.315260 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-883c332e-ba78-4f00-b251-7c9274f93813 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:23.316811 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-883c332e-ba78-4f00-b251-7c9274f93813 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:23.316811 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-883c332e-ba78-4f00-b251-7c9274f93813 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:23.334501 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-883c332e-ba78-4f00-b251-7c9274f93813 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:24.302516 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fed12946-1a1e-48af-a673-6a3dc2064498 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:24.327300 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fed12946-1a1e-48af-a673-6a3dc2064498 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:24.330390 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fed12946-1a1e-48af-a673-6a3dc2064498 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:24.332145 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fed12946-1a1e-48af-a673-6a3dc2064498 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1807 microversion: 2.20 time: 1.169033 Apr 16 21:33:24.339427 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3003/5845] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:33:23 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1807 bytes in 1177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:33:25.119831 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-883c332e-ba78-4f00-b251-7c9274f93813 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd17fc3dd855491cae4fa8119e9aeb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6fb0a879f54d85895e6b63f3b5ee5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:25.132979 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-883c332e-ba78-4f00-b251-7c9274f93813 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] 10.222.0.20 "GET /compute/v2.1/servers/4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816" status: 200 len: 1316 microversion: 2.1 time: 1.855716 Apr 16 21:33:25.135397 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2843/5846] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:33:23 2022] GET /compute/v2.1/servers/4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816 => generated 1316 bytes in 1859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:33:25.353349 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5b721d34-db29-4cad-b8ab-9d248d9c9372 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:25.355042 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5b721d34-db29-4cad-b8ab-9d248d9c9372 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:25.386095 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5b721d34-db29-4cad-b8ab-9d248d9c9372 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:25.386095 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5b721d34-db29-4cad-b8ab-9d248d9c9372 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:25.386095 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5b721d34-db29-4cad-b8ab-9d248d9c9372 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:25.386095 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5b721d34-db29-4cad-b8ab-9d248d9c9372 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:25.746557 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-0179e15b-c068-4018-befc-a2cf76ae68f2 req-730a0f6b-27fa-4b3e-8b55-5c5cec3d3e62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816", "tag": "f6f35eec-a034-4ada-9d0c-a22db01f2b1c"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:33:25.771488 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-0179e15b-c068-4018-befc-a2cf76ae68f2 req-730a0f6b-27fa-4b3e-8b55-5c5cec3d3e62 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:25.773258 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-0179e15b-c068-4018-befc-a2cf76ae68f2 req-730a0f6b-27fa-4b3e-8b55-5c5cec3d3e62 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:25.826186 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-0179e15b-c068-4018-befc-a2cf76ae68f2 req-730a0f6b-27fa-4b3e-8b55-5c5cec3d3e62 service nova] Creating event network-changed:f6f35eec-a034-4ada-9d0c-a22db01f2b1c for instance 4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816 on nch1-master-1 Apr 16 21:33:25.836929 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-0179e15b-c068-4018-befc-a2cf76ae68f2 req-730a0f6b-27fa-4b3e-8b55-5c5cec3d3e62 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094167 Apr 16 21:33:25.841780 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2844/5847] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:33:26.158505 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b325d192-fc6d-4834-93db-cc08d834c6bb tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:26.166541 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b325d192-fc6d-4834-93db-cc08d834c6bb tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] [instance: 4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:26.186524 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b325d192-fc6d-4834-93db-cc08d834c6bb tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:26.186993 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b325d192-fc6d-4834-93db-cc08d834c6bb tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:26.188228 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b325d192-fc6d-4834-93db-cc08d834c6bb tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:26.188858 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b325d192-fc6d-4834-93db-cc08d834c6bb tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:26.647528 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5b721d34-db29-4cad-b8ab-9d248d9c9372 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:26.657850 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5b721d34-db29-4cad-b8ab-9d248d9c9372 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:26.659407 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5b721d34-db29-4cad-b8ab-9d248d9c9372 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:26.660665 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5b721d34-db29-4cad-b8ab-9d248d9c9372 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1807 microversion: 2.20 time: 1.313777 Apr 16 21:33:26.680407 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3004/5848] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:33:25 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1807 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:33:26.771489 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b325d192-fc6d-4834-93db-cc08d834c6bb tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd17fc3dd855491cae4fa8119e9aeb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6fb0a879f54d85895e6b63f3b5ee5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:26.797857 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b325d192-fc6d-4834-93db-cc08d834c6bb tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] 10.222.0.20 "GET /compute/v2.1/servers/4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816" status: 200 len: 1316 microversion: 2.1 time: 0.642282 Apr 16 21:33:26.798459 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2845/5849] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:33:26 2022] GET /compute/v2.1/servers/4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816 => generated 1316 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:33:27.685554 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a9366b03-bf7e-41ed-a681-e7600588bae3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:27.686205 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a9366b03-bf7e-41ed-a681-e7600588bae3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:27.718546 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9366b03-bf7e-41ed-a681-e7600588bae3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:27.726403 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9366b03-bf7e-41ed-a681-e7600588bae3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:27.729228 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9366b03-bf7e-41ed-a681-e7600588bae3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:27.731598 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9366b03-bf7e-41ed-a681-e7600588bae3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:27.817176 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5a6414d8-f90e-4e52-a8d7-ef67953b003b tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:27.820300 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5a6414d8-f90e-4e52-a8d7-ef67953b003b tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] [instance: 4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:27.833216 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5a6414d8-f90e-4e52-a8d7-ef67953b003b tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:27.837060 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5a6414d8-f90e-4e52-a8d7-ef67953b003b tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:27.838797 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5a6414d8-f90e-4e52-a8d7-ef67953b003b tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:27.841308 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5a6414d8-f90e-4e52-a8d7-ef67953b003b tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:28.375747 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a9366b03-bf7e-41ed-a681-e7600588bae3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:28.391117 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a9366b03-bf7e-41ed-a681-e7600588bae3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:28.396629 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a9366b03-bf7e-41ed-a681-e7600588bae3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:28.405107 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a9366b03-bf7e-41ed-a681-e7600588bae3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1807 microversion: 2.20 time: 0.729182 Apr 16 21:33:28.405944 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3005/5850] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:33:27 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1807 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:33:28.592095 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5a6414d8-f90e-4e52-a8d7-ef67953b003b tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd17fc3dd855491cae4fa8119e9aeb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6fb0a879f54d85895e6b63f3b5ee5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:28.622477 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5a6414d8-f90e-4e52-a8d7-ef67953b003b tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] 10.222.0.20 "GET /compute/v2.1/servers/4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816" status: 200 len: 1316 microversion: 2.1 time: 0.808008 Apr 16 21:33:28.636653 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2846/5851] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:33:27 2022] GET /compute/v2.1/servers/4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816 => generated 1316 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:33:29.424696 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-371b3e62-24df-4524-bd72-de8c5282405a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:29.425324 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-371b3e62-24df-4524-bd72-de8c5282405a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:29.453880 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-371b3e62-24df-4524-bd72-de8c5282405a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:29.459980 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-371b3e62-24df-4524-bd72-de8c5282405a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:29.476324 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-371b3e62-24df-4524-bd72-de8c5282405a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:29.477188 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-371b3e62-24df-4524-bd72-de8c5282405a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:29.657553 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-beb39730-d480-44d2-b360-86952d82ff5f tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:29.658180 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-beb39730-d480-44d2-b360-86952d82ff5f tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] [instance: 4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:29.691583 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-beb39730-d480-44d2-b360-86952d82ff5f tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:29.692089 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-beb39730-d480-44d2-b360-86952d82ff5f tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:29.692895 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-beb39730-d480-44d2-b360-86952d82ff5f tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:29.693906 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-beb39730-d480-44d2-b360-86952d82ff5f tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:30.621318 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-beb39730-d480-44d2-b360-86952d82ff5f tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd17fc3dd855491cae4fa8119e9aeb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6fb0a879f54d85895e6b63f3b5ee5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:30.630146 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-beb39730-d480-44d2-b360-86952d82ff5f tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] 10.222.0.20 "GET /compute/v2.1/servers/4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816" status: 200 len: 1316 microversion: 2.1 time: 0.976461 Apr 16 21:33:30.630748 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2847/5852] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:33:29 2022] GET /compute/v2.1/servers/4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816 => generated 1316 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:33:30.788307 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-371b3e62-24df-4524-bd72-de8c5282405a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:30.809468 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-371b3e62-24df-4524-bd72-de8c5282405a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:30.811729 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-371b3e62-24df-4524-bd72-de8c5282405a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:30.813286 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-371b3e62-24df-4524-bd72-de8c5282405a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1807 microversion: 2.20 time: 1.393338 Apr 16 21:33:30.814543 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3006/5853] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:33:29 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1807 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:33:31.663223 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2baea05c-23c0-4c10-9766-409fbf617073 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:31.666033 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2baea05c-23c0-4c10-9766-409fbf617073 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] [instance: 4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:31.693291 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2baea05c-23c0-4c10-9766-409fbf617073 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:31.693789 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2baea05c-23c0-4c10-9766-409fbf617073 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:31.696827 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2baea05c-23c0-4c10-9766-409fbf617073 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:31.699326 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2baea05c-23c0-4c10-9766-409fbf617073 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:31.835631 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-50be4735-8ffd-48e2-9a41-f984a9699343 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:31.837179 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-50be4735-8ffd-48e2-9a41-f984a9699343 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:31.868008 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-50be4735-8ffd-48e2-9a41-f984a9699343 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:31.874036 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-50be4735-8ffd-48e2-9a41-f984a9699343 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:31.874601 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-50be4735-8ffd-48e2-9a41-f984a9699343 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:31.875167 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-50be4735-8ffd-48e2-9a41-f984a9699343 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:32.221947 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2baea05c-23c0-4c10-9766-409fbf617073 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd17fc3dd855491cae4fa8119e9aeb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6fb0a879f54d85895e6b63f3b5ee5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:32.233199 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2baea05c-23c0-4c10-9766-409fbf617073 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] 10.222.0.20 "GET /compute/v2.1/servers/4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816" status: 200 len: 1316 microversion: 2.1 time: 0.588701 Apr 16 21:33:32.234796 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2848/5854] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:33:31 2022] GET /compute/v2.1/servers/4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816 => generated 1316 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:33:32.290055 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-50be4735-8ffd-48e2-9a41-f984a9699343 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:32.297979 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-50be4735-8ffd-48e2-9a41-f984a9699343 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:32.300105 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-50be4735-8ffd-48e2-9a41-f984a9699343 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:32.301708 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-50be4735-8ffd-48e2-9a41-f984a9699343 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1807 microversion: 2.20 time: 0.472803 Apr 16 21:33:32.303454 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3007/5855] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:33:31 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1807 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:33:33.251331 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8ecbf6dc-8788-4b51-a566-e98027866312 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:33.252630 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8ecbf6dc-8788-4b51-a566-e98027866312 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] [instance: 4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:33.260012 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8ecbf6dc-8788-4b51-a566-e98027866312 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:33.260891 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8ecbf6dc-8788-4b51-a566-e98027866312 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:33.261980 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8ecbf6dc-8788-4b51-a566-e98027866312 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:33.263181 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8ecbf6dc-8788-4b51-a566-e98027866312 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:33.323505 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-917c319b-cf66-4be0-8855-328b5939c664 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:33.324239 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-917c319b-cf66-4be0-8855-328b5939c664 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:33.335788 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-917c319b-cf66-4be0-8855-328b5939c664 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:33.343133 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-917c319b-cf66-4be0-8855-328b5939c664 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:33.352800 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-917c319b-cf66-4be0-8855-328b5939c664 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:33.352800 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-917c319b-cf66-4be0-8855-328b5939c664 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:33.618485 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8ecbf6dc-8788-4b51-a566-e98027866312 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd17fc3dd855491cae4fa8119e9aeb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6fb0a879f54d85895e6b63f3b5ee5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:33.628395 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8ecbf6dc-8788-4b51-a566-e98027866312 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] 10.222.0.20 "GET /compute/v2.1/servers/4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816" status: 200 len: 1316 microversion: 2.1 time: 0.381106 Apr 16 21:33:33.640150 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2849/5856] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:33:33 2022] GET /compute/v2.1/servers/4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816 => generated 1316 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:33:33.655285 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-917c319b-cf66-4be0-8855-328b5939c664 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:33.665481 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-917c319b-cf66-4be0-8855-328b5939c664 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:33.667503 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-917c319b-cf66-4be0-8855-328b5939c664 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:33.669837 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-917c319b-cf66-4be0-8855-328b5939c664 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1807 microversion: 2.20 time: 0.352186 Apr 16 21:33:33.682340 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3008/5857] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:33:33 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1807 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:33:34.648414 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bb0b82af-b5b0-494c-aeca-93f09c25a0b1 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:34.649159 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-bb0b82af-b5b0-494c-aeca-93f09c25a0b1 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] [instance: 4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:34.662399 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bb0b82af-b5b0-494c-aeca-93f09c25a0b1 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:34.664908 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bb0b82af-b5b0-494c-aeca-93f09c25a0b1 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:34.666225 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bb0b82af-b5b0-494c-aeca-93f09c25a0b1 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:34.669517 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bb0b82af-b5b0-494c-aeca-93f09c25a0b1 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:34.669792 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-90e9791c-34ae-46bb-866d-7c6de961a3ac req-6450d2d2-14ac-4ff8-bb47-c481e9074b93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816", "name": "network-vif-plugged", "status": "completed", "tag": "f6f35eec-a034-4ada-9d0c-a22db01f2b1c"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:33:34.689842 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-90e9791c-34ae-46bb-866d-7c6de961a3ac req-6450d2d2-14ac-4ff8-bb47-c481e9074b93 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:34.690514 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-90e9791c-34ae-46bb-866d-7c6de961a3ac req-6450d2d2-14ac-4ff8-bb47-c481e9074b93 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:34.724968 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-90e9791c-34ae-46bb-866d-7c6de961a3ac req-6450d2d2-14ac-4ff8-bb47-c481e9074b93 service nova] Creating event network-vif-plugged:f6f35eec-a034-4ada-9d0c-a22db01f2b1c for instance 4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816 on nch1-master-1 Apr 16 21:33:34.736469 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-90e9791c-34ae-46bb-866d-7c6de961a3ac req-6450d2d2-14ac-4ff8-bb47-c481e9074b93 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.299617 Apr 16 21:33:34.741122 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2850/5858] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:33:34.747235 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-75a6437d-e69b-4426-b6a6-7132a76d5bc5 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:34.753251 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-75a6437d-e69b-4426-b6a6-7132a76d5bc5 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:34.767543 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-75a6437d-e69b-4426-b6a6-7132a76d5bc5 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:34.774314 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-75a6437d-e69b-4426-b6a6-7132a76d5bc5 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:34.775656 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-75a6437d-e69b-4426-b6a6-7132a76d5bc5 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:34.776301 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-75a6437d-e69b-4426-b6a6-7132a76d5bc5 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:35.021471 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-bb0b82af-b5b0-494c-aeca-93f09c25a0b1 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd17fc3dd855491cae4fa8119e9aeb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6fb0a879f54d85895e6b63f3b5ee5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:35.039269 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-bb0b82af-b5b0-494c-aeca-93f09c25a0b1 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] 10.222.0.20 "GET /compute/v2.1/servers/4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816" status: 200 len: 1316 microversion: 2.1 time: 0.396459 Apr 16 21:33:35.041298 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3009/5859] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:33:34 2022] GET /compute/v2.1/servers/4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816 => generated 1316 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:33:35.355116 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-75a6437d-e69b-4426-b6a6-7132a76d5bc5 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:35.372048 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-75a6437d-e69b-4426-b6a6-7132a76d5bc5 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:35.375085 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-75a6437d-e69b-4426-b6a6-7132a76d5bc5 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:35.376645 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-75a6437d-e69b-4426-b6a6-7132a76d5bc5 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1807 microversion: 2.20 time: 0.633589 Apr 16 21:33:35.389544 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2851/5860] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:33:34 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1807 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:33:36.059332 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-32bb29b8-04e4-4900-ab25-3180b534552a tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:36.060095 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-32bb29b8-04e4-4900-ab25-3180b534552a tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] [instance: 4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:36.066932 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-32bb29b8-04e4-4900-ab25-3180b534552a tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:36.067520 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-32bb29b8-04e4-4900-ab25-3180b534552a tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:36.068429 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-32bb29b8-04e4-4900-ab25-3180b534552a tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:36.069112 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-32bb29b8-04e4-4900-ab25-3180b534552a tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:36.312587 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-32bb29b8-04e4-4900-ab25-3180b534552a tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd17fc3dd855491cae4fa8119e9aeb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6fb0a879f54d85895e6b63f3b5ee5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:36.320513 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-32bb29b8-04e4-4900-ab25-3180b534552a tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] 10.222.0.20 "GET /compute/v2.1/servers/4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816" status: 200 len: 1316 microversion: 2.1 time: 0.266572 Apr 16 21:33:36.321318 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3010/5861] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:33:36 2022] GET /compute/v2.1/servers/4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816 => generated 1316 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:33:36.397191 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ff47cab3-3b0c-41c7-9697-c98c57de610d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:36.398489 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ff47cab3-3b0c-41c7-9697-c98c57de610d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:36.419518 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ff47cab3-3b0c-41c7-9697-c98c57de610d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:36.420089 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ff47cab3-3b0c-41c7-9697-c98c57de610d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:36.455928 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ff47cab3-3b0c-41c7-9697-c98c57de610d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:36.458241 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ff47cab3-3b0c-41c7-9697-c98c57de610d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:36.947529 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ff47cab3-3b0c-41c7-9697-c98c57de610d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:36.956271 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ff47cab3-3b0c-41c7-9697-c98c57de610d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:36.957825 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ff47cab3-3b0c-41c7-9697-c98c57de610d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:36.959026 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ff47cab3-3b0c-41c7-9697-c98c57de610d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1807 microversion: 2.20 time: 0.567701 Apr 16 21:33:36.960139 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2852/5862] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:33:36 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1807 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:33:37.338891 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6c872b67-714e-4899-89f1-25c00314420c tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:37.340990 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6c872b67-714e-4899-89f1-25c00314420c tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] [instance: 4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:37.356840 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6c872b67-714e-4899-89f1-25c00314420c tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:37.359265 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6c872b67-714e-4899-89f1-25c00314420c tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:37.362606 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6c872b67-714e-4899-89f1-25c00314420c tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:37.363362 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6c872b67-714e-4899-89f1-25c00314420c tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:37.979854 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-53d91e32-2a36-4709-9b66-5b15a95e169f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:37.980513 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-53d91e32-2a36-4709-9b66-5b15a95e169f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:37.987911 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-53d91e32-2a36-4709-9b66-5b15a95e169f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:37.988409 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-53d91e32-2a36-4709-9b66-5b15a95e169f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:37.989209 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-53d91e32-2a36-4709-9b66-5b15a95e169f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:37.989656 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-53d91e32-2a36-4709-9b66-5b15a95e169f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:38.105154 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6c872b67-714e-4899-89f1-25c00314420c tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd17fc3dd855491cae4fa8119e9aeb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6fb0a879f54d85895e6b63f3b5ee5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:38.120538 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6c872b67-714e-4899-89f1-25c00314420c tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] 10.222.0.20 "GET /compute/v2.1/servers/4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816" status: 200 len: 1503 microversion: 2.1 time: 0.784130 Apr 16 21:33:38.122267 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3011/5863] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:33:37 2022] GET /compute/v2.1/servers/4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816 => generated 1503 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:33:38.142122 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c1e54654-d02b-47cd-9a7f-20de6250adc3 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:38.142907 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c1e54654-d02b-47cd-9a7f-20de6250adc3 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] [instance: 4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:38.151266 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c1e54654-d02b-47cd-9a7f-20de6250adc3 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:38.152152 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c1e54654-d02b-47cd-9a7f-20de6250adc3 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:38.153295 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c1e54654-d02b-47cd-9a7f-20de6250adc3 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:38.154385 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c1e54654-d02b-47cd-9a7f-20de6250adc3 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:38.291695 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c1e54654-d02b-47cd-9a7f-20de6250adc3 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.155936 Apr 16 21:33:38.297566 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3012/5864] 10.222.0.20 () {58 vars in 1295 bytes} [Sat Apr 16 21:33:38 2022] DELETE /compute/v2.1/servers/4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816/os-server-password => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:33:38.304199 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cba7c926-dc0d-4bc2-9d2b-bdfcdc215938 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:38.304989 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cba7c926-dc0d-4bc2-9d2b-bdfcdc215938 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] [instance: 4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:38.312545 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cba7c926-dc0d-4bc2-9d2b-bdfcdc215938 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:38.313405 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cba7c926-dc0d-4bc2-9d2b-bdfcdc215938 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:38.314804 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cba7c926-dc0d-4bc2-9d2b-bdfcdc215938 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:38.315480 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cba7c926-dc0d-4bc2-9d2b-bdfcdc215938 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:38.351222 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cba7c926-dc0d-4bc2-9d2b-bdfcdc215938 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] 10.222.0.20 "GET /compute/v2.1/servers/4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.051798 Apr 16 21:33:38.352747 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3013/5865] 10.222.0.20 () {58 vars in 1292 bytes} [Sat Apr 16 21:33:38 2022] GET /compute/v2.1/servers/4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816/os-server-password => generated 16 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:33:38.364503 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f9dc4893-02f6-427a-a52c-805237b4640b tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:38.365387 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f9dc4893-02f6-427a-a52c-805237b4640b tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] [instance: 4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:38.374005 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9dc4893-02f6-427a-a52c-805237b4640b tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:38.375048 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9dc4893-02f6-427a-a52c-805237b4640b tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:38.376029 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9dc4893-02f6-427a-a52c-805237b4640b tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:38.376774 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9dc4893-02f6-427a-a52c-805237b4640b tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:38.405893 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f9dc4893-02f6-427a-a52c-805237b4640b tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] [instance: 4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:33:38.438535 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-53d91e32-2a36-4709-9b66-5b15a95e169f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:38.453048 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-53d91e32-2a36-4709-9b66-5b15a95e169f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:38.456094 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-53d91e32-2a36-4709-9b66-5b15a95e169f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:38.458155 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-53d91e32-2a36-4709-9b66-5b15a95e169f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1807 microversion: 2.20 time: 0.483769 Apr 16 21:33:38.459353 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2853/5866] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:33:37 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1807 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:33:38.843375 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f9dc4893-02f6-427a-a52c-805237b4640b tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816" status: 204 len: 0 microversion: 2.1 time: 0.482723 Apr 16 21:33:38.843984 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3014/5867] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:33:38 2022] DELETE /compute/v2.1/servers/4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:33:38.852686 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4f1754b2-a44d-4211-ae1d-e54ad3a2d70d tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:38.853544 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4f1754b2-a44d-4211-ae1d-e54ad3a2d70d tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] [instance: 4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:38.860494 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4f1754b2-a44d-4211-ae1d-e54ad3a2d70d tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:38.861199 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4f1754b2-a44d-4211-ae1d-e54ad3a2d70d tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:38.862245 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4f1754b2-a44d-4211-ae1d-e54ad3a2d70d tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:38.862932 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4f1754b2-a44d-4211-ae1d-e54ad3a2d70d tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:39.097408 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4f1754b2-a44d-4211-ae1d-e54ad3a2d70d tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd17fc3dd855491cae4fa8119e9aeb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6fb0a879f54d85895e6b63f3b5ee5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:39.114327 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4f1754b2-a44d-4211-ae1d-e54ad3a2d70d tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] 10.222.0.20 "GET /compute/v2.1/servers/4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816" status: 200 len: 1509 microversion: 2.1 time: 0.265493 Apr 16 21:33:39.124481 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2854/5868] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:33:38 2022] GET /compute/v2.1/servers/4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816 => generated 1509 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:33:39.487388 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-333e0427-b0fc-4384-b50f-785f297d7d85 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:39.488399 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-333e0427-b0fc-4384-b50f-785f297d7d85 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:39.515350 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-333e0427-b0fc-4384-b50f-785f297d7d85 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:39.515350 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-333e0427-b0fc-4384-b50f-785f297d7d85 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:39.515350 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-333e0427-b0fc-4384-b50f-785f297d7d85 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:39.515350 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-333e0427-b0fc-4384-b50f-785f297d7d85 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:39.841152 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-333e0427-b0fc-4384-b50f-785f297d7d85 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:39.860814 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-333e0427-b0fc-4384-b50f-785f297d7d85 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:39.862972 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-333e0427-b0fc-4384-b50f-785f297d7d85 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:39.864483 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-333e0427-b0fc-4384-b50f-785f297d7d85 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1807 microversion: 2.20 time: 0.383019 Apr 16 21:33:39.866329 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3015/5869] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:33:39 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1807 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:33:40.131065 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6c3db812-8207-4489-a9e2-4ed8ed1916c4 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:40.131833 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6c3db812-8207-4489-a9e2-4ed8ed1916c4 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] [instance: 4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:40.138371 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6c3db812-8207-4489-a9e2-4ed8ed1916c4 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:40.138836 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6c3db812-8207-4489-a9e2-4ed8ed1916c4 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:40.139672 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6c3db812-8207-4489-a9e2-4ed8ed1916c4 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:40.140123 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6c3db812-8207-4489-a9e2-4ed8ed1916c4 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:40.679566 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6c3db812-8207-4489-a9e2-4ed8ed1916c4 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd17fc3dd855491cae4fa8119e9aeb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6fb0a879f54d85895e6b63f3b5ee5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:40.688025 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6c3db812-8207-4489-a9e2-4ed8ed1916c4 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] 10.222.0.20 "GET /compute/v2.1/servers/4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816" status: 200 len: 1509 microversion: 2.1 time: 0.560781 Apr 16 21:33:40.688659 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2855/5870] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:33:40 2022] GET /compute/v2.1/servers/4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816 => generated 1509 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:33:40.886124 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-93b7246d-f12f-4745-b6ca-01b94391d505 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:40.887974 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-93b7246d-f12f-4745-b6ca-01b94391d505 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:40.912278 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-93b7246d-f12f-4745-b6ca-01b94391d505 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:40.916011 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-93b7246d-f12f-4745-b6ca-01b94391d505 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:40.923341 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-93b7246d-f12f-4745-b6ca-01b94391d505 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:40.928186 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-93b7246d-f12f-4745-b6ca-01b94391d505 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:41.257899 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-93b7246d-f12f-4745-b6ca-01b94391d505 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:41.271541 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-93b7246d-f12f-4745-b6ca-01b94391d505 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:41.276918 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-93b7246d-f12f-4745-b6ca-01b94391d505 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:41.279142 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-93b7246d-f12f-4745-b6ca-01b94391d505 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1807 microversion: 2.20 time: 0.398501 Apr 16 21:33:41.282325 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3016/5871] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:33:40 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1807 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:33:41.713543 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a606b5e3-5b82-4d7a-b3d1-99559ccd816c tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:41.717820 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a606b5e3-5b82-4d7a-b3d1-99559ccd816c tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] [instance: 4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:41.726581 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-3f9c48da-5748-4fb6-978e-7249db313dd2 req-ac4a94c0-8a8c-4cd2-89ac-338478e1fba4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816", "name": "network-vif-deleted", "tag": "f6f35eec-a034-4ada-9d0c-a22db01f2b1c"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:33:41.748962 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a606b5e3-5b82-4d7a-b3d1-99559ccd816c tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:41.749864 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a606b5e3-5b82-4d7a-b3d1-99559ccd816c tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:41.750533 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-3f9c48da-5748-4fb6-978e-7249db313dd2 req-ac4a94c0-8a8c-4cd2-89ac-338478e1fba4 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:41.751478 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-3f9c48da-5748-4fb6-978e-7249db313dd2 req-ac4a94c0-8a8c-4cd2-89ac-338478e1fba4 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:41.754487 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a606b5e3-5b82-4d7a-b3d1-99559ccd816c tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:41.756397 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a606b5e3-5b82-4d7a-b3d1-99559ccd816c tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:41.800673 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-3f9c48da-5748-4fb6-978e-7249db313dd2 req-ac4a94c0-8a8c-4cd2-89ac-338478e1fba4 service nova] Creating event network-vif-deleted:f6f35eec-a034-4ada-9d0c-a22db01f2b1c for instance 4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816 on nch1-master-1 Apr 16 21:33:41.810756 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-3f9c48da-5748-4fb6-978e-7249db313dd2 req-ac4a94c0-8a8c-4cd2-89ac-338478e1fba4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089564 Apr 16 21:33:41.815640 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3017/5872] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:33:41.959052 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a606b5e3-5b82-4d7a-b3d1-99559ccd816c tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd17fc3dd855491cae4fa8119e9aeb50', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f6fb0a879f54d85895e6b63f3b5ee5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:41.970627 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a606b5e3-5b82-4d7a-b3d1-99559ccd816c tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] 10.222.0.20 "GET /compute/v2.1/servers/4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816" status: 200 len: 1467 microversion: 2.1 time: 0.265417 Apr 16 21:33:41.973674 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2856/5873] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:33:41 2022] GET /compute/v2.1/servers/4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816 => generated 1467 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:33:42.300308 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9f4e5c33-bb90-4fbb-b2b6-b989431403a4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:42.301648 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9f4e5c33-bb90-4fbb-b2b6-b989431403a4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:42.310552 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9f4e5c33-bb90-4fbb-b2b6-b989431403a4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:42.311309 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9f4e5c33-bb90-4fbb-b2b6-b989431403a4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:42.312320 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9f4e5c33-bb90-4fbb-b2b6-b989431403a4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:42.312925 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9f4e5c33-bb90-4fbb-b2b6-b989431403a4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:42.522470 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-3549f7b5-8994-4899-9265-e317693a52b6 req-ef80e0ab-29cc-49c8-9c0f-de7e99f36751 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b86e6830-cedb-4d55-a3b2-997462319b30", "name": "network-vif-plugged", "status": "completed", "tag": "b966fc7e-0221-46eb-a92a-00d9f48a8a41"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:33:42.532464 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-3549f7b5-8994-4899-9265-e317693a52b6 req-ef80e0ab-29cc-49c8-9c0f-de7e99f36751 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:42.533579 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-3549f7b5-8994-4899-9265-e317693a52b6 req-ef80e0ab-29cc-49c8-9c0f-de7e99f36751 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:42.547043 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-3549f7b5-8994-4899-9265-e317693a52b6 req-ef80e0ab-29cc-49c8-9c0f-de7e99f36751 service nova] Creating event network-vif-plugged:b966fc7e-0221-46eb-a92a-00d9f48a8a41 for instance b86e6830-cedb-4d55-a3b2-997462319b30 on nch2-master-1 Apr 16 21:33:42.552798 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-3549f7b5-8994-4899-9265-e317693a52b6 req-ef80e0ab-29cc-49c8-9c0f-de7e99f36751 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034534 Apr 16 21:33:42.553553 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2857/5874] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:33:42.916825 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9f4e5c33-bb90-4fbb-b2b6-b989431403a4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:42.935087 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9f4e5c33-bb90-4fbb-b2b6-b989431403a4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:42.936674 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9f4e5c33-bb90-4fbb-b2b6-b989431403a4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:42.939502 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9f4e5c33-bb90-4fbb-b2b6-b989431403a4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1807 microversion: 2.20 time: 0.642335 Apr 16 21:33:42.940653 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3018/5875] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:33:42 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1807 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:33:43.001792 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f0767848-560f-4764-ad74-de904a368271 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:43.002693 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f0767848-560f-4764-ad74-de904a368271 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] [instance: 4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:43.018996 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f0767848-560f-4764-ad74-de904a368271 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:43.019583 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f0767848-560f-4764-ad74-de904a368271 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:43.020528 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f0767848-560f-4764-ad74-de904a368271 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:43.021236 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f0767848-560f-4764-ad74-de904a368271 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:43.050764 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-f0767848-560f-4764-ad74-de904a368271 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] HTTP exception thrown: Instance 4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816 could not be found. Apr 16 21:33:43.051666 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f0767848-560f-4764-ad74-de904a368271 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] Returning 404 to user: Instance 4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:33:43.052758 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f0767848-560f-4764-ad74-de904a368271 tempest-ServerPasswordTestJSON-795534175 tempest-ServerPasswordTestJSON-795534175-project] 10.222.0.20 "GET /compute/v2.1/servers/4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816" status: 404 len: 111 microversion: 2.1 time: 0.065529 Apr 16 21:33:43.057799 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2858/5876] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:33:42 2022] GET /compute/v2.1/servers/4709c7e3-fa28-4abd-ab9f-f5aa0d2fa816 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:33:43.959282 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2b79cebc-a3a9-4812-a77b-d5d395c36931 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:43.959909 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2b79cebc-a3a9-4812-a77b-d5d395c36931 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:43.968288 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b79cebc-a3a9-4812-a77b-d5d395c36931 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:43.969012 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b79cebc-a3a9-4812-a77b-d5d395c36931 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:43.969991 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b79cebc-a3a9-4812-a77b-d5d395c36931 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:43.970602 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b79cebc-a3a9-4812-a77b-d5d395c36931 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:44.343582 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2b79cebc-a3a9-4812-a77b-d5d395c36931 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:44.353395 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2b79cebc-a3a9-4812-a77b-d5d395c36931 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:44.364910 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2b79cebc-a3a9-4812-a77b-d5d395c36931 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:44.368991 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2b79cebc-a3a9-4812-a77b-d5d395c36931 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1807 microversion: 2.20 time: 0.413882 Apr 16 21:33:44.371791 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3019/5877] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:33:43 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1807 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:33:45.389039 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4d7fd708-3b5a-4af4-b7db-5325427fdbb5 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:45.389676 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4d7fd708-3b5a-4af4-b7db-5325427fdbb5 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:45.401061 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4d7fd708-3b5a-4af4-b7db-5325427fdbb5 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:45.401536 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4d7fd708-3b5a-4af4-b7db-5325427fdbb5 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:45.406755 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4d7fd708-3b5a-4af4-b7db-5325427fdbb5 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:45.407708 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4d7fd708-3b5a-4af4-b7db-5325427fdbb5 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:45.821767 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-dce61e30-4c47-478f-9e08-3d0edd9daf2d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:33:45.826371 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4d7fd708-3b5a-4af4-b7db-5325427fdbb5 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:45.828720 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-dce61e30-4c47-478f-9e08-3d0edd9daf2d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:45.833043 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4d7fd708-3b5a-4af4-b7db-5325427fdbb5 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:45.834573 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4d7fd708-3b5a-4af4-b7db-5325427fdbb5 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:45.835786 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4d7fd708-3b5a-4af4-b7db-5325427fdbb5 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1807 microversion: 2.20 time: 0.452082 Apr 16 21:33:45.836373 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2859/5878] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:33:45 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1807 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:33:45.857997 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dce61e30-4c47-478f-9e08-3d0edd9daf2d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:45.859827 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dce61e30-4c47-478f-9e08-3d0edd9daf2d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:45.865716 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dce61e30-4c47-478f-9e08-3d0edd9daf2d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:45.867268 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dce61e30-4c47-478f-9e08-3d0edd9daf2d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:45.979022 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-dce61e30-4c47-478f-9e08-3d0edd9daf2d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "POST /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457/action" status: 200 len: 24559 microversion: 2.1 time: 0.167002 Apr 16 21:33:45.979801 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3020/5879] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:33:45 2022] POST /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457/action => generated 24559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:33:46.857124 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cd300410-2e2b-4491-b050-9515f59c56ef tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:46.857899 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-cd300410-2e2b-4491-b050-9515f59c56ef tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:46.864991 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cd300410-2e2b-4491-b050-9515f59c56ef tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:46.868644 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cd300410-2e2b-4491-b050-9515f59c56ef tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:46.868644 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cd300410-2e2b-4491-b050-9515f59c56ef tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:46.868644 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cd300410-2e2b-4491-b050-9515f59c56ef tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:47.218755 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cd300410-2e2b-4491-b050-9515f59c56ef tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:47.232131 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cd300410-2e2b-4491-b050-9515f59c56ef tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:47.237359 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cd300410-2e2b-4491-b050-9515f59c56ef tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:47.238630 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cd300410-2e2b-4491-b050-9515f59c56ef tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1807 microversion: 2.20 time: 0.385505 Apr 16 21:33:47.239205 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2860/5880] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:33:46 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1807 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:33:47.637454 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-37d2a240-41ed-48d2-a433-cd6584de3d25 tempest-VolumesNegativeTest-1681449155 tempest-VolumesNegativeTest-1681449155-project] Action: 'create', calling method: .version_select at 0x7fbb967730d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1673231883", "metadata": {"Type": "work"}}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:33:47.639765 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-37d2a240-41ed-48d2-a433-cd6584de3d25 tempest-VolumesNegativeTest-1681449155 tempest-VolumesNegativeTest-1681449155-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:33:47.640976 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-37d2a240-41ed-48d2-a433-cd6584de3d25 tempest-VolumesNegativeTest-1681449155 tempest-VolumesNegativeTest-1681449155-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.192037 Apr 16 21:33:47.645591 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3021/5881] 10.222.0.20 () {60 vars in 1155 bytes} [Sat Apr 16 21:33:47 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 194 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:33:47.651857 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-340f18aa-eab7-4ee9-8f3b-093323172ef2 tempest-VolumesNegativeTest-1681449155 tempest-VolumesNegativeTest-1681449155-project] Action: 'create', calling method: .version_select at 0x7fbb95c871f0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1878471698", "metadata": {"Type": "work"}}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:33:47.654636 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-340f18aa-eab7-4ee9-8f3b-093323172ef2 tempest-VolumesNegativeTest-1681449155 tempest-VolumesNegativeTest-1681449155-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:33:47.656099 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-340f18aa-eab7-4ee9-8f3b-093323172ef2 tempest-VolumesNegativeTest-1681449155 tempest-VolumesNegativeTest-1681449155-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008803 Apr 16 21:33:47.657495 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2861/5882] 10.222.0.20 () {60 vars in 1155 bytes} [Sat Apr 16 21:33:47 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:33:47.671365 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4effa12a-2029-4cf2-8ec5-862f056ead2d tempest-VolumesNegativeTest-1681449155 tempest-VolumesNegativeTest-1681449155-project] Action: 'create', calling method: .version_select at 0x7fbb95a93430>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-780828781", "metadata": {"Type": "work"}}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:33:47.673318 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4effa12a-2029-4cf2-8ec5-862f056ead2d tempest-VolumesNegativeTest-1681449155 tempest-VolumesNegativeTest-1681449155-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:33:47.675086 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4effa12a-2029-4cf2-8ec5-862f056ead2d tempest-VolumesNegativeTest-1681449155 tempest-VolumesNegativeTest-1681449155-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.012453 Apr 16 21:33:47.680206 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3022/5883] 10.222.0.20 () {60 vars in 1155 bytes} [Sat Apr 16 21:33:47 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:33:47.704738 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5a0b3350-3665-4930-b943-7d85dc495aa3 tempest-VolumesNegativeTest-1681449155 tempest-VolumesNegativeTest-1681449155-project] Calling method '.version_select at 0x7fbb95441a60>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:47.743003 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-5a0b3350-3665-4930-b943-7d85dc495aa3 tempest-VolumesNegativeTest-1681449155 tempest-VolumesNegativeTest-1681449155-project] HTTP exception thrown: Volume tempest-invalid-1475465981 could not be found. Apr 16 21:33:47.743736 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5a0b3350-3665-4930-b943-7d85dc495aa3 tempest-VolumesNegativeTest-1681449155 tempest-VolumesNegativeTest-1681449155-project] Returning 404 to user: Volume tempest-invalid-1475465981 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:33:47.744843 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5a0b3350-3665-4930-b943-7d85dc495aa3 tempest-VolumesNegativeTest-1681449155 tempest-VolumesNegativeTest-1681449155-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1475465981" status: 404 len: 99 microversion: 2.1 time: 0.057598 Apr 16 21:33:47.745429 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2862/5884] 10.222.0.20 () {58 vars in 1217 bytes} [Sat Apr 16 21:33:47 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1475465981 => generated 99 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 16 21:33:47.758024 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-26a2db77-96ff-4205-b1be-04764fecdec7 tempest-VolumesNegativeTest-1681449155 tempest-VolumesNegativeTest-1681449155-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006958 Apr 16 21:33:47.758552 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3023/5885] 10.222.0.20 () {58 vars in 1139 bytes} [Sat Apr 16 21:33:47 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 16 21:33:47.770216 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a37592e3-b876-4af4-9fbe-174cfbf749cd tempest-VolumesNegativeTest-1681449155 tempest-VolumesNegativeTest-1681449155-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003838 Apr 16 21:33:47.773137 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2863/5886] 10.222.0.20 () {58 vars in 1136 bytes} [Sat Apr 16 21:33:47 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 16 21:33:47.790123 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5b422e50-389f-409f-9948-ca875841dce2 tempest-VolumesNegativeTest-1681449155 tempest-VolumesNegativeTest-1681449155-project] Calling method '.version_select at 0x7fbb96870af0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:47.834873 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-5b422e50-389f-409f-9948-ca875841dce2 tempest-VolumesNegativeTest-1681449155 tempest-VolumesNegativeTest-1681449155-project] HTTP exception thrown: Volume 3246745c-a695-403b-8972-5ef36cc3aafc could not be found. Apr 16 21:33:47.835708 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5b422e50-389f-409f-9948-ca875841dce2 tempest-VolumesNegativeTest-1681449155 tempest-VolumesNegativeTest-1681449155-project] Returning 404 to user: Volume 3246745c-a695-403b-8972-5ef36cc3aafc could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:33:47.837072 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5b422e50-389f-409f-9948-ca875841dce2 tempest-VolumesNegativeTest-1681449155 tempest-VolumesNegativeTest-1681449155-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/3246745c-a695-403b-8972-5ef36cc3aafc" status: 404 len: 109 microversion: 2.1 time: 0.050961 Apr 16 21:33:47.838289 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3024/5887] 10.222.0.20 () {58 vars in 1247 bytes} [Sat Apr 16 21:33:47 2022] DELETE /compute/v2.1/os-volumes/3246745c-a695-403b-8972-5ef36cc3aafc => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:33:47.851001 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4f88347e-a3e7-4a49-8984-4a90067c1f44 tempest-VolumesNegativeTest-1681449155 tempest-VolumesNegativeTest-1681449155-project] Calling method '.version_select at 0x7fbb95441160>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:47.909009 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-4f88347e-a3e7-4a49-8984-4a90067c1f44 tempest-VolumesNegativeTest-1681449155 tempest-VolumesNegativeTest-1681449155-project] HTTP exception thrown: Volume f8f9df19-37c2-4129-b841-aa2e2170d77d could not be found. Apr 16 21:33:47.909647 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4f88347e-a3e7-4a49-8984-4a90067c1f44 tempest-VolumesNegativeTest-1681449155 tempest-VolumesNegativeTest-1681449155-project] Returning 404 to user: Volume f8f9df19-37c2-4129-b841-aa2e2170d77d could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:33:47.910933 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4f88347e-a3e7-4a49-8984-4a90067c1f44 tempest-VolumesNegativeTest-1681449155 tempest-VolumesNegativeTest-1681449155-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/f8f9df19-37c2-4129-b841-aa2e2170d77d" status: 404 len: 109 microversion: 2.1 time: 0.066558 Apr 16 21:33:47.912713 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2864/5888] 10.222.0.20 () {58 vars in 1244 bytes} [Sat Apr 16 21:33:47 2022] GET /compute/v2.1/os-volumes/f8f9df19-37c2-4129-b841-aa2e2170d77d => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:33:48.258791 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-592a7cf4-f27a-4f0a-8f36-4202a5112a8d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:33:48.259770 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-592a7cf4-f27a-4f0a-8f36-4202a5112a8d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:33:48.281348 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-592a7cf4-f27a-4f0a-8f36-4202a5112a8d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:48.281820 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-592a7cf4-f27a-4f0a-8f36-4202a5112a8d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:48.282632 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-592a7cf4-f27a-4f0a-8f36-4202a5112a8d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:33:48.283119 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-592a7cf4-f27a-4f0a-8f36-4202a5112a8d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:33:48.505410 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-592a7cf4-f27a-4f0a-8f36-4202a5112a8d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:48.521574 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-592a7cf4-f27a-4f0a-8f36-4202a5112a8d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:48.523719 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-592a7cf4-f27a-4f0a-8f36-4202a5112a8d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:33:48.526078 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-592a7cf4-f27a-4f0a-8f36-4202a5112a8d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1794 microversion: 2.20 time: 0.271776 Apr 16 21:33:48.527238 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3025/5889] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:33:48 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1794 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:33:51.155850 ncdv-master-1 devstack@n-api.service[137409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 21:33:51.156363 ncdv-master-1 devstack@n-api.service[137409]: Sat Apr 16 21:33:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 21:34:08.949634 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-76d1ba8e-9c84-46d7-b70f-f120b5a9f561 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:34:08.950474 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-76d1ba8e-9c84-46d7-b70f-f120b5a9f561 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:34:08.962126 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-76d1ba8e-9c84-46d7-b70f-f120b5a9f561 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:08.962596 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-76d1ba8e-9c84-46d7-b70f-f120b5a9f561 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:08.963411 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-76d1ba8e-9c84-46d7-b70f-f120b5a9f561 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:08.963853 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-76d1ba8e-9c84-46d7-b70f-f120b5a9f561 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:09.259709 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-76d1ba8e-9c84-46d7-b70f-f120b5a9f561 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1836 microversion: 2.1 time: 0.321874 Apr 16 21:34:09.272680 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2865/5890] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:34:08 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1836 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:34:11.416317 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ec8a14ab-0d63-40ba-bc69-32e7eeb2b30d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:34:11.417640 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ec8a14ab-0d63-40ba-bc69-32e7eeb2b30d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:34:11.424129 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-be114668-272c-4279-abf5-d42c3c3f1bc9 req-b413cab5-12bf-478d-8c7d-688bd343dbcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebff90b9-4ca5-4301-b5d7-4c1e92b16457", "tag": "f0531494-4be1-4c6b-bed4-5ffd32fa231d"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:34:11.439891 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ec8a14ab-0d63-40ba-bc69-32e7eeb2b30d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:11.440326 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ec8a14ab-0d63-40ba-bc69-32e7eeb2b30d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:11.441434 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ec8a14ab-0d63-40ba-bc69-32e7eeb2b30d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:11.445539 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-be114668-272c-4279-abf5-d42c3c3f1bc9 req-b413cab5-12bf-478d-8c7d-688bd343dbcf service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:11.445997 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-be114668-272c-4279-abf5-d42c3c3f1bc9 req-b413cab5-12bf-478d-8c7d-688bd343dbcf service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:11.456238 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ec8a14ab-0d63-40ba-bc69-32e7eeb2b30d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:11.481162 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-be114668-272c-4279-abf5-d42c3c3f1bc9 req-b413cab5-12bf-478d-8c7d-688bd343dbcf service nova] Creating event network-changed:f0531494-4be1-4c6b-bed4-5ffd32fa231d for instance ebff90b9-4ca5-4301-b5d7-4c1e92b16457 on nch2-master-1 Apr 16 21:34:11.488808 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-be114668-272c-4279-abf5-d42c3c3f1bc9 req-b413cab5-12bf-478d-8c7d-688bd343dbcf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068104 Apr 16 21:34:11.492661 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2866/5891] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:34:11.498572 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ec8a14ab-0d63-40ba-bc69-32e7eeb2b30d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:34:11.871753 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ec8a14ab-0d63-40ba-bc69-32e7eeb2b30d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 204 len: 0 microversion: 2.1 time: 0.458583 Apr 16 21:34:11.872825 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3026/5892] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:34:11 2022] DELETE /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 16 21:34:11.882141 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2f70fccf-a7ae-432f-b569-bb40c6ff3bc3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:34:11.882863 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2f70fccf-a7ae-432f-b569-bb40c6ff3bc3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:34:11.892839 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2f70fccf-a7ae-432f-b569-bb40c6ff3bc3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:11.902932 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2f70fccf-a7ae-432f-b569-bb40c6ff3bc3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:11.904221 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2f70fccf-a7ae-432f-b569-bb40c6ff3bc3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:11.904695 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2f70fccf-a7ae-432f-b569-bb40c6ff3bc3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:12.329432 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2f70fccf-a7ae-432f-b569-bb40c6ff3bc3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:34:12.341694 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2f70fccf-a7ae-432f-b569-bb40c6ff3bc3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1691 microversion: 2.1 time: 0.460207 Apr 16 21:34:12.342635 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2867/5893] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:34:11 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1691 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:34:13.362957 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3e6d59bf-1f4c-4a33-a9fc-c7a2cea01847 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:34:13.364254 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3e6d59bf-1f4c-4a33-a9fc-c7a2cea01847 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:34:13.381695 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3e6d59bf-1f4c-4a33-a9fc-c7a2cea01847 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:13.382191 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3e6d59bf-1f4c-4a33-a9fc-c7a2cea01847 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:13.383030 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3e6d59bf-1f4c-4a33-a9fc-c7a2cea01847 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:13.388490 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3e6d59bf-1f4c-4a33-a9fc-c7a2cea01847 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:13.782281 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3e6d59bf-1f4c-4a33-a9fc-c7a2cea01847 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:34:13.791792 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3e6d59bf-1f4c-4a33-a9fc-c7a2cea01847 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1691 microversion: 2.1 time: 0.432043 Apr 16 21:34:13.793447 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3027/5894] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:34:13 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1691 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:34:14.810796 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e2b95bfd-05ac-4b26-b3ff-75c4f79821f8 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:34:14.812922 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e2b95bfd-05ac-4b26-b3ff-75c4f79821f8 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:34:14.829136 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e2b95bfd-05ac-4b26-b3ff-75c4f79821f8 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:14.830871 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e2b95bfd-05ac-4b26-b3ff-75c4f79821f8 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:14.831853 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e2b95bfd-05ac-4b26-b3ff-75c4f79821f8 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:14.834382 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e2b95bfd-05ac-4b26-b3ff-75c4f79821f8 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:15.604314 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e2b95bfd-05ac-4b26-b3ff-75c4f79821f8 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:34:15.617614 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e2b95bfd-05ac-4b26-b3ff-75c4f79821f8 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1504 microversion: 2.1 time: 0.810416 Apr 16 21:34:15.622377 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2868/5895] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:34:14 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1504 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:34:15.645131 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-f632654a-252a-4a49-a9e8-fcbc80a4613d req-e78f0913-2ca8-4d2a-8192-26b746f187ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebff90b9-4ca5-4301-b5d7-4c1e92b16457", "name": "network-vif-deleted", "tag": "f0531494-4be1-4c6b-bed4-5ffd32fa231d"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:34:15.664127 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-f632654a-252a-4a49-a9e8-fcbc80a4613d req-e78f0913-2ca8-4d2a-8192-26b746f187ef service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:15.675337 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-f632654a-252a-4a49-a9e8-fcbc80a4613d req-e78f0913-2ca8-4d2a-8192-26b746f187ef service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:15.715562 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-f632654a-252a-4a49-a9e8-fcbc80a4613d req-e78f0913-2ca8-4d2a-8192-26b746f187ef service nova] Creating event network-vif-deleted:f0531494-4be1-4c6b-bed4-5ffd32fa231d for instance ebff90b9-4ca5-4301-b5d7-4c1e92b16457 on nch2-master-1 Apr 16 21:34:15.726771 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-f632654a-252a-4a49-a9e8-fcbc80a4613d req-e78f0913-2ca8-4d2a-8192-26b746f187ef service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087846 Apr 16 21:34:15.749098 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3028/5896] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:34:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:34:16.639491 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f40ff37c-5468-4e2a-9ad8-53adc4f6ba76 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:34:16.641286 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f40ff37c-5468-4e2a-9ad8-53adc4f6ba76 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:34:16.658224 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f40ff37c-5468-4e2a-9ad8-53adc4f6ba76 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:16.658714 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f40ff37c-5468-4e2a-9ad8-53adc4f6ba76 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:16.659513 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f40ff37c-5468-4e2a-9ad8-53adc4f6ba76 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:16.659958 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f40ff37c-5468-4e2a-9ad8-53adc4f6ba76 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:16.746396 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f40ff37c-5468-4e2a-9ad8-53adc4f6ba76 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:16.747829 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f40ff37c-5468-4e2a-9ad8-53adc4f6ba76 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:16.748523 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-f40ff37c-5468-4e2a-9ad8-53adc4f6ba76 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lazy-loading 'fault' on Instance uuid ebff90b9-4ca5-4301-b5d7-4c1e92b16457 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:34:16.821857 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f40ff37c-5468-4e2a-9ad8-53adc4f6ba76 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:34:16.831825 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f40ff37c-5468-4e2a-9ad8-53adc4f6ba76 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 200 len: 1357 microversion: 2.1 time: 0.194820 Apr 16 21:34:16.832521 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2869/5897] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:34:16 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 1357 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:34:17.858149 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d4b43693-ce07-49e0-8e62-10d392b715f6 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:34:17.859014 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d4b43693-ce07-49e0-8e62-10d392b715f6 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: ebff90b9-4ca5-4301-b5d7-4c1e92b16457] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:34:17.867640 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d4b43693-ce07-49e0-8e62-10d392b715f6 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:17.868504 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d4b43693-ce07-49e0-8e62-10d392b715f6 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:17.870582 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d4b43693-ce07-49e0-8e62-10d392b715f6 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:17.870582 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d4b43693-ce07-49e0-8e62-10d392b715f6 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:17.888585 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-d4b43693-ce07-49e0-8e62-10d392b715f6 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] HTTP exception thrown: Instance ebff90b9-4ca5-4301-b5d7-4c1e92b16457 could not be found. Apr 16 21:34:17.889739 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d4b43693-ce07-49e0-8e62-10d392b715f6 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Returning 404 to user: Instance ebff90b9-4ca5-4301-b5d7-4c1e92b16457 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:34:17.891867 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d4b43693-ce07-49e0-8e62-10d392b715f6 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457" status: 404 len: 111 microversion: 2.1 time: 0.039840 Apr 16 21:34:17.894499 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3029/5898] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:34:17 2022] GET /compute/v2.1/servers/ebff90b9-4ca5-4301-b5d7-4c1e92b16457 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:34:23.842878 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e1d4ba0f-4d9c-4b0e-8020-aad637ab0300 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Action: 'create', calling method: .version_select at 0x7fbb95441820>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1979599195"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:34:23.861776 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-e1d4ba0f-4d9c-4b0e-8020-aad637ab0300 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Getting quotas for project 551fe53574564e4ea60f7288faf4298f. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:34:23.869437 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-e1d4ba0f-4d9c-4b0e-8020-aad637ab0300 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Getting quotas for user d96d2c5371744a65806022c50819f800 and project 551fe53574564e4ea60f7288faf4298f. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:34:24.184112 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-e1d4ba0f-4d9c-4b0e-8020-aad637ab0300 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Getting quotas for project 551fe53574564e4ea60f7288faf4298f. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:34:24.204391 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-e1d4ba0f-4d9c-4b0e-8020-aad637ab0300 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Getting quotas for user d96d2c5371744a65806022c50819f800 and project 551fe53574564e4ea60f7288faf4298f. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:34:24.259576 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e1d4ba0f-4d9c-4b0e-8020-aad637ab0300 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.746139 Apr 16 21:34:24.260675 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2870/5899] 10.222.0.20 () {60 vars in 1157 bytes} [Sat Apr 16 21:34:23 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:34:29.986544 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c5ac4eda-0e52-4421-8605-52773ad4bf02 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '.version_select at 0x7fbb96578940>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:34:30.112072 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c5ac4eda-0e52-4421-8605-52773ad4bf02 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1932535405" status: 202 len: 0 microversion: 2.1 time: 0.126904 Apr 16 21:34:30.113328 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3030/5900] 10.222.0.20 () {58 vars in 1283 bytes} [Sat Apr 16 21:34:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1932535405 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:34:30.149900 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-aae6e147-b3b0-4844-ab0d-3e38b5a357ef tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Action: 'create', calling method: .version_select at 0x7fbb95441a60>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-360195677"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:34:30.184008 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-aae6e147-b3b0-4844-ab0d-3e38b5a357ef tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Getting quotas for project 0ee2ef9a941a429b82a89f7c8f71d45b. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:34:30.189388 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5b3ad682-684d-472f-bf92-4380bd79aad0 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-149510289", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1979599195", "security_groups": [{"name": "tempest-secgroup-smoke-219532067"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "b0b57eca-5587-422d-aee9-773ab2a51166"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:34:30.193251 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-aae6e147-b3b0-4844-ab0d-3e38b5a357ef tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Getting quotas for user f27a0cf693a247bb87a8c12193fee719 and project 0ee2ef9a941a429b82a89f7c8f71d45b. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:34:30.434784 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-5b3ad682-684d-472f-bf92-4380bd79aad0 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] validate_networks() for [('b0b57eca-5587-422d-aee9-773ab2a51166', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:34:30.454424 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-aae6e147-b3b0-4844-ab0d-3e38b5a357ef tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Getting quotas for project 0ee2ef9a941a429b82a89f7c8f71d45b. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:34:30.460662 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-aae6e147-b3b0-4844-ab0d-3e38b5a357ef tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Getting quotas for user f27a0cf693a247bb87a8c12193fee719 and project 0ee2ef9a941a429b82a89f7c8f71d45b. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:34:30.488023 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-aae6e147-b3b0-4844-ab0d-3e38b5a357ef tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2325 microversion: 2.1 time: 0.342608 Apr 16 21:34:30.488687 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2871/5901] 10.222.0.20 () {60 vars in 1157 bytes} [Sat Apr 16 21:34:30 2022] POST /compute/v2.1/os-keypairs => generated 2325 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:34:31.468212 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-5b3ad682-684d-472f-bf92-4380bd79aad0 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Getting quotas for project 551fe53574564e4ea60f7288faf4298f. Resources: dict_keys(['metadata_items']) {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:34:31.486636 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-5b3ad682-684d-472f-bf92-4380bd79aad0 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Getting quotas for user d96d2c5371744a65806022c50819f800 and project 551fe53574564e4ea60f7288faf4298f. Resources: dict_keys(['metadata_items']) {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:34:31.518936 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-5b3ad682-684d-472f-bf92-4380bd79aad0 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:34:31.522178 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-5b3ad682-684d-472f-bf92-4380bd79aad0 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:34:31.523631 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-5b3ad682-684d-472f-bf92-4380bd79aad0 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:34:31.524536 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-5b3ad682-684d-472f-bf92-4380bd79aad0 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:34:31.528164 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-5b3ad682-684d-472f-bf92-4380bd79aad0 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:34:31.548808 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5b3ad682-684d-472f-bf92-4380bd79aad0 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:31.554120 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5b3ad682-684d-472f-bf92-4380bd79aad0 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:31.554120 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5b3ad682-684d-472f-bf92-4380bd79aad0 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:31.554120 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5b3ad682-684d-472f-bf92-4380bd79aad0 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:31.575315 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-5b3ad682-684d-472f-bf92-4380bd79aad0 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Getting quotas for project 551fe53574564e4ea60f7288faf4298f. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:34:31.582286 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-5b3ad682-684d-472f-bf92-4380bd79aad0 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Getting quotas for user d96d2c5371744a65806022c50819f800 and project 551fe53574564e4ea60f7288faf4298f. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:34:31.598469 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5b3ad682-684d-472f-bf92-4380bd79aad0 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:34:31.602283 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5b3ad682-684d-472f-bf92-4380bd79aad0 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] [instance: 83455e10-9079-4214-a0d9-4b07eae7272b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:34:31.769232 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5b3ad682-684d-472f-bf92-4380bd79aad0 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.585751 Apr 16 21:34:31.777657 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3031/5902] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:34:30 2022] POST /compute/v2.1/servers => generated 405 bytes in 1595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:34:31.792982 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c4db5f2e-5a71-4486-af68-f3353838a002 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:34:31.793736 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c4db5f2e-5a71-4486-af68-f3353838a002 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] [instance: 83455e10-9079-4214-a0d9-4b07eae7272b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:34:31.939521 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c4db5f2e-5a71-4486-af68-f3353838a002 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96d2c5371744a65806022c50819f800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551fe53574564e4ea60f7288faf4298f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:34:31.948381 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c4db5f2e-5a71-4486-af68-f3353838a002 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] 10.222.0.20 "GET /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b" status: 200 len: 1302 microversion: 2.1 time: 0.160786 Apr 16 21:34:31.949539 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2872/5903] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:34:31 2022] GET /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b => generated 1302 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:34:32.968672 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8146b9fd-2d0b-41c0-bb47-d5699eaed566 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:34:32.969564 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8146b9fd-2d0b-41c0-bb47-d5699eaed566 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] [instance: 83455e10-9079-4214-a0d9-4b07eae7272b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:34:32.977000 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8146b9fd-2d0b-41c0-bb47-d5699eaed566 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:32.977471 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8146b9fd-2d0b-41c0-bb47-d5699eaed566 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:32.978457 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8146b9fd-2d0b-41c0-bb47-d5699eaed566 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:32.979094 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8146b9fd-2d0b-41c0-bb47-d5699eaed566 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:33.097948 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8146b9fd-2d0b-41c0-bb47-d5699eaed566 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96d2c5371744a65806022c50819f800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551fe53574564e4ea60f7288faf4298f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:34:33.122207 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8146b9fd-2d0b-41c0-bb47-d5699eaed566 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] 10.222.0.20 "GET /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b" status: 200 len: 1306 microversion: 2.1 time: 0.159258 Apr 16 21:34:33.123106 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3032/5904] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:34:32 2022] GET /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b => generated 1306 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:34:34.139520 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7a6b874f-0f35-4341-a7fd-0beca43270ae tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:34:34.140540 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7a6b874f-0f35-4341-a7fd-0beca43270ae tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] [instance: 83455e10-9079-4214-a0d9-4b07eae7272b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:34:34.152744 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7a6b874f-0f35-4341-a7fd-0beca43270ae tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:34.156606 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7a6b874f-0f35-4341-a7fd-0beca43270ae tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:34.157665 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7a6b874f-0f35-4341-a7fd-0beca43270ae tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:34.158250 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7a6b874f-0f35-4341-a7fd-0beca43270ae tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:34.342553 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7a6b874f-0f35-4341-a7fd-0beca43270ae tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96d2c5371744a65806022c50819f800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551fe53574564e4ea60f7288faf4298f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:34:34.357325 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7a6b874f-0f35-4341-a7fd-0beca43270ae tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] 10.222.0.20 "GET /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b" status: 200 len: 1354 microversion: 2.1 time: 0.222153 Apr 16 21:34:34.358835 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2873/5905] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:34:34 2022] GET /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b => generated 1354 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:34:35.374898 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-20fea4cc-78ac-40ab-b0d3-6be131572e12 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:34:35.375668 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-20fea4cc-78ac-40ab-b0d3-6be131572e12 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] [instance: 83455e10-9079-4214-a0d9-4b07eae7272b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:34:35.383985 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-20fea4cc-78ac-40ab-b0d3-6be131572e12 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:35.392653 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-20fea4cc-78ac-40ab-b0d3-6be131572e12 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:35.393838 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-20fea4cc-78ac-40ab-b0d3-6be131572e12 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:35.394458 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-20fea4cc-78ac-40ab-b0d3-6be131572e12 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:35.570338 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-20fea4cc-78ac-40ab-b0d3-6be131572e12 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96d2c5371744a65806022c50819f800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551fe53574564e4ea60f7288faf4298f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:34:35.592059 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-20fea4cc-78ac-40ab-b0d3-6be131572e12 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] 10.222.0.20 "GET /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b" status: 200 len: 1360 microversion: 2.1 time: 0.219735 Apr 16 21:34:35.595052 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3033/5906] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:34:35 2022] GET /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b => generated 1360 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:34:36.613818 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a4741ac7-00da-4ddc-8e8a-fd82b9c6d17b tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:34:36.615089 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a4741ac7-00da-4ddc-8e8a-fd82b9c6d17b tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] [instance: 83455e10-9079-4214-a0d9-4b07eae7272b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:34:36.623327 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a4741ac7-00da-4ddc-8e8a-fd82b9c6d17b tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:36.630936 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a4741ac7-00da-4ddc-8e8a-fd82b9c6d17b tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:36.632058 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a4741ac7-00da-4ddc-8e8a-fd82b9c6d17b tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:36.640993 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a4741ac7-00da-4ddc-8e8a-fd82b9c6d17b tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:37.239411 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a4741ac7-00da-4ddc-8e8a-fd82b9c6d17b tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96d2c5371744a65806022c50819f800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551fe53574564e4ea60f7288faf4298f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:34:37.255326 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a4741ac7-00da-4ddc-8e8a-fd82b9c6d17b tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] 10.222.0.20 "GET /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b" status: 200 len: 1427 microversion: 2.1 time: 0.645761 Apr 16 21:34:37.256545 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2874/5907] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:34:36 2022] GET /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b => generated 1427 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:34:38.273126 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5930bf18-3a50-406e-9f4e-ad5a84d566a8 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:34:38.273757 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5930bf18-3a50-406e-9f4e-ad5a84d566a8 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] [instance: 83455e10-9079-4214-a0d9-4b07eae7272b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:34:38.286130 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5930bf18-3a50-406e-9f4e-ad5a84d566a8 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:38.286365 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5930bf18-3a50-406e-9f4e-ad5a84d566a8 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:38.290916 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5930bf18-3a50-406e-9f4e-ad5a84d566a8 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:38.291645 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5930bf18-3a50-406e-9f4e-ad5a84d566a8 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:38.795299 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-cc4fc214-f9e6-453e-aec8-718f169122b9 req-4e06b3da-afa6-40ee-921e-45cc1066ce80 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83455e10-9079-4214-a0d9-4b07eae7272b", "tag": "b0384a65-07bb-42fc-8a13-ff7c5fb3a7e8"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:34:38.804373 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5930bf18-3a50-406e-9f4e-ad5a84d566a8 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96d2c5371744a65806022c50819f800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551fe53574564e4ea60f7288faf4298f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:34:38.810901 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-cc4fc214-f9e6-453e-aec8-718f169122b9 req-4e06b3da-afa6-40ee-921e-45cc1066ce80 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:38.812411 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-cc4fc214-f9e6-453e-aec8-718f169122b9 req-4e06b3da-afa6-40ee-921e-45cc1066ce80 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:38.814704 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5930bf18-3a50-406e-9f4e-ad5a84d566a8 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] 10.222.0.20 "GET /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b" status: 200 len: 1427 microversion: 2.1 time: 0.545409 Apr 16 21:34:38.828472 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3034/5908] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:34:38 2022] GET /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b => generated 1427 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:34:38.831841 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-cc4fc214-f9e6-453e-aec8-718f169122b9 req-4e06b3da-afa6-40ee-921e-45cc1066ce80 service nova] Creating event network-changed:b0384a65-07bb-42fc-8a13-ff7c5fb3a7e8 for instance 83455e10-9079-4214-a0d9-4b07eae7272b on nch1-master-1 Apr 16 21:34:38.846867 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-cc4fc214-f9e6-453e-aec8-718f169122b9 req-4e06b3da-afa6-40ee-921e-45cc1066ce80 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056499 Apr 16 21:34:38.849791 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2875/5909] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:34:39.832130 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-60041a3b-d955-4f78-897b-f485b43df071 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:34:39.832782 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-60041a3b-d955-4f78-897b-f485b43df071 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] [instance: 83455e10-9079-4214-a0d9-4b07eae7272b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:34:39.842463 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-60041a3b-d955-4f78-897b-f485b43df071 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:39.842933 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-60041a3b-d955-4f78-897b-f485b43df071 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:39.845656 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-60041a3b-d955-4f78-897b-f485b43df071 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:39.845656 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-60041a3b-d955-4f78-897b-f485b43df071 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:40.280153 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-60041a3b-d955-4f78-897b-f485b43df071 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96d2c5371744a65806022c50819f800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551fe53574564e4ea60f7288faf4298f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:34:40.290777 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-60041a3b-d955-4f78-897b-f485b43df071 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] 10.222.0.20 "GET /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b" status: 200 len: 1427 microversion: 2.1 time: 0.463149 Apr 16 21:34:40.292258 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3035/5910] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:34:39 2022] GET /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b => generated 1427 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:34:41.311250 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-09a7e953-ea61-499e-80bb-d2245dc6aae4 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:34:41.312317 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-09a7e953-ea61-499e-80bb-d2245dc6aae4 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] [instance: 83455e10-9079-4214-a0d9-4b07eae7272b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:34:41.328601 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-09a7e953-ea61-499e-80bb-d2245dc6aae4 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:41.331105 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-09a7e953-ea61-499e-80bb-d2245dc6aae4 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:41.332108 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-09a7e953-ea61-499e-80bb-d2245dc6aae4 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:41.334763 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-09a7e953-ea61-499e-80bb-d2245dc6aae4 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:41.688897 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-09a7e953-ea61-499e-80bb-d2245dc6aae4 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96d2c5371744a65806022c50819f800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551fe53574564e4ea60f7288faf4298f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:34:41.702883 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-09a7e953-ea61-499e-80bb-d2245dc6aae4 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] 10.222.0.20 "GET /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b" status: 200 len: 1427 microversion: 2.1 time: 0.395822 Apr 16 21:34:41.705267 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2876/5911] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:34:41 2022] GET /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b => generated 1427 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:34:42.726518 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3131f756-2130-4816-ae4d-cdab447a98f4 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:34:42.727292 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3131f756-2130-4816-ae4d-cdab447a98f4 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] [instance: 83455e10-9079-4214-a0d9-4b07eae7272b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:34:42.740391 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3131f756-2130-4816-ae4d-cdab447a98f4 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:42.740880 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3131f756-2130-4816-ae4d-cdab447a98f4 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:42.741977 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3131f756-2130-4816-ae4d-cdab447a98f4 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:42.742439 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3131f756-2130-4816-ae4d-cdab447a98f4 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:43.093308 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3131f756-2130-4816-ae4d-cdab447a98f4 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96d2c5371744a65806022c50819f800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551fe53574564e4ea60f7288faf4298f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:34:43.112156 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3131f756-2130-4816-ae4d-cdab447a98f4 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] 10.222.0.20 "GET /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b" status: 200 len: 1427 microversion: 2.1 time: 0.393453 Apr 16 21:34:43.114249 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3036/5912] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:34:42 2022] GET /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b => generated 1427 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:34:44.134889 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a339068c-20f6-4957-8250-52fed1a2ce6c tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:34:44.135508 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a339068c-20f6-4957-8250-52fed1a2ce6c tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] [instance: 83455e10-9079-4214-a0d9-4b07eae7272b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:34:44.158101 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a339068c-20f6-4957-8250-52fed1a2ce6c tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:44.162744 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a339068c-20f6-4957-8250-52fed1a2ce6c tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:44.163679 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a339068c-20f6-4957-8250-52fed1a2ce6c tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:44.164148 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a339068c-20f6-4957-8250-52fed1a2ce6c tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:44.508410 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a339068c-20f6-4957-8250-52fed1a2ce6c tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96d2c5371744a65806022c50819f800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551fe53574564e4ea60f7288faf4298f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:34:44.518638 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a339068c-20f6-4957-8250-52fed1a2ce6c tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] 10.222.0.20 "GET /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b" status: 200 len: 1427 microversion: 2.1 time: 0.388542 Apr 16 21:34:44.521231 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2877/5913] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:34:44 2022] GET /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b => generated 1427 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:34:45.546396 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b5d699a2-0360-4ee2-9d50-855f7f77d2af tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:34:45.547037 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b5d699a2-0360-4ee2-9d50-855f7f77d2af tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] [instance: 83455e10-9079-4214-a0d9-4b07eae7272b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:34:45.562070 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5d699a2-0360-4ee2-9d50-855f7f77d2af tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:45.562531 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5d699a2-0360-4ee2-9d50-855f7f77d2af tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:45.567541 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5d699a2-0360-4ee2-9d50-855f7f77d2af tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:45.568286 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5d699a2-0360-4ee2-9d50-855f7f77d2af tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:46.065006 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b5d699a2-0360-4ee2-9d50-855f7f77d2af tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96d2c5371744a65806022c50819f800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551fe53574564e4ea60f7288faf4298f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:34:46.078192 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b5d699a2-0360-4ee2-9d50-855f7f77d2af tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] 10.222.0.20 "GET /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b" status: 200 len: 1427 microversion: 2.1 time: 0.543243 Apr 16 21:34:46.093033 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3037/5914] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:34:45 2022] GET /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b => generated 1427 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:34:47.102116 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-23354c6d-1a42-4866-a597-d9f3e3f1b7b6 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:34:47.105005 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-23354c6d-1a42-4866-a597-d9f3e3f1b7b6 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] [instance: 83455e10-9079-4214-a0d9-4b07eae7272b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:34:47.117428 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-23354c6d-1a42-4866-a597-d9f3e3f1b7b6 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:47.117907 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-23354c6d-1a42-4866-a597-d9f3e3f1b7b6 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:47.118730 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-23354c6d-1a42-4866-a597-d9f3e3f1b7b6 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:47.122474 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-23354c6d-1a42-4866-a597-d9f3e3f1b7b6 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:47.468812 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-23354c6d-1a42-4866-a597-d9f3e3f1b7b6 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96d2c5371744a65806022c50819f800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551fe53574564e4ea60f7288faf4298f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:34:47.483003 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-23354c6d-1a42-4866-a597-d9f3e3f1b7b6 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] 10.222.0.20 "GET /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b" status: 200 len: 1427 microversion: 2.1 time: 0.389318 Apr 16 21:34:47.484758 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2878/5915] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:34:47 2022] GET /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b => generated 1427 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:34:47.836287 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-40dd014b-7a90-43a6-b9e9-4df6645ca127 req-81ba4e30-4810-4f86-a5ba-ccae076c47b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83455e10-9079-4214-a0d9-4b07eae7272b", "name": "network-vif-plugged", "status": "completed", "tag": "b0384a65-07bb-42fc-8a13-ff7c5fb3a7e8"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:34:47.865855 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-40dd014b-7a90-43a6-b9e9-4df6645ca127 req-81ba4e30-4810-4f86-a5ba-ccae076c47b8 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:47.867736 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-40dd014b-7a90-43a6-b9e9-4df6645ca127 req-81ba4e30-4810-4f86-a5ba-ccae076c47b8 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:47.910511 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-40dd014b-7a90-43a6-b9e9-4df6645ca127 req-81ba4e30-4810-4f86-a5ba-ccae076c47b8 service nova] Creating event network-vif-plugged:b0384a65-07bb-42fc-8a13-ff7c5fb3a7e8 for instance 83455e10-9079-4214-a0d9-4b07eae7272b on nch1-master-1 Apr 16 21:34:47.937061 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-40dd014b-7a90-43a6-b9e9-4df6645ca127 req-81ba4e30-4810-4f86-a5ba-ccae076c47b8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108329 Apr 16 21:34:47.940248 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3038/5916] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:34:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:34:48.505608 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-307ce598-90e4-45fb-a78e-4a7e50e4b0ee tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:34:48.506392 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-307ce598-90e4-45fb-a78e-4a7e50e4b0ee tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] [instance: 83455e10-9079-4214-a0d9-4b07eae7272b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:34:48.529183 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-307ce598-90e4-45fb-a78e-4a7e50e4b0ee tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:48.529659 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-307ce598-90e4-45fb-a78e-4a7e50e4b0ee tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:48.530480 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-307ce598-90e4-45fb-a78e-4a7e50e4b0ee tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:48.530936 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-307ce598-90e4-45fb-a78e-4a7e50e4b0ee tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:48.894610 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-307ce598-90e4-45fb-a78e-4a7e50e4b0ee tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96d2c5371744a65806022c50819f800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551fe53574564e4ea60f7288faf4298f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:34:48.902928 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-307ce598-90e4-45fb-a78e-4a7e50e4b0ee tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] 10.222.0.20 "GET /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b" status: 200 len: 1427 microversion: 2.1 time: 0.405594 Apr 16 21:34:48.913525 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2879/5917] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:34:48 2022] GET /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b => generated 1427 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:34:49.922234 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-97438168-994f-4d92-bdf6-961056ddbd0b tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:34:49.923815 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-97438168-994f-4d92-bdf6-961056ddbd0b tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] [instance: 83455e10-9079-4214-a0d9-4b07eae7272b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:34:49.940019 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-97438168-994f-4d92-bdf6-961056ddbd0b tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:49.941546 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-97438168-994f-4d92-bdf6-961056ddbd0b tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:49.943916 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-97438168-994f-4d92-bdf6-961056ddbd0b tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:49.945473 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-97438168-994f-4d92-bdf6-961056ddbd0b tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:49.980429 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-afab9e61-d663-4ae8-a085-22258762b389 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-687041148", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "34b088a4-071c-46d1-9c2e-d1a9af0cae05"}], "key_name": "tempest-TestNetworkAdvancedServerOps-360195677", "security_groups": [{"name": "tempest-secgroup-smoke-1138912031"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:34:50.195584 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-97438168-994f-4d92-bdf6-961056ddbd0b tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96d2c5371744a65806022c50819f800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551fe53574564e4ea60f7288faf4298f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:34:50.205491 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-97438168-994f-4d92-bdf6-961056ddbd0b tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] 10.222.0.20 "GET /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b" status: 200 len: 1607 microversion: 2.1 time: 0.288993 Apr 16 21:34:50.209478 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3039/5918] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:34:49 2022] GET /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b => generated 1607 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:34:50.225744 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0df28335-d4e0-4e73-bec4-2ca5171badf5 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:34:50.226709 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0df28335-d4e0-4e73-bec4-2ca5171badf5 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] [instance: 83455e10-9079-4214-a0d9-4b07eae7272b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:34:50.234661 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0df28335-d4e0-4e73-bec4-2ca5171badf5 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:50.235261 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0df28335-d4e0-4e73-bec4-2ca5171badf5 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:50.236190 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0df28335-d4e0-4e73-bec4-2ca5171badf5 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:50.237664 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0df28335-d4e0-4e73-bec4-2ca5171badf5 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:50.424826 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0df28335-d4e0-4e73-bec4-2ca5171badf5 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96d2c5371744a65806022c50819f800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551fe53574564e4ea60f7288faf4298f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:34:50.436770 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0df28335-d4e0-4e73-bec4-2ca5171badf5 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] 10.222.0.20 "GET /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b" status: 200 len: 1607 microversion: 2.1 time: 0.215002 Apr 16 21:34:50.437940 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3040/5919] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:34:50 2022] GET /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b => generated 1607 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:34:50.454593 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f8ce1e72-4ceb-4822-9a83-e41ede70bc6d tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:34:50.455466 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f8ce1e72-4ceb-4822-9a83-e41ede70bc6d tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] [instance: 83455e10-9079-4214-a0d9-4b07eae7272b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:34:50.463599 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f8ce1e72-4ceb-4822-9a83-e41ede70bc6d tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:50.464420 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f8ce1e72-4ceb-4822-9a83-e41ede70bc6d tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:50.471064 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f8ce1e72-4ceb-4822-9a83-e41ede70bc6d tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:50.471714 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f8ce1e72-4ceb-4822-9a83-e41ede70bc6d tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:50.697019 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f8ce1e72-4ceb-4822-9a83-e41ede70bc6d tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96d2c5371744a65806022c50819f800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551fe53574564e4ea60f7288faf4298f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:34:50.703380 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-afab9e61-d663-4ae8-a085-22258762b389 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] validate_networks() for [('34b088a4-071c-46d1-9c2e-d1a9af0cae05', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:34:50.720557 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f8ce1e72-4ceb-4822-9a83-e41ede70bc6d tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] 10.222.0.20 "GET /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b" status: 200 len: 1607 microversion: 2.1 time: 0.269926 Apr 16 21:34:50.721803 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3041/5920] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:34:50 2022] GET /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b => generated 1607 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:34:51.889198 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-afab9e61-d663-4ae8-a085-22258762b389 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:34:51.889198 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-afab9e61-d663-4ae8-a085-22258762b389 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:34:51.889198 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-afab9e61-d663-4ae8-a085-22258762b389 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:34:51.889198 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-afab9e61-d663-4ae8-a085-22258762b389 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:34:51.889198 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-afab9e61-d663-4ae8-a085-22258762b389 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:34:51.908300 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-afab9e61-d663-4ae8-a085-22258762b389 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:51.909493 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-afab9e61-d663-4ae8-a085-22258762b389 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:51.910583 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-afab9e61-d663-4ae8-a085-22258762b389 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:51.911448 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-afab9e61-d663-4ae8-a085-22258762b389 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:51.958115 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-afab9e61-d663-4ae8-a085-22258762b389 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Getting quotas for project 0ee2ef9a941a429b82a89f7c8f71d45b. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:34:51.977603 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-afab9e61-d663-4ae8-a085-22258762b389 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Getting quotas for user f27a0cf693a247bb87a8c12193fee719 and project 0ee2ef9a941a429b82a89f7c8f71d45b. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:34:51.999578 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-afab9e61-d663-4ae8-a085-22258762b389 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:34:52.014344 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-afab9e61-d663-4ae8-a085-22258762b389 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:34:52.170503 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-295e9851-e13b-4d72-8175-deac8772b649 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:34:52.173844 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-295e9851-e13b-4d72-8175-deac8772b649 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:34:52.208985 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-295e9851-e13b-4d72-8175-deac8772b649 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:52.209467 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-295e9851-e13b-4d72-8175-deac8772b649 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:52.216732 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-295e9851-e13b-4d72-8175-deac8772b649 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:52.217223 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-295e9851-e13b-4d72-8175-deac8772b649 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:52.226949 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-afab9e61-d663-4ae8-a085-22258762b389 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.250422 Apr 16 21:34:52.234202 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2880/5921] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:34:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 2259 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:34:52.263015 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b397fd22-dd1e-4164-bea8-092fbaed32aa tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:34:52.264053 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b397fd22-dd1e-4164-bea8-092fbaed32aa tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:34:52.364705 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-295e9851-e13b-4d72-8175-deac8772b649 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30/os-volume_attachments/53ad134b-66f9-4d7f-b696-56f6d63b72e9" status: 200 len: 194 microversion: 2.20 time: 0.198433 Apr 16 21:34:52.365271 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3042/5922] 10.222.0.20 () {60 vars in 1453 bytes} [Sat Apr 16 21:34:52 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30/os-volume_attachments/53ad134b-66f9-4d7f-b696-56f6d63b72e9 => generated 194 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 16 21:34:52.518729 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b76f08e8-76d6-44b9-b6dd-072b9a62b707 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:34:52.521360 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b76f08e8-76d6-44b9-b6dd-072b9a62b707 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:34:52.534013 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b76f08e8-76d6-44b9-b6dd-072b9a62b707 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:52.536780 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b76f08e8-76d6-44b9-b6dd-072b9a62b707 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:52.538891 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b76f08e8-76d6-44b9-b6dd-072b9a62b707 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:52.541018 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b76f08e8-76d6-44b9-b6dd-072b9a62b707 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:52.592592 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b397fd22-dd1e-4164-bea8-092fbaed32aa tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:34:52.608571 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b397fd22-dd1e-4164-bea8-092fbaed32aa tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1265 microversion: 2.1 time: 0.364681 Apr 16 21:34:52.615605 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2881/5923] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:34:52 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1265 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:34:52.763520 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-b76f08e8-76d6-44b9-b6dd-072b9a62b707 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lazy-loading 'services' on Instance uuid b86e6830-cedb-4d55-a3b2-997462319b30 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:34:53.068729 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b76f08e8-76d6-44b9-b6dd-072b9a62b707 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30/os-volume_attachments/53ad134b-66f9-4d7f-b696-56f6d63b72e9" status: 202 len: 0 microversion: 2.20 time: 0.565033 Apr 16 21:34:53.074507 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3043/5924] 10.222.0.20 () {60 vars in 1456 bytes} [Sat Apr 16 21:34:52 2022] DELETE /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30/os-volume_attachments/53ad134b-66f9-4d7f-b696-56f6d63b72e9 => generated 0 bytes in 572 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:34:53.079324 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a08f99b3-5e2e-46b7-8734-fc87d59aca95 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:34:53.080423 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a08f99b3-5e2e-46b7-8734-fc87d59aca95 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:34:53.115771 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a08f99b3-5e2e-46b7-8734-fc87d59aca95 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:53.120550 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a08f99b3-5e2e-46b7-8734-fc87d59aca95 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:53.122734 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a08f99b3-5e2e-46b7-8734-fc87d59aca95 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:53.123985 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a08f99b3-5e2e-46b7-8734-fc87d59aca95 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:53.231189 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a08f99b3-5e2e-46b7-8734-fc87d59aca95 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.155309 Apr 16 21:34:53.237329 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2882/5925] 10.222.0.20 () {60 vars in 1342 bytes} [Sat Apr 16 21:34:53 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30/os-volume_attachments => generated 197 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 16 21:34:53.632101 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c0eaed5b-958e-4bbb-8e90-0c29272d2858 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:34:53.633175 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c0eaed5b-958e-4bbb-8e90-0c29272d2858 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:34:53.656612 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c0eaed5b-958e-4bbb-8e90-0c29272d2858 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:53.659666 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c0eaed5b-958e-4bbb-8e90-0c29272d2858 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:53.661286 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c0eaed5b-958e-4bbb-8e90-0c29272d2858 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:53.675881 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c0eaed5b-958e-4bbb-8e90-0c29272d2858 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:53.794226 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c0eaed5b-958e-4bbb-8e90-0c29272d2858 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:34:53.806214 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c0eaed5b-958e-4bbb-8e90-0c29272d2858 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1269 microversion: 2.1 time: 0.178468 Apr 16 21:34:53.808087 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3044/5926] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:34:53 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1269 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:34:54.243808 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bb16fec0-7480-4dc9-9508-c5445430972a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:34:54.244751 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bb16fec0-7480-4dc9-9508-c5445430972a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:34:54.264765 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bb16fec0-7480-4dc9-9508-c5445430972a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:54.265231 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bb16fec0-7480-4dc9-9508-c5445430972a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:54.266035 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bb16fec0-7480-4dc9-9508-c5445430972a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:54.266484 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bb16fec0-7480-4dc9-9508-c5445430972a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:54.323004 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bb16fec0-7480-4dc9-9508-c5445430972a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.083279 Apr 16 21:34:54.323996 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2883/5927] 10.222.0.20 () {60 vars in 1342 bytes} [Sat Apr 16 21:34:54 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30/os-volume_attachments => generated 25 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:34:54.429150 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f72d96ac-94bc-4cab-883b-6f5644eff037 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:34:54.429776 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f72d96ac-94bc-4cab-883b-6f5644eff037 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:34:54.438948 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f72d96ac-94bc-4cab-883b-6f5644eff037 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:54.439788 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f72d96ac-94bc-4cab-883b-6f5644eff037 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:54.441116 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f72d96ac-94bc-4cab-883b-6f5644eff037 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:54.441752 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f72d96ac-94bc-4cab-883b-6f5644eff037 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:54.481024 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f72d96ac-94bc-4cab-883b-6f5644eff037 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:34:54.768223 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f72d96ac-94bc-4cab-883b-6f5644eff037 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 204 len: 0 microversion: 2.20 time: 0.342762 Apr 16 21:34:54.772480 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3045/5928] 10.222.0.20 () {60 vars in 1279 bytes} [Sat Apr 16 21:34:54 2022] DELETE /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 16 21:34:54.778695 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5b4cea49-35c1-4ce9-bd69-d45f92484f62 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:34:54.779315 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5b4cea49-35c1-4ce9-bd69-d45f92484f62 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:34:54.787157 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5b4cea49-35c1-4ce9-bd69-d45f92484f62 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:54.787620 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5b4cea49-35c1-4ce9-bd69-d45f92484f62 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:54.789247 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5b4cea49-35c1-4ce9-bd69-d45f92484f62 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:54.789704 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5b4cea49-35c1-4ce9-bd69-d45f92484f62 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:54.824980 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5b6a2aaf-74aa-4d1b-ad1a-b7b39fd0ab74 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:34:54.825524 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5b6a2aaf-74aa-4d1b-ad1a-b7b39fd0ab74 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:34:54.837707 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5b6a2aaf-74aa-4d1b-ad1a-b7b39fd0ab74 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:54.838233 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5b6a2aaf-74aa-4d1b-ad1a-b7b39fd0ab74 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:54.839608 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5b6a2aaf-74aa-4d1b-ad1a-b7b39fd0ab74 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:54.840056 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5b6a2aaf-74aa-4d1b-ad1a-b7b39fd0ab74 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:54.959430 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5b4cea49-35c1-4ce9-bd69-d45f92484f62 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:34:54.980412 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5b4cea49-35c1-4ce9-bd69-d45f92484f62 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:34:54.980412 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5b4cea49-35c1-4ce9-bd69-d45f92484f62 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:34:54.980412 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5b4cea49-35c1-4ce9-bd69-d45f92484f62 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1722 microversion: 2.20 time: 0.205297 Apr 16 21:34:54.980412 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2884/5929] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:34:54 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1722 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:34:55.078172 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5b6a2aaf-74aa-4d1b-ad1a-b7b39fd0ab74 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:34:55.097052 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5b6a2aaf-74aa-4d1b-ad1a-b7b39fd0ab74 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1317 microversion: 2.1 time: 0.277737 Apr 16 21:34:55.097637 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3046/5930] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:34:54 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1317 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:34:56.002205 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d4bb00a6-9452-4678-9df5-dadb3918ae3a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:34:56.002909 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d4bb00a6-9452-4678-9df5-dadb3918ae3a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:34:56.027846 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d4bb00a6-9452-4678-9df5-dadb3918ae3a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:56.029927 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d4bb00a6-9452-4678-9df5-dadb3918ae3a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:56.030804 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d4bb00a6-9452-4678-9df5-dadb3918ae3a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:56.035127 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d4bb00a6-9452-4678-9df5-dadb3918ae3a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:56.130296 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b18f5aa8-48df-4ed4-b5f8-43fcd72fc4f5 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:34:56.141216 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b18f5aa8-48df-4ed4-b5f8-43fcd72fc4f5 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:34:56.173481 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b18f5aa8-48df-4ed4-b5f8-43fcd72fc4f5 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:56.173481 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b18f5aa8-48df-4ed4-b5f8-43fcd72fc4f5 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:56.173481 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b18f5aa8-48df-4ed4-b5f8-43fcd72fc4f5 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:56.173481 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b18f5aa8-48df-4ed4-b5f8-43fcd72fc4f5 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:56.302585 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d4bb00a6-9452-4678-9df5-dadb3918ae3a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:34:56.323598 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d4bb00a6-9452-4678-9df5-dadb3918ae3a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:34:56.332591 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b18f5aa8-48df-4ed4-b5f8-43fcd72fc4f5 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:34:56.347824 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b18f5aa8-48df-4ed4-b5f8-43fcd72fc4f5 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1325 microversion: 2.1 time: 0.238327 Apr 16 21:34:56.348021 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d4bb00a6-9452-4678-9df5-dadb3918ae3a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:34:56.352091 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d4bb00a6-9452-4678-9df5-dadb3918ae3a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1722 microversion: 2.20 time: 0.354368 Apr 16 21:34:56.353286 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2885/5931] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:34:55 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1722 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:34:56.363300 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3047/5932] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:34:56 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1325 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:34:57.363887 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-bcc8269e-e42e-4660-9fb8-c9946f1e1821 req-2c260fb1-ef52-43b1-964b-f7a43255eb3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83455e10-9079-4214-a0d9-4b07eae7272b", "tag": "b0384a65-07bb-42fc-8a13-ff7c5fb3a7e8"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:34:57.369725 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-29154532-2bbc-4fd3-8610-750f045a2a13 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:34:57.371458 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-29154532-2bbc-4fd3-8610-750f045a2a13 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:34:57.384799 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-29154532-2bbc-4fd3-8610-750f045a2a13 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:57.386117 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-29154532-2bbc-4fd3-8610-750f045a2a13 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:57.387159 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-29154532-2bbc-4fd3-8610-750f045a2a13 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:57.387780 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-29154532-2bbc-4fd3-8610-750f045a2a13 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:57.391481 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-bcc8269e-e42e-4660-9fb8-c9946f1e1821 req-2c260fb1-ef52-43b1-964b-f7a43255eb3c service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:57.391984 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-bcc8269e-e42e-4660-9fb8-c9946f1e1821 req-2c260fb1-ef52-43b1-964b-f7a43255eb3c service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:57.415652 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-bcc8269e-e42e-4660-9fb8-c9946f1e1821 req-2c260fb1-ef52-43b1-964b-f7a43255eb3c service nova] Creating event network-changed:b0384a65-07bb-42fc-8a13-ff7c5fb3a7e8 for instance 83455e10-9079-4214-a0d9-4b07eae7272b on nch1-master-1 Apr 16 21:34:57.427847 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-bcc8269e-e42e-4660-9fb8-c9946f1e1821 req-2c260fb1-ef52-43b1-964b-f7a43255eb3c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.398194 Apr 16 21:34:57.430636 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2886/5933] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:34:57.445911 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8ef09fea-3809-4a38-bb5c-6e3760818334 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:34:57.449385 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8ef09fea-3809-4a38-bb5c-6e3760818334 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:34:57.475895 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8ef09fea-3809-4a38-bb5c-6e3760818334 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:57.476379 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8ef09fea-3809-4a38-bb5c-6e3760818334 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:57.480966 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8ef09fea-3809-4a38-bb5c-6e3760818334 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:57.481539 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8ef09fea-3809-4a38-bb5c-6e3760818334 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:57.628671 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-29154532-2bbc-4fd3-8610-750f045a2a13 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:34:57.646944 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-29154532-2bbc-4fd3-8610-750f045a2a13 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1323 microversion: 2.1 time: 0.281241 Apr 16 21:34:57.657433 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3048/5934] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:34:57 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1323 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:34:58.583325 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8ef09fea-3809-4a38-bb5c-6e3760818334 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:34:58.611501 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8ef09fea-3809-4a38-bb5c-6e3760818334 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:34:58.621489 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8ef09fea-3809-4a38-bb5c-6e3760818334 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:34:58.625072 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8ef09fea-3809-4a38-bb5c-6e3760818334 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1722 microversion: 2.20 time: 1.193089 Apr 16 21:34:58.638078 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2887/5935] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:34:57 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1722 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:34:58.686766 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c5f1668c-df7e-47da-9c70-5c229cd22cdd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:34:58.688297 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c5f1668c-df7e-47da-9c70-5c229cd22cdd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:34:58.701325 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c5f1668c-df7e-47da-9c70-5c229cd22cdd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:58.702069 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c5f1668c-df7e-47da-9c70-5c229cd22cdd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:58.703191 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c5f1668c-df7e-47da-9c70-5c229cd22cdd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:58.704427 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c5f1668c-df7e-47da-9c70-5c229cd22cdd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:59.318379 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c5f1668c-df7e-47da-9c70-5c229cd22cdd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:34:59.328428 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c5f1668c-df7e-47da-9c70-5c229cd22cdd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1391 microversion: 2.1 time: 0.666842 Apr 16 21:34:59.332384 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3049/5936] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:34:58 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1391 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:34:59.647313 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6d5e36f4-4ec2-45be-9d90-2cd9bea6b86f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:34:59.649407 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6d5e36f4-4ec2-45be-9d90-2cd9bea6b86f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:34:59.667856 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6d5e36f4-4ec2-45be-9d90-2cd9bea6b86f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:59.672502 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6d5e36f4-4ec2-45be-9d90-2cd9bea6b86f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:59.674695 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6d5e36f4-4ec2-45be-9d90-2cd9bea6b86f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:34:59.680147 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6d5e36f4-4ec2-45be-9d90-2cd9bea6b86f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:34:59.977374 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6d5e36f4-4ec2-45be-9d90-2cd9bea6b86f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:34:59.996959 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6d5e36f4-4ec2-45be-9d90-2cd9bea6b86f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:34:59.999147 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6d5e36f4-4ec2-45be-9d90-2cd9bea6b86f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:00.007884 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6d5e36f4-4ec2-45be-9d90-2cd9bea6b86f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1655 microversion: 2.20 time: 0.361919 Apr 16 21:35:00.007884 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2888/5937] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:34:59 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1655 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:35:00.347514 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-721add05-3090-46a4-a27b-78aa87417c40 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:35:00.348927 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-721add05-3090-46a4-a27b-78aa87417c40 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:35:00.374407 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-721add05-3090-46a4-a27b-78aa87417c40 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:00.374407 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-721add05-3090-46a4-a27b-78aa87417c40 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:00.374407 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-721add05-3090-46a4-a27b-78aa87417c40 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:00.374833 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-721add05-3090-46a4-a27b-78aa87417c40 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:00.501310 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-03a51eb3-a136-4840-a2bb-e665e7e5abeb req-6c681928-6ee4-4eff-b087-1364097f04a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b86e6830-cedb-4d55-a3b2-997462319b30", "name": "network-vif-deleted", "tag": "b966fc7e-0221-46eb-a92a-00d9f48a8a41"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:35:00.518814 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-03a51eb3-a136-4840-a2bb-e665e7e5abeb req-6c681928-6ee4-4eff-b087-1364097f04a3 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:00.522564 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-03a51eb3-a136-4840-a2bb-e665e7e5abeb req-6c681928-6ee4-4eff-b087-1364097f04a3 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:00.543656 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-03a51eb3-a136-4840-a2bb-e665e7e5abeb req-6c681928-6ee4-4eff-b087-1364097f04a3 service nova] Creating event network-vif-deleted:b966fc7e-0221-46eb-a92a-00d9f48a8a41 for instance b86e6830-cedb-4d55-a3b2-997462319b30 on nch2-master-1 Apr 16 21:35:00.551014 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-03a51eb3-a136-4840-a2bb-e665e7e5abeb req-6c681928-6ee4-4eff-b087-1364097f04a3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054157 Apr 16 21:35:00.552382 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2889/5938] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:35:01.006771 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-721add05-3090-46a4-a27b-78aa87417c40 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:01.025313 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-721add05-3090-46a4-a27b-78aa87417c40 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1391 microversion: 2.1 time: 0.678895 Apr 16 21:35:01.027490 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3050/5939] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:35:00 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1391 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:35:01.067285 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9cc91d4e-adc6-4bbd-a62d-c1c8066154bd tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:35:01.069916 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9cc91d4e-adc6-4bbd-a62d-c1c8066154bd tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:35:01.089568 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9cc91d4e-adc6-4bbd-a62d-c1c8066154bd tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:01.095006 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9cc91d4e-adc6-4bbd-a62d-c1c8066154bd tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:01.098328 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9cc91d4e-adc6-4bbd-a62d-c1c8066154bd tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:01.101171 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9cc91d4e-adc6-4bbd-a62d-c1c8066154bd tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:01.191988 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9cc91d4e-adc6-4bbd-a62d-c1c8066154bd tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:01.194819 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9cc91d4e-adc6-4bbd-a62d-c1c8066154bd tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:01.194819 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-9cc91d4e-adc6-4bbd-a62d-c1c8066154bd tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lazy-loading 'fault' on Instance uuid b86e6830-cedb-4d55-a3b2-997462319b30 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:35:01.457479 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9cc91d4e-adc6-4bbd-a62d-c1c8066154bd tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:01.468122 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9cc91d4e-adc6-4bbd-a62d-c1c8066154bd tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:01.470542 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9cc91d4e-adc6-4bbd-a62d-c1c8066154bd tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:01.472876 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9cc91d4e-adc6-4bbd-a62d-c1c8066154bd tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 200 len: 1371 microversion: 2.20 time: 0.450703 Apr 16 21:35:01.487616 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2890/5940] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:35:01 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 1371 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:35:01.688604 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-efce494d-4770-4648-a8dc-eac992f92219 req-7f2778bc-f602-4eef-a399-76ae8e242422 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69bd9595-c9e9-4d06-af55-ce22d5f09416", "tag": "10dae36f-fbbc-45d6-b539-d8ce65bad3c2"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:35:01.702172 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-efce494d-4770-4648-a8dc-eac992f92219 req-7f2778bc-f602-4eef-a399-76ae8e242422 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:01.702501 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-efce494d-4770-4648-a8dc-eac992f92219 req-7f2778bc-f602-4eef-a399-76ae8e242422 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:01.731215 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-efce494d-4770-4648-a8dc-eac992f92219 req-7f2778bc-f602-4eef-a399-76ae8e242422 service nova] Creating event network-changed:10dae36f-fbbc-45d6-b539-d8ce65bad3c2 for instance 69bd9595-c9e9-4d06-af55-ce22d5f09416 on nch2-master-1 Apr 16 21:35:01.752267 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-efce494d-4770-4648-a8dc-eac992f92219 req-7f2778bc-f602-4eef-a399-76ae8e242422 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074357 Apr 16 21:35:01.753153 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3051/5941] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:35:02.048022 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-367337d5-367b-403e-b7f1-93727ab15004 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:35:02.048685 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-367337d5-367b-403e-b7f1-93727ab15004 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:35:02.061367 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-367337d5-367b-403e-b7f1-93727ab15004 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:02.062520 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-367337d5-367b-403e-b7f1-93727ab15004 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:02.068757 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-367337d5-367b-403e-b7f1-93727ab15004 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:02.069244 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-367337d5-367b-403e-b7f1-93727ab15004 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:02.494630 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2df22aff-c80c-4ed7-bf14-bff185d29403 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:35:02.496835 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2df22aff-c80c-4ed7-bf14-bff185d29403 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:35:02.504434 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2df22aff-c80c-4ed7-bf14-bff185d29403 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:02.505701 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2df22aff-c80c-4ed7-bf14-bff185d29403 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:02.506844 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2df22aff-c80c-4ed7-bf14-bff185d29403 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:02.507724 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2df22aff-c80c-4ed7-bf14-bff185d29403 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:02.557953 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-2df22aff-c80c-4ed7-bf14-bff185d29403 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] HTTP exception thrown: Instance b86e6830-cedb-4d55-a3b2-997462319b30 could not be found. Apr 16 21:35:02.557953 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2df22aff-c80c-4ed7-bf14-bff185d29403 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Returning 404 to user: Instance b86e6830-cedb-4d55-a3b2-997462319b30 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:35:02.557953 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2df22aff-c80c-4ed7-bf14-bff185d29403 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 404 len: 111 microversion: 2.20 time: 0.062172 Apr 16 21:35:02.557953 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3052/5942] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:35:02 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 16 21:35:02.566104 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-367337d5-367b-403e-b7f1-93727ab15004 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:02.566594 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ef3555f6-f9eb-4318-96a1-edf5b9d9025b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '.version_select at 0x7fbb96bdfee0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:35:02.592546 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-367337d5-367b-403e-b7f1-93727ab15004 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1391 microversion: 2.1 time: 0.548558 Apr 16 21:35:02.593159 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2891/5943] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:35:02 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1391 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:35:02.700632 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ef3555f6-f9eb-4318-96a1-edf5b9d9025b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-441865800" status: 204 len: 0 microversion: 2.20 time: 0.140735 Apr 16 21:35:02.702085 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3053/5944] 10.222.0.20 () {60 vars in 1258 bytes} [Sat Apr 16 21:35:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-441865800 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 16 21:35:03.610239 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-019ecd58-980c-428f-aba8-ba3a7a2e4919 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:35:03.610927 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-019ecd58-980c-428f-aba8-ba3a7a2e4919 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:35:03.618861 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-019ecd58-980c-428f-aba8-ba3a7a2e4919 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:03.619375 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-019ecd58-980c-428f-aba8-ba3a7a2e4919 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:03.620744 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-019ecd58-980c-428f-aba8-ba3a7a2e4919 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:03.621230 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-019ecd58-980c-428f-aba8-ba3a7a2e4919 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:03.888453 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-019ecd58-980c-428f-aba8-ba3a7a2e4919 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:03.896966 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-019ecd58-980c-428f-aba8-ba3a7a2e4919 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1391 microversion: 2.1 time: 0.290705 Apr 16 21:35:03.897965 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2892/5945] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:35:03 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1391 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:35:04.727770 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-400ecaf0-f810-4df6-a563-19b6a49a83e0 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Action: 'create', calling method: .version_select at 0x7fbb96db7ee0>, body: {"keypair": {"name": "tempest-keypair-703218455"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:35:04.769088 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-400ecaf0-f810-4df6-a563-19b6a49a83e0 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Getting quotas for project 7d3a8f4590014b8d9738bd3739f08c0c. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:35:04.776787 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-400ecaf0-f810-4df6-a563-19b6a49a83e0 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Getting quotas for user e007558161974720bb11a4e7588af0c8 and project 7d3a8f4590014b8d9738bd3739f08c0c. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:35:04.917982 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f4bd3312-aede-4d33-ad18-cf567b76fdd0 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:35:04.919872 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f4bd3312-aede-4d33-ad18-cf567b76fdd0 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:35:04.930650 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f4bd3312-aede-4d33-ad18-cf567b76fdd0 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:04.931633 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f4bd3312-aede-4d33-ad18-cf567b76fdd0 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:04.934417 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f4bd3312-aede-4d33-ad18-cf567b76fdd0 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:04.935145 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f4bd3312-aede-4d33-ad18-cf567b76fdd0 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:05.165178 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-400ecaf0-f810-4df6-a563-19b6a49a83e0 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Getting quotas for project 7d3a8f4590014b8d9738bd3739f08c0c. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:35:05.180069 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-400ecaf0-f810-4df6-a563-19b6a49a83e0 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Getting quotas for user e007558161974720bb11a4e7588af0c8 and project 7d3a8f4590014b8d9738bd3739f08c0c. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:35:05.198810 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-400ecaf0-f810-4df6-a563-19b6a49a83e0 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.474998 Apr 16 21:35:05.199528 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3054/5946] 10.222.0.20 () {62 vars in 1198 bytes} [Sat Apr 16 21:35:04 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 476 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 16 21:35:05.217358 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f4bd3312-aede-4d33-ad18-cf567b76fdd0 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:05.226689 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f4bd3312-aede-4d33-ad18-cf567b76fdd0 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1391 microversion: 2.1 time: 0.315930 Apr 16 21:35:05.227545 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2893/5947] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:35:04 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1391 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:35:06.244495 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e1df8934-0dc4-4d28-9227-527b62d42eaf tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:35:06.245359 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e1df8934-0dc4-4d28-9227-527b62d42eaf tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:35:06.262495 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e1df8934-0dc4-4d28-9227-527b62d42eaf tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:06.264955 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e1df8934-0dc4-4d28-9227-527b62d42eaf tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:06.264955 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e1df8934-0dc4-4d28-9227-527b62d42eaf tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:06.276772 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e1df8934-0dc4-4d28-9227-527b62d42eaf tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:06.546992 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e1df8934-0dc4-4d28-9227-527b62d42eaf tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:06.556395 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e1df8934-0dc4-4d28-9227-527b62d42eaf tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1391 microversion: 2.1 time: 0.316074 Apr 16 21:35:06.558133 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3055/5948] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:35:06 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1391 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:35:07.577161 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d4a70e7f-c350-4a7a-a35d-f1dd48fcfb82 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:35:07.577739 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d4a70e7f-c350-4a7a-a35d-f1dd48fcfb82 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:35:07.589617 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d4a70e7f-c350-4a7a-a35d-f1dd48fcfb82 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:07.590330 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d4a70e7f-c350-4a7a-a35d-f1dd48fcfb82 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:07.591492 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d4a70e7f-c350-4a7a-a35d-f1dd48fcfb82 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:07.592116 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d4a70e7f-c350-4a7a-a35d-f1dd48fcfb82 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:08.098037 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d4a70e7f-c350-4a7a-a35d-f1dd48fcfb82 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:08.119422 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d4a70e7f-c350-4a7a-a35d-f1dd48fcfb82 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1391 microversion: 2.1 time: 0.546504 Apr 16 21:35:08.120871 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2894/5949] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:35:07 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1391 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:35:09.139610 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6448118e-6f5a-45c0-b161-0216fc87f4b2 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:35:09.141329 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6448118e-6f5a-45c0-b161-0216fc87f4b2 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:35:09.156859 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6448118e-6f5a-45c0-b161-0216fc87f4b2 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:09.158794 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6448118e-6f5a-45c0-b161-0216fc87f4b2 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:09.162183 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6448118e-6f5a-45c0-b161-0216fc87f4b2 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:09.166247 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6448118e-6f5a-45c0-b161-0216fc87f4b2 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:09.269351 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e9301f53-88da-48db-8d61-462534e2821c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-631817251", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "33417375-20a3-4356-abb1-47c6dcf1fa40"}], "security_groups": [{"name": "tempest-securitygroup--2115206201"}], "key_name": "tempest-keypair-703218455", "user_data": "}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:35:09.502104 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6448118e-6f5a-45c0-b161-0216fc87f4b2 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:09.511790 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6448118e-6f5a-45c0-b161-0216fc87f4b2 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1391 microversion: 2.1 time: 0.376066 Apr 16 21:35:09.525088 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3056/5950] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:35:09 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1391 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:35:09.558514 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-e9301f53-88da-48db-8d61-462534e2821c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] validate_networks() for [('33417375-20a3-4356-abb1-47c6dcf1fa40', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:35:10.161374 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-e9301f53-88da-48db-8d61-462534e2821c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:35:10.161818 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-e9301f53-88da-48db-8d61-462534e2821c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:35:10.162342 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-e9301f53-88da-48db-8d61-462534e2821c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:35:10.162948 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-e9301f53-88da-48db-8d61-462534e2821c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:35:10.163543 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-e9301f53-88da-48db-8d61-462534e2821c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:35:10.177038 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e9301f53-88da-48db-8d61-462534e2821c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:10.183165 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e9301f53-88da-48db-8d61-462534e2821c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:10.183165 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e9301f53-88da-48db-8d61-462534e2821c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:10.183165 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e9301f53-88da-48db-8d61-462534e2821c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:10.197016 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-e9301f53-88da-48db-8d61-462534e2821c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Getting quotas for project 7d3a8f4590014b8d9738bd3739f08c0c. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:35:10.202649 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-e9301f53-88da-48db-8d61-462534e2821c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Getting quotas for user e007558161974720bb11a4e7588af0c8 and project 7d3a8f4590014b8d9738bd3739f08c0c. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:35:10.217253 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e9301f53-88da-48db-8d61-462534e2821c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:35:10.219574 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e9301f53-88da-48db-8d61-462534e2821c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:35:10.382315 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e9301f53-88da-48db-8d61-462534e2821c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.117624 Apr 16 21:35:10.389073 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2895/5951] 10.222.0.20 () {62 vars in 1187 bytes} [Sat Apr 16 21:35:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 1125 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Apr 16 21:35:10.395035 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-83edbd62-6a3c-449b-83c4-df2c1a1b8bff tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:35:10.395728 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-83edbd62-6a3c-449b-83c4-df2c1a1b8bff tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:35:10.502243 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-83edbd62-6a3c-449b-83c4-df2c1a1b8bff tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:10.511776 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-83edbd62-6a3c-449b-83c4-df2c1a1b8bff tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:10.517296 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-83edbd62-6a3c-449b-83c4-df2c1a1b8bff tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:10.517296 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-83edbd62-6a3c-449b-83c4-df2c1a1b8bff tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1280 microversion: 2.20 time: 0.124981 Apr 16 21:35:10.517296 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3057/5952] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:35:10 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1280 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:35:10.534880 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a42b0e27-22f6-489b-a8f3-741a13104e79 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:35:10.540063 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a42b0e27-22f6-489b-a8f3-741a13104e79 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:35:10.551646 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a42b0e27-22f6-489b-a8f3-741a13104e79 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:10.552367 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a42b0e27-22f6-489b-a8f3-741a13104e79 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:10.553336 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a42b0e27-22f6-489b-a8f3-741a13104e79 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:10.553950 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a42b0e27-22f6-489b-a8f3-741a13104e79 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:10.753473 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a42b0e27-22f6-489b-a8f3-741a13104e79 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:10.763300 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a42b0e27-22f6-489b-a8f3-741a13104e79 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1391 microversion: 2.1 time: 0.233863 Apr 16 21:35:10.766838 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2896/5953] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:35:10 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1391 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:35:10.819246 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-2a23cdda-616e-42f8-9af6-f8e8543c6d3d req-6d4ad118-f5db-4273-8b16-944df915693f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69bd9595-c9e9-4d06-af55-ce22d5f09416", "name": "network-vif-plugged", "status": "completed", "tag": "10dae36f-fbbc-45d6-b539-d8ce65bad3c2"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:35:10.830523 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-2a23cdda-616e-42f8-9af6-f8e8543c6d3d req-6d4ad118-f5db-4273-8b16-944df915693f service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:10.830984 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-2a23cdda-616e-42f8-9af6-f8e8543c6d3d req-6d4ad118-f5db-4273-8b16-944df915693f service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:10.847670 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-2a23cdda-616e-42f8-9af6-f8e8543c6d3d req-6d4ad118-f5db-4273-8b16-944df915693f service nova] Creating event network-vif-plugged:10dae36f-fbbc-45d6-b539-d8ce65bad3c2 for instance 69bd9595-c9e9-4d06-af55-ce22d5f09416 on nch2-master-1 Apr 16 21:35:10.850380 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-2a23cdda-616e-42f8-9af6-f8e8543c6d3d req-6d4ad118-f5db-4273-8b16-944df915693f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035785 Apr 16 21:35:10.853980 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3058/5954] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:35:11.535533 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6933a44d-b497-4922-9da8-88a10b43a936 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:35:11.536210 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6933a44d-b497-4922-9da8-88a10b43a936 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:35:11.563370 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6933a44d-b497-4922-9da8-88a10b43a936 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:11.564138 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6933a44d-b497-4922-9da8-88a10b43a936 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:11.565168 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6933a44d-b497-4922-9da8-88a10b43a936 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:11.565900 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6933a44d-b497-4922-9da8-88a10b43a936 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:11.646878 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6933a44d-b497-4922-9da8-88a10b43a936 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:11.659754 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6933a44d-b497-4922-9da8-88a10b43a936 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:11.662881 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6933a44d-b497-4922-9da8-88a10b43a936 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:11.664202 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6933a44d-b497-4922-9da8-88a10b43a936 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1284 microversion: 2.20 time: 0.132874 Apr 16 21:35:11.664860 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2897/5955] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:35:11 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1284 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:35:11.785930 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-11fccccf-c45a-4c22-b723-421145afaa06 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:35:11.786649 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-11fccccf-c45a-4c22-b723-421145afaa06 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:35:11.793482 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-11fccccf-c45a-4c22-b723-421145afaa06 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:11.794198 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-11fccccf-c45a-4c22-b723-421145afaa06 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:11.795209 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-11fccccf-c45a-4c22-b723-421145afaa06 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:11.795839 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-11fccccf-c45a-4c22-b723-421145afaa06 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:12.041124 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-11fccccf-c45a-4c22-b723-421145afaa06 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:12.048789 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-11fccccf-c45a-4c22-b723-421145afaa06 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1391 microversion: 2.1 time: 0.268259 Apr 16 21:35:12.049386 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3059/5956] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:35:11 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1391 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:35:12.689316 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-44d4e5cf-27ca-490d-ad45-2659d1dfbf19 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:35:12.690095 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-44d4e5cf-27ca-490d-ad45-2659d1dfbf19 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:35:12.714081 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-44d4e5cf-27ca-490d-ad45-2659d1dfbf19 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:12.714081 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-44d4e5cf-27ca-490d-ad45-2659d1dfbf19 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:12.714081 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-44d4e5cf-27ca-490d-ad45-2659d1dfbf19 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:12.714081 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-44d4e5cf-27ca-490d-ad45-2659d1dfbf19 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:12.883730 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-44d4e5cf-27ca-490d-ad45-2659d1dfbf19 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:12.894491 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-44d4e5cf-27ca-490d-ad45-2659d1dfbf19 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:12.896011 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-44d4e5cf-27ca-490d-ad45-2659d1dfbf19 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:12.897743 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-44d4e5cf-27ca-490d-ad45-2659d1dfbf19 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1340 microversion: 2.20 time: 0.212321 Apr 16 21:35:12.899024 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2898/5957] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:35:12 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1340 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:35:13.066078 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9d7d6f0b-01c4-4e5e-a39b-a45206eaa91b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:35:13.066712 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9d7d6f0b-01c4-4e5e-a39b-a45206eaa91b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:35:13.074084 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9d7d6f0b-01c4-4e5e-a39b-a45206eaa91b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:13.074506 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9d7d6f0b-01c4-4e5e-a39b-a45206eaa91b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:13.075310 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9d7d6f0b-01c4-4e5e-a39b-a45206eaa91b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:13.088109 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9d7d6f0b-01c4-4e5e-a39b-a45206eaa91b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:13.275081 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9d7d6f0b-01c4-4e5e-a39b-a45206eaa91b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:13.283592 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9d7d6f0b-01c4-4e5e-a39b-a45206eaa91b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1563 microversion: 2.1 time: 0.221459 Apr 16 21:35:13.284275 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3060/5958] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:35:13 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1563 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:35:13.300133 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4ef9fb61-8dea-49ef-905c-f7b4a762c69d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:35:13.300790 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4ef9fb61-8dea-49ef-905c-f7b4a762c69d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:35:13.308709 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4ef9fb61-8dea-49ef-905c-f7b4a762c69d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:13.309187 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4ef9fb61-8dea-49ef-905c-f7b4a762c69d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:13.309995 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4ef9fb61-8dea-49ef-905c-f7b4a762c69d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:13.310453 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4ef9fb61-8dea-49ef-905c-f7b4a762c69d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:13.597001 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4ef9fb61-8dea-49ef-905c-f7b4a762c69d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:13.605645 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4ef9fb61-8dea-49ef-905c-f7b4a762c69d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1563 microversion: 2.1 time: 0.309559 Apr 16 21:35:13.606237 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2899/5959] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:35:13 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1563 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:35:13.919608 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5ae59464-3956-40fb-b0c7-b24c73b0e5bf tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:35:13.920233 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5ae59464-3956-40fb-b0c7-b24c73b0e5bf tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:35:13.926580 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5ae59464-3956-40fb-b0c7-b24c73b0e5bf tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:13.927055 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5ae59464-3956-40fb-b0c7-b24c73b0e5bf tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:13.928383 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5ae59464-3956-40fb-b0c7-b24c73b0e5bf tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:13.928383 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5ae59464-3956-40fb-b0c7-b24c73b0e5bf tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:14.411836 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5ae59464-3956-40fb-b0c7-b24c73b0e5bf tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:14.426340 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5ae59464-3956-40fb-b0c7-b24c73b0e5bf tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:14.428829 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5ae59464-3956-40fb-b0c7-b24c73b0e5bf tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:14.430477 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5ae59464-3956-40fb-b0c7-b24c73b0e5bf tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1338 microversion: 2.20 time: 0.515175 Apr 16 21:35:14.440434 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3061/5960] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:35:13 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1338 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:35:15.465301 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3f6acf10-91d3-499e-890f-66c03000c94e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:35:15.467079 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3f6acf10-91d3-499e-890f-66c03000c94e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:35:15.479369 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3f6acf10-91d3-499e-890f-66c03000c94e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:15.480071 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3f6acf10-91d3-499e-890f-66c03000c94e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:15.481573 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3f6acf10-91d3-499e-890f-66c03000c94e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:15.482246 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3f6acf10-91d3-499e-890f-66c03000c94e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:16.116153 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3f6acf10-91d3-499e-890f-66c03000c94e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:16.124541 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3f6acf10-91d3-499e-890f-66c03000c94e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:16.126193 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3f6acf10-91d3-499e-890f-66c03000c94e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:16.127435 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3f6acf10-91d3-499e-890f-66c03000c94e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1406 microversion: 2.20 time: 0.668645 Apr 16 21:35:16.128111 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2900/5961] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:35:15 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1406 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:35:17.123543 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-28a9ff1b-6ad8-4590-beb4-7729c0e6b5af req-956eb324-84c7-49e9-a394-53c05ea94c42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25cb82d7-b342-407d-8f63-71670d8f22d9", "tag": "32c60358-6ed6-4d01-a515-c08c9770f288"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:35:17.146110 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-28a9ff1b-6ad8-4590-beb4-7729c0e6b5af req-956eb324-84c7-49e9-a394-53c05ea94c42 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:17.147090 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-28a9ff1b-6ad8-4590-beb4-7729c0e6b5af req-956eb324-84c7-49e9-a394-53c05ea94c42 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:17.147876 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e98e6981-0139-4c89-8289-e2de89a196e5 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:35:17.148400 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e98e6981-0139-4c89-8289-e2de89a196e5 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:35:17.157447 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e98e6981-0139-4c89-8289-e2de89a196e5 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:17.157912 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e98e6981-0139-4c89-8289-e2de89a196e5 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:17.158708 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e98e6981-0139-4c89-8289-e2de89a196e5 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:17.159158 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e98e6981-0139-4c89-8289-e2de89a196e5 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:17.182659 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-28a9ff1b-6ad8-4590-beb4-7729c0e6b5af req-956eb324-84c7-49e9-a394-53c05ea94c42 service nova] Creating event network-changed:32c60358-6ed6-4d01-a515-c08c9770f288 for instance 25cb82d7-b342-407d-8f63-71670d8f22d9 on nch1-master-1 Apr 16 21:35:17.190384 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-28a9ff1b-6ad8-4590-beb4-7729c0e6b5af req-956eb324-84c7-49e9-a394-53c05ea94c42 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072294 Apr 16 21:35:17.192442 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3062/5962] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:35:17.659972 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e98e6981-0139-4c89-8289-e2de89a196e5 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:17.677832 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e98e6981-0139-4c89-8289-e2de89a196e5 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:17.679488 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e98e6981-0139-4c89-8289-e2de89a196e5 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:17.680656 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e98e6981-0139-4c89-8289-e2de89a196e5 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1406 microversion: 2.20 time: 0.538463 Apr 16 21:35:17.681215 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2901/5963] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:35:17 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1406 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:35:18.702008 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b8acecc1-2891-444b-8aeb-709259f40a96 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:35:18.702759 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b8acecc1-2891-444b-8aeb-709259f40a96 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:35:18.720135 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b8acecc1-2891-444b-8aeb-709259f40a96 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:18.720784 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b8acecc1-2891-444b-8aeb-709259f40a96 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:18.721641 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b8acecc1-2891-444b-8aeb-709259f40a96 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:18.722046 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b8acecc1-2891-444b-8aeb-709259f40a96 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:19.043546 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b8acecc1-2891-444b-8aeb-709259f40a96 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:19.055901 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b8acecc1-2891-444b-8aeb-709259f40a96 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:19.062718 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b8acecc1-2891-444b-8aeb-709259f40a96 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:19.064762 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b8acecc1-2891-444b-8aeb-709259f40a96 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1406 microversion: 2.20 time: 0.369070 Apr 16 21:35:19.066313 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3063/5964] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:35:18 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1406 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:35:19.434600 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f646537b-134f-45f0-984f-29f21b3db248 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:35:19.436292 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f646537b-134f-45f0-984f-29f21b3db248 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:35:19.440209 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-ef33445a-ef41-421a-b7cb-168cbee8d042 req-1a33a420-e933-4ee5-b8ab-c6e57ffc84a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69bd9595-c9e9-4d06-af55-ce22d5f09416", "tag": "10dae36f-fbbc-45d6-b539-d8ce65bad3c2"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:35:19.446104 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f646537b-134f-45f0-984f-29f21b3db248 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:19.446828 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f646537b-134f-45f0-984f-29f21b3db248 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:19.452962 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f646537b-134f-45f0-984f-29f21b3db248 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:19.452962 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f646537b-134f-45f0-984f-29f21b3db248 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:19.453569 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-ef33445a-ef41-421a-b7cb-168cbee8d042 req-1a33a420-e933-4ee5-b8ab-c6e57ffc84a7 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:19.454042 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-ef33445a-ef41-421a-b7cb-168cbee8d042 req-1a33a420-e933-4ee5-b8ab-c6e57ffc84a7 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:19.487553 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-ef33445a-ef41-421a-b7cb-168cbee8d042 req-1a33a420-e933-4ee5-b8ab-c6e57ffc84a7 service nova] Creating event network-changed:10dae36f-fbbc-45d6-b539-d8ce65bad3c2 for instance 69bd9595-c9e9-4d06-af55-ce22d5f09416 on nch2-master-1 Apr 16 21:35:19.502255 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-ef33445a-ef41-421a-b7cb-168cbee8d042 req-1a33a420-e933-4ee5-b8ab-c6e57ffc84a7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066155 Apr 16 21:35:19.509264 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3064/5965] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:35:20.083998 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7edc599f-bc92-4d73-86b7-354e775d98b3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:35:20.085468 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7edc599f-bc92-4d73-86b7-354e775d98b3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:35:20.098530 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7edc599f-bc92-4d73-86b7-354e775d98b3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:20.098986 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7edc599f-bc92-4d73-86b7-354e775d98b3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:20.102174 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7edc599f-bc92-4d73-86b7-354e775d98b3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:20.104074 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7edc599f-bc92-4d73-86b7-354e775d98b3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:20.218207 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f646537b-134f-45f0-984f-29f21b3db248 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:20.229476 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f646537b-134f-45f0-984f-29f21b3db248 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1563 microversion: 2.1 time: 0.798275 Apr 16 21:35:20.232762 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2902/5966] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:35:19 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1563 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:35:21.029163 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7edc599f-bc92-4d73-86b7-354e775d98b3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:21.040616 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7edc599f-bc92-4d73-86b7-354e775d98b3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:21.042179 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7edc599f-bc92-4d73-86b7-354e775d98b3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:21.043540 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7edc599f-bc92-4d73-86b7-354e775d98b3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1406 microversion: 2.20 time: 0.964200 Apr 16 21:35:21.044344 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3065/5967] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:35:20 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1406 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:35:22.075777 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f9645e75-5323-4409-8c78-fcd99e8399c0 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:35:22.076461 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f9645e75-5323-4409-8c78-fcd99e8399c0 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:35:22.113299 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f9645e75-5323-4409-8c78-fcd99e8399c0 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:22.116313 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f9645e75-5323-4409-8c78-fcd99e8399c0 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:22.118560 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f9645e75-5323-4409-8c78-fcd99e8399c0 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:22.123520 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f9645e75-5323-4409-8c78-fcd99e8399c0 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:22.463643 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f9645e75-5323-4409-8c78-fcd99e8399c0 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:22.472320 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f9645e75-5323-4409-8c78-fcd99e8399c0 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:22.479543 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f9645e75-5323-4409-8c78-fcd99e8399c0 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:22.481807 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f9645e75-5323-4409-8c78-fcd99e8399c0 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1406 microversion: 2.20 time: 0.418248 Apr 16 21:35:22.484093 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2903/5968] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:35:22 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1406 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:35:23.511562 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5deeecaa-4553-447e-8468-da871396bf97 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:35:23.512909 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5deeecaa-4553-447e-8468-da871396bf97 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:35:23.545507 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5deeecaa-4553-447e-8468-da871396bf97 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:23.545507 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5deeecaa-4553-447e-8468-da871396bf97 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:23.545507 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5deeecaa-4553-447e-8468-da871396bf97 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:23.545507 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5deeecaa-4553-447e-8468-da871396bf97 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:23.785004 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5deeecaa-4553-447e-8468-da871396bf97 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:23.796580 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5deeecaa-4553-447e-8468-da871396bf97 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:23.798551 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5deeecaa-4553-447e-8468-da871396bf97 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:23.799963 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5deeecaa-4553-447e-8468-da871396bf97 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1406 microversion: 2.20 time: 0.295656 Apr 16 21:35:23.809263 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3066/5969] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:35:23 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1406 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:35:24.821405 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-621b0265-f3b2-4065-8d0b-f6421594d83f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:35:24.837399 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-621b0265-f3b2-4065-8d0b-f6421594d83f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:35:24.877106 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-621b0265-f3b2-4065-8d0b-f6421594d83f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:24.881337 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-621b0265-f3b2-4065-8d0b-f6421594d83f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:24.890424 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-621b0265-f3b2-4065-8d0b-f6421594d83f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:24.890424 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-621b0265-f3b2-4065-8d0b-f6421594d83f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:25.365892 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-621b0265-f3b2-4065-8d0b-f6421594d83f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:25.375327 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-621b0265-f3b2-4065-8d0b-f6421594d83f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:25.376664 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-621b0265-f3b2-4065-8d0b-f6421594d83f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:25.377824 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-621b0265-f3b2-4065-8d0b-f6421594d83f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1406 microversion: 2.20 time: 0.561363 Apr 16 21:35:25.378401 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2904/5970] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:35:24 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1406 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:35:26.397992 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-470ded77-1fba-4780-b058-03310fa5176b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:35:26.401113 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-470ded77-1fba-4780-b058-03310fa5176b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:35:26.428500 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-470ded77-1fba-4780-b058-03310fa5176b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:26.431564 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-470ded77-1fba-4780-b058-03310fa5176b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:26.433626 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-470ded77-1fba-4780-b058-03310fa5176b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:26.435109 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-470ded77-1fba-4780-b058-03310fa5176b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:26.937337 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-8b763f8e-921e-407f-83d2-87f6c75985d1 req-db7d25d7-e608-4bd9-8fdc-827813b3092d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25cb82d7-b342-407d-8f63-71670d8f22d9", "name": "network-vif-plugged", "status": "completed", "tag": "32c60358-6ed6-4d01-a515-c08c9770f288"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:35:26.952943 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-8b763f8e-921e-407f-83d2-87f6c75985d1 req-db7d25d7-e608-4bd9-8fdc-827813b3092d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:26.953323 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-8b763f8e-921e-407f-83d2-87f6c75985d1 req-db7d25d7-e608-4bd9-8fdc-827813b3092d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:26.975250 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-470ded77-1fba-4780-b058-03310fa5176b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:26.978991 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-8b763f8e-921e-407f-83d2-87f6c75985d1 req-db7d25d7-e608-4bd9-8fdc-827813b3092d service nova] Creating event network-vif-plugged:32c60358-6ed6-4d01-a515-c08c9770f288 for instance 25cb82d7-b342-407d-8f63-71670d8f22d9 on nch1-master-1 Apr 16 21:35:26.986913 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-470ded77-1fba-4780-b058-03310fa5176b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:26.988695 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-470ded77-1fba-4780-b058-03310fa5176b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:26.988984 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-8b763f8e-921e-407f-83d2-87f6c75985d1 req-db7d25d7-e608-4bd9-8fdc-827813b3092d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054443 Apr 16 21:35:26.989873 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-470ded77-1fba-4780-b058-03310fa5176b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1406 microversion: 2.20 time: 0.596092 Apr 16 21:35:26.990492 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2905/5971] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:35:26.997440 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3067/5972] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:35:26 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1406 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:35:28.011984 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9f2a9dc5-5d82-462f-95c8-3639ffc25b3e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:35:28.014174 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9f2a9dc5-5d82-462f-95c8-3639ffc25b3e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:35:28.024528 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9f2a9dc5-5d82-462f-95c8-3639ffc25b3e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:28.025188 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9f2a9dc5-5d82-462f-95c8-3639ffc25b3e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:28.027139 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9f2a9dc5-5d82-462f-95c8-3639ffc25b3e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:28.027761 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9f2a9dc5-5d82-462f-95c8-3639ffc25b3e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:28.419924 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3f4fe941-4b88-4889-878b-1ef942687b4a tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:35:28.421264 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3f4fe941-4b88-4889-878b-1ef942687b4a tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] [instance: 83455e10-9079-4214-a0d9-4b07eae7272b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:35:28.433949 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3f4fe941-4b88-4889-878b-1ef942687b4a tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:28.434948 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3f4fe941-4b88-4889-878b-1ef942687b4a tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:28.438040 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3f4fe941-4b88-4889-878b-1ef942687b4a tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:28.439036 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3f4fe941-4b88-4889-878b-1ef942687b4a tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:28.467808 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9f2a9dc5-5d82-462f-95c8-3639ffc25b3e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:28.480781 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9f2a9dc5-5d82-462f-95c8-3639ffc25b3e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:28.482501 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3f4fe941-4b88-4889-878b-1ef942687b4a tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] 10.222.0.20 "GET /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.066875 Apr 16 21:35:28.488363 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3068/5973] 10.222.0.20 () {58 vars in 1292 bytes} [Sat Apr 16 21:35:28 2022] GET /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b/os-server-password => generated 116 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:35:28.490985 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9f2a9dc5-5d82-462f-95c8-3639ffc25b3e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:28.498711 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9f2a9dc5-5d82-462f-95c8-3639ffc25b3e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1406 microversion: 2.20 time: 0.489008 Apr 16 21:35:28.498711 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2906/5974] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:35:28 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1406 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:35:29.516150 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d5565e32-dd46-4e43-965b-97c83d912fb8 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:35:29.516829 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d5565e32-dd46-4e43-965b-97c83d912fb8 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:35:29.543777 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d5565e32-dd46-4e43-965b-97c83d912fb8 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:29.543777 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d5565e32-dd46-4e43-965b-97c83d912fb8 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:29.543777 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d5565e32-dd46-4e43-965b-97c83d912fb8 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:29.546007 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d5565e32-dd46-4e43-965b-97c83d912fb8 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:29.874316 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d5565e32-dd46-4e43-965b-97c83d912fb8 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:29.883435 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d5565e32-dd46-4e43-965b-97c83d912fb8 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:29.885977 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d5565e32-dd46-4e43-965b-97c83d912fb8 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:35:29.887473 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d5565e32-dd46-4e43-965b-97c83d912fb8 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1598 microversion: 2.20 time: 0.376052 Apr 16 21:35:29.888047 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3069/5975] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:35:29 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1598 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:35:29.906923 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4501bad3-ab9f-4169-b52c-13d04b0202ca tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:35:29.907642 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4501bad3-ab9f-4169-b52c-13d04b0202ca tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:35:29.915592 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4501bad3-ab9f-4169-b52c-13d04b0202ca tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:29.916744 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4501bad3-ab9f-4169-b52c-13d04b0202ca tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:29.917932 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4501bad3-ab9f-4169-b52c-13d04b0202ca tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:29.918386 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4501bad3-ab9f-4169-b52c-13d04b0202ca tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:30.132714 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4501bad3-ab9f-4169-b52c-13d04b0202ca tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.230300 Apr 16 21:35:30.133323 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2907/5976] 10.222.0.20 () {60 vars in 1315 bytes} [Sat Apr 16 21:35:29 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9/os-interface => generated 284 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:35:32.669115 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-8683df94-31e3-49ef-9010-0af1cd2024b8 req-0518fbf7-2902-4580-931d-c93b48d2e4ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25cb82d7-b342-407d-8f63-71670d8f22d9", "tag": "32c60358-6ed6-4d01-a515-c08c9770f288"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:35:32.683300 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-8683df94-31e3-49ef-9010-0af1cd2024b8 req-0518fbf7-2902-4580-931d-c93b48d2e4ee service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:32.683826 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-8683df94-31e3-49ef-9010-0af1cd2024b8 req-0518fbf7-2902-4580-931d-c93b48d2e4ee service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:32.711978 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-8683df94-31e3-49ef-9010-0af1cd2024b8 req-0518fbf7-2902-4580-931d-c93b48d2e4ee service nova] Creating event network-changed:32c60358-6ed6-4d01-a515-c08c9770f288 for instance 25cb82d7-b342-407d-8f63-71670d8f22d9 on nch1-master-1 Apr 16 21:35:32.725876 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-8683df94-31e3-49ef-9010-0af1cd2024b8 req-0518fbf7-2902-4580-931d-c93b48d2e4ee service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069996 Apr 16 21:35:32.726935 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3070/5977] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:35:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:35:47.799863 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-67d0d2ea-0651-467d-b693-aed1718c5d51 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:35:47.800820 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-67d0d2ea-0651-467d-b693-aed1718c5d51 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:35:47.807797 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-67d0d2ea-0651-467d-b693-aed1718c5d51 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:47.808597 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-67d0d2ea-0651-467d-b693-aed1718c5d51 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:47.809397 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-67d0d2ea-0651-467d-b693-aed1718c5d51 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:35:47.809850 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-67d0d2ea-0651-467d-b693-aed1718c5d51 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:35:47.876087 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-67d0d2ea-0651-467d-b693-aed1718c5d51 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "POST /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416/action" status: 200 len: 24570 microversion: 2.1 time: 0.081363 Apr 16 21:35:47.878696 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2908/5978] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:35:47 2022] POST /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416/action => generated 24570 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:36:00.062628 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-13f363c4-3926-4413-a204-233bf73010d3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:00.064695 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-13f363c4-3926-4413-a204-233bf73010d3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:00.083719 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-13f363c4-3926-4413-a204-233bf73010d3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:00.085318 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-13f363c4-3926-4413-a204-233bf73010d3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:00.086450 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-13f363c4-3926-4413-a204-233bf73010d3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:00.087075 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-13f363c4-3926-4413-a204-233bf73010d3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:00.152003 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-13f363c4-3926-4413-a204-233bf73010d3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9/ips" status: 200 len: 152 microversion: 2.20 time: 0.459131 Apr 16 21:36:00.152621 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3071/5979] 10.222.0.20 () {60 vars in 1288 bytes} [Sat Apr 16 21:35:59 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9/ips => generated 152 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:36:03.803095 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7863fdab-933f-40c7-ac5b-6b773207d9e3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:36:03.804991 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7863fdab-933f-40c7-ac5b-6b773207d9e3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:03.836380 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7863fdab-933f-40c7-ac5b-6b773207d9e3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:03.840850 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7863fdab-933f-40c7-ac5b-6b773207d9e3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:03.841887 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7863fdab-933f-40c7-ac5b-6b773207d9e3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:03.842511 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7863fdab-933f-40c7-ac5b-6b773207d9e3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:03.871897 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-7863fdab-933f-40c7-ac5b-6b773207d9e3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lazy-loading 'flavor' on Instance uuid 25cb82d7-b342-407d-8f63-71670d8f22d9 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:36:04.535829 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7863fdab-933f-40c7-ac5b-6b773207d9e3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "POST /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9/action" status: 202 len: 0 microversion: 2.20 time: 0.730521 Apr 16 21:36:04.537371 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2909/5980] 10.222.0.20 () {62 vars in 1318 bytes} [Sat Apr 16 21:36:03 2022] POST /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9/action => generated 0 bytes in 740 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:36:04.546673 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f2bc2339-50e9-4d20-9852-218b0b29e111 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:04.547977 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f2bc2339-50e9-4d20-9852-218b0b29e111 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:04.568189 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f2bc2339-50e9-4d20-9852-218b0b29e111 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:04.568963 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f2bc2339-50e9-4d20-9852-218b0b29e111 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:04.570245 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f2bc2339-50e9-4d20-9852-218b0b29e111 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:04.570985 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f2bc2339-50e9-4d20-9852-218b0b29e111 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:04.941632 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f2bc2339-50e9-4d20-9852-218b0b29e111 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:04.949575 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f2bc2339-50e9-4d20-9852-218b0b29e111 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:04.953073 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f2bc2339-50e9-4d20-9852-218b0b29e111 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:04.957269 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f2bc2339-50e9-4d20-9852-218b0b29e111 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1723 microversion: 2.20 time: 0.413934 Apr 16 21:36:04.958509 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3072/5981] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:36:04 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1723 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:36:05.989198 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0e8a8718-c1e0-48e2-b618-d393cc03c88f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:05.989969 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0e8a8718-c1e0-48e2-b618-d393cc03c88f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:06.005429 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0e8a8718-c1e0-48e2-b618-d393cc03c88f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:06.006174 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0e8a8718-c1e0-48e2-b618-d393cc03c88f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:06.007877 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0e8a8718-c1e0-48e2-b618-d393cc03c88f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:06.008566 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0e8a8718-c1e0-48e2-b618-d393cc03c88f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:06.441903 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0e8a8718-c1e0-48e2-b618-d393cc03c88f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:06.454585 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0e8a8718-c1e0-48e2-b618-d393cc03c88f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:06.457172 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0e8a8718-c1e0-48e2-b618-d393cc03c88f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:06.458594 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0e8a8718-c1e0-48e2-b618-d393cc03c88f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1723 microversion: 2.20 time: 0.486091 Apr 16 21:36:06.462117 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2910/5982] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:36:05 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1723 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:36:07.480481 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-afb9ecf6-d3ec-4581-be15-3a6fc4bc6b0d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:07.481710 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-afb9ecf6-d3ec-4581-be15-3a6fc4bc6b0d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:07.489296 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-afb9ecf6-d3ec-4581-be15-3a6fc4bc6b0d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:07.490011 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-afb9ecf6-d3ec-4581-be15-3a6fc4bc6b0d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:07.490988 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-afb9ecf6-d3ec-4581-be15-3a6fc4bc6b0d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:07.491947 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-afb9ecf6-d3ec-4581-be15-3a6fc4bc6b0d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:07.803693 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-afb9ecf6-d3ec-4581-be15-3a6fc4bc6b0d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:07.816337 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-afb9ecf6-d3ec-4581-be15-3a6fc4bc6b0d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:07.818001 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-afb9ecf6-d3ec-4581-be15-3a6fc4bc6b0d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:07.819710 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-afb9ecf6-d3ec-4581-be15-3a6fc4bc6b0d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1723 microversion: 2.20 time: 0.343477 Apr 16 21:36:07.820616 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3073/5983] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:36:07 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1723 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:36:08.839481 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4d844e77-64c2-4730-8f11-942c0f08e839 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:08.840104 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4d844e77-64c2-4730-8f11-942c0f08e839 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:08.847430 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4d844e77-64c2-4730-8f11-942c0f08e839 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:08.847906 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4d844e77-64c2-4730-8f11-942c0f08e839 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:08.848726 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4d844e77-64c2-4730-8f11-942c0f08e839 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:08.849173 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4d844e77-64c2-4730-8f11-942c0f08e839 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:09.408457 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4d844e77-64c2-4730-8f11-942c0f08e839 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:09.420836 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4d844e77-64c2-4730-8f11-942c0f08e839 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:09.424841 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4d844e77-64c2-4730-8f11-942c0f08e839 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:09.426892 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4d844e77-64c2-4730-8f11-942c0f08e839 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1723 microversion: 2.20 time: 0.591418 Apr 16 21:36:09.436484 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2911/5984] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:36:08 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1723 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:36:10.448039 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5720abce-2484-44d7-8755-0816baca30ad tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:10.448758 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5720abce-2484-44d7-8755-0816baca30ad tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:10.465556 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5720abce-2484-44d7-8755-0816baca30ad tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:10.466772 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5720abce-2484-44d7-8755-0816baca30ad tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:10.469633 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5720abce-2484-44d7-8755-0816baca30ad tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:10.469633 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5720abce-2484-44d7-8755-0816baca30ad tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:10.666304 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5720abce-2484-44d7-8755-0816baca30ad tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:10.681355 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5720abce-2484-44d7-8755-0816baca30ad tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:10.682934 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5720abce-2484-44d7-8755-0816baca30ad tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:10.684113 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5720abce-2484-44d7-8755-0816baca30ad tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1723 microversion: 2.20 time: 0.241199 Apr 16 21:36:10.700447 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3074/5985] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:36:10 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1723 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:36:11.708106 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-df3666e9-cba8-44e5-b914-13917c5e6bf4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:11.708767 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-df3666e9-cba8-44e5-b914-13917c5e6bf4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:11.716261 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-df3666e9-cba8-44e5-b914-13917c5e6bf4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:11.716735 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-df3666e9-cba8-44e5-b914-13917c5e6bf4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:11.717528 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-df3666e9-cba8-44e5-b914-13917c5e6bf4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:11.717980 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-df3666e9-cba8-44e5-b914-13917c5e6bf4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:11.868089 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-df3666e9-cba8-44e5-b914-13917c5e6bf4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:11.880904 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-df3666e9-cba8-44e5-b914-13917c5e6bf4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:11.882675 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-df3666e9-cba8-44e5-b914-13917c5e6bf4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:11.884093 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-df3666e9-cba8-44e5-b914-13917c5e6bf4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1723 microversion: 2.20 time: 0.179976 Apr 16 21:36:11.884838 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2912/5986] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:36:11 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:36:12.908653 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4adf0f9b-0f2b-4b01-a8df-f086c84ef77c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:12.909417 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4adf0f9b-0f2b-4b01-a8df-f086c84ef77c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:12.923058 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4adf0f9b-0f2b-4b01-a8df-f086c84ef77c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:12.926559 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4adf0f9b-0f2b-4b01-a8df-f086c84ef77c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:12.927475 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4adf0f9b-0f2b-4b01-a8df-f086c84ef77c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:12.927935 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4adf0f9b-0f2b-4b01-a8df-f086c84ef77c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:13.114069 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4adf0f9b-0f2b-4b01-a8df-f086c84ef77c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:13.124057 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4adf0f9b-0f2b-4b01-a8df-f086c84ef77c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:13.126396 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4adf0f9b-0f2b-4b01-a8df-f086c84ef77c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:13.128674 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4adf0f9b-0f2b-4b01-a8df-f086c84ef77c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1723 microversion: 2.20 time: 0.229571 Apr 16 21:36:13.130193 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3075/5987] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:36:12 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:36:14.149205 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4ae3d135-eb4a-4320-b4bf-ea440506e01b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:14.150023 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4ae3d135-eb4a-4320-b4bf-ea440506e01b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:14.162257 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4ae3d135-eb4a-4320-b4bf-ea440506e01b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:14.162729 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4ae3d135-eb4a-4320-b4bf-ea440506e01b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:14.163548 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4ae3d135-eb4a-4320-b4bf-ea440506e01b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:14.164006 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4ae3d135-eb4a-4320-b4bf-ea440506e01b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:14.456550 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4ae3d135-eb4a-4320-b4bf-ea440506e01b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:14.470941 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4ae3d135-eb4a-4320-b4bf-ea440506e01b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:14.472953 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4ae3d135-eb4a-4320-b4bf-ea440506e01b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:14.475251 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4ae3d135-eb4a-4320-b4bf-ea440506e01b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1723 microversion: 2.20 time: 0.331785 Apr 16 21:36:14.476384 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2913/5988] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:36:14 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1723 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:36:15.497320 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c5268d34-b589-4c55-9608-315bac0d6dcc tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:15.497320 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c5268d34-b589-4c55-9608-315bac0d6dcc tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:15.509352 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c5268d34-b589-4c55-9608-315bac0d6dcc tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:15.517014 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c5268d34-b589-4c55-9608-315bac0d6dcc tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:15.518227 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c5268d34-b589-4c55-9608-315bac0d6dcc tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:15.518825 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c5268d34-b589-4c55-9608-315bac0d6dcc tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:15.879990 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c5268d34-b589-4c55-9608-315bac0d6dcc tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:15.896002 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c5268d34-b589-4c55-9608-315bac0d6dcc tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:15.901954 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c5268d34-b589-4c55-9608-315bac0d6dcc tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:15.903546 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c5268d34-b589-4c55-9608-315bac0d6dcc tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1723 microversion: 2.20 time: 0.411625 Apr 16 21:36:15.904691 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3076/5989] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:36:15 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1723 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:36:16.927790 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9f6dda1e-713e-4fd3-b8bc-15a746fbc20b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:16.928737 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9f6dda1e-713e-4fd3-b8bc-15a746fbc20b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:16.948726 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9f6dda1e-713e-4fd3-b8bc-15a746fbc20b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:16.949237 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9f6dda1e-713e-4fd3-b8bc-15a746fbc20b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:16.950047 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9f6dda1e-713e-4fd3-b8bc-15a746fbc20b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:16.950491 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9f6dda1e-713e-4fd3-b8bc-15a746fbc20b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:17.262743 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9f6dda1e-713e-4fd3-b8bc-15a746fbc20b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:17.271551 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9f6dda1e-713e-4fd3-b8bc-15a746fbc20b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:17.273098 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9f6dda1e-713e-4fd3-b8bc-15a746fbc20b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:17.274783 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9f6dda1e-713e-4fd3-b8bc-15a746fbc20b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1723 microversion: 2.20 time: 0.353773 Apr 16 21:36:17.275556 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2914/5990] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:36:16 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1723 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:36:18.293860 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7d8d827e-452e-4744-b16f-16978f456a72 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:18.294574 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7d8d827e-452e-4744-b16f-16978f456a72 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:18.304618 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7d8d827e-452e-4744-b16f-16978f456a72 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:18.304911 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7d8d827e-452e-4744-b16f-16978f456a72 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:18.305718 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7d8d827e-452e-4744-b16f-16978f456a72 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:18.306683 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7d8d827e-452e-4744-b16f-16978f456a72 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:18.536663 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4604b19b-f98e-432b-bab8-0f7790a0de1d tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:18.537904 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4604b19b-f98e-432b-bab8-0f7790a0de1d tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:18.548462 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4604b19b-f98e-432b-bab8-0f7790a0de1d tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:18.548462 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4604b19b-f98e-432b-bab8-0f7790a0de1d tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:18.548462 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4604b19b-f98e-432b-bab8-0f7790a0de1d tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:18.548462 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4604b19b-f98e-432b-bab8-0f7790a0de1d tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:18.727390 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7d8d827e-452e-4744-b16f-16978f456a72 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:18.739093 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7d8d827e-452e-4744-b16f-16978f456a72 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:18.748269 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7d8d827e-452e-4744-b16f-16978f456a72 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:18.751888 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7d8d827e-452e-4744-b16f-16978f456a72 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1723 microversion: 2.20 time: 0.460710 Apr 16 21:36:18.753957 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2915/5991] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:36:18 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1723 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:36:18.814240 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4604b19b-f98e-432b-bab8-0f7790a0de1d tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1833 microversion: 2.1 time: 0.549770 Apr 16 21:36:18.814817 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3077/5992] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:36:18 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1833 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:36:18.985109 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3d3ec2a7-9614-48fc-9087-f90e6665f971 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:18.986005 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3d3ec2a7-9614-48fc-9087-f90e6665f971 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:18.992331 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3d3ec2a7-9614-48fc-9087-f90e6665f971 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:18.992961 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3d3ec2a7-9614-48fc-9087-f90e6665f971 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:18.994443 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3d3ec2a7-9614-48fc-9087-f90e6665f971 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:18.994904 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3d3ec2a7-9614-48fc-9087-f90e6665f971 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:19.270656 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3d3ec2a7-9614-48fc-9087-f90e6665f971 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:19.279432 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3d3ec2a7-9614-48fc-9087-f90e6665f971 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1682 microversion: 2.1 time: 0.448927 Apr 16 21:36:19.295981 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2916/5993] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:36:18 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1682 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:36:19.469803 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7217f198-4256-489f-a8ff-4e77e64bec17 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:36:19.470807 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7217f198-4256-489f-a8ff-4e77e64bec17 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:19.477577 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7217f198-4256-489f-a8ff-4e77e64bec17 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:19.478031 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7217f198-4256-489f-a8ff-4e77e64bec17 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:19.478799 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7217f198-4256-489f-a8ff-4e77e64bec17 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:19.479246 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7217f198-4256-489f-a8ff-4e77e64bec17 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:19.529481 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7217f198-4256-489f-a8ff-4e77e64bec17 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "POST /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416/action" status: 200 len: 32644 microversion: 2.1 time: 0.063082 Apr 16 21:36:19.530364 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3078/5994] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:36:19 2022] POST /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416/action => generated 32644 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:36:19.763198 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4502eb3a-a370-4cbc-9eb0-45ae22a68698 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:36:19.763909 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4502eb3a-a370-4cbc-9eb0-45ae22a68698 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:19.777059 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4502eb3a-a370-4cbc-9eb0-45ae22a68698 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:19.777844 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4502eb3a-a370-4cbc-9eb0-45ae22a68698 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:19.778927 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4502eb3a-a370-4cbc-9eb0-45ae22a68698 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:19.779749 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4502eb3a-a370-4cbc-9eb0-45ae22a68698 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:19.781377 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b6a4d679-cc57-47b2-89de-d79927011e98 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:19.783066 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b6a4d679-cc57-47b2-89de-d79927011e98 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:19.791380 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b6a4d679-cc57-47b2-89de-d79927011e98 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:19.793302 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b6a4d679-cc57-47b2-89de-d79927011e98 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:19.794300 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b6a4d679-cc57-47b2-89de-d79927011e98 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:19.794959 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b6a4d679-cc57-47b2-89de-d79927011e98 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:19.865350 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4502eb3a-a370-4cbc-9eb0-45ae22a68698 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'e96e42d9b66345579624d33c2caee061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2b1d1209bf34874a82a0c9ee0081e9e', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:19.866102 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4502eb3a-a370-4cbc-9eb0-45ae22a68698 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] flavor_id is None. Assuming migration. {{(pid=137409) resize /opt/stack/nova/nova/compute/api.py:4140}} Apr 16 21:36:19.866615 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4502eb3a-a370-4cbc-9eb0-45ae22a68698 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=137409) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 16 21:36:20.057389 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b6a4d679-cc57-47b2-89de-d79927011e98 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:20.069394 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b6a4d679-cc57-47b2-89de-d79927011e98 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:20.071594 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b6a4d679-cc57-47b2-89de-d79927011e98 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:20.073476 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b6a4d679-cc57-47b2-89de-d79927011e98 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1723 microversion: 2.20 time: 0.298578 Apr 16 21:36:20.074436 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3079/5995] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:36:19 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1723 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:36:20.423481 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4502eb3a-a370-4cbc-9eb0-45ae22a68698 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416/action" status: 202 len: 0 microversion: 2.1 time: 0.662235 Apr 16 21:36:20.428318 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2917/5996] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:36:19 2022] POST /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416/action => generated 0 bytes in 671 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:36:20.434256 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3b54a1bf-82b8-4255-8fe9-2dbae37911dc tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:20.434866 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3b54a1bf-82b8-4255-8fe9-2dbae37911dc tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:20.443868 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3b54a1bf-82b8-4255-8fe9-2dbae37911dc tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:20.450259 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3b54a1bf-82b8-4255-8fe9-2dbae37911dc tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:20.451158 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3b54a1bf-82b8-4255-8fe9-2dbae37911dc tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:20.451590 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3b54a1bf-82b8-4255-8fe9-2dbae37911dc tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:20.673253 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3b54a1bf-82b8-4255-8fe9-2dbae37911dc tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:20.681550 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3b54a1bf-82b8-4255-8fe9-2dbae37911dc tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1691 microversion: 2.1 time: 0.252205 Apr 16 21:36:20.685013 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3080/5997] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:36:20 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1691 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:36:21.094845 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b910d834-f55c-4ffa-82a9-cd2f7b428420 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:21.098423 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b910d834-f55c-4ffa-82a9-cd2f7b428420 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:21.103271 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b910d834-f55c-4ffa-82a9-cd2f7b428420 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:21.103971 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b910d834-f55c-4ffa-82a9-cd2f7b428420 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:21.105012 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b910d834-f55c-4ffa-82a9-cd2f7b428420 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:21.105616 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b910d834-f55c-4ffa-82a9-cd2f7b428420 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:21.325266 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b910d834-f55c-4ffa-82a9-cd2f7b428420 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:21.333280 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b910d834-f55c-4ffa-82a9-cd2f7b428420 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:21.336497 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b910d834-f55c-4ffa-82a9-cd2f7b428420 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:21.336497 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b910d834-f55c-4ffa-82a9-cd2f7b428420 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1744 microversion: 2.20 time: 0.247492 Apr 16 21:36:21.342700 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2918/5998] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:36:21 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1744 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:36:21.702896 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b5e68e13-899b-4857-9207-f9bfbb571586 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:21.703540 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b5e68e13-899b-4857-9207-f9bfbb571586 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:21.710548 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5e68e13-899b-4857-9207-f9bfbb571586 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:21.713012 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5e68e13-899b-4857-9207-f9bfbb571586 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:21.713012 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5e68e13-899b-4857-9207-f9bfbb571586 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:21.713012 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5e68e13-899b-4857-9207-f9bfbb571586 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:21.980584 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b5e68e13-899b-4857-9207-f9bfbb571586 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:22.000636 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b5e68e13-899b-4857-9207-f9bfbb571586 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1691 microversion: 2.1 time: 0.301493 Apr 16 21:36:22.004329 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3081/5999] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:36:21 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1691 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:36:22.357207 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-86159e5a-9081-4b04-bb63-750bfbd04b1e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:22.360526 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-86159e5a-9081-4b04-bb63-750bfbd04b1e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:22.385706 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-86159e5a-9081-4b04-bb63-750bfbd04b1e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:22.386974 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-86159e5a-9081-4b04-bb63-750bfbd04b1e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:22.392356 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-86159e5a-9081-4b04-bb63-750bfbd04b1e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:22.393034 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-86159e5a-9081-4b04-bb63-750bfbd04b1e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:22.672281 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-86159e5a-9081-4b04-bb63-750bfbd04b1e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:22.681861 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-86159e5a-9081-4b04-bb63-750bfbd04b1e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:22.687160 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-86159e5a-9081-4b04-bb63-750bfbd04b1e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:22.688551 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-86159e5a-9081-4b04-bb63-750bfbd04b1e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1744 microversion: 2.20 time: 0.337584 Apr 16 21:36:22.692242 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2919/6000] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:36:22 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1744 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:36:23.018320 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-966f6c4e-3093-407c-8a3d-85652bb18549 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:23.018951 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-966f6c4e-3093-407c-8a3d-85652bb18549 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:23.028587 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-966f6c4e-3093-407c-8a3d-85652bb18549 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:23.029677 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-966f6c4e-3093-407c-8a3d-85652bb18549 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:23.030500 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-966f6c4e-3093-407c-8a3d-85652bb18549 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:23.030931 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-966f6c4e-3093-407c-8a3d-85652bb18549 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:23.231169 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-966f6c4e-3093-407c-8a3d-85652bb18549 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:23.252401 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-966f6c4e-3093-407c-8a3d-85652bb18549 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1691 microversion: 2.1 time: 0.238200 Apr 16 21:36:23.253299 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3082/6001] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:36:23 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1691 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:36:23.707619 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-89158c0d-a799-4c96-a97b-1f3946fc7618 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:23.708293 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-89158c0d-a799-4c96-a97b-1f3946fc7618 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:23.724654 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-89158c0d-a799-4c96-a97b-1f3946fc7618 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:23.725487 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-89158c0d-a799-4c96-a97b-1f3946fc7618 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:23.725985 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-89158c0d-a799-4c96-a97b-1f3946fc7618 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:23.726447 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-89158c0d-a799-4c96-a97b-1f3946fc7618 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:23.978782 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-89158c0d-a799-4c96-a97b-1f3946fc7618 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:23.983454 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-89158c0d-a799-4c96-a97b-1f3946fc7618 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:23.985880 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-89158c0d-a799-4c96-a97b-1f3946fc7618 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:23.987459 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-89158c0d-a799-4c96-a97b-1f3946fc7618 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1739 microversion: 2.20 time: 0.283954 Apr 16 21:36:23.988651 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2920/6002] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:36:23 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1739 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:36:24.192672 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-0779d334-df5e-4c22-a4da-dabc53826087 req-2c66d65d-9d91-4018-bd27-6c21d8d83acd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25cb82d7-b342-407d-8f63-71670d8f22d9", "name": "network-vif-plugged", "status": "completed", "tag": "32c60358-6ed6-4d01-a515-c08c9770f288"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:36:24.214745 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-0779d334-df5e-4c22-a4da-dabc53826087 req-2c66d65d-9d91-4018-bd27-6c21d8d83acd service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:24.215208 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-0779d334-df5e-4c22-a4da-dabc53826087 req-2c66d65d-9d91-4018-bd27-6c21d8d83acd service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:24.249985 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-0779d334-df5e-4c22-a4da-dabc53826087 req-2c66d65d-9d91-4018-bd27-6c21d8d83acd service nova] Creating event network-vif-plugged:32c60358-6ed6-4d01-a515-c08c9770f288 for instance 25cb82d7-b342-407d-8f63-71670d8f22d9 on nch1-master-1 Apr 16 21:36:24.261940 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-0779d334-df5e-4c22-a4da-dabc53826087 req-2c66d65d-9d91-4018-bd27-6c21d8d83acd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072821 Apr 16 21:36:24.262566 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3083/6003] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:36:24.272261 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8a8c7c95-48bf-4292-a718-de4fac3f26cd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:24.273150 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8a8c7c95-48bf-4292-a718-de4fac3f26cd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:24.295590 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8a8c7c95-48bf-4292-a718-de4fac3f26cd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:24.296063 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8a8c7c95-48bf-4292-a718-de4fac3f26cd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:24.312241 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8a8c7c95-48bf-4292-a718-de4fac3f26cd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:24.312824 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8a8c7c95-48bf-4292-a718-de4fac3f26cd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:24.798169 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8a8c7c95-48bf-4292-a718-de4fac3f26cd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:24.822053 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8a8c7c95-48bf-4292-a718-de4fac3f26cd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1691 microversion: 2.1 time: 0.555512 Apr 16 21:36:24.823233 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2921/6004] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:36:24 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1691 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:36:25.007956 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fa4d2211-eaae-4a41-9db4-5dc8bb65c592 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:25.008786 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fa4d2211-eaae-4a41-9db4-5dc8bb65c592 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:25.019625 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fa4d2211-eaae-4a41-9db4-5dc8bb65c592 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:25.021731 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fa4d2211-eaae-4a41-9db4-5dc8bb65c592 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:25.024920 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fa4d2211-eaae-4a41-9db4-5dc8bb65c592 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:25.024920 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fa4d2211-eaae-4a41-9db4-5dc8bb65c592 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:25.296219 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fa4d2211-eaae-4a41-9db4-5dc8bb65c592 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:25.317735 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fa4d2211-eaae-4a41-9db4-5dc8bb65c592 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:25.317735 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fa4d2211-eaae-4a41-9db4-5dc8bb65c592 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:25.317735 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fa4d2211-eaae-4a41-9db4-5dc8bb65c592 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1739 microversion: 2.20 time: 0.313873 Apr 16 21:36:25.322492 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3084/6005] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:36:25 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1739 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:36:25.840728 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0106a718-404f-4932-997d-98008c59726a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:25.841367 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0106a718-404f-4932-997d-98008c59726a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:25.852019 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0106a718-404f-4932-997d-98008c59726a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:25.853069 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0106a718-404f-4932-997d-98008c59726a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:25.857035 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0106a718-404f-4932-997d-98008c59726a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:25.859484 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0106a718-404f-4932-997d-98008c59726a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:26.191653 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0106a718-404f-4932-997d-98008c59726a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:26.212365 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0106a718-404f-4932-997d-98008c59726a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1696 microversion: 2.1 time: 0.376367 Apr 16 21:36:26.212966 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2922/6006] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:36:25 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1696 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:36:26.340806 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-92d51cd7-7d9e-4a58-ad10-ca27741f84ca tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:26.341435 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-92d51cd7-7d9e-4a58-ad10-ca27741f84ca tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:26.348296 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-92d51cd7-7d9e-4a58-ad10-ca27741f84ca tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:26.353258 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-92d51cd7-7d9e-4a58-ad10-ca27741f84ca tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:26.353258 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-92d51cd7-7d9e-4a58-ad10-ca27741f84ca tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:26.353258 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-92d51cd7-7d9e-4a58-ad10-ca27741f84ca tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:26.612213 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-92d51cd7-7d9e-4a58-ad10-ca27741f84ca tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:26.621594 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-92d51cd7-7d9e-4a58-ad10-ca27741f84ca tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:26.623319 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-92d51cd7-7d9e-4a58-ad10-ca27741f84ca tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:26.624794 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-92d51cd7-7d9e-4a58-ad10-ca27741f84ca tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1739 microversion: 2.20 time: 0.288206 Apr 16 21:36:26.626621 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3085/6007] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:36:26 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1739 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:36:27.236264 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6dc10594-e2ce-488d-b914-f114a36a7aaf tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:27.237668 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6dc10594-e2ce-488d-b914-f114a36a7aaf tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:27.255146 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6dc10594-e2ce-488d-b914-f114a36a7aaf tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:27.257113 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6dc10594-e2ce-488d-b914-f114a36a7aaf tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:27.261823 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6dc10594-e2ce-488d-b914-f114a36a7aaf tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:27.263162 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6dc10594-e2ce-488d-b914-f114a36a7aaf tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:27.567767 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6dc10594-e2ce-488d-b914-f114a36a7aaf tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:27.578059 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6dc10594-e2ce-488d-b914-f114a36a7aaf tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1696 microversion: 2.1 time: 0.348084 Apr 16 21:36:27.579986 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2923/6008] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:36:27 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1696 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:36:27.648362 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-550ec16d-f74c-47be-817d-9c225e6f615e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:27.662986 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-550ec16d-f74c-47be-817d-9c225e6f615e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:27.682481 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-550ec16d-f74c-47be-817d-9c225e6f615e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:27.682737 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-550ec16d-f74c-47be-817d-9c225e6f615e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:27.683556 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-550ec16d-f74c-47be-817d-9c225e6f615e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:27.684005 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-550ec16d-f74c-47be-817d-9c225e6f615e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:28.263624 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-550ec16d-f74c-47be-817d-9c225e6f615e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:28.271505 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-550ec16d-f74c-47be-817d-9c225e6f615e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:28.273447 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-550ec16d-f74c-47be-817d-9c225e6f615e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:28.275230 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-550ec16d-f74c-47be-817d-9c225e6f615e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1739 microversion: 2.20 time: 0.631509 Apr 16 21:36:28.275803 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3086/6009] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:36:27 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1739 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:36:28.597458 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6b6ffc6f-1d70-4ef9-b43e-15d7d7ba2358 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:28.598021 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6b6ffc6f-1d70-4ef9-b43e-15d7d7ba2358 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:28.605942 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6b6ffc6f-1d70-4ef9-b43e-15d7d7ba2358 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:28.606405 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6b6ffc6f-1d70-4ef9-b43e-15d7d7ba2358 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:28.607204 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6b6ffc6f-1d70-4ef9-b43e-15d7d7ba2358 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:28.607651 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6b6ffc6f-1d70-4ef9-b43e-15d7d7ba2358 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:28.903566 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6b6ffc6f-1d70-4ef9-b43e-15d7d7ba2358 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:28.912030 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6b6ffc6f-1d70-4ef9-b43e-15d7d7ba2358 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1696 microversion: 2.1 time: 0.319301 Apr 16 21:36:28.913317 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2924/6010] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:36:28 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1696 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:36:29.294957 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-32b346b9-bc2f-4f83-ae51-682196a3296d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:29.294957 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-32b346b9-bc2f-4f83-ae51-682196a3296d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:29.306788 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-32b346b9-bc2f-4f83-ae51-682196a3296d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:29.307588 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-32b346b9-bc2f-4f83-ae51-682196a3296d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:29.308677 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-32b346b9-bc2f-4f83-ae51-682196a3296d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:29.309191 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-32b346b9-bc2f-4f83-ae51-682196a3296d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:29.494578 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-32b346b9-bc2f-4f83-ae51-682196a3296d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:29.502887 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-32b346b9-bc2f-4f83-ae51-682196a3296d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:29.504475 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-32b346b9-bc2f-4f83-ae51-682196a3296d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:29.505632 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-32b346b9-bc2f-4f83-ae51-682196a3296d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1739 microversion: 2.20 time: 0.216450 Apr 16 21:36:29.506710 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3087/6011] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:36:29 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1739 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:36:29.931480 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-97589c39-877b-401c-a4eb-4e7d3d094acb tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:29.933265 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-97589c39-877b-401c-a4eb-4e7d3d094acb tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:29.953406 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-97589c39-877b-401c-a4eb-4e7d3d094acb tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:29.953878 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-97589c39-877b-401c-a4eb-4e7d3d094acb tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:29.954685 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-97589c39-877b-401c-a4eb-4e7d3d094acb tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:29.955140 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-97589c39-877b-401c-a4eb-4e7d3d094acb tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:30.205491 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-97589c39-877b-401c-a4eb-4e7d3d094acb tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:30.210831 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-97589c39-877b-401c-a4eb-4e7d3d094acb tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1696 microversion: 2.1 time: 0.284844 Apr 16 21:36:30.211471 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2925/6012] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:36:29 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1696 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:36:30.525955 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a5fa1aec-8569-454d-aac5-cad3c1a41dd6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:30.526570 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a5fa1aec-8569-454d-aac5-cad3c1a41dd6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:30.544440 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a5fa1aec-8569-454d-aac5-cad3c1a41dd6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:30.544440 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a5fa1aec-8569-454d-aac5-cad3c1a41dd6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:30.544440 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a5fa1aec-8569-454d-aac5-cad3c1a41dd6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:30.544822 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a5fa1aec-8569-454d-aac5-cad3c1a41dd6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:30.716876 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a5fa1aec-8569-454d-aac5-cad3c1a41dd6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:30.730383 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a5fa1aec-8569-454d-aac5-cad3c1a41dd6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:30.732200 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a5fa1aec-8569-454d-aac5-cad3c1a41dd6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:30.735676 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a5fa1aec-8569-454d-aac5-cad3c1a41dd6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1739 microversion: 2.20 time: 0.213562 Apr 16 21:36:30.735676 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3088/6013] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:36:30 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1739 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:36:31.230839 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-901c8653-ab51-4a01-acdd-c84c46d6b8ab tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:31.232506 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-901c8653-ab51-4a01-acdd-c84c46d6b8ab tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:31.240394 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-901c8653-ab51-4a01-acdd-c84c46d6b8ab tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:31.250139 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-901c8653-ab51-4a01-acdd-c84c46d6b8ab tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:31.250139 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-901c8653-ab51-4a01-acdd-c84c46d6b8ab tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:31.250139 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-901c8653-ab51-4a01-acdd-c84c46d6b8ab tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:31.422931 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-901c8653-ab51-4a01-acdd-c84c46d6b8ab tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:31.431849 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-901c8653-ab51-4a01-acdd-c84c46d6b8ab tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1696 microversion: 2.1 time: 0.207059 Apr 16 21:36:31.437178 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2926/6014] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:36:31 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1696 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:36:31.757737 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0db16369-0246-4f4c-bab1-5e3f8ca27683 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:31.759197 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0db16369-0246-4f4c-bab1-5e3f8ca27683 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:31.776039 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0db16369-0246-4f4c-bab1-5e3f8ca27683 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:31.776220 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0db16369-0246-4f4c-bab1-5e3f8ca27683 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:31.777003 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0db16369-0246-4f4c-bab1-5e3f8ca27683 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:31.777453 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0db16369-0246-4f4c-bab1-5e3f8ca27683 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:31.997896 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0db16369-0246-4f4c-bab1-5e3f8ca27683 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:31.997896 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0db16369-0246-4f4c-bab1-5e3f8ca27683 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:31.997896 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0db16369-0246-4f4c-bab1-5e3f8ca27683 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:31.997896 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0db16369-0246-4f4c-bab1-5e3f8ca27683 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1739 microversion: 2.20 time: 0.221400 Apr 16 21:36:31.997896 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3089/6015] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:36:31 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1739 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:36:32.452193 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b73417d4-ede0-4e17-94fb-befca7bd456f tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:32.452854 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b73417d4-ede0-4e17-94fb-befca7bd456f tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:32.468954 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b73417d4-ede0-4e17-94fb-befca7bd456f tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:32.469427 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b73417d4-ede0-4e17-94fb-befca7bd456f tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:32.470256 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b73417d4-ede0-4e17-94fb-befca7bd456f tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:32.471069 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b73417d4-ede0-4e17-94fb-befca7bd456f tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:32.753668 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b73417d4-ede0-4e17-94fb-befca7bd456f tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:32.763235 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b73417d4-ede0-4e17-94fb-befca7bd456f tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1696 microversion: 2.1 time: 0.315064 Apr 16 21:36:32.764616 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2927/6016] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:36:32 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1696 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:36:33.017447 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-24e6fc8b-d769-4fb3-8969-8ebd3e5d9837 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:33.020402 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-24e6fc8b-d769-4fb3-8969-8ebd3e5d9837 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:33.029825 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-24e6fc8b-d769-4fb3-8969-8ebd3e5d9837 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:33.030573 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-24e6fc8b-d769-4fb3-8969-8ebd3e5d9837 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:33.031745 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-24e6fc8b-d769-4fb3-8969-8ebd3e5d9837 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:33.032400 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-24e6fc8b-d769-4fb3-8969-8ebd3e5d9837 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:33.290617 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-24e6fc8b-d769-4fb3-8969-8ebd3e5d9837 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:33.309417 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-24e6fc8b-d769-4fb3-8969-8ebd3e5d9837 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:33.311477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-24e6fc8b-d769-4fb3-8969-8ebd3e5d9837 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:33.312746 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-24e6fc8b-d769-4fb3-8969-8ebd3e5d9837 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1739 microversion: 2.20 time: 0.299203 Apr 16 21:36:33.324074 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3090/6017] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:36:33 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1739 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:36:33.783597 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-87f8b2a2-04d7-4f18-aaef-13786f3fa7b5 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:33.784252 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-87f8b2a2-04d7-4f18-aaef-13786f3fa7b5 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:33.792043 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-87f8b2a2-04d7-4f18-aaef-13786f3fa7b5 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:33.792556 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-87f8b2a2-04d7-4f18-aaef-13786f3fa7b5 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:33.793394 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-87f8b2a2-04d7-4f18-aaef-13786f3fa7b5 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:33.793863 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-87f8b2a2-04d7-4f18-aaef-13786f3fa7b5 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:34.040430 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-87f8b2a2-04d7-4f18-aaef-13786f3fa7b5 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:34.048945 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-87f8b2a2-04d7-4f18-aaef-13786f3fa7b5 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1696 microversion: 2.1 time: 0.270754 Apr 16 21:36:34.050217 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2928/6018] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:36:33 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1696 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:36:34.330888 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e047434c-18d7-463e-ac5d-34e60229b5bf tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:34.332066 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e047434c-18d7-463e-ac5d-34e60229b5bf tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:34.342016 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e047434c-18d7-463e-ac5d-34e60229b5bf tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:34.343785 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e047434c-18d7-463e-ac5d-34e60229b5bf tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:34.345348 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e047434c-18d7-463e-ac5d-34e60229b5bf tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:34.345783 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e047434c-18d7-463e-ac5d-34e60229b5bf tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:34.639383 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e047434c-18d7-463e-ac5d-34e60229b5bf tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:34.648638 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e047434c-18d7-463e-ac5d-34e60229b5bf tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:34.650579 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e047434c-18d7-463e-ac5d-34e60229b5bf tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:34.651949 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e047434c-18d7-463e-ac5d-34e60229b5bf tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1739 microversion: 2.20 time: 0.325029 Apr 16 21:36:34.652581 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3091/6019] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:36:34 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1739 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:36:35.072495 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a7dfb6a9-de59-4c59-b248-135cc7035708 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:35.073104 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a7dfb6a9-de59-4c59-b248-135cc7035708 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:35.088521 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a7dfb6a9-de59-4c59-b248-135cc7035708 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:35.088984 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a7dfb6a9-de59-4c59-b248-135cc7035708 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:35.091345 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a7dfb6a9-de59-4c59-b248-135cc7035708 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:35.094342 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a7dfb6a9-de59-4c59-b248-135cc7035708 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:35.391398 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a7dfb6a9-de59-4c59-b248-135cc7035708 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:35.415635 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a7dfb6a9-de59-4c59-b248-135cc7035708 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1696 microversion: 2.1 time: 0.345296 Apr 16 21:36:35.418183 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2929/6020] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:36:35 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1696 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:36:35.670432 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-24c8b9d1-4e6a-470c-a5f6-8f29cfa6e73f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:35.671618 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-24c8b9d1-4e6a-470c-a5f6-8f29cfa6e73f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:35.684114 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-24c8b9d1-4e6a-470c-a5f6-8f29cfa6e73f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:35.685830 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-24c8b9d1-4e6a-470c-a5f6-8f29cfa6e73f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:35.686851 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-24c8b9d1-4e6a-470c-a5f6-8f29cfa6e73f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:35.689216 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-24c8b9d1-4e6a-470c-a5f6-8f29cfa6e73f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:35.910212 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-24c8b9d1-4e6a-470c-a5f6-8f29cfa6e73f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:35.919728 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-24c8b9d1-4e6a-470c-a5f6-8f29cfa6e73f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:35.921320 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-24c8b9d1-4e6a-470c-a5f6-8f29cfa6e73f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:35.922566 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-24c8b9d1-4e6a-470c-a5f6-8f29cfa6e73f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1739 microversion: 2.20 time: 0.256182 Apr 16 21:36:35.923156 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3092/6021] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:36:35 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1739 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:36:36.436382 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-dba45ae5-035f-42f3-b448-f46602c6740d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:36.437017 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-dba45ae5-035f-42f3-b448-f46602c6740d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:36.443932 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dba45ae5-035f-42f3-b448-f46602c6740d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:36.444432 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dba45ae5-035f-42f3-b448-f46602c6740d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:36.446306 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dba45ae5-035f-42f3-b448-f46602c6740d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:36.446836 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dba45ae5-035f-42f3-b448-f46602c6740d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:36.590485 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-dba45ae5-035f-42f3-b448-f46602c6740d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:36.603926 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-dba45ae5-035f-42f3-b448-f46602c6740d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1696 microversion: 2.1 time: 0.171675 Apr 16 21:36:36.607669 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2930/6022] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:36:36 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1696 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:36:36.957040 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0b24f2c5-610c-474a-92d6-66e135095af3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:36.957040 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0b24f2c5-610c-474a-92d6-66e135095af3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:36.957040 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0b24f2c5-610c-474a-92d6-66e135095af3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:36.957040 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0b24f2c5-610c-474a-92d6-66e135095af3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:36.959373 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0b24f2c5-610c-474a-92d6-66e135095af3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:36.960050 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0b24f2c5-610c-474a-92d6-66e135095af3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:37.191680 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0b24f2c5-610c-474a-92d6-66e135095af3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:37.206195 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0b24f2c5-610c-474a-92d6-66e135095af3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:37.211052 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0b24f2c5-610c-474a-92d6-66e135095af3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:37.212497 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0b24f2c5-610c-474a-92d6-66e135095af3 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1739 microversion: 2.20 time: 0.274791 Apr 16 21:36:37.214794 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3093/6023] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:36:36 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1739 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:36:37.623743 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d3e7428d-7c60-49c3-a3b8-90df7b4cbf9e tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:37.624457 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d3e7428d-7c60-49c3-a3b8-90df7b4cbf9e tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:37.633082 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d3e7428d-7c60-49c3-a3b8-90df7b4cbf9e tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:37.633082 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d3e7428d-7c60-49c3-a3b8-90df7b4cbf9e tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:37.633636 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d3e7428d-7c60-49c3-a3b8-90df7b4cbf9e tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:37.634091 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d3e7428d-7c60-49c3-a3b8-90df7b4cbf9e tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:37.885319 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d3e7428d-7c60-49c3-a3b8-90df7b4cbf9e tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:37.895579 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d3e7428d-7c60-49c3-a3b8-90df7b4cbf9e tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1695 microversion: 2.1 time: 0.275858 Apr 16 21:36:37.896352 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2931/6024] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:36:37 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1695 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:36:38.233223 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9b7e68aa-aae0-465f-aea6-12b6ec8e729a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:38.233844 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9b7e68aa-aae0-465f-aea6-12b6ec8e729a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:38.239197 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-48145b0c-2cbf-4633-bbaa-3d636a2cac84 req-2ce9f2a2-eabc-4ea0-ad15-3d4e1ea78967 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69bd9595-c9e9-4d06-af55-ce22d5f09416", "name": "network-vif-unplugged", "status": "completed", "tag": "10dae36f-fbbc-45d6-b539-d8ce65bad3c2"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:36:38.243852 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9b7e68aa-aae0-465f-aea6-12b6ec8e729a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:38.244316 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9b7e68aa-aae0-465f-aea6-12b6ec8e729a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:38.245119 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9b7e68aa-aae0-465f-aea6-12b6ec8e729a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:38.245882 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9b7e68aa-aae0-465f-aea6-12b6ec8e729a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:38.252249 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-48145b0c-2cbf-4633-bbaa-3d636a2cac84 req-2ce9f2a2-eabc-4ea0-ad15-3d4e1ea78967 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:38.252875 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-48145b0c-2cbf-4633-bbaa-3d636a2cac84 req-2ce9f2a2-eabc-4ea0-ad15-3d4e1ea78967 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:38.266026 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-48145b0c-2cbf-4633-bbaa-3d636a2cac84 req-2ce9f2a2-eabc-4ea0-ad15-3d4e1ea78967 service nova] Creating event network-vif-unplugged:10dae36f-fbbc-45d6-b539-d8ce65bad3c2 for instance 69bd9595-c9e9-4d06-af55-ce22d5f09416 on nch1-master-1 Apr 16 21:36:38.273989 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [req-48145b0c-2cbf-4633-bbaa-3d636a2cac84 req-2ce9f2a2-eabc-4ea0-ad15-3d4e1ea78967 service nova] Instance 69bd9595-c9e9-4d06-af55-ce22d5f09416 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137409) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 16 21:36:38.287420 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-48145b0c-2cbf-4633-bbaa-3d636a2cac84 req-2ce9f2a2-eabc-4ea0-ad15-3d4e1ea78967 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053034 Apr 16 21:36:38.289421 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2932/6025] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:36:38.559975 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9b7e68aa-aae0-465f-aea6-12b6ec8e729a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:38.584999 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9b7e68aa-aae0-465f-aea6-12b6ec8e729a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:38.589927 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9b7e68aa-aae0-465f-aea6-12b6ec8e729a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:38.591298 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9b7e68aa-aae0-465f-aea6-12b6ec8e729a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1739 microversion: 2.20 time: 0.362064 Apr 16 21:36:38.592777 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3094/6026] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:36:38 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1739 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:36:38.917766 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0f9331e1-209a-4400-9290-aa76163e9456 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:38.918569 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0f9331e1-209a-4400-9290-aa76163e9456 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:38.927750 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0f9331e1-209a-4400-9290-aa76163e9456 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:38.928694 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0f9331e1-209a-4400-9290-aa76163e9456 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:38.930392 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0f9331e1-209a-4400-9290-aa76163e9456 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:38.931087 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0f9331e1-209a-4400-9290-aa76163e9456 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:39.234993 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0f9331e1-209a-4400-9290-aa76163e9456 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:39.255128 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0f9331e1-209a-4400-9290-aa76163e9456 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1695 microversion: 2.1 time: 0.342404 Apr 16 21:36:39.267446 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2933/6027] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:36:38 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1695 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:36:39.612403 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-eb03f83f-bf34-4887-97f7-e5fc173929e1 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:39.613679 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-eb03f83f-bf34-4887-97f7-e5fc173929e1 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:39.664889 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eb03f83f-bf34-4887-97f7-e5fc173929e1 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:39.665368 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eb03f83f-bf34-4887-97f7-e5fc173929e1 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:39.666199 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eb03f83f-bf34-4887-97f7-e5fc173929e1 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:39.666645 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eb03f83f-bf34-4887-97f7-e5fc173929e1 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:39.870560 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-eb03f83f-bf34-4887-97f7-e5fc173929e1 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:39.882928 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-eb03f83f-bf34-4887-97f7-e5fc173929e1 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:39.885665 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-eb03f83f-bf34-4887-97f7-e5fc173929e1 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:39.887104 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-eb03f83f-bf34-4887-97f7-e5fc173929e1 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1721 microversion: 2.20 time: 0.279525 Apr 16 21:36:39.893713 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3095/6028] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:36:39 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1721 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:36:40.274452 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-72a59791-6112-4525-8da8-03c362c897e5 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:40.275288 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-72a59791-6112-4525-8da8-03c362c897e5 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:40.282405 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-72a59791-6112-4525-8da8-03c362c897e5 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:40.284493 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-72a59791-6112-4525-8da8-03c362c897e5 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:40.284493 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-72a59791-6112-4525-8da8-03c362c897e5 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:40.284493 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-72a59791-6112-4525-8da8-03c362c897e5 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:40.304198 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-1bdecbd7-ec21-42f2-a918-c41f81612443 req-b5379fca-8575-43ed-a481-f765f8347beb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69bd9595-c9e9-4d06-af55-ce22d5f09416", "tag": "10dae36f-fbbc-45d6-b539-d8ce65bad3c2"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:36:40.312519 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-1bdecbd7-ec21-42f2-a918-c41f81612443 req-b5379fca-8575-43ed-a481-f765f8347beb service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:40.313528 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-1bdecbd7-ec21-42f2-a918-c41f81612443 req-b5379fca-8575-43ed-a481-f765f8347beb service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:40.331435 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-1bdecbd7-ec21-42f2-a918-c41f81612443 req-b5379fca-8575-43ed-a481-f765f8347beb service nova] Creating event network-changed:10dae36f-fbbc-45d6-b539-d8ce65bad3c2 for instance 69bd9595-c9e9-4d06-af55-ce22d5f09416 on nch1-master-1 Apr 16 21:36:40.340072 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [req-1bdecbd7-ec21-42f2-a918-c41f81612443 req-b5379fca-8575-43ed-a481-f765f8347beb service nova] Instance 69bd9595-c9e9-4d06-af55-ce22d5f09416 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 16 21:36:40.353084 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-1bdecbd7-ec21-42f2-a918-c41f81612443 req-b5379fca-8575-43ed-a481-f765f8347beb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052482 Apr 16 21:36:40.353855 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3096/6029] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:36:40.463511 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-72a59791-6112-4525-8da8-03c362c897e5 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:40.471521 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-72a59791-6112-4525-8da8-03c362c897e5 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1695 microversion: 2.1 time: 0.201872 Apr 16 21:36:40.472137 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2934/6030] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:36:40 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1695 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:36:40.907825 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-eab78199-fddc-4cd1-9f3b-243a7c89f56f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:40.910622 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-eab78199-fddc-4cd1-9f3b-243a7c89f56f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:40.922681 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eab78199-fddc-4cd1-9f3b-243a7c89f56f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:40.923046 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eab78199-fddc-4cd1-9f3b-243a7c89f56f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:40.923861 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eab78199-fddc-4cd1-9f3b-243a7c89f56f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:40.924515 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eab78199-fddc-4cd1-9f3b-243a7c89f56f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:41.167796 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-eab78199-fddc-4cd1-9f3b-243a7c89f56f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:41.182710 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-eab78199-fddc-4cd1-9f3b-243a7c89f56f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:41.185652 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-eab78199-fddc-4cd1-9f3b-243a7c89f56f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:41.187291 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-eab78199-fddc-4cd1-9f3b-243a7c89f56f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1721 microversion: 2.20 time: 0.284829 Apr 16 21:36:41.188146 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3097/6031] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:36:40 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1721 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:36:41.489656 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-350dbb7c-6388-42c4-afc8-fd0c4b598555 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:41.490651 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-350dbb7c-6388-42c4-afc8-fd0c4b598555 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:41.498400 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-350dbb7c-6388-42c4-afc8-fd0c4b598555 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:41.500115 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-350dbb7c-6388-42c4-afc8-fd0c4b598555 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:41.501139 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-350dbb7c-6388-42c4-afc8-fd0c4b598555 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:41.501917 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-350dbb7c-6388-42c4-afc8-fd0c4b598555 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:41.686730 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-350dbb7c-6388-42c4-afc8-fd0c4b598555 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:41.694469 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-350dbb7c-6388-42c4-afc8-fd0c4b598555 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1695 microversion: 2.1 time: 0.209326 Apr 16 21:36:41.699178 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2935/6032] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:36:41 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1695 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:36:42.124415 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-825016c9-9055-4259-94ef-2a971ee3c57f req-9ed54d28-10a2-4af0-bd02-3134cd1db5dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25cb82d7-b342-407d-8f63-71670d8f22d9", "name": "network-vif-unplugged", "status": "completed", "tag": "32c60358-6ed6-4d01-a515-c08c9770f288"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:36:42.136894 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-825016c9-9055-4259-94ef-2a971ee3c57f req-9ed54d28-10a2-4af0-bd02-3134cd1db5dd service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:42.137343 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-825016c9-9055-4259-94ef-2a971ee3c57f req-9ed54d28-10a2-4af0-bd02-3134cd1db5dd service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:42.149892 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.compute.server_external_events [req-825016c9-9055-4259-94ef-2a971ee3c57f req-9ed54d28-10a2-4af0-bd02-3134cd1db5dd service nova] Unable to find a host for instance 25cb82d7-b342-407d-8f63-71670d8f22d9. Dropping event network-vif-unplugged {{(pid=137408) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Apr 16 21:36:42.150780 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-825016c9-9055-4259-94ef-2a971ee3c57f req-9ed54d28-10a2-4af0-bd02-3134cd1db5dd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030668 Apr 16 21:36:42.151370 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3098/6033] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Apr 16 21:36:42.206317 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e5a93acd-e914-40e4-a030-e50f8772e0a5 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:42.206940 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e5a93acd-e914-40e4-a030-e50f8772e0a5 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:42.213969 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e5a93acd-e914-40e4-a030-e50f8772e0a5 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:42.214429 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e5a93acd-e914-40e4-a030-e50f8772e0a5 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:42.215414 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e5a93acd-e914-40e4-a030-e50f8772e0a5 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:42.215863 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e5a93acd-e914-40e4-a030-e50f8772e0a5 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:42.680205 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e5a93acd-e914-40e4-a030-e50f8772e0a5 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:42.689361 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e5a93acd-e914-40e4-a030-e50f8772e0a5 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:42.691805 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e5a93acd-e914-40e4-a030-e50f8772e0a5 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:42.693253 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e5a93acd-e914-40e4-a030-e50f8772e0a5 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1664 microversion: 2.20 time: 0.491241 Apr 16 21:36:42.693880 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2936/6034] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:36:42 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1664 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:36:42.711753 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c7e5e709-21d1-4a3f-8f85-5d9bf656b118 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:42.711958 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c7e5e709-21d1-4a3f-8f85-5d9bf656b118 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:42.718645 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f4492389-b1e1-4541-a868-46f0ce4c37d9 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b6ddcce-64a6-4813-bff3-73c4e4ef81d6"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:36:42.718822 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c7e5e709-21d1-4a3f-8f85-5d9bf656b118 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:42.719198 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c7e5e709-21d1-4a3f-8f85-5d9bf656b118 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:42.719695 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f4492389-b1e1-4541-a868-46f0ce4c37d9 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:42.719997 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c7e5e709-21d1-4a3f-8f85-5d9bf656b118 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:42.720697 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c7e5e709-21d1-4a3f-8f85-5d9bf656b118 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:42.727814 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f4492389-b1e1-4541-a868-46f0ce4c37d9 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:42.728496 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f4492389-b1e1-4541-a868-46f0ce4c37d9 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:42.734214 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f4492389-b1e1-4541-a868-46f0ce4c37d9 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:42.734214 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f4492389-b1e1-4541-a868-46f0ce4c37d9 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:42.886437 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c7e5e709-21d1-4a3f-8f85-5d9bf656b118 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:42.897862 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c7e5e709-21d1-4a3f-8f85-5d9bf656b118 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1693 microversion: 2.1 time: 0.187279 Apr 16 21:36:42.905323 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3099/6035] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:36:42 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1693 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:36:43.820352 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f4492389-b1e1-4541-a868-46f0ce4c37d9 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "POST /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.102396 Apr 16 21:36:43.820352 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2937/6036] 10.222.0.20 () {62 vars in 1363 bytes} [Sat Apr 16 21:36:42 2022] POST /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9/os-volume_attachments => generated 188 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 16 21:36:43.926013 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-59f2d5fd-344b-404f-bb93-41543147aec5 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:43.929504 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-59f2d5fd-344b-404f-bb93-41543147aec5 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:43.936647 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-756100a7-b8b6-4bbc-8a8b-300babb29717 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:43.937153 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-756100a7-b8b6-4bbc-8a8b-300babb29717 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:43.943394 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-756100a7-b8b6-4bbc-8a8b-300babb29717 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:43.943563 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-59f2d5fd-344b-404f-bb93-41543147aec5 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:43.943891 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-59f2d5fd-344b-404f-bb93-41543147aec5 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:43.944038 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-756100a7-b8b6-4bbc-8a8b-300babb29717 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:43.946102 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-756100a7-b8b6-4bbc-8a8b-300babb29717 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:43.946504 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-756100a7-b8b6-4bbc-8a8b-300babb29717 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:43.948041 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-59f2d5fd-344b-404f-bb93-41543147aec5 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:43.948558 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-59f2d5fd-344b-404f-bb93-41543147aec5 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:44.152795 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-59f2d5fd-344b-404f-bb93-41543147aec5 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:44.168576 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-59f2d5fd-344b-404f-bb93-41543147aec5 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1690 microversion: 2.1 time: 0.247413 Apr 16 21:36:44.181071 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3100/6037] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:36:43 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1690 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:36:44.186853 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cdf7b6f7-2ba7-471f-acf0-be62654713dd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:36:44.187479 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cdf7b6f7-2ba7-471f-acf0-be62654713dd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:44.193986 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cdf7b6f7-2ba7-471f-acf0-be62654713dd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:44.194488 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cdf7b6f7-2ba7-471f-acf0-be62654713dd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:44.195282 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cdf7b6f7-2ba7-471f-acf0-be62654713dd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:44.195918 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cdf7b6f7-2ba7-471f-acf0-be62654713dd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:44.602062 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cdf7b6f7-2ba7-471f-acf0-be62654713dd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "POST /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416/action" status: 202 len: 0 microversion: 2.1 time: 0.419517 Apr 16 21:36:44.602928 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3101/6038] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:36:44 2022] POST /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416/action => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:36:44.611685 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ca215b94-43b9-43eb-b09d-72e28bc92d19 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:44.612539 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ca215b94-43b9-43eb-b09d-72e28bc92d19 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:44.619635 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ca215b94-43b9-43eb-b09d-72e28bc92d19 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:44.625265 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ca215b94-43b9-43eb-b09d-72e28bc92d19 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:44.625265 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ca215b94-43b9-43eb-b09d-72e28bc92d19 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:44.625265 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ca215b94-43b9-43eb-b09d-72e28bc92d19 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:44.731868 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-756100a7-b8b6-4bbc-8a8b-300babb29717 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "DELETE /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9/os-volume_attachments/5b6ddcce-64a6-4813-bff3-73c4e4ef81d6" status: 202 len: 0 microversion: 2.20 time: 0.799193 Apr 16 21:36:44.734626 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2938/6039] 10.222.0.20 () {60 vars in 1456 bytes} [Sat Apr 16 21:36:43 2022] DELETE /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9/os-volume_attachments/5b6ddcce-64a6-4813-bff3-73c4e4ef81d6 => generated 0 bytes in 801 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:36:44.822510 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3cc0adbb-ba30-4c0a-9855-13b1af88352a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:36:44.823297 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3cc0adbb-ba30-4c0a-9855-13b1af88352a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:44.840970 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3cc0adbb-ba30-4c0a-9855-13b1af88352a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:44.841794 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3cc0adbb-ba30-4c0a-9855-13b1af88352a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:44.842806 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3cc0adbb-ba30-4c0a-9855-13b1af88352a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:44.843424 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3cc0adbb-ba30-4c0a-9855-13b1af88352a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:44.866597 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ca215b94-43b9-43eb-b09d-72e28bc92d19 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:44.878217 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ca215b94-43b9-43eb-b09d-72e28bc92d19 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1689 microversion: 2.1 time: 0.270108 Apr 16 21:36:44.878986 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3102/6040] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:36:44 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1689 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:36:45.291382 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3cc0adbb-ba30-4c0a-9855-13b1af88352a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "POST /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9/action" status: 202 len: 0 microversion: 2.20 time: 0.473253 Apr 16 21:36:45.295370 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2939/6041] 10.222.0.20 () {62 vars in 1318 bytes} [Sat Apr 16 21:36:44 2022] POST /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9/action => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 16 21:36:45.303351 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-57e64e3e-de8e-4b1e-b8eb-4e89e8b80811 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:45.303351 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-57e64e3e-de8e-4b1e-b8eb-4e89e8b80811 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:45.311697 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-57e64e3e-de8e-4b1e-b8eb-4e89e8b80811 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:45.312442 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-57e64e3e-de8e-4b1e-b8eb-4e89e8b80811 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:45.313458 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-57e64e3e-de8e-4b1e-b8eb-4e89e8b80811 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:45.314262 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-57e64e3e-de8e-4b1e-b8eb-4e89e8b80811 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:45.511925 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-57e64e3e-de8e-4b1e-b8eb-4e89e8b80811 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:45.528736 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-57e64e3e-de8e-4b1e-b8eb-4e89e8b80811 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:45.532097 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-57e64e3e-de8e-4b1e-b8eb-4e89e8b80811 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:45.534226 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-57e64e3e-de8e-4b1e-b8eb-4e89e8b80811 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1672 microversion: 2.20 time: 0.237002 Apr 16 21:36:45.534226 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3103/6042] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:36:45 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1672 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:36:45.897461 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-48a7b785-9b18-4bb9-86e9-e3325ac0a9cd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:45.903876 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-48a7b785-9b18-4bb9-86e9-e3325ac0a9cd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:45.904649 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-48a7b785-9b18-4bb9-86e9-e3325ac0a9cd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:45.905339 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-48a7b785-9b18-4bb9-86e9-e3325ac0a9cd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:45.906244 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-48a7b785-9b18-4bb9-86e9-e3325ac0a9cd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:45.906767 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-48a7b785-9b18-4bb9-86e9-e3325ac0a9cd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:46.081265 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-48a7b785-9b18-4bb9-86e9-e3325ac0a9cd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:46.089995 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-48a7b785-9b18-4bb9-86e9-e3325ac0a9cd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1689 microversion: 2.1 time: 0.197957 Apr 16 21:36:46.090871 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2940/6043] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:36:45 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1689 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:36:46.266537 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-f9574411-5a32-4e6d-983a-29524135ebe3 req-05128e04-754b-4f92-ba54-52f59624039f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69bd9595-c9e9-4d06-af55-ce22d5f09416", "name": "network-vif-plugged", "status": "completed", "tag": "10dae36f-fbbc-45d6-b539-d8ce65bad3c2"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:36:46.277226 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-f9574411-5a32-4e6d-983a-29524135ebe3 req-05128e04-754b-4f92-ba54-52f59624039f service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:46.277875 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-f9574411-5a32-4e6d-983a-29524135ebe3 req-05128e04-754b-4f92-ba54-52f59624039f service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:46.290816 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-f9574411-5a32-4e6d-983a-29524135ebe3 req-05128e04-754b-4f92-ba54-52f59624039f service nova] Creating event network-vif-plugged:10dae36f-fbbc-45d6-b539-d8ce65bad3c2 for instance 69bd9595-c9e9-4d06-af55-ce22d5f09416 on nch1-master-1 Apr 16 21:36:46.296087 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [req-f9574411-5a32-4e6d-983a-29524135ebe3 req-05128e04-754b-4f92-ba54-52f59624039f service nova] Instance 69bd9595-c9e9-4d06-af55-ce22d5f09416 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 16 21:36:46.307234 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-f9574411-5a32-4e6d-983a-29524135ebe3 req-05128e04-754b-4f92-ba54-52f59624039f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044308 Apr 16 21:36:46.308563 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3104/6044] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:36:46.553010 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ab363e55-3eb4-418d-b50b-839fe4c66de8 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:46.553769 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ab363e55-3eb4-418d-b50b-839fe4c66de8 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:46.560486 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ab363e55-3eb4-418d-b50b-839fe4c66de8 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:46.560999 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ab363e55-3eb4-418d-b50b-839fe4c66de8 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:46.561883 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ab363e55-3eb4-418d-b50b-839fe4c66de8 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:46.562644 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ab363e55-3eb4-418d-b50b-839fe4c66de8 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:46.727159 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ab363e55-3eb4-418d-b50b-839fe4c66de8 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:46.738341 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ab363e55-3eb4-418d-b50b-839fe4c66de8 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:46.740053 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ab363e55-3eb4-418d-b50b-839fe4c66de8 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:46.741620 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ab363e55-3eb4-418d-b50b-839fe4c66de8 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1672 microversion: 2.20 time: 0.192810 Apr 16 21:36:46.743135 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2941/6045] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:36:46 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1672 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:36:47.110594 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8bf01281-9bc2-4557-b4fb-ea048ab12248 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:47.111548 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8bf01281-9bc2-4557-b4fb-ea048ab12248 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:47.118936 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8bf01281-9bc2-4557-b4fb-ea048ab12248 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:47.119522 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8bf01281-9bc2-4557-b4fb-ea048ab12248 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:47.120338 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8bf01281-9bc2-4557-b4fb-ea048ab12248 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:47.120782 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8bf01281-9bc2-4557-b4fb-ea048ab12248 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:47.259989 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8bf01281-9bc2-4557-b4fb-ea048ab12248 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:47.269698 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8bf01281-9bc2-4557-b4fb-ea048ab12248 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1689 microversion: 2.1 time: 0.165232 Apr 16 21:36:47.270279 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3105/6046] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:36:47 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:36:47.763387 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0058b7a3-98e6-4499-a96d-77807f1a32ef tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:47.764065 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0058b7a3-98e6-4499-a96d-77807f1a32ef tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:47.771541 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0058b7a3-98e6-4499-a96d-77807f1a32ef tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:47.772009 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0058b7a3-98e6-4499-a96d-77807f1a32ef tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:47.772863 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0058b7a3-98e6-4499-a96d-77807f1a32ef tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:47.774065 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0058b7a3-98e6-4499-a96d-77807f1a32ef tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:47.911343 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0058b7a3-98e6-4499-a96d-77807f1a32ef tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:47.920539 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0058b7a3-98e6-4499-a96d-77807f1a32ef tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:47.922086 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0058b7a3-98e6-4499-a96d-77807f1a32ef tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:47.923358 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0058b7a3-98e6-4499-a96d-77807f1a32ef tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1730 microversion: 2.20 time: 0.165204 Apr 16 21:36:47.924149 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2942/6047] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:36:47 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:36:48.287817 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-de357072-883a-482a-a765-4c1bed1aabf2 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:48.289222 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-de357072-883a-482a-a765-4c1bed1aabf2 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:48.295929 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-de357072-883a-482a-a765-4c1bed1aabf2 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:48.296435 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-de357072-883a-482a-a765-4c1bed1aabf2 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:48.297332 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-de357072-883a-482a-a765-4c1bed1aabf2 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:48.297786 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-de357072-883a-482a-a765-4c1bed1aabf2 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:48.593660 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-de357072-883a-482a-a765-4c1bed1aabf2 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:48.601086 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-de357072-883a-482a-a765-4c1bed1aabf2 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1689 microversion: 2.1 time: 0.318016 Apr 16 21:36:48.602203 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3106/6048] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:36:48 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1689 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:36:48.693858 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-fff872e3-59d0-4b65-a40b-8227c1d1b75d req-1714c639-ddce-4ee2-8b78-f8e2006e39c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69bd9595-c9e9-4d06-af55-ce22d5f09416", "name": "network-vif-unplugged", "status": "completed", "tag": "10dae36f-fbbc-45d6-b539-d8ce65bad3c2"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:36:48.702327 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-fff872e3-59d0-4b65-a40b-8227c1d1b75d req-1714c639-ddce-4ee2-8b78-f8e2006e39c3 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:48.702732 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-fff872e3-59d0-4b65-a40b-8227c1d1b75d req-1714c639-ddce-4ee2-8b78-f8e2006e39c3 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:48.714775 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-fff872e3-59d0-4b65-a40b-8227c1d1b75d req-1714c639-ddce-4ee2-8b78-f8e2006e39c3 service nova] Creating event network-vif-unplugged:10dae36f-fbbc-45d6-b539-d8ce65bad3c2 for instance 69bd9595-c9e9-4d06-af55-ce22d5f09416 on nch2-master-1 Apr 16 21:36:48.720470 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [req-fff872e3-59d0-4b65-a40b-8227c1d1b75d req-1714c639-ddce-4ee2-8b78-f8e2006e39c3 service nova] Instance 69bd9595-c9e9-4d06-af55-ce22d5f09416 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137409) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 16 21:36:48.732969 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-fff872e3-59d0-4b65-a40b-8227c1d1b75d req-1714c639-ddce-4ee2-8b78-f8e2006e39c3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055023 Apr 16 21:36:48.733585 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2943/6049] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:36:48.962073 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-5ef6ea75-7375-4d6e-a5c3-3242854ad170 req-83c6d403-018e-4554-8eb8-78ac28d79d2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25cb82d7-b342-407d-8f63-71670d8f22d9", "tag": "32c60358-6ed6-4d01-a515-c08c9770f288"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:36:48.966513 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-23936cc5-1c54-4a9d-b4aa-f5a762ff87c8 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:48.967442 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-23936cc5-1c54-4a9d-b4aa-f5a762ff87c8 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:48.976995 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-23936cc5-1c54-4a9d-b4aa-f5a762ff87c8 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:48.977664 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-23936cc5-1c54-4a9d-b4aa-f5a762ff87c8 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:48.986935 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-23936cc5-1c54-4a9d-b4aa-f5a762ff87c8 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:48.987773 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-23936cc5-1c54-4a9d-b4aa-f5a762ff87c8 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:49.003420 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-5ef6ea75-7375-4d6e-a5c3-3242854ad170 req-83c6d403-018e-4554-8eb8-78ac28d79d2b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:49.004357 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-5ef6ea75-7375-4d6e-a5c3-3242854ad170 req-83c6d403-018e-4554-8eb8-78ac28d79d2b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:49.025467 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-5ef6ea75-7375-4d6e-a5c3-3242854ad170 req-83c6d403-018e-4554-8eb8-78ac28d79d2b service nova] Creating event network-changed:32c60358-6ed6-4d01-a515-c08c9770f288 for instance 25cb82d7-b342-407d-8f63-71670d8f22d9 on nch2-master-1 Apr 16 21:36:49.040760 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-5ef6ea75-7375-4d6e-a5c3-3242854ad170 req-83c6d403-018e-4554-8eb8-78ac28d79d2b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087465 Apr 16 21:36:49.042234 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2944/6050] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:36:49.405119 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-23936cc5-1c54-4a9d-b4aa-f5a762ff87c8 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:49.413157 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-23936cc5-1c54-4a9d-b4aa-f5a762ff87c8 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:49.415667 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-23936cc5-1c54-4a9d-b4aa-f5a762ff87c8 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:49.417331 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-23936cc5-1c54-4a9d-b4aa-f5a762ff87c8 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1730 microversion: 2.20 time: 0.473742 Apr 16 21:36:49.417904 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3107/6051] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:36:48 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1730 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:36:49.619863 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a8f95254-f8cb-4c1a-a819-a8b16bb4d472 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:49.621092 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a8f95254-f8cb-4c1a-a819-a8b16bb4d472 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:49.627919 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a8f95254-f8cb-4c1a-a819-a8b16bb4d472 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:49.628735 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a8f95254-f8cb-4c1a-a819-a8b16bb4d472 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:49.629880 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a8f95254-f8cb-4c1a-a819-a8b16bb4d472 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:49.630567 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a8f95254-f8cb-4c1a-a819-a8b16bb4d472 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:49.890837 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a8f95254-f8cb-4c1a-a819-a8b16bb4d472 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:49.899128 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a8f95254-f8cb-4c1a-a819-a8b16bb4d472 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1689 microversion: 2.1 time: 0.283436 Apr 16 21:36:49.899646 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2945/6052] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:36:49 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1689 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:36:50.441052 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cde042a1-c3f8-46aa-be8f-cb664af85c90 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:50.441721 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cde042a1-c3f8-46aa-be8f-cb664af85c90 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:50.450899 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cde042a1-c3f8-46aa-be8f-cb664af85c90 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:50.451741 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cde042a1-c3f8-46aa-be8f-cb664af85c90 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:50.452752 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cde042a1-c3f8-46aa-be8f-cb664af85c90 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:50.453586 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cde042a1-c3f8-46aa-be8f-cb664af85c90 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:50.604072 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cde042a1-c3f8-46aa-be8f-cb664af85c90 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:50.612596 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cde042a1-c3f8-46aa-be8f-cb664af85c90 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:50.614133 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cde042a1-c3f8-46aa-be8f-cb664af85c90 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:50.615310 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cde042a1-c3f8-46aa-be8f-cb664af85c90 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1730 microversion: 2.20 time: 0.178730 Apr 16 21:36:50.615886 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3108/6053] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:36:50 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:36:50.747585 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-543c8679-196b-4487-84e3-0e506554a160 req-39968083-ba9a-4ca3-ae73-c130c6c60684 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69bd9595-c9e9-4d06-af55-ce22d5f09416", "tag": "10dae36f-fbbc-45d6-b539-d8ce65bad3c2"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:36:50.756275 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-543c8679-196b-4487-84e3-0e506554a160 req-39968083-ba9a-4ca3-ae73-c130c6c60684 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:50.756893 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-543c8679-196b-4487-84e3-0e506554a160 req-39968083-ba9a-4ca3-ae73-c130c6c60684 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:50.769141 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-543c8679-196b-4487-84e3-0e506554a160 req-39968083-ba9a-4ca3-ae73-c130c6c60684 service nova] Creating event network-changed:10dae36f-fbbc-45d6-b539-d8ce65bad3c2 for instance 69bd9595-c9e9-4d06-af55-ce22d5f09416 on nch2-master-1 Apr 16 21:36:50.774993 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [req-543c8679-196b-4487-84e3-0e506554a160 req-39968083-ba9a-4ca3-ae73-c130c6c60684 service nova] Instance 69bd9595-c9e9-4d06-af55-ce22d5f09416 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137409) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 16 21:36:50.787640 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-543c8679-196b-4487-84e3-0e506554a160 req-39968083-ba9a-4ca3-ae73-c130c6c60684 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043632 Apr 16 21:36:50.788298 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2946/6054] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:36:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:36:50.919937 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-09e772fe-91c3-444a-a233-3d62100b51ac tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:50.920611 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-09e772fe-91c3-444a-a233-3d62100b51ac tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:50.927138 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-09e772fe-91c3-444a-a233-3d62100b51ac tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:50.927741 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-09e772fe-91c3-444a-a233-3d62100b51ac tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:50.928719 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-09e772fe-91c3-444a-a233-3d62100b51ac tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:50.929316 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-09e772fe-91c3-444a-a233-3d62100b51ac tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:51.090345 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-09e772fe-91c3-444a-a233-3d62100b51ac tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:51.101888 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-09e772fe-91c3-444a-a233-3d62100b51ac tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1689 microversion: 2.1 time: 0.183079 Apr 16 21:36:51.101888 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3109/6055] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:36:50 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1689 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:36:51.635310 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-782102df-2194-4968-9b4b-fc95883b0283 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:51.635947 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-782102df-2194-4968-9b4b-fc95883b0283 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:51.642001 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-782102df-2194-4968-9b4b-fc95883b0283 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:51.642467 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-782102df-2194-4968-9b4b-fc95883b0283 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:51.643296 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-782102df-2194-4968-9b4b-fc95883b0283 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:51.643745 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-782102df-2194-4968-9b4b-fc95883b0283 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:51.791831 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-782102df-2194-4968-9b4b-fc95883b0283 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:51.800676 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-782102df-2194-4968-9b4b-fc95883b0283 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:51.802661 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-782102df-2194-4968-9b4b-fc95883b0283 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:51.803996 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-782102df-2194-4968-9b4b-fc95883b0283 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1730 microversion: 2.20 time: 0.173590 Apr 16 21:36:51.815018 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2947/6056] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:36:51 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:36:52.116965 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5f541186-7a22-42cb-a4ba-62b68b5a3f40 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:52.118781 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5f541186-7a22-42cb-a4ba-62b68b5a3f40 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:52.126042 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5f541186-7a22-42cb-a4ba-62b68b5a3f40 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:52.126615 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5f541186-7a22-42cb-a4ba-62b68b5a3f40 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:52.127672 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5f541186-7a22-42cb-a4ba-62b68b5a3f40 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:52.128496 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5f541186-7a22-42cb-a4ba-62b68b5a3f40 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:52.332025 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5f541186-7a22-42cb-a4ba-62b68b5a3f40 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:52.339862 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5f541186-7a22-42cb-a4ba-62b68b5a3f40 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1689 microversion: 2.1 time: 0.222144 Apr 16 21:36:52.339862 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3110/6057] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:36:52 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1689 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:36:52.824662 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5def412f-5e30-429f-b9e6-e31152de589d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:52.829865 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5def412f-5e30-429f-b9e6-e31152de589d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:52.839934 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5def412f-5e30-429f-b9e6-e31152de589d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:52.841889 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5def412f-5e30-429f-b9e6-e31152de589d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:52.843324 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5def412f-5e30-429f-b9e6-e31152de589d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:52.844891 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5def412f-5e30-429f-b9e6-e31152de589d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:53.022232 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5def412f-5e30-429f-b9e6-e31152de589d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:53.038008 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5def412f-5e30-429f-b9e6-e31152de589d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:53.039550 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5def412f-5e30-429f-b9e6-e31152de589d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:53.041468 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5def412f-5e30-429f-b9e6-e31152de589d tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1730 microversion: 2.20 time: 0.222754 Apr 16 21:36:53.053009 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2948/6058] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:36:52 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1730 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:36:53.355514 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8205b5fd-0a60-4a92-9aac-6bff7ed6121b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:53.375475 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8205b5fd-0a60-4a92-9aac-6bff7ed6121b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:53.396107 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8205b5fd-0a60-4a92-9aac-6bff7ed6121b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:53.398053 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8205b5fd-0a60-4a92-9aac-6bff7ed6121b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:53.400674 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8205b5fd-0a60-4a92-9aac-6bff7ed6121b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:53.401134 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8205b5fd-0a60-4a92-9aac-6bff7ed6121b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:53.613838 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8205b5fd-0a60-4a92-9aac-6bff7ed6121b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:53.628497 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8205b5fd-0a60-4a92-9aac-6bff7ed6121b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1689 microversion: 2.1 time: 0.276858 Apr 16 21:36:53.629944 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3111/6059] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:36:53 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1689 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:36:54.067465 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2ed1f5b8-95bc-4120-a36e-84b9e7ef0058 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:54.067465 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2ed1f5b8-95bc-4120-a36e-84b9e7ef0058 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:54.086816 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2ed1f5b8-95bc-4120-a36e-84b9e7ef0058 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:54.088261 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2ed1f5b8-95bc-4120-a36e-84b9e7ef0058 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:54.095223 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2ed1f5b8-95bc-4120-a36e-84b9e7ef0058 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:54.095824 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2ed1f5b8-95bc-4120-a36e-84b9e7ef0058 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:54.554795 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2ed1f5b8-95bc-4120-a36e-84b9e7ef0058 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:54.565347 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2ed1f5b8-95bc-4120-a36e-84b9e7ef0058 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:54.568851 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2ed1f5b8-95bc-4120-a36e-84b9e7ef0058 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:54.571086 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2ed1f5b8-95bc-4120-a36e-84b9e7ef0058 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1730 microversion: 2.20 time: 0.514962 Apr 16 21:36:54.572936 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2949/6060] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:36:54 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1730 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:36:54.657032 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e108323e-b527-4d58-b55c-2efc283a0122 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:54.658278 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e108323e-b527-4d58-b55c-2efc283a0122 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:54.668923 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e108323e-b527-4d58-b55c-2efc283a0122 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:54.670019 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e108323e-b527-4d58-b55c-2efc283a0122 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:54.671139 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e108323e-b527-4d58-b55c-2efc283a0122 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:54.671793 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e108323e-b527-4d58-b55c-2efc283a0122 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:54.929972 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e108323e-b527-4d58-b55c-2efc283a0122 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:54.943261 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e108323e-b527-4d58-b55c-2efc283a0122 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1682 microversion: 2.1 time: 0.291551 Apr 16 21:36:54.943730 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3112/6061] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:36:54 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1682 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:36:55.599219 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3df64c46-cf1d-43b2-a0b5-4c4ddf6c7488 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:55.600692 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3df64c46-cf1d-43b2-a0b5-4c4ddf6c7488 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:55.609977 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3df64c46-cf1d-43b2-a0b5-4c4ddf6c7488 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:55.610934 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3df64c46-cf1d-43b2-a0b5-4c4ddf6c7488 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:55.612205 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3df64c46-cf1d-43b2-a0b5-4c4ddf6c7488 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:55.613040 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3df64c46-cf1d-43b2-a0b5-4c4ddf6c7488 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:55.848010 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3df64c46-cf1d-43b2-a0b5-4c4ddf6c7488 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:55.862370 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3df64c46-cf1d-43b2-a0b5-4c4ddf6c7488 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:55.876072 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3df64c46-cf1d-43b2-a0b5-4c4ddf6c7488 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:55.877461 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3df64c46-cf1d-43b2-a0b5-4c4ddf6c7488 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1730 microversion: 2.20 time: 0.287317 Apr 16 21:36:55.883153 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2950/6062] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:36:55 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1730 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:36:56.915222 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-43e3e2db-0af9-4eb3-ad36-f9c8c3240f0f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:56.917717 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-43e3e2db-0af9-4eb3-ad36-f9c8c3240f0f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:56.929040 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-43e3e2db-0af9-4eb3-ad36-f9c8c3240f0f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:56.929821 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-43e3e2db-0af9-4eb3-ad36-f9c8c3240f0f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:56.932560 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-43e3e2db-0af9-4eb3-ad36-f9c8c3240f0f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:56.933255 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-43e3e2db-0af9-4eb3-ad36-f9c8c3240f0f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:57.215933 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-43e3e2db-0af9-4eb3-ad36-f9c8c3240f0f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:57.232233 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-43e3e2db-0af9-4eb3-ad36-f9c8c3240f0f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:57.237103 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-43e3e2db-0af9-4eb3-ad36-f9c8c3240f0f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:57.238786 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-43e3e2db-0af9-4eb3-ad36-f9c8c3240f0f tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1730 microversion: 2.20 time: 0.337630 Apr 16 21:36:57.251980 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3113/6063] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:36:56 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1730 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:36:57.338704 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-3143f70b-b789-45d5-9419-06c828e6160b req-61a80a05-7ab6-433f-b78d-f86d7e0a188b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69bd9595-c9e9-4d06-af55-ce22d5f09416", "name": "network-vif-plugged", "status": "completed", "tag": "10dae36f-fbbc-45d6-b539-d8ce65bad3c2"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:36:57.353983 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-3143f70b-b789-45d5-9419-06c828e6160b req-61a80a05-7ab6-433f-b78d-f86d7e0a188b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:57.354520 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-3143f70b-b789-45d5-9419-06c828e6160b req-61a80a05-7ab6-433f-b78d-f86d7e0a188b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:57.380035 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-3143f70b-b789-45d5-9419-06c828e6160b req-61a80a05-7ab6-433f-b78d-f86d7e0a188b service nova] Creating event network-vif-plugged:10dae36f-fbbc-45d6-b539-d8ce65bad3c2 for instance 69bd9595-c9e9-4d06-af55-ce22d5f09416 on nch2-master-1 Apr 16 21:36:57.388929 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-3143f70b-b789-45d5-9419-06c828e6160b req-61a80a05-7ab6-433f-b78d-f86d7e0a188b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053864 Apr 16 21:36:57.390303 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2951/6064] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:36:57.934861 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-45484226-a4a3-488e-a980-9bed975ac211 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1529480119", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:36:58.004633 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-45484226-a4a3-488e-a980-9bed975ac211 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] validate_networks() for None {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:36:58.263487 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f598fbc0-d7cc-4f90-ab56-241cb4322167 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:58.264261 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f598fbc0-d7cc-4f90-ab56-241cb4322167 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:58.276753 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f598fbc0-d7cc-4f90-ab56-241cb4322167 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:58.278095 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f598fbc0-d7cc-4f90-ab56-241cb4322167 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:58.282588 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f598fbc0-d7cc-4f90-ab56-241cb4322167 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:58.283262 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f598fbc0-d7cc-4f90-ab56-241cb4322167 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:58.425209 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-45484226-a4a3-488e-a980-9bed975ac211 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:36:58.426151 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-45484226-a4a3-488e-a980-9bed975ac211 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:36:58.426884 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-45484226-a4a3-488e-a980-9bed975ac211 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:36:58.427573 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-45484226-a4a3-488e-a980-9bed975ac211 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:36:58.428421 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-45484226-a4a3-488e-a980-9bed975ac211 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:36:58.737703 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-45484226-a4a3-488e-a980-9bed975ac211 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:58.737703 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-45484226-a4a3-488e-a980-9bed975ac211 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:58.737703 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-45484226-a4a3-488e-a980-9bed975ac211 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:58.737703 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-45484226-a4a3-488e-a980-9bed975ac211 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:58.737703 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-45484226-a4a3-488e-a980-9bed975ac211 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Getting quotas for project d51b576f9c0241c1a254f15308a455ec. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:36:58.737703 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-45484226-a4a3-488e-a980-9bed975ac211 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Getting quotas for user 77f61ccbf5114e6080e33f0c5f500468 and project d51b576f9c0241c1a254f15308a455ec. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:36:58.737703 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-45484226-a4a3-488e-a980-9bed975ac211 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:36:58.737703 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-45484226-a4a3-488e-a980-9bed975ac211 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] [instance: d88536ad-512b-4504-9b3b-737f9c497ce8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:36:58.745644 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f598fbc0-d7cc-4f90-ab56-241cb4322167 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:58.745644 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f598fbc0-d7cc-4f90-ab56-241cb4322167 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:58.745644 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f598fbc0-d7cc-4f90-ab56-241cb4322167 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:58.745644 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f598fbc0-d7cc-4f90-ab56-241cb4322167 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1730 microversion: 2.20 time: 0.357496 Apr 16 21:36:58.745644 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2952/6065] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:36:58 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1730 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:36:58.747447 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-45484226-a4a3-488e-a980-9bed975ac211 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.720700 Apr 16 21:36:58.747447 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3114/6066] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:36:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:36:58.747599 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f2ea93d1-5f78-4292-b832-db109330e5db tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:58.747599 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f2ea93d1-5f78-4292-b832-db109330e5db tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] [instance: d88536ad-512b-4504-9b3b-737f9c497ce8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:58.823111 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f2ea93d1-5f78-4292-b832-db109330e5db tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f61ccbf5114e6080e33f0c5f500468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51b576f9c0241c1a254f15308a455ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:58.835077 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f2ea93d1-5f78-4292-b832-db109330e5db tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] 10.222.0.20 "GET /compute/v2.1/servers/d88536ad-512b-4504-9b3b-737f9c497ce8" status: 200 len: 1214 microversion: 2.1 time: 0.175356 Apr 16 21:36:58.842052 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2953/6067] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:36:58 2022] GET /compute/v2.1/servers/d88536ad-512b-4504-9b3b-737f9c497ce8 => generated 1214 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:36:59.633824 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-dbafd527-2448-4f43-9539-d795bc83d21c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:59.634630 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-dbafd527-2448-4f43-9539-d795bc83d21c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:59.641728 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dbafd527-2448-4f43-9539-d795bc83d21c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:59.642190 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dbafd527-2448-4f43-9539-d795bc83d21c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:59.643148 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dbafd527-2448-4f43-9539-d795bc83d21c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:36:59.643595 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dbafd527-2448-4f43-9539-d795bc83d21c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:36:59.831214 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-dbafd527-2448-4f43-9539-d795bc83d21c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:59.844859 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-dbafd527-2448-4f43-9539-d795bc83d21c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:59.854020 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-dbafd527-2448-4f43-9539-d795bc83d21c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:59.854745 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-dbafd527-2448-4f43-9539-d795bc83d21c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1730 microversion: 2.20 time: 0.225821 Apr 16 21:36:59.855117 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-16cdbf7e-f696-4b98-87ce-5673cb2b5fb2 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:36:59.855755 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-16cdbf7e-f696-4b98-87ce-5673cb2b5fb2 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] [instance: d88536ad-512b-4504-9b3b-737f9c497ce8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:36:59.859934 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3115/6068] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:36:59 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1730 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:36:59.933640 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-16cdbf7e-f696-4b98-87ce-5673cb2b5fb2 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f61ccbf5114e6080e33f0c5f500468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51b576f9c0241c1a254f15308a455ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:36:59.941757 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-16cdbf7e-f696-4b98-87ce-5673cb2b5fb2 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] 10.222.0.20 "GET /compute/v2.1/servers/d88536ad-512b-4504-9b3b-737f9c497ce8" status: 200 len: 1214 microversion: 2.1 time: 0.092290 Apr 16 21:36:59.942340 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2954/6069] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:36:59 2022] GET /compute/v2.1/servers/d88536ad-512b-4504-9b3b-737f9c497ce8 => generated 1214 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:37:00.878218 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-dad8bebb-aa3e-4064-803d-3a492cfd3097 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:37:00.879798 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-dad8bebb-aa3e-4064-803d-3a492cfd3097 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:37:00.905801 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dad8bebb-aa3e-4064-803d-3a492cfd3097 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:00.906578 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dad8bebb-aa3e-4064-803d-3a492cfd3097 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:00.907444 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dad8bebb-aa3e-4064-803d-3a492cfd3097 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:00.907957 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dad8bebb-aa3e-4064-803d-3a492cfd3097 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:00.959148 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-105b0338-8fdd-46b3-a50d-62a4a79ba240 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:37:00.964162 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-105b0338-8fdd-46b3-a50d-62a4a79ba240 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] [instance: d88536ad-512b-4504-9b3b-737f9c497ce8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:37:00.972139 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-105b0338-8fdd-46b3-a50d-62a4a79ba240 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:00.977585 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-105b0338-8fdd-46b3-a50d-62a4a79ba240 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:00.980137 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-105b0338-8fdd-46b3-a50d-62a4a79ba240 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:00.982585 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-105b0338-8fdd-46b3-a50d-62a4a79ba240 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:01.099654 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-105b0338-8fdd-46b3-a50d-62a4a79ba240 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f61ccbf5114e6080e33f0c5f500468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51b576f9c0241c1a254f15308a455ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:01.107717 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-105b0338-8fdd-46b3-a50d-62a4a79ba240 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] 10.222.0.20 "GET /compute/v2.1/servers/d88536ad-512b-4504-9b3b-737f9c497ce8" status: 200 len: 1210 microversion: 2.1 time: 0.152369 Apr 16 21:37:01.115763 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2955/6070] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:37:00 2022] GET /compute/v2.1/servers/d88536ad-512b-4504-9b3b-737f9c497ce8 => generated 1210 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:37:01.225164 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-dad8bebb-aa3e-4064-803d-3a492cfd3097 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:01.237963 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-dad8bebb-aa3e-4064-803d-3a492cfd3097 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:01.239829 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-dad8bebb-aa3e-4064-803d-3a492cfd3097 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:01.241155 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-dad8bebb-aa3e-4064-803d-3a492cfd3097 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1730 microversion: 2.20 time: 0.371533 Apr 16 21:37:01.253575 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3116/6071] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:37:00 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1730 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:37:02.137209 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7e01e6c4-c51e-4289-a1bf-fd5030be74cb tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:37:02.137809 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7e01e6c4-c51e-4289-a1bf-fd5030be74cb tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] [instance: d88536ad-512b-4504-9b3b-737f9c497ce8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:37:02.145734 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7e01e6c4-c51e-4289-a1bf-fd5030be74cb tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:02.146274 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7e01e6c4-c51e-4289-a1bf-fd5030be74cb tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:02.148535 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7e01e6c4-c51e-4289-a1bf-fd5030be74cb tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:02.148535 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7e01e6c4-c51e-4289-a1bf-fd5030be74cb tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:02.218810 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7e01e6c4-c51e-4289-a1bf-fd5030be74cb tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f61ccbf5114e6080e33f0c5f500468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51b576f9c0241c1a254f15308a455ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:02.226249 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7e01e6c4-c51e-4289-a1bf-fd5030be74cb tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] 10.222.0.20 "GET /compute/v2.1/servers/d88536ad-512b-4504-9b3b-737f9c497ce8" status: 200 len: 1272 microversion: 2.1 time: 0.094104 Apr 16 21:37:02.226850 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2956/6072] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:37:02 2022] GET /compute/v2.1/servers/d88536ad-512b-4504-9b3b-737f9c497ce8 => generated 1272 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:37:02.262934 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-77330225-1e6e-4a50-931f-0e9f28e84364 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:37:02.263827 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-77330225-1e6e-4a50-931f-0e9f28e84364 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:37:02.271881 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-77330225-1e6e-4a50-931f-0e9f28e84364 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:02.272450 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-77330225-1e6e-4a50-931f-0e9f28e84364 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:02.273366 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-77330225-1e6e-4a50-931f-0e9f28e84364 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:02.274740 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-77330225-1e6e-4a50-931f-0e9f28e84364 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:02.430592 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-77330225-1e6e-4a50-931f-0e9f28e84364 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:02.441880 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-77330225-1e6e-4a50-931f-0e9f28e84364 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:02.447743 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-77330225-1e6e-4a50-931f-0e9f28e84364 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:02.447743 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-77330225-1e6e-4a50-931f-0e9f28e84364 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1730 microversion: 2.20 time: 0.185667 Apr 16 21:37:02.447743 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3117/6073] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:37:02 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1730 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:37:03.248471 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-da576170-7863-4ab0-a2f4-bef21e882b37 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:37:03.249416 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-da576170-7863-4ab0-a2f4-bef21e882b37 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] [instance: d88536ad-512b-4504-9b3b-737f9c497ce8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:37:03.257413 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-da576170-7863-4ab0-a2f4-bef21e882b37 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:03.257910 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-da576170-7863-4ab0-a2f4-bef21e882b37 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:03.258720 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-da576170-7863-4ab0-a2f4-bef21e882b37 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:03.259332 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-da576170-7863-4ab0-a2f4-bef21e882b37 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:03.471086 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8fbf256b-c5b5-42a5-aed8-78b84ce4b359 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:37:03.472686 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8fbf256b-c5b5-42a5-aed8-78b84ce4b359 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:37:03.483747 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8fbf256b-c5b5-42a5-aed8-78b84ce4b359 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:03.483747 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8fbf256b-c5b5-42a5-aed8-78b84ce4b359 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:03.484141 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8fbf256b-c5b5-42a5-aed8-78b84ce4b359 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:03.484721 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8fbf256b-c5b5-42a5-aed8-78b84ce4b359 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:03.599821 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-da576170-7863-4ab0-a2f4-bef21e882b37 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f61ccbf5114e6080e33f0c5f500468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51b576f9c0241c1a254f15308a455ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:03.614107 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-da576170-7863-4ab0-a2f4-bef21e882b37 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] 10.222.0.20 "GET /compute/v2.1/servers/d88536ad-512b-4504-9b3b-737f9c497ce8" status: 200 len: 1314 microversion: 2.1 time: 0.369657 Apr 16 21:37:03.624106 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2957/6074] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:37:03 2022] GET /compute/v2.1/servers/d88536ad-512b-4504-9b3b-737f9c497ce8 => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:37:03.661244 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8fbf256b-c5b5-42a5-aed8-78b84ce4b359 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:03.669694 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8fbf256b-c5b5-42a5-aed8-78b84ce4b359 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:03.671367 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8fbf256b-c5b5-42a5-aed8-78b84ce4b359 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:03.672705 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8fbf256b-c5b5-42a5-aed8-78b84ce4b359 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1730 microversion: 2.20 time: 0.209519 Apr 16 21:37:03.673500 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3118/6075] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:37:03 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1730 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:37:04.275743 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-bd91bd62-8318-46c5-b6e7-5f6f9e704e23 req-969c22b8-0e53-4f3e-a9cc-df58c82be5e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d88536ad-512b-4504-9b3b-737f9c497ce8", "tag": "cb189c5d-c71a-432e-a46a-5c28238c6554"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:37:04.294090 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-bd91bd62-8318-46c5-b6e7-5f6f9e704e23 req-969c22b8-0e53-4f3e-a9cc-df58c82be5e0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:04.302209 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-bd91bd62-8318-46c5-b6e7-5f6f9e704e23 req-969c22b8-0e53-4f3e-a9cc-df58c82be5e0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:04.317252 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-bd91bd62-8318-46c5-b6e7-5f6f9e704e23 req-969c22b8-0e53-4f3e-a9cc-df58c82be5e0 service nova] Creating event network-changed:cb189c5d-c71a-432e-a46a-5c28238c6554 for instance d88536ad-512b-4504-9b3b-737f9c497ce8 on nch1-master-1 Apr 16 21:37:04.323636 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-bd91bd62-8318-46c5-b6e7-5f6f9e704e23 req-969c22b8-0e53-4f3e-a9cc-df58c82be5e0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058279 Apr 16 21:37:04.327492 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2958/6076] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:37:04.630933 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-208d3f9b-e823-4250-a77d-2fc4fc118458 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:37:04.631560 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-208d3f9b-e823-4250-a77d-2fc4fc118458 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] [instance: d88536ad-512b-4504-9b3b-737f9c497ce8] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:37:04.640972 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-208d3f9b-e823-4250-a77d-2fc4fc118458 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:04.641508 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-208d3f9b-e823-4250-a77d-2fc4fc118458 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:04.648915 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-208d3f9b-e823-4250-a77d-2fc4fc118458 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:04.648915 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-208d3f9b-e823-4250-a77d-2fc4fc118458 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:04.694506 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3de27d82-4fdb-44a2-bf81-f5ddcdfc70a4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:37:04.700873 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3de27d82-4fdb-44a2-bf81-f5ddcdfc70a4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:37:04.706509 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3de27d82-4fdb-44a2-bf81-f5ddcdfc70a4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:04.707166 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3de27d82-4fdb-44a2-bf81-f5ddcdfc70a4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:04.708416 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3de27d82-4fdb-44a2-bf81-f5ddcdfc70a4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:04.709014 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3de27d82-4fdb-44a2-bf81-f5ddcdfc70a4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:04.793519 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-208d3f9b-e823-4250-a77d-2fc4fc118458 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f61ccbf5114e6080e33f0c5f500468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51b576f9c0241c1a254f15308a455ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:04.801738 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-208d3f9b-e823-4250-a77d-2fc4fc118458 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] 10.222.0.20 "GET /compute/v2.1/servers/d88536ad-512b-4504-9b3b-737f9c497ce8" status: 200 len: 1314 microversion: 2.1 time: 0.174631 Apr 16 21:37:04.802338 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3119/6077] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:37:04 2022] GET /compute/v2.1/servers/d88536ad-512b-4504-9b3b-737f9c497ce8 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:37:04.943121 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3de27d82-4fdb-44a2-bf81-f5ddcdfc70a4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:04.951557 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3de27d82-4fdb-44a2-bf81-f5ddcdfc70a4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:04.953482 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3de27d82-4fdb-44a2-bf81-f5ddcdfc70a4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:04.955159 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3de27d82-4fdb-44a2-bf81-f5ddcdfc70a4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1730 microversion: 2.20 time: 0.267960 Apr 16 21:37:04.955739 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2959/6078] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:37:04 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1730 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:37:05.818714 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-71ecb734-13cc-460f-90be-a5bf83fe6465 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:37:05.819278 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-71ecb734-13cc-460f-90be-a5bf83fe6465 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] [instance: d88536ad-512b-4504-9b3b-737f9c497ce8] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:37:05.826426 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-71ecb734-13cc-460f-90be-a5bf83fe6465 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:05.826890 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-71ecb734-13cc-460f-90be-a5bf83fe6465 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:05.827679 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-71ecb734-13cc-460f-90be-a5bf83fe6465 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:05.828134 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-71ecb734-13cc-460f-90be-a5bf83fe6465 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:05.966411 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-71ecb734-13cc-460f-90be-a5bf83fe6465 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f61ccbf5114e6080e33f0c5f500468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51b576f9c0241c1a254f15308a455ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:05.974087 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-71ecb734-13cc-460f-90be-a5bf83fe6465 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] 10.222.0.20 "GET /compute/v2.1/servers/d88536ad-512b-4504-9b3b-737f9c497ce8" status: 200 len: 1314 microversion: 2.1 time: 0.159507 Apr 16 21:37:05.974674 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3120/6079] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:37:05 2022] GET /compute/v2.1/servers/d88536ad-512b-4504-9b3b-737f9c497ce8 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:37:05.974955 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cbd6a706-147f-4eef-b87f-09953da2315c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:37:05.975572 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-cbd6a706-147f-4eef-b87f-09953da2315c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:37:05.982871 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cbd6a706-147f-4eef-b87f-09953da2315c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:05.983333 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cbd6a706-147f-4eef-b87f-09953da2315c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:05.984216 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cbd6a706-147f-4eef-b87f-09953da2315c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:05.984660 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cbd6a706-147f-4eef-b87f-09953da2315c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:06.113964 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cbd6a706-147f-4eef-b87f-09953da2315c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:06.122817 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cbd6a706-147f-4eef-b87f-09953da2315c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:06.124049 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cbd6a706-147f-4eef-b87f-09953da2315c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:06.125265 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cbd6a706-147f-4eef-b87f-09953da2315c tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1730 microversion: 2.20 time: 0.154855 Apr 16 21:37:06.125833 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2960/6080] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:37:05 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:37:06.991723 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e1dd1f2e-3f6f-49d6-9610-da21960629da tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:37:06.992858 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e1dd1f2e-3f6f-49d6-9610-da21960629da tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] [instance: d88536ad-512b-4504-9b3b-737f9c497ce8] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:37:06.999752 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e1dd1f2e-3f6f-49d6-9610-da21960629da tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:07.000243 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e1dd1f2e-3f6f-49d6-9610-da21960629da tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:07.001032 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e1dd1f2e-3f6f-49d6-9610-da21960629da tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:07.001492 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e1dd1f2e-3f6f-49d6-9610-da21960629da tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:07.150570 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6275cac7-17e6-494a-a06a-de6be2013be7 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:37:07.151282 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6275cac7-17e6-494a-a06a-de6be2013be7 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:37:07.166886 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6275cac7-17e6-494a-a06a-de6be2013be7 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:07.167342 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6275cac7-17e6-494a-a06a-de6be2013be7 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:07.170622 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6275cac7-17e6-494a-a06a-de6be2013be7 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:07.170622 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6275cac7-17e6-494a-a06a-de6be2013be7 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:07.170887 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e1dd1f2e-3f6f-49d6-9610-da21960629da tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f61ccbf5114e6080e33f0c5f500468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51b576f9c0241c1a254f15308a455ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:07.180129 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e1dd1f2e-3f6f-49d6-9610-da21960629da tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] 10.222.0.20 "GET /compute/v2.1/servers/d88536ad-512b-4504-9b3b-737f9c497ce8" status: 200 len: 1314 microversion: 2.1 time: 0.192069 Apr 16 21:37:07.180768 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3121/6081] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:37:06 2022] GET /compute/v2.1/servers/d88536ad-512b-4504-9b3b-737f9c497ce8 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:37:07.322559 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6275cac7-17e6-494a-a06a-de6be2013be7 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:07.330507 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6275cac7-17e6-494a-a06a-de6be2013be7 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:07.332017 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6275cac7-17e6-494a-a06a-de6be2013be7 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:07.333205 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6275cac7-17e6-494a-a06a-de6be2013be7 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1730 microversion: 2.20 time: 0.186835 Apr 16 21:37:07.333784 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2961/6082] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:37:07 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:37:07.622295 ncdv-master-1 devstack@n-api.service[137408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 21:37:07.622501 ncdv-master-1 devstack@n-api.service[137408]: Sat Apr 16 21:37:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 21:37:08.197336 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6a2b5b92-de7f-4c11-848a-10fd467f1f40 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:37:08.197938 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6a2b5b92-de7f-4c11-848a-10fd467f1f40 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] [instance: d88536ad-512b-4504-9b3b-737f9c497ce8] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:37:08.205557 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6a2b5b92-de7f-4c11-848a-10fd467f1f40 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:08.206004 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6a2b5b92-de7f-4c11-848a-10fd467f1f40 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:08.206791 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6a2b5b92-de7f-4c11-848a-10fd467f1f40 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:08.207251 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6a2b5b92-de7f-4c11-848a-10fd467f1f40 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:08.352797 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3ebf3ddf-9d0a-4667-ac38-ed6543c716a4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:37:08.353435 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3ebf3ddf-9d0a-4667-ac38-ed6543c716a4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:37:08.362437 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3ebf3ddf-9d0a-4667-ac38-ed6543c716a4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:08.363061 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3ebf3ddf-9d0a-4667-ac38-ed6543c716a4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:08.363869 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3ebf3ddf-9d0a-4667-ac38-ed6543c716a4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:08.364355 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3ebf3ddf-9d0a-4667-ac38-ed6543c716a4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:08.372848 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6a2b5b92-de7f-4c11-848a-10fd467f1f40 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f61ccbf5114e6080e33f0c5f500468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51b576f9c0241c1a254f15308a455ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:08.381234 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6a2b5b92-de7f-4c11-848a-10fd467f1f40 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] 10.222.0.20 "GET /compute/v2.1/servers/d88536ad-512b-4504-9b3b-737f9c497ce8" status: 200 len: 1314 microversion: 2.1 time: 0.187936 Apr 16 21:37:08.381896 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3122/6083] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:37:08 2022] GET /compute/v2.1/servers/d88536ad-512b-4504-9b3b-737f9c497ce8 => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:37:08.527368 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3ebf3ddf-9d0a-4667-ac38-ed6543c716a4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:08.535498 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3ebf3ddf-9d0a-4667-ac38-ed6543c716a4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:08.537067 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3ebf3ddf-9d0a-4667-ac38-ed6543c716a4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:08.538261 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3ebf3ddf-9d0a-4667-ac38-ed6543c716a4 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1730 microversion: 2.20 time: 0.190717 Apr 16 21:37:08.538872 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2962/6084] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:37:08 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1730 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:37:09.399934 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ef3e4e5e-e038-46c3-a305-3650caf8a1d4 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:37:09.401302 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ef3e4e5e-e038-46c3-a305-3650caf8a1d4 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] [instance: d88536ad-512b-4504-9b3b-737f9c497ce8] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:37:09.419623 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ef3e4e5e-e038-46c3-a305-3650caf8a1d4 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:09.420159 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ef3e4e5e-e038-46c3-a305-3650caf8a1d4 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:09.421070 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ef3e4e5e-e038-46c3-a305-3650caf8a1d4 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:09.421522 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ef3e4e5e-e038-46c3-a305-3650caf8a1d4 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:09.557904 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c198d1d6-ad80-48d3-951c-e3f8769d4388 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:37:09.559037 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c198d1d6-ad80-48d3-951c-e3f8769d4388 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:37:09.564253 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ef3e4e5e-e038-46c3-a305-3650caf8a1d4 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f61ccbf5114e6080e33f0c5f500468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51b576f9c0241c1a254f15308a455ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:09.575803 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ef3e4e5e-e038-46c3-a305-3650caf8a1d4 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] 10.222.0.20 "GET /compute/v2.1/servers/d88536ad-512b-4504-9b3b-737f9c497ce8" status: 200 len: 1314 microversion: 2.1 time: 0.181369 Apr 16 21:37:09.576437 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3123/6085] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:37:09 2022] GET /compute/v2.1/servers/d88536ad-512b-4504-9b3b-737f9c497ce8 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:37:09.580212 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c198d1d6-ad80-48d3-951c-e3f8769d4388 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:09.583150 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c198d1d6-ad80-48d3-951c-e3f8769d4388 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:09.583150 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c198d1d6-ad80-48d3-951c-e3f8769d4388 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:09.583150 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c198d1d6-ad80-48d3-951c-e3f8769d4388 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:09.717176 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c198d1d6-ad80-48d3-951c-e3f8769d4388 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:09.725377 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c198d1d6-ad80-48d3-951c-e3f8769d4388 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:09.727089 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c198d1d6-ad80-48d3-951c-e3f8769d4388 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:09.728297 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c198d1d6-ad80-48d3-951c-e3f8769d4388 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1730 microversion: 2.20 time: 0.175106 Apr 16 21:37:09.728860 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2963/6086] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:37:09 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:37:10.372699 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-1ff7680a-8f0d-4f86-a932-4fd0bf3ffd57 req-50e57f67-4ee5-44cf-a784-0c243036ef06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d88536ad-512b-4504-9b3b-737f9c497ce8", "name": "network-vif-plugged", "status": "completed", "tag": "cb189c5d-c71a-432e-a46a-5c28238c6554"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:37:10.381229 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-1ff7680a-8f0d-4f86-a932-4fd0bf3ffd57 req-50e57f67-4ee5-44cf-a784-0c243036ef06 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:10.381750 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-1ff7680a-8f0d-4f86-a932-4fd0bf3ffd57 req-50e57f67-4ee5-44cf-a784-0c243036ef06 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:10.394895 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-1ff7680a-8f0d-4f86-a932-4fd0bf3ffd57 req-50e57f67-4ee5-44cf-a784-0c243036ef06 service nova] Creating event network-vif-plugged:cb189c5d-c71a-432e-a46a-5c28238c6554 for instance d88536ad-512b-4504-9b3b-737f9c497ce8 on nch1-master-1 Apr 16 21:37:10.401248 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-1ff7680a-8f0d-4f86-a932-4fd0bf3ffd57 req-50e57f67-4ee5-44cf-a784-0c243036ef06 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032506 Apr 16 21:37:10.402160 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3124/6087] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:37:10.593372 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1d7fa92a-66a2-48ff-ab8e-a7d41e6fea79 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:37:10.593960 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1d7fa92a-66a2-48ff-ab8e-a7d41e6fea79 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] [instance: d88536ad-512b-4504-9b3b-737f9c497ce8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:37:10.601958 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1d7fa92a-66a2-48ff-ab8e-a7d41e6fea79 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:10.602423 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1d7fa92a-66a2-48ff-ab8e-a7d41e6fea79 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:10.603205 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1d7fa92a-66a2-48ff-ab8e-a7d41e6fea79 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:10.603653 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1d7fa92a-66a2-48ff-ab8e-a7d41e6fea79 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:10.747628 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3532a5ba-07f5-4987-8d32-26e183f01b33 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:37:10.748357 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3532a5ba-07f5-4987-8d32-26e183f01b33 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:37:10.755825 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3532a5ba-07f5-4987-8d32-26e183f01b33 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:10.756315 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3532a5ba-07f5-4987-8d32-26e183f01b33 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:10.759784 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3532a5ba-07f5-4987-8d32-26e183f01b33 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:10.759784 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3532a5ba-07f5-4987-8d32-26e183f01b33 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:10.808944 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1d7fa92a-66a2-48ff-ab8e-a7d41e6fea79 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f61ccbf5114e6080e33f0c5f500468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51b576f9c0241c1a254f15308a455ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:10.816543 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1d7fa92a-66a2-48ff-ab8e-a7d41e6fea79 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] 10.222.0.20 "GET /compute/v2.1/servers/d88536ad-512b-4504-9b3b-737f9c497ce8" status: 200 len: 1314 microversion: 2.1 time: 0.227491 Apr 16 21:37:10.817118 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2964/6088] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:37:10 2022] GET /compute/v2.1/servers/d88536ad-512b-4504-9b3b-737f9c497ce8 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:37:10.899298 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3532a5ba-07f5-4987-8d32-26e183f01b33 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:10.907314 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3532a5ba-07f5-4987-8d32-26e183f01b33 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:10.908868 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3532a5ba-07f5-4987-8d32-26e183f01b33 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:10.910271 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3532a5ba-07f5-4987-8d32-26e183f01b33 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1730 microversion: 2.20 time: 0.167022 Apr 16 21:37:10.910825 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3125/6089] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:37:10 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:37:11.165322 ncdv-master-1 devstack@n-api.service[137409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 21:37:11.165523 ncdv-master-1 devstack@n-api.service[137409]: Sat Apr 16 21:37:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 21:37:11.833198 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cf448cd8-6039-4fcf-b800-82a0126f3f5a tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:37:11.833838 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-cf448cd8-6039-4fcf-b800-82a0126f3f5a tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] [instance: d88536ad-512b-4504-9b3b-737f9c497ce8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:37:11.841213 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cf448cd8-6039-4fcf-b800-82a0126f3f5a tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:11.841671 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cf448cd8-6039-4fcf-b800-82a0126f3f5a tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:11.842446 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cf448cd8-6039-4fcf-b800-82a0126f3f5a tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:11.842890 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cf448cd8-6039-4fcf-b800-82a0126f3f5a tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:11.928124 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a5672af9-4f6b-4fb8-9aaf-cbde127c50c6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:37:11.928768 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a5672af9-4f6b-4fb8-9aaf-cbde127c50c6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:37:11.935711 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a5672af9-4f6b-4fb8-9aaf-cbde127c50c6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:11.936203 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a5672af9-4f6b-4fb8-9aaf-cbde127c50c6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:11.937022 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a5672af9-4f6b-4fb8-9aaf-cbde127c50c6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:11.937472 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a5672af9-4f6b-4fb8-9aaf-cbde127c50c6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:11.977894 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cf448cd8-6039-4fcf-b800-82a0126f3f5a tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f61ccbf5114e6080e33f0c5f500468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51b576f9c0241c1a254f15308a455ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:11.986830 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cf448cd8-6039-4fcf-b800-82a0126f3f5a tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] 10.222.0.20 "GET /compute/v2.1/servers/d88536ad-512b-4504-9b3b-737f9c497ce8" status: 200 len: 1314 microversion: 2.1 time: 0.156711 Apr 16 21:37:11.987010 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2965/6090] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:37:11 2022] GET /compute/v2.1/servers/d88536ad-512b-4504-9b3b-737f9c497ce8 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:37:12.108224 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a5672af9-4f6b-4fb8-9aaf-cbde127c50c6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:12.116396 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a5672af9-4f6b-4fb8-9aaf-cbde127c50c6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:12.117951 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a5672af9-4f6b-4fb8-9aaf-cbde127c50c6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:12.119119 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a5672af9-4f6b-4fb8-9aaf-cbde127c50c6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1730 microversion: 2.20 time: 0.195060 Apr 16 21:37:12.119679 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3126/6091] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:37:11 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1730 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:37:13.003608 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8c0cf44d-3029-442b-b060-f7d6d7b31ed1 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:37:13.004268 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8c0cf44d-3029-442b-b060-f7d6d7b31ed1 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] [instance: d88536ad-512b-4504-9b3b-737f9c497ce8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:37:13.011172 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8c0cf44d-3029-442b-b060-f7d6d7b31ed1 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:13.011637 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8c0cf44d-3029-442b-b060-f7d6d7b31ed1 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:13.012451 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8c0cf44d-3029-442b-b060-f7d6d7b31ed1 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:13.012905 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8c0cf44d-3029-442b-b060-f7d6d7b31ed1 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:13.137499 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-75b026d7-84d6-4253-a31c-eff0c6b67492 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:37:13.138123 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-75b026d7-84d6-4253-a31c-eff0c6b67492 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:37:13.145497 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-75b026d7-84d6-4253-a31c-eff0c6b67492 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:13.145966 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-75b026d7-84d6-4253-a31c-eff0c6b67492 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:13.148668 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-75b026d7-84d6-4253-a31c-eff0c6b67492 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:13.148668 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-75b026d7-84d6-4253-a31c-eff0c6b67492 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:13.152070 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8c0cf44d-3029-442b-b060-f7d6d7b31ed1 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f61ccbf5114e6080e33f0c5f500468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51b576f9c0241c1a254f15308a455ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:13.159735 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8c0cf44d-3029-442b-b060-f7d6d7b31ed1 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] 10.222.0.20 "GET /compute/v2.1/servers/d88536ad-512b-4504-9b3b-737f9c497ce8" status: 200 len: 1463 microversion: 2.1 time: 0.160750 Apr 16 21:37:13.160455 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2966/6092] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:37:12 2022] GET /compute/v2.1/servers/d88536ad-512b-4504-9b3b-737f9c497ce8 => generated 1463 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:37:13.178804 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-85993bbb-1515-4ff9-b064-0cf5233d1439 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0dc9c2b9-1dc0-4ef0-b0d6-2a09be69e861", "device": "/dev/sdb"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:37:13.180525 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-85993bbb-1515-4ff9-b064-0cf5233d1439 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] [instance: d88536ad-512b-4504-9b3b-737f9c497ce8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:37:13.186583 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-85993bbb-1515-4ff9-b064-0cf5233d1439 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:13.187039 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-85993bbb-1515-4ff9-b064-0cf5233d1439 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:13.187824 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-85993bbb-1515-4ff9-b064-0cf5233d1439 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:13.188304 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-85993bbb-1515-4ff9-b064-0cf5233d1439 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:13.294872 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-75b026d7-84d6-4253-a31c-eff0c6b67492 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:13.306129 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-75b026d7-84d6-4253-a31c-eff0c6b67492 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:13.308044 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-75b026d7-84d6-4253-a31c-eff0c6b67492 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:13.309280 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-75b026d7-84d6-4253-a31c-eff0c6b67492 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1730 microversion: 2.20 time: 0.175733 Apr 16 21:37:13.309845 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3127/6093] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:37:13 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 16 21:37:13.314461 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-4b89c26f-d310-440c-9c50-9b2fd0272702 req-a78cab41-6921-430c-939a-a5fbae455903 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25cb82d7-b342-407d-8f63-71670d8f22d9", "name": "network-vif-plugged", "status": "completed", "tag": "32c60358-6ed6-4d01-a515-c08c9770f288"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:37:13.322559 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-4b89c26f-d310-440c-9c50-9b2fd0272702 req-a78cab41-6921-430c-939a-a5fbae455903 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:13.322870 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-4b89c26f-d310-440c-9c50-9b2fd0272702 req-a78cab41-6921-430c-939a-a5fbae455903 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:13.334110 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-4b89c26f-d310-440c-9c50-9b2fd0272702 req-a78cab41-6921-430c-939a-a5fbae455903 service nova] Creating event network-vif-plugged:32c60358-6ed6-4d01-a515-c08c9770f288 for instance 25cb82d7-b342-407d-8f63-71670d8f22d9 on nch2-master-1 Apr 16 21:37:13.339649 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-4b89c26f-d310-440c-9c50-9b2fd0272702 req-a78cab41-6921-430c-939a-a5fbae455903 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028540 Apr 16 21:37:13.340481 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3128/6094] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:37:13.825101 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-85993bbb-1515-4ff9-b064-0cf5233d1439 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] 10.222.0.20 "POST /compute/v2.1/servers/d88536ad-512b-4504-9b3b-737f9c497ce8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.650043 Apr 16 21:37:13.825763 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2967/6095] 10.222.0.20 () {60 vars in 1322 bytes} [Sat Apr 16 21:37:13 2022] POST /compute/v2.1/servers/d88536ad-512b-4504-9b3b-737f9c497ce8/os-volume_attachments => generated 194 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:37:14.331379 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2d684333-5fb6-4c10-8518-9369273ab715 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:37:14.332198 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2d684333-5fb6-4c10-8518-9369273ab715 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:37:14.339970 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2d684333-5fb6-4c10-8518-9369273ab715 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:14.341129 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2d684333-5fb6-4c10-8518-9369273ab715 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:14.344867 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2d684333-5fb6-4c10-8518-9369273ab715 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:14.344867 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2d684333-5fb6-4c10-8518-9369273ab715 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:14.487467 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2d684333-5fb6-4c10-8518-9369273ab715 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:14.497005 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2d684333-5fb6-4c10-8518-9369273ab715 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:14.498442 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2d684333-5fb6-4c10-8518-9369273ab715 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:14.499651 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2d684333-5fb6-4c10-8518-9369273ab715 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1730 microversion: 2.20 time: 0.175868 Apr 16 21:37:14.500275 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3129/6096] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:37:14 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:37:15.519135 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a90e13ec-e1ac-4e00-b6cf-3e4ab848cd9a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:37:15.519849 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a90e13ec-e1ac-4e00-b6cf-3e4ab848cd9a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:37:15.529288 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a90e13ec-e1ac-4e00-b6cf-3e4ab848cd9a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:15.529288 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a90e13ec-e1ac-4e00-b6cf-3e4ab848cd9a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:15.529288 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a90e13ec-e1ac-4e00-b6cf-3e4ab848cd9a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:15.529557 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a90e13ec-e1ac-4e00-b6cf-3e4ab848cd9a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:15.696774 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a90e13ec-e1ac-4e00-b6cf-3e4ab848cd9a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:15.709026 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a90e13ec-e1ac-4e00-b6cf-3e4ab848cd9a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:15.710549 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a90e13ec-e1ac-4e00-b6cf-3e4ab848cd9a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:15.712354 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a90e13ec-e1ac-4e00-b6cf-3e4ab848cd9a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1730 microversion: 2.20 time: 0.198019 Apr 16 21:37:15.712921 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2968/6097] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:37:15 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1730 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:37:16.731800 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-470245a6-4c02-41ad-bdef-555abbc523ad tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:37:16.732699 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-470245a6-4c02-41ad-bdef-555abbc523ad tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:37:16.739417 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-470245a6-4c02-41ad-bdef-555abbc523ad tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:16.746692 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-470245a6-4c02-41ad-bdef-555abbc523ad tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:16.746692 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-470245a6-4c02-41ad-bdef-555abbc523ad tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:16.746692 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-470245a6-4c02-41ad-bdef-555abbc523ad tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:16.905594 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-470245a6-4c02-41ad-bdef-555abbc523ad tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:16.913690 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-470245a6-4c02-41ad-bdef-555abbc523ad tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:16.915678 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-470245a6-4c02-41ad-bdef-555abbc523ad tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:16.916876 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-470245a6-4c02-41ad-bdef-555abbc523ad tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1717 microversion: 2.20 time: 0.189459 Apr 16 21:37:16.928584 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3130/6098] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:37:16 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1717 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:37:27.224005 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e669461e-a2e6-4a97-8feb-8b8bb504f108 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:37:27.225378 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e669461e-a2e6-4a97-8feb-8b8bb504f108 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:37:27.237472 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e669461e-a2e6-4a97-8feb-8b8bb504f108 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:27.239209 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e669461e-a2e6-4a97-8feb-8b8bb504f108 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:27.241965 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e669461e-a2e6-4a97-8feb-8b8bb504f108 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:27.242952 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e669461e-a2e6-4a97-8feb-8b8bb504f108 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:27.308134 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e669461e-a2e6-4a97-8feb-8b8bb504f108 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "POST /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416/action" status: 200 len: 63190 microversion: 2.1 time: 0.088079 Apr 16 21:37:27.309388 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2969/6099] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:37:27 2022] POST /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416/action => generated 63190 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:37:36.763475 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0126b064-9d5b-4bb0-ae87-4f8f76483fc1 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:37:36.764010 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0126b064-9d5b-4bb0-ae87-4f8f76483fc1 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] [instance: d88536ad-512b-4504-9b3b-737f9c497ce8] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:37:36.770404 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0126b064-9d5b-4bb0-ae87-4f8f76483fc1 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:36.770867 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0126b064-9d5b-4bb0-ae87-4f8f76483fc1 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:36.776592 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0126b064-9d5b-4bb0-ae87-4f8f76483fc1 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:36.776592 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0126b064-9d5b-4bb0-ae87-4f8f76483fc1 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:36.994061 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-0126b064-9d5b-4bb0-ae87-4f8f76483fc1 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lazy-loading 'services' on Instance uuid d88536ad-512b-4504-9b3b-737f9c497ce8 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:37:37.299115 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0126b064-9d5b-4bb0-ae87-4f8f76483fc1 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d88536ad-512b-4504-9b3b-737f9c497ce8/os-volume_attachments/0dc9c2b9-1dc0-4ef0-b0d6-2a09be69e861" status: 202 len: 0 microversion: 2.1 time: 0.533334 Apr 16 21:37:37.299115 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3131/6100] 10.222.0.20 () {58 vars in 1415 bytes} [Sat Apr 16 21:37:36 2022] DELETE /compute/v2.1/servers/d88536ad-512b-4504-9b3b-737f9c497ce8/os-volume_attachments/0dc9c2b9-1dc0-4ef0-b0d6-2a09be69e861 => generated 0 bytes in 535 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:37:39.531988 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f9a029c8-879a-4192-90db-942c3ff5118b tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:37:39.532625 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f9a029c8-879a-4192-90db-942c3ff5118b tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] [instance: d88536ad-512b-4504-9b3b-737f9c497ce8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:37:39.540698 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f9a029c8-879a-4192-90db-942c3ff5118b tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:39.541155 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f9a029c8-879a-4192-90db-942c3ff5118b tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:39.541936 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f9a029c8-879a-4192-90db-942c3ff5118b tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:39.542385 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f9a029c8-879a-4192-90db-942c3ff5118b tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:39.567763 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f9a029c8-879a-4192-90db-942c3ff5118b tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] [instance: d88536ad-512b-4504-9b3b-737f9c497ce8] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:37:39.904792 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f9a029c8-879a-4192-90db-942c3ff5118b tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d88536ad-512b-4504-9b3b-737f9c497ce8" status: 204 len: 0 microversion: 2.1 time: 0.376878 Apr 16 21:37:39.905722 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2970/6101] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:37:39 2022] DELETE /compute/v2.1/servers/d88536ad-512b-4504-9b3b-737f9c497ce8 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:37:39.916763 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0655e5dc-4f0b-4812-a8dd-5979f9a8c4b2 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:37:39.917623 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0655e5dc-4f0b-4812-a8dd-5979f9a8c4b2 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] [instance: d88536ad-512b-4504-9b3b-737f9c497ce8] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:37:39.924011 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0655e5dc-4f0b-4812-a8dd-5979f9a8c4b2 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:39.924513 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0655e5dc-4f0b-4812-a8dd-5979f9a8c4b2 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:39.925308 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0655e5dc-4f0b-4812-a8dd-5979f9a8c4b2 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:39.925756 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0655e5dc-4f0b-4812-a8dd-5979f9a8c4b2 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:40.067256 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0655e5dc-4f0b-4812-a8dd-5979f9a8c4b2 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f61ccbf5114e6080e33f0c5f500468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51b576f9c0241c1a254f15308a455ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:40.075814 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0655e5dc-4f0b-4812-a8dd-5979f9a8c4b2 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] 10.222.0.20 "GET /compute/v2.1/servers/d88536ad-512b-4504-9b3b-737f9c497ce8" status: 200 len: 1469 microversion: 2.1 time: 0.165361 Apr 16 21:37:40.086332 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3132/6102] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:37:39 2022] GET /compute/v2.1/servers/d88536ad-512b-4504-9b3b-737f9c497ce8 => generated 1469 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:37:41.094678 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1bbae123-a588-4e74-93b4-5d0adc0fe7e2 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:37:41.095413 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1bbae123-a588-4e74-93b4-5d0adc0fe7e2 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] [instance: d88536ad-512b-4504-9b3b-737f9c497ce8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:37:41.105527 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1bbae123-a588-4e74-93b4-5d0adc0fe7e2 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:41.106220 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1bbae123-a588-4e74-93b4-5d0adc0fe7e2 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:41.107063 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1bbae123-a588-4e74-93b4-5d0adc0fe7e2 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:41.107508 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1bbae123-a588-4e74-93b4-5d0adc0fe7e2 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:41.408817 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1bbae123-a588-4e74-93b4-5d0adc0fe7e2 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f61ccbf5114e6080e33f0c5f500468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51b576f9c0241c1a254f15308a455ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:41.417030 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1bbae123-a588-4e74-93b4-5d0adc0fe7e2 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] 10.222.0.20 "GET /compute/v2.1/servers/d88536ad-512b-4504-9b3b-737f9c497ce8" status: 200 len: 1469 microversion: 2.1 time: 0.326619 Apr 16 21:37:41.419734 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2971/6103] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:37:41 2022] GET /compute/v2.1/servers/d88536ad-512b-4504-9b3b-737f9c497ce8 => generated 1469 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:37:42.259937 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-f08f227c-bea1-460f-a7b5-74ce297780bf req-8511af3f-be5f-4d3c-a05f-c8ce9b774cc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d88536ad-512b-4504-9b3b-737f9c497ce8", "name": "network-vif-deleted", "tag": "cb189c5d-c71a-432e-a46a-5c28238c6554"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:37:42.269603 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-f08f227c-bea1-460f-a7b5-74ce297780bf req-8511af3f-be5f-4d3c-a05f-c8ce9b774cc4 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:42.270054 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-f08f227c-bea1-460f-a7b5-74ce297780bf req-8511af3f-be5f-4d3c-a05f-c8ce9b774cc4 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:42.281401 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-f08f227c-bea1-460f-a7b5-74ce297780bf req-8511af3f-be5f-4d3c-a05f-c8ce9b774cc4 service nova] Creating event network-vif-deleted:cb189c5d-c71a-432e-a46a-5c28238c6554 for instance d88536ad-512b-4504-9b3b-737f9c497ce8 on nch1-master-1 Apr 16 21:37:42.286648 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-f08f227c-bea1-460f-a7b5-74ce297780bf req-8511af3f-be5f-4d3c-a05f-c8ce9b774cc4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030689 Apr 16 21:37:42.287736 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3133/6104] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:37:42.435117 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bb3798bb-11f3-4534-923b-f0140d0e8049 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:37:42.436370 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bb3798bb-11f3-4534-923b-f0140d0e8049 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] [instance: d88536ad-512b-4504-9b3b-737f9c497ce8] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:37:42.445301 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bb3798bb-11f3-4534-923b-f0140d0e8049 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:42.445981 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bb3798bb-11f3-4534-923b-f0140d0e8049 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:42.446900 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bb3798bb-11f3-4534-923b-f0140d0e8049 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:42.447462 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bb3798bb-11f3-4534-923b-f0140d0e8049 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:42.526712 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-bb3798bb-11f3-4534-923b-f0140d0e8049 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '77f61ccbf5114e6080e33f0c5f500468', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd51b576f9c0241c1a254f15308a455ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:42.534812 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bb3798bb-11f3-4534-923b-f0140d0e8049 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] 10.222.0.20 "GET /compute/v2.1/servers/d88536ad-512b-4504-9b3b-737f9c497ce8" status: 200 len: 1299 microversion: 2.1 time: 0.104036 Apr 16 21:37:42.535430 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2972/6105] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:37:42 2022] GET /compute/v2.1/servers/d88536ad-512b-4504-9b3b-737f9c497ce8 => generated 1299 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:37:43.553294 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-04b23fe0-513f-45cf-8d2a-7f0b572ec2c3 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:37:43.563631 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-04b23fe0-513f-45cf-8d2a-7f0b572ec2c3 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] [instance: d88536ad-512b-4504-9b3b-737f9c497ce8] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:37:43.569006 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-04b23fe0-513f-45cf-8d2a-7f0b572ec2c3 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:43.569492 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-04b23fe0-513f-45cf-8d2a-7f0b572ec2c3 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:43.570584 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-04b23fe0-513f-45cf-8d2a-7f0b572ec2c3 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:43.571369 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-04b23fe0-513f-45cf-8d2a-7f0b572ec2c3 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:43.589534 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-04b23fe0-513f-45cf-8d2a-7f0b572ec2c3 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] HTTP exception thrown: Instance d88536ad-512b-4504-9b3b-737f9c497ce8 could not be found. Apr 16 21:37:43.590408 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-04b23fe0-513f-45cf-8d2a-7f0b572ec2c3 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] Returning 404 to user: Instance d88536ad-512b-4504-9b3b-737f9c497ce8 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:37:43.591404 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-04b23fe0-513f-45cf-8d2a-7f0b572ec2c3 tempest-VolumesBackupsTest-493584864 tempest-VolumesBackupsTest-493584864-project] 10.222.0.20 "GET /compute/v2.1/servers/d88536ad-512b-4504-9b3b-737f9c497ce8" status: 404 len: 111 microversion: 2.1 time: 0.042863 Apr 16 21:37:43.592810 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3134/6106] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:37:43 2022] GET /compute/v2.1/servers/d88536ad-512b-4504-9b3b-737f9c497ce8 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:37:50.087625 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4f80f7fb-ffd8-48c4-a86c-122db3ce9574 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:37:50.088376 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4f80f7fb-ffd8-48c4-a86c-122db3ce9574 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:37:50.095444 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4f80f7fb-ffd8-48c4-a86c-122db3ce9574 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:50.095912 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4f80f7fb-ffd8-48c4-a86c-122db3ce9574 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:50.096829 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4f80f7fb-ffd8-48c4-a86c-122db3ce9574 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:50.097463 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4f80f7fb-ffd8-48c4-a86c-122db3ce9574 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:50.244400 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4f80f7fb-ffd8-48c4-a86c-122db3ce9574 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1833 microversion: 2.1 time: 0.161602 Apr 16 21:37:50.249746 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2973/6107] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:37:50 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1833 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:37:51.805288 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7f329692-9376-466f-a0f2-1e88a4dd4581 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:37:51.805800 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7f329692-9376-466f-a0f2-1e88a4dd4581 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:37:51.808882 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-01f0a678-64cb-4aab-b8b9-983a2ba6a50c req-7f1ef961-a9f2-47fd-bed5-44ca49df0b68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69bd9595-c9e9-4d06-af55-ce22d5f09416", "tag": "10dae36f-fbbc-45d6-b539-d8ce65bad3c2"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:37:51.817964 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7f329692-9376-466f-a0f2-1e88a4dd4581 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:51.819614 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-01f0a678-64cb-4aab-b8b9-983a2ba6a50c req-7f1ef961-a9f2-47fd-bed5-44ca49df0b68 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:51.820028 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-01f0a678-64cb-4aab-b8b9-983a2ba6a50c req-7f1ef961-a9f2-47fd-bed5-44ca49df0b68 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:51.820119 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7f329692-9376-466f-a0f2-1e88a4dd4581 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:51.821926 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7f329692-9376-466f-a0f2-1e88a4dd4581 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:51.824847 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7f329692-9376-466f-a0f2-1e88a4dd4581 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:51.838012 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-01f0a678-64cb-4aab-b8b9-983a2ba6a50c req-7f1ef961-a9f2-47fd-bed5-44ca49df0b68 service nova] Creating event network-changed:10dae36f-fbbc-45d6-b539-d8ce65bad3c2 for instance 69bd9595-c9e9-4d06-af55-ce22d5f09416 on nch2-master-1 Apr 16 21:37:51.845994 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-01f0a678-64cb-4aab-b8b9-983a2ba6a50c req-7f1ef961-a9f2-47fd-bed5-44ca49df0b68 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041248 Apr 16 21:37:51.846889 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2974/6108] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:37:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:37:51.860877 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7f329692-9376-466f-a0f2-1e88a4dd4581 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:37:52.121312 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7f329692-9376-466f-a0f2-1e88a4dd4581 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "DELETE /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 204 len: 0 microversion: 2.1 time: 0.320400 Apr 16 21:37:52.122954 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3135/6109] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:37:51 2022] DELETE /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:37:52.135989 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-02dffbdb-bafe-49c1-8c73-379c32f44af4 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:37:52.137344 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-02dffbdb-bafe-49c1-8c73-379c32f44af4 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:37:52.144727 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-02dffbdb-bafe-49c1-8c73-379c32f44af4 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:52.145222 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-02dffbdb-bafe-49c1-8c73-379c32f44af4 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:52.146199 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-02dffbdb-bafe-49c1-8c73-379c32f44af4 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:52.146827 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-02dffbdb-bafe-49c1-8c73-379c32f44af4 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:52.298288 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-02dffbdb-bafe-49c1-8c73-379c32f44af4 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:52.307404 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-02dffbdb-bafe-49c1-8c73-379c32f44af4 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1688 microversion: 2.1 time: 0.179041 Apr 16 21:37:52.308293 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2975/6110] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:37:52 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1688 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:37:53.326749 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-03e658bf-9003-4bb7-bc6c-6636a5867ea3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:37:53.328112 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-03e658bf-9003-4bb7-bc6c-6636a5867ea3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:37:53.335373 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-03e658bf-9003-4bb7-bc6c-6636a5867ea3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:53.336600 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-03e658bf-9003-4bb7-bc6c-6636a5867ea3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:53.337643 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-03e658bf-9003-4bb7-bc6c-6636a5867ea3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:53.338302 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-03e658bf-9003-4bb7-bc6c-6636a5867ea3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:53.516906 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-03e658bf-9003-4bb7-bc6c-6636a5867ea3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:53.525435 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-03e658bf-9003-4bb7-bc6c-6636a5867ea3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1688 microversion: 2.1 time: 0.203536 Apr 16 21:37:53.526205 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3136/6111] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:37:53 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1688 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:37:54.260409 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-dcaf7bac-f460-4e5a-be61-97e4bd107761 req-73c369e9-3f79-4bab-a973-6188c6f432f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69bd9595-c9e9-4d06-af55-ce22d5f09416", "name": "network-vif-deleted", "tag": "10dae36f-fbbc-45d6-b539-d8ce65bad3c2"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:37:54.270006 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-dcaf7bac-f460-4e5a-be61-97e4bd107761 req-73c369e9-3f79-4bab-a973-6188c6f432f5 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:54.271014 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-dcaf7bac-f460-4e5a-be61-97e4bd107761 req-73c369e9-3f79-4bab-a973-6188c6f432f5 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:54.283901 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-dcaf7bac-f460-4e5a-be61-97e4bd107761 req-73c369e9-3f79-4bab-a973-6188c6f432f5 service nova] Creating event network-vif-deleted:10dae36f-fbbc-45d6-b539-d8ce65bad3c2 for instance 69bd9595-c9e9-4d06-af55-ce22d5f09416 on nch2-master-1 Apr 16 21:37:54.289597 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-dcaf7bac-f460-4e5a-be61-97e4bd107761 req-73c369e9-3f79-4bab-a973-6188c6f432f5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033330 Apr 16 21:37:54.290414 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2976/6112] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:37:54.543183 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a9cac390-831e-44fa-ba87-9c978c91bf3f tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:37:54.544160 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a9cac390-831e-44fa-ba87-9c978c91bf3f tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:37:54.552481 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9cac390-831e-44fa-ba87-9c978c91bf3f tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:54.552945 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9cac390-831e-44fa-ba87-9c978c91bf3f tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:54.553745 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9cac390-831e-44fa-ba87-9c978c91bf3f tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:54.554192 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9cac390-831e-44fa-ba87-9c978c91bf3f tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:54.622653 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a9cac390-831e-44fa-ba87-9c978c91bf3f tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:37:54.631034 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a9cac390-831e-44fa-ba87-9c978c91bf3f tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 200 len: 1350 microversion: 2.1 time: 0.091860 Apr 16 21:37:54.641138 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3137/6113] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:37:54 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 1350 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:37:55.650611 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-65b8cb5c-3936-444c-a8fc-da269e0bcb59 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:37:55.651334 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-65b8cb5c-3936-444c-a8fc-da269e0bcb59 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 69bd9595-c9e9-4d06-af55-ce22d5f09416] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:37:55.658262 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-65b8cb5c-3936-444c-a8fc-da269e0bcb59 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:55.658735 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-65b8cb5c-3936-444c-a8fc-da269e0bcb59 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:55.660525 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-65b8cb5c-3936-444c-a8fc-da269e0bcb59 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:37:55.660525 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-65b8cb5c-3936-444c-a8fc-da269e0bcb59 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:37:55.673965 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-65b8cb5c-3936-444c-a8fc-da269e0bcb59 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] HTTP exception thrown: Instance 69bd9595-c9e9-4d06-af55-ce22d5f09416 could not be found. Apr 16 21:37:55.674586 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-65b8cb5c-3936-444c-a8fc-da269e0bcb59 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Returning 404 to user: Instance 69bd9595-c9e9-4d06-af55-ce22d5f09416 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:37:55.675453 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-65b8cb5c-3936-444c-a8fc-da269e0bcb59 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416" status: 404 len: 111 microversion: 2.1 time: 0.030018 Apr 16 21:37:55.676018 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2977/6114] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:37:55 2022] GET /compute/v2.1/servers/69bd9595-c9e9-4d06-af55-ce22d5f09416 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:38:00.044466 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-850b9458-e748-45c1-bd12-ec9b474c629a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '.version_select at 0x7fbb9ffd4ca0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:38:00.126673 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-850b9458-e748-45c1-bd12-ec9b474c629a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-360195677" status: 202 len: 0 microversion: 2.1 time: 0.086222 Apr 16 21:38:00.127467 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3138/6115] 10.222.0.20 () {58 vars in 1280 bytes} [Sat Apr 16 21:38:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-360195677 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:38:00.168113 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-99522423-b652-4c03-b13d-65e4d7f9d377 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Action: 'create', calling method: .version_select at 0x7fbb964c13a0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-581618457"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:38:00.186218 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-99522423-b652-4c03-b13d-65e4d7f9d377 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Getting quotas for project 0ee2ef9a941a429b82a89f7c8f71d45b. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:38:00.193553 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-99522423-b652-4c03-b13d-65e4d7f9d377 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Getting quotas for user f27a0cf693a247bb87a8c12193fee719 and project 0ee2ef9a941a429b82a89f7c8f71d45b. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:38:00.554776 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-99522423-b652-4c03-b13d-65e4d7f9d377 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Getting quotas for project 0ee2ef9a941a429b82a89f7c8f71d45b. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:38:00.560374 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-99522423-b652-4c03-b13d-65e4d7f9d377 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Getting quotas for user f27a0cf693a247bb87a8c12193fee719 and project 0ee2ef9a941a429b82a89f7c8f71d45b. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:38:00.585257 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-99522423-b652-4c03-b13d-65e4d7f9d377 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.421090 Apr 16 21:38:00.586037 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2978/6116] 10.222.0.20 () {60 vars in 1157 bytes} [Sat Apr 16 21:38:00 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:38:10.054157 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b21d7255-05c6-4dc0-a091-efaa4422d623 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-436004629", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "05c2f35c-bc8e-4836-b934-7e59daa1ea89"}], "key_name": "tempest-TestNetworkAdvancedServerOps-581618457", "security_groups": [{"name": "tempest-secgroup-smoke-336211592"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:38:10.181107 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-b21d7255-05c6-4dc0-a091-efaa4422d623 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] validate_networks() for [('05c2f35c-bc8e-4836-b934-7e59daa1ea89', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:38:10.757919 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-b21d7255-05c6-4dc0-a091-efaa4422d623 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:38:10.758346 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-b21d7255-05c6-4dc0-a091-efaa4422d623 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:38:10.758827 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-b21d7255-05c6-4dc0-a091-efaa4422d623 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:38:10.759242 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-b21d7255-05c6-4dc0-a091-efaa4422d623 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:38:10.759658 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-b21d7255-05c6-4dc0-a091-efaa4422d623 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:38:10.768885 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b21d7255-05c6-4dc0-a091-efaa4422d623 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:10.769347 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b21d7255-05c6-4dc0-a091-efaa4422d623 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:10.771147 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b21d7255-05c6-4dc0-a091-efaa4422d623 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:10.771147 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b21d7255-05c6-4dc0-a091-efaa4422d623 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:10.788150 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-b21d7255-05c6-4dc0-a091-efaa4422d623 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Getting quotas for project 0ee2ef9a941a429b82a89f7c8f71d45b. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:38:10.793897 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-b21d7255-05c6-4dc0-a091-efaa4422d623 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Getting quotas for user f27a0cf693a247bb87a8c12193fee719 and project 0ee2ef9a941a429b82a89f7c8f71d45b. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:38:10.811098 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b21d7255-05c6-4dc0-a091-efaa4422d623 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:38:10.813441 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b21d7255-05c6-4dc0-a091-efaa4422d623 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 05be7894-901d-4845-be17-f6e12dc9f6f3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:38:11.134234 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b21d7255-05c6-4dc0-a091-efaa4422d623 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.086252 Apr 16 21:38:11.140480 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3139/6117] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:38:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 1088 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:38:11.147090 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-74f41e54-85d9-483d-a71a-49074572814c tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:38:11.163944 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-74f41e54-85d9-483d-a71a-49074572814c tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 05be7894-901d-4845-be17-f6e12dc9f6f3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:38:11.257295 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-74f41e54-85d9-483d-a71a-49074572814c tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:38:11.264320 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-74f41e54-85d9-483d-a71a-49074572814c tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3" status: 200 len: 1265 microversion: 2.1 time: 0.122107 Apr 16 21:38:11.266081 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2979/6118] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:38:11 2022] GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3 => generated 1265 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:38:12.293660 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b190dbdc-22b3-4c7f-8ee4-0aeb42d4c691 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:38:12.294294 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b190dbdc-22b3-4c7f-8ee4-0aeb42d4c691 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 05be7894-901d-4845-be17-f6e12dc9f6f3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:38:12.361899 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b190dbdc-22b3-4c7f-8ee4-0aeb42d4c691 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:38:12.367880 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b190dbdc-22b3-4c7f-8ee4-0aeb42d4c691 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3" status: 200 len: 1265 microversion: 2.1 time: 0.088452 Apr 16 21:38:12.368878 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3140/6119] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:38:12 2022] GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3 => generated 1265 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:38:13.385156 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f2702bfe-7e60-4fbb-9c2d-2d8bfe7439b3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:38:13.385775 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f2702bfe-7e60-4fbb-9c2d-2d8bfe7439b3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 05be7894-901d-4845-be17-f6e12dc9f6f3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:38:13.393723 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f2702bfe-7e60-4fbb-9c2d-2d8bfe7439b3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:13.394185 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f2702bfe-7e60-4fbb-9c2d-2d8bfe7439b3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:13.394967 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f2702bfe-7e60-4fbb-9c2d-2d8bfe7439b3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:13.395450 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f2702bfe-7e60-4fbb-9c2d-2d8bfe7439b3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:13.476583 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f2702bfe-7e60-4fbb-9c2d-2d8bfe7439b3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:38:13.487003 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f2702bfe-7e60-4fbb-9c2d-2d8bfe7439b3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3" status: 200 len: 1317 microversion: 2.1 time: 0.105471 Apr 16 21:38:13.488661 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2980/6120] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:38:13 2022] GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3 => generated 1317 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:38:14.505888 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-13a834ee-ee23-4513-b795-3623fccd3bc5 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:38:14.506674 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-13a834ee-ee23-4513-b795-3623fccd3bc5 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 05be7894-901d-4845-be17-f6e12dc9f6f3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:38:14.514993 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-13a834ee-ee23-4513-b795-3623fccd3bc5 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:14.515544 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-13a834ee-ee23-4513-b795-3623fccd3bc5 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:14.516465 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-13a834ee-ee23-4513-b795-3623fccd3bc5 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:14.517038 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-13a834ee-ee23-4513-b795-3623fccd3bc5 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:14.660637 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-13a834ee-ee23-4513-b795-3623fccd3bc5 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:38:14.669142 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-13a834ee-ee23-4513-b795-3623fccd3bc5 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3" status: 200 len: 1390 microversion: 2.1 time: 0.167969 Apr 16 21:38:14.670004 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3141/6121] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:38:14 2022] GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3 => generated 1390 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:38:15.429224 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-e3e3bb64-9970-46d7-bd41-741e8f9717f3 req-3374cc70-3841-4459-9099-3f3190c741c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05be7894-901d-4845-be17-f6e12dc9f6f3", "tag": "c8075c9e-8845-461b-859a-ca04ebb3e039"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:38:15.443724 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-e3e3bb64-9970-46d7-bd41-741e8f9717f3 req-3374cc70-3841-4459-9099-3f3190c741c5 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:15.444248 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-e3e3bb64-9970-46d7-bd41-741e8f9717f3 req-3374cc70-3841-4459-9099-3f3190c741c5 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:15.462185 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-e3e3bb64-9970-46d7-bd41-741e8f9717f3 req-3374cc70-3841-4459-9099-3f3190c741c5 service nova] Creating event network-changed:c8075c9e-8845-461b-859a-ca04ebb3e039 for instance 05be7894-901d-4845-be17-f6e12dc9f6f3 on nch1-master-1 Apr 16 21:38:15.467498 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-e3e3bb64-9970-46d7-bd41-741e8f9717f3 req-3374cc70-3841-4459-9099-3f3190c741c5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.192478 Apr 16 21:38:15.468215 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2981/6122] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:38:15.686501 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e895d916-62bc-4ddb-b526-bd68ef049ebd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:38:15.687324 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e895d916-62bc-4ddb-b526-bd68ef049ebd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 05be7894-901d-4845-be17-f6e12dc9f6f3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:38:15.693977 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e895d916-62bc-4ddb-b526-bd68ef049ebd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:15.694433 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e895d916-62bc-4ddb-b526-bd68ef049ebd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:15.695395 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e895d916-62bc-4ddb-b526-bd68ef049ebd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:15.699299 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e895d916-62bc-4ddb-b526-bd68ef049ebd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:15.839090 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e895d916-62bc-4ddb-b526-bd68ef049ebd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:38:15.847330 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e895d916-62bc-4ddb-b526-bd68ef049ebd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3" status: 200 len: 1390 microversion: 2.1 time: 0.164259 Apr 16 21:38:15.847903 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3142/6123] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:38:15 2022] GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3 => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:38:16.871449 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ecce52c6-19fd-44e5-a85d-e53e73e59fe3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:38:16.872336 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ecce52c6-19fd-44e5-a85d-e53e73e59fe3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 05be7894-901d-4845-be17-f6e12dc9f6f3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:38:16.879334 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ecce52c6-19fd-44e5-a85d-e53e73e59fe3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:16.879792 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ecce52c6-19fd-44e5-a85d-e53e73e59fe3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:16.880627 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ecce52c6-19fd-44e5-a85d-e53e73e59fe3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:16.881076 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ecce52c6-19fd-44e5-a85d-e53e73e59fe3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:17.087959 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ecce52c6-19fd-44e5-a85d-e53e73e59fe3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:38:17.095896 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ecce52c6-19fd-44e5-a85d-e53e73e59fe3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3" status: 200 len: 1390 microversion: 2.1 time: 0.229956 Apr 16 21:38:17.097126 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2982/6124] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:38:16 2022] GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3 => generated 1390 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:38:18.113873 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9f718937-ba07-4448-abc1-eaff96b97953 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:38:18.114481 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9f718937-ba07-4448-abc1-eaff96b97953 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 05be7894-901d-4845-be17-f6e12dc9f6f3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:38:18.121241 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9f718937-ba07-4448-abc1-eaff96b97953 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:18.121697 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9f718937-ba07-4448-abc1-eaff96b97953 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:18.122468 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9f718937-ba07-4448-abc1-eaff96b97953 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:18.122912 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9f718937-ba07-4448-abc1-eaff96b97953 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:18.257512 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9f718937-ba07-4448-abc1-eaff96b97953 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:38:18.265089 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9f718937-ba07-4448-abc1-eaff96b97953 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3" status: 200 len: 1390 microversion: 2.1 time: 0.155670 Apr 16 21:38:18.265650 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3143/6125] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:38:18 2022] GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3 => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:38:19.282229 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-484bc468-e660-46d3-a367-0a6985550248 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:38:19.282866 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-484bc468-e660-46d3-a367-0a6985550248 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 05be7894-901d-4845-be17-f6e12dc9f6f3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:38:19.290177 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-484bc468-e660-46d3-a367-0a6985550248 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:19.290896 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-484bc468-e660-46d3-a367-0a6985550248 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:19.291858 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-484bc468-e660-46d3-a367-0a6985550248 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:19.292139 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-484bc468-e660-46d3-a367-0a6985550248 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:19.505525 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-484bc468-e660-46d3-a367-0a6985550248 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:38:19.513161 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-484bc468-e660-46d3-a367-0a6985550248 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3" status: 200 len: 1390 microversion: 2.1 time: 0.235140 Apr 16 21:38:19.513733 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2983/6126] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:38:19 2022] GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3 => generated 1390 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:38:20.531435 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0c962502-b093-4ae0-a71f-903c1df98a4c tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:38:20.532212 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0c962502-b093-4ae0-a71f-903c1df98a4c tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 05be7894-901d-4845-be17-f6e12dc9f6f3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:38:20.539145 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0c962502-b093-4ae0-a71f-903c1df98a4c tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:20.539608 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0c962502-b093-4ae0-a71f-903c1df98a4c tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:20.540460 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0c962502-b093-4ae0-a71f-903c1df98a4c tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:20.540907 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0c962502-b093-4ae0-a71f-903c1df98a4c tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:20.607193 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-8aaafc67-d0b4-45db-8cc5-91ce62ad187d req-287d5a66-b6f8-4549-9d28-0e27eb86c265 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05be7894-901d-4845-be17-f6e12dc9f6f3", "name": "network-vif-plugged", "status": "completed", "tag": "c8075c9e-8845-461b-859a-ca04ebb3e039"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:38:20.619653 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-8aaafc67-d0b4-45db-8cc5-91ce62ad187d req-287d5a66-b6f8-4549-9d28-0e27eb86c265 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:20.620119 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-8aaafc67-d0b4-45db-8cc5-91ce62ad187d req-287d5a66-b6f8-4549-9d28-0e27eb86c265 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:20.634401 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-8aaafc67-d0b4-45db-8cc5-91ce62ad187d req-287d5a66-b6f8-4549-9d28-0e27eb86c265 service nova] Creating event network-vif-plugged:c8075c9e-8845-461b-859a-ca04ebb3e039 for instance 05be7894-901d-4845-be17-f6e12dc9f6f3 on nch1-master-1 Apr 16 21:38:20.640033 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-8aaafc67-d0b4-45db-8cc5-91ce62ad187d req-287d5a66-b6f8-4549-9d28-0e27eb86c265 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037973 Apr 16 21:38:20.640738 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2984/6127] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:38:20.698822 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0c962502-b093-4ae0-a71f-903c1df98a4c tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:38:20.708080 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0c962502-b093-4ae0-a71f-903c1df98a4c tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3" status: 200 len: 1390 microversion: 2.1 time: 0.180856 Apr 16 21:38:20.709251 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3144/6128] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:38:20 2022] GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3 => generated 1390 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:38:21.585256 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ac4074be-c021-49da-8b12-84c5e2cf8eeb tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:38:21.585256 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ac4074be-c021-49da-8b12-84c5e2cf8eeb tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:38:21.589820 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ac4074be-c021-49da-8b12-84c5e2cf8eeb tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:21.590288 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ac4074be-c021-49da-8b12-84c5e2cf8eeb tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:21.591171 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ac4074be-c021-49da-8b12-84c5e2cf8eeb tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:21.591615 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ac4074be-c021-49da-8b12-84c5e2cf8eeb tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:21.621018 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ac4074be-c021-49da-8b12-84c5e2cf8eeb tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043568 Apr 16 21:38:21.621671 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2985/6129] 10.222.0.20 () {60 vars in 1342 bytes} [Sat Apr 16 21:38:21 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:38:21.696155 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b4e56a35-1e8d-4136-814f-e4c8b21c069b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:38:21.696693 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b4e56a35-1e8d-4136-814f-e4c8b21c069b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:38:21.703623 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b4e56a35-1e8d-4136-814f-e4c8b21c069b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:21.704081 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b4e56a35-1e8d-4136-814f-e4c8b21c069b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:21.704887 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b4e56a35-1e8d-4136-814f-e4c8b21c069b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:21.705513 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b4e56a35-1e8d-4136-814f-e4c8b21c069b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:21.725483 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6eca6790-9cc6-40d3-b00f-7a9b08eb9f6e tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:38:21.726195 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6eca6790-9cc6-40d3-b00f-7a9b08eb9f6e tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 05be7894-901d-4845-be17-f6e12dc9f6f3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:38:21.732187 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b4e56a35-1e8d-4136-814f-e4c8b21c069b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:38:21.733821 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6eca6790-9cc6-40d3-b00f-7a9b08eb9f6e tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:21.734291 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6eca6790-9cc6-40d3-b00f-7a9b08eb9f6e tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:21.735165 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6eca6790-9cc6-40d3-b00f-7a9b08eb9f6e tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:21.735620 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6eca6790-9cc6-40d3-b00f-7a9b08eb9f6e tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:21.884721 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6eca6790-9cc6-40d3-b00f-7a9b08eb9f6e tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:38:21.897172 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6eca6790-9cc6-40d3-b00f-7a9b08eb9f6e tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3" status: 200 len: 1390 microversion: 2.1 time: 0.176130 Apr 16 21:38:21.897691 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2986/6130] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:38:21 2022] GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3 => generated 1390 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:38:22.061097 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b4e56a35-1e8d-4136-814f-e4c8b21c069b tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "DELETE /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 204 len: 0 microversion: 2.20 time: 0.368835 Apr 16 21:38:22.062114 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3145/6131] 10.222.0.20 () {60 vars in 1279 bytes} [Sat Apr 16 21:38:21 2022] DELETE /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 16 21:38:22.071282 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f1aa802e-ac71-459e-a125-d2444545e84a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:38:22.071953 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f1aa802e-ac71-459e-a125-d2444545e84a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:38:22.078384 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f1aa802e-ac71-459e-a125-d2444545e84a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:22.078855 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f1aa802e-ac71-459e-a125-d2444545e84a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:22.079658 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f1aa802e-ac71-459e-a125-d2444545e84a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:22.080115 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f1aa802e-ac71-459e-a125-d2444545e84a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:22.215312 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f1aa802e-ac71-459e-a125-d2444545e84a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:38:22.224037 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f1aa802e-ac71-459e-a125-d2444545e84a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:38:22.225641 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f1aa802e-ac71-459e-a125-d2444545e84a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:38:22.226859 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f1aa802e-ac71-459e-a125-d2444545e84a tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1723 microversion: 2.20 time: 0.159561 Apr 16 21:38:22.227410 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2987/6132] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:38:22 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:38:22.915381 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-06a5eaaa-985e-4598-9ad9-ca611ec047de tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:38:22.916115 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-06a5eaaa-985e-4598-9ad9-ca611ec047de tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 05be7894-901d-4845-be17-f6e12dc9f6f3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:38:22.922948 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-06a5eaaa-985e-4598-9ad9-ca611ec047de tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:22.923405 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-06a5eaaa-985e-4598-9ad9-ca611ec047de tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:22.924191 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-06a5eaaa-985e-4598-9ad9-ca611ec047de tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:22.924636 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-06a5eaaa-985e-4598-9ad9-ca611ec047de tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:23.057101 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-06a5eaaa-985e-4598-9ad9-ca611ec047de tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:38:23.065008 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-06a5eaaa-985e-4598-9ad9-ca611ec047de tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3" status: 200 len: 1562 microversion: 2.1 time: 0.153936 Apr 16 21:38:23.065582 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3146/6133] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:38:22 2022] GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3 => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:38:23.080868 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fdd383ee-5a05-4d48-b41b-19b7d50f8f6c tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:38:23.082136 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-fdd383ee-5a05-4d48-b41b-19b7d50f8f6c tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 05be7894-901d-4845-be17-f6e12dc9f6f3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:38:23.089009 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fdd383ee-5a05-4d48-b41b-19b7d50f8f6c tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:23.089476 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fdd383ee-5a05-4d48-b41b-19b7d50f8f6c tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:23.090255 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fdd383ee-5a05-4d48-b41b-19b7d50f8f6c tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:23.090703 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fdd383ee-5a05-4d48-b41b-19b7d50f8f6c tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:23.223195 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-fdd383ee-5a05-4d48-b41b-19b7d50f8f6c tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:38:23.230681 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fdd383ee-5a05-4d48-b41b-19b7d50f8f6c tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3" status: 200 len: 1562 microversion: 2.1 time: 0.153607 Apr 16 21:38:23.231261 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2988/6134] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:38:23 2022] GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3 => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:38:23.245625 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-318d5fd6-eed9-4ee5-8bb0-d9f94f043ce8 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:38:23.249889 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-318d5fd6-eed9-4ee5-8bb0-d9f94f043ce8 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:38:23.256982 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-318d5fd6-eed9-4ee5-8bb0-d9f94f043ce8 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:23.257458 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-318d5fd6-eed9-4ee5-8bb0-d9f94f043ce8 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:23.258171 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-318d5fd6-eed9-4ee5-8bb0-d9f94f043ce8 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:23.258619 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-318d5fd6-eed9-4ee5-8bb0-d9f94f043ce8 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:23.395120 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-318d5fd6-eed9-4ee5-8bb0-d9f94f043ce8 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:38:23.403427 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-318d5fd6-eed9-4ee5-8bb0-d9f94f043ce8 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:38:23.404996 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-318d5fd6-eed9-4ee5-8bb0-d9f94f043ce8 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:38:23.406178 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-318d5fd6-eed9-4ee5-8bb0-d9f94f043ce8 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1723 microversion: 2.20 time: 0.164494 Apr 16 21:38:23.406746 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3147/6135] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:38:23 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:38:24.424810 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-daae5b4f-f4b5-4f25-902d-f66b70452426 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:38:24.426105 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-daae5b4f-f4b5-4f25-902d-f66b70452426 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:38:24.433029 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-daae5b4f-f4b5-4f25-902d-f66b70452426 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:24.433626 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-daae5b4f-f4b5-4f25-902d-f66b70452426 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:24.434427 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-daae5b4f-f4b5-4f25-902d-f66b70452426 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:24.434878 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-daae5b4f-f4b5-4f25-902d-f66b70452426 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:24.753802 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-daae5b4f-f4b5-4f25-902d-f66b70452426 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:38:24.764401 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-daae5b4f-f4b5-4f25-902d-f66b70452426 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:38:24.766205 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-daae5b4f-f4b5-4f25-902d-f66b70452426 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:38:24.767500 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-daae5b4f-f4b5-4f25-902d-f66b70452426 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1723 microversion: 2.20 time: 0.346647 Apr 16 21:38:24.768292 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2989/6136] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:38:24 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1723 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:38:25.539482 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-72a96fd4-14d8-4c79-b749-3858698f63f9 req-e61ae7a5-c21e-4260-be79-aad429bdd24e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25cb82d7-b342-407d-8f63-71670d8f22d9", "name": "network-vif-deleted", "tag": "32c60358-6ed6-4d01-a515-c08c9770f288"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:38:25.552469 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-72a96fd4-14d8-4c79-b749-3858698f63f9 req-e61ae7a5-c21e-4260-be79-aad429bdd24e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:25.553199 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-72a96fd4-14d8-4c79-b749-3858698f63f9 req-e61ae7a5-c21e-4260-be79-aad429bdd24e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:25.566603 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-72a96fd4-14d8-4c79-b749-3858698f63f9 req-e61ae7a5-c21e-4260-be79-aad429bdd24e service nova] Creating event network-vif-deleted:32c60358-6ed6-4d01-a515-c08c9770f288 for instance 25cb82d7-b342-407d-8f63-71670d8f22d9 on nch2-master-1 Apr 16 21:38:25.571844 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-72a96fd4-14d8-4c79-b749-3858698f63f9 req-e61ae7a5-c21e-4260-be79-aad429bdd24e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036104 Apr 16 21:38:25.572905 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3148/6137] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:38:25.787215 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3812fb72-24c7-4f85-9b30-a3bf0c74b300 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:38:25.788044 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3812fb72-24c7-4f85-9b30-a3bf0c74b300 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:38:25.794625 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3812fb72-24c7-4f85-9b30-a3bf0c74b300 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:25.795095 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3812fb72-24c7-4f85-9b30-a3bf0c74b300 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:25.795902 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3812fb72-24c7-4f85-9b30-a3bf0c74b300 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:25.796443 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3812fb72-24c7-4f85-9b30-a3bf0c74b300 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:25.872085 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3812fb72-24c7-4f85-9b30-a3bf0c74b300 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:38:25.880688 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3812fb72-24c7-4f85-9b30-a3bf0c74b300 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:38:25.883112 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3812fb72-24c7-4f85-9b30-a3bf0c74b300 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e007558161974720bb11a4e7588af0c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d3a8f4590014b8d9738bd3739f08c0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:38:25.887115 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3812fb72-24c7-4f85-9b30-a3bf0c74b300 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 200 len: 1365 microversion: 2.20 time: 0.103888 Apr 16 21:38:25.889682 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2990/6138] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:38:25 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 1365 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 16 21:38:26.917027 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1dcee533-3ea9-47f8-b3cf-c86302ab3377 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:38:26.921014 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1dcee533-3ea9-47f8-b3cf-c86302ab3377 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:38:26.937070 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1dcee533-3ea9-47f8-b3cf-c86302ab3377 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:26.937631 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1dcee533-3ea9-47f8-b3cf-c86302ab3377 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:26.939366 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1dcee533-3ea9-47f8-b3cf-c86302ab3377 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:26.939919 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1dcee533-3ea9-47f8-b3cf-c86302ab3377 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:26.956546 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-1dcee533-3ea9-47f8-b3cf-c86302ab3377 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] HTTP exception thrown: Instance 25cb82d7-b342-407d-8f63-71670d8f22d9 could not be found. Apr 16 21:38:26.957255 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1dcee533-3ea9-47f8-b3cf-c86302ab3377 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Returning 404 to user: Instance 25cb82d7-b342-407d-8f63-71670d8f22d9 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:38:26.958177 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1dcee533-3ea9-47f8-b3cf-c86302ab3377 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 404 len: 111 microversion: 2.20 time: 0.054542 Apr 16 21:38:26.959839 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3149/6139] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:38:26 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:38:26.961525 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-182c5ae8-e48e-4e3b-97cd-0c481e3403a8 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:38:26.962501 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-182c5ae8-e48e-4e3b-97cd-0c481e3403a8 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 05be7894-901d-4845-be17-f6e12dc9f6f3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:38:26.970408 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-182c5ae8-e48e-4e3b-97cd-0c481e3403a8 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:26.970973 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-182c5ae8-e48e-4e3b-97cd-0c481e3403a8 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:26.971342 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f600a910-43e6-4c30-8836-3493ac1f5af0 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '.version_select at 0x7fbba004a160>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:38:26.972461 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-182c5ae8-e48e-4e3b-97cd-0c481e3403a8 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:26.972956 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-182c5ae8-e48e-4e3b-97cd-0c481e3403a8 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:27.109685 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-182c5ae8-e48e-4e3b-97cd-0c481e3403a8 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:38:27.117302 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-182c5ae8-e48e-4e3b-97cd-0c481e3403a8 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3" status: 200 len: 1562 microversion: 2.1 time: 0.162090 Apr 16 21:38:27.117880 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2991/6140] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:38:26 2022] GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3 => generated 1562 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:38:27.129593 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f600a910-43e6-4c30-8836-3493ac1f5af0 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-703218455" status: 204 len: 0 microversion: 2.20 time: 0.162034 Apr 16 21:38:27.131329 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3150/6141] 10.222.0.20 () {60 vars in 1258 bytes} [Sat Apr 16 21:38:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-703218455 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 16 21:38:27.598182 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-620cf40d-2fe4-4e6e-9f7d-da895992656a req-ab001c08-2f1e-4b1c-b1ea-5b05c30c7a9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05be7894-901d-4845-be17-f6e12dc9f6f3", "tag": "c8075c9e-8845-461b-859a-ca04ebb3e039"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:38:27.616917 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-620cf40d-2fe4-4e6e-9f7d-da895992656a req-ab001c08-2f1e-4b1c-b1ea-5b05c30c7a9e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:27.617621 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-620cf40d-2fe4-4e6e-9f7d-da895992656a req-ab001c08-2f1e-4b1c-b1ea-5b05c30c7a9e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:27.633015 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-620cf40d-2fe4-4e6e-9f7d-da895992656a req-ab001c08-2f1e-4b1c-b1ea-5b05c30c7a9e service nova] Creating event network-changed:c8075c9e-8845-461b-859a-ca04ebb3e039 for instance 05be7894-901d-4845-be17-f6e12dc9f6f3 on nch1-master-1 Apr 16 21:38:27.652122 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-620cf40d-2fe4-4e6e-9f7d-da895992656a req-ab001c08-2f1e-4b1c-b1ea-5b05c30c7a9e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059573 Apr 16 21:38:27.653079 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2992/6142] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:38:46.451056 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-18c4ac0c-0cf3-4b5e-b7ff-74da85dd06fd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:38:46.451932 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-18c4ac0c-0cf3-4b5e-b7ff-74da85dd06fd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 05be7894-901d-4845-be17-f6e12dc9f6f3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:38:46.458892 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-18c4ac0c-0cf3-4b5e-b7ff-74da85dd06fd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:46.459375 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-18c4ac0c-0cf3-4b5e-b7ff-74da85dd06fd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:46.460139 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-18c4ac0c-0cf3-4b5e-b7ff-74da85dd06fd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:46.460613 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-18c4ac0c-0cf3-4b5e-b7ff-74da85dd06fd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:46.514038 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-18c4ac0c-0cf3-4b5e-b7ff-74da85dd06fd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "POST /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3/action" status: 200 len: 24574 microversion: 2.1 time: 0.068024 Apr 16 21:38:46.514709 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3151/6143] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:38:46 2022] POST /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3/action => generated 24574 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:38:54.757878 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e19a5123-b683-4c1b-bf9a-40e3da366465 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:38:54.758609 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e19a5123-b683-4c1b-bf9a-40e3da366465 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:38:54.765836 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e19a5123-b683-4c1b-bf9a-40e3da366465 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:54.766302 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e19a5123-b683-4c1b-bf9a-40e3da366465 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:54.767096 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e19a5123-b683-4c1b-bf9a-40e3da366465 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:54.767547 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e19a5123-b683-4c1b-bf9a-40e3da366465 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:54.781016 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-e19a5123-b683-4c1b-bf9a-40e3da366465 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] HTTP exception thrown: Instance 25cb82d7-b342-407d-8f63-71670d8f22d9 could not be found. Apr 16 21:38:54.781632 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e19a5123-b683-4c1b-bf9a-40e3da366465 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Returning 404 to user: Instance 25cb82d7-b342-407d-8f63-71670d8f22d9 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:38:54.782471 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e19a5123-b683-4c1b-bf9a-40e3da366465 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "DELETE /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 404 len: 111 microversion: 2.20 time: 0.030744 Apr 16 21:38:54.783012 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2993/6144] 10.222.0.20 () {60 vars in 1279 bytes} [Sat Apr 16 21:38:54 2022] DELETE /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:38:54.792533 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0388573c-c42b-48e1-915b-719594f5aa10 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:38:54.793247 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0388573c-c42b-48e1-915b-719594f5aa10 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: 25cb82d7-b342-407d-8f63-71670d8f22d9] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:38:54.800788 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0388573c-c42b-48e1-915b-719594f5aa10 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:54.801446 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0388573c-c42b-48e1-915b-719594f5aa10 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:54.802248 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0388573c-c42b-48e1-915b-719594f5aa10 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:54.802698 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0388573c-c42b-48e1-915b-719594f5aa10 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:54.820476 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-0388573c-c42b-48e1-915b-719594f5aa10 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] HTTP exception thrown: Instance 25cb82d7-b342-407d-8f63-71670d8f22d9 could not be found. Apr 16 21:38:54.821092 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0388573c-c42b-48e1-915b-719594f5aa10 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Returning 404 to user: Instance 25cb82d7-b342-407d-8f63-71670d8f22d9 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:38:54.821952 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0388573c-c42b-48e1-915b-719594f5aa10 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9" status: 404 len: 111 microversion: 2.20 time: 0.034463 Apr 16 21:38:54.822519 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3152/6145] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:38:54 2022] GET /compute/v2.1/servers/25cb82d7-b342-407d-8f63-71670d8f22d9 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:38:57.495910 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-482f1f3d-ea9c-4af8-b391-b97a186782fe tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:38:57.495910 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-482f1f3d-ea9c-4af8-b391-b97a186782fe tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 05be7894-901d-4845-be17-f6e12dc9f6f3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:38:57.502395 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-482f1f3d-ea9c-4af8-b391-b97a186782fe tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:57.502873 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-482f1f3d-ea9c-4af8-b391-b97a186782fe tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:57.503675 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-482f1f3d-ea9c-4af8-b391-b97a186782fe tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:57.504129 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-482f1f3d-ea9c-4af8-b391-b97a186782fe tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:57.645905 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-482f1f3d-ea9c-4af8-b391-b97a186782fe tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:38:57.657582 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-482f1f3d-ea9c-4af8-b391-b97a186782fe tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3" status: 200 len: 1681 microversion: 2.1 time: 0.167496 Apr 16 21:38:57.658170 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2994/6146] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:38:57 2022] GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3 => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:38:57.768275 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4f71366e-2121-4d0a-81be-0e369fc1a0e6 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:38:57.769196 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4f71366e-2121-4d0a-81be-0e369fc1a0e6 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 05be7894-901d-4845-be17-f6e12dc9f6f3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:38:57.776340 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4f71366e-2121-4d0a-81be-0e369fc1a0e6 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:57.776842 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4f71366e-2121-4d0a-81be-0e369fc1a0e6 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:57.777620 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4f71366e-2121-4d0a-81be-0e369fc1a0e6 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:57.778065 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4f71366e-2121-4d0a-81be-0e369fc1a0e6 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:57.833020 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4f71366e-2121-4d0a-81be-0e369fc1a0e6 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "POST /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3/action" status: 200 len: 32649 microversion: 2.1 time: 0.068822 Apr 16 21:38:57.833821 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3153/6147] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:38:57 2022] POST /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3/action => generated 32649 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:38:57.998065 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0170bb78-8fbc-42f0-b014-7dba19234055 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:38:57.998826 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0170bb78-8fbc-42f0-b014-7dba19234055 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] [instance: 05be7894-901d-4845-be17-f6e12dc9f6f3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:38:58.004970 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0170bb78-8fbc-42f0-b014-7dba19234055 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:58.007530 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0170bb78-8fbc-42f0-b014-7dba19234055 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:58.008404 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0170bb78-8fbc-42f0-b014-7dba19234055 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:58.008855 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0170bb78-8fbc-42f0-b014-7dba19234055 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:58.140844 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0170bb78-8fbc-42f0-b014-7dba19234055 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3" status: 200 len: 1832 microversion: 2.1 time: 0.146526 Apr 16 21:38:58.141418 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2995/6148] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:38:57 2022] GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3 => generated 1832 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:38:58.158906 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6442d3c3-3e8f-4fba-b98c-cedb50187651 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:38:58.160880 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6442d3c3-3e8f-4fba-b98c-cedb50187651 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] [instance: 05be7894-901d-4845-be17-f6e12dc9f6f3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:38:58.167199 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6442d3c3-3e8f-4fba-b98c-cedb50187651 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:58.167842 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6442d3c3-3e8f-4fba-b98c-cedb50187651 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:58.169200 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6442d3c3-3e8f-4fba-b98c-cedb50187651 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:38:58.169200 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6442d3c3-3e8f-4fba-b98c-cedb50187651 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:38:58.197491 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-6442d3c3-3e8f-4fba-b98c-cedb50187651 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Lazy-loading 'flavor' on Instance uuid 05be7894-901d-4845-be17-f6e12dc9f6f3 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:38:58.210002 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6442d3c3-3e8f-4fba-b98c-cedb50187651 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] [instance: 05be7894-901d-4845-be17-f6e12dc9f6f3] Going to try to live migrate instance to another host {{(pid=137408) live_migrate /opt/stack/nova/nova/compute/api.py:5347}} Apr 16 21:39:00.853892 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6442d3c3-3e8f-4fba-b98c-cedb50187651 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3/action" status: 202 len: 0 microversion: 2.1 time: 2.699489 Apr 16 21:39:00.854756 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3154/6149] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:38:58 2022] POST /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3/action => generated 0 bytes in 2701 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:39:00.862639 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b412cfe6-3dcd-470d-885b-5ed708f34458 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:00.863296 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b412cfe6-3dcd-470d-885b-5ed708f34458 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 05be7894-901d-4845-be17-f6e12dc9f6f3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:00.870020 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b412cfe6-3dcd-470d-885b-5ed708f34458 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:00.870484 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b412cfe6-3dcd-470d-885b-5ed708f34458 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:00.871273 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b412cfe6-3dcd-470d-885b-5ed708f34458 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:00.871722 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b412cfe6-3dcd-470d-885b-5ed708f34458 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:01.004858 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b412cfe6-3dcd-470d-885b-5ed708f34458 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:01.013046 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b412cfe6-3dcd-470d-885b-5ed708f34458 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3" status: 200 len: 1691 microversion: 2.1 time: 0.154308 Apr 16 21:39:01.013645 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2996/6150] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:00 2022] GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3 => generated 1691 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:39:02.031045 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e14b41ed-5840-4889-b783-93dd565121fd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:02.031666 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e14b41ed-5840-4889-b783-93dd565121fd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 05be7894-901d-4845-be17-f6e12dc9f6f3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:02.039642 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e14b41ed-5840-4889-b783-93dd565121fd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:02.040107 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e14b41ed-5840-4889-b783-93dd565121fd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:02.040931 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e14b41ed-5840-4889-b783-93dd565121fd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:02.041387 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e14b41ed-5840-4889-b783-93dd565121fd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:02.201862 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e14b41ed-5840-4889-b783-93dd565121fd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:02.209324 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e14b41ed-5840-4889-b783-93dd565121fd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3" status: 200 len: 1691 microversion: 2.1 time: 0.182122 Apr 16 21:39:02.210455 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3155/6151] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:02 2022] GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3 => generated 1691 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:39:02.385595 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-78a6a09f-bf90-41bb-80c8-b3525b86685c req-a481a36d-2834-401d-97a4-0e241fd941d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05be7894-901d-4845-be17-f6e12dc9f6f3", "name": "network-vif-unplugged", "status": "completed", "tag": "c8075c9e-8845-461b-859a-ca04ebb3e039"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:39:02.394723 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-78a6a09f-bf90-41bb-80c8-b3525b86685c req-a481a36d-2834-401d-97a4-0e241fd941d6 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:02.395180 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-78a6a09f-bf90-41bb-80c8-b3525b86685c req-a481a36d-2834-401d-97a4-0e241fd941d6 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:02.406320 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-78a6a09f-bf90-41bb-80c8-b3525b86685c req-a481a36d-2834-401d-97a4-0e241fd941d6 service nova] Creating event network-vif-unplugged:c8075c9e-8845-461b-859a-ca04ebb3e039 for instance 05be7894-901d-4845-be17-f6e12dc9f6f3 on nch1-master-1 Apr 16 21:39:02.411248 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-78a6a09f-bf90-41bb-80c8-b3525b86685c req-a481a36d-2834-401d-97a4-0e241fd941d6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029887 Apr 16 21:39:02.411837 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2997/6152] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:39:03.228003 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-41b3e1e3-4bd5-4d2f-b896-8c639647faf3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:03.228778 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-41b3e1e3-4bd5-4d2f-b896-8c639647faf3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 05be7894-901d-4845-be17-f6e12dc9f6f3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:03.235510 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-41b3e1e3-4bd5-4d2f-b896-8c639647faf3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:03.235975 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-41b3e1e3-4bd5-4d2f-b896-8c639647faf3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:03.236808 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-41b3e1e3-4bd5-4d2f-b896-8c639647faf3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:03.237250 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-41b3e1e3-4bd5-4d2f-b896-8c639647faf3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:03.382441 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-41b3e1e3-4bd5-4d2f-b896-8c639647faf3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:03.390357 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-41b3e1e3-4bd5-4d2f-b896-8c639647faf3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3" status: 200 len: 1691 microversion: 2.1 time: 0.166800 Apr 16 21:39:03.390947 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3156/6153] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:03 2022] GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3 => generated 1691 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:39:03.494598 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-5c7d51c0-3aff-40b8-b9c7-ec3e72a9e000 req-797ed5b5-1975-4aeb-80eb-1355219c193a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05be7894-901d-4845-be17-f6e12dc9f6f3", "name": "network-vif-plugged", "status": "completed", "tag": "c8075c9e-8845-461b-859a-ca04ebb3e039"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:39:03.504436 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-5c7d51c0-3aff-40b8-b9c7-ec3e72a9e000 req-797ed5b5-1975-4aeb-80eb-1355219c193a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:03.504969 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-5c7d51c0-3aff-40b8-b9c7-ec3e72a9e000 req-797ed5b5-1975-4aeb-80eb-1355219c193a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:03.517185 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-5c7d51c0-3aff-40b8-b9c7-ec3e72a9e000 req-797ed5b5-1975-4aeb-80eb-1355219c193a service nova] Creating event network-vif-plugged:c8075c9e-8845-461b-859a-ca04ebb3e039 for instance 05be7894-901d-4845-be17-f6e12dc9f6f3 on nch1-master-1 Apr 16 21:39:03.523483 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-5c7d51c0-3aff-40b8-b9c7-ec3e72a9e000 req-797ed5b5-1975-4aeb-80eb-1355219c193a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.164507 Apr 16 21:39:03.524206 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2998/6154] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:39:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:39:04.409825 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-23d9d0c2-29be-4b44-85a7-8d377a26ef1d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:04.410564 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-23d9d0c2-29be-4b44-85a7-8d377a26ef1d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 05be7894-901d-4845-be17-f6e12dc9f6f3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:04.417298 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-23d9d0c2-29be-4b44-85a7-8d377a26ef1d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:04.417764 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-23d9d0c2-29be-4b44-85a7-8d377a26ef1d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:04.418553 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-23d9d0c2-29be-4b44-85a7-8d377a26ef1d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:04.419001 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-23d9d0c2-29be-4b44-85a7-8d377a26ef1d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:04.426654 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-730583cc-40d7-4d44-81df-2f31d5dba5d5 req-cb29f7c0-a38b-4d58-9a10-0245079fb560 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05be7894-901d-4845-be17-f6e12dc9f6f3", "tag": "c8075c9e-8845-461b-859a-ca04ebb3e039"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:39:04.437322 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-730583cc-40d7-4d44-81df-2f31d5dba5d5 req-cb29f7c0-a38b-4d58-9a10-0245079fb560 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:04.437880 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-730583cc-40d7-4d44-81df-2f31d5dba5d5 req-cb29f7c0-a38b-4d58-9a10-0245079fb560 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:04.451265 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-730583cc-40d7-4d44-81df-2f31d5dba5d5 req-cb29f7c0-a38b-4d58-9a10-0245079fb560 service nova] Creating event network-changed:c8075c9e-8845-461b-859a-ca04ebb3e039 for instance 05be7894-901d-4845-be17-f6e12dc9f6f3 on nch1-master-1 Apr 16 21:39:04.458314 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-730583cc-40d7-4d44-81df-2f31d5dba5d5 req-cb29f7c0-a38b-4d58-9a10-0245079fb560 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035602 Apr 16 21:39:04.458928 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 2999/6155] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:39:04.566137 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-23d9d0c2-29be-4b44-85a7-8d377a26ef1d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:04.574099 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-23d9d0c2-29be-4b44-85a7-8d377a26ef1d tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3" status: 200 len: 1691 microversion: 2.1 time: 0.168252 Apr 16 21:39:04.580308 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3157/6156] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:04 2022] GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3 => generated 1691 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:39:05.593238 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d7146c12-e008-4769-bf6c-59054d03f184 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:05.594392 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d7146c12-e008-4769-bf6c-59054d03f184 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 05be7894-901d-4845-be17-f6e12dc9f6f3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:05.601426 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d7146c12-e008-4769-bf6c-59054d03f184 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:05.603354 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d7146c12-e008-4769-bf6c-59054d03f184 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:05.604199 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d7146c12-e008-4769-bf6c-59054d03f184 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:05.604668 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d7146c12-e008-4769-bf6c-59054d03f184 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:05.749939 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d7146c12-e008-4769-bf6c-59054d03f184 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:05.757521 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d7146c12-e008-4769-bf6c-59054d03f184 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3" status: 200 len: 1691 microversion: 2.1 time: 0.169527 Apr 16 21:39:05.758088 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3000/6157] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:05 2022] GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3 => generated 1691 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:39:06.775626 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e3abce66-451e-4f95-8f54-58b9b8bbd8a7 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:06.776359 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e3abce66-451e-4f95-8f54-58b9b8bbd8a7 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 05be7894-901d-4845-be17-f6e12dc9f6f3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:06.786740 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e3abce66-451e-4f95-8f54-58b9b8bbd8a7 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:06.787238 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e3abce66-451e-4f95-8f54-58b9b8bbd8a7 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:06.788085 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e3abce66-451e-4f95-8f54-58b9b8bbd8a7 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:06.788558 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e3abce66-451e-4f95-8f54-58b9b8bbd8a7 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:06.924520 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e3abce66-451e-4f95-8f54-58b9b8bbd8a7 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:06.932249 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e3abce66-451e-4f95-8f54-58b9b8bbd8a7 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3" status: 200 len: 1691 microversion: 2.1 time: 0.161455 Apr 16 21:39:06.933967 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3158/6158] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:06 2022] GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3 => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:39:07.950072 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-40397eaf-a078-4a2b-bfe8-810a696ba4dc tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:07.950688 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-40397eaf-a078-4a2b-bfe8-810a696ba4dc tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 05be7894-901d-4845-be17-f6e12dc9f6f3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:07.957430 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-40397eaf-a078-4a2b-bfe8-810a696ba4dc tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:07.957883 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-40397eaf-a078-4a2b-bfe8-810a696ba4dc tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:07.958651 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-40397eaf-a078-4a2b-bfe8-810a696ba4dc tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:07.959161 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-40397eaf-a078-4a2b-bfe8-810a696ba4dc tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:08.094779 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-40397eaf-a078-4a2b-bfe8-810a696ba4dc tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:08.102333 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-40397eaf-a078-4a2b-bfe8-810a696ba4dc tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3" status: 200 len: 1691 microversion: 2.1 time: 0.156283 Apr 16 21:39:08.102926 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3001/6159] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:07 2022] GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3 => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:39:09.118940 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fd47215d-6e83-420a-966e-38ea5d786349 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:09.119562 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fd47215d-6e83-420a-966e-38ea5d786349 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 05be7894-901d-4845-be17-f6e12dc9f6f3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:09.126556 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fd47215d-6e83-420a-966e-38ea5d786349 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:09.127020 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fd47215d-6e83-420a-966e-38ea5d786349 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:09.127797 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fd47215d-6e83-420a-966e-38ea5d786349 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:09.128303 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fd47215d-6e83-420a-966e-38ea5d786349 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:09.267939 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fd47215d-6e83-420a-966e-38ea5d786349 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:09.277256 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fd47215d-6e83-420a-966e-38ea5d786349 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3" status: 200 len: 1691 microversion: 2.1 time: 0.162327 Apr 16 21:39:09.277827 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3159/6160] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:09 2022] GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3 => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:39:10.294284 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8f0df3ba-ab7e-4134-87c2-a7871b15a346 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:10.294931 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8f0df3ba-ab7e-4134-87c2-a7871b15a346 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 05be7894-901d-4845-be17-f6e12dc9f6f3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:10.301803 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8f0df3ba-ab7e-4134-87c2-a7871b15a346 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:10.304393 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8f0df3ba-ab7e-4134-87c2-a7871b15a346 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:10.304393 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8f0df3ba-ab7e-4134-87c2-a7871b15a346 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:10.304393 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8f0df3ba-ab7e-4134-87c2-a7871b15a346 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:10.434765 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8f0df3ba-ab7e-4134-87c2-a7871b15a346 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:10.442236 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8f0df3ba-ab7e-4134-87c2-a7871b15a346 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3" status: 200 len: 1691 microversion: 2.1 time: 0.151872 Apr 16 21:39:10.442811 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3002/6161] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:10 2022] GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3 => generated 1691 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:39:11.459672 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ed596b10-4913-4dd3-8d35-e41b6eef7d7e tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:11.460211 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ed596b10-4913-4dd3-8d35-e41b6eef7d7e tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 05be7894-901d-4845-be17-f6e12dc9f6f3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:11.466987 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ed596b10-4913-4dd3-8d35-e41b6eef7d7e tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:11.467484 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ed596b10-4913-4dd3-8d35-e41b6eef7d7e tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:11.468291 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ed596b10-4913-4dd3-8d35-e41b6eef7d7e tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:11.468736 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ed596b10-4913-4dd3-8d35-e41b6eef7d7e tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:11.612440 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ed596b10-4913-4dd3-8d35-e41b6eef7d7e tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:11.621102 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ed596b10-4913-4dd3-8d35-e41b6eef7d7e tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3" status: 200 len: 1691 microversion: 2.1 time: 0.165981 Apr 16 21:39:11.622639 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3160/6162] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:11 2022] GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3 => generated 1691 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:39:11.938262 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-2b602109-bf3c-4abb-9bf6-449378c9aa48 req-5ba56e5d-f930-4bba-acc9-e4a6ea7caaf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05be7894-901d-4845-be17-f6e12dc9f6f3", "name": "network-vif-unplugged", "status": "completed", "tag": "c8075c9e-8845-461b-859a-ca04ebb3e039"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:39:11.948630 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-2b602109-bf3c-4abb-9bf6-449378c9aa48 req-5ba56e5d-f930-4bba-acc9-e4a6ea7caaf3 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:11.949234 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-2b602109-bf3c-4abb-9bf6-449378c9aa48 req-5ba56e5d-f930-4bba-acc9-e4a6ea7caaf3 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:11.961350 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-2b602109-bf3c-4abb-9bf6-449378c9aa48 req-5ba56e5d-f930-4bba-acc9-e4a6ea7caaf3 service nova] Creating event network-vif-unplugged:c8075c9e-8845-461b-859a-ca04ebb3e039 for instance 05be7894-901d-4845-be17-f6e12dc9f6f3 on nch1-master-1 Apr 16 21:39:11.970010 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-2b602109-bf3c-4abb-9bf6-449378c9aa48 req-5ba56e5d-f930-4bba-acc9-e4a6ea7caaf3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035112 Apr 16 21:39:11.970830 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3003/6163] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:39:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:39:12.642080 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-50c4aeaa-4d4e-4ede-aef6-fc58947f19ef tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:12.642080 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-50c4aeaa-4d4e-4ede-aef6-fc58947f19ef tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 05be7894-901d-4845-be17-f6e12dc9f6f3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:12.646903 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-50c4aeaa-4d4e-4ede-aef6-fc58947f19ef tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:12.647362 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-50c4aeaa-4d4e-4ede-aef6-fc58947f19ef tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:12.648148 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-50c4aeaa-4d4e-4ede-aef6-fc58947f19ef tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:12.648688 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-50c4aeaa-4d4e-4ede-aef6-fc58947f19ef tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:12.803837 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-50c4aeaa-4d4e-4ede-aef6-fc58947f19ef tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:12.810472 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-50c4aeaa-4d4e-4ede-aef6-fc58947f19ef tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3" status: 200 len: 1691 microversion: 2.1 time: 0.175517 Apr 16 21:39:12.811073 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3161/6164] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:12 2022] GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3 => generated 1691 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:39:13.829070 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ea5da1d1-e1da-4b77-be83-3d02ecfeaa71 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:13.830589 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ea5da1d1-e1da-4b77-be83-3d02ecfeaa71 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 05be7894-901d-4845-be17-f6e12dc9f6f3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:13.838335 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ea5da1d1-e1da-4b77-be83-3d02ecfeaa71 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:13.838805 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ea5da1d1-e1da-4b77-be83-3d02ecfeaa71 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:13.839695 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ea5da1d1-e1da-4b77-be83-3d02ecfeaa71 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:13.840066 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ea5da1d1-e1da-4b77-be83-3d02ecfeaa71 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:14.064009 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e4876254-2707-4529-ab31-f8936a0b124e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:14.064738 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e4876254-2707-4529-ab31-f8936a0b124e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:14.072905 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e4876254-2707-4529-ab31-f8936a0b124e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:14.073477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e4876254-2707-4529-ab31-f8936a0b124e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:14.076115 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e4876254-2707-4529-ab31-f8936a0b124e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:14.076115 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e4876254-2707-4529-ab31-f8936a0b124e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:14.089808 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-e4876254-2707-4529-ab31-f8936a0b124e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] HTTP exception thrown: Instance b86e6830-cedb-4d55-a3b2-997462319b30 could not be found. Apr 16 21:39:14.090416 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e4876254-2707-4529-ab31-f8936a0b124e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Returning 404 to user: Instance b86e6830-cedb-4d55-a3b2-997462319b30 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:39:14.091564 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e4876254-2707-4529-ab31-f8936a0b124e tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 404 len: 111 microversion: 2.20 time: 0.034756 Apr 16 21:39:14.092529 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3162/6165] 10.222.0.20 () {60 vars in 1279 bytes} [Sat Apr 16 21:39:14 2022] DELETE /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 16 21:39:14.099999 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ea5da1d1-e1da-4b77-be83-3d02ecfeaa71 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:14.102881 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9f6d3cbd-1ff4-411b-aa55-df92572c01f6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:14.106467 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ea5da1d1-e1da-4b77-be83-3d02ecfeaa71 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3" status: 200 len: 1681 microversion: 2.1 time: 0.281684 Apr 16 21:39:14.107285 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3004/6166] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:13 2022] GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3 => generated 1681 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:39:14.116593 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9f6d3cbd-1ff4-411b-aa55-df92572c01f6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] [instance: b86e6830-cedb-4d55-a3b2-997462319b30] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:14.124024 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9f6d3cbd-1ff4-411b-aa55-df92572c01f6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:14.128372 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9f6d3cbd-1ff4-411b-aa55-df92572c01f6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:14.128791 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b2720fec-9b02-46e2-a56f-366f1aab5c04 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:14.128896 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9f6d3cbd-1ff4-411b-aa55-df92572c01f6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:14.128984 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b2720fec-9b02-46e2-a56f-366f1aab5c04 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] [instance: 05be7894-901d-4845-be17-f6e12dc9f6f3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:14.129067 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9f6d3cbd-1ff4-411b-aa55-df92572c01f6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:14.133332 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b2720fec-9b02-46e2-a56f-366f1aab5c04 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:14.133792 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b2720fec-9b02-46e2-a56f-366f1aab5c04 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:14.136350 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b2720fec-9b02-46e2-a56f-366f1aab5c04 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:14.136772 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b2720fec-9b02-46e2-a56f-366f1aab5c04 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:14.150857 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-9f6d3cbd-1ff4-411b-aa55-df92572c01f6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] HTTP exception thrown: Instance b86e6830-cedb-4d55-a3b2-997462319b30 could not be found. Apr 16 21:39:14.150857 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9f6d3cbd-1ff4-411b-aa55-df92572c01f6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] Returning 404 to user: Instance b86e6830-cedb-4d55-a3b2-997462319b30 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:39:14.150857 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9f6d3cbd-1ff4-411b-aa55-df92572c01f6 tempest-AttachVolumeShelveTestJSON-1483033820 tempest-AttachVolumeShelveTestJSON-1483033820-project] 10.222.0.20 "GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30" status: 404 len: 111 microversion: 2.20 time: 0.051945 Apr 16 21:39:14.150857 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3163/6167] 10.222.0.20 () {60 vars in 1276 bytes} [Sat Apr 16 21:39:14 2022] GET /compute/v2.1/servers/b86e6830-cedb-4d55-a3b2-997462319b30 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 16 21:39:14.275482 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b2720fec-9b02-46e2-a56f-366f1aab5c04 tempest-TestNetworkAdvancedServerOps-1387150561 tempest-TestNetworkAdvancedServerOps-1387150561-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3" status: 200 len: 1832 microversion: 2.1 time: 0.155865 Apr 16 21:39:14.276090 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3005/6168] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:14 2022] GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3 => generated 1832 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:39:14.291980 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d517f8a8-11b0-4a51-a52c-382d0c678f9a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:14.295521 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d517f8a8-11b0-4a51-a52c-382d0c678f9a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 05be7894-901d-4845-be17-f6e12dc9f6f3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:14.299067 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d517f8a8-11b0-4a51-a52c-382d0c678f9a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:14.299524 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d517f8a8-11b0-4a51-a52c-382d0c678f9a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:14.300416 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d517f8a8-11b0-4a51-a52c-382d0c678f9a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:14.300947 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d517f8a8-11b0-4a51-a52c-382d0c678f9a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:14.462354 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d517f8a8-11b0-4a51-a52c-382d0c678f9a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:14.470352 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d517f8a8-11b0-4a51-a52c-382d0c678f9a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3" status: 200 len: 1681 microversion: 2.1 time: 0.182227 Apr 16 21:39:14.471081 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3164/6169] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:14 2022] GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3 => generated 1681 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:39:14.570169 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-952e8a77-fc51-46ab-8ab1-d642d32133d2 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:39:14.571143 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-952e8a77-fc51-46ab-8ab1-d642d32133d2 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 05be7894-901d-4845-be17-f6e12dc9f6f3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:14.577130 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-952e8a77-fc51-46ab-8ab1-d642d32133d2 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:14.577591 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-952e8a77-fc51-46ab-8ab1-d642d32133d2 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:14.578362 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-952e8a77-fc51-46ab-8ab1-d642d32133d2 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:14.578802 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-952e8a77-fc51-46ab-8ab1-d642d32133d2 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:14.630340 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-952e8a77-fc51-46ab-8ab1-d642d32133d2 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "POST /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3/action" status: 200 len: 38600 microversion: 2.1 time: 0.063965 Apr 16 21:39:14.636350 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3006/6170] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:39:14 2022] POST /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3/action => generated 38600 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:39:15.926922 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-83cffe6f-16fd-4b2e-880b-10aa21987618 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:15.928436 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-83cffe6f-16fd-4b2e-880b-10aa21987618 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 05be7894-901d-4845-be17-f6e12dc9f6f3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:15.939615 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-66f69af9-c75d-434b-b92c-a2beb2183107 req-30a58fc1-d310-4a98-b25e-808cd0cef9a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05be7894-901d-4845-be17-f6e12dc9f6f3", "tag": "c8075c9e-8845-461b-859a-ca04ebb3e039"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:39:15.948069 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-83cffe6f-16fd-4b2e-880b-10aa21987618 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:15.952644 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-66f69af9-c75d-434b-b92c-a2beb2183107 req-30a58fc1-d310-4a98-b25e-808cd0cef9a3 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:15.953098 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-66f69af9-c75d-434b-b92c-a2beb2183107 req-30a58fc1-d310-4a98-b25e-808cd0cef9a3 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:15.957307 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-83cffe6f-16fd-4b2e-880b-10aa21987618 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:15.958189 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-83cffe6f-16fd-4b2e-880b-10aa21987618 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:15.958669 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-83cffe6f-16fd-4b2e-880b-10aa21987618 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:15.984139 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-66f69af9-c75d-434b-b92c-a2beb2183107 req-30a58fc1-d310-4a98-b25e-808cd0cef9a3 service nova] Creating event network-changed:c8075c9e-8845-461b-859a-ca04ebb3e039 for instance 05be7894-901d-4845-be17-f6e12dc9f6f3 on nch2-master-1 Apr 16 21:39:15.989515 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-66f69af9-c75d-434b-b92c-a2beb2183107 req-30a58fc1-d310-4a98-b25e-808cd0cef9a3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053899 Apr 16 21:39:15.991307 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3007/6171] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:39:16.002601 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-83cffe6f-16fd-4b2e-880b-10aa21987618 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 05be7894-901d-4845-be17-f6e12dc9f6f3] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:39:16.338942 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-83cffe6f-16fd-4b2e-880b-10aa21987618 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "DELETE /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3" status: 204 len: 0 microversion: 2.1 time: 0.415575 Apr 16 21:39:16.340343 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3165/6172] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:39:15 2022] DELETE /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:39:16.353857 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ec396ab6-1bdd-4ca9-99c1-24b7eb2da0a2 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:16.354834 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ec396ab6-1bdd-4ca9-99c1-24b7eb2da0a2 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 05be7894-901d-4845-be17-f6e12dc9f6f3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:16.365725 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ec396ab6-1bdd-4ca9-99c1-24b7eb2da0a2 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:16.367021 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ec396ab6-1bdd-4ca9-99c1-24b7eb2da0a2 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:16.368028 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ec396ab6-1bdd-4ca9-99c1-24b7eb2da0a2 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:16.368656 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ec396ab6-1bdd-4ca9-99c1-24b7eb2da0a2 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:16.685651 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ec396ab6-1bdd-4ca9-99c1-24b7eb2da0a2 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:16.695722 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ec396ab6-1bdd-4ca9-99c1-24b7eb2da0a2 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3" status: 200 len: 1687 microversion: 2.1 time: 0.348401 Apr 16 21:39:16.696484 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3008/6173] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:16 2022] GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3 => generated 1687 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:39:17.714695 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-dde19642-6042-4cd6-a695-6d6dc8f62ff9 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:17.715421 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-dde19642-6042-4cd6-a695-6d6dc8f62ff9 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 05be7894-901d-4845-be17-f6e12dc9f6f3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:17.722603 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dde19642-6042-4cd6-a695-6d6dc8f62ff9 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:17.723071 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dde19642-6042-4cd6-a695-6d6dc8f62ff9 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:17.723946 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dde19642-6042-4cd6-a695-6d6dc8f62ff9 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:17.724422 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dde19642-6042-4cd6-a695-6d6dc8f62ff9 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:17.790146 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-dde19642-6042-4cd6-a695-6d6dc8f62ff9 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:17.798056 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-dde19642-6042-4cd6-a695-6d6dc8f62ff9 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3" status: 200 len: 1501 microversion: 2.1 time: 0.087754 Apr 16 21:39:17.802866 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3166/6174] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:17 2022] GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3 => generated 1501 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:39:18.013465 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-333f35bd-b05b-40a8-9fc2-fc7d64842e3f req-62e762f9-fd85-4f25-9b52-e287c4671a9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05be7894-901d-4845-be17-f6e12dc9f6f3", "name": "network-vif-deleted", "tag": "c8075c9e-8845-461b-859a-ca04ebb3e039"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:39:18.023518 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-333f35bd-b05b-40a8-9fc2-fc7d64842e3f req-62e762f9-fd85-4f25-9b52-e287c4671a9e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:18.023975 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-333f35bd-b05b-40a8-9fc2-fc7d64842e3f req-62e762f9-fd85-4f25-9b52-e287c4671a9e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:18.038843 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-333f35bd-b05b-40a8-9fc2-fc7d64842e3f req-62e762f9-fd85-4f25-9b52-e287c4671a9e service nova] Creating event network-vif-deleted:c8075c9e-8845-461b-859a-ca04ebb3e039 for instance 05be7894-901d-4845-be17-f6e12dc9f6f3 on nch2-master-1 Apr 16 21:39:18.045895 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-333f35bd-b05b-40a8-9fc2-fc7d64842e3f req-62e762f9-fd85-4f25-9b52-e287c4671a9e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042927 Apr 16 21:39:18.046827 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3009/6175] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:39:18.815626 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a83055cf-ca0b-4f27-8bd7-3311276d0624 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:18.816163 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a83055cf-ca0b-4f27-8bd7-3311276d0624 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 05be7894-901d-4845-be17-f6e12dc9f6f3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:18.823653 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a83055cf-ca0b-4f27-8bd7-3311276d0624 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:18.824341 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a83055cf-ca0b-4f27-8bd7-3311276d0624 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:18.825419 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a83055cf-ca0b-4f27-8bd7-3311276d0624 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:18.825893 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a83055cf-ca0b-4f27-8bd7-3311276d0624 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:18.841091 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-a83055cf-ca0b-4f27-8bd7-3311276d0624 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] HTTP exception thrown: Instance 05be7894-901d-4845-be17-f6e12dc9f6f3 could not be found. Apr 16 21:39:18.841946 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a83055cf-ca0b-4f27-8bd7-3311276d0624 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Returning 404 to user: Instance 05be7894-901d-4845-be17-f6e12dc9f6f3 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:39:18.842811 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a83055cf-ca0b-4f27-8bd7-3311276d0624 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3" status: 404 len: 111 microversion: 2.1 time: 0.031427 Apr 16 21:39:18.843377 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3167/6176] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:18 2022] GET /compute/v2.1/servers/05be7894-901d-4845-be17-f6e12dc9f6f3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:39:23.421591 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-56981416-95cd-48ee-9e0c-70d439f82b83 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '.version_select at 0x7fbb964c1b80>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:23.521169 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-56981416-95cd-48ee-9e0c-70d439f82b83 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-581618457" status: 202 len: 0 microversion: 2.1 time: 0.103263 Apr 16 21:39:23.521519 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3010/6177] 10.222.0.20 () {58 vars in 1280 bytes} [Sat Apr 16 21:39:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-581618457 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:39:23.551128 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9496de02-4924-4c4f-9a49-959797bcce3a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Action: 'create', calling method: .version_select at 0x7fbba00020d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1255096748"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:39:23.571906 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-9496de02-4924-4c4f-9a49-959797bcce3a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Getting quotas for project 0ee2ef9a941a429b82a89f7c8f71d45b. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:39:23.580270 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-9496de02-4924-4c4f-9a49-959797bcce3a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Getting quotas for user f27a0cf693a247bb87a8c12193fee719 and project 0ee2ef9a941a429b82a89f7c8f71d45b. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:39:23.840607 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-9496de02-4924-4c4f-9a49-959797bcce3a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Getting quotas for project 0ee2ef9a941a429b82a89f7c8f71d45b. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:39:23.849927 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-9496de02-4924-4c4f-9a49-959797bcce3a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Getting quotas for user f27a0cf693a247bb87a8c12193fee719 and project 0ee2ef9a941a429b82a89f7c8f71d45b. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:39:23.869242 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9496de02-4924-4c4f-9a49-959797bcce3a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2326 microversion: 2.1 time: 0.321742 Apr 16 21:39:23.875550 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3168/6178] 10.222.0.20 () {60 vars in 1157 bytes} [Sat Apr 16 21:39:23 2022] POST /compute/v2.1/os-keypairs => generated 2326 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:39:29.499649 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c0eff5cc-d503-471f-8e68-e2d5458d1adc tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Action: 'create', calling method: .version_select at 0x7fbb96a5cd30>, body: {"keypair": {"name": "tempest-keypair-1824759213"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:39:29.522169 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-c0eff5cc-d503-471f-8e68-e2d5458d1adc tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Getting quotas for project 7fc33178ac5b4d4f9c1f346e3b4371b6. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:39:29.527660 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-c0eff5cc-d503-471f-8e68-e2d5458d1adc tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Getting quotas for user 8b67f0226ea247ae857b18891e0834f8 and project 7fc33178ac5b4d4f9c1f346e3b4371b6. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:39:29.691422 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-c0eff5cc-d503-471f-8e68-e2d5458d1adc tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Getting quotas for project 7fc33178ac5b4d4f9c1f346e3b4371b6. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:39:29.697382 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-c0eff5cc-d503-471f-8e68-e2d5458d1adc tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Getting quotas for user 8b67f0226ea247ae857b18891e0834f8 and project 7fc33178ac5b4d4f9c1f346e3b4371b6. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:39:29.711533 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c0eff5cc-d503-471f-8e68-e2d5458d1adc tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.396834 Apr 16 21:39:29.712125 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3011/6179] 10.222.0.20 () {60 vars in 1157 bytes} [Sat Apr 16 21:39:29 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:39:32.263974 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-15069f8e-18a7-4af1-aa7b-37bd623b39dd tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:32.264569 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-15069f8e-18a7-4af1-aa7b-37bd623b39dd tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] [instance: 83455e10-9079-4214-a0d9-4b07eae7272b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:32.277331 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-15069f8e-18a7-4af1-aa7b-37bd623b39dd tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:32.279269 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-15069f8e-18a7-4af1-aa7b-37bd623b39dd tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:32.281013 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-15069f8e-18a7-4af1-aa7b-37bd623b39dd tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:32.285036 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-15069f8e-18a7-4af1-aa7b-37bd623b39dd tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:32.336860 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-15069f8e-18a7-4af1-aa7b-37bd623b39dd tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] [instance: 83455e10-9079-4214-a0d9-4b07eae7272b] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:39:32.743989 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-15069f8e-18a7-4af1-aa7b-37bd623b39dd tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] 10.222.0.20 "DELETE /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b" status: 204 len: 0 microversion: 2.1 time: 0.863819 Apr 16 21:39:32.754700 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3169/6180] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:39:31 2022] DELETE /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b => generated 0 bytes in 868 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:39:32.770082 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-241da4c7-dfd7-47e5-a5e0-7b2b8d33857e tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:32.772529 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-241da4c7-dfd7-47e5-a5e0-7b2b8d33857e tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] [instance: 83455e10-9079-4214-a0d9-4b07eae7272b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:32.780557 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-241da4c7-dfd7-47e5-a5e0-7b2b8d33857e tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:32.784288 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-241da4c7-dfd7-47e5-a5e0-7b2b8d33857e tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:32.784288 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-241da4c7-dfd7-47e5-a5e0-7b2b8d33857e tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:32.784288 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-241da4c7-dfd7-47e5-a5e0-7b2b8d33857e tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:33.145894 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-241da4c7-dfd7-47e5-a5e0-7b2b8d33857e tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96d2c5371744a65806022c50819f800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551fe53574564e4ea60f7288faf4298f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:33.159961 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-241da4c7-dfd7-47e5-a5e0-7b2b8d33857e tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] 10.222.0.20 "GET /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b" status: 200 len: 1730 microversion: 2.1 time: 0.401646 Apr 16 21:39:33.197374 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3012/6181] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:32 2022] GET /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b => generated 1730 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:39:34.213262 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-66217475-49d3-4631-b6db-4088b452cc4b tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:34.216336 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-66217475-49d3-4631-b6db-4088b452cc4b tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] [instance: 83455e10-9079-4214-a0d9-4b07eae7272b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:34.227745 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-66217475-49d3-4631-b6db-4088b452cc4b tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:34.228506 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-66217475-49d3-4631-b6db-4088b452cc4b tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:34.229813 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-66217475-49d3-4631-b6db-4088b452cc4b tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:34.230607 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-66217475-49d3-4631-b6db-4088b452cc4b tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:34.425077 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9bf2ae21-b9ba-4fcf-bc53-4dacf7183b7e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1946268341", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3e745f17-203e-4728-9fb7-50341f5a0a21"}], "security_groups": [{"name": "tempest-securitygroup--2554426"}], "key_name": "tempest-keypair-1824759213", "user_data": "}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:39:34.622770 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-66217475-49d3-4631-b6db-4088b452cc4b tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96d2c5371744a65806022c50819f800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551fe53574564e4ea60f7288faf4298f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:34.639620 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-66217475-49d3-4631-b6db-4088b452cc4b tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] 10.222.0.20 "GET /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b" status: 200 len: 1730 microversion: 2.1 time: 0.432257 Apr 16 21:39:34.641262 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3170/6182] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:34 2022] GET /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b => generated 1730 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:39:34.889225 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-9bf2ae21-b9ba-4fcf-bc53-4dacf7183b7e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] validate_networks() for [('3e745f17-203e-4728-9fb7-50341f5a0a21', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:39:35.659283 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0269fe15-aa8a-4e49-918e-bde612dd8f6d tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:35.661627 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0269fe15-aa8a-4e49-918e-bde612dd8f6d tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] [instance: 83455e10-9079-4214-a0d9-4b07eae7272b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:35.669769 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0269fe15-aa8a-4e49-918e-bde612dd8f6d tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:35.670927 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0269fe15-aa8a-4e49-918e-bde612dd8f6d tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:35.672036 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0269fe15-aa8a-4e49-918e-bde612dd8f6d tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:35.672615 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0269fe15-aa8a-4e49-918e-bde612dd8f6d tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:35.913567 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-9bf2ae21-b9ba-4fcf-bc53-4dacf7183b7e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:39:35.914114 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-9bf2ae21-b9ba-4fcf-bc53-4dacf7183b7e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:39:35.914681 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-9bf2ae21-b9ba-4fcf-bc53-4dacf7183b7e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:39:35.915289 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-9bf2ae21-b9ba-4fcf-bc53-4dacf7183b7e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:39:35.915948 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-9bf2ae21-b9ba-4fcf-bc53-4dacf7183b7e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:39:35.931964 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9bf2ae21-b9ba-4fcf-bc53-4dacf7183b7e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:35.934050 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9bf2ae21-b9ba-4fcf-bc53-4dacf7183b7e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:35.936465 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9bf2ae21-b9ba-4fcf-bc53-4dacf7183b7e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:35.937262 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9bf2ae21-b9ba-4fcf-bc53-4dacf7183b7e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:35.996607 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0269fe15-aa8a-4e49-918e-bde612dd8f6d tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96d2c5371744a65806022c50819f800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551fe53574564e4ea60f7288faf4298f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:36.006356 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-9bf2ae21-b9ba-4fcf-bc53-4dacf7183b7e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Getting quotas for project 7fc33178ac5b4d4f9c1f346e3b4371b6. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:39:36.017014 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-9bf2ae21-b9ba-4fcf-bc53-4dacf7183b7e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Getting quotas for user 8b67f0226ea247ae857b18891e0834f8 and project 7fc33178ac5b4d4f9c1f346e3b4371b6. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:39:36.018495 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0269fe15-aa8a-4e49-918e-bde612dd8f6d tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] 10.222.0.20 "GET /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b" status: 200 len: 1730 microversion: 2.1 time: 0.363045 Apr 16 21:39:36.019312 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3171/6183] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:35 2022] GET /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b => generated 1730 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:39:36.045188 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9bf2ae21-b9ba-4fcf-bc53-4dacf7183b7e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:39:36.048485 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9bf2ae21-b9ba-4fcf-bc53-4dacf7183b7e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:39:36.279391 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9bf2ae21-b9ba-4fcf-bc53-4dacf7183b7e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 1.866140 Apr 16 21:39:36.283234 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3013/6184] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:39:34 2022] POST /compute/v2.1/servers => generated 399 bytes in 1871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 16 21:39:36.296029 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-62e12234-1fdb-4750-b118-005a75646502 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:36.296760 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-62e12234-1fdb-4750-b118-005a75646502 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:36.473684 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-62e12234-1fdb-4750-b118-005a75646502 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:36.498020 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-62e12234-1fdb-4750-b118-005a75646502 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf" status: 200 len: 1238 microversion: 2.1 time: 0.207918 Apr 16 21:39:36.498631 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3172/6185] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:36 2022] GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf => generated 1238 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:39:37.039533 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1a1fde71-42d4-4c11-916b-8dbb4556a466 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:37.040450 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1a1fde71-42d4-4c11-916b-8dbb4556a466 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] [instance: 83455e10-9079-4214-a0d9-4b07eae7272b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:37.055740 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1a1fde71-42d4-4c11-916b-8dbb4556a466 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:37.056874 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1a1fde71-42d4-4c11-916b-8dbb4556a466 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:37.058707 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1a1fde71-42d4-4c11-916b-8dbb4556a466 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:37.060165 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1a1fde71-42d4-4c11-916b-8dbb4556a466 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:37.234588 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1a1fde71-42d4-4c11-916b-8dbb4556a466 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96d2c5371744a65806022c50819f800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551fe53574564e4ea60f7288faf4298f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:37.239034 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-cd9c54ae-de1f-45e7-b8ef-944465014a16 req-c7d09733-5d22-400d-b138-509ac8a1e31d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83455e10-9079-4214-a0d9-4b07eae7272b", "name": "network-vif-deleted", "tag": "b0384a65-07bb-42fc-8a13-ff7c5fb3a7e8"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:39:37.249161 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1a1fde71-42d4-4c11-916b-8dbb4556a466 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] 10.222.0.20 "GET /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b" status: 200 len: 1663 microversion: 2.1 time: 0.216439 Apr 16 21:39:37.249775 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3014/6186] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:37 2022] GET /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b => generated 1663 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:39:37.263286 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-cd9c54ae-de1f-45e7-b8ef-944465014a16 req-c7d09733-5d22-400d-b138-509ac8a1e31d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:37.264122 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-cd9c54ae-de1f-45e7-b8ef-944465014a16 req-c7d09733-5d22-400d-b138-509ac8a1e31d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:37.291677 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-cd9c54ae-de1f-45e7-b8ef-944465014a16 req-c7d09733-5d22-400d-b138-509ac8a1e31d service nova] Creating event network-vif-deleted:b0384a65-07bb-42fc-8a13-ff7c5fb3a7e8 for instance 83455e10-9079-4214-a0d9-4b07eae7272b on nch1-master-1 Apr 16 21:39:37.298059 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-cd9c54ae-de1f-45e7-b8ef-944465014a16 req-c7d09733-5d22-400d-b138-509ac8a1e31d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063014 Apr 16 21:39:37.303502 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3173/6187] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:39:37.521113 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b20d9086-cd23-49d0-9e90-2654b47d788c tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:37.521985 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b20d9086-cd23-49d0-9e90-2654b47d788c tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:37.649656 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b20d9086-cd23-49d0-9e90-2654b47d788c tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:37.659808 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b20d9086-cd23-49d0-9e90-2654b47d788c tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf" status: 200 len: 1238 microversion: 2.1 time: 0.142846 Apr 16 21:39:37.664332 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3015/6188] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:37 2022] GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf => generated 1238 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:39:38.267327 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7e220fa2-95fa-42d4-905c-e909b92187df tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:38.268118 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7e220fa2-95fa-42d4-905c-e909b92187df tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] [instance: 83455e10-9079-4214-a0d9-4b07eae7272b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:38.280821 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7e220fa2-95fa-42d4-905c-e909b92187df tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:38.281411 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7e220fa2-95fa-42d4-905c-e909b92187df tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:38.285352 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7e220fa2-95fa-42d4-905c-e909b92187df tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:38.285917 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7e220fa2-95fa-42d4-905c-e909b92187df tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:38.334345 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-be08089a-9fb1-4463-aa9a-70d7df692f9a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1080452950", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "4dd7eb45-8776-4f81-9375-6aaa334b721b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1255096748", "security_groups": [{"name": "tempest-secgroup-smoke-842590783"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:39:38.378177 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7e220fa2-95fa-42d4-905c-e909b92187df tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:38.378177 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7e220fa2-95fa-42d4-905c-e909b92187df tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:38.378177 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-7e220fa2-95fa-42d4-905c-e909b92187df tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lazy-loading 'fault' on Instance uuid 83455e10-9079-4214-a0d9-4b07eae7272b {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:39:38.597328 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7e220fa2-95fa-42d4-905c-e909b92187df tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd96d2c5371744a65806022c50819f800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '551fe53574564e4ea60f7288faf4298f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:38.607454 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-be08089a-9fb1-4463-aa9a-70d7df692f9a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] validate_networks() for [('4dd7eb45-8776-4f81-9375-6aaa334b721b', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:39:38.608643 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7e220fa2-95fa-42d4-905c-e909b92187df tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] 10.222.0.20 "GET /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b" status: 200 len: 1388 microversion: 2.1 time: 0.346268 Apr 16 21:39:38.621592 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3174/6189] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:38 2022] GET /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b => generated 1388 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:39:38.684093 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-15f32509-078f-49d4-a06e-93b572f4b591 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:38.685084 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-15f32509-078f-49d4-a06e-93b572f4b591 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:38.701095 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-15f32509-078f-49d4-a06e-93b572f4b591 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:38.702618 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-15f32509-078f-49d4-a06e-93b572f4b591 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:38.704894 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-15f32509-078f-49d4-a06e-93b572f4b591 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:38.706835 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-15f32509-078f-49d4-a06e-93b572f4b591 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:38.837863 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-15f32509-078f-49d4-a06e-93b572f4b591 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:38.858981 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-15f32509-078f-49d4-a06e-93b572f4b591 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf" status: 200 len: 1242 microversion: 2.1 time: 0.183766 Apr 16 21:39:38.873173 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3175/6190] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:38 2022] GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf => generated 1242 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:39:39.203235 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-be08089a-9fb1-4463-aa9a-70d7df692f9a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:39:39.203673 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-be08089a-9fb1-4463-aa9a-70d7df692f9a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:39:39.205368 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-be08089a-9fb1-4463-aa9a-70d7df692f9a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:39:39.206084 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-be08089a-9fb1-4463-aa9a-70d7df692f9a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:39:39.206579 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-be08089a-9fb1-4463-aa9a-70d7df692f9a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:39:39.230832 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-be08089a-9fb1-4463-aa9a-70d7df692f9a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:39.231613 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-be08089a-9fb1-4463-aa9a-70d7df692f9a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:39.232722 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-be08089a-9fb1-4463-aa9a-70d7df692f9a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:39.233520 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-be08089a-9fb1-4463-aa9a-70d7df692f9a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:39.264811 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-be08089a-9fb1-4463-aa9a-70d7df692f9a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Getting quotas for project 0ee2ef9a941a429b82a89f7c8f71d45b. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:39:39.272989 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-be08089a-9fb1-4463-aa9a-70d7df692f9a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Getting quotas for user f27a0cf693a247bb87a8c12193fee719 and project 0ee2ef9a941a429b82a89f7c8f71d45b. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:39:39.289646 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-be08089a-9fb1-4463-aa9a-70d7df692f9a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:39:39.291818 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-be08089a-9fb1-4463-aa9a-70d7df692f9a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:39:39.554948 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-be08089a-9fb1-4463-aa9a-70d7df692f9a tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.225433 Apr 16 21:39:39.561061 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3016/6191] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:39:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 1232 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 16 21:39:39.575942 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bd2e77ab-dfc8-450f-8eb7-65003db58400 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:39.576688 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-bd2e77ab-dfc8-450f-8eb7-65003db58400 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:39.635356 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-afb5284c-dc78-404d-8247-e9069acb7712 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:39.637153 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-afb5284c-dc78-404d-8247-e9069acb7712 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] [instance: 83455e10-9079-4214-a0d9-4b07eae7272b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:39.651740 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-afb5284c-dc78-404d-8247-e9069acb7712 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:39.654330 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-afb5284c-dc78-404d-8247-e9069acb7712 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:39.657579 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-afb5284c-dc78-404d-8247-e9069acb7712 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:39.660591 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-afb5284c-dc78-404d-8247-e9069acb7712 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:39.698856 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-afb5284c-dc78-404d-8247-e9069acb7712 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] HTTP exception thrown: Instance 83455e10-9079-4214-a0d9-4b07eae7272b could not be found. Apr 16 21:39:39.702605 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-afb5284c-dc78-404d-8247-e9069acb7712 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Returning 404 to user: Instance 83455e10-9079-4214-a0d9-4b07eae7272b could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:39:39.705903 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-afb5284c-dc78-404d-8247-e9069acb7712 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] 10.222.0.20 "GET /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b" status: 404 len: 111 microversion: 2.1 time: 0.082819 Apr 16 21:39:39.711975 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3017/6192] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:39 2022] GET /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:39:39.751658 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-bd2e77ab-dfc8-450f-8eb7-65003db58400 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:39.762121 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-bd2e77ab-dfc8-450f-8eb7-65003db58400 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024" status: 200 len: 1267 microversion: 2.1 time: 0.193997 Apr 16 21:39:39.765463 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3176/6193] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:39 2022] GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024 => generated 1267 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:39:39.899529 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-48f0bbb0-4028-40ef-8029-0f2f8945833d tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:39.900215 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-48f0bbb0-4028-40ef-8029-0f2f8945833d tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:39.914889 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-48f0bbb0-4028-40ef-8029-0f2f8945833d tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:39.914889 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-48f0bbb0-4028-40ef-8029-0f2f8945833d tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:39.914889 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-48f0bbb0-4028-40ef-8029-0f2f8945833d tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:39.914889 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-48f0bbb0-4028-40ef-8029-0f2f8945833d tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:40.379115 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-48f0bbb0-4028-40ef-8029-0f2f8945833d tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:40.391531 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-48f0bbb0-4028-40ef-8029-0f2f8945833d tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf" status: 200 len: 1298 microversion: 2.1 time: 0.509396 Apr 16 21:39:40.404439 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3018/6194] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:39 2022] GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf => generated 1298 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:39:40.783001 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6cffcb15-e921-4079-b03c-0722605d02d9 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:40.784154 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6cffcb15-e921-4079-b03c-0722605d02d9 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:40.903224 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6cffcb15-e921-4079-b03c-0722605d02d9 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:40.913933 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6cffcb15-e921-4079-b03c-0722605d02d9 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024" status: 200 len: 1267 microversion: 2.1 time: 0.136062 Apr 16 21:39:40.914537 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3177/6195] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:40 2022] GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024 => generated 1267 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:39:41.182114 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e2f15662-d329-4517-857f-6b8b95c9b184 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:41.182717 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e2f15662-d329-4517-857f-6b8b95c9b184 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] [instance: 83455e10-9079-4214-a0d9-4b07eae7272b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:41.189335 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e2f15662-d329-4517-857f-6b8b95c9b184 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:41.190475 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e2f15662-d329-4517-857f-6b8b95c9b184 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:41.192403 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e2f15662-d329-4517-857f-6b8b95c9b184 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:41.193959 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e2f15662-d329-4517-857f-6b8b95c9b184 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:41.217342 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-e2f15662-d329-4517-857f-6b8b95c9b184 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] HTTP exception thrown: Instance 83455e10-9079-4214-a0d9-4b07eae7272b could not be found. Apr 16 21:39:41.218326 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e2f15662-d329-4517-857f-6b8b95c9b184 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Returning 404 to user: Instance 83455e10-9079-4214-a0d9-4b07eae7272b could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:39:41.220517 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e2f15662-d329-4517-857f-6b8b95c9b184 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] 10.222.0.20 "DELETE /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b" status: 404 len: 111 microversion: 2.1 time: 0.042345 Apr 16 21:39:41.222460 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3019/6196] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:39:41 2022] DELETE /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:39:41.236098 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bbae3546-d5e5-4066-b321-c231e14b1855 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:41.245305 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-bbae3546-d5e5-4066-b321-c231e14b1855 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] [instance: 83455e10-9079-4214-a0d9-4b07eae7272b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:41.264730 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bbae3546-d5e5-4066-b321-c231e14b1855 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:41.267900 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bbae3546-d5e5-4066-b321-c231e14b1855 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:41.269032 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bbae3546-d5e5-4066-b321-c231e14b1855 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:41.270513 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bbae3546-d5e5-4066-b321-c231e14b1855 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:41.303127 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-bbae3546-d5e5-4066-b321-c231e14b1855 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] HTTP exception thrown: Instance 83455e10-9079-4214-a0d9-4b07eae7272b could not be found. Apr 16 21:39:41.310721 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bbae3546-d5e5-4066-b321-c231e14b1855 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Returning 404 to user: Instance 83455e10-9079-4214-a0d9-4b07eae7272b could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:39:41.310721 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-bbae3546-d5e5-4066-b321-c231e14b1855 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] 10.222.0.20 "GET /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b" status: 404 len: 111 microversion: 2.1 time: 0.077734 Apr 16 21:39:41.310721 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3178/6197] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:41 2022] GET /compute/v2.1/servers/83455e10-9079-4214-a0d9-4b07eae7272b => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:39:41.424633 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9050aa7a-cb9c-41b8-98f7-324176aac02a tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:41.426084 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9050aa7a-cb9c-41b8-98f7-324176aac02a tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:41.435718 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9050aa7a-cb9c-41b8-98f7-324176aac02a tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:41.436490 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9050aa7a-cb9c-41b8-98f7-324176aac02a tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:41.438266 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9050aa7a-cb9c-41b8-98f7-324176aac02a tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:41.440767 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9050aa7a-cb9c-41b8-98f7-324176aac02a tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:41.616109 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9050aa7a-cb9c-41b8-98f7-324176aac02a tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:41.629610 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9050aa7a-cb9c-41b8-98f7-324176aac02a tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf" status: 200 len: 1296 microversion: 2.1 time: 0.221638 Apr 16 21:39:41.632274 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3020/6198] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:41 2022] GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf => generated 1296 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:39:41.931758 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4d8ce4df-d17f-4fa5-a0d2-6a0440222dfd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:41.932535 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4d8ce4df-d17f-4fa5-a0d2-6a0440222dfd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:41.941426 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4d8ce4df-d17f-4fa5-a0d2-6a0440222dfd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:41.943536 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4d8ce4df-d17f-4fa5-a0d2-6a0440222dfd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:41.944731 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4d8ce4df-d17f-4fa5-a0d2-6a0440222dfd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:41.945197 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4d8ce4df-d17f-4fa5-a0d2-6a0440222dfd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:41.967181 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e97530e9-56f1-4b42-aa22-25d69c7997f9 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] Calling method '.version_select at 0x7fbb96c42a60>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:42.123321 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e97530e9-56f1-4b42-aa22-25d69c7997f9 tempest-TestServerBasicOps-620278304 tempest-TestServerBasicOps-620278304-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1979599195" status: 202 len: 0 microversion: 2.1 time: 0.165116 Apr 16 21:39:42.123962 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3021/6199] 10.222.0.20 () {58 vars in 1253 bytes} [Sat Apr 16 21:39:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1979599195 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 16 21:39:42.154243 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4d8ce4df-d17f-4fa5-a0d2-6a0440222dfd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:42.165513 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4d8ce4df-d17f-4fa5-a0d2-6a0440222dfd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024" status: 200 len: 1319 microversion: 2.1 time: 0.238935 Apr 16 21:39:42.181145 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3179/6200] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:41 2022] GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024 => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:39:42.649284 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bf5fa719-087a-4900-9c6a-23dd52e855f5 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:42.655462 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bf5fa719-087a-4900-9c6a-23dd52e855f5 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:42.663915 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bf5fa719-087a-4900-9c6a-23dd52e855f5 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:42.669817 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bf5fa719-087a-4900-9c6a-23dd52e855f5 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:42.683281 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bf5fa719-087a-4900-9c6a-23dd52e855f5 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:42.684752 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bf5fa719-087a-4900-9c6a-23dd52e855f5 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:43.152515 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-bf5fa719-087a-4900-9c6a-23dd52e855f5 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:43.176274 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bf5fa719-087a-4900-9c6a-23dd52e855f5 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf" status: 200 len: 1361 microversion: 2.1 time: 0.529106 Apr 16 21:39:43.176274 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3022/6201] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:42 2022] GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf => generated 1361 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:39:43.182964 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-65879984-665d-4418-851a-61b5bd2736c4 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:43.184200 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-65879984-665d-4418-851a-61b5bd2736c4 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:43.196486 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-65879984-665d-4418-851a-61b5bd2736c4 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:43.197064 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-65879984-665d-4418-851a-61b5bd2736c4 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:43.197755 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-65879984-665d-4418-851a-61b5bd2736c4 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:43.198200 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-65879984-665d-4418-851a-61b5bd2736c4 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:43.339731 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-65879984-665d-4418-851a-61b5bd2736c4 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:43.359454 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-65879984-665d-4418-851a-61b5bd2736c4 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024" status: 200 len: 1325 microversion: 2.1 time: 0.180248 Apr 16 21:39:43.360403 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3180/6202] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:43 2022] GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024 => generated 1325 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:39:43.510429 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-f00b3b5b-5c33-447e-bf3d-2c99a2d47774 req-36381be0-2054-4948-8796-136d10c40597 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c63a395-2ffd-44e5-aa9b-cd3417a504bf", "tag": "28042d4b-e13b-4b15-bfcb-0e0dd805600f"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:39:43.532068 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-f00b3b5b-5c33-447e-bf3d-2c99a2d47774 req-36381be0-2054-4948-8796-136d10c40597 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:43.532863 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-f00b3b5b-5c33-447e-bf3d-2c99a2d47774 req-36381be0-2054-4948-8796-136d10c40597 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:43.559740 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-f00b3b5b-5c33-447e-bf3d-2c99a2d47774 req-36381be0-2054-4948-8796-136d10c40597 service nova] Creating event network-changed:28042d4b-e13b-4b15-bfcb-0e0dd805600f for instance 8c63a395-2ffd-44e5-aa9b-cd3417a504bf on nch1-master-1 Apr 16 21:39:43.568007 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-f00b3b5b-5c33-447e-bf3d-2c99a2d47774 req-36381be0-2054-4948-8796-136d10c40597 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064011 Apr 16 21:39:43.568007 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3023/6203] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:39:44.198886 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f64f5ec2-7d16-4b0b-b685-7edf3d9c3bd1 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:44.201629 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f64f5ec2-7d16-4b0b-b685-7edf3d9c3bd1 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:44.215564 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f64f5ec2-7d16-4b0b-b685-7edf3d9c3bd1 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:44.216041 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f64f5ec2-7d16-4b0b-b685-7edf3d9c3bd1 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:44.222704 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f64f5ec2-7d16-4b0b-b685-7edf3d9c3bd1 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:44.222704 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f64f5ec2-7d16-4b0b-b685-7edf3d9c3bd1 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:44.379620 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-98cac6a0-092a-46a1-baa9-c00b458abdbb tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:44.380631 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-98cac6a0-092a-46a1-baa9-c00b458abdbb tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:44.400331 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-98cac6a0-092a-46a1-baa9-c00b458abdbb tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:44.402510 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-98cac6a0-092a-46a1-baa9-c00b458abdbb tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:44.405342 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-98cac6a0-092a-46a1-baa9-c00b458abdbb tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:44.407957 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-98cac6a0-092a-46a1-baa9-c00b458abdbb tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:44.459597 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f64f5ec2-7d16-4b0b-b685-7edf3d9c3bd1 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:44.467772 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f64f5ec2-7d16-4b0b-b685-7edf3d9c3bd1 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf" status: 200 len: 1361 microversion: 2.1 time: 0.276568 Apr 16 21:39:44.468401 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3181/6204] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:44 2022] GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf => generated 1361 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:39:44.696904 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4a51f28e-f63b-406f-95f4-dfcd0b5c0d1a tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1461822591", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "ae312670-622b-491e-8d2c-d3ae19809533"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:39:44.707861 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-98cac6a0-092a-46a1-baa9-c00b458abdbb tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:44.716665 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-98cac6a0-092a-46a1-baa9-c00b458abdbb tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024" status: 200 len: 1392 microversion: 2.1 time: 0.342632 Apr 16 21:39:44.720678 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3024/6205] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:44 2022] GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024 => generated 1392 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:39:44.778763 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-4a51f28e-f63b-406f-95f4-dfcd0b5c0d1a tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] validate_networks() for [('ae312670-622b-491e-8d2c-d3ae19809533', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:39:45.484601 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-71e72b9c-ded0-4f20-8ba7-d621fb23d2ca tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:45.486176 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-71e72b9c-ded0-4f20-8ba7-d621fb23d2ca tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:45.496121 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-71e72b9c-ded0-4f20-8ba7-d621fb23d2ca tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:45.496914 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-71e72b9c-ded0-4f20-8ba7-d621fb23d2ca tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:45.497537 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-71e72b9c-ded0-4f20-8ba7-d621fb23d2ca tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:45.497996 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-71e72b9c-ded0-4f20-8ba7-d621fb23d2ca tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:45.649754 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-71e72b9c-ded0-4f20-8ba7-d621fb23d2ca tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:45.661183 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-71e72b9c-ded0-4f20-8ba7-d621fb23d2ca tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf" status: 200 len: 1361 microversion: 2.1 time: 0.178956 Apr 16 21:39:45.664520 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3025/6206] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:45 2022] GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf => generated 1361 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:39:45.741936 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d9857b66-9d27-4e93-893c-7c3661bce118 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:45.743554 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d9857b66-9d27-4e93-893c-7c3661bce118 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:45.751358 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d9857b66-9d27-4e93-893c-7c3661bce118 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:45.751831 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d9857b66-9d27-4e93-893c-7c3661bce118 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:45.752676 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d9857b66-9d27-4e93-893c-7c3661bce118 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:45.753170 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d9857b66-9d27-4e93-893c-7c3661bce118 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:45.899335 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d9857b66-9d27-4e93-893c-7c3661bce118 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:45.905713 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d9857b66-9d27-4e93-893c-7c3661bce118 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024" status: 200 len: 1392 microversion: 2.1 time: 0.169431 Apr 16 21:39:45.906476 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3026/6207] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:45 2022] GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024 => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:39:46.051042 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-4a51f28e-f63b-406f-95f4-dfcd0b5c0d1a tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:39:46.051684 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-4a51f28e-f63b-406f-95f4-dfcd0b5c0d1a tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:39:46.052201 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-4a51f28e-f63b-406f-95f4-dfcd0b5c0d1a tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:39:46.052661 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-4a51f28e-f63b-406f-95f4-dfcd0b5c0d1a tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:39:46.053138 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-4a51f28e-f63b-406f-95f4-dfcd0b5c0d1a tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:39:46.063664 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4a51f28e-f63b-406f-95f4-dfcd0b5c0d1a tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:46.064426 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4a51f28e-f63b-406f-95f4-dfcd0b5c0d1a tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:46.065262 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4a51f28e-f63b-406f-95f4-dfcd0b5c0d1a tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:46.065742 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4a51f28e-f63b-406f-95f4-dfcd0b5c0d1a tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:46.092776 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-4a51f28e-f63b-406f-95f4-dfcd0b5c0d1a tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Getting quotas for project c96a293eac61499182c2a30c324d461f. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:39:46.100448 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-4a51f28e-f63b-406f-95f4-dfcd0b5c0d1a tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Getting quotas for user f6e4f0060ec44989882b3b21624cb87a and project c96a293eac61499182c2a30c324d461f. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:39:46.114364 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4a51f28e-f63b-406f-95f4-dfcd0b5c0d1a tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:39:46.116897 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4a51f28e-f63b-406f-95f4-dfcd0b5c0d1a tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] [instance: 9e6e9f1d-bd16-433f-b71c-28676755ada1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:39:46.259444 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4a51f28e-f63b-406f-95f4-dfcd0b5c0d1a tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.789710 Apr 16 21:39:46.263544 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3182/6208] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:39:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:39:46.276302 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-58555ec6-859b-4d7e-82d7-280e6738c473 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:46.277285 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-58555ec6-859b-4d7e-82d7-280e6738c473 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] [instance: 9e6e9f1d-bd16-433f-b71c-28676755ada1] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:46.357881 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-58555ec6-859b-4d7e-82d7-280e6738c473 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e4f0060ec44989882b3b21624cb87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a293eac61499182c2a30c324d461f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:46.381009 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-58555ec6-859b-4d7e-82d7-280e6738c473 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] 10.222.0.20 "GET /compute/v2.1/servers/9e6e9f1d-bd16-433f-b71c-28676755ada1" status: 200 len: 1214 microversion: 2.1 time: 0.110009 Apr 16 21:39:46.388764 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3027/6209] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:46 2022] GET /compute/v2.1/servers/9e6e9f1d-bd16-433f-b71c-28676755ada1 => generated 1214 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:39:46.677429 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ec41aad8-4758-4d41-b3db-6b1ca2ea6614 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:46.678574 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ec41aad8-4758-4d41-b3db-6b1ca2ea6614 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:46.699145 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ec41aad8-4758-4d41-b3db-6b1ca2ea6614 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:46.699938 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ec41aad8-4758-4d41-b3db-6b1ca2ea6614 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:46.700994 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ec41aad8-4758-4d41-b3db-6b1ca2ea6614 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:46.701452 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ec41aad8-4758-4d41-b3db-6b1ca2ea6614 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:46.923608 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-26e7bf62-3c87-4903-bd6a-0ad1e77f11dc tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:46.924407 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-26e7bf62-3c87-4903-bd6a-0ad1e77f11dc tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:46.936057 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-26e7bf62-3c87-4903-bd6a-0ad1e77f11dc tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:46.940283 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ec41aad8-4758-4d41-b3db-6b1ca2ea6614 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:46.948564 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-26e7bf62-3c87-4903-bd6a-0ad1e77f11dc tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:46.951555 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ec41aad8-4758-4d41-b3db-6b1ca2ea6614 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf" status: 200 len: 1361 microversion: 2.1 time: 0.279006 Apr 16 21:39:46.952109 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-26e7bf62-3c87-4903-bd6a-0ad1e77f11dc tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:46.952868 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-26e7bf62-3c87-4903-bd6a-0ad1e77f11dc tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:46.957003 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3183/6210] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:46 2022] GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf => generated 1361 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:39:47.186703 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-26e7bf62-3c87-4903-bd6a-0ad1e77f11dc tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:47.203910 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-26e7bf62-3c87-4903-bd6a-0ad1e77f11dc tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024" status: 200 len: 1392 microversion: 2.1 time: 0.284727 Apr 16 21:39:47.204784 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3028/6211] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:46 2022] GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024 => generated 1392 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:39:47.333170 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-9d13ef72-7f39-42e9-99ba-9bbf8265a09e req-a40747d2-d7fb-4a18-84a5-f5175e89a6cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7537290d-836b-431c-bfb7-c8f83dd03024", "tag": "73138183-36f0-4a32-833a-7b6e3fa38956"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:39:47.355202 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-9d13ef72-7f39-42e9-99ba-9bbf8265a09e req-a40747d2-d7fb-4a18-84a5-f5175e89a6cc service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:47.355202 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-9d13ef72-7f39-42e9-99ba-9bbf8265a09e req-a40747d2-d7fb-4a18-84a5-f5175e89a6cc service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:47.370165 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-9d13ef72-7f39-42e9-99ba-9bbf8265a09e req-a40747d2-d7fb-4a18-84a5-f5175e89a6cc service nova] Creating event network-changed:73138183-36f0-4a32-833a-7b6e3fa38956 for instance 7537290d-836b-431c-bfb7-c8f83dd03024 on nch2-master-1 Apr 16 21:39:47.394157 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-9d13ef72-7f39-42e9-99ba-9bbf8265a09e req-a40747d2-d7fb-4a18-84a5-f5175e89a6cc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065814 Apr 16 21:39:47.397915 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3184/6212] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:39:47.399687 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2260c344-c804-4c36-81f6-b9baafcedf89 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:47.400339 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2260c344-c804-4c36-81f6-b9baafcedf89 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] [instance: 9e6e9f1d-bd16-433f-b71c-28676755ada1] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:47.505126 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2260c344-c804-4c36-81f6-b9baafcedf89 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e4f0060ec44989882b3b21624cb87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a293eac61499182c2a30c324d461f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:47.516230 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2260c344-c804-4c36-81f6-b9baafcedf89 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] 10.222.0.20 "GET /compute/v2.1/servers/9e6e9f1d-bd16-433f-b71c-28676755ada1" status: 200 len: 1214 microversion: 2.1 time: 0.116958 Apr 16 21:39:47.516980 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3029/6213] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:47 2022] GET /compute/v2.1/servers/9e6e9f1d-bd16-433f-b71c-28676755ada1 => generated 1214 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:39:47.975276 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4d6d90c1-c1d8-40ab-90ed-7c395e467930 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:47.976125 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4d6d90c1-c1d8-40ab-90ed-7c395e467930 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:47.984466 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4d6d90c1-c1d8-40ab-90ed-7c395e467930 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:47.985271 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4d6d90c1-c1d8-40ab-90ed-7c395e467930 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:47.986406 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4d6d90c1-c1d8-40ab-90ed-7c395e467930 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:47.987906 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4d6d90c1-c1d8-40ab-90ed-7c395e467930 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:48.222352 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-379d523d-4bea-4ae2-9dc4-5c9cf7f11b01 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:48.223160 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-379d523d-4bea-4ae2-9dc4-5c9cf7f11b01 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:48.231884 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-379d523d-4bea-4ae2-9dc4-5c9cf7f11b01 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:48.240409 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-379d523d-4bea-4ae2-9dc4-5c9cf7f11b01 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:48.240409 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-379d523d-4bea-4ae2-9dc4-5c9cf7f11b01 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:48.240409 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-379d523d-4bea-4ae2-9dc4-5c9cf7f11b01 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:48.752454 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-379d523d-4bea-4ae2-9dc4-5c9cf7f11b01 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:48.787777 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-379d523d-4bea-4ae2-9dc4-5c9cf7f11b01 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024" status: 200 len: 1392 microversion: 2.1 time: 0.565929 Apr 16 21:39:48.788561 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3030/6214] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:48 2022] GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024 => generated 1392 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:39:48.795143 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2a720353-2d1f-4b95-af48-894638a169fb tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:48.800162 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2a720353-2d1f-4b95-af48-894638a169fb tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] [instance: 9e6e9f1d-bd16-433f-b71c-28676755ada1] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:48.808750 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2a720353-2d1f-4b95-af48-894638a169fb tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:48.809467 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2a720353-2d1f-4b95-af48-894638a169fb tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:48.810474 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2a720353-2d1f-4b95-af48-894638a169fb tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:48.811070 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2a720353-2d1f-4b95-af48-894638a169fb tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:48.886838 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4d6d90c1-c1d8-40ab-90ed-7c395e467930 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:48.890632 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2a720353-2d1f-4b95-af48-894638a169fb tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e4f0060ec44989882b3b21624cb87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a293eac61499182c2a30c324d461f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:48.898202 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2a720353-2d1f-4b95-af48-894638a169fb tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] 10.222.0.20 "GET /compute/v2.1/servers/9e6e9f1d-bd16-433f-b71c-28676755ada1" status: 200 len: 1266 microversion: 2.1 time: 0.108161 Apr 16 21:39:48.899650 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3031/6215] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:48 2022] GET /compute/v2.1/servers/9e6e9f1d-bd16-433f-b71c-28676755ada1 => generated 1266 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:39:48.900880 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4d6d90c1-c1d8-40ab-90ed-7c395e467930 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf" status: 200 len: 1361 microversion: 2.1 time: 0.929953 Apr 16 21:39:48.901978 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3185/6216] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:47 2022] GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf => generated 1361 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:39:49.282032 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-d5d0e67f-4641-4246-86c6-df05fa4f1de1 req-d2c52f8c-d099-43a3-af3d-43b40052cc75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c63a395-2ffd-44e5-aa9b-cd3417a504bf", "name": "network-vif-plugged", "status": "completed", "tag": "28042d4b-e13b-4b15-bfcb-0e0dd805600f"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:39:49.293488 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-d5d0e67f-4641-4246-86c6-df05fa4f1de1 req-d2c52f8c-d099-43a3-af3d-43b40052cc75 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:49.298264 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-d5d0e67f-4641-4246-86c6-df05fa4f1de1 req-d2c52f8c-d099-43a3-af3d-43b40052cc75 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:49.306472 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-d5d0e67f-4641-4246-86c6-df05fa4f1de1 req-d2c52f8c-d099-43a3-af3d-43b40052cc75 service nova] Creating event network-vif-plugged:28042d4b-e13b-4b15-bfcb-0e0dd805600f for instance 8c63a395-2ffd-44e5-aa9b-cd3417a504bf on nch1-master-1 Apr 16 21:39:49.313050 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-d5d0e67f-4641-4246-86c6-df05fa4f1de1 req-d2c52f8c-d099-43a3-af3d-43b40052cc75 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033837 Apr 16 21:39:49.314375 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3032/6217] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:39:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:39:49.805690 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ec344717-b0bd-4c85-9259-de2a54592fbe tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:49.806513 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ec344717-b0bd-4c85-9259-de2a54592fbe tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:49.814359 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ec344717-b0bd-4c85-9259-de2a54592fbe tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:49.815052 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ec344717-b0bd-4c85-9259-de2a54592fbe tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:49.815855 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ec344717-b0bd-4c85-9259-de2a54592fbe tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:49.816336 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ec344717-b0bd-4c85-9259-de2a54592fbe tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:49.919882 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cc640de9-906c-4c63-9b1f-5b456a845742 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:49.920633 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-cc640de9-906c-4c63-9b1f-5b456a845742 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] [instance: 9e6e9f1d-bd16-433f-b71c-28676755ada1] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:49.936443 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cc640de9-906c-4c63-9b1f-5b456a845742 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:49.937465 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cc640de9-906c-4c63-9b1f-5b456a845742 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:49.939276 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cc640de9-906c-4c63-9b1f-5b456a845742 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:49.943176 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cc640de9-906c-4c63-9b1f-5b456a845742 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:50.066650 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ec344717-b0bd-4c85-9259-de2a54592fbe tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:50.084752 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ec344717-b0bd-4c85-9259-de2a54592fbe tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024" status: 200 len: 1392 microversion: 2.1 time: 0.282140 Apr 16 21:39:50.085984 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3186/6218] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:49 2022] GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024 => generated 1392 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:39:50.095190 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-68038070-c03a-44ec-828f-ff213fd01442 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:50.097582 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-68038070-c03a-44ec-828f-ff213fd01442 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:50.109365 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-68038070-c03a-44ec-828f-ff213fd01442 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:50.110292 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-68038070-c03a-44ec-828f-ff213fd01442 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:50.112050 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-68038070-c03a-44ec-828f-ff213fd01442 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:50.112792 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-68038070-c03a-44ec-828f-ff213fd01442 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:50.154638 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cc640de9-906c-4c63-9b1f-5b456a845742 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e4f0060ec44989882b3b21624cb87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a293eac61499182c2a30c324d461f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:50.175956 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cc640de9-906c-4c63-9b1f-5b456a845742 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] 10.222.0.20 "GET /compute/v2.1/servers/9e6e9f1d-bd16-433f-b71c-28676755ada1" status: 200 len: 1272 microversion: 2.1 time: 0.260857 Apr 16 21:39:50.177704 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3033/6219] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:49 2022] GET /compute/v2.1/servers/9e6e9f1d-bd16-433f-b71c-28676755ada1 => generated 1272 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:39:50.378909 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-68038070-c03a-44ec-828f-ff213fd01442 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:50.389310 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-68038070-c03a-44ec-828f-ff213fd01442 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf" status: 200 len: 1361 microversion: 2.1 time: 0.300808 Apr 16 21:39:50.390249 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3187/6220] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:50 2022] GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf => generated 1361 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:39:51.109110 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-533a4907-734f-4ebc-87bb-082e54e0e36e tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:51.109742 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-533a4907-734f-4ebc-87bb-082e54e0e36e tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:51.116702 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-533a4907-734f-4ebc-87bb-082e54e0e36e tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:51.117160 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-533a4907-734f-4ebc-87bb-082e54e0e36e tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:51.117936 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-533a4907-734f-4ebc-87bb-082e54e0e36e tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:51.118378 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-533a4907-734f-4ebc-87bb-082e54e0e36e tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:51.195495 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a9e7c7df-63f6-423e-9f12-9f23335fc9ae tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:51.197093 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a9e7c7df-63f6-423e-9f12-9f23335fc9ae tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] [instance: 9e6e9f1d-bd16-433f-b71c-28676755ada1] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:51.204108 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9e7c7df-63f6-423e-9f12-9f23335fc9ae tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:51.204692 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9e7c7df-63f6-423e-9f12-9f23335fc9ae tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:51.205588 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9e7c7df-63f6-423e-9f12-9f23335fc9ae tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:51.207420 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9e7c7df-63f6-423e-9f12-9f23335fc9ae tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:51.477168 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-533a4907-734f-4ebc-87bb-082e54e0e36e tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:51.485615 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-533a4907-734f-4ebc-87bb-082e54e0e36e tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024" status: 200 len: 1392 microversion: 2.1 time: 0.380229 Apr 16 21:39:51.487489 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3034/6221] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:51 2022] GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024 => generated 1392 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:39:51.502047 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-de7ee45b-cfa1-47a7-85a6-114a011ac4f9 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:51.503159 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a9e7c7df-63f6-423e-9f12-9f23335fc9ae tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e4f0060ec44989882b3b21624cb87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a293eac61499182c2a30c324d461f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:51.503437 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-de7ee45b-cfa1-47a7-85a6-114a011ac4f9 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:51.511319 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-de7ee45b-cfa1-47a7-85a6-114a011ac4f9 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:51.513434 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-de7ee45b-cfa1-47a7-85a6-114a011ac4f9 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:51.513434 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-de7ee45b-cfa1-47a7-85a6-114a011ac4f9 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:51.513434 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-de7ee45b-cfa1-47a7-85a6-114a011ac4f9 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:51.514289 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a9e7c7df-63f6-423e-9f12-9f23335fc9ae tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] 10.222.0.20 "GET /compute/v2.1/servers/9e6e9f1d-bd16-433f-b71c-28676755ada1" status: 200 len: 1314 microversion: 2.1 time: 0.322044 Apr 16 21:39:51.519482 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3188/6222] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:51 2022] GET /compute/v2.1/servers/9e6e9f1d-bd16-433f-b71c-28676755ada1 => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:39:51.777069 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-de7ee45b-cfa1-47a7-85a6-114a011ac4f9 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:51.786317 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-de7ee45b-cfa1-47a7-85a6-114a011ac4f9 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf" status: 200 len: 1546 microversion: 2.1 time: 0.297618 Apr 16 21:39:51.793317 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3035/6223] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:51 2022] GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf => generated 1546 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:39:51.803325 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8bc3c353-f582-46b4-ab34-85a0e2d8fade tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:51.804066 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8bc3c353-f582-46b4-ab34-85a0e2d8fade tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:51.815634 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8bc3c353-f582-46b4-ab34-85a0e2d8fade tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:51.816101 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8bc3c353-f582-46b4-ab34-85a0e2d8fade tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:51.817011 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8bc3c353-f582-46b4-ab34-85a0e2d8fade tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:51.817457 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8bc3c353-f582-46b4-ab34-85a0e2d8fade tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:51.961843 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8bc3c353-f582-46b4-ab34-85a0e2d8fade tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.162850 Apr 16 21:39:51.963010 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3189/6224] 10.222.0.20 () {58 vars in 1274 bytes} [Sat Apr 16 21:39:51 2022] GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf/os-interface => generated 284 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:39:52.307948 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-7a7f8bd7-05d8-444a-81ec-f26192049861 req-93803d25-5f9b-402d-9b25-95ba4621645f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e6e9f1d-bd16-433f-b71c-28676755ada1", "tag": "3cc5ad53-5aec-413a-afba-7128ed6391bc"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:39:52.322543 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-7a7f8bd7-05d8-444a-81ec-f26192049861 req-93803d25-5f9b-402d-9b25-95ba4621645f service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:52.322996 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-7a7f8bd7-05d8-444a-81ec-f26192049861 req-93803d25-5f9b-402d-9b25-95ba4621645f service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:52.334562 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-7a7f8bd7-05d8-444a-81ec-f26192049861 req-93803d25-5f9b-402d-9b25-95ba4621645f service nova] Creating event network-changed:3cc5ad53-5aec-413a-afba-7128ed6391bc for instance 9e6e9f1d-bd16-433f-b71c-28676755ada1 on nch1-master-1 Apr 16 21:39:52.339532 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-7a7f8bd7-05d8-444a-81ec-f26192049861 req-93803d25-5f9b-402d-9b25-95ba4621645f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035444 Apr 16 21:39:52.340441 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3036/6225] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:39:52.505478 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cd35a4b4-adb9-4bd5-8e45-e8fce77bb6ed tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:52.507022 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cd35a4b4-adb9-4bd5-8e45-e8fce77bb6ed tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:52.515027 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cd35a4b4-adb9-4bd5-8e45-e8fce77bb6ed tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:52.516031 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cd35a4b4-adb9-4bd5-8e45-e8fce77bb6ed tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:52.516943 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cd35a4b4-adb9-4bd5-8e45-e8fce77bb6ed tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:52.517445 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cd35a4b4-adb9-4bd5-8e45-e8fce77bb6ed tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:52.534864 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cd4bb02c-4200-4f53-bb96-9ebdcda4af7b tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:52.537823 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-cd4bb02c-4200-4f53-bb96-9ebdcda4af7b tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] [instance: 9e6e9f1d-bd16-433f-b71c-28676755ada1] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:52.553832 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cd4bb02c-4200-4f53-bb96-9ebdcda4af7b tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:52.554616 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cd4bb02c-4200-4f53-bb96-9ebdcda4af7b tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:52.555832 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cd4bb02c-4200-4f53-bb96-9ebdcda4af7b tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:52.557139 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cd4bb02c-4200-4f53-bb96-9ebdcda4af7b tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:52.805987 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cd4bb02c-4200-4f53-bb96-9ebdcda4af7b tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e4f0060ec44989882b3b21624cb87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a293eac61499182c2a30c324d461f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:52.815006 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cd4bb02c-4200-4f53-bb96-9ebdcda4af7b tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] 10.222.0.20 "GET /compute/v2.1/servers/9e6e9f1d-bd16-433f-b71c-28676755ada1" status: 200 len: 1314 microversion: 2.1 time: 0.286302 Apr 16 21:39:52.816076 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3037/6226] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:52 2022] GET /compute/v2.1/servers/9e6e9f1d-bd16-433f-b71c-28676755ada1 => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:39:52.899957 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cd35a4b4-adb9-4bd5-8e45-e8fce77bb6ed tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:52.908000 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cd35a4b4-adb9-4bd5-8e45-e8fce77bb6ed tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024" status: 200 len: 1392 microversion: 2.1 time: 0.408005 Apr 16 21:39:52.908679 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3190/6227] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:52 2022] GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024 => generated 1392 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:39:53.832142 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-906c4876-3e0a-4a01-8a8b-8ada393c0eeb tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:53.832809 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-906c4876-3e0a-4a01-8a8b-8ada393c0eeb tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] [instance: 9e6e9f1d-bd16-433f-b71c-28676755ada1] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:53.839820 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-906c4876-3e0a-4a01-8a8b-8ada393c0eeb tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:53.840516 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-906c4876-3e0a-4a01-8a8b-8ada393c0eeb tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:53.841679 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-906c4876-3e0a-4a01-8a8b-8ada393c0eeb tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:53.842297 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-906c4876-3e0a-4a01-8a8b-8ada393c0eeb tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:53.926643 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5bc82f41-d04f-41d1-abbc-9096232d0740 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:53.928071 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5bc82f41-d04f-41d1-abbc-9096232d0740 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:53.936096 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5bc82f41-d04f-41d1-abbc-9096232d0740 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:53.939647 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5bc82f41-d04f-41d1-abbc-9096232d0740 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:53.941104 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5bc82f41-d04f-41d1-abbc-9096232d0740 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:53.941733 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5bc82f41-d04f-41d1-abbc-9096232d0740 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:54.138763 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-906c4876-3e0a-4a01-8a8b-8ada393c0eeb tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e4f0060ec44989882b3b21624cb87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a293eac61499182c2a30c324d461f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:54.150248 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-906c4876-3e0a-4a01-8a8b-8ada393c0eeb tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] 10.222.0.20 "GET /compute/v2.1/servers/9e6e9f1d-bd16-433f-b71c-28676755ada1" status: 200 len: 1314 microversion: 2.1 time: 0.319381 Apr 16 21:39:54.150248 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3038/6228] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:53 2022] GET /compute/v2.1/servers/9e6e9f1d-bd16-433f-b71c-28676755ada1 => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:39:54.351948 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5bc82f41-d04f-41d1-abbc-9096232d0740 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:54.365489 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5bc82f41-d04f-41d1-abbc-9096232d0740 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024" status: 200 len: 1392 microversion: 2.1 time: 0.442585 Apr 16 21:39:54.368540 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3191/6229] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:53 2022] GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024 => generated 1392 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:39:54.667835 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-657cdf48-4d41-43c2-ac2c-6b5cf2db5b00 req-fbbd9394-51a9-42b5-b3cc-40b71f31d823 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c63a395-2ffd-44e5-aa9b-cd3417a504bf", "tag": "28042d4b-e13b-4b15-bfcb-0e0dd805600f"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:39:54.695601 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-657cdf48-4d41-43c2-ac2c-6b5cf2db5b00 req-fbbd9394-51a9-42b5-b3cc-40b71f31d823 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:54.695601 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-657cdf48-4d41-43c2-ac2c-6b5cf2db5b00 req-fbbd9394-51a9-42b5-b3cc-40b71f31d823 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:54.710183 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-657cdf48-4d41-43c2-ac2c-6b5cf2db5b00 req-fbbd9394-51a9-42b5-b3cc-40b71f31d823 service nova] Creating event network-changed:28042d4b-e13b-4b15-bfcb-0e0dd805600f for instance 8c63a395-2ffd-44e5-aa9b-cd3417a504bf on nch1-master-1 Apr 16 21:39:54.717896 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-657cdf48-4d41-43c2-ac2c-6b5cf2db5b00 req-fbbd9394-51a9-42b5-b3cc-40b71f31d823 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056663 Apr 16 21:39:54.719196 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3039/6230] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:39:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:39:55.165369 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4f765a73-0182-4d6b-825b-18b57b701f7e tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:55.166723 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4f765a73-0182-4d6b-825b-18b57b701f7e tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] [instance: 9e6e9f1d-bd16-433f-b71c-28676755ada1] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:55.178504 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4f765a73-0182-4d6b-825b-18b57b701f7e tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:55.179742 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4f765a73-0182-4d6b-825b-18b57b701f7e tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:55.181427 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4f765a73-0182-4d6b-825b-18b57b701f7e tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:55.182051 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4f765a73-0182-4d6b-825b-18b57b701f7e tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:55.385590 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c32bc04b-ae89-497e-983f-5d893db28caf tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:55.387445 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c32bc04b-ae89-497e-983f-5d893db28caf tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:55.396989 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c32bc04b-ae89-497e-983f-5d893db28caf tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:55.397769 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c32bc04b-ae89-497e-983f-5d893db28caf tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:55.402566 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c32bc04b-ae89-497e-983f-5d893db28caf tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:55.402566 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c32bc04b-ae89-497e-983f-5d893db28caf tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:55.593521 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4f765a73-0182-4d6b-825b-18b57b701f7e tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e4f0060ec44989882b3b21624cb87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a293eac61499182c2a30c324d461f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:55.649371 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4f765a73-0182-4d6b-825b-18b57b701f7e tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] 10.222.0.20 "GET /compute/v2.1/servers/9e6e9f1d-bd16-433f-b71c-28676755ada1" status: 200 len: 1314 microversion: 2.1 time: 0.488350 Apr 16 21:39:55.650234 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3192/6231] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:55 2022] GET /compute/v2.1/servers/9e6e9f1d-bd16-433f-b71c-28676755ada1 => generated 1314 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:39:55.828138 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c32bc04b-ae89-497e-983f-5d893db28caf tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:55.838934 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c32bc04b-ae89-497e-983f-5d893db28caf tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024" status: 200 len: 1392 microversion: 2.1 time: 0.458521 Apr 16 21:39:55.849975 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3040/6232] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:55 2022] GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024 => generated 1392 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:39:56.671952 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-78d5c081-e78f-4917-b725-6c393e23ea19 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:56.672616 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-78d5c081-e78f-4917-b725-6c393e23ea19 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] [instance: 9e6e9f1d-bd16-433f-b71c-28676755ada1] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:56.692984 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-78d5c081-e78f-4917-b725-6c393e23ea19 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:56.693347 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-78d5c081-e78f-4917-b725-6c393e23ea19 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:56.694422 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-78d5c081-e78f-4917-b725-6c393e23ea19 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:56.695080 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-78d5c081-e78f-4917-b725-6c393e23ea19 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:56.856983 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fae7b05a-f19d-44de-9c57-854d049c3347 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:56.868192 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-fae7b05a-f19d-44de-9c57-854d049c3347 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:56.883666 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fae7b05a-f19d-44de-9c57-854d049c3347 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:56.889479 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fae7b05a-f19d-44de-9c57-854d049c3347 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:56.889479 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fae7b05a-f19d-44de-9c57-854d049c3347 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:56.889479 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fae7b05a-f19d-44de-9c57-854d049c3347 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:56.999695 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-78d5c081-e78f-4917-b725-6c393e23ea19 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e4f0060ec44989882b3b21624cb87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a293eac61499182c2a30c324d461f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:57.031420 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-78d5c081-e78f-4917-b725-6c393e23ea19 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] 10.222.0.20 "GET /compute/v2.1/servers/9e6e9f1d-bd16-433f-b71c-28676755ada1" status: 200 len: 1314 microversion: 2.1 time: 0.362683 Apr 16 21:39:57.033115 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3193/6233] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:56 2022] GET /compute/v2.1/servers/9e6e9f1d-bd16-433f-b71c-28676755ada1 => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:39:57.222114 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-fae7b05a-f19d-44de-9c57-854d049c3347 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:57.241247 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fae7b05a-f19d-44de-9c57-854d049c3347 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024" status: 200 len: 1392 microversion: 2.1 time: 0.388151 Apr 16 21:39:57.254913 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3041/6234] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:56 2022] GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024 => generated 1392 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:39:58.051479 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a6b84e3f-7d6f-43ea-bd6f-e27b3e3c8774 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:58.052904 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a6b84e3f-7d6f-43ea-bd6f-e27b3e3c8774 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] [instance: 9e6e9f1d-bd16-433f-b71c-28676755ada1] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:58.061012 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a6b84e3f-7d6f-43ea-bd6f-e27b3e3c8774 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:58.061852 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a6b84e3f-7d6f-43ea-bd6f-e27b3e3c8774 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:58.062895 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a6b84e3f-7d6f-43ea-bd6f-e27b3e3c8774 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:58.063574 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a6b84e3f-7d6f-43ea-bd6f-e27b3e3c8774 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:58.271463 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f97232a6-9d49-4cfc-a108-ba448fe8d5e8 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:58.272080 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f97232a6-9d49-4cfc-a108-ba448fe8d5e8 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:58.278805 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f97232a6-9d49-4cfc-a108-ba448fe8d5e8 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:58.279264 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f97232a6-9d49-4cfc-a108-ba448fe8d5e8 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:58.280255 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f97232a6-9d49-4cfc-a108-ba448fe8d5e8 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:58.280860 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f97232a6-9d49-4cfc-a108-ba448fe8d5e8 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:58.405296 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a6b84e3f-7d6f-43ea-bd6f-e27b3e3c8774 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e4f0060ec44989882b3b21624cb87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a293eac61499182c2a30c324d461f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:58.415741 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a6b84e3f-7d6f-43ea-bd6f-e27b3e3c8774 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] 10.222.0.20 "GET /compute/v2.1/servers/9e6e9f1d-bd16-433f-b71c-28676755ada1" status: 200 len: 1314 microversion: 2.1 time: 0.368243 Apr 16 21:39:58.424443 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3194/6235] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:58 2022] GET /compute/v2.1/servers/9e6e9f1d-bd16-433f-b71c-28676755ada1 => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:39:58.455903 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f97232a6-9d49-4cfc-a108-ba448fe8d5e8 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:58.481366 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f97232a6-9d49-4cfc-a108-ba448fe8d5e8 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024" status: 200 len: 1392 microversion: 2.1 time: 0.214332 Apr 16 21:39:58.482296 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3042/6236] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:58 2022] GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024 => generated 1392 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:39:58.498070 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-e85f572f-0293-4d75-851e-d08006e4ae8d req-7c8befd9-7c11-4181-b5d8-ad8eb87c2f8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7537290d-836b-431c-bfb7-c8f83dd03024", "name": "network-vif-plugged", "status": "completed", "tag": "73138183-36f0-4a32-833a-7b6e3fa38956"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:39:58.512386 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-e85f572f-0293-4d75-851e-d08006e4ae8d req-7c8befd9-7c11-4181-b5d8-ad8eb87c2f8e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:58.516013 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-e85f572f-0293-4d75-851e-d08006e4ae8d req-7c8befd9-7c11-4181-b5d8-ad8eb87c2f8e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:58.535396 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-e85f572f-0293-4d75-851e-d08006e4ae8d req-7c8befd9-7c11-4181-b5d8-ad8eb87c2f8e service nova] Creating event network-vif-plugged:73138183-36f0-4a32-833a-7b6e3fa38956 for instance 7537290d-836b-431c-bfb7-c8f83dd03024 on nch2-master-1 Apr 16 21:39:58.543970 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-e85f572f-0293-4d75-851e-d08006e4ae8d req-7c8befd9-7c11-4181-b5d8-ad8eb87c2f8e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049451 Apr 16 21:39:58.550354 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3195/6237] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:39:59.435119 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-836201e0-9037-4e80-a9af-6569836c1b55 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:59.437655 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-836201e0-9037-4e80-a9af-6569836c1b55 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] [instance: 9e6e9f1d-bd16-433f-b71c-28676755ada1] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:59.453950 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-836201e0-9037-4e80-a9af-6569836c1b55 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:59.454413 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-836201e0-9037-4e80-a9af-6569836c1b55 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:59.455517 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-836201e0-9037-4e80-a9af-6569836c1b55 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:59.455917 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-836201e0-9037-4e80-a9af-6569836c1b55 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:59.502492 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bc164988-5a49-4580-9413-25ea2e506ea6 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:39:59.503894 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-bc164988-5a49-4580-9413-25ea2e506ea6 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:39:59.511987 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bc164988-5a49-4580-9413-25ea2e506ea6 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:59.512749 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bc164988-5a49-4580-9413-25ea2e506ea6 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:59.513717 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bc164988-5a49-4580-9413-25ea2e506ea6 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:39:59.514419 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bc164988-5a49-4580-9413-25ea2e506ea6 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:39:59.651854 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-836201e0-9037-4e80-a9af-6569836c1b55 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e4f0060ec44989882b3b21624cb87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a293eac61499182c2a30c324d461f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:59.661787 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-836201e0-9037-4e80-a9af-6569836c1b55 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] 10.222.0.20 "GET /compute/v2.1/servers/9e6e9f1d-bd16-433f-b71c-28676755ada1" status: 200 len: 1314 microversion: 2.1 time: 0.232247 Apr 16 21:39:59.662975 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3043/6238] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:59 2022] GET /compute/v2.1/servers/9e6e9f1d-bd16-433f-b71c-28676755ada1 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:39:59.752081 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-bc164988-5a49-4580-9413-25ea2e506ea6 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:39:59.760964 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-bc164988-5a49-4580-9413-25ea2e506ea6 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024" status: 200 len: 1392 microversion: 2.1 time: 0.263461 Apr 16 21:39:59.761275 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3196/6239] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:39:59 2022] GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024 => generated 1392 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:40:00.606122 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-1009b4b1-376c-445b-b7ea-d88e0073e49a req-8de801da-a1a1-49ea-a001-1b57db54db5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e6e9f1d-bd16-433f-b71c-28676755ada1", "name": "network-vif-plugged", "status": "completed", "tag": "3cc5ad53-5aec-413a-afba-7128ed6391bc"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:40:00.620469 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-1009b4b1-376c-445b-b7ea-d88e0073e49a req-8de801da-a1a1-49ea-a001-1b57db54db5e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:00.621150 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-1009b4b1-376c-445b-b7ea-d88e0073e49a req-8de801da-a1a1-49ea-a001-1b57db54db5e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:00.635961 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-1009b4b1-376c-445b-b7ea-d88e0073e49a req-8de801da-a1a1-49ea-a001-1b57db54db5e service nova] Creating event network-vif-plugged:3cc5ad53-5aec-413a-afba-7128ed6391bc for instance 9e6e9f1d-bd16-433f-b71c-28676755ada1 on nch1-master-1 Apr 16 21:40:00.641750 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-1009b4b1-376c-445b-b7ea-d88e0073e49a req-8de801da-a1a1-49ea-a001-1b57db54db5e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039292 Apr 16 21:40:00.642979 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3044/6240] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:40:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:40:00.684709 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d974bb5e-dc94-4fbd-bf7d-ab54c29b0359 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:40:00.685344 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d974bb5e-dc94-4fbd-bf7d-ab54c29b0359 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] [instance: 9e6e9f1d-bd16-433f-b71c-28676755ada1] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:00.698767 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d974bb5e-dc94-4fbd-bf7d-ab54c29b0359 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:00.701910 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d974bb5e-dc94-4fbd-bf7d-ab54c29b0359 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:00.705935 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d974bb5e-dc94-4fbd-bf7d-ab54c29b0359 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:00.706550 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d974bb5e-dc94-4fbd-bf7d-ab54c29b0359 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:00.779394 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-dc45603b-231c-483f-b498-252ea95e39d9 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:40:00.780561 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-dc45603b-231c-483f-b498-252ea95e39d9 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:00.787053 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dc45603b-231c-483f-b498-252ea95e39d9 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:00.787721 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dc45603b-231c-483f-b498-252ea95e39d9 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:00.788691 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dc45603b-231c-483f-b498-252ea95e39d9 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:00.789305 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dc45603b-231c-483f-b498-252ea95e39d9 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:01.079512 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-dc45603b-231c-483f-b498-252ea95e39d9 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:40:01.088692 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-dc45603b-231c-483f-b498-252ea95e39d9 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024" status: 200 len: 1564 microversion: 2.1 time: 0.314166 Apr 16 21:40:01.089497 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3045/6241] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:40:00 2022] GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024 => generated 1564 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:40:01.105636 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-10871729-1dae-438b-a03f-58f908ef7f09 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Action: 'create', calling method: .version_select at 0x7fbb9595ee50>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-735648333"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:40:01.116338 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d974bb5e-dc94-4fbd-bf7d-ab54c29b0359 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e4f0060ec44989882b3b21624cb87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a293eac61499182c2a30c324d461f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:40:01.136274 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-10871729-1dae-438b-a03f-58f908ef7f09 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Getting quotas for project 5279e09b8205420980e8c7accbcc5f93. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:40:01.140336 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d974bb5e-dc94-4fbd-bf7d-ab54c29b0359 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] 10.222.0.20 "GET /compute/v2.1/servers/9e6e9f1d-bd16-433f-b71c-28676755ada1" status: 200 len: 1314 microversion: 2.1 time: 0.457994 Apr 16 21:40:01.141889 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-10871729-1dae-438b-a03f-58f908ef7f09 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Getting quotas for user 1a36974ad8094dcd99951dbc1ce6049e and project 5279e09b8205420980e8c7accbcc5f93. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:40:01.145672 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3197/6242] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:40:00 2022] GET /compute/v2.1/servers/9e6e9f1d-bd16-433f-b71c-28676755ada1 => generated 1314 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:40:01.152916 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6ba347ea-d359-40db-aeae-4ce9d2fe6d21 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:40:01.154068 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6ba347ea-d359-40db-aeae-4ce9d2fe6d21 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:01.161722 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6ba347ea-d359-40db-aeae-4ce9d2fe6d21 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:01.162195 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6ba347ea-d359-40db-aeae-4ce9d2fe6d21 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:01.163110 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6ba347ea-d359-40db-aeae-4ce9d2fe6d21 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:01.163443 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6ba347ea-d359-40db-aeae-4ce9d2fe6d21 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:01.343541 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6ba347ea-d359-40db-aeae-4ce9d2fe6d21 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:40:01.353096 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6ba347ea-d359-40db-aeae-4ce9d2fe6d21 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024" status: 200 len: 1564 microversion: 2.1 time: 0.206239 Apr 16 21:40:01.365675 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3198/6243] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:40:01 2022] GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024 => generated 1564 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:40:01.495766 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-10871729-1dae-438b-a03f-58f908ef7f09 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Getting quotas for project 5279e09b8205420980e8c7accbcc5f93. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:40:01.500839 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-10871729-1dae-438b-a03f-58f908ef7f09 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Getting quotas for user 1a36974ad8094dcd99951dbc1ce6049e and project 5279e09b8205420980e8c7accbcc5f93. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:40:01.515416 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-10871729-1dae-438b-a03f-58f908ef7f09 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2312 microversion: 2.1 time: 0.414138 Apr 16 21:40:01.516034 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3046/6244] 10.222.0.20 () {60 vars in 1157 bytes} [Sat Apr 16 21:40:01 2022] POST /compute/v2.1/os-keypairs => generated 2312 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:40:02.161901 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5cd6a307-37ce-43b5-8393-66c71c54fee4 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:40:02.162552 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5cd6a307-37ce-43b5-8393-66c71c54fee4 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] [instance: 9e6e9f1d-bd16-433f-b71c-28676755ada1] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:02.170627 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5cd6a307-37ce-43b5-8393-66c71c54fee4 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:02.171106 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5cd6a307-37ce-43b5-8393-66c71c54fee4 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:02.171942 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5cd6a307-37ce-43b5-8393-66c71c54fee4 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:02.172444 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5cd6a307-37ce-43b5-8393-66c71c54fee4 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:02.451205 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5cd6a307-37ce-43b5-8393-66c71c54fee4 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e4f0060ec44989882b3b21624cb87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a293eac61499182c2a30c324d461f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:40:02.459830 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5cd6a307-37ce-43b5-8393-66c71c54fee4 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] 10.222.0.20 "GET /compute/v2.1/servers/9e6e9f1d-bd16-433f-b71c-28676755ada1" status: 200 len: 1314 microversion: 2.1 time: 0.302102 Apr 16 21:40:02.460738 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3199/6245] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:40:02 2022] GET /compute/v2.1/servers/9e6e9f1d-bd16-433f-b71c-28676755ada1 => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:40:03.479452 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-817d5fc2-0c6d-4534-adad-4f4bcb4352fd tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:40:03.480862 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-817d5fc2-0c6d-4534-adad-4f4bcb4352fd tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] [instance: 9e6e9f1d-bd16-433f-b71c-28676755ada1] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:03.489565 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-817d5fc2-0c6d-4534-adad-4f4bcb4352fd tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:03.490547 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-817d5fc2-0c6d-4534-adad-4f4bcb4352fd tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:03.490871 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-817d5fc2-0c6d-4534-adad-4f4bcb4352fd tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:03.491319 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-817d5fc2-0c6d-4534-adad-4f4bcb4352fd tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:03.664130 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-817d5fc2-0c6d-4534-adad-4f4bcb4352fd tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e4f0060ec44989882b3b21624cb87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a293eac61499182c2a30c324d461f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:40:03.678768 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-817d5fc2-0c6d-4534-adad-4f4bcb4352fd tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] 10.222.0.20 "GET /compute/v2.1/servers/9e6e9f1d-bd16-433f-b71c-28676755ada1" status: 200 len: 1499 microversion: 2.1 time: 0.204898 Apr 16 21:40:03.688061 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3047/6246] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:40:03 2022] GET /compute/v2.1/servers/9e6e9f1d-bd16-433f-b71c-28676755ada1 => generated 1499 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:40:04.425514 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d88b8a61-53c7-48db-9fa1-b212c1e2dda8 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:40:04.426707 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d88b8a61-53c7-48db-9fa1-b212c1e2dda8 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:04.438535 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d88b8a61-53c7-48db-9fa1-b212c1e2dda8 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:04.439045 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d88b8a61-53c7-48db-9fa1-b212c1e2dda8 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:04.439861 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d88b8a61-53c7-48db-9fa1-b212c1e2dda8 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:04.440406 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d88b8a61-53c7-48db-9fa1-b212c1e2dda8 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:04.728975 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d88b8a61-53c7-48db-9fa1-b212c1e2dda8 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:40:04.738559 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d88b8a61-53c7-48db-9fa1-b212c1e2dda8 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024" status: 200 len: 1564 microversion: 2.1 time: 0.317359 Apr 16 21:40:04.743553 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3200/6247] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:40:04 2022] GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024 => generated 1564 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:40:04.789773 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-ba775577-c3f5-46ba-a690-e4b276c187d2 req-98472469-5422-48e9-844d-0428b3c67a82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7537290d-836b-431c-bfb7-c8f83dd03024", "tag": "73138183-36f0-4a32-833a-7b6e3fa38956"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:40:04.803548 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-ba775577-c3f5-46ba-a690-e4b276c187d2 req-98472469-5422-48e9-844d-0428b3c67a82 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:04.804043 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-ba775577-c3f5-46ba-a690-e4b276c187d2 req-98472469-5422-48e9-844d-0428b3c67a82 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:04.826071 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-ba775577-c3f5-46ba-a690-e4b276c187d2 req-98472469-5422-48e9-844d-0428b3c67a82 service nova] Creating event network-changed:73138183-36f0-4a32-833a-7b6e3fa38956 for instance 7537290d-836b-431c-bfb7-c8f83dd03024 on nch2-master-1 Apr 16 21:40:04.839457 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-ba775577-c3f5-46ba-a690-e4b276c187d2 req-98472469-5422-48e9-844d-0428b3c67a82 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.415877 Apr 16 21:40:04.844408 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3048/6248] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:40:05.617332 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6d1d9dcd-a5a4-4104-b4bc-38f93ffbbd8a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1794604800", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "b388ded9-ed4e-4d02-8bce-a7e57d94b1b5"}], "key_name": "tempest-TestNetworkBasicOps-735648333", "security_groups": [{"name": "tempest-secgroup-smoke-448113110"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:40:05.752720 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-6d1d9dcd-a5a4-4104-b4bc-38f93ffbbd8a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] validate_networks() for [('b388ded9-ed4e-4d02-8bce-a7e57d94b1b5', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:40:06.134271 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-6d1d9dcd-a5a4-4104-b4bc-38f93ffbbd8a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:40:06.134699 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-6d1d9dcd-a5a4-4104-b4bc-38f93ffbbd8a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:40:06.135178 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-6d1d9dcd-a5a4-4104-b4bc-38f93ffbbd8a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:40:06.135591 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-6d1d9dcd-a5a4-4104-b4bc-38f93ffbbd8a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:40:06.136026 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-6d1d9dcd-a5a4-4104-b4bc-38f93ffbbd8a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:40:06.145341 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6d1d9dcd-a5a4-4104-b4bc-38f93ffbbd8a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:06.145804 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6d1d9dcd-a5a4-4104-b4bc-38f93ffbbd8a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:06.146676 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6d1d9dcd-a5a4-4104-b4bc-38f93ffbbd8a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:06.147149 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6d1d9dcd-a5a4-4104-b4bc-38f93ffbbd8a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:06.165404 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-6d1d9dcd-a5a4-4104-b4bc-38f93ffbbd8a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Getting quotas for project 5279e09b8205420980e8c7accbcc5f93. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:40:06.174663 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-6d1d9dcd-a5a4-4104-b4bc-38f93ffbbd8a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Getting quotas for user 1a36974ad8094dcd99951dbc1ce6049e and project 5279e09b8205420980e8c7accbcc5f93. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:40:06.188721 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6d1d9dcd-a5a4-4104-b4bc-38f93ffbbd8a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:40:06.192522 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6d1d9dcd-a5a4-4104-b4bc-38f93ffbbd8a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 57955d80-c264-4db1-8860-f2e5ac141ab7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:40:06.686169 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6d1d9dcd-a5a4-4104-b4bc-38f93ffbbd8a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.072808 Apr 16 21:40:06.687323 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3201/6249] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:40:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 1074 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:40:06.698318 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-86036692-ecb0-4b2b-b12a-9d2e4748619f tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:40:06.699915 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-86036692-ecb0-4b2b-b12a-9d2e4748619f tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 57955d80-c264-4db1-8860-f2e5ac141ab7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:06.765834 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-86036692-ecb0-4b2b-b12a-9d2e4748619f tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a36974ad8094dcd99951dbc1ce6049e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5279e09b8205420980e8c7accbcc5f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:40:06.774381 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-86036692-ecb0-4b2b-b12a-9d2e4748619f tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/57955d80-c264-4db1-8860-f2e5ac141ab7" status: 200 len: 1248 microversion: 2.1 time: 0.081030 Apr 16 21:40:06.782587 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3049/6250] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:40:06 2022] GET /compute/v2.1/servers/57955d80-c264-4db1-8860-f2e5ac141ab7 => generated 1248 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:40:07.792588 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-48d0c3c8-2bf5-413c-8e8e-1df9860fecab tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:40:07.793257 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-48d0c3c8-2bf5-413c-8e8e-1df9860fecab tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 57955d80-c264-4db1-8860-f2e5ac141ab7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:07.846888 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-48d0c3c8-2bf5-413c-8e8e-1df9860fecab tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a36974ad8094dcd99951dbc1ce6049e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5279e09b8205420980e8c7accbcc5f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:40:07.853737 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-48d0c3c8-2bf5-413c-8e8e-1df9860fecab tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/57955d80-c264-4db1-8860-f2e5ac141ab7" status: 200 len: 1248 microversion: 2.1 time: 0.065960 Apr 16 21:40:07.854311 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3202/6251] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:40:07 2022] GET /compute/v2.1/servers/57955d80-c264-4db1-8860-f2e5ac141ab7 => generated 1248 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:40:08.870775 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-66998eb3-b8e4-43de-8de8-b4b30a68f383 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:40:08.871398 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-66998eb3-b8e4-43de-8de8-b4b30a68f383 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 57955d80-c264-4db1-8860-f2e5ac141ab7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:08.879314 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-66998eb3-b8e4-43de-8de8-b4b30a68f383 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:08.879790 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-66998eb3-b8e4-43de-8de8-b4b30a68f383 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:08.880615 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-66998eb3-b8e4-43de-8de8-b4b30a68f383 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:08.881073 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-66998eb3-b8e4-43de-8de8-b4b30a68f383 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:08.941437 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-66998eb3-b8e4-43de-8de8-b4b30a68f383 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a36974ad8094dcd99951dbc1ce6049e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5279e09b8205420980e8c7accbcc5f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:40:08.950067 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-66998eb3-b8e4-43de-8de8-b4b30a68f383 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/57955d80-c264-4db1-8860-f2e5ac141ab7" status: 200 len: 1300 microversion: 2.1 time: 0.083114 Apr 16 21:40:08.951107 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3050/6252] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:40:08 2022] GET /compute/v2.1/servers/57955d80-c264-4db1-8860-f2e5ac141ab7 => generated 1300 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:40:09.968383 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7efaa51b-2c7a-4522-8b0d-2eaa2436b0d3 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:40:09.968912 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7efaa51b-2c7a-4522-8b0d-2eaa2436b0d3 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 57955d80-c264-4db1-8860-f2e5ac141ab7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:09.976222 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7efaa51b-2c7a-4522-8b0d-2eaa2436b0d3 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:09.976686 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7efaa51b-2c7a-4522-8b0d-2eaa2436b0d3 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:09.977500 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7efaa51b-2c7a-4522-8b0d-2eaa2436b0d3 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:09.977946 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7efaa51b-2c7a-4522-8b0d-2eaa2436b0d3 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:10.554449 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7efaa51b-2c7a-4522-8b0d-2eaa2436b0d3 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a36974ad8094dcd99951dbc1ce6049e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5279e09b8205420980e8c7accbcc5f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:40:10.562441 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7efaa51b-2c7a-4522-8b0d-2eaa2436b0d3 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/57955d80-c264-4db1-8860-f2e5ac141ab7" status: 200 len: 1373 microversion: 2.1 time: 0.598005 Apr 16 21:40:10.563067 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3203/6253] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:40:09 2022] GET /compute/v2.1/servers/57955d80-c264-4db1-8860-f2e5ac141ab7 => generated 1373 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:40:11.458805 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-b8578c4d-08bb-4be5-9573-70e0b9a1ed93 req-b0148dd3-89b6-450c-a1df-bc93350214c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57955d80-c264-4db1-8860-f2e5ac141ab7", "tag": "e80de17d-54c2-489c-a517-04dc0b10426e"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:40:11.473932 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-b8578c4d-08bb-4be5-9573-70e0b9a1ed93 req-b0148dd3-89b6-450c-a1df-bc93350214c0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:11.474209 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-b8578c4d-08bb-4be5-9573-70e0b9a1ed93 req-b0148dd3-89b6-450c-a1df-bc93350214c0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:11.496912 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-b8578c4d-08bb-4be5-9573-70e0b9a1ed93 req-b0148dd3-89b6-450c-a1df-bc93350214c0 service nova] Creating event network-changed:e80de17d-54c2-489c-a517-04dc0b10426e for instance 57955d80-c264-4db1-8860-f2e5ac141ab7 on nch2-master-1 Apr 16 21:40:11.502627 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-b8578c4d-08bb-4be5-9573-70e0b9a1ed93 req-b0148dd3-89b6-450c-a1df-bc93350214c0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047813 Apr 16 21:40:11.503515 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3051/6254] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:40:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:40:11.580088 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2b273f77-bd16-407c-a7f8-3d692a6ef15e tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:40:11.581612 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2b273f77-bd16-407c-a7f8-3d692a6ef15e tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 57955d80-c264-4db1-8860-f2e5ac141ab7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:11.588477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b273f77-bd16-407c-a7f8-3d692a6ef15e tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:11.588943 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b273f77-bd16-407c-a7f8-3d692a6ef15e tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:11.589745 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b273f77-bd16-407c-a7f8-3d692a6ef15e tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:11.590304 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b273f77-bd16-407c-a7f8-3d692a6ef15e tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:11.862486 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2b273f77-bd16-407c-a7f8-3d692a6ef15e tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a36974ad8094dcd99951dbc1ce6049e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5279e09b8205420980e8c7accbcc5f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:40:11.871415 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2b273f77-bd16-407c-a7f8-3d692a6ef15e tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/57955d80-c264-4db1-8860-f2e5ac141ab7" status: 200 len: 1373 microversion: 2.1 time: 0.295076 Apr 16 21:40:11.882517 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3204/6255] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:40:11 2022] GET /compute/v2.1/servers/57955d80-c264-4db1-8860-f2e5ac141ab7 => generated 1373 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:40:12.461536 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-938dd1a7-6869-4cb0-86e7-f6e46dfab6c3 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:40:12.462139 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-938dd1a7-6869-4cb0-86e7-f6e46dfab6c3 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] [instance: 9e6e9f1d-bd16-433f-b71c-28676755ada1] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:12.468801 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-938dd1a7-6869-4cb0-86e7-f6e46dfab6c3 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:12.469255 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-938dd1a7-6869-4cb0-86e7-f6e46dfab6c3 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:12.470071 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-938dd1a7-6869-4cb0-86e7-f6e46dfab6c3 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:12.470526 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-938dd1a7-6869-4cb0-86e7-f6e46dfab6c3 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:12.500453 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-938dd1a7-6869-4cb0-86e7-f6e46dfab6c3 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] [instance: 9e6e9f1d-bd16-433f-b71c-28676755ada1] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:40:12.861315 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-938dd1a7-6869-4cb0-86e7-f6e46dfab6c3 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9e6e9f1d-bd16-433f-b71c-28676755ada1" status: 204 len: 0 microversion: 2.1 time: 0.403039 Apr 16 21:40:12.862066 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3052/6256] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:40:12 2022] DELETE /compute/v2.1/servers/9e6e9f1d-bd16-433f-b71c-28676755ada1 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:40:12.870544 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-903434e2-683c-4df1-8be0-0df9acf81aec tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:40:12.871167 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-903434e2-683c-4df1-8be0-0df9acf81aec tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] [instance: 9e6e9f1d-bd16-433f-b71c-28676755ada1] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:12.878143 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-903434e2-683c-4df1-8be0-0df9acf81aec tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:12.878606 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-903434e2-683c-4df1-8be0-0df9acf81aec tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:12.879393 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-903434e2-683c-4df1-8be0-0df9acf81aec tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:12.879843 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-903434e2-683c-4df1-8be0-0df9acf81aec tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:12.889518 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-73de35fc-99b7-41bb-8340-dfa3a8248dca tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:40:12.890265 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-73de35fc-99b7-41bb-8340-dfa3a8248dca tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 57955d80-c264-4db1-8860-f2e5ac141ab7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:12.896303 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-73de35fc-99b7-41bb-8340-dfa3a8248dca tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:12.896766 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-73de35fc-99b7-41bb-8340-dfa3a8248dca tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:12.897588 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-73de35fc-99b7-41bb-8340-dfa3a8248dca tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:12.898032 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-73de35fc-99b7-41bb-8340-dfa3a8248dca tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:13.025640 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-903434e2-683c-4df1-8be0-0df9acf81aec tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e4f0060ec44989882b3b21624cb87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a293eac61499182c2a30c324d461f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:40:13.033740 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-73de35fc-99b7-41bb-8340-dfa3a8248dca tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a36974ad8094dcd99951dbc1ce6049e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5279e09b8205420980e8c7accbcc5f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:40:13.033920 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-903434e2-683c-4df1-8be0-0df9acf81aec tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] 10.222.0.20 "GET /compute/v2.1/servers/9e6e9f1d-bd16-433f-b71c-28676755ada1" status: 200 len: 1505 microversion: 2.1 time: 0.167361 Apr 16 21:40:13.034378 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3205/6257] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:40:12 2022] GET /compute/v2.1/servers/9e6e9f1d-bd16-433f-b71c-28676755ada1 => generated 1505 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:40:13.041824 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-73de35fc-99b7-41bb-8340-dfa3a8248dca tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/57955d80-c264-4db1-8860-f2e5ac141ab7" status: 200 len: 1373 microversion: 2.1 time: 0.156460 Apr 16 21:40:13.042391 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3053/6258] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:40:12 2022] GET /compute/v2.1/servers/57955d80-c264-4db1-8860-f2e5ac141ab7 => generated 1373 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:40:14.051698 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-25931e7f-6096-4efd-b345-18c1674c6018 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:40:14.052440 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-25931e7f-6096-4efd-b345-18c1674c6018 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] [instance: 9e6e9f1d-bd16-433f-b71c-28676755ada1] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:14.058704 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ae1057da-ec86-48f5-8457-9c2a77153d3c tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:40:14.059446 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ae1057da-ec86-48f5-8457-9c2a77153d3c tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 57955d80-c264-4db1-8860-f2e5ac141ab7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:14.059556 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-25931e7f-6096-4efd-b345-18c1674c6018 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:14.059899 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-25931e7f-6096-4efd-b345-18c1674c6018 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:14.060709 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-25931e7f-6096-4efd-b345-18c1674c6018 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:14.061151 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-25931e7f-6096-4efd-b345-18c1674c6018 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:14.067588 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ae1057da-ec86-48f5-8457-9c2a77153d3c tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:14.068352 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ae1057da-ec86-48f5-8457-9c2a77153d3c tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:14.069182 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ae1057da-ec86-48f5-8457-9c2a77153d3c tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:14.069636 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ae1057da-ec86-48f5-8457-9c2a77153d3c tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:14.193203 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-25931e7f-6096-4efd-b345-18c1674c6018 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e4f0060ec44989882b3b21624cb87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a293eac61499182c2a30c324d461f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:40:14.202969 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-25931e7f-6096-4efd-b345-18c1674c6018 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] 10.222.0.20 "GET /compute/v2.1/servers/9e6e9f1d-bd16-433f-b71c-28676755ada1" status: 200 len: 1505 microversion: 2.1 time: 0.155742 Apr 16 21:40:14.203761 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3206/6259] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:40:14 2022] GET /compute/v2.1/servers/9e6e9f1d-bd16-433f-b71c-28676755ada1 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:40:14.210474 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ae1057da-ec86-48f5-8457-9c2a77153d3c tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a36974ad8094dcd99951dbc1ce6049e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5279e09b8205420980e8c7accbcc5f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:40:14.217937 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ae1057da-ec86-48f5-8457-9c2a77153d3c tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/57955d80-c264-4db1-8860-f2e5ac141ab7" status: 200 len: 1373 microversion: 2.1 time: 0.163096 Apr 16 21:40:14.218509 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3054/6260] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:40:14 2022] GET /compute/v2.1/servers/57955d80-c264-4db1-8860-f2e5ac141ab7 => generated 1373 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:40:15.085048 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-e6efa057-86b0-4848-b894-5dac2297fa57 req-a3da2898-289e-4d79-a4a9-ac3400777c2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e6e9f1d-bd16-433f-b71c-28676755ada1", "name": "network-vif-deleted", "tag": "3cc5ad53-5aec-413a-afba-7128ed6391bc"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:40:15.094186 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-e6efa057-86b0-4848-b894-5dac2297fa57 req-a3da2898-289e-4d79-a4a9-ac3400777c2a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:15.098517 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-e6efa057-86b0-4848-b894-5dac2297fa57 req-a3da2898-289e-4d79-a4a9-ac3400777c2a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:15.105718 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-e6efa057-86b0-4848-b894-5dac2297fa57 req-a3da2898-289e-4d79-a4a9-ac3400777c2a service nova] Creating event network-vif-deleted:3cc5ad53-5aec-413a-afba-7128ed6391bc for instance 9e6e9f1d-bd16-433f-b71c-28676755ada1 on nch1-master-1 Apr 16 21:40:15.110689 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-e6efa057-86b0-4848-b894-5dac2297fa57 req-a3da2898-289e-4d79-a4a9-ac3400777c2a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029423 Apr 16 21:40:15.111317 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3207/6261] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:40:15.221109 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a64d115e-76fa-4ee4-938f-165f6c752e46 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:40:15.221729 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a64d115e-76fa-4ee4-938f-165f6c752e46 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] [instance: 9e6e9f1d-bd16-433f-b71c-28676755ada1] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:15.228353 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a64d115e-76fa-4ee4-938f-165f6c752e46 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:15.228825 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a64d115e-76fa-4ee4-938f-165f6c752e46 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:15.229619 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a64d115e-76fa-4ee4-938f-165f6c752e46 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:15.230288 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a64d115e-76fa-4ee4-938f-165f6c752e46 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:15.242459 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cc061692-4e05-4cdc-9ce1-4849233e913a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:40:15.243319 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cc061692-4e05-4cdc-9ce1-4849233e913a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 57955d80-c264-4db1-8860-f2e5ac141ab7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:15.253755 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cc061692-4e05-4cdc-9ce1-4849233e913a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:15.254334 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cc061692-4e05-4cdc-9ce1-4849233e913a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:15.255238 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cc061692-4e05-4cdc-9ce1-4849233e913a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:15.255791 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cc061692-4e05-4cdc-9ce1-4849233e913a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:15.304954 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a64d115e-76fa-4ee4-938f-165f6c752e46 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e4f0060ec44989882b3b21624cb87a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c96a293eac61499182c2a30c324d461f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:40:15.312653 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a64d115e-76fa-4ee4-938f-165f6c752e46 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] 10.222.0.20 "GET /compute/v2.1/servers/9e6e9f1d-bd16-433f-b71c-28676755ada1" status: 200 len: 1299 microversion: 2.1 time: 0.096525 Apr 16 21:40:15.313233 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3055/6262] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:40:15 2022] GET /compute/v2.1/servers/9e6e9f1d-bd16-433f-b71c-28676755ada1 => generated 1299 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:40:15.397879 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cc061692-4e05-4cdc-9ce1-4849233e913a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a36974ad8094dcd99951dbc1ce6049e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5279e09b8205420980e8c7accbcc5f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:40:15.405401 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cc061692-4e05-4cdc-9ce1-4849233e913a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/57955d80-c264-4db1-8860-f2e5ac141ab7" status: 200 len: 1373 microversion: 2.1 time: 0.174103 Apr 16 21:40:15.405999 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3208/6263] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:40:15 2022] GET /compute/v2.1/servers/57955d80-c264-4db1-8860-f2e5ac141ab7 => generated 1373 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:40:16.331155 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-465ad004-7bdb-41c9-8226-6c29651b86f9 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:40:16.331775 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-465ad004-7bdb-41c9-8226-6c29651b86f9 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] [instance: 9e6e9f1d-bd16-433f-b71c-28676755ada1] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:16.338247 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-465ad004-7bdb-41c9-8226-6c29651b86f9 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:16.343211 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-465ad004-7bdb-41c9-8226-6c29651b86f9 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:16.343211 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-465ad004-7bdb-41c9-8226-6c29651b86f9 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:16.343211 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-465ad004-7bdb-41c9-8226-6c29651b86f9 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:16.354309 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-465ad004-7bdb-41c9-8226-6c29651b86f9 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] HTTP exception thrown: Instance 9e6e9f1d-bd16-433f-b71c-28676755ada1 could not be found. Apr 16 21:40:16.354948 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-465ad004-7bdb-41c9-8226-6c29651b86f9 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] Returning 404 to user: Instance 9e6e9f1d-bd16-433f-b71c-28676755ada1 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:40:16.355786 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-465ad004-7bdb-41c9-8226-6c29651b86f9 tempest-VolumesActionsTest-1967188215 tempest-VolumesActionsTest-1967188215-project] 10.222.0.20 "GET /compute/v2.1/servers/9e6e9f1d-bd16-433f-b71c-28676755ada1" status: 404 len: 111 microversion: 2.1 time: 0.029078 Apr 16 21:40:16.356372 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3056/6264] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:40:16 2022] GET /compute/v2.1/servers/9e6e9f1d-bd16-433f-b71c-28676755ada1 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:40:16.422533 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a9014fe2-72f0-4708-a55a-06515af6c5d3 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:40:16.423065 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a9014fe2-72f0-4708-a55a-06515af6c5d3 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 57955d80-c264-4db1-8860-f2e5ac141ab7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:16.429921 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9014fe2-72f0-4708-a55a-06515af6c5d3 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:16.430375 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9014fe2-72f0-4708-a55a-06515af6c5d3 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:16.431149 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9014fe2-72f0-4708-a55a-06515af6c5d3 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:16.431592 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9014fe2-72f0-4708-a55a-06515af6c5d3 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:16.573146 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a9014fe2-72f0-4708-a55a-06515af6c5d3 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a36974ad8094dcd99951dbc1ce6049e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5279e09b8205420980e8c7accbcc5f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:40:16.587380 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a9014fe2-72f0-4708-a55a-06515af6c5d3 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/57955d80-c264-4db1-8860-f2e5ac141ab7" status: 200 len: 1373 microversion: 2.1 time: 0.168660 Apr 16 21:40:16.588263 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3209/6265] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:40:16 2022] GET /compute/v2.1/servers/57955d80-c264-4db1-8860-f2e5ac141ab7 => generated 1373 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:40:17.605093 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-798424c2-ed75-4940-9231-83373a19a1b5 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:40:17.605774 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-798424c2-ed75-4940-9231-83373a19a1b5 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 57955d80-c264-4db1-8860-f2e5ac141ab7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:17.613306 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-798424c2-ed75-4940-9231-83373a19a1b5 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:17.613764 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-798424c2-ed75-4940-9231-83373a19a1b5 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:17.614579 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-798424c2-ed75-4940-9231-83373a19a1b5 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:17.615018 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-798424c2-ed75-4940-9231-83373a19a1b5 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:17.750586 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-798424c2-ed75-4940-9231-83373a19a1b5 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a36974ad8094dcd99951dbc1ce6049e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5279e09b8205420980e8c7accbcc5f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:40:17.758955 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-798424c2-ed75-4940-9231-83373a19a1b5 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/57955d80-c264-4db1-8860-f2e5ac141ab7" status: 200 len: 1373 microversion: 2.1 time: 0.157883 Apr 16 21:40:17.759552 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3057/6266] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:40:17 2022] GET /compute/v2.1/servers/57955d80-c264-4db1-8860-f2e5ac141ab7 => generated 1373 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:40:18.198392 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-8536c9b8-99a0-49c9-99a1-14aa3db40e51 req-4c5550f1-20ba-4282-a54c-3137c9919858 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57955d80-c264-4db1-8860-f2e5ac141ab7", "name": "network-vif-plugged", "status": "completed", "tag": "e80de17d-54c2-489c-a517-04dc0b10426e"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:40:18.207357 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-8536c9b8-99a0-49c9-99a1-14aa3db40e51 req-4c5550f1-20ba-4282-a54c-3137c9919858 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:18.207820 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-8536c9b8-99a0-49c9-99a1-14aa3db40e51 req-4c5550f1-20ba-4282-a54c-3137c9919858 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:18.219364 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-8536c9b8-99a0-49c9-99a1-14aa3db40e51 req-4c5550f1-20ba-4282-a54c-3137c9919858 service nova] Creating event network-vif-plugged:e80de17d-54c2-489c-a517-04dc0b10426e for instance 57955d80-c264-4db1-8860-f2e5ac141ab7 on nch2-master-1 Apr 16 21:40:18.224331 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-8536c9b8-99a0-49c9-99a1-14aa3db40e51 req-4c5550f1-20ba-4282-a54c-3137c9919858 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029693 Apr 16 21:40:18.224925 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3210/6267] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:40:18.775810 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b0ae76b6-2ce7-4155-9f52-3c57ebeb34ef tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:40:18.776427 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b0ae76b6-2ce7-4155-9f52-3c57ebeb34ef tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 57955d80-c264-4db1-8860-f2e5ac141ab7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:18.783282 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b0ae76b6-2ce7-4155-9f52-3c57ebeb34ef tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:18.790540 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b0ae76b6-2ce7-4155-9f52-3c57ebeb34ef tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:18.790540 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b0ae76b6-2ce7-4155-9f52-3c57ebeb34ef tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:18.790540 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b0ae76b6-2ce7-4155-9f52-3c57ebeb34ef tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:18.915541 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b0ae76b6-2ce7-4155-9f52-3c57ebeb34ef tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a36974ad8094dcd99951dbc1ce6049e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5279e09b8205420980e8c7accbcc5f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:40:18.923112 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b0ae76b6-2ce7-4155-9f52-3c57ebeb34ef tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/57955d80-c264-4db1-8860-f2e5ac141ab7" status: 200 len: 1373 microversion: 2.1 time: 0.151310 Apr 16 21:40:18.923683 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3058/6268] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:40:18 2022] GET /compute/v2.1/servers/57955d80-c264-4db1-8860-f2e5ac141ab7 => generated 1373 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:40:19.941321 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d76f6e76-706e-4edc-a2d0-28d856bad6bf tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:40:19.942167 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d76f6e76-706e-4edc-a2d0-28d856bad6bf tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 57955d80-c264-4db1-8860-f2e5ac141ab7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:19.948473 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d76f6e76-706e-4edc-a2d0-28d856bad6bf tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:19.948942 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d76f6e76-706e-4edc-a2d0-28d856bad6bf tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:19.949744 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d76f6e76-706e-4edc-a2d0-28d856bad6bf tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:19.950192 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d76f6e76-706e-4edc-a2d0-28d856bad6bf tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:20.173827 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d76f6e76-706e-4edc-a2d0-28d856bad6bf tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a36974ad8094dcd99951dbc1ce6049e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5279e09b8205420980e8c7accbcc5f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:40:20.181342 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d76f6e76-706e-4edc-a2d0-28d856bad6bf tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/57955d80-c264-4db1-8860-f2e5ac141ab7" status: 200 len: 1373 microversion: 2.1 time: 0.245270 Apr 16 21:40:20.182029 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3211/6269] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:40:19 2022] GET /compute/v2.1/servers/57955d80-c264-4db1-8860-f2e5ac141ab7 => generated 1373 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:40:21.198395 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ef43121a-96b6-4a19-bf08-9f4fbc6b6986 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:40:21.198998 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ef43121a-96b6-4a19-bf08-9f4fbc6b6986 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 57955d80-c264-4db1-8860-f2e5ac141ab7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:21.205859 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ef43121a-96b6-4a19-bf08-9f4fbc6b6986 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:21.206326 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ef43121a-96b6-4a19-bf08-9f4fbc6b6986 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:21.207113 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ef43121a-96b6-4a19-bf08-9f4fbc6b6986 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:21.207566 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ef43121a-96b6-4a19-bf08-9f4fbc6b6986 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:21.340475 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ef43121a-96b6-4a19-bf08-9f4fbc6b6986 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a36974ad8094dcd99951dbc1ce6049e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5279e09b8205420980e8c7accbcc5f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:40:21.348620 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ef43121a-96b6-4a19-bf08-9f4fbc6b6986 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/57955d80-c264-4db1-8860-f2e5ac141ab7" status: 200 len: 1545 microversion: 2.1 time: 0.154256 Apr 16 21:40:21.349205 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3059/6270] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:40:21 2022] GET /compute/v2.1/servers/57955d80-c264-4db1-8860-f2e5ac141ab7 => generated 1545 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:40:21.366949 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-03417055-511b-45e1-ba90-8a90414be041 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:40:21.370030 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-03417055-511b-45e1-ba90-8a90414be041 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 57955d80-c264-4db1-8860-f2e5ac141ab7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:21.374260 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-03417055-511b-45e1-ba90-8a90414be041 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:21.374724 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-03417055-511b-45e1-ba90-8a90414be041 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:21.375518 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-03417055-511b-45e1-ba90-8a90414be041 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:21.375965 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-03417055-511b-45e1-ba90-8a90414be041 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:21.520018 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-03417055-511b-45e1-ba90-8a90414be041 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a36974ad8094dcd99951dbc1ce6049e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5279e09b8205420980e8c7accbcc5f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:40:21.528353 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-03417055-511b-45e1-ba90-8a90414be041 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/57955d80-c264-4db1-8860-f2e5ac141ab7" status: 200 len: 1545 microversion: 2.1 time: 0.166756 Apr 16 21:40:21.529128 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3212/6271] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:40:21 2022] GET /compute/v2.1/servers/57955d80-c264-4db1-8860-f2e5ac141ab7 => generated 1545 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:40:23.101736 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5cafb520-46df-47b9-a761-c1daae217d61 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:40:23.102296 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5cafb520-46df-47b9-a761-c1daae217d61 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:23.110735 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5cafb520-46df-47b9-a761-c1daae217d61 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:23.111202 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5cafb520-46df-47b9-a761-c1daae217d61 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:23.112033 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5cafb520-46df-47b9-a761-c1daae217d61 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:23.112498 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5cafb520-46df-47b9-a761-c1daae217d61 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:23.141987 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5cafb520-46df-47b9-a761-c1daae217d61 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf/ips" status: 200 len: 144 microversion: 2.1 time: 0.044185 Apr 16 21:40:23.142589 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3060/6272] 10.222.0.20 () {58 vars in 1247 bytes} [Sat Apr 16 21:40:23 2022] GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf/ips => generated 144 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:40:24.070624 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-61362d06-333a-4d09-be91-0733094cca06 req-2b0bde33-1a48-4914-8012-0a408d90d83b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57955d80-c264-4db1-8860-f2e5ac141ab7", "tag": "e80de17d-54c2-489c-a517-04dc0b10426e"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:40:24.079571 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-61362d06-333a-4d09-be91-0733094cca06 req-2b0bde33-1a48-4914-8012-0a408d90d83b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:24.080031 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-61362d06-333a-4d09-be91-0733094cca06 req-2b0bde33-1a48-4914-8012-0a408d90d83b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:24.091450 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-61362d06-333a-4d09-be91-0733094cca06 req-2b0bde33-1a48-4914-8012-0a408d90d83b service nova] Creating event network-changed:e80de17d-54c2-489c-a517-04dc0b10426e for instance 57955d80-c264-4db1-8860-f2e5ac141ab7 on nch2-master-1 Apr 16 21:40:24.097360 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-61362d06-333a-4d09-be91-0733094cca06 req-2b0bde33-1a48-4914-8012-0a408d90d83b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030431 Apr 16 21:40:24.098158 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3213/6273] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:40:29.297724 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fd1bfd7b-f0f0-47a5-9ac5-c5063cc1d861 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c83e6b4d-92b1-4775-8ed2-19365c945f19"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:40:29.298847 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-fd1bfd7b-f0f0-47a5-9ac5-c5063cc1d861 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:29.306127 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fd1bfd7b-f0f0-47a5-9ac5-c5063cc1d861 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:29.306589 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fd1bfd7b-f0f0-47a5-9ac5-c5063cc1d861 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:29.307360 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fd1bfd7b-f0f0-47a5-9ac5-c5063cc1d861 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:29.307804 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fd1bfd7b-f0f0-47a5-9ac5-c5063cc1d861 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:30.139457 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fd1bfd7b-f0f0-47a5-9ac5-c5063cc1d861 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "POST /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.845621 Apr 16 21:40:30.140732 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3061/6274] 10.222.0.20 () {60 vars in 1322 bytes} [Sat Apr 16 21:40:29 2022] POST /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf/os-volume_attachments => generated 194 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:40:35.514487 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6ea9f919-0844-4fdd-a4e5-8e01a324150f tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:40:35.520710 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6ea9f919-0844-4fdd-a4e5-8e01a324150f tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:35.521171 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6ea9f919-0844-4fdd-a4e5-8e01a324150f tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:35.542805 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6ea9f919-0844-4fdd-a4e5-8e01a324150f tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Going to try to stop instance {{(pid=137408) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 16 21:40:35.800347 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6ea9f919-0844-4fdd-a4e5-8e01a324150f tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "POST /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf/action" status: 202 len: 0 microversion: 2.1 time: 0.290802 Apr 16 21:40:35.801638 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3214/6275] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:40:35 2022] POST /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:40:35.811359 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3dd798f6-abca-4c22-b52c-cf3e284750ff tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:40:35.812188 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3dd798f6-abca-4c22-b52c-cf3e284750ff tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:35.819211 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3dd798f6-abca-4c22-b52c-cf3e284750ff tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:35.823103 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3dd798f6-abca-4c22-b52c-cf3e284750ff tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:35.823103 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3dd798f6-abca-4c22-b52c-cf3e284750ff tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:35.823103 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3dd798f6-abca-4c22-b52c-cf3e284750ff tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:35.955397 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3dd798f6-abca-4c22-b52c-cf3e284750ff tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:40:35.963977 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3dd798f6-abca-4c22-b52c-cf3e284750ff tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf" status: 200 len: 1720 microversion: 2.1 time: 0.157697 Apr 16 21:40:35.964588 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3062/6276] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:40:35 2022] GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:40:36.122053 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-dbdb5608-7ef0-47e7-902f-8212a09ac73c tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:40:36.123105 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-dbdb5608-7ef0-47e7-902f-8212a09ac73c tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:36.129849 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dbdb5608-7ef0-47e7-902f-8212a09ac73c tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:36.130036 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dbdb5608-7ef0-47e7-902f-8212a09ac73c tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:36.131135 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dbdb5608-7ef0-47e7-902f-8212a09ac73c tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:36.131585 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dbdb5608-7ef0-47e7-902f-8212a09ac73c tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:36.182975 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-dbdb5608-7ef0-47e7-902f-8212a09ac73c tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "POST /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024/action" status: 200 len: 24567 microversion: 2.1 time: 0.065060 Apr 16 21:40:36.183790 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3215/6277] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:40:36 2022] POST /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024/action => generated 24567 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:40:36.982055 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-64263838-2225-48b2-b2b0-ea9025ef996d tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:40:36.982670 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-64263838-2225-48b2-b2b0-ea9025ef996d tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:36.990153 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-64263838-2225-48b2-b2b0-ea9025ef996d tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:36.990612 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-64263838-2225-48b2-b2b0-ea9025ef996d tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:36.991401 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-64263838-2225-48b2-b2b0-ea9025ef996d tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:36.991847 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-64263838-2225-48b2-b2b0-ea9025ef996d tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:37.125461 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-64263838-2225-48b2-b2b0-ea9025ef996d tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:40:37.134793 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-64263838-2225-48b2-b2b0-ea9025ef996d tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf" status: 200 len: 1720 microversion: 2.1 time: 0.156614 Apr 16 21:40:37.135370 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3063/6278] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:40:36 2022] GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:40:38.151904 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-85bf2d81-a053-40dd-afb1-127c95dfb893 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:40:38.152637 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-85bf2d81-a053-40dd-afb1-127c95dfb893 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:38.159993 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-85bf2d81-a053-40dd-afb1-127c95dfb893 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:38.160486 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-85bf2d81-a053-40dd-afb1-127c95dfb893 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:38.161272 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-85bf2d81-a053-40dd-afb1-127c95dfb893 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:38.161715 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-85bf2d81-a053-40dd-afb1-127c95dfb893 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:38.292617 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-85bf2d81-a053-40dd-afb1-127c95dfb893 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:40:38.301115 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-85bf2d81-a053-40dd-afb1-127c95dfb893 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf" status: 200 len: 1720 microversion: 2.1 time: 0.153473 Apr 16 21:40:38.301807 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3216/6279] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:40:38 2022] GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:40:39.318607 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0ae963f1-de44-493f-b575-3ac6eb28ec88 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:40:39.319221 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0ae963f1-de44-493f-b575-3ac6eb28ec88 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:39.325997 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0ae963f1-de44-493f-b575-3ac6eb28ec88 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:39.326461 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0ae963f1-de44-493f-b575-3ac6eb28ec88 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:39.327237 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0ae963f1-de44-493f-b575-3ac6eb28ec88 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:39.327718 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0ae963f1-de44-493f-b575-3ac6eb28ec88 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:39.462573 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0ae963f1-de44-493f-b575-3ac6eb28ec88 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:40:39.470431 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0ae963f1-de44-493f-b575-3ac6eb28ec88 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf" status: 200 len: 1720 microversion: 2.1 time: 0.156131 Apr 16 21:40:39.471002 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3064/6280] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:40:39 2022] GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:40:40.489044 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-87432353-ffd3-4503-afe0-021b204484e5 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:40:40.489579 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-87432353-ffd3-4503-afe0-021b204484e5 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:40.496653 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-87432353-ffd3-4503-afe0-021b204484e5 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:40.497118 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-87432353-ffd3-4503-afe0-021b204484e5 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:40.497897 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-87432353-ffd3-4503-afe0-021b204484e5 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:40.498343 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-87432353-ffd3-4503-afe0-021b204484e5 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:40.631233 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-87432353-ffd3-4503-afe0-021b204484e5 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:40:40.640297 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-87432353-ffd3-4503-afe0-021b204484e5 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf" status: 200 len: 1720 microversion: 2.1 time: 0.155948 Apr 16 21:40:40.644257 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3217/6281] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:40:40 2022] GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:40:41.657504 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-77015a7f-8aad-44c6-a1bf-0228b517c45b tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:40:41.658118 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-77015a7f-8aad-44c6-a1bf-0228b517c45b tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:41.664907 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-77015a7f-8aad-44c6-a1bf-0228b517c45b tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:41.674593 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-77015a7f-8aad-44c6-a1bf-0228b517c45b tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:41.674593 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-77015a7f-8aad-44c6-a1bf-0228b517c45b tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:41.674593 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-77015a7f-8aad-44c6-a1bf-0228b517c45b tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:41.801842 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-77015a7f-8aad-44c6-a1bf-0228b517c45b tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:40:41.809842 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-77015a7f-8aad-44c6-a1bf-0228b517c45b tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf" status: 200 len: 1720 microversion: 2.1 time: 0.156173 Apr 16 21:40:41.810415 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3065/6282] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:40:41 2022] GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:40:42.828204 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e7232c81-daf9-4b99-ac61-15830579d103 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:40:42.828800 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e7232c81-daf9-4b99-ac61-15830579d103 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:42.836617 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e7232c81-daf9-4b99-ac61-15830579d103 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:42.837086 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e7232c81-daf9-4b99-ac61-15830579d103 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:42.837875 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e7232c81-daf9-4b99-ac61-15830579d103 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:42.838327 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e7232c81-daf9-4b99-ac61-15830579d103 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:42.966335 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e7232c81-daf9-4b99-ac61-15830579d103 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:40:42.974898 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e7232c81-daf9-4b99-ac61-15830579d103 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf" status: 200 len: 1720 microversion: 2.1 time: 0.150686 Apr 16 21:40:42.975481 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3218/6283] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:40:42 2022] GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:40:43.992505 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-27aeca3c-0b49-472c-8151-3920bcded284 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:40:43.997416 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-27aeca3c-0b49-472c-8151-3920bcded284 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:44.000051 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-27aeca3c-0b49-472c-8151-3920bcded284 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:44.000541 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-27aeca3c-0b49-472c-8151-3920bcded284 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:44.001340 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-27aeca3c-0b49-472c-8151-3920bcded284 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:44.001788 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-27aeca3c-0b49-472c-8151-3920bcded284 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:44.140618 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-27aeca3c-0b49-472c-8151-3920bcded284 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:40:44.150084 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-27aeca3c-0b49-472c-8151-3920bcded284 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf" status: 200 len: 1720 microversion: 2.1 time: 0.161481 Apr 16 21:40:44.150768 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3066/6284] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:40:43 2022] GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:40:45.167746 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c68710e0-7901-441e-8093-df99807c3125 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:40:45.168381 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c68710e0-7901-441e-8093-df99807c3125 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:45.174875 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c68710e0-7901-441e-8093-df99807c3125 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:45.175920 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c68710e0-7901-441e-8093-df99807c3125 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:45.176960 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c68710e0-7901-441e-8093-df99807c3125 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:45.177404 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c68710e0-7901-441e-8093-df99807c3125 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:45.311223 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c68710e0-7901-441e-8093-df99807c3125 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:40:45.319713 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c68710e0-7901-441e-8093-df99807c3125 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf" status: 200 len: 1720 microversion: 2.1 time: 0.155837 Apr 16 21:40:45.320386 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3219/6285] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:40:45 2022] GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:40:46.337447 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-db02f167-b8cc-4a72-b968-29f71a20bb21 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:40:46.343337 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-db02f167-b8cc-4a72-b968-29f71a20bb21 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:46.344578 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-db02f167-b8cc-4a72-b968-29f71a20bb21 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:46.345036 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-db02f167-b8cc-4a72-b968-29f71a20bb21 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:46.345810 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-db02f167-b8cc-4a72-b968-29f71a20bb21 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:46.346252 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-db02f167-b8cc-4a72-b968-29f71a20bb21 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:46.485635 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-db02f167-b8cc-4a72-b968-29f71a20bb21 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:40:46.493456 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-db02f167-b8cc-4a72-b968-29f71a20bb21 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf" status: 200 len: 1697 microversion: 2.1 time: 0.160092 Apr 16 21:40:46.494034 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3067/6286] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:40:46 2022] GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:40:46.514356 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-971900c7-ec5e-4867-9194-7894507ca31f tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:40:46.521230 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-971900c7-ec5e-4867-9194-7894507ca31f tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:46.521683 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-971900c7-ec5e-4867-9194-7894507ca31f tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:46.544349 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-971900c7-ec5e-4867-9194-7894507ca31f tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Going to try to start instance {{(pid=137408) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 16 21:40:46.729731 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-971900c7-ec5e-4867-9194-7894507ca31f tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "POST /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf/action" status: 202 len: 0 microversion: 2.1 time: 0.219262 Apr 16 21:40:46.730338 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3220/6287] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:40:46 2022] POST /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 16 21:40:46.738925 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f20503a3-3f09-4458-a180-c040fa30bf98 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:40:46.739572 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f20503a3-3f09-4458-a180-c040fa30bf98 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:46.745548 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f20503a3-3f09-4458-a180-c040fa30bf98 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:46.746584 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f20503a3-3f09-4458-a180-c040fa30bf98 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:46.746812 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f20503a3-3f09-4458-a180-c040fa30bf98 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:46.747303 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f20503a3-3f09-4458-a180-c040fa30bf98 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:46.883006 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f20503a3-3f09-4458-a180-c040fa30bf98 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:40:46.891590 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f20503a3-3f09-4458-a180-c040fa30bf98 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf" status: 200 len: 1706 microversion: 2.1 time: 0.156529 Apr 16 21:40:46.892107 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3068/6288] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:40:46 2022] GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf => generated 1706 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:40:47.196371 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5bf104d9-8ca9-429b-abe9-2f0c5273833f tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Action: 'create', calling method: .version_select at 0x7fbb9578a8b0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-2033653954"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:40:47.211495 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-5bf104d9-8ca9-429b-abe9-2f0c5273833f tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Getting quotas for project 80715ea8284b48959a67d33e8be6b560. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:40:47.217171 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-5bf104d9-8ca9-429b-abe9-2f0c5273833f tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Getting quotas for user 52bbf82f2ac64a4c9e3b86975f8173b2 and project 80715ea8284b48959a67d33e8be6b560. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:40:47.582387 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-5bf104d9-8ca9-429b-abe9-2f0c5273833f tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Getting quotas for project 80715ea8284b48959a67d33e8be6b560. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:40:47.587414 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-5bf104d9-8ca9-429b-abe9-2f0c5273833f tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Getting quotas for user 52bbf82f2ac64a4c9e3b86975f8173b2 and project 80715ea8284b48959a67d33e8be6b560. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:40:47.601972 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5bf104d9-8ca9-429b-abe9-2f0c5273833f tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.410513 Apr 16 21:40:47.602582 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3221/6289] 10.222.0.20 () {60 vars in 1157 bytes} [Sat Apr 16 21:40:47 2022] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:40:47.909545 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d1cefdb7-af74-43d1-9aee-0dfca8416521 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:40:47.910207 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d1cefdb7-af74-43d1-9aee-0dfca8416521 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:47.917537 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d1cefdb7-af74-43d1-9aee-0dfca8416521 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:47.918009 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d1cefdb7-af74-43d1-9aee-0dfca8416521 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:47.918797 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d1cefdb7-af74-43d1-9aee-0dfca8416521 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:47.919247 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d1cefdb7-af74-43d1-9aee-0dfca8416521 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:48.059378 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d1cefdb7-af74-43d1-9aee-0dfca8416521 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:40:48.069328 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d1cefdb7-af74-43d1-9aee-0dfca8416521 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf" status: 200 len: 1706 microversion: 2.1 time: 0.163654 Apr 16 21:40:48.080361 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3069/6290] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:40:47 2022] GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf => generated 1706 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:40:49.087933 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-01c35494-b897-45b9-a916-576a9012fb61 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:40:49.088706 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-01c35494-b897-45b9-a916-576a9012fb61 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:49.094964 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-01c35494-b897-45b9-a916-576a9012fb61 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:49.095445 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-01c35494-b897-45b9-a916-576a9012fb61 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:49.096298 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-01c35494-b897-45b9-a916-576a9012fb61 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:49.096755 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-01c35494-b897-45b9-a916-576a9012fb61 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:49.245609 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-01c35494-b897-45b9-a916-576a9012fb61 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:40:49.255420 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-01c35494-b897-45b9-a916-576a9012fb61 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf" status: 200 len: 1710 microversion: 2.1 time: 0.171463 Apr 16 21:40:49.256015 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3222/6291] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:40:49 2022] GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf => generated 1710 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:40:50.054884 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ebe6d8ed-4a47-411b-b57e-0a6f8ef6b634 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-2048113222", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "9312ec94-740a-4dce-bd71-1c9d823af28d", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-2033653954", "security_groups": [{"name": "tempest-secgroup-smoke-1071724071"}], "networks": [{"uuid": "b1c074bd-a506-4388-980b-b836a98ab276"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:40:50.164262 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-ebe6d8ed-4a47-411b-b57e-0a6f8ef6b634 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] validate_networks() for [('b1c074bd-a506-4388-980b-b836a98ab276', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:40:50.531510 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-ebe6d8ed-4a47-411b-b57e-0a6f8ef6b634 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:40:50.531990 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-ebe6d8ed-4a47-411b-b57e-0a6f8ef6b634 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:40:50.532508 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-ebe6d8ed-4a47-411b-b57e-0a6f8ef6b634 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:40:50.532924 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-ebe6d8ed-4a47-411b-b57e-0a6f8ef6b634 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:40:50.533343 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-ebe6d8ed-4a47-411b-b57e-0a6f8ef6b634 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:40:50.542461 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ebe6d8ed-4a47-411b-b57e-0a6f8ef6b634 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:50.542916 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ebe6d8ed-4a47-411b-b57e-0a6f8ef6b634 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:50.543723 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ebe6d8ed-4a47-411b-b57e-0a6f8ef6b634 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:50.544166 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ebe6d8ed-4a47-411b-b57e-0a6f8ef6b634 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:50.561694 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-ebe6d8ed-4a47-411b-b57e-0a6f8ef6b634 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Getting quotas for project 80715ea8284b48959a67d33e8be6b560. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:40:50.567644 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-ebe6d8ed-4a47-411b-b57e-0a6f8ef6b634 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Getting quotas for user 52bbf82f2ac64a4c9e3b86975f8173b2 and project 80715ea8284b48959a67d33e8be6b560. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:40:50.623511 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ebe6d8ed-4a47-411b-b57e-0a6f8ef6b634 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:40:50.628924 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ebe6d8ed-4a47-411b-b57e-0a6f8ef6b634 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] [instance: f83afebe-c606-461f-9138-67707e788014] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9312ec94-740a-4dce-bd71-1c9d823af28d',volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:40:51.116334 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ebe6d8ed-4a47-411b-b57e-0a6f8ef6b634 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.065276 Apr 16 21:40:51.117018 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3070/6292] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:40:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 1067 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:40:51.126953 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5b94f666-ef4c-472b-a7aa-3e38d3fa0e5e tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:40:51.127581 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5b94f666-ef4c-472b-a7aa-3e38d3fa0e5e tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] [instance: f83afebe-c606-461f-9138-67707e788014] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:51.184684 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5b94f666-ef4c-472b-a7aa-3e38d3fa0e5e tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bbf82f2ac64a4c9e3b86975f8173b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80715ea8284b48959a67d33e8be6b560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:40:51.191411 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5b94f666-ef4c-472b-a7aa-3e38d3fa0e5e tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] 10.222.0.20 "GET /compute/v2.1/servers/f83afebe-c606-461f-9138-67707e788014" status: 200 len: 1099 microversion: 2.1 time: 0.068299 Apr 16 21:40:51.192021 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3223/6293] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:40:51 2022] GET /compute/v2.1/servers/f83afebe-c606-461f-9138-67707e788014 => generated 1099 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:40:52.209892 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ad83de7a-52aa-4b04-ac3b-cbc822b7480a tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:40:52.210511 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ad83de7a-52aa-4b04-ac3b-cbc822b7480a tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] [instance: f83afebe-c606-461f-9138-67707e788014] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:52.263617 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ad83de7a-52aa-4b04-ac3b-cbc822b7480a tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bbf82f2ac64a4c9e3b86975f8173b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80715ea8284b48959a67d33e8be6b560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:40:52.270683 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ad83de7a-52aa-4b04-ac3b-cbc822b7480a tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] 10.222.0.20 "GET /compute/v2.1/servers/f83afebe-c606-461f-9138-67707e788014" status: 200 len: 1099 microversion: 2.1 time: 0.066292 Apr 16 21:40:52.271251 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3071/6294] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:40:52 2022] GET /compute/v2.1/servers/f83afebe-c606-461f-9138-67707e788014 => generated 1099 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:40:53.287578 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4452e01f-a125-4c0a-bb00-4a866a4243f1 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:40:53.288117 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4452e01f-a125-4c0a-bb00-4a866a4243f1 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] [instance: f83afebe-c606-461f-9138-67707e788014] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:53.295957 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4452e01f-a125-4c0a-bb00-4a866a4243f1 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:53.296460 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4452e01f-a125-4c0a-bb00-4a866a4243f1 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:53.297311 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4452e01f-a125-4c0a-bb00-4a866a4243f1 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:53.297873 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4452e01f-a125-4c0a-bb00-4a866a4243f1 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:53.362060 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4452e01f-a125-4c0a-bb00-4a866a4243f1 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bbf82f2ac64a4c9e3b86975f8173b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80715ea8284b48959a67d33e8be6b560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:40:53.370724 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4452e01f-a125-4c0a-bb00-4a866a4243f1 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] 10.222.0.20 "GET /compute/v2.1/servers/f83afebe-c606-461f-9138-67707e788014" status: 200 len: 1197 microversion: 2.1 time: 0.087817 Apr 16 21:40:53.371412 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3224/6295] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:40:53 2022] GET /compute/v2.1/servers/f83afebe-c606-461f-9138-67707e788014 => generated 1197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:40:54.388389 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-dbb514f6-e7b2-4cda-848c-b56b355a8819 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:40:54.389737 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-dbb514f6-e7b2-4cda-848c-b56b355a8819 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] [instance: f83afebe-c606-461f-9138-67707e788014] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:54.397411 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dbb514f6-e7b2-4cda-848c-b56b355a8819 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:54.398516 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dbb514f6-e7b2-4cda-848c-b56b355a8819 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:54.398804 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dbb514f6-e7b2-4cda-848c-b56b355a8819 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:54.399328 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dbb514f6-e7b2-4cda-848c-b56b355a8819 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:54.587793 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-dbb514f6-e7b2-4cda-848c-b56b355a8819 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bbf82f2ac64a4c9e3b86975f8173b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80715ea8284b48959a67d33e8be6b560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:40:54.597034 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-dbb514f6-e7b2-4cda-848c-b56b355a8819 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] 10.222.0.20 "GET /compute/v2.1/servers/f83afebe-c606-461f-9138-67707e788014" status: 200 len: 1283 microversion: 2.1 time: 0.212440 Apr 16 21:40:54.597571 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3072/6296] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:40:54 2022] GET /compute/v2.1/servers/f83afebe-c606-461f-9138-67707e788014 => generated 1283 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:40:55.369773 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0c3a8fd0-1fd4-4b09-a771-ec244a34bfa4 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:40:55.370757 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0c3a8fd0-1fd4-4b09-a771-ec244a34bfa4 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 57955d80-c264-4db1-8860-f2e5ac141ab7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:55.377316 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0c3a8fd0-1fd4-4b09-a771-ec244a34bfa4 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:55.377819 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0c3a8fd0-1fd4-4b09-a771-ec244a34bfa4 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:55.378547 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0c3a8fd0-1fd4-4b09-a771-ec244a34bfa4 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:55.379508 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0c3a8fd0-1fd4-4b09-a771-ec244a34bfa4 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:55.426891 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0c3a8fd0-1fd4-4b09-a771-ec244a34bfa4 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "POST /compute/v2.1/servers/57955d80-c264-4db1-8860-f2e5ac141ab7/action" status: 200 len: 24578 microversion: 2.1 time: 0.060853 Apr 16 21:40:55.428601 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3225/6297] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:40:55 2022] POST /compute/v2.1/servers/57955d80-c264-4db1-8860-f2e5ac141ab7/action => generated 24578 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:40:55.453701 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-48d3ffa3-e507-4f50-a051-33e8328a180b req-bb6bb449-d47f-4518-9669-3a3e74db15d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f83afebe-c606-461f-9138-67707e788014", "tag": "65c3354a-8ecb-43ae-a281-e7a13cc9dd80"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:40:55.473484 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-48d3ffa3-e507-4f50-a051-33e8328a180b req-bb6bb449-d47f-4518-9669-3a3e74db15d0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:55.474074 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-48d3ffa3-e507-4f50-a051-33e8328a180b req-bb6bb449-d47f-4518-9669-3a3e74db15d0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:55.486656 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-48d3ffa3-e507-4f50-a051-33e8328a180b req-bb6bb449-d47f-4518-9669-3a3e74db15d0 service nova] Creating event network-changed:65c3354a-8ecb-43ae-a281-e7a13cc9dd80 for instance f83afebe-c606-461f-9138-67707e788014 on nch1-master-1 Apr 16 21:40:55.491710 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-48d3ffa3-e507-4f50-a051-33e8328a180b req-bb6bb449-d47f-4518-9669-3a3e74db15d0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045010 Apr 16 21:40:55.492545 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3073/6298] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:40:55.616365 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0b5d403f-1758-48e3-9cc1-6a80d8502852 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:40:55.617101 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0b5d403f-1758-48e3-9cc1-6a80d8502852 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] [instance: f83afebe-c606-461f-9138-67707e788014] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:55.629254 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0b5d403f-1758-48e3-9cc1-6a80d8502852 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:55.629893 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0b5d403f-1758-48e3-9cc1-6a80d8502852 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:55.630689 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0b5d403f-1758-48e3-9cc1-6a80d8502852 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:55.631314 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0b5d403f-1758-48e3-9cc1-6a80d8502852 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:55.773779 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0b5d403f-1758-48e3-9cc1-6a80d8502852 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bbf82f2ac64a4c9e3b86975f8173b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80715ea8284b48959a67d33e8be6b560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:40:55.782116 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0b5d403f-1758-48e3-9cc1-6a80d8502852 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] 10.222.0.20 "GET /compute/v2.1/servers/f83afebe-c606-461f-9138-67707e788014" status: 200 len: 1271 microversion: 2.1 time: 0.170872 Apr 16 21:40:55.782697 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3226/6299] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:40:55 2022] GET /compute/v2.1/servers/f83afebe-c606-461f-9138-67707e788014 => generated 1271 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:40:56.805845 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-22d7716b-3628-4754-b6a9-b5368dd8965b tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:40:56.806464 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-22d7716b-3628-4754-b6a9-b5368dd8965b tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] [instance: f83afebe-c606-461f-9138-67707e788014] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:56.812696 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-22d7716b-3628-4754-b6a9-b5368dd8965b tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:56.813156 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-22d7716b-3628-4754-b6a9-b5368dd8965b tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:56.813928 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-22d7716b-3628-4754-b6a9-b5368dd8965b tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:56.814371 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-22d7716b-3628-4754-b6a9-b5368dd8965b tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:56.946698 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-22d7716b-3628-4754-b6a9-b5368dd8965b tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bbf82f2ac64a4c9e3b86975f8173b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80715ea8284b48959a67d33e8be6b560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:40:56.954870 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-22d7716b-3628-4754-b6a9-b5368dd8965b tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] 10.222.0.20 "GET /compute/v2.1/servers/f83afebe-c606-461f-9138-67707e788014" status: 200 len: 1271 microversion: 2.1 time: 0.154716 Apr 16 21:40:56.955452 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3074/6300] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:40:56 2022] GET /compute/v2.1/servers/f83afebe-c606-461f-9138-67707e788014 => generated 1271 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:40:57.971027 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7e1e9ced-9237-472d-a4db-3542e34e3633 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:40:57.971625 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7e1e9ced-9237-472d-a4db-3542e34e3633 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] [instance: f83afebe-c606-461f-9138-67707e788014] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:57.979056 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7e1e9ced-9237-472d-a4db-3542e34e3633 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:57.979512 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7e1e9ced-9237-472d-a4db-3542e34e3633 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:57.980318 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7e1e9ced-9237-472d-a4db-3542e34e3633 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:57.980760 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7e1e9ced-9237-472d-a4db-3542e34e3633 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:58.110755 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7e1e9ced-9237-472d-a4db-3542e34e3633 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bbf82f2ac64a4c9e3b86975f8173b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80715ea8284b48959a67d33e8be6b560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:40:58.118097 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7e1e9ced-9237-472d-a4db-3542e34e3633 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] 10.222.0.20 "GET /compute/v2.1/servers/f83afebe-c606-461f-9138-67707e788014" status: 200 len: 1271 microversion: 2.1 time: 0.151124 Apr 16 21:40:58.118666 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3227/6301] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:40:57 2022] GET /compute/v2.1/servers/f83afebe-c606-461f-9138-67707e788014 => generated 1271 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:40:59.135022 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-631360a8-400a-4b34-a65d-5b582a5c92e6 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:40:59.135640 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-631360a8-400a-4b34-a65d-5b582a5c92e6 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] [instance: f83afebe-c606-461f-9138-67707e788014] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:40:59.142377 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-631360a8-400a-4b34-a65d-5b582a5c92e6 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:59.142835 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-631360a8-400a-4b34-a65d-5b582a5c92e6 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:59.143630 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-631360a8-400a-4b34-a65d-5b582a5c92e6 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:40:59.144079 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-631360a8-400a-4b34-a65d-5b582a5c92e6 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:40:59.283708 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-631360a8-400a-4b34-a65d-5b582a5c92e6 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bbf82f2ac64a4c9e3b86975f8173b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80715ea8284b48959a67d33e8be6b560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:40:59.291709 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-631360a8-400a-4b34-a65d-5b582a5c92e6 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] 10.222.0.20 "GET /compute/v2.1/servers/f83afebe-c606-461f-9138-67707e788014" status: 200 len: 1271 microversion: 2.1 time: 0.160591 Apr 16 21:40:59.292330 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3075/6302] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:40:59 2022] GET /compute/v2.1/servers/f83afebe-c606-461f-9138-67707e788014 => generated 1271 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:41:00.308974 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5544e1e4-23d7-40d9-ab6e-5a4eae2049cb tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:41:00.309622 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5544e1e4-23d7-40d9-ab6e-5a4eae2049cb tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] [instance: f83afebe-c606-461f-9138-67707e788014] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:00.316697 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5544e1e4-23d7-40d9-ab6e-5a4eae2049cb tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:00.317153 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5544e1e4-23d7-40d9-ab6e-5a4eae2049cb tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:00.317938 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5544e1e4-23d7-40d9-ab6e-5a4eae2049cb tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:00.318370 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5544e1e4-23d7-40d9-ab6e-5a4eae2049cb tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:00.460900 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5544e1e4-23d7-40d9-ab6e-5a4eae2049cb tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bbf82f2ac64a4c9e3b86975f8173b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80715ea8284b48959a67d33e8be6b560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:41:00.469725 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5544e1e4-23d7-40d9-ab6e-5a4eae2049cb tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] 10.222.0.20 "GET /compute/v2.1/servers/f83afebe-c606-461f-9138-67707e788014" status: 200 len: 1271 microversion: 2.1 time: 0.164563 Apr 16 21:41:00.479778 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3228/6303] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:41:00 2022] GET /compute/v2.1/servers/f83afebe-c606-461f-9138-67707e788014 => generated 1271 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:41:01.374232 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-29a2221c-6613-45ae-9124-6c269468fc94 req-acc0fb64-5ee4-44fc-bdc7-7369986fd27b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f83afebe-c606-461f-9138-67707e788014", "name": "network-vif-plugged", "status": "completed", "tag": "65c3354a-8ecb-43ae-a281-e7a13cc9dd80"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:41:01.383588 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-29a2221c-6613-45ae-9124-6c269468fc94 req-acc0fb64-5ee4-44fc-bdc7-7369986fd27b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:01.383983 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-29a2221c-6613-45ae-9124-6c269468fc94 req-acc0fb64-5ee4-44fc-bdc7-7369986fd27b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:01.394887 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-29a2221c-6613-45ae-9124-6c269468fc94 req-acc0fb64-5ee4-44fc-bdc7-7369986fd27b service nova] Creating event network-vif-plugged:65c3354a-8ecb-43ae-a281-e7a13cc9dd80 for instance f83afebe-c606-461f-9138-67707e788014 on nch1-master-1 Apr 16 21:41:01.400036 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-29a2221c-6613-45ae-9124-6c269468fc94 req-acc0fb64-5ee4-44fc-bdc7-7369986fd27b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029510 Apr 16 21:41:01.400656 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3076/6304] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:41:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:41:01.490566 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e97d067f-96ea-486b-92eb-a6d81d9f352c tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:41:01.491196 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e97d067f-96ea-486b-92eb-a6d81d9f352c tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] [instance: f83afebe-c606-461f-9138-67707e788014] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:01.499109 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e97d067f-96ea-486b-92eb-a6d81d9f352c tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:01.499586 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e97d067f-96ea-486b-92eb-a6d81d9f352c tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:01.500411 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e97d067f-96ea-486b-92eb-a6d81d9f352c tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:01.500868 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e97d067f-96ea-486b-92eb-a6d81d9f352c tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:01.638985 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e97d067f-96ea-486b-92eb-a6d81d9f352c tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bbf82f2ac64a4c9e3b86975f8173b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80715ea8284b48959a67d33e8be6b560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:41:01.646767 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e97d067f-96ea-486b-92eb-a6d81d9f352c tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] 10.222.0.20 "GET /compute/v2.1/servers/f83afebe-c606-461f-9138-67707e788014" status: 200 len: 1271 microversion: 2.1 time: 0.161690 Apr 16 21:41:01.647344 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3229/6305] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:41:01 2022] GET /compute/v2.1/servers/f83afebe-c606-461f-9138-67707e788014 => generated 1271 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:41:02.665734 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-28d3a816-d45c-46e1-a5b3-769ed97e5a0f tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:41:02.666448 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-28d3a816-d45c-46e1-a5b3-769ed97e5a0f tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] [instance: f83afebe-c606-461f-9138-67707e788014] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:02.673364 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-28d3a816-d45c-46e1-a5b3-769ed97e5a0f tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:02.673740 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-28d3a816-d45c-46e1-a5b3-769ed97e5a0f tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:02.674828 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-28d3a816-d45c-46e1-a5b3-769ed97e5a0f tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:02.675332 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-28d3a816-d45c-46e1-a5b3-769ed97e5a0f tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:02.808501 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-28d3a816-d45c-46e1-a5b3-769ed97e5a0f tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bbf82f2ac64a4c9e3b86975f8173b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80715ea8284b48959a67d33e8be6b560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:41:02.820338 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-28d3a816-d45c-46e1-a5b3-769ed97e5a0f tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] 10.222.0.20 "GET /compute/v2.1/servers/f83afebe-c606-461f-9138-67707e788014" status: 200 len: 1271 microversion: 2.1 time: 0.158038 Apr 16 21:41:02.820338 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3077/6306] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:41:02 2022] GET /compute/v2.1/servers/f83afebe-c606-461f-9138-67707e788014 => generated 1271 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:41:03.835396 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c23eb1ef-6236-4381-98c0-3f824634c4ce tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:41:03.843200 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c23eb1ef-6236-4381-98c0-3f824634c4ce tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] [instance: f83afebe-c606-461f-9138-67707e788014] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:03.843200 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c23eb1ef-6236-4381-98c0-3f824634c4ce tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:03.843384 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c23eb1ef-6236-4381-98c0-3f824634c4ce tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:03.844130 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c23eb1ef-6236-4381-98c0-3f824634c4ce tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:03.844609 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c23eb1ef-6236-4381-98c0-3f824634c4ce tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:03.979880 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c23eb1ef-6236-4381-98c0-3f824634c4ce tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bbf82f2ac64a4c9e3b86975f8173b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80715ea8284b48959a67d33e8be6b560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:41:03.987405 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c23eb1ef-6236-4381-98c0-3f824634c4ce tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] 10.222.0.20 "GET /compute/v2.1/servers/f83afebe-c606-461f-9138-67707e788014" status: 200 len: 1459 microversion: 2.1 time: 0.156580 Apr 16 21:41:03.988593 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3230/6307] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:41:03 2022] GET /compute/v2.1/servers/f83afebe-c606-461f-9138-67707e788014 => generated 1459 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:41:04.005500 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6f019d5a-823c-41b2-9d02-aacf282ead1c tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:41:04.006145 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6f019d5a-823c-41b2-9d02-aacf282ead1c tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] [instance: f83afebe-c606-461f-9138-67707e788014] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:04.012955 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6f019d5a-823c-41b2-9d02-aacf282ead1c tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:04.013413 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6f019d5a-823c-41b2-9d02-aacf282ead1c tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:04.016310 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6f019d5a-823c-41b2-9d02-aacf282ead1c tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:04.016310 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6f019d5a-823c-41b2-9d02-aacf282ead1c tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:04.147545 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6f019d5a-823c-41b2-9d02-aacf282ead1c tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bbf82f2ac64a4c9e3b86975f8173b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80715ea8284b48959a67d33e8be6b560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:41:04.155045 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6f019d5a-823c-41b2-9d02-aacf282ead1c tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] 10.222.0.20 "GET /compute/v2.1/servers/f83afebe-c606-461f-9138-67707e788014" status: 200 len: 1459 microversion: 2.1 time: 0.154421 Apr 16 21:41:04.155621 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3078/6308] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:41:03 2022] GET /compute/v2.1/servers/f83afebe-c606-461f-9138-67707e788014 => generated 1459 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:41:06.599902 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-79c9f219-3ce6-4f6c-bb33-e3cdf0c63b69 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:41:06.601701 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-79c9f219-3ce6-4f6c-bb33-e3cdf0c63b69 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:06.608734 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-79c9f219-3ce6-4f6c-bb33-e3cdf0c63b69 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:06.609209 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-79c9f219-3ce6-4f6c-bb33-e3cdf0c63b69 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:06.610211 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-79c9f219-3ce6-4f6c-bb33-e3cdf0c63b69 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:06.610536 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-79c9f219-3ce6-4f6c-bb33-e3cdf0c63b69 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:06.704227 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-79c9f219-3ce6-4f6c-bb33-e3cdf0c63b69 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:41:06.704985 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-79c9f219-3ce6-4f6c-bb33-e3cdf0c63b69 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:41:06.705699 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-79c9f219-3ce6-4f6c-bb33-e3cdf0c63b69 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:41:06.707147 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-79c9f219-3ce6-4f6c-bb33-e3cdf0c63b69 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:41:06.708247 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-79c9f219-3ce6-4f6c-bb33-e3cdf0c63b69 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:41:06.767409 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-e006908a-2ed4-4cdf-8a3d-4efeb5de1dd8 req-299ed664-99b5-430b-b0cf-6adf52310dad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f83afebe-c606-461f-9138-67707e788014", "tag": "65c3354a-8ecb-43ae-a281-e7a13cc9dd80"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:41:06.778395 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-e006908a-2ed4-4cdf-8a3d-4efeb5de1dd8 req-299ed664-99b5-430b-b0cf-6adf52310dad service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:06.778926 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-e006908a-2ed4-4cdf-8a3d-4efeb5de1dd8 req-299ed664-99b5-430b-b0cf-6adf52310dad service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:06.791792 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-e006908a-2ed4-4cdf-8a3d-4efeb5de1dd8 req-299ed664-99b5-430b-b0cf-6adf52310dad service nova] Creating event network-changed:65c3354a-8ecb-43ae-a281-e7a13cc9dd80 for instance f83afebe-c606-461f-9138-67707e788014 on nch1-master-1 Apr 16 21:41:06.797263 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-e006908a-2ed4-4cdf-8a3d-4efeb5de1dd8 req-299ed664-99b5-430b-b0cf-6adf52310dad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035185 Apr 16 21:41:06.798288 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3079/6309] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:41:06.930870 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-79c9f219-3ce6-4f6c-bb33-e3cdf0c63b69 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:06.938834 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-79c9f219-3ce6-4f6c-bb33-e3cdf0c63b69 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:06.939316 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-79c9f219-3ce6-4f6c-bb33-e3cdf0c63b69 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:06.940126 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-79c9f219-3ce6-4f6c-bb33-e3cdf0c63b69 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:06.941991 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-79c9f219-3ce6-4f6c-bb33-e3cdf0c63b69 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:06.977161 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-79c9f219-3ce6-4f6c-bb33-e3cdf0c63b69 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "POST /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024/action" status: 202 len: 1137 microversion: 2.1 time: 0.381789 Apr 16 21:41:06.977822 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3231/6310] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:41:06 2022] POST /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024/action => generated 1137 bytes in 384 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 16 21:41:06.994315 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5ff11c6b-1c84-408a-9d42-f3918b251c5f tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:41:06.995826 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5ff11c6b-1c84-408a-9d42-f3918b251c5f tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:07.002920 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5ff11c6b-1c84-408a-9d42-f3918b251c5f tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:07.003854 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5ff11c6b-1c84-408a-9d42-f3918b251c5f tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:07.005068 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5ff11c6b-1c84-408a-9d42-f3918b251c5f tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:07.005521 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5ff11c6b-1c84-408a-9d42-f3918b251c5f tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:07.371184 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5ff11c6b-1c84-408a-9d42-f3918b251c5f tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:41:07.379990 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5ff11c6b-1c84-408a-9d42-f3918b251c5f tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024" status: 200 len: 1691 microversion: 2.1 time: 0.390595 Apr 16 21:41:07.390460 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3080/6311] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:41:06 2022] GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024 => generated 1691 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:41:08.397687 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0283196e-6623-4d33-9f6d-7ca1de49d4a4 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:41:08.398573 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0283196e-6623-4d33-9f6d-7ca1de49d4a4 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:08.405595 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0283196e-6623-4d33-9f6d-7ca1de49d4a4 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:08.406063 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0283196e-6623-4d33-9f6d-7ca1de49d4a4 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:08.406860 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0283196e-6623-4d33-9f6d-7ca1de49d4a4 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:08.407308 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0283196e-6623-4d33-9f6d-7ca1de49d4a4 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:08.544949 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0283196e-6623-4d33-9f6d-7ca1de49d4a4 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:41:08.552988 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0283196e-6623-4d33-9f6d-7ca1de49d4a4 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024" status: 200 len: 1691 microversion: 2.1 time: 0.159193 Apr 16 21:41:08.554198 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3232/6312] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:41:08 2022] GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024 => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:41:08.812848 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-cfe9d96b-11c2-408b-8833-d7341a02adeb req-c111c1a0-c4c0-46fa-8339-37835d4f0a2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f83afebe-c606-461f-9138-67707e788014", "tag": "65c3354a-8ecb-43ae-a281-e7a13cc9dd80"}, {"name": "network-changed", "server_uuid": "f83afebe-c606-461f-9138-67707e788014", "tag": "65c3354a-8ecb-43ae-a281-e7a13cc9dd80"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:41:08.822349 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-cfe9d96b-11c2-408b-8833-d7341a02adeb req-c111c1a0-c4c0-46fa-8339-37835d4f0a2a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:08.822880 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-cfe9d96b-11c2-408b-8833-d7341a02adeb req-c111c1a0-c4c0-46fa-8339-37835d4f0a2a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:08.839129 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-cfe9d96b-11c2-408b-8833-d7341a02adeb req-c111c1a0-c4c0-46fa-8339-37835d4f0a2a service nova] Creating event network-changed:65c3354a-8ecb-43ae-a281-e7a13cc9dd80 for instance f83afebe-c606-461f-9138-67707e788014 on nch1-master-1 Apr 16 21:41:08.839906 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-cfe9d96b-11c2-408b-8833-d7341a02adeb req-c111c1a0-c4c0-46fa-8339-37835d4f0a2a service nova] Creating event network-changed:65c3354a-8ecb-43ae-a281-e7a13cc9dd80 for instance f83afebe-c606-461f-9138-67707e788014 on nch1-master-1 Apr 16 21:41:08.845764 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-cfe9d96b-11c2-408b-8833-d7341a02adeb req-c111c1a0-c4c0-46fa-8339-37835d4f0a2a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.036292 Apr 16 21:41:08.846357 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3081/6313] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:41:09.571252 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4e32ad09-b9ac-47dc-8743-2122241b1bc7 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:41:09.571955 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4e32ad09-b9ac-47dc-8743-2122241b1bc7 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:09.579714 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4e32ad09-b9ac-47dc-8743-2122241b1bc7 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:09.580405 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4e32ad09-b9ac-47dc-8743-2122241b1bc7 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:09.581510 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4e32ad09-b9ac-47dc-8743-2122241b1bc7 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:09.582030 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4e32ad09-b9ac-47dc-8743-2122241b1bc7 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:09.751608 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4e32ad09-b9ac-47dc-8743-2122241b1bc7 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:41:09.760567 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4e32ad09-b9ac-47dc-8743-2122241b1bc7 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024" status: 200 len: 1691 microversion: 2.1 time: 0.193468 Apr 16 21:41:09.761157 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3233/6314] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:41:09 2022] GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024 => generated 1691 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:41:10.780136 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3c8a7028-4bd0-45c1-a701-5c133f8d2670 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:41:10.780867 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3c8a7028-4bd0-45c1-a701-5c133f8d2670 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:10.787086 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3c8a7028-4bd0-45c1-a701-5c133f8d2670 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:10.787552 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3c8a7028-4bd0-45c1-a701-5c133f8d2670 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:10.788364 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3c8a7028-4bd0-45c1-a701-5c133f8d2670 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:10.788815 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3c8a7028-4bd0-45c1-a701-5c133f8d2670 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:10.925585 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3c8a7028-4bd0-45c1-a701-5c133f8d2670 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:41:10.933478 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3c8a7028-4bd0-45c1-a701-5c133f8d2670 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024" status: 200 len: 1691 microversion: 2.1 time: 0.158473 Apr 16 21:41:10.934081 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3082/6315] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:41:10 2022] GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:41:11.952442 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-dcb3c475-db3e-4435-953d-37d1254cc997 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:41:11.953096 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-dcb3c475-db3e-4435-953d-37d1254cc997 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:11.960057 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dcb3c475-db3e-4435-953d-37d1254cc997 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:11.960558 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dcb3c475-db3e-4435-953d-37d1254cc997 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:11.961341 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dcb3c475-db3e-4435-953d-37d1254cc997 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:11.961790 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dcb3c475-db3e-4435-953d-37d1254cc997 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:12.095128 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-dcb3c475-db3e-4435-953d-37d1254cc997 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:41:12.103113 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-dcb3c475-db3e-4435-953d-37d1254cc997 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024" status: 200 len: 1691 microversion: 2.1 time: 0.154782 Apr 16 21:41:12.105987 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3234/6316] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:41:11 2022] GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024 => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:41:13.121052 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f9337e7d-6bc0-4341-98c6-4dc16eafd9b0 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:41:13.121670 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f9337e7d-6bc0-4341-98c6-4dc16eafd9b0 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:13.128471 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f9337e7d-6bc0-4341-98c6-4dc16eafd9b0 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:13.129210 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f9337e7d-6bc0-4341-98c6-4dc16eafd9b0 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:13.130023 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f9337e7d-6bc0-4341-98c6-4dc16eafd9b0 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:13.130499 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f9337e7d-6bc0-4341-98c6-4dc16eafd9b0 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:13.265575 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f9337e7d-6bc0-4341-98c6-4dc16eafd9b0 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:41:13.274278 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f9337e7d-6bc0-4341-98c6-4dc16eafd9b0 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024" status: 200 len: 1691 microversion: 2.1 time: 0.157159 Apr 16 21:41:13.278575 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3083/6317] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:41:13 2022] GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024 => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:41:14.291453 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-de137c90-6f5b-4cf7-8963-e0450aa415b2 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:41:14.292099 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-de137c90-6f5b-4cf7-8963-e0450aa415b2 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:14.299195 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-de137c90-6f5b-4cf7-8963-e0450aa415b2 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:14.299679 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-de137c90-6f5b-4cf7-8963-e0450aa415b2 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:14.300574 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-de137c90-6f5b-4cf7-8963-e0450aa415b2 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:14.301189 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-de137c90-6f5b-4cf7-8963-e0450aa415b2 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:14.438230 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-de137c90-6f5b-4cf7-8963-e0450aa415b2 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:41:14.450426 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-de137c90-6f5b-4cf7-8963-e0450aa415b2 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024" status: 200 len: 1691 microversion: 2.1 time: 0.158478 Apr 16 21:41:14.450426 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3235/6318] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:41:14 2022] GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:41:15.463111 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fbbc35b4-360d-4ffb-a782-16e93a3e0590 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:41:15.463817 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-fbbc35b4-360d-4ffb-a782-16e93a3e0590 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:15.470654 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fbbc35b4-360d-4ffb-a782-16e93a3e0590 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:15.471156 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fbbc35b4-360d-4ffb-a782-16e93a3e0590 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:15.471937 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fbbc35b4-360d-4ffb-a782-16e93a3e0590 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:15.472480 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fbbc35b4-360d-4ffb-a782-16e93a3e0590 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:15.615453 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-fbbc35b4-360d-4ffb-a782-16e93a3e0590 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:41:15.623501 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fbbc35b4-360d-4ffb-a782-16e93a3e0590 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024" status: 200 len: 1691 microversion: 2.1 time: 0.164462 Apr 16 21:41:15.624350 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3084/6319] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:41:15 2022] GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024 => generated 1691 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:41:16.641459 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5917a216-2e37-4a7a-b2a3-e2be1fb2b5a3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:41:16.642154 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5917a216-2e37-4a7a-b2a3-e2be1fb2b5a3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:16.649094 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5917a216-2e37-4a7a-b2a3-e2be1fb2b5a3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:16.649553 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5917a216-2e37-4a7a-b2a3-e2be1fb2b5a3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:16.650405 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5917a216-2e37-4a7a-b2a3-e2be1fb2b5a3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:16.650849 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5917a216-2e37-4a7a-b2a3-e2be1fb2b5a3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:16.802330 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5917a216-2e37-4a7a-b2a3-e2be1fb2b5a3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:41:16.810177 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5917a216-2e37-4a7a-b2a3-e2be1fb2b5a3 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024" status: 200 len: 1691 microversion: 2.1 time: 0.172580 Apr 16 21:41:16.810755 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3236/6320] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:41:16 2022] GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024 => generated 1691 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:41:17.827890 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fe36dd88-455d-4ae3-b197-c2b01fae75fd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:41:17.828552 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-fe36dd88-455d-4ae3-b197-c2b01fae75fd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:17.835370 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fe36dd88-455d-4ae3-b197-c2b01fae75fd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:17.835831 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fe36dd88-455d-4ae3-b197-c2b01fae75fd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:17.836685 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fe36dd88-455d-4ae3-b197-c2b01fae75fd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:17.837184 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fe36dd88-455d-4ae3-b197-c2b01fae75fd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:17.973397 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-fe36dd88-455d-4ae3-b197-c2b01fae75fd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:41:17.980603 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fe36dd88-455d-4ae3-b197-c2b01fae75fd tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024" status: 200 len: 1691 microversion: 2.1 time: 0.156575 Apr 16 21:41:17.981300 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3085/6321] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:41:17 2022] GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024 => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:41:19.128705 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-32b988a5-141f-4b99-89ef-0b94632b23fc tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:41:19.130032 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-32b988a5-141f-4b99-89ef-0b94632b23fc tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:19.136219 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-32b988a5-141f-4b99-89ef-0b94632b23fc tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:19.136683 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-32b988a5-141f-4b99-89ef-0b94632b23fc tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:19.137465 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-32b988a5-141f-4b99-89ef-0b94632b23fc tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:19.137912 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-32b988a5-141f-4b99-89ef-0b94632b23fc tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:19.268966 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-32b988a5-141f-4b99-89ef-0b94632b23fc tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:41:19.280075 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-32b988a5-141f-4b99-89ef-0b94632b23fc tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024" status: 200 len: 1691 microversion: 2.1 time: 0.285287 Apr 16 21:41:19.280687 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3237/6322] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:41:18 2022] GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024 => generated 1691 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:41:20.297826 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-718afb24-cbf7-4602-948b-0c38b6b27e45 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:41:20.298452 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-718afb24-cbf7-4602-948b-0c38b6b27e45 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:20.306001 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-718afb24-cbf7-4602-948b-0c38b6b27e45 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:20.309115 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-718afb24-cbf7-4602-948b-0c38b6b27e45 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:20.309115 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-718afb24-cbf7-4602-948b-0c38b6b27e45 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:20.309115 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-718afb24-cbf7-4602-948b-0c38b6b27e45 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:20.444118 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-718afb24-cbf7-4602-948b-0c38b6b27e45 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:41:20.452225 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-718afb24-cbf7-4602-948b-0c38b6b27e45 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024" status: 200 len: 1691 microversion: 2.1 time: 0.158257 Apr 16 21:41:20.452838 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3086/6323] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:41:20 2022] GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:41:21.470206 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bac91de5-dd5e-4521-98c0-1f825a978873 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:41:21.470758 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-bac91de5-dd5e-4521-98c0-1f825a978873 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:21.478040 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bac91de5-dd5e-4521-98c0-1f825a978873 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:21.478499 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bac91de5-dd5e-4521-98c0-1f825a978873 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:21.479330 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bac91de5-dd5e-4521-98c0-1f825a978873 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:21.479771 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bac91de5-dd5e-4521-98c0-1f825a978873 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:21.610510 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-bac91de5-dd5e-4521-98c0-1f825a978873 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:41:21.618503 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-bac91de5-dd5e-4521-98c0-1f825a978873 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024" status: 200 len: 1691 microversion: 2.1 time: 0.152319 Apr 16 21:41:21.619120 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3238/6324] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:41:21 2022] GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024 => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:41:21.905013 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bec57f78-d2e4-4b35-b967-78ffe15f88a1 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:41:21.905547 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bec57f78-d2e4-4b35-b967-78ffe15f88a1 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:21.913036 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bec57f78-d2e4-4b35-b967-78ffe15f88a1 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:21.913501 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bec57f78-d2e4-4b35-b967-78ffe15f88a1 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:21.914286 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bec57f78-d2e4-4b35-b967-78ffe15f88a1 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:21.914732 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bec57f78-d2e4-4b35-b967-78ffe15f88a1 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:21.992856 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-bec57f78-d2e4-4b35-b967-78ffe15f88a1 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lazy-loading 'services' on Instance uuid 8c63a395-2ffd-44e5-aa9b-cd3417a504bf {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:41:22.236698 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bec57f78-d2e4-4b35-b967-78ffe15f88a1 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf/os-volume_attachments/c83e6b4d-92b1-4775-8ed2-19365c945f19" status: 202 len: 0 microversion: 2.1 time: 0.335469 Apr 16 21:41:22.237403 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3087/6325] 10.222.0.20 () {58 vars in 1415 bytes} [Sat Apr 16 21:41:21 2022] DELETE /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf/os-volume_attachments/c83e6b4d-92b1-4775-8ed2-19365c945f19 => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:41:22.636001 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a187835a-680c-47f6-9afa-875ded7918cc tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:41:22.636648 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a187835a-680c-47f6-9afa-875ded7918cc tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:22.643620 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a187835a-680c-47f6-9afa-875ded7918cc tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:22.644130 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a187835a-680c-47f6-9afa-875ded7918cc tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:22.645596 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a187835a-680c-47f6-9afa-875ded7918cc tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:22.646043 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a187835a-680c-47f6-9afa-875ded7918cc tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:22.782177 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a187835a-680c-47f6-9afa-875ded7918cc tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:41:22.789628 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a187835a-680c-47f6-9afa-875ded7918cc tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024" status: 200 len: 1691 microversion: 2.1 time: 0.157602 Apr 16 21:41:22.790200 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3239/6326] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:41:22 2022] GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024 => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:41:23.808146 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b3ae32da-8de4-4bde-8d1c-b3660635a323 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:41:23.808901 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b3ae32da-8de4-4bde-8d1c-b3660635a323 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:23.815092 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b3ae32da-8de4-4bde-8d1c-b3660635a323 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:23.815570 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b3ae32da-8de4-4bde-8d1c-b3660635a323 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:23.816962 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b3ae32da-8de4-4bde-8d1c-b3660635a323 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:23.817416 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b3ae32da-8de4-4bde-8d1c-b3660635a323 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:23.954315 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b3ae32da-8de4-4bde-8d1c-b3660635a323 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:41:23.962712 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b3ae32da-8de4-4bde-8d1c-b3660635a323 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024" status: 200 len: 1691 microversion: 2.1 time: 0.159678 Apr 16 21:41:23.963280 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3088/6327] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:41:23 2022] GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024 => generated 1691 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:41:24.980554 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-40c241b6-0985-42af-b0d9-d2e5a7bfbe92 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:41:24.981410 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-40c241b6-0985-42af-b0d9-d2e5a7bfbe92 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:24.988941 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40c241b6-0985-42af-b0d9-d2e5a7bfbe92 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:24.989400 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40c241b6-0985-42af-b0d9-d2e5a7bfbe92 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:24.990234 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40c241b6-0985-42af-b0d9-d2e5a7bfbe92 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:24.990675 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40c241b6-0985-42af-b0d9-d2e5a7bfbe92 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:25.128348 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-40c241b6-0985-42af-b0d9-d2e5a7bfbe92 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:41:25.135988 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-40c241b6-0985-42af-b0d9-d2e5a7bfbe92 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024" status: 200 len: 1697 microversion: 2.1 time: 0.159340 Apr 16 21:41:25.136818 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3240/6328] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:41:24 2022] GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024 => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:41:25.454978 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-761bc9c9-c43b-4383-b2af-dfc9351431b1 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:41:25.462995 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-761bc9c9-c43b-4383-b2af-dfc9351431b1 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:25.463462 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-761bc9c9-c43b-4383-b2af-dfc9351431b1 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:25.484783 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-761bc9c9-c43b-4383-b2af-dfc9351431b1 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Going to try to stop instance {{(pid=137409) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 16 21:41:25.712116 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-761bc9c9-c43b-4383-b2af-dfc9351431b1 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "POST /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf/action" status: 202 len: 0 microversion: 2.1 time: 0.260827 Apr 16 21:41:25.712761 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3089/6329] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:41:25 2022] POST /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:41:25.721349 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0fa08cc7-8688-45f0-8682-124aeb3734b1 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:41:25.722128 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0fa08cc7-8688-45f0-8682-124aeb3734b1 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:25.728189 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0fa08cc7-8688-45f0-8682-124aeb3734b1 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:25.728680 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0fa08cc7-8688-45f0-8682-124aeb3734b1 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:25.729565 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0fa08cc7-8688-45f0-8682-124aeb3734b1 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:25.730009 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0fa08cc7-8688-45f0-8682-124aeb3734b1 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:25.863079 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0fa08cc7-8688-45f0-8682-124aeb3734b1 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:41:25.871249 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0fa08cc7-8688-45f0-8682-124aeb3734b1 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf" status: 200 len: 1674 microversion: 2.1 time: 0.154112 Apr 16 21:41:25.871966 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3241/6330] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:41:25 2022] GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:41:26.154670 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5d7e3960-8b1d-4026-bdfe-a45a8ce95657 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:41:26.155366 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5d7e3960-8b1d-4026-bdfe-a45a8ce95657 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:26.162115 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5d7e3960-8b1d-4026-bdfe-a45a8ce95657 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:26.162580 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5d7e3960-8b1d-4026-bdfe-a45a8ce95657 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:26.163403 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5d7e3960-8b1d-4026-bdfe-a45a8ce95657 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:26.163846 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5d7e3960-8b1d-4026-bdfe-a45a8ce95657 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:26.299325 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5d7e3960-8b1d-4026-bdfe-a45a8ce95657 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:41:26.311592 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5d7e3960-8b1d-4026-bdfe-a45a8ce95657 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024" status: 200 len: 1697 microversion: 2.1 time: 0.160994 Apr 16 21:41:26.316198 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3090/6331] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:41:26 2022] GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024 => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:41:26.889472 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b6bbe332-7bdd-4543-b5e2-035273ff9cae tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:41:26.890101 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b6bbe332-7bdd-4543-b5e2-035273ff9cae tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:26.897480 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b6bbe332-7bdd-4543-b5e2-035273ff9cae tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:26.897950 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b6bbe332-7bdd-4543-b5e2-035273ff9cae tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:26.898750 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b6bbe332-7bdd-4543-b5e2-035273ff9cae tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:26.899200 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b6bbe332-7bdd-4543-b5e2-035273ff9cae tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:27.032190 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b6bbe332-7bdd-4543-b5e2-035273ff9cae tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:41:27.039782 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b6bbe332-7bdd-4543-b5e2-035273ff9cae tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf" status: 200 len: 1674 microversion: 2.1 time: 0.154282 Apr 16 21:41:27.040587 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3242/6332] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:41:26 2022] GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:41:27.328953 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fb50de4f-b0f2-46aa-b149-14352ec6ff74 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:41:27.329594 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-fb50de4f-b0f2-46aa-b149-14352ec6ff74 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:27.336641 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fb50de4f-b0f2-46aa-b149-14352ec6ff74 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:27.337106 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fb50de4f-b0f2-46aa-b149-14352ec6ff74 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:27.337892 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fb50de4f-b0f2-46aa-b149-14352ec6ff74 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:27.338337 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fb50de4f-b0f2-46aa-b149-14352ec6ff74 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:27.495236 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-fb50de4f-b0f2-46aa-b149-14352ec6ff74 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:41:27.503315 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fb50de4f-b0f2-46aa-b149-14352ec6ff74 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024" status: 200 len: 1697 microversion: 2.1 time: 0.178105 Apr 16 21:41:27.503894 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3091/6333] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:41:27 2022] GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024 => generated 1697 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:41:28.059249 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a4820486-1ae7-443b-84e0-f5342b054baa tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:41:28.059868 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a4820486-1ae7-443b-84e0-f5342b054baa tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:28.067079 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a4820486-1ae7-443b-84e0-f5342b054baa tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:28.067534 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a4820486-1ae7-443b-84e0-f5342b054baa tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:28.068398 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a4820486-1ae7-443b-84e0-f5342b054baa tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:28.068934 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a4820486-1ae7-443b-84e0-f5342b054baa tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:28.204715 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a4820486-1ae7-443b-84e0-f5342b054baa tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:41:28.213961 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a4820486-1ae7-443b-84e0-f5342b054baa tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf" status: 200 len: 1674 microversion: 2.1 time: 0.158577 Apr 16 21:41:28.214547 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3243/6334] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:41:28 2022] GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:41:28.520714 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-713dcbff-0c6e-481a-a954-b9331a95ccf5 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:41:28.522870 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-713dcbff-0c6e-481a-a954-b9331a95ccf5 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:28.528627 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-713dcbff-0c6e-481a-a954-b9331a95ccf5 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:28.529091 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-713dcbff-0c6e-481a-a954-b9331a95ccf5 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:28.530006 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-713dcbff-0c6e-481a-a954-b9331a95ccf5 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:28.534419 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-713dcbff-0c6e-481a-a954-b9331a95ccf5 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:28.577053 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-3be1afdd-0489-4572-b0b4-d5a1f71a3392 req-e0c0fcae-e396-4964-97c1-3726230971c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7537290d-836b-431c-bfb7-c8f83dd03024", "name": "network-vif-unplugged", "status": "completed", "tag": "73138183-36f0-4a32-833a-7b6e3fa38956"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:41:28.586508 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-3be1afdd-0489-4572-b0b4-d5a1f71a3392 req-e0c0fcae-e396-4964-97c1-3726230971c6 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:28.587048 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-3be1afdd-0489-4572-b0b4-d5a1f71a3392 req-e0c0fcae-e396-4964-97c1-3726230971c6 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:28.601888 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-3be1afdd-0489-4572-b0b4-d5a1f71a3392 req-e0c0fcae-e396-4964-97c1-3726230971c6 service nova] Creating event network-vif-unplugged:73138183-36f0-4a32-833a-7b6e3fa38956 for instance 7537290d-836b-431c-bfb7-c8f83dd03024 on nch2-master-1 Apr 16 21:41:28.607212 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-3be1afdd-0489-4572-b0b4-d5a1f71a3392 req-e0c0fcae-e396-4964-97c1-3726230971c6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034232 Apr 16 21:41:28.608078 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3244/6335] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:41:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:41:28.698707 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-713dcbff-0c6e-481a-a954-b9331a95ccf5 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:41:28.703739 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-713dcbff-0c6e-481a-a954-b9331a95ccf5 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024" status: 200 len: 1682 microversion: 2.1 time: 0.186805 Apr 16 21:41:28.708231 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3092/6336] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:41:28 2022] GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024 => generated 1682 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:41:29.233722 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ff6971ea-40a9-43ee-8333-de8c6632cdf3 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:41:29.234358 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ff6971ea-40a9-43ee-8333-de8c6632cdf3 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:29.241134 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ff6971ea-40a9-43ee-8333-de8c6632cdf3 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:29.241647 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ff6971ea-40a9-43ee-8333-de8c6632cdf3 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:29.242408 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ff6971ea-40a9-43ee-8333-de8c6632cdf3 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:29.242857 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ff6971ea-40a9-43ee-8333-de8c6632cdf3 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:29.393540 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ff6971ea-40a9-43ee-8333-de8c6632cdf3 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:41:29.407658 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ff6971ea-40a9-43ee-8333-de8c6632cdf3 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf" status: 200 len: 1674 microversion: 2.1 time: 0.173243 Apr 16 21:41:29.407658 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3245/6337] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:41:29 2022] GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf => generated 1674 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:41:30.419973 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-40c94129-338a-4ec7-b213-517dea48caf4 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:41:30.420645 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-40c94129-338a-4ec7-b213-517dea48caf4 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:30.428797 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-40c94129-338a-4ec7-b213-517dea48caf4 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:30.429298 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-40c94129-338a-4ec7-b213-517dea48caf4 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:30.430093 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-40c94129-338a-4ec7-b213-517dea48caf4 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:30.430545 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-40c94129-338a-4ec7-b213-517dea48caf4 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:30.561067 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-40c94129-338a-4ec7-b213-517dea48caf4 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:41:30.573804 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-40c94129-338a-4ec7-b213-517dea48caf4 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf" status: 200 len: 1674 microversion: 2.1 time: 0.152931 Apr 16 21:41:30.573804 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3093/6338] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:41:30 2022] GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:41:30.725890 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-3bec7b49-5302-4479-9308-c75c1b50f9c9 req-288e0191-f1e9-4880-8691-bfcbbfa71ea9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7537290d-836b-431c-bfb7-c8f83dd03024", "name": "network-vif-plugged", "status": "completed", "tag": "73138183-36f0-4a32-833a-7b6e3fa38956"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:41:30.734969 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-3bec7b49-5302-4479-9308-c75c1b50f9c9 req-288e0191-f1e9-4880-8691-bfcbbfa71ea9 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:30.740294 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-3bec7b49-5302-4479-9308-c75c1b50f9c9 req-288e0191-f1e9-4880-8691-bfcbbfa71ea9 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:30.746721 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-3bec7b49-5302-4479-9308-c75c1b50f9c9 req-288e0191-f1e9-4880-8691-bfcbbfa71ea9 service nova] Creating event network-vif-plugged:73138183-36f0-4a32-833a-7b6e3fa38956 for instance 7537290d-836b-431c-bfb7-c8f83dd03024 on nch2-master-1 Apr 16 21:41:30.751480 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-3bec7b49-5302-4479-9308-c75c1b50f9c9 req-288e0191-f1e9-4880-8691-bfcbbfa71ea9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029922 Apr 16 21:41:30.752215 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3246/6339] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:41:31.587762 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d2fa76e8-5352-4e72-9dba-0d894d48b55f tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:41:31.588404 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d2fa76e8-5352-4e72-9dba-0d894d48b55f tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:31.595826 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d2fa76e8-5352-4e72-9dba-0d894d48b55f tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:31.596400 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d2fa76e8-5352-4e72-9dba-0d894d48b55f tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:31.597241 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d2fa76e8-5352-4e72-9dba-0d894d48b55f tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:31.598013 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d2fa76e8-5352-4e72-9dba-0d894d48b55f tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:31.734659 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d2fa76e8-5352-4e72-9dba-0d894d48b55f tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:41:31.742725 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d2fa76e8-5352-4e72-9dba-0d894d48b55f tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf" status: 200 len: 1674 microversion: 2.1 time: 0.159435 Apr 16 21:41:31.743319 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3094/6340] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:41:31 2022] GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf => generated 1674 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:41:32.762097 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4c10203b-1525-4e80-a016-cf29c81a89b9 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:41:32.762795 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4c10203b-1525-4e80-a016-cf29c81a89b9 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:32.769008 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4c10203b-1525-4e80-a016-cf29c81a89b9 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:32.769466 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4c10203b-1525-4e80-a016-cf29c81a89b9 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:32.770236 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4c10203b-1525-4e80-a016-cf29c81a89b9 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:32.770677 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4c10203b-1525-4e80-a016-cf29c81a89b9 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:32.900139 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4c10203b-1525-4e80-a016-cf29c81a89b9 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:41:32.908689 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4c10203b-1525-4e80-a016-cf29c81a89b9 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf" status: 200 len: 1674 microversion: 2.1 time: 0.152190 Apr 16 21:41:32.909283 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3247/6341] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:41:32 2022] GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:41:33.926096 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6cbde439-f3fb-4aa9-aa27-cdbb29ffed3e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:41:33.926828 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6cbde439-f3fb-4aa9-aa27-cdbb29ffed3e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:33.933624 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6cbde439-f3fb-4aa9-aa27-cdbb29ffed3e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:33.934092 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6cbde439-f3fb-4aa9-aa27-cdbb29ffed3e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:33.935935 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6cbde439-f3fb-4aa9-aa27-cdbb29ffed3e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:33.935935 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6cbde439-f3fb-4aa9-aa27-cdbb29ffed3e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:34.113508 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6cbde439-f3fb-4aa9-aa27-cdbb29ffed3e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:41:34.121098 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6cbde439-f3fb-4aa9-aa27-cdbb29ffed3e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf" status: 200 len: 1674 microversion: 2.1 time: 0.198940 Apr 16 21:41:34.121683 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3095/6342] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:41:33 2022] GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf => generated 1674 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:41:35.138662 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-321a8081-dc57-4b1b-8122-bdcfa72c19c1 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:41:35.139278 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-321a8081-dc57-4b1b-8122-bdcfa72c19c1 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:35.146031 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-321a8081-dc57-4b1b-8122-bdcfa72c19c1 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:35.146424 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-321a8081-dc57-4b1b-8122-bdcfa72c19c1 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:35.147229 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-321a8081-dc57-4b1b-8122-bdcfa72c19c1 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:35.147671 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-321a8081-dc57-4b1b-8122-bdcfa72c19c1 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:35.279217 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-321a8081-dc57-4b1b-8122-bdcfa72c19c1 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:41:35.286675 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-321a8081-dc57-4b1b-8122-bdcfa72c19c1 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf" status: 200 len: 1674 microversion: 2.1 time: 0.151921 Apr 16 21:41:35.287266 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3248/6343] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:41:35 2022] GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:41:36.304589 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a0e0092c-ed1f-4eea-baa0-7fca712a0366 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:41:36.305210 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a0e0092c-ed1f-4eea-baa0-7fca712a0366 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:36.312705 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a0e0092c-ed1f-4eea-baa0-7fca712a0366 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:36.313245 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a0e0092c-ed1f-4eea-baa0-7fca712a0366 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:36.313967 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a0e0092c-ed1f-4eea-baa0-7fca712a0366 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:36.314423 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a0e0092c-ed1f-4eea-baa0-7fca712a0366 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:36.459544 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a0e0092c-ed1f-4eea-baa0-7fca712a0366 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:41:36.467297 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a0e0092c-ed1f-4eea-baa0-7fca712a0366 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf" status: 200 len: 1651 microversion: 2.1 time: 0.166721 Apr 16 21:41:36.468915 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3096/6344] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:41:36 2022] GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf => generated 1651 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:41:36.484326 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fa5e88c8-b4f9-4951-b9d1-96813a456ebb tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:41:36.491174 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fa5e88c8-b4f9-4951-b9d1-96813a456ebb tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:36.491641 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fa5e88c8-b4f9-4951-b9d1-96813a456ebb tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:36.516269 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fa5e88c8-b4f9-4951-b9d1-96813a456ebb tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Going to try to start instance {{(pid=137408) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 16 21:41:36.727903 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fa5e88c8-b4f9-4951-b9d1-96813a456ebb tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "POST /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf/action" status: 202 len: 0 microversion: 2.1 time: 0.247397 Apr 16 21:41:36.732634 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3249/6345] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:41:36 2022] POST /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 16 21:41:36.739634 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b571890c-c727-4c42-b3a8-069728c8cc3c tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:41:36.740568 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b571890c-c727-4c42-b3a8-069728c8cc3c tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:36.748786 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b571890c-c727-4c42-b3a8-069728c8cc3c tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:36.749300 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b571890c-c727-4c42-b3a8-069728c8cc3c tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:36.750187 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b571890c-c727-4c42-b3a8-069728c8cc3c tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:36.750706 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b571890c-c727-4c42-b3a8-069728c8cc3c tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:36.891269 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b571890c-c727-4c42-b3a8-069728c8cc3c tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:41:36.899049 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b571890c-c727-4c42-b3a8-069728c8cc3c tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf" status: 200 len: 1660 microversion: 2.1 time: 0.164718 Apr 16 21:41:36.899630 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3097/6346] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:41:36 2022] GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf => generated 1660 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:41:37.919540 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d2a6a606-6a74-4bb2-9bf2-502090b2f726 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:41:37.920904 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d2a6a606-6a74-4bb2-9bf2-502090b2f726 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:37.927502 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d2a6a606-6a74-4bb2-9bf2-502090b2f726 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:37.927966 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d2a6a606-6a74-4bb2-9bf2-502090b2f726 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:37.929060 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d2a6a606-6a74-4bb2-9bf2-502090b2f726 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:37.929511 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d2a6a606-6a74-4bb2-9bf2-502090b2f726 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:38.139075 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d2a6a606-6a74-4bb2-9bf2-502090b2f726 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:41:38.148129 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d2a6a606-6a74-4bb2-9bf2-502090b2f726 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf" status: 200 len: 1660 microversion: 2.1 time: 0.234259 Apr 16 21:41:38.151332 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3250/6347] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:41:37 2022] GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf => generated 1660 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:41:38.622610 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a3f9d8d5-fea4-4f3b-b150-a1ffbd3c2e84 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Action: 'create', calling method: .version_select at 0x7fbb95973d30>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-920927973"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:41:38.637943 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-a3f9d8d5-fea4-4f3b-b150-a1ffbd3c2e84 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Getting quotas for project 5279e09b8205420980e8c7accbcc5f93. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:41:38.643287 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-a3f9d8d5-fea4-4f3b-b150-a1ffbd3c2e84 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Getting quotas for user 1a36974ad8094dcd99951dbc1ce6049e and project 5279e09b8205420980e8c7accbcc5f93. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:41:38.916409 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-a3f9d8d5-fea4-4f3b-b150-a1ffbd3c2e84 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Getting quotas for project 5279e09b8205420980e8c7accbcc5f93. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:41:38.922336 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-a3f9d8d5-fea4-4f3b-b150-a1ffbd3c2e84 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Getting quotas for user 1a36974ad8094dcd99951dbc1ce6049e and project 5279e09b8205420980e8c7accbcc5f93. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:41:38.936798 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a3f9d8d5-fea4-4f3b-b150-a1ffbd3c2e84 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.318105 Apr 16 21:41:38.938471 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3098/6348] 10.222.0.20 () {60 vars in 1157 bytes} [Sat Apr 16 21:41:38 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:41:39.170257 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2c712519-07da-4e28-b9c6-472033ee4f8a tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:41:39.171718 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2c712519-07da-4e28-b9c6-472033ee4f8a tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:39.179786 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2c712519-07da-4e28-b9c6-472033ee4f8a tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:39.181580 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2c712519-07da-4e28-b9c6-472033ee4f8a tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:39.182443 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2c712519-07da-4e28-b9c6-472033ee4f8a tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:39.182954 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2c712519-07da-4e28-b9c6-472033ee4f8a tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:39.334650 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2c712519-07da-4e28-b9c6-472033ee4f8a tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:41:39.347429 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2c712519-07da-4e28-b9c6-472033ee4f8a tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf" status: 200 len: 1664 microversion: 2.1 time: 0.182352 Apr 16 21:41:39.348500 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3251/6349] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:41:39 2022] GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf => generated 1664 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:41:42.024846 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-44c01bbc-e8a5-40ed-bf30-d06cd4cfd8a7 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1052601608", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "4dde0f08-8661-4da9-83c4-4c68c0d1d88d"}], "key_name": "tempest-TestNetworkBasicOps-920927973", "security_groups": [{"name": "tempest-secgroup-smoke-1490607861"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:41:42.127980 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-44c01bbc-e8a5-40ed-bf30-d06cd4cfd8a7 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] validate_networks() for [('4dde0f08-8661-4da9-83c4-4c68c0d1d88d', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:41:42.526328 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-44c01bbc-e8a5-40ed-bf30-d06cd4cfd8a7 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:41:42.526835 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-44c01bbc-e8a5-40ed-bf30-d06cd4cfd8a7 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:41:42.527425 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-44c01bbc-e8a5-40ed-bf30-d06cd4cfd8a7 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:41:42.527891 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-44c01bbc-e8a5-40ed-bf30-d06cd4cfd8a7 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:41:42.528376 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-44c01bbc-e8a5-40ed-bf30-d06cd4cfd8a7 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:41:42.537000 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-44c01bbc-e8a5-40ed-bf30-d06cd4cfd8a7 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:42.537493 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-44c01bbc-e8a5-40ed-bf30-d06cd4cfd8a7 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:42.538245 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-44c01bbc-e8a5-40ed-bf30-d06cd4cfd8a7 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:42.538689 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-44c01bbc-e8a5-40ed-bf30-d06cd4cfd8a7 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:42.556798 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-44c01bbc-e8a5-40ed-bf30-d06cd4cfd8a7 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Getting quotas for project 5279e09b8205420980e8c7accbcc5f93. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:41:42.563134 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-44c01bbc-e8a5-40ed-bf30-d06cd4cfd8a7 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Getting quotas for user 1a36974ad8094dcd99951dbc1ce6049e and project 5279e09b8205420980e8c7accbcc5f93. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:41:42.578013 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-44c01bbc-e8a5-40ed-bf30-d06cd4cfd8a7 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:41:42.580320 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-44c01bbc-e8a5-40ed-bf30-d06cd4cfd8a7 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 97de4895-75ad-4f0f-bde9-0d3d2215d099] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:41:42.724869 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-44c01bbc-e8a5-40ed-bf30-d06cd4cfd8a7 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.704965 Apr 16 21:41:42.725697 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3099/6350] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:41:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:41:42.736360 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ee0941d5-1fe7-45f3-a3be-c5b5a00e1b60 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:41:42.737001 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ee0941d5-1fe7-45f3-a3be-c5b5a00e1b60 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 97de4895-75ad-4f0f-bde9-0d3d2215d099] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:42.793546 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ee0941d5-1fe7-45f3-a3be-c5b5a00e1b60 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a36974ad8094dcd99951dbc1ce6049e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5279e09b8205420980e8c7accbcc5f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:41:42.803193 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ee0941d5-1fe7-45f3-a3be-c5b5a00e1b60 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/97de4895-75ad-4f0f-bde9-0d3d2215d099" status: 200 len: 1248 microversion: 2.1 time: 0.070053 Apr 16 21:41:42.803783 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3252/6351] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:41:42 2022] GET /compute/v2.1/servers/97de4895-75ad-4f0f-bde9-0d3d2215d099 => generated 1248 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:41:43.821605 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-04e95439-cc72-4cd3-94a3-07606d96d30c tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:41:43.822332 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-04e95439-cc72-4cd3-94a3-07606d96d30c tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 97de4895-75ad-4f0f-bde9-0d3d2215d099] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:43.829829 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-04e95439-cc72-4cd3-94a3-07606d96d30c tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:43.830315 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-04e95439-cc72-4cd3-94a3-07606d96d30c tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:43.831124 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-04e95439-cc72-4cd3-94a3-07606d96d30c tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:43.831568 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-04e95439-cc72-4cd3-94a3-07606d96d30c tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:43.894382 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-04e95439-cc72-4cd3-94a3-07606d96d30c tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a36974ad8094dcd99951dbc1ce6049e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5279e09b8205420980e8c7accbcc5f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:41:43.916853 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-04e95439-cc72-4cd3-94a3-07606d96d30c tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/97de4895-75ad-4f0f-bde9-0d3d2215d099" status: 200 len: 1252 microversion: 2.1 time: 0.089097 Apr 16 21:41:43.916853 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3100/6352] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:41:43 2022] GET /compute/v2.1/servers/97de4895-75ad-4f0f-bde9-0d3d2215d099 => generated 1252 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:41:44.925947 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6b633e13-cc1a-42a6-aa13-6647aeda8769 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:41:44.926646 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6b633e13-cc1a-42a6-aa13-6647aeda8769 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 97de4895-75ad-4f0f-bde9-0d3d2215d099] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:44.936607 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6b633e13-cc1a-42a6-aa13-6647aeda8769 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:44.937146 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6b633e13-cc1a-42a6-aa13-6647aeda8769 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:44.938042 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6b633e13-cc1a-42a6-aa13-6647aeda8769 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:44.938566 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6b633e13-cc1a-42a6-aa13-6647aeda8769 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:45.005540 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6b633e13-cc1a-42a6-aa13-6647aeda8769 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a36974ad8094dcd99951dbc1ce6049e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5279e09b8205420980e8c7accbcc5f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:41:45.019329 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6b633e13-cc1a-42a6-aa13-6647aeda8769 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/97de4895-75ad-4f0f-bde9-0d3d2215d099" status: 200 len: 1318 microversion: 2.1 time: 0.095084 Apr 16 21:41:45.024385 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3253/6353] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:41:44 2022] GET /compute/v2.1/servers/97de4895-75ad-4f0f-bde9-0d3d2215d099 => generated 1318 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:41:46.031183 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-188e832c-e6be-4b7e-a07d-7e05d58311e3 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:41:46.032197 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-188e832c-e6be-4b7e-a07d-7e05d58311e3 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 97de4895-75ad-4f0f-bde9-0d3d2215d099] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:46.043615 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-188e832c-e6be-4b7e-a07d-7e05d58311e3 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:46.043615 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-188e832c-e6be-4b7e-a07d-7e05d58311e3 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:46.043615 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-188e832c-e6be-4b7e-a07d-7e05d58311e3 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:46.043615 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-188e832c-e6be-4b7e-a07d-7e05d58311e3 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:46.274669 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-188e832c-e6be-4b7e-a07d-7e05d58311e3 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a36974ad8094dcd99951dbc1ce6049e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5279e09b8205420980e8c7accbcc5f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:41:46.283385 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-188e832c-e6be-4b7e-a07d-7e05d58311e3 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/97de4895-75ad-4f0f-bde9-0d3d2215d099" status: 200 len: 1374 microversion: 2.1 time: 0.256307 Apr 16 21:41:46.284455 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3101/6354] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:41:46 2022] GET /compute/v2.1/servers/97de4895-75ad-4f0f-bde9-0d3d2215d099 => generated 1374 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:41:46.491505 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-2d7f02b2-5092-47cf-abf9-dcc73298ad6e req-cda4faa9-4c65-4bd3-be60-9d2321e2f638 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97de4895-75ad-4f0f-bde9-0d3d2215d099", "tag": "567bf7ae-21ad-47f7-ab4e-8a25023f45b8"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:41:46.503852 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-2d7f02b2-5092-47cf-abf9-dcc73298ad6e req-cda4faa9-4c65-4bd3-be60-9d2321e2f638 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:46.504683 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-2d7f02b2-5092-47cf-abf9-dcc73298ad6e req-cda4faa9-4c65-4bd3-be60-9d2321e2f638 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:46.522808 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-2d7f02b2-5092-47cf-abf9-dcc73298ad6e req-cda4faa9-4c65-4bd3-be60-9d2321e2f638 service nova] Creating event network-changed:567bf7ae-21ad-47f7-ab4e-8a25023f45b8 for instance 97de4895-75ad-4f0f-bde9-0d3d2215d099 on nch1-master-1 Apr 16 21:41:46.528377 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-2d7f02b2-5092-47cf-abf9-dcc73298ad6e req-cda4faa9-4c65-4bd3-be60-9d2321e2f638 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042786 Apr 16 21:41:46.528975 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3254/6355] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:41:47.300877 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-109c239f-e202-413b-994a-5bd60fc70e6d tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:41:47.301492 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-109c239f-e202-413b-994a-5bd60fc70e6d tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 97de4895-75ad-4f0f-bde9-0d3d2215d099] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:47.308989 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-109c239f-e202-413b-994a-5bd60fc70e6d tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:47.309498 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-109c239f-e202-413b-994a-5bd60fc70e6d tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:47.310232 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-109c239f-e202-413b-994a-5bd60fc70e6d tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:47.310674 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-109c239f-e202-413b-994a-5bd60fc70e6d tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:47.443462 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-109c239f-e202-413b-994a-5bd60fc70e6d tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a36974ad8094dcd99951dbc1ce6049e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5279e09b8205420980e8c7accbcc5f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:41:47.451432 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-109c239f-e202-413b-994a-5bd60fc70e6d tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/97de4895-75ad-4f0f-bde9-0d3d2215d099" status: 200 len: 1374 microversion: 2.1 time: 0.154716 Apr 16 21:41:47.452016 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3102/6356] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:41:47 2022] GET /compute/v2.1/servers/97de4895-75ad-4f0f-bde9-0d3d2215d099 => generated 1374 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:41:48.470014 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3d44cbc0-6675-46db-8dd3-4149974ba126 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:41:48.470714 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3d44cbc0-6675-46db-8dd3-4149974ba126 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 97de4895-75ad-4f0f-bde9-0d3d2215d099] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:48.476904 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d44cbc0-6675-46db-8dd3-4149974ba126 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:48.477356 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d44cbc0-6675-46db-8dd3-4149974ba126 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:48.478139 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d44cbc0-6675-46db-8dd3-4149974ba126 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:48.478596 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d44cbc0-6675-46db-8dd3-4149974ba126 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:48.610741 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3d44cbc0-6675-46db-8dd3-4149974ba126 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a36974ad8094dcd99951dbc1ce6049e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5279e09b8205420980e8c7accbcc5f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:41:48.618193 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3d44cbc0-6675-46db-8dd3-4149974ba126 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/97de4895-75ad-4f0f-bde9-0d3d2215d099" status: 200 len: 1374 microversion: 2.1 time: 0.153220 Apr 16 21:41:48.618780 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3255/6357] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:41:48 2022] GET /compute/v2.1/servers/97de4895-75ad-4f0f-bde9-0d3d2215d099 => generated 1374 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:41:49.636592 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9557ba31-6637-4dc1-8395-3a3435332ef9 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:41:49.637125 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9557ba31-6637-4dc1-8395-3a3435332ef9 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 97de4895-75ad-4f0f-bde9-0d3d2215d099] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:49.643612 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9557ba31-6637-4dc1-8395-3a3435332ef9 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:49.644072 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9557ba31-6637-4dc1-8395-3a3435332ef9 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:49.644916 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9557ba31-6637-4dc1-8395-3a3435332ef9 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:49.645359 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9557ba31-6637-4dc1-8395-3a3435332ef9 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:50.121604 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9557ba31-6637-4dc1-8395-3a3435332ef9 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a36974ad8094dcd99951dbc1ce6049e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5279e09b8205420980e8c7accbcc5f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:41:50.129235 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9557ba31-6637-4dc1-8395-3a3435332ef9 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/97de4895-75ad-4f0f-bde9-0d3d2215d099" status: 200 len: 1374 microversion: 2.1 time: 0.497260 Apr 16 21:41:50.129810 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3103/6358] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:41:49 2022] GET /compute/v2.1/servers/97de4895-75ad-4f0f-bde9-0d3d2215d099 => generated 1374 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:41:51.146788 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1f0368bb-8ef7-4bce-bc0c-6917b62f4455 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:41:51.147430 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1f0368bb-8ef7-4bce-bc0c-6917b62f4455 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 97de4895-75ad-4f0f-bde9-0d3d2215d099] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:51.154699 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1f0368bb-8ef7-4bce-bc0c-6917b62f4455 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:51.155157 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1f0368bb-8ef7-4bce-bc0c-6917b62f4455 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:51.155929 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1f0368bb-8ef7-4bce-bc0c-6917b62f4455 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:51.156409 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1f0368bb-8ef7-4bce-bc0c-6917b62f4455 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:51.286086 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1f0368bb-8ef7-4bce-bc0c-6917b62f4455 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a36974ad8094dcd99951dbc1ce6049e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5279e09b8205420980e8c7accbcc5f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:41:51.294054 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1f0368bb-8ef7-4bce-bc0c-6917b62f4455 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/97de4895-75ad-4f0f-bde9-0d3d2215d099" status: 200 len: 1374 microversion: 2.1 time: 0.151305 Apr 16 21:41:51.294622 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3256/6359] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:41:51 2022] GET /compute/v2.1/servers/97de4895-75ad-4f0f-bde9-0d3d2215d099 => generated 1374 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:41:51.593107 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-b1af6da3-fc71-4ec5-b215-44e8daa2536f req-13b3311f-ad3f-4b65-9947-8af2c9681b04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97de4895-75ad-4f0f-bde9-0d3d2215d099", "name": "network-vif-plugged", "status": "completed", "tag": "567bf7ae-21ad-47f7-ab4e-8a25023f45b8"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:41:51.603950 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-b1af6da3-fc71-4ec5-b215-44e8daa2536f req-13b3311f-ad3f-4b65-9947-8af2c9681b04 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:51.604440 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-b1af6da3-fc71-4ec5-b215-44e8daa2536f req-13b3311f-ad3f-4b65-9947-8af2c9681b04 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:51.615487 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-b1af6da3-fc71-4ec5-b215-44e8daa2536f req-13b3311f-ad3f-4b65-9947-8af2c9681b04 service nova] Creating event network-vif-plugged:567bf7ae-21ad-47f7-ab4e-8a25023f45b8 for instance 97de4895-75ad-4f0f-bde9-0d3d2215d099 on nch1-master-1 Apr 16 21:41:51.620597 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-b1af6da3-fc71-4ec5-b215-44e8daa2536f req-13b3311f-ad3f-4b65-9947-8af2c9681b04 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031287 Apr 16 21:41:51.621184 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3104/6360] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:41:52.311433 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-dc04baa5-6b86-4eff-918a-d745973b4fc4 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:41:52.312097 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-dc04baa5-6b86-4eff-918a-d745973b4fc4 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 97de4895-75ad-4f0f-bde9-0d3d2215d099] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:52.318833 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dc04baa5-6b86-4eff-918a-d745973b4fc4 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:52.319287 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dc04baa5-6b86-4eff-918a-d745973b4fc4 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:52.320056 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dc04baa5-6b86-4eff-918a-d745973b4fc4 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:52.320529 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dc04baa5-6b86-4eff-918a-d745973b4fc4 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:52.787997 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-dc04baa5-6b86-4eff-918a-d745973b4fc4 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a36974ad8094dcd99951dbc1ce6049e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5279e09b8205420980e8c7accbcc5f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:41:52.796567 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-dc04baa5-6b86-4eff-918a-d745973b4fc4 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/97de4895-75ad-4f0f-bde9-0d3d2215d099" status: 200 len: 1374 microversion: 2.1 time: 0.488731 Apr 16 21:41:52.797087 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3257/6361] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:41:52 2022] GET /compute/v2.1/servers/97de4895-75ad-4f0f-bde9-0d3d2215d099 => generated 1374 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:41:53.815082 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e7f4cdb8-679b-43a7-8db5-a152f4d31aef tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:41:53.815794 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e7f4cdb8-679b-43a7-8db5-a152f4d31aef tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 97de4895-75ad-4f0f-bde9-0d3d2215d099] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:53.823058 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e7f4cdb8-679b-43a7-8db5-a152f4d31aef tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:53.823999 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e7f4cdb8-679b-43a7-8db5-a152f4d31aef tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:53.824852 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e7f4cdb8-679b-43a7-8db5-a152f4d31aef tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:53.825009 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e7f4cdb8-679b-43a7-8db5-a152f4d31aef tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:53.988050 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e7f4cdb8-679b-43a7-8db5-a152f4d31aef tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a36974ad8094dcd99951dbc1ce6049e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5279e09b8205420980e8c7accbcc5f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:41:53.995862 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e7f4cdb8-679b-43a7-8db5-a152f4d31aef tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/97de4895-75ad-4f0f-bde9-0d3d2215d099" status: 200 len: 1546 microversion: 2.1 time: 0.185812 Apr 16 21:41:53.996475 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3105/6362] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:41:53 2022] GET /compute/v2.1/servers/97de4895-75ad-4f0f-bde9-0d3d2215d099 => generated 1546 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:41:54.012503 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-58d6250a-3788-44e6-8fe3-7412e6cac1b7 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:41:54.013311 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-58d6250a-3788-44e6-8fe3-7412e6cac1b7 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 97de4895-75ad-4f0f-bde9-0d3d2215d099] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:41:54.020257 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58d6250a-3788-44e6-8fe3-7412e6cac1b7 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:54.020717 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58d6250a-3788-44e6-8fe3-7412e6cac1b7 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:54.021496 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58d6250a-3788-44e6-8fe3-7412e6cac1b7 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:41:54.024569 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58d6250a-3788-44e6-8fe3-7412e6cac1b7 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:41:54.152540 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-58d6250a-3788-44e6-8fe3-7412e6cac1b7 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a36974ad8094dcd99951dbc1ce6049e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5279e09b8205420980e8c7accbcc5f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:41:54.160793 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-58d6250a-3788-44e6-8fe3-7412e6cac1b7 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/97de4895-75ad-4f0f-bde9-0d3d2215d099" status: 200 len: 1546 microversion: 2.1 time: 0.152497 Apr 16 21:41:54.161390 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3258/6363] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:41:54 2022] GET /compute/v2.1/servers/97de4895-75ad-4f0f-bde9-0d3d2215d099 => generated 1546 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:42:02.972100 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-62eacb01-f815-45b9-b9e3-7d705a75731b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:42:02.973111 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-62eacb01-f815-45b9-b9e3-7d705a75731b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:42:02.979854 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-62eacb01-f815-45b9-b9e3-7d705a75731b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:02.980374 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-62eacb01-f815-45b9-b9e3-7d705a75731b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:02.981150 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-62eacb01-f815-45b9-b9e3-7d705a75731b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:02.981594 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-62eacb01-f815-45b9-b9e3-7d705a75731b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:03.029373 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-62eacb01-f815-45b9-b9e3-7d705a75731b tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "POST /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024/action" status: 200 len: 24573 microversion: 2.1 time: 0.061183 Apr 16 21:42:03.029943 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3106/6364] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:42:02 2022] POST /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024/action => generated 24573 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:42:11.840453 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-16e29f31-c82a-4336-bc1f-722713f24c88 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:42:11.848957 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-16e29f31-c82a-4336-bc1f-722713f24c88 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:42:11.848957 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-16e29f31-c82a-4336-bc1f-722713f24c88 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:11.848957 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-16e29f31-c82a-4336-bc1f-722713f24c88 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:11.849515 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-16e29f31-c82a-4336-bc1f-722713f24c88 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:11.849967 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-16e29f31-c82a-4336-bc1f-722713f24c88 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:11.878873 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-16e29f31-c82a-4336-bc1f-722713f24c88 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042690 Apr 16 21:42:11.879433 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3259/6365] 10.222.0.20 () {58 vars in 1301 bytes} [Sat Apr 16 21:42:11 2022] GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:42:11.937631 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-22faf0c5-b2ed-4670-89a2-fc87da697b77 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:42:11.938234 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-22faf0c5-b2ed-4670-89a2-fc87da697b77 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:42:11.946958 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-22faf0c5-b2ed-4670-89a2-fc87da697b77 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:11.947390 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-22faf0c5-b2ed-4670-89a2-fc87da697b77 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:11.948190 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-22faf0c5-b2ed-4670-89a2-fc87da697b77 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:11.948669 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-22faf0c5-b2ed-4670-89a2-fc87da697b77 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:11.974196 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-22faf0c5-b2ed-4670-89a2-fc87da697b77 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:42:12.323861 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-22faf0c5-b2ed-4670-89a2-fc87da697b77 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf" status: 204 len: 0 microversion: 2.1 time: 0.390281 Apr 16 21:42:12.324519 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3107/6366] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:42:11 2022] DELETE /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:42:12.333187 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-51c1825d-8113-4a36-b067-a82bd3f4a2d6 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:42:12.335231 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-51c1825d-8113-4a36-b067-a82bd3f4a2d6 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:42:12.339719 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-51c1825d-8113-4a36-b067-a82bd3f4a2d6 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:12.340192 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-51c1825d-8113-4a36-b067-a82bd3f4a2d6 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:12.340979 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-51c1825d-8113-4a36-b067-a82bd3f4a2d6 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:12.341424 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-51c1825d-8113-4a36-b067-a82bd3f4a2d6 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:12.476251 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-51c1825d-8113-4a36-b067-a82bd3f4a2d6 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:42:12.483776 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-51c1825d-8113-4a36-b067-a82bd3f4a2d6 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf" status: 200 len: 1670 microversion: 2.1 time: 0.154491 Apr 16 21:42:12.489249 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3260/6367] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:42:12 2022] GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:42:13.501596 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8622ddb9-e641-4849-806d-34496189145c tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:42:13.502300 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8622ddb9-e641-4849-806d-34496189145c tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:42:13.509960 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8622ddb9-e641-4849-806d-34496189145c tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:13.510414 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8622ddb9-e641-4849-806d-34496189145c tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:13.511197 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8622ddb9-e641-4849-806d-34496189145c tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:13.511637 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8622ddb9-e641-4849-806d-34496189145c tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:13.653297 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8622ddb9-e641-4849-806d-34496189145c tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:42:13.653297 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8622ddb9-e641-4849-806d-34496189145c tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf" status: 200 len: 1670 microversion: 2.1 time: 0.152090 Apr 16 21:42:13.653297 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3108/6368] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:42:13 2022] GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf => generated 1670 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:42:14.666713 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b06ca615-0964-4edb-aa7e-50b462d68e9d tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:42:14.667658 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b06ca615-0964-4edb-aa7e-50b462d68e9d tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:42:14.675707 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b06ca615-0964-4edb-aa7e-50b462d68e9d tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:14.677536 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b06ca615-0964-4edb-aa7e-50b462d68e9d tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:14.677536 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b06ca615-0964-4edb-aa7e-50b462d68e9d tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:14.677536 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b06ca615-0964-4edb-aa7e-50b462d68e9d tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:14.834013 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b06ca615-0964-4edb-aa7e-50b462d68e9d tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:42:14.841688 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b06ca615-0964-4edb-aa7e-50b462d68e9d tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf" status: 200 len: 1670 microversion: 2.1 time: 0.178956 Apr 16 21:42:14.842358 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3261/6369] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:42:14 2022] GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf => generated 1670 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:42:15.283507 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-5a82def8-7121-424f-a78e-97e910365d30 req-d7856f32-e866-406a-9dd9-0c81ae3ba520 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c63a395-2ffd-44e5-aa9b-cd3417a504bf", "name": "network-vif-deleted", "tag": "28042d4b-e13b-4b15-bfcb-0e0dd805600f"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:42:15.292437 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-5a82def8-7121-424f-a78e-97e910365d30 req-d7856f32-e866-406a-9dd9-0c81ae3ba520 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:15.297648 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-5a82def8-7121-424f-a78e-97e910365d30 req-d7856f32-e866-406a-9dd9-0c81ae3ba520 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:15.307092 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-5a82def8-7121-424f-a78e-97e910365d30 req-d7856f32-e866-406a-9dd9-0c81ae3ba520 service nova] Creating event network-vif-deleted:28042d4b-e13b-4b15-bfcb-0e0dd805600f for instance 8c63a395-2ffd-44e5-aa9b-cd3417a504bf on nch1-master-1 Apr 16 21:42:15.312037 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-5a82def8-7121-424f-a78e-97e910365d30 req-d7856f32-e866-406a-9dd9-0c81ae3ba520 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032933 Apr 16 21:42:15.313272 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3109/6370] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:42:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:42:15.860457 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-75a7bdef-73a6-4dc6-a967-a391952aedfc tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:42:15.861073 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-75a7bdef-73a6-4dc6-a967-a391952aedfc tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:42:15.868383 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-75a7bdef-73a6-4dc6-a967-a391952aedfc tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:15.873152 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-75a7bdef-73a6-4dc6-a967-a391952aedfc tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:15.873152 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-75a7bdef-73a6-4dc6-a967-a391952aedfc tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:15.873152 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-75a7bdef-73a6-4dc6-a967-a391952aedfc tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:15.903702 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-75a7bdef-73a6-4dc6-a967-a391952aedfc tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:15.904311 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-75a7bdef-73a6-4dc6-a967-a391952aedfc tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:15.904810 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-75a7bdef-73a6-4dc6-a967-a391952aedfc tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lazy-loading 'fault' on Instance uuid 8c63a395-2ffd-44e5-aa9b-cd3417a504bf {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:42:15.947776 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-75a7bdef-73a6-4dc6-a967-a391952aedfc tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:42:15.956134 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-75a7bdef-73a6-4dc6-a967-a391952aedfc tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf" status: 200 len: 1328 microversion: 2.1 time: 0.100852 Apr 16 21:42:15.970770 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3262/6371] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:42:15 2022] GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf => generated 1328 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:42:16.980380 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a28ea69c-01cf-4d58-9a4f-bd293e9eb5f5 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:42:16.981212 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a28ea69c-01cf-4d58-9a4f-bd293e9eb5f5 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:42:16.991689 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a28ea69c-01cf-4d58-9a4f-bd293e9eb5f5 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:16.992148 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a28ea69c-01cf-4d58-9a4f-bd293e9eb5f5 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:16.992970 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a28ea69c-01cf-4d58-9a4f-bd293e9eb5f5 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:16.993493 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a28ea69c-01cf-4d58-9a4f-bd293e9eb5f5 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:17.007837 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-a28ea69c-01cf-4d58-9a4f-bd293e9eb5f5 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] HTTP exception thrown: Instance 8c63a395-2ffd-44e5-aa9b-cd3417a504bf could not be found. Apr 16 21:42:17.008474 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a28ea69c-01cf-4d58-9a4f-bd293e9eb5f5 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Returning 404 to user: Instance 8c63a395-2ffd-44e5-aa9b-cd3417a504bf could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:42:17.009326 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a28ea69c-01cf-4d58-9a4f-bd293e9eb5f5 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf" status: 404 len: 111 microversion: 2.1 time: 0.034082 Apr 16 21:42:17.009870 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3110/6372] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:42:16 2022] GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:42:17.018452 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a8f38829-bad2-4c99-a261-ce0b35138b5d tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '.version_select at 0x7fbb9ff4aa60>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:42:17.097065 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a8f38829-bad2-4c99-a261-ce0b35138b5d tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1824759213" status: 202 len: 0 microversion: 2.1 time: 0.082555 Apr 16 21:42:17.097665 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3263/6373] 10.222.0.20 () {58 vars in 1220 bytes} [Sat Apr 16 21:42:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1824759213 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:42:17.952023 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7884ecac-6900-4fe6-93ef-9e4ec70596af tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Action: 'create', calling method: .version_select at 0x7fbb96a20940>, body: {"keypair": {"name": "tempest-keypair-492647057"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:42:17.966122 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-7884ecac-6900-4fe6-93ef-9e4ec70596af tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Getting quotas for project 7fc33178ac5b4d4f9c1f346e3b4371b6. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:42:17.971138 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-7884ecac-6900-4fe6-93ef-9e4ec70596af tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Getting quotas for user 8b67f0226ea247ae857b18891e0834f8 and project 7fc33178ac5b4d4f9c1f346e3b4371b6. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:42:18.427342 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-7884ecac-6900-4fe6-93ef-9e4ec70596af tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Getting quotas for project 7fc33178ac5b4d4f9c1f346e3b4371b6. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:42:18.432774 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-7884ecac-6900-4fe6-93ef-9e4ec70596af tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Getting quotas for user 8b67f0226ea247ae857b18891e0834f8 and project 7fc33178ac5b4d4f9c1f346e3b4371b6. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:42:18.448193 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7884ecac-6900-4fe6-93ef-9e4ec70596af tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.500005 Apr 16 21:42:18.448806 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3111/6374] 10.222.0.20 () {60 vars in 1157 bytes} [Sat Apr 16 21:42:17 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:42:20.522963 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ee0b8c2c-6af9-44be-b85a-be0b68534013 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:42:20.523827 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ee0b8c2c-6af9-44be-b85a-be0b68534013 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 97de4895-75ad-4f0f-bde9-0d3d2215d099] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:42:20.531655 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee0b8c2c-6af9-44be-b85a-be0b68534013 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:20.531655 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee0b8c2c-6af9-44be-b85a-be0b68534013 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:20.532562 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee0b8c2c-6af9-44be-b85a-be0b68534013 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:20.533384 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee0b8c2c-6af9-44be-b85a-be0b68534013 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:20.558719 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ee0b8c2c-6af9-44be-b85a-be0b68534013 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 97de4895-75ad-4f0f-bde9-0d3d2215d099] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:42:20.901487 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ee0b8c2c-6af9-44be-b85a-be0b68534013 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "DELETE /compute/v2.1/servers/97de4895-75ad-4f0f-bde9-0d3d2215d099" status: 204 len: 0 microversion: 2.1 time: 0.383311 Apr 16 21:42:20.902122 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3264/6375] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:42:20 2022] DELETE /compute/v2.1/servers/97de4895-75ad-4f0f-bde9-0d3d2215d099 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:42:20.912011 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0f093156-dcad-4fcc-87fc-a8ad2d186c6c tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:42:20.912661 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0f093156-dcad-4fcc-87fc-a8ad2d186c6c tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 97de4895-75ad-4f0f-bde9-0d3d2215d099] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:42:20.918693 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0f093156-dcad-4fcc-87fc-a8ad2d186c6c tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:20.919147 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0f093156-dcad-4fcc-87fc-a8ad2d186c6c tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:20.919924 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0f093156-dcad-4fcc-87fc-a8ad2d186c6c tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:20.920416 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0f093156-dcad-4fcc-87fc-a8ad2d186c6c tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:21.092063 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0f093156-dcad-4fcc-87fc-a8ad2d186c6c tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a36974ad8094dcd99951dbc1ce6049e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5279e09b8205420980e8c7accbcc5f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:42:21.100388 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0f093156-dcad-4fcc-87fc-a8ad2d186c6c tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/97de4895-75ad-4f0f-bde9-0d3d2215d099" status: 200 len: 1552 microversion: 2.1 time: 0.193300 Apr 16 21:42:21.100951 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3112/6376] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:42:20 2022] GET /compute/v2.1/servers/97de4895-75ad-4f0f-bde9-0d3d2215d099 => generated 1552 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:42:21.237449 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1a2a7772-b2d3-4c0a-b190-be3664b1e872 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1058621315", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3e745f17-203e-4728-9fb7-50341f5a0a21"}], "security_groups": [{"name": "tempest-securitygroup--218736505"}], "key_name": "tempest-keypair-492647057", "user_data": "}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:42:21.345167 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-1a2a7772-b2d3-4c0a-b190-be3664b1e872 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] validate_networks() for [('3e745f17-203e-4728-9fb7-50341f5a0a21', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:42:21.722661 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-1a2a7772-b2d3-4c0a-b190-be3664b1e872 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:42:21.723256 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-1a2a7772-b2d3-4c0a-b190-be3664b1e872 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:42:21.723591 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-1a2a7772-b2d3-4c0a-b190-be3664b1e872 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:42:21.724007 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-1a2a7772-b2d3-4c0a-b190-be3664b1e872 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:42:21.724456 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-1a2a7772-b2d3-4c0a-b190-be3664b1e872 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:42:21.733228 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1a2a7772-b2d3-4c0a-b190-be3664b1e872 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:21.733684 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1a2a7772-b2d3-4c0a-b190-be3664b1e872 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:21.734498 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1a2a7772-b2d3-4c0a-b190-be3664b1e872 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:21.734943 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1a2a7772-b2d3-4c0a-b190-be3664b1e872 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:21.753905 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-1a2a7772-b2d3-4c0a-b190-be3664b1e872 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Getting quotas for project 7fc33178ac5b4d4f9c1f346e3b4371b6. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:42:21.759192 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-1a2a7772-b2d3-4c0a-b190-be3664b1e872 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Getting quotas for user 8b67f0226ea247ae857b18891e0834f8 and project 7fc33178ac5b4d4f9c1f346e3b4371b6. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:42:21.772468 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1a2a7772-b2d3-4c0a-b190-be3664b1e872 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:42:21.774958 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1a2a7772-b2d3-4c0a-b190-be3664b1e872 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 9300724f-49f1-464c-8f56-76b4fb4a0d2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:42:21.900704 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1a2a7772-b2d3-4c0a-b190-be3664b1e872 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.667842 Apr 16 21:42:21.901544 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3265/6377] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:42:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:42:21.911470 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-61eb8404-395e-4845-aa75-ef6079609527 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:42:21.912091 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-61eb8404-395e-4845-aa75-ef6079609527 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 9300724f-49f1-464c-8f56-76b4fb4a0d2e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:42:21.985244 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-61eb8404-395e-4845-aa75-ef6079609527 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:42:21.998810 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-61eb8404-395e-4845-aa75-ef6079609527 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e" status: 200 len: 1237 microversion: 2.1 time: 0.090793 Apr 16 21:42:21.999999 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3113/6378] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:42:21 2022] GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e => generated 1237 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:42:22.118883 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d8899af1-59ba-4c54-84f8-ee9ecadbe59f tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:42:22.119514 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d8899af1-59ba-4c54-84f8-ee9ecadbe59f tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 97de4895-75ad-4f0f-bde9-0d3d2215d099] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:42:22.127232 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d8899af1-59ba-4c54-84f8-ee9ecadbe59f tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:22.127697 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d8899af1-59ba-4c54-84f8-ee9ecadbe59f tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:22.128634 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d8899af1-59ba-4c54-84f8-ee9ecadbe59f tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:22.129086 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d8899af1-59ba-4c54-84f8-ee9ecadbe59f tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:22.336909 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d8899af1-59ba-4c54-84f8-ee9ecadbe59f tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a36974ad8094dcd99951dbc1ce6049e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5279e09b8205420980e8c7accbcc5f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:42:22.348524 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d8899af1-59ba-4c54-84f8-ee9ecadbe59f tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/97de4895-75ad-4f0f-bde9-0d3d2215d099" status: 200 len: 1552 microversion: 2.1 time: 0.233810 Apr 16 21:42:22.351489 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3266/6379] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:42:22 2022] GET /compute/v2.1/servers/97de4895-75ad-4f0f-bde9-0d3d2215d099 => generated 1552 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:42:22.821712 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-a8a6ee0b-5f82-43d9-840b-024aa1e0d5cf req-5b7943c5-2b37-403c-9b60-75c1a85cc305 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97de4895-75ad-4f0f-bde9-0d3d2215d099", "name": "network-vif-deleted", "tag": "567bf7ae-21ad-47f7-ab4e-8a25023f45b8"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:42:22.833158 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-a8a6ee0b-5f82-43d9-840b-024aa1e0d5cf req-5b7943c5-2b37-403c-9b60-75c1a85cc305 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:22.833628 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-a8a6ee0b-5f82-43d9-840b-024aa1e0d5cf req-5b7943c5-2b37-403c-9b60-75c1a85cc305 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:22.849439 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-a8a6ee0b-5f82-43d9-840b-024aa1e0d5cf req-5b7943c5-2b37-403c-9b60-75c1a85cc305 service nova] Creating event network-vif-deleted:567bf7ae-21ad-47f7-ab4e-8a25023f45b8 for instance 97de4895-75ad-4f0f-bde9-0d3d2215d099 on nch1-master-1 Apr 16 21:42:22.856366 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-a8a6ee0b-5f82-43d9-840b-024aa1e0d5cf req-5b7943c5-2b37-403c-9b60-75c1a85cc305 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038616 Apr 16 21:42:22.856366 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3114/6380] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:42:23.017536 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-aaf4df81-d105-4e95-9669-8790b1c8bfac tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:42:23.018120 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-aaf4df81-d105-4e95-9669-8790b1c8bfac tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 9300724f-49f1-464c-8f56-76b4fb4a0d2e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:42:23.024968 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aaf4df81-d105-4e95-9669-8790b1c8bfac tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:23.025371 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aaf4df81-d105-4e95-9669-8790b1c8bfac tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:23.026150 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aaf4df81-d105-4e95-9669-8790b1c8bfac tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:23.026591 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aaf4df81-d105-4e95-9669-8790b1c8bfac tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:23.089221 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-aaf4df81-d105-4e95-9669-8790b1c8bfac tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:42:23.097496 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-aaf4df81-d105-4e95-9669-8790b1c8bfac tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e" status: 200 len: 1241 microversion: 2.1 time: 0.084436 Apr 16 21:42:23.098217 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3267/6381] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:42:23 2022] GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:42:23.367363 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-271548a1-c00d-459a-902e-2806f62926cf tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:42:23.368007 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-271548a1-c00d-459a-902e-2806f62926cf tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 97de4895-75ad-4f0f-bde9-0d3d2215d099] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:42:23.375457 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-271548a1-c00d-459a-902e-2806f62926cf tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:23.375903 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-271548a1-c00d-459a-902e-2806f62926cf tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:23.376717 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-271548a1-c00d-459a-902e-2806f62926cf tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:23.377161 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-271548a1-c00d-459a-902e-2806f62926cf tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:23.409435 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-271548a1-c00d-459a-902e-2806f62926cf tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:23.412361 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-271548a1-c00d-459a-902e-2806f62926cf tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:23.412361 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-271548a1-c00d-459a-902e-2806f62926cf tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lazy-loading 'fault' on Instance uuid 97de4895-75ad-4f0f-bde9-0d3d2215d099 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:42:23.453718 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-271548a1-c00d-459a-902e-2806f62926cf tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a36974ad8094dcd99951dbc1ce6049e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5279e09b8205420980e8c7accbcc5f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:42:23.461409 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-271548a1-c00d-459a-902e-2806f62926cf tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/97de4895-75ad-4f0f-bde9-0d3d2215d099" status: 200 len: 1338 microversion: 2.1 time: 0.099205 Apr 16 21:42:23.461979 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3115/6382] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:42:23 2022] GET /compute/v2.1/servers/97de4895-75ad-4f0f-bde9-0d3d2215d099 => generated 1338 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:42:24.115418 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-89f7610c-e18e-4825-baa8-7ff33d8fa8a1 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:42:24.116036 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-89f7610c-e18e-4825-baa8-7ff33d8fa8a1 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 9300724f-49f1-464c-8f56-76b4fb4a0d2e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:42:24.122934 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-89f7610c-e18e-4825-baa8-7ff33d8fa8a1 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:24.123427 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-89f7610c-e18e-4825-baa8-7ff33d8fa8a1 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:24.129798 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-89f7610c-e18e-4825-baa8-7ff33d8fa8a1 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:24.129798 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-89f7610c-e18e-4825-baa8-7ff33d8fa8a1 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:24.189710 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-89f7610c-e18e-4825-baa8-7ff33d8fa8a1 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:42:24.197049 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-89f7610c-e18e-4825-baa8-7ff33d8fa8a1 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e" status: 200 len: 1289 microversion: 2.1 time: 0.085570 Apr 16 21:42:24.197623 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3268/6383] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:42:24 2022] GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e => generated 1289 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:42:24.478770 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a00ddaae-3722-4a59-872f-3d1ba37432a4 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:42:24.479293 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a00ddaae-3722-4a59-872f-3d1ba37432a4 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 97de4895-75ad-4f0f-bde9-0d3d2215d099] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:42:24.486418 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a00ddaae-3722-4a59-872f-3d1ba37432a4 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:24.486872 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a00ddaae-3722-4a59-872f-3d1ba37432a4 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:24.487751 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a00ddaae-3722-4a59-872f-3d1ba37432a4 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:24.488215 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a00ddaae-3722-4a59-872f-3d1ba37432a4 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:24.501594 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-a00ddaae-3722-4a59-872f-3d1ba37432a4 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] HTTP exception thrown: Instance 97de4895-75ad-4f0f-bde9-0d3d2215d099 could not be found. Apr 16 21:42:24.502220 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a00ddaae-3722-4a59-872f-3d1ba37432a4 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Returning 404 to user: Instance 97de4895-75ad-4f0f-bde9-0d3d2215d099 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:42:24.503054 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a00ddaae-3722-4a59-872f-3d1ba37432a4 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/97de4895-75ad-4f0f-bde9-0d3d2215d099" status: 404 len: 111 microversion: 2.1 time: 0.028440 Apr 16 21:42:24.503571 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3116/6384] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:42:24 2022] GET /compute/v2.1/servers/97de4895-75ad-4f0f-bde9-0d3d2215d099 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:42:24.765060 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c578e34f-c9e5-4b94-b0f4-31bcf03bf232 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '.version_select at 0x7fbb9fe8a310>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:42:24.879598 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c578e34f-c9e5-4b94-b0f4-31bcf03bf232 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-920927973" status: 202 len: 0 microversion: 2.1 time: 0.119699 Apr 16 21:42:24.882396 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3269/6385] 10.222.0.20 () {58 vars in 1253 bytes} [Sat Apr 16 21:42:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-920927973 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:42:25.215131 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d9dd1402-dff9-49ec-a8a1-654ab19f0e0e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:42:25.215839 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d9dd1402-dff9-49ec-a8a1-654ab19f0e0e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 9300724f-49f1-464c-8f56-76b4fb4a0d2e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:42:25.223559 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d9dd1402-dff9-49ec-a8a1-654ab19f0e0e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:25.224108 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d9dd1402-dff9-49ec-a8a1-654ab19f0e0e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:25.224945 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d9dd1402-dff9-49ec-a8a1-654ab19f0e0e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:25.225396 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d9dd1402-dff9-49ec-a8a1-654ab19f0e0e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:25.471400 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d9dd1402-dff9-49ec-a8a1-654ab19f0e0e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:42:25.489922 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d9dd1402-dff9-49ec-a8a1-654ab19f0e0e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e" status: 200 len: 1362 microversion: 2.1 time: 0.278456 Apr 16 21:42:25.499893 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3117/6386] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:42:25 2022] GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e => generated 1362 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:42:26.257833 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-39ca992f-e5e2-4e73-b1be-af36be95625a req-ca471c27-cc18-4c19-bc3e-8150c1dd2568 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9300724f-49f1-464c-8f56-76b4fb4a0d2e", "tag": "ad860733-a04f-4d60-88e2-92bce10f1de8"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:42:26.270061 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-39ca992f-e5e2-4e73-b1be-af36be95625a req-ca471c27-cc18-4c19-bc3e-8150c1dd2568 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:26.270527 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-39ca992f-e5e2-4e73-b1be-af36be95625a req-ca471c27-cc18-4c19-bc3e-8150c1dd2568 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:26.282447 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-39ca992f-e5e2-4e73-b1be-af36be95625a req-ca471c27-cc18-4c19-bc3e-8150c1dd2568 service nova] Creating event network-changed:ad860733-a04f-4d60-88e2-92bce10f1de8 for instance 9300724f-49f1-464c-8f56-76b4fb4a0d2e on nch1-master-1 Apr 16 21:42:26.290332 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-39ca992f-e5e2-4e73-b1be-af36be95625a req-ca471c27-cc18-4c19-bc3e-8150c1dd2568 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035890 Apr 16 21:42:26.291554 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3270/6387] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:42:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:42:26.506894 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6a812589-71a5-46bc-9f58-b57aa74f3878 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:42:26.507612 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6a812589-71a5-46bc-9f58-b57aa74f3878 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 9300724f-49f1-464c-8f56-76b4fb4a0d2e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:42:26.515513 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6a812589-71a5-46bc-9f58-b57aa74f3878 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:26.516085 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6a812589-71a5-46bc-9f58-b57aa74f3878 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:26.516973 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6a812589-71a5-46bc-9f58-b57aa74f3878 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:26.517491 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6a812589-71a5-46bc-9f58-b57aa74f3878 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:26.700088 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6a812589-71a5-46bc-9f58-b57aa74f3878 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:42:26.709440 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6a812589-71a5-46bc-9f58-b57aa74f3878 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e" status: 200 len: 1362 microversion: 2.1 time: 0.206332 Apr 16 21:42:26.710327 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3118/6388] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:42:26 2022] GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e => generated 1362 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:42:27.331167 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8306bccc-a887-4262-b388-af1bdb56fd16 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:42:27.332023 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8306bccc-a887-4262-b388-af1bdb56fd16 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 57955d80-c264-4db1-8860-f2e5ac141ab7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:42:27.332267 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-691a6214-cb0a-4917-a85b-fb12ea5a4f89 req-e7daea03-794b-41e5-9ec5-5b595860e102 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57955d80-c264-4db1-8860-f2e5ac141ab7", "tag": "e80de17d-54c2-489c-a517-04dc0b10426e"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:42:27.340165 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8306bccc-a887-4262-b388-af1bdb56fd16 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:27.340772 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8306bccc-a887-4262-b388-af1bdb56fd16 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:27.341066 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-691a6214-cb0a-4917-a85b-fb12ea5a4f89 req-e7daea03-794b-41e5-9ec5-5b595860e102 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:27.341530 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-691a6214-cb0a-4917-a85b-fb12ea5a4f89 req-e7daea03-794b-41e5-9ec5-5b595860e102 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:27.341840 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8306bccc-a887-4262-b388-af1bdb56fd16 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:27.343000 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8306bccc-a887-4262-b388-af1bdb56fd16 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:27.361495 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-691a6214-cb0a-4917-a85b-fb12ea5a4f89 req-e7daea03-794b-41e5-9ec5-5b595860e102 service nova] Creating event network-changed:e80de17d-54c2-489c-a517-04dc0b10426e for instance 57955d80-c264-4db1-8860-f2e5ac141ab7 on nch2-master-1 Apr 16 21:42:27.366740 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-691a6214-cb0a-4917-a85b-fb12ea5a4f89 req-e7daea03-794b-41e5-9ec5-5b595860e102 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038470 Apr 16 21:42:27.367398 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3119/6389] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:42:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:42:27.379021 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8306bccc-a887-4262-b388-af1bdb56fd16 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 57955d80-c264-4db1-8860-f2e5ac141ab7] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:42:27.703434 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8306bccc-a887-4262-b388-af1bdb56fd16 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "DELETE /compute/v2.1/servers/57955d80-c264-4db1-8860-f2e5ac141ab7" status: 204 len: 0 microversion: 2.1 time: 0.377898 Apr 16 21:42:27.704215 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3271/6390] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:42:27 2022] DELETE /compute/v2.1/servers/57955d80-c264-4db1-8860-f2e5ac141ab7 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:42:27.713865 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e38c976e-1d8a-40a4-aa19-11adabe397c3 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:42:27.714587 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e38c976e-1d8a-40a4-aa19-11adabe397c3 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 57955d80-c264-4db1-8860-f2e5ac141ab7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:42:27.721383 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e38c976e-1d8a-40a4-aa19-11adabe397c3 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:27.722062 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e38c976e-1d8a-40a4-aa19-11adabe397c3 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:27.722998 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e38c976e-1d8a-40a4-aa19-11adabe397c3 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:27.723463 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e38c976e-1d8a-40a4-aa19-11adabe397c3 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:27.728032 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d03b0e5a-2980-47aa-9662-f94fcb3a0ed5 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:42:27.730155 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d03b0e5a-2980-47aa-9662-f94fcb3a0ed5 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 9300724f-49f1-464c-8f56-76b4fb4a0d2e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:42:27.736098 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d03b0e5a-2980-47aa-9662-f94fcb3a0ed5 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:27.736797 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d03b0e5a-2980-47aa-9662-f94fcb3a0ed5 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:27.737585 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d03b0e5a-2980-47aa-9662-f94fcb3a0ed5 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:27.738029 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d03b0e5a-2980-47aa-9662-f94fcb3a0ed5 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:27.877949 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d03b0e5a-2980-47aa-9662-f94fcb3a0ed5 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:42:27.880132 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e38c976e-1d8a-40a4-aa19-11adabe397c3 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a36974ad8094dcd99951dbc1ce6049e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5279e09b8205420980e8c7accbcc5f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:42:27.885582 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d03b0e5a-2980-47aa-9662-f94fcb3a0ed5 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e" status: 200 len: 1362 microversion: 2.1 time: 0.162153 Apr 16 21:42:27.886346 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3272/6391] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:42:27 2022] GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:42:27.895400 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e38c976e-1d8a-40a4-aa19-11adabe397c3 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/57955d80-c264-4db1-8860-f2e5ac141ab7" status: 200 len: 1670 microversion: 2.1 time: 0.179483 Apr 16 21:42:27.895400 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3120/6392] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:42:27 2022] GET /compute/v2.1/servers/57955d80-c264-4db1-8860-f2e5ac141ab7 => generated 1670 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:42:28.902930 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6ffefa2c-e40a-4098-a66e-b03a50a9dac9 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:42:28.903806 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6ffefa2c-e40a-4098-a66e-b03a50a9dac9 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 9300724f-49f1-464c-8f56-76b4fb4a0d2e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:42:28.908455 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-36c7d0a6-39b2-40d3-a60e-63bc814aab95 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:42:28.909075 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-36c7d0a6-39b2-40d3-a60e-63bc814aab95 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 57955d80-c264-4db1-8860-f2e5ac141ab7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:42:28.910773 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6ffefa2c-e40a-4098-a66e-b03a50a9dac9 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:28.911236 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6ffefa2c-e40a-4098-a66e-b03a50a9dac9 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:28.912023 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6ffefa2c-e40a-4098-a66e-b03a50a9dac9 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:28.912496 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6ffefa2c-e40a-4098-a66e-b03a50a9dac9 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:28.915145 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-36c7d0a6-39b2-40d3-a60e-63bc814aab95 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:28.915601 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-36c7d0a6-39b2-40d3-a60e-63bc814aab95 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:28.916411 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-36c7d0a6-39b2-40d3-a60e-63bc814aab95 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:28.916852 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-36c7d0a6-39b2-40d3-a60e-63bc814aab95 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:29.050626 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6ffefa2c-e40a-4098-a66e-b03a50a9dac9 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:42:29.058465 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6ffefa2c-e40a-4098-a66e-b03a50a9dac9 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e" status: 200 len: 1362 microversion: 2.1 time: 0.159437 Apr 16 21:42:29.058601 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-36c7d0a6-39b2-40d3-a60e-63bc814aab95 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a36974ad8094dcd99951dbc1ce6049e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5279e09b8205420980e8c7accbcc5f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:42:29.061621 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3121/6393] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:42:28 2022] GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:42:29.066578 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-36c7d0a6-39b2-40d3-a60e-63bc814aab95 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/57955d80-c264-4db1-8860-f2e5ac141ab7" status: 200 len: 1670 microversion: 2.1 time: 0.163033 Apr 16 21:42:29.067150 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3273/6394] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:42:28 2022] GET /compute/v2.1/servers/57955d80-c264-4db1-8860-f2e5ac141ab7 => generated 1670 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:42:29.811727 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-6eb08c69-d593-45c9-ab98-187c1215bba4 req-5824c8b4-b5e7-43d6-ba80-cb4df209b996 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57955d80-c264-4db1-8860-f2e5ac141ab7", "name": "network-vif-deleted", "tag": "e80de17d-54c2-489c-a517-04dc0b10426e"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:42:29.819804 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-6eb08c69-d593-45c9-ab98-187c1215bba4 req-5824c8b4-b5e7-43d6-ba80-cb4df209b996 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:29.820280 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-6eb08c69-d593-45c9-ab98-187c1215bba4 req-5824c8b4-b5e7-43d6-ba80-cb4df209b996 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:29.831723 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-6eb08c69-d593-45c9-ab98-187c1215bba4 req-5824c8b4-b5e7-43d6-ba80-cb4df209b996 service nova] Creating event network-vif-deleted:e80de17d-54c2-489c-a517-04dc0b10426e for instance 57955d80-c264-4db1-8860-f2e5ac141ab7 on nch2-master-1 Apr 16 21:42:29.836850 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-6eb08c69-d593-45c9-ab98-187c1215bba4 req-5824c8b4-b5e7-43d6-ba80-cb4df209b996 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029575 Apr 16 21:42:29.837430 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3122/6395] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:42:30.079575 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c65fdfba-a8a3-4ef2-8c53-3cf062a11820 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:42:30.080315 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c65fdfba-a8a3-4ef2-8c53-3cf062a11820 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 9300724f-49f1-464c-8f56-76b4fb4a0d2e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:42:30.085755 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b5d998d9-ed4f-4518-9c83-9787064895b4 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:42:30.087266 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b5d998d9-ed4f-4518-9c83-9787064895b4 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 57955d80-c264-4db1-8860-f2e5ac141ab7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:42:30.088812 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c65fdfba-a8a3-4ef2-8c53-3cf062a11820 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:30.090920 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c65fdfba-a8a3-4ef2-8c53-3cf062a11820 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:30.092632 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c65fdfba-a8a3-4ef2-8c53-3cf062a11820 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:30.093259 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c65fdfba-a8a3-4ef2-8c53-3cf062a11820 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:30.095126 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b5d998d9-ed4f-4518-9c83-9787064895b4 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:30.095691 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b5d998d9-ed4f-4518-9c83-9787064895b4 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:30.097116 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b5d998d9-ed4f-4518-9c83-9787064895b4 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:30.097843 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b5d998d9-ed4f-4518-9c83-9787064895b4 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:30.168048 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b5d998d9-ed4f-4518-9c83-9787064895b4 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:30.169702 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b5d998d9-ed4f-4518-9c83-9787064895b4 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:30.171636 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-b5d998d9-ed4f-4518-9c83-9787064895b4 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lazy-loading 'fault' on Instance uuid 57955d80-c264-4db1-8860-f2e5ac141ab7 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:42:30.224976 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b5d998d9-ed4f-4518-9c83-9787064895b4 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a36974ad8094dcd99951dbc1ce6049e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5279e09b8205420980e8c7accbcc5f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:42:30.249553 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b5d998d9-ed4f-4518-9c83-9787064895b4 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/57955d80-c264-4db1-8860-f2e5ac141ab7" status: 200 len: 1338 microversion: 2.1 time: 0.168723 Apr 16 21:42:30.251031 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3123/6396] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:42:30 2022] GET /compute/v2.1/servers/57955d80-c264-4db1-8860-f2e5ac141ab7 => generated 1338 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:42:30.316228 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c65fdfba-a8a3-4ef2-8c53-3cf062a11820 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:42:30.323623 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c65fdfba-a8a3-4ef2-8c53-3cf062a11820 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e" status: 200 len: 1362 microversion: 2.1 time: 0.250283 Apr 16 21:42:30.329026 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3274/6397] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:42:30 2022] GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e => generated 1362 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:42:31.273203 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-aab8187e-f131-4ea4-9b08-8fbce33fd60f tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:42:31.273864 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-aab8187e-f131-4ea4-9b08-8fbce33fd60f tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 57955d80-c264-4db1-8860-f2e5ac141ab7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:42:31.281379 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aab8187e-f131-4ea4-9b08-8fbce33fd60f tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:31.281844 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aab8187e-f131-4ea4-9b08-8fbce33fd60f tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:31.282627 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aab8187e-f131-4ea4-9b08-8fbce33fd60f tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:31.283077 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aab8187e-f131-4ea4-9b08-8fbce33fd60f tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:31.296238 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-aab8187e-f131-4ea4-9b08-8fbce33fd60f tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] HTTP exception thrown: Instance 57955d80-c264-4db1-8860-f2e5ac141ab7 could not be found. Apr 16 21:42:31.296840 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-aab8187e-f131-4ea4-9b08-8fbce33fd60f tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Returning 404 to user: Instance 57955d80-c264-4db1-8860-f2e5ac141ab7 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:42:31.297667 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-aab8187e-f131-4ea4-9b08-8fbce33fd60f tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/57955d80-c264-4db1-8860-f2e5ac141ab7" status: 404 len: 111 microversion: 2.1 time: 0.028521 Apr 16 21:42:31.298200 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3124/6398] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:42:31 2022] GET /compute/v2.1/servers/57955d80-c264-4db1-8860-f2e5ac141ab7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:42:31.341863 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c3535f1f-4af1-4550-92a5-e8420dacee59 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:42:31.343769 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c3535f1f-4af1-4550-92a5-e8420dacee59 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 9300724f-49f1-464c-8f56-76b4fb4a0d2e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:42:31.350903 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3535f1f-4af1-4550-92a5-e8420dacee59 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:31.351455 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3535f1f-4af1-4550-92a5-e8420dacee59 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:31.352374 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3535f1f-4af1-4550-92a5-e8420dacee59 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:31.352894 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3535f1f-4af1-4550-92a5-e8420dacee59 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:31.813767 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-cd078e64-39cb-4a05-97d2-d2a5e7c52d2d req-fad5b7aa-c619-4be4-acef-f1e5fc87b2f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9300724f-49f1-464c-8f56-76b4fb4a0d2e", "name": "network-vif-plugged", "status": "completed", "tag": "ad860733-a04f-4d60-88e2-92bce10f1de8"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:42:31.825752 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-cd078e64-39cb-4a05-97d2-d2a5e7c52d2d req-fad5b7aa-c619-4be4-acef-f1e5fc87b2f9 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:31.825752 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-cd078e64-39cb-4a05-97d2-d2a5e7c52d2d req-fad5b7aa-c619-4be4-acef-f1e5fc87b2f9 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:31.835149 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-cd078e64-39cb-4a05-97d2-d2a5e7c52d2d req-fad5b7aa-c619-4be4-acef-f1e5fc87b2f9 service nova] Creating event network-vif-plugged:ad860733-a04f-4d60-88e2-92bce10f1de8 for instance 9300724f-49f1-464c-8f56-76b4fb4a0d2e on nch1-master-1 Apr 16 21:42:31.836649 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c3535f1f-4af1-4550-92a5-e8420dacee59 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:42:31.840770 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-cd078e64-39cb-4a05-97d2-d2a5e7c52d2d req-fad5b7aa-c619-4be4-acef-f1e5fc87b2f9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031737 Apr 16 21:42:31.841342 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3125/6399] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:42:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:42:31.845510 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c3535f1f-4af1-4550-92a5-e8420dacee59 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e" status: 200 len: 1362 microversion: 2.1 time: 0.507495 Apr 16 21:42:31.846122 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3275/6400] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:42:31 2022] GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e => generated 1362 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:42:31.965407 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f8156514-186c-4a1b-84f2-75f2e839e150 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '.version_select at 0x7fbb965f0c10>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:42:32.087202 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f8156514-186c-4a1b-84f2-75f2e839e150 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-735648333" status: 202 len: 0 microversion: 2.1 time: 0.124158 Apr 16 21:42:32.087202 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3126/6401] 10.222.0.20 () {58 vars in 1253 bytes} [Sat Apr 16 21:42:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-735648333 => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:42:32.863757 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-23951a82-b276-4cd2-9612-7d47c5b8ddb9 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:42:32.864410 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-23951a82-b276-4cd2-9612-7d47c5b8ddb9 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 9300724f-49f1-464c-8f56-76b4fb4a0d2e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:42:32.871261 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-23951a82-b276-4cd2-9612-7d47c5b8ddb9 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:32.872131 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-23951a82-b276-4cd2-9612-7d47c5b8ddb9 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:32.872949 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-23951a82-b276-4cd2-9612-7d47c5b8ddb9 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:32.873931 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-23951a82-b276-4cd2-9612-7d47c5b8ddb9 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:33.066662 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-23951a82-b276-4cd2-9612-7d47c5b8ddb9 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:42:33.075292 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-23951a82-b276-4cd2-9612-7d47c5b8ddb9 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e" status: 200 len: 1362 microversion: 2.1 time: 0.216541 Apr 16 21:42:33.075869 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3276/6402] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:42:32 2022] GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e => generated 1362 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:42:34.098829 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ae942770-01b0-4ffa-897d-effb6463adc2 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:42:34.100438 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ae942770-01b0-4ffa-897d-effb6463adc2 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 9300724f-49f1-464c-8f56-76b4fb4a0d2e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:42:34.109799 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ae942770-01b0-4ffa-897d-effb6463adc2 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:34.110714 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ae942770-01b0-4ffa-897d-effb6463adc2 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:34.111917 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ae942770-01b0-4ffa-897d-effb6463adc2 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:34.112554 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ae942770-01b0-4ffa-897d-effb6463adc2 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:34.359173 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ae942770-01b0-4ffa-897d-effb6463adc2 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:42:34.370661 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ae942770-01b0-4ffa-897d-effb6463adc2 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e" status: 200 len: 1548 microversion: 2.1 time: 0.280045 Apr 16 21:42:34.372046 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3127/6403] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:42:34 2022] GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e => generated 1548 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:42:34.388450 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8e7f2cf2-3845-417f-9025-ec60c2c26349 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:42:34.389630 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8e7f2cf2-3845-417f-9025-ec60c2c26349 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 9300724f-49f1-464c-8f56-76b4fb4a0d2e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:42:34.396600 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8e7f2cf2-3845-417f-9025-ec60c2c26349 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:34.397408 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8e7f2cf2-3845-417f-9025-ec60c2c26349 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:34.398308 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8e7f2cf2-3845-417f-9025-ec60c2c26349 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:34.398840 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8e7f2cf2-3845-417f-9025-ec60c2c26349 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:34.503046 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8e7f2cf2-3845-417f-9025-ec60c2c26349 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.117796 Apr 16 21:42:34.505775 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3277/6404] 10.222.0.20 () {58 vars in 1274 bytes} [Sat Apr 16 21:42:34 2022] GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e/os-interface => generated 285 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:42:35.003686 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fa521069-2909-4b5d-8542-fbe68b7292ed tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:42:35.004597 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-fa521069-2909-4b5d-8542-fbe68b7292ed tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:42:35.005261 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-4ad7979b-659c-4ea7-8d04-f6e6a64716e2 req-a631f0fa-c806-4657-93c0-fa7563a777c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7537290d-836b-431c-bfb7-c8f83dd03024", "tag": "73138183-36f0-4a32-833a-7b6e3fa38956"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:42:35.015297 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fa521069-2909-4b5d-8542-fbe68b7292ed tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:35.016059 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fa521069-2909-4b5d-8542-fbe68b7292ed tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:35.017928 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fa521069-2909-4b5d-8542-fbe68b7292ed tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:35.019010 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fa521069-2909-4b5d-8542-fbe68b7292ed tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:35.021409 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-4ad7979b-659c-4ea7-8d04-f6e6a64716e2 req-a631f0fa-c806-4657-93c0-fa7563a777c1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:35.021874 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-4ad7979b-659c-4ea7-8d04-f6e6a64716e2 req-a631f0fa-c806-4657-93c0-fa7563a777c1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:35.047744 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-4ad7979b-659c-4ea7-8d04-f6e6a64716e2 req-a631f0fa-c806-4657-93c0-fa7563a777c1 service nova] Creating event network-changed:73138183-36f0-4a32-833a-7b6e3fa38956 for instance 7537290d-836b-431c-bfb7-c8f83dd03024 on nch2-master-1 Apr 16 21:42:35.058072 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-4ad7979b-659c-4ea7-8d04-f6e6a64716e2 req-a631f0fa-c806-4657-93c0-fa7563a777c1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059649 Apr 16 21:42:35.061204 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3278/6405] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:42:35.061335 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-fa521069-2909-4b5d-8542-fbe68b7292ed tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:42:35.403804 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fa521069-2909-4b5d-8542-fbe68b7292ed tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024" status: 204 len: 0 microversion: 2.1 time: 0.408424 Apr 16 21:42:35.406153 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3128/6406] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:42:34 2022] DELETE /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:42:35.415779 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ae25a87d-cc68-4bd7-8f26-5fb01e5c8726 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:42:35.416570 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ae25a87d-cc68-4bd7-8f26-5fb01e5c8726 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:42:35.424191 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ae25a87d-cc68-4bd7-8f26-5fb01e5c8726 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:35.424903 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ae25a87d-cc68-4bd7-8f26-5fb01e5c8726 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:35.425904 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ae25a87d-cc68-4bd7-8f26-5fb01e5c8726 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:35.426515 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ae25a87d-cc68-4bd7-8f26-5fb01e5c8726 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:35.983241 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ae25a87d-cc68-4bd7-8f26-5fb01e5c8726 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:42:35.991424 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ae25a87d-cc68-4bd7-8f26-5fb01e5c8726 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024" status: 200 len: 1688 microversion: 2.1 time: 0.580649 Apr 16 21:42:35.991994 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3279/6407] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:42:35 2022] GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024 => generated 1688 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:42:36.880733 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-0c3824b1-ff2d-4e00-85da-cf91117802cb req-eb2e1948-5325-4519-8449-9cb7bf3e2f98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9300724f-49f1-464c-8f56-76b4fb4a0d2e", "tag": "ad860733-a04f-4d60-88e2-92bce10f1de8"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:42:36.895777 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-0c3824b1-ff2d-4e00-85da-cf91117802cb req-eb2e1948-5325-4519-8449-9cb7bf3e2f98 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:36.896255 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-0c3824b1-ff2d-4e00-85da-cf91117802cb req-eb2e1948-5325-4519-8449-9cb7bf3e2f98 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:36.906791 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-0c3824b1-ff2d-4e00-85da-cf91117802cb req-eb2e1948-5325-4519-8449-9cb7bf3e2f98 service nova] Creating event network-changed:ad860733-a04f-4d60-88e2-92bce10f1de8 for instance 9300724f-49f1-464c-8f56-76b4fb4a0d2e on nch1-master-1 Apr 16 21:42:36.911771 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-0c3824b1-ff2d-4e00-85da-cf91117802cb req-eb2e1948-5325-4519-8449-9cb7bf3e2f98 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036823 Apr 16 21:42:36.912573 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3129/6408] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:42:37.011014 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7f19e736-0f95-4253-8b05-30adc7b2d561 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:42:37.012508 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7f19e736-0f95-4253-8b05-30adc7b2d561 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:42:37.023736 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7f19e736-0f95-4253-8b05-30adc7b2d561 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:37.023736 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7f19e736-0f95-4253-8b05-30adc7b2d561 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:37.023736 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7f19e736-0f95-4253-8b05-30adc7b2d561 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:37.023736 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7f19e736-0f95-4253-8b05-30adc7b2d561 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:37.563171 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7f19e736-0f95-4253-8b05-30adc7b2d561 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:42:37.583902 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7f19e736-0f95-4253-8b05-30adc7b2d561 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024" status: 200 len: 1688 microversion: 2.1 time: 0.577283 Apr 16 21:42:37.589407 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3280/6409] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:42:37 2022] GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024 => generated 1688 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:42:38.015816 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-27c51ca7-9a69-48b8-ae70-36f7e38d2e4a req-963fad56-efd1-4950-b8ef-b8ddbbf57e98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7537290d-836b-431c-bfb7-c8f83dd03024", "name": "network-vif-deleted", "tag": "73138183-36f0-4a32-833a-7b6e3fa38956"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:42:38.025318 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-27c51ca7-9a69-48b8-ae70-36f7e38d2e4a req-963fad56-efd1-4950-b8ef-b8ddbbf57e98 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:38.025773 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-27c51ca7-9a69-48b8-ae70-36f7e38d2e4a req-963fad56-efd1-4950-b8ef-b8ddbbf57e98 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:38.037715 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-27c51ca7-9a69-48b8-ae70-36f7e38d2e4a req-963fad56-efd1-4950-b8ef-b8ddbbf57e98 service nova] Creating event network-vif-deleted:73138183-36f0-4a32-833a-7b6e3fa38956 for instance 7537290d-836b-431c-bfb7-c8f83dd03024 on nch2-master-1 Apr 16 21:42:38.042612 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-27c51ca7-9a69-48b8-ae70-36f7e38d2e4a req-963fad56-efd1-4950-b8ef-b8ddbbf57e98 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030866 Apr 16 21:42:38.043212 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3130/6410] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:42:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:42:38.602883 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d3935345-c594-4f6f-b4f1-bc6d63701292 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:42:38.603506 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d3935345-c594-4f6f-b4f1-bc6d63701292 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:42:38.610392 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d3935345-c594-4f6f-b4f1-bc6d63701292 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:38.613652 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d3935345-c594-4f6f-b4f1-bc6d63701292 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:38.613652 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d3935345-c594-4f6f-b4f1-bc6d63701292 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:38.613652 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d3935345-c594-4f6f-b4f1-bc6d63701292 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:38.643766 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d3935345-c594-4f6f-b4f1-bc6d63701292 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:38.644254 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d3935345-c594-4f6f-b4f1-bc6d63701292 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:38.644747 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-d3935345-c594-4f6f-b4f1-bc6d63701292 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lazy-loading 'fault' on Instance uuid 7537290d-836b-431c-bfb7-c8f83dd03024 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:42:38.697509 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d3935345-c594-4f6f-b4f1-bc6d63701292 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f27a0cf693a247bb87a8c12193fee719', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee2ef9a941a429b82a89f7c8f71d45b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:42:38.706116 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d3935345-c594-4f6f-b4f1-bc6d63701292 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024" status: 200 len: 1357 microversion: 2.1 time: 0.107041 Apr 16 21:42:38.712108 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3281/6411] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:42:38 2022] GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024 => generated 1357 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:42:39.725169 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ec9770ff-0bc8-466b-b54f-5051b46024c4 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:42:39.734238 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ec9770ff-0bc8-466b-b54f-5051b46024c4 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] [instance: 7537290d-836b-431c-bfb7-c8f83dd03024] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:42:39.734238 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ec9770ff-0bc8-466b-b54f-5051b46024c4 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:39.734238 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ec9770ff-0bc8-466b-b54f-5051b46024c4 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:39.734694 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ec9770ff-0bc8-466b-b54f-5051b46024c4 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:39.735016 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ec9770ff-0bc8-466b-b54f-5051b46024c4 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:39.748515 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-ec9770ff-0bc8-466b-b54f-5051b46024c4 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] HTTP exception thrown: Instance 7537290d-836b-431c-bfb7-c8f83dd03024 could not be found. Apr 16 21:42:39.749112 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ec9770ff-0bc8-466b-b54f-5051b46024c4 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Returning 404 to user: Instance 7537290d-836b-431c-bfb7-c8f83dd03024 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:42:39.750387 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ec9770ff-0bc8-466b-b54f-5051b46024c4 tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024" status: 404 len: 111 microversion: 2.1 time: 0.030680 Apr 16 21:42:39.750938 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3131/6412] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:42:39 2022] GET /compute/v2.1/servers/7537290d-836b-431c-bfb7-c8f83dd03024 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:42:44.873535 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ebe04c7a-f8a0-49bb-a130-e84e507effea tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] Calling method '.version_select at 0x7fbb955d6d30>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:42:44.986966 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ebe04c7a-f8a0-49bb-a130-e84e507effea tempest-TestNetworkAdvancedServerOps-844126952 tempest-TestNetworkAdvancedServerOps-844126952-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1255096748" status: 202 len: 0 microversion: 2.1 time: 0.118229 Apr 16 21:42:44.987720 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3282/6413] 10.222.0.20 () {58 vars in 1283 bytes} [Sat Apr 16 21:42:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1255096748 => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:42:46.048564 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-aca84c41-3cf3-444b-bcfd-113ffa676fd1 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Action: 'create', calling method: .version_select at 0x7fbb96c56550>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-211976224"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:42:46.080628 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-aca84c41-3cf3-444b-bcfd-113ffa676fd1 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Getting quotas for project 5279e09b8205420980e8c7accbcc5f93. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:42:46.087888 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-aca84c41-3cf3-444b-bcfd-113ffa676fd1 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Getting quotas for user 1a36974ad8094dcd99951dbc1ce6049e and project 5279e09b8205420980e8c7accbcc5f93. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:42:46.316589 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-aca84c41-3cf3-444b-bcfd-113ffa676fd1 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Getting quotas for project 5279e09b8205420980e8c7accbcc5f93. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:42:46.324676 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-aca84c41-3cf3-444b-bcfd-113ffa676fd1 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Getting quotas for user 1a36974ad8094dcd99951dbc1ce6049e and project 5279e09b8205420980e8c7accbcc5f93. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:42:46.344312 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-aca84c41-3cf3-444b-bcfd-113ffa676fd1 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.300260 Apr 16 21:42:46.346641 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3132/6414] 10.222.0.20 () {60 vars in 1157 bytes} [Sat Apr 16 21:42:46 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:42:49.336577 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-693d844e-fd55-4bf9-b15a-c0e77d231998 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1759085041", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "e4195a25-b1a8-4a56-8295-36338d15756e"}], "key_name": "tempest-TestNetworkBasicOps-211976224", "security_groups": [{"name": "tempest-secgroup-smoke-1235302146"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:42:49.442247 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-693d844e-fd55-4bf9-b15a-c0e77d231998 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] validate_networks() for [('e4195a25-b1a8-4a56-8295-36338d15756e', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:42:50.118319 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c96a25c7-e542-405d-8c8a-7718d83b55f9 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Action: 'create', calling method: .version_select at 0x7fbb96274c10>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-941866712"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:42:50.133505 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-c96a25c7-e542-405d-8c8a-7718d83b55f9 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Getting quotas for project b9d0d3b45797487d88c64d6ae767cc18. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:42:50.138756 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-c96a25c7-e542-405d-8c8a-7718d83b55f9 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Getting quotas for user 9213dce366cd4351a55e8e82b4c2f7b6 and project b9d0d3b45797487d88c64d6ae767cc18. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:42:50.156786 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-693d844e-fd55-4bf9-b15a-c0e77d231998 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:42:50.157308 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-693d844e-fd55-4bf9-b15a-c0e77d231998 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:42:50.157924 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-693d844e-fd55-4bf9-b15a-c0e77d231998 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:42:50.162091 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-693d844e-fd55-4bf9-b15a-c0e77d231998 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:42:50.162091 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-693d844e-fd55-4bf9-b15a-c0e77d231998 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:42:50.167634 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-693d844e-fd55-4bf9-b15a-c0e77d231998 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:50.168089 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-693d844e-fd55-4bf9-b15a-c0e77d231998 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:50.169523 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-693d844e-fd55-4bf9-b15a-c0e77d231998 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:50.169979 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-693d844e-fd55-4bf9-b15a-c0e77d231998 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:50.187595 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-693d844e-fd55-4bf9-b15a-c0e77d231998 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Getting quotas for project 5279e09b8205420980e8c7accbcc5f93. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:42:50.192897 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-693d844e-fd55-4bf9-b15a-c0e77d231998 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Getting quotas for user 1a36974ad8094dcd99951dbc1ce6049e and project 5279e09b8205420980e8c7accbcc5f93. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:42:50.205092 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-693d844e-fd55-4bf9-b15a-c0e77d231998 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:42:50.207320 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-693d844e-fd55-4bf9-b15a-c0e77d231998 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:42:50.331864 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-693d844e-fd55-4bf9-b15a-c0e77d231998 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.000077 Apr 16 21:42:50.332883 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3283/6415] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:42:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 1002 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:42:50.346068 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8ab1f6dd-155f-4e81-9cc9-2bae0ceb4005 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:42:50.346068 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8ab1f6dd-155f-4e81-9cc9-2bae0ceb4005 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:42:50.401616 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8ab1f6dd-155f-4e81-9cc9-2bae0ceb4005 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a36974ad8094dcd99951dbc1ce6049e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5279e09b8205420980e8c7accbcc5f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:42:50.409277 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8ab1f6dd-155f-4e81-9cc9-2bae0ceb4005 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f" status: 200 len: 1248 microversion: 2.1 time: 0.070560 Apr 16 21:42:50.412056 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3284/6416] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:42:50 2022] GET /compute/v2.1/servers/6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f => generated 1248 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:42:50.573504 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-c96a25c7-e542-405d-8c8a-7718d83b55f9 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Getting quotas for project b9d0d3b45797487d88c64d6ae767cc18. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:42:50.578575 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-c96a25c7-e542-405d-8c8a-7718d83b55f9 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Getting quotas for user 9213dce366cd4351a55e8e82b4c2f7b6 and project b9d0d3b45797487d88c64d6ae767cc18. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:42:50.594292 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c96a25c7-e542-405d-8c8a-7718d83b55f9 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.650582 Apr 16 21:42:50.594890 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3133/6417] 10.222.0.20 () {60 vars in 1157 bytes} [Sat Apr 16 21:42:49 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:42:51.426409 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0ba5b711-b3d6-4f0e-b247-2662026d3c61 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:42:51.427033 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0ba5b711-b3d6-4f0e-b247-2662026d3c61 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:42:51.434012 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0ba5b711-b3d6-4f0e-b247-2662026d3c61 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:51.434601 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0ba5b711-b3d6-4f0e-b247-2662026d3c61 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:51.435900 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0ba5b711-b3d6-4f0e-b247-2662026d3c61 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:51.436384 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0ba5b711-b3d6-4f0e-b247-2662026d3c61 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:51.507001 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0ba5b711-b3d6-4f0e-b247-2662026d3c61 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a36974ad8094dcd99951dbc1ce6049e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5279e09b8205420980e8c7accbcc5f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:42:51.515750 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0ba5b711-b3d6-4f0e-b247-2662026d3c61 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f" status: 200 len: 1252 microversion: 2.1 time: 0.093246 Apr 16 21:42:51.516396 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3285/6418] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:42:51 2022] GET /compute/v2.1/servers/6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f => generated 1252 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:42:52.532794 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7a055e74-0d5e-4abf-a3c9-aa16daa45d36 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:42:52.534937 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7a055e74-0d5e-4abf-a3c9-aa16daa45d36 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:42:52.542375 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7a055e74-0d5e-4abf-a3c9-aa16daa45d36 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:52.542835 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7a055e74-0d5e-4abf-a3c9-aa16daa45d36 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:52.543623 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7a055e74-0d5e-4abf-a3c9-aa16daa45d36 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:52.544067 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7a055e74-0d5e-4abf-a3c9-aa16daa45d36 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:52.773581 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7a055e74-0d5e-4abf-a3c9-aa16daa45d36 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a36974ad8094dcd99951dbc1ce6049e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5279e09b8205420980e8c7accbcc5f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:42:52.781541 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7a055e74-0d5e-4abf-a3c9-aa16daa45d36 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f" status: 200 len: 1308 microversion: 2.1 time: 0.253067 Apr 16 21:42:52.782321 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3134/6419] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:42:52 2022] GET /compute/v2.1/servers/6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f => generated 1308 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:42:53.799564 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fc9252c2-f883-4304-9765-a017ff00e9e0 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:42:53.800285 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fc9252c2-f883-4304-9765-a017ff00e9e0 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:42:53.807755 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fc9252c2-f883-4304-9765-a017ff00e9e0 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:53.808282 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fc9252c2-f883-4304-9765-a017ff00e9e0 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:53.809079 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fc9252c2-f883-4304-9765-a017ff00e9e0 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:53.810131 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fc9252c2-f883-4304-9765-a017ff00e9e0 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:53.871475 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fc9252c2-f883-4304-9765-a017ff00e9e0 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a36974ad8094dcd99951dbc1ce6049e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5279e09b8205420980e8c7accbcc5f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:42:53.879251 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fc9252c2-f883-4304-9765-a017ff00e9e0 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f" status: 200 len: 1306 microversion: 2.1 time: 0.083624 Apr 16 21:42:53.885600 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3286/6420] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:42:53 2022] GET /compute/v2.1/servers/6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f => generated 1306 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:42:54.896740 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2e2cfac7-b608-4055-b49d-30aa03d64792 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:42:54.905020 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2e2cfac7-b608-4055-b49d-30aa03d64792 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:42:54.912547 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2e2cfac7-b608-4055-b49d-30aa03d64792 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:54.913239 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2e2cfac7-b608-4055-b49d-30aa03d64792 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:54.914406 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2e2cfac7-b608-4055-b49d-30aa03d64792 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:54.915210 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2e2cfac7-b608-4055-b49d-30aa03d64792 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:55.157109 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2e2cfac7-b608-4055-b49d-30aa03d64792 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a36974ad8094dcd99951dbc1ce6049e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5279e09b8205420980e8c7accbcc5f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:42:55.166970 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2e2cfac7-b608-4055-b49d-30aa03d64792 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f" status: 200 len: 1374 microversion: 2.1 time: 0.274341 Apr 16 21:42:55.168786 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3135/6421] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:42:54 2022] GET /compute/v2.1/servers/6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f => generated 1374 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:42:55.374197 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-a69f0ddb-69b5-4acd-9cc7-a4f3ec3dba95 req-18515ff8-8ae9-476a-8fb9-ad127878b474 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f", "tag": "a87314d7-f7ef-4a87-97c5-dd497a66d084"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:42:55.384707 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-a69f0ddb-69b5-4acd-9cc7-a4f3ec3dba95 req-18515ff8-8ae9-476a-8fb9-ad127878b474 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:55.385403 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-a69f0ddb-69b5-4acd-9cc7-a4f3ec3dba95 req-18515ff8-8ae9-476a-8fb9-ad127878b474 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:55.407084 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-a69f0ddb-69b5-4acd-9cc7-a4f3ec3dba95 req-18515ff8-8ae9-476a-8fb9-ad127878b474 service nova] Creating event network-changed:a87314d7-f7ef-4a87-97c5-dd497a66d084 for instance 6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f on nch2-master-1 Apr 16 21:42:55.411251 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-a69f0ddb-69b5-4acd-9cc7-a4f3ec3dba95 req-18515ff8-8ae9-476a-8fb9-ad127878b474 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041461 Apr 16 21:42:55.411939 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3287/6422] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:42:56.185015 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-de4c26ab-1e0a-4afb-ab42-4ab26038ea0f tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:42:56.185762 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-de4c26ab-1e0a-4afb-ab42-4ab26038ea0f tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:42:56.193462 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-de4c26ab-1e0a-4afb-ab42-4ab26038ea0f tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:56.194027 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-de4c26ab-1e0a-4afb-ab42-4ab26038ea0f tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:56.195055 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-de4c26ab-1e0a-4afb-ab42-4ab26038ea0f tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:56.195501 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-de4c26ab-1e0a-4afb-ab42-4ab26038ea0f tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:56.978830 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-de4c26ab-1e0a-4afb-ab42-4ab26038ea0f tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a36974ad8094dcd99951dbc1ce6049e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5279e09b8205420980e8c7accbcc5f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:42:56.992147 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-de4c26ab-1e0a-4afb-ab42-4ab26038ea0f tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f" status: 200 len: 1374 microversion: 2.1 time: 0.811449 Apr 16 21:42:56.992959 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3136/6423] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:42:56 2022] GET /compute/v2.1/servers/6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f => generated 1374 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:42:58.011137 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b9e45b39-6b3d-41f2-b466-540b3bf26f2c tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:42:58.013188 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b9e45b39-6b3d-41f2-b466-540b3bf26f2c tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:42:58.020791 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b9e45b39-6b3d-41f2-b466-540b3bf26f2c tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:58.021257 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b9e45b39-6b3d-41f2-b466-540b3bf26f2c tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:58.022274 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b9e45b39-6b3d-41f2-b466-540b3bf26f2c tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:58.022810 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b9e45b39-6b3d-41f2-b466-540b3bf26f2c tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:58.204133 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b9e45b39-6b3d-41f2-b466-540b3bf26f2c tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a36974ad8094dcd99951dbc1ce6049e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5279e09b8205420980e8c7accbcc5f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:42:58.212113 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b9e45b39-6b3d-41f2-b466-540b3bf26f2c tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f" status: 200 len: 1374 microversion: 2.1 time: 0.205587 Apr 16 21:42:58.212737 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3288/6424] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:42:58 2022] GET /compute/v2.1/servers/6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f => generated 1374 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:42:59.231731 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3e6540ff-ab0e-45f4-8da1-2573429c6848 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:42:59.232396 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3e6540ff-ab0e-45f4-8da1-2573429c6848 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:42:59.239409 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e6540ff-ab0e-45f4-8da1-2573429c6848 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:59.241162 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e6540ff-ab0e-45f4-8da1-2573429c6848 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:59.242197 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e6540ff-ab0e-45f4-8da1-2573429c6848 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:42:59.242658 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3e6540ff-ab0e-45f4-8da1-2573429c6848 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:42:59.388254 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3e6540ff-ab0e-45f4-8da1-2573429c6848 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a36974ad8094dcd99951dbc1ce6049e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5279e09b8205420980e8c7accbcc5f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:42:59.395865 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3e6540ff-ab0e-45f4-8da1-2573429c6848 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f" status: 200 len: 1374 microversion: 2.1 time: 0.170396 Apr 16 21:42:59.396716 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3137/6425] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:42:59 2022] GET /compute/v2.1/servers/6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f => generated 1374 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:43:00.148988 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-693674f5-b4b2-452f-ac0a-603d2e9e6ed6 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-599744156-access_point-1839571604", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "d454821f-512f-4611-b8de-f13798dcc3be"}], "key_name": "tempest-TestSecurityGroupsBasicOps-941866712", "security_groups": [{"name": "tempest-secgroup_access--1301151330"}, {"name": "tempest-secgroup_general--1910818018"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:43:00.320838 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-693674f5-b4b2-452f-ac0a-603d2e9e6ed6 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] validate_networks() for [('d454821f-512f-4611-b8de-f13798dcc3be', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:43:00.413837 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8f8e7918-8dd1-4759-9246-a33479ae4b28 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:43:00.414469 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8f8e7918-8dd1-4759-9246-a33479ae4b28 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:43:00.423221 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8f8e7918-8dd1-4759-9246-a33479ae4b28 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:00.423700 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8f8e7918-8dd1-4759-9246-a33479ae4b28 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:00.424732 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8f8e7918-8dd1-4759-9246-a33479ae4b28 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:00.425383 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8f8e7918-8dd1-4759-9246-a33479ae4b28 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:00.641656 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8f8e7918-8dd1-4759-9246-a33479ae4b28 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a36974ad8094dcd99951dbc1ce6049e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5279e09b8205420980e8c7accbcc5f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:43:00.650224 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8f8e7918-8dd1-4759-9246-a33479ae4b28 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f" status: 200 len: 1374 microversion: 2.1 time: 0.240220 Apr 16 21:43:00.651409 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3138/6426] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:43:00 2022] GET /compute/v2.1/servers/6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f => generated 1374 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:43:00.811696 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-693674f5-b4b2-452f-ac0a-603d2e9e6ed6 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:43:00.812143 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-693674f5-b4b2-452f-ac0a-603d2e9e6ed6 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:43:00.812790 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-693674f5-b4b2-452f-ac0a-603d2e9e6ed6 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:43:00.813219 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-693674f5-b4b2-452f-ac0a-603d2e9e6ed6 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:43:00.813730 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-693674f5-b4b2-452f-ac0a-603d2e9e6ed6 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:43:00.823117 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-693674f5-b4b2-452f-ac0a-603d2e9e6ed6 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:00.823799 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-693674f5-b4b2-452f-ac0a-603d2e9e6ed6 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:00.830185 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-693674f5-b4b2-452f-ac0a-603d2e9e6ed6 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:00.830185 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-693674f5-b4b2-452f-ac0a-603d2e9e6ed6 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:00.844587 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-693674f5-b4b2-452f-ac0a-603d2e9e6ed6 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Getting quotas for project b9d0d3b45797487d88c64d6ae767cc18. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:43:00.850416 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-693674f5-b4b2-452f-ac0a-603d2e9e6ed6 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Getting quotas for user 9213dce366cd4351a55e8e82b4c2f7b6 and project b9d0d3b45797487d88c64d6ae767cc18. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:43:00.867046 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-693674f5-b4b2-452f-ac0a-603d2e9e6ed6 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:43:00.869156 ncdv-master-1 devstack@n-api.service[137408]: WARNING nova.utils [None req-693674f5-b4b2-452f-ac0a-603d2e9e6ed6 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-599744156-access_point-1839571604 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-599744156-acc Apr 16 21:43:00.869900 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-693674f5-b4b2-452f-ac0a-603d2e9e6ed6 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] [instance: 45de93d5-b2bb-423f-9aec-48c79b81e6fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:43:01.014476 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-693674f5-b4b2-452f-ac0a-603d2e9e6ed6 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 458 microversion: 2.1 time: 0.869880 Apr 16 21:43:01.015319 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3289/6427] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:43:00 2022] POST /compute/v2.1/servers => generated 458 bytes in 871 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:43:01.027940 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e2b56c9b-d810-4f47-8732-f309f190762d tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:43:01.028704 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e2b56c9b-d810-4f47-8732-f309f190762d tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] [instance: 45de93d5-b2bb-423f-9aec-48c79b81e6fd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:43:01.087994 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e2b56c9b-d810-4f47-8732-f309f190762d tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9213dce366cd4351a55e8e82b4c2f7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d0d3b45797487d88c64d6ae767cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:43:01.095052 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e2b56c9b-d810-4f47-8732-f309f190762d tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] 10.222.0.20 "GET /compute/v2.1/servers/45de93d5-b2bb-423f-9aec-48c79b81e6fd" status: 200 len: 1293 microversion: 2.1 time: 0.071341 Apr 16 21:43:01.096571 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3139/6428] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:43:01 2022] GET /compute/v2.1/servers/45de93d5-b2bb-423f-9aec-48c79b81e6fd => generated 1293 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:43:01.670654 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ec97972f-a181-4ca5-a52b-23560698c8fe tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:43:01.671381 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ec97972f-a181-4ca5-a52b-23560698c8fe tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:43:01.690234 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ec97972f-a181-4ca5-a52b-23560698c8fe tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:01.690764 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ec97972f-a181-4ca5-a52b-23560698c8fe tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:01.691629 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ec97972f-a181-4ca5-a52b-23560698c8fe tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:01.692086 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ec97972f-a181-4ca5-a52b-23560698c8fe tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:01.834117 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ec97972f-a181-4ca5-a52b-23560698c8fe tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a36974ad8094dcd99951dbc1ce6049e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5279e09b8205420980e8c7accbcc5f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:43:01.842411 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ec97972f-a181-4ca5-a52b-23560698c8fe tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f" status: 200 len: 1374 microversion: 2.1 time: 0.177953 Apr 16 21:43:01.843082 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3290/6429] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:43:01 2022] GET /compute/v2.1/servers/6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f => generated 1374 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:43:02.112423 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4d462b17-1aa9-4c59-a6c0-03504ff00b11 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:43:02.113183 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4d462b17-1aa9-4c59-a6c0-03504ff00b11 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] [instance: 45de93d5-b2bb-423f-9aec-48c79b81e6fd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:43:02.171565 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4d462b17-1aa9-4c59-a6c0-03504ff00b11 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9213dce366cd4351a55e8e82b4c2f7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d0d3b45797487d88c64d6ae767cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:43:02.178601 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4d462b17-1aa9-4c59-a6c0-03504ff00b11 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] 10.222.0.20 "GET /compute/v2.1/servers/45de93d5-b2bb-423f-9aec-48c79b81e6fd" status: 200 len: 1293 microversion: 2.1 time: 0.070143 Apr 16 21:43:02.179178 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3140/6430] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:43:02 2022] GET /compute/v2.1/servers/45de93d5-b2bb-423f-9aec-48c79b81e6fd => generated 1293 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:43:02.859800 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fe8f16f5-d62e-4475-9bb7-e3f53f63be8a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:43:02.860370 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fe8f16f5-d62e-4475-9bb7-e3f53f63be8a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:43:02.867500 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fe8f16f5-d62e-4475-9bb7-e3f53f63be8a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:02.867959 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fe8f16f5-d62e-4475-9bb7-e3f53f63be8a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:02.868763 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fe8f16f5-d62e-4475-9bb7-e3f53f63be8a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:02.869229 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fe8f16f5-d62e-4475-9bb7-e3f53f63be8a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:03.009618 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fe8f16f5-d62e-4475-9bb7-e3f53f63be8a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a36974ad8094dcd99951dbc1ce6049e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5279e09b8205420980e8c7accbcc5f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:43:03.017591 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fe8f16f5-d62e-4475-9bb7-e3f53f63be8a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f" status: 200 len: 1374 microversion: 2.1 time: 0.162432 Apr 16 21:43:03.018329 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3291/6431] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:43:02 2022] GET /compute/v2.1/servers/6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:43:03.196952 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8aad40b5-a669-4327-937b-3f785b5892f9 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:43:03.197690 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8aad40b5-a669-4327-937b-3f785b5892f9 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] [instance: 45de93d5-b2bb-423f-9aec-48c79b81e6fd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:43:03.205802 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8aad40b5-a669-4327-937b-3f785b5892f9 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:03.206360 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8aad40b5-a669-4327-937b-3f785b5892f9 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:03.207268 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8aad40b5-a669-4327-937b-3f785b5892f9 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:03.207791 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8aad40b5-a669-4327-937b-3f785b5892f9 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:03.225638 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-940de055-ef63-477f-8170-fb7f685e93b4 req-e51b3184-9c47-4ce4-a453-b9cf57651960 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f", "name": "network-vif-plugged", "status": "completed", "tag": "a87314d7-f7ef-4a87-97c5-dd497a66d084"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:43:03.234550 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-940de055-ef63-477f-8170-fb7f685e93b4 req-e51b3184-9c47-4ce4-a453-b9cf57651960 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:03.235012 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-940de055-ef63-477f-8170-fb7f685e93b4 req-e51b3184-9c47-4ce4-a453-b9cf57651960 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:03.248633 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-940de055-ef63-477f-8170-fb7f685e93b4 req-e51b3184-9c47-4ce4-a453-b9cf57651960 service nova] Creating event network-vif-plugged:a87314d7-f7ef-4a87-97c5-dd497a66d084 for instance 6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f on nch2-master-1 Apr 16 21:43:03.253861 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-940de055-ef63-477f-8170-fb7f685e93b4 req-e51b3184-9c47-4ce4-a453-b9cf57651960 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034960 Apr 16 21:43:03.254515 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3292/6432] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:43:03.298681 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8aad40b5-a669-4327-937b-3f785b5892f9 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9213dce366cd4351a55e8e82b4c2f7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d0d3b45797487d88c64d6ae767cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:43:03.306516 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8aad40b5-a669-4327-937b-3f785b5892f9 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] 10.222.0.20 "GET /compute/v2.1/servers/45de93d5-b2bb-423f-9aec-48c79b81e6fd" status: 200 len: 1345 microversion: 2.1 time: 0.113594 Apr 16 21:43:03.308767 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3141/6433] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:43:03 2022] GET /compute/v2.1/servers/45de93d5-b2bb-423f-9aec-48c79b81e6fd => generated 1345 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:43:04.036350 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2289e3ef-cfdc-4319-9e3a-7f5b3ac77072 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:43:04.036978 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2289e3ef-cfdc-4319-9e3a-7f5b3ac77072 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:43:04.045813 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2289e3ef-cfdc-4319-9e3a-7f5b3ac77072 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:04.046328 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2289e3ef-cfdc-4319-9e3a-7f5b3ac77072 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:04.047126 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2289e3ef-cfdc-4319-9e3a-7f5b3ac77072 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:04.047585 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2289e3ef-cfdc-4319-9e3a-7f5b3ac77072 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:04.260272 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2289e3ef-cfdc-4319-9e3a-7f5b3ac77072 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a36974ad8094dcd99951dbc1ce6049e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5279e09b8205420980e8c7accbcc5f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:43:04.268660 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2289e3ef-cfdc-4319-9e3a-7f5b3ac77072 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f" status: 200 len: 1374 microversion: 2.1 time: 0.237390 Apr 16 21:43:04.269452 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3293/6434] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:43:04 2022] GET /compute/v2.1/servers/6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f => generated 1374 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:43:04.324189 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7c0f1a6f-cd08-4a1e-bddf-15a16ea739d4 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:43:04.325542 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7c0f1a6f-cd08-4a1e-bddf-15a16ea739d4 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] [instance: 45de93d5-b2bb-423f-9aec-48c79b81e6fd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:43:04.332486 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7c0f1a6f-cd08-4a1e-bddf-15a16ea739d4 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:04.332951 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7c0f1a6f-cd08-4a1e-bddf-15a16ea739d4 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:04.333807 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7c0f1a6f-cd08-4a1e-bddf-15a16ea739d4 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:04.334180 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7c0f1a6f-cd08-4a1e-bddf-15a16ea739d4 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:04.396847 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7c0f1a6f-cd08-4a1e-bddf-15a16ea739d4 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9213dce366cd4351a55e8e82b4c2f7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d0d3b45797487d88c64d6ae767cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:43:04.404305 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7c0f1a6f-cd08-4a1e-bddf-15a16ea739d4 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] 10.222.0.20 "GET /compute/v2.1/servers/45de93d5-b2bb-423f-9aec-48c79b81e6fd" status: 200 len: 1351 microversion: 2.1 time: 0.084106 Apr 16 21:43:04.404882 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3142/6435] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:43:04 2022] GET /compute/v2.1/servers/45de93d5-b2bb-423f-9aec-48c79b81e6fd => generated 1351 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:43:05.286987 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-dd043105-5847-4e67-9335-3f00ced9a820 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:43:05.288550 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-dd043105-5847-4e67-9335-3f00ced9a820 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:43:05.298046 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dd043105-5847-4e67-9335-3f00ced9a820 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:05.298521 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dd043105-5847-4e67-9335-3f00ced9a820 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:05.299579 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dd043105-5847-4e67-9335-3f00ced9a820 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:05.300624 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dd043105-5847-4e67-9335-3f00ced9a820 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:05.422527 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e9b3aa29-d430-43b7-8a24-c2a35240f058 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:43:05.423722 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e9b3aa29-d430-43b7-8a24-c2a35240f058 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] [instance: 45de93d5-b2bb-423f-9aec-48c79b81e6fd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:43:05.431069 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e9b3aa29-d430-43b7-8a24-c2a35240f058 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:05.431541 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e9b3aa29-d430-43b7-8a24-c2a35240f058 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:05.432385 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e9b3aa29-d430-43b7-8a24-c2a35240f058 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:05.432841 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e9b3aa29-d430-43b7-8a24-c2a35240f058 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:05.442402 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-dd043105-5847-4e67-9335-3f00ced9a820 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a36974ad8094dcd99951dbc1ce6049e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5279e09b8205420980e8c7accbcc5f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:43:05.450427 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-dd043105-5847-4e67-9335-3f00ced9a820 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f" status: 200 len: 1546 microversion: 2.1 time: 0.168511 Apr 16 21:43:05.450998 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3294/6436] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:43:05 2022] GET /compute/v2.1/servers/6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f => generated 1546 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:43:05.467373 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-06b56946-0e8e-4489-80ff-02aab836bed9 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:43:05.468225 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-06b56946-0e8e-4489-80ff-02aab836bed9 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:43:05.474460 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-06b56946-0e8e-4489-80ff-02aab836bed9 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:05.474917 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-06b56946-0e8e-4489-80ff-02aab836bed9 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:05.475885 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-06b56946-0e8e-4489-80ff-02aab836bed9 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:05.476711 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-06b56946-0e8e-4489-80ff-02aab836bed9 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:05.590890 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e9b3aa29-d430-43b7-8a24-c2a35240f058 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9213dce366cd4351a55e8e82b4c2f7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d0d3b45797487d88c64d6ae767cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:43:05.604045 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e9b3aa29-d430-43b7-8a24-c2a35240f058 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] 10.222.0.20 "GET /compute/v2.1/servers/45de93d5-b2bb-423f-9aec-48c79b81e6fd" status: 200 len: 1471 microversion: 2.1 time: 0.186260 Apr 16 21:43:05.605115 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3143/6437] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:43:05 2022] GET /compute/v2.1/servers/45de93d5-b2bb-423f-9aec-48c79b81e6fd => generated 1471 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:43:05.609498 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-3f36082d-92ef-4cfc-96f3-ec1a8418b5bf req-3d7f7f9c-d976-499d-b3e3-9addc69ea575 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45de93d5-b2bb-423f-9aec-48c79b81e6fd", "tag": "c4d5001d-e0c4-4dba-9703-42704badf73f"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:43:05.624444 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-3f36082d-92ef-4cfc-96f3-ec1a8418b5bf req-3d7f7f9c-d976-499d-b3e3-9addc69ea575 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:05.625291 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-3f36082d-92ef-4cfc-96f3-ec1a8418b5bf req-3d7f7f9c-d976-499d-b3e3-9addc69ea575 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:05.647763 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-3f36082d-92ef-4cfc-96f3-ec1a8418b5bf req-3d7f7f9c-d976-499d-b3e3-9addc69ea575 service nova] Creating event network-changed:c4d5001d-e0c4-4dba-9703-42704badf73f for instance 45de93d5-b2bb-423f-9aec-48c79b81e6fd on nch2-master-1 Apr 16 21:43:05.654477 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-3f36082d-92ef-4cfc-96f3-ec1a8418b5bf req-3d7f7f9c-d976-499d-b3e3-9addc69ea575 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048171 Apr 16 21:43:05.655227 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3144/6438] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:43:05.721133 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-06b56946-0e8e-4489-80ff-02aab836bed9 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a36974ad8094dcd99951dbc1ce6049e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5279e09b8205420980e8c7accbcc5f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:43:05.730061 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-06b56946-0e8e-4489-80ff-02aab836bed9 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f" status: 200 len: 1546 microversion: 2.1 time: 0.267341 Apr 16 21:43:05.730873 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3295/6439] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:43:05 2022] GET /compute/v2.1/servers/6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f => generated 1546 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:43:06.623424 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a1724496-a016-44d4-bf7a-4d2d547c5227 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:43:06.624227 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a1724496-a016-44d4-bf7a-4d2d547c5227 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] [instance: 45de93d5-b2bb-423f-9aec-48c79b81e6fd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:43:06.630912 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a1724496-a016-44d4-bf7a-4d2d547c5227 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:06.634765 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a1724496-a016-44d4-bf7a-4d2d547c5227 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:06.634765 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a1724496-a016-44d4-bf7a-4d2d547c5227 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:06.634765 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a1724496-a016-44d4-bf7a-4d2d547c5227 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:06.974916 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a1724496-a016-44d4-bf7a-4d2d547c5227 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9213dce366cd4351a55e8e82b4c2f7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d0d3b45797487d88c64d6ae767cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:43:06.982489 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a1724496-a016-44d4-bf7a-4d2d547c5227 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] 10.222.0.20 "GET /compute/v2.1/servers/45de93d5-b2bb-423f-9aec-48c79b81e6fd" status: 200 len: 1471 microversion: 2.1 time: 0.364829 Apr 16 21:43:06.983069 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3145/6440] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:43:06 2022] GET /compute/v2.1/servers/45de93d5-b2bb-423f-9aec-48c79b81e6fd => generated 1471 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:43:08.001494 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6a49ddfd-0a71-4c6f-9966-af95a64b0a67 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:43:08.002151 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6a49ddfd-0a71-4c6f-9966-af95a64b0a67 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] [instance: 45de93d5-b2bb-423f-9aec-48c79b81e6fd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:43:08.009186 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6a49ddfd-0a71-4c6f-9966-af95a64b0a67 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:08.009728 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6a49ddfd-0a71-4c6f-9966-af95a64b0a67 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:08.010583 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6a49ddfd-0a71-4c6f-9966-af95a64b0a67 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:08.011104 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6a49ddfd-0a71-4c6f-9966-af95a64b0a67 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:08.198491 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6a49ddfd-0a71-4c6f-9966-af95a64b0a67 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9213dce366cd4351a55e8e82b4c2f7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d0d3b45797487d88c64d6ae767cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:43:08.198491 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6a49ddfd-0a71-4c6f-9966-af95a64b0a67 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] 10.222.0.20 "GET /compute/v2.1/servers/45de93d5-b2bb-423f-9aec-48c79b81e6fd" status: 200 len: 1471 microversion: 2.1 time: 0.200165 Apr 16 21:43:08.198491 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3296/6441] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:43:07 2022] GET /compute/v2.1/servers/45de93d5-b2bb-423f-9aec-48c79b81e6fd => generated 1471 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:43:08.280034 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-b6687b52-83f4-46c1-9ea5-1d31ac72b7d0 req-37d5e983-064a-4918-b1b2-debb05edbc1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f", "tag": "a87314d7-f7ef-4a87-97c5-dd497a66d084"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:43:08.301114 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-b6687b52-83f4-46c1-9ea5-1d31ac72b7d0 req-37d5e983-064a-4918-b1b2-debb05edbc1f service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:08.301887 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-b6687b52-83f4-46c1-9ea5-1d31ac72b7d0 req-37d5e983-064a-4918-b1b2-debb05edbc1f service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:08.326769 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-b6687b52-83f4-46c1-9ea5-1d31ac72b7d0 req-37d5e983-064a-4918-b1b2-debb05edbc1f service nova] Creating event network-changed:a87314d7-f7ef-4a87-97c5-dd497a66d084 for instance 6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f on nch2-master-1 Apr 16 21:43:08.338455 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-b6687b52-83f4-46c1-9ea5-1d31ac72b7d0 req-37d5e983-064a-4918-b1b2-debb05edbc1f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063215 Apr 16 21:43:08.339400 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3146/6442] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:43:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:43:09.213143 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a7f95fe3-742a-4871-8f93-dd395766b93a tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:43:09.225075 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a7f95fe3-742a-4871-8f93-dd395766b93a tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] [instance: 45de93d5-b2bb-423f-9aec-48c79b81e6fd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:43:09.225075 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a7f95fe3-742a-4871-8f93-dd395766b93a tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:09.225075 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a7f95fe3-742a-4871-8f93-dd395766b93a tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:09.225413 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a7f95fe3-742a-4871-8f93-dd395766b93a tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:09.225945 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a7f95fe3-742a-4871-8f93-dd395766b93a tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:09.454425 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a7f95fe3-742a-4871-8f93-dd395766b93a tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9213dce366cd4351a55e8e82b4c2f7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d0d3b45797487d88c64d6ae767cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:43:09.463536 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a7f95fe3-742a-4871-8f93-dd395766b93a tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] 10.222.0.20 "GET /compute/v2.1/servers/45de93d5-b2bb-423f-9aec-48c79b81e6fd" status: 200 len: 1471 microversion: 2.1 time: 0.254244 Apr 16 21:43:09.464275 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3297/6443] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:43:09 2022] GET /compute/v2.1/servers/45de93d5-b2bb-423f-9aec-48c79b81e6fd => generated 1471 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:43:10.271601 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-966e8f32-69f9-4de7-b277-6773779c5397 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:43:10.277859 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-dd718ac0-18ae-402a-a027-89b44b3ed6f6 req-54d6e60f-9976-4ccc-978a-40b7b1823672 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f83afebe-c606-461f-9138-67707e788014", "tag": "65c3354a-8ecb-43ae-a281-e7a13cc9dd80"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:43:10.288444 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-966e8f32-69f9-4de7-b277-6773779c5397 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] [instance: f83afebe-c606-461f-9138-67707e788014] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:43:10.290717 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-dd718ac0-18ae-402a-a027-89b44b3ed6f6 req-54d6e60f-9976-4ccc-978a-40b7b1823672 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:10.291553 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-dd718ac0-18ae-402a-a027-89b44b3ed6f6 req-54d6e60f-9976-4ccc-978a-40b7b1823672 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:10.301464 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-966e8f32-69f9-4de7-b277-6773779c5397 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:10.302321 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-966e8f32-69f9-4de7-b277-6773779c5397 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:10.303122 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-966e8f32-69f9-4de7-b277-6773779c5397 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:10.303666 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-dd718ac0-18ae-402a-a027-89b44b3ed6f6 req-54d6e60f-9976-4ccc-978a-40b7b1823672 service nova] Creating event network-changed:65c3354a-8ecb-43ae-a281-e7a13cc9dd80 for instance f83afebe-c606-461f-9138-67707e788014 on nch1-master-1 Apr 16 21:43:10.309059 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-966e8f32-69f9-4de7-b277-6773779c5397 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:10.309695 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-dd718ac0-18ae-402a-a027-89b44b3ed6f6 req-54d6e60f-9976-4ccc-978a-40b7b1823672 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036305 Apr 16 21:43:10.310494 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3298/6444] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:43:10.334827 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6c09f50f-abc2-448e-85c7-cafa7bb1f223 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:43:10.335748 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6c09f50f-abc2-448e-85c7-cafa7bb1f223 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 9300724f-49f1-464c-8f56-76b4fb4a0d2e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:43:10.344925 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6c09f50f-abc2-448e-85c7-cafa7bb1f223 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:10.346433 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6c09f50f-abc2-448e-85c7-cafa7bb1f223 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:10.347402 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6c09f50f-abc2-448e-85c7-cafa7bb1f223 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:10.348337 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6c09f50f-abc2-448e-85c7-cafa7bb1f223 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:10.351750 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-966e8f32-69f9-4de7-b277-6773779c5397 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] [instance: f83afebe-c606-461f-9138-67707e788014] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:43:10.375442 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6c09f50f-abc2-448e-85c7-cafa7bb1f223 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e/ips" status: 200 len: 145 microversion: 2.1 time: 0.045321 Apr 16 21:43:10.376046 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3299/6445] 10.222.0.20 () {58 vars in 1247 bytes} [Sat Apr 16 21:43:10 2022] GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e/ips => generated 145 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:43:10.482099 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a6e889a5-db7d-496c-ba6e-171e9d8cb10f tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:43:10.483025 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a6e889a5-db7d-496c-ba6e-171e9d8cb10f tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] [instance: 45de93d5-b2bb-423f-9aec-48c79b81e6fd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:43:10.490011 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a6e889a5-db7d-496c-ba6e-171e9d8cb10f tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:10.490654 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a6e889a5-db7d-496c-ba6e-171e9d8cb10f tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:10.491761 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a6e889a5-db7d-496c-ba6e-171e9d8cb10f tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:10.492431 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a6e889a5-db7d-496c-ba6e-171e9d8cb10f tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:10.742995 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-966e8f32-69f9-4de7-b277-6773779c5397 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] 10.222.0.20 "DELETE /compute/v2.1/servers/f83afebe-c606-461f-9138-67707e788014" status: 204 len: 0 microversion: 2.1 time: 0.475602 Apr 16 21:43:10.753143 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3147/6446] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:43:10 2022] DELETE /compute/v2.1/servers/f83afebe-c606-461f-9138-67707e788014 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:43:10.759384 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-add94465-8ab2-4fb1-a7e7-78c97e0ce70c tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:43:10.760147 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-add94465-8ab2-4fb1-a7e7-78c97e0ce70c tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] [instance: f83afebe-c606-461f-9138-67707e788014] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:43:10.763571 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a6e889a5-db7d-496c-ba6e-171e9d8cb10f tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9213dce366cd4351a55e8e82b4c2f7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d0d3b45797487d88c64d6ae767cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:43:10.773900 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-add94465-8ab2-4fb1-a7e7-78c97e0ce70c tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:10.776298 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-add94465-8ab2-4fb1-a7e7-78c97e0ce70c tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:10.777946 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-add94465-8ab2-4fb1-a7e7-78c97e0ce70c tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:10.778227 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a6e889a5-db7d-496c-ba6e-171e9d8cb10f tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] 10.222.0.20 "GET /compute/v2.1/servers/45de93d5-b2bb-423f-9aec-48c79b81e6fd" status: 200 len: 1471 microversion: 2.1 time: 0.299425 Apr 16 21:43:10.778403 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-add94465-8ab2-4fb1-a7e7-78c97e0ce70c tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:10.781341 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3300/6447] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:43:10 2022] GET /compute/v2.1/servers/45de93d5-b2bb-423f-9aec-48c79b81e6fd => generated 1471 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:43:10.928317 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-add94465-8ab2-4fb1-a7e7-78c97e0ce70c tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bbf82f2ac64a4c9e3b86975f8173b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80715ea8284b48959a67d33e8be6b560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:43:10.936307 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-add94465-8ab2-4fb1-a7e7-78c97e0ce70c tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] 10.222.0.20 "GET /compute/v2.1/servers/f83afebe-c606-461f-9138-67707e788014" status: 200 len: 1584 microversion: 2.1 time: 0.181352 Apr 16 21:43:10.937125 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3148/6448] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:43:10 2022] GET /compute/v2.1/servers/f83afebe-c606-461f-9138-67707e788014 => generated 1584 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:43:11.325296 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-e5a9ec47-8c5a-4837-9aca-270a10617483 req-be96dc8e-6405-489e-b98c-295015f791e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45de93d5-b2bb-423f-9aec-48c79b81e6fd", "name": "network-vif-plugged", "status": "completed", "tag": "c4d5001d-e0c4-4dba-9703-42704badf73f"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:43:11.336920 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-e5a9ec47-8c5a-4837-9aca-270a10617483 req-be96dc8e-6405-489e-b98c-295015f791e7 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:11.336920 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-e5a9ec47-8c5a-4837-9aca-270a10617483 req-be96dc8e-6405-489e-b98c-295015f791e7 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:11.348258 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-e5a9ec47-8c5a-4837-9aca-270a10617483 req-be96dc8e-6405-489e-b98c-295015f791e7 service nova] Creating event network-vif-plugged:c4d5001d-e0c4-4dba-9703-42704badf73f for instance 45de93d5-b2bb-423f-9aec-48c79b81e6fd on nch2-master-1 Apr 16 21:43:11.353275 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-e5a9ec47-8c5a-4837-9aca-270a10617483 req-be96dc8e-6405-489e-b98c-295015f791e7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032815 Apr 16 21:43:11.358439 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3301/6449] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:43:11.797226 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7f3e80be-574c-48cc-839d-f58618ffa320 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:43:11.797980 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7f3e80be-574c-48cc-839d-f58618ffa320 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] [instance: 45de93d5-b2bb-423f-9aec-48c79b81e6fd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:43:11.804692 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7f3e80be-574c-48cc-839d-f58618ffa320 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:11.805129 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7f3e80be-574c-48cc-839d-f58618ffa320 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:11.805916 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7f3e80be-574c-48cc-839d-f58618ffa320 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:11.806367 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7f3e80be-574c-48cc-839d-f58618ffa320 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:11.955585 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4268770f-3f5d-4315-bd08-2650bbbbcc12 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:43:11.956528 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4268770f-3f5d-4315-bd08-2650bbbbcc12 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] [instance: f83afebe-c606-461f-9138-67707e788014] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:43:11.962718 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4268770f-3f5d-4315-bd08-2650bbbbcc12 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:11.963171 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4268770f-3f5d-4315-bd08-2650bbbbcc12 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:11.963950 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4268770f-3f5d-4315-bd08-2650bbbbcc12 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:11.964912 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4268770f-3f5d-4315-bd08-2650bbbbcc12 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:12.033697 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7f3e80be-574c-48cc-839d-f58618ffa320 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9213dce366cd4351a55e8e82b4c2f7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d0d3b45797487d88c64d6ae767cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:43:12.053725 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7f3e80be-574c-48cc-839d-f58618ffa320 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] 10.222.0.20 "GET /compute/v2.1/servers/45de93d5-b2bb-423f-9aec-48c79b81e6fd" status: 200 len: 1471 microversion: 2.1 time: 0.261015 Apr 16 21:43:12.054328 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3149/6450] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:43:11 2022] GET /compute/v2.1/servers/45de93d5-b2bb-423f-9aec-48c79b81e6fd => generated 1471 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:43:12.099669 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4268770f-3f5d-4315-bd08-2650bbbbcc12 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bbf82f2ac64a4c9e3b86975f8173b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80715ea8284b48959a67d33e8be6b560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:43:12.108077 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4268770f-3f5d-4315-bd08-2650bbbbcc12 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] 10.222.0.20 "GET /compute/v2.1/servers/f83afebe-c606-461f-9138-67707e788014" status: 200 len: 1584 microversion: 2.1 time: 0.156817 Apr 16 21:43:12.108844 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3302/6451] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:43:11 2022] GET /compute/v2.1/servers/f83afebe-c606-461f-9138-67707e788014 => generated 1584 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:43:13.071550 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e330f47f-b6ae-4439-ba11-abc675e42b98 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:43:13.073071 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e330f47f-b6ae-4439-ba11-abc675e42b98 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] [instance: 45de93d5-b2bb-423f-9aec-48c79b81e6fd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:43:13.080306 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e330f47f-b6ae-4439-ba11-abc675e42b98 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:13.081016 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e330f47f-b6ae-4439-ba11-abc675e42b98 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:13.082185 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e330f47f-b6ae-4439-ba11-abc675e42b98 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:13.082637 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e330f47f-b6ae-4439-ba11-abc675e42b98 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:13.127134 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5b017cb7-a18b-4a55-b1f0-7a17b7d3e7bc tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:43:13.127134 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5b017cb7-a18b-4a55-b1f0-7a17b7d3e7bc tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] [instance: f83afebe-c606-461f-9138-67707e788014] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:43:13.133940 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5b017cb7-a18b-4a55-b1f0-7a17b7d3e7bc tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:13.134408 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5b017cb7-a18b-4a55-b1f0-7a17b7d3e7bc tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:13.135312 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5b017cb7-a18b-4a55-b1f0-7a17b7d3e7bc tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:13.135968 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5b017cb7-a18b-4a55-b1f0-7a17b7d3e7bc tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:13.284042 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5b017cb7-a18b-4a55-b1f0-7a17b7d3e7bc tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bbf82f2ac64a4c9e3b86975f8173b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80715ea8284b48959a67d33e8be6b560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:43:13.287635 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e330f47f-b6ae-4439-ba11-abc675e42b98 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9213dce366cd4351a55e8e82b4c2f7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d0d3b45797487d88c64d6ae767cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:43:13.296751 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e330f47f-b6ae-4439-ba11-abc675e42b98 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] 10.222.0.20 "GET /compute/v2.1/servers/45de93d5-b2bb-423f-9aec-48c79b81e6fd" status: 200 len: 1643 microversion: 2.1 time: 0.229657 Apr 16 21:43:13.298197 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3150/6452] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:43:13 2022] GET /compute/v2.1/servers/45de93d5-b2bb-423f-9aec-48c79b81e6fd => generated 1643 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:43:13.304348 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2c7adacd-dded-432e-90b6-cb89fbb41216 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ff535870-3c90-4727-bb5b-abf029d4dc9e"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:43:13.305591 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2c7adacd-dded-432e-90b6-cb89fbb41216 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 9300724f-49f1-464c-8f56-76b4fb4a0d2e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:43:13.315541 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2c7adacd-dded-432e-90b6-cb89fbb41216 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:13.316242 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2c7adacd-dded-432e-90b6-cb89fbb41216 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:13.317364 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2c7adacd-dded-432e-90b6-cb89fbb41216 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:13.318120 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2c7adacd-dded-432e-90b6-cb89fbb41216 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:13.320752 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5b017cb7-a18b-4a55-b1f0-7a17b7d3e7bc tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] 10.222.0.20 "GET /compute/v2.1/servers/f83afebe-c606-461f-9138-67707e788014" status: 200 len: 1465 microversion: 2.1 time: 0.198063 Apr 16 21:43:13.328336 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3303/6453] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:43:13 2022] GET /compute/v2.1/servers/f83afebe-c606-461f-9138-67707e788014 => generated 1465 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:43:13.334311 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d5893ac1-8e30-4bd3-acd8-da64716735de tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:43:13.338166 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d5893ac1-8e30-4bd3-acd8-da64716735de tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] [instance: 45de93d5-b2bb-423f-9aec-48c79b81e6fd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:43:13.342972 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d5893ac1-8e30-4bd3-acd8-da64716735de tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:13.343521 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d5893ac1-8e30-4bd3-acd8-da64716735de tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:13.344452 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d5893ac1-8e30-4bd3-acd8-da64716735de tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:13.344975 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d5893ac1-8e30-4bd3-acd8-da64716735de tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:13.518216 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d5893ac1-8e30-4bd3-acd8-da64716735de tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9213dce366cd4351a55e8e82b4c2f7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d0d3b45797487d88c64d6ae767cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:43:13.526180 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d5893ac1-8e30-4bd3-acd8-da64716735de tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] 10.222.0.20 "GET /compute/v2.1/servers/45de93d5-b2bb-423f-9aec-48c79b81e6fd" status: 200 len: 1643 microversion: 2.1 time: 0.196589 Apr 16 21:43:13.526800 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3304/6454] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:43:13 2022] GET /compute/v2.1/servers/45de93d5-b2bb-423f-9aec-48c79b81e6fd => generated 1643 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:43:13.532965 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-68bdd983-bc0e-4a9d-89d6-6e7928d75254 req-bc1e10ab-fc62-4db4-a64e-2485b2179bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f83afebe-c606-461f-9138-67707e788014", "name": "network-vif-deleted", "tag": "65c3354a-8ecb-43ae-a281-e7a13cc9dd80"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:43:13.541694 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-68bdd983-bc0e-4a9d-89d6-6e7928d75254 req-bc1e10ab-fc62-4db4-a64e-2485b2179bd1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:13.542152 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-68bdd983-bc0e-4a9d-89d6-6e7928d75254 req-bc1e10ab-fc62-4db4-a64e-2485b2179bd1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:13.554068 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-68bdd983-bc0e-4a9d-89d6-6e7928d75254 req-bc1e10ab-fc62-4db4-a64e-2485b2179bd1 service nova] Creating event network-vif-deleted:65c3354a-8ecb-43ae-a281-e7a13cc9dd80 for instance f83afebe-c606-461f-9138-67707e788014 on nch1-master-1 Apr 16 21:43:13.559528 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-68bdd983-bc0e-4a9d-89d6-6e7928d75254 req-bc1e10ab-fc62-4db4-a64e-2485b2179bd1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031579 Apr 16 21:43:13.560427 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3305/6455] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:43:13.565592 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a660b866-609a-47e7-8675-a24e598474a2 tempest-TestSecurityGroupsBasicOps-1778137446 tempest-TestSecurityGroupsBasicOps-1778137446-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:43:13.566477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a660b866-609a-47e7-8675-a24e598474a2 tempest-TestSecurityGroupsBasicOps-1778137446 tempest-TestSecurityGroupsBasicOps-1778137446-project-admin] [instance: 45de93d5-b2bb-423f-9aec-48c79b81e6fd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:43:13.578066 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a660b866-609a-47e7-8675-a24e598474a2 tempest-TestSecurityGroupsBasicOps-1778137446 tempest-TestSecurityGroupsBasicOps-1778137446-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:13.578066 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a660b866-609a-47e7-8675-a24e598474a2 tempest-TestSecurityGroupsBasicOps-1778137446 tempest-TestSecurityGroupsBasicOps-1778137446-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:13.578066 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a660b866-609a-47e7-8675-a24e598474a2 tempest-TestSecurityGroupsBasicOps-1778137446 tempest-TestSecurityGroupsBasicOps-1778137446-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:13.578066 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a660b866-609a-47e7-8675-a24e598474a2 tempest-TestSecurityGroupsBasicOps-1778137446 tempest-TestSecurityGroupsBasicOps-1778137446-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:13.923079 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a660b866-609a-47e7-8675-a24e598474a2 tempest-TestSecurityGroupsBasicOps-1778137446 tempest-TestSecurityGroupsBasicOps-1778137446-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/45de93d5-b2bb-423f-9aec-48c79b81e6fd" status: 200 len: 1794 microversion: 2.1 time: 0.361242 Apr 16 21:43:13.923647 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3306/6456] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:43:13 2022] GET /compute/v2.1/servers/45de93d5-b2bb-423f-9aec-48c79b81e6fd => generated 1794 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:43:14.260165 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2c7adacd-dded-432e-90b6-cb89fbb41216 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "POST /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.960334 Apr 16 21:43:14.260719 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3151/6457] 10.222.0.20 () {60 vars in 1322 bytes} [Sat Apr 16 21:43:13 2022] POST /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e/os-volume_attachments => generated 194 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:43:14.337710 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2c2e46e9-1d77-4c94-8b2f-bedbeb6b7e70 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:43:14.339079 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2c2e46e9-1d77-4c94-8b2f-bedbeb6b7e70 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] [instance: f83afebe-c606-461f-9138-67707e788014] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:43:14.346989 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2c2e46e9-1d77-4c94-8b2f-bedbeb6b7e70 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:14.347529 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2c2e46e9-1d77-4c94-8b2f-bedbeb6b7e70 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:14.348352 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2c2e46e9-1d77-4c94-8b2f-bedbeb6b7e70 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:14.348801 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2c2e46e9-1d77-4c94-8b2f-bedbeb6b7e70 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:14.380112 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2c2e46e9-1d77-4c94-8b2f-bedbeb6b7e70 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:14.380851 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2c2e46e9-1d77-4c94-8b2f-bedbeb6b7e70 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:14.381311 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-2c2e46e9-1d77-4c94-8b2f-bedbeb6b7e70 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lazy-loading 'fault' on Instance uuid f83afebe-c606-461f-9138-67707e788014 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:43:14.442858 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2c2e46e9-1d77-4c94-8b2f-bedbeb6b7e70 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '52bbf82f2ac64a4c9e3b86975f8173b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80715ea8284b48959a67d33e8be6b560', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:43:14.451956 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2c2e46e9-1d77-4c94-8b2f-bedbeb6b7e70 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] 10.222.0.20 "GET /compute/v2.1/servers/f83afebe-c606-461f-9138-67707e788014" status: 200 len: 1235 microversion: 2.1 time: 0.118018 Apr 16 21:43:14.453181 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3307/6458] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:43:14 2022] GET /compute/v2.1/servers/f83afebe-c606-461f-9138-67707e788014 => generated 1235 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:43:15.469860 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-05196001-bb86-445e-81af-ce32be8f8f25 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:43:15.472561 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-05196001-bb86-445e-81af-ce32be8f8f25 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] [instance: f83afebe-c606-461f-9138-67707e788014] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:43:15.476978 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-05196001-bb86-445e-81af-ce32be8f8f25 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:15.477435 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-05196001-bb86-445e-81af-ce32be8f8f25 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:15.478203 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-05196001-bb86-445e-81af-ce32be8f8f25 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:15.478759 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-05196001-bb86-445e-81af-ce32be8f8f25 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:15.492927 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-05196001-bb86-445e-81af-ce32be8f8f25 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] HTTP exception thrown: Instance f83afebe-c606-461f-9138-67707e788014 could not be found. Apr 16 21:43:15.496421 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-05196001-bb86-445e-81af-ce32be8f8f25 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Returning 404 to user: Instance f83afebe-c606-461f-9138-67707e788014 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:43:15.496421 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-05196001-bb86-445e-81af-ce32be8f8f25 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] 10.222.0.20 "GET /compute/v2.1/servers/f83afebe-c606-461f-9138-67707e788014" status: 404 len: 111 microversion: 2.1 time: 0.029814 Apr 16 21:43:15.496421 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3152/6459] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:43:15 2022] GET /compute/v2.1/servers/f83afebe-c606-461f-9138-67707e788014 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:43:15.891004 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-673f5c8c-ad12-4e5a-929b-b9cf0cd9f7e3 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] Calling method '.version_select at 0x7fbb95679940>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:43:15.979428 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-673f5c8c-ad12-4e5a-929b-b9cf0cd9f7e3 tempest-TestVolumeBackupRestore-1675082881 tempest-TestVolumeBackupRestore-1675082881-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2033653954" status: 202 len: 0 microversion: 2.1 time: 0.088892 Apr 16 21:43:15.979428 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3308/6460] 10.222.0.20 () {58 vars in 1268 bytes} [Sat Apr 16 21:43:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-2033653954 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:43:16.606142 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-b823b6c2-6cd8-4f6b-885c-1dfdeabe4a85 req-a88396ac-c845-4f6d-8d54-2137a922982e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45de93d5-b2bb-423f-9aec-48c79b81e6fd", "tag": "c4d5001d-e0c4-4dba-9703-42704badf73f"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:43:16.622141 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-b823b6c2-6cd8-4f6b-885c-1dfdeabe4a85 req-a88396ac-c845-4f6d-8d54-2137a922982e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:16.628352 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-b823b6c2-6cd8-4f6b-885c-1dfdeabe4a85 req-a88396ac-c845-4f6d-8d54-2137a922982e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:16.636499 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-b823b6c2-6cd8-4f6b-885c-1dfdeabe4a85 req-a88396ac-c845-4f6d-8d54-2137a922982e service nova] Creating event network-changed:c4d5001d-e0c4-4dba-9703-42704badf73f for instance 45de93d5-b2bb-423f-9aec-48c79b81e6fd on nch2-master-1 Apr 16 21:43:16.642774 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-b823b6c2-6cd8-4f6b-885c-1dfdeabe4a85 req-a88396ac-c845-4f6d-8d54-2137a922982e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046460 Apr 16 21:43:16.643893 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3153/6461] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:43:24.919056 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e53cc426-8413-4c93-8e27-0f5ce1fb0e81 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:43:24.920495 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e53cc426-8413-4c93-8e27-0f5ce1fb0e81 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 9300724f-49f1-464c-8f56-76b4fb4a0d2e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:43:24.928879 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e53cc426-8413-4c93-8e27-0f5ce1fb0e81 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:24.930260 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e53cc426-8413-4c93-8e27-0f5ce1fb0e81 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:24.930260 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e53cc426-8413-4c93-8e27-0f5ce1fb0e81 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:24.930576 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e53cc426-8413-4c93-8e27-0f5ce1fb0e81 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:24.958619 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e53cc426-8413-4c93-8e27-0f5ce1fb0e81 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044696 Apr 16 21:43:24.963758 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3309/6462] 10.222.0.20 () {58 vars in 1301 bytes} [Sat Apr 16 21:43:24 2022] GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:43:24.971092 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-eeb5c4fa-f5a9-4f22-ba5d-d3c4f2b6be91 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:43:24.971679 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-eeb5c4fa-f5a9-4f22-ba5d-d3c4f2b6be91 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 9300724f-49f1-464c-8f56-76b4fb4a0d2e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:43:24.978023 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eeb5c4fa-f5a9-4f22-ba5d-d3c4f2b6be91 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:24.978520 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eeb5c4fa-f5a9-4f22-ba5d-d3c4f2b6be91 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:24.979296 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eeb5c4fa-f5a9-4f22-ba5d-d3c4f2b6be91 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:24.979863 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eeb5c4fa-f5a9-4f22-ba5d-d3c4f2b6be91 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:25.013018 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-eeb5c4fa-f5a9-4f22-ba5d-d3c4f2b6be91 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e/os-volume_attachments/ff535870-3c90-4727-bb5b-abf029d4dc9e" status: 200 len: 194 microversion: 2.1 time: 0.047789 Apr 16 21:43:25.018674 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3154/6463] 10.222.0.20 () {58 vars in 1412 bytes} [Sat Apr 16 21:43:24 2022] GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e/os-volume_attachments/ff535870-3c90-4727-bb5b-abf029d4dc9e => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:43:33.992564 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b6aa3216-7fd0-4173-bdb2-add0de3d76b7 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4648da5b-a470-426c-b3aa-189111891a4d"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:43:33.993652 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b6aa3216-7fd0-4173-bdb2-add0de3d76b7 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 9300724f-49f1-464c-8f56-76b4fb4a0d2e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:43:34.000395 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b6aa3216-7fd0-4173-bdb2-add0de3d76b7 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:34.000866 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b6aa3216-7fd0-4173-bdb2-add0de3d76b7 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:34.001658 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b6aa3216-7fd0-4173-bdb2-add0de3d76b7 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:34.002115 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b6aa3216-7fd0-4173-bdb2-add0de3d76b7 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:34.715654 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b6aa3216-7fd0-4173-bdb2-add0de3d76b7 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "POST /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.727044 Apr 16 21:43:34.716416 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3310/6464] 10.222.0.20 () {60 vars in 1322 bytes} [Sat Apr 16 21:43:33 2022] POST /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e/os-volume_attachments => generated 194 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:43:40.087707 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bd576d06-94e5-4d7b-955e-cce56fd9f6ad tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:43:40.088701 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bd576d06-94e5-4d7b-955e-cce56fd9f6ad tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 9300724f-49f1-464c-8f56-76b4fb4a0d2e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:43:40.096612 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bd576d06-94e5-4d7b-955e-cce56fd9f6ad tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:40.097112 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bd576d06-94e5-4d7b-955e-cce56fd9f6ad tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:40.097988 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bd576d06-94e5-4d7b-955e-cce56fd9f6ad tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:40.098395 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bd576d06-94e5-4d7b-955e-cce56fd9f6ad tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:40.127726 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bd576d06-94e5-4d7b-955e-cce56fd9f6ad tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044102 Apr 16 21:43:40.128306 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3155/6465] 10.222.0.20 () {58 vars in 1301 bytes} [Sat Apr 16 21:43:40 2022] GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:43:40.274229 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3e22714c-1393-49ee-89a5-c920f06fe9f5 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:43:40.276812 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3e22714c-1393-49ee-89a5-c920f06fe9f5 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 9300724f-49f1-464c-8f56-76b4fb4a0d2e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:43:40.284275 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3e22714c-1393-49ee-89a5-c920f06fe9f5 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:40.284734 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3e22714c-1393-49ee-89a5-c920f06fe9f5 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:40.285515 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3e22714c-1393-49ee-89a5-c920f06fe9f5 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:40.285956 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3e22714c-1393-49ee-89a5-c920f06fe9f5 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:40.314175 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3e22714c-1393-49ee-89a5-c920f06fe9f5 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e/os-volume_attachments/ff535870-3c90-4727-bb5b-abf029d4dc9e" status: 200 len: 194 microversion: 2.1 time: 0.045031 Apr 16 21:43:40.314777 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3311/6466] 10.222.0.20 () {58 vars in 1412 bytes} [Sat Apr 16 21:43:40 2022] GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e/os-volume_attachments/ff535870-3c90-4727-bb5b-abf029d4dc9e => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:43:40.324377 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f3e7f794-61af-47ce-b7c3-16d27d10f8e4 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:43:40.324898 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f3e7f794-61af-47ce-b7c3-16d27d10f8e4 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 9300724f-49f1-464c-8f56-76b4fb4a0d2e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:43:40.333272 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f3e7f794-61af-47ce-b7c3-16d27d10f8e4 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:40.333731 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f3e7f794-61af-47ce-b7c3-16d27d10f8e4 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:40.334509 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f3e7f794-61af-47ce-b7c3-16d27d10f8e4 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:40.334951 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f3e7f794-61af-47ce-b7c3-16d27d10f8e4 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:40.417324 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-f3e7f794-61af-47ce-b7c3-16d27d10f8e4 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lazy-loading 'services' on Instance uuid 9300724f-49f1-464c-8f56-76b4fb4a0d2e {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:43:40.663886 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f3e7f794-61af-47ce-b7c3-16d27d10f8e4 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e/os-volume_attachments/ff535870-3c90-4727-bb5b-abf029d4dc9e" status: 202 len: 0 microversion: 2.1 time: 0.343289 Apr 16 21:43:40.664478 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3156/6467] 10.222.0.20 () {58 vars in 1415 bytes} [Sat Apr 16 21:43:40 2022] DELETE /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e/os-volume_attachments/ff535870-3c90-4727-bb5b-abf029d4dc9e => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:43:40.854260 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b758611c-6ecd-4b78-b838-e02d584277ba tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:43:40.855240 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b758611c-6ecd-4b78-b838-e02d584277ba tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:43:40.862258 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b758611c-6ecd-4b78-b838-e02d584277ba tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:40.862712 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b758611c-6ecd-4b78-b838-e02d584277ba tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:40.863667 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b758611c-6ecd-4b78-b838-e02d584277ba tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:40.864151 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b758611c-6ecd-4b78-b838-e02d584277ba tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:40.914517 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b758611c-6ecd-4b78-b838-e02d584277ba tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "POST /compute/v2.1/servers/6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f/action" status: 200 len: 24556 microversion: 2.1 time: 0.063933 Apr 16 21:43:40.915145 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3312/6468] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:43:40 2022] POST /compute/v2.1/servers/6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f/action => generated 24556 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:43:45.981094 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c93ef348-1764-4ef2-87bf-39e3faa06e9f tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:43:45.981671 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c93ef348-1764-4ef2-87bf-39e3faa06e9f tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 9300724f-49f1-464c-8f56-76b4fb4a0d2e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:43:45.987989 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c93ef348-1764-4ef2-87bf-39e3faa06e9f tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:45.988487 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c93ef348-1764-4ef2-87bf-39e3faa06e9f tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:45.989275 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c93ef348-1764-4ef2-87bf-39e3faa06e9f tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:45.989732 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c93ef348-1764-4ef2-87bf-39e3faa06e9f tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:46.022728 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c93ef348-1764-4ef2-87bf-39e3faa06e9f tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e/os-volume_attachments/4648da5b-a470-426c-b3aa-189111891a4d" status: 200 len: 194 microversion: 2.1 time: 0.046925 Apr 16 21:43:46.023637 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3157/6469] 10.222.0.20 () {58 vars in 1412 bytes} [Sat Apr 16 21:43:45 2022] GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e/os-volume_attachments/4648da5b-a470-426c-b3aa-189111891a4d => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:43:46.034581 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7e19c252-91aa-4472-969a-05ae73655d7e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:43:46.035329 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7e19c252-91aa-4472-969a-05ae73655d7e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 9300724f-49f1-464c-8f56-76b4fb4a0d2e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:43:46.042963 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7e19c252-91aa-4472-969a-05ae73655d7e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:46.043536 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7e19c252-91aa-4472-969a-05ae73655d7e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:46.044426 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7e19c252-91aa-4472-969a-05ae73655d7e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:46.044939 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7e19c252-91aa-4472-969a-05ae73655d7e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:46.127416 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-7e19c252-91aa-4472-969a-05ae73655d7e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lazy-loading 'services' on Instance uuid 9300724f-49f1-464c-8f56-76b4fb4a0d2e {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:43:46.407607 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7e19c252-91aa-4472-969a-05ae73655d7e tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e/os-volume_attachments/4648da5b-a470-426c-b3aa-189111891a4d" status: 202 len: 0 microversion: 2.1 time: 0.377333 Apr 16 21:43:46.408233 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3313/6470] 10.222.0.20 () {58 vars in 1415 bytes} [Sat Apr 16 21:43:46 2022] DELETE /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e/os-volume_attachments/4648da5b-a470-426c-b3aa-189111891a4d => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:43:47.571678 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-970c7fd5-a665-4bb9-b168-b52001eebf06 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:43:47.572886 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-970c7fd5-a665-4bb9-b168-b52001eebf06 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 9300724f-49f1-464c-8f56-76b4fb4a0d2e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:43:47.581546 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-970c7fd5-a665-4bb9-b168-b52001eebf06 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:47.582015 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-970c7fd5-a665-4bb9-b168-b52001eebf06 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:47.582976 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-970c7fd5-a665-4bb9-b168-b52001eebf06 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:47.583457 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-970c7fd5-a665-4bb9-b168-b52001eebf06 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:47.613805 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-970c7fd5-a665-4bb9-b168-b52001eebf06 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046120 Apr 16 21:43:47.614502 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3158/6471] 10.222.0.20 () {58 vars in 1301 bytes} [Sat Apr 16 21:43:47 2022] GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:43:47.733453 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3b389c47-d140-4e95-9d81-6fcfeb5f3d63 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:43:47.734486 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3b389c47-d140-4e95-9d81-6fcfeb5f3d63 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 9300724f-49f1-464c-8f56-76b4fb4a0d2e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:43:47.742409 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3b389c47-d140-4e95-9d81-6fcfeb5f3d63 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:47.742875 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3b389c47-d140-4e95-9d81-6fcfeb5f3d63 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:47.743860 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3b389c47-d140-4e95-9d81-6fcfeb5f3d63 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:47.744355 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3b389c47-d140-4e95-9d81-6fcfeb5f3d63 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:47.774683 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3b389c47-d140-4e95-9d81-6fcfeb5f3d63 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045535 Apr 16 21:43:47.775859 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3314/6472] 10.222.0.20 () {58 vars in 1301 bytes} [Sat Apr 16 21:43:47 2022] GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 21:43:47.837785 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f7914fe7-3780-40eb-9d28-b52cd8980e82 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:43:47.838633 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f7914fe7-3780-40eb-9d28-b52cd8980e82 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 9300724f-49f1-464c-8f56-76b4fb4a0d2e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:43:47.844685 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f7914fe7-3780-40eb-9d28-b52cd8980e82 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:47.849130 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f7914fe7-3780-40eb-9d28-b52cd8980e82 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:47.849130 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f7914fe7-3780-40eb-9d28-b52cd8980e82 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:47.849130 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f7914fe7-3780-40eb-9d28-b52cd8980e82 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:47.873263 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f7914fe7-3780-40eb-9d28-b52cd8980e82 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 9300724f-49f1-464c-8f56-76b4fb4a0d2e] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:43:48.174169 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f7914fe7-3780-40eb-9d28-b52cd8980e82 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e" status: 204 len: 0 microversion: 2.1 time: 0.340033 Apr 16 21:43:48.174981 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3159/6473] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:43:47 2022] DELETE /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:43:48.186889 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c7980853-d86a-40a0-a4dd-612a1ea2f85f tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:43:48.187766 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c7980853-d86a-40a0-a4dd-612a1ea2f85f tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 9300724f-49f1-464c-8f56-76b4fb4a0d2e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:43:48.194178 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c7980853-d86a-40a0-a4dd-612a1ea2f85f tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:48.194721 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c7980853-d86a-40a0-a4dd-612a1ea2f85f tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:48.195590 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c7980853-d86a-40a0-a4dd-612a1ea2f85f tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:48.196351 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c7980853-d86a-40a0-a4dd-612a1ea2f85f tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:48.338131 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c7980853-d86a-40a0-a4dd-612a1ea2f85f tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:43:48.345845 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c7980853-d86a-40a0-a4dd-612a1ea2f85f tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e" status: 200 len: 1672 microversion: 2.1 time: 0.166712 Apr 16 21:43:48.346419 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3315/6474] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:43:48 2022] GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e => generated 1672 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:43:49.363721 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6f9c8eff-9b7e-499e-8134-2bdc63d7a44f tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:43:49.365117 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6f9c8eff-9b7e-499e-8134-2bdc63d7a44f tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 9300724f-49f1-464c-8f56-76b4fb4a0d2e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:43:49.372598 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6f9c8eff-9b7e-499e-8134-2bdc63d7a44f tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:49.373339 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6f9c8eff-9b7e-499e-8134-2bdc63d7a44f tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:49.374135 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6f9c8eff-9b7e-499e-8134-2bdc63d7a44f tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:49.374809 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6f9c8eff-9b7e-499e-8134-2bdc63d7a44f tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:49.544678 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6f9c8eff-9b7e-499e-8134-2bdc63d7a44f tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:43:49.555471 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6f9c8eff-9b7e-499e-8134-2bdc63d7a44f tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e" status: 200 len: 1672 microversion: 2.1 time: 0.195977 Apr 16 21:43:49.556048 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3160/6475] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:43:49 2022] GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e => generated 1672 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:43:50.573172 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9a76edf4-be02-430a-8127-c820bd2137e2 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:43:50.574036 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9a76edf4-be02-430a-8127-c820bd2137e2 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 9300724f-49f1-464c-8f56-76b4fb4a0d2e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:43:50.580816 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a76edf4-be02-430a-8127-c820bd2137e2 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:50.581272 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a76edf4-be02-430a-8127-c820bd2137e2 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:50.582539 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a76edf4-be02-430a-8127-c820bd2137e2 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:50.583184 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a76edf4-be02-430a-8127-c820bd2137e2 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:50.678139 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9a76edf4-be02-430a-8127-c820bd2137e2 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:43:50.694412 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9a76edf4-be02-430a-8127-c820bd2137e2 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e" status: 200 len: 1605 microversion: 2.1 time: 0.124968 Apr 16 21:43:50.705393 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3316/6476] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:43:50 2022] GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e => generated 1605 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:43:50.899126 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-3e0e95c3-3948-4fec-90fd-1d3323873a52 req-ed394f81-a4d0-4e1f-b77d-dacd2b8373dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9300724f-49f1-464c-8f56-76b4fb4a0d2e", "name": "network-vif-deleted", "tag": "ad860733-a04f-4d60-88e2-92bce10f1de8"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:43:50.909655 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-3e0e95c3-3948-4fec-90fd-1d3323873a52 req-ed394f81-a4d0-4e1f-b77d-dacd2b8373dd service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:50.910424 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-3e0e95c3-3948-4fec-90fd-1d3323873a52 req-ed394f81-a4d0-4e1f-b77d-dacd2b8373dd service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:50.959875 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-3e0e95c3-3948-4fec-90fd-1d3323873a52 req-ed394f81-a4d0-4e1f-b77d-dacd2b8373dd service nova] Creating event network-vif-deleted:ad860733-a04f-4d60-88e2-92bce10f1de8 for instance 9300724f-49f1-464c-8f56-76b4fb4a0d2e on nch1-master-1 Apr 16 21:43:50.960839 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-3e0e95c3-3948-4fec-90fd-1d3323873a52 req-ed394f81-a4d0-4e1f-b77d-dacd2b8373dd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148973 Apr 16 21:43:50.962609 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3161/6477] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:43:51.713004 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-17e6e50d-95a7-4985-87ee-4f25362fc295 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:43:51.714239 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-17e6e50d-95a7-4985-87ee-4f25362fc295 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 9300724f-49f1-464c-8f56-76b4fb4a0d2e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:43:51.722497 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-17e6e50d-95a7-4985-87ee-4f25362fc295 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:51.722985 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-17e6e50d-95a7-4985-87ee-4f25362fc295 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:51.729169 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-17e6e50d-95a7-4985-87ee-4f25362fc295 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:51.729640 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-17e6e50d-95a7-4985-87ee-4f25362fc295 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:51.788674 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-17e6e50d-95a7-4985-87ee-4f25362fc295 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:51.789424 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-17e6e50d-95a7-4985-87ee-4f25362fc295 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:51.790077 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-17e6e50d-95a7-4985-87ee-4f25362fc295 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lazy-loading 'fault' on Instance uuid 9300724f-49f1-464c-8f56-76b4fb4a0d2e {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:43:51.842815 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-17e6e50d-95a7-4985-87ee-4f25362fc295 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8b67f0226ea247ae857b18891e0834f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7fc33178ac5b4d4f9c1f346e3b4371b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:43:51.850106 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-17e6e50d-95a7-4985-87ee-4f25362fc295 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e" status: 200 len: 1327 microversion: 2.1 time: 0.141765 Apr 16 21:43:51.853041 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3317/6478] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:43:51 2022] GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e => generated 1327 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:43:52.869268 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a0b097b9-9e96-4589-af97-f36896b0e622 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:43:52.869979 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a0b097b9-9e96-4589-af97-f36896b0e622 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 9300724f-49f1-464c-8f56-76b4fb4a0d2e] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:43:52.877346 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a0b097b9-9e96-4589-af97-f36896b0e622 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:52.877791 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a0b097b9-9e96-4589-af97-f36896b0e622 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:52.878701 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a0b097b9-9e96-4589-af97-f36896b0e622 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:43:52.879352 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a0b097b9-9e96-4589-af97-f36896b0e622 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:43:52.892998 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-a0b097b9-9e96-4589-af97-f36896b0e622 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] HTTP exception thrown: Instance 9300724f-49f1-464c-8f56-76b4fb4a0d2e could not be found. Apr 16 21:43:52.893609 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a0b097b9-9e96-4589-af97-f36896b0e622 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Returning 404 to user: Instance 9300724f-49f1-464c-8f56-76b4fb4a0d2e could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:43:52.894458 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a0b097b9-9e96-4589-af97-f36896b0e622 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e" status: 404 len: 111 microversion: 2.1 time: 0.030446 Apr 16 21:43:52.895390 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3162/6479] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:43:52 2022] GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:43:52.903672 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-585f590d-6194-4110-9876-f9bda8cc8136 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '.version_select at 0x7fbba0096c10>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:43:52.992600 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-585f590d-6194-4110-9876-f9bda8cc8136 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-492647057" status: 202 len: 0 microversion: 2.1 time: 0.092671 Apr 16 21:43:52.993305 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3318/6480] 10.222.0.20 () {58 vars in 1217 bytes} [Sat Apr 16 21:43:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-492647057 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 16 21:44:00.861022 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7a86d6cd-e09c-4d78-b570-1a5910c9593f tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1928881658", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "2aad2bcc-ed09-4c05-a89b-4988a07fb386"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:44:00.914743 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-7a86d6cd-e09c-4d78-b570-1a5910c9593f tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] validate_networks() for [('2aad2bcc-ed09-4c05-a89b-4988a07fb386', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:44:01.381746 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-7a86d6cd-e09c-4d78-b570-1a5910c9593f tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:44:01.382204 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-7a86d6cd-e09c-4d78-b570-1a5910c9593f tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:44:01.382682 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-7a86d6cd-e09c-4d78-b570-1a5910c9593f tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:44:01.383096 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-7a86d6cd-e09c-4d78-b570-1a5910c9593f tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:44:01.383513 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-7a86d6cd-e09c-4d78-b570-1a5910c9593f tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:44:01.393874 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7a86d6cd-e09c-4d78-b570-1a5910c9593f tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:01.394327 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7a86d6cd-e09c-4d78-b570-1a5910c9593f tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:01.395133 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7a86d6cd-e09c-4d78-b570-1a5910c9593f tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:01.395573 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7a86d6cd-e09c-4d78-b570-1a5910c9593f tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:01.413028 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-7a86d6cd-e09c-4d78-b570-1a5910c9593f tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Getting quotas for project cda4f5ee41d2439e935ee0f658f465d4. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:44:01.418408 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-7a86d6cd-e09c-4d78-b570-1a5910c9593f tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Getting quotas for user 95bf99de7a594e209f995e62db441850 and project cda4f5ee41d2439e935ee0f658f465d4. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:44:01.430537 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7a86d6cd-e09c-4d78-b570-1a5910c9593f tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:44:01.432846 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7a86d6cd-e09c-4d78-b570-1a5910c9593f tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] [instance: 59d6853a-6832-4a96-a033-4acb32260eb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:44:01.557572 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7a86d6cd-e09c-4d78-b570-1a5910c9593f tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.700420 Apr 16 21:44:01.558148 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3163/6481] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:44:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:44:01.569787 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-68529f51-91d7-4ed5-92ff-d4131eb2508a tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:01.570399 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-68529f51-91d7-4ed5-92ff-d4131eb2508a tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] [instance: 59d6853a-6832-4a96-a033-4acb32260eb6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:01.624199 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-68529f51-91d7-4ed5-92ff-d4131eb2508a tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bf99de7a594e209f995e62db441850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda4f5ee41d2439e935ee0f658f465d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:44:01.630921 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-68529f51-91d7-4ed5-92ff-d4131eb2508a tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] 10.222.0.20 "GET /compute/v2.1/servers/59d6853a-6832-4a96-a033-4acb32260eb6" status: 200 len: 1219 microversion: 2.1 time: 0.065952 Apr 16 21:44:01.631501 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3319/6482] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:01 2022] GET /compute/v2.1/servers/59d6853a-6832-4a96-a033-4acb32260eb6 => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:44:02.649123 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cec2605a-c47e-4216-88ad-a34ff44928f4 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:02.649667 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-cec2605a-c47e-4216-88ad-a34ff44928f4 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] [instance: 59d6853a-6832-4a96-a033-4acb32260eb6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:02.703846 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cec2605a-c47e-4216-88ad-a34ff44928f4 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bf99de7a594e209f995e62db441850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda4f5ee41d2439e935ee0f658f465d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:44:02.710570 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cec2605a-c47e-4216-88ad-a34ff44928f4 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] 10.222.0.20 "GET /compute/v2.1/servers/59d6853a-6832-4a96-a033-4acb32260eb6" status: 200 len: 1219 microversion: 2.1 time: 0.066428 Apr 16 21:44:02.711129 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3164/6483] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:02 2022] GET /compute/v2.1/servers/59d6853a-6832-4a96-a033-4acb32260eb6 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:44:03.727031 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9aa1fb5d-fbf2-484a-8bc3-37085f27e022 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:03.727661 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9aa1fb5d-fbf2-484a-8bc3-37085f27e022 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] [instance: 59d6853a-6832-4a96-a033-4acb32260eb6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:03.734503 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9aa1fb5d-fbf2-484a-8bc3-37085f27e022 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:03.735667 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9aa1fb5d-fbf2-484a-8bc3-37085f27e022 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:03.736473 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9aa1fb5d-fbf2-484a-8bc3-37085f27e022 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:03.736924 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9aa1fb5d-fbf2-484a-8bc3-37085f27e022 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:03.797369 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9aa1fb5d-fbf2-484a-8bc3-37085f27e022 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bf99de7a594e209f995e62db441850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda4f5ee41d2439e935ee0f658f465d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:44:03.804859 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9aa1fb5d-fbf2-484a-8bc3-37085f27e022 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] 10.222.0.20 "GET /compute/v2.1/servers/59d6853a-6832-4a96-a033-4acb32260eb6" status: 200 len: 1271 microversion: 2.1 time: 0.081779 Apr 16 21:44:03.805431 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3320/6484] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:03 2022] GET /compute/v2.1/servers/59d6853a-6832-4a96-a033-4acb32260eb6 => generated 1271 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:44:04.826969 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-086eee76-555a-48d8-8e76-688f1d73e06d tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:04.826969 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-086eee76-555a-48d8-8e76-688f1d73e06d tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] [instance: 59d6853a-6832-4a96-a033-4acb32260eb6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:04.828943 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-086eee76-555a-48d8-8e76-688f1d73e06d tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:04.829409 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-086eee76-555a-48d8-8e76-688f1d73e06d tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:04.830228 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-086eee76-555a-48d8-8e76-688f1d73e06d tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:04.830677 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-086eee76-555a-48d8-8e76-688f1d73e06d tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:05.071882 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-086eee76-555a-48d8-8e76-688f1d73e06d tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bf99de7a594e209f995e62db441850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda4f5ee41d2439e935ee0f658f465d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:44:05.079285 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-086eee76-555a-48d8-8e76-688f1d73e06d tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] 10.222.0.20 "GET /compute/v2.1/servers/59d6853a-6832-4a96-a033-4acb32260eb6" status: 200 len: 1319 microversion: 2.1 time: 0.262233 Apr 16 21:44:05.079836 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3165/6485] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:04 2022] GET /compute/v2.1/servers/59d6853a-6832-4a96-a033-4acb32260eb6 => generated 1319 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:44:05.642451 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-261c78a4-d301-4745-844a-15b0fda6ff92 req-c5b48ba8-34d9-48e4-9d0b-e6b67b408e26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59d6853a-6832-4a96-a033-4acb32260eb6", "tag": "6a24e936-fcf3-4173-bf74-80d1489399a4"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:44:05.651709 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-261c78a4-d301-4745-844a-15b0fda6ff92 req-c5b48ba8-34d9-48e4-9d0b-e6b67b408e26 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:05.652163 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-261c78a4-d301-4745-844a-15b0fda6ff92 req-c5b48ba8-34d9-48e4-9d0b-e6b67b408e26 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:05.667649 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-261c78a4-d301-4745-844a-15b0fda6ff92 req-c5b48ba8-34d9-48e4-9d0b-e6b67b408e26 service nova] Creating event network-changed:6a24e936-fcf3-4173-bf74-80d1489399a4 for instance 59d6853a-6832-4a96-a033-4acb32260eb6 on nch1-master-1 Apr 16 21:44:05.669708 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-261c78a4-d301-4745-844a-15b0fda6ff92 req-c5b48ba8-34d9-48e4-9d0b-e6b67b408e26 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032393 Apr 16 21:44:05.670504 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3321/6486] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:44:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:44:06.097416 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-426f76c8-990b-4367-901c-39fc341ddfe8 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:06.098399 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-426f76c8-990b-4367-901c-39fc341ddfe8 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] [instance: 59d6853a-6832-4a96-a033-4acb32260eb6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:06.106519 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-426f76c8-990b-4367-901c-39fc341ddfe8 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:06.113222 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-426f76c8-990b-4367-901c-39fc341ddfe8 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:06.113222 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-426f76c8-990b-4367-901c-39fc341ddfe8 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:06.113222 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-426f76c8-990b-4367-901c-39fc341ddfe8 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:06.264523 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e1afae21-9097-4099-bb4b-a9bab12849ef tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:06.265114 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e1afae21-9097-4099-bb4b-a9bab12849ef tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 9300724f-49f1-464c-8f56-76b4fb4a0d2e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:06.271319 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e1afae21-9097-4099-bb4b-a9bab12849ef tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:06.272154 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e1afae21-9097-4099-bb4b-a9bab12849ef tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:06.272977 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e1afae21-9097-4099-bb4b-a9bab12849ef tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:06.273414 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e1afae21-9097-4099-bb4b-a9bab12849ef tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:06.287425 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-e1afae21-9097-4099-bb4b-a9bab12849ef tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] HTTP exception thrown: Instance 9300724f-49f1-464c-8f56-76b4fb4a0d2e could not be found. Apr 16 21:44:06.288040 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e1afae21-9097-4099-bb4b-a9bab12849ef tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Returning 404 to user: Instance 9300724f-49f1-464c-8f56-76b4fb4a0d2e could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:44:06.288910 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e1afae21-9097-4099-bb4b-a9bab12849ef tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e" status: 404 len: 111 microversion: 2.1 time: 0.031693 Apr 16 21:44:06.289476 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3322/6487] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:44:06 2022] DELETE /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:44:06.298003 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e6f3ae64-94fb-4c27-b08a-ffd6505a1e26 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:06.298616 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e6f3ae64-94fb-4c27-b08a-ffd6505a1e26 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 9300724f-49f1-464c-8f56-76b4fb4a0d2e] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:06.304775 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e6f3ae64-94fb-4c27-b08a-ffd6505a1e26 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:06.305235 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e6f3ae64-94fb-4c27-b08a-ffd6505a1e26 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:06.306018 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e6f3ae64-94fb-4c27-b08a-ffd6505a1e26 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:06.306460 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e6f3ae64-94fb-4c27-b08a-ffd6505a1e26 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:06.321380 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-e6f3ae64-94fb-4c27-b08a-ffd6505a1e26 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] HTTP exception thrown: Instance 9300724f-49f1-464c-8f56-76b4fb4a0d2e could not be found. Apr 16 21:44:06.321969 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e6f3ae64-94fb-4c27-b08a-ffd6505a1e26 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Returning 404 to user: Instance 9300724f-49f1-464c-8f56-76b4fb4a0d2e could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:44:06.322891 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e6f3ae64-94fb-4c27-b08a-ffd6505a1e26 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e" status: 404 len: 111 microversion: 2.1 time: 0.029206 Apr 16 21:44:06.323615 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3323/6488] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:06 2022] GET /compute/v2.1/servers/9300724f-49f1-464c-8f56-76b4fb4a0d2e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:44:06.372501 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-426f76c8-990b-4367-901c-39fc341ddfe8 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bf99de7a594e209f995e62db441850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda4f5ee41d2439e935ee0f658f465d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:44:06.380579 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-426f76c8-990b-4367-901c-39fc341ddfe8 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] 10.222.0.20 "GET /compute/v2.1/servers/59d6853a-6832-4a96-a033-4acb32260eb6" status: 200 len: 1319 microversion: 2.1 time: 0.287637 Apr 16 21:44:06.381365 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3166/6489] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:06 2022] GET /compute/v2.1/servers/59d6853a-6832-4a96-a033-4acb32260eb6 => generated 1319 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:44:07.397888 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f0ee4855-281c-4e0b-8638-0cf4d938671a tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:07.398609 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f0ee4855-281c-4e0b-8638-0cf4d938671a tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] [instance: 59d6853a-6832-4a96-a033-4acb32260eb6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:07.405423 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f0ee4855-281c-4e0b-8638-0cf4d938671a tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:07.405882 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f0ee4855-281c-4e0b-8638-0cf4d938671a tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:07.406666 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f0ee4855-281c-4e0b-8638-0cf4d938671a tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:07.407094 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f0ee4855-281c-4e0b-8638-0cf4d938671a tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:07.536643 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f0ee4855-281c-4e0b-8638-0cf4d938671a tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bf99de7a594e209f995e62db441850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda4f5ee41d2439e935ee0f658f465d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:44:07.543976 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f0ee4855-281c-4e0b-8638-0cf4d938671a tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] 10.222.0.20 "GET /compute/v2.1/servers/59d6853a-6832-4a96-a033-4acb32260eb6" status: 200 len: 1319 microversion: 2.1 time: 0.149961 Apr 16 21:44:07.544591 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3324/6490] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:07 2022] GET /compute/v2.1/servers/59d6853a-6832-4a96-a033-4acb32260eb6 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:44:08.561795 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-98f0a0f6-de43-477a-988a-63b310aef881 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:08.562333 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-98f0a0f6-de43-477a-988a-63b310aef881 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] [instance: 59d6853a-6832-4a96-a033-4acb32260eb6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:08.569362 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-98f0a0f6-de43-477a-988a-63b310aef881 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:08.569939 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-98f0a0f6-de43-477a-988a-63b310aef881 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:08.570716 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-98f0a0f6-de43-477a-988a-63b310aef881 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:08.571162 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-98f0a0f6-de43-477a-988a-63b310aef881 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:08.710388 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-98f0a0f6-de43-477a-988a-63b310aef881 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bf99de7a594e209f995e62db441850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda4f5ee41d2439e935ee0f658f465d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:44:08.717844 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-98f0a0f6-de43-477a-988a-63b310aef881 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] 10.222.0.20 "GET /compute/v2.1/servers/59d6853a-6832-4a96-a033-4acb32260eb6" status: 200 len: 1319 microversion: 2.1 time: 0.160358 Apr 16 21:44:08.718415 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3167/6491] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:08 2022] GET /compute/v2.1/servers/59d6853a-6832-4a96-a033-4acb32260eb6 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:44:09.733760 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-24ad8feb-578a-468e-86cb-7b833b06a968 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:09.734410 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-24ad8feb-578a-468e-86cb-7b833b06a968 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] [instance: 59d6853a-6832-4a96-a033-4acb32260eb6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:09.741234 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-24ad8feb-578a-468e-86cb-7b833b06a968 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:09.741694 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-24ad8feb-578a-468e-86cb-7b833b06a968 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:09.742473 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-24ad8feb-578a-468e-86cb-7b833b06a968 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:09.742917 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-24ad8feb-578a-468e-86cb-7b833b06a968 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:09.876046 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-24ad8feb-578a-468e-86cb-7b833b06a968 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bf99de7a594e209f995e62db441850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda4f5ee41d2439e935ee0f658f465d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:44:09.883375 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-24ad8feb-578a-468e-86cb-7b833b06a968 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] 10.222.0.20 "GET /compute/v2.1/servers/59d6853a-6832-4a96-a033-4acb32260eb6" status: 200 len: 1319 microversion: 2.1 time: 0.153470 Apr 16 21:44:09.883939 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3325/6492] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:09 2022] GET /compute/v2.1/servers/59d6853a-6832-4a96-a033-4acb32260eb6 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:44:10.418067 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-5be28a51-84a7-40e5-b275-6cc2eb63ed90 req-531911ef-135c-47ab-b161-206fc18a09ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59d6853a-6832-4a96-a033-4acb32260eb6", "name": "network-vif-plugged", "status": "completed", "tag": "6a24e936-fcf3-4173-bf74-80d1489399a4"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:44:10.426762 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-5be28a51-84a7-40e5-b275-6cc2eb63ed90 req-531911ef-135c-47ab-b161-206fc18a09ed service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:10.427219 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-5be28a51-84a7-40e5-b275-6cc2eb63ed90 req-531911ef-135c-47ab-b161-206fc18a09ed service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:10.438557 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-5be28a51-84a7-40e5-b275-6cc2eb63ed90 req-531911ef-135c-47ab-b161-206fc18a09ed service nova] Creating event network-vif-plugged:6a24e936-fcf3-4173-bf74-80d1489399a4 for instance 59d6853a-6832-4a96-a033-4acb32260eb6 on nch1-master-1 Apr 16 21:44:10.443592 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-5be28a51-84a7-40e5-b275-6cc2eb63ed90 req-531911ef-135c-47ab-b161-206fc18a09ed service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160021 Apr 16 21:44:10.444203 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3168/6493] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:44:10.738302 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2bccb014-c710-4c03-8e71-a177395ff242 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:10.738803 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2bccb014-c710-4c03-8e71-a177395ff242 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:10.745885 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2bccb014-c710-4c03-8e71-a177395ff242 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:10.746346 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2bccb014-c710-4c03-8e71-a177395ff242 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:10.747133 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2bccb014-c710-4c03-8e71-a177395ff242 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:10.747583 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2bccb014-c710-4c03-8e71-a177395ff242 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:10.760756 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-2bccb014-c710-4c03-8e71-a177395ff242 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] HTTP exception thrown: Instance 8c63a395-2ffd-44e5-aa9b-cd3417a504bf could not be found. Apr 16 21:44:10.761358 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2bccb014-c710-4c03-8e71-a177395ff242 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Returning 404 to user: Instance 8c63a395-2ffd-44e5-aa9b-cd3417a504bf could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:44:10.762191 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2bccb014-c710-4c03-8e71-a177395ff242 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf" status: 404 len: 111 microversion: 2.1 time: 0.027979 Apr 16 21:44:10.762716 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3326/6494] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:44:10 2022] DELETE /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:44:10.771589 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9fd10df0-3590-46c8-af00-e6db8aae0373 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:10.772357 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9fd10df0-3590-46c8-af00-e6db8aae0373 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] [instance: 8c63a395-2ffd-44e5-aa9b-cd3417a504bf] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:10.778466 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9fd10df0-3590-46c8-af00-e6db8aae0373 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:10.778928 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9fd10df0-3590-46c8-af00-e6db8aae0373 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:10.779712 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9fd10df0-3590-46c8-af00-e6db8aae0373 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:10.780163 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9fd10df0-3590-46c8-af00-e6db8aae0373 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:10.793895 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-9fd10df0-3590-46c8-af00-e6db8aae0373 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] HTTP exception thrown: Instance 8c63a395-2ffd-44e5-aa9b-cd3417a504bf could not be found. Apr 16 21:44:10.794430 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9fd10df0-3590-46c8-af00-e6db8aae0373 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] Returning 404 to user: Instance 8c63a395-2ffd-44e5-aa9b-cd3417a504bf could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:44:10.795261 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9fd10df0-3590-46c8-af00-e6db8aae0373 tempest-AttachVolumeTestJSON-1623236864 tempest-AttachVolumeTestJSON-1623236864-project] 10.222.0.20 "GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf" status: 404 len: 111 microversion: 2.1 time: 0.028485 Apr 16 21:44:10.795792 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3169/6495] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:10 2022] GET /compute/v2.1/servers/8c63a395-2ffd-44e5-aa9b-cd3417a504bf => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:44:10.901075 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-013d453d-1bbd-4795-98ec-f774d9e2386f tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:10.901692 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-013d453d-1bbd-4795-98ec-f774d9e2386f tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] [instance: 59d6853a-6832-4a96-a033-4acb32260eb6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:10.907577 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-013d453d-1bbd-4795-98ec-f774d9e2386f tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:10.908041 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-013d453d-1bbd-4795-98ec-f774d9e2386f tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:10.908873 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-013d453d-1bbd-4795-98ec-f774d9e2386f tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:10.909323 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-013d453d-1bbd-4795-98ec-f774d9e2386f tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:11.133247 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-013d453d-1bbd-4795-98ec-f774d9e2386f tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bf99de7a594e209f995e62db441850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda4f5ee41d2439e935ee0f658f465d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:44:11.142187 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-013d453d-1bbd-4795-98ec-f774d9e2386f tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] 10.222.0.20 "GET /compute/v2.1/servers/59d6853a-6832-4a96-a033-4acb32260eb6" status: 200 len: 1319 microversion: 2.1 time: 0.244459 Apr 16 21:44:11.142969 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3327/6496] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:10 2022] GET /compute/v2.1/servers/59d6853a-6832-4a96-a033-4acb32260eb6 => generated 1319 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:44:12.159897 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fd1bac49-8be8-4d86-afbd-3ab0adb3ec0c tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:12.161173 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-fd1bac49-8be8-4d86-afbd-3ab0adb3ec0c tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] [instance: 59d6853a-6832-4a96-a033-4acb32260eb6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:12.167935 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fd1bac49-8be8-4d86-afbd-3ab0adb3ec0c tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:12.168434 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fd1bac49-8be8-4d86-afbd-3ab0adb3ec0c tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:12.169220 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fd1bac49-8be8-4d86-afbd-3ab0adb3ec0c tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:12.169674 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fd1bac49-8be8-4d86-afbd-3ab0adb3ec0c tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:12.317738 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-fd1bac49-8be8-4d86-afbd-3ab0adb3ec0c tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bf99de7a594e209f995e62db441850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda4f5ee41d2439e935ee0f658f465d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:44:12.325305 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fd1bac49-8be8-4d86-afbd-3ab0adb3ec0c tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] 10.222.0.20 "GET /compute/v2.1/servers/59d6853a-6832-4a96-a033-4acb32260eb6" status: 200 len: 1509 microversion: 2.1 time: 0.170186 Apr 16 21:44:12.325883 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3170/6497] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:12 2022] GET /compute/v2.1/servers/59d6853a-6832-4a96-a033-4acb32260eb6 => generated 1509 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:44:16.249206 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-08f26616-d803-45d8-9aa0-001536ae6ba0 tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] Action: 'create', calling method: .version_select at 0x7fbb957b4ee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1872605079"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:44:17.014986 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-08f26616-d803-45d8-9aa0-001536ae6ba0 tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 338 microversion: 2.1 time: 0.887090 Apr 16 21:44:17.015703 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3328/6498] 10.222.0.20 () {60 vars in 1154 bytes} [Sat Apr 16 21:44:16 2022] POST /compute/v2.1/os-volumes => generated 338 bytes in 888 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 16 21:44:17.028838 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cd022920-f2c1-4613-b40d-28d16c992b9b tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] Calling method '.version_select at 0x7fbb9575ae50>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:17.080803 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cd022920-f2c1-4613-b40d-28d16c992b9b tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/fec8a94a-52da-4bca-82d0-aa3da71ef967" status: 200 len: 338 microversion: 2.1 time: 0.055285 Apr 16 21:44:17.085756 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3171/6499] 10.222.0.20 () {58 vars in 1244 bytes} [Sat Apr 16 21:44:17 2022] GET /compute/v2.1/os-volumes/fec8a94a-52da-4bca-82d0-aa3da71ef967 => generated 338 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:44:17.267172 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0eec4c1d-f8d5-471f-bc2c-ccc4c638dc8e tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fedcef50-29c9-4c19-a9b4-b678f9441c3f", "device": "/dev/sdb"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:44:17.269427 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0eec4c1d-f8d5-471f-bc2c-ccc4c638dc8e tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] [instance: 59d6853a-6832-4a96-a033-4acb32260eb6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:17.275523 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0eec4c1d-f8d5-471f-bc2c-ccc4c638dc8e tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:17.275993 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0eec4c1d-f8d5-471f-bc2c-ccc4c638dc8e tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:17.276810 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0eec4c1d-f8d5-471f-bc2c-ccc4c638dc8e tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:17.277262 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0eec4c1d-f8d5-471f-bc2c-ccc4c638dc8e tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:18.022587 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0eec4c1d-f8d5-471f-bc2c-ccc4c638dc8e tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] 10.222.0.20 "POST /compute/v2.1/servers/59d6853a-6832-4a96-a033-4acb32260eb6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.760110 Apr 16 21:44:18.023248 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3329/6500] 10.222.0.20 () {60 vars in 1322 bytes} [Sat Apr 16 21:44:17 2022] POST /compute/v2.1/servers/59d6853a-6832-4a96-a033-4acb32260eb6/os-volume_attachments => generated 194 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:44:18.094315 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-869acd2e-1891-40b3-b65e-7fb99afad793 tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] Calling method '.version_select at 0x7fbb961e7b80>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:18.141304 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-869acd2e-1891-40b3-b65e-7fb99afad793 tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/fec8a94a-52da-4bca-82d0-aa3da71ef967" status: 200 len: 339 microversion: 2.1 time: 0.051760 Apr 16 21:44:18.141890 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3172/6501] 10.222.0.20 () {58 vars in 1244 bytes} [Sat Apr 16 21:44:18 2022] GET /compute/v2.1/os-volumes/fec8a94a-52da-4bca-82d0-aa3da71ef967 => generated 339 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:44:18.154997 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9f9faf31-b862-4564-9baa-3d295e138124 tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] Action: 'create', calling method: .version_select at 0x7fbb956fa8b0>, body: {"snapshot": {"volume_id": "fec8a94a-52da-4bca-82d0-aa3da71ef967", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-806648362"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:44:18.540106 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9f9faf31-b862-4564-9baa-3d295e138124 tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.389408 Apr 16 21:44:18.540912 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3330/6502] 10.222.0.20 () {60 vars in 1161 bytes} [Sat Apr 16 21:44:18 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:44:18.550571 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-552a3bc9-1ab8-4406-81fa-0f3d7eddc472 tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] Calling method '.version_select at 0x7fbb95bac4c0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:18.582637 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-552a3bc9-1ab8-4406-81fa-0f3d7eddc472 tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/265fd1cf-7727-4f40-97a4-a84abf780641" status: 200 len: 286 microversion: 2.1 time: 0.035954 Apr 16 21:44:18.588228 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3173/6503] 10.222.0.20 () {58 vars in 1250 bytes} [Sat Apr 16 21:44:18 2022] GET /compute/v2.1/os-snapshots/265fd1cf-7727-4f40-97a4-a84abf780641 => generated 286 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:44:18.593389 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-56189b7c-2740-415b-83c9-589e155eb334 tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] Calling method '.version_select at 0x7fbb95a5ea60>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:18.623066 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-56189b7c-2740-415b-83c9-589e155eb334 tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.033600 Apr 16 21:44:18.623670 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3331/6504] 10.222.0.20 () {58 vars in 1139 bytes} [Sat Apr 16 21:44:18 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:44:18.636015 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6fb123e0-ee79-4e32-b7a6-d2f0178d0c1c tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] Calling method '.version_select at 0x7fbb96227550>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:18.666376 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6fb123e0-ee79-4e32-b7a6-d2f0178d0c1c tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/265fd1cf-7727-4f40-97a4-a84abf780641" status: 200 len: 286 microversion: 2.1 time: 0.036073 Apr 16 21:44:18.666954 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3174/6505] 10.222.0.20 () {58 vars in 1250 bytes} [Sat Apr 16 21:44:18 2022] GET /compute/v2.1/os-snapshots/265fd1cf-7727-4f40-97a4-a84abf780641 => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:44:19.679186 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-18adf494-d9a7-4e38-996f-9f48fa8d4893 tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] Calling method '.version_select at 0x7fbb956610d0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:19.708259 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-18adf494-d9a7-4e38-996f-9f48fa8d4893 tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/265fd1cf-7727-4f40-97a4-a84abf780641" status: 200 len: 286 microversion: 2.1 time: 0.033879 Apr 16 21:44:19.708832 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3332/6506] 10.222.0.20 () {58 vars in 1250 bytes} [Sat Apr 16 21:44:19 2022] GET /compute/v2.1/os-snapshots/265fd1cf-7727-4f40-97a4-a84abf780641 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:44:19.992338 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1a5c7ac3-20c2-4dd5-8a8d-d0d34c0c5aa8 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:44:19.995133 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1a5c7ac3-20c2-4dd5-8a8d-d0d34c0c5aa8 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:20.000106 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1a5c7ac3-20c2-4dd5-8a8d-d0d34c0c5aa8 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:20.000588 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1a5c7ac3-20c2-4dd5-8a8d-d0d34c0c5aa8 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:20.001356 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1a5c7ac3-20c2-4dd5-8a8d-d0d34c0c5aa8 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:20.001848 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1a5c7ac3-20c2-4dd5-8a8d-d0d34c0c5aa8 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:20.072550 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1a5c7ac3-20c2-4dd5-8a8d-d0d34c0c5aa8 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "POST /compute/v2.1/servers/6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f/action" status: 200 len: 32631 microversion: 2.1 time: 0.084794 Apr 16 21:44:20.073196 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3175/6507] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:44:19 2022] POST /compute/v2.1/servers/6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f/action => generated 32631 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:44:20.721950 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-848f963a-e2a8-4c7b-b6af-c228123d4b79 tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] Calling method '.version_select at 0x7fbb955a2430>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:20.753439 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-848f963a-e2a8-4c7b-b6af-c228123d4b79 tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/265fd1cf-7727-4f40-97a4-a84abf780641" status: 200 len: 286 microversion: 2.1 time: 0.036967 Apr 16 21:44:20.759322 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3333/6508] 10.222.0.20 () {58 vars in 1250 bytes} [Sat Apr 16 21:44:20 2022] GET /compute/v2.1/os-snapshots/265fd1cf-7727-4f40-97a4-a84abf780641 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:44:21.086722 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ef561856-f223-420a-92c5-3876ed1a8c99 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:21.087434 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ef561856-f223-420a-92c5-3876ed1a8c99 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:21.091071 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-9aaa44e9-8d11-4e6b-9fe8-e549f14c8261 req-2b39f3a5-0ce4-41fa-b376-3a29e333a959 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f", "tag": "a87314d7-f7ef-4a87-97c5-dd497a66d084"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:44:21.100433 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-9aaa44e9-8d11-4e6b-9fe8-e549f14c8261 req-2b39f3a5-0ce4-41fa-b376-3a29e333a959 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:21.100663 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ef561856-f223-420a-92c5-3876ed1a8c99 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:21.100893 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-9aaa44e9-8d11-4e6b-9fe8-e549f14c8261 req-2b39f3a5-0ce4-41fa-b376-3a29e333a959 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:21.101469 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ef561856-f223-420a-92c5-3876ed1a8c99 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:21.102288 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ef561856-f223-420a-92c5-3876ed1a8c99 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:21.102745 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ef561856-f223-420a-92c5-3876ed1a8c99 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:21.113597 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-9aaa44e9-8d11-4e6b-9fe8-e549f14c8261 req-2b39f3a5-0ce4-41fa-b376-3a29e333a959 service nova] Creating event network-changed:a87314d7-f7ef-4a87-97c5-dd497a66d084 for instance 6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f on nch2-master-1 Apr 16 21:44:21.119548 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-9aaa44e9-8d11-4e6b-9fe8-e549f14c8261 req-2b39f3a5-0ce4-41fa-b376-3a29e333a959 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031628 Apr 16 21:44:21.120622 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3334/6509] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:44:21.132282 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ef561856-f223-420a-92c5-3876ed1a8c99 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:44:21.490510 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ef561856-f223-420a-92c5-3876ed1a8c99 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f" status: 204 len: 0 microversion: 2.1 time: 0.407899 Apr 16 21:44:21.494398 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3176/6510] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:44:21 2022] DELETE /compute/v2.1/servers/6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:44:21.500275 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b4177860-8657-4d14-909e-e2bd3baa881c tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:21.500989 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b4177860-8657-4d14-909e-e2bd3baa881c tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:21.510982 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b4177860-8657-4d14-909e-e2bd3baa881c tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:21.511444 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b4177860-8657-4d14-909e-e2bd3baa881c tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:21.512287 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b4177860-8657-4d14-909e-e2bd3baa881c tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:21.512742 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b4177860-8657-4d14-909e-e2bd3baa881c tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:21.660726 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b4177860-8657-4d14-909e-e2bd3baa881c tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a36974ad8094dcd99951dbc1ce6049e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5279e09b8205420980e8c7accbcc5f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:44:21.668584 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b4177860-8657-4d14-909e-e2bd3baa881c tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f" status: 200 len: 1670 microversion: 2.1 time: 0.172582 Apr 16 21:44:21.669388 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3335/6511] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:21 2022] GET /compute/v2.1/servers/6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f => generated 1670 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:44:21.765775 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a6497d06-a38f-4a3a-99c8-1b208ece15b7 tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] Calling method '.version_select at 0x7fbb962278b0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:21.797570 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a6497d06-a38f-4a3a-99c8-1b208ece15b7 tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/265fd1cf-7727-4f40-97a4-a84abf780641" status: 200 len: 287 microversion: 2.1 time: 0.035959 Apr 16 21:44:21.798407 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3177/6512] 10.222.0.20 () {58 vars in 1250 bytes} [Sat Apr 16 21:44:21 2022] GET /compute/v2.1/os-snapshots/265fd1cf-7727-4f40-97a4-a84abf780641 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:44:21.809542 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d60ab4df-27b3-4dcb-8667-3aa0d3057ee3 tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] Calling method '.version_select at 0x7fbb955a2940>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:21.923005 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d60ab4df-27b3-4dcb-8667-3aa0d3057ee3 tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/265fd1cf-7727-4f40-97a4-a84abf780641" status: 202 len: 0 microversion: 2.1 time: 0.117419 Apr 16 21:44:21.923658 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3336/6513] 10.222.0.20 () {58 vars in 1253 bytes} [Sat Apr 16 21:44:21 2022] DELETE /compute/v2.1/os-snapshots/265fd1cf-7727-4f40-97a4-a84abf780641 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:44:21.932702 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bb688bbb-6dd5-4f1a-a1d6-0c3461e5a49d tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] Calling method '.version_select at 0x7fbb96297ee0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:21.965608 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bb688bbb-6dd5-4f1a-a1d6-0c3461e5a49d tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/265fd1cf-7727-4f40-97a4-a84abf780641" status: 200 len: 286 microversion: 2.1 time: 0.036752 Apr 16 21:44:21.966269 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3178/6514] 10.222.0.20 () {58 vars in 1250 bytes} [Sat Apr 16 21:44:21 2022] GET /compute/v2.1/os-snapshots/265fd1cf-7727-4f40-97a4-a84abf780641 => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:44:22.689234 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-242f6be1-4fa3-4d35-9806-9e68277b4467 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:22.689852 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-242f6be1-4fa3-4d35-9806-9e68277b4467 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:22.696979 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-242f6be1-4fa3-4d35-9806-9e68277b4467 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:22.697438 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-242f6be1-4fa3-4d35-9806-9e68277b4467 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:22.698214 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-242f6be1-4fa3-4d35-9806-9e68277b4467 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:22.698654 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-242f6be1-4fa3-4d35-9806-9e68277b4467 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:22.831926 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-242f6be1-4fa3-4d35-9806-9e68277b4467 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a36974ad8094dcd99951dbc1ce6049e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5279e09b8205420980e8c7accbcc5f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:44:22.840079 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-242f6be1-4fa3-4d35-9806-9e68277b4467 tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f" status: 200 len: 1670 microversion: 2.1 time: 0.154843 Apr 16 21:44:22.840690 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3337/6515] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:22 2022] GET /compute/v2.1/servers/6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:44:22.978347 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-365be1b6-92b9-489b-aaee-991e9c29573f tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] Calling method '.version_select at 0x7fbb96c56dc0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:23.010556 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-365be1b6-92b9-489b-aaee-991e9c29573f tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/265fd1cf-7727-4f40-97a4-a84abf780641" status: 200 len: 286 microversion: 2.1 time: 0.034877 Apr 16 21:44:23.010556 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3179/6516] 10.222.0.20 () {58 vars in 1250 bytes} [Sat Apr 16 21:44:22 2022] GET /compute/v2.1/os-snapshots/265fd1cf-7727-4f40-97a4-a84abf780641 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:44:23.697914 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-158b2249-d1e4-4379-a7d7-26f59219d623 req-b443227b-33ec-4d58-924c-a8424ee93690 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f", "name": "network-vif-deleted", "tag": "a87314d7-f7ef-4a87-97c5-dd497a66d084"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:44:23.707660 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-158b2249-d1e4-4379-a7d7-26f59219d623 req-b443227b-33ec-4d58-924c-a8424ee93690 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:23.708227 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-158b2249-d1e4-4379-a7d7-26f59219d623 req-b443227b-33ec-4d58-924c-a8424ee93690 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:23.720624 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-158b2249-d1e4-4379-a7d7-26f59219d623 req-b443227b-33ec-4d58-924c-a8424ee93690 service nova] Creating event network-vif-deleted:a87314d7-f7ef-4a87-97c5-dd497a66d084 for instance 6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f on nch2-master-1 Apr 16 21:44:23.725853 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-158b2249-d1e4-4379-a7d7-26f59219d623 req-b443227b-33ec-4d58-924c-a8424ee93690 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032333 Apr 16 21:44:23.726651 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3338/6517] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:44:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:44:23.857802 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e56c0008-38a9-4aa8-ae71-a54619afe52f tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:23.858804 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e56c0008-38a9-4aa8-ae71-a54619afe52f tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:23.866288 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e56c0008-38a9-4aa8-ae71-a54619afe52f tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:23.867095 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e56c0008-38a9-4aa8-ae71-a54619afe52f tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:23.868141 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e56c0008-38a9-4aa8-ae71-a54619afe52f tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:23.868789 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e56c0008-38a9-4aa8-ae71-a54619afe52f tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:23.936030 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e56c0008-38a9-4aa8-ae71-a54619afe52f tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a36974ad8094dcd99951dbc1ce6049e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5279e09b8205420980e8c7accbcc5f93', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:44:23.944116 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e56c0008-38a9-4aa8-ae71-a54619afe52f tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f" status: 200 len: 1333 microversion: 2.1 time: 0.090306 Apr 16 21:44:23.961718 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3180/6518] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:23 2022] GET /compute/v2.1/servers/6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f => generated 1333 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:44:24.022080 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2779d473-874c-4680-b092-cc3e474fd640 tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] Calling method '.version_select at 0x7fbb9fe8a310>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:24.056543 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2779d473-874c-4680-b092-cc3e474fd640 tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/265fd1cf-7727-4f40-97a4-a84abf780641" status: 200 len: 286 microversion: 2.1 time: 0.039578 Apr 16 21:44:24.057125 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3339/6519] 10.222.0.20 () {58 vars in 1250 bytes} [Sat Apr 16 21:44:24 2022] GET /compute/v2.1/os-snapshots/265fd1cf-7727-4f40-97a4-a84abf780641 => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:44:24.961887 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2fbb516b-ac89-4ce3-acb0-ddae155c2f1a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:24.962506 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2fbb516b-ac89-4ce3-acb0-ddae155c2f1a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] [instance: 6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:24.969318 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2fbb516b-ac89-4ce3-acb0-ddae155c2f1a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:24.969783 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2fbb516b-ac89-4ce3-acb0-ddae155c2f1a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:24.970574 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2fbb516b-ac89-4ce3-acb0-ddae155c2f1a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:24.971025 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2fbb516b-ac89-4ce3-acb0-ddae155c2f1a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:24.985322 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-2fbb516b-ac89-4ce3-acb0-ddae155c2f1a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] HTTP exception thrown: Instance 6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f could not be found. Apr 16 21:44:24.985940 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2fbb516b-ac89-4ce3-acb0-ddae155c2f1a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Returning 404 to user: Instance 6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:44:24.986812 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2fbb516b-ac89-4ce3-acb0-ddae155c2f1a tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "GET /compute/v2.1/servers/6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f" status: 404 len: 111 microversion: 2.1 time: 0.029127 Apr 16 21:44:24.987357 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3181/6520] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:24 2022] GET /compute/v2.1/servers/6b4da9aa-d72c-40d2-ac99-0b86e8f81d1f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:44:25.070646 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9cbd67ed-c15c-4737-9c50-c8ddb9b3c7a7 tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] Calling method '.version_select at 0x7fbb9fe7b3a0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:25.096557 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-9cbd67ed-c15c-4737-9c50-c8ddb9b3c7a7 tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] HTTP exception thrown: Snapshot 265fd1cf-7727-4f40-97a4-a84abf780641 could not be found. Apr 16 21:44:25.097293 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9cbd67ed-c15c-4737-9c50-c8ddb9b3c7a7 tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] Returning 404 to user: Snapshot 265fd1cf-7727-4f40-97a4-a84abf780641 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:44:25.098225 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9cbd67ed-c15c-4737-9c50-c8ddb9b3c7a7 tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/265fd1cf-7727-4f40-97a4-a84abf780641" status: 404 len: 111 microversion: 2.1 time: 0.033542 Apr 16 21:44:25.098869 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3340/6521] 10.222.0.20 () {58 vars in 1250 bytes} [Sat Apr 16 21:44:25 2022] GET /compute/v2.1/os-snapshots/265fd1cf-7727-4f40-97a4-a84abf780641 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:44:25.107335 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bad15ad2-5ba5-47a9-895e-90ff7bdf43db tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] Calling method '.version_select at 0x7fbb96227ca0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:25.218324 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-43f5ec5e-aeb7-47d5-ae83-4c54cfd16beb tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] Calling method '.version_select at 0x7fbb956c5670>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:25.321994 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bad15ad2-5ba5-47a9-895e-90ff7bdf43db tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/fec8a94a-52da-4bca-82d0-aa3da71ef967" status: 202 len: 0 microversion: 2.1 time: 0.218474 Apr 16 21:44:25.326199 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3182/6522] 10.222.0.20 () {58 vars in 1247 bytes} [Sat Apr 16 21:44:25 2022] DELETE /compute/v2.1/os-volumes/fec8a94a-52da-4bca-82d0-aa3da71ef967 => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:44:25.330252 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-43f5ec5e-aeb7-47d5-ae83-4c54cfd16beb tempest-TestNetworkBasicOps-2083126549 tempest-TestNetworkBasicOps-2083126549-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-211976224" status: 202 len: 0 microversion: 2.1 time: 0.113343 Apr 16 21:44:25.333208 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3341/6523] 10.222.0.20 () {58 vars in 1253 bytes} [Sat Apr 16 21:44:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-211976224 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:44:25.335750 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ff2dba1f-4c23-457e-9cff-079b73613c69 tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] Calling method '.version_select at 0x7fbb957e4550>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:25.399292 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ff2dba1f-4c23-457e-9cff-079b73613c69 tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/fec8a94a-52da-4bca-82d0-aa3da71ef967" status: 200 len: 338 microversion: 2.1 time: 0.068696 Apr 16 21:44:25.399980 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3183/6524] 10.222.0.20 () {58 vars in 1244 bytes} [Sat Apr 16 21:44:25 2022] GET /compute/v2.1/os-volumes/fec8a94a-52da-4bca-82d0-aa3da71ef967 => generated 338 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:44:26.416500 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ae09a322-c1e7-4f9d-a2db-45f9e58cd0ec tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] Calling method '.version_select at 0x7fbb95679e50>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:26.484854 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ae09a322-c1e7-4f9d-a2db-45f9e58cd0ec tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/fec8a94a-52da-4bca-82d0-aa3da71ef967" status: 200 len: 338 microversion: 2.1 time: 0.075674 Apr 16 21:44:26.486970 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3342/6525] 10.222.0.20 () {58 vars in 1244 bytes} [Sat Apr 16 21:44:26 2022] GET /compute/v2.1/os-volumes/fec8a94a-52da-4bca-82d0-aa3da71ef967 => generated 338 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:44:27.499343 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f7f55c0f-d7a4-46c0-b188-30b333951efe tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] Calling method '.version_select at 0x7fbb9ffa7e50>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:27.551108 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f7f55c0f-d7a4-46c0-b188-30b333951efe tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/fec8a94a-52da-4bca-82d0-aa3da71ef967" status: 200 len: 338 microversion: 2.1 time: 0.055550 Apr 16 21:44:27.558552 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3184/6526] 10.222.0.20 () {58 vars in 1244 bytes} [Sat Apr 16 21:44:27 2022] GET /compute/v2.1/os-volumes/fec8a94a-52da-4bca-82d0-aa3da71ef967 => generated 338 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:44:28.567260 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1eaed2aa-1e21-451f-8832-caccdd2119a6 tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] Calling method '.version_select at 0x7fbb956033a0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:28.656128 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1eaed2aa-1e21-451f-8832-caccdd2119a6 tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/fec8a94a-52da-4bca-82d0-aa3da71ef967" status: 200 len: 338 microversion: 2.1 time: 0.095381 Apr 16 21:44:28.657249 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3343/6527] 10.222.0.20 () {58 vars in 1244 bytes} [Sat Apr 16 21:44:28 2022] GET /compute/v2.1/os-volumes/fec8a94a-52da-4bca-82d0-aa3da71ef967 => generated 338 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:44:29.671969 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b3c2ff69-34f5-488f-bdf2-174027b4f664 tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] Calling method '.version_select at 0x7fbb96254700>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:29.734707 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b3c2ff69-34f5-488f-bdf2-174027b4f664 tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/fec8a94a-52da-4bca-82d0-aa3da71ef967" status: 200 len: 338 microversion: 2.1 time: 0.068447 Apr 16 21:44:29.736228 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3185/6528] 10.222.0.20 () {58 vars in 1244 bytes} [Sat Apr 16 21:44:29 2022] GET /compute/v2.1/os-volumes/fec8a94a-52da-4bca-82d0-aa3da71ef967 => generated 338 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:44:30.753560 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-571fcc2b-c78b-4992-9709-a13cdfd2a33c tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] Calling method '.version_select at 0x7fbb95a5eb80>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:30.839104 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-571fcc2b-c78b-4992-9709-a13cdfd2a33c tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] HTTP exception thrown: Volume fec8a94a-52da-4bca-82d0-aa3da71ef967 could not be found. Apr 16 21:44:30.840084 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-571fcc2b-c78b-4992-9709-a13cdfd2a33c tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] Returning 404 to user: Volume fec8a94a-52da-4bca-82d0-aa3da71ef967 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:44:30.841700 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-571fcc2b-c78b-4992-9709-a13cdfd2a33c tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/fec8a94a-52da-4bca-82d0-aa3da71ef967" status: 404 len: 109 microversion: 2.1 time: 0.098488 Apr 16 21:44:30.842682 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3344/6529] 10.222.0.20 () {58 vars in 1244 bytes} [Sat Apr 16 21:44:30 2022] GET /compute/v2.1/os-volumes/fec8a94a-52da-4bca-82d0-aa3da71ef967 => generated 109 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:44:30.856768 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c34d2a1c-8faf-40b9-bf9c-cadbadd732f9 tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] Calling method '.version_select at 0x7fbb9575a040>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:30.936610 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-c34d2a1c-8faf-40b9-bf9c-cadbadd732f9 tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] HTTP exception thrown: Volume fec8a94a-52da-4bca-82d0-aa3da71ef967 could not be found. Apr 16 21:44:30.937329 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c34d2a1c-8faf-40b9-bf9c-cadbadd732f9 tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] Returning 404 to user: Volume fec8a94a-52da-4bca-82d0-aa3da71ef967 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:44:30.938414 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c34d2a1c-8faf-40b9-bf9c-cadbadd732f9 tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/fec8a94a-52da-4bca-82d0-aa3da71ef967" status: 404 len: 109 microversion: 2.1 time: 0.088728 Apr 16 21:44:30.939303 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3186/6530] 10.222.0.20 () {58 vars in 1247 bytes} [Sat Apr 16 21:44:30 2022] DELETE /compute/v2.1/os-volumes/fec8a94a-52da-4bca-82d0-aa3da71ef967 => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:44:31.040440 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0ae777eb-0053-472e-bfe2-63faae8b5f91 tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] Calling method '.version_select at 0x7fbb9572f4c0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:31.095282 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-0ae777eb-0053-472e-bfe2-63faae8b5f91 tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] HTTP exception thrown: Volume fec8a94a-52da-4bca-82d0-aa3da71ef967 could not be found. Apr 16 21:44:31.097390 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0ae777eb-0053-472e-bfe2-63faae8b5f91 tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] Returning 404 to user: Volume fec8a94a-52da-4bca-82d0-aa3da71ef967 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:44:31.098637 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0ae777eb-0053-472e-bfe2-63faae8b5f91 tempest-VolumesSnapshotsTestJSON-1826452390 tempest-VolumesSnapshotsTestJSON-1826452390-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/fec8a94a-52da-4bca-82d0-aa3da71ef967" status: 404 len: 109 microversion: 2.1 time: 0.155316 Apr 16 21:44:31.102273 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3345/6531] 10.222.0.20 () {58 vars in 1244 bytes} [Sat Apr 16 21:44:30 2022] GET /compute/v2.1/os-volumes/fec8a94a-52da-4bca-82d0-aa3da71ef967 => generated 109 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:44:31.458314 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-97cd471a-d02a-4434-a41e-48ca33f61bdb tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1983415385", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "b74be7d4-ad60-4796-9499-3dd51e9f81cf"}], "key_name": "tempest-TestSecurityGroupsBasicOps-941866712", "security_groups": []}, "os:scheduler_hints": {"different_host": ["45de93d5-b2bb-423f-9aec-48c79b81e6fd"]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:44:31.529595 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-97cd471a-d02a-4434-a41e-48ca33f61bdb tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] validate_networks() for [('b74be7d4-ad60-4796-9499-3dd51e9f81cf', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:44:32.237081 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-97cd471a-d02a-4434-a41e-48ca33f61bdb tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:44:32.237682 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-97cd471a-d02a-4434-a41e-48ca33f61bdb tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:44:32.238158 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-97cd471a-d02a-4434-a41e-48ca33f61bdb tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:44:32.238636 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-97cd471a-d02a-4434-a41e-48ca33f61bdb tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:44:32.239165 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-97cd471a-d02a-4434-a41e-48ca33f61bdb tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:44:32.250246 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-97cd471a-d02a-4434-a41e-48ca33f61bdb tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:32.251121 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-97cd471a-d02a-4434-a41e-48ca33f61bdb tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:32.253381 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-97cd471a-d02a-4434-a41e-48ca33f61bdb tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:32.254588 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-97cd471a-d02a-4434-a41e-48ca33f61bdb tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:32.274910 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-97cd471a-d02a-4434-a41e-48ca33f61bdb tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Getting quotas for project b9d0d3b45797487d88c64d6ae767cc18. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:44:32.281858 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-97cd471a-d02a-4434-a41e-48ca33f61bdb tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Getting quotas for user 9213dce366cd4351a55e8e82b4c2f7b6 and project b9d0d3b45797487d88c64d6ae767cc18. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:44:32.294730 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-97cd471a-d02a-4434-a41e-48ca33f61bdb tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:44:32.297081 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-97cd471a-d02a-4434-a41e-48ca33f61bdb tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] [instance: cd96bc57-afee-414c-a2f0-852e8056f737] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:44:32.436067 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-97cd471a-d02a-4434-a41e-48ca33f61bdb tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 0.981982 Apr 16 21:44:32.442770 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3187/6532] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:44:31 2022] POST /compute/v2.1/servers => generated 361 bytes in 990 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:44:32.454446 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a405874c-3d3b-4341-93ec-ddd5081db888 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:32.455836 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a405874c-3d3b-4341-93ec-ddd5081db888 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] [instance: cd96bc57-afee-414c-a2f0-852e8056f737] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:32.538225 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a405874c-3d3b-4341-93ec-ddd5081db888 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9213dce366cd4351a55e8e82b4c2f7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d0d3b45797487d88c64d6ae767cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:44:32.546072 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a405874c-3d3b-4341-93ec-ddd5081db888 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] 10.222.0.20 "GET /compute/v2.1/servers/cd96bc57-afee-414c-a2f0-852e8056f737" status: 200 len: 1241 microversion: 2.1 time: 0.096344 Apr 16 21:44:32.556821 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3346/6533] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:32 2022] GET /compute/v2.1/servers/cd96bc57-afee-414c-a2f0-852e8056f737 => generated 1241 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:44:33.564125 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-70611667-0c14-476a-b8cd-535f3cb6c25e tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:33.565515 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-70611667-0c14-476a-b8cd-535f3cb6c25e tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] [instance: cd96bc57-afee-414c-a2f0-852e8056f737] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:33.572848 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-70611667-0c14-476a-b8cd-535f3cb6c25e tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:33.573390 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-70611667-0c14-476a-b8cd-535f3cb6c25e tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:33.574176 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-70611667-0c14-476a-b8cd-535f3cb6c25e tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:33.574622 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-70611667-0c14-476a-b8cd-535f3cb6c25e tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:34.075221 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-70611667-0c14-476a-b8cd-535f3cb6c25e tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9213dce366cd4351a55e8e82b4c2f7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d0d3b45797487d88c64d6ae767cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:44:34.086388 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-70611667-0c14-476a-b8cd-535f3cb6c25e tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] 10.222.0.20 "GET /compute/v2.1/servers/cd96bc57-afee-414c-a2f0-852e8056f737" status: 200 len: 1245 microversion: 2.1 time: 0.527223 Apr 16 21:44:34.087689 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3188/6534] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:33 2022] GET /compute/v2.1/servers/cd96bc57-afee-414c-a2f0-852e8056f737 => generated 1245 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:44:35.106975 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b4caab26-4b77-4aa3-9259-aa7a37896005 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:35.107803 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b4caab26-4b77-4aa3-9259-aa7a37896005 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] [instance: cd96bc57-afee-414c-a2f0-852e8056f737] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:35.114975 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b4caab26-4b77-4aa3-9259-aa7a37896005 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:35.115434 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b4caab26-4b77-4aa3-9259-aa7a37896005 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:35.116253 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b4caab26-4b77-4aa3-9259-aa7a37896005 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:35.116847 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b4caab26-4b77-4aa3-9259-aa7a37896005 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:35.182135 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b4caab26-4b77-4aa3-9259-aa7a37896005 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9213dce366cd4351a55e8e82b4c2f7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d0d3b45797487d88c64d6ae767cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:44:35.190474 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b4caab26-4b77-4aa3-9259-aa7a37896005 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] 10.222.0.20 "GET /compute/v2.1/servers/cd96bc57-afee-414c-a2f0-852e8056f737" status: 200 len: 1311 microversion: 2.1 time: 0.087490 Apr 16 21:44:35.191050 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3347/6535] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:35 2022] GET /compute/v2.1/servers/cd96bc57-afee-414c-a2f0-852e8056f737 => generated 1311 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:44:36.207229 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f1a489e4-f53d-40b3-8921-3a16c9fb7bdd tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:36.208734 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f1a489e4-f53d-40b3-8921-3a16c9fb7bdd tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] [instance: cd96bc57-afee-414c-a2f0-852e8056f737] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:36.216328 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f1a489e4-f53d-40b3-8921-3a16c9fb7bdd tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:36.221390 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f1a489e4-f53d-40b3-8921-3a16c9fb7bdd tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:36.221390 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f1a489e4-f53d-40b3-8921-3a16c9fb7bdd tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:36.221390 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f1a489e4-f53d-40b3-8921-3a16c9fb7bdd tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:36.400144 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f1a489e4-f53d-40b3-8921-3a16c9fb7bdd tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9213dce366cd4351a55e8e82b4c2f7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d0d3b45797487d88c64d6ae767cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:44:36.411885 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f1a489e4-f53d-40b3-8921-3a16c9fb7bdd tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] 10.222.0.20 "GET /compute/v2.1/servers/cd96bc57-afee-414c-a2f0-852e8056f737" status: 200 len: 1299 microversion: 2.1 time: 0.208779 Apr 16 21:44:36.423077 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3189/6536] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:36 2022] GET /compute/v2.1/servers/cd96bc57-afee-414c-a2f0-852e8056f737 => generated 1299 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:44:36.635162 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-b7a7426a-2cb8-4f93-83fa-7309433bc856 req-4370d18d-5b6e-4311-aaa5-aa98c7233e12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cd96bc57-afee-414c-a2f0-852e8056f737", "tag": "39595c5d-c2b6-43da-a81e-20810d7cadf9"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:44:36.653471 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-b7a7426a-2cb8-4f93-83fa-7309433bc856 req-4370d18d-5b6e-4311-aaa5-aa98c7233e12 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:36.653924 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-b7a7426a-2cb8-4f93-83fa-7309433bc856 req-4370d18d-5b6e-4311-aaa5-aa98c7233e12 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:36.666199 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-b7a7426a-2cb8-4f93-83fa-7309433bc856 req-4370d18d-5b6e-4311-aaa5-aa98c7233e12 service nova] Creating event network-changed:39595c5d-c2b6-43da-a81e-20810d7cadf9 for instance cd96bc57-afee-414c-a2f0-852e8056f737 on nch1-master-1 Apr 16 21:44:36.671240 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-b7a7426a-2cb8-4f93-83fa-7309433bc856 req-4370d18d-5b6e-4311-aaa5-aa98c7233e12 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046915 Apr 16 21:44:36.672134 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3348/6537] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:44:37.435238 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5e2b3636-bdc8-4742-a416-8456350ca8ba tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:37.435238 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5e2b3636-bdc8-4742-a416-8456350ca8ba tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] [instance: cd96bc57-afee-414c-a2f0-852e8056f737] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:37.440185 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5e2b3636-bdc8-4742-a416-8456350ca8ba tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:37.440886 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5e2b3636-bdc8-4742-a416-8456350ca8ba tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:37.441905 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5e2b3636-bdc8-4742-a416-8456350ca8ba tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:37.442505 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5e2b3636-bdc8-4742-a416-8456350ca8ba tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:37.532147 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5e2b3636-bdc8-4742-a416-8456350ca8ba tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9213dce366cd4351a55e8e82b4c2f7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d0d3b45797487d88c64d6ae767cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:44:37.539765 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5e2b3636-bdc8-4742-a416-8456350ca8ba tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] 10.222.0.20 "GET /compute/v2.1/servers/cd96bc57-afee-414c-a2f0-852e8056f737" status: 200 len: 1299 microversion: 2.1 time: 0.112796 Apr 16 21:44:37.540374 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3190/6538] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:37 2022] GET /compute/v2.1/servers/cd96bc57-afee-414c-a2f0-852e8056f737 => generated 1299 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:44:38.561433 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-50725ef4-d9b0-4adf-aa86-c5471e602cb7 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:38.562137 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-50725ef4-d9b0-4adf-aa86-c5471e602cb7 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] [instance: cd96bc57-afee-414c-a2f0-852e8056f737] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:38.568855 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-50725ef4-d9b0-4adf-aa86-c5471e602cb7 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:38.569514 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-50725ef4-d9b0-4adf-aa86-c5471e602cb7 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:38.570306 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-50725ef4-d9b0-4adf-aa86-c5471e602cb7 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:38.570750 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-50725ef4-d9b0-4adf-aa86-c5471e602cb7 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:38.665333 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-50725ef4-d9b0-4adf-aa86-c5471e602cb7 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9213dce366cd4351a55e8e82b4c2f7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d0d3b45797487d88c64d6ae767cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:44:38.674529 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-50725ef4-d9b0-4adf-aa86-c5471e602cb7 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] 10.222.0.20 "GET /compute/v2.1/servers/cd96bc57-afee-414c-a2f0-852e8056f737" status: 200 len: 1299 microversion: 2.1 time: 0.117525 Apr 16 21:44:38.675450 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3349/6539] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:38 2022] GET /compute/v2.1/servers/cd96bc57-afee-414c-a2f0-852e8056f737 => generated 1299 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:44:39.692032 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b9dc3306-d02e-4b96-8d3f-270d469fd9b8 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:39.692676 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b9dc3306-d02e-4b96-8d3f-270d469fd9b8 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] [instance: cd96bc57-afee-414c-a2f0-852e8056f737] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:39.699572 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b9dc3306-d02e-4b96-8d3f-270d469fd9b8 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:39.700020 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b9dc3306-d02e-4b96-8d3f-270d469fd9b8 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:39.700826 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b9dc3306-d02e-4b96-8d3f-270d469fd9b8 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:39.701277 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b9dc3306-d02e-4b96-8d3f-270d469fd9b8 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:39.788401 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b9dc3306-d02e-4b96-8d3f-270d469fd9b8 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9213dce366cd4351a55e8e82b4c2f7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d0d3b45797487d88c64d6ae767cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:44:39.796462 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b9dc3306-d02e-4b96-8d3f-270d469fd9b8 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] 10.222.0.20 "GET /compute/v2.1/servers/cd96bc57-afee-414c-a2f0-852e8056f737" status: 200 len: 1299 microversion: 2.1 time: 0.108553 Apr 16 21:44:39.797267 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3191/6540] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:39 2022] GET /compute/v2.1/servers/cd96bc57-afee-414c-a2f0-852e8056f737 => generated 1299 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:44:40.813306 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9afde483-27c4-4b8e-aecc-15743ed3ddde tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:40.813927 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9afde483-27c4-4b8e-aecc-15743ed3ddde tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] [instance: cd96bc57-afee-414c-a2f0-852e8056f737] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:40.822304 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9afde483-27c4-4b8e-aecc-15743ed3ddde tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:40.822639 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9afde483-27c4-4b8e-aecc-15743ed3ddde tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:40.823616 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9afde483-27c4-4b8e-aecc-15743ed3ddde tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:40.824412 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9afde483-27c4-4b8e-aecc-15743ed3ddde tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:40.911772 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9afde483-27c4-4b8e-aecc-15743ed3ddde tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9213dce366cd4351a55e8e82b4c2f7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d0d3b45797487d88c64d6ae767cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:44:40.919208 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9afde483-27c4-4b8e-aecc-15743ed3ddde tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] 10.222.0.20 "GET /compute/v2.1/servers/cd96bc57-afee-414c-a2f0-852e8056f737" status: 200 len: 1299 microversion: 2.1 time: 0.109899 Apr 16 21:44:40.919771 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3350/6541] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:40 2022] GET /compute/v2.1/servers/cd96bc57-afee-414c-a2f0-852e8056f737 => generated 1299 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:44:41.936241 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3cf002f9-2899-4aec-b347-275a050e6501 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:41.936853 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3cf002f9-2899-4aec-b347-275a050e6501 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] [instance: cd96bc57-afee-414c-a2f0-852e8056f737] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:41.943923 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3cf002f9-2899-4aec-b347-275a050e6501 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:41.944422 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3cf002f9-2899-4aec-b347-275a050e6501 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:41.945216 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3cf002f9-2899-4aec-b347-275a050e6501 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:41.945662 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3cf002f9-2899-4aec-b347-275a050e6501 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:42.039795 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3cf002f9-2899-4aec-b347-275a050e6501 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9213dce366cd4351a55e8e82b4c2f7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d0d3b45797487d88c64d6ae767cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:44:42.040986 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3cf002f9-2899-4aec-b347-275a050e6501 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] 10.222.0.20 "GET /compute/v2.1/servers/cd96bc57-afee-414c-a2f0-852e8056f737" status: 200 len: 1299 microversion: 2.1 time: 0.108660 Apr 16 21:44:42.041565 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3192/6542] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:41 2022] GET /compute/v2.1/servers/cd96bc57-afee-414c-a2f0-852e8056f737 => generated 1299 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:44:42.530045 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-72de1fbd-3fc0-459f-8f06-650807243b07 req-4a30691a-9beb-444e-84e7-74517edccfea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd96bc57-afee-414c-a2f0-852e8056f737", "name": "network-vif-plugged", "status": "completed", "tag": "39595c5d-c2b6-43da-a81e-20810d7cadf9"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:44:42.541043 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-72de1fbd-3fc0-459f-8f06-650807243b07 req-4a30691a-9beb-444e-84e7-74517edccfea service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:42.541753 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-72de1fbd-3fc0-459f-8f06-650807243b07 req-4a30691a-9beb-444e-84e7-74517edccfea service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:42.557306 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-72de1fbd-3fc0-459f-8f06-650807243b07 req-4a30691a-9beb-444e-84e7-74517edccfea service nova] Creating event network-vif-plugged:39595c5d-c2b6-43da-a81e-20810d7cadf9 for instance cd96bc57-afee-414c-a2f0-852e8056f737 on nch1-master-1 Apr 16 21:44:42.566741 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-72de1fbd-3fc0-459f-8f06-650807243b07 req-4a30691a-9beb-444e-84e7-74517edccfea service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040445 Apr 16 21:44:42.568432 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3351/6543] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:44:43.058075 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d21ec78a-67f8-41c1-93e0-28f5255bd967 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:43.058692 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d21ec78a-67f8-41c1-93e0-28f5255bd967 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] [instance: cd96bc57-afee-414c-a2f0-852e8056f737] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:43.065829 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d21ec78a-67f8-41c1-93e0-28f5255bd967 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:43.066294 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d21ec78a-67f8-41c1-93e0-28f5255bd967 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:43.067290 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d21ec78a-67f8-41c1-93e0-28f5255bd967 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:43.067731 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d21ec78a-67f8-41c1-93e0-28f5255bd967 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:43.174145 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d21ec78a-67f8-41c1-93e0-28f5255bd967 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9213dce366cd4351a55e8e82b4c2f7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d0d3b45797487d88c64d6ae767cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:44:43.181716 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d21ec78a-67f8-41c1-93e0-28f5255bd967 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] 10.222.0.20 "GET /compute/v2.1/servers/cd96bc57-afee-414c-a2f0-852e8056f737" status: 200 len: 1299 microversion: 2.1 time: 0.127614 Apr 16 21:44:43.182566 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3193/6544] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:43 2022] GET /compute/v2.1/servers/cd96bc57-afee-414c-a2f0-852e8056f737 => generated 1299 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:44:44.198239 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-49f916bd-830e-4c41-9756-9d1365f788c4 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:44.198942 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-49f916bd-830e-4c41-9756-9d1365f788c4 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] [instance: cd96bc57-afee-414c-a2f0-852e8056f737] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:44.206041 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-49f916bd-830e-4c41-9756-9d1365f788c4 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:44.208939 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-49f916bd-830e-4c41-9756-9d1365f788c4 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:44.208939 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-49f916bd-830e-4c41-9756-9d1365f788c4 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:44.208939 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-49f916bd-830e-4c41-9756-9d1365f788c4 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:44.324559 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-49f916bd-830e-4c41-9756-9d1365f788c4 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9213dce366cd4351a55e8e82b4c2f7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d0d3b45797487d88c64d6ae767cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:44:44.332013 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-49f916bd-830e-4c41-9756-9d1365f788c4 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] 10.222.0.20 "GET /compute/v2.1/servers/cd96bc57-afee-414c-a2f0-852e8056f737" status: 200 len: 1472 microversion: 2.1 time: 0.137837 Apr 16 21:44:44.332624 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3352/6545] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:44 2022] GET /compute/v2.1/servers/cd96bc57-afee-414c-a2f0-852e8056f737 => generated 1472 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:44:44.348645 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3fb3bdc4-c694-4b13-a843-469c8dc0ef8d tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:44.363658 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3fb3bdc4-c694-4b13-a843-469c8dc0ef8d tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] [instance: cd96bc57-afee-414c-a2f0-852e8056f737] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:44.363658 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3fb3bdc4-c694-4b13-a843-469c8dc0ef8d tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:44.363658 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3fb3bdc4-c694-4b13-a843-469c8dc0ef8d tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:44.363658 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3fb3bdc4-c694-4b13-a843-469c8dc0ef8d tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:44.363658 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3fb3bdc4-c694-4b13-a843-469c8dc0ef8d tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:44.441624 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3fb3bdc4-c694-4b13-a843-469c8dc0ef8d tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9213dce366cd4351a55e8e82b4c2f7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d0d3b45797487d88c64d6ae767cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:44:44.449377 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3fb3bdc4-c694-4b13-a843-469c8dc0ef8d tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] 10.222.0.20 "GET /compute/v2.1/servers/cd96bc57-afee-414c-a2f0-852e8056f737" status: 200 len: 1472 microversion: 2.1 time: 0.104990 Apr 16 21:44:44.449963 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3194/6546] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:44 2022] GET /compute/v2.1/servers/cd96bc57-afee-414c-a2f0-852e8056f737 => generated 1472 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:44:44.465404 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-188024b2-68c3-49d8-8897-141858bb0155 tempest-TestSecurityGroupsBasicOps-1778137446 tempest-TestSecurityGroupsBasicOps-1778137446-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:44.466113 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-188024b2-68c3-49d8-8897-141858bb0155 tempest-TestSecurityGroupsBasicOps-1778137446 tempest-TestSecurityGroupsBasicOps-1778137446-project-admin] [instance: cd96bc57-afee-414c-a2f0-852e8056f737] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:44.472683 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-188024b2-68c3-49d8-8897-141858bb0155 tempest-TestSecurityGroupsBasicOps-1778137446 tempest-TestSecurityGroupsBasicOps-1778137446-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:44.473333 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-188024b2-68c3-49d8-8897-141858bb0155 tempest-TestSecurityGroupsBasicOps-1778137446 tempest-TestSecurityGroupsBasicOps-1778137446-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:44.478259 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-188024b2-68c3-49d8-8897-141858bb0155 tempest-TestSecurityGroupsBasicOps-1778137446 tempest-TestSecurityGroupsBasicOps-1778137446-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:44.478259 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-188024b2-68c3-49d8-8897-141858bb0155 tempest-TestSecurityGroupsBasicOps-1778137446 tempest-TestSecurityGroupsBasicOps-1778137446-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:44.595618 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-188024b2-68c3-49d8-8897-141858bb0155 tempest-TestSecurityGroupsBasicOps-1778137446 tempest-TestSecurityGroupsBasicOps-1778137446-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/cd96bc57-afee-414c-a2f0-852e8056f737" status: 200 len: 1623 microversion: 2.1 time: 0.131953 Apr 16 21:44:44.595618 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3353/6547] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:44 2022] GET /compute/v2.1/servers/cd96bc57-afee-414c-a2f0-852e8056f737 => generated 1623 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:44:44.609812 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e0a0a159-47b1-4ffa-ac62-2244ef3890ec tempest-TestSecurityGroupsBasicOps-1778137446 tempest-TestSecurityGroupsBasicOps-1778137446-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:44.610431 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e0a0a159-47b1-4ffa-ac62-2244ef3890ec tempest-TestSecurityGroupsBasicOps-1778137446 tempest-TestSecurityGroupsBasicOps-1778137446-project-admin] [instance: 45de93d5-b2bb-423f-9aec-48c79b81e6fd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:44.617325 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e0a0a159-47b1-4ffa-ac62-2244ef3890ec tempest-TestSecurityGroupsBasicOps-1778137446 tempest-TestSecurityGroupsBasicOps-1778137446-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:44.617787 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e0a0a159-47b1-4ffa-ac62-2244ef3890ec tempest-TestSecurityGroupsBasicOps-1778137446 tempest-TestSecurityGroupsBasicOps-1778137446-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:44.619880 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e0a0a159-47b1-4ffa-ac62-2244ef3890ec tempest-TestSecurityGroupsBasicOps-1778137446 tempest-TestSecurityGroupsBasicOps-1778137446-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:44.619880 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e0a0a159-47b1-4ffa-ac62-2244ef3890ec tempest-TestSecurityGroupsBasicOps-1778137446 tempest-TestSecurityGroupsBasicOps-1778137446-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:44.763276 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e0a0a159-47b1-4ffa-ac62-2244ef3890ec tempest-TestSecurityGroupsBasicOps-1778137446 tempest-TestSecurityGroupsBasicOps-1778137446-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/45de93d5-b2bb-423f-9aec-48c79b81e6fd" status: 200 len: 1912 microversion: 2.1 time: 0.157157 Apr 16 21:44:44.763867 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3195/6548] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:44 2022] GET /compute/v2.1/servers/45de93d5-b2bb-423f-9aec-48c79b81e6fd => generated 1912 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:44:44.824073 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-50927836-1ba4-4b5e-84e4-386ec041d93e tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:44.824660 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-50927836-1ba4-4b5e-84e4-386ec041d93e tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] [instance: cd96bc57-afee-414c-a2f0-852e8056f737] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:44.830643 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-50927836-1ba4-4b5e-84e4-386ec041d93e tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:44.831115 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-50927836-1ba4-4b5e-84e4-386ec041d93e tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:44.831909 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-50927836-1ba4-4b5e-84e4-386ec041d93e tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:44.832397 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-50927836-1ba4-4b5e-84e4-386ec041d93e tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:44.857329 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-50927836-1ba4-4b5e-84e4-386ec041d93e tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] [instance: cd96bc57-afee-414c-a2f0-852e8056f737] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:44:45.193949 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-50927836-1ba4-4b5e-84e4-386ec041d93e tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] 10.222.0.20 "DELETE /compute/v2.1/servers/cd96bc57-afee-414c-a2f0-852e8056f737" status: 204 len: 0 microversion: 2.1 time: 0.371382 Apr 16 21:44:45.203101 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5fbc7709-987a-42c8-8ce1-b45b81c27134 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:45.203805 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5fbc7709-987a-42c8-8ce1-b45b81c27134 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] [instance: cd96bc57-afee-414c-a2f0-852e8056f737] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:45.205057 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3354/6549] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:44:44 2022] DELETE /compute/v2.1/servers/cd96bc57-afee-414c-a2f0-852e8056f737 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:44:45.211148 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5fbc7709-987a-42c8-8ce1-b45b81c27134 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:45.211674 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5fbc7709-987a-42c8-8ce1-b45b81c27134 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:45.213110 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5fbc7709-987a-42c8-8ce1-b45b81c27134 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:45.213638 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5fbc7709-987a-42c8-8ce1-b45b81c27134 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:45.317884 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5fbc7709-987a-42c8-8ce1-b45b81c27134 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9213dce366cd4351a55e8e82b4c2f7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d0d3b45797487d88c64d6ae767cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:44:45.326163 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5fbc7709-987a-42c8-8ce1-b45b81c27134 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] 10.222.0.20 "GET /compute/v2.1/servers/cd96bc57-afee-414c-a2f0-852e8056f737" status: 200 len: 1478 microversion: 2.1 time: 0.127668 Apr 16 21:44:45.327407 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3196/6550] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:45 2022] GET /compute/v2.1/servers/cd96bc57-afee-414c-a2f0-852e8056f737 => generated 1478 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:44:45.727913 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-41afdf9a-f6de-412c-beab-ef3ee2061b01 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1033310337", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "7357ee69-bede-4b55-a14b-94cda7691368"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:44:45.777921 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-41afdf9a-f6de-412c-beab-ef3ee2061b01 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] validate_networks() for [('7357ee69-bede-4b55-a14b-94cda7691368', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:44:46.226976 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-41afdf9a-f6de-412c-beab-ef3ee2061b01 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:44:46.227567 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-41afdf9a-f6de-412c-beab-ef3ee2061b01 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:44:46.227852 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-41afdf9a-f6de-412c-beab-ef3ee2061b01 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:44:46.228296 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-41afdf9a-f6de-412c-beab-ef3ee2061b01 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:44:46.228717 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-41afdf9a-f6de-412c-beab-ef3ee2061b01 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:44:46.238456 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-41afdf9a-f6de-412c-beab-ef3ee2061b01 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:46.238918 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-41afdf9a-f6de-412c-beab-ef3ee2061b01 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:46.239738 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-41afdf9a-f6de-412c-beab-ef3ee2061b01 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:46.240432 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-41afdf9a-f6de-412c-beab-ef3ee2061b01 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:46.257478 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-41afdf9a-f6de-412c-beab-ef3ee2061b01 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Getting quotas for project a812c01aa9574c9abb3ae67bf117ce3c. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:44:46.262706 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-41afdf9a-f6de-412c-beab-ef3ee2061b01 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Getting quotas for user 418700d27b044ee797d574625d4352f5 and project a812c01aa9574c9abb3ae67bf117ce3c. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:44:46.274761 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-41afdf9a-f6de-412c-beab-ef3ee2061b01 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:44:46.277087 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-41afdf9a-f6de-412c-beab-ef3ee2061b01 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] [instance: 9f452fb7-6767-4bbd-96f0-81b4e7bfd2db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:44:46.344530 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7e428630-490c-4c50-a2b0-ee04ac911cb2 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:46.345804 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7e428630-490c-4c50-a2b0-ee04ac911cb2 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] [instance: cd96bc57-afee-414c-a2f0-852e8056f737] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:46.352836 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7e428630-490c-4c50-a2b0-ee04ac911cb2 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:46.353368 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7e428630-490c-4c50-a2b0-ee04ac911cb2 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:46.354233 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7e428630-490c-4c50-a2b0-ee04ac911cb2 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:46.354747 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7e428630-490c-4c50-a2b0-ee04ac911cb2 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:46.396389 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-41afdf9a-f6de-412c-beab-ef3ee2061b01 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.907388 Apr 16 21:44:46.397868 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3355/6551] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:44:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 910 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:44:46.409183 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3585fcb0-9d27-49ec-b588-b4981ebe9a40 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:46.409984 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3585fcb0-9d27-49ec-b588-b4981ebe9a40 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] [instance: 9f452fb7-6767-4bbd-96f0-81b4e7bfd2db] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:46.450050 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7e428630-490c-4c50-a2b0-ee04ac911cb2 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9213dce366cd4351a55e8e82b4c2f7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d0d3b45797487d88c64d6ae767cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:44:46.463140 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7e428630-490c-4c50-a2b0-ee04ac911cb2 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] 10.222.0.20 "GET /compute/v2.1/servers/cd96bc57-afee-414c-a2f0-852e8056f737" status: 200 len: 1478 microversion: 2.1 time: 0.122756 Apr 16 21:44:46.463848 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3197/6552] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:46 2022] GET /compute/v2.1/servers/cd96bc57-afee-414c-a2f0-852e8056f737 => generated 1478 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:44:46.479933 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3585fcb0-9d27-49ec-b588-b4981ebe9a40 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418700d27b044ee797d574625d4352f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a812c01aa9574c9abb3ae67bf117ce3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:44:46.487087 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3585fcb0-9d27-49ec-b588-b4981ebe9a40 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] 10.222.0.20 "GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db" status: 200 len: 1215 microversion: 2.1 time: 0.083413 Apr 16 21:44:46.487696 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3356/6553] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:46 2022] GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db => generated 1215 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:44:47.084426 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-65d37703-d114-4ca5-ad20-0d55849b46b9 req-e12a2a71-3040-4be9-978a-65b38bb8a0b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd96bc57-afee-414c-a2f0-852e8056f737", "name": "network-vif-deleted", "tag": "39595c5d-c2b6-43da-a81e-20810d7cadf9"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:44:47.097593 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-65d37703-d114-4ca5-ad20-0d55849b46b9 req-e12a2a71-3040-4be9-978a-65b38bb8a0b0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:47.098047 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-65d37703-d114-4ca5-ad20-0d55849b46b9 req-e12a2a71-3040-4be9-978a-65b38bb8a0b0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:47.110787 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-65d37703-d114-4ca5-ad20-0d55849b46b9 req-e12a2a71-3040-4be9-978a-65b38bb8a0b0 service nova] Creating event network-vif-deleted:39595c5d-c2b6-43da-a81e-20810d7cadf9 for instance cd96bc57-afee-414c-a2f0-852e8056f737 on nch1-master-1 Apr 16 21:44:47.116019 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-65d37703-d114-4ca5-ad20-0d55849b46b9 req-e12a2a71-3040-4be9-978a-65b38bb8a0b0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036032 Apr 16 21:44:47.116679 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3198/6554] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:44:47.481184 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7e720023-0b6d-433d-b84f-4ff40799623f tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:47.481866 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7e720023-0b6d-433d-b84f-4ff40799623f tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] [instance: cd96bc57-afee-414c-a2f0-852e8056f737] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:47.489565 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7e720023-0b6d-433d-b84f-4ff40799623f tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:47.490029 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7e720023-0b6d-433d-b84f-4ff40799623f tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:47.490846 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7e720023-0b6d-433d-b84f-4ff40799623f tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:47.491294 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7e720023-0b6d-433d-b84f-4ff40799623f tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:47.506609 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f3e9baed-6204-4cc5-8dc6-58c07f6dcf88 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:47.507188 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f3e9baed-6204-4cc5-8dc6-58c07f6dcf88 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] [instance: 9f452fb7-6767-4bbd-96f0-81b4e7bfd2db] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:47.514278 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f3e9baed-6204-4cc5-8dc6-58c07f6dcf88 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:47.514746 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f3e9baed-6204-4cc5-8dc6-58c07f6dcf88 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:47.515576 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f3e9baed-6204-4cc5-8dc6-58c07f6dcf88 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:47.516033 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f3e9baed-6204-4cc5-8dc6-58c07f6dcf88 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:47.528767 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7e720023-0b6d-433d-b84f-4ff40799623f tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:47.529232 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7e720023-0b6d-433d-b84f-4ff40799623f tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:47.529706 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-7e720023-0b6d-433d-b84f-4ff40799623f tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lazy-loading 'fault' on Instance uuid cd96bc57-afee-414c-a2f0-852e8056f737 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:44:47.580978 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7e720023-0b6d-433d-b84f-4ff40799623f tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9213dce366cd4351a55e8e82b4c2f7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d0d3b45797487d88c64d6ae767cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:44:47.581403 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f3e9baed-6204-4cc5-8dc6-58c07f6dcf88 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418700d27b044ee797d574625d4352f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a812c01aa9574c9abb3ae67bf117ce3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:44:47.589979 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f3e9baed-6204-4cc5-8dc6-58c07f6dcf88 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] 10.222.0.20 "GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db" status: 200 len: 1219 microversion: 2.1 time: 0.089628 Apr 16 21:44:47.591074 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3199/6555] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:47 2022] GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:44:47.594828 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7e720023-0b6d-433d-b84f-4ff40799623f tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] 10.222.0.20 "GET /compute/v2.1/servers/cd96bc57-afee-414c-a2f0-852e8056f737" status: 200 len: 1331 microversion: 2.1 time: 0.113943 Apr 16 21:44:47.594828 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3357/6556] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:47 2022] GET /compute/v2.1/servers/cd96bc57-afee-414c-a2f0-852e8056f737 => generated 1331 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:44:48.607536 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f0f55755-8730-4b8c-a117-8ff965e66648 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:48.608148 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f0f55755-8730-4b8c-a117-8ff965e66648 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] [instance: 9f452fb7-6767-4bbd-96f0-81b4e7bfd2db] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:48.608993 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-676ad135-dddc-4f55-9702-fddbd2307633 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:48.609552 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-676ad135-dddc-4f55-9702-fddbd2307633 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] [instance: cd96bc57-afee-414c-a2f0-852e8056f737] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:48.615506 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f0f55755-8730-4b8c-a117-8ff965e66648 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:48.615967 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f0f55755-8730-4b8c-a117-8ff965e66648 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:48.616681 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-676ad135-dddc-4f55-9702-fddbd2307633 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:48.617150 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-676ad135-dddc-4f55-9702-fddbd2307633 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:48.617533 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f0f55755-8730-4b8c-a117-8ff965e66648 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:48.617939 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-676ad135-dddc-4f55-9702-fddbd2307633 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:48.618048 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f0f55755-8730-4b8c-a117-8ff965e66648 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:48.618386 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-676ad135-dddc-4f55-9702-fddbd2307633 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:48.634103 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-676ad135-dddc-4f55-9702-fddbd2307633 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] HTTP exception thrown: Instance cd96bc57-afee-414c-a2f0-852e8056f737 could not be found. Apr 16 21:44:48.635005 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-676ad135-dddc-4f55-9702-fddbd2307633 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Returning 404 to user: Instance cd96bc57-afee-414c-a2f0-852e8056f737 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:44:48.636019 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-676ad135-dddc-4f55-9702-fddbd2307633 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] 10.222.0.20 "GET /compute/v2.1/servers/cd96bc57-afee-414c-a2f0-852e8056f737" status: 404 len: 111 microversion: 2.1 time: 0.030944 Apr 16 21:44:48.636603 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3358/6557] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:48 2022] GET /compute/v2.1/servers/cd96bc57-afee-414c-a2f0-852e8056f737 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:44:48.731891 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f0f55755-8730-4b8c-a117-8ff965e66648 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418700d27b044ee797d574625d4352f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a812c01aa9574c9abb3ae67bf117ce3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:44:48.741535 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f0f55755-8730-4b8c-a117-8ff965e66648 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] 10.222.0.20 "GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db" status: 200 len: 1275 microversion: 2.1 time: 0.137556 Apr 16 21:44:48.741535 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3200/6558] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:48 2022] GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db => generated 1275 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:44:49.757746 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0245161b-f46f-4925-906f-53b8d32ebe30 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:49.758370 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0245161b-f46f-4925-906f-53b8d32ebe30 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] [instance: 9f452fb7-6767-4bbd-96f0-81b4e7bfd2db] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:49.765255 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0245161b-f46f-4925-906f-53b8d32ebe30 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:49.765744 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0245161b-f46f-4925-906f-53b8d32ebe30 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:49.767178 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0245161b-f46f-4925-906f-53b8d32ebe30 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:49.767647 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0245161b-f46f-4925-906f-53b8d32ebe30 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:49.832464 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0245161b-f46f-4925-906f-53b8d32ebe30 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418700d27b044ee797d574625d4352f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a812c01aa9574c9abb3ae67bf117ce3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:44:49.839903 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0245161b-f46f-4925-906f-53b8d32ebe30 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] 10.222.0.20 "GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db" status: 200 len: 1273 microversion: 2.1 time: 0.086010 Apr 16 21:44:49.840508 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3359/6559] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:49 2022] GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db => generated 1273 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:44:50.862272 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b3e8228f-47e3-4335-a87f-04beb2f6e2f3 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:50.863517 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b3e8228f-47e3-4335-a87f-04beb2f6e2f3 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] [instance: 9f452fb7-6767-4bbd-96f0-81b4e7bfd2db] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:50.874761 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b3e8228f-47e3-4335-a87f-04beb2f6e2f3 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:50.875222 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b3e8228f-47e3-4335-a87f-04beb2f6e2f3 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:50.876040 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b3e8228f-47e3-4335-a87f-04beb2f6e2f3 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:50.876509 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b3e8228f-47e3-4335-a87f-04beb2f6e2f3 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:51.129993 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b3e8228f-47e3-4335-a87f-04beb2f6e2f3 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418700d27b044ee797d574625d4352f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a812c01aa9574c9abb3ae67bf117ce3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:44:51.137953 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b3e8228f-47e3-4335-a87f-04beb2f6e2f3 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] 10.222.0.20 "GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db" status: 200 len: 1315 microversion: 2.1 time: 0.280094 Apr 16 21:44:51.139113 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3201/6560] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:50 2022] GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db => generated 1315 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:44:51.833143 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-4bcaa5fc-a6d1-4d1a-88dc-d80ba547203f req-00be5a68-1d74-480c-83b7-a2bdffae8868 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f452fb7-6767-4bbd-96f0-81b4e7bfd2db", "tag": "7d23f851-895e-4529-9088-669809a7d0ac"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:44:51.843418 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-4bcaa5fc-a6d1-4d1a-88dc-d80ba547203f req-00be5a68-1d74-480c-83b7-a2bdffae8868 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:51.844394 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-4bcaa5fc-a6d1-4d1a-88dc-d80ba547203f req-00be5a68-1d74-480c-83b7-a2bdffae8868 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:51.856880 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-4bcaa5fc-a6d1-4d1a-88dc-d80ba547203f req-00be5a68-1d74-480c-83b7-a2bdffae8868 service nova] Creating event network-changed:7d23f851-895e-4529-9088-669809a7d0ac for instance 9f452fb7-6767-4bbd-96f0-81b4e7bfd2db on nch2-master-1 Apr 16 21:44:51.864623 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-4bcaa5fc-a6d1-4d1a-88dc-d80ba547203f req-00be5a68-1d74-480c-83b7-a2bdffae8868 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035094 Apr 16 21:44:51.866005 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3360/6561] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:44:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:44:52.158112 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f0a26052-822c-4cbe-89b4-3bc0ca23d707 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:52.158838 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f0a26052-822c-4cbe-89b4-3bc0ca23d707 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] [instance: 9f452fb7-6767-4bbd-96f0-81b4e7bfd2db] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:52.176811 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f0a26052-822c-4cbe-89b4-3bc0ca23d707 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:52.177524 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f0a26052-822c-4cbe-89b4-3bc0ca23d707 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:52.179498 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f0a26052-822c-4cbe-89b4-3bc0ca23d707 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:52.180858 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f0a26052-822c-4cbe-89b4-3bc0ca23d707 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:52.469936 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f0a26052-822c-4cbe-89b4-3bc0ca23d707 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418700d27b044ee797d574625d4352f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a812c01aa9574c9abb3ae67bf117ce3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:44:52.478790 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f0a26052-822c-4cbe-89b4-3bc0ca23d707 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] 10.222.0.20 "GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db" status: 200 len: 1315 microversion: 2.1 time: 0.327107 Apr 16 21:44:52.480708 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3202/6562] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:52 2022] GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db => generated 1315 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:44:53.500493 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-abfa799b-b494-458a-9088-69bcbad13ba8 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:53.501366 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-abfa799b-b494-458a-9088-69bcbad13ba8 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] [instance: 9f452fb7-6767-4bbd-96f0-81b4e7bfd2db] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:53.508843 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-abfa799b-b494-458a-9088-69bcbad13ba8 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:53.510953 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-abfa799b-b494-458a-9088-69bcbad13ba8 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:53.510953 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-abfa799b-b494-458a-9088-69bcbad13ba8 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:53.510953 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-abfa799b-b494-458a-9088-69bcbad13ba8 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:53.725935 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-abfa799b-b494-458a-9088-69bcbad13ba8 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418700d27b044ee797d574625d4352f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a812c01aa9574c9abb3ae67bf117ce3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:44:53.737755 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-abfa799b-b494-458a-9088-69bcbad13ba8 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] 10.222.0.20 "GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db" status: 200 len: 1315 microversion: 2.1 time: 0.239319 Apr 16 21:44:53.738692 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3361/6563] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:53 2022] GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:44:54.754884 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fa3a7e78-eb98-4c59-b09a-d2623d8ad7ba tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:54.755521 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-fa3a7e78-eb98-4c59-b09a-d2623d8ad7ba tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] [instance: 9f452fb7-6767-4bbd-96f0-81b4e7bfd2db] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:54.762351 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fa3a7e78-eb98-4c59-b09a-d2623d8ad7ba tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:54.762810 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fa3a7e78-eb98-4c59-b09a-d2623d8ad7ba tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:54.763603 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fa3a7e78-eb98-4c59-b09a-d2623d8ad7ba tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:54.764031 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fa3a7e78-eb98-4c59-b09a-d2623d8ad7ba tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:54.847145 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2bb3e6a0-c9bb-4b87-9363-352a7c77c316 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:54.847674 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2bb3e6a0-c9bb-4b87-9363-352a7c77c316 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] [instance: 45de93d5-b2bb-423f-9aec-48c79b81e6fd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:54.855472 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2bb3e6a0-c9bb-4b87-9363-352a7c77c316 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:54.856056 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2bb3e6a0-c9bb-4b87-9363-352a7c77c316 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:54.856986 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2bb3e6a0-c9bb-4b87-9363-352a7c77c316 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:54.857615 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2bb3e6a0-c9bb-4b87-9363-352a7c77c316 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:54.895027 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2bb3e6a0-c9bb-4b87-9363-352a7c77c316 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] [instance: 45de93d5-b2bb-423f-9aec-48c79b81e6fd] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:44:54.965077 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-fa3a7e78-eb98-4c59-b09a-d2623d8ad7ba tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418700d27b044ee797d574625d4352f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a812c01aa9574c9abb3ae67bf117ce3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:44:54.974617 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fa3a7e78-eb98-4c59-b09a-d2623d8ad7ba tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] 10.222.0.20 "GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db" status: 200 len: 1315 microversion: 2.1 time: 0.223529 Apr 16 21:44:54.975406 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3203/6564] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:54 2022] GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db => generated 1315 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:44:54.982027 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-6487d60f-2fe8-4967-a9c8-f993261871a1 req-556c3ddc-3747-426a-b973-c153385809b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45de93d5-b2bb-423f-9aec-48c79b81e6fd", "tag": "c4d5001d-e0c4-4dba-9703-42704badf73f"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:44:54.990670 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-6487d60f-2fe8-4967-a9c8-f993261871a1 req-556c3ddc-3747-426a-b973-c153385809b1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:54.991127 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-6487d60f-2fe8-4967-a9c8-f993261871a1 req-556c3ddc-3747-426a-b973-c153385809b1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:55.004113 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-6487d60f-2fe8-4967-a9c8-f993261871a1 req-556c3ddc-3747-426a-b973-c153385809b1 service nova] Creating event network-changed:c4d5001d-e0c4-4dba-9703-42704badf73f for instance 45de93d5-b2bb-423f-9aec-48c79b81e6fd on nch2-master-1 Apr 16 21:44:55.010285 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-6487d60f-2fe8-4967-a9c8-f993261871a1 req-556c3ddc-3747-426a-b973-c153385809b1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032497 Apr 16 21:44:55.011170 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3204/6565] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:44:55.262749 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2bb3e6a0-c9bb-4b87-9363-352a7c77c316 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] 10.222.0.20 "DELETE /compute/v2.1/servers/45de93d5-b2bb-423f-9aec-48c79b81e6fd" status: 204 len: 0 microversion: 2.1 time: 0.420144 Apr 16 21:44:55.263449 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3362/6566] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:44:54 2022] DELETE /compute/v2.1/servers/45de93d5-b2bb-423f-9aec-48c79b81e6fd => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:44:55.272919 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9bb8a1a9-9d5f-491c-b1f5-46a91a8181df tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:55.273717 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9bb8a1a9-9d5f-491c-b1f5-46a91a8181df tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] [instance: 45de93d5-b2bb-423f-9aec-48c79b81e6fd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:55.287023 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9bb8a1a9-9d5f-491c-b1f5-46a91a8181df tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:55.288055 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9bb8a1a9-9d5f-491c-b1f5-46a91a8181df tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:55.289524 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9bb8a1a9-9d5f-491c-b1f5-46a91a8181df tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:55.290140 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9bb8a1a9-9d5f-491c-b1f5-46a91a8181df tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:55.441366 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9bb8a1a9-9d5f-491c-b1f5-46a91a8181df tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9213dce366cd4351a55e8e82b4c2f7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d0d3b45797487d88c64d6ae767cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:44:55.449800 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9bb8a1a9-9d5f-491c-b1f5-46a91a8181df tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] 10.222.0.20 "GET /compute/v2.1/servers/45de93d5-b2bb-423f-9aec-48c79b81e6fd" status: 200 len: 1767 microversion: 2.1 time: 0.181214 Apr 16 21:44:55.450443 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3205/6567] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:55 2022] GET /compute/v2.1/servers/45de93d5-b2bb-423f-9aec-48c79b81e6fd => generated 1767 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:44:55.997430 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1ffbfb04-3067-494a-a8f4-b6142ee31a13 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:55.998129 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1ffbfb04-3067-494a-a8f4-b6142ee31a13 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] [instance: 9f452fb7-6767-4bbd-96f0-81b4e7bfd2db] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:56.004623 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1ffbfb04-3067-494a-a8f4-b6142ee31a13 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:56.005119 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1ffbfb04-3067-494a-a8f4-b6142ee31a13 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:56.005866 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1ffbfb04-3067-494a-a8f4-b6142ee31a13 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:56.006307 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1ffbfb04-3067-494a-a8f4-b6142ee31a13 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:56.139879 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1ffbfb04-3067-494a-a8f4-b6142ee31a13 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418700d27b044ee797d574625d4352f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a812c01aa9574c9abb3ae67bf117ce3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:44:56.148131 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1ffbfb04-3067-494a-a8f4-b6142ee31a13 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] 10.222.0.20 "GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db" status: 200 len: 1315 microversion: 2.1 time: 0.155138 Apr 16 21:44:56.148826 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3363/6568] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:55 2022] GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:44:56.469001 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ad0a476b-b338-4bbc-9c7d-9cd15c983a9a tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:56.470609 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ad0a476b-b338-4bbc-9c7d-9cd15c983a9a tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] [instance: 45de93d5-b2bb-423f-9aec-48c79b81e6fd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:56.477398 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ad0a476b-b338-4bbc-9c7d-9cd15c983a9a tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:56.477860 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ad0a476b-b338-4bbc-9c7d-9cd15c983a9a tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:56.478656 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ad0a476b-b338-4bbc-9c7d-9cd15c983a9a tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:56.479104 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ad0a476b-b338-4bbc-9c7d-9cd15c983a9a tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:56.629379 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ad0a476b-b338-4bbc-9c7d-9cd15c983a9a tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9213dce366cd4351a55e8e82b4c2f7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d0d3b45797487d88c64d6ae767cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:44:56.637156 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ad0a476b-b338-4bbc-9c7d-9cd15c983a9a tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] 10.222.0.20 "GET /compute/v2.1/servers/45de93d5-b2bb-423f-9aec-48c79b81e6fd" status: 200 len: 1767 microversion: 2.1 time: 0.173066 Apr 16 21:44:56.637739 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3206/6569] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:56 2022] GET /compute/v2.1/servers/45de93d5-b2bb-423f-9aec-48c79b81e6fd => generated 1767 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:44:57.165940 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-429d7e8c-3e85-4927-9f49-732b282b44b9 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:57.167614 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-429d7e8c-3e85-4927-9f49-732b282b44b9 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] [instance: 9f452fb7-6767-4bbd-96f0-81b4e7bfd2db] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:57.175152 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-429d7e8c-3e85-4927-9f49-732b282b44b9 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:57.175626 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-429d7e8c-3e85-4927-9f49-732b282b44b9 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:57.180814 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-429d7e8c-3e85-4927-9f49-732b282b44b9 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:57.180814 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-429d7e8c-3e85-4927-9f49-732b282b44b9 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:57.327548 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-429d7e8c-3e85-4927-9f49-732b282b44b9 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418700d27b044ee797d574625d4352f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a812c01aa9574c9abb3ae67bf117ce3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:44:57.335148 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-429d7e8c-3e85-4927-9f49-732b282b44b9 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] 10.222.0.20 "GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db" status: 200 len: 1315 microversion: 2.1 time: 0.173219 Apr 16 21:44:57.335981 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3364/6570] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:57 2022] GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:44:57.355414 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-0d5a9053-3f94-410a-a770-c4a12f1629d8 req-589ba7c1-c0e4-45b6-ac71-3fc8b1160b17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45de93d5-b2bb-423f-9aec-48c79b81e6fd", "name": "network-vif-deleted", "tag": "c4d5001d-e0c4-4dba-9703-42704badf73f"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:44:57.363995 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-0d5a9053-3f94-410a-a770-c4a12f1629d8 req-589ba7c1-c0e4-45b6-ac71-3fc8b1160b17 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:57.364526 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-0d5a9053-3f94-410a-a770-c4a12f1629d8 req-589ba7c1-c0e4-45b6-ac71-3fc8b1160b17 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:57.375601 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-0d5a9053-3f94-410a-a770-c4a12f1629d8 req-589ba7c1-c0e4-45b6-ac71-3fc8b1160b17 service nova] Creating event network-vif-deleted:c4d5001d-e0c4-4dba-9703-42704badf73f for instance 45de93d5-b2bb-423f-9aec-48c79b81e6fd on nch2-master-1 Apr 16 21:44:57.380718 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-0d5a9053-3f94-410a-a770-c4a12f1629d8 req-589ba7c1-c0e4-45b6-ac71-3fc8b1160b17 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029137 Apr 16 21:44:57.381497 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3207/6571] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:44:57.655834 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f00603fb-f725-4dd4-8193-df7feec901ed tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:57.660518 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f00603fb-f725-4dd4-8193-df7feec901ed tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] [instance: 45de93d5-b2bb-423f-9aec-48c79b81e6fd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:57.667824 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f00603fb-f725-4dd4-8193-df7feec901ed tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:57.668324 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f00603fb-f725-4dd4-8193-df7feec901ed tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:57.669166 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f00603fb-f725-4dd4-8193-df7feec901ed tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:57.669622 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f00603fb-f725-4dd4-8193-df7feec901ed tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:57.708110 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f00603fb-f725-4dd4-8193-df7feec901ed tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:57.708862 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f00603fb-f725-4dd4-8193-df7feec901ed tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:57.709529 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-f00603fb-f725-4dd4-8193-df7feec901ed tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lazy-loading 'fault' on Instance uuid 45de93d5-b2bb-423f-9aec-48c79b81e6fd {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:44:57.761964 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f00603fb-f725-4dd4-8193-df7feec901ed tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9213dce366cd4351a55e8e82b4c2f7b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9d0d3b45797487d88c64d6ae767cc18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:44:57.770745 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f00603fb-f725-4dd4-8193-df7feec901ed tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] 10.222.0.20 "GET /compute/v2.1/servers/45de93d5-b2bb-423f-9aec-48c79b81e6fd" status: 200 len: 1383 microversion: 2.1 time: 0.119452 Apr 16 21:44:57.771343 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3365/6572] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:57 2022] GET /compute/v2.1/servers/45de93d5-b2bb-423f-9aec-48c79b81e6fd => generated 1383 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:44:57.830550 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-59b140e1-2f2f-4323-be01-05b70529fc6a req-dccdd47e-1f67-4c35-8387-ce86046b3b71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f452fb7-6767-4bbd-96f0-81b4e7bfd2db", "name": "network-vif-plugged", "status": "completed", "tag": "7d23f851-895e-4529-9088-669809a7d0ac"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:44:57.839188 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-59b140e1-2f2f-4323-be01-05b70529fc6a req-dccdd47e-1f67-4c35-8387-ce86046b3b71 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:57.839656 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-59b140e1-2f2f-4323-be01-05b70529fc6a req-dccdd47e-1f67-4c35-8387-ce86046b3b71 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:57.851358 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-59b140e1-2f2f-4323-be01-05b70529fc6a req-dccdd47e-1f67-4c35-8387-ce86046b3b71 service nova] Creating event network-vif-plugged:7d23f851-895e-4529-9088-669809a7d0ac for instance 9f452fb7-6767-4bbd-96f0-81b4e7bfd2db on nch2-master-1 Apr 16 21:44:57.856076 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-59b140e1-2f2f-4323-be01-05b70529fc6a req-dccdd47e-1f67-4c35-8387-ce86046b3b71 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030992 Apr 16 21:44:57.856704 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3208/6573] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:44:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:44:58.352118 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-978ed89d-63fd-46e3-88a3-36f9f3b6d011 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:58.352779 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-978ed89d-63fd-46e3-88a3-36f9f3b6d011 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] [instance: 9f452fb7-6767-4bbd-96f0-81b4e7bfd2db] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:58.364059 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-978ed89d-63fd-46e3-88a3-36f9f3b6d011 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:58.364563 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-978ed89d-63fd-46e3-88a3-36f9f3b6d011 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:58.365350 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-978ed89d-63fd-46e3-88a3-36f9f3b6d011 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:58.365809 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-978ed89d-63fd-46e3-88a3-36f9f3b6d011 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:58.503216 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-978ed89d-63fd-46e3-88a3-36f9f3b6d011 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418700d27b044ee797d574625d4352f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a812c01aa9574c9abb3ae67bf117ce3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:44:58.510637 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-978ed89d-63fd-46e3-88a3-36f9f3b6d011 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] 10.222.0.20 "GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db" status: 200 len: 1315 microversion: 2.1 time: 0.162436 Apr 16 21:44:58.511205 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3366/6574] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:58 2022] GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:44:58.789177 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e78d595b-10c8-4c41-aad2-b4d815720b84 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:58.789887 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e78d595b-10c8-4c41-aad2-b4d815720b84 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] [instance: 45de93d5-b2bb-423f-9aec-48c79b81e6fd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:58.796123 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e78d595b-10c8-4c41-aad2-b4d815720b84 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:58.796624 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e78d595b-10c8-4c41-aad2-b4d815720b84 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:58.798031 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e78d595b-10c8-4c41-aad2-b4d815720b84 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:58.798493 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e78d595b-10c8-4c41-aad2-b4d815720b84 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:58.811678 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-e78d595b-10c8-4c41-aad2-b4d815720b84 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] HTTP exception thrown: Instance 45de93d5-b2bb-423f-9aec-48c79b81e6fd could not be found. Apr 16 21:44:58.812311 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e78d595b-10c8-4c41-aad2-b4d815720b84 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Returning 404 to user: Instance 45de93d5-b2bb-423f-9aec-48c79b81e6fd could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:44:58.813145 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e78d595b-10c8-4c41-aad2-b4d815720b84 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] 10.222.0.20 "GET /compute/v2.1/servers/45de93d5-b2bb-423f-9aec-48c79b81e6fd" status: 404 len: 111 microversion: 2.1 time: 0.028436 Apr 16 21:44:58.813678 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3209/6575] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:58 2022] GET /compute/v2.1/servers/45de93d5-b2bb-423f-9aec-48c79b81e6fd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:44:59.527375 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-dd5642ee-a81d-4585-bc96-2a5a858a8106 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:44:59.528749 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-dd5642ee-a81d-4585-bc96-2a5a858a8106 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] [instance: 9f452fb7-6767-4bbd-96f0-81b4e7bfd2db] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:44:59.536719 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dd5642ee-a81d-4585-bc96-2a5a858a8106 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:59.537267 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dd5642ee-a81d-4585-bc96-2a5a858a8106 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:59.538290 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dd5642ee-a81d-4585-bc96-2a5a858a8106 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:44:59.538821 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dd5642ee-a81d-4585-bc96-2a5a858a8106 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:44:59.786552 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-dd5642ee-a81d-4585-bc96-2a5a858a8106 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418700d27b044ee797d574625d4352f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a812c01aa9574c9abb3ae67bf117ce3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:44:59.795857 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-dd5642ee-a81d-4585-bc96-2a5a858a8106 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] 10.222.0.20 "GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db" status: 200 len: 1315 microversion: 2.1 time: 0.272597 Apr 16 21:44:59.796959 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3367/6576] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:44:59 2022] GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db => generated 1315 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:45:00.814064 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e555dc35-ce0d-4847-a420-7b37ff190205 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:45:00.814648 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e555dc35-ce0d-4847-a420-7b37ff190205 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] [instance: 9f452fb7-6767-4bbd-96f0-81b4e7bfd2db] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:45:00.821702 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e555dc35-ce0d-4847-a420-7b37ff190205 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:00.822141 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e555dc35-ce0d-4847-a420-7b37ff190205 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:00.822935 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e555dc35-ce0d-4847-a420-7b37ff190205 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:00.823422 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e555dc35-ce0d-4847-a420-7b37ff190205 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:00.969566 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e555dc35-ce0d-4847-a420-7b37ff190205 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418700d27b044ee797d574625d4352f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a812c01aa9574c9abb3ae67bf117ce3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:45:00.977909 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e555dc35-ce0d-4847-a420-7b37ff190205 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] 10.222.0.20 "GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db" status: 200 len: 1502 microversion: 2.1 time: 0.168561 Apr 16 21:45:00.978499 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3210/6577] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:45:00 2022] GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db => generated 1502 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:45:00.994907 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7cd321aa-ab56-45cd-80f5-b22f1304cc9c tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:45:00.995536 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7cd321aa-ab56-45cd-80f5-b22f1304cc9c tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] [instance: 9f452fb7-6767-4bbd-96f0-81b4e7bfd2db] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:45:01.003588 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7cd321aa-ab56-45cd-80f5-b22f1304cc9c tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:01.004191 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7cd321aa-ab56-45cd-80f5-b22f1304cc9c tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:01.005375 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7cd321aa-ab56-45cd-80f5-b22f1304cc9c tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:01.005937 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7cd321aa-ab56-45cd-80f5-b22f1304cc9c tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:01.206508 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7cd321aa-ab56-45cd-80f5-b22f1304cc9c tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418700d27b044ee797d574625d4352f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a812c01aa9574c9abb3ae67bf117ce3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:45:01.214489 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7cd321aa-ab56-45cd-80f5-b22f1304cc9c tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] 10.222.0.20 "GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db" status: 200 len: 1502 microversion: 2.1 time: 0.223667 Apr 16 21:45:01.215397 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3368/6578] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:45:00 2022] GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db => generated 1502 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:45:01.231498 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-dac22393-15ae-4d7a-baf2-638537a73154 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:45:01.232043 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-dac22393-15ae-4d7a-baf2-638537a73154 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] [instance: 9f452fb7-6767-4bbd-96f0-81b4e7bfd2db] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:45:01.238820 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dac22393-15ae-4d7a-baf2-638537a73154 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:01.239361 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dac22393-15ae-4d7a-baf2-638537a73154 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:01.240343 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dac22393-15ae-4d7a-baf2-638537a73154 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:01.240872 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dac22393-15ae-4d7a-baf2-638537a73154 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:01.263121 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-dac22393-15ae-4d7a-baf2-638537a73154 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lazy-loading 'flavor' on Instance uuid 9f452fb7-6767-4bbd-96f0-81b4e7bfd2db {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:45:01.550716 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-dac22393-15ae-4d7a-baf2-638537a73154 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] 10.222.0.20 "POST /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db/action" status: 202 len: 0 microversion: 2.1 time: 0.322983 Apr 16 21:45:01.554363 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3211/6579] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:45:01 2022] POST /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 16 21:45:01.561027 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b5673700-9b9d-41ff-a6ee-f32a005c1884 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:45:01.561869 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b5673700-9b9d-41ff-a6ee-f32a005c1884 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] [instance: 9f452fb7-6767-4bbd-96f0-81b4e7bfd2db] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:45:01.572572 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5673700-9b9d-41ff-a6ee-f32a005c1884 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:01.573041 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5673700-9b9d-41ff-a6ee-f32a005c1884 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:01.573848 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5673700-9b9d-41ff-a6ee-f32a005c1884 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:01.580377 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5673700-9b9d-41ff-a6ee-f32a005c1884 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:01.769681 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b5673700-9b9d-41ff-a6ee-f32a005c1884 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418700d27b044ee797d574625d4352f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a812c01aa9574c9abb3ae67bf117ce3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:45:01.779019 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b5673700-9b9d-41ff-a6ee-f32a005c1884 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] 10.222.0.20 "GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db" status: 200 len: 1510 microversion: 2.1 time: 0.221741 Apr 16 21:45:01.779792 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3369/6580] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:45:01 2022] GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db => generated 1510 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:45:02.800551 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fabed0bf-9540-4872-9b8c-bb04242bb780 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:45:02.800551 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-fabed0bf-9540-4872-9b8c-bb04242bb780 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] [instance: 9f452fb7-6767-4bbd-96f0-81b4e7bfd2db] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:45:02.806556 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fabed0bf-9540-4872-9b8c-bb04242bb780 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:02.807104 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fabed0bf-9540-4872-9b8c-bb04242bb780 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:02.807979 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fabed0bf-9540-4872-9b8c-bb04242bb780 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:02.808602 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fabed0bf-9540-4872-9b8c-bb04242bb780 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:03.014227 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-fabed0bf-9540-4872-9b8c-bb04242bb780 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418700d27b044ee797d574625d4352f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a812c01aa9574c9abb3ae67bf117ce3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:45:03.028895 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fabed0bf-9540-4872-9b8c-bb04242bb780 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] 10.222.0.20 "GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db" status: 200 len: 1493 microversion: 2.1 time: 0.235378 Apr 16 21:45:03.030059 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3212/6581] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:45:02 2022] GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db => generated 1493 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:45:03.046901 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6901e756-8cd5-4005-8fd6-77cff33ff19e tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:45:03.047607 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6901e756-8cd5-4005-8fd6-77cff33ff19e tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] [instance: 9f452fb7-6767-4bbd-96f0-81b4e7bfd2db] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:45:03.066901 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6901e756-8cd5-4005-8fd6-77cff33ff19e tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:03.067844 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6901e756-8cd5-4005-8fd6-77cff33ff19e tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:03.068948 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6901e756-8cd5-4005-8fd6-77cff33ff19e tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:03.069606 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6901e756-8cd5-4005-8fd6-77cff33ff19e tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:03.300567 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6901e756-8cd5-4005-8fd6-77cff33ff19e tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] 10.222.0.20 "POST /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db/action" status: 202 len: 0 microversion: 2.1 time: 0.257733 Apr 16 21:45:03.301609 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3370/6582] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:45:03 2022] POST /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:45:03.309710 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f498cdee-5343-4c02-b81c-bd8fe2e3e3bf tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:45:03.310267 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f498cdee-5343-4c02-b81c-bd8fe2e3e3bf tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] [instance: 9f452fb7-6767-4bbd-96f0-81b4e7bfd2db] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:45:03.317284 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f498cdee-5343-4c02-b81c-bd8fe2e3e3bf tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:03.317753 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f498cdee-5343-4c02-b81c-bd8fe2e3e3bf tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:03.318535 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f498cdee-5343-4c02-b81c-bd8fe2e3e3bf tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:03.318985 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f498cdee-5343-4c02-b81c-bd8fe2e3e3bf tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:03.350335 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b816e885-34e0-444e-b716-b013d41b9589 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] Calling method '.version_select at 0x7fbb95a5ea60>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:45:03.435624 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b816e885-34e0-444e-b716-b013d41b9589 tempest-TestSecurityGroupsBasicOps-599744156 tempest-TestSecurityGroupsBasicOps-599744156-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-941866712" status: 202 len: 0 microversion: 2.1 time: 0.089414 Apr 16 21:45:03.439932 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3371/6583] 10.222.0.20 () {58 vars in 1274 bytes} [Sat Apr 16 21:45:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-941866712 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:45:03.552389 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f498cdee-5343-4c02-b81c-bd8fe2e3e3bf tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418700d27b044ee797d574625d4352f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a812c01aa9574c9abb3ae67bf117ce3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:45:03.563777 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f498cdee-5343-4c02-b81c-bd8fe2e3e3bf tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] 10.222.0.20 "GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db" status: 200 len: 1499 microversion: 2.1 time: 0.257909 Apr 16 21:45:03.564562 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3213/6584] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:45:03 2022] GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db => generated 1499 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:45:04.581804 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-85c6ef47-d97a-4f66-a59f-8e8ce0830acf tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:45:04.582539 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-85c6ef47-d97a-4f66-a59f-8e8ce0830acf tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] [instance: 9f452fb7-6767-4bbd-96f0-81b4e7bfd2db] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:45:04.591323 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-85c6ef47-d97a-4f66-a59f-8e8ce0830acf tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:04.591784 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-85c6ef47-d97a-4f66-a59f-8e8ce0830acf tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:04.592595 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-85c6ef47-d97a-4f66-a59f-8e8ce0830acf tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:04.593047 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-85c6ef47-d97a-4f66-a59f-8e8ce0830acf tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:04.729181 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-85c6ef47-d97a-4f66-a59f-8e8ce0830acf tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418700d27b044ee797d574625d4352f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a812c01aa9574c9abb3ae67bf117ce3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:45:04.734435 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-85c6ef47-d97a-4f66-a59f-8e8ce0830acf tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] 10.222.0.20 "GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db" status: 200 len: 1499 microversion: 2.1 time: 0.157338 Apr 16 21:45:04.735581 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3372/6585] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:45:04 2022] GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db => generated 1499 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:45:05.751582 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c797f4f2-4708-4393-94fc-8716d51a67d5 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:45:05.752274 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c797f4f2-4708-4393-94fc-8716d51a67d5 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] [instance: 9f452fb7-6767-4bbd-96f0-81b4e7bfd2db] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:45:05.758914 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c797f4f2-4708-4393-94fc-8716d51a67d5 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:05.759472 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c797f4f2-4708-4393-94fc-8716d51a67d5 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:05.760267 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c797f4f2-4708-4393-94fc-8716d51a67d5 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:05.760711 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c797f4f2-4708-4393-94fc-8716d51a67d5 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:05.893971 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c797f4f2-4708-4393-94fc-8716d51a67d5 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418700d27b044ee797d574625d4352f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a812c01aa9574c9abb3ae67bf117ce3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:45:05.901349 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c797f4f2-4708-4393-94fc-8716d51a67d5 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] 10.222.0.20 "GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db" status: 200 len: 1502 microversion: 2.1 time: 0.154121 Apr 16 21:45:05.901923 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3214/6586] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:45:05 2022] GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db => generated 1502 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:45:05.918343 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b5d5dcb7-c510-49cb-9faf-ca1eb09e9c46 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:45:05.918899 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b5d5dcb7-c510-49cb-9faf-ca1eb09e9c46 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] [instance: 9f452fb7-6767-4bbd-96f0-81b4e7bfd2db] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:45:05.926017 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5d5dcb7-c510-49cb-9faf-ca1eb09e9c46 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:05.926702 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5d5dcb7-c510-49cb-9faf-ca1eb09e9c46 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:05.927655 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5d5dcb7-c510-49cb-9faf-ca1eb09e9c46 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:05.928107 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5d5dcb7-c510-49cb-9faf-ca1eb09e9c46 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:05.952354 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-b5d5dcb7-c510-49cb-9faf-ca1eb09e9c46 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lazy-loading 'flavor' on Instance uuid 9f452fb7-6767-4bbd-96f0-81b4e7bfd2db {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:45:06.230619 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b5d5dcb7-c510-49cb-9faf-ca1eb09e9c46 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] 10.222.0.20 "POST /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db/action" status: 202 len: 0 microversion: 2.1 time: 0.316035 Apr 16 21:45:06.233623 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3373/6587] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:45:05 2022] POST /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:45:06.241232 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-97cf4c4d-8385-41a8-a7fc-6864162dd0e4 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:45:06.241856 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-97cf4c4d-8385-41a8-a7fc-6864162dd0e4 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] [instance: 9f452fb7-6767-4bbd-96f0-81b4e7bfd2db] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:45:06.248888 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-97cf4c4d-8385-41a8-a7fc-6864162dd0e4 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:06.249738 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-97cf4c4d-8385-41a8-a7fc-6864162dd0e4 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:06.251111 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-97cf4c4d-8385-41a8-a7fc-6864162dd0e4 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:06.251563 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-97cf4c4d-8385-41a8-a7fc-6864162dd0e4 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:06.428394 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-97cf4c4d-8385-41a8-a7fc-6864162dd0e4 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418700d27b044ee797d574625d4352f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a812c01aa9574c9abb3ae67bf117ce3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:45:06.437384 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-97cf4c4d-8385-41a8-a7fc-6864162dd0e4 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] 10.222.0.20 "GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db" status: 200 len: 1510 microversion: 2.1 time: 0.200031 Apr 16 21:45:06.438011 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3215/6588] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:45:06 2022] GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db => generated 1510 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:45:07.455550 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-770067c3-fd05-49de-9d6d-a4dda1843121 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:45:07.456324 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-770067c3-fd05-49de-9d6d-a4dda1843121 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] [instance: 9f452fb7-6767-4bbd-96f0-81b4e7bfd2db] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:45:07.463404 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-770067c3-fd05-49de-9d6d-a4dda1843121 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:07.463867 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-770067c3-fd05-49de-9d6d-a4dda1843121 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:07.464851 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-770067c3-fd05-49de-9d6d-a4dda1843121 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:07.465163 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-770067c3-fd05-49de-9d6d-a4dda1843121 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:07.596690 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-770067c3-fd05-49de-9d6d-a4dda1843121 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418700d27b044ee797d574625d4352f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a812c01aa9574c9abb3ae67bf117ce3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:45:07.604455 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-770067c3-fd05-49de-9d6d-a4dda1843121 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] 10.222.0.20 "GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db" status: 200 len: 1493 microversion: 2.1 time: 0.153085 Apr 16 21:45:07.604944 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3374/6589] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:45:07 2022] GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db => generated 1493 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:45:07.621630 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c439438e-732e-434a-84e4-17bcc59768a5 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:45:07.623931 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c439438e-732e-434a-84e4-17bcc59768a5 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] [instance: 9f452fb7-6767-4bbd-96f0-81b4e7bfd2db] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:45:07.629586 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c439438e-732e-434a-84e4-17bcc59768a5 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:07.630133 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c439438e-732e-434a-84e4-17bcc59768a5 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:07.631017 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c439438e-732e-434a-84e4-17bcc59768a5 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:07.631532 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c439438e-732e-434a-84e4-17bcc59768a5 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:07.871012 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c439438e-732e-434a-84e4-17bcc59768a5 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] 10.222.0.20 "POST /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db/action" status: 202 len: 0 microversion: 2.1 time: 0.253386 Apr 16 21:45:07.871668 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3216/6590] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:45:07 2022] POST /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:45:07.880941 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ccace36c-ce65-4c2f-b28f-0e82febcbd4d tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:45:07.881807 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ccace36c-ce65-4c2f-b28f-0e82febcbd4d tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] [instance: 9f452fb7-6767-4bbd-96f0-81b4e7bfd2db] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:45:07.892870 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ccace36c-ce65-4c2f-b28f-0e82febcbd4d tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:07.896823 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ccace36c-ce65-4c2f-b28f-0e82febcbd4d tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:07.896823 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ccace36c-ce65-4c2f-b28f-0e82febcbd4d tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:07.896823 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ccace36c-ce65-4c2f-b28f-0e82febcbd4d tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:08.033021 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ccace36c-ce65-4c2f-b28f-0e82febcbd4d tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418700d27b044ee797d574625d4352f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a812c01aa9574c9abb3ae67bf117ce3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:45:08.040625 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ccace36c-ce65-4c2f-b28f-0e82febcbd4d tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] 10.222.0.20 "GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db" status: 200 len: 1499 microversion: 2.1 time: 0.163776 Apr 16 21:45:08.041396 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3375/6591] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:45:07 2022] GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db => generated 1499 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:45:09.059078 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-78d671f2-b784-4019-9705-3310320941b1 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:45:09.059697 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-78d671f2-b784-4019-9705-3310320941b1 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] [instance: 9f452fb7-6767-4bbd-96f0-81b4e7bfd2db] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:45:09.066980 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-78d671f2-b784-4019-9705-3310320941b1 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:09.067441 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-78d671f2-b784-4019-9705-3310320941b1 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:09.068251 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-78d671f2-b784-4019-9705-3310320941b1 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:09.068704 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-78d671f2-b784-4019-9705-3310320941b1 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:09.225876 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-78d671f2-b784-4019-9705-3310320941b1 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418700d27b044ee797d574625d4352f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a812c01aa9574c9abb3ae67bf117ce3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:45:09.236433 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-78d671f2-b784-4019-9705-3310320941b1 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] 10.222.0.20 "GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db" status: 200 len: 1499 microversion: 2.1 time: 0.179754 Apr 16 21:45:09.243593 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3217/6592] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:45:09 2022] GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db => generated 1499 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:45:10.252019 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d9e7f2e5-5366-40b6-8443-e437fde45468 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:45:10.252618 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d9e7f2e5-5366-40b6-8443-e437fde45468 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] [instance: 9f452fb7-6767-4bbd-96f0-81b4e7bfd2db] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:45:10.259755 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d9e7f2e5-5366-40b6-8443-e437fde45468 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:10.260236 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d9e7f2e5-5366-40b6-8443-e437fde45468 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:10.261035 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d9e7f2e5-5366-40b6-8443-e437fde45468 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:10.261478 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d9e7f2e5-5366-40b6-8443-e437fde45468 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:10.406793 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d9e7f2e5-5366-40b6-8443-e437fde45468 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418700d27b044ee797d574625d4352f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a812c01aa9574c9abb3ae67bf117ce3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:45:10.414578 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d9e7f2e5-5366-40b6-8443-e437fde45468 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] 10.222.0.20 "GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db" status: 200 len: 1502 microversion: 2.1 time: 0.167372 Apr 16 21:45:10.415147 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3376/6593] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:45:10 2022] GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db => generated 1502 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:45:10.431307 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d66e8ebc-1c1c-4439-8335-967e848347fe tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:45:10.431887 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d66e8ebc-1c1c-4439-8335-967e848347fe tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] [instance: 9f452fb7-6767-4bbd-96f0-81b4e7bfd2db] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:45:10.439189 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d66e8ebc-1c1c-4439-8335-967e848347fe tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:10.439944 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d66e8ebc-1c1c-4439-8335-967e848347fe tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:10.440727 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d66e8ebc-1c1c-4439-8335-967e848347fe tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:10.441169 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d66e8ebc-1c1c-4439-8335-967e848347fe tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:10.465654 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d66e8ebc-1c1c-4439-8335-967e848347fe tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] [instance: 9f452fb7-6767-4bbd-96f0-81b4e7bfd2db] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:45:10.803094 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d66e8ebc-1c1c-4439-8335-967e848347fe tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db" status: 204 len: 0 microversion: 2.1 time: 0.375362 Apr 16 21:45:10.803636 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3218/6594] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:45:10 2022] DELETE /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:45:10.812045 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8bfa448e-56d4-46d4-9e40-f6ef0b042038 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:45:10.812739 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8bfa448e-56d4-46d4-9e40-f6ef0b042038 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] [instance: 9f452fb7-6767-4bbd-96f0-81b4e7bfd2db] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:45:10.818655 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8bfa448e-56d4-46d4-9e40-f6ef0b042038 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:10.819114 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8bfa448e-56d4-46d4-9e40-f6ef0b042038 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:10.819897 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8bfa448e-56d4-46d4-9e40-f6ef0b042038 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:10.820364 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8bfa448e-56d4-46d4-9e40-f6ef0b042038 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:10.947517 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8bfa448e-56d4-46d4-9e40-f6ef0b042038 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418700d27b044ee797d574625d4352f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a812c01aa9574c9abb3ae67bf117ce3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:45:10.955066 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8bfa448e-56d4-46d4-9e40-f6ef0b042038 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] 10.222.0.20 "GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db" status: 200 len: 1508 microversion: 2.1 time: 0.146984 Apr 16 21:45:10.955647 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3377/6595] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:45:10 2022] GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db => generated 1508 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:45:11.972808 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-dc8ffcb0-9f3a-4a1f-913b-8965156d9b94 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:45:11.973511 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-dc8ffcb0-9f3a-4a1f-913b-8965156d9b94 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] [instance: 9f452fb7-6767-4bbd-96f0-81b4e7bfd2db] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:45:11.980192 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dc8ffcb0-9f3a-4a1f-913b-8965156d9b94 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:11.980688 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dc8ffcb0-9f3a-4a1f-913b-8965156d9b94 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:11.981458 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dc8ffcb0-9f3a-4a1f-913b-8965156d9b94 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:11.981900 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dc8ffcb0-9f3a-4a1f-913b-8965156d9b94 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:12.206624 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-dc8ffcb0-9f3a-4a1f-913b-8965156d9b94 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418700d27b044ee797d574625d4352f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a812c01aa9574c9abb3ae67bf117ce3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:45:12.214321 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-dc8ffcb0-9f3a-4a1f-913b-8965156d9b94 tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] 10.222.0.20 "GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db" status: 200 len: 1508 microversion: 2.1 time: 0.245734 Apr 16 21:45:12.214905 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3219/6596] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:45:11 2022] GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db => generated 1508 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:45:13.231236 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e5b49dba-c761-4c17-a04e-77b88959e8fe tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:45:13.231797 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e5b49dba-c761-4c17-a04e-77b88959e8fe tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] [instance: 9f452fb7-6767-4bbd-96f0-81b4e7bfd2db] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:45:13.238710 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e5b49dba-c761-4c17-a04e-77b88959e8fe tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:13.239174 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e5b49dba-c761-4c17-a04e-77b88959e8fe tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:13.239957 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e5b49dba-c761-4c17-a04e-77b88959e8fe tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:13.240447 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e5b49dba-c761-4c17-a04e-77b88959e8fe tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:13.372355 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e5b49dba-c761-4c17-a04e-77b88959e8fe tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418700d27b044ee797d574625d4352f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a812c01aa9574c9abb3ae67bf117ce3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:45:13.381249 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e5b49dba-c761-4c17-a04e-77b88959e8fe tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] 10.222.0.20 "GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db" status: 200 len: 1508 microversion: 2.1 time: 0.154044 Apr 16 21:45:13.388270 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3378/6597] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:45:13 2022] GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:45:13.821542 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-e84d91dc-1006-4b82-a2c9-b8b4cc5c816e req-6c676d47-ab6e-4d82-a0fa-ad03fa47d062 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f452fb7-6767-4bbd-96f0-81b4e7bfd2db", "name": "network-vif-deleted", "tag": "7d23f851-895e-4529-9088-669809a7d0ac"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:45:13.830987 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-e84d91dc-1006-4b82-a2c9-b8b4cc5c816e req-6c676d47-ab6e-4d82-a0fa-ad03fa47d062 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:13.831440 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-e84d91dc-1006-4b82-a2c9-b8b4cc5c816e req-6c676d47-ab6e-4d82-a0fa-ad03fa47d062 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:13.843244 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-e84d91dc-1006-4b82-a2c9-b8b4cc5c816e req-6c676d47-ab6e-4d82-a0fa-ad03fa47d062 service nova] Creating event network-vif-deleted:7d23f851-895e-4529-9088-669809a7d0ac for instance 9f452fb7-6767-4bbd-96f0-81b4e7bfd2db on nch2-master-1 Apr 16 21:45:13.848890 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-e84d91dc-1006-4b82-a2c9-b8b4cc5c816e req-6c676d47-ab6e-4d82-a0fa-ad03fa47d062 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031236 Apr 16 21:45:13.849496 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3220/6598] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:45:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:45:14.400370 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e97533f6-2ab6-43c9-837e-eca5989860ce tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:45:14.401096 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e97533f6-2ab6-43c9-837e-eca5989860ce tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] [instance: 9f452fb7-6767-4bbd-96f0-81b4e7bfd2db] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:45:14.408691 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e97533f6-2ab6-43c9-837e-eca5989860ce tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:14.409153 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e97533f6-2ab6-43c9-837e-eca5989860ce tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:14.409945 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e97533f6-2ab6-43c9-837e-eca5989860ce tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:14.410459 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e97533f6-2ab6-43c9-837e-eca5989860ce tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:14.443875 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e97533f6-2ab6-43c9-837e-eca5989860ce tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:14.444367 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e97533f6-2ab6-43c9-837e-eca5989860ce tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:14.444827 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-e97533f6-2ab6-43c9-837e-eca5989860ce tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lazy-loading 'fault' on Instance uuid 9f452fb7-6767-4bbd-96f0-81b4e7bfd2db {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:45:14.495192 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e97533f6-2ab6-43c9-837e-eca5989860ce tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '418700d27b044ee797d574625d4352f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a812c01aa9574c9abb3ae67bf117ce3c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:45:14.504727 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e97533f6-2ab6-43c9-837e-eca5989860ce tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] 10.222.0.20 "GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db" status: 200 len: 1305 microversion: 2.1 time: 0.108521 Apr 16 21:45:14.505294 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3379/6599] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:45:14 2022] GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db => generated 1305 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:45:15.521951 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2d615073-1869-4353-bd20-1fa859d7d21f tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:45:15.522654 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2d615073-1869-4353-bd20-1fa859d7d21f tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] [instance: 9f452fb7-6767-4bbd-96f0-81b4e7bfd2db] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:45:15.528948 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2d615073-1869-4353-bd20-1fa859d7d21f tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:15.529407 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2d615073-1869-4353-bd20-1fa859d7d21f tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:15.530267 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2d615073-1869-4353-bd20-1fa859d7d21f tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:15.530711 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2d615073-1869-4353-bd20-1fa859d7d21f tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:15.544514 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-2d615073-1869-4353-bd20-1fa859d7d21f tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] HTTP exception thrown: Instance 9f452fb7-6767-4bbd-96f0-81b4e7bfd2db could not be found. Apr 16 21:45:15.545110 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2d615073-1869-4353-bd20-1fa859d7d21f tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] Returning 404 to user: Instance 9f452fb7-6767-4bbd-96f0-81b4e7bfd2db could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:45:15.545947 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2d615073-1869-4353-bd20-1fa859d7d21f tempest-TestServerAdvancedOps-75144958 tempest-TestServerAdvancedOps-75144958-project] 10.222.0.20 "GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db" status: 404 len: 111 microversion: 2.1 time: 0.028633 Apr 16 21:45:15.546537 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3221/6600] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:45:15 2022] GET /compute/v2.1/servers/9f452fb7-6767-4bbd-96f0-81b4e7bfd2db => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:45:31.180601 ncdv-master-1 devstack@n-api.service[137409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 21:45:31.181276 ncdv-master-1 devstack@n-api.service[137409]: Sat Apr 16 21:45:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 21:45:34.632632 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ec7190ad-cd95-4ea8-8bcb-af65af9541cc tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:45:34.633662 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:45:34.633662 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:45:34.635077 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ec7190ad-cd95-4ea8-8bcb-af65af9541cc tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:34.635535 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ec7190ad-cd95-4ea8-8bcb-af65af9541cc tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:34.636414 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ec7190ad-cd95-4ea8-8bcb-af65af9541cc tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:34.636849 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ec7190ad-cd95-4ea8-8bcb-af65af9541cc tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:34.663744 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ec7190ad-cd95-4ea8-8bcb-af65af9541cc tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] 10.222.0.20 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 613 microversion: 2.1 time: 0.194870 Apr 16 21:45:34.677359 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3380/6601] 10.222.0.20 () {58 vars in 1184 bytes} [Sat Apr 16 21:45:34 2022] GET /compute/v2.1/os-availability-zone/detail => generated 613 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:45:34.782269 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-40e30912-0f68-48ab-94b2-45a3d42363ca tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-22552520", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "availability_zone": "nova:nch1-master-1", "networks": [{"uuid": "d0879ecd-5603-42bc-a1f6-a16a3c99be85"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:45:34.859450 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-40e30912-0f68-48ab-94b2-45a3d42363ca tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] validate_networks() for [('d0879ecd-5603-42bc-a1f6-a16a3c99be85', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:45:35.409312 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-40e30912-0f68-48ab-94b2-45a3d42363ca tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:45:35.410510 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-40e30912-0f68-48ab-94b2-45a3d42363ca tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:45:35.411107 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-40e30912-0f68-48ab-94b2-45a3d42363ca tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:45:35.411631 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-40e30912-0f68-48ab-94b2-45a3d42363ca tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:45:35.412154 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-40e30912-0f68-48ab-94b2-45a3d42363ca tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:45:35.422171 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-40e30912-0f68-48ab-94b2-45a3d42363ca tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:35.422749 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-40e30912-0f68-48ab-94b2-45a3d42363ca tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:35.423690 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-40e30912-0f68-48ab-94b2-45a3d42363ca tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:35.424532 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-40e30912-0f68-48ab-94b2-45a3d42363ca tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:35.443684 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-40e30912-0f68-48ab-94b2-45a3d42363ca tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Getting quotas for project 3a77b24c69964f2bb99a7ca0345df95d. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:45:35.450435 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-40e30912-0f68-48ab-94b2-45a3d42363ca tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Getting quotas for user 8481c8e388fa4c2f97487215edb731d7 and project 3a77b24c69964f2bb99a7ca0345df95d. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:45:35.464204 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-40e30912-0f68-48ab-94b2-45a3d42363ca tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:45:35.466699 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-40e30912-0f68-48ab-94b2-45a3d42363ca tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] [instance: fbe56afd-1789-47ec-b02a-d1ee36cadd27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:45:35.590947 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-40e30912-0f68-48ab-94b2-45a3d42363ca tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.812748 Apr 16 21:45:35.591826 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3222/6602] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:45:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:45:35.601973 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4a8b1420-dd1b-4e70-a022-e449503e09a3 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:45:35.602806 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4a8b1420-dd1b-4e70-a022-e449503e09a3 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] [instance: fbe56afd-1789-47ec-b02a-d1ee36cadd27] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:45:35.819059 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4a8b1420-dd1b-4e70-a022-e449503e09a3 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/fbe56afd-1789-47ec-b02a-d1ee36cadd27" status: 200 len: 1327 microversion: 2.1 time: 0.221040 Apr 16 21:45:35.819935 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3381/6603] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:45:35 2022] GET /compute/v2.1/servers/fbe56afd-1789-47ec-b02a-d1ee36cadd27 => generated 1327 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:45:36.837133 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-49a28739-1509-49ad-9a19-efd1b530e002 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:45:36.837937 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-49a28739-1509-49ad-9a19-efd1b530e002 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] [instance: fbe56afd-1789-47ec-b02a-d1ee36cadd27] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:45:36.846710 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-49a28739-1509-49ad-9a19-efd1b530e002 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:36.847155 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-49a28739-1509-49ad-9a19-efd1b530e002 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:36.848009 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-49a28739-1509-49ad-9a19-efd1b530e002 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:36.848494 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-49a28739-1509-49ad-9a19-efd1b530e002 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:36.941856 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-49a28739-1509-49ad-9a19-efd1b530e002 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/fbe56afd-1789-47ec-b02a-d1ee36cadd27" status: 200 len: 1344 microversion: 2.1 time: 0.107281 Apr 16 21:45:36.942440 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3223/6604] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:45:36 2022] GET /compute/v2.1/servers/fbe56afd-1789-47ec-b02a-d1ee36cadd27 => generated 1344 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:45:37.959590 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6069fb06-b4f1-4d60-99c9-3c9e9bb676e9 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:45:37.960253 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6069fb06-b4f1-4d60-99c9-3c9e9bb676e9 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] [instance: fbe56afd-1789-47ec-b02a-d1ee36cadd27] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:45:37.968472 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6069fb06-b4f1-4d60-99c9-3c9e9bb676e9 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:37.973691 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6069fb06-b4f1-4d60-99c9-3c9e9bb676e9 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:37.973691 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6069fb06-b4f1-4d60-99c9-3c9e9bb676e9 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:37.973691 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6069fb06-b4f1-4d60-99c9-3c9e9bb676e9 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:38.039296 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6069fb06-b4f1-4d60-99c9-3c9e9bb676e9 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/fbe56afd-1789-47ec-b02a-d1ee36cadd27" status: 200 len: 1414 microversion: 2.1 time: 0.083356 Apr 16 21:45:38.040050 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3382/6605] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:45:37 2022] GET /compute/v2.1/servers/fbe56afd-1789-47ec-b02a-d1ee36cadd27 => generated 1414 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:45:39.055847 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5dd09bce-b1a5-47c6-ac8e-11998c7a8f83 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:45:39.056822 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5dd09bce-b1a5-47c6-ac8e-11998c7a8f83 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] [instance: fbe56afd-1789-47ec-b02a-d1ee36cadd27] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:45:39.069868 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5dd09bce-b1a5-47c6-ac8e-11998c7a8f83 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:39.070493 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5dd09bce-b1a5-47c6-ac8e-11998c7a8f83 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:39.072008 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5dd09bce-b1a5-47c6-ac8e-11998c7a8f83 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:39.072278 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5dd09bce-b1a5-47c6-ac8e-11998c7a8f83 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:39.360617 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5dd09bce-b1a5-47c6-ac8e-11998c7a8f83 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/fbe56afd-1789-47ec-b02a-d1ee36cadd27" status: 200 len: 1462 microversion: 2.1 time: 0.307408 Apr 16 21:45:39.362913 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3224/6606] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:45:39 2022] GET /compute/v2.1/servers/fbe56afd-1789-47ec-b02a-d1ee36cadd27 => generated 1462 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:45:40.132773 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-ee12d980-4784-45ef-ae5d-80180e1b669a req-b2e54916-831d-4d82-89c2-d8891886326a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbe56afd-1789-47ec-b02a-d1ee36cadd27", "tag": "85774be5-21d1-4ad5-b784-5a21bb8300fd"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:45:40.147691 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-ee12d980-4784-45ef-ae5d-80180e1b669a req-b2e54916-831d-4d82-89c2-d8891886326a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:40.148526 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-ee12d980-4784-45ef-ae5d-80180e1b669a req-b2e54916-831d-4d82-89c2-d8891886326a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:40.164640 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-ee12d980-4784-45ef-ae5d-80180e1b669a req-b2e54916-831d-4d82-89c2-d8891886326a service nova] Creating event network-changed:85774be5-21d1-4ad5-b784-5a21bb8300fd for instance fbe56afd-1789-47ec-b02a-d1ee36cadd27 on nch1-master-1 Apr 16 21:45:40.173392 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-ee12d980-4784-45ef-ae5d-80180e1b669a req-b2e54916-831d-4d82-89c2-d8891886326a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046025 Apr 16 21:45:40.174690 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3383/6607] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:45:40.381004 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9b6b4500-08ac-4f25-a968-6332d3b000ad tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:45:40.381542 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9b6b4500-08ac-4f25-a968-6332d3b000ad tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] [instance: fbe56afd-1789-47ec-b02a-d1ee36cadd27] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:45:40.389189 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9b6b4500-08ac-4f25-a968-6332d3b000ad tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:40.390517 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9b6b4500-08ac-4f25-a968-6332d3b000ad tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:40.391472 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9b6b4500-08ac-4f25-a968-6332d3b000ad tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:40.392334 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9b6b4500-08ac-4f25-a968-6332d3b000ad tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:40.607268 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9b6b4500-08ac-4f25-a968-6332d3b000ad tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/fbe56afd-1789-47ec-b02a-d1ee36cadd27" status: 200 len: 1462 microversion: 2.1 time: 0.229937 Apr 16 21:45:40.618082 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3225/6608] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:45:40 2022] GET /compute/v2.1/servers/fbe56afd-1789-47ec-b02a-d1ee36cadd27 => generated 1462 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:45:41.625842 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ee5daf53-14a6-47f8-9c46-12ec6f3fe6e0 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:45:41.626548 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ee5daf53-14a6-47f8-9c46-12ec6f3fe6e0 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] [instance: fbe56afd-1789-47ec-b02a-d1ee36cadd27] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:45:41.633502 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee5daf53-14a6-47f8-9c46-12ec6f3fe6e0 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:41.633959 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee5daf53-14a6-47f8-9c46-12ec6f3fe6e0 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:41.634743 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee5daf53-14a6-47f8-9c46-12ec6f3fe6e0 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:41.635189 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee5daf53-14a6-47f8-9c46-12ec6f3fe6e0 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:41.765821 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ee5daf53-14a6-47f8-9c46-12ec6f3fe6e0 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/fbe56afd-1789-47ec-b02a-d1ee36cadd27" status: 200 len: 1462 microversion: 2.1 time: 0.143800 Apr 16 21:45:41.766504 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3384/6609] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:45:41 2022] GET /compute/v2.1/servers/fbe56afd-1789-47ec-b02a-d1ee36cadd27 => generated 1462 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:45:42.783369 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ef84c195-b1af-438a-aac2-eeffeac0c466 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:45:42.784085 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ef84c195-b1af-438a-aac2-eeffeac0c466 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] [instance: fbe56afd-1789-47ec-b02a-d1ee36cadd27] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:45:42.791589 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ef84c195-b1af-438a-aac2-eeffeac0c466 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:42.792350 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ef84c195-b1af-438a-aac2-eeffeac0c466 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:42.793101 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ef84c195-b1af-438a-aac2-eeffeac0c466 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:42.793782 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ef84c195-b1af-438a-aac2-eeffeac0c466 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:42.998411 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ef84c195-b1af-438a-aac2-eeffeac0c466 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/fbe56afd-1789-47ec-b02a-d1ee36cadd27" status: 200 len: 1462 microversion: 2.1 time: 0.219358 Apr 16 21:45:42.999580 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3226/6610] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:45:42 2022] GET /compute/v2.1/servers/fbe56afd-1789-47ec-b02a-d1ee36cadd27 => generated 1462 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:45:44.017225 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-463d9dec-4b0e-4ede-8192-f6682e747c57 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:45:44.018462 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-463d9dec-4b0e-4ede-8192-f6682e747c57 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] [instance: fbe56afd-1789-47ec-b02a-d1ee36cadd27] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:45:44.025547 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-463d9dec-4b0e-4ede-8192-f6682e747c57 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:44.026215 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-463d9dec-4b0e-4ede-8192-f6682e747c57 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:44.027022 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-463d9dec-4b0e-4ede-8192-f6682e747c57 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:44.027469 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-463d9dec-4b0e-4ede-8192-f6682e747c57 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:44.217584 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-463d9dec-4b0e-4ede-8192-f6682e747c57 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/fbe56afd-1789-47ec-b02a-d1ee36cadd27" status: 200 len: 1462 microversion: 2.1 time: 0.204117 Apr 16 21:45:44.221353 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3385/6611] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:45:44 2022] GET /compute/v2.1/servers/fbe56afd-1789-47ec-b02a-d1ee36cadd27 => generated 1462 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:45:44.860987 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-f82ff523-4d2c-4fd5-a5bf-fc530ed982c7 req-b17856d8-9603-4ab7-996e-8da7eb8239ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbe56afd-1789-47ec-b02a-d1ee36cadd27", "name": "network-vif-plugged", "status": "completed", "tag": "85774be5-21d1-4ad5-b784-5a21bb8300fd"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:45:44.878504 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-f82ff523-4d2c-4fd5-a5bf-fc530ed982c7 req-b17856d8-9603-4ab7-996e-8da7eb8239ef service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:44.879047 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-f82ff523-4d2c-4fd5-a5bf-fc530ed982c7 req-b17856d8-9603-4ab7-996e-8da7eb8239ef service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:44.901114 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-f82ff523-4d2c-4fd5-a5bf-fc530ed982c7 req-b17856d8-9603-4ab7-996e-8da7eb8239ef service nova] Creating event network-vif-plugged:85774be5-21d1-4ad5-b784-5a21bb8300fd for instance fbe56afd-1789-47ec-b02a-d1ee36cadd27 on nch1-master-1 Apr 16 21:45:44.906942 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-f82ff523-4d2c-4fd5-a5bf-fc530ed982c7 req-b17856d8-9603-4ab7-996e-8da7eb8239ef service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060699 Apr 16 21:45:44.908104 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3227/6612] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:45:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:45:45.237468 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-82dd45c6-5c9d-4ed6-937b-361708dc14ec tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:45:45.238187 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-82dd45c6-5c9d-4ed6-937b-361708dc14ec tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] [instance: fbe56afd-1789-47ec-b02a-d1ee36cadd27] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:45:45.245413 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-82dd45c6-5c9d-4ed6-937b-361708dc14ec tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:45.246102 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-82dd45c6-5c9d-4ed6-937b-361708dc14ec tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:45.247109 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-82dd45c6-5c9d-4ed6-937b-361708dc14ec tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:45.247748 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-82dd45c6-5c9d-4ed6-937b-361708dc14ec tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:45.381148 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-82dd45c6-5c9d-4ed6-937b-361708dc14ec tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/fbe56afd-1789-47ec-b02a-d1ee36cadd27" status: 200 len: 1462 microversion: 2.1 time: 0.147881 Apr 16 21:45:45.381714 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3386/6613] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:45:45 2022] GET /compute/v2.1/servers/fbe56afd-1789-47ec-b02a-d1ee36cadd27 => generated 1462 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:45:46.399028 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0ff22edb-f060-4ac8-a249-568ba7f2df79 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:45:46.399611 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0ff22edb-f060-4ac8-a249-568ba7f2df79 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] [instance: fbe56afd-1789-47ec-b02a-d1ee36cadd27] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:45:46.407710 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0ff22edb-f060-4ac8-a249-568ba7f2df79 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:46.411372 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0ff22edb-f060-4ac8-a249-568ba7f2df79 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:46.411372 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0ff22edb-f060-4ac8-a249-568ba7f2df79 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:46.411372 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0ff22edb-f060-4ac8-a249-568ba7f2df79 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:46.818493 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0ff22edb-f060-4ac8-a249-568ba7f2df79 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/fbe56afd-1789-47ec-b02a-d1ee36cadd27" status: 200 len: 1647 microversion: 2.1 time: 0.423831 Apr 16 21:45:46.819342 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3228/6614] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:45:46 2022] GET /compute/v2.1/servers/fbe56afd-1789-47ec-b02a-d1ee36cadd27 => generated 1647 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:45:46.834617 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-87bb7134-173a-437b-a104-8bbd226fa3ab tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:45:46.835236 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-87bb7134-173a-437b-a104-8bbd226fa3ab tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] [instance: fbe56afd-1789-47ec-b02a-d1ee36cadd27] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:45:46.842015 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-87bb7134-173a-437b-a104-8bbd226fa3ab tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:46.842960 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-87bb7134-173a-437b-a104-8bbd226fa3ab tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:46.843734 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-87bb7134-173a-437b-a104-8bbd226fa3ab tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:46.844192 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-87bb7134-173a-437b-a104-8bbd226fa3ab tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:46.974635 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-87bb7134-173a-437b-a104-8bbd226fa3ab tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/fbe56afd-1789-47ec-b02a-d1ee36cadd27" status: 200 len: 1647 microversion: 2.1 time: 0.143716 Apr 16 21:45:46.975436 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3387/6615] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:45:46 2022] GET /compute/v2.1/servers/fbe56afd-1789-47ec-b02a-d1ee36cadd27 => generated 1647 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:45:46.991924 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bfdee3b3-8d2f-4e57-a084-ac843d7c0717 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:45:46.993083 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bfdee3b3-8d2f-4e57-a084-ac843d7c0717 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] [instance: fbe56afd-1789-47ec-b02a-d1ee36cadd27] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:45:46.999361 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bfdee3b3-8d2f-4e57-a084-ac843d7c0717 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:47.000014 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bfdee3b3-8d2f-4e57-a084-ac843d7c0717 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:47.000862 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bfdee3b3-8d2f-4e57-a084-ac843d7c0717 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:47.001568 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bfdee3b3-8d2f-4e57-a084-ac843d7c0717 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:47.132436 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bfdee3b3-8d2f-4e57-a084-ac843d7c0717 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/fbe56afd-1789-47ec-b02a-d1ee36cadd27" status: 200 len: 1647 microversion: 2.1 time: 0.144433 Apr 16 21:45:47.133012 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3229/6616] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:45:46 2022] GET /compute/v2.1/servers/fbe56afd-1789-47ec-b02a-d1ee36cadd27 => generated 1647 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:45:47.233485 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-530162c5-deb1-4c0e-a29a-9c5eab5e4127 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-476215072", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "availability_zone": "nova:nch2-master-1", "networks": [{"uuid": "d0879ecd-5603-42bc-a1f6-a16a3c99be85"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:45:47.291153 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-530162c5-deb1-4c0e-a29a-9c5eab5e4127 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] validate_networks() for [('d0879ecd-5603-42bc-a1f6-a16a3c99be85', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:45:48.010080 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-530162c5-deb1-4c0e-a29a-9c5eab5e4127 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:45:48.010683 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-530162c5-deb1-4c0e-a29a-9c5eab5e4127 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:45:48.010994 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-530162c5-deb1-4c0e-a29a-9c5eab5e4127 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:45:48.011413 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-530162c5-deb1-4c0e-a29a-9c5eab5e4127 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:45:48.011836 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-530162c5-deb1-4c0e-a29a-9c5eab5e4127 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:45:48.021155 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-530162c5-deb1-4c0e-a29a-9c5eab5e4127 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:48.021846 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-530162c5-deb1-4c0e-a29a-9c5eab5e4127 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:48.022414 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-530162c5-deb1-4c0e-a29a-9c5eab5e4127 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:48.022861 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-530162c5-deb1-4c0e-a29a-9c5eab5e4127 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:48.040320 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-530162c5-deb1-4c0e-a29a-9c5eab5e4127 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Getting quotas for project 3a77b24c69964f2bb99a7ca0345df95d. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:45:48.046212 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-530162c5-deb1-4c0e-a29a-9c5eab5e4127 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Getting quotas for user 8481c8e388fa4c2f97487215edb731d7 and project 3a77b24c69964f2bb99a7ca0345df95d. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:45:48.059046 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-530162c5-deb1-4c0e-a29a-9c5eab5e4127 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:45:48.061451 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-530162c5-deb1-4c0e-a29a-9c5eab5e4127 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] [instance: beab72d9-4311-48a0-8214-092b0b79ff51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:45:48.187400 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-530162c5-deb1-4c0e-a29a-9c5eab5e4127 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.957626 Apr 16 21:45:48.192976 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3388/6617] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:45:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:45:48.198031 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-26e79584-be1b-4f63-a273-c6e8a4907d29 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:45:48.198704 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-26e79584-be1b-4f63-a273-c6e8a4907d29 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] [instance: beab72d9-4311-48a0-8214-092b0b79ff51] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:45:48.270698 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-26e79584-be1b-4f63-a273-c6e8a4907d29 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/beab72d9-4311-48a0-8214-092b0b79ff51" status: 200 len: 1328 microversion: 2.1 time: 0.076471 Apr 16 21:45:48.271275 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3230/6618] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:45:48 2022] GET /compute/v2.1/servers/beab72d9-4311-48a0-8214-092b0b79ff51 => generated 1328 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:45:49.287958 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d89abf30-0004-447e-95d1-92240ec32886 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:45:49.288762 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d89abf30-0004-447e-95d1-92240ec32886 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] [instance: beab72d9-4311-48a0-8214-092b0b79ff51] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:45:49.294704 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d89abf30-0004-447e-95d1-92240ec32886 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:49.295160 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d89abf30-0004-447e-95d1-92240ec32886 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:49.296614 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d89abf30-0004-447e-95d1-92240ec32886 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:49.297066 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d89abf30-0004-447e-95d1-92240ec32886 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:49.367592 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d89abf30-0004-447e-95d1-92240ec32886 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/beab72d9-4311-48a0-8214-092b0b79ff51" status: 200 len: 1345 microversion: 2.1 time: 0.084145 Apr 16 21:45:49.368112 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3389/6619] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:45:49 2022] GET /compute/v2.1/servers/beab72d9-4311-48a0-8214-092b0b79ff51 => generated 1345 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:45:50.383953 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3307a2d3-2598-4f1f-a001-31891165218c tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:45:50.384665 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3307a2d3-2598-4f1f-a001-31891165218c tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] [instance: beab72d9-4311-48a0-8214-092b0b79ff51] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:45:50.392046 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3307a2d3-2598-4f1f-a001-31891165218c tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:50.392541 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3307a2d3-2598-4f1f-a001-31891165218c tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:50.393518 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3307a2d3-2598-4f1f-a001-31891165218c tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:50.393961 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3307a2d3-2598-4f1f-a001-31891165218c tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:50.479444 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3307a2d3-2598-4f1f-a001-31891165218c tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/beab72d9-4311-48a0-8214-092b0b79ff51" status: 200 len: 1433 microversion: 2.1 time: 0.099281 Apr 16 21:45:50.489518 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3231/6620] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:45:50 2022] GET /compute/v2.1/servers/beab72d9-4311-48a0-8214-092b0b79ff51 => generated 1433 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:45:51.497385 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3c58dc4f-91cf-4f6a-9646-8f0c80e92597 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:45:51.498348 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3c58dc4f-91cf-4f6a-9646-8f0c80e92597 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] [instance: beab72d9-4311-48a0-8214-092b0b79ff51] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:45:51.505740 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3c58dc4f-91cf-4f6a-9646-8f0c80e92597 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:51.506258 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3c58dc4f-91cf-4f6a-9646-8f0c80e92597 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:51.507055 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3c58dc4f-91cf-4f6a-9646-8f0c80e92597 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:51.507496 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3c58dc4f-91cf-4f6a-9646-8f0c80e92597 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:51.645451 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-7751e5d8-557d-42ea-84a7-3230f34b2a5c req-8de4cdaa-da5b-4d00-8ea5-a51f5108556b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "beab72d9-4311-48a0-8214-092b0b79ff51", "tag": "721e695b-699b-48df-a361-bd07bfb1268f"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:45:51.657858 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3c58dc4f-91cf-4f6a-9646-8f0c80e92597 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/beab72d9-4311-48a0-8214-092b0b79ff51" status: 200 len: 1463 microversion: 2.1 time: 0.153211 Apr 16 21:45:51.657858 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3390/6621] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:45:51 2022] GET /compute/v2.1/servers/beab72d9-4311-48a0-8214-092b0b79ff51 => generated 1463 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:45:51.658238 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-7751e5d8-557d-42ea-84a7-3230f34b2a5c req-8de4cdaa-da5b-4d00-8ea5-a51f5108556b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:51.658238 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-7751e5d8-557d-42ea-84a7-3230f34b2a5c req-8de4cdaa-da5b-4d00-8ea5-a51f5108556b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:51.667188 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-7751e5d8-557d-42ea-84a7-3230f34b2a5c req-8de4cdaa-da5b-4d00-8ea5-a51f5108556b service nova] Creating event network-changed:721e695b-699b-48df-a361-bd07bfb1268f for instance beab72d9-4311-48a0-8214-092b0b79ff51 on nch2-master-1 Apr 16 21:45:51.673776 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-7751e5d8-557d-42ea-84a7-3230f34b2a5c req-8de4cdaa-da5b-4d00-8ea5-a51f5108556b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031677 Apr 16 21:45:51.677860 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3232/6622] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:45:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:45:52.664824 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-066a69d3-3990-422a-ba73-4417eb8a9f79 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:45:52.665569 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-066a69d3-3990-422a-ba73-4417eb8a9f79 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] [instance: beab72d9-4311-48a0-8214-092b0b79ff51] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:45:52.673198 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-066a69d3-3990-422a-ba73-4417eb8a9f79 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:52.673913 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-066a69d3-3990-422a-ba73-4417eb8a9f79 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:52.674773 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-066a69d3-3990-422a-ba73-4417eb8a9f79 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:52.675507 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-066a69d3-3990-422a-ba73-4417eb8a9f79 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:52.850053 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-066a69d3-3990-422a-ba73-4417eb8a9f79 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/beab72d9-4311-48a0-8214-092b0b79ff51" status: 200 len: 1463 microversion: 2.1 time: 0.188962 Apr 16 21:45:52.850937 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3391/6623] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:45:52 2022] GET /compute/v2.1/servers/beab72d9-4311-48a0-8214-092b0b79ff51 => generated 1463 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:45:53.875104 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0cfe5255-a764-432b-9e15-99e3a9674448 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:45:53.876049 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0cfe5255-a764-432b-9e15-99e3a9674448 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] [instance: beab72d9-4311-48a0-8214-092b0b79ff51] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:45:53.883130 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0cfe5255-a764-432b-9e15-99e3a9674448 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:53.883766 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0cfe5255-a764-432b-9e15-99e3a9674448 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:53.884872 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0cfe5255-a764-432b-9e15-99e3a9674448 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:53.885550 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0cfe5255-a764-432b-9e15-99e3a9674448 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:54.086758 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0cfe5255-a764-432b-9e15-99e3a9674448 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/beab72d9-4311-48a0-8214-092b0b79ff51" status: 200 len: 1463 microversion: 2.1 time: 0.221552 Apr 16 21:45:54.087697 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3233/6624] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:45:53 2022] GET /compute/v2.1/servers/beab72d9-4311-48a0-8214-092b0b79ff51 => generated 1463 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:45:55.105590 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-84ddbe86-42d6-42df-8089-d6d15ef75337 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:45:55.108430 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-84ddbe86-42d6-42df-8089-d6d15ef75337 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] [instance: beab72d9-4311-48a0-8214-092b0b79ff51] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:45:55.123738 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-84ddbe86-42d6-42df-8089-d6d15ef75337 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:55.124756 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-84ddbe86-42d6-42df-8089-d6d15ef75337 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:55.125844 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-84ddbe86-42d6-42df-8089-d6d15ef75337 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:55.127469 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-84ddbe86-42d6-42df-8089-d6d15ef75337 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:55.348097 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-84ddbe86-42d6-42df-8089-d6d15ef75337 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/beab72d9-4311-48a0-8214-092b0b79ff51" status: 200 len: 1463 microversion: 2.1 time: 0.248852 Apr 16 21:45:55.348698 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3392/6625] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:45:55 2022] GET /compute/v2.1/servers/beab72d9-4311-48a0-8214-092b0b79ff51 => generated 1463 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:45:56.365556 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3cf03da1-ab60-473a-9490-df3e9223570e tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:45:56.366461 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3cf03da1-ab60-473a-9490-df3e9223570e tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] [instance: beab72d9-4311-48a0-8214-092b0b79ff51] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:45:56.374434 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3cf03da1-ab60-473a-9490-df3e9223570e tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:56.375285 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3cf03da1-ab60-473a-9490-df3e9223570e tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:56.376122 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3cf03da1-ab60-473a-9490-df3e9223570e tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:56.376608 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3cf03da1-ab60-473a-9490-df3e9223570e tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:56.551799 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3cf03da1-ab60-473a-9490-df3e9223570e tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/beab72d9-4311-48a0-8214-092b0b79ff51" status: 200 len: 1463 microversion: 2.1 time: 0.190834 Apr 16 21:45:56.565953 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3234/6626] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:45:56 2022] GET /compute/v2.1/servers/beab72d9-4311-48a0-8214-092b0b79ff51 => generated 1463 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:45:57.587185 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0fa230bc-68f0-49f3-b6a8-5d7d3d025cb3 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:45:57.588921 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0fa230bc-68f0-49f3-b6a8-5d7d3d025cb3 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] [instance: beab72d9-4311-48a0-8214-092b0b79ff51] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:45:57.603895 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0fa230bc-68f0-49f3-b6a8-5d7d3d025cb3 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:57.614042 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0fa230bc-68f0-49f3-b6a8-5d7d3d025cb3 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:57.615052 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0fa230bc-68f0-49f3-b6a8-5d7d3d025cb3 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:57.615523 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0fa230bc-68f0-49f3-b6a8-5d7d3d025cb3 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:57.783734 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0fa230bc-68f0-49f3-b6a8-5d7d3d025cb3 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/beab72d9-4311-48a0-8214-092b0b79ff51" status: 200 len: 1463 microversion: 2.1 time: 0.205002 Apr 16 21:45:57.784351 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3393/6627] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:45:57 2022] GET /compute/v2.1/servers/beab72d9-4311-48a0-8214-092b0b79ff51 => generated 1463 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:45:58.140992 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-1c293be1-3ada-4835-8564-c200b4dde45b req-6e30a672-99b1-4b33-9d66-645c29631090 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beab72d9-4311-48a0-8214-092b0b79ff51", "name": "network-vif-plugged", "status": "completed", "tag": "721e695b-699b-48df-a361-bd07bfb1268f"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:45:58.157692 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-1c293be1-3ada-4835-8564-c200b4dde45b req-6e30a672-99b1-4b33-9d66-645c29631090 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:58.158173 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-1c293be1-3ada-4835-8564-c200b4dde45b req-6e30a672-99b1-4b33-9d66-645c29631090 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:58.171441 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-1c293be1-3ada-4835-8564-c200b4dde45b req-6e30a672-99b1-4b33-9d66-645c29631090 service nova] Creating event network-vif-plugged:721e695b-699b-48df-a361-bd07bfb1268f for instance beab72d9-4311-48a0-8214-092b0b79ff51 on nch2-master-1 Apr 16 21:45:58.176958 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-1c293be1-3ada-4835-8564-c200b4dde45b req-6e30a672-99b1-4b33-9d66-645c29631090 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040782 Apr 16 21:45:58.178453 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3235/6628] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:45:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:45:58.802413 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-818d7ec0-d27d-4adc-a098-f286ca058c16 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:45:58.803039 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-818d7ec0-d27d-4adc-a098-f286ca058c16 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] [instance: beab72d9-4311-48a0-8214-092b0b79ff51] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:45:58.811592 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-818d7ec0-d27d-4adc-a098-f286ca058c16 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:58.812662 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-818d7ec0-d27d-4adc-a098-f286ca058c16 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:58.813715 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-818d7ec0-d27d-4adc-a098-f286ca058c16 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:45:58.814167 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-818d7ec0-d27d-4adc-a098-f286ca058c16 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:45:59.033950 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-818d7ec0-d27d-4adc-a098-f286ca058c16 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/beab72d9-4311-48a0-8214-092b0b79ff51" status: 200 len: 1463 microversion: 2.1 time: 0.236415 Apr 16 21:45:59.036757 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3394/6629] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:45:58 2022] GET /compute/v2.1/servers/beab72d9-4311-48a0-8214-092b0b79ff51 => generated 1463 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:46:00.052719 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4d5e325b-411d-4a2d-8f20-06a6b2a2cde3 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:46:00.053517 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4d5e325b-411d-4a2d-8f20-06a6b2a2cde3 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] [instance: beab72d9-4311-48a0-8214-092b0b79ff51] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:46:00.059708 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4d5e325b-411d-4a2d-8f20-06a6b2a2cde3 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:00.060165 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4d5e325b-411d-4a2d-8f20-06a6b2a2cde3 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:00.065223 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4d5e325b-411d-4a2d-8f20-06a6b2a2cde3 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:00.065223 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4d5e325b-411d-4a2d-8f20-06a6b2a2cde3 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:00.257372 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4d5e325b-411d-4a2d-8f20-06a6b2a2cde3 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/beab72d9-4311-48a0-8214-092b0b79ff51" status: 200 len: 1647 microversion: 2.1 time: 0.209613 Apr 16 21:46:00.257964 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3236/6630] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:46:00 2022] GET /compute/v2.1/servers/beab72d9-4311-48a0-8214-092b0b79ff51 => generated 1647 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:46:00.273973 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-eb7e1bdb-d826-41f0-a15d-1087d1a27d52 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:46:00.275552 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-eb7e1bdb-d826-41f0-a15d-1087d1a27d52 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] [instance: beab72d9-4311-48a0-8214-092b0b79ff51] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:46:00.283161 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eb7e1bdb-d826-41f0-a15d-1087d1a27d52 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:00.283623 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eb7e1bdb-d826-41f0-a15d-1087d1a27d52 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:00.284451 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eb7e1bdb-d826-41f0-a15d-1087d1a27d52 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:00.284961 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eb7e1bdb-d826-41f0-a15d-1087d1a27d52 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:00.429045 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-eb7e1bdb-d826-41f0-a15d-1087d1a27d52 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/beab72d9-4311-48a0-8214-092b0b79ff51" status: 200 len: 1647 microversion: 2.1 time: 0.158803 Apr 16 21:46:00.429618 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3395/6631] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:46:00 2022] GET /compute/v2.1/servers/beab72d9-4311-48a0-8214-092b0b79ff51 => generated 1647 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:46:00.444491 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0af7ac5f-6ce5-4c14-b8d1-68449b4adc90 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:46:00.445115 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0af7ac5f-6ce5-4c14-b8d1-68449b4adc90 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] [instance: beab72d9-4311-48a0-8214-092b0b79ff51] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:46:00.451340 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0af7ac5f-6ce5-4c14-b8d1-68449b4adc90 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:00.451471 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0af7ac5f-6ce5-4c14-b8d1-68449b4adc90 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:00.452588 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0af7ac5f-6ce5-4c14-b8d1-68449b4adc90 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:00.453218 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0af7ac5f-6ce5-4c14-b8d1-68449b4adc90 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:00.577242 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0af7ac5f-6ce5-4c14-b8d1-68449b4adc90 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/beab72d9-4311-48a0-8214-092b0b79ff51" status: 200 len: 1647 microversion: 2.1 time: 0.136338 Apr 16 21:46:00.577886 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3237/6632] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:46:00 2022] GET /compute/v2.1/servers/beab72d9-4311-48a0-8214-092b0b79ff51 => generated 1647 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:46:00.593780 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0edf39e9-f683-4ddf-a5b6-7116fa116fc5 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:46:00.594319 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0edf39e9-f683-4ddf-a5b6-7116fa116fc5 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] [instance: beab72d9-4311-48a0-8214-092b0b79ff51] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:46:00.600659 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0edf39e9-f683-4ddf-a5b6-7116fa116fc5 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:00.600952 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0edf39e9-f683-4ddf-a5b6-7116fa116fc5 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:00.601754 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0edf39e9-f683-4ddf-a5b6-7116fa116fc5 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:00.602194 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0edf39e9-f683-4ddf-a5b6-7116fa116fc5 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:00.627915 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0edf39e9-f683-4ddf-a5b6-7116fa116fc5 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] [instance: beab72d9-4311-48a0-8214-092b0b79ff51] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:46:00.877167 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0edf39e9-f683-4ddf-a5b6-7116fa116fc5 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] 10.222.0.20 "DELETE /compute/v2.1/servers/beab72d9-4311-48a0-8214-092b0b79ff51" status: 204 len: 0 microversion: 2.1 time: 0.287408 Apr 16 21:46:00.877787 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3396/6633] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:46:00 2022] DELETE /compute/v2.1/servers/beab72d9-4311-48a0-8214-092b0b79ff51 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 16 21:46:00.885971 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-995ae85d-1e2c-4ee3-b684-8349398a0ab8 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:46:00.886641 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-995ae85d-1e2c-4ee3-b684-8349398a0ab8 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] [instance: beab72d9-4311-48a0-8214-092b0b79ff51] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:46:00.896126 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-995ae85d-1e2c-4ee3-b684-8349398a0ab8 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:00.896126 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-995ae85d-1e2c-4ee3-b684-8349398a0ab8 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:00.897396 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-995ae85d-1e2c-4ee3-b684-8349398a0ab8 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:00.898366 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-995ae85d-1e2c-4ee3-b684-8349398a0ab8 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:01.041645 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-995ae85d-1e2c-4ee3-b684-8349398a0ab8 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/beab72d9-4311-48a0-8214-092b0b79ff51" status: 200 len: 1653 microversion: 2.1 time: 0.159297 Apr 16 21:46:01.042229 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3238/6634] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:46:00 2022] GET /compute/v2.1/servers/beab72d9-4311-48a0-8214-092b0b79ff51 => generated 1653 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:46:02.059190 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f8341b19-0e7c-4294-a254-c0b7b2960083 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:46:02.060009 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f8341b19-0e7c-4294-a254-c0b7b2960083 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] [instance: beab72d9-4311-48a0-8214-092b0b79ff51] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:46:02.066903 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f8341b19-0e7c-4294-a254-c0b7b2960083 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:02.067444 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f8341b19-0e7c-4294-a254-c0b7b2960083 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:02.068345 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f8341b19-0e7c-4294-a254-c0b7b2960083 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:02.068868 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f8341b19-0e7c-4294-a254-c0b7b2960083 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:02.310530 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f8341b19-0e7c-4294-a254-c0b7b2960083 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/beab72d9-4311-48a0-8214-092b0b79ff51" status: 200 len: 1653 microversion: 2.1 time: 0.255358 Apr 16 21:46:02.315109 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3397/6635] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:46:02 2022] GET /compute/v2.1/servers/beab72d9-4311-48a0-8214-092b0b79ff51 => generated 1653 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:46:02.893003 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-9ce260f5-61f3-458f-b7e5-e6211fad34b2 req-636be5ef-6002-4dd7-a756-2482b30bf9fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beab72d9-4311-48a0-8214-092b0b79ff51", "name": "network-vif-deleted", "tag": "721e695b-699b-48df-a361-bd07bfb1268f"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:46:02.912477 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-9ce260f5-61f3-458f-b7e5-e6211fad34b2 req-636be5ef-6002-4dd7-a756-2482b30bf9fe service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:02.913954 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-9ce260f5-61f3-458f-b7e5-e6211fad34b2 req-636be5ef-6002-4dd7-a756-2482b30bf9fe service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:02.932719 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-9ce260f5-61f3-458f-b7e5-e6211fad34b2 req-636be5ef-6002-4dd7-a756-2482b30bf9fe service nova] Creating event network-vif-deleted:721e695b-699b-48df-a361-bd07bfb1268f for instance beab72d9-4311-48a0-8214-092b0b79ff51 on nch2-master-1 Apr 16 21:46:02.942286 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-9ce260f5-61f3-458f-b7e5-e6211fad34b2 req-636be5ef-6002-4dd7-a756-2482b30bf9fe service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053750 Apr 16 21:46:02.943651 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3239/6636] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:46:03.331929 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0150a824-3e3b-4fd2-b76f-3781d01a605c tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:46:03.332589 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0150a824-3e3b-4fd2-b76f-3781d01a605c tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] [instance: beab72d9-4311-48a0-8214-092b0b79ff51] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:46:03.343792 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0150a824-3e3b-4fd2-b76f-3781d01a605c tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:03.344510 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0150a824-3e3b-4fd2-b76f-3781d01a605c tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:03.348505 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0150a824-3e3b-4fd2-b76f-3781d01a605c tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:03.348505 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0150a824-3e3b-4fd2-b76f-3781d01a605c tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:03.378053 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0150a824-3e3b-4fd2-b76f-3781d01a605c tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:03.378550 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0150a824-3e3b-4fd2-b76f-3781d01a605c tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:03.379059 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-0150a824-3e3b-4fd2-b76f-3781d01a605c tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lazy-loading 'fault' on Instance uuid beab72d9-4311-48a0-8214-092b0b79ff51 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:46:03.481312 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0150a824-3e3b-4fd2-b76f-3781d01a605c tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/beab72d9-4311-48a0-8214-092b0b79ff51" status: 200 len: 1453 microversion: 2.1 time: 0.153091 Apr 16 21:46:03.482991 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3398/6637] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:46:03 2022] GET /compute/v2.1/servers/beab72d9-4311-48a0-8214-092b0b79ff51 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:46:04.501317 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-74c3954e-69f8-4306-a867-1f481718bd31 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:46:04.501937 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-74c3954e-69f8-4306-a867-1f481718bd31 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] [instance: beab72d9-4311-48a0-8214-092b0b79ff51] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:46:04.508152 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-74c3954e-69f8-4306-a867-1f481718bd31 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:04.508641 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-74c3954e-69f8-4306-a867-1f481718bd31 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:04.509411 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-74c3954e-69f8-4306-a867-1f481718bd31 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:04.509849 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-74c3954e-69f8-4306-a867-1f481718bd31 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:04.524884 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-74c3954e-69f8-4306-a867-1f481718bd31 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] HTTP exception thrown: Instance beab72d9-4311-48a0-8214-092b0b79ff51 could not be found. Apr 16 21:46:04.525495 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-74c3954e-69f8-4306-a867-1f481718bd31 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Returning 404 to user: Instance beab72d9-4311-48a0-8214-092b0b79ff51 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:46:04.526349 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-74c3954e-69f8-4306-a867-1f481718bd31 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/beab72d9-4311-48a0-8214-092b0b79ff51" status: 404 len: 111 microversion: 2.1 time: 0.030765 Apr 16 21:46:04.526914 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3240/6638] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:46:04 2022] GET /compute/v2.1/servers/beab72d9-4311-48a0-8214-092b0b79ff51 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:46:04.534988 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-940198f9-646c-4129-8ea4-ae0673f1d15b tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:46:04.535474 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-940198f9-646c-4129-8ea4-ae0673f1d15b tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] [instance: fbe56afd-1789-47ec-b02a-d1ee36cadd27] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:46:04.542430 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-940198f9-646c-4129-8ea4-ae0673f1d15b tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:04.542889 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-940198f9-646c-4129-8ea4-ae0673f1d15b tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:04.543666 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-940198f9-646c-4129-8ea4-ae0673f1d15b tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:04.544112 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-940198f9-646c-4129-8ea4-ae0673f1d15b tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:04.571595 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-940198f9-646c-4129-8ea4-ae0673f1d15b tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] [instance: fbe56afd-1789-47ec-b02a-d1ee36cadd27] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:46:04.934633 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-940198f9-646c-4129-8ea4-ae0673f1d15b tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] 10.222.0.20 "DELETE /compute/v2.1/servers/fbe56afd-1789-47ec-b02a-d1ee36cadd27" status: 204 len: 0 microversion: 2.1 time: 0.403089 Apr 16 21:46:04.935882 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3399/6639] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:46:04 2022] DELETE /compute/v2.1/servers/fbe56afd-1789-47ec-b02a-d1ee36cadd27 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:46:04.947359 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-63383b7a-59bb-4238-83ec-0a65e8bee611 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:46:04.949192 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-63383b7a-59bb-4238-83ec-0a65e8bee611 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] [instance: fbe56afd-1789-47ec-b02a-d1ee36cadd27] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:46:04.957469 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-63383b7a-59bb-4238-83ec-0a65e8bee611 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:04.958342 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-63383b7a-59bb-4238-83ec-0a65e8bee611 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:04.959440 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-63383b7a-59bb-4238-83ec-0a65e8bee611 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:04.960793 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-63383b7a-59bb-4238-83ec-0a65e8bee611 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:05.126270 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-63383b7a-59bb-4238-83ec-0a65e8bee611 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/fbe56afd-1789-47ec-b02a-d1ee36cadd27" status: 200 len: 1653 microversion: 2.1 time: 0.185285 Apr 16 21:46:05.128236 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3241/6640] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:46:04 2022] GET /compute/v2.1/servers/fbe56afd-1789-47ec-b02a-d1ee36cadd27 => generated 1653 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:46:06.147151 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-28a92dc8-bb5f-4935-b611-5b0602883d73 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:46:06.149834 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-28a92dc8-bb5f-4935-b611-5b0602883d73 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] [instance: fbe56afd-1789-47ec-b02a-d1ee36cadd27] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:46:06.156719 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-28a92dc8-bb5f-4935-b611-5b0602883d73 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:06.157395 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-28a92dc8-bb5f-4935-b611-5b0602883d73 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:06.158236 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-28a92dc8-bb5f-4935-b611-5b0602883d73 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:06.158682 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-28a92dc8-bb5f-4935-b611-5b0602883d73 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:06.375899 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-28a92dc8-bb5f-4935-b611-5b0602883d73 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/fbe56afd-1789-47ec-b02a-d1ee36cadd27" status: 200 len: 1653 microversion: 2.1 time: 0.232825 Apr 16 21:46:06.376733 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3400/6641] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:46:06 2022] GET /compute/v2.1/servers/fbe56afd-1789-47ec-b02a-d1ee36cadd27 => generated 1653 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:46:07.147038 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-d6be4dad-a77b-44de-bcdf-ce229aa79b9b req-de22e80c-132c-4740-af7d-fc3868424a6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbe56afd-1789-47ec-b02a-d1ee36cadd27", "name": "network-vif-deleted", "tag": "85774be5-21d1-4ad5-b784-5a21bb8300fd"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:46:07.163675 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-d6be4dad-a77b-44de-bcdf-ce229aa79b9b req-de22e80c-132c-4740-af7d-fc3868424a6f service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:07.164125 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-d6be4dad-a77b-44de-bcdf-ce229aa79b9b req-de22e80c-132c-4740-af7d-fc3868424a6f service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:07.181788 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-d6be4dad-a77b-44de-bcdf-ce229aa79b9b req-de22e80c-132c-4740-af7d-fc3868424a6f service nova] Creating event network-vif-deleted:85774be5-21d1-4ad5-b784-5a21bb8300fd for instance fbe56afd-1789-47ec-b02a-d1ee36cadd27 on nch1-master-1 Apr 16 21:46:07.188770 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-d6be4dad-a77b-44de-bcdf-ce229aa79b9b req-de22e80c-132c-4740-af7d-fc3868424a6f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047018 Apr 16 21:46:07.189924 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3242/6642] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:46:07.393767 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9935c859-96cf-41e1-ba5b-21f11425e620 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:46:07.395768 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9935c859-96cf-41e1-ba5b-21f11425e620 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] [instance: fbe56afd-1789-47ec-b02a-d1ee36cadd27] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:46:07.403198 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9935c859-96cf-41e1-ba5b-21f11425e620 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:07.404082 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9935c859-96cf-41e1-ba5b-21f11425e620 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:07.405119 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9935c859-96cf-41e1-ba5b-21f11425e620 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:07.405787 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9935c859-96cf-41e1-ba5b-21f11425e620 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:07.440990 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9935c859-96cf-41e1-ba5b-21f11425e620 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:07.441839 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9935c859-96cf-41e1-ba5b-21f11425e620 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:07.442510 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-9935c859-96cf-41e1-ba5b-21f11425e620 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lazy-loading 'fault' on Instance uuid fbe56afd-1789-47ec-b02a-d1ee36cadd27 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:46:07.496955 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9935c859-96cf-41e1-ba5b-21f11425e620 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/fbe56afd-1789-47ec-b02a-d1ee36cadd27" status: 200 len: 1452 microversion: 2.1 time: 0.106858 Apr 16 21:46:07.497678 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3401/6643] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:46:07 2022] GET /compute/v2.1/servers/fbe56afd-1789-47ec-b02a-d1ee36cadd27 => generated 1452 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:46:08.516654 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a45ae9d3-42bc-4df1-bb76-3292ca4fd414 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:46:08.517385 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a45ae9d3-42bc-4df1-bb76-3292ca4fd414 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] [instance: fbe56afd-1789-47ec-b02a-d1ee36cadd27] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:46:08.524123 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a45ae9d3-42bc-4df1-bb76-3292ca4fd414 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:08.524626 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a45ae9d3-42bc-4df1-bb76-3292ca4fd414 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:08.525420 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a45ae9d3-42bc-4df1-bb76-3292ca4fd414 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:08.525876 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a45ae9d3-42bc-4df1-bb76-3292ca4fd414 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:08.539731 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-a45ae9d3-42bc-4df1-bb76-3292ca4fd414 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] HTTP exception thrown: Instance fbe56afd-1789-47ec-b02a-d1ee36cadd27 could not be found. Apr 16 21:46:08.541461 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a45ae9d3-42bc-4df1-bb76-3292ca4fd414 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] Returning 404 to user: Instance fbe56afd-1789-47ec-b02a-d1ee36cadd27 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:46:08.541461 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a45ae9d3-42bc-4df1-bb76-3292ca4fd414 tempest-TestServerMultinode-1569778382 tempest-TestServerMultinode-1569778382-project-admin] 10.222.0.20 "GET /compute/v2.1/servers/fbe56afd-1789-47ec-b02a-d1ee36cadd27" status: 404 len: 111 microversion: 2.1 time: 0.030235 Apr 16 21:46:08.541790 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3243/6644] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:46:08 2022] GET /compute/v2.1/servers/fbe56afd-1789-47ec-b02a-d1ee36cadd27 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:46:09.916967 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-264dac83-1429-4cc6-bd35-3adc854f01cb tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:46:09.917490 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-264dac83-1429-4cc6-bd35-3adc854f01cb tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] [instance: 59d6853a-6832-4a96-a033-4acb32260eb6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:46:09.926477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-264dac83-1429-4cc6-bd35-3adc854f01cb tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:09.926477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-264dac83-1429-4cc6-bd35-3adc854f01cb tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:09.926477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-264dac83-1429-4cc6-bd35-3adc854f01cb tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:09.926477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-264dac83-1429-4cc6-bd35-3adc854f01cb tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:10.007564 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-264dac83-1429-4cc6-bd35-3adc854f01cb tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lazy-loading 'services' on Instance uuid 59d6853a-6832-4a96-a033-4acb32260eb6 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:46:10.186435 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-264dac83-1429-4cc6-bd35-3adc854f01cb tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] 10.222.0.20 "DELETE /compute/v2.1/servers/59d6853a-6832-4a96-a033-4acb32260eb6/os-volume_attachments/fedcef50-29c9-4c19-a9b4-b678f9441c3f" status: 202 len: 0 microversion: 2.1 time: 0.272269 Apr 16 21:46:10.187961 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3402/6645] 10.222.0.20 () {58 vars in 1415 bytes} [Sat Apr 16 21:46:09 2022] DELETE /compute/v2.1/servers/59d6853a-6832-4a96-a033-4acb32260eb6/os-volume_attachments/fedcef50-29c9-4c19-a9b4-b678f9441c3f => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:46:11.343073 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-068a4049-bf6e-4ca3-84ff-61a5b90766ae tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:46:11.343720 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-068a4049-bf6e-4ca3-84ff-61a5b90766ae tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] [instance: 59d6853a-6832-4a96-a033-4acb32260eb6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:46:11.351251 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-068a4049-bf6e-4ca3-84ff-61a5b90766ae tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:11.351961 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-068a4049-bf6e-4ca3-84ff-61a5b90766ae tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:11.353057 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-068a4049-bf6e-4ca3-84ff-61a5b90766ae tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:11.353790 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-068a4049-bf6e-4ca3-84ff-61a5b90766ae tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:11.380255 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-068a4049-bf6e-4ca3-84ff-61a5b90766ae tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] [instance: 59d6853a-6832-4a96-a033-4acb32260eb6] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:46:11.678837 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-068a4049-bf6e-4ca3-84ff-61a5b90766ae tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] 10.222.0.20 "DELETE /compute/v2.1/servers/59d6853a-6832-4a96-a033-4acb32260eb6" status: 204 len: 0 microversion: 2.1 time: 0.341777 Apr 16 21:46:11.680506 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3244/6646] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:46:11 2022] DELETE /compute/v2.1/servers/59d6853a-6832-4a96-a033-4acb32260eb6 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:46:11.689488 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-66e65e6a-2602-4133-93f9-40d9eafc3e11 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:46:11.690197 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-66e65e6a-2602-4133-93f9-40d9eafc3e11 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] [instance: 59d6853a-6832-4a96-a033-4acb32260eb6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:46:11.697493 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-66e65e6a-2602-4133-93f9-40d9eafc3e11 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:11.697950 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-66e65e6a-2602-4133-93f9-40d9eafc3e11 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:11.698741 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-66e65e6a-2602-4133-93f9-40d9eafc3e11 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:11.699181 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-66e65e6a-2602-4133-93f9-40d9eafc3e11 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:11.936796 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-66e65e6a-2602-4133-93f9-40d9eafc3e11 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bf99de7a594e209f995e62db441850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda4f5ee41d2439e935ee0f658f465d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:46:11.946165 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-66e65e6a-2602-4133-93f9-40d9eafc3e11 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] 10.222.0.20 "GET /compute/v2.1/servers/59d6853a-6832-4a96-a033-4acb32260eb6" status: 200 len: 1515 microversion: 2.1 time: 0.260853 Apr 16 21:46:11.955336 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3403/6647] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:46:11 2022] GET /compute/v2.1/servers/59d6853a-6832-4a96-a033-4acb32260eb6 => generated 1515 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:46:12.964825 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4ea82656-184b-4ffd-b87f-2e6b7a5f2438 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:46:12.965719 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4ea82656-184b-4ffd-b87f-2e6b7a5f2438 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] [instance: 59d6853a-6832-4a96-a033-4acb32260eb6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:46:12.973992 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4ea82656-184b-4ffd-b87f-2e6b7a5f2438 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:12.974875 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4ea82656-184b-4ffd-b87f-2e6b7a5f2438 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:12.975759 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4ea82656-184b-4ffd-b87f-2e6b7a5f2438 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:12.976335 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4ea82656-184b-4ffd-b87f-2e6b7a5f2438 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:13.320224 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4ea82656-184b-4ffd-b87f-2e6b7a5f2438 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bf99de7a594e209f995e62db441850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda4f5ee41d2439e935ee0f658f465d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:46:13.328798 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4ea82656-184b-4ffd-b87f-2e6b7a5f2438 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] 10.222.0.20 "GET /compute/v2.1/servers/59d6853a-6832-4a96-a033-4acb32260eb6" status: 200 len: 1515 microversion: 2.1 time: 0.369620 Apr 16 21:46:13.329392 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3245/6648] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:46:12 2022] GET /compute/v2.1/servers/59d6853a-6832-4a96-a033-4acb32260eb6 => generated 1515 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:46:14.096964 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-5f64c82c-1fd2-4f85-b2e2-57e6a6feff5d req-943a13b1-6cbf-43a3-86f8-1b693cedd77e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59d6853a-6832-4a96-a033-4acb32260eb6", "name": "network-vif-deleted", "tag": "6a24e936-fcf3-4173-bf74-80d1489399a4"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:46:14.106438 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-5f64c82c-1fd2-4f85-b2e2-57e6a6feff5d req-943a13b1-6cbf-43a3-86f8-1b693cedd77e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:14.107650 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-5f64c82c-1fd2-4f85-b2e2-57e6a6feff5d req-943a13b1-6cbf-43a3-86f8-1b693cedd77e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:14.124076 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-5f64c82c-1fd2-4f85-b2e2-57e6a6feff5d req-943a13b1-6cbf-43a3-86f8-1b693cedd77e service nova] Creating event network-vif-deleted:6a24e936-fcf3-4173-bf74-80d1489399a4 for instance 59d6853a-6832-4a96-a033-4acb32260eb6 on nch1-master-1 Apr 16 21:46:14.129358 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-5f64c82c-1fd2-4f85-b2e2-57e6a6feff5d req-943a13b1-6cbf-43a3-86f8-1b693cedd77e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036211 Apr 16 21:46:14.130144 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3404/6649] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:46:14.347339 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f15b8a77-1df3-453a-90b5-97bc0c6ade20 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:46:14.348040 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f15b8a77-1df3-453a-90b5-97bc0c6ade20 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] [instance: 59d6853a-6832-4a96-a033-4acb32260eb6] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:46:14.354821 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f15b8a77-1df3-453a-90b5-97bc0c6ade20 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:14.355279 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f15b8a77-1df3-453a-90b5-97bc0c6ade20 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:14.356067 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f15b8a77-1df3-453a-90b5-97bc0c6ade20 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:14.356539 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f15b8a77-1df3-453a-90b5-97bc0c6ade20 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:14.387732 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f15b8a77-1df3-453a-90b5-97bc0c6ade20 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:14.388879 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f15b8a77-1df3-453a-90b5-97bc0c6ade20 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:14.389364 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-f15b8a77-1df3-453a-90b5-97bc0c6ade20 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lazy-loading 'fault' on Instance uuid 59d6853a-6832-4a96-a033-4acb32260eb6 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:46:14.445815 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f15b8a77-1df3-453a-90b5-97bc0c6ade20 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bf99de7a594e209f995e62db441850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda4f5ee41d2439e935ee0f658f465d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:46:14.454132 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f15b8a77-1df3-453a-90b5-97bc0c6ade20 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] 10.222.0.20 "GET /compute/v2.1/servers/59d6853a-6832-4a96-a033-4acb32260eb6" status: 200 len: 1309 microversion: 2.1 time: 0.110914 Apr 16 21:46:14.454770 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3246/6650] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:46:14 2022] GET /compute/v2.1/servers/59d6853a-6832-4a96-a033-4acb32260eb6 => generated 1309 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:46:15.475682 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-48526515-dff9-426e-92d7-86db30f5474e tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:46:15.477121 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-48526515-dff9-426e-92d7-86db30f5474e tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] [instance: 59d6853a-6832-4a96-a033-4acb32260eb6] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:46:15.484734 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-48526515-dff9-426e-92d7-86db30f5474e tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:15.485409 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-48526515-dff9-426e-92d7-86db30f5474e tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:15.486375 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-48526515-dff9-426e-92d7-86db30f5474e tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:15.487669 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-48526515-dff9-426e-92d7-86db30f5474e tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:15.505271 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-48526515-dff9-426e-92d7-86db30f5474e tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] HTTP exception thrown: Instance 59d6853a-6832-4a96-a033-4acb32260eb6 could not be found. Apr 16 21:46:15.506151 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-48526515-dff9-426e-92d7-86db30f5474e tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Returning 404 to user: Instance 59d6853a-6832-4a96-a033-4acb32260eb6 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:46:15.507157 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-48526515-dff9-426e-92d7-86db30f5474e tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] 10.222.0.20 "GET /compute/v2.1/servers/59d6853a-6832-4a96-a033-4acb32260eb6" status: 404 len: 111 microversion: 2.1 time: 0.037324 Apr 16 21:46:15.507877 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3405/6651] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:46:15 2022] GET /compute/v2.1/servers/59d6853a-6832-4a96-a033-4acb32260eb6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:46:27.156516 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ff52cc80-514f-401f-8699-c37fc05c7ac9 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1063747863", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "2aad2bcc-ed09-4c05-a89b-4988a07fb386"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:46:27.212246 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-ff52cc80-514f-401f-8699-c37fc05c7ac9 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] validate_networks() for [('2aad2bcc-ed09-4c05-a89b-4988a07fb386', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:46:27.688391 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-ff52cc80-514f-401f-8699-c37fc05c7ac9 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:46:27.688830 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-ff52cc80-514f-401f-8699-c37fc05c7ac9 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:46:27.689315 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-ff52cc80-514f-401f-8699-c37fc05c7ac9 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:46:27.689732 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-ff52cc80-514f-401f-8699-c37fc05c7ac9 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:46:27.690155 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-ff52cc80-514f-401f-8699-c37fc05c7ac9 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:46:27.699491 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ff52cc80-514f-401f-8699-c37fc05c7ac9 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:27.700503 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ff52cc80-514f-401f-8699-c37fc05c7ac9 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:27.701320 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ff52cc80-514f-401f-8699-c37fc05c7ac9 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:27.701763 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ff52cc80-514f-401f-8699-c37fc05c7ac9 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:27.719418 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-ff52cc80-514f-401f-8699-c37fc05c7ac9 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Getting quotas for project cda4f5ee41d2439e935ee0f658f465d4. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:46:27.725296 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-ff52cc80-514f-401f-8699-c37fc05c7ac9 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Getting quotas for user 95bf99de7a594e209f995e62db441850 and project cda4f5ee41d2439e935ee0f658f465d4. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:46:27.738655 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ff52cc80-514f-401f-8699-c37fc05c7ac9 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:46:27.741472 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ff52cc80-514f-401f-8699-c37fc05c7ac9 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] [instance: 8e3ee82e-b49c-4d49-aca8-7a42af4de7dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:46:27.851964 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ff52cc80-514f-401f-8699-c37fc05c7ac9 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.699598 Apr 16 21:46:27.852882 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3247/6652] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:46:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 701 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:46:27.862616 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d91f9758-ce07-47eb-bf51-84b031fe4d48 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:46:27.863248 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d91f9758-ce07-47eb-bf51-84b031fe4d48 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] [instance: 8e3ee82e-b49c-4d49-aca8-7a42af4de7dc] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:46:27.960679 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d91f9758-ce07-47eb-bf51-84b031fe4d48 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bf99de7a594e209f995e62db441850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda4f5ee41d2439e935ee0f658f465d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:46:27.970136 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d91f9758-ce07-47eb-bf51-84b031fe4d48 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] 10.222.0.20 "GET /compute/v2.1/servers/8e3ee82e-b49c-4d49-aca8-7a42af4de7dc" status: 200 len: 1219 microversion: 2.1 time: 0.111065 Apr 16 21:46:27.971166 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3406/6653] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:46:27 2022] GET /compute/v2.1/servers/8e3ee82e-b49c-4d49-aca8-7a42af4de7dc => generated 1219 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:46:29.025429 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-dc8c114e-b473-4d54-87b2-29bfa601b2f6 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:46:29.026099 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-dc8c114e-b473-4d54-87b2-29bfa601b2f6 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] [instance: 8e3ee82e-b49c-4d49-aca8-7a42af4de7dc] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:46:29.045498 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dc8c114e-b473-4d54-87b2-29bfa601b2f6 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:29.046202 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dc8c114e-b473-4d54-87b2-29bfa601b2f6 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:29.047186 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dc8c114e-b473-4d54-87b2-29bfa601b2f6 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:29.048018 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dc8c114e-b473-4d54-87b2-29bfa601b2f6 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:29.300038 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-dc8c114e-b473-4d54-87b2-29bfa601b2f6 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bf99de7a594e209f995e62db441850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda4f5ee41d2439e935ee0f658f465d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:46:29.309359 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-dc8c114e-b473-4d54-87b2-29bfa601b2f6 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] 10.222.0.20 "GET /compute/v2.1/servers/8e3ee82e-b49c-4d49-aca8-7a42af4de7dc" status: 200 len: 1223 microversion: 2.1 time: 0.325145 Apr 16 21:46:29.321376 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3248/6654] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:46:28 2022] GET /compute/v2.1/servers/8e3ee82e-b49c-4d49-aca8-7a42af4de7dc => generated 1223 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:46:30.333935 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-79a13c05-1ba1-430e-bd7f-986cab44a857 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:46:30.334567 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-79a13c05-1ba1-430e-bd7f-986cab44a857 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] [instance: 8e3ee82e-b49c-4d49-aca8-7a42af4de7dc] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:46:30.347180 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-79a13c05-1ba1-430e-bd7f-986cab44a857 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:30.347837 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-79a13c05-1ba1-430e-bd7f-986cab44a857 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:30.348860 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-79a13c05-1ba1-430e-bd7f-986cab44a857 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:30.349470 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-79a13c05-1ba1-430e-bd7f-986cab44a857 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:30.431374 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-79a13c05-1ba1-430e-bd7f-986cab44a857 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bf99de7a594e209f995e62db441850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda4f5ee41d2439e935ee0f658f465d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:46:30.439813 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-79a13c05-1ba1-430e-bd7f-986cab44a857 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] 10.222.0.20 "GET /compute/v2.1/servers/8e3ee82e-b49c-4d49-aca8-7a42af4de7dc" status: 200 len: 1279 microversion: 2.1 time: 0.114807 Apr 16 21:46:30.440577 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3407/6655] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:46:30 2022] GET /compute/v2.1/servers/8e3ee82e-b49c-4d49-aca8-7a42af4de7dc => generated 1279 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:46:31.457153 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-da254be5-5c18-4253-a778-bc89881bc016 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:46:31.458404 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-da254be5-5c18-4253-a778-bc89881bc016 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] [instance: 8e3ee82e-b49c-4d49-aca8-7a42af4de7dc] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:46:31.466522 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-da254be5-5c18-4253-a778-bc89881bc016 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:31.467248 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-da254be5-5c18-4253-a778-bc89881bc016 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:31.468231 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-da254be5-5c18-4253-a778-bc89881bc016 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:31.468844 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-da254be5-5c18-4253-a778-bc89881bc016 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:31.792215 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-da254be5-5c18-4253-a778-bc89881bc016 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bf99de7a594e209f995e62db441850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda4f5ee41d2439e935ee0f658f465d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:46:31.808211 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-da254be5-5c18-4253-a778-bc89881bc016 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] 10.222.0.20 "GET /compute/v2.1/servers/8e3ee82e-b49c-4d49-aca8-7a42af4de7dc" status: 200 len: 1319 microversion: 2.1 time: 0.354319 Apr 16 21:46:31.809417 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3249/6656] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:46:31 2022] GET /compute/v2.1/servers/8e3ee82e-b49c-4d49-aca8-7a42af4de7dc => generated 1319 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:46:32.828244 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d3a04620-b07c-48bf-9d54-d13438c5c043 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:46:32.829204 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d3a04620-b07c-48bf-9d54-d13438c5c043 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] [instance: 8e3ee82e-b49c-4d49-aca8-7a42af4de7dc] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:46:32.837151 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d3a04620-b07c-48bf-9d54-d13438c5c043 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:32.837715 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d3a04620-b07c-48bf-9d54-d13438c5c043 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:32.838608 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d3a04620-b07c-48bf-9d54-d13438c5c043 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:32.839456 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d3a04620-b07c-48bf-9d54-d13438c5c043 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:32.984360 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-b77d4a2d-d22e-4155-8f62-3a9148291599 req-5f33e9d0-ff3d-449a-a214-99ff07fe11c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e3ee82e-b49c-4d49-aca8-7a42af4de7dc", "tag": "5d901921-b640-4e8b-a7d1-f001809168ce"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:46:33.004377 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-b77d4a2d-d22e-4155-8f62-3a9148291599 req-5f33e9d0-ff3d-449a-a214-99ff07fe11c0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:33.005078 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-b77d4a2d-d22e-4155-8f62-3a9148291599 req-5f33e9d0-ff3d-449a-a214-99ff07fe11c0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:33.006605 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d3a04620-b07c-48bf-9d54-d13438c5c043 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bf99de7a594e209f995e62db441850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda4f5ee41d2439e935ee0f658f465d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:46:33.023493 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-b77d4a2d-d22e-4155-8f62-3a9148291599 req-5f33e9d0-ff3d-449a-a214-99ff07fe11c0 service nova] Creating event network-changed:5d901921-b640-4e8b-a7d1-f001809168ce for instance 8e3ee82e-b49c-4d49-aca8-7a42af4de7dc on nch1-master-1 Apr 16 21:46:33.024284 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d3a04620-b07c-48bf-9d54-d13438c5c043 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] 10.222.0.20 "GET /compute/v2.1/servers/8e3ee82e-b49c-4d49-aca8-7a42af4de7dc" status: 200 len: 1319 microversion: 2.1 time: 0.198238 Apr 16 21:46:33.024909 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3408/6657] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:46:32 2022] GET /compute/v2.1/servers/8e3ee82e-b49c-4d49-aca8-7a42af4de7dc => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:46:33.026607 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-b77d4a2d-d22e-4155-8f62-3a9148291599 req-5f33e9d0-ff3d-449a-a214-99ff07fe11c0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046139 Apr 16 21:46:33.029929 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3250/6658] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:46:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:46:34.042377 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-faf26890-a32a-4b3e-9c09-662f53238d93 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:46:34.043853 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-faf26890-a32a-4b3e-9c09-662f53238d93 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] [instance: 8e3ee82e-b49c-4d49-aca8-7a42af4de7dc] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:46:34.055939 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-faf26890-a32a-4b3e-9c09-662f53238d93 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:34.059636 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-faf26890-a32a-4b3e-9c09-662f53238d93 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:34.060567 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-faf26890-a32a-4b3e-9c09-662f53238d93 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:34.061672 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-faf26890-a32a-4b3e-9c09-662f53238d93 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:34.202060 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-faf26890-a32a-4b3e-9c09-662f53238d93 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bf99de7a594e209f995e62db441850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda4f5ee41d2439e935ee0f658f465d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:46:34.209663 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-faf26890-a32a-4b3e-9c09-662f53238d93 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] 10.222.0.20 "GET /compute/v2.1/servers/8e3ee82e-b49c-4d49-aca8-7a42af4de7dc" status: 200 len: 1319 microversion: 2.1 time: 0.171559 Apr 16 21:46:34.210231 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3409/6659] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:46:34 2022] GET /compute/v2.1/servers/8e3ee82e-b49c-4d49-aca8-7a42af4de7dc => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:46:35.229015 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c027a2fc-823b-4600-9e3d-a5b57925df8f tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:46:35.229729 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c027a2fc-823b-4600-9e3d-a5b57925df8f tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] [instance: 8e3ee82e-b49c-4d49-aca8-7a42af4de7dc] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:46:35.238219 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c027a2fc-823b-4600-9e3d-a5b57925df8f tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:35.239309 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c027a2fc-823b-4600-9e3d-a5b57925df8f tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:35.240628 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c027a2fc-823b-4600-9e3d-a5b57925df8f tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:35.241265 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c027a2fc-823b-4600-9e3d-a5b57925df8f tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:35.391578 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c027a2fc-823b-4600-9e3d-a5b57925df8f tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bf99de7a594e209f995e62db441850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda4f5ee41d2439e935ee0f658f465d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:46:35.398938 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c027a2fc-823b-4600-9e3d-a5b57925df8f tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] 10.222.0.20 "GET /compute/v2.1/servers/8e3ee82e-b49c-4d49-aca8-7a42af4de7dc" status: 200 len: 1319 microversion: 2.1 time: 0.175705 Apr 16 21:46:35.400142 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3251/6660] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:46:35 2022] GET /compute/v2.1/servers/8e3ee82e-b49c-4d49-aca8-7a42af4de7dc => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:46:36.423357 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9399148d-b427-4056-aa22-d1e98187d8e6 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:46:36.425472 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9399148d-b427-4056-aa22-d1e98187d8e6 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] [instance: 8e3ee82e-b49c-4d49-aca8-7a42af4de7dc] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:46:36.433220 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9399148d-b427-4056-aa22-d1e98187d8e6 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:36.446566 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9399148d-b427-4056-aa22-d1e98187d8e6 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:36.447628 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9399148d-b427-4056-aa22-d1e98187d8e6 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:36.451902 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9399148d-b427-4056-aa22-d1e98187d8e6 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:36.651158 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9399148d-b427-4056-aa22-d1e98187d8e6 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bf99de7a594e209f995e62db441850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda4f5ee41d2439e935ee0f658f465d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:46:36.659783 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9399148d-b427-4056-aa22-d1e98187d8e6 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] 10.222.0.20 "GET /compute/v2.1/servers/8e3ee82e-b49c-4d49-aca8-7a42af4de7dc" status: 200 len: 1319 microversion: 2.1 time: 0.241427 Apr 16 21:46:36.660764 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3410/6661] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:46:36 2022] GET /compute/v2.1/servers/8e3ee82e-b49c-4d49-aca8-7a42af4de7dc => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:46:37.681987 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5190837b-346b-4c74-ab4b-e75d3b8186b5 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:46:37.682608 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5190837b-346b-4c74-ab4b-e75d3b8186b5 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] [instance: 8e3ee82e-b49c-4d49-aca8-7a42af4de7dc] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:46:37.690253 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5190837b-346b-4c74-ab4b-e75d3b8186b5 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:37.690710 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5190837b-346b-4c74-ab4b-e75d3b8186b5 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:37.691496 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5190837b-346b-4c74-ab4b-e75d3b8186b5 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:37.693653 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5190837b-346b-4c74-ab4b-e75d3b8186b5 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:37.826405 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5190837b-346b-4c74-ab4b-e75d3b8186b5 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bf99de7a594e209f995e62db441850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda4f5ee41d2439e935ee0f658f465d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:46:37.834180 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5190837b-346b-4c74-ab4b-e75d3b8186b5 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] 10.222.0.20 "GET /compute/v2.1/servers/8e3ee82e-b49c-4d49-aca8-7a42af4de7dc" status: 200 len: 1319 microversion: 2.1 time: 0.156132 Apr 16 21:46:37.836848 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3252/6662] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:46:37 2022] GET /compute/v2.1/servers/8e3ee82e-b49c-4d49-aca8-7a42af4de7dc => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:46:38.851607 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8a858887-d455-484a-b8e1-c9fd090bf1d4 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:46:38.852068 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8a858887-d455-484a-b8e1-c9fd090bf1d4 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] [instance: 8e3ee82e-b49c-4d49-aca8-7a42af4de7dc] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:46:38.859697 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8a858887-d455-484a-b8e1-c9fd090bf1d4 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:38.860158 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8a858887-d455-484a-b8e1-c9fd090bf1d4 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:38.860985 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8a858887-d455-484a-b8e1-c9fd090bf1d4 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:38.861418 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8a858887-d455-484a-b8e1-c9fd090bf1d4 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:38.980407 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-a4c4db7f-a287-40f8-8715-15e276cbee9a req-6afa2be2-5a9f-4a3c-b162-6d6fee77fca8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e3ee82e-b49c-4d49-aca8-7a42af4de7dc", "name": "network-vif-plugged", "status": "completed", "tag": "5d901921-b640-4e8b-a7d1-f001809168ce"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:46:38.990059 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-a4c4db7f-a287-40f8-8715-15e276cbee9a req-6afa2be2-5a9f-4a3c-b162-6d6fee77fca8 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:38.990519 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-a4c4db7f-a287-40f8-8715-15e276cbee9a req-6afa2be2-5a9f-4a3c-b162-6d6fee77fca8 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:39.003553 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8a858887-d455-484a-b8e1-c9fd090bf1d4 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bf99de7a594e209f995e62db441850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda4f5ee41d2439e935ee0f658f465d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:46:39.007643 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-a4c4db7f-a287-40f8-8715-15e276cbee9a req-6afa2be2-5a9f-4a3c-b162-6d6fee77fca8 service nova] Creating event network-vif-plugged:5d901921-b640-4e8b-a7d1-f001809168ce for instance 8e3ee82e-b49c-4d49-aca8-7a42af4de7dc on nch1-master-1 Apr 16 21:46:39.011347 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8a858887-d455-484a-b8e1-c9fd090bf1d4 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] 10.222.0.20 "GET /compute/v2.1/servers/8e3ee82e-b49c-4d49-aca8-7a42af4de7dc" status: 200 len: 1319 microversion: 2.1 time: 0.163856 Apr 16 21:46:39.012629 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3411/6663] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:46:38 2022] GET /compute/v2.1/servers/8e3ee82e-b49c-4d49-aca8-7a42af4de7dc => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:46:39.013271 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-a4c4db7f-a287-40f8-8715-15e276cbee9a req-6afa2be2-5a9f-4a3c-b162-6d6fee77fca8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036745 Apr 16 21:46:39.013861 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3253/6664] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:46:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:46:40.029632 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f4784672-b5a4-43ff-8bcd-ea39e3b53e90 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:46:40.030302 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f4784672-b5a4-43ff-8bcd-ea39e3b53e90 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] [instance: 8e3ee82e-b49c-4d49-aca8-7a42af4de7dc] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:46:40.037337 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f4784672-b5a4-43ff-8bcd-ea39e3b53e90 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:40.037832 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f4784672-b5a4-43ff-8bcd-ea39e3b53e90 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:40.038642 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f4784672-b5a4-43ff-8bcd-ea39e3b53e90 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:40.039093 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f4784672-b5a4-43ff-8bcd-ea39e3b53e90 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:40.177225 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f4784672-b5a4-43ff-8bcd-ea39e3b53e90 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bf99de7a594e209f995e62db441850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda4f5ee41d2439e935ee0f658f465d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:46:40.184725 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f4784672-b5a4-43ff-8bcd-ea39e3b53e90 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] 10.222.0.20 "GET /compute/v2.1/servers/8e3ee82e-b49c-4d49-aca8-7a42af4de7dc" status: 200 len: 1319 microversion: 2.1 time: 0.159572 Apr 16 21:46:40.185312 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3412/6665] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:46:40 2022] GET /compute/v2.1/servers/8e3ee82e-b49c-4d49-aca8-7a42af4de7dc => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:46:41.202944 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3554d871-bce2-4629-8b69-7582f8aa20d9 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:46:41.203600 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3554d871-bce2-4629-8b69-7582f8aa20d9 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] [instance: 8e3ee82e-b49c-4d49-aca8-7a42af4de7dc] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:46:41.209842 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3554d871-bce2-4629-8b69-7582f8aa20d9 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:41.210296 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3554d871-bce2-4629-8b69-7582f8aa20d9 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:41.211101 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3554d871-bce2-4629-8b69-7582f8aa20d9 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:41.215940 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3554d871-bce2-4629-8b69-7582f8aa20d9 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:41.342857 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3554d871-bce2-4629-8b69-7582f8aa20d9 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bf99de7a594e209f995e62db441850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda4f5ee41d2439e935ee0f658f465d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:46:41.350914 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3554d871-bce2-4629-8b69-7582f8aa20d9 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] 10.222.0.20 "GET /compute/v2.1/servers/8e3ee82e-b49c-4d49-aca8-7a42af4de7dc" status: 200 len: 1508 microversion: 2.1 time: 0.153196 Apr 16 21:46:41.351701 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3254/6666] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:46:41 2022] GET /compute/v2.1/servers/8e3ee82e-b49c-4d49-aca8-7a42af4de7dc => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:46:41.368244 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c78dbece-c607-4a7f-8b62-2c95fc1cf1fc tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b419c8ec-d8d6-495e-9cec-3da461c92db9", "device": "/dev/sdb"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:46:41.369393 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c78dbece-c607-4a7f-8b62-2c95fc1cf1fc tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] [instance: 8e3ee82e-b49c-4d49-aca8-7a42af4de7dc] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:46:41.377124 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c78dbece-c607-4a7f-8b62-2c95fc1cf1fc tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:41.377577 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c78dbece-c607-4a7f-8b62-2c95fc1cf1fc tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:41.378353 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c78dbece-c607-4a7f-8b62-2c95fc1cf1fc tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:41.378795 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c78dbece-c607-4a7f-8b62-2c95fc1cf1fc tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:42.217480 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c78dbece-c607-4a7f-8b62-2c95fc1cf1fc tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] 10.222.0.20 "POST /compute/v2.1/servers/8e3ee82e-b49c-4d49-aca8-7a42af4de7dc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.853400 Apr 16 21:46:42.218252 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3413/6667] 10.222.0.20 () {60 vars in 1322 bytes} [Sat Apr 16 21:46:41 2022] POST /compute/v2.1/servers/8e3ee82e-b49c-4d49-aca8-7a42af4de7dc/os-volume_attachments => generated 194 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:46:44.961597 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-294837084", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "dbaffdb9-592f-43f8-8f98-1f062f804f7e", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "7ab5cb2e-2db3-494a-9695-37178734f696"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:46:45.049936 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] validate_networks() for [('7ab5cb2e-2db3-494a-9695-37178734f696', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:46:45.430252 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:46:45.430689 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:46:45.431175 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:46:45.431595 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:46:45.432015 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:46:45.441264 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:45.441725 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:45.442533 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:45.442975 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:45.460197 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Getting quotas for project dfcde168250f4d16b2d305afed23fee5. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:46:45.465434 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Getting quotas for user 9771814136c84ab3a13bc98dfd79a40f and project dfcde168250f4d16b2d305afed23fee5. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:46:45.478113 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:46:45.480156 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: e36e9859-e176-4fab-b781-c77b88ee33c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='dbaffdb9-592f-43f8-8f98-1f062f804f7e',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:46:45.591076 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6f4a5515-8c15-4f49-93dc-e8ae04ea5764 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.633571 Apr 16 21:46:45.591754 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3255/6668] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:46:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:46:45.602934 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-688db30b-ae56-41fc-afa7-18bcb611c448 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:46:45.603551 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-688db30b-ae56-41fc-afa7-18bcb611c448 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: e36e9859-e176-4fab-b781-c77b88ee33c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:46:45.663277 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-688db30b-ae56-41fc-afa7-18bcb611c448 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:46:45.670678 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-688db30b-ae56-41fc-afa7-18bcb611c448 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7" status: 200 len: 1056 microversion: 2.1 time: 0.072778 Apr 16 21:46:45.671576 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3414/6669] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:46:45 2022] GET /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7 => generated 1056 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:46:46.690239 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1ca3c233-f782-4c76-842f-9bacf84de182 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:46:46.690857 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1ca3c233-f782-4c76-842f-9bacf84de182 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: e36e9859-e176-4fab-b781-c77b88ee33c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:46:46.697012 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1ca3c233-f782-4c76-842f-9bacf84de182 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:46.697453 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1ca3c233-f782-4c76-842f-9bacf84de182 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:46.698227 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1ca3c233-f782-4c76-842f-9bacf84de182 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:46.699174 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1ca3c233-f782-4c76-842f-9bacf84de182 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:46.762672 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1ca3c233-f782-4c76-842f-9bacf84de182 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:46:46.769252 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1ca3c233-f782-4c76-842f-9bacf84de182 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7" status: 200 len: 1060 microversion: 2.1 time: 0.085405 Apr 16 21:46:46.769992 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3256/6670] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:46:46 2022] GET /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7 => generated 1060 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:46:47.786316 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-016adb7c-2fec-4cf8-88b5-61b17685eb37 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:46:47.786957 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-016adb7c-2fec-4cf8-88b5-61b17685eb37 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: e36e9859-e176-4fab-b781-c77b88ee33c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:46:47.795165 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-016adb7c-2fec-4cf8-88b5-61b17685eb37 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:47.795705 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-016adb7c-2fec-4cf8-88b5-61b17685eb37 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:47.796598 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-016adb7c-2fec-4cf8-88b5-61b17685eb37 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:47.797117 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-016adb7c-2fec-4cf8-88b5-61b17685eb37 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:47.863216 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-016adb7c-2fec-4cf8-88b5-61b17685eb37 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:46:47.871788 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-016adb7c-2fec-4cf8-88b5-61b17685eb37 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7" status: 200 len: 1116 microversion: 2.1 time: 0.089668 Apr 16 21:46:47.872901 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3415/6671] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:46:47 2022] GET /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7 => generated 1116 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:46:48.890889 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3b5f7ef7-6ea4-4337-83de-92480d05baf3 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:46:48.891540 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3b5f7ef7-6ea4-4337-83de-92480d05baf3 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: e36e9859-e176-4fab-b781-c77b88ee33c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:46:48.902384 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3b5f7ef7-6ea4-4337-83de-92480d05baf3 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:48.903027 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3b5f7ef7-6ea4-4337-83de-92480d05baf3 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:48.903851 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3b5f7ef7-6ea4-4337-83de-92480d05baf3 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:48.904327 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3b5f7ef7-6ea4-4337-83de-92480d05baf3 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:49.101451 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3b5f7ef7-6ea4-4337-83de-92480d05baf3 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:46:49.109280 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3b5f7ef7-6ea4-4337-83de-92480d05baf3 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7" status: 200 len: 1168 microversion: 2.1 time: 0.224008 Apr 16 21:46:49.110154 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3257/6672] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:46:48 2022] GET /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7 => generated 1168 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:46:49.560906 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-90a8ec09-e6b6-4fd3-ad07-7fffe17414b7 req-3ab97249-af71-4e81-b1a0-0e4d7ac783fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e36e9859-e176-4fab-b781-c77b88ee33c7", "tag": "88fe82b3-dbdd-46e4-8da1-60c552d90216"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:46:49.569983 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-90a8ec09-e6b6-4fd3-ad07-7fffe17414b7 req-3ab97249-af71-4e81-b1a0-0e4d7ac783fb service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:49.570439 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-90a8ec09-e6b6-4fd3-ad07-7fffe17414b7 req-3ab97249-af71-4e81-b1a0-0e4d7ac783fb service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:49.581783 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-90a8ec09-e6b6-4fd3-ad07-7fffe17414b7 req-3ab97249-af71-4e81-b1a0-0e4d7ac783fb service nova] Creating event network-changed:88fe82b3-dbdd-46e4-8da1-60c552d90216 for instance e36e9859-e176-4fab-b781-c77b88ee33c7 on nch2-master-1 Apr 16 21:46:49.590571 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-90a8ec09-e6b6-4fd3-ad07-7fffe17414b7 req-3ab97249-af71-4e81-b1a0-0e4d7ac783fb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034403 Apr 16 21:46:49.591342 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3416/6673] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:46:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:46:50.127306 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-23df7133-40da-4401-a350-e1948418b70d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:46:50.128016 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-23df7133-40da-4401-a350-e1948418b70d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: e36e9859-e176-4fab-b781-c77b88ee33c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:46:50.135371 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-23df7133-40da-4401-a350-e1948418b70d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:50.139785 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-23df7133-40da-4401-a350-e1948418b70d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:50.139785 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-23df7133-40da-4401-a350-e1948418b70d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:50.139785 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-23df7133-40da-4401-a350-e1948418b70d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:50.338462 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-23df7133-40da-4401-a350-e1948418b70d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:46:50.348748 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-23df7133-40da-4401-a350-e1948418b70d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7" status: 200 len: 1168 microversion: 2.1 time: 0.225199 Apr 16 21:46:50.365728 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3258/6674] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:46:50 2022] GET /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7 => generated 1168 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:46:51.375033 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-60c038f0-5992-4fc6-94fa-1ec9007d581c tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:46:51.375733 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-60c038f0-5992-4fc6-94fa-1ec9007d581c tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: e36e9859-e176-4fab-b781-c77b88ee33c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:46:51.381975 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-60c038f0-5992-4fc6-94fa-1ec9007d581c tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:51.382413 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-60c038f0-5992-4fc6-94fa-1ec9007d581c tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:51.383187 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-60c038f0-5992-4fc6-94fa-1ec9007d581c tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:51.383624 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-60c038f0-5992-4fc6-94fa-1ec9007d581c tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:51.514391 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-60c038f0-5992-4fc6-94fa-1ec9007d581c tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:46:51.521526 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-60c038f0-5992-4fc6-94fa-1ec9007d581c tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7" status: 200 len: 1168 microversion: 2.1 time: 0.152052 Apr 16 21:46:51.522087 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3417/6675] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:46:51 2022] GET /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7 => generated 1168 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:46:52.538000 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-43c9a736-13ea-4d6e-bd8e-836cb1da501a tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:46:52.538585 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-43c9a736-13ea-4d6e-bd8e-836cb1da501a tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: e36e9859-e176-4fab-b781-c77b88ee33c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:46:52.545420 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-43c9a736-13ea-4d6e-bd8e-836cb1da501a tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:52.545881 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-43c9a736-13ea-4d6e-bd8e-836cb1da501a tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:52.546664 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-43c9a736-13ea-4d6e-bd8e-836cb1da501a tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:52.547105 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-43c9a736-13ea-4d6e-bd8e-836cb1da501a tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:52.681861 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-43c9a736-13ea-4d6e-bd8e-836cb1da501a tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:46:52.689728 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-43c9a736-13ea-4d6e-bd8e-836cb1da501a tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7" status: 200 len: 1168 microversion: 2.1 time: 0.155879 Apr 16 21:46:52.690395 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3259/6676] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:46:52 2022] GET /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7 => generated 1168 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:46:53.706598 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5a1ec0c6-af4a-441a-919f-a88c61ba7666 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:46:53.707541 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5a1ec0c6-af4a-441a-919f-a88c61ba7666 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: e36e9859-e176-4fab-b781-c77b88ee33c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:46:53.714813 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5a1ec0c6-af4a-441a-919f-a88c61ba7666 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:53.715278 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5a1ec0c6-af4a-441a-919f-a88c61ba7666 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:53.716593 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5a1ec0c6-af4a-441a-919f-a88c61ba7666 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:53.717077 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5a1ec0c6-af4a-441a-919f-a88c61ba7666 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:53.850296 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5a1ec0c6-af4a-441a-919f-a88c61ba7666 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:46:53.858101 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5a1ec0c6-af4a-441a-919f-a88c61ba7666 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7" status: 200 len: 1202 microversion: 2.1 time: 0.155450 Apr 16 21:46:53.858692 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3418/6677] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:46:53 2022] GET /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7 => generated 1202 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:46:54.875499 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f3cad641-ff8b-4b68-af0c-9b0c5361e3a9 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:46:54.876291 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f3cad641-ff8b-4b68-af0c-9b0c5361e3a9 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: e36e9859-e176-4fab-b781-c77b88ee33c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:46:54.883052 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f3cad641-ff8b-4b68-af0c-9b0c5361e3a9 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:54.883514 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f3cad641-ff8b-4b68-af0c-9b0c5361e3a9 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:54.884327 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f3cad641-ff8b-4b68-af0c-9b0c5361e3a9 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:54.884778 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f3cad641-ff8b-4b68-af0c-9b0c5361e3a9 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:55.016444 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f3cad641-ff8b-4b68-af0c-9b0c5361e3a9 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:46:55.024846 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f3cad641-ff8b-4b68-af0c-9b0c5361e3a9 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7" status: 200 len: 1202 microversion: 2.1 time: 0.153884 Apr 16 21:46:55.025594 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3260/6678] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:46:54 2022] GET /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7 => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:46:56.043161 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-05cafa84-939d-4cc4-a82e-fc35583898ab tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:46:56.043784 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-05cafa84-939d-4cc4-a82e-fc35583898ab tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: e36e9859-e176-4fab-b781-c77b88ee33c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:46:56.050710 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-05cafa84-939d-4cc4-a82e-fc35583898ab tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:56.051176 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-05cafa84-939d-4cc4-a82e-fc35583898ab tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:56.051966 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-05cafa84-939d-4cc4-a82e-fc35583898ab tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:56.052448 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-05cafa84-939d-4cc4-a82e-fc35583898ab tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:56.185536 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-05cafa84-939d-4cc4-a82e-fc35583898ab tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:46:56.192958 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-05cafa84-939d-4cc4-a82e-fc35583898ab tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7" status: 200 len: 1202 microversion: 2.1 time: 0.154063 Apr 16 21:46:56.193532 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3419/6679] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:46:56 2022] GET /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7 => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:46:57.209787 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-eba86c2c-f54c-4f0c-849f-dd569e10db74 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:46:57.210403 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-eba86c2c-f54c-4f0c-849f-dd569e10db74 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: e36e9859-e176-4fab-b781-c77b88ee33c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:46:57.217984 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eba86c2c-f54c-4f0c-849f-dd569e10db74 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:57.218447 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eba86c2c-f54c-4f0c-849f-dd569e10db74 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:57.219220 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eba86c2c-f54c-4f0c-849f-dd569e10db74 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:57.219657 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eba86c2c-f54c-4f0c-849f-dd569e10db74 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:57.348688 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-eba86c2c-f54c-4f0c-849f-dd569e10db74 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:46:57.356077 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-eba86c2c-f54c-4f0c-849f-dd569e10db74 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7" status: 200 len: 1202 microversion: 2.1 time: 0.150245 Apr 16 21:46:57.356705 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3261/6680] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:46:57 2022] GET /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7 => generated 1202 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:46:58.372704 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a1452d8e-e579-4f33-b6b9-f7875bf9525f tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:46:58.373354 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a1452d8e-e579-4f33-b6b9-f7875bf9525f tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: e36e9859-e176-4fab-b781-c77b88ee33c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:46:58.380103 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a1452d8e-e579-4f33-b6b9-f7875bf9525f tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:58.380588 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a1452d8e-e579-4f33-b6b9-f7875bf9525f tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:58.381375 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a1452d8e-e579-4f33-b6b9-f7875bf9525f tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:58.384474 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a1452d8e-e579-4f33-b6b9-f7875bf9525f tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:58.511429 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a1452d8e-e579-4f33-b6b9-f7875bf9525f tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:46:58.519481 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a1452d8e-e579-4f33-b6b9-f7875bf9525f tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7" status: 200 len: 1202 microversion: 2.1 time: 0.150949 Apr 16 21:46:58.520053 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3420/6681] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:46:58 2022] GET /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7 => generated 1202 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:46:59.537310 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b82f0aa4-f7e9-4e36-8fa0-874a6f4d5cd5 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:46:59.537859 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b82f0aa4-f7e9-4e36-8fa0-874a6f4d5cd5 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: e36e9859-e176-4fab-b781-c77b88ee33c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:46:59.544515 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b82f0aa4-f7e9-4e36-8fa0-874a6f4d5cd5 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:59.544976 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b82f0aa4-f7e9-4e36-8fa0-874a6f4d5cd5 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:59.545802 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b82f0aa4-f7e9-4e36-8fa0-874a6f4d5cd5 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:46:59.546244 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b82f0aa4-f7e9-4e36-8fa0-874a6f4d5cd5 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:46:59.678584 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b82f0aa4-f7e9-4e36-8fa0-874a6f4d5cd5 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:46:59.687736 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b82f0aa4-f7e9-4e36-8fa0-874a6f4d5cd5 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7" status: 200 len: 1202 microversion: 2.1 time: 0.153696 Apr 16 21:46:59.687860 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3262/6682] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:46:59 2022] GET /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7 => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:47:00.339952 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-1388d72a-7d3f-4c28-8383-4613e5b2b5c9 req-014e0531-d747-4fe3-aa88-d329c2db77df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e36e9859-e176-4fab-b781-c77b88ee33c7", "name": "network-vif-plugged", "status": "completed", "tag": "88fe82b3-dbdd-46e4-8da1-60c552d90216"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:47:00.349586 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-1388d72a-7d3f-4c28-8383-4613e5b2b5c9 req-014e0531-d747-4fe3-aa88-d329c2db77df service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:00.350045 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-1388d72a-7d3f-4c28-8383-4613e5b2b5c9 req-014e0531-d747-4fe3-aa88-d329c2db77df service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:00.360867 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-1388d72a-7d3f-4c28-8383-4613e5b2b5c9 req-014e0531-d747-4fe3-aa88-d329c2db77df service nova] Creating event network-vif-plugged:88fe82b3-dbdd-46e4-8da1-60c552d90216 for instance e36e9859-e176-4fab-b781-c77b88ee33c7 on nch2-master-1 Apr 16 21:47:00.366190 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-1388d72a-7d3f-4c28-8383-4613e5b2b5c9 req-014e0531-d747-4fe3-aa88-d329c2db77df service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030557 Apr 16 21:47:00.366827 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3421/6683] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:47:00.704181 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c7a5acf9-0852-4cff-b7d2-f207ae0c0ed0 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:47:00.704816 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c7a5acf9-0852-4cff-b7d2-f207ae0c0ed0 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: e36e9859-e176-4fab-b781-c77b88ee33c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:47:00.711634 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c7a5acf9-0852-4cff-b7d2-f207ae0c0ed0 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:00.712667 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c7a5acf9-0852-4cff-b7d2-f207ae0c0ed0 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:00.713001 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c7a5acf9-0852-4cff-b7d2-f207ae0c0ed0 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:00.713442 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c7a5acf9-0852-4cff-b7d2-f207ae0c0ed0 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:00.849860 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c7a5acf9-0852-4cff-b7d2-f207ae0c0ed0 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:47:00.857337 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c7a5acf9-0852-4cff-b7d2-f207ae0c0ed0 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7" status: 200 len: 1202 microversion: 2.1 time: 0.157166 Apr 16 21:47:00.857906 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3263/6684] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:47:00 2022] GET /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7 => generated 1202 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:47:01.876759 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f9f33321-f405-4c31-a3d6-91ffb3af1858 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:47:01.877462 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f9f33321-f405-4c31-a3d6-91ffb3af1858 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: e36e9859-e176-4fab-b781-c77b88ee33c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:47:01.883753 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9f33321-f405-4c31-a3d6-91ffb3af1858 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:01.884562 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9f33321-f405-4c31-a3d6-91ffb3af1858 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:01.885652 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9f33321-f405-4c31-a3d6-91ffb3af1858 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:01.886102 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9f33321-f405-4c31-a3d6-91ffb3af1858 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:02.020473 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f9f33321-f405-4c31-a3d6-91ffb3af1858 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:47:02.028354 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f9f33321-f405-4c31-a3d6-91ffb3af1858 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7" status: 200 len: 1202 microversion: 2.1 time: 0.157195 Apr 16 21:47:02.028934 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3422/6685] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:47:01 2022] GET /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7 => generated 1202 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:47:03.047097 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fe20592f-1261-4b7d-a23f-ffd4f17d3955 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:47:03.048364 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-fe20592f-1261-4b7d-a23f-ffd4f17d3955 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: e36e9859-e176-4fab-b781-c77b88ee33c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:47:03.055731 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fe20592f-1261-4b7d-a23f-ffd4f17d3955 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:03.056355 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fe20592f-1261-4b7d-a23f-ffd4f17d3955 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:03.057242 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fe20592f-1261-4b7d-a23f-ffd4f17d3955 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:03.057768 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fe20592f-1261-4b7d-a23f-ffd4f17d3955 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:03.197932 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-fe20592f-1261-4b7d-a23f-ffd4f17d3955 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:47:03.205867 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fe20592f-1261-4b7d-a23f-ffd4f17d3955 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7" status: 200 len: 1390 microversion: 2.1 time: 0.163833 Apr 16 21:47:03.206442 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3264/6686] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:47:03 2022] GET /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7 => generated 1390 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:47:03.221788 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9ad75826-99a0-44b7-bb22-b6b57b3bdd38 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:47:03.222399 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9ad75826-99a0-44b7-bb22-b6b57b3bdd38 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: e36e9859-e176-4fab-b781-c77b88ee33c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:47:03.229241 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9ad75826-99a0-44b7-bb22-b6b57b3bdd38 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:03.229693 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9ad75826-99a0-44b7-bb22-b6b57b3bdd38 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:03.230498 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9ad75826-99a0-44b7-bb22-b6b57b3bdd38 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:03.230955 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9ad75826-99a0-44b7-bb22-b6b57b3bdd38 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:03.362001 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9ad75826-99a0-44b7-bb22-b6b57b3bdd38 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:47:03.370122 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9ad75826-99a0-44b7-bb22-b6b57b3bdd38 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7" status: 200 len: 1390 microversion: 2.1 time: 0.152180 Apr 16 21:47:03.370694 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3423/6687] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:47:03 2022] GET /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7 => generated 1390 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:47:03.386215 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-dd28e1ba-1c34-4f5a-88dc-3037de8bd09e tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:47:03.386834 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-dd28e1ba-1c34-4f5a-88dc-3037de8bd09e tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: e36e9859-e176-4fab-b781-c77b88ee33c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:47:03.393369 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dd28e1ba-1c34-4f5a-88dc-3037de8bd09e tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:03.393828 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dd28e1ba-1c34-4f5a-88dc-3037de8bd09e tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:03.394605 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dd28e1ba-1c34-4f5a-88dc-3037de8bd09e tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:03.395053 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dd28e1ba-1c34-4f5a-88dc-3037de8bd09e tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:03.520487 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-dd28e1ba-1c34-4f5a-88dc-3037de8bd09e tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:47:03.527959 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-dd28e1ba-1c34-4f5a-88dc-3037de8bd09e tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7" status: 200 len: 1390 microversion: 2.1 time: 0.145673 Apr 16 21:47:03.528634 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3265/6688] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:47:03 2022] GET /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7 => generated 1390 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:47:03.594019 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9345d937-5183-462e-a9de-b404529f88f9 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:47:03.594524 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9345d937-5183-462e-a9de-b404529f88f9 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: e36e9859-e176-4fab-b781-c77b88ee33c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:47:03.600453 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9345d937-5183-462e-a9de-b404529f88f9 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:03.600918 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9345d937-5183-462e-a9de-b404529f88f9 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:03.601695 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9345d937-5183-462e-a9de-b404529f88f9 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:03.602142 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9345d937-5183-462e-a9de-b404529f88f9 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:03.627283 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9345d937-5183-462e-a9de-b404529f88f9 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: e36e9859-e176-4fab-b781-c77b88ee33c7] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:47:03.914202 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9345d937-5183-462e-a9de-b404529f88f9 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7" status: 204 len: 0 microversion: 2.1 time: 0.323518 Apr 16 21:47:03.914990 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3424/6689] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:47:03 2022] DELETE /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:47:03.923687 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f973aa85-968d-4bda-bf7b-4d00da854c8a tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:47:03.924398 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f973aa85-968d-4bda-bf7b-4d00da854c8a tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: e36e9859-e176-4fab-b781-c77b88ee33c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:47:03.930368 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f973aa85-968d-4bda-bf7b-4d00da854c8a tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:03.930832 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f973aa85-968d-4bda-bf7b-4d00da854c8a tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:03.931618 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f973aa85-968d-4bda-bf7b-4d00da854c8a tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:03.932067 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f973aa85-968d-4bda-bf7b-4d00da854c8a tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:04.059999 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f973aa85-968d-4bda-bf7b-4d00da854c8a tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:47:04.067490 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f973aa85-968d-4bda-bf7b-4d00da854c8a tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7" status: 200 len: 1396 microversion: 2.1 time: 0.148378 Apr 16 21:47:04.068370 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3266/6690] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:47:03 2022] GET /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7 => generated 1396 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:47:05.085086 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-05599c93-9b01-425a-b89d-f3c297bce8a8 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:47:05.085790 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-05599c93-9b01-425a-b89d-f3c297bce8a8 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: e36e9859-e176-4fab-b781-c77b88ee33c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:47:05.094447 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-05599c93-9b01-425a-b89d-f3c297bce8a8 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:05.095317 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-05599c93-9b01-425a-b89d-f3c297bce8a8 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:05.097385 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-05599c93-9b01-425a-b89d-f3c297bce8a8 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:05.097385 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-05599c93-9b01-425a-b89d-f3c297bce8a8 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:05.229135 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-05599c93-9b01-425a-b89d-f3c297bce8a8 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:47:05.237139 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-05599c93-9b01-425a-b89d-f3c297bce8a8 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7" status: 200 len: 1396 microversion: 2.1 time: 0.156369 Apr 16 21:47:05.237711 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3425/6691] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:47:05 2022] GET /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7 => generated 1396 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:47:06.056422 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-00ade097-5c90-417d-b865-d0672b164a28 req-15cd5ba1-13ca-4af3-b1e4-6787c7281ae5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e36e9859-e176-4fab-b781-c77b88ee33c7", "name": "network-vif-deleted", "tag": "88fe82b3-dbdd-46e4-8da1-60c552d90216"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:47:06.068116 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-00ade097-5c90-417d-b865-d0672b164a28 req-15cd5ba1-13ca-4af3-b1e4-6787c7281ae5 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:06.068592 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-00ade097-5c90-417d-b865-d0672b164a28 req-15cd5ba1-13ca-4af3-b1e4-6787c7281ae5 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:06.081153 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-00ade097-5c90-417d-b865-d0672b164a28 req-15cd5ba1-13ca-4af3-b1e4-6787c7281ae5 service nova] Creating event network-vif-deleted:88fe82b3-dbdd-46e4-8da1-60c552d90216 for instance e36e9859-e176-4fab-b781-c77b88ee33c7 on nch2-master-1 Apr 16 21:47:06.086525 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-00ade097-5c90-417d-b865-d0672b164a28 req-15cd5ba1-13ca-4af3-b1e4-6787c7281ae5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034621 Apr 16 21:47:06.087143 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3267/6692] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:47:06.254274 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-138f3374-4317-4b66-911d-f2700c8cee64 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:47:06.254984 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-138f3374-4317-4b66-911d-f2700c8cee64 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: e36e9859-e176-4fab-b781-c77b88ee33c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:47:06.262183 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-138f3374-4317-4b66-911d-f2700c8cee64 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:06.262647 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-138f3374-4317-4b66-911d-f2700c8cee64 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:06.263448 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-138f3374-4317-4b66-911d-f2700c8cee64 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:06.264082 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-138f3374-4317-4b66-911d-f2700c8cee64 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:06.354301 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-138f3374-4317-4b66-911d-f2700c8cee64 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:47:06.354301 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-138f3374-4317-4b66-911d-f2700c8cee64 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7" status: 200 len: 1187 microversion: 2.1 time: 0.100514 Apr 16 21:47:06.354301 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3426/6693] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:47:06 2022] GET /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7 => generated 1187 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:47:07.369124 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-785857be-f063-4cb8-9301-7cd9858e2cfa tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:47:07.369855 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-785857be-f063-4cb8-9301-7cd9858e2cfa tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: e36e9859-e176-4fab-b781-c77b88ee33c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:47:07.377472 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-785857be-f063-4cb8-9301-7cd9858e2cfa tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:07.377937 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-785857be-f063-4cb8-9301-7cd9858e2cfa tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:07.378728 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-785857be-f063-4cb8-9301-7cd9858e2cfa tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:07.379169 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-785857be-f063-4cb8-9301-7cd9858e2cfa tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:07.393514 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-785857be-f063-4cb8-9301-7cd9858e2cfa tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] HTTP exception thrown: Instance e36e9859-e176-4fab-b781-c77b88ee33c7 could not be found. Apr 16 21:47:07.397290 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-785857be-f063-4cb8-9301-7cd9858e2cfa tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Returning 404 to user: Instance e36e9859-e176-4fab-b781-c77b88ee33c7 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:47:07.397290 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-785857be-f063-4cb8-9301-7cd9858e2cfa tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7" status: 404 len: 111 microversion: 2.1 time: 0.030315 Apr 16 21:47:07.397290 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3268/6694] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:47:07 2022] GET /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:47:07.637841 ncdv-master-1 devstack@n-api.service[137408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 21:47:07.638413 ncdv-master-1 devstack@n-api.service[137408]: Sat Apr 16 21:47:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 21:47:13.720547 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-17ecfe50-9350-47bd-9954-3f21bb6ea4f1 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:47:13.721139 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-17ecfe50-9350-47bd-9954-3f21bb6ea4f1 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: e36e9859-e176-4fab-b781-c77b88ee33c7] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:47:13.728114 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-17ecfe50-9350-47bd-9954-3f21bb6ea4f1 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:13.728610 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-17ecfe50-9350-47bd-9954-3f21bb6ea4f1 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:13.729394 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-17ecfe50-9350-47bd-9954-3f21bb6ea4f1 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:13.729838 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-17ecfe50-9350-47bd-9954-3f21bb6ea4f1 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:13.743803 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-17ecfe50-9350-47bd-9954-3f21bb6ea4f1 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] HTTP exception thrown: Instance e36e9859-e176-4fab-b781-c77b88ee33c7 could not be found. Apr 16 21:47:13.744431 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-17ecfe50-9350-47bd-9954-3f21bb6ea4f1 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Returning 404 to user: Instance e36e9859-e176-4fab-b781-c77b88ee33c7 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:47:13.745260 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-17ecfe50-9350-47bd-9954-3f21bb6ea4f1 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7" status: 404 len: 111 microversion: 2.1 time: 0.029190 Apr 16 21:47:13.745789 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3427/6695] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:47:13 2022] DELETE /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:47:13.754033 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b2595907-dbc2-4817-ad8d-5d4bf8917a1d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:47:13.754713 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b2595907-dbc2-4817-ad8d-5d4bf8917a1d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: e36e9859-e176-4fab-b781-c77b88ee33c7] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:47:13.762219 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b2595907-dbc2-4817-ad8d-5d4bf8917a1d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:13.762692 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b2595907-dbc2-4817-ad8d-5d4bf8917a1d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:13.763503 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b2595907-dbc2-4817-ad8d-5d4bf8917a1d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:13.763954 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b2595907-dbc2-4817-ad8d-5d4bf8917a1d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:13.779020 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-b2595907-dbc2-4817-ad8d-5d4bf8917a1d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] HTTP exception thrown: Instance e36e9859-e176-4fab-b781-c77b88ee33c7 could not be found. Apr 16 21:47:13.779626 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b2595907-dbc2-4817-ad8d-5d4bf8917a1d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Returning 404 to user: Instance e36e9859-e176-4fab-b781-c77b88ee33c7 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:47:13.780524 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b2595907-dbc2-4817-ad8d-5d4bf8917a1d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7" status: 404 len: 111 microversion: 2.1 time: 0.030386 Apr 16 21:47:13.781071 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3269/6696] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:47:13 2022] GET /compute/v2.1/servers/e36e9859-e176-4fab-b781-c77b88ee33c7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:47:31.620357 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b5a47bf1-4297-4457-9fba-1af21ad623bd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-320927755", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "07e9f1ad-2e5e-4c0e-907f-ab51c873b678", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "7ab5cb2e-2db3-494a-9695-37178734f696"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:47:31.679307 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-b5a47bf1-4297-4457-9fba-1af21ad623bd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] validate_networks() for [('7ab5cb2e-2db3-494a-9695-37178734f696', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:47:32.039101 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-b5a47bf1-4297-4457-9fba-1af21ad623bd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:47:32.039557 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-b5a47bf1-4297-4457-9fba-1af21ad623bd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:47:32.040035 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-b5a47bf1-4297-4457-9fba-1af21ad623bd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:47:32.040481 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-b5a47bf1-4297-4457-9fba-1af21ad623bd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:47:32.040898 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-b5a47bf1-4297-4457-9fba-1af21ad623bd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:47:32.050521 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5a47bf1-4297-4457-9fba-1af21ad623bd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:32.050981 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5a47bf1-4297-4457-9fba-1af21ad623bd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:32.051788 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5a47bf1-4297-4457-9fba-1af21ad623bd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:32.052252 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5a47bf1-4297-4457-9fba-1af21ad623bd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:32.069660 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-b5a47bf1-4297-4457-9fba-1af21ad623bd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Getting quotas for project dfcde168250f4d16b2d305afed23fee5. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:47:32.074950 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-b5a47bf1-4297-4457-9fba-1af21ad623bd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Getting quotas for user 9771814136c84ab3a13bc98dfd79a40f and project dfcde168250f4d16b2d305afed23fee5. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:47:32.137361 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b5a47bf1-4297-4457-9fba-1af21ad623bd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:47:32.139497 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b5a47bf1-4297-4457-9fba-1af21ad623bd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: 5bfe9916-82fe-4ca4-a05d-9f599340cb36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='07e9f1ad-2e5e-4c0e-907f-ab51c873b678',volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:47:32.561212 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b5a47bf1-4297-4457-9fba-1af21ad623bd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.944824 Apr 16 21:47:32.561994 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3428/6697] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:47:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 946 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:47:32.572282 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4075b105-3eff-41e1-ad24-925f044bc264 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:47:32.572899 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4075b105-3eff-41e1-ad24-925f044bc264 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: 5bfe9916-82fe-4ca4-a05d-9f599340cb36] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:47:32.632054 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4075b105-3eff-41e1-ad24-925f044bc264 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:47:32.639614 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4075b105-3eff-41e1-ad24-925f044bc264 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/5bfe9916-82fe-4ca4-a05d-9f599340cb36" status: 200 len: 1070 microversion: 2.1 time: 0.071587 Apr 16 21:47:32.640768 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3270/6698] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:47:32 2022] GET /compute/v2.1/servers/5bfe9916-82fe-4ca4-a05d-9f599340cb36 => generated 1070 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:47:33.657641 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-61a9b3e7-aed4-416d-925e-fd84b762d6b5 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:47:33.658255 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-61a9b3e7-aed4-416d-925e-fd84b762d6b5 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: 5bfe9916-82fe-4ca4-a05d-9f599340cb36] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:47:33.665403 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-61a9b3e7-aed4-416d-925e-fd84b762d6b5 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:33.665984 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-61a9b3e7-aed4-416d-925e-fd84b762d6b5 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:33.666762 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-61a9b3e7-aed4-416d-925e-fd84b762d6b5 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:33.667202 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-61a9b3e7-aed4-416d-925e-fd84b762d6b5 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:33.733062 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-61a9b3e7-aed4-416d-925e-fd84b762d6b5 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:47:33.741593 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-61a9b3e7-aed4-416d-925e-fd84b762d6b5 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/5bfe9916-82fe-4ca4-a05d-9f599340cb36" status: 200 len: 1120 microversion: 2.1 time: 0.088854 Apr 16 21:47:33.742146 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3429/6699] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:47:33 2022] GET /compute/v2.1/servers/5bfe9916-82fe-4ca4-a05d-9f599340cb36 => generated 1120 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:47:34.758533 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6984c152-ac84-4f01-8c1c-51ead9e21a1a tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:47:34.759808 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6984c152-ac84-4f01-8c1c-51ead9e21a1a tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: 5bfe9916-82fe-4ca4-a05d-9f599340cb36] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:47:34.769248 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6984c152-ac84-4f01-8c1c-51ead9e21a1a tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:34.769998 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6984c152-ac84-4f01-8c1c-51ead9e21a1a tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:34.770806 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6984c152-ac84-4f01-8c1c-51ead9e21a1a tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:34.771259 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6984c152-ac84-4f01-8c1c-51ead9e21a1a tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:34.840962 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6984c152-ac84-4f01-8c1c-51ead9e21a1a tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:47:34.848716 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6984c152-ac84-4f01-8c1c-51ead9e21a1a tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/5bfe9916-82fe-4ca4-a05d-9f599340cb36" status: 200 len: 1186 microversion: 2.1 time: 0.094171 Apr 16 21:47:34.849305 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3271/6700] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:47:34 2022] GET /compute/v2.1/servers/5bfe9916-82fe-4ca4-a05d-9f599340cb36 => generated 1186 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:47:35.867200 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b55fb255-a8a9-4c08-8d05-b872d511be92 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:47:35.867819 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b55fb255-a8a9-4c08-8d05-b872d511be92 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: 5bfe9916-82fe-4ca4-a05d-9f599340cb36] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:47:35.875696 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b55fb255-a8a9-4c08-8d05-b872d511be92 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:35.876379 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b55fb255-a8a9-4c08-8d05-b872d511be92 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:35.877609 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b55fb255-a8a9-4c08-8d05-b872d511be92 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:35.878263 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b55fb255-a8a9-4c08-8d05-b872d511be92 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:36.023661 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b55fb255-a8a9-4c08-8d05-b872d511be92 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:47:36.032210 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b55fb255-a8a9-4c08-8d05-b872d511be92 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/5bfe9916-82fe-4ca4-a05d-9f599340cb36" status: 200 len: 1228 microversion: 2.1 time: 0.170096 Apr 16 21:47:36.033331 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3430/6701] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:47:35 2022] GET /compute/v2.1/servers/5bfe9916-82fe-4ca4-a05d-9f599340cb36 => generated 1228 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:47:36.101202 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-690c760f-a815-4da6-9baf-f92aef55c159 req-76e3454d-b711-4544-8b1e-af9dcb9af251 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5bfe9916-82fe-4ca4-a05d-9f599340cb36", "tag": "17a36012-56f8-4b50-9369-74faa6c990c5"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:47:36.110615 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-690c760f-a815-4da6-9baf-f92aef55c159 req-76e3454d-b711-4544-8b1e-af9dcb9af251 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:36.111327 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-690c760f-a815-4da6-9baf-f92aef55c159 req-76e3454d-b711-4544-8b1e-af9dcb9af251 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:36.124898 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-690c760f-a815-4da6-9baf-f92aef55c159 req-76e3454d-b711-4544-8b1e-af9dcb9af251 service nova] Creating event network-changed:17a36012-56f8-4b50-9369-74faa6c990c5 for instance 5bfe9916-82fe-4ca4-a05d-9f599340cb36 on nch2-master-1 Apr 16 21:47:36.132406 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-690c760f-a815-4da6-9baf-f92aef55c159 req-76e3454d-b711-4544-8b1e-af9dcb9af251 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033337 Apr 16 21:47:36.132406 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3272/6702] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:47:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:47:37.049977 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a00aa220-e722-4ee8-823d-fe8561385892 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:47:37.050524 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a00aa220-e722-4ee8-823d-fe8561385892 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: 5bfe9916-82fe-4ca4-a05d-9f599340cb36] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:47:37.057415 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a00aa220-e722-4ee8-823d-fe8561385892 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:37.057878 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a00aa220-e722-4ee8-823d-fe8561385892 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:37.058668 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a00aa220-e722-4ee8-823d-fe8561385892 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:37.059149 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a00aa220-e722-4ee8-823d-fe8561385892 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:37.390492 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a00aa220-e722-4ee8-823d-fe8561385892 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:47:37.398351 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a00aa220-e722-4ee8-823d-fe8561385892 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/5bfe9916-82fe-4ca4-a05d-9f599340cb36" status: 200 len: 1216 microversion: 2.1 time: 0.353050 Apr 16 21:47:37.398915 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3431/6703] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:47:37 2022] GET /compute/v2.1/servers/5bfe9916-82fe-4ca4-a05d-9f599340cb36 => generated 1216 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:47:38.415326 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-11b123ee-2149-4bdd-9051-c48dc5d29fd6 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:47:38.415947 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-11b123ee-2149-4bdd-9051-c48dc5d29fd6 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: 5bfe9916-82fe-4ca4-a05d-9f599340cb36] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:47:38.423860 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-11b123ee-2149-4bdd-9051-c48dc5d29fd6 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:38.424458 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-11b123ee-2149-4bdd-9051-c48dc5d29fd6 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:38.425312 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-11b123ee-2149-4bdd-9051-c48dc5d29fd6 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:38.425884 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-11b123ee-2149-4bdd-9051-c48dc5d29fd6 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:38.559152 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-11b123ee-2149-4bdd-9051-c48dc5d29fd6 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:47:38.566526 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-11b123ee-2149-4bdd-9051-c48dc5d29fd6 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/5bfe9916-82fe-4ca4-a05d-9f599340cb36" status: 200 len: 1216 microversion: 2.1 time: 0.155485 Apr 16 21:47:38.567087 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3273/6704] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:47:38 2022] GET /compute/v2.1/servers/5bfe9916-82fe-4ca4-a05d-9f599340cb36 => generated 1216 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:47:39.582865 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-57c8ed0c-8712-4e76-9ff3-ccd26b9f2e37 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:47:39.583491 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-57c8ed0c-8712-4e76-9ff3-ccd26b9f2e37 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: 5bfe9916-82fe-4ca4-a05d-9f599340cb36] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:47:39.590425 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-57c8ed0c-8712-4e76-9ff3-ccd26b9f2e37 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:39.590881 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-57c8ed0c-8712-4e76-9ff3-ccd26b9f2e37 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:39.591656 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-57c8ed0c-8712-4e76-9ff3-ccd26b9f2e37 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:39.592104 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-57c8ed0c-8712-4e76-9ff3-ccd26b9f2e37 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:39.726158 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-57c8ed0c-8712-4e76-9ff3-ccd26b9f2e37 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:47:39.733513 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-57c8ed0c-8712-4e76-9ff3-ccd26b9f2e37 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/5bfe9916-82fe-4ca4-a05d-9f599340cb36" status: 200 len: 1216 microversion: 2.1 time: 0.154566 Apr 16 21:47:39.734194 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3432/6705] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:47:39 2022] GET /compute/v2.1/servers/5bfe9916-82fe-4ca4-a05d-9f599340cb36 => generated 1216 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:47:40.750947 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3ebc3c1a-1bd8-4880-8986-61a063fe0547 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:47:40.751566 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3ebc3c1a-1bd8-4880-8986-61a063fe0547 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: 5bfe9916-82fe-4ca4-a05d-9f599340cb36] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:47:40.758436 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3ebc3c1a-1bd8-4880-8986-61a063fe0547 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:40.758899 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3ebc3c1a-1bd8-4880-8986-61a063fe0547 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:40.759676 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3ebc3c1a-1bd8-4880-8986-61a063fe0547 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:40.760123 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3ebc3c1a-1bd8-4880-8986-61a063fe0547 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:40.894207 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3ebc3c1a-1bd8-4880-8986-61a063fe0547 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:47:40.901612 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3ebc3c1a-1bd8-4880-8986-61a063fe0547 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/5bfe9916-82fe-4ca4-a05d-9f599340cb36" status: 200 len: 1216 microversion: 2.1 time: 0.154561 Apr 16 21:47:40.902351 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3274/6706] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:47:40 2022] GET /compute/v2.1/servers/5bfe9916-82fe-4ca4-a05d-9f599340cb36 => generated 1216 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:47:41.918671 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f58fc1db-20a1-4b34-ac0b-0be75f145a7a tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:47:41.919223 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f58fc1db-20a1-4b34-ac0b-0be75f145a7a tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: 5bfe9916-82fe-4ca4-a05d-9f599340cb36] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:47:41.926627 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f58fc1db-20a1-4b34-ac0b-0be75f145a7a tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:41.927091 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f58fc1db-20a1-4b34-ac0b-0be75f145a7a tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:41.927865 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f58fc1db-20a1-4b34-ac0b-0be75f145a7a tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:41.928339 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f58fc1db-20a1-4b34-ac0b-0be75f145a7a tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:42.060345 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f58fc1db-20a1-4b34-ac0b-0be75f145a7a tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:47:42.068340 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f58fc1db-20a1-4b34-ac0b-0be75f145a7a tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/5bfe9916-82fe-4ca4-a05d-9f599340cb36" status: 200 len: 1216 microversion: 2.1 time: 0.153530 Apr 16 21:47:42.068921 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3433/6707] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:47:41 2022] GET /compute/v2.1/servers/5bfe9916-82fe-4ca4-a05d-9f599340cb36 => generated 1216 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:47:42.539735 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-7fa06eb0-d890-41f3-8c61-cad033bff270 req-f687bd99-16ae-49c8-a4c7-9038c8a2a764 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bfe9916-82fe-4ca4-a05d-9f599340cb36", "name": "network-vif-plugged", "status": "completed", "tag": "17a36012-56f8-4b50-9369-74faa6c990c5"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:47:42.549305 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-7fa06eb0-d890-41f3-8c61-cad033bff270 req-f687bd99-16ae-49c8-a4c7-9038c8a2a764 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:42.550382 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-7fa06eb0-d890-41f3-8c61-cad033bff270 req-f687bd99-16ae-49c8-a4c7-9038c8a2a764 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:42.561604 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-7fa06eb0-d890-41f3-8c61-cad033bff270 req-f687bd99-16ae-49c8-a4c7-9038c8a2a764 service nova] Creating event network-vif-plugged:17a36012-56f8-4b50-9369-74faa6c990c5 for instance 5bfe9916-82fe-4ca4-a05d-9f599340cb36 on nch2-master-1 Apr 16 21:47:42.566582 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-7fa06eb0-d890-41f3-8c61-cad033bff270 req-f687bd99-16ae-49c8-a4c7-9038c8a2a764 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031029 Apr 16 21:47:42.567174 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3275/6708] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:47:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:47:43.085672 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-18c4913a-370f-4cd9-bb00-935987f368e2 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:47:43.086294 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-18c4913a-370f-4cd9-bb00-935987f368e2 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: 5bfe9916-82fe-4ca4-a05d-9f599340cb36] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:47:43.093159 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-18c4913a-370f-4cd9-bb00-935987f368e2 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:43.093784 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-18c4913a-370f-4cd9-bb00-935987f368e2 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:43.094414 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-18c4913a-370f-4cd9-bb00-935987f368e2 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:43.094898 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-18c4913a-370f-4cd9-bb00-935987f368e2 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:43.228943 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-18c4913a-370f-4cd9-bb00-935987f368e2 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:47:43.236802 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-18c4913a-370f-4cd9-bb00-935987f368e2 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/5bfe9916-82fe-4ca4-a05d-9f599340cb36" status: 200 len: 1216 microversion: 2.1 time: 0.155113 Apr 16 21:47:43.237624 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3434/6709] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:47:43 2022] GET /compute/v2.1/servers/5bfe9916-82fe-4ca4-a05d-9f599340cb36 => generated 1216 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:47:44.254706 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cf742501-517a-421e-bd26-90415a121515 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:47:44.255425 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-cf742501-517a-421e-bd26-90415a121515 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: 5bfe9916-82fe-4ca4-a05d-9f599340cb36] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:47:44.264579 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cf742501-517a-421e-bd26-90415a121515 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:44.264579 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cf742501-517a-421e-bd26-90415a121515 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:44.264579 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cf742501-517a-421e-bd26-90415a121515 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:44.264579 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cf742501-517a-421e-bd26-90415a121515 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:44.398773 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cf742501-517a-421e-bd26-90415a121515 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:47:44.406664 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cf742501-517a-421e-bd26-90415a121515 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/5bfe9916-82fe-4ca4-a05d-9f599340cb36" status: 200 len: 1216 microversion: 2.1 time: 0.157083 Apr 16 21:47:44.407245 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3276/6710] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:47:44 2022] GET /compute/v2.1/servers/5bfe9916-82fe-4ca4-a05d-9f599340cb36 => generated 1216 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:47:45.423351 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-99540f22-5829-4019-a053-d80d047444e9 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:47:45.423971 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-99540f22-5829-4019-a053-d80d047444e9 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: 5bfe9916-82fe-4ca4-a05d-9f599340cb36] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:47:45.430947 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-99540f22-5829-4019-a053-d80d047444e9 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:45.431414 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-99540f22-5829-4019-a053-d80d047444e9 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:45.432226 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-99540f22-5829-4019-a053-d80d047444e9 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:45.432791 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-99540f22-5829-4019-a053-d80d047444e9 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:45.562503 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-99540f22-5829-4019-a053-d80d047444e9 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:47:45.570101 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-99540f22-5829-4019-a053-d80d047444e9 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/5bfe9916-82fe-4ca4-a05d-9f599340cb36" status: 200 len: 1404 microversion: 2.1 time: 0.151165 Apr 16 21:47:45.570841 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3435/6711] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:47:45 2022] GET /compute/v2.1/servers/5bfe9916-82fe-4ca4-a05d-9f599340cb36 => generated 1404 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:47:45.586502 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-340fb536-2720-42e1-b2ee-7bca4d3943d4 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:47:45.587123 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-340fb536-2720-42e1-b2ee-7bca4d3943d4 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: 5bfe9916-82fe-4ca4-a05d-9f599340cb36] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:47:45.593433 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-340fb536-2720-42e1-b2ee-7bca4d3943d4 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:45.593902 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-340fb536-2720-42e1-b2ee-7bca4d3943d4 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:45.595233 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-340fb536-2720-42e1-b2ee-7bca4d3943d4 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:45.595699 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-340fb536-2720-42e1-b2ee-7bca4d3943d4 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:45.727299 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-340fb536-2720-42e1-b2ee-7bca4d3943d4 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:47:45.735174 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-340fb536-2720-42e1-b2ee-7bca4d3943d4 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/5bfe9916-82fe-4ca4-a05d-9f599340cb36" status: 200 len: 1404 microversion: 2.1 time: 0.152551 Apr 16 21:47:45.735826 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3277/6712] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:47:45 2022] GET /compute/v2.1/servers/5bfe9916-82fe-4ca4-a05d-9f599340cb36 => generated 1404 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:47:45.752345 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d67cfc0c-32e8-4935-bb92-5423e03bb7cf tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1489126905"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:47:45.753431 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d67cfc0c-32e8-4935-bb92-5423e03bb7cf tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: 5bfe9916-82fe-4ca4-a05d-9f599340cb36] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:47:45.759274 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d67cfc0c-32e8-4935-bb92-5423e03bb7cf tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:45.759730 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d67cfc0c-32e8-4935-bb92-5423e03bb7cf tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:45.760538 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d67cfc0c-32e8-4935-bb92-5423e03bb7cf tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:45.760984 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d67cfc0c-32e8-4935-bb92-5423e03bb7cf tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:45.851102 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.compute.api [None req-d67cfc0c-32e8-4935-bb92-5423e03bb7cf tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: 5bfe9916-82fe-4ca4-a05d-9f599340cb36] Attempting to quiesce instance before volume snapshot. Apr 16 21:47:45.918934 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.compute.api [None req-d67cfc0c-32e8-4935-bb92-5423e03bb7cf tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: 5bfe9916-82fe-4ca4-a05d-9f599340cb36] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Apr 16 21:47:46.157650 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d67cfc0c-32e8-4935-bb92-5423e03bb7cf tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: 5bfe9916-82fe-4ca4-a05d-9f599340cb36] Creating snapshot from volume 07e9f1ad-2e5e-4c0e-907f-ab51c873b678. {{(pid=137408) snapshot_instance /opt/stack/nova/nova/compute/api.py:3452}} Apr 16 21:47:47.852785 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d67cfc0c-32e8-4935-bb92-5423e03bb7cf tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "POST /compute/v2.1/servers/5bfe9916-82fe-4ca4-a05d-9f599340cb36/action" status: 202 len: 0 microversion: 2.1 time: 2.104862 Apr 16 21:47:47.853721 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3436/6713] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:47:45 2022] POST /compute/v2.1/servers/5bfe9916-82fe-4ca4-a05d-9f599340cb36/action => generated 0 bytes in 2106 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 16 21:47:49.051634 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-370f4171-19e1-4389-bfdc-0bcff56ec681 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-478844774", "imageRef": "e38464be-04d9-4fa6-9295-d49de83c0ba8", "flavorRef": "452", "networks": [{"uuid": "7ab5cb2e-2db3-494a-9695-37178734f696"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:47:49.110946 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-370f4171-19e1-4389-bfdc-0bcff56ec681 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] validate_networks() for [('7ab5cb2e-2db3-494a-9695-37178734f696', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:47:49.905056 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-370f4171-19e1-4389-bfdc-0bcff56ec681 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:47:49.905490 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-370f4171-19e1-4389-bfdc-0bcff56ec681 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:47:49.905970 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-370f4171-19e1-4389-bfdc-0bcff56ec681 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:47:49.906414 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-370f4171-19e1-4389-bfdc-0bcff56ec681 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:47:49.906834 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-370f4171-19e1-4389-bfdc-0bcff56ec681 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:47:49.916362 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-370f4171-19e1-4389-bfdc-0bcff56ec681 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:49.916819 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-370f4171-19e1-4389-bfdc-0bcff56ec681 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:49.917633 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-370f4171-19e1-4389-bfdc-0bcff56ec681 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:49.918082 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-370f4171-19e1-4389-bfdc-0bcff56ec681 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:49.935386 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-370f4171-19e1-4389-bfdc-0bcff56ec681 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Getting quotas for project dfcde168250f4d16b2d305afed23fee5. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:47:49.940689 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-370f4171-19e1-4389-bfdc-0bcff56ec681 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Getting quotas for user 9771814136c84ab3a13bc98dfd79a40f and project dfcde168250f4d16b2d305afed23fee5. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:47:49.952771 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-370f4171-19e1-4389-bfdc-0bcff56ec681 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:47:49.955280 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-370f4171-19e1-4389-bfdc-0bcff56ec681 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: ed635fcb-53d2-4ace-a3a8-4cd6aec9204f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='b98ad8a4-81cd-4741-bdff-771bedb7f94b',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:47:50.104583 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-370f4171-19e1-4389-bfdc-0bcff56ec681 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.056869 Apr 16 21:47:50.105524 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3278/6714] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:47:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1058 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:47:50.116973 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e6c8ec08-369c-42fb-9f07-267909467ecc tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:47:50.123210 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e6c8ec08-369c-42fb-9f07-267909467ecc tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: ed635fcb-53d2-4ace-a3a8-4cd6aec9204f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:47:50.178277 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e6c8ec08-369c-42fb-9f07-267909467ecc tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:47:50.187851 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e6c8ec08-369c-42fb-9f07-267909467ecc tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/ed635fcb-53d2-4ace-a3a8-4cd6aec9204f" status: 200 len: 1229 microversion: 2.1 time: 0.075081 Apr 16 21:47:50.187851 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3437/6715] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:47:50 2022] GET /compute/v2.1/servers/ed635fcb-53d2-4ace-a3a8-4cd6aec9204f => generated 1229 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:47:51.203845 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-69789b28-97eb-49f7-a3a9-3af29c2cc2e2 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:47:51.205091 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-69789b28-97eb-49f7-a3a9-3af29c2cc2e2 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: ed635fcb-53d2-4ace-a3a8-4cd6aec9204f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:47:51.214605 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-69789b28-97eb-49f7-a3a9-3af29c2cc2e2 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:51.214605 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-69789b28-97eb-49f7-a3a9-3af29c2cc2e2 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:51.214605 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-69789b28-97eb-49f7-a3a9-3af29c2cc2e2 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:51.214906 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-69789b28-97eb-49f7-a3a9-3af29c2cc2e2 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:51.284027 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-69789b28-97eb-49f7-a3a9-3af29c2cc2e2 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:47:51.292091 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-69789b28-97eb-49f7-a3a9-3af29c2cc2e2 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/ed635fcb-53d2-4ace-a3a8-4cd6aec9204f" status: 200 len: 1233 microversion: 2.1 time: 0.092571 Apr 16 21:47:51.292918 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3279/6716] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:47:51 2022] GET /compute/v2.1/servers/ed635fcb-53d2-4ace-a3a8-4cd6aec9204f => generated 1233 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:47:52.308764 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-58e2829c-3cad-461a-8969-a8b7f73cc65a tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:47:52.309402 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-58e2829c-3cad-461a-8969-a8b7f73cc65a tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: ed635fcb-53d2-4ace-a3a8-4cd6aec9204f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:47:52.324382 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58e2829c-3cad-461a-8969-a8b7f73cc65a tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:52.325106 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58e2829c-3cad-461a-8969-a8b7f73cc65a tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:52.326878 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58e2829c-3cad-461a-8969-a8b7f73cc65a tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:52.327526 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58e2829c-3cad-461a-8969-a8b7f73cc65a tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:52.402486 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-58e2829c-3cad-461a-8969-a8b7f73cc65a tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:47:52.423632 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-58e2829c-3cad-461a-8969-a8b7f73cc65a tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/ed635fcb-53d2-4ace-a3a8-4cd6aec9204f" status: 200 len: 1299 microversion: 2.1 time: 0.118615 Apr 16 21:47:52.434582 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3438/6717] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:47:52 2022] GET /compute/v2.1/servers/ed635fcb-53d2-4ace-a3a8-4cd6aec9204f => generated 1299 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:47:53.442051 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7d21c675-c3c2-4812-a9f2-7530dd994da0 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:47:53.447561 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7d21c675-c3c2-4812-a9f2-7530dd994da0 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: ed635fcb-53d2-4ace-a3a8-4cd6aec9204f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:47:53.449727 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7d21c675-c3c2-4812-a9f2-7530dd994da0 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:53.450771 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7d21c675-c3c2-4812-a9f2-7530dd994da0 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:53.451570 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7d21c675-c3c2-4812-a9f2-7530dd994da0 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:53.452020 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7d21c675-c3c2-4812-a9f2-7530dd994da0 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:53.829667 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-75c1cdb9-476c-4967-b460-d9c673868a4a req-6e0ff28a-e54e-4ca5-836f-dcb0efd04e8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed635fcb-53d2-4ace-a3a8-4cd6aec9204f", "tag": "8223342d-fa73-470c-bff4-e0bc8ea57853"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:47:53.846356 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-75c1cdb9-476c-4967-b460-d9c673868a4a req-6e0ff28a-e54e-4ca5-836f-dcb0efd04e8a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:53.846982 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-75c1cdb9-476c-4967-b460-d9c673868a4a req-6e0ff28a-e54e-4ca5-836f-dcb0efd04e8a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:53.859533 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-75c1cdb9-476c-4967-b460-d9c673868a4a req-6e0ff28a-e54e-4ca5-836f-dcb0efd04e8a service nova] Creating event network-changed:8223342d-fa73-470c-bff4-e0bc8ea57853 for instance ed635fcb-53d2-4ace-a3a8-4cd6aec9204f on nch1-master-1 Apr 16 21:47:53.867076 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-75c1cdb9-476c-4967-b460-d9c673868a4a req-6e0ff28a-e54e-4ca5-836f-dcb0efd04e8a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041190 Apr 16 21:47:53.868518 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3439/6718] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:47:53.875936 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7d21c675-c3c2-4812-a9f2-7530dd994da0 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:47:53.886821 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7d21c675-c3c2-4812-a9f2-7530dd994da0 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/ed635fcb-53d2-4ace-a3a8-4cd6aec9204f" status: 200 len: 1341 microversion: 2.1 time: 0.449060 Apr 16 21:47:53.887429 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3280/6719] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:47:53 2022] GET /compute/v2.1/servers/ed635fcb-53d2-4ace-a3a8-4cd6aec9204f => generated 1341 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:47:54.908137 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5500efc2-9e67-47f4-9cd7-b92b0d64845d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:47:54.908905 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5500efc2-9e67-47f4-9cd7-b92b0d64845d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: ed635fcb-53d2-4ace-a3a8-4cd6aec9204f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:47:54.916148 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5500efc2-9e67-47f4-9cd7-b92b0d64845d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:54.917686 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5500efc2-9e67-47f4-9cd7-b92b0d64845d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:54.918523 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5500efc2-9e67-47f4-9cd7-b92b0d64845d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:54.918996 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5500efc2-9e67-47f4-9cd7-b92b0d64845d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:55.064894 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5500efc2-9e67-47f4-9cd7-b92b0d64845d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:47:55.073615 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5500efc2-9e67-47f4-9cd7-b92b0d64845d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/ed635fcb-53d2-4ace-a3a8-4cd6aec9204f" status: 200 len: 1341 microversion: 2.1 time: 0.170797 Apr 16 21:47:55.074261 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3440/6720] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:47:54 2022] GET /compute/v2.1/servers/ed635fcb-53d2-4ace-a3a8-4cd6aec9204f => generated 1341 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:47:56.091298 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0a828350-13a0-4ccd-ab78-f9d406600150 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:47:56.091920 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0a828350-13a0-4ccd-ab78-f9d406600150 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: ed635fcb-53d2-4ace-a3a8-4cd6aec9204f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:47:56.099088 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0a828350-13a0-4ccd-ab78-f9d406600150 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:56.106116 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0a828350-13a0-4ccd-ab78-f9d406600150 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:56.106116 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0a828350-13a0-4ccd-ab78-f9d406600150 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:56.106116 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0a828350-13a0-4ccd-ab78-f9d406600150 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:56.242067 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0a828350-13a0-4ccd-ab78-f9d406600150 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:47:56.250029 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0a828350-13a0-4ccd-ab78-f9d406600150 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/ed635fcb-53d2-4ace-a3a8-4cd6aec9204f" status: 200 len: 1341 microversion: 2.1 time: 0.163032 Apr 16 21:47:56.250629 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3281/6721] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:47:56 2022] GET /compute/v2.1/servers/ed635fcb-53d2-4ace-a3a8-4cd6aec9204f => generated 1341 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:47:57.266443 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c329b5e7-cdad-489e-8181-1780b030ce13 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:47:57.267098 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c329b5e7-cdad-489e-8181-1780b030ce13 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: ed635fcb-53d2-4ace-a3a8-4cd6aec9204f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:47:57.274283 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c329b5e7-cdad-489e-8181-1780b030ce13 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:57.274916 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c329b5e7-cdad-489e-8181-1780b030ce13 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:57.275532 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c329b5e7-cdad-489e-8181-1780b030ce13 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:57.276016 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c329b5e7-cdad-489e-8181-1780b030ce13 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:57.414679 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c329b5e7-cdad-489e-8181-1780b030ce13 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:47:57.438789 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c329b5e7-cdad-489e-8181-1780b030ce13 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/ed635fcb-53d2-4ace-a3a8-4cd6aec9204f" status: 200 len: 1387 microversion: 2.1 time: 0.176172 Apr 16 21:47:57.439732 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3441/6722] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:47:57 2022] GET /compute/v2.1/servers/ed635fcb-53d2-4ace-a3a8-4cd6aec9204f => generated 1387 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:47:58.456871 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9647334b-cf76-4660-bb7a-54368e05f7b1 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:47:58.457486 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9647334b-cf76-4660-bb7a-54368e05f7b1 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: ed635fcb-53d2-4ace-a3a8-4cd6aec9204f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:47:58.464274 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9647334b-cf76-4660-bb7a-54368e05f7b1 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:58.464790 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9647334b-cf76-4660-bb7a-54368e05f7b1 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:58.465575 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9647334b-cf76-4660-bb7a-54368e05f7b1 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:58.466029 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9647334b-cf76-4660-bb7a-54368e05f7b1 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:58.602359 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9647334b-cf76-4660-bb7a-54368e05f7b1 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:47:58.609981 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9647334b-cf76-4660-bb7a-54368e05f7b1 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/ed635fcb-53d2-4ace-a3a8-4cd6aec9204f" status: 200 len: 1375 microversion: 2.1 time: 0.157602 Apr 16 21:47:58.610553 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3282/6723] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:47:58 2022] GET /compute/v2.1/servers/ed635fcb-53d2-4ace-a3a8-4cd6aec9204f => generated 1375 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:47:59.626781 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-59c645a7-4b8e-42c7-a711-1690ced2a7fd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:47:59.627390 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-59c645a7-4b8e-42c7-a711-1690ced2a7fd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: ed635fcb-53d2-4ace-a3a8-4cd6aec9204f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:47:59.635079 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-59c645a7-4b8e-42c7-a711-1690ced2a7fd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:59.635552 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-59c645a7-4b8e-42c7-a711-1690ced2a7fd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:59.636383 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-59c645a7-4b8e-42c7-a711-1690ced2a7fd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:47:59.636829 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-59c645a7-4b8e-42c7-a711-1690ced2a7fd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:47:59.770787 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-59c645a7-4b8e-42c7-a711-1690ced2a7fd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:47:59.778476 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-59c645a7-4b8e-42c7-a711-1690ced2a7fd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/ed635fcb-53d2-4ace-a3a8-4cd6aec9204f" status: 200 len: 1375 microversion: 2.1 time: 0.155440 Apr 16 21:47:59.778987 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3442/6724] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:47:59 2022] GET /compute/v2.1/servers/ed635fcb-53d2-4ace-a3a8-4cd6aec9204f => generated 1375 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:48:00.794897 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-982fead5-6443-423b-89f9-1266415f11f6 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:48:00.795472 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-982fead5-6443-423b-89f9-1266415f11f6 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: ed635fcb-53d2-4ace-a3a8-4cd6aec9204f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:48:00.802800 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-982fead5-6443-423b-89f9-1266415f11f6 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:00.803259 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-982fead5-6443-423b-89f9-1266415f11f6 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:00.804031 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-982fead5-6443-423b-89f9-1266415f11f6 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:00.804506 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-982fead5-6443-423b-89f9-1266415f11f6 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:00.931477 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-982fead5-6443-423b-89f9-1266415f11f6 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:48:00.939083 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-982fead5-6443-423b-89f9-1266415f11f6 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/ed635fcb-53d2-4ace-a3a8-4cd6aec9204f" status: 200 len: 1375 microversion: 2.1 time: 0.148095 Apr 16 21:48:00.939660 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3283/6725] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:48:00 2022] GET /compute/v2.1/servers/ed635fcb-53d2-4ace-a3a8-4cd6aec9204f => generated 1375 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:48:01.956084 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-df939e43-2493-42a1-b662-c3dadd3abfd9 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:48:01.956728 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-df939e43-2493-42a1-b662-c3dadd3abfd9 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: ed635fcb-53d2-4ace-a3a8-4cd6aec9204f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:48:01.964131 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-df939e43-2493-42a1-b662-c3dadd3abfd9 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:01.964688 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-df939e43-2493-42a1-b662-c3dadd3abfd9 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:01.965568 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-df939e43-2493-42a1-b662-c3dadd3abfd9 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:01.966027 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-df939e43-2493-42a1-b662-c3dadd3abfd9 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:02.103056 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-df939e43-2493-42a1-b662-c3dadd3abfd9 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:48:02.110949 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-df939e43-2493-42a1-b662-c3dadd3abfd9 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/ed635fcb-53d2-4ace-a3a8-4cd6aec9204f" status: 200 len: 1375 microversion: 2.1 time: 0.158815 Apr 16 21:48:02.111553 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3443/6726] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:48:01 2022] GET /compute/v2.1/servers/ed635fcb-53d2-4ace-a3a8-4cd6aec9204f => generated 1375 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:48:03.128095 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-22fe9985-a6cc-4465-a131-53d0e00ab879 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:48:03.128824 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-22fe9985-a6cc-4465-a131-53d0e00ab879 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: ed635fcb-53d2-4ace-a3a8-4cd6aec9204f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:48:03.135794 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-22fe9985-a6cc-4465-a131-53d0e00ab879 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:03.136289 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-22fe9985-a6cc-4465-a131-53d0e00ab879 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:03.137076 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-22fe9985-a6cc-4465-a131-53d0e00ab879 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:03.137527 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-22fe9985-a6cc-4465-a131-53d0e00ab879 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:03.268500 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-22fe9985-a6cc-4465-a131-53d0e00ab879 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:48:03.276006 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-22fe9985-a6cc-4465-a131-53d0e00ab879 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/ed635fcb-53d2-4ace-a3a8-4cd6aec9204f" status: 200 len: 1375 microversion: 2.1 time: 0.151808 Apr 16 21:48:03.276611 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3284/6727] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:48:03 2022] GET /compute/v2.1/servers/ed635fcb-53d2-4ace-a3a8-4cd6aec9204f => generated 1375 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:48:04.293492 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-da2ebf9d-0f13-475c-8c71-947efeff824f tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:48:04.294122 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-da2ebf9d-0f13-475c-8c71-947efeff824f tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: ed635fcb-53d2-4ace-a3a8-4cd6aec9204f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:48:04.301517 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-da2ebf9d-0f13-475c-8c71-947efeff824f tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:04.302024 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-da2ebf9d-0f13-475c-8c71-947efeff824f tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:04.302803 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-da2ebf9d-0f13-475c-8c71-947efeff824f tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:04.303252 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-da2ebf9d-0f13-475c-8c71-947efeff824f tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:04.435981 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-da2ebf9d-0f13-475c-8c71-947efeff824f tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:48:04.444192 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-da2ebf9d-0f13-475c-8c71-947efeff824f tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/ed635fcb-53d2-4ace-a3a8-4cd6aec9204f" status: 200 len: 1375 microversion: 2.1 time: 0.154519 Apr 16 21:48:04.444780 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3444/6728] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:48:04 2022] GET /compute/v2.1/servers/ed635fcb-53d2-4ace-a3a8-4cd6aec9204f => generated 1375 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:48:05.286286 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-b8c6404e-008b-4a99-9a99-d1a4fdee36d9 req-136c1823-fbeb-4192-8c4c-6305f891ae14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed635fcb-53d2-4ace-a3a8-4cd6aec9204f", "name": "network-vif-plugged", "status": "completed", "tag": "8223342d-fa73-470c-bff4-e0bc8ea57853"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:48:05.295260 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-b8c6404e-008b-4a99-9a99-d1a4fdee36d9 req-136c1823-fbeb-4192-8c4c-6305f891ae14 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:05.295845 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-b8c6404e-008b-4a99-9a99-d1a4fdee36d9 req-136c1823-fbeb-4192-8c4c-6305f891ae14 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:05.306702 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-b8c6404e-008b-4a99-9a99-d1a4fdee36d9 req-136c1823-fbeb-4192-8c4c-6305f891ae14 service nova] Creating event network-vif-plugged:8223342d-fa73-470c-bff4-e0bc8ea57853 for instance ed635fcb-53d2-4ace-a3a8-4cd6aec9204f on nch1-master-1 Apr 16 21:48:05.311738 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-b8c6404e-008b-4a99-9a99-d1a4fdee36d9 req-136c1823-fbeb-4192-8c4c-6305f891ae14 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029398 Apr 16 21:48:05.312348 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3285/6729] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:48:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:48:05.461824 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-845a01ab-6f39-4c9b-9898-c1c249b85a5f tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:48:05.462450 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-845a01ab-6f39-4c9b-9898-c1c249b85a5f tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: ed635fcb-53d2-4ace-a3a8-4cd6aec9204f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:48:05.469150 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-845a01ab-6f39-4c9b-9898-c1c249b85a5f tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:05.469623 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-845a01ab-6f39-4c9b-9898-c1c249b85a5f tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:05.470452 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-845a01ab-6f39-4c9b-9898-c1c249b85a5f tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:05.471269 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-845a01ab-6f39-4c9b-9898-c1c249b85a5f tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:05.600676 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-845a01ab-6f39-4c9b-9898-c1c249b85a5f tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:48:05.608048 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-845a01ab-6f39-4c9b-9898-c1c249b85a5f tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/ed635fcb-53d2-4ace-a3a8-4cd6aec9204f" status: 200 len: 1375 microversion: 2.1 time: 0.150221 Apr 16 21:48:05.608683 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3445/6730] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:48:05 2022] GET /compute/v2.1/servers/ed635fcb-53d2-4ace-a3a8-4cd6aec9204f => generated 1375 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:48:06.626724 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ad5ee75c-d671-4bc6-8133-bca9895a5718 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:48:06.627431 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ad5ee75c-d671-4bc6-8133-bca9895a5718 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: ed635fcb-53d2-4ace-a3a8-4cd6aec9204f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:48:06.634101 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ad5ee75c-d671-4bc6-8133-bca9895a5718 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:06.634575 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ad5ee75c-d671-4bc6-8133-bca9895a5718 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:06.635359 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ad5ee75c-d671-4bc6-8133-bca9895a5718 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:06.635922 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ad5ee75c-d671-4bc6-8133-bca9895a5718 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:06.780998 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ad5ee75c-d671-4bc6-8133-bca9895a5718 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:48:06.788786 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ad5ee75c-d671-4bc6-8133-bca9895a5718 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/ed635fcb-53d2-4ace-a3a8-4cd6aec9204f" status: 200 len: 1375 microversion: 2.1 time: 0.167060 Apr 16 21:48:06.798805 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3286/6731] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:48:06 2022] GET /compute/v2.1/servers/ed635fcb-53d2-4ace-a3a8-4cd6aec9204f => generated 1375 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:48:07.806534 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a385bb7f-46d0-47d4-b074-e457d538fa95 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:48:07.807167 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a385bb7f-46d0-47d4-b074-e457d538fa95 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: ed635fcb-53d2-4ace-a3a8-4cd6aec9204f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:48:07.814446 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a385bb7f-46d0-47d4-b074-e457d538fa95 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:07.814918 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a385bb7f-46d0-47d4-b074-e457d538fa95 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:07.815705 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a385bb7f-46d0-47d4-b074-e457d538fa95 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:07.816284 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a385bb7f-46d0-47d4-b074-e457d538fa95 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:07.947433 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a385bb7f-46d0-47d4-b074-e457d538fa95 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:48:07.955195 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a385bb7f-46d0-47d4-b074-e457d538fa95 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/ed635fcb-53d2-4ace-a3a8-4cd6aec9204f" status: 200 len: 1563 microversion: 2.1 time: 0.152565 Apr 16 21:48:07.955776 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3446/6732] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:48:07 2022] GET /compute/v2.1/servers/ed635fcb-53d2-4ace-a3a8-4cd6aec9204f => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:48:07.972943 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-67512535-9398-4e20-8522-034164807504 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:48:07.973559 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-67512535-9398-4e20-8522-034164807504 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: ed635fcb-53d2-4ace-a3a8-4cd6aec9204f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:48:07.980751 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-67512535-9398-4e20-8522-034164807504 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:07.981251 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-67512535-9398-4e20-8522-034164807504 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:07.983696 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-67512535-9398-4e20-8522-034164807504 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:07.983696 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-67512535-9398-4e20-8522-034164807504 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:08.114574 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-67512535-9398-4e20-8522-034164807504 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:48:08.122259 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-67512535-9398-4e20-8522-034164807504 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/ed635fcb-53d2-4ace-a3a8-4cd6aec9204f" status: 200 len: 1563 microversion: 2.1 time: 0.153891 Apr 16 21:48:08.122990 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3287/6733] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:48:07 2022] GET /compute/v2.1/servers/ed635fcb-53d2-4ace-a3a8-4cd6aec9204f => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:48:08.192310 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-dc890fc4-06c6-4c0c-94cf-6058dc5f8d02 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:48:08.192835 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-dc890fc4-06c6-4c0c-94cf-6058dc5f8d02 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: ed635fcb-53d2-4ace-a3a8-4cd6aec9204f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:48:08.199855 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dc890fc4-06c6-4c0c-94cf-6058dc5f8d02 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:08.200367 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dc890fc4-06c6-4c0c-94cf-6058dc5f8d02 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:08.201186 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dc890fc4-06c6-4c0c-94cf-6058dc5f8d02 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:08.201926 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dc890fc4-06c6-4c0c-94cf-6058dc5f8d02 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:08.231169 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-dc890fc4-06c6-4c0c-94cf-6058dc5f8d02 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: ed635fcb-53d2-4ace-a3a8-4cd6aec9204f] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:48:08.507022 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-dc890fc4-06c6-4c0c-94cf-6058dc5f8d02 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ed635fcb-53d2-4ace-a3a8-4cd6aec9204f" status: 204 len: 0 microversion: 2.1 time: 0.318284 Apr 16 21:48:08.507622 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3447/6734] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:48:08 2022] DELETE /compute/v2.1/servers/ed635fcb-53d2-4ace-a3a8-4cd6aec9204f => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:48:08.515813 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-233cc6ef-99f5-48fe-86a8-c449bae24a1c tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:48:08.517238 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-233cc6ef-99f5-48fe-86a8-c449bae24a1c tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: ed635fcb-53d2-4ace-a3a8-4cd6aec9204f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:48:08.523404 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-233cc6ef-99f5-48fe-86a8-c449bae24a1c tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:08.523866 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-233cc6ef-99f5-48fe-86a8-c449bae24a1c tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:08.524707 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-233cc6ef-99f5-48fe-86a8-c449bae24a1c tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:08.525163 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-233cc6ef-99f5-48fe-86a8-c449bae24a1c tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:08.666430 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-233cc6ef-99f5-48fe-86a8-c449bae24a1c tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:48:08.674131 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-233cc6ef-99f5-48fe-86a8-c449bae24a1c tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/ed635fcb-53d2-4ace-a3a8-4cd6aec9204f" status: 200 len: 1569 microversion: 2.1 time: 0.162140 Apr 16 21:48:08.674712 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3288/6735] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:48:08 2022] GET /compute/v2.1/servers/ed635fcb-53d2-4ace-a3a8-4cd6aec9204f => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:48:09.692306 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-25b87120-1ad4-4ded-910a-aeb84a3e7c41 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:48:09.693217 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-25b87120-1ad4-4ded-910a-aeb84a3e7c41 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: ed635fcb-53d2-4ace-a3a8-4cd6aec9204f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:48:09.700376 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-25b87120-1ad4-4ded-910a-aeb84a3e7c41 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:09.701119 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-25b87120-1ad4-4ded-910a-aeb84a3e7c41 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:09.701976 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-25b87120-1ad4-4ded-910a-aeb84a3e7c41 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:09.702436 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-25b87120-1ad4-4ded-910a-aeb84a3e7c41 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:09.838128 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-25b87120-1ad4-4ded-910a-aeb84a3e7c41 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:48:09.845846 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-25b87120-1ad4-4ded-910a-aeb84a3e7c41 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/ed635fcb-53d2-4ace-a3a8-4cd6aec9204f" status: 200 len: 1569 microversion: 2.1 time: 0.158546 Apr 16 21:48:09.846421 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3448/6736] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:48:09 2022] GET /compute/v2.1/servers/ed635fcb-53d2-4ace-a3a8-4cd6aec9204f => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:48:10.525739 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-6f8425d2-b350-4e9d-8715-0f3df2ba39e9 req-d090b604-c40d-48c1-bc70-a01776438abf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed635fcb-53d2-4ace-a3a8-4cd6aec9204f", "name": "network-vif-deleted", "tag": "8223342d-fa73-470c-bff4-e0bc8ea57853"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:48:10.534197 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-6f8425d2-b350-4e9d-8715-0f3df2ba39e9 req-d090b604-c40d-48c1-bc70-a01776438abf service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:10.534709 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-6f8425d2-b350-4e9d-8715-0f3df2ba39e9 req-d090b604-c40d-48c1-bc70-a01776438abf service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:10.553567 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-6f8425d2-b350-4e9d-8715-0f3df2ba39e9 req-d090b604-c40d-48c1-bc70-a01776438abf service nova] Creating event network-vif-deleted:8223342d-fa73-470c-bff4-e0bc8ea57853 for instance ed635fcb-53d2-4ace-a3a8-4cd6aec9204f on nch1-master-1 Apr 16 21:48:10.559594 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-6f8425d2-b350-4e9d-8715-0f3df2ba39e9 req-d090b604-c40d-48c1-bc70-a01776438abf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037572 Apr 16 21:48:10.560585 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3289/6737] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:48:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:48:10.863930 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-38c5e91d-a815-4d84-a38f-abaa7018a3f9 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:48:10.864844 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-38c5e91d-a815-4d84-a38f-abaa7018a3f9 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: ed635fcb-53d2-4ace-a3a8-4cd6aec9204f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:48:10.871820 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-38c5e91d-a815-4d84-a38f-abaa7018a3f9 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:10.872336 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-38c5e91d-a815-4d84-a38f-abaa7018a3f9 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:10.873138 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-38c5e91d-a815-4d84-a38f-abaa7018a3f9 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:10.873600 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-38c5e91d-a815-4d84-a38f-abaa7018a3f9 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:10.935837 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-38c5e91d-a815-4d84-a38f-abaa7018a3f9 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:48:10.944052 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-38c5e91d-a815-4d84-a38f-abaa7018a3f9 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/ed635fcb-53d2-4ace-a3a8-4cd6aec9204f" status: 200 len: 1360 microversion: 2.1 time: 0.084833 Apr 16 21:48:10.944809 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3449/6738] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:48:10 2022] GET /compute/v2.1/servers/ed635fcb-53d2-4ace-a3a8-4cd6aec9204f => generated 1360 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:48:11.961981 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d12b0356-855f-4255-988c-1b06c9a293ed tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:48:11.962633 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d12b0356-855f-4255-988c-1b06c9a293ed tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: ed635fcb-53d2-4ace-a3a8-4cd6aec9204f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:48:11.969451 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d12b0356-855f-4255-988c-1b06c9a293ed tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:11.969903 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d12b0356-855f-4255-988c-1b06c9a293ed tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:11.970673 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d12b0356-855f-4255-988c-1b06c9a293ed tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:11.971113 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d12b0356-855f-4255-988c-1b06c9a293ed tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:11.984717 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-d12b0356-855f-4255-988c-1b06c9a293ed tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] HTTP exception thrown: Instance ed635fcb-53d2-4ace-a3a8-4cd6aec9204f could not be found. Apr 16 21:48:11.985316 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d12b0356-855f-4255-988c-1b06c9a293ed tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Returning 404 to user: Instance ed635fcb-53d2-4ace-a3a8-4cd6aec9204f could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:48:11.986174 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d12b0356-855f-4255-988c-1b06c9a293ed tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/ed635fcb-53d2-4ace-a3a8-4cd6aec9204f" status: 404 len: 111 microversion: 2.1 time: 0.028541 Apr 16 21:48:11.986964 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3290/6739] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:48:11 2022] GET /compute/v2.1/servers/ed635fcb-53d2-4ace-a3a8-4cd6aec9204f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:48:29.320989 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b0f5f58c-25ff-4750-b625-1ba3ca1e4025 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:48:29.321534 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b0f5f58c-25ff-4750-b625-1ba3ca1e4025 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] [instance: 8e3ee82e-b49c-4d49-aca8-7a42af4de7dc] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:48:29.329262 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b0f5f58c-25ff-4750-b625-1ba3ca1e4025 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:29.329731 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b0f5f58c-25ff-4750-b625-1ba3ca1e4025 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:29.330524 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b0f5f58c-25ff-4750-b625-1ba3ca1e4025 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:29.331020 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b0f5f58c-25ff-4750-b625-1ba3ca1e4025 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:29.411393 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-b0f5f58c-25ff-4750-b625-1ba3ca1e4025 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lazy-loading 'services' on Instance uuid 8e3ee82e-b49c-4d49-aca8-7a42af4de7dc {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:48:29.631589 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b0f5f58c-25ff-4750-b625-1ba3ca1e4025 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8e3ee82e-b49c-4d49-aca8-7a42af4de7dc/os-volume_attachments/b419c8ec-d8d6-495e-9cec-3da461c92db9" status: 202 len: 0 microversion: 2.1 time: 0.314377 Apr 16 21:48:29.632259 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3450/6740] 10.222.0.20 () {58 vars in 1415 bytes} [Sat Apr 16 21:48:29 2022] DELETE /compute/v2.1/servers/8e3ee82e-b49c-4d49-aca8-7a42af4de7dc/os-volume_attachments/b419c8ec-d8d6-495e-9cec-3da461c92db9 => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:48:30.744140 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bd230a64-9774-43de-a6e6-7b51f785b8a5 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:48:30.744714 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bd230a64-9774-43de-a6e6-7b51f785b8a5 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] [instance: 8e3ee82e-b49c-4d49-aca8-7a42af4de7dc] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:48:30.751230 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bd230a64-9774-43de-a6e6-7b51f785b8a5 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:30.755977 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bd230a64-9774-43de-a6e6-7b51f785b8a5 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:30.755977 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bd230a64-9774-43de-a6e6-7b51f785b8a5 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:30.755977 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bd230a64-9774-43de-a6e6-7b51f785b8a5 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:30.777078 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bd230a64-9774-43de-a6e6-7b51f785b8a5 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] [instance: 8e3ee82e-b49c-4d49-aca8-7a42af4de7dc] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:48:31.083354 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bd230a64-9774-43de-a6e6-7b51f785b8a5 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8e3ee82e-b49c-4d49-aca8-7a42af4de7dc" status: 204 len: 0 microversion: 2.1 time: 0.343452 Apr 16 21:48:31.092091 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3291/6741] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:48:30 2022] DELETE /compute/v2.1/servers/8e3ee82e-b49c-4d49-aca8-7a42af4de7dc => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:48:31.094084 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-101d03f7-f94f-43ed-93c8-be844e3502ec tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:48:31.094823 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-101d03f7-f94f-43ed-93c8-be844e3502ec tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] [instance: 8e3ee82e-b49c-4d49-aca8-7a42af4de7dc] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:48:31.101691 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-101d03f7-f94f-43ed-93c8-be844e3502ec tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:31.102168 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-101d03f7-f94f-43ed-93c8-be844e3502ec tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:31.102961 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-101d03f7-f94f-43ed-93c8-be844e3502ec tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:31.103416 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-101d03f7-f94f-43ed-93c8-be844e3502ec tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:31.232762 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-101d03f7-f94f-43ed-93c8-be844e3502ec tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bf99de7a594e209f995e62db441850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda4f5ee41d2439e935ee0f658f465d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:48:31.240407 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-101d03f7-f94f-43ed-93c8-be844e3502ec tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] 10.222.0.20 "GET /compute/v2.1/servers/8e3ee82e-b49c-4d49-aca8-7a42af4de7dc" status: 200 len: 1514 microversion: 2.1 time: 0.151301 Apr 16 21:48:31.240981 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3451/6742] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:48:31 2022] GET /compute/v2.1/servers/8e3ee82e-b49c-4d49-aca8-7a42af4de7dc => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:48:32.258023 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e7a8e4e7-a8b2-4e48-abd0-3b7662ad4a0b tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:48:32.258727 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e7a8e4e7-a8b2-4e48-abd0-3b7662ad4a0b tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] [instance: 8e3ee82e-b49c-4d49-aca8-7a42af4de7dc] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:48:32.265431 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e7a8e4e7-a8b2-4e48-abd0-3b7662ad4a0b tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:32.265893 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e7a8e4e7-a8b2-4e48-abd0-3b7662ad4a0b tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:32.266672 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e7a8e4e7-a8b2-4e48-abd0-3b7662ad4a0b tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:32.267118 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e7a8e4e7-a8b2-4e48-abd0-3b7662ad4a0b tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:32.412775 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e7a8e4e7-a8b2-4e48-abd0-3b7662ad4a0b tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bf99de7a594e209f995e62db441850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda4f5ee41d2439e935ee0f658f465d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:48:32.420260 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e7a8e4e7-a8b2-4e48-abd0-3b7662ad4a0b tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] 10.222.0.20 "GET /compute/v2.1/servers/8e3ee82e-b49c-4d49-aca8-7a42af4de7dc" status: 200 len: 1514 microversion: 2.1 time: 0.166927 Apr 16 21:48:32.420849 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3292/6743] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:48:32 2022] GET /compute/v2.1/servers/8e3ee82e-b49c-4d49-aca8-7a42af4de7dc => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:48:33.091692 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-6377ffe6-0430-45d3-a1d0-17519c2a0989 req-a73c7c14-f251-4c71-aeba-b48d48a6c0ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e3ee82e-b49c-4d49-aca8-7a42af4de7dc", "name": "network-vif-deleted", "tag": "5d901921-b640-4e8b-a7d1-f001809168ce"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:48:33.101267 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-6377ffe6-0430-45d3-a1d0-17519c2a0989 req-a73c7c14-f251-4c71-aeba-b48d48a6c0ed service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:33.101738 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-6377ffe6-0430-45d3-a1d0-17519c2a0989 req-a73c7c14-f251-4c71-aeba-b48d48a6c0ed service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:33.113143 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-6377ffe6-0430-45d3-a1d0-17519c2a0989 req-a73c7c14-f251-4c71-aeba-b48d48a6c0ed service nova] Creating event network-vif-deleted:5d901921-b640-4e8b-a7d1-f001809168ce for instance 8e3ee82e-b49c-4d49-aca8-7a42af4de7dc on nch1-master-1 Apr 16 21:48:33.118823 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-6377ffe6-0430-45d3-a1d0-17519c2a0989 req-a73c7c14-f251-4c71-aeba-b48d48a6c0ed service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030962 Apr 16 21:48:33.119603 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3452/6744] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:48:33.437545 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-84e46fbe-efb3-4cc4-92d3-664552a74ab6 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:48:33.438122 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-84e46fbe-efb3-4cc4-92d3-664552a74ab6 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] [instance: 8e3ee82e-b49c-4d49-aca8-7a42af4de7dc] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:48:33.444881 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-84e46fbe-efb3-4cc4-92d3-664552a74ab6 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:33.445375 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-84e46fbe-efb3-4cc4-92d3-664552a74ab6 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:33.446185 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-84e46fbe-efb3-4cc4-92d3-664552a74ab6 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:33.446634 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-84e46fbe-efb3-4cc4-92d3-664552a74ab6 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:33.477397 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-84e46fbe-efb3-4cc4-92d3-664552a74ab6 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:33.477858 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-84e46fbe-efb3-4cc4-92d3-664552a74ab6 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:33.478315 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-84e46fbe-efb3-4cc4-92d3-664552a74ab6 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lazy-loading 'fault' on Instance uuid 8e3ee82e-b49c-4d49-aca8-7a42af4de7dc {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:48:33.519220 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-84e46fbe-efb3-4cc4-92d3-664552a74ab6 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95bf99de7a594e209f995e62db441850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cda4f5ee41d2439e935ee0f658f465d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:48:33.527329 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-84e46fbe-efb3-4cc4-92d3-664552a74ab6 tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] 10.222.0.20 "GET /compute/v2.1/servers/8e3ee82e-b49c-4d49-aca8-7a42af4de7dc" status: 200 len: 1309 microversion: 2.1 time: 0.093755 Apr 16 21:48:33.530118 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3293/6745] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:48:33 2022] GET /compute/v2.1/servers/8e3ee82e-b49c-4d49-aca8-7a42af4de7dc => generated 1309 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:48:34.545625 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-81046b9b-bb5d-422f-be8c-27f4083df32e tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:48:34.546343 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-81046b9b-bb5d-422f-be8c-27f4083df32e tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] [instance: 8e3ee82e-b49c-4d49-aca8-7a42af4de7dc] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:48:34.553603 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-81046b9b-bb5d-422f-be8c-27f4083df32e tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:34.554103 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-81046b9b-bb5d-422f-be8c-27f4083df32e tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:34.554905 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-81046b9b-bb5d-422f-be8c-27f4083df32e tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:34.555365 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-81046b9b-bb5d-422f-be8c-27f4083df32e tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:34.568832 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-81046b9b-bb5d-422f-be8c-27f4083df32e tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] HTTP exception thrown: Instance 8e3ee82e-b49c-4d49-aca8-7a42af4de7dc could not be found. Apr 16 21:48:34.569437 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-81046b9b-bb5d-422f-be8c-27f4083df32e tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] Returning 404 to user: Instance 8e3ee82e-b49c-4d49-aca8-7a42af4de7dc could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:48:34.570276 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-81046b9b-bb5d-422f-be8c-27f4083df32e tempest-VolumesSnapshotTestJSON-2078807312 tempest-VolumesSnapshotTestJSON-2078807312-project] 10.222.0.20 "GET /compute/v2.1/servers/8e3ee82e-b49c-4d49-aca8-7a42af4de7dc" status: 404 len: 111 microversion: 2.1 time: 0.028991 Apr 16 21:48:34.570814 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3453/6746] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:48:34 2022] GET /compute/v2.1/servers/8e3ee82e-b49c-4d49-aca8-7a42af4de7dc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:48:51.211266 ncdv-master-1 devstack@n-api.service[137409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 21:48:51.211847 ncdv-master-1 devstack@n-api.service[137409]: Sat Apr 16 21:48:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 21:48:51.423180 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0c11dc43-6c6b-4d6e-992a-63299bda151d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:48:51.423677 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0c11dc43-6c6b-4d6e-992a-63299bda151d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: 5bfe9916-82fe-4ca4-a05d-9f599340cb36] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:48:51.429663 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0c11dc43-6c6b-4d6e-992a-63299bda151d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:51.431482 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0c11dc43-6c6b-4d6e-992a-63299bda151d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:51.431482 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0c11dc43-6c6b-4d6e-992a-63299bda151d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:51.431482 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0c11dc43-6c6b-4d6e-992a-63299bda151d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:51.455160 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0c11dc43-6c6b-4d6e-992a-63299bda151d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: 5bfe9916-82fe-4ca4-a05d-9f599340cb36] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:48:51.762768 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0c11dc43-6c6b-4d6e-992a-63299bda151d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5bfe9916-82fe-4ca4-a05d-9f599340cb36" status: 204 len: 0 microversion: 2.1 time: 0.343396 Apr 16 21:48:51.763328 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3294/6747] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:48:51 2022] DELETE /compute/v2.1/servers/5bfe9916-82fe-4ca4-a05d-9f599340cb36 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:48:51.772081 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3e59e19c-0b86-4337-b1f2-005a6c8279b8 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:48:51.774120 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3e59e19c-0b86-4337-b1f2-005a6c8279b8 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: 5bfe9916-82fe-4ca4-a05d-9f599340cb36] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:48:51.780115 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3e59e19c-0b86-4337-b1f2-005a6c8279b8 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:51.780643 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3e59e19c-0b86-4337-b1f2-005a6c8279b8 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:51.781444 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3e59e19c-0b86-4337-b1f2-005a6c8279b8 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:51.781904 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3e59e19c-0b86-4337-b1f2-005a6c8279b8 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:51.913006 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3e59e19c-0b86-4337-b1f2-005a6c8279b8 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:48:51.920585 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3e59e19c-0b86-4337-b1f2-005a6c8279b8 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/5bfe9916-82fe-4ca4-a05d-9f599340cb36" status: 200 len: 1410 microversion: 2.1 time: 0.152837 Apr 16 21:48:51.921153 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3454/6748] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:48:51 2022] GET /compute/v2.1/servers/5bfe9916-82fe-4ca4-a05d-9f599340cb36 => generated 1410 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:48:52.937848 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0e8f000a-b166-4756-bd12-2cebe3ac4700 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:48:52.938502 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0e8f000a-b166-4756-bd12-2cebe3ac4700 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: 5bfe9916-82fe-4ca4-a05d-9f599340cb36] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:48:52.945342 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0e8f000a-b166-4756-bd12-2cebe3ac4700 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:52.945806 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0e8f000a-b166-4756-bd12-2cebe3ac4700 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:52.946618 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0e8f000a-b166-4756-bd12-2cebe3ac4700 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:52.947065 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0e8f000a-b166-4756-bd12-2cebe3ac4700 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:53.080882 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0e8f000a-b166-4756-bd12-2cebe3ac4700 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:48:53.088929 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0e8f000a-b166-4756-bd12-2cebe3ac4700 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/5bfe9916-82fe-4ca4-a05d-9f599340cb36" status: 200 len: 1410 microversion: 2.1 time: 0.154872 Apr 16 21:48:53.089500 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3295/6749] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:48:52 2022] GET /compute/v2.1/servers/5bfe9916-82fe-4ca4-a05d-9f599340cb36 => generated 1410 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:48:54.054489 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-32a03df2-5135-440a-86c6-28786963dda8 req-e9c61426-1906-420e-9ca8-9fff76439b44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5bfe9916-82fe-4ca4-a05d-9f599340cb36", "name": "network-vif-deleted", "tag": "17a36012-56f8-4b50-9369-74faa6c990c5"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:48:54.063849 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-32a03df2-5135-440a-86c6-28786963dda8 req-e9c61426-1906-420e-9ca8-9fff76439b44 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:54.064447 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-32a03df2-5135-440a-86c6-28786963dda8 req-e9c61426-1906-420e-9ca8-9fff76439b44 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:54.077790 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-32a03df2-5135-440a-86c6-28786963dda8 req-e9c61426-1906-420e-9ca8-9fff76439b44 service nova] Creating event network-vif-deleted:17a36012-56f8-4b50-9369-74faa6c990c5 for instance 5bfe9916-82fe-4ca4-a05d-9f599340cb36 on nch2-master-1 Apr 16 21:48:54.083232 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-32a03df2-5135-440a-86c6-28786963dda8 req-e9c61426-1906-420e-9ca8-9fff76439b44 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168006 Apr 16 21:48:54.084449 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3455/6750] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:48:54.109141 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fd82fb4f-88e3-4082-ab47-2453f335f25f tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:48:54.110392 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-fd82fb4f-88e3-4082-ab47-2453f335f25f tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: 5bfe9916-82fe-4ca4-a05d-9f599340cb36] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:48:54.117866 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fd82fb4f-88e3-4082-ab47-2453f335f25f tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:54.118426 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fd82fb4f-88e3-4082-ab47-2453f335f25f tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:54.119404 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fd82fb4f-88e3-4082-ab47-2453f335f25f tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:54.119905 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fd82fb4f-88e3-4082-ab47-2453f335f25f tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:54.185474 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-fd82fb4f-88e3-4082-ab47-2453f335f25f tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:48:54.193108 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fd82fb4f-88e3-4082-ab47-2453f335f25f tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/5bfe9916-82fe-4ca4-a05d-9f599340cb36" status: 200 len: 1201 microversion: 2.1 time: 0.088708 Apr 16 21:48:54.193678 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3296/6751] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:48:54 2022] GET /compute/v2.1/servers/5bfe9916-82fe-4ca4-a05d-9f599340cb36 => generated 1201 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:48:55.210256 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8cfdc07a-3f1c-43c6-ba13-9cbb78954c58 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:48:55.210963 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8cfdc07a-3f1c-43c6-ba13-9cbb78954c58 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: 5bfe9916-82fe-4ca4-a05d-9f599340cb36] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:48:55.218072 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8cfdc07a-3f1c-43c6-ba13-9cbb78954c58 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:55.219847 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8cfdc07a-3f1c-43c6-ba13-9cbb78954c58 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:55.219847 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8cfdc07a-3f1c-43c6-ba13-9cbb78954c58 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:48:55.219847 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8cfdc07a-3f1c-43c6-ba13-9cbb78954c58 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:48:55.233563 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-8cfdc07a-3f1c-43c6-ba13-9cbb78954c58 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] HTTP exception thrown: Instance 5bfe9916-82fe-4ca4-a05d-9f599340cb36 could not be found. Apr 16 21:48:55.234182 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8cfdc07a-3f1c-43c6-ba13-9cbb78954c58 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Returning 404 to user: Instance 5bfe9916-82fe-4ca4-a05d-9f599340cb36 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:48:55.235283 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8cfdc07a-3f1c-43c6-ba13-9cbb78954c58 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/5bfe9916-82fe-4ca4-a05d-9f599340cb36" status: 404 len: 111 microversion: 2.1 time: 0.029520 Apr 16 21:48:55.235842 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3456/6752] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:48:55 2022] GET /compute/v2.1/servers/5bfe9916-82fe-4ca4-a05d-9f599340cb36 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:49:03.670814 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-20bfd138-3c8d-4066-8088-e93d3646ecd1 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:49:03.671319 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-20bfd138-3c8d-4066-8088-e93d3646ecd1 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: ed635fcb-53d2-4ace-a3a8-4cd6aec9204f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:49:03.678540 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-20bfd138-3c8d-4066-8088-e93d3646ecd1 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:49:03.679004 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-20bfd138-3c8d-4066-8088-e93d3646ecd1 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:49:03.679822 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-20bfd138-3c8d-4066-8088-e93d3646ecd1 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:49:03.680300 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-20bfd138-3c8d-4066-8088-e93d3646ecd1 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:49:03.697283 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-20bfd138-3c8d-4066-8088-e93d3646ecd1 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] HTTP exception thrown: Instance ed635fcb-53d2-4ace-a3a8-4cd6aec9204f could not be found. Apr 16 21:49:03.697894 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-20bfd138-3c8d-4066-8088-e93d3646ecd1 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Returning 404 to user: Instance ed635fcb-53d2-4ace-a3a8-4cd6aec9204f could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:49:03.698739 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-20bfd138-3c8d-4066-8088-e93d3646ecd1 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "DELETE /compute/v2.1/servers/ed635fcb-53d2-4ace-a3a8-4cd6aec9204f" status: 404 len: 111 microversion: 2.1 time: 0.031903 Apr 16 21:49:03.699289 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3297/6753] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:49:03 2022] DELETE /compute/v2.1/servers/ed635fcb-53d2-4ace-a3a8-4cd6aec9204f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:49:03.708292 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8df81b52-1584-487a-9d6a-761f82e031a6 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:49:03.708913 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8df81b52-1584-487a-9d6a-761f82e031a6 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: ed635fcb-53d2-4ace-a3a8-4cd6aec9204f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:49:03.715670 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8df81b52-1584-487a-9d6a-761f82e031a6 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:49:03.716154 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8df81b52-1584-487a-9d6a-761f82e031a6 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:49:03.716987 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8df81b52-1584-487a-9d6a-761f82e031a6 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:49:03.717492 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8df81b52-1584-487a-9d6a-761f82e031a6 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:49:03.731045 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-8df81b52-1584-487a-9d6a-761f82e031a6 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] HTTP exception thrown: Instance ed635fcb-53d2-4ace-a3a8-4cd6aec9204f could not be found. Apr 16 21:49:03.731597 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8df81b52-1584-487a-9d6a-761f82e031a6 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Returning 404 to user: Instance ed635fcb-53d2-4ace-a3a8-4cd6aec9204f could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:49:03.732477 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8df81b52-1584-487a-9d6a-761f82e031a6 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/ed635fcb-53d2-4ace-a3a8-4cd6aec9204f" status: 404 len: 111 microversion: 2.1 time: 0.028218 Apr 16 21:49:03.733032 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3457/6754] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:49:03 2022] GET /compute/v2.1/servers/ed635fcb-53d2-4ace-a3a8-4cd6aec9204f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:49:04.634731 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b42630f2-82d3-40b3-aaae-885f589343b7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:49:04.635242 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b42630f2-82d3-40b3-aaae-885f589343b7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: 5bfe9916-82fe-4ca4-a05d-9f599340cb36] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:49:04.641935 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b42630f2-82d3-40b3-aaae-885f589343b7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:49:04.648273 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b42630f2-82d3-40b3-aaae-885f589343b7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:49:04.648273 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b42630f2-82d3-40b3-aaae-885f589343b7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:49:04.648273 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b42630f2-82d3-40b3-aaae-885f589343b7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:49:04.657651 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-b42630f2-82d3-40b3-aaae-885f589343b7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] HTTP exception thrown: Instance 5bfe9916-82fe-4ca4-a05d-9f599340cb36 could not be found. Apr 16 21:49:04.658241 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b42630f2-82d3-40b3-aaae-885f589343b7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Returning 404 to user: Instance 5bfe9916-82fe-4ca4-a05d-9f599340cb36 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:49:04.659087 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b42630f2-82d3-40b3-aaae-885f589343b7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5bfe9916-82fe-4ca4-a05d-9f599340cb36" status: 404 len: 111 microversion: 2.1 time: 0.028622 Apr 16 21:49:04.659623 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3298/6755] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:49:04 2022] DELETE /compute/v2.1/servers/5bfe9916-82fe-4ca4-a05d-9f599340cb36 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:49:04.668212 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f716502d-197f-447d-a9b8-7bb6a93a40dd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:49:04.668728 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f716502d-197f-447d-a9b8-7bb6a93a40dd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: 5bfe9916-82fe-4ca4-a05d-9f599340cb36] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:49:04.674772 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f716502d-197f-447d-a9b8-7bb6a93a40dd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:49:04.675250 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f716502d-197f-447d-a9b8-7bb6a93a40dd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:49:04.676052 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f716502d-197f-447d-a9b8-7bb6a93a40dd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:49:04.676548 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f716502d-197f-447d-a9b8-7bb6a93a40dd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:49:04.690121 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-f716502d-197f-447d-a9b8-7bb6a93a40dd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] HTTP exception thrown: Instance 5bfe9916-82fe-4ca4-a05d-9f599340cb36 could not be found. Apr 16 21:49:04.690742 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f716502d-197f-447d-a9b8-7bb6a93a40dd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Returning 404 to user: Instance 5bfe9916-82fe-4ca4-a05d-9f599340cb36 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:49:04.691666 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f716502d-197f-447d-a9b8-7bb6a93a40dd tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/5bfe9916-82fe-4ca4-a05d-9f599340cb36" status: 404 len: 111 microversion: 2.1 time: 0.027718 Apr 16 21:49:04.692238 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3458/6756] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:49:04 2022] GET /compute/v2.1/servers/5bfe9916-82fe-4ca4-a05d-9f599340cb36 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:49:04.763158 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0fc77f60-6dc1-4a12-b62e-f417483a7cc2 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Action: 'create', calling method: .version_select at 0x7fbb96c424c0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-202961170"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:49:04.778289 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-0fc77f60-6dc1-4a12-b62e-f417483a7cc2 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Getting quotas for project dfcde168250f4d16b2d305afed23fee5. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:49:04.784260 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-0fc77f60-6dc1-4a12-b62e-f417483a7cc2 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Getting quotas for user 9771814136c84ab3a13bc98dfd79a40f and project dfcde168250f4d16b2d305afed23fee5. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:49:04.928312 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-0fc77f60-6dc1-4a12-b62e-f417483a7cc2 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Getting quotas for project dfcde168250f4d16b2d305afed23fee5. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:49:04.933758 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-0fc77f60-6dc1-4a12-b62e-f417483a7cc2 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Getting quotas for user 9771814136c84ab3a13bc98dfd79a40f and project dfcde168250f4d16b2d305afed23fee5. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:49:04.949241 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0fc77f60-6dc1-4a12-b62e-f417483a7cc2 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2314 microversion: 2.1 time: 0.189944 Apr 16 21:49:04.950018 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3299/6757] 10.222.0.20 () {60 vars in 1157 bytes} [Sat Apr 16 21:49:04 2022] POST /compute/v2.1/os-keypairs => generated 2314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:49:14.345440 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8ef7089f-a202-4b6f-8933-5401830363b7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1667390580", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-202961170", "security_groups": [{"name": "tempest-secgroup-smoke-1999215453"}], "block_device_mapping_v2": [{"uuid": "c1b68977-5c1b-4c1e-9c4f-a8b269df8d2b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7ab5cb2e-2db3-494a-9695-37178734f696"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:49:14.457892 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-8ef7089f-a202-4b6f-8933-5401830363b7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] validate_networks() for [('7ab5cb2e-2db3-494a-9695-37178734f696', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:49:14.822677 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-8ef7089f-a202-4b6f-8933-5401830363b7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:49:14.823126 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-8ef7089f-a202-4b6f-8933-5401830363b7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:49:14.823653 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-8ef7089f-a202-4b6f-8933-5401830363b7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:49:14.824117 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-8ef7089f-a202-4b6f-8933-5401830363b7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:49:14.824584 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-8ef7089f-a202-4b6f-8933-5401830363b7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:49:14.834180 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8ef7089f-a202-4b6f-8933-5401830363b7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:49:14.834659 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8ef7089f-a202-4b6f-8933-5401830363b7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:49:14.835488 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8ef7089f-a202-4b6f-8933-5401830363b7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:49:14.835944 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8ef7089f-a202-4b6f-8933-5401830363b7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:49:14.852388 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-8ef7089f-a202-4b6f-8933-5401830363b7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Getting quotas for project dfcde168250f4d16b2d305afed23fee5. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:49:14.857561 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-8ef7089f-a202-4b6f-8933-5401830363b7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Getting quotas for user 9771814136c84ab3a13bc98dfd79a40f and project dfcde168250f4d16b2d305afed23fee5. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:49:14.915961 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8ef7089f-a202-4b6f-8933-5401830363b7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:49:14.917531 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8ef7089f-a202-4b6f-8933-5401830363b7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: b44e2605-fae0-4ebf-9362-cdf9a8323375] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c1b68977-5c1b-4c1e-9c4f-a8b269df8d2b',volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:49:15.301412 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8ef7089f-a202-4b6f-8933-5401830363b7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.960619 Apr 16 21:49:15.303132 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3459/6758] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:49:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 962 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:49:15.313960 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9ab81e7b-a088-45ad-aa4c-c95ceb6cae28 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:49:15.314580 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9ab81e7b-a088-45ad-aa4c-c95ceb6cae28 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: b44e2605-fae0-4ebf-9362-cdf9a8323375] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:49:15.368032 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9ab81e7b-a088-45ad-aa4c-c95ceb6cae28 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:49:15.376080 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9ab81e7b-a088-45ad-aa4c-c95ceb6cae28 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/b44e2605-fae0-4ebf-9362-cdf9a8323375" status: 200 len: 1094 microversion: 2.1 time: 0.067503 Apr 16 21:49:15.376947 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3300/6759] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:49:15 2022] GET /compute/v2.1/servers/b44e2605-fae0-4ebf-9362-cdf9a8323375 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:49:16.394283 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-49a1f67f-5480-48b1-a941-7d170387791d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:49:16.395703 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-49a1f67f-5480-48b1-a941-7d170387791d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: b44e2605-fae0-4ebf-9362-cdf9a8323375] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:49:16.405509 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-49a1f67f-5480-48b1-a941-7d170387791d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:49:16.405910 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-49a1f67f-5480-48b1-a941-7d170387791d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:49:16.406743 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-49a1f67f-5480-48b1-a941-7d170387791d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:49:16.407204 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-49a1f67f-5480-48b1-a941-7d170387791d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:49:16.470176 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-49a1f67f-5480-48b1-a941-7d170387791d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:49:16.486878 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-49a1f67f-5480-48b1-a941-7d170387791d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/b44e2605-fae0-4ebf-9362-cdf9a8323375" status: 200 len: 1144 microversion: 2.1 time: 0.097452 Apr 16 21:49:16.487699 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3460/6760] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:49:16 2022] GET /compute/v2.1/servers/b44e2605-fae0-4ebf-9362-cdf9a8323375 => generated 1144 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:49:17.504046 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4e3eeed9-3aa8-45c9-93cb-2ecff4685856 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:49:17.504826 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4e3eeed9-3aa8-45c9-93cb-2ecff4685856 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: b44e2605-fae0-4ebf-9362-cdf9a8323375] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:49:17.512759 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4e3eeed9-3aa8-45c9-93cb-2ecff4685856 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:49:17.513263 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4e3eeed9-3aa8-45c9-93cb-2ecff4685856 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:49:17.514657 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4e3eeed9-3aa8-45c9-93cb-2ecff4685856 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:49:17.515225 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4e3eeed9-3aa8-45c9-93cb-2ecff4685856 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:49:17.606763 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4e3eeed9-3aa8-45c9-93cb-2ecff4685856 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:49:17.619110 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4e3eeed9-3aa8-45c9-93cb-2ecff4685856 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/b44e2605-fae0-4ebf-9362-cdf9a8323375" status: 200 len: 1210 microversion: 2.1 time: 0.118133 Apr 16 21:49:17.619733 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3301/6761] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:49:17 2022] GET /compute/v2.1/servers/b44e2605-fae0-4ebf-9362-cdf9a8323375 => generated 1210 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:49:18.636892 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-af240c33-36cd-415b-9fe8-c2989dfa6fc5 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:49:18.637629 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-af240c33-36cd-415b-9fe8-c2989dfa6fc5 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: b44e2605-fae0-4ebf-9362-cdf9a8323375] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:49:18.648688 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-af240c33-36cd-415b-9fe8-c2989dfa6fc5 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:49:18.651066 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-af240c33-36cd-415b-9fe8-c2989dfa6fc5 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:49:18.651066 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-af240c33-36cd-415b-9fe8-c2989dfa6fc5 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:49:18.651601 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-af240c33-36cd-415b-9fe8-c2989dfa6fc5 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:49:18.814985 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-af240c33-36cd-415b-9fe8-c2989dfa6fc5 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:49:18.822514 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-af240c33-36cd-415b-9fe8-c2989dfa6fc5 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/b44e2605-fae0-4ebf-9362-cdf9a8323375" status: 200 len: 1278 microversion: 2.1 time: 0.190123 Apr 16 21:49:18.823078 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3461/6762] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:49:18 2022] GET /compute/v2.1/servers/b44e2605-fae0-4ebf-9362-cdf9a8323375 => generated 1278 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:49:18.969925 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-727e7451-2675-4873-bd11-28f911dff37c req-45996d7e-da4b-409f-b2b0-5e01d4ca351b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b44e2605-fae0-4ebf-9362-cdf9a8323375", "tag": "33729da0-5d16-49dc-8352-ed7cc676c9e7"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:49:18.981287 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-727e7451-2675-4873-bd11-28f911dff37c req-45996d7e-da4b-409f-b2b0-5e01d4ca351b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:49:18.982073 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-727e7451-2675-4873-bd11-28f911dff37c req-45996d7e-da4b-409f-b2b0-5e01d4ca351b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:49:18.996003 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-727e7451-2675-4873-bd11-28f911dff37c req-45996d7e-da4b-409f-b2b0-5e01d4ca351b service nova] Creating event network-changed:33729da0-5d16-49dc-8352-ed7cc676c9e7 for instance b44e2605-fae0-4ebf-9362-cdf9a8323375 on nch1-master-1 Apr 16 21:49:19.002142 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-727e7451-2675-4873-bd11-28f911dff37c req-45996d7e-da4b-409f-b2b0-5e01d4ca351b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036700 Apr 16 21:49:19.002796 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3302/6763] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:49:19.838915 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-999dac45-40ab-45ee-920c-6cd87bab1be4 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:49:19.860138 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-999dac45-40ab-45ee-920c-6cd87bab1be4 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: b44e2605-fae0-4ebf-9362-cdf9a8323375] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:49:19.860138 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-999dac45-40ab-45ee-920c-6cd87bab1be4 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:49:19.860138 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-999dac45-40ab-45ee-920c-6cd87bab1be4 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:49:19.860138 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-999dac45-40ab-45ee-920c-6cd87bab1be4 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:49:19.860138 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-999dac45-40ab-45ee-920c-6cd87bab1be4 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:49:19.993194 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-999dac45-40ab-45ee-920c-6cd87bab1be4 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:49:20.001966 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-999dac45-40ab-45ee-920c-6cd87bab1be4 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/b44e2605-fae0-4ebf-9362-cdf9a8323375" status: 200 len: 1266 microversion: 2.1 time: 0.166958 Apr 16 21:49:20.002543 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3462/6764] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:49:19 2022] GET /compute/v2.1/servers/b44e2605-fae0-4ebf-9362-cdf9a8323375 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:49:21.021197 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d75b9904-a336-4fb3-8497-a3305dd7130d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:49:21.021906 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d75b9904-a336-4fb3-8497-a3305dd7130d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: b44e2605-fae0-4ebf-9362-cdf9a8323375] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:49:21.028242 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d75b9904-a336-4fb3-8497-a3305dd7130d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:49:21.028712 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d75b9904-a336-4fb3-8497-a3305dd7130d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:49:21.030138 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d75b9904-a336-4fb3-8497-a3305dd7130d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:49:21.030595 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d75b9904-a336-4fb3-8497-a3305dd7130d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:49:21.165297 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d75b9904-a336-4fb3-8497-a3305dd7130d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:49:21.172861 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d75b9904-a336-4fb3-8497-a3305dd7130d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/b44e2605-fae0-4ebf-9362-cdf9a8323375" status: 200 len: 1266 microversion: 2.1 time: 0.156906 Apr 16 21:49:21.175172 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3303/6765] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:49:21 2022] GET /compute/v2.1/servers/b44e2605-fae0-4ebf-9362-cdf9a8323375 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:49:22.190771 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2fbec5fd-7036-46b8-bfca-31974a3f7794 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:49:22.191411 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2fbec5fd-7036-46b8-bfca-31974a3f7794 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: b44e2605-fae0-4ebf-9362-cdf9a8323375] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:49:22.198332 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2fbec5fd-7036-46b8-bfca-31974a3f7794 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:49:22.205263 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2fbec5fd-7036-46b8-bfca-31974a3f7794 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:49:22.205263 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2fbec5fd-7036-46b8-bfca-31974a3f7794 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:49:22.205263 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2fbec5fd-7036-46b8-bfca-31974a3f7794 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:49:22.331331 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2fbec5fd-7036-46b8-bfca-31974a3f7794 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:49:22.338674 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2fbec5fd-7036-46b8-bfca-31974a3f7794 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/b44e2605-fae0-4ebf-9362-cdf9a8323375" status: 200 len: 1266 microversion: 2.1 time: 0.153095 Apr 16 21:49:22.339567 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3463/6766] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:49:22 2022] GET /compute/v2.1/servers/b44e2605-fae0-4ebf-9362-cdf9a8323375 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:49:23.354829 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bea85299-af46-4746-a03c-3e29a58f5061 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:49:23.355473 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bea85299-af46-4746-a03c-3e29a58f5061 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: b44e2605-fae0-4ebf-9362-cdf9a8323375] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:49:23.362657 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bea85299-af46-4746-a03c-3e29a58f5061 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:49:23.363113 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bea85299-af46-4746-a03c-3e29a58f5061 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:49:23.363887 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bea85299-af46-4746-a03c-3e29a58f5061 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:49:23.364378 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bea85299-af46-4746-a03c-3e29a58f5061 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:49:23.496542 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-bea85299-af46-4746-a03c-3e29a58f5061 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:49:23.504224 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bea85299-af46-4746-a03c-3e29a58f5061 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/b44e2605-fae0-4ebf-9362-cdf9a8323375" status: 200 len: 1266 microversion: 2.1 time: 0.153198 Apr 16 21:49:23.504809 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3304/6767] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:49:23 2022] GET /compute/v2.1/servers/b44e2605-fae0-4ebf-9362-cdf9a8323375 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:49:24.521529 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-86181f6b-fbbd-447c-b73b-1cad66440b21 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:49:24.522158 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-86181f6b-fbbd-447c-b73b-1cad66440b21 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: b44e2605-fae0-4ebf-9362-cdf9a8323375] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:49:24.529060 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-86181f6b-fbbd-447c-b73b-1cad66440b21 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:49:24.530030 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-86181f6b-fbbd-447c-b73b-1cad66440b21 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:49:24.530864 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-86181f6b-fbbd-447c-b73b-1cad66440b21 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:49:24.531321 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-86181f6b-fbbd-447c-b73b-1cad66440b21 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:49:24.663878 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-86181f6b-fbbd-447c-b73b-1cad66440b21 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:49:24.672005 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-86181f6b-fbbd-447c-b73b-1cad66440b21 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/b44e2605-fae0-4ebf-9362-cdf9a8323375" status: 200 len: 1266 microversion: 2.1 time: 0.154719 Apr 16 21:49:24.673425 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3464/6768] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:49:24 2022] GET /compute/v2.1/servers/b44e2605-fae0-4ebf-9362-cdf9a8323375 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:49:25.689827 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-25229583-0e30-43fc-9ee3-2da286d687c5 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:49:25.690487 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-25229583-0e30-43fc-9ee3-2da286d687c5 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: b44e2605-fae0-4ebf-9362-cdf9a8323375] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:49:25.697193 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-25229583-0e30-43fc-9ee3-2da286d687c5 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:49:25.702925 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-25229583-0e30-43fc-9ee3-2da286d687c5 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:49:25.702925 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-25229583-0e30-43fc-9ee3-2da286d687c5 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:49:25.702925 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-25229583-0e30-43fc-9ee3-2da286d687c5 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:49:25.816318 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-61329d7e-d9a4-40a8-99f0-15fc72fc2409 req-20f7a333-0ff2-4feb-8eaa-a13b16192c44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b44e2605-fae0-4ebf-9362-cdf9a8323375", "name": "network-vif-plugged", "status": "completed", "tag": "33729da0-5d16-49dc-8352-ed7cc676c9e7"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:49:25.829648 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-61329d7e-d9a4-40a8-99f0-15fc72fc2409 req-20f7a333-0ff2-4feb-8eaa-a13b16192c44 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:49:25.830199 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-61329d7e-d9a4-40a8-99f0-15fc72fc2409 req-20f7a333-0ff2-4feb-8eaa-a13b16192c44 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:49:25.843725 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-61329d7e-d9a4-40a8-99f0-15fc72fc2409 req-20f7a333-0ff2-4feb-8eaa-a13b16192c44 service nova] Creating event network-vif-plugged:33729da0-5d16-49dc-8352-ed7cc676c9e7 for instance b44e2605-fae0-4ebf-9362-cdf9a8323375 on nch1-master-1 Apr 16 21:49:25.849254 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-61329d7e-d9a4-40a8-99f0-15fc72fc2409 req-20f7a333-0ff2-4feb-8eaa-a13b16192c44 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186002 Apr 16 21:49:25.850054 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3305/6769] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:49:25.850177 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-25229583-0e30-43fc-9ee3-2da286d687c5 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:49:25.865235 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-25229583-0e30-43fc-9ee3-2da286d687c5 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/b44e2605-fae0-4ebf-9362-cdf9a8323375" status: 200 len: 1266 microversion: 2.1 time: 0.179946 Apr 16 21:49:25.865814 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3465/6770] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:49:25 2022] GET /compute/v2.1/servers/b44e2605-fae0-4ebf-9362-cdf9a8323375 => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:49:26.883312 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-62bdcfb8-72ea-4454-bd5f-e6d363bae342 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:49:26.884195 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-62bdcfb8-72ea-4454-bd5f-e6d363bae342 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: b44e2605-fae0-4ebf-9362-cdf9a8323375] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:49:26.891124 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-62bdcfb8-72ea-4454-bd5f-e6d363bae342 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:49:26.896422 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-62bdcfb8-72ea-4454-bd5f-e6d363bae342 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:49:26.896422 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-62bdcfb8-72ea-4454-bd5f-e6d363bae342 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:49:26.896422 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-62bdcfb8-72ea-4454-bd5f-e6d363bae342 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:49:27.028307 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-62bdcfb8-72ea-4454-bd5f-e6d363bae342 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:49:27.035720 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-62bdcfb8-72ea-4454-bd5f-e6d363bae342 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/b44e2605-fae0-4ebf-9362-cdf9a8323375" status: 200 len: 1266 microversion: 2.1 time: 0.157548 Apr 16 21:49:27.036332 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3306/6771] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:49:26 2022] GET /compute/v2.1/servers/b44e2605-fae0-4ebf-9362-cdf9a8323375 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:49:28.053061 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-754d64c4-a489-4c15-b3de-f0644f118ba7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:49:28.053647 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-754d64c4-a489-4c15-b3de-f0644f118ba7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: b44e2605-fae0-4ebf-9362-cdf9a8323375] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:49:28.061146 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-754d64c4-a489-4c15-b3de-f0644f118ba7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:49:28.061615 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-754d64c4-a489-4c15-b3de-f0644f118ba7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:49:28.062449 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-754d64c4-a489-4c15-b3de-f0644f118ba7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:49:28.062903 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-754d64c4-a489-4c15-b3de-f0644f118ba7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:49:28.194256 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-754d64c4-a489-4c15-b3de-f0644f118ba7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:49:28.200530 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-754d64c4-a489-4c15-b3de-f0644f118ba7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/b44e2605-fae0-4ebf-9362-cdf9a8323375" status: 200 len: 1454 microversion: 2.1 time: 0.151407 Apr 16 21:49:28.201131 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3466/6772] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:49:28 2022] GET /compute/v2.1/servers/b44e2605-fae0-4ebf-9362-cdf9a8323375 => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:49:28.217078 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-776385c3-1297-440c-8634-ebfe40b94383 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:49:28.217699 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-776385c3-1297-440c-8634-ebfe40b94383 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: b44e2605-fae0-4ebf-9362-cdf9a8323375] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:49:28.224442 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-776385c3-1297-440c-8634-ebfe40b94383 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:49:28.224904 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-776385c3-1297-440c-8634-ebfe40b94383 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:49:28.225677 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-776385c3-1297-440c-8634-ebfe40b94383 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:49:28.226121 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-776385c3-1297-440c-8634-ebfe40b94383 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:49:28.354008 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-776385c3-1297-440c-8634-ebfe40b94383 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:49:28.362573 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-776385c3-1297-440c-8634-ebfe40b94383 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/b44e2605-fae0-4ebf-9362-cdf9a8323375" status: 200 len: 1454 microversion: 2.1 time: 0.149960 Apr 16 21:49:28.366413 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3307/6773] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:49:28 2022] GET /compute/v2.1/servers/b44e2605-fae0-4ebf-9362-cdf9a8323375 => generated 1454 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:49:31.144904 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-1b637aed-6286-48eb-af6e-293c55c9be1f req-e4ada5a8-24b9-4ee2-803e-9a93889e8649 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b44e2605-fae0-4ebf-9362-cdf9a8323375", "tag": "33729da0-5d16-49dc-8352-ed7cc676c9e7"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:49:31.155606 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-1b637aed-6286-48eb-af6e-293c55c9be1f req-e4ada5a8-24b9-4ee2-803e-9a93889e8649 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:49:31.156214 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-1b637aed-6286-48eb-af6e-293c55c9be1f req-e4ada5a8-24b9-4ee2-803e-9a93889e8649 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:49:31.172445 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-1b637aed-6286-48eb-af6e-293c55c9be1f req-e4ada5a8-24b9-4ee2-803e-9a93889e8649 service nova] Creating event network-changed:33729da0-5d16-49dc-8352-ed7cc676c9e7 for instance b44e2605-fae0-4ebf-9362-cdf9a8323375 on nch1-master-1 Apr 16 21:49:31.181581 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-1b637aed-6286-48eb-af6e-293c55c9be1f req-e4ada5a8-24b9-4ee2-803e-9a93889e8649 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.240549 Apr 16 21:49:31.182124 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3467/6774] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:49:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:50:27.646202 ncdv-master-1 devstack@n-api.service[137408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 21:50:27.647016 ncdv-master-1 devstack@n-api.service[137408]: Sat Apr 16 21:50:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 21:50:31.161957 ncdv-master-1 devstack@n-api.service[137409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 21:50:31.162499 ncdv-master-1 devstack@n-api.service[137409]: Sat Apr 16 21:50:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 21:52:07.782291 ncdv-master-1 devstack@n-api.service[137408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 21:52:07.782830 ncdv-master-1 devstack@n-api.service[137408]: Sat Apr 16 21:52:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 21:52:11.219870 ncdv-master-1 devstack@n-api.service[137409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 21:52:11.220424 ncdv-master-1 devstack@n-api.service[137409]: Sat Apr 16 21:52:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 21:52:24.356312 ncdv-master-1 devstack@n-api.service[137408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 21:52:24.357000 ncdv-master-1 devstack@n-api.service[137408]: Sat Apr 16 21:52:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 21:52:43.146680 ncdv-master-1 devstack@n-api.service[137409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 21:52:43.147247 ncdv-master-1 devstack@n-api.service[137409]: Sat Apr 16 21:52:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 21:52:53.061101 ncdv-master-1 devstack@n-api.service[137409]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c4054330-0d3a-466e-a30b-fa9db79ae593] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 16 21:52:53.061992 ncdv-master-1 devstack@n-api.service[137409]: ERROR oslo.messaging._drivers.impl_rabbit [-] [288aa017-6cef-4242-b65f-3a2680f89840] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 16 21:52:53.226137 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-abb9f45d-615b-414d-b553-8fcad5bc287d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:52:53.227083 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-abb9f45d-615b-414d-b553-8fcad5bc287d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: b44e2605-fae0-4ebf-9362-cdf9a8323375] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:52:53.234719 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-abb9f45d-615b-414d-b553-8fcad5bc287d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:52:53.235181 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-abb9f45d-615b-414d-b553-8fcad5bc287d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:52:53.235958 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-abb9f45d-615b-414d-b553-8fcad5bc287d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:52:53.236438 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-abb9f45d-615b-414d-b553-8fcad5bc287d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:52:54.069807 ncdv-master-1 devstack@n-api.service[137409]: INFO oslo.messaging._drivers.impl_rabbit [-] [288aa017-6cef-4242-b65f-3a2680f89840] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 42104. Apr 16 21:52:54.070473 ncdv-master-1 devstack@n-api.service[137409]: INFO oslo.messaging._drivers.impl_rabbit [-] [c4054330-0d3a-466e-a30b-fa9db79ae593] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 42102. Apr 16 21:52:54.074170 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-abb9f45d-615b-414d-b553-8fcad5bc287d tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "POST /compute/v2.1/servers/b44e2605-fae0-4ebf-9362-cdf9a8323375/action" status: 200 len: 24570 microversion: 2.1 time: 1.020921 Apr 16 21:52:54.078457 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3308/6775] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:52:53 2022] POST /compute/v2.1/servers/b44e2605-fae0-4ebf-9362-cdf9a8323375/action => generated 24570 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 21:52:55.039889 ncdv-master-1 devstack@n-api.service[137408]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cd30ce4f-cd80-45c8-9ec5-78e4a107947b] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 16 21:52:55.045915 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-ed129b6f-064b-4b4e-8592-f920f85f8adf req-76c9eda3-8087-470f-9142-8e1e3dab9009 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b44e2605-fae0-4ebf-9362-cdf9a8323375", "tag": "33729da0-5d16-49dc-8352-ed7cc676c9e7"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:52:55.046242 ncdv-master-1 devstack@n-api.service[137408]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5f71e57d-51af-43d6-a26d-a848d4145923] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 16 21:52:55.050729 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a34a238c-af76-4c62-97f4-656beb2e7edf tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:52:55.051761 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a34a238c-af76-4c62-97f4-656beb2e7edf tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: b44e2605-fae0-4ebf-9362-cdf9a8323375] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:52:55.055735 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-ed129b6f-064b-4b4e-8592-f920f85f8adf req-76c9eda3-8087-470f-9142-8e1e3dab9009 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:52:55.056719 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-ed129b6f-064b-4b4e-8592-f920f85f8adf req-76c9eda3-8087-470f-9142-8e1e3dab9009 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:52:55.058553 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a34a238c-af76-4c62-97f4-656beb2e7edf tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:52:55.059341 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a34a238c-af76-4c62-97f4-656beb2e7edf tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:52:55.060188 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a34a238c-af76-4c62-97f4-656beb2e7edf tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:52:55.060654 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a34a238c-af76-4c62-97f4-656beb2e7edf tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:52:55.069135 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-ed129b6f-064b-4b4e-8592-f920f85f8adf req-76c9eda3-8087-470f-9142-8e1e3dab9009 service nova] Creating event network-changed:33729da0-5d16-49dc-8352-ed7cc676c9e7 for instance b44e2605-fae0-4ebf-9362-cdf9a8323375 on nch1-master-1 Apr 16 21:52:55.074314 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-ed129b6f-064b-4b4e-8592-f920f85f8adf req-76c9eda3-8087-470f-9142-8e1e3dab9009 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032445 Apr 16 21:52:55.075749 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3309/6776] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:52:55.090810 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a34a238c-af76-4c62-97f4-656beb2e7edf tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: b44e2605-fae0-4ebf-9362-cdf9a8323375] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:52:55.402813 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a34a238c-af76-4c62-97f4-656beb2e7edf tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b44e2605-fae0-4ebf-9362-cdf9a8323375" status: 204 len: 0 microversion: 2.1 time: 0.364754 Apr 16 21:52:55.406807 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3468/6777] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:52:55 2022] DELETE /compute/v2.1/servers/b44e2605-fae0-4ebf-9362-cdf9a8323375 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:52:55.412937 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8ad96765-a5db-48e2-a292-45b1d71ca297 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:52:55.413737 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8ad96765-a5db-48e2-a292-45b1d71ca297 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: b44e2605-fae0-4ebf-9362-cdf9a8323375] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:52:55.420575 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8ad96765-a5db-48e2-a292-45b1d71ca297 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:52:55.421150 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8ad96765-a5db-48e2-a292-45b1d71ca297 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:52:55.422620 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8ad96765-a5db-48e2-a292-45b1d71ca297 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:52:55.423141 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8ad96765-a5db-48e2-a292-45b1d71ca297 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:52:55.680156 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8ad96765-a5db-48e2-a292-45b1d71ca297 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:52:55.692704 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8ad96765-a5db-48e2-a292-45b1d71ca297 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/b44e2605-fae0-4ebf-9362-cdf9a8323375" status: 200 len: 1578 microversion: 2.1 time: 0.280273 Apr 16 21:52:55.692704 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3310/6778] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:52:55 2022] GET /compute/v2.1/servers/b44e2605-fae0-4ebf-9362-cdf9a8323375 => generated 1578 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:52:56.706343 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-65229aa5-f383-4cfc-b712-4ecffe04f170 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:52:56.707092 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-65229aa5-f383-4cfc-b712-4ecffe04f170 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: b44e2605-fae0-4ebf-9362-cdf9a8323375] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:52:56.717706 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-65229aa5-f383-4cfc-b712-4ecffe04f170 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:52:56.718184 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-65229aa5-f383-4cfc-b712-4ecffe04f170 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:52:56.719543 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-65229aa5-f383-4cfc-b712-4ecffe04f170 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:52:56.720054 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-65229aa5-f383-4cfc-b712-4ecffe04f170 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:52:56.724513 ncdv-master-1 devstack@n-api.service[137408]: INFO oslo.messaging._drivers.impl_rabbit [-] [5f71e57d-51af-43d6-a26d-a848d4145923] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 42122. Apr 16 21:52:56.726550 ncdv-master-1 devstack@n-api.service[137408]: INFO oslo.messaging._drivers.impl_rabbit [-] [cd30ce4f-cd80-45c8-9ec5-78e4a107947b] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 42120. Apr 16 21:52:56.917614 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-65229aa5-f383-4cfc-b712-4ecffe04f170 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:52:56.925168 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-65229aa5-f383-4cfc-b712-4ecffe04f170 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/b44e2605-fae0-4ebf-9362-cdf9a8323375" status: 200 len: 1460 microversion: 2.1 time: 0.223214 Apr 16 21:52:56.925738 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3469/6779] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:52:56 2022] GET /compute/v2.1/servers/b44e2605-fae0-4ebf-9362-cdf9a8323375 => generated 1460 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:52:57.443540 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-aad37afc-3146-4901-9b0c-1ff3248bacb3 req-05c7a114-fb20-4fdd-be27-0dc5fba45c9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b44e2605-fae0-4ebf-9362-cdf9a8323375", "name": "network-vif-deleted", "tag": "33729da0-5d16-49dc-8352-ed7cc676c9e7"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:52:57.452477 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-aad37afc-3146-4901-9b0c-1ff3248bacb3 req-05c7a114-fb20-4fdd-be27-0dc5fba45c9a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:52:57.453583 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-aad37afc-3146-4901-9b0c-1ff3248bacb3 req-05c7a114-fb20-4fdd-be27-0dc5fba45c9a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:52:57.464452 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-aad37afc-3146-4901-9b0c-1ff3248bacb3 req-05c7a114-fb20-4fdd-be27-0dc5fba45c9a service nova] Creating event network-vif-deleted:33729da0-5d16-49dc-8352-ed7cc676c9e7 for instance b44e2605-fae0-4ebf-9362-cdf9a8323375 on nch1-master-1 Apr 16 21:52:57.469640 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-aad37afc-3146-4901-9b0c-1ff3248bacb3 req-05c7a114-fb20-4fdd-be27-0dc5fba45c9a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029965 Apr 16 21:52:57.470222 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3311/6780] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:52:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:52:57.942189 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-eea8ada4-cdb4-43d6-8294-8b92ee678ed2 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:52:57.942819 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-eea8ada4-cdb4-43d6-8294-8b92ee678ed2 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: b44e2605-fae0-4ebf-9362-cdf9a8323375] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:52:57.949620 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eea8ada4-cdb4-43d6-8294-8b92ee678ed2 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:52:57.950097 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eea8ada4-cdb4-43d6-8294-8b92ee678ed2 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:52:57.950889 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eea8ada4-cdb4-43d6-8294-8b92ee678ed2 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:52:57.951350 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eea8ada4-cdb4-43d6-8294-8b92ee678ed2 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:52:57.981484 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eea8ada4-cdb4-43d6-8294-8b92ee678ed2 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:52:57.981890 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eea8ada4-cdb4-43d6-8294-8b92ee678ed2 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:52:57.982361 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-eea8ada4-cdb4-43d6-8294-8b92ee678ed2 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lazy-loading 'fault' on Instance uuid b44e2605-fae0-4ebf-9362-cdf9a8323375 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:52:58.023826 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-eea8ada4-cdb4-43d6-8294-8b92ee678ed2 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9771814136c84ab3a13bc98dfd79a40f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfcde168250f4d16b2d305afed23fee5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:52:58.031980 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-eea8ada4-cdb4-43d6-8294-8b92ee678ed2 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/b44e2605-fae0-4ebf-9362-cdf9a8323375" status: 200 len: 1230 microversion: 2.1 time: 0.094482 Apr 16 21:52:58.032624 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3470/6781] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:52:57 2022] GET /compute/v2.1/servers/b44e2605-fae0-4ebf-9362-cdf9a8323375 => generated 1230 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:52:59.050413 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6ae3fae9-78b6-4da1-87d1-3e4e26f6e471 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:52:59.051028 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6ae3fae9-78b6-4da1-87d1-3e4e26f6e471 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] [instance: b44e2605-fae0-4ebf-9362-cdf9a8323375] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:52:59.057163 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6ae3fae9-78b6-4da1-87d1-3e4e26f6e471 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:52:59.057654 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6ae3fae9-78b6-4da1-87d1-3e4e26f6e471 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:52:59.058420 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6ae3fae9-78b6-4da1-87d1-3e4e26f6e471 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:52:59.058858 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6ae3fae9-78b6-4da1-87d1-3e4e26f6e471 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:52:59.072053 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-6ae3fae9-78b6-4da1-87d1-3e4e26f6e471 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] HTTP exception thrown: Instance b44e2605-fae0-4ebf-9362-cdf9a8323375 could not be found. Apr 16 21:52:59.072663 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6ae3fae9-78b6-4da1-87d1-3e4e26f6e471 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Returning 404 to user: Instance b44e2605-fae0-4ebf-9362-cdf9a8323375 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:52:59.073482 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6ae3fae9-78b6-4da1-87d1-3e4e26f6e471 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "GET /compute/v2.1/servers/b44e2605-fae0-4ebf-9362-cdf9a8323375" status: 404 len: 111 microversion: 2.1 time: 0.028245 Apr 16 21:52:59.074009 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3312/6782] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:52:59 2022] GET /compute/v2.1/servers/b44e2605-fae0-4ebf-9362-cdf9a8323375 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:53:06.938558 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3924951e-2209-461a-937c-1dde960f58d7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] Calling method '.version_select at 0x7fbb95573550>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:53:07.020616 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3924951e-2209-461a-937c-1dde960f58d7 tempest-TestVolumeBootPattern-410552364 tempest-TestVolumeBootPattern-410552364-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-202961170" status: 202 len: 0 microversion: 2.1 time: 0.085961 Apr 16 21:53:07.021211 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3471/6783] 10.222.0.20 () {58 vars in 1259 bytes} [Sat Apr 16 21:53:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-202961170 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:53:27.993540 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-89fc9d45-c9d8-4959-ab34-162fa031e2b6 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-569490107", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:53:28.043208 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-89fc9d45-c9d8-4959-ab34-162fa031e2b6 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] validate_networks() for None {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:53:28.338391 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-89fc9d45-c9d8-4959-ab34-162fa031e2b6 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:53:28.338817 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-89fc9d45-c9d8-4959-ab34-162fa031e2b6 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:53:28.339298 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-89fc9d45-c9d8-4959-ab34-162fa031e2b6 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:53:28.339709 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-89fc9d45-c9d8-4959-ab34-162fa031e2b6 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:53:28.340125 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-89fc9d45-c9d8-4959-ab34-162fa031e2b6 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:53:28.353979 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-89fc9d45-c9d8-4959-ab34-162fa031e2b6 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:28.354429 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-89fc9d45-c9d8-4959-ab34-162fa031e2b6 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:28.355411 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-89fc9d45-c9d8-4959-ab34-162fa031e2b6 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:28.355873 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-89fc9d45-c9d8-4959-ab34-162fa031e2b6 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:28.373041 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-89fc9d45-c9d8-4959-ab34-162fa031e2b6 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Getting quotas for project 48e225fe10944f3eb50816c44682da5d. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:53:28.378924 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-89fc9d45-c9d8-4959-ab34-162fa031e2b6 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Getting quotas for user 5645e9867fd84c088140b3f4c07463e6 and project 48e225fe10944f3eb50816c44682da5d. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:53:28.391017 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-89fc9d45-c9d8-4959-ab34-162fa031e2b6 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:53:28.393496 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-89fc9d45-c9d8-4959-ab34-162fa031e2b6 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] [instance: 99bda36e-ea80-4f20-b825-c76c36155d0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:53:28.507053 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-89fc9d45-c9d8-4959-ab34-162fa031e2b6 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.625850 Apr 16 21:53:28.508417 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3313/6784] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:53:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:53:28.518064 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8addf7e4-3438-4164-96d3-57f91aa7f101 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:53:28.518701 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8addf7e4-3438-4164-96d3-57f91aa7f101 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] [instance: 99bda36e-ea80-4f20-b825-c76c36155d0b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:53:28.575590 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8addf7e4-3438-4164-96d3-57f91aa7f101 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645e9867fd84c088140b3f4c07463e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e225fe10944f3eb50816c44682da5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:53:28.582184 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8addf7e4-3438-4164-96d3-57f91aa7f101 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] 10.222.0.20 "GET /compute/v2.1/servers/99bda36e-ea80-4f20-b825-c76c36155d0b" status: 200 len: 1221 microversion: 2.1 time: 0.068049 Apr 16 21:53:28.582755 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3472/6785] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:53:28 2022] GET /compute/v2.1/servers/99bda36e-ea80-4f20-b825-c76c36155d0b => generated 1221 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:53:29.600020 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e4218dab-fdf9-4921-87c0-21ef1553e476 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:53:29.600765 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e4218dab-fdf9-4921-87c0-21ef1553e476 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] [instance: 99bda36e-ea80-4f20-b825-c76c36155d0b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:53:29.607547 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e4218dab-fdf9-4921-87c0-21ef1553e476 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:29.608011 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e4218dab-fdf9-4921-87c0-21ef1553e476 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:29.608918 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e4218dab-fdf9-4921-87c0-21ef1553e476 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:29.609366 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e4218dab-fdf9-4921-87c0-21ef1553e476 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:29.671463 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e4218dab-fdf9-4921-87c0-21ef1553e476 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645e9867fd84c088140b3f4c07463e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e225fe10944f3eb50816c44682da5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:53:29.679125 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e4218dab-fdf9-4921-87c0-21ef1553e476 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] 10.222.0.20 "GET /compute/v2.1/servers/99bda36e-ea80-4f20-b825-c76c36155d0b" status: 200 len: 1225 microversion: 2.1 time: 0.083834 Apr 16 21:53:29.679704 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3314/6786] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:53:29 2022] GET /compute/v2.1/servers/99bda36e-ea80-4f20-b825-c76c36155d0b => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:53:30.696575 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0f76f572-5c27-48f2-bfa6-fa1297df0cc9 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:53:30.700806 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0f76f572-5c27-48f2-bfa6-fa1297df0cc9 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] [instance: 99bda36e-ea80-4f20-b825-c76c36155d0b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:53:30.704204 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0f76f572-5c27-48f2-bfa6-fa1297df0cc9 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:30.705216 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0f76f572-5c27-48f2-bfa6-fa1297df0cc9 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:30.706015 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0f76f572-5c27-48f2-bfa6-fa1297df0cc9 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:30.706504 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0f76f572-5c27-48f2-bfa6-fa1297df0cc9 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:30.771079 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0f76f572-5c27-48f2-bfa6-fa1297df0cc9 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645e9867fd84c088140b3f4c07463e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e225fe10944f3eb50816c44682da5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:53:30.778545 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0f76f572-5c27-48f2-bfa6-fa1297df0cc9 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] 10.222.0.20 "GET /compute/v2.1/servers/99bda36e-ea80-4f20-b825-c76c36155d0b" status: 200 len: 1291 microversion: 2.1 time: 0.086146 Apr 16 21:53:30.779119 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3473/6787] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:53:30 2022] GET /compute/v2.1/servers/99bda36e-ea80-4f20-b825-c76c36155d0b => generated 1291 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:53:31.796638 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d26b17e3-d83f-4caa-a1ce-b012a1d6a088 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:53:31.797175 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d26b17e3-d83f-4caa-a1ce-b012a1d6a088 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] [instance: 99bda36e-ea80-4f20-b825-c76c36155d0b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:53:31.804489 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d26b17e3-d83f-4caa-a1ce-b012a1d6a088 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:31.804950 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d26b17e3-d83f-4caa-a1ce-b012a1d6a088 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:31.805733 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d26b17e3-d83f-4caa-a1ce-b012a1d6a088 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:31.806196 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d26b17e3-d83f-4caa-a1ce-b012a1d6a088 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:31.956282 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d26b17e3-d83f-4caa-a1ce-b012a1d6a088 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645e9867fd84c088140b3f4c07463e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e225fe10944f3eb50816c44682da5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:53:31.963626 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d26b17e3-d83f-4caa-a1ce-b012a1d6a088 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] 10.222.0.20 "GET /compute/v2.1/servers/99bda36e-ea80-4f20-b825-c76c36155d0b" status: 200 len: 1321 microversion: 2.1 time: 0.170952 Apr 16 21:53:31.964212 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3315/6788] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:53:31 2022] GET /compute/v2.1/servers/99bda36e-ea80-4f20-b825-c76c36155d0b => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:53:32.324116 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-81cef4a4-2b7c-4614-8c9f-b2ca2faa3589 req-b931d161-e418-408a-8cfc-f5e17bdae7ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99bda36e-ea80-4f20-b825-c76c36155d0b", "tag": "14ea974e-7d86-4e02-af03-fec7e5239009"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:53:32.339558 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-81cef4a4-2b7c-4614-8c9f-b2ca2faa3589 req-b931d161-e418-408a-8cfc-f5e17bdae7ff service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:32.340147 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-81cef4a4-2b7c-4614-8c9f-b2ca2faa3589 req-b931d161-e418-408a-8cfc-f5e17bdae7ff service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:32.352229 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-81cef4a4-2b7c-4614-8c9f-b2ca2faa3589 req-b931d161-e418-408a-8cfc-f5e17bdae7ff service nova] Creating event network-changed:14ea974e-7d86-4e02-af03-fec7e5239009 for instance 99bda36e-ea80-4f20-b825-c76c36155d0b on nch1-master-1 Apr 16 21:53:32.357481 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-81cef4a4-2b7c-4614-8c9f-b2ca2faa3589 req-b931d161-e418-408a-8cfc-f5e17bdae7ff service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037902 Apr 16 21:53:32.366203 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3474/6789] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:53:32.984097 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d36a996a-1fa8-4ecf-a509-76bce5275254 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:53:32.984756 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d36a996a-1fa8-4ecf-a509-76bce5275254 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] [instance: 99bda36e-ea80-4f20-b825-c76c36155d0b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:53:32.992187 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d36a996a-1fa8-4ecf-a509-76bce5275254 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:32.992657 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d36a996a-1fa8-4ecf-a509-76bce5275254 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:32.993431 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d36a996a-1fa8-4ecf-a509-76bce5275254 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:32.993879 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d36a996a-1fa8-4ecf-a509-76bce5275254 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:33.120531 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d36a996a-1fa8-4ecf-a509-76bce5275254 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645e9867fd84c088140b3f4c07463e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e225fe10944f3eb50816c44682da5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:53:33.128495 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d36a996a-1fa8-4ecf-a509-76bce5275254 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] 10.222.0.20 "GET /compute/v2.1/servers/99bda36e-ea80-4f20-b825-c76c36155d0b" status: 200 len: 1321 microversion: 2.1 time: 0.148382 Apr 16 21:53:33.129069 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3316/6790] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:53:32 2022] GET /compute/v2.1/servers/99bda36e-ea80-4f20-b825-c76c36155d0b => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:53:34.147045 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-78d12578-b974-4c96-b198-64008c304e19 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:53:34.147821 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-78d12578-b974-4c96-b198-64008c304e19 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] [instance: 99bda36e-ea80-4f20-b825-c76c36155d0b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:53:34.154413 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-78d12578-b974-4c96-b198-64008c304e19 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:34.154877 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-78d12578-b974-4c96-b198-64008c304e19 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:34.155661 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-78d12578-b974-4c96-b198-64008c304e19 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:34.156116 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-78d12578-b974-4c96-b198-64008c304e19 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:34.284728 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-78d12578-b974-4c96-b198-64008c304e19 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645e9867fd84c088140b3f4c07463e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e225fe10944f3eb50816c44682da5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:53:34.292078 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-78d12578-b974-4c96-b198-64008c304e19 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] 10.222.0.20 "GET /compute/v2.1/servers/99bda36e-ea80-4f20-b825-c76c36155d0b" status: 200 len: 1321 microversion: 2.1 time: 0.150336 Apr 16 21:53:34.301164 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3475/6791] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:53:34 2022] GET /compute/v2.1/servers/99bda36e-ea80-4f20-b825-c76c36155d0b => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:53:35.309092 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-82c9a389-a0c7-4a5c-ac5f-9dde0e8fb612 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:53:35.313556 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-82c9a389-a0c7-4a5c-ac5f-9dde0e8fb612 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] [instance: 99bda36e-ea80-4f20-b825-c76c36155d0b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:53:35.317087 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-82c9a389-a0c7-4a5c-ac5f-9dde0e8fb612 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:35.317545 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-82c9a389-a0c7-4a5c-ac5f-9dde0e8fb612 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:35.318313 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-82c9a389-a0c7-4a5c-ac5f-9dde0e8fb612 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:35.318753 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-82c9a389-a0c7-4a5c-ac5f-9dde0e8fb612 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:35.449069 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-82c9a389-a0c7-4a5c-ac5f-9dde0e8fb612 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645e9867fd84c088140b3f4c07463e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e225fe10944f3eb50816c44682da5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:53:35.456431 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-82c9a389-a0c7-4a5c-ac5f-9dde0e8fb612 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] 10.222.0.20 "GET /compute/v2.1/servers/99bda36e-ea80-4f20-b825-c76c36155d0b" status: 200 len: 1321 microversion: 2.1 time: 0.151193 Apr 16 21:53:35.457013 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3317/6792] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:53:35 2022] GET /compute/v2.1/servers/99bda36e-ea80-4f20-b825-c76c36155d0b => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:53:36.473228 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f72b041c-a497-465d-8f7a-b8c039d5433b tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:53:36.473858 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f72b041c-a497-465d-8f7a-b8c039d5433b tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] [instance: 99bda36e-ea80-4f20-b825-c76c36155d0b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:53:36.480960 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f72b041c-a497-465d-8f7a-b8c039d5433b tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:36.481433 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f72b041c-a497-465d-8f7a-b8c039d5433b tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:36.482220 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f72b041c-a497-465d-8f7a-b8c039d5433b tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:36.482677 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f72b041c-a497-465d-8f7a-b8c039d5433b tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:36.610174 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f72b041c-a497-465d-8f7a-b8c039d5433b tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645e9867fd84c088140b3f4c07463e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e225fe10944f3eb50816c44682da5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:53:36.618163 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f72b041c-a497-465d-8f7a-b8c039d5433b tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] 10.222.0.20 "GET /compute/v2.1/servers/99bda36e-ea80-4f20-b825-c76c36155d0b" status: 200 len: 1321 microversion: 2.1 time: 0.148860 Apr 16 21:53:36.618733 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3476/6793] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:53:36 2022] GET /compute/v2.1/servers/99bda36e-ea80-4f20-b825-c76c36155d0b => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:53:37.635198 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ab44479d-28cb-4103-99b5-7c4e1f4f5ea1 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:53:37.635911 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ab44479d-28cb-4103-99b5-7c4e1f4f5ea1 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] [instance: 99bda36e-ea80-4f20-b825-c76c36155d0b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:53:37.643384 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ab44479d-28cb-4103-99b5-7c4e1f4f5ea1 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:37.643871 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ab44479d-28cb-4103-99b5-7c4e1f4f5ea1 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:37.644669 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ab44479d-28cb-4103-99b5-7c4e1f4f5ea1 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:37.645117 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ab44479d-28cb-4103-99b5-7c4e1f4f5ea1 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:37.773499 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ab44479d-28cb-4103-99b5-7c4e1f4f5ea1 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645e9867fd84c088140b3f4c07463e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e225fe10944f3eb50816c44682da5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:53:37.780811 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ab44479d-28cb-4103-99b5-7c4e1f4f5ea1 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] 10.222.0.20 "GET /compute/v2.1/servers/99bda36e-ea80-4f20-b825-c76c36155d0b" status: 200 len: 1321 microversion: 2.1 time: 0.149564 Apr 16 21:53:37.781376 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3318/6794] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:53:37 2022] GET /compute/v2.1/servers/99bda36e-ea80-4f20-b825-c76c36155d0b => generated 1321 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:53:38.797467 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-229eb7a8-139d-48cf-b31c-3a755e523a20 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:53:38.798117 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-229eb7a8-139d-48cf-b31c-3a755e523a20 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] [instance: 99bda36e-ea80-4f20-b825-c76c36155d0b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:53:38.804909 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-229eb7a8-139d-48cf-b31c-3a755e523a20 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:38.805378 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-229eb7a8-139d-48cf-b31c-3a755e523a20 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:38.806167 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-229eb7a8-139d-48cf-b31c-3a755e523a20 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:38.806657 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-229eb7a8-139d-48cf-b31c-3a755e523a20 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:38.935018 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-229eb7a8-139d-48cf-b31c-3a755e523a20 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645e9867fd84c088140b3f4c07463e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e225fe10944f3eb50816c44682da5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:53:38.942348 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-229eb7a8-139d-48cf-b31c-3a755e523a20 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] 10.222.0.20 "GET /compute/v2.1/servers/99bda36e-ea80-4f20-b825-c76c36155d0b" status: 200 len: 1321 microversion: 2.1 time: 0.148735 Apr 16 21:53:38.942858 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3477/6795] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:53:38 2022] GET /compute/v2.1/servers/99bda36e-ea80-4f20-b825-c76c36155d0b => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:53:39.071751 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-14934992-e3c3-4b0e-b8a8-cb643ffa233c req-7c629730-5d9d-4720-ae47-8027a6786693 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99bda36e-ea80-4f20-b825-c76c36155d0b", "name": "network-vif-plugged", "status": "completed", "tag": "14ea974e-7d86-4e02-af03-fec7e5239009"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:53:39.081210 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-14934992-e3c3-4b0e-b8a8-cb643ffa233c req-7c629730-5d9d-4720-ae47-8027a6786693 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:39.081673 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-14934992-e3c3-4b0e-b8a8-cb643ffa233c req-7c629730-5d9d-4720-ae47-8027a6786693 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:39.092822 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-14934992-e3c3-4b0e-b8a8-cb643ffa233c req-7c629730-5d9d-4720-ae47-8027a6786693 service nova] Creating event network-vif-plugged:14ea974e-7d86-4e02-af03-fec7e5239009 for instance 99bda36e-ea80-4f20-b825-c76c36155d0b on nch1-master-1 Apr 16 21:53:39.098684 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-14934992-e3c3-4b0e-b8a8-cb643ffa233c req-7c629730-5d9d-4720-ae47-8027a6786693 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030801 Apr 16 21:53:39.099282 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3319/6796] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:53:39.959024 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f958c7a5-454f-4ffd-99cf-c8c1e895ddc3 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:53:39.959591 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f958c7a5-454f-4ffd-99cf-c8c1e895ddc3 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] [instance: 99bda36e-ea80-4f20-b825-c76c36155d0b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:53:39.966302 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f958c7a5-454f-4ffd-99cf-c8c1e895ddc3 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:39.966777 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f958c7a5-454f-4ffd-99cf-c8c1e895ddc3 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:39.967561 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f958c7a5-454f-4ffd-99cf-c8c1e895ddc3 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:39.968014 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f958c7a5-454f-4ffd-99cf-c8c1e895ddc3 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:40.101095 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f958c7a5-454f-4ffd-99cf-c8c1e895ddc3 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645e9867fd84c088140b3f4c07463e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e225fe10944f3eb50816c44682da5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:53:40.108662 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f958c7a5-454f-4ffd-99cf-c8c1e895ddc3 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] 10.222.0.20 "GET /compute/v2.1/servers/99bda36e-ea80-4f20-b825-c76c36155d0b" status: 200 len: 1321 microversion: 2.1 time: 0.153612 Apr 16 21:53:40.109224 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3478/6797] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:53:39 2022] GET /compute/v2.1/servers/99bda36e-ea80-4f20-b825-c76c36155d0b => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:53:41.127969 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3724e63a-edf6-48fb-aad0-e761af89cecd tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:53:41.128702 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3724e63a-edf6-48fb-aad0-e761af89cecd tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] [instance: 99bda36e-ea80-4f20-b825-c76c36155d0b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:53:41.134883 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3724e63a-edf6-48fb-aad0-e761af89cecd tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:41.135343 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3724e63a-edf6-48fb-aad0-e761af89cecd tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:41.136147 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3724e63a-edf6-48fb-aad0-e761af89cecd tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:41.136621 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3724e63a-edf6-48fb-aad0-e761af89cecd tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:41.272857 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3724e63a-edf6-48fb-aad0-e761af89cecd tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645e9867fd84c088140b3f4c07463e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e225fe10944f3eb50816c44682da5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:53:41.281065 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3724e63a-edf6-48fb-aad0-e761af89cecd tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] 10.222.0.20 "GET /compute/v2.1/servers/99bda36e-ea80-4f20-b825-c76c36155d0b" status: 200 len: 1471 microversion: 2.1 time: 0.158244 Apr 16 21:53:41.281206 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3320/6798] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:53:41 2022] GET /compute/v2.1/servers/99bda36e-ea80-4f20-b825-c76c36155d0b => generated 1471 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:53:41.352659 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5dadc41f-36a2-48d4-9c47-3a4a95d0f475 tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] Calling method '.version_select at 0x7fbb945355e0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:53:41.417440 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5dadc41f-36a2-48d4-9c47-3a4a95d0f475 tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/cf0cf29c8fe141b3ac6d742f0b474c78" status: 200 len: 371 microversion: 2.1 time: 0.122089 Apr 16 21:53:41.418003 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3479/6799] 10.222.0.20 () {58 vars in 1241 bytes} [Sat Apr 16 21:53:41 2022] GET /compute/v2.1/os-quota-sets/cf0cf29c8fe141b3ac6d742f0b474c78 => generated 371 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:53:41.428804 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8290b581-9a32-4df1-b806-8366675d0770 tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-467563723", "id": 1900623891, "os-flavor-access:is_public": "True"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:53:41.430382 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:53:41.430382 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:53:41.534171 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8290b581-9a32-4df1-b806-8366675d0770 tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.108971 Apr 16 21:53:41.534789 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3321/6800] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:53:41 2022] POST /compute/v2.1/flavors => generated 437 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:53:41.546345 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f451a306-f36f-4775-a14e-7250749fd5c7 tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1900623891"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:53:41.547743 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f451a306-f36f-4775-a14e-7250749fd5c7 tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] [instance: 99bda36e-ea80-4f20-b825-c76c36155d0b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:53:41.554898 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f451a306-f36f-4775-a14e-7250749fd5c7 tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:41.555355 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f451a306-f36f-4775-a14e-7250749fd5c7 tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:41.556479 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f451a306-f36f-4775-a14e-7250749fd5c7 tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:41.556967 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f451a306-f36f-4775-a14e-7250749fd5c7 tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:41.704664 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f451a306-f36f-4775-a14e-7250749fd5c7 tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '71de3d985cc24815b245bd8d305c9e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0cf29c8fe141b3ac6d742f0b474c78', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:53:41.711168 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f451a306-f36f-4775-a14e-7250749fd5c7 tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] [instance: 99bda36e-ea80-4f20-b825-c76c36155d0b] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-467563723 {{(pid=137408) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 16 21:53:41.717587 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f451a306-f36f-4775-a14e-7250749fd5c7 tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:41.718060 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f451a306-f36f-4775-a14e-7250749fd5c7 tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:41.718891 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f451a306-f36f-4775-a14e-7250749fd5c7 tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:41.719350 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f451a306-f36f-4775-a14e-7250749fd5c7 tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:41.740380 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-f451a306-f36f-4775-a14e-7250749fd5c7 tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] Getting quotas for project 48e225fe10944f3eb50816c44682da5d. Resources: {'ram', 'cores'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:53:41.745515 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-f451a306-f36f-4775-a14e-7250749fd5c7 tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] Getting quotas for user 5645e9867fd84c088140b3f4c07463e6 and project 48e225fe10944f3eb50816c44682da5d. Resources: {'ram', 'cores'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:53:41.757112 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.compute.api [None req-f451a306-f36f-4775-a14e-7250749fd5c7 tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] ram quota exceeded for cf0cf29c8fe141b3ac6d742f0b474c78, tried to resize instance. Apr 16 21:53:41.757924 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-f451a306-f36f-4775-a14e-7250749fd5c7 tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Apr 16 21:53:41.758566 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f451a306-f36f-4775-a14e-7250749fd5c7 tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:53:41.759411 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f451a306-f36f-4775-a14e-7250749fd5c7 tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/99bda36e-ea80-4f20-b825-c76c36155d0b/action" status: 403 len: 118 microversion: 2.1 time: 0.217484 Apr 16 21:53:41.759972 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3480/6801] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:53:41 2022] POST /compute/v2.1/servers/99bda36e-ea80-4f20-b825-c76c36155d0b/action => generated 118 bytes in 219 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:53:41.768731 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-aca9255d-5d1e-4889-9c2d-86e9eee3f33f tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:53:41.769494 ncdv-master-1 devstack@n-api.service[137409]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:53:41.769494 ncdv-master-1 devstack@n-api.service[137409]: warnings.warn(msg) Apr 16 21:53:41.840325 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-aca9255d-5d1e-4889-9c2d-86e9eee3f33f tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/1900623891" status: 202 len: 0 microversion: 2.1 time: 0.075762 Apr 16 21:53:41.840926 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3322/6802] 10.222.0.20 () {58 vars in 1160 bytes} [Sat Apr 16 21:53:41 2022] DELETE /compute/v2.1/flavors/1900623891 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:53:41.849410 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-548e9f5d-99cf-4ce6-b984-d77f8adcee40 tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:53:41.868366 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-548e9f5d-99cf-4ce6-b984-d77f8adcee40 tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022599 Apr 16 21:53:41.868922 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3481/6803] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:53:41 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:53:41.885709 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-db382fe5-f37d-4ea2-aff7-5317a21f1def tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] Calling method '.version_select at 0x7fbb954a28b0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:53:41.956657 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-db382fe5-f37d-4ea2-aff7-5317a21f1def tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] 10.222.0.20 "GET /compute/v2.1/os-quota-sets/cf0cf29c8fe141b3ac6d742f0b474c78" status: 200 len: 371 microversion: 2.1 time: 0.074557 Apr 16 21:53:41.957240 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3323/6804] 10.222.0.20 () {58 vars in 1241 bytes} [Sat Apr 16 21:53:41 2022] GET /compute/v2.1/os-quota-sets/cf0cf29c8fe141b3ac6d742f0b474c78 => generated 371 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:53:41.967235 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-aee98219-5cc7-440b-b48f-740e484a8602 tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1433591926", "id": 360923980, "os-flavor-access:is_public": "True"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:53:41.968830 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:53:41.968830 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:53:42.040649 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-aee98219-5cc7-440b-b48f-740e484a8602 tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.077015 Apr 16 21:53:42.041234 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3482/6805] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:53:41 2022] POST /compute/v2.1/flavors => generated 434 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:53:42.051703 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d4a08e03-ff00-4802-95c3-3af519783ef2 tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "360923980"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:53:42.052697 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d4a08e03-ff00-4802-95c3-3af519783ef2 tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] [instance: 99bda36e-ea80-4f20-b825-c76c36155d0b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:53:42.058591 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d4a08e03-ff00-4802-95c3-3af519783ef2 tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:42.059069 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d4a08e03-ff00-4802-95c3-3af519783ef2 tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:42.059840 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d4a08e03-ff00-4802-95c3-3af519783ef2 tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:42.060320 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d4a08e03-ff00-4802-95c3-3af519783ef2 tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:42.195923 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d4a08e03-ff00-4802-95c3-3af519783ef2 tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '71de3d985cc24815b245bd8d305c9e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf0cf29c8fe141b3ac6d742f0b474c78', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:53:42.202334 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d4a08e03-ff00-4802-95c3-3af519783ef2 tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] [instance: 99bda36e-ea80-4f20-b825-c76c36155d0b] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1433591926 {{(pid=137409) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 16 21:53:42.209605 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d4a08e03-ff00-4802-95c3-3af519783ef2 tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:42.210058 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d4a08e03-ff00-4802-95c3-3af519783ef2 tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:42.210871 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d4a08e03-ff00-4802-95c3-3af519783ef2 tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:42.211313 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d4a08e03-ff00-4802-95c3-3af519783ef2 tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:42.231175 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-d4a08e03-ff00-4802-95c3-3af519783ef2 tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] Getting quotas for project 48e225fe10944f3eb50816c44682da5d. Resources: {'ram', 'cores'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:53:42.236072 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-d4a08e03-ff00-4802-95c3-3af519783ef2 tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] Getting quotas for user 5645e9867fd84c088140b3f4c07463e6 and project 48e225fe10944f3eb50816c44682da5d. Resources: {'ram', 'cores'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:53:42.247635 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.compute.api [None req-d4a08e03-ff00-4802-95c3-3af519783ef2 tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] cores quota exceeded for cf0cf29c8fe141b3ac6d742f0b474c78, tried to resize instance. Apr 16 21:53:42.249181 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-d4a08e03-ff00-4802-95c3-3af519783ef2 tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Apr 16 21:53:42.249181 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d4a08e03-ff00-4802-95c3-3af519783ef2 tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:53:42.249639 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d4a08e03-ff00-4802-95c3-3af519783ef2 tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] 10.222.0.20 "POST /compute/v2.1/servers/99bda36e-ea80-4f20-b825-c76c36155d0b/action" status: 403 len: 113 microversion: 2.1 time: 0.201977 Apr 16 21:53:42.250211 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3324/6806] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:53:42 2022] POST /compute/v2.1/servers/99bda36e-ea80-4f20-b825-c76c36155d0b/action => generated 113 bytes in 203 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:53:42.258859 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c244bfcd-4144-4682-a2b8-8a4d0d047bdb tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:53:42.259618 ncdv-master-1 devstack@n-api.service[137408]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 16 21:53:42.259618 ncdv-master-1 devstack@n-api.service[137408]: warnings.warn(msg) Apr 16 21:53:42.355555 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c244bfcd-4144-4682-a2b8-8a4d0d047bdb tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] 10.222.0.20 "DELETE /compute/v2.1/flavors/360923980" status: 202 len: 0 microversion: 2.1 time: 0.100473 Apr 16 21:53:42.356163 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3483/6807] 10.222.0.20 () {58 vars in 1157 bytes} [Sat Apr 16 21:53:42 2022] DELETE /compute/v2.1/flavors/360923980 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:53:42.364103 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6c1d8dd7-2d6b-49c0-a705-ff3b270c3afb tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:53:42.383180 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6c1d8dd7-2d6b-49c0-a705-ff3b270c3afb tempest-ServersAdminNegativeTestJSON-102369313 tempest-ServersAdminNegativeTestJSON-102369313-project-admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.022942 Apr 16 21:53:42.383725 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3325/6808] 10.222.0.20 () {58 vars in 1145 bytes} [Sat Apr 16 21:53:42 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:53:42.400738 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-18c810da-a4ae-4224-bfb9-1bf2628f2d62 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:53:42.401261 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-18c810da-a4ae-4224-bfb9-1bf2628f2d62 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] [instance: 99bda36e-ea80-4f20-b825-c76c36155d0b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:53:42.408078 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-18c810da-a4ae-4224-bfb9-1bf2628f2d62 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:42.408607 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-18c810da-a4ae-4224-bfb9-1bf2628f2d62 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:42.409385 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-18c810da-a4ae-4224-bfb9-1bf2628f2d62 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:42.409865 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-18c810da-a4ae-4224-bfb9-1bf2628f2d62 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:42.432934 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-18c810da-a4ae-4224-bfb9-1bf2628f2d62 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] [instance: 99bda36e-ea80-4f20-b825-c76c36155d0b] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:53:42.762090 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-18c810da-a4ae-4224-bfb9-1bf2628f2d62 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] 10.222.0.20 "DELETE /compute/v2.1/servers/99bda36e-ea80-4f20-b825-c76c36155d0b" status: 204 len: 0 microversion: 2.1 time: 0.365056 Apr 16 21:53:42.762906 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3484/6809] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:53:42 2022] DELETE /compute/v2.1/servers/99bda36e-ea80-4f20-b825-c76c36155d0b => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:53:42.771457 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b66e4011-73d6-4a94-aa19-5ce1ffaf221f tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:53:42.772070 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b66e4011-73d6-4a94-aa19-5ce1ffaf221f tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] [instance: 99bda36e-ea80-4f20-b825-c76c36155d0b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:53:42.778211 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b66e4011-73d6-4a94-aa19-5ce1ffaf221f tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:42.778930 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b66e4011-73d6-4a94-aa19-5ce1ffaf221f tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:42.779702 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b66e4011-73d6-4a94-aa19-5ce1ffaf221f tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:42.780144 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b66e4011-73d6-4a94-aa19-5ce1ffaf221f tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:42.906804 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b66e4011-73d6-4a94-aa19-5ce1ffaf221f tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645e9867fd84c088140b3f4c07463e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e225fe10944f3eb50816c44682da5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:53:42.914757 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b66e4011-73d6-4a94-aa19-5ce1ffaf221f tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] 10.222.0.20 "GET /compute/v2.1/servers/99bda36e-ea80-4f20-b825-c76c36155d0b" status: 200 len: 1477 microversion: 2.1 time: 0.147570 Apr 16 21:53:42.915329 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3326/6810] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:53:42 2022] GET /compute/v2.1/servers/99bda36e-ea80-4f20-b825-c76c36155d0b => generated 1477 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:53:43.932156 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f13c241c-d852-40f9-b1f0-7725b2ce1cfe tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:53:43.933137 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f13c241c-d852-40f9-b1f0-7725b2ce1cfe tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] [instance: 99bda36e-ea80-4f20-b825-c76c36155d0b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:53:43.940587 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f13c241c-d852-40f9-b1f0-7725b2ce1cfe tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:43.940999 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f13c241c-d852-40f9-b1f0-7725b2ce1cfe tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:43.941792 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f13c241c-d852-40f9-b1f0-7725b2ce1cfe tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:43.942246 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f13c241c-d852-40f9-b1f0-7725b2ce1cfe tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:44.069945 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f13c241c-d852-40f9-b1f0-7725b2ce1cfe tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645e9867fd84c088140b3f4c07463e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e225fe10944f3eb50816c44682da5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:53:44.077398 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f13c241c-d852-40f9-b1f0-7725b2ce1cfe tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] 10.222.0.20 "GET /compute/v2.1/servers/99bda36e-ea80-4f20-b825-c76c36155d0b" status: 200 len: 1477 microversion: 2.1 time: 0.149569 Apr 16 21:53:44.077968 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3485/6811] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:53:43 2022] GET /compute/v2.1/servers/99bda36e-ea80-4f20-b825-c76c36155d0b => generated 1477 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:53:44.962542 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-96e2ad60-26bd-46f1-b68a-f47191307397 req-52ec7694-2e9e-49e2-a819-5f407e0dcce4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99bda36e-ea80-4f20-b825-c76c36155d0b", "name": "network-vif-deleted", "tag": "14ea974e-7d86-4e02-af03-fec7e5239009"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:53:44.972188 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-96e2ad60-26bd-46f1-b68a-f47191307397 req-52ec7694-2e9e-49e2-a819-5f407e0dcce4 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:44.977033 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-96e2ad60-26bd-46f1-b68a-f47191307397 req-52ec7694-2e9e-49e2-a819-5f407e0dcce4 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:44.984965 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-96e2ad60-26bd-46f1-b68a-f47191307397 req-52ec7694-2e9e-49e2-a819-5f407e0dcce4 service nova] Creating event network-vif-deleted:14ea974e-7d86-4e02-af03-fec7e5239009 for instance 99bda36e-ea80-4f20-b825-c76c36155d0b on nch1-master-1 Apr 16 21:53:44.990232 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-96e2ad60-26bd-46f1-b68a-f47191307397 req-52ec7694-2e9e-49e2-a819-5f407e0dcce4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031551 Apr 16 21:53:44.990846 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3327/6812] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:53:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:53:45.094482 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9078cf2f-73a7-40ca-bb34-10720247dae4 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:53:45.097340 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9078cf2f-73a7-40ca-bb34-10720247dae4 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] [instance: 99bda36e-ea80-4f20-b825-c76c36155d0b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:53:45.102847 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9078cf2f-73a7-40ca-bb34-10720247dae4 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:45.103314 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9078cf2f-73a7-40ca-bb34-10720247dae4 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:45.104093 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9078cf2f-73a7-40ca-bb34-10720247dae4 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:45.104569 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9078cf2f-73a7-40ca-bb34-10720247dae4 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:45.168945 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9078cf2f-73a7-40ca-bb34-10720247dae4 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5645e9867fd84c088140b3f4c07463e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e225fe10944f3eb50816c44682da5d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:53:45.176354 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9078cf2f-73a7-40ca-bb34-10720247dae4 tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] 10.222.0.20 "GET /compute/v2.1/servers/99bda36e-ea80-4f20-b825-c76c36155d0b" status: 200 len: 1306 microversion: 2.1 time: 0.085834 Apr 16 21:53:45.176916 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3486/6813] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:53:45 2022] GET /compute/v2.1/servers/99bda36e-ea80-4f20-b825-c76c36155d0b => generated 1306 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:53:46.194408 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b012c70e-281d-4a00-b4a9-dce23ee25a6f tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:53:46.195100 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b012c70e-281d-4a00-b4a9-dce23ee25a6f tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] [instance: 99bda36e-ea80-4f20-b825-c76c36155d0b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:53:46.202090 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b012c70e-281d-4a00-b4a9-dce23ee25a6f tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:46.202559 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b012c70e-281d-4a00-b4a9-dce23ee25a6f tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:46.203346 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b012c70e-281d-4a00-b4a9-dce23ee25a6f tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:46.203801 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b012c70e-281d-4a00-b4a9-dce23ee25a6f tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:46.217298 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-b012c70e-281d-4a00-b4a9-dce23ee25a6f tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] HTTP exception thrown: Instance 99bda36e-ea80-4f20-b825-c76c36155d0b could not be found. Apr 16 21:53:46.217922 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b012c70e-281d-4a00-b4a9-dce23ee25a6f tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] Returning 404 to user: Instance 99bda36e-ea80-4f20-b825-c76c36155d0b could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:53:46.218782 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b012c70e-281d-4a00-b4a9-dce23ee25a6f tempest-ServersAdminNegativeTestJSON-1718338656 tempest-ServersAdminNegativeTestJSON-1718338656-project] 10.222.0.20 "GET /compute/v2.1/servers/99bda36e-ea80-4f20-b825-c76c36155d0b" status: 404 len: 111 microversion: 2.1 time: 0.028667 Apr 16 21:53:46.219318 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3328/6814] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:53:46 2022] GET /compute/v2.1/servers/99bda36e-ea80-4f20-b825-c76c36155d0b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:53:50.576798 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8ba906a0-edf5-4ec3-b4d5-095f7ab1caad tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1491485925", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "5a98825e-7844-4a20-91af-c751fd67dab9"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:53:50.626381 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-8ba906a0-edf5-4ec3-b4d5-095f7ab1caad tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] validate_networks() for [('5a98825e-7844-4a20-91af-c751fd67dab9', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:53:50.970938 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-8ba906a0-edf5-4ec3-b4d5-095f7ab1caad tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:53:50.971407 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-8ba906a0-edf5-4ec3-b4d5-095f7ab1caad tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:53:50.971957 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-8ba906a0-edf5-4ec3-b4d5-095f7ab1caad tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:53:50.972424 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-8ba906a0-edf5-4ec3-b4d5-095f7ab1caad tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:53:50.972859 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-8ba906a0-edf5-4ec3-b4d5-095f7ab1caad tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:53:50.981770 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8ba906a0-edf5-4ec3-b4d5-095f7ab1caad tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:50.982242 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8ba906a0-edf5-4ec3-b4d5-095f7ab1caad tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:50.983064 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8ba906a0-edf5-4ec3-b4d5-095f7ab1caad tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:50.983521 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8ba906a0-edf5-4ec3-b4d5-095f7ab1caad tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:50.999841 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-8ba906a0-edf5-4ec3-b4d5-095f7ab1caad tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Getting quotas for project efbd1717b6ff4d73b5187f4d19c05e4a. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:53:51.005080 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-8ba906a0-edf5-4ec3-b4d5-095f7ab1caad tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Getting quotas for user 20102d18ab024354aba47971a20d1595 and project efbd1717b6ff4d73b5187f4d19c05e4a. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:53:51.017581 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8ba906a0-edf5-4ec3-b4d5-095f7ab1caad tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:53:51.019827 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8ba906a0-edf5-4ec3-b4d5-095f7ab1caad tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:53:51.154423 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8ba906a0-edf5-4ec3-b4d5-095f7ab1caad tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.693247 Apr 16 21:53:51.154971 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3487/6815] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:53:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:53:51.165089 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-596cdf4a-e8c9-4580-8662-b47efe05c079 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:53:51.165713 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-596cdf4a-e8c9-4580-8662-b47efe05c079 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:53:51.223029 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-596cdf4a-e8c9-4580-8662-b47efe05c079 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20102d18ab024354aba47971a20d1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbd1717b6ff4d73b5187f4d19c05e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:53:51.231072 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-596cdf4a-e8c9-4580-8662-b47efe05c079 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b" status: 200 len: 1215 microversion: 2.1 time: 0.070009 Apr 16 21:53:51.231637 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3329/6816] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:53:51 2022] GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b => generated 1215 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:53:52.248931 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-08070332-2114-4996-bb30-e54038457fdb tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:53:52.249555 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-08070332-2114-4996-bb30-e54038457fdb tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:53:52.256302 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-08070332-2114-4996-bb30-e54038457fdb tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:52.256793 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-08070332-2114-4996-bb30-e54038457fdb tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:52.257650 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-08070332-2114-4996-bb30-e54038457fdb tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:52.258078 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-08070332-2114-4996-bb30-e54038457fdb tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:52.579189 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-08070332-2114-4996-bb30-e54038457fdb tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20102d18ab024354aba47971a20d1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbd1717b6ff4d73b5187f4d19c05e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:53:52.586842 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-08070332-2114-4996-bb30-e54038457fdb tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b" status: 200 len: 1219 microversion: 2.1 time: 0.342947 Apr 16 21:53:52.587485 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3488/6817] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:53:52 2022] GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b => generated 1219 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:53:53.603793 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2967d792-6a1b-4506-bce3-0bb2ad4446f2 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:53:53.604415 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2967d792-6a1b-4506-bce3-0bb2ad4446f2 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:53:53.611094 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2967d792-6a1b-4506-bce3-0bb2ad4446f2 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:53.611551 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2967d792-6a1b-4506-bce3-0bb2ad4446f2 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:53.612371 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2967d792-6a1b-4506-bce3-0bb2ad4446f2 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:53.612829 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2967d792-6a1b-4506-bce3-0bb2ad4446f2 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:53.692421 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2967d792-6a1b-4506-bce3-0bb2ad4446f2 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20102d18ab024354aba47971a20d1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbd1717b6ff4d73b5187f4d19c05e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:53:53.699789 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2967d792-6a1b-4506-bce3-0bb2ad4446f2 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b" status: 200 len: 1273 microversion: 2.1 time: 0.100135 Apr 16 21:53:53.700394 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3330/6818] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:53:53 2022] GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b => generated 1273 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:53:54.717625 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7570aa05-64fb-4638-8ed5-c1d3a1a49dcc tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:53:54.718256 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7570aa05-64fb-4638-8ed5-c1d3a1a49dcc tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:53:54.726237 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7570aa05-64fb-4638-8ed5-c1d3a1a49dcc tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:54.726710 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7570aa05-64fb-4638-8ed5-c1d3a1a49dcc tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:54.727759 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7570aa05-64fb-4638-8ed5-c1d3a1a49dcc tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:54.728247 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7570aa05-64fb-4638-8ed5-c1d3a1a49dcc tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:54.865875 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7570aa05-64fb-4638-8ed5-c1d3a1a49dcc tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20102d18ab024354aba47971a20d1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbd1717b6ff4d73b5187f4d19c05e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:53:54.873428 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7570aa05-64fb-4638-8ed5-c1d3a1a49dcc tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b" status: 200 len: 1315 microversion: 2.1 time: 0.159719 Apr 16 21:53:54.874006 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3489/6819] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:53:54 2022] GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:53:54.885866 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-9d606633-3d72-484d-9039-97653f19410f req-ebd8d006-6af2-421a-9715-9f8b421bc4fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fb7b620-bde5-480a-8ba4-1aa778d5261b", "tag": "102ee478-ed79-49d6-a7cd-2fe3125d53cd"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:53:54.894501 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-9d606633-3d72-484d-9039-97653f19410f req-ebd8d006-6af2-421a-9715-9f8b421bc4fd service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:54.894954 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-9d606633-3d72-484d-9039-97653f19410f req-ebd8d006-6af2-421a-9715-9f8b421bc4fd service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:54.908520 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-9d606633-3d72-484d-9039-97653f19410f req-ebd8d006-6af2-421a-9715-9f8b421bc4fd service nova] Creating event network-changed:102ee478-ed79-49d6-a7cd-2fe3125d53cd for instance 3fb7b620-bde5-480a-8ba4-1aa778d5261b on nch1-master-1 Apr 16 21:53:54.913675 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-9d606633-3d72-484d-9039-97653f19410f req-ebd8d006-6af2-421a-9715-9f8b421bc4fd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105484 Apr 16 21:53:54.914630 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3331/6820] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:53:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:53:55.891017 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-37a95360-a49b-49b4-a54b-7ca4eacc9b92 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:53:55.891708 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-37a95360-a49b-49b4-a54b-7ca4eacc9b92 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:53:55.898522 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-37a95360-a49b-49b4-a54b-7ca4eacc9b92 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:55.899752 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-37a95360-a49b-49b4-a54b-7ca4eacc9b92 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:55.899910 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-37a95360-a49b-49b4-a54b-7ca4eacc9b92 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:55.900292 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-37a95360-a49b-49b4-a54b-7ca4eacc9b92 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:56.024486 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-37a95360-a49b-49b4-a54b-7ca4eacc9b92 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20102d18ab024354aba47971a20d1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbd1717b6ff4d73b5187f4d19c05e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:53:56.031796 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-37a95360-a49b-49b4-a54b-7ca4eacc9b92 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b" status: 200 len: 1315 microversion: 2.1 time: 0.144733 Apr 16 21:53:56.033061 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3490/6821] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:53:55 2022] GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:53:57.050320 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-22e7ef1e-2862-4a9a-92ab-63666943f2bd tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:53:57.050945 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-22e7ef1e-2862-4a9a-92ab-63666943f2bd tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:53:57.058141 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-22e7ef1e-2862-4a9a-92ab-63666943f2bd tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:57.058605 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-22e7ef1e-2862-4a9a-92ab-63666943f2bd tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:57.059383 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-22e7ef1e-2862-4a9a-92ab-63666943f2bd tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:57.059830 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-22e7ef1e-2862-4a9a-92ab-63666943f2bd tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:57.192826 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-22e7ef1e-2862-4a9a-92ab-63666943f2bd tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20102d18ab024354aba47971a20d1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbd1717b6ff4d73b5187f4d19c05e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:53:57.200108 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-22e7ef1e-2862-4a9a-92ab-63666943f2bd tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b" status: 200 len: 1315 microversion: 2.1 time: 0.154558 Apr 16 21:53:57.200687 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3332/6822] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:53:57 2022] GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:53:58.217247 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a9b9aadd-e7da-475c-8cf4-7505b8e65621 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:53:58.217897 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a9b9aadd-e7da-475c-8cf4-7505b8e65621 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:53:58.224052 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9b9aadd-e7da-475c-8cf4-7505b8e65621 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:58.224564 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9b9aadd-e7da-475c-8cf4-7505b8e65621 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:58.225387 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9b9aadd-e7da-475c-8cf4-7505b8e65621 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:58.225836 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9b9aadd-e7da-475c-8cf4-7505b8e65621 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:58.353940 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a9b9aadd-e7da-475c-8cf4-7505b8e65621 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20102d18ab024354aba47971a20d1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbd1717b6ff4d73b5187f4d19c05e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:53:58.361850 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a9b9aadd-e7da-475c-8cf4-7505b8e65621 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b" status: 200 len: 1315 microversion: 2.1 time: 0.148847 Apr 16 21:53:58.362432 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3491/6823] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:53:58 2022] GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:53:59.379479 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-631a6387-0a39-44e2-a9b0-c3893ffade13 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:53:59.380219 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-631a6387-0a39-44e2-a9b0-c3893ffade13 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:53:59.387340 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-631a6387-0a39-44e2-a9b0-c3893ffade13 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:59.388620 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-631a6387-0a39-44e2-a9b0-c3893ffade13 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:59.388819 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-631a6387-0a39-44e2-a9b0-c3893ffade13 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:53:59.389269 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-631a6387-0a39-44e2-a9b0-c3893ffade13 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:53:59.519171 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-631a6387-0a39-44e2-a9b0-c3893ffade13 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20102d18ab024354aba47971a20d1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbd1717b6ff4d73b5187f4d19c05e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:53:59.526448 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-631a6387-0a39-44e2-a9b0-c3893ffade13 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b" status: 200 len: 1315 microversion: 2.1 time: 0.151427 Apr 16 21:53:59.527016 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3333/6824] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:53:59 2022] GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:54:00.542533 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-eecdd049-f841-4778-b396-dd20bb19144e tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:00.543164 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-eecdd049-f841-4778-b396-dd20bb19144e tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:00.550438 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eecdd049-f841-4778-b396-dd20bb19144e tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:00.550909 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eecdd049-f841-4778-b396-dd20bb19144e tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:00.551699 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eecdd049-f841-4778-b396-dd20bb19144e tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:00.552157 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eecdd049-f841-4778-b396-dd20bb19144e tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:00.675958 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-eecdd049-f841-4778-b396-dd20bb19144e tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20102d18ab024354aba47971a20d1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbd1717b6ff4d73b5187f4d19c05e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:54:00.683533 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-eecdd049-f841-4778-b396-dd20bb19144e tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b" status: 200 len: 1315 microversion: 2.1 time: 0.144898 Apr 16 21:54:00.684186 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3492/6825] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:54:00 2022] GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:54:01.171546 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-77721c74-2d5c-4d1e-9fcf-230954ff8aca req-c050e065-d2e8-4077-a228-abe863ab5b16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fb7b620-bde5-480a-8ba4-1aa778d5261b", "name": "network-vif-plugged", "status": "completed", "tag": "102ee478-ed79-49d6-a7cd-2fe3125d53cd"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:54:01.180501 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-77721c74-2d5c-4d1e-9fcf-230954ff8aca req-c050e065-d2e8-4077-a228-abe863ab5b16 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:01.180932 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-77721c74-2d5c-4d1e-9fcf-230954ff8aca req-c050e065-d2e8-4077-a228-abe863ab5b16 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:01.192044 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-77721c74-2d5c-4d1e-9fcf-230954ff8aca req-c050e065-d2e8-4077-a228-abe863ab5b16 service nova] Creating event network-vif-plugged:102ee478-ed79-49d6-a7cd-2fe3125d53cd for instance 3fb7b620-bde5-480a-8ba4-1aa778d5261b on nch1-master-1 Apr 16 21:54:01.196956 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-77721c74-2d5c-4d1e-9fcf-230954ff8aca req-c050e065-d2e8-4077-a228-abe863ab5b16 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029179 Apr 16 21:54:01.197538 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3334/6826] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:54:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:54:01.700647 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-aee0d4f8-34a0-46ae-8c95-ffc66d91d6a7 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:01.701318 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-aee0d4f8-34a0-46ae-8c95-ffc66d91d6a7 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:01.708388 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aee0d4f8-34a0-46ae-8c95-ffc66d91d6a7 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:01.708862 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aee0d4f8-34a0-46ae-8c95-ffc66d91d6a7 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:01.709656 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aee0d4f8-34a0-46ae-8c95-ffc66d91d6a7 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:01.710116 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aee0d4f8-34a0-46ae-8c95-ffc66d91d6a7 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:01.838298 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-aee0d4f8-34a0-46ae-8c95-ffc66d91d6a7 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20102d18ab024354aba47971a20d1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbd1717b6ff4d73b5187f4d19c05e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:54:01.846221 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-aee0d4f8-34a0-46ae-8c95-ffc66d91d6a7 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b" status: 200 len: 1315 microversion: 2.1 time: 0.149548 Apr 16 21:54:01.846787 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3493/6827] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:54:01 2022] GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:54:02.864762 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b16213d5-7ef5-4301-b733-6e4bb151294b tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:02.865461 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b16213d5-7ef5-4301-b733-6e4bb151294b tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:02.871613 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b16213d5-7ef5-4301-b733-6e4bb151294b tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:02.872069 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b16213d5-7ef5-4301-b733-6e4bb151294b tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:02.872863 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b16213d5-7ef5-4301-b733-6e4bb151294b tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:02.873305 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b16213d5-7ef5-4301-b733-6e4bb151294b tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:02.998487 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b16213d5-7ef5-4301-b733-6e4bb151294b tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20102d18ab024354aba47971a20d1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbd1717b6ff4d73b5187f4d19c05e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:54:03.006373 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b16213d5-7ef5-4301-b733-6e4bb151294b tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b" status: 200 len: 1502 microversion: 2.1 time: 0.147298 Apr 16 21:54:03.006937 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3335/6828] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:54:02 2022] GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b => generated 1502 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:54:03.022631 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8b723df1-ca6b-4cae-bc1d-6315a8fa388d tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:54:03.023732 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8b723df1-ca6b-4cae-bc1d-6315a8fa388d tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:03.030417 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8b723df1-ca6b-4cae-bc1d-6315a8fa388d tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:03.030893 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8b723df1-ca6b-4cae-bc1d-6315a8fa388d tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:03.031871 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8b723df1-ca6b-4cae-bc1d-6315a8fa388d tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:03.032360 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8b723df1-ca6b-4cae-bc1d-6315a8fa388d tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:03.105470 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8b723df1-ca6b-4cae-bc1d-6315a8fa388d tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '20102d18ab024354aba47971a20d1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbd1717b6ff4d73b5187f4d19c05e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:54:03.111627 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8b723df1-ca6b-4cae-bc1d-6315a8fa388d tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Old instance type m1.heat2, new instance type m1.heat {{(pid=137408) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 16 21:54:03.117981 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-8b723df1-ca6b-4cae-bc1d-6315a8fa388d tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:54:03.118422 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-8b723df1-ca6b-4cae-bc1d-6315a8fa388d tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:54:03.118912 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-8b723df1-ca6b-4cae-bc1d-6315a8fa388d tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:54:03.119371 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-8b723df1-ca6b-4cae-bc1d-6315a8fa388d tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:54:03.119800 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-8b723df1-ca6b-4cae-bc1d-6315a8fa388d tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:54:03.381398 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8b723df1-ca6b-4cae-bc1d-6315a8fa388d tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "POST /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b/action" status: 202 len: 0 microversion: 2.1 time: 0.362618 Apr 16 21:54:03.382018 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3494/6829] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:54:03 2022] POST /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b/action => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:54:03.389889 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0875b5ae-3470-4838-bd76-538dc3eb6521 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:03.390587 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0875b5ae-3470-4838-bd76-538dc3eb6521 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:03.396638 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0875b5ae-3470-4838-bd76-538dc3eb6521 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:03.397082 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0875b5ae-3470-4838-bd76-538dc3eb6521 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:03.398059 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0875b5ae-3470-4838-bd76-538dc3eb6521 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:03.398503 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0875b5ae-3470-4838-bd76-538dc3eb6521 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:03.525237 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0875b5ae-3470-4838-bd76-538dc3eb6521 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20102d18ab024354aba47971a20d1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbd1717b6ff4d73b5187f4d19c05e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:54:03.533139 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0875b5ae-3470-4838-bd76-538dc3eb6521 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b" status: 200 len: 1511 microversion: 2.1 time: 0.147051 Apr 16 21:54:03.533715 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3336/6830] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:54:03 2022] GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b => generated 1511 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:54:04.551241 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-deddbb00-8ea6-476c-8bd9-4361946b22d8 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:04.551872 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-deddbb00-8ea6-476c-8bd9-4361946b22d8 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:04.558685 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-deddbb00-8ea6-476c-8bd9-4361946b22d8 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:04.559184 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-deddbb00-8ea6-476c-8bd9-4361946b22d8 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:04.559974 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-deddbb00-8ea6-476c-8bd9-4361946b22d8 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:04.560453 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-deddbb00-8ea6-476c-8bd9-4361946b22d8 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:04.693606 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-deddbb00-8ea6-476c-8bd9-4361946b22d8 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20102d18ab024354aba47971a20d1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbd1717b6ff4d73b5187f4d19c05e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:54:04.701537 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-deddbb00-8ea6-476c-8bd9-4361946b22d8 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b" status: 200 len: 1511 microversion: 2.1 time: 0.155480 Apr 16 21:54:04.702782 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3495/6831] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:54:04 2022] GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:54:05.718825 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-be4a04b5-c7bd-4f50-b313-b02a354df8d1 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:05.719447 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-be4a04b5-c7bd-4f50-b313-b02a354df8d1 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:05.726470 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-be4a04b5-c7bd-4f50-b313-b02a354df8d1 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:05.727295 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-be4a04b5-c7bd-4f50-b313-b02a354df8d1 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:05.728095 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-be4a04b5-c7bd-4f50-b313-b02a354df8d1 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:05.728604 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-be4a04b5-c7bd-4f50-b313-b02a354df8d1 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:05.940204 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-be4a04b5-c7bd-4f50-b313-b02a354df8d1 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20102d18ab024354aba47971a20d1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbd1717b6ff4d73b5187f4d19c05e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:54:05.947635 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-be4a04b5-c7bd-4f50-b313-b02a354df8d1 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b" status: 200 len: 1511 microversion: 2.1 time: 0.232659 Apr 16 21:54:05.948233 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3337/6832] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:54:05 2022] GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b => generated 1511 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:54:06.964796 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7bc9279d-1c3d-4ba3-bf7b-8508ef1b15c1 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:06.965363 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7bc9279d-1c3d-4ba3-bf7b-8508ef1b15c1 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:06.972080 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7bc9279d-1c3d-4ba3-bf7b-8508ef1b15c1 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:06.972584 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7bc9279d-1c3d-4ba3-bf7b-8508ef1b15c1 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:06.973375 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7bc9279d-1c3d-4ba3-bf7b-8508ef1b15c1 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:06.973829 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7bc9279d-1c3d-4ba3-bf7b-8508ef1b15c1 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:07.104473 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7bc9279d-1c3d-4ba3-bf7b-8508ef1b15c1 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20102d18ab024354aba47971a20d1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbd1717b6ff4d73b5187f4d19c05e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:54:07.112005 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7bc9279d-1c3d-4ba3-bf7b-8508ef1b15c1 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b" status: 200 len: 1516 microversion: 2.1 time: 0.151227 Apr 16 21:54:07.112606 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3496/6833] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:54:06 2022] GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:54:08.129276 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9f9cd78c-436d-4966-9c01-bc2a5a7db013 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:08.129898 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9f9cd78c-436d-4966-9c01-bc2a5a7db013 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:08.136741 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9f9cd78c-436d-4966-9c01-bc2a5a7db013 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:08.137199 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9f9cd78c-436d-4966-9c01-bc2a5a7db013 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:08.137984 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9f9cd78c-436d-4966-9c01-bc2a5a7db013 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:08.138427 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9f9cd78c-436d-4966-9c01-bc2a5a7db013 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:08.266429 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9f9cd78c-436d-4966-9c01-bc2a5a7db013 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20102d18ab024354aba47971a20d1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbd1717b6ff4d73b5187f4d19c05e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:54:08.276643 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9f9cd78c-436d-4966-9c01-bc2a5a7db013 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b" status: 200 len: 1516 microversion: 2.1 time: 0.148236 Apr 16 21:54:08.276643 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3338/6834] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:54:08 2022] GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b => generated 1516 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:54:09.291030 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ac13c432-7786-4e51-818d-50bab4620fcb tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:09.291659 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ac13c432-7786-4e51-818d-50bab4620fcb tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:09.301436 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ac13c432-7786-4e51-818d-50bab4620fcb tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:09.301436 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ac13c432-7786-4e51-818d-50bab4620fcb tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:09.301436 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ac13c432-7786-4e51-818d-50bab4620fcb tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:09.301436 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ac13c432-7786-4e51-818d-50bab4620fcb tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:09.427855 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ac13c432-7786-4e51-818d-50bab4620fcb tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20102d18ab024354aba47971a20d1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbd1717b6ff4d73b5187f4d19c05e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:54:09.435236 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ac13c432-7786-4e51-818d-50bab4620fcb tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b" status: 200 len: 1516 microversion: 2.1 time: 0.148293 Apr 16 21:54:09.435927 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3497/6835] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:54:09 2022] GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:54:10.452228 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8d48724b-f307-47a4-98c1-f15b8d61224b tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:10.452848 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8d48724b-f307-47a4-98c1-f15b8d61224b tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:10.459503 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8d48724b-f307-47a4-98c1-f15b8d61224b tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:10.459961 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8d48724b-f307-47a4-98c1-f15b8d61224b tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:10.460774 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8d48724b-f307-47a4-98c1-f15b8d61224b tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:10.461226 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8d48724b-f307-47a4-98c1-f15b8d61224b tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:10.589388 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8d48724b-f307-47a4-98c1-f15b8d61224b tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20102d18ab024354aba47971a20d1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbd1717b6ff4d73b5187f4d19c05e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:54:10.596761 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8d48724b-f307-47a4-98c1-f15b8d61224b tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b" status: 200 len: 1516 microversion: 2.1 time: 0.148459 Apr 16 21:54:10.597336 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3339/6836] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:54:10 2022] GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:54:11.614147 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-df897b86-3c38-4b0d-9eaa-258289993601 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:11.614780 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-df897b86-3c38-4b0d-9eaa-258289993601 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:11.621621 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-df897b86-3c38-4b0d-9eaa-258289993601 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:11.622092 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-df897b86-3c38-4b0d-9eaa-258289993601 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:11.622880 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-df897b86-3c38-4b0d-9eaa-258289993601 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:11.623339 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-df897b86-3c38-4b0d-9eaa-258289993601 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:11.756135 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-df897b86-3c38-4b0d-9eaa-258289993601 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20102d18ab024354aba47971a20d1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbd1717b6ff4d73b5187f4d19c05e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:54:11.763467 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-df897b86-3c38-4b0d-9eaa-258289993601 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b" status: 200 len: 1516 microversion: 2.1 time: 0.153339 Apr 16 21:54:11.764028 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3498/6837] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:54:11 2022] GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:54:12.780506 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-477b66c7-7e63-43ae-a6ad-5f6d1aaab89a tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:12.781126 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-477b66c7-7e63-43ae-a6ad-5f6d1aaab89a tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:12.788532 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-477b66c7-7e63-43ae-a6ad-5f6d1aaab89a tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:12.788997 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-477b66c7-7e63-43ae-a6ad-5f6d1aaab89a tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:12.789769 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-477b66c7-7e63-43ae-a6ad-5f6d1aaab89a tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:12.790215 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-477b66c7-7e63-43ae-a6ad-5f6d1aaab89a tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:12.915354 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-477b66c7-7e63-43ae-a6ad-5f6d1aaab89a tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20102d18ab024354aba47971a20d1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbd1717b6ff4d73b5187f4d19c05e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:54:12.922560 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-477b66c7-7e63-43ae-a6ad-5f6d1aaab89a tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b" status: 200 len: 1516 microversion: 2.1 time: 0.146094 Apr 16 21:54:12.923127 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3340/6838] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:54:12 2022] GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b => generated 1516 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:54:13.939765 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4bf055b6-6cf5-45f9-96c0-ef04a7c26d4b tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:13.940366 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4bf055b6-6cf5-45f9-96c0-ef04a7c26d4b tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:13.947145 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4bf055b6-6cf5-45f9-96c0-ef04a7c26d4b tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:13.947622 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4bf055b6-6cf5-45f9-96c0-ef04a7c26d4b tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:13.948450 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4bf055b6-6cf5-45f9-96c0-ef04a7c26d4b tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:13.948916 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4bf055b6-6cf5-45f9-96c0-ef04a7c26d4b tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:14.074108 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4bf055b6-6cf5-45f9-96c0-ef04a7c26d4b tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20102d18ab024354aba47971a20d1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbd1717b6ff4d73b5187f4d19c05e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:54:14.082006 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4bf055b6-6cf5-45f9-96c0-ef04a7c26d4b tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b" status: 200 len: 1516 microversion: 2.1 time: 0.146263 Apr 16 21:54:14.082571 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3499/6839] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:54:13 2022] GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b => generated 1516 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:54:15.098902 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a9e9e44e-752c-4598-9f24-b0a6378dc632 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:15.099522 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a9e9e44e-752c-4598-9f24-b0a6378dc632 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:15.106591 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a9e9e44e-752c-4598-9f24-b0a6378dc632 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:15.107080 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a9e9e44e-752c-4598-9f24-b0a6378dc632 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:15.107858 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a9e9e44e-752c-4598-9f24-b0a6378dc632 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:15.108352 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a9e9e44e-752c-4598-9f24-b0a6378dc632 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:15.235395 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a9e9e44e-752c-4598-9f24-b0a6378dc632 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20102d18ab024354aba47971a20d1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbd1717b6ff4d73b5187f4d19c05e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:54:15.242771 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a9e9e44e-752c-4598-9f24-b0a6378dc632 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b" status: 200 len: 1516 microversion: 2.1 time: 0.147814 Apr 16 21:54:15.243353 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3341/6840] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:54:15 2022] GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b => generated 1516 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:54:16.258965 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-662cc43c-172c-4790-8842-b00c3037a068 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:16.259606 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-662cc43c-172c-4790-8842-b00c3037a068 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:16.266475 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-662cc43c-172c-4790-8842-b00c3037a068 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:16.266956 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-662cc43c-172c-4790-8842-b00c3037a068 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:16.267766 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-662cc43c-172c-4790-8842-b00c3037a068 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:16.268274 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-662cc43c-172c-4790-8842-b00c3037a068 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:16.399504 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-662cc43c-172c-4790-8842-b00c3037a068 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20102d18ab024354aba47971a20d1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbd1717b6ff4d73b5187f4d19c05e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:54:16.406962 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-662cc43c-172c-4790-8842-b00c3037a068 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b" status: 200 len: 1516 microversion: 2.1 time: 0.152008 Apr 16 21:54:16.407539 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3500/6841] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:54:16 2022] GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:54:17.424072 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6de923af-f930-4288-8d89-e741e4c23f4a tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:17.424653 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6de923af-f930-4288-8d89-e741e4c23f4a tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:17.431416 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6de923af-f930-4288-8d89-e741e4c23f4a tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:17.431864 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6de923af-f930-4288-8d89-e741e4c23f4a tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:17.432671 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6de923af-f930-4288-8d89-e741e4c23f4a tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:17.433154 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6de923af-f930-4288-8d89-e741e4c23f4a tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:17.561358 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6de923af-f930-4288-8d89-e741e4c23f4a tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20102d18ab024354aba47971a20d1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbd1717b6ff4d73b5187f4d19c05e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:54:17.569149 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6de923af-f930-4288-8d89-e741e4c23f4a tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b" status: 200 len: 1516 microversion: 2.1 time: 0.149077 Apr 16 21:54:17.569757 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3342/6842] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:54:17 2022] GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:54:18.586871 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3fa0c0c2-0000-4f18-b949-83ab7adfd289 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:18.587499 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3fa0c0c2-0000-4f18-b949-83ab7adfd289 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:18.594897 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3fa0c0c2-0000-4f18-b949-83ab7adfd289 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:18.595368 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3fa0c0c2-0000-4f18-b949-83ab7adfd289 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:18.596152 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3fa0c0c2-0000-4f18-b949-83ab7adfd289 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:18.596629 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3fa0c0c2-0000-4f18-b949-83ab7adfd289 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:18.723797 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3fa0c0c2-0000-4f18-b949-83ab7adfd289 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20102d18ab024354aba47971a20d1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbd1717b6ff4d73b5187f4d19c05e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:54:18.731868 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3fa0c0c2-0000-4f18-b949-83ab7adfd289 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b" status: 200 len: 1516 microversion: 2.1 time: 0.148946 Apr 16 21:54:18.732468 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3501/6843] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:54:18 2022] GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:54:19.749361 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d90fff5f-e4d9-4283-89d0-5208f837298a tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:19.750470 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d90fff5f-e4d9-4283-89d0-5208f837298a tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:19.757586 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d90fff5f-e4d9-4283-89d0-5208f837298a tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:19.758045 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d90fff5f-e4d9-4283-89d0-5208f837298a tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:19.758823 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d90fff5f-e4d9-4283-89d0-5208f837298a tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:19.759268 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d90fff5f-e4d9-4283-89d0-5208f837298a tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:19.883732 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d90fff5f-e4d9-4283-89d0-5208f837298a tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20102d18ab024354aba47971a20d1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbd1717b6ff4d73b5187f4d19c05e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:54:19.891673 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d90fff5f-e4d9-4283-89d0-5208f837298a tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b" status: 200 len: 1516 microversion: 2.1 time: 0.146200 Apr 16 21:54:19.892264 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3343/6844] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:54:19 2022] GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b => generated 1516 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:54:20.908630 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3d84f5b0-c1ba-49a4-a167-196b93537741 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:20.909259 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3d84f5b0-c1ba-49a4-a167-196b93537741 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:20.916058 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d84f5b0-c1ba-49a4-a167-196b93537741 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:20.916561 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d84f5b0-c1ba-49a4-a167-196b93537741 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:20.917352 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d84f5b0-c1ba-49a4-a167-196b93537741 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:20.917808 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d84f5b0-c1ba-49a4-a167-196b93537741 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:21.050538 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3d84f5b0-c1ba-49a4-a167-196b93537741 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20102d18ab024354aba47971a20d1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbd1717b6ff4d73b5187f4d19c05e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:54:21.057870 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3d84f5b0-c1ba-49a4-a167-196b93537741 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b" status: 200 len: 1516 microversion: 2.1 time: 0.153350 Apr 16 21:54:21.058443 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3502/6845] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:54:20 2022] GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:54:22.075640 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-23830cc8-3803-47b6-bf03-958eb8503ce9 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:22.076295 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-23830cc8-3803-47b6-bf03-958eb8503ce9 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:22.083641 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-23830cc8-3803-47b6-bf03-958eb8503ce9 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:22.084096 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-23830cc8-3803-47b6-bf03-958eb8503ce9 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:22.084897 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-23830cc8-3803-47b6-bf03-958eb8503ce9 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:22.085341 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-23830cc8-3803-47b6-bf03-958eb8503ce9 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:22.216953 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-23830cc8-3803-47b6-bf03-958eb8503ce9 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20102d18ab024354aba47971a20d1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbd1717b6ff4d73b5187f4d19c05e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:54:22.224400 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-23830cc8-3803-47b6-bf03-958eb8503ce9 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b" status: 200 len: 1516 microversion: 2.1 time: 0.152641 Apr 16 21:54:22.224920 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3344/6846] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:54:22 2022] GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:54:23.242425 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1db2a322-401a-40ac-9ae4-31279574b0de tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:23.247679 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1db2a322-401a-40ac-9ae4-31279574b0de tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:23.250374 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1db2a322-401a-40ac-9ae4-31279574b0de tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:23.250862 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1db2a322-401a-40ac-9ae4-31279574b0de tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:23.251652 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1db2a322-401a-40ac-9ae4-31279574b0de tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:23.252108 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1db2a322-401a-40ac-9ae4-31279574b0de tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:23.379653 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1db2a322-401a-40ac-9ae4-31279574b0de tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20102d18ab024354aba47971a20d1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbd1717b6ff4d73b5187f4d19c05e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:54:23.387118 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1db2a322-401a-40ac-9ae4-31279574b0de tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b" status: 200 len: 1516 microversion: 2.1 time: 0.148728 Apr 16 21:54:23.387704 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3503/6847] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:54:23 2022] GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:54:24.404444 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b7cd69e5-446c-4e48-9b58-84babb29e0b1 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:24.405084 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b7cd69e5-446c-4e48-9b58-84babb29e0b1 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:24.411126 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b7cd69e5-446c-4e48-9b58-84babb29e0b1 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:24.411588 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b7cd69e5-446c-4e48-9b58-84babb29e0b1 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:24.412387 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b7cd69e5-446c-4e48-9b58-84babb29e0b1 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:24.412838 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b7cd69e5-446c-4e48-9b58-84babb29e0b1 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:24.542155 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b7cd69e5-446c-4e48-9b58-84babb29e0b1 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20102d18ab024354aba47971a20d1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbd1717b6ff4d73b5187f4d19c05e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:54:24.549963 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b7cd69e5-446c-4e48-9b58-84babb29e0b1 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b" status: 200 len: 1516 microversion: 2.1 time: 0.149635 Apr 16 21:54:24.550537 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3345/6848] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:54:24 2022] GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b => generated 1516 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:54:25.566996 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d788f1dd-bf53-4b76-8de7-e08728808415 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:25.567560 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d788f1dd-bf53-4b76-8de7-e08728808415 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:25.574383 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d788f1dd-bf53-4b76-8de7-e08728808415 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:25.574855 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d788f1dd-bf53-4b76-8de7-e08728808415 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:25.575648 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d788f1dd-bf53-4b76-8de7-e08728808415 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:25.576108 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d788f1dd-bf53-4b76-8de7-e08728808415 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:25.702412 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d788f1dd-bf53-4b76-8de7-e08728808415 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20102d18ab024354aba47971a20d1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbd1717b6ff4d73b5187f4d19c05e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:54:25.710503 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d788f1dd-bf53-4b76-8de7-e08728808415 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b" status: 200 len: 1516 microversion: 2.1 time: 0.147501 Apr 16 21:54:25.711074 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3504/6849] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:54:25 2022] GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b => generated 1516 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:54:26.727278 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3371049f-3871-48d9-84d4-271a057ed686 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:26.727892 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3371049f-3871-48d9-84d4-271a057ed686 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:26.735544 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3371049f-3871-48d9-84d4-271a057ed686 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:26.736006 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3371049f-3871-48d9-84d4-271a057ed686 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:26.736815 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3371049f-3871-48d9-84d4-271a057ed686 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:26.737257 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3371049f-3871-48d9-84d4-271a057ed686 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:26.869444 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3371049f-3871-48d9-84d4-271a057ed686 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20102d18ab024354aba47971a20d1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbd1717b6ff4d73b5187f4d19c05e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:54:26.877298 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3371049f-3871-48d9-84d4-271a057ed686 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b" status: 200 len: 1516 microversion: 2.1 time: 0.154008 Apr 16 21:54:26.877862 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3346/6850] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:54:26 2022] GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:54:27.894421 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b4302950-b925-479a-8d96-9de62139b04e tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:27.895038 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b4302950-b925-479a-8d96-9de62139b04e tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:27.901145 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b4302950-b925-479a-8d96-9de62139b04e tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:27.901617 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b4302950-b925-479a-8d96-9de62139b04e tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:27.902411 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b4302950-b925-479a-8d96-9de62139b04e tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:27.902864 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b4302950-b925-479a-8d96-9de62139b04e tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:28.031686 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b4302950-b925-479a-8d96-9de62139b04e tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20102d18ab024354aba47971a20d1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbd1717b6ff4d73b5187f4d19c05e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:54:28.039031 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b4302950-b925-479a-8d96-9de62139b04e tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b" status: 200 len: 1516 microversion: 2.1 time: 0.148782 Apr 16 21:54:28.039604 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3505/6851] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:54:27 2022] GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:54:29.056190 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8dcfd8cc-6245-4ba1-9c03-eaf7f355be94 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:29.056810 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8dcfd8cc-6245-4ba1-9c03-eaf7f355be94 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:29.064151 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8dcfd8cc-6245-4ba1-9c03-eaf7f355be94 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:29.064643 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8dcfd8cc-6245-4ba1-9c03-eaf7f355be94 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:29.065422 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8dcfd8cc-6245-4ba1-9c03-eaf7f355be94 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:29.065868 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8dcfd8cc-6245-4ba1-9c03-eaf7f355be94 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:29.190799 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8dcfd8cc-6245-4ba1-9c03-eaf7f355be94 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20102d18ab024354aba47971a20d1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbd1717b6ff4d73b5187f4d19c05e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:54:29.197988 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8dcfd8cc-6245-4ba1-9c03-eaf7f355be94 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b" status: 200 len: 1516 microversion: 2.1 time: 0.145731 Apr 16 21:54:29.198555 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3347/6852] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:54:29 2022] GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b => generated 1516 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:54:30.214716 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c06263e6-ebbf-4f69-b561-12359814f542 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:30.215347 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c06263e6-ebbf-4f69-b561-12359814f542 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:30.222268 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c06263e6-ebbf-4f69-b561-12359814f542 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:30.222743 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c06263e6-ebbf-4f69-b561-12359814f542 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:30.223548 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c06263e6-ebbf-4f69-b561-12359814f542 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:30.223992 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c06263e6-ebbf-4f69-b561-12359814f542 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:30.351934 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c06263e6-ebbf-4f69-b561-12359814f542 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20102d18ab024354aba47971a20d1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbd1717b6ff4d73b5187f4d19c05e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:54:30.359336 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c06263e6-ebbf-4f69-b561-12359814f542 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b" status: 200 len: 1516 microversion: 2.1 time: 0.148666 Apr 16 21:54:30.364215 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3506/6853] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:54:30 2022] GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:54:31.376496 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-28f4e939-cb99-464c-a5f6-1e2df231dbcc tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:31.377108 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-28f4e939-cb99-464c-a5f6-1e2df231dbcc tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:31.383811 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-28f4e939-cb99-464c-a5f6-1e2df231dbcc tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:31.384276 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-28f4e939-cb99-464c-a5f6-1e2df231dbcc tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:31.385048 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-28f4e939-cb99-464c-a5f6-1e2df231dbcc tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:31.385488 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-28f4e939-cb99-464c-a5f6-1e2df231dbcc tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:31.517448 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-28f4e939-cb99-464c-a5f6-1e2df231dbcc tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20102d18ab024354aba47971a20d1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbd1717b6ff4d73b5187f4d19c05e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:54:31.524909 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-28f4e939-cb99-464c-a5f6-1e2df231dbcc tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b" status: 200 len: 1516 microversion: 2.1 time: 0.152366 Apr 16 21:54:31.525482 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3348/6854] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:54:31 2022] GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:54:32.542645 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f372dea9-423d-47ce-b06d-88a38a106edd tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:32.543280 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f372dea9-423d-47ce-b06d-88a38a106edd tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:32.550730 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f372dea9-423d-47ce-b06d-88a38a106edd tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:32.551204 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f372dea9-423d-47ce-b06d-88a38a106edd tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:32.551998 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f372dea9-423d-47ce-b06d-88a38a106edd tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:32.552492 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f372dea9-423d-47ce-b06d-88a38a106edd tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:32.687012 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f372dea9-423d-47ce-b06d-88a38a106edd tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20102d18ab024354aba47971a20d1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbd1717b6ff4d73b5187f4d19c05e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:54:32.694630 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f372dea9-423d-47ce-b06d-88a38a106edd tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b" status: 200 len: 1516 microversion: 2.1 time: 0.155916 Apr 16 21:54:32.695204 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3507/6855] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:54:32 2022] GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b => generated 1516 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:54:33.711285 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fe711943-6726-4d85-9a62-774a95a82f2b tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:33.711897 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-fe711943-6726-4d85-9a62-774a95a82f2b tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:33.718623 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fe711943-6726-4d85-9a62-774a95a82f2b tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:33.721758 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fe711943-6726-4d85-9a62-774a95a82f2b tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:33.721758 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fe711943-6726-4d85-9a62-774a95a82f2b tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:33.721758 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fe711943-6726-4d85-9a62-774a95a82f2b tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:33.865033 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-fe711943-6726-4d85-9a62-774a95a82f2b tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20102d18ab024354aba47971a20d1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbd1717b6ff4d73b5187f4d19c05e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:54:33.873061 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fe711943-6726-4d85-9a62-774a95a82f2b tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b" status: 200 len: 1515 microversion: 2.1 time: 0.165963 Apr 16 21:54:33.874178 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3349/6856] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:54:33 2022] GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:54:34.394166 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-e7d8aa15-154d-4999-ad51-a4ba81a8bb0d req-3ab30909-746e-4ef2-892f-b2af09463006 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fb7b620-bde5-480a-8ba4-1aa778d5261b", "name": "network-vif-unplugged", "status": "completed", "tag": "102ee478-ed79-49d6-a7cd-2fe3125d53cd"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:54:34.403167 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-e7d8aa15-154d-4999-ad51-a4ba81a8bb0d req-3ab30909-746e-4ef2-892f-b2af09463006 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:34.403635 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-e7d8aa15-154d-4999-ad51-a4ba81a8bb0d req-3ab30909-746e-4ef2-892f-b2af09463006 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:34.415817 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-e7d8aa15-154d-4999-ad51-a4ba81a8bb0d req-3ab30909-746e-4ef2-892f-b2af09463006 service nova] Creating event network-vif-unplugged:102ee478-ed79-49d6-a7cd-2fe3125d53cd for instance 3fb7b620-bde5-480a-8ba4-1aa778d5261b on nch2-master-1 Apr 16 21:54:34.421025 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [req-e7d8aa15-154d-4999-ad51-a4ba81a8bb0d req-3ab30909-746e-4ef2-892f-b2af09463006 service nova] Instance 3fb7b620-bde5-480a-8ba4-1aa778d5261b is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 16 21:54:34.431685 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-e7d8aa15-154d-4999-ad51-a4ba81a8bb0d req-3ab30909-746e-4ef2-892f-b2af09463006 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041818 Apr 16 21:54:34.432305 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3508/6857] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:54:34.891080 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-eed9625f-8eb6-4a07-b1d9-24be0c95020e tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:34.891713 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-eed9625f-8eb6-4a07-b1d9-24be0c95020e tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:34.899189 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eed9625f-8eb6-4a07-b1d9-24be0c95020e tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:34.899682 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eed9625f-8eb6-4a07-b1d9-24be0c95020e tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:34.900517 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eed9625f-8eb6-4a07-b1d9-24be0c95020e tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:34.900966 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eed9625f-8eb6-4a07-b1d9-24be0c95020e tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:35.401629 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-eed9625f-8eb6-4a07-b1d9-24be0c95020e tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20102d18ab024354aba47971a20d1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbd1717b6ff4d73b5187f4d19c05e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:54:35.409424 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-eed9625f-8eb6-4a07-b1d9-24be0c95020e tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b" status: 200 len: 1515 microversion: 2.1 time: 0.523023 Apr 16 21:54:35.410013 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3350/6858] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:54:34 2022] GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b => generated 1515 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:54:36.428563 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f6f6a405-fad9-47f2-8fd6-714e972f3b5e tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:36.429273 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f6f6a405-fad9-47f2-8fd6-714e972f3b5e tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:36.435370 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6f6a405-fad9-47f2-8fd6-714e972f3b5e tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:36.435862 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6f6a405-fad9-47f2-8fd6-714e972f3b5e tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:36.436740 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6f6a405-fad9-47f2-8fd6-714e972f3b5e tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:36.437199 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6f6a405-fad9-47f2-8fd6-714e972f3b5e tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:36.446126 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-73d7026a-362c-4239-958d-2d3c300a12ae req-1120594c-fd08-4609-8015-e22273e8f795 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fb7b620-bde5-480a-8ba4-1aa778d5261b", "tag": "102ee478-ed79-49d6-a7cd-2fe3125d53cd"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:54:36.454892 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-73d7026a-362c-4239-958d-2d3c300a12ae req-1120594c-fd08-4609-8015-e22273e8f795 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:36.455343 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-73d7026a-362c-4239-958d-2d3c300a12ae req-1120594c-fd08-4609-8015-e22273e8f795 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:36.466816 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-73d7026a-362c-4239-958d-2d3c300a12ae req-1120594c-fd08-4609-8015-e22273e8f795 service nova] Creating event network-changed:102ee478-ed79-49d6-a7cd-2fe3125d53cd for instance 3fb7b620-bde5-480a-8ba4-1aa778d5261b on nch2-master-1 Apr 16 21:54:36.472764 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [req-73d7026a-362c-4239-958d-2d3c300a12ae req-1120594c-fd08-4609-8015-e22273e8f795 service nova] Instance 3fb7b620-bde5-480a-8ba4-1aa778d5261b is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137409) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 16 21:54:36.486653 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-73d7026a-362c-4239-958d-2d3c300a12ae req-1120594c-fd08-4609-8015-e22273e8f795 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044152 Apr 16 21:54:36.487303 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3351/6859] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:54:36.571233 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f6f6a405-fad9-47f2-8fd6-714e972f3b5e tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20102d18ab024354aba47971a20d1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbd1717b6ff4d73b5187f4d19c05e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:54:36.579261 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f6f6a405-fad9-47f2-8fd6-714e972f3b5e tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b" status: 200 len: 1513 microversion: 2.1 time: 0.155818 Apr 16 21:54:36.579975 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3509/6860] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:54:36 2022] GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:54:37.598413 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4d18ac17-2b67-4097-ac06-b9a5e9b30b66 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:37.599122 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4d18ac17-2b67-4097-ac06-b9a5e9b30b66 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:37.605761 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4d18ac17-2b67-4097-ac06-b9a5e9b30b66 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:37.606222 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4d18ac17-2b67-4097-ac06-b9a5e9b30b66 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:37.606991 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4d18ac17-2b67-4097-ac06-b9a5e9b30b66 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:37.607436 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4d18ac17-2b67-4097-ac06-b9a5e9b30b66 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:37.737438 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4d18ac17-2b67-4097-ac06-b9a5e9b30b66 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20102d18ab024354aba47971a20d1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbd1717b6ff4d73b5187f4d19c05e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:54:37.744817 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4d18ac17-2b67-4097-ac06-b9a5e9b30b66 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b" status: 200 len: 1513 microversion: 2.1 time: 0.151755 Apr 16 21:54:37.746169 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3352/6861] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:54:37 2022] GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b => generated 1513 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:54:38.762302 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-958b67c0-59f3-4f47-b02a-02d96317b99e tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:38.767327 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-958b67c0-59f3-4f47-b02a-02d96317b99e tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:38.770094 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-958b67c0-59f3-4f47-b02a-02d96317b99e tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:38.770569 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-958b67c0-59f3-4f47-b02a-02d96317b99e tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:38.771367 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-958b67c0-59f3-4f47-b02a-02d96317b99e tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:38.771824 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-958b67c0-59f3-4f47-b02a-02d96317b99e tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:38.899791 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-958b67c0-59f3-4f47-b02a-02d96317b99e tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20102d18ab024354aba47971a20d1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbd1717b6ff4d73b5187f4d19c05e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:54:38.908004 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-958b67c0-59f3-4f47-b02a-02d96317b99e tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b" status: 200 len: 1510 microversion: 2.1 time: 0.149777 Apr 16 21:54:38.908808 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3510/6862] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:54:38 2022] GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b => generated 1510 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:54:38.924383 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ca8b09d6-ce94-4c13-bd78-31837fe89c1c tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:38.924978 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ca8b09d6-ce94-4c13-bd78-31837fe89c1c tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:38.931534 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ca8b09d6-ce94-4c13-bd78-31837fe89c1c tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:38.931995 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ca8b09d6-ce94-4c13-bd78-31837fe89c1c tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:38.932796 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ca8b09d6-ce94-4c13-bd78-31837fe89c1c tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:38.933232 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ca8b09d6-ce94-4c13-bd78-31837fe89c1c tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:38.959241 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ca8b09d6-ce94-4c13-bd78-31837fe89c1c tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:54:39.082809 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.compute.api [None req-ca8b09d6-ce94-4c13-bd78-31837fe89c1c tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Found an unconfirmed migration during delete, id: 16, status: finished Apr 16 21:54:41.117299 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-c644a000-5815-430e-9c3c-aba9009901fa req-394defba-81d5-4a9f-98a0-6b43329ba46c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fb7b620-bde5-480a-8ba4-1aa778d5261b", "name": "network-vif-plugged", "status": "completed", "tag": "102ee478-ed79-49d6-a7cd-2fe3125d53cd"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:54:41.125787 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-c644a000-5815-430e-9c3c-aba9009901fa req-394defba-81d5-4a9f-98a0-6b43329ba46c service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:41.126339 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-c644a000-5815-430e-9c3c-aba9009901fa req-394defba-81d5-4a9f-98a0-6b43329ba46c service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:41.137662 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-c644a000-5815-430e-9c3c-aba9009901fa req-394defba-81d5-4a9f-98a0-6b43329ba46c service nova] Creating event network-vif-plugged:102ee478-ed79-49d6-a7cd-2fe3125d53cd for instance 3fb7b620-bde5-480a-8ba4-1aa778d5261b on nch2-master-1 Apr 16 21:54:41.143227 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-c644a000-5815-430e-9c3c-aba9009901fa req-394defba-81d5-4a9f-98a0-6b43329ba46c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093679 Apr 16 21:54:41.144071 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3511/6863] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:54:41.182521 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ca8b09d6-ce94-4c13-bd78-31837fe89c1c tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b" status: 204 len: 0 microversion: 2.1 time: 2.261802 Apr 16 21:54:41.184831 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3353/6864] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:54:38 2022] DELETE /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b => generated 0 bytes in 2263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:54:41.191902 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ae533b80-0aee-45d6-9001-0171f712d9ee tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:41.192645 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ae533b80-0aee-45d6-9001-0171f712d9ee tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:41.198851 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ae533b80-0aee-45d6-9001-0171f712d9ee tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:41.199324 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ae533b80-0aee-45d6-9001-0171f712d9ee tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:41.200107 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ae533b80-0aee-45d6-9001-0171f712d9ee tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:41.200588 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ae533b80-0aee-45d6-9001-0171f712d9ee tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:41.332084 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ae533b80-0aee-45d6-9001-0171f712d9ee tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20102d18ab024354aba47971a20d1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbd1717b6ff4d73b5187f4d19c05e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:54:41.339526 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ae533b80-0aee-45d6-9001-0171f712d9ee tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b" status: 200 len: 1502 microversion: 2.1 time: 0.151859 Apr 16 21:54:41.340092 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3512/6865] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:54:41 2022] GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:54:42.358127 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-37a5918a-1a8f-4441-abe1-cdaa4d69af3b tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:42.358880 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-37a5918a-1a8f-4441-abe1-cdaa4d69af3b tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:42.366122 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-37a5918a-1a8f-4441-abe1-cdaa4d69af3b tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:42.366575 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-37a5918a-1a8f-4441-abe1-cdaa4d69af3b tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:42.367341 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-37a5918a-1a8f-4441-abe1-cdaa4d69af3b tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:42.367777 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-37a5918a-1a8f-4441-abe1-cdaa4d69af3b tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:42.499736 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-37a5918a-1a8f-4441-abe1-cdaa4d69af3b tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20102d18ab024354aba47971a20d1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbd1717b6ff4d73b5187f4d19c05e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:54:42.508139 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-37a5918a-1a8f-4441-abe1-cdaa4d69af3b tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b" status: 200 len: 1502 microversion: 2.1 time: 0.154367 Apr 16 21:54:42.508734 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3354/6866] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:54:42 2022] GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:54:43.110066 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-3ce65bd5-6690-46c4-8def-1fe4a2a316e5 req-55e114f8-95d1-43eb-8d22-4137ebc5d2ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fb7b620-bde5-480a-8ba4-1aa778d5261b", "name": "network-vif-deleted", "tag": "102ee478-ed79-49d6-a7cd-2fe3125d53cd"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:54:43.119135 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-3ce65bd5-6690-46c4-8def-1fe4a2a316e5 req-55e114f8-95d1-43eb-8d22-4137ebc5d2ac service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:43.119644 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-3ce65bd5-6690-46c4-8def-1fe4a2a316e5 req-55e114f8-95d1-43eb-8d22-4137ebc5d2ac service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:43.130478 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-3ce65bd5-6690-46c4-8def-1fe4a2a316e5 req-55e114f8-95d1-43eb-8d22-4137ebc5d2ac service nova] Creating event network-vif-deleted:102ee478-ed79-49d6-a7cd-2fe3125d53cd for instance 3fb7b620-bde5-480a-8ba4-1aa778d5261b on nch2-master-1 Apr 16 21:54:43.135362 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-3ce65bd5-6690-46c4-8def-1fe4a2a316e5 req-55e114f8-95d1-43eb-8d22-4137ebc5d2ac service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029582 Apr 16 21:54:43.136095 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3513/6867] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:54:43.525761 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-17252fc5-dd67-4d1c-8324-73ceeb403730 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:43.526378 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-17252fc5-dd67-4d1c-8324-73ceeb403730 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:43.533934 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-17252fc5-dd67-4d1c-8324-73ceeb403730 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:43.534396 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-17252fc5-dd67-4d1c-8324-73ceeb403730 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:43.535211 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-17252fc5-dd67-4d1c-8324-73ceeb403730 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:43.535658 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-17252fc5-dd67-4d1c-8324-73ceeb403730 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:43.565013 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-17252fc5-dd67-4d1c-8324-73ceeb403730 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:43.565411 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-17252fc5-dd67-4d1c-8324-73ceeb403730 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:43.565872 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-17252fc5-dd67-4d1c-8324-73ceeb403730 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lazy-loading 'fault' on Instance uuid 3fb7b620-bde5-480a-8ba4-1aa778d5261b {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:54:43.611023 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-17252fc5-dd67-4d1c-8324-73ceeb403730 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20102d18ab024354aba47971a20d1595', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efbd1717b6ff4d73b5187f4d19c05e4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:54:43.618582 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-17252fc5-dd67-4d1c-8324-73ceeb403730 tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b" status: 200 len: 1305 microversion: 2.1 time: 0.096746 Apr 16 21:54:43.621256 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3355/6868] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:54:43 2022] GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b => generated 1305 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:54:44.636911 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cde55ad0-aa18-4020-86cf-fa2538208a1c tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:44.637623 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cde55ad0-aa18-4020-86cf-fa2538208a1c tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:44.644581 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cde55ad0-aa18-4020-86cf-fa2538208a1c tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:44.645055 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cde55ad0-aa18-4020-86cf-fa2538208a1c tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:44.645845 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cde55ad0-aa18-4020-86cf-fa2538208a1c tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:44.646301 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cde55ad0-aa18-4020-86cf-fa2538208a1c tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:44.659672 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-cde55ad0-aa18-4020-86cf-fa2538208a1c tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] HTTP exception thrown: Instance 3fb7b620-bde5-480a-8ba4-1aa778d5261b could not be found. Apr 16 21:54:44.660297 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cde55ad0-aa18-4020-86cf-fa2538208a1c tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Returning 404 to user: Instance 3fb7b620-bde5-480a-8ba4-1aa778d5261b could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:54:44.661129 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cde55ad0-aa18-4020-86cf-fa2538208a1c tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b" status: 404 len: 111 microversion: 2.1 time: 0.028464 Apr 16 21:54:44.661652 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3514/6869] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:54:44 2022] GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:54:44.679889 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ef1c61b6-045e-4174-a155-81e0f8f84a1b tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:44.680502 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ef1c61b6-045e-4174-a155-81e0f8f84a1b tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:44.687223 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ef1c61b6-045e-4174-a155-81e0f8f84a1b tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:44.687686 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ef1c61b6-045e-4174-a155-81e0f8f84a1b tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:44.688490 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ef1c61b6-045e-4174-a155-81e0f8f84a1b tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:44.688941 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ef1c61b6-045e-4174-a155-81e0f8f84a1b tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:44.704136 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-ef1c61b6-045e-4174-a155-81e0f8f84a1b tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] HTTP exception thrown: Instance 3fb7b620-bde5-480a-8ba4-1aa778d5261b could not be found. Apr 16 21:54:44.704762 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ef1c61b6-045e-4174-a155-81e0f8f84a1b tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Returning 404 to user: Instance 3fb7b620-bde5-480a-8ba4-1aa778d5261b could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:54:44.705595 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ef1c61b6-045e-4174-a155-81e0f8f84a1b tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b" status: 404 len: 111 microversion: 2.1 time: 0.030068 Apr 16 21:54:44.706131 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3356/6870] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:54:44 2022] DELETE /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:54:44.714387 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fdeced0b-5345-4413-94b0-5ba6b8a756fd tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:44.715057 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fdeced0b-5345-4413-94b0-5ba6b8a756fd tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] [instance: 3fb7b620-bde5-480a-8ba4-1aa778d5261b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:44.721678 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fdeced0b-5345-4413-94b0-5ba6b8a756fd tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:44.722161 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fdeced0b-5345-4413-94b0-5ba6b8a756fd tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:44.722961 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fdeced0b-5345-4413-94b0-5ba6b8a756fd tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:44.723426 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fdeced0b-5345-4413-94b0-5ba6b8a756fd tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:44.737798 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-fdeced0b-5345-4413-94b0-5ba6b8a756fd tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] HTTP exception thrown: Instance 3fb7b620-bde5-480a-8ba4-1aa778d5261b could not be found. Apr 16 21:54:44.738413 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fdeced0b-5345-4413-94b0-5ba6b8a756fd tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] Returning 404 to user: Instance 3fb7b620-bde5-480a-8ba4-1aa778d5261b could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:54:44.739256 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fdeced0b-5345-4413-94b0-5ba6b8a756fd tempest-DeleteServersTestJSON-1390199497 tempest-DeleteServersTestJSON-1390199497-project] 10.222.0.20 "GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b" status: 404 len: 111 microversion: 2.1 time: 0.028887 Apr 16 21:54:44.739783 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3515/6871] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:54:44 2022] GET /compute/v2.1/servers/3fb7b620-bde5-480a-8ba4-1aa778d5261b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:54:48.464940 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-dd178426-4e36-4163-9282-46cd2437e585 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1105325050", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "fc8553b4-22f7-4eb6-a00d-5dd26aacc5a4"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:54:48.514444 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-dd178426-4e36-4163-9282-46cd2437e585 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] validate_networks() for [('fc8553b4-22f7-4eb6-a00d-5dd26aacc5a4', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:54:48.864427 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-dd178426-4e36-4163-9282-46cd2437e585 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:54:48.865011 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-dd178426-4e36-4163-9282-46cd2437e585 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:54:48.865496 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-dd178426-4e36-4163-9282-46cd2437e585 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:54:48.865918 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-dd178426-4e36-4163-9282-46cd2437e585 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:54:48.866334 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-dd178426-4e36-4163-9282-46cd2437e585 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:54:48.875774 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dd178426-4e36-4163-9282-46cd2437e585 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:48.876425 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dd178426-4e36-4163-9282-46cd2437e585 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:48.877255 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dd178426-4e36-4163-9282-46cd2437e585 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:48.877699 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dd178426-4e36-4163-9282-46cd2437e585 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:48.895011 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-dd178426-4e36-4163-9282-46cd2437e585 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Getting quotas for project c5dd165bd07e4d8daffbfa8a93aad4e8. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:54:48.900197 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-dd178426-4e36-4163-9282-46cd2437e585 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Getting quotas for user 4be1280a437044ed84be6af90f62e642 and project c5dd165bd07e4d8daffbfa8a93aad4e8. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:54:48.912543 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-dd178426-4e36-4163-9282-46cd2437e585 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:54:48.914812 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-dd178426-4e36-4163-9282-46cd2437e585 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:54:49.019583 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-dd178426-4e36-4163-9282-46cd2437e585 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.665367 Apr 16 21:54:49.020468 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3357/6872] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:54:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 667 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:54:49.042153 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4c8f8b2b-5b1c-4ba9-b81f-a978e40f2a83 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:49.042791 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4c8f8b2b-5b1c-4ba9-b81f-a978e40f2a83 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:49.097352 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4c8f8b2b-5b1c-4ba9-b81f-a978e40f2a83 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:54:49.105092 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4c8f8b2b-5b1c-4ba9-b81f-a978e40f2a83 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1218 microversion: 2.1 time: 0.066839 Apr 16 21:54:49.105850 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3516/6873] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:54:49 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:54:50.122676 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ef28f402-dafa-4db0-a1ff-ab9155c42a15 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:50.123235 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ef28f402-dafa-4db0-a1ff-ab9155c42a15 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:50.129724 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ef28f402-dafa-4db0-a1ff-ab9155c42a15 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:50.130195 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ef28f402-dafa-4db0-a1ff-ab9155c42a15 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:50.130978 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ef28f402-dafa-4db0-a1ff-ab9155c42a15 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:50.131430 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ef28f402-dafa-4db0-a1ff-ab9155c42a15 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:50.192242 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ef28f402-dafa-4db0-a1ff-ab9155c42a15 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:54:50.199686 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ef28f402-dafa-4db0-a1ff-ab9155c42a15 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1222 microversion: 2.1 time: 0.081879 Apr 16 21:54:50.200286 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3358/6874] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:54:50 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:54:51.217444 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-316a802a-94b4-4084-83c2-dfbce4294956 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:51.219245 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-316a802a-94b4-4084-83c2-dfbce4294956 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:51.226683 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-316a802a-94b4-4084-83c2-dfbce4294956 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:51.227243 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-316a802a-94b4-4084-83c2-dfbce4294956 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:51.228123 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-316a802a-94b4-4084-83c2-dfbce4294956 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:51.229082 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-316a802a-94b4-4084-83c2-dfbce4294956 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:51.294005 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-316a802a-94b4-4084-83c2-dfbce4294956 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:54:51.302297 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-316a802a-94b4-4084-83c2-dfbce4294956 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1278 microversion: 2.1 time: 0.088863 Apr 16 21:54:51.304328 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3517/6875] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:54:51 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1278 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:54:52.319141 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5e6d1f5c-e4c5-4c52-847f-036f9a9b7c04 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:52.319769 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5e6d1f5c-e4c5-4c52-847f-036f9a9b7c04 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:52.326659 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5e6d1f5c-e4c5-4c52-847f-036f9a9b7c04 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:52.327152 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5e6d1f5c-e4c5-4c52-847f-036f9a9b7c04 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:52.327947 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5e6d1f5c-e4c5-4c52-847f-036f9a9b7c04 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:52.328495 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5e6d1f5c-e4c5-4c52-847f-036f9a9b7c04 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:52.506535 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5e6d1f5c-e4c5-4c52-847f-036f9a9b7c04 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:54:52.515117 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5e6d1f5c-e4c5-4c52-847f-036f9a9b7c04 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1318 microversion: 2.1 time: 0.200038 Apr 16 21:54:52.515792 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3359/6876] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:54:52 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:54:52.757391 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-22cd7ede-12c5-483c-a6a4-a3b07224eece req-75e10a46-7617-4834-814e-9523098e02ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7632198d-4754-4aa4-8363-696023b07de2", "tag": "c654414f-5802-4de3-b225-eb0ee0017736"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:54:52.770398 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-22cd7ede-12c5-483c-a6a4-a3b07224eece req-75e10a46-7617-4834-814e-9523098e02ef service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:52.770872 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-22cd7ede-12c5-483c-a6a4-a3b07224eece req-75e10a46-7617-4834-814e-9523098e02ef service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:52.782384 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-22cd7ede-12c5-483c-a6a4-a3b07224eece req-75e10a46-7617-4834-814e-9523098e02ef service nova] Creating event network-changed:c654414f-5802-4de3-b225-eb0ee0017736 for instance 7632198d-4754-4aa4-8363-696023b07de2 on nch2-master-1 Apr 16 21:54:52.787223 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-22cd7ede-12c5-483c-a6a4-a3b07224eece req-75e10a46-7617-4834-814e-9523098e02ef service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033599 Apr 16 21:54:52.787819 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3518/6877] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:54:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:54:53.532578 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-27fe8fb5-4f79-47de-82f1-53499abe8357 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:53.533157 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-27fe8fb5-4f79-47de-82f1-53499abe8357 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:53.540065 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-27fe8fb5-4f79-47de-82f1-53499abe8357 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:53.540559 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-27fe8fb5-4f79-47de-82f1-53499abe8357 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:53.541371 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-27fe8fb5-4f79-47de-82f1-53499abe8357 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:53.541818 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-27fe8fb5-4f79-47de-82f1-53499abe8357 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:53.768968 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-27fe8fb5-4f79-47de-82f1-53499abe8357 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:54:53.768968 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-27fe8fb5-4f79-47de-82f1-53499abe8357 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1318 microversion: 2.1 time: 0.235350 Apr 16 21:54:53.768968 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3360/6878] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:54:53 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:54:54.786920 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1c37994b-e3ee-4732-80e4-afba9df69972 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:54.787626 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1c37994b-e3ee-4732-80e4-afba9df69972 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:54.793864 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1c37994b-e3ee-4732-80e4-afba9df69972 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:54.794339 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1c37994b-e3ee-4732-80e4-afba9df69972 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:54.795134 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1c37994b-e3ee-4732-80e4-afba9df69972 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:54.795596 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1c37994b-e3ee-4732-80e4-afba9df69972 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:55.259730 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1c37994b-e3ee-4732-80e4-afba9df69972 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:54:55.267140 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1c37994b-e3ee-4732-80e4-afba9df69972 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1318 microversion: 2.1 time: 0.485420 Apr 16 21:54:55.267705 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3519/6879] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:54:54 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1318 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:54:56.284482 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fa8f46fb-843b-48e6-af74-eda09dc779e8 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:56.285109 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-fa8f46fb-843b-48e6-af74-eda09dc779e8 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:56.291718 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fa8f46fb-843b-48e6-af74-eda09dc779e8 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:56.292190 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fa8f46fb-843b-48e6-af74-eda09dc779e8 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:56.293004 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fa8f46fb-843b-48e6-af74-eda09dc779e8 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:56.293461 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fa8f46fb-843b-48e6-af74-eda09dc779e8 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:56.418391 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-fa8f46fb-843b-48e6-af74-eda09dc779e8 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:54:56.425785 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fa8f46fb-843b-48e6-af74-eda09dc779e8 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1318 microversion: 2.1 time: 0.145774 Apr 16 21:54:56.426360 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3361/6880] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:54:56 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:54:57.443140 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-edecbb0b-d14c-4568-b28e-225c5ee38a1c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:57.443806 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-edecbb0b-d14c-4568-b28e-225c5ee38a1c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:57.450034 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-edecbb0b-d14c-4568-b28e-225c5ee38a1c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:57.450519 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-edecbb0b-d14c-4568-b28e-225c5ee38a1c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:57.451322 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-edecbb0b-d14c-4568-b28e-225c5ee38a1c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:57.451786 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-edecbb0b-d14c-4568-b28e-225c5ee38a1c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:57.577984 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-edecbb0b-d14c-4568-b28e-225c5ee38a1c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:54:57.585407 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-edecbb0b-d14c-4568-b28e-225c5ee38a1c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1318 microversion: 2.1 time: 0.146440 Apr 16 21:54:57.586012 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3520/6881] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:54:57 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:54:58.603142 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9a828727-d6b9-438c-b7df-1bf961db382b tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:58.603828 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9a828727-d6b9-438c-b7df-1bf961db382b tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:58.611037 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9a828727-d6b9-438c-b7df-1bf961db382b tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:58.611491 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9a828727-d6b9-438c-b7df-1bf961db382b tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:58.612293 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9a828727-d6b9-438c-b7df-1bf961db382b tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:58.612742 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9a828727-d6b9-438c-b7df-1bf961db382b tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:58.744283 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9a828727-d6b9-438c-b7df-1bf961db382b tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:54:58.751810 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9a828727-d6b9-438c-b7df-1bf961db382b tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1318 microversion: 2.1 time: 0.152905 Apr 16 21:54:58.752413 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3362/6882] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:54:58 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:54:58.917327 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-884c62ef-5240-4cc3-9b83-54b90591e892 req-4eb02ec9-abf5-4926-bfd2-d9c56ecc5939 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7632198d-4754-4aa4-8363-696023b07de2", "name": "network-vif-plugged", "status": "completed", "tag": "c654414f-5802-4de3-b225-eb0ee0017736"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:54:58.926897 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-884c62ef-5240-4cc3-9b83-54b90591e892 req-4eb02ec9-abf5-4926-bfd2-d9c56ecc5939 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:58.927369 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-884c62ef-5240-4cc3-9b83-54b90591e892 req-4eb02ec9-abf5-4926-bfd2-d9c56ecc5939 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:58.938807 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-884c62ef-5240-4cc3-9b83-54b90591e892 req-4eb02ec9-abf5-4926-bfd2-d9c56ecc5939 service nova] Creating event network-vif-plugged:c654414f-5802-4de3-b225-eb0ee0017736 for instance 7632198d-4754-4aa4-8363-696023b07de2 on nch2-master-1 Apr 16 21:54:58.944353 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-884c62ef-5240-4cc3-9b83-54b90591e892 req-4eb02ec9-abf5-4926-bfd2-d9c56ecc5939 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030642 Apr 16 21:54:58.945707 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3521/6883] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:54:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:54:59.768976 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-01f583ee-ebf5-4122-85bb-17326284afdf tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:54:59.769591 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-01f583ee-ebf5-4122-85bb-17326284afdf tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:54:59.776583 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-01f583ee-ebf5-4122-85bb-17326284afdf tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:59.777039 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-01f583ee-ebf5-4122-85bb-17326284afdf tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:59.777817 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-01f583ee-ebf5-4122-85bb-17326284afdf tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:54:59.778260 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-01f583ee-ebf5-4122-85bb-17326284afdf tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:54:59.903239 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-01f583ee-ebf5-4122-85bb-17326284afdf tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:54:59.910618 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-01f583ee-ebf5-4122-85bb-17326284afdf tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1318 microversion: 2.1 time: 0.145563 Apr 16 21:54:59.911201 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3363/6884] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:54:59 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:00.928193 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d56698fe-c503-4922-8eda-2897838c046d tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:00.928946 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d56698fe-c503-4922-8eda-2897838c046d tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:00.936046 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d56698fe-c503-4922-8eda-2897838c046d tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:00.936477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d56698fe-c503-4922-8eda-2897838c046d tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:00.937770 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d56698fe-c503-4922-8eda-2897838c046d tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:00.938236 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d56698fe-c503-4922-8eda-2897838c046d tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:01.067253 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d56698fe-c503-4922-8eda-2897838c046d tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:01.074720 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d56698fe-c503-4922-8eda-2897838c046d tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1508 microversion: 2.1 time: 0.150838 Apr 16 21:55:01.075300 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3522/6885] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:00 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:01.091388 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4020cd7a-8a48-4877-a989-f2309b92f584 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:01.092003 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4020cd7a-8a48-4877-a989-f2309b92f584 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:01.098762 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4020cd7a-8a48-4877-a989-f2309b92f584 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:01.099216 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4020cd7a-8a48-4877-a989-f2309b92f584 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:01.099988 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4020cd7a-8a48-4877-a989-f2309b92f584 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:01.100458 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4020cd7a-8a48-4877-a989-f2309b92f584 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:01.227801 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4020cd7a-8a48-4877-a989-f2309b92f584 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:01.235585 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4020cd7a-8a48-4877-a989-f2309b92f584 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1508 microversion: 2.1 time: 0.148170 Apr 16 21:55:01.236152 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3364/6886] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:01 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:01.252088 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4bdea8c9-928e-430d-b923-40780ca2a23e tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:55:01.253286 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4bdea8c9-928e-430d-b923-40780ca2a23e tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:01.259129 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4bdea8c9-928e-430d-b923-40780ca2a23e tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:01.259605 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4bdea8c9-928e-430d-b923-40780ca2a23e tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:01.260424 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4bdea8c9-928e-430d-b923-40780ca2a23e tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:01.260885 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4bdea8c9-928e-430d-b923-40780ca2a23e tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:01.376597 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4bdea8c9-928e-430d-b923-40780ca2a23e tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "PUT /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1080 microversion: 2.1 time: 0.128907 Apr 16 21:55:01.377238 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3523/6887] 10.222.0.20 () {60 vars in 1255 bytes} [Sat Apr 16 21:55:01 2022] PUT /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1080 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:01.390756 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-eaf651d3-7eba-4947-8b94-19ad19821d9b tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:01.391367 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-eaf651d3-7eba-4947-8b94-19ad19821d9b tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:01.397347 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eaf651d3-7eba-4947-8b94-19ad19821d9b tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:01.397799 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eaf651d3-7eba-4947-8b94-19ad19821d9b tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:01.398568 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eaf651d3-7eba-4947-8b94-19ad19821d9b tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:01.399007 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eaf651d3-7eba-4947-8b94-19ad19821d9b tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:01.523339 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-eaf651d3-7eba-4947-8b94-19ad19821d9b tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:01.530661 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-eaf651d3-7eba-4947-8b94-19ad19821d9b tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1506 microversion: 2.1 time: 0.143761 Apr 16 21:55:01.531232 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3365/6888] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:01 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1506 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:01.547255 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1260ad9b-e45b-4c23-8215-24fcc0afbfd7 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:01.547946 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1260ad9b-e45b-4c23-8215-24fcc0afbfd7 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:01.554003 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1260ad9b-e45b-4c23-8215-24fcc0afbfd7 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:01.554480 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1260ad9b-e45b-4c23-8215-24fcc0afbfd7 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:01.555272 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1260ad9b-e45b-4c23-8215-24fcc0afbfd7 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:01.555734 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1260ad9b-e45b-4c23-8215-24fcc0afbfd7 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:01.681158 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1260ad9b-e45b-4c23-8215-24fcc0afbfd7 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:01.688919 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1260ad9b-e45b-4c23-8215-24fcc0afbfd7 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1506 microversion: 2.1 time: 0.146086 Apr 16 21:55:01.691298 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3524/6889] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:01 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1506 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:01.705550 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-329fd434-401d-4eee-a67c-9e31d36af849 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:55:01.706589 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-329fd434-401d-4eee-a67c-9e31d36af849 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:01.712558 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-329fd434-401d-4eee-a67c-9e31d36af849 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:01.713024 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-329fd434-401d-4eee-a67c-9e31d36af849 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:01.713793 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-329fd434-401d-4eee-a67c-9e31d36af849 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:01.714239 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-329fd434-401d-4eee-a67c-9e31d36af849 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:01.741953 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-329fd434-401d-4eee-a67c-9e31d36af849 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:01.747686 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-329fd434-401d-4eee-a67c-9e31d36af849 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Old instance type m1.heat2, new instance type m1.heat {{(pid=137409) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 16 21:55:01.753718 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-329fd434-401d-4eee-a67c-9e31d36af849 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:55:01.754143 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-329fd434-401d-4eee-a67c-9e31d36af849 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:55:01.754685 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-329fd434-401d-4eee-a67c-9e31d36af849 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:55:01.755031 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-329fd434-401d-4eee-a67c-9e31d36af849 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:55:01.755446 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-329fd434-401d-4eee-a67c-9e31d36af849 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:55:01.894726 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-329fd434-401d-4eee-a67c-9e31d36af849 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "POST /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2/action" status: 202 len: 0 microversion: 2.1 time: 0.193256 Apr 16 21:55:01.895699 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3366/6890] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:55:01 2022] POST /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:55:01.903432 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-135ff030-03b0-4bfa-832c-e8a3ca91fdac tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:01.904069 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-135ff030-03b0-4bfa-832c-e8a3ca91fdac tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:01.910509 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-135ff030-03b0-4bfa-832c-e8a3ca91fdac tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:01.910989 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-135ff030-03b0-4bfa-832c-e8a3ca91fdac tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:01.911795 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-135ff030-03b0-4bfa-832c-e8a3ca91fdac tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:01.912289 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-135ff030-03b0-4bfa-832c-e8a3ca91fdac tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:02.041731 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-135ff030-03b0-4bfa-832c-e8a3ca91fdac tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:02.049561 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-135ff030-03b0-4bfa-832c-e8a3ca91fdac tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1517 microversion: 2.1 time: 0.149954 Apr 16 21:55:02.052943 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3525/6891] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:01 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1517 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:55:03.068564 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-80a12e38-3e2a-4d2c-9f1f-cdd5e757f3b2 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:03.069451 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-80a12e38-3e2a-4d2c-9f1f-cdd5e757f3b2 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:03.075694 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-80a12e38-3e2a-4d2c-9f1f-cdd5e757f3b2 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:03.076149 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-80a12e38-3e2a-4d2c-9f1f-cdd5e757f3b2 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:03.076950 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-80a12e38-3e2a-4d2c-9f1f-cdd5e757f3b2 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:03.077390 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-80a12e38-3e2a-4d2c-9f1f-cdd5e757f3b2 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:03.209876 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-80a12e38-3e2a-4d2c-9f1f-cdd5e757f3b2 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:03.217368 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-80a12e38-3e2a-4d2c-9f1f-cdd5e757f3b2 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1517 microversion: 2.1 time: 0.153731 Apr 16 21:55:03.217932 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3367/6892] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:03 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:04.235933 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8b19ab14-f045-41b9-aa9a-772634cc9cdf tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:04.236613 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8b19ab14-f045-41b9-aa9a-772634cc9cdf tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:04.243310 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8b19ab14-f045-41b9-aa9a-772634cc9cdf tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:04.243789 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8b19ab14-f045-41b9-aa9a-772634cc9cdf tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:04.244617 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8b19ab14-f045-41b9-aa9a-772634cc9cdf tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:04.245081 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8b19ab14-f045-41b9-aa9a-772634cc9cdf tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:04.375502 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8b19ab14-f045-41b9-aa9a-772634cc9cdf tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:04.383583 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8b19ab14-f045-41b9-aa9a-772634cc9cdf tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1517 microversion: 2.1 time: 0.152032 Apr 16 21:55:04.384199 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3526/6893] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:04 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:05.400880 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-125b349c-9b12-48ce-9e5d-c3a5f2e669b6 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:05.401498 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-125b349c-9b12-48ce-9e5d-c3a5f2e669b6 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:05.408291 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-125b349c-9b12-48ce-9e5d-c3a5f2e669b6 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:05.408757 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-125b349c-9b12-48ce-9e5d-c3a5f2e669b6 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:05.409533 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-125b349c-9b12-48ce-9e5d-c3a5f2e669b6 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:05.409980 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-125b349c-9b12-48ce-9e5d-c3a5f2e669b6 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:05.541075 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-125b349c-9b12-48ce-9e5d-c3a5f2e669b6 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:05.549054 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-125b349c-9b12-48ce-9e5d-c3a5f2e669b6 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1522 microversion: 2.1 time: 0.152012 Apr 16 21:55:05.549639 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3368/6894] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:05 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:06.566827 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6bfc48e8-2953-471b-90df-c9b9fe908ca1 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:06.567497 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6bfc48e8-2953-471b-90df-c9b9fe908ca1 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:06.574340 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6bfc48e8-2953-471b-90df-c9b9fe908ca1 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:06.574818 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6bfc48e8-2953-471b-90df-c9b9fe908ca1 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:06.575617 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6bfc48e8-2953-471b-90df-c9b9fe908ca1 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:06.576082 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6bfc48e8-2953-471b-90df-c9b9fe908ca1 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:06.710286 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6bfc48e8-2953-471b-90df-c9b9fe908ca1 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:06.717668 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6bfc48e8-2953-471b-90df-c9b9fe908ca1 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1522 microversion: 2.1 time: 0.154856 Apr 16 21:55:06.718236 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3527/6895] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:06 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:07.736202 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b1f7476a-1c8f-45c3-a6e6-9dac9ae25936 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:07.736805 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b1f7476a-1c8f-45c3-a6e6-9dac9ae25936 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:07.743457 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b1f7476a-1c8f-45c3-a6e6-9dac9ae25936 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:07.743911 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b1f7476a-1c8f-45c3-a6e6-9dac9ae25936 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:07.744697 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b1f7476a-1c8f-45c3-a6e6-9dac9ae25936 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:07.745138 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b1f7476a-1c8f-45c3-a6e6-9dac9ae25936 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:07.873413 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b1f7476a-1c8f-45c3-a6e6-9dac9ae25936 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:07.880669 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b1f7476a-1c8f-45c3-a6e6-9dac9ae25936 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1522 microversion: 2.1 time: 0.149116 Apr 16 21:55:07.881237 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3369/6896] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:07 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:08.897126 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-72bc7bef-a0cd-4e76-a565-32eb523a4f2b tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:08.897766 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-72bc7bef-a0cd-4e76-a565-32eb523a4f2b tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:08.904603 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-72bc7bef-a0cd-4e76-a565-32eb523a4f2b tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:08.905080 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-72bc7bef-a0cd-4e76-a565-32eb523a4f2b tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:08.905887 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-72bc7bef-a0cd-4e76-a565-32eb523a4f2b tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:08.906358 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-72bc7bef-a0cd-4e76-a565-32eb523a4f2b tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:09.034023 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-72bc7bef-a0cd-4e76-a565-32eb523a4f2b tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:09.041635 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-72bc7bef-a0cd-4e76-a565-32eb523a4f2b tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1522 microversion: 2.1 time: 0.148475 Apr 16 21:55:09.042217 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3528/6897] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:08 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:10.058866 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-52632968-f6f5-4a65-95e1-21c771a174d2 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:10.059490 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-52632968-f6f5-4a65-95e1-21c771a174d2 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:10.066348 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-52632968-f6f5-4a65-95e1-21c771a174d2 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:10.066811 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-52632968-f6f5-4a65-95e1-21c771a174d2 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:10.067595 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-52632968-f6f5-4a65-95e1-21c771a174d2 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:10.068043 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-52632968-f6f5-4a65-95e1-21c771a174d2 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:10.195289 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-52632968-f6f5-4a65-95e1-21c771a174d2 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:10.203156 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-52632968-f6f5-4a65-95e1-21c771a174d2 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1522 microversion: 2.1 time: 0.147710 Apr 16 21:55:10.203735 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3370/6898] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:10 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:11.220887 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2e39517b-a269-4aa4-96ab-bf6ac566de07 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:11.221593 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2e39517b-a269-4aa4-96ab-bf6ac566de07 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:11.228722 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2e39517b-a269-4aa4-96ab-bf6ac566de07 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:11.229199 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2e39517b-a269-4aa4-96ab-bf6ac566de07 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:11.230000 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2e39517b-a269-4aa4-96ab-bf6ac566de07 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:11.230465 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2e39517b-a269-4aa4-96ab-bf6ac566de07 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:11.361271 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2e39517b-a269-4aa4-96ab-bf6ac566de07 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:11.368718 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2e39517b-a269-4aa4-96ab-bf6ac566de07 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1522 microversion: 2.1 time: 0.152360 Apr 16 21:55:11.369292 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3529/6899] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:11 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:12.386291 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0cbdf5c6-423a-4d5e-ad9f-aee4d1994327 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:12.386919 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0cbdf5c6-423a-4d5e-ad9f-aee4d1994327 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:12.393574 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0cbdf5c6-423a-4d5e-ad9f-aee4d1994327 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:12.394029 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0cbdf5c6-423a-4d5e-ad9f-aee4d1994327 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:12.394806 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0cbdf5c6-423a-4d5e-ad9f-aee4d1994327 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:12.395247 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0cbdf5c6-423a-4d5e-ad9f-aee4d1994327 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:12.525729 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0cbdf5c6-423a-4d5e-ad9f-aee4d1994327 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:12.533932 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0cbdf5c6-423a-4d5e-ad9f-aee4d1994327 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1522 microversion: 2.1 time: 0.151512 Apr 16 21:55:12.534500 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3371/6900] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:12 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:55:13.551586 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6c927af7-5ab7-45e3-9156-d26a36655ab8 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:13.552250 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6c927af7-5ab7-45e3-9156-d26a36655ab8 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:13.559059 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6c927af7-5ab7-45e3-9156-d26a36655ab8 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:13.559539 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6c927af7-5ab7-45e3-9156-d26a36655ab8 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:13.560395 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6c927af7-5ab7-45e3-9156-d26a36655ab8 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:13.560863 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6c927af7-5ab7-45e3-9156-d26a36655ab8 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:13.688333 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6c927af7-5ab7-45e3-9156-d26a36655ab8 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:13.695770 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6c927af7-5ab7-45e3-9156-d26a36655ab8 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1522 microversion: 2.1 time: 0.148147 Apr 16 21:55:13.696379 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3530/6901] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:13 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:14.712451 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0498f1bf-d14f-4ce1-8f63-9d67de66ade2 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:14.713070 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0498f1bf-d14f-4ce1-8f63-9d67de66ade2 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:14.719832 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0498f1bf-d14f-4ce1-8f63-9d67de66ade2 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:14.720330 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0498f1bf-d14f-4ce1-8f63-9d67de66ade2 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:14.721105 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0498f1bf-d14f-4ce1-8f63-9d67de66ade2 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:14.721580 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0498f1bf-d14f-4ce1-8f63-9d67de66ade2 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:14.847148 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0498f1bf-d14f-4ce1-8f63-9d67de66ade2 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:14.854653 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0498f1bf-d14f-4ce1-8f63-9d67de66ade2 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1522 microversion: 2.1 time: 0.146122 Apr 16 21:55:14.855229 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3372/6902] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:14 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:15.872244 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9ab76045-4bf4-4aac-b087-476123b8d3bb tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:15.872882 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9ab76045-4bf4-4aac-b087-476123b8d3bb tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:15.880119 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9ab76045-4bf4-4aac-b087-476123b8d3bb tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:15.880726 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9ab76045-4bf4-4aac-b087-476123b8d3bb tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:15.881526 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9ab76045-4bf4-4aac-b087-476123b8d3bb tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:15.881988 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9ab76045-4bf4-4aac-b087-476123b8d3bb tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:16.010545 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9ab76045-4bf4-4aac-b087-476123b8d3bb tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:16.018697 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9ab76045-4bf4-4aac-b087-476123b8d3bb tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1522 microversion: 2.1 time: 0.150511 Apr 16 21:55:16.019300 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3531/6903] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:15 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:17.035978 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2dbc4789-d895-4ecf-a826-02e347a35256 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:17.036697 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2dbc4789-d895-4ecf-a826-02e347a35256 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:17.043484 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2dbc4789-d895-4ecf-a826-02e347a35256 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:17.043950 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2dbc4789-d895-4ecf-a826-02e347a35256 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:17.044766 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2dbc4789-d895-4ecf-a826-02e347a35256 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:17.045221 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2dbc4789-d895-4ecf-a826-02e347a35256 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:17.177026 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2dbc4789-d895-4ecf-a826-02e347a35256 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:17.184686 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2dbc4789-d895-4ecf-a826-02e347a35256 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1522 microversion: 2.1 time: 0.152857 Apr 16 21:55:17.185175 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3373/6904] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:17 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:18.204328 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b50cc625-d9f5-4d11-9529-7eb7459c5860 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:18.204979 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b50cc625-d9f5-4d11-9529-7eb7459c5860 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:18.211742 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b50cc625-d9f5-4d11-9529-7eb7459c5860 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:18.212249 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b50cc625-d9f5-4d11-9529-7eb7459c5860 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:18.213047 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b50cc625-d9f5-4d11-9529-7eb7459c5860 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:18.213506 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b50cc625-d9f5-4d11-9529-7eb7459c5860 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:18.344002 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b50cc625-d9f5-4d11-9529-7eb7459c5860 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:18.351632 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b50cc625-d9f5-4d11-9529-7eb7459c5860 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1522 microversion: 2.1 time: 0.151912 Apr 16 21:55:18.352214 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3532/6905] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:18 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:19.368750 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-130b2c75-c0f6-49d1-9c69-aa97a6e1950f tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:19.369363 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-130b2c75-c0f6-49d1-9c69-aa97a6e1950f tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:19.376079 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-130b2c75-c0f6-49d1-9c69-aa97a6e1950f tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:19.376568 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-130b2c75-c0f6-49d1-9c69-aa97a6e1950f tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:19.377337 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-130b2c75-c0f6-49d1-9c69-aa97a6e1950f tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:19.377778 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-130b2c75-c0f6-49d1-9c69-aa97a6e1950f tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:19.503579 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-130b2c75-c0f6-49d1-9c69-aa97a6e1950f tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:19.510953 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-130b2c75-c0f6-49d1-9c69-aa97a6e1950f tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1522 microversion: 2.1 time: 0.146122 Apr 16 21:55:19.511528 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3374/6906] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:19 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:20.528819 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ee72d561-a2c3-430f-bf26-6d2724a4acd8 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:20.529644 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ee72d561-a2c3-430f-bf26-6d2724a4acd8 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:20.536662 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee72d561-a2c3-430f-bf26-6d2724a4acd8 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:20.537136 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee72d561-a2c3-430f-bf26-6d2724a4acd8 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:20.537948 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee72d561-a2c3-430f-bf26-6d2724a4acd8 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:20.538403 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee72d561-a2c3-430f-bf26-6d2724a4acd8 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:20.689851 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ee72d561-a2c3-430f-bf26-6d2724a4acd8 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:20.689851 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ee72d561-a2c3-430f-bf26-6d2724a4acd8 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1522 microversion: 2.1 time: 0.161066 Apr 16 21:55:20.689851 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3533/6907] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:20 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:21.703339 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1868a4e3-d1ad-4a68-a082-414d0445463e tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:21.703954 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1868a4e3-d1ad-4a68-a082-414d0445463e tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:21.710699 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1868a4e3-d1ad-4a68-a082-414d0445463e tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:21.711153 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1868a4e3-d1ad-4a68-a082-414d0445463e tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:21.711925 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1868a4e3-d1ad-4a68-a082-414d0445463e tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:21.712393 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1868a4e3-d1ad-4a68-a082-414d0445463e tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:21.840948 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1868a4e3-d1ad-4a68-a082-414d0445463e tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:21.848422 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1868a4e3-d1ad-4a68-a082-414d0445463e tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1522 microversion: 2.1 time: 0.149537 Apr 16 21:55:21.852374 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3375/6908] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:21 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:22.865886 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-96e4fdd6-3f40-4706-b04e-facf2e7d14ee tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:22.866523 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-96e4fdd6-3f40-4706-b04e-facf2e7d14ee tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:22.873404 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-96e4fdd6-3f40-4706-b04e-facf2e7d14ee tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:22.873886 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-96e4fdd6-3f40-4706-b04e-facf2e7d14ee tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:22.874678 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-96e4fdd6-3f40-4706-b04e-facf2e7d14ee tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:22.875137 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-96e4fdd6-3f40-4706-b04e-facf2e7d14ee tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:23.008799 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-96e4fdd6-3f40-4706-b04e-facf2e7d14ee tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:23.017015 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-96e4fdd6-3f40-4706-b04e-facf2e7d14ee tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1522 microversion: 2.1 time: 0.155038 Apr 16 21:55:23.021893 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3534/6909] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:22 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:24.033828 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4f2dc896-c4a5-4a76-ba19-383bb87cde1c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:24.034379 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4f2dc896-c4a5-4a76-ba19-383bb87cde1c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:24.041167 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4f2dc896-c4a5-4a76-ba19-383bb87cde1c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:24.041625 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4f2dc896-c4a5-4a76-ba19-383bb87cde1c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:24.042397 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4f2dc896-c4a5-4a76-ba19-383bb87cde1c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:24.042837 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4f2dc896-c4a5-4a76-ba19-383bb87cde1c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:24.177623 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4f2dc896-c4a5-4a76-ba19-383bb87cde1c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:24.185255 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4f2dc896-c4a5-4a76-ba19-383bb87cde1c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1522 microversion: 2.1 time: 0.155424 Apr 16 21:55:24.185829 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3376/6910] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:24 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:25.203114 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5540c259-4a99-42c4-9f82-61b7d11b1e0c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:25.203744 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5540c259-4a99-42c4-9f82-61b7d11b1e0c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:25.210480 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5540c259-4a99-42c4-9f82-61b7d11b1e0c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:25.210948 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5540c259-4a99-42c4-9f82-61b7d11b1e0c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:25.211736 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5540c259-4a99-42c4-9f82-61b7d11b1e0c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:25.212208 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5540c259-4a99-42c4-9f82-61b7d11b1e0c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:25.337238 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5540c259-4a99-42c4-9f82-61b7d11b1e0c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:25.344696 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5540c259-4a99-42c4-9f82-61b7d11b1e0c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1522 microversion: 2.1 time: 0.146195 Apr 16 21:55:25.345281 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3535/6911] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:25 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:26.361900 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6da54a6e-9d62-4c92-80ba-5e147ac9f5d4 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:26.362540 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6da54a6e-9d62-4c92-80ba-5e147ac9f5d4 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:26.369395 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6da54a6e-9d62-4c92-80ba-5e147ac9f5d4 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:26.369857 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6da54a6e-9d62-4c92-80ba-5e147ac9f5d4 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:26.370631 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6da54a6e-9d62-4c92-80ba-5e147ac9f5d4 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:26.371079 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6da54a6e-9d62-4c92-80ba-5e147ac9f5d4 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:26.497283 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6da54a6e-9d62-4c92-80ba-5e147ac9f5d4 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:26.505160 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6da54a6e-9d62-4c92-80ba-5e147ac9f5d4 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1522 microversion: 2.1 time: 0.147238 Apr 16 21:55:26.505726 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3377/6912] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:26 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:27.521777 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4f940378-58c4-41a0-af7c-568cac31971c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:27.522410 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4f940378-58c4-41a0-af7c-568cac31971c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:27.528726 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4f940378-58c4-41a0-af7c-568cac31971c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:27.529206 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4f940378-58c4-41a0-af7c-568cac31971c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:27.529999 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4f940378-58c4-41a0-af7c-568cac31971c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:27.531081 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4f940378-58c4-41a0-af7c-568cac31971c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:27.656842 ncdv-master-1 devstack@n-api.service[137408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 21:55:27.657068 ncdv-master-1 devstack@n-api.service[137408]: Sat Apr 16 21:55:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 (ip 10.222.0.20) !!! Apr 16 21:55:27.674776 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4f940378-58c4-41a0-af7c-568cac31971c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:27.684257 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4f940378-58c4-41a0-af7c-568cac31971c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1522 microversion: 2.1 time: 0.164926 Apr 16 21:55:27.692349 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3536/6913] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:27 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:28.699757 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b421a053-1bb9-4c38-9469-d560d39d3e0f tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:28.700400 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b421a053-1bb9-4c38-9469-d560d39d3e0f tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:28.707230 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b421a053-1bb9-4c38-9469-d560d39d3e0f tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:28.707684 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b421a053-1bb9-4c38-9469-d560d39d3e0f tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:28.708480 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b421a053-1bb9-4c38-9469-d560d39d3e0f tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:28.708920 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b421a053-1bb9-4c38-9469-d560d39d3e0f tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:28.837144 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b421a053-1bb9-4c38-9469-d560d39d3e0f tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:28.845029 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b421a053-1bb9-4c38-9469-d560d39d3e0f tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1522 microversion: 2.1 time: 0.149179 Apr 16 21:55:28.845605 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3378/6914] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:28 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:29.862378 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bcafb66c-7bf5-4512-b6a5-3dcb851ea978 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:29.863011 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-bcafb66c-7bf5-4512-b6a5-3dcb851ea978 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:29.869883 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bcafb66c-7bf5-4512-b6a5-3dcb851ea978 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:29.870353 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bcafb66c-7bf5-4512-b6a5-3dcb851ea978 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:29.871148 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bcafb66c-7bf5-4512-b6a5-3dcb851ea978 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:29.871754 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bcafb66c-7bf5-4512-b6a5-3dcb851ea978 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:30.001049 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-bcafb66c-7bf5-4512-b6a5-3dcb851ea978 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:30.008369 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-bcafb66c-7bf5-4512-b6a5-3dcb851ea978 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1522 microversion: 2.1 time: 0.150056 Apr 16 21:55:30.008960 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3537/6915] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:29 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:31.025916 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-51c6f963-64de-4e42-8743-5a820a6935f8 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:31.026481 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-51c6f963-64de-4e42-8743-5a820a6935f8 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:31.033690 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-51c6f963-64de-4e42-8743-5a820a6935f8 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:31.034148 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-51c6f963-64de-4e42-8743-5a820a6935f8 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:31.034925 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-51c6f963-64de-4e42-8743-5a820a6935f8 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:31.035373 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-51c6f963-64de-4e42-8743-5a820a6935f8 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:31.162608 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-51c6f963-64de-4e42-8743-5a820a6935f8 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:31.169924 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-51c6f963-64de-4e42-8743-5a820a6935f8 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1522 microversion: 2.1 time: 0.148017 Apr 16 21:55:31.170491 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3379/6916] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:31 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:31.230136 ncdv-master-1 devstack@n-api.service[137409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 21:55:31.230331 ncdv-master-1 devstack@n-api.service[137409]: Sat Apr 16 21:55:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 21:55:32.187888 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-320282ba-16e2-4d42-8b3a-d67ac4ce7a0a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:32.188502 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-320282ba-16e2-4d42-8b3a-d67ac4ce7a0a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:32.195218 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-320282ba-16e2-4d42-8b3a-d67ac4ce7a0a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:32.195692 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-320282ba-16e2-4d42-8b3a-d67ac4ce7a0a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:32.196552 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-320282ba-16e2-4d42-8b3a-d67ac4ce7a0a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:32.197012 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-320282ba-16e2-4d42-8b3a-d67ac4ce7a0a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:32.334438 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-320282ba-16e2-4d42-8b3a-d67ac4ce7a0a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:32.342238 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-320282ba-16e2-4d42-8b3a-d67ac4ce7a0a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1521 microversion: 2.1 time: 0.158973 Apr 16 21:55:32.355075 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3538/6917] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:32 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:32.567669 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-12fe5014-8878-494a-b76a-d016952aabd5 req-061ea952-4631-4cb3-955a-f276fac068ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7632198d-4754-4aa4-8363-696023b07de2", "name": "network-vif-unplugged", "status": "completed", "tag": "c654414f-5802-4de3-b225-eb0ee0017736"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:55:32.576642 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-12fe5014-8878-494a-b76a-d016952aabd5 req-061ea952-4631-4cb3-955a-f276fac068ea service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:32.577105 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-12fe5014-8878-494a-b76a-d016952aabd5 req-061ea952-4631-4cb3-955a-f276fac068ea service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:32.588505 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-12fe5014-8878-494a-b76a-d016952aabd5 req-061ea952-4631-4cb3-955a-f276fac068ea service nova] Creating event network-vif-unplugged:c654414f-5802-4de3-b225-eb0ee0017736 for instance 7632198d-4754-4aa4-8363-696023b07de2 on nch1-master-1 Apr 16 21:55:32.594225 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [req-12fe5014-8878-494a-b76a-d016952aabd5 req-061ea952-4631-4cb3-955a-f276fac068ea service nova] Instance 7632198d-4754-4aa4-8363-696023b07de2 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137409) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 16 21:55:32.605253 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-12fe5014-8878-494a-b76a-d016952aabd5 req-061ea952-4631-4cb3-955a-f276fac068ea service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041233 Apr 16 21:55:32.605848 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3380/6918] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:55:33.360442 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-629bf24b-b0f0-427a-a38a-26490b259de5 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:33.361081 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-629bf24b-b0f0-427a-a38a-26490b259de5 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:33.368152 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-629bf24b-b0f0-427a-a38a-26490b259de5 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:33.368651 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-629bf24b-b0f0-427a-a38a-26490b259de5 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:33.369457 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-629bf24b-b0f0-427a-a38a-26490b259de5 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:33.369921 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-629bf24b-b0f0-427a-a38a-26490b259de5 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:33.500050 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-629bf24b-b0f0-427a-a38a-26490b259de5 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:33.507643 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-629bf24b-b0f0-427a-a38a-26490b259de5 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1521 microversion: 2.1 time: 0.151240 Apr 16 21:55:33.508241 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3539/6919] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:33 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:34.526080 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-24b1de44-866a-49a1-bbe6-9b28ff023362 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:34.526787 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-24b1de44-866a-49a1-bbe6-9b28ff023362 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:34.533714 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-24b1de44-866a-49a1-bbe6-9b28ff023362 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:34.534203 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-24b1de44-866a-49a1-bbe6-9b28ff023362 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:34.534986 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-24b1de44-866a-49a1-bbe6-9b28ff023362 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:34.535437 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-24b1de44-866a-49a1-bbe6-9b28ff023362 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:34.626435 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-58c438fe-6363-4fa1-a884-92ebe6ed64ec req-ad5f7003-672b-439d-8396-d9bf8dcb9ccb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7632198d-4754-4aa4-8363-696023b07de2", "tag": "c654414f-5802-4de3-b225-eb0ee0017736"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:55:34.635214 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-58c438fe-6363-4fa1-a884-92ebe6ed64ec req-ad5f7003-672b-439d-8396-d9bf8dcb9ccb service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:34.635673 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-58c438fe-6363-4fa1-a884-92ebe6ed64ec req-ad5f7003-672b-439d-8396-d9bf8dcb9ccb service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:34.647701 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-58c438fe-6363-4fa1-a884-92ebe6ed64ec req-ad5f7003-672b-439d-8396-d9bf8dcb9ccb service nova] Creating event network-changed:c654414f-5802-4de3-b225-eb0ee0017736 for instance 7632198d-4754-4aa4-8363-696023b07de2 on nch1-master-1 Apr 16 21:55:34.653049 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [req-58c438fe-6363-4fa1-a884-92ebe6ed64ec req-ad5f7003-672b-439d-8396-d9bf8dcb9ccb service nova] Instance 7632198d-4754-4aa4-8363-696023b07de2 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 16 21:55:34.663733 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-58c438fe-6363-4fa1-a884-92ebe6ed64ec req-ad5f7003-672b-439d-8396-d9bf8dcb9ccb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041512 Apr 16 21:55:34.664385 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3540/6920] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:55:34.666466 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-24b1de44-866a-49a1-bbe6-9b28ff023362 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:34.674269 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-24b1de44-866a-49a1-bbe6-9b28ff023362 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1519 microversion: 2.1 time: 0.153210 Apr 16 21:55:34.675086 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3381/6921] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:34 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:35.693154 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-44562c26-a502-49d3-943a-da7a3e6c006a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:35.693874 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-44562c26-a502-49d3-943a-da7a3e6c006a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:35.700098 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-44562c26-a502-49d3-943a-da7a3e6c006a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:35.700598 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-44562c26-a502-49d3-943a-da7a3e6c006a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:35.701390 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-44562c26-a502-49d3-943a-da7a3e6c006a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:35.702461 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-44562c26-a502-49d3-943a-da7a3e6c006a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:35.832026 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-44562c26-a502-49d3-943a-da7a3e6c006a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:35.839607 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-44562c26-a502-49d3-943a-da7a3e6c006a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1516 microversion: 2.1 time: 0.151698 Apr 16 21:55:35.840202 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3541/6922] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:35 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:35.867192 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-917c8eb7-18b2-4909-8eb7-71d79e09f93e tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:55:35.867791 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-917c8eb7-18b2-4909-8eb7-71d79e09f93e tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:35.874449 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-917c8eb7-18b2-4909-8eb7-71d79e09f93e tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:35.874900 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-917c8eb7-18b2-4909-8eb7-71d79e09f93e tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:35.875675 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-917c8eb7-18b2-4909-8eb7-71d79e09f93e tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:35.876114 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-917c8eb7-18b2-4909-8eb7-71d79e09f93e tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:36.055628 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-917c8eb7-18b2-4909-8eb7-71d79e09f93e tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "POST /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2/action" status: 204 len: 0 microversion: 2.1 time: 0.193543 Apr 16 21:55:36.056357 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3382/6923] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:55:35 2022] POST /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2/action => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:55:36.064840 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d970fcaa-94b4-4d20-8e7b-e152d6f83f4a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:36.065476 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d970fcaa-94b4-4d20-8e7b-e152d6f83f4a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:36.071462 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d970fcaa-94b4-4d20-8e7b-e152d6f83f4a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:36.071939 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d970fcaa-94b4-4d20-8e7b-e152d6f83f4a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:36.072833 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d970fcaa-94b4-4d20-8e7b-e152d6f83f4a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:36.073293 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d970fcaa-94b4-4d20-8e7b-e152d6f83f4a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:36.304938 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d970fcaa-94b4-4d20-8e7b-e152d6f83f4a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:36.312873 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d970fcaa-94b4-4d20-8e7b-e152d6f83f4a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1516 microversion: 2.1 time: 0.252516 Apr 16 21:55:36.313382 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3542/6924] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:36 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1516 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:37.332333 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-96e5851a-dd4d-43ba-aa87-e9f18983a4fc tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:37.333035 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-96e5851a-dd4d-43ba-aa87-e9f18983a4fc tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:37.339067 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-96e5851a-dd4d-43ba-aa87-e9f18983a4fc tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:37.339517 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-96e5851a-dd4d-43ba-aa87-e9f18983a4fc tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:37.340315 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-96e5851a-dd4d-43ba-aa87-e9f18983a4fc tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:37.340760 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-96e5851a-dd4d-43ba-aa87-e9f18983a4fc tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:37.477593 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-96e5851a-dd4d-43ba-aa87-e9f18983a4fc tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:37.485283 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-96e5851a-dd4d-43ba-aa87-e9f18983a4fc tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1516 microversion: 2.1 time: 0.158624 Apr 16 21:55:37.485865 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3383/6925] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:37 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:38.502878 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e177f2e7-831d-46dd-a508-15f05f173ffb tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:38.503505 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e177f2e7-831d-46dd-a508-15f05f173ffb tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:38.510309 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e177f2e7-831d-46dd-a508-15f05f173ffb tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:38.510781 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e177f2e7-831d-46dd-a508-15f05f173ffb tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:38.511562 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e177f2e7-831d-46dd-a508-15f05f173ffb tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:38.512018 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e177f2e7-831d-46dd-a508-15f05f173ffb tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:38.638775 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e177f2e7-831d-46dd-a508-15f05f173ffb tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:38.646272 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e177f2e7-831d-46dd-a508-15f05f173ffb tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1508 microversion: 2.1 time: 0.147319 Apr 16 21:55:38.646848 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3543/6926] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:38 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:38.662643 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5daa036e-3f8a-4653-9dee-fd4e118b1144 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:38.663260 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5daa036e-3f8a-4653-9dee-fd4e118b1144 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:38.670098 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5daa036e-3f8a-4653-9dee-fd4e118b1144 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:38.670560 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5daa036e-3f8a-4653-9dee-fd4e118b1144 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:38.671887 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5daa036e-3f8a-4653-9dee-fd4e118b1144 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:38.672367 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5daa036e-3f8a-4653-9dee-fd4e118b1144 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:38.798532 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5daa036e-3f8a-4653-9dee-fd4e118b1144 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:38.805817 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5daa036e-3f8a-4653-9dee-fd4e118b1144 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1508 microversion: 2.1 time: 0.146990 Apr 16 21:55:38.806387 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3384/6927] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:38 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1508 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:38.821540 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-24e97c11-1b6f-4b10-8656-cff82a169960 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:38.822174 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-24e97c11-1b6f-4b10-8656-cff82a169960 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:38.828638 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-24e97c11-1b6f-4b10-8656-cff82a169960 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:38.829115 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-24e97c11-1b6f-4b10-8656-cff82a169960 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:38.829909 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-24e97c11-1b6f-4b10-8656-cff82a169960 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:38.830368 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-24e97c11-1b6f-4b10-8656-cff82a169960 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:38.961022 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-24e97c11-1b6f-4b10-8656-cff82a169960 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:38.969205 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-24e97c11-1b6f-4b10-8656-cff82a169960 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 200 len: 1508 microversion: 2.1 time: 0.151550 Apr 16 21:55:38.970236 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3544/6928] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:38 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:38.985626 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8628a3c8-5f9c-4aea-8fc0-348ff440d088 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:38.986121 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8628a3c8-5f9c-4aea-8fc0-348ff440d088 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:38.992003 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8628a3c8-5f9c-4aea-8fc0-348ff440d088 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:38.992495 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8628a3c8-5f9c-4aea-8fc0-348ff440d088 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:38.993265 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8628a3c8-5f9c-4aea-8fc0-348ff440d088 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:38.993704 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8628a3c8-5f9c-4aea-8fc0-348ff440d088 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:39.017219 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8628a3c8-5f9c-4aea-8fc0-348ff440d088 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:55:39.205049 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8628a3c8-5f9c-4aea-8fc0-348ff440d088 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 204 len: 0 microversion: 2.1 time: 0.223152 Apr 16 21:55:39.205653 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3385/6929] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:55:38 2022] DELETE /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:55:39.260892 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1b87ead0-3f99-4317-a387-630e4016a954 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-417350427", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "fc8553b4-22f7-4eb6-a00d-5dd26aacc5a4"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:55:39.310581 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-1b87ead0-3f99-4317-a387-630e4016a954 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] validate_networks() for [('fc8553b4-22f7-4eb6-a00d-5dd26aacc5a4', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:55:39.574796 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-bb418e2f-8ef8-4d3e-9bd3-9e8c19aa3e30 req-83c50042-2ffa-4aa2-8c6a-d264ad99f204 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7632198d-4754-4aa4-8363-696023b07de2", "name": "network-vif-plugged", "status": "completed", "tag": "c654414f-5802-4de3-b225-eb0ee0017736"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:55:39.583372 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-bb418e2f-8ef8-4d3e-9bd3-9e8c19aa3e30 req-83c50042-2ffa-4aa2-8c6a-d264ad99f204 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:39.583931 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-bb418e2f-8ef8-4d3e-9bd3-9e8c19aa3e30 req-83c50042-2ffa-4aa2-8c6a-d264ad99f204 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:39.595043 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-bb418e2f-8ef8-4d3e-9bd3-9e8c19aa3e30 req-83c50042-2ffa-4aa2-8c6a-d264ad99f204 service nova] Creating event network-vif-plugged:c654414f-5802-4de3-b225-eb0ee0017736 for instance 7632198d-4754-4aa4-8363-696023b07de2 on nch1-master-1 Apr 16 21:55:39.600201 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-bb418e2f-8ef8-4d3e-9bd3-9e8c19aa3e30 req-83c50042-2ffa-4aa2-8c6a-d264ad99f204 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029587 Apr 16 21:55:39.604332 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3386/6930] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:55:39.676972 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-1b87ead0-3f99-4317-a387-630e4016a954 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:55:39.677559 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-1b87ead0-3f99-4317-a387-630e4016a954 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:55:39.677892 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-1b87ead0-3f99-4317-a387-630e4016a954 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:55:39.678320 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-1b87ead0-3f99-4317-a387-630e4016a954 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:55:39.678753 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-1b87ead0-3f99-4317-a387-630e4016a954 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:55:39.688696 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1b87ead0-3f99-4317-a387-630e4016a954 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:39.689028 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1b87ead0-3f99-4317-a387-630e4016a954 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:39.689853 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1b87ead0-3f99-4317-a387-630e4016a954 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:39.690305 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1b87ead0-3f99-4317-a387-630e4016a954 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:39.706985 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-1b87ead0-3f99-4317-a387-630e4016a954 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Getting quotas for project c5dd165bd07e4d8daffbfa8a93aad4e8. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:55:39.712395 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-1b87ead0-3f99-4317-a387-630e4016a954 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Getting quotas for user 4be1280a437044ed84be6af90f62e642 and project c5dd165bd07e4d8daffbfa8a93aad4e8. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:55:39.725037 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1b87ead0-3f99-4317-a387-630e4016a954 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:55:39.727982 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1b87ead0-3f99-4317-a387-630e4016a954 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:55:39.847616 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1b87ead0-3f99-4317-a387-630e4016a954 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.590529 Apr 16 21:55:39.851236 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3545/6931] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:55:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:55:39.860766 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-398a298d-716e-4db4-8987-867fb26d84b7 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:39.861467 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-398a298d-716e-4db4-8987-867fb26d84b7 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:39.916781 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-398a298d-716e-4db4-8987-867fb26d84b7 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:39.924216 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-398a298d-716e-4db4-8987-867fb26d84b7 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1217 microversion: 2.1 time: 0.069227 Apr 16 21:55:39.924780 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3387/6932] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:39 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1217 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:40.943480 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-176b4825-7fbe-43c1-84e3-e45660c32ef5 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:40.944406 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-176b4825-7fbe-43c1-84e3-e45660c32ef5 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:40.950818 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-176b4825-7fbe-43c1-84e3-e45660c32ef5 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:40.951689 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-176b4825-7fbe-43c1-84e3-e45660c32ef5 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:40.953522 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-176b4825-7fbe-43c1-84e3-e45660c32ef5 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:40.954060 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-176b4825-7fbe-43c1-84e3-e45660c32ef5 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:40.984309 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-a6ae7565-b0ed-4063-86e3-73f56a34bfdf req-5c170b48-6b5f-4df4-a235-daf1b07761c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7632198d-4754-4aa4-8363-696023b07de2", "name": "network-vif-deleted", "tag": "c654414f-5802-4de3-b225-eb0ee0017736"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:55:40.994738 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-a6ae7565-b0ed-4063-86e3-73f56a34bfdf req-5c170b48-6b5f-4df4-a235-daf1b07761c6 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:40.995287 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-a6ae7565-b0ed-4063-86e3-73f56a34bfdf req-5c170b48-6b5f-4df4-a235-daf1b07761c6 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:41.008166 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-a6ae7565-b0ed-4063-86e3-73f56a34bfdf req-5c170b48-6b5f-4df4-a235-daf1b07761c6 service nova] Creating event network-vif-deleted:c654414f-5802-4de3-b225-eb0ee0017736 for instance 7632198d-4754-4aa4-8363-696023b07de2 on nch1-master-1 Apr 16 21:55:41.013422 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-a6ae7565-b0ed-4063-86e3-73f56a34bfdf req-5c170b48-6b5f-4df4-a235-daf1b07761c6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033203 Apr 16 21:55:41.014304 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3388/6933] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:55:41.037263 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-176b4825-7fbe-43c1-84e3-e45660c32ef5 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:41.043553 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-176b4825-7fbe-43c1-84e3-e45660c32ef5 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1213 microversion: 2.1 time: 0.105895 Apr 16 21:55:41.044129 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3546/6934] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:40 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1213 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:42.062938 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1ef159d1-6e58-4cee-8a47-d734e2e0f71d tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:42.063803 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1ef159d1-6e58-4cee-8a47-d734e2e0f71d tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:42.070136 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1ef159d1-6e58-4cee-8a47-d734e2e0f71d tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:42.070604 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1ef159d1-6e58-4cee-8a47-d734e2e0f71d tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:42.071398 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1ef159d1-6e58-4cee-8a47-d734e2e0f71d tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:42.071849 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1ef159d1-6e58-4cee-8a47-d734e2e0f71d tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:42.142645 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1ef159d1-6e58-4cee-8a47-d734e2e0f71d tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:42.149974 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1ef159d1-6e58-4cee-8a47-d734e2e0f71d tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1287 microversion: 2.1 time: 0.092932 Apr 16 21:55:42.150562 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3389/6935] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:42 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1287 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:43.166905 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0b65a2dd-4104-4949-9549-df54fdc49d05 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:43.167545 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0b65a2dd-4104-4949-9549-df54fdc49d05 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:43.175123 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0b65a2dd-4104-4949-9549-df54fdc49d05 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:43.175598 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0b65a2dd-4104-4949-9549-df54fdc49d05 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:43.176432 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0b65a2dd-4104-4949-9549-df54fdc49d05 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:43.176893 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0b65a2dd-4104-4949-9549-df54fdc49d05 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:43.304301 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0b65a2dd-4104-4949-9549-df54fdc49d05 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:43.312222 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0b65a2dd-4104-4949-9549-df54fdc49d05 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1317 microversion: 2.1 time: 0.149274 Apr 16 21:55:43.312803 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3547/6936] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:43 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:43.433089 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-071b400e-7feb-42ff-ab80-83e4195a4df7 req-9faac710-1d3a-4bc4-bb55-14684366a53d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bb0317e-028c-4886-82a1-4e0912ec3508", "tag": "9b307e71-2c8a-49fd-a64f-144993d40261"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:55:43.441889 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-071b400e-7feb-42ff-ab80-83e4195a4df7 req-9faac710-1d3a-4bc4-bb55-14684366a53d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:43.442343 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-071b400e-7feb-42ff-ab80-83e4195a4df7 req-9faac710-1d3a-4bc4-bb55-14684366a53d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:43.453855 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-071b400e-7feb-42ff-ab80-83e4195a4df7 req-9faac710-1d3a-4bc4-bb55-14684366a53d service nova] Creating event network-changed:9b307e71-2c8a-49fd-a64f-144993d40261 for instance 3bb0317e-028c-4886-82a1-4e0912ec3508 on nch1-master-1 Apr 16 21:55:43.458465 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-071b400e-7feb-42ff-ab80-83e4195a4df7 req-9faac710-1d3a-4bc4-bb55-14684366a53d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029258 Apr 16 21:55:43.459047 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3390/6937] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:55:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:55:44.329560 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bee08d73-1fb0-464b-ae59-03fe5321297c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:44.330208 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-bee08d73-1fb0-464b-ae59-03fe5321297c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:44.337552 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bee08d73-1fb0-464b-ae59-03fe5321297c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:44.338105 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bee08d73-1fb0-464b-ae59-03fe5321297c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:44.338920 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bee08d73-1fb0-464b-ae59-03fe5321297c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:44.339425 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bee08d73-1fb0-464b-ae59-03fe5321297c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:44.472939 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-bee08d73-1fb0-464b-ae59-03fe5321297c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:44.480655 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-bee08d73-1fb0-464b-ae59-03fe5321297c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1317 microversion: 2.1 time: 0.154963 Apr 16 21:55:44.481173 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3548/6938] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:44 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:45.499581 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-66a51e5d-dc38-4dc9-9ade-6632afdd41f2 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:45.500311 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-66a51e5d-dc38-4dc9-9ade-6632afdd41f2 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:45.508865 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-66a51e5d-dc38-4dc9-9ade-6632afdd41f2 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:45.518775 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-66a51e5d-dc38-4dc9-9ade-6632afdd41f2 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:45.518775 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-66a51e5d-dc38-4dc9-9ade-6632afdd41f2 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:45.518775 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-66a51e5d-dc38-4dc9-9ade-6632afdd41f2 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:45.641281 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-66a51e5d-dc38-4dc9-9ade-6632afdd41f2 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:45.648624 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-66a51e5d-dc38-4dc9-9ade-6632afdd41f2 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1317 microversion: 2.1 time: 0.154727 Apr 16 21:55:45.649208 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3391/6939] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:45 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:46.668250 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b2a12746-4424-47ba-8e58-67865c74ff9c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:46.668897 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b2a12746-4424-47ba-8e58-67865c74ff9c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:46.676447 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b2a12746-4424-47ba-8e58-67865c74ff9c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:46.676920 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b2a12746-4424-47ba-8e58-67865c74ff9c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:46.677727 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b2a12746-4424-47ba-8e58-67865c74ff9c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:46.678183 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b2a12746-4424-47ba-8e58-67865c74ff9c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:46.805378 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b2a12746-4424-47ba-8e58-67865c74ff9c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:46.813117 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b2a12746-4424-47ba-8e58-67865c74ff9c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1317 microversion: 2.1 time: 0.151729 Apr 16 21:55:46.813679 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3549/6940] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:46 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:47.829867 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-58c6bfed-2b82-4bce-b0cb-c24a3d3a3673 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:47.830520 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-58c6bfed-2b82-4bce-b0cb-c24a3d3a3673 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:47.837253 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-58c6bfed-2b82-4bce-b0cb-c24a3d3a3673 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:47.837714 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-58c6bfed-2b82-4bce-b0cb-c24a3d3a3673 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:47.838489 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-58c6bfed-2b82-4bce-b0cb-c24a3d3a3673 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:47.838934 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-58c6bfed-2b82-4bce-b0cb-c24a3d3a3673 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:47.965492 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-58c6bfed-2b82-4bce-b0cb-c24a3d3a3673 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:47.973362 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-58c6bfed-2b82-4bce-b0cb-c24a3d3a3673 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1317 microversion: 2.1 time: 0.147873 Apr 16 21:55:47.973921 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3392/6941] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:47 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:48.990646 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-353d1096-a304-45bb-98cc-bde61f4c4732 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:48.991204 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-353d1096-a304-45bb-98cc-bde61f4c4732 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:48.998038 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-353d1096-a304-45bb-98cc-bde61f4c4732 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:48.998518 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-353d1096-a304-45bb-98cc-bde61f4c4732 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:48.999356 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-353d1096-a304-45bb-98cc-bde61f4c4732 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:48.999823 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-353d1096-a304-45bb-98cc-bde61f4c4732 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:49.129131 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-353d1096-a304-45bb-98cc-bde61f4c4732 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:49.136503 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-353d1096-a304-45bb-98cc-bde61f4c4732 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1317 microversion: 2.1 time: 0.149871 Apr 16 21:55:49.137082 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3550/6942] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:48 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:49.576011 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-ded26d5c-c95e-4ab8-9ff1-b5ca8b581fa0 req-285238e5-2fa2-4af3-b73f-9385d0faf7b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bb0317e-028c-4886-82a1-4e0912ec3508", "name": "network-vif-plugged", "status": "completed", "tag": "9b307e71-2c8a-49fd-a64f-144993d40261"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:55:49.585573 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-ded26d5c-c95e-4ab8-9ff1-b5ca8b581fa0 req-285238e5-2fa2-4af3-b73f-9385d0faf7b8 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:49.586031 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-ded26d5c-c95e-4ab8-9ff1-b5ca8b581fa0 req-285238e5-2fa2-4af3-b73f-9385d0faf7b8 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:49.596566 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-ded26d5c-c95e-4ab8-9ff1-b5ca8b581fa0 req-285238e5-2fa2-4af3-b73f-9385d0faf7b8 service nova] Creating event network-vif-plugged:9b307e71-2c8a-49fd-a64f-144993d40261 for instance 3bb0317e-028c-4886-82a1-4e0912ec3508 on nch1-master-1 Apr 16 21:55:49.603369 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-ded26d5c-c95e-4ab8-9ff1-b5ca8b581fa0 req-285238e5-2fa2-4af3-b73f-9385d0faf7b8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029546 Apr 16 21:55:49.603369 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3393/6943] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:55:50.153336 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cf65538b-23df-4567-9632-b275b58ecd34 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:50.153975 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cf65538b-23df-4567-9632-b275b58ecd34 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:50.160848 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cf65538b-23df-4567-9632-b275b58ecd34 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:50.161328 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cf65538b-23df-4567-9632-b275b58ecd34 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:50.162127 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cf65538b-23df-4567-9632-b275b58ecd34 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:50.162589 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cf65538b-23df-4567-9632-b275b58ecd34 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:50.293003 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cf65538b-23df-4567-9632-b275b58ecd34 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:50.300912 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cf65538b-23df-4567-9632-b275b58ecd34 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1317 microversion: 2.1 time: 0.151537 Apr 16 21:55:50.301503 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3551/6944] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:50 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:51.318910 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-196b937e-440f-44f2-a26c-267b44fa2370 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:51.319615 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-196b937e-440f-44f2-a26c-267b44fa2370 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:51.325849 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-196b937e-440f-44f2-a26c-267b44fa2370 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:51.326309 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-196b937e-440f-44f2-a26c-267b44fa2370 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:51.327091 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-196b937e-440f-44f2-a26c-267b44fa2370 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:51.327541 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-196b937e-440f-44f2-a26c-267b44fa2370 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:51.455863 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-196b937e-440f-44f2-a26c-267b44fa2370 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:51.463278 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-196b937e-440f-44f2-a26c-267b44fa2370 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1508 microversion: 2.1 time: 0.149538 Apr 16 21:55:51.463849 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3394/6945] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:51 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:51.480234 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ac7cbb8d-da5e-48d8-bbc6-e3892c39f61e tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:51.480870 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ac7cbb8d-da5e-48d8-bbc6-e3892c39f61e tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:51.487609 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ac7cbb8d-da5e-48d8-bbc6-e3892c39f61e tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:51.488085 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ac7cbb8d-da5e-48d8-bbc6-e3892c39f61e tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:51.488909 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ac7cbb8d-da5e-48d8-bbc6-e3892c39f61e tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:51.489371 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ac7cbb8d-da5e-48d8-bbc6-e3892c39f61e tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:51.615611 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ac7cbb8d-da5e-48d8-bbc6-e3892c39f61e tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:51.622997 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ac7cbb8d-da5e-48d8-bbc6-e3892c39f61e tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1508 microversion: 2.1 time: 0.146623 Apr 16 21:55:51.623565 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3552/6946] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:51 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1508 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:51.638725 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bd110e16-5c27-4670-92aa-09623eafef85 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:55:51.640218 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bd110e16-5c27-4670-92aa-09623eafef85 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:51.645990 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bd110e16-5c27-4670-92aa-09623eafef85 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:51.646436 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bd110e16-5c27-4670-92aa-09623eafef85 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:51.647225 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bd110e16-5c27-4670-92aa-09623eafef85 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:51.647662 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bd110e16-5c27-4670-92aa-09623eafef85 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:51.674497 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-bd110e16-5c27-4670-92aa-09623eafef85 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:51.680397 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bd110e16-5c27-4670-92aa-09623eafef85 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Old instance type m1.heat2, new instance type m1.heat {{(pid=137409) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 16 21:55:51.686589 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-bd110e16-5c27-4670-92aa-09623eafef85 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:55:51.687023 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-bd110e16-5c27-4670-92aa-09623eafef85 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:55:51.687506 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-bd110e16-5c27-4670-92aa-09623eafef85 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:55:51.687925 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-bd110e16-5c27-4670-92aa-09623eafef85 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:55:51.688452 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-bd110e16-5c27-4670-92aa-09623eafef85 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:55:51.894741 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bd110e16-5c27-4670-92aa-09623eafef85 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "POST /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508/action" status: 202 len: 0 microversion: 2.1 time: 0.259642 Apr 16 21:55:51.895275 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3395/6947] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:55:51 2022] POST /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:55:51.903440 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e0d7fd6f-8b35-4a3e-b3b1-e082915660e0 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:51.904081 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e0d7fd6f-8b35-4a3e-b3b1-e082915660e0 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:51.910044 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e0d7fd6f-8b35-4a3e-b3b1-e082915660e0 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:51.910524 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e0d7fd6f-8b35-4a3e-b3b1-e082915660e0 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:51.911331 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e0d7fd6f-8b35-4a3e-b3b1-e082915660e0 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:51.911794 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e0d7fd6f-8b35-4a3e-b3b1-e082915660e0 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:52.043170 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e0d7fd6f-8b35-4a3e-b3b1-e082915660e0 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:52.050765 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e0d7fd6f-8b35-4a3e-b3b1-e082915660e0 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1515 microversion: 2.1 time: 0.151255 Apr 16 21:55:52.051366 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3553/6948] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:51 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:53.069120 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-621dff5f-9749-42f0-ba22-0e6e05d6a99a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:53.069708 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-621dff5f-9749-42f0-ba22-0e6e05d6a99a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:53.078959 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-621dff5f-9749-42f0-ba22-0e6e05d6a99a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:53.079411 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-621dff5f-9749-42f0-ba22-0e6e05d6a99a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:53.080193 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-621dff5f-9749-42f0-ba22-0e6e05d6a99a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:53.080648 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-621dff5f-9749-42f0-ba22-0e6e05d6a99a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:53.207232 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-621dff5f-9749-42f0-ba22-0e6e05d6a99a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:53.214924 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-621dff5f-9749-42f0-ba22-0e6e05d6a99a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1515 microversion: 2.1 time: 0.150595 Apr 16 21:55:53.215501 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3396/6949] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:53 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:54.234416 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-21797a85-e411-4875-9843-cb40d3d18175 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:54.235052 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-21797a85-e411-4875-9843-cb40d3d18175 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:54.241888 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-21797a85-e411-4875-9843-cb40d3d18175 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:54.242371 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-21797a85-e411-4875-9843-cb40d3d18175 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:54.243169 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-21797a85-e411-4875-9843-cb40d3d18175 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:54.243682 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-21797a85-e411-4875-9843-cb40d3d18175 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:54.377028 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-21797a85-e411-4875-9843-cb40d3d18175 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:54.384458 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-21797a85-e411-4875-9843-cb40d3d18175 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1515 microversion: 2.1 time: 0.154535 Apr 16 21:55:54.385035 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3554/6950] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:54 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:55.401608 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ec4675d1-9326-4444-af60-59f8bba92629 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:55.402220 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ec4675d1-9326-4444-af60-59f8bba92629 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:55.408988 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ec4675d1-9326-4444-af60-59f8bba92629 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:55.409449 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ec4675d1-9326-4444-af60-59f8bba92629 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:55.410285 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ec4675d1-9326-4444-af60-59f8bba92629 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:55.410764 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ec4675d1-9326-4444-af60-59f8bba92629 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:55.535508 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ec4675d1-9326-4444-af60-59f8bba92629 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:55.542786 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ec4675d1-9326-4444-af60-59f8bba92629 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1520 microversion: 2.1 time: 0.145199 Apr 16 21:55:55.543356 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3397/6951] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:55 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1520 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:56.559247 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fc169b0d-2ac0-4368-82be-41899a652110 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:56.559875 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fc169b0d-2ac0-4368-82be-41899a652110 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:56.566722 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fc169b0d-2ac0-4368-82be-41899a652110 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:56.567193 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fc169b0d-2ac0-4368-82be-41899a652110 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:56.567980 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fc169b0d-2ac0-4368-82be-41899a652110 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:56.568459 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fc169b0d-2ac0-4368-82be-41899a652110 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:56.694603 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fc169b0d-2ac0-4368-82be-41899a652110 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:56.704432 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fc169b0d-2ac0-4368-82be-41899a652110 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1520 microversion: 2.1 time: 0.149060 Apr 16 21:55:56.705023 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3555/6952] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:56 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:57.721771 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-39b35b32-1fe0-4496-93cc-a303c2e0caf2 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:57.722383 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-39b35b32-1fe0-4496-93cc-a303c2e0caf2 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:57.729388 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-39b35b32-1fe0-4496-93cc-a303c2e0caf2 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:57.729852 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-39b35b32-1fe0-4496-93cc-a303c2e0caf2 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:57.734965 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-39b35b32-1fe0-4496-93cc-a303c2e0caf2 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:57.734965 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-39b35b32-1fe0-4496-93cc-a303c2e0caf2 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:57.860405 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-39b35b32-1fe0-4496-93cc-a303c2e0caf2 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:57.867648 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-39b35b32-1fe0-4496-93cc-a303c2e0caf2 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1520 microversion: 2.1 time: 0.150409 Apr 16 21:55:57.868237 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3398/6953] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:57 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:55:58.885696 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-66348190-1a80-49a9-8235-2b2d3a9c867f tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:55:58.886328 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-66348190-1a80-49a9-8235-2b2d3a9c867f tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:55:58.892526 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-66348190-1a80-49a9-8235-2b2d3a9c867f tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:58.893008 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-66348190-1a80-49a9-8235-2b2d3a9c867f tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:58.893809 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-66348190-1a80-49a9-8235-2b2d3a9c867f tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:55:58.894274 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-66348190-1a80-49a9-8235-2b2d3a9c867f tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:55:59.023208 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-66348190-1a80-49a9-8235-2b2d3a9c867f tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:55:59.031548 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-66348190-1a80-49a9-8235-2b2d3a9c867f tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1520 microversion: 2.1 time: 0.150095 Apr 16 21:55:59.032122 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3556/6954] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:55:58 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:56:00.048673 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-33044b80-378d-4922-84ad-7df43f33b71e tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:00.049265 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-33044b80-378d-4922-84ad-7df43f33b71e tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:00.055836 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-33044b80-378d-4922-84ad-7df43f33b71e tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:00.056319 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-33044b80-378d-4922-84ad-7df43f33b71e tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:00.057089 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-33044b80-378d-4922-84ad-7df43f33b71e tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:00.057530 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-33044b80-378d-4922-84ad-7df43f33b71e tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:00.184187 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-33044b80-378d-4922-84ad-7df43f33b71e tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:56:00.191676 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-33044b80-378d-4922-84ad-7df43f33b71e tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1520 microversion: 2.1 time: 0.147498 Apr 16 21:56:00.192306 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3399/6955] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:56:00 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:56:01.208754 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d60fb072-4359-4704-b870-4a5d40457f07 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:01.209401 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d60fb072-4359-4704-b870-4a5d40457f07 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:01.216145 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d60fb072-4359-4704-b870-4a5d40457f07 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:01.216644 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d60fb072-4359-4704-b870-4a5d40457f07 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:01.217432 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d60fb072-4359-4704-b870-4a5d40457f07 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:01.217889 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d60fb072-4359-4704-b870-4a5d40457f07 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:01.344259 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d60fb072-4359-4704-b870-4a5d40457f07 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:56:01.351788 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d60fb072-4359-4704-b870-4a5d40457f07 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1520 microversion: 2.1 time: 0.147009 Apr 16 21:56:01.352392 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3557/6956] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:56:01 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:56:02.368588 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5d62c2c7-993d-45f8-8941-ae1989744eb4 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:02.369206 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5d62c2c7-993d-45f8-8941-ae1989744eb4 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:02.376810 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5d62c2c7-993d-45f8-8941-ae1989744eb4 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:02.377273 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5d62c2c7-993d-45f8-8941-ae1989744eb4 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:02.378050 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5d62c2c7-993d-45f8-8941-ae1989744eb4 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:02.378492 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5d62c2c7-993d-45f8-8941-ae1989744eb4 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:02.508671 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5d62c2c7-993d-45f8-8941-ae1989744eb4 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:56:02.516732 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5d62c2c7-993d-45f8-8941-ae1989744eb4 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1520 microversion: 2.1 time: 0.152082 Apr 16 21:56:02.517312 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3400/6957] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:56:02 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:56:03.534328 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ad7e977e-2a5a-4cc6-ba9d-9f0ad75a191c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:03.534965 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ad7e977e-2a5a-4cc6-ba9d-9f0ad75a191c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:03.541731 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ad7e977e-2a5a-4cc6-ba9d-9f0ad75a191c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:03.542202 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ad7e977e-2a5a-4cc6-ba9d-9f0ad75a191c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:03.542988 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ad7e977e-2a5a-4cc6-ba9d-9f0ad75a191c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:03.543443 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ad7e977e-2a5a-4cc6-ba9d-9f0ad75a191c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:03.671613 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ad7e977e-2a5a-4cc6-ba9d-9f0ad75a191c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:56:03.679150 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ad7e977e-2a5a-4cc6-ba9d-9f0ad75a191c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1520 microversion: 2.1 time: 0.149357 Apr 16 21:56:03.679730 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3558/6958] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:56:03 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:56:04.696282 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1c2c742c-66f7-4fcb-9e77-4b8895828c72 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:04.696900 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1c2c742c-66f7-4fcb-9e77-4b8895828c72 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:04.704267 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1c2c742c-66f7-4fcb-9e77-4b8895828c72 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:04.704728 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1c2c742c-66f7-4fcb-9e77-4b8895828c72 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:04.705506 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1c2c742c-66f7-4fcb-9e77-4b8895828c72 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:04.705981 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1c2c742c-66f7-4fcb-9e77-4b8895828c72 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:04.830687 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1c2c742c-66f7-4fcb-9e77-4b8895828c72 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:56:04.838000 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1c2c742c-66f7-4fcb-9e77-4b8895828c72 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1520 microversion: 2.1 time: 0.145656 Apr 16 21:56:04.838577 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3401/6959] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:56:04 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:56:05.855348 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0aaa74f7-6d6d-4220-8a67-7980fda7fa1c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:05.855979 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0aaa74f7-6d6d-4220-8a67-7980fda7fa1c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:05.863468 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0aaa74f7-6d6d-4220-8a67-7980fda7fa1c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:05.867235 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0aaa74f7-6d6d-4220-8a67-7980fda7fa1c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:05.867235 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0aaa74f7-6d6d-4220-8a67-7980fda7fa1c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:05.867235 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0aaa74f7-6d6d-4220-8a67-7980fda7fa1c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:05.998222 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0aaa74f7-6d6d-4220-8a67-7980fda7fa1c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:56:06.006267 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0aaa74f7-6d6d-4220-8a67-7980fda7fa1c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1520 microversion: 2.1 time: 0.154892 Apr 16 21:56:06.006840 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3559/6960] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:56:05 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:56:07.023223 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3f5af376-ef55-495c-8bcb-ac92605f28c5 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:07.023830 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3f5af376-ef55-495c-8bcb-ac92605f28c5 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:07.030543 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3f5af376-ef55-495c-8bcb-ac92605f28c5 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:07.030993 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3f5af376-ef55-495c-8bcb-ac92605f28c5 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:07.031759 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3f5af376-ef55-495c-8bcb-ac92605f28c5 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:07.032217 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3f5af376-ef55-495c-8bcb-ac92605f28c5 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:07.160108 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3f5af376-ef55-495c-8bcb-ac92605f28c5 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:56:07.167539 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3f5af376-ef55-495c-8bcb-ac92605f28c5 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1520 microversion: 2.1 time: 0.148188 Apr 16 21:56:07.168158 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3402/6961] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:56:07 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:56:08.186813 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2f022a6d-c952-4267-9bea-efdae5a5855a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:08.187475 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2f022a6d-c952-4267-9bea-efdae5a5855a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:08.194263 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2f022a6d-c952-4267-9bea-efdae5a5855a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:08.194732 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2f022a6d-c952-4267-9bea-efdae5a5855a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:08.195517 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2f022a6d-c952-4267-9bea-efdae5a5855a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:08.195965 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2f022a6d-c952-4267-9bea-efdae5a5855a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:08.322159 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2f022a6d-c952-4267-9bea-efdae5a5855a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:56:08.330231 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2f022a6d-c952-4267-9bea-efdae5a5855a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1520 microversion: 2.1 time: 0.147397 Apr 16 21:56:08.330801 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3560/6962] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:56:08 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:56:09.347372 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-602e0bfa-baf0-4216-9793-8c0ed5d4542c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:09.347992 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-602e0bfa-baf0-4216-9793-8c0ed5d4542c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:09.355197 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-602e0bfa-baf0-4216-9793-8c0ed5d4542c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:09.355659 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-602e0bfa-baf0-4216-9793-8c0ed5d4542c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:09.356525 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-602e0bfa-baf0-4216-9793-8c0ed5d4542c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:09.362899 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-602e0bfa-baf0-4216-9793-8c0ed5d4542c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:09.488099 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-602e0bfa-baf0-4216-9793-8c0ed5d4542c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:56:09.495492 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-602e0bfa-baf0-4216-9793-8c0ed5d4542c tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1520 microversion: 2.1 time: 0.152034 Apr 16 21:56:09.496715 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3403/6963] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:56:09 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:56:10.513197 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-90d538a6-98e6-4c99-8130-fea83e10f4c1 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:10.514311 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-90d538a6-98e6-4c99-8130-fea83e10f4c1 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:10.521086 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-90d538a6-98e6-4c99-8130-fea83e10f4c1 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:10.521558 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-90d538a6-98e6-4c99-8130-fea83e10f4c1 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:10.522346 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-90d538a6-98e6-4c99-8130-fea83e10f4c1 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:10.522804 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-90d538a6-98e6-4c99-8130-fea83e10f4c1 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:10.655280 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-90d538a6-98e6-4c99-8130-fea83e10f4c1 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:56:10.662667 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-90d538a6-98e6-4c99-8130-fea83e10f4c1 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1520 microversion: 2.1 time: 0.153372 Apr 16 21:56:10.663241 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3561/6964] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:56:10 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:56:11.678768 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b549bb0b-8ece-40b0-945c-4229c1156b08 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:11.679379 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b549bb0b-8ece-40b0-945c-4229c1156b08 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:11.686437 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b549bb0b-8ece-40b0-945c-4229c1156b08 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:11.686750 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b549bb0b-8ece-40b0-945c-4229c1156b08 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:11.687524 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b549bb0b-8ece-40b0-945c-4229c1156b08 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:11.687966 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b549bb0b-8ece-40b0-945c-4229c1156b08 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:11.813105 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b549bb0b-8ece-40b0-945c-4229c1156b08 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:56:11.820397 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b549bb0b-8ece-40b0-945c-4229c1156b08 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1520 microversion: 2.1 time: 0.145464 Apr 16 21:56:11.820964 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3404/6965] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:56:11 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:56:12.838790 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-31b4c97c-947b-405f-b6eb-6011ede42151 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:12.839435 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-31b4c97c-947b-405f-b6eb-6011ede42151 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:12.846807 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-31b4c97c-947b-405f-b6eb-6011ede42151 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:12.847275 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-31b4c97c-947b-405f-b6eb-6011ede42151 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:12.848063 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-31b4c97c-947b-405f-b6eb-6011ede42151 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:12.848542 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-31b4c97c-947b-405f-b6eb-6011ede42151 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:12.975392 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-31b4c97c-947b-405f-b6eb-6011ede42151 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:56:12.983361 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-31b4c97c-947b-405f-b6eb-6011ede42151 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1520 microversion: 2.1 time: 0.148143 Apr 16 21:56:12.983928 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3562/6966] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:56:12 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:56:14.000300 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-caeba206-6ab0-4b9b-8e32-5ba03df555a7 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:14.000824 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-caeba206-6ab0-4b9b-8e32-5ba03df555a7 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:14.007542 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-caeba206-6ab0-4b9b-8e32-5ba03df555a7 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:14.007994 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-caeba206-6ab0-4b9b-8e32-5ba03df555a7 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:14.008790 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-caeba206-6ab0-4b9b-8e32-5ba03df555a7 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:14.009231 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-caeba206-6ab0-4b9b-8e32-5ba03df555a7 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:14.140240 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-caeba206-6ab0-4b9b-8e32-5ba03df555a7 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:56:14.147536 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-caeba206-6ab0-4b9b-8e32-5ba03df555a7 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1520 microversion: 2.1 time: 0.151681 Apr 16 21:56:14.152407 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3405/6967] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:56:13 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:56:15.164315 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a974336b-c56e-4adb-96db-a234b0384b49 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:15.164950 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a974336b-c56e-4adb-96db-a234b0384b49 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:15.171921 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a974336b-c56e-4adb-96db-a234b0384b49 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:15.172423 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a974336b-c56e-4adb-96db-a234b0384b49 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:15.173222 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a974336b-c56e-4adb-96db-a234b0384b49 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:15.173682 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a974336b-c56e-4adb-96db-a234b0384b49 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:15.299972 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a974336b-c56e-4adb-96db-a234b0384b49 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:56:15.307519 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a974336b-c56e-4adb-96db-a234b0384b49 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1520 microversion: 2.1 time: 0.147318 Apr 16 21:56:15.308100 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3563/6968] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:56:15 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:56:16.325221 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b938304b-b3c2-44d3-954b-f432d5e4741a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:16.325837 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b938304b-b3c2-44d3-954b-f432d5e4741a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:16.333351 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b938304b-b3c2-44d3-954b-f432d5e4741a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:16.333812 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b938304b-b3c2-44d3-954b-f432d5e4741a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:16.334593 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b938304b-b3c2-44d3-954b-f432d5e4741a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:16.335169 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b938304b-b3c2-44d3-954b-f432d5e4741a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:16.463080 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b938304b-b3c2-44d3-954b-f432d5e4741a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:56:16.471062 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b938304b-b3c2-44d3-954b-f432d5e4741a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1520 microversion: 2.1 time: 0.149757 Apr 16 21:56:16.471628 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3406/6969] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:56:16 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:56:17.488928 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5e7884d2-422b-41a5-8ea7-ff8f563b1d10 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:17.489559 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5e7884d2-422b-41a5-8ea7-ff8f563b1d10 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:17.496488 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5e7884d2-422b-41a5-8ea7-ff8f563b1d10 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:17.496961 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5e7884d2-422b-41a5-8ea7-ff8f563b1d10 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:17.497777 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5e7884d2-422b-41a5-8ea7-ff8f563b1d10 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:17.498234 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5e7884d2-422b-41a5-8ea7-ff8f563b1d10 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:17.636432 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5e7884d2-422b-41a5-8ea7-ff8f563b1d10 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:56:17.643863 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5e7884d2-422b-41a5-8ea7-ff8f563b1d10 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1520 microversion: 2.1 time: 0.158976 Apr 16 21:56:17.644480 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3564/6970] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:56:17 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:56:18.660958 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-68893b22-859e-4ad3-8f3c-38a5c8f1b952 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:18.661631 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-68893b22-859e-4ad3-8f3c-38a5c8f1b952 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:18.668254 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-68893b22-859e-4ad3-8f3c-38a5c8f1b952 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:18.669785 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-68893b22-859e-4ad3-8f3c-38a5c8f1b952 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:18.669785 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-68893b22-859e-4ad3-8f3c-38a5c8f1b952 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:18.669999 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-68893b22-859e-4ad3-8f3c-38a5c8f1b952 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:18.798907 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-68893b22-859e-4ad3-8f3c-38a5c8f1b952 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:56:18.806181 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-68893b22-859e-4ad3-8f3c-38a5c8f1b952 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1520 microversion: 2.1 time: 0.149149 Apr 16 21:56:18.806749 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3407/6971] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:56:18 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:56:19.822854 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ef1abd1b-5435-471e-a96f-930b9cc2cf55 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:19.823486 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ef1abd1b-5435-471e-a96f-930b9cc2cf55 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:19.830968 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ef1abd1b-5435-471e-a96f-930b9cc2cf55 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:19.831445 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ef1abd1b-5435-471e-a96f-930b9cc2cf55 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:19.832266 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ef1abd1b-5435-471e-a96f-930b9cc2cf55 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:19.832734 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ef1abd1b-5435-471e-a96f-930b9cc2cf55 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:19.962876 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ef1abd1b-5435-471e-a96f-930b9cc2cf55 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:56:19.970358 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ef1abd1b-5435-471e-a96f-930b9cc2cf55 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1520 microversion: 2.1 time: 0.151427 Apr 16 21:56:19.970939 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3565/6972] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:56:19 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:56:20.987942 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c237cdb1-1727-4211-aa04-06f51d54a5bd tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:20.988514 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c237cdb1-1727-4211-aa04-06f51d54a5bd tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:20.995256 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c237cdb1-1727-4211-aa04-06f51d54a5bd tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:20.999272 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c237cdb1-1727-4211-aa04-06f51d54a5bd tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:20.999272 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c237cdb1-1727-4211-aa04-06f51d54a5bd tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:20.999272 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c237cdb1-1727-4211-aa04-06f51d54a5bd tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:21.129601 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c237cdb1-1727-4211-aa04-06f51d54a5bd tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:56:21.136860 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c237cdb1-1727-4211-aa04-06f51d54a5bd tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1520 microversion: 2.1 time: 0.153045 Apr 16 21:56:21.137438 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3408/6973] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:56:20 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:56:22.153443 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7bee1320-7e9d-4a39-9a18-eb1fc794548d tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:22.154695 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7bee1320-7e9d-4a39-9a18-eb1fc794548d tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:22.161506 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7bee1320-7e9d-4a39-9a18-eb1fc794548d tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:22.161976 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7bee1320-7e9d-4a39-9a18-eb1fc794548d tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:22.162776 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7bee1320-7e9d-4a39-9a18-eb1fc794548d tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:22.163230 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7bee1320-7e9d-4a39-9a18-eb1fc794548d tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:22.314066 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7bee1320-7e9d-4a39-9a18-eb1fc794548d tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:56:22.317115 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-ff63ef3a-cec8-41d3-9966-a3dd7f28bd45 req-bfe968ba-e3c0-40f8-9584-1cc76b3a6b3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bb0317e-028c-4886-82a1-4e0912ec3508", "name": "network-vif-unplugged", "status": "completed", "tag": "9b307e71-2c8a-49fd-a64f-144993d40261"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:56:22.321560 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7bee1320-7e9d-4a39-9a18-eb1fc794548d tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1519 microversion: 2.1 time: 0.172031 Apr 16 21:56:22.331423 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3566/6974] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:56:22 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:56:22.331784 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-ff63ef3a-cec8-41d3-9966-a3dd7f28bd45 req-bfe968ba-e3c0-40f8-9584-1cc76b3a6b3a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:22.331784 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-ff63ef3a-cec8-41d3-9966-a3dd7f28bd45 req-bfe968ba-e3c0-40f8-9584-1cc76b3a6b3a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:22.343050 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-ff63ef3a-cec8-41d3-9966-a3dd7f28bd45 req-bfe968ba-e3c0-40f8-9584-1cc76b3a6b3a service nova] Creating event network-vif-unplugged:9b307e71-2c8a-49fd-a64f-144993d40261 for instance 3bb0317e-028c-4886-82a1-4e0912ec3508 on nch2-master-1 Apr 16 21:56:22.346291 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [req-ff63ef3a-cec8-41d3-9966-a3dd7f28bd45 req-bfe968ba-e3c0-40f8-9584-1cc76b3a6b3a service nova] Instance 3bb0317e-028c-4886-82a1-4e0912ec3508 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137409) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 16 21:56:22.358436 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-ff63ef3a-cec8-41d3-9966-a3dd7f28bd45 req-bfe968ba-e3c0-40f8-9584-1cc76b3a6b3a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.123590 Apr 16 21:56:22.359091 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3409/6975] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:56:23.338561 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ff2231db-7d0b-47fb-9d85-a7c3f93696df tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:23.339227 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ff2231db-7d0b-47fb-9d85-a7c3f93696df tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:23.346041 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ff2231db-7d0b-47fb-9d85-a7c3f93696df tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:23.346513 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ff2231db-7d0b-47fb-9d85-a7c3f93696df tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:23.347317 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ff2231db-7d0b-47fb-9d85-a7c3f93696df tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:23.347780 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ff2231db-7d0b-47fb-9d85-a7c3f93696df tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:23.480197 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ff2231db-7d0b-47fb-9d85-a7c3f93696df tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:56:23.487681 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ff2231db-7d0b-47fb-9d85-a7c3f93696df tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1519 microversion: 2.1 time: 0.153209 Apr 16 21:56:23.488277 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3567/6976] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:56:23 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:56:24.378074 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-987b7ef3-655d-43c6-a103-18244a82497a req-d0f62312-edc7-4217-a89c-8aa37098251c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bb0317e-028c-4886-82a1-4e0912ec3508", "tag": "9b307e71-2c8a-49fd-a64f-144993d40261"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:56:24.388670 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-987b7ef3-655d-43c6-a103-18244a82497a req-d0f62312-edc7-4217-a89c-8aa37098251c service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:24.389150 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-987b7ef3-655d-43c6-a103-18244a82497a req-d0f62312-edc7-4217-a89c-8aa37098251c service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:24.400545 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-987b7ef3-655d-43c6-a103-18244a82497a req-d0f62312-edc7-4217-a89c-8aa37098251c service nova] Creating event network-changed:9b307e71-2c8a-49fd-a64f-144993d40261 for instance 3bb0317e-028c-4886-82a1-4e0912ec3508 on nch2-master-1 Apr 16 21:56:24.406329 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [req-987b7ef3-655d-43c6-a103-18244a82497a req-d0f62312-edc7-4217-a89c-8aa37098251c service nova] Instance 3bb0317e-028c-4886-82a1-4e0912ec3508 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137409) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 16 21:56:24.416967 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-987b7ef3-655d-43c6-a103-18244a82497a req-d0f62312-edc7-4217-a89c-8aa37098251c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044101 Apr 16 21:56:24.417566 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3410/6977] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:56:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:56:24.503713 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b105ba1b-e155-4ce2-bb98-2d056f90a040 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:24.504394 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b105ba1b-e155-4ce2-bb98-2d056f90a040 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:24.511145 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b105ba1b-e155-4ce2-bb98-2d056f90a040 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:24.511618 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b105ba1b-e155-4ce2-bb98-2d056f90a040 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:24.512451 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b105ba1b-e155-4ce2-bb98-2d056f90a040 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:24.512912 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b105ba1b-e155-4ce2-bb98-2d056f90a040 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:24.646858 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b105ba1b-e155-4ce2-bb98-2d056f90a040 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:56:24.654275 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b105ba1b-e155-4ce2-bb98-2d056f90a040 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1517 microversion: 2.1 time: 0.154592 Apr 16 21:56:24.655447 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3568/6978] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:56:24 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:56:25.678064 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-468f1617-b0f2-41a8-9f3d-c274c43fde92 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:25.678683 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-468f1617-b0f2-41a8-9f3d-c274c43fde92 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:25.685951 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-468f1617-b0f2-41a8-9f3d-c274c43fde92 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:25.686416 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-468f1617-b0f2-41a8-9f3d-c274c43fde92 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:25.687212 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-468f1617-b0f2-41a8-9f3d-c274c43fde92 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:25.687651 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-468f1617-b0f2-41a8-9f3d-c274c43fde92 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:25.817347 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-468f1617-b0f2-41a8-9f3d-c274c43fde92 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:56:25.824848 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-468f1617-b0f2-41a8-9f3d-c274c43fde92 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1517 microversion: 2.1 time: 0.155803 Apr 16 21:56:25.827746 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3411/6979] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:56:25 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:56:26.842620 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8c67f009-9ed8-40b0-865b-3b0d28487b5f tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:26.843304 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8c67f009-9ed8-40b0-865b-3b0d28487b5f tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:26.850157 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8c67f009-9ed8-40b0-865b-3b0d28487b5f tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:26.850638 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8c67f009-9ed8-40b0-865b-3b0d28487b5f tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:26.851465 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8c67f009-9ed8-40b0-865b-3b0d28487b5f tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:26.851931 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8c67f009-9ed8-40b0-865b-3b0d28487b5f tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:26.982483 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8c67f009-9ed8-40b0-865b-3b0d28487b5f tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:56:26.990475 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8c67f009-9ed8-40b0-865b-3b0d28487b5f tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1514 microversion: 2.1 time: 0.152138 Apr 16 21:56:26.991047 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3569/6980] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:56:26 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:56:27.010615 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3ffc7342-60cd-43c5-b482-bed2ff0e7083 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:56:27.011748 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3ffc7342-60cd-43c5-b482-bed2ff0e7083 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:27.018415 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3ffc7342-60cd-43c5-b482-bed2ff0e7083 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:27.018877 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3ffc7342-60cd-43c5-b482-bed2ff0e7083 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:27.019660 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3ffc7342-60cd-43c5-b482-bed2ff0e7083 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:27.020106 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3ffc7342-60cd-43c5-b482-bed2ff0e7083 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:27.169940 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3ffc7342-60cd-43c5-b482-bed2ff0e7083 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "POST /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508/action" status: 204 len: 0 microversion: 2.1 time: 0.163917 Apr 16 21:56:27.174647 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3412/6981] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:56:27 2022] POST /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508/action => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:56:27.179992 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a04dc249-d9f7-494f-a105-0b312aaaf972 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:27.180688 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a04dc249-d9f7-494f-a105-0b312aaaf972 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:27.186723 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a04dc249-d9f7-494f-a105-0b312aaaf972 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:27.187202 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a04dc249-d9f7-494f-a105-0b312aaaf972 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:27.188002 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a04dc249-d9f7-494f-a105-0b312aaaf972 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:27.188487 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a04dc249-d9f7-494f-a105-0b312aaaf972 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:27.319717 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a04dc249-d9f7-494f-a105-0b312aaaf972 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:56:27.327667 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a04dc249-d9f7-494f-a105-0b312aaaf972 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1514 microversion: 2.1 time: 0.151598 Apr 16 21:56:27.328526 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3570/6982] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:56:27 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:56:28.344812 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0522044f-24b4-4b22-b609-30a75c03c6f7 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:28.345525 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0522044f-24b4-4b22-b609-30a75c03c6f7 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:28.352732 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0522044f-24b4-4b22-b609-30a75c03c6f7 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:28.353201 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0522044f-24b4-4b22-b609-30a75c03c6f7 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:28.353980 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0522044f-24b4-4b22-b609-30a75c03c6f7 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:28.354432 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0522044f-24b4-4b22-b609-30a75c03c6f7 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:28.492351 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0522044f-24b4-4b22-b609-30a75c03c6f7 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:56:28.500439 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0522044f-24b4-4b22-b609-30a75c03c6f7 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1514 microversion: 2.1 time: 0.159905 Apr 16 21:56:28.505800 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3413/6983] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:56:28 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:56:29.395809 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-f4320da2-81ee-41ca-bcaa-a2e7701c75b6 req-9d0cf370-beb2-48c3-add4-57eff60333f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bb0317e-028c-4886-82a1-4e0912ec3508", "name": "network-vif-plugged", "status": "completed", "tag": "9b307e71-2c8a-49fd-a64f-144993d40261"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:56:29.404421 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-f4320da2-81ee-41ca-bcaa-a2e7701c75b6 req-9d0cf370-beb2-48c3-add4-57eff60333f9 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:29.404886 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-f4320da2-81ee-41ca-bcaa-a2e7701c75b6 req-9d0cf370-beb2-48c3-add4-57eff60333f9 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:29.416067 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-f4320da2-81ee-41ca-bcaa-a2e7701c75b6 req-9d0cf370-beb2-48c3-add4-57eff60333f9 service nova] Creating event network-vif-plugged:9b307e71-2c8a-49fd-a64f-144993d40261 for instance 3bb0317e-028c-4886-82a1-4e0912ec3508 on nch2-master-1 Apr 16 21:56:29.421392 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-f4320da2-81ee-41ca-bcaa-a2e7701c75b6 req-9d0cf370-beb2-48c3-add4-57eff60333f9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029831 Apr 16 21:56:29.422350 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3571/6984] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:56:29.517217 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b96d4401-72cd-45ed-bf02-695928d30a6a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:29.517858 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b96d4401-72cd-45ed-bf02-695928d30a6a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:29.524200 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b96d4401-72cd-45ed-bf02-695928d30a6a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:29.524660 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b96d4401-72cd-45ed-bf02-695928d30a6a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:29.525428 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b96d4401-72cd-45ed-bf02-695928d30a6a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:29.525870 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b96d4401-72cd-45ed-bf02-695928d30a6a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:29.654022 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b96d4401-72cd-45ed-bf02-695928d30a6a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:56:29.661432 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b96d4401-72cd-45ed-bf02-695928d30a6a tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1506 microversion: 2.1 time: 0.148699 Apr 16 21:56:29.662002 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3414/6985] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:56:29 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:56:29.678912 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0fff3a2f-5d65-44b3-9caf-8dd34ad66698 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:29.679668 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0fff3a2f-5d65-44b3-9caf-8dd34ad66698 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:29.687188 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0fff3a2f-5d65-44b3-9caf-8dd34ad66698 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:29.687308 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0fff3a2f-5d65-44b3-9caf-8dd34ad66698 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:29.688017 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0fff3a2f-5d65-44b3-9caf-8dd34ad66698 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:29.688505 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0fff3a2f-5d65-44b3-9caf-8dd34ad66698 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:29.821533 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0fff3a2f-5d65-44b3-9caf-8dd34ad66698 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:56:29.828982 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0fff3a2f-5d65-44b3-9caf-8dd34ad66698 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1506 microversion: 2.1 time: 0.154329 Apr 16 21:56:29.829564 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3572/6986] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:56:29 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:56:29.844432 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ec6d8304-cd09-41c7-b081-c594f1c914bf tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:29.845045 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ec6d8304-cd09-41c7-b081-c594f1c914bf tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:29.851137 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ec6d8304-cd09-41c7-b081-c594f1c914bf tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:29.851588 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ec6d8304-cd09-41c7-b081-c594f1c914bf tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:29.852386 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ec6d8304-cd09-41c7-b081-c594f1c914bf tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:29.852825 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ec6d8304-cd09-41c7-b081-c594f1c914bf tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:29.976976 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ec6d8304-cd09-41c7-b081-c594f1c914bf tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:56:29.984802 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ec6d8304-cd09-41c7-b081-c594f1c914bf tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1506 microversion: 2.1 time: 0.144273 Apr 16 21:56:29.985377 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3415/6987] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:56:29 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1506 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:56:30.001390 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-81f6069b-d9ce-4b30-97b2-1a7806522598 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:30.001920 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-81f6069b-d9ce-4b30-97b2-1a7806522598 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:30.008010 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-81f6069b-d9ce-4b30-97b2-1a7806522598 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:30.008526 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-81f6069b-d9ce-4b30-97b2-1a7806522598 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:30.009319 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-81f6069b-d9ce-4b30-97b2-1a7806522598 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:30.009779 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-81f6069b-d9ce-4b30-97b2-1a7806522598 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:30.034314 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-81f6069b-d9ce-4b30-97b2-1a7806522598 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:56:30.322506 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-81f6069b-d9ce-4b30-97b2-1a7806522598 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 204 len: 0 microversion: 2.1 time: 0.325432 Apr 16 21:56:30.323144 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3573/6988] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:56:29 2022] DELETE /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 16 21:56:30.340487 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-aa8384ec-f247-408f-8761-394402000770 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:30.341017 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-aa8384ec-f247-408f-8761-394402000770 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:30.347503 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aa8384ec-f247-408f-8761-394402000770 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:30.347953 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aa8384ec-f247-408f-8761-394402000770 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:30.349021 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aa8384ec-f247-408f-8761-394402000770 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:30.349457 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-aa8384ec-f247-408f-8761-394402000770 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:30.380195 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-aa8384ec-f247-408f-8761-394402000770 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:56:30.424543 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.compute.api [None req-aa8384ec-f247-408f-8761-394402000770 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Instance is already in deleting state, ignoring this request Apr 16 21:56:30.425375 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-aa8384ec-f247-408f-8761-394402000770 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 204 len: 0 microversion: 2.1 time: 0.089195 Apr 16 21:56:30.425952 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3416/6989] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:56:30 2022] DELETE /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:56:30.434530 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9c64bfcb-84a8-4c41-bcc0-5bbb76f8b025 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:30.435252 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9c64bfcb-84a8-4c41-bcc0-5bbb76f8b025 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:30.442098 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9c64bfcb-84a8-4c41-bcc0-5bbb76f8b025 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:30.442572 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9c64bfcb-84a8-4c41-bcc0-5bbb76f8b025 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:30.443368 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9c64bfcb-84a8-4c41-bcc0-5bbb76f8b025 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:30.443830 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9c64bfcb-84a8-4c41-bcc0-5bbb76f8b025 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:30.570734 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9c64bfcb-84a8-4c41-bcc0-5bbb76f8b025 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:56:30.578710 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9c64bfcb-84a8-4c41-bcc0-5bbb76f8b025 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1512 microversion: 2.1 time: 0.148381 Apr 16 21:56:30.579230 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3574/6990] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:56:30 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1512 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:56:31.595514 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2ebb410b-297d-4ce2-aad5-c06df857b9d3 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:31.596213 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2ebb410b-297d-4ce2-aad5-c06df857b9d3 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:31.603142 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2ebb410b-297d-4ce2-aad5-c06df857b9d3 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:31.603595 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2ebb410b-297d-4ce2-aad5-c06df857b9d3 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:31.604400 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2ebb410b-297d-4ce2-aad5-c06df857b9d3 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:31.604866 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2ebb410b-297d-4ce2-aad5-c06df857b9d3 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:31.739857 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2ebb410b-297d-4ce2-aad5-c06df857b9d3 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:56:31.747184 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2ebb410b-297d-4ce2-aad5-c06df857b9d3 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1512 microversion: 2.1 time: 0.156198 Apr 16 21:56:31.747764 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3417/6991] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:56:31 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:56:32.070918 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-58011573-21d8-4567-97b8-64813ff9bea5 req-1dc4ba3c-c254-4416-8c41-f83e7af4ce65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bb0317e-028c-4886-82a1-4e0912ec3508", "name": "network-vif-deleted", "tag": "9b307e71-2c8a-49fd-a64f-144993d40261"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:56:32.080096 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-58011573-21d8-4567-97b8-64813ff9bea5 req-1dc4ba3c-c254-4416-8c41-f83e7af4ce65 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:32.080601 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-58011573-21d8-4567-97b8-64813ff9bea5 req-1dc4ba3c-c254-4416-8c41-f83e7af4ce65 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:32.091361 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-58011573-21d8-4567-97b8-64813ff9bea5 req-1dc4ba3c-c254-4416-8c41-f83e7af4ce65 service nova] Creating event network-vif-deleted:9b307e71-2c8a-49fd-a64f-144993d40261 for instance 3bb0317e-028c-4886-82a1-4e0912ec3508 on nch2-master-1 Apr 16 21:56:32.097019 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-58011573-21d8-4567-97b8-64813ff9bea5 req-1dc4ba3c-c254-4416-8c41-f83e7af4ce65 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029800 Apr 16 21:56:32.100226 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3575/6992] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:56:32.763571 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f8ff1141-507b-4145-8f18-f1520d60befb tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:32.764201 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f8ff1141-507b-4145-8f18-f1520d60befb tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:32.770909 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f8ff1141-507b-4145-8f18-f1520d60befb tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:32.771339 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f8ff1141-507b-4145-8f18-f1520d60befb tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:32.772113 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f8ff1141-507b-4145-8f18-f1520d60befb tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:32.772585 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f8ff1141-507b-4145-8f18-f1520d60befb tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:32.802715 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f8ff1141-507b-4145-8f18-f1520d60befb tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:32.803173 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f8ff1141-507b-4145-8f18-f1520d60befb tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:32.803625 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-f8ff1141-507b-4145-8f18-f1520d60befb tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lazy-loading 'fault' on Instance uuid 3bb0317e-028c-4886-82a1-4e0912ec3508 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 21:56:32.843982 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f8ff1141-507b-4145-8f18-f1520d60befb tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be1280a437044ed84be6af90f62e642', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dd165bd07e4d8daffbfa8a93aad4e8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:56:32.851653 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f8ff1141-507b-4145-8f18-f1520d60befb tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 200 len: 1305 microversion: 2.1 time: 0.092048 Apr 16 21:56:32.852221 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3418/6993] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:56:32 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 1305 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:56:33.872420 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6ef08474-3ada-4109-ba67-1ee3d3d5cd12 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:33.873639 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6ef08474-3ada-4109-ba67-1ee3d3d5cd12 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 3bb0317e-028c-4886-82a1-4e0912ec3508] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:33.879818 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6ef08474-3ada-4109-ba67-1ee3d3d5cd12 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:33.880331 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6ef08474-3ada-4109-ba67-1ee3d3d5cd12 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:33.881127 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6ef08474-3ada-4109-ba67-1ee3d3d5cd12 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:33.881592 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6ef08474-3ada-4109-ba67-1ee3d3d5cd12 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:33.895168 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-6ef08474-3ada-4109-ba67-1ee3d3d5cd12 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] HTTP exception thrown: Instance 3bb0317e-028c-4886-82a1-4e0912ec3508 could not be found. Apr 16 21:56:33.895775 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6ef08474-3ada-4109-ba67-1ee3d3d5cd12 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Returning 404 to user: Instance 3bb0317e-028c-4886-82a1-4e0912ec3508 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:56:33.896647 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6ef08474-3ada-4109-ba67-1ee3d3d5cd12 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508" status: 404 len: 111 microversion: 2.1 time: 0.029453 Apr 16 21:56:33.897178 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3576/6994] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:56:33 2022] GET /compute/v2.1/servers/3bb0317e-028c-4886-82a1-4e0912ec3508 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:56:33.905161 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7934057a-122d-4ace-80bc-71d60d19bf09 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:33.905777 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7934057a-122d-4ace-80bc-71d60d19bf09 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:33.912473 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7934057a-122d-4ace-80bc-71d60d19bf09 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:33.912935 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7934057a-122d-4ace-80bc-71d60d19bf09 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:33.913709 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7934057a-122d-4ace-80bc-71d60d19bf09 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:33.914152 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7934057a-122d-4ace-80bc-71d60d19bf09 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:33.927012 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-7934057a-122d-4ace-80bc-71d60d19bf09 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] HTTP exception thrown: Instance 7632198d-4754-4aa4-8363-696023b07de2 could not be found. Apr 16 21:56:33.927595 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7934057a-122d-4ace-80bc-71d60d19bf09 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Returning 404 to user: Instance 7632198d-4754-4aa4-8363-696023b07de2 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:56:33.928440 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7934057a-122d-4ace-80bc-71d60d19bf09 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 404 len: 111 microversion: 2.1 time: 0.027197 Apr 16 21:56:33.928976 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3419/6995] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:56:33 2022] DELETE /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:56:33.937332 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b144d99d-b840-46e7-90ba-2f86e10b76a3 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:33.937905 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b144d99d-b840-46e7-90ba-2f86e10b76a3 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] [instance: 7632198d-4754-4aa4-8363-696023b07de2] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:33.943734 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b144d99d-b840-46e7-90ba-2f86e10b76a3 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:33.944240 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b144d99d-b840-46e7-90ba-2f86e10b76a3 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:33.945040 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b144d99d-b840-46e7-90ba-2f86e10b76a3 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:33.945500 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b144d99d-b840-46e7-90ba-2f86e10b76a3 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:33.959280 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-b144d99d-b840-46e7-90ba-2f86e10b76a3 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] HTTP exception thrown: Instance 7632198d-4754-4aa4-8363-696023b07de2 could not be found. Apr 16 21:56:33.959887 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b144d99d-b840-46e7-90ba-2f86e10b76a3 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] Returning 404 to user: Instance 7632198d-4754-4aa4-8363-696023b07de2 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:56:33.960848 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b144d99d-b840-46e7-90ba-2f86e10b76a3 tempest-ServerDiskConfigTestJSON-570619817 tempest-ServerDiskConfigTestJSON-570619817-project] 10.222.0.20 "GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2" status: 404 len: 111 microversion: 2.1 time: 0.027960 Apr 16 21:56:33.961399 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3577/6996] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:56:33 2022] GET /compute/v2.1/servers/7632198d-4754-4aa4-8363-696023b07de2 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:56:42.076011 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-51d3c50b-3d04-4a01-be93-2d4aa7f87873 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Action: 'create', calling method: .version_select at 0x7fbb9c39fdc0>, body: {"keypair": {"name": "tempest-keypair-1181093857"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:56:42.090966 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-51d3c50b-3d04-4a01-be93-2d4aa7f87873 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Getting quotas for project 14958c4ca99847bfb86911005da65809. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:56:42.097184 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-51d3c50b-3d04-4a01-be93-2d4aa7f87873 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Getting quotas for user 63b69490b00b49789e7859dca41f4a5d and project 14958c4ca99847bfb86911005da65809. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:56:42.480974 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-51d3c50b-3d04-4a01-be93-2d4aa7f87873 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Getting quotas for project 14958c4ca99847bfb86911005da65809. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:56:42.486054 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-51d3c50b-3d04-4a01-be93-2d4aa7f87873 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Getting quotas for user 63b69490b00b49789e7859dca41f4a5d and project 14958c4ca99847bfb86911005da65809. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:56:42.500738 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-51d3c50b-3d04-4a01-be93-2d4aa7f87873 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.545499 Apr 16 21:56:42.501344 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3420/6997] 10.222.0.20 () {60 vars in 1157 bytes} [Sat Apr 16 21:56:41 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:56:44.995692 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e0904e69-df09-4dcf-bca3-6d551ef3a447 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1159690963", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "46ed5fd0-8613-4ef4-9bd7-a5169ec06285"}], "security_groups": [{"name": "tempest-securitygroup--937765651"}], "key_name": "tempest-keypair-1181093857", "user_data": "}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:56:45.102971 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-e0904e69-df09-4dcf-bca3-6d551ef3a447 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] validate_networks() for [('46ed5fd0-8613-4ef4-9bd7-a5169ec06285', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:56:45.500526 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-e0904e69-df09-4dcf-bca3-6d551ef3a447 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:56:45.500982 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-e0904e69-df09-4dcf-bca3-6d551ef3a447 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:56:45.501489 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-e0904e69-df09-4dcf-bca3-6d551ef3a447 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:56:45.501998 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-e0904e69-df09-4dcf-bca3-6d551ef3a447 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:56:45.504270 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-e0904e69-df09-4dcf-bca3-6d551ef3a447 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:56:45.511911 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e0904e69-df09-4dcf-bca3-6d551ef3a447 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:45.512762 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e0904e69-df09-4dcf-bca3-6d551ef3a447 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:45.513668 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e0904e69-df09-4dcf-bca3-6d551ef3a447 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:45.514257 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e0904e69-df09-4dcf-bca3-6d551ef3a447 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:45.536910 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-e0904e69-df09-4dcf-bca3-6d551ef3a447 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Getting quotas for project 14958c4ca99847bfb86911005da65809. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:56:45.542934 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-e0904e69-df09-4dcf-bca3-6d551ef3a447 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Getting quotas for user 63b69490b00b49789e7859dca41f4a5d and project 14958c4ca99847bfb86911005da65809. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:56:45.558928 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e0904e69-df09-4dcf-bca3-6d551ef3a447 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:56:45.562286 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e0904e69-df09-4dcf-bca3-6d551ef3a447 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:56:45.677330 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e0904e69-df09-4dcf-bca3-6d551ef3a447 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.687371 Apr 16 21:56:45.678564 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3578/6998] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:56:44 2022] POST /compute/v2.1/servers => generated 408 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:56:45.690219 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-badc8407-8818-4dc5-8ac9-98965c32e299 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:45.690848 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-badc8407-8818-4dc5-8ac9-98965c32e299 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:45.756361 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-badc8407-8818-4dc5-8ac9-98965c32e299 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:56:45.764243 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-badc8407-8818-4dc5-8ac9-98965c32e299 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1239 microversion: 2.1 time: 0.079809 Apr 16 21:56:45.764942 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3421/6999] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:56:45 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1239 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:56:46.782152 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-aba7f1f4-a3ed-47c8-90c9-8974d534cfe4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:46.782815 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-aba7f1f4-a3ed-47c8-90c9-8974d534cfe4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:46.789765 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aba7f1f4-a3ed-47c8-90c9-8974d534cfe4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:46.790252 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aba7f1f4-a3ed-47c8-90c9-8974d534cfe4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:46.791133 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aba7f1f4-a3ed-47c8-90c9-8974d534cfe4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:46.791641 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aba7f1f4-a3ed-47c8-90c9-8974d534cfe4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:46.853111 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-aba7f1f4-a3ed-47c8-90c9-8974d534cfe4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:56:46.860756 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-aba7f1f4-a3ed-47c8-90c9-8974d534cfe4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1243 microversion: 2.1 time: 0.083424 Apr 16 21:56:46.861334 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3579/7000] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:56:46 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1243 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:56:47.878162 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-312dbcb1-1184-46d9-8b69-fafc5a75f02a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:47.879359 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-312dbcb1-1184-46d9-8b69-fafc5a75f02a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:47.886797 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-312dbcb1-1184-46d9-8b69-fafc5a75f02a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:47.887255 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-312dbcb1-1184-46d9-8b69-fafc5a75f02a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:47.888078 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-312dbcb1-1184-46d9-8b69-fafc5a75f02a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:47.888547 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-312dbcb1-1184-46d9-8b69-fafc5a75f02a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:47.966650 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-312dbcb1-1184-46d9-8b69-fafc5a75f02a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:56:47.974646 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-312dbcb1-1184-46d9-8b69-fafc5a75f02a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1299 microversion: 2.1 time: 0.100804 Apr 16 21:56:47.975218 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3422/7001] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:56:47 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1299 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:56:48.991634 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-dc6b7105-fd54-41d2-83e8-62df2acd8390 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:48.992341 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-dc6b7105-fd54-41d2-83e8-62df2acd8390 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:48.999280 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dc6b7105-fd54-41d2-83e8-62df2acd8390 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:48.999755 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dc6b7105-fd54-41d2-83e8-62df2acd8390 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:49.000655 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dc6b7105-fd54-41d2-83e8-62df2acd8390 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:49.001126 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dc6b7105-fd54-41d2-83e8-62df2acd8390 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:49.135407 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-dc6b7105-fd54-41d2-83e8-62df2acd8390 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:56:49.145597 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-dc6b7105-fd54-41d2-83e8-62df2acd8390 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1364 microversion: 2.1 time: 0.157961 Apr 16 21:56:49.146200 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3580/7002] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:56:48 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:56:49.417689 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-bb9da677-c4e5-4f57-80d3-d961c4128aef req-86161339-94e4-4479-819d-54a28be5f78d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55", "tag": "650175dd-39b5-4078-a257-9030adcf5d2d"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:56:49.427288 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-bb9da677-c4e5-4f57-80d3-d961c4128aef req-86161339-94e4-4479-819d-54a28be5f78d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:49.429063 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-bb9da677-c4e5-4f57-80d3-d961c4128aef req-86161339-94e4-4479-819d-54a28be5f78d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:49.439682 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-bb9da677-c4e5-4f57-80d3-d961c4128aef req-86161339-94e4-4479-819d-54a28be5f78d service nova] Creating event network-changed:650175dd-39b5-4078-a257-9030adcf5d2d for instance 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 on nch1-master-1 Apr 16 21:56:49.444496 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-bb9da677-c4e5-4f57-80d3-d961c4128aef req-86161339-94e4-4479-819d-54a28be5f78d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030723 Apr 16 21:56:49.445139 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3423/7003] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:56:50.163542 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f1309a24-1a75-4377-97df-0b4f7dedf62b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:50.164105 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f1309a24-1a75-4377-97df-0b4f7dedf62b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:50.170928 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f1309a24-1a75-4377-97df-0b4f7dedf62b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:50.171404 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f1309a24-1a75-4377-97df-0b4f7dedf62b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:50.172255 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f1309a24-1a75-4377-97df-0b4f7dedf62b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:50.172694 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f1309a24-1a75-4377-97df-0b4f7dedf62b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:50.305900 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f1309a24-1a75-4377-97df-0b4f7dedf62b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:56:50.313977 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f1309a24-1a75-4377-97df-0b4f7dedf62b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1364 microversion: 2.1 time: 0.154512 Apr 16 21:56:50.315162 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3581/7004] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:56:50 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:56:51.332732 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6beab59a-1eba-4d3b-9fb7-88bcd0fead8d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:51.333428 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6beab59a-1eba-4d3b-9fb7-88bcd0fead8d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:51.339686 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6beab59a-1eba-4d3b-9fb7-88bcd0fead8d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:51.340140 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6beab59a-1eba-4d3b-9fb7-88bcd0fead8d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:51.340929 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6beab59a-1eba-4d3b-9fb7-88bcd0fead8d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:51.341368 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6beab59a-1eba-4d3b-9fb7-88bcd0fead8d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:51.472850 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6beab59a-1eba-4d3b-9fb7-88bcd0fead8d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:56:51.480511 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6beab59a-1eba-4d3b-9fb7-88bcd0fead8d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1364 microversion: 2.1 time: 0.153425 Apr 16 21:56:51.481102 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3424/7005] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:56:51 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:56:52.497956 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-58cf3d76-e70e-4d74-963e-5763febed397 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:52.498593 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-58cf3d76-e70e-4d74-963e-5763febed397 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:52.506173 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58cf3d76-e70e-4d74-963e-5763febed397 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:52.506683 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58cf3d76-e70e-4d74-963e-5763febed397 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:52.507485 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58cf3d76-e70e-4d74-963e-5763febed397 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:52.507948 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-58cf3d76-e70e-4d74-963e-5763febed397 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:52.633665 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-58cf3d76-e70e-4d74-963e-5763febed397 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:56:52.641619 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-58cf3d76-e70e-4d74-963e-5763febed397 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1364 microversion: 2.1 time: 0.147673 Apr 16 21:56:52.642202 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3582/7006] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:56:52 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:56:53.658934 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c8ab0669-f123-43bc-813e-c580e8bbab58 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:53.659673 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c8ab0669-f123-43bc-813e-c580e8bbab58 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:53.666098 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c8ab0669-f123-43bc-813e-c580e8bbab58 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:53.666553 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c8ab0669-f123-43bc-813e-c580e8bbab58 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:53.667326 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c8ab0669-f123-43bc-813e-c580e8bbab58 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:53.667767 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c8ab0669-f123-43bc-813e-c580e8bbab58 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:53.802728 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c8ab0669-f123-43bc-813e-c580e8bbab58 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:56:53.810391 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c8ab0669-f123-43bc-813e-c580e8bbab58 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1364 microversion: 2.1 time: 0.155897 Apr 16 21:56:53.810969 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3425/7007] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:56:53 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:56:54.826935 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-736ad105-f8ba-4f21-99f8-fbefbf6467a2 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:54.827570 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-736ad105-f8ba-4f21-99f8-fbefbf6467a2 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:54.834550 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-736ad105-f8ba-4f21-99f8-fbefbf6467a2 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:54.835031 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-736ad105-f8ba-4f21-99f8-fbefbf6467a2 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:54.835834 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-736ad105-f8ba-4f21-99f8-fbefbf6467a2 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:54.836337 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-736ad105-f8ba-4f21-99f8-fbefbf6467a2 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:54.966208 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-736ad105-f8ba-4f21-99f8-fbefbf6467a2 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:56:54.974428 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-736ad105-f8ba-4f21-99f8-fbefbf6467a2 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1364 microversion: 2.1 time: 0.151505 Apr 16 21:56:54.975002 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3583/7008] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:56:54 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:56:55.768516 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-07a7a4ad-29b5-410c-b430-5588ea939425 req-d48f95c4-9074-4751-b5d8-011ed7b0b4cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55", "name": "network-vif-plugged", "status": "completed", "tag": "650175dd-39b5-4078-a257-9030adcf5d2d"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:56:55.776768 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-07a7a4ad-29b5-410c-b430-5588ea939425 req-d48f95c4-9074-4751-b5d8-011ed7b0b4cb service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:55.777269 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-07a7a4ad-29b5-410c-b430-5588ea939425 req-d48f95c4-9074-4751-b5d8-011ed7b0b4cb service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:55.787738 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-07a7a4ad-29b5-410c-b430-5588ea939425 req-d48f95c4-9074-4751-b5d8-011ed7b0b4cb service nova] Creating event network-vif-plugged:650175dd-39b5-4078-a257-9030adcf5d2d for instance 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 on nch1-master-1 Apr 16 21:56:55.792849 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-07a7a4ad-29b5-410c-b430-5588ea939425 req-d48f95c4-9074-4751-b5d8-011ed7b0b4cb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028733 Apr 16 21:56:55.793444 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3426/7009] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:56:55.991270 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7e036d33-12cb-41e0-a0dc-6b9b1f2c81a3 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:55.991899 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7e036d33-12cb-41e0-a0dc-6b9b1f2c81a3 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:55.998647 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7e036d33-12cb-41e0-a0dc-6b9b1f2c81a3 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:55.999134 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7e036d33-12cb-41e0-a0dc-6b9b1f2c81a3 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:56.000623 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7e036d33-12cb-41e0-a0dc-6b9b1f2c81a3 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:56.001096 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7e036d33-12cb-41e0-a0dc-6b9b1f2c81a3 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:56.126505 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7e036d33-12cb-41e0-a0dc-6b9b1f2c81a3 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:56:56.133826 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7e036d33-12cb-41e0-a0dc-6b9b1f2c81a3 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1364 microversion: 2.1 time: 0.146519 Apr 16 21:56:56.134399 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3584/7010] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:56:55 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:56:57.152607 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-25f301ae-5176-48fa-b75d-0a5582966cff tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:57.153311 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-25f301ae-5176-48fa-b75d-0a5582966cff tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:57.160416 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-25f301ae-5176-48fa-b75d-0a5582966cff tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:57.160880 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-25f301ae-5176-48fa-b75d-0a5582966cff tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:57.161658 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-25f301ae-5176-48fa-b75d-0a5582966cff tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:57.162098 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-25f301ae-5176-48fa-b75d-0a5582966cff tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:57.295524 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-25f301ae-5176-48fa-b75d-0a5582966cff tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:56:57.303204 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-25f301ae-5176-48fa-b75d-0a5582966cff tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1551 microversion: 2.1 time: 0.156010 Apr 16 21:56:57.303775 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3427/7011] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:56:57 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1551 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:56:57.320213 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0ed12797-f1b8-45b7-b42f-d492bfabf787 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:57.321374 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0ed12797-f1b8-45b7-b42f-d492bfabf787 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:57.327761 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0ed12797-f1b8-45b7-b42f-d492bfabf787 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:57.328838 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0ed12797-f1b8-45b7-b42f-d492bfabf787 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:57.329718 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0ed12797-f1b8-45b7-b42f-d492bfabf787 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:57.330175 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0ed12797-f1b8-45b7-b42f-d492bfabf787 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:57.407775 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0ed12797-f1b8-45b7-b42f-d492bfabf787 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091543 Apr 16 21:56:57.408438 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3585/7012] 10.222.0.20 () {58 vars in 1274 bytes} [Sat Apr 16 21:56:57 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:56:58.452032 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7a83dd58-b6a9-4f29-a1d7-4ea89af091da tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:58.452907 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7a83dd58-b6a9-4f29-a1d7-4ea89af091da tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:58.454897 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-43258ed8-5e51-4a8a-b188-5339b619ae29 req-21a60c42-b04e-4f3a-ad52-49618810c99c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55", "tag": "650175dd-39b5-4078-a257-9030adcf5d2d"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:56:58.459760 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7a83dd58-b6a9-4f29-a1d7-4ea89af091da tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:58.460248 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7a83dd58-b6a9-4f29-a1d7-4ea89af091da tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:58.461036 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7a83dd58-b6a9-4f29-a1d7-4ea89af091da tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:58.461661 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7a83dd58-b6a9-4f29-a1d7-4ea89af091da tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:58.463421 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-43258ed8-5e51-4a8a-b188-5339b619ae29 req-21a60c42-b04e-4f3a-ad52-49618810c99c service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:58.463891 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-43258ed8-5e51-4a8a-b188-5339b619ae29 req-21a60c42-b04e-4f3a-ad52-49618810c99c service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:58.477662 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-43258ed8-5e51-4a8a-b188-5339b619ae29 req-21a60c42-b04e-4f3a-ad52-49618810c99c service nova] Creating event network-changed:650175dd-39b5-4078-a257-9030adcf5d2d for instance 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 on nch1-master-1 Apr 16 21:56:58.483464 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-43258ed8-5e51-4a8a-b188-5339b619ae29 req-21a60c42-b04e-4f3a-ad52-49618810c99c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032662 Apr 16 21:56:58.484865 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3586/7013] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:56:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:56:58.675293 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7a83dd58-b6a9-4f29-a1d7-4ea89af091da tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:56:58.683131 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7a83dd58-b6a9-4f29-a1d7-4ea89af091da tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1551 microversion: 2.1 time: 0.234961 Apr 16 21:56:58.683816 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3428/7014] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:56:58 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1551 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:56:58.700347 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-42a11cb0-ed3a-4c0f-bb39-442b88303469 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:58.701342 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-42a11cb0-ed3a-4c0f-bb39-442b88303469 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:58.707887 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-42a11cb0-ed3a-4c0f-bb39-442b88303469 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:58.708397 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-42a11cb0-ed3a-4c0f-bb39-442b88303469 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:58.709206 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-42a11cb0-ed3a-4c0f-bb39-442b88303469 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:58.709673 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-42a11cb0-ed3a-4c0f-bb39-442b88303469 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:58.852917 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-42a11cb0-ed3a-4c0f-bb39-442b88303469 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:56:58.861311 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-42a11cb0-ed3a-4c0f-bb39-442b88303469 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1551 microversion: 2.1 time: 0.165147 Apr 16 21:56:58.862211 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3587/7015] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:56:58 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1551 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:56:59.878335 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e004b066-5782-4566-99ef-74b82db49d84 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:56:59.878952 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e004b066-5782-4566-99ef-74b82db49d84 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:56:59.885655 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e004b066-5782-4566-99ef-74b82db49d84 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:59.886115 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e004b066-5782-4566-99ef-74b82db49d84 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:56:59.886889 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e004b066-5782-4566-99ef-74b82db49d84 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:56:59.887332 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e004b066-5782-4566-99ef-74b82db49d84 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:00.013178 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e004b066-5782-4566-99ef-74b82db49d84 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:00.021153 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e004b066-5782-4566-99ef-74b82db49d84 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1670 microversion: 2.1 time: 0.146741 Apr 16 21:57:00.021726 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3429/7016] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:56:59 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1670 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:00.036900 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f610fd18-f674-4ca9-8cf2-8b42cd66d6c3 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:00.037569 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f610fd18-f674-4ca9-8cf2-8b42cd66d6c3 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:00.044100 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f610fd18-f674-4ca9-8cf2-8b42cd66d6c3 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:00.044608 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f610fd18-f674-4ca9-8cf2-8b42cd66d6c3 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:00.045409 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f610fd18-f674-4ca9-8cf2-8b42cd66d6c3 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:00.045875 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f610fd18-f674-4ca9-8cf2-8b42cd66d6c3 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:00.170788 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f610fd18-f674-4ca9-8cf2-8b42cd66d6c3 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:00.178294 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f610fd18-f674-4ca9-8cf2-8b42cd66d6c3 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1670 microversion: 2.1 time: 0.145304 Apr 16 21:57:00.178874 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3588/7017] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:00 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1670 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:00.194723 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9434dd80-3b9a-4de5-8de8-e3a9fb3c49c4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:57:00.195684 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9434dd80-3b9a-4de5-8de8-e3a9fb3c49c4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:00.201560 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9434dd80-3b9a-4de5-8de8-e3a9fb3c49c4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:00.202030 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9434dd80-3b9a-4de5-8de8-e3a9fb3c49c4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:00.203442 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9434dd80-3b9a-4de5-8de8-e3a9fb3c49c4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:00.203910 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9434dd80-3b9a-4de5-8de8-e3a9fb3c49c4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:00.230098 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9434dd80-3b9a-4de5-8de8-e3a9fb3c49c4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:00.235591 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9434dd80-3b9a-4de5-8de8-e3a9fb3c49c4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Old instance type m1.heat2, new instance type m1.heat {{(pid=137409) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 16 21:57:00.241753 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-9434dd80-3b9a-4de5-8de8-e3a9fb3c49c4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:57:00.242181 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-9434dd80-3b9a-4de5-8de8-e3a9fb3c49c4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:57:00.242663 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-9434dd80-3b9a-4de5-8de8-e3a9fb3c49c4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:57:00.243079 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-9434dd80-3b9a-4de5-8de8-e3a9fb3c49c4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:57:00.243496 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-9434dd80-3b9a-4de5-8de8-e3a9fb3c49c4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:57:00.487880 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9434dd80-3b9a-4de5-8de8-e3a9fb3c49c4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "POST /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55/action" status: 202 len: 0 microversion: 2.1 time: 0.296870 Apr 16 21:57:00.488454 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3430/7018] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:57:00 2022] POST /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55/action => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:57:00.496544 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-777568c9-3322-4e4a-a727-2c0bb07f3706 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:00.497300 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-777568c9-3322-4e4a-a727-2c0bb07f3706 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:00.504209 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-777568c9-3322-4e4a-a727-2c0bb07f3706 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:00.505012 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-777568c9-3322-4e4a-a727-2c0bb07f3706 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:00.505198 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-777568c9-3322-4e4a-a727-2c0bb07f3706 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:00.505646 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-777568c9-3322-4e4a-a727-2c0bb07f3706 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:00.638088 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-777568c9-3322-4e4a-a727-2c0bb07f3706 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:00.645751 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-777568c9-3322-4e4a-a727-2c0bb07f3706 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1679 microversion: 2.1 time: 0.153141 Apr 16 21:57:00.646328 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3589/7019] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:00 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:01.665507 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-43e4f24f-e19b-4950-9b66-64ac9178033c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:01.666093 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-43e4f24f-e19b-4950-9b66-64ac9178033c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:01.671917 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-43e4f24f-e19b-4950-9b66-64ac9178033c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:01.672478 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-43e4f24f-e19b-4950-9b66-64ac9178033c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:01.673260 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-43e4f24f-e19b-4950-9b66-64ac9178033c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:01.673708 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-43e4f24f-e19b-4950-9b66-64ac9178033c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:01.806824 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-43e4f24f-e19b-4950-9b66-64ac9178033c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:01.815215 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-43e4f24f-e19b-4950-9b66-64ac9178033c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1679 microversion: 2.1 time: 0.154529 Apr 16 21:57:01.815798 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3431/7020] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:01 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:02.833714 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a1e64944-8968-42d8-8ad8-a6a9988fd89a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:02.834488 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a1e64944-8968-42d8-8ad8-a6a9988fd89a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:02.841529 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a1e64944-8968-42d8-8ad8-a6a9988fd89a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:02.842004 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a1e64944-8968-42d8-8ad8-a6a9988fd89a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:02.842806 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a1e64944-8968-42d8-8ad8-a6a9988fd89a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:02.843890 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a1e64944-8968-42d8-8ad8-a6a9988fd89a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:02.974823 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a1e64944-8968-42d8-8ad8-a6a9988fd89a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:02.982695 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a1e64944-8968-42d8-8ad8-a6a9988fd89a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1679 microversion: 2.1 time: 0.153417 Apr 16 21:57:02.983280 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3590/7021] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:02 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:04.000004 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-089feddb-9128-4874-a183-beeab0f26d0f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:04.000577 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-089feddb-9128-4874-a183-beeab0f26d0f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:04.007280 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-089feddb-9128-4874-a183-beeab0f26d0f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:04.007742 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-089feddb-9128-4874-a183-beeab0f26d0f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:04.008553 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-089feddb-9128-4874-a183-beeab0f26d0f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:04.009006 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-089feddb-9128-4874-a183-beeab0f26d0f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:04.138820 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-089feddb-9128-4874-a183-beeab0f26d0f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:04.146667 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-089feddb-9128-4874-a183-beeab0f26d0f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1684 microversion: 2.1 time: 0.150632 Apr 16 21:57:04.147239 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3432/7022] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:03 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:05.173151 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b1d5eb01-7100-4504-b3ff-5ce2eb144489 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:05.173780 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b1d5eb01-7100-4504-b3ff-5ce2eb144489 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:05.180894 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b1d5eb01-7100-4504-b3ff-5ce2eb144489 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:05.181398 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b1d5eb01-7100-4504-b3ff-5ce2eb144489 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:05.182194 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b1d5eb01-7100-4504-b3ff-5ce2eb144489 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:05.182654 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b1d5eb01-7100-4504-b3ff-5ce2eb144489 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:05.314389 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b1d5eb01-7100-4504-b3ff-5ce2eb144489 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:05.321826 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b1d5eb01-7100-4504-b3ff-5ce2eb144489 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1684 microversion: 2.1 time: 0.153089 Apr 16 21:57:05.322397 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3591/7023] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:05 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:06.338773 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ef229299-381e-4d6d-9a81-d03212f8f05f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:06.339389 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ef229299-381e-4d6d-9a81-d03212f8f05f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:06.346279 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ef229299-381e-4d6d-9a81-d03212f8f05f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:06.346741 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ef229299-381e-4d6d-9a81-d03212f8f05f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:06.347512 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ef229299-381e-4d6d-9a81-d03212f8f05f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:06.348256 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ef229299-381e-4d6d-9a81-d03212f8f05f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:06.475293 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ef229299-381e-4d6d-9a81-d03212f8f05f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:06.482679 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ef229299-381e-4d6d-9a81-d03212f8f05f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1684 microversion: 2.1 time: 0.147755 Apr 16 21:57:06.483257 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3433/7024] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:06 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1684 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:07.500501 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8af62186-c9a3-4be8-abbb-7a943c6649f5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:07.501172 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8af62186-c9a3-4be8-abbb-7a943c6649f5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:07.509078 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8af62186-c9a3-4be8-abbb-7a943c6649f5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:07.509578 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8af62186-c9a3-4be8-abbb-7a943c6649f5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:07.510441 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8af62186-c9a3-4be8-abbb-7a943c6649f5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:07.510901 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8af62186-c9a3-4be8-abbb-7a943c6649f5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:07.639518 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8af62186-c9a3-4be8-abbb-7a943c6649f5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:07.647951 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8af62186-c9a3-4be8-abbb-7a943c6649f5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1684 microversion: 2.1 time: 0.151824 Apr 16 21:57:07.648570 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3592/7025] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:07 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:08.664696 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3f8f1718-d9e6-4576-87c6-664ef9a6778e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:08.665349 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3f8f1718-d9e6-4576-87c6-664ef9a6778e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:08.672122 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3f8f1718-d9e6-4576-87c6-664ef9a6778e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:08.672618 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3f8f1718-d9e6-4576-87c6-664ef9a6778e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:08.673408 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3f8f1718-d9e6-4576-87c6-664ef9a6778e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:08.673851 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3f8f1718-d9e6-4576-87c6-664ef9a6778e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:08.802540 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3f8f1718-d9e6-4576-87c6-664ef9a6778e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:08.809904 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3f8f1718-d9e6-4576-87c6-664ef9a6778e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1684 microversion: 2.1 time: 0.149118 Apr 16 21:57:08.810502 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3434/7026] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:08 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1684 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:09.827172 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-407f59db-060b-4568-b396-99e0dbfc3cc8 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:09.828477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-407f59db-060b-4568-b396-99e0dbfc3cc8 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:09.835616 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-407f59db-060b-4568-b396-99e0dbfc3cc8 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:09.836096 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-407f59db-060b-4568-b396-99e0dbfc3cc8 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:09.836930 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-407f59db-060b-4568-b396-99e0dbfc3cc8 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:09.837395 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-407f59db-060b-4568-b396-99e0dbfc3cc8 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:09.967907 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-407f59db-060b-4568-b396-99e0dbfc3cc8 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:09.975747 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-407f59db-060b-4568-b396-99e0dbfc3cc8 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1684 microversion: 2.1 time: 0.152613 Apr 16 21:57:09.976368 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3593/7027] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:09 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:10.993171 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-291d4ccc-829d-46f9-ad86-e2270b0b36ac tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:10.993746 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-291d4ccc-829d-46f9-ad86-e2270b0b36ac tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:11.000602 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-291d4ccc-829d-46f9-ad86-e2270b0b36ac tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:11.001060 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-291d4ccc-829d-46f9-ad86-e2270b0b36ac tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:11.001834 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-291d4ccc-829d-46f9-ad86-e2270b0b36ac tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:11.002277 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-291d4ccc-829d-46f9-ad86-e2270b0b36ac tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:11.128894 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-291d4ccc-829d-46f9-ad86-e2270b0b36ac tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:11.136085 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-291d4ccc-829d-46f9-ad86-e2270b0b36ac tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1684 microversion: 2.1 time: 0.146889 Apr 16 21:57:11.136679 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3435/7028] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:10 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1684 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:12.153165 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-134e9f95-eae9-49bd-bf33-8ad25ce42d75 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:12.153793 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-134e9f95-eae9-49bd-bf33-8ad25ce42d75 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:12.160862 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-134e9f95-eae9-49bd-bf33-8ad25ce42d75 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:12.161335 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-134e9f95-eae9-49bd-bf33-8ad25ce42d75 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:12.162122 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-134e9f95-eae9-49bd-bf33-8ad25ce42d75 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:12.162578 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-134e9f95-eae9-49bd-bf33-8ad25ce42d75 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:12.293362 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-134e9f95-eae9-49bd-bf33-8ad25ce42d75 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:12.300818 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-134e9f95-eae9-49bd-bf33-8ad25ce42d75 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1684 microversion: 2.1 time: 0.151541 Apr 16 21:57:12.302909 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3594/7029] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:12 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:13.318188 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-666f41f6-d040-4df7-bc0a-d20196226ff4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:13.318868 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-666f41f6-d040-4df7-bc0a-d20196226ff4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:13.325770 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-666f41f6-d040-4df7-bc0a-d20196226ff4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:13.326229 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-666f41f6-d040-4df7-bc0a-d20196226ff4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:13.327009 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-666f41f6-d040-4df7-bc0a-d20196226ff4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:13.327962 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-666f41f6-d040-4df7-bc0a-d20196226ff4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:13.458863 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-666f41f6-d040-4df7-bc0a-d20196226ff4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:13.466423 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-666f41f6-d040-4df7-bc0a-d20196226ff4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1684 microversion: 2.1 time: 0.152112 Apr 16 21:57:13.467007 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3436/7030] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:13 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:14.485021 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6c9c1df0-b549-49db-94ed-394d19a61a8d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:14.485659 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6c9c1df0-b549-49db-94ed-394d19a61a8d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:14.492500 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6c9c1df0-b549-49db-94ed-394d19a61a8d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:14.492971 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6c9c1df0-b549-49db-94ed-394d19a61a8d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:14.493794 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6c9c1df0-b549-49db-94ed-394d19a61a8d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:14.494255 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6c9c1df0-b549-49db-94ed-394d19a61a8d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:14.629374 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6c9c1df0-b549-49db-94ed-394d19a61a8d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:14.631740 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6c9c1df0-b549-49db-94ed-394d19a61a8d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1684 microversion: 2.1 time: 0.151304 Apr 16 21:57:14.632348 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3595/7031] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:14 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:15.649272 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-96064a40-6572-49a7-aa14-87955188ad2c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:15.649846 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-96064a40-6572-49a7-aa14-87955188ad2c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:15.657273 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-96064a40-6572-49a7-aa14-87955188ad2c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:15.657736 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-96064a40-6572-49a7-aa14-87955188ad2c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:15.658504 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-96064a40-6572-49a7-aa14-87955188ad2c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:15.658950 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-96064a40-6572-49a7-aa14-87955188ad2c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:15.784537 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-96064a40-6572-49a7-aa14-87955188ad2c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:15.791794 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-96064a40-6572-49a7-aa14-87955188ad2c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1684 microversion: 2.1 time: 0.146487 Apr 16 21:57:15.793431 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3437/7032] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:15 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1684 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:16.808892 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-94458cad-1bd3-4e3f-8be8-0b0ca10aad5b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:16.809554 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-94458cad-1bd3-4e3f-8be8-0b0ca10aad5b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:16.816438 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-94458cad-1bd3-4e3f-8be8-0b0ca10aad5b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:16.816916 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-94458cad-1bd3-4e3f-8be8-0b0ca10aad5b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:16.817710 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-94458cad-1bd3-4e3f-8be8-0b0ca10aad5b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:16.818170 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-94458cad-1bd3-4e3f-8be8-0b0ca10aad5b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:16.946187 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-94458cad-1bd3-4e3f-8be8-0b0ca10aad5b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:16.954170 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-94458cad-1bd3-4e3f-8be8-0b0ca10aad5b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1684 microversion: 2.1 time: 0.149184 Apr 16 21:57:16.954762 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3596/7033] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:16 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1684 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:17.971630 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-89bde942-d623-4501-8488-49f663141033 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:17.972212 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-89bde942-d623-4501-8488-49f663141033 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:17.979155 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-89bde942-d623-4501-8488-49f663141033 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:17.979617 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-89bde942-d623-4501-8488-49f663141033 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:17.980428 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-89bde942-d623-4501-8488-49f663141033 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:17.980875 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-89bde942-d623-4501-8488-49f663141033 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:18.107212 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-89bde942-d623-4501-8488-49f663141033 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:18.114609 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-89bde942-d623-4501-8488-49f663141033 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1684 microversion: 2.1 time: 0.147624 Apr 16 21:57:18.115190 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3438/7034] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:17 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1684 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:19.132474 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-15ac5c58-5046-42d3-aa40-52ade17197f4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:19.133111 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-15ac5c58-5046-42d3-aa40-52ade17197f4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:19.140475 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-15ac5c58-5046-42d3-aa40-52ade17197f4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:19.140960 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-15ac5c58-5046-42d3-aa40-52ade17197f4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:19.141756 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-15ac5c58-5046-42d3-aa40-52ade17197f4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:19.142219 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-15ac5c58-5046-42d3-aa40-52ade17197f4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:19.267779 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-15ac5c58-5046-42d3-aa40-52ade17197f4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:19.275284 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-15ac5c58-5046-42d3-aa40-52ade17197f4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1684 microversion: 2.1 time: 0.146993 Apr 16 21:57:19.277279 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3597/7035] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:19 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1684 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:20.293268 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-77c47ea6-5d24-4d96-8309-a85fd99475ee tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:20.293834 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-77c47ea6-5d24-4d96-8309-a85fd99475ee tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:20.301087 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-77c47ea6-5d24-4d96-8309-a85fd99475ee tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:20.301551 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-77c47ea6-5d24-4d96-8309-a85fd99475ee tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:20.302349 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-77c47ea6-5d24-4d96-8309-a85fd99475ee tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:20.302783 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-77c47ea6-5d24-4d96-8309-a85fd99475ee tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:20.432544 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-77c47ea6-5d24-4d96-8309-a85fd99475ee tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:20.439872 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-77c47ea6-5d24-4d96-8309-a85fd99475ee tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1684 microversion: 2.1 time: 0.150614 Apr 16 21:57:20.440477 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3439/7036] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:20 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:21.456993 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-485dc9ef-330b-40f7-adc2-0063233318fa tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:21.457625 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-485dc9ef-330b-40f7-adc2-0063233318fa tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:21.464558 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-485dc9ef-330b-40f7-adc2-0063233318fa tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:21.465034 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-485dc9ef-330b-40f7-adc2-0063233318fa tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:21.465838 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-485dc9ef-330b-40f7-adc2-0063233318fa tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:21.466298 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-485dc9ef-330b-40f7-adc2-0063233318fa tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:21.598383 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-485dc9ef-330b-40f7-adc2-0063233318fa tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:21.605813 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-485dc9ef-330b-40f7-adc2-0063233318fa tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1684 microversion: 2.1 time: 0.152710 Apr 16 21:57:21.606391 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3598/7037] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:21 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:22.623529 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-61a19f98-7f99-4d2b-8377-6740633734ad tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:22.624142 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-61a19f98-7f99-4d2b-8377-6740633734ad tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:22.631341 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-61a19f98-7f99-4d2b-8377-6740633734ad tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:22.631797 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-61a19f98-7f99-4d2b-8377-6740633734ad tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:22.632596 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-61a19f98-7f99-4d2b-8377-6740633734ad tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:22.633066 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-61a19f98-7f99-4d2b-8377-6740633734ad tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:22.759173 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-61a19f98-7f99-4d2b-8377-6740633734ad tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:22.767048 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-61a19f98-7f99-4d2b-8377-6740633734ad tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1684 microversion: 2.1 time: 0.147443 Apr 16 21:57:22.767610 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3440/7038] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:22 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1684 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:23.785160 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f0a7a30f-5c18-4897-b93b-b53a0ca4d9f2 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:23.785796 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f0a7a30f-5c18-4897-b93b-b53a0ca4d9f2 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:23.792886 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f0a7a30f-5c18-4897-b93b-b53a0ca4d9f2 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:23.793379 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f0a7a30f-5c18-4897-b93b-b53a0ca4d9f2 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:23.794165 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f0a7a30f-5c18-4897-b93b-b53a0ca4d9f2 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:23.794622 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f0a7a30f-5c18-4897-b93b-b53a0ca4d9f2 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:23.921642 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f0a7a30f-5c18-4897-b93b-b53a0ca4d9f2 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:23.929049 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f0a7a30f-5c18-4897-b93b-b53a0ca4d9f2 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1684 microversion: 2.1 time: 0.149466 Apr 16 21:57:23.929621 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3599/7039] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:23 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:24.945990 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e0adc512-5b3c-4161-ac44-ba22f3323244 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:24.946544 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e0adc512-5b3c-4161-ac44-ba22f3323244 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:24.952629 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e0adc512-5b3c-4161-ac44-ba22f3323244 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:24.953081 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e0adc512-5b3c-4161-ac44-ba22f3323244 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:24.953844 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e0adc512-5b3c-4161-ac44-ba22f3323244 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:24.954288 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e0adc512-5b3c-4161-ac44-ba22f3323244 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:25.080685 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e0adc512-5b3c-4161-ac44-ba22f3323244 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:25.088161 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e0adc512-5b3c-4161-ac44-ba22f3323244 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1684 microversion: 2.1 time: 0.146084 Apr 16 21:57:25.089320 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3441/7040] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:24 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1684 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:26.106302 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b0e07fa6-b847-4dcd-9452-2cfd3b0cbe86 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:26.106939 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b0e07fa6-b847-4dcd-9452-2cfd3b0cbe86 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:26.114492 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b0e07fa6-b847-4dcd-9452-2cfd3b0cbe86 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:26.114970 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b0e07fa6-b847-4dcd-9452-2cfd3b0cbe86 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:26.115758 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b0e07fa6-b847-4dcd-9452-2cfd3b0cbe86 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:26.116248 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b0e07fa6-b847-4dcd-9452-2cfd3b0cbe86 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:26.250079 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b0e07fa6-b847-4dcd-9452-2cfd3b0cbe86 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:26.257506 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b0e07fa6-b847-4dcd-9452-2cfd3b0cbe86 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1684 microversion: 2.1 time: 0.155203 Apr 16 21:57:26.258091 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3600/7041] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:26 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:27.274690 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-19c1488c-a455-4a8f-9f09-8c7ce28f3df1 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:27.275314 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-19c1488c-a455-4a8f-9f09-8c7ce28f3df1 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:27.282039 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-19c1488c-a455-4a8f-9f09-8c7ce28f3df1 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:27.282498 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-19c1488c-a455-4a8f-9f09-8c7ce28f3df1 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:27.283268 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-19c1488c-a455-4a8f-9f09-8c7ce28f3df1 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:27.283712 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-19c1488c-a455-4a8f-9f09-8c7ce28f3df1 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:27.414701 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-19c1488c-a455-4a8f-9f09-8c7ce28f3df1 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:27.422484 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-19c1488c-a455-4a8f-9f09-8c7ce28f3df1 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1684 microversion: 2.1 time: 0.151727 Apr 16 21:57:27.428467 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3442/7042] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:27 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:28.441586 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f448ee0b-2389-4a8b-93d4-519eb6798067 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:28.442221 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f448ee0b-2389-4a8b-93d4-519eb6798067 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:28.448304 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f448ee0b-2389-4a8b-93d4-519eb6798067 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:28.448785 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f448ee0b-2389-4a8b-93d4-519eb6798067 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:28.449586 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f448ee0b-2389-4a8b-93d4-519eb6798067 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:28.450053 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f448ee0b-2389-4a8b-93d4-519eb6798067 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:28.576125 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f448ee0b-2389-4a8b-93d4-519eb6798067 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:28.583503 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f448ee0b-2389-4a8b-93d4-519eb6798067 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1684 microversion: 2.1 time: 0.146741 Apr 16 21:57:28.584071 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3601/7043] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:28 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1684 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:29.601129 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e05dd26f-589a-432a-98cf-7d0ea5e7251d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:29.601759 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e05dd26f-589a-432a-98cf-7d0ea5e7251d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:29.610957 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e05dd26f-589a-432a-98cf-7d0ea5e7251d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:29.610957 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e05dd26f-589a-432a-98cf-7d0ea5e7251d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:29.611274 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e05dd26f-589a-432a-98cf-7d0ea5e7251d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:29.611584 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e05dd26f-589a-432a-98cf-7d0ea5e7251d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:29.744912 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e05dd26f-589a-432a-98cf-7d0ea5e7251d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:29.752910 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e05dd26f-589a-432a-98cf-7d0ea5e7251d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1684 microversion: 2.1 time: 0.155979 Apr 16 21:57:29.753485 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3443/7044] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:29 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:30.770923 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d43c0cf5-e3be-4b4f-b4d3-00293031ec2c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:30.771553 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d43c0cf5-e3be-4b4f-b4d3-00293031ec2c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:30.778457 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d43c0cf5-e3be-4b4f-b4d3-00293031ec2c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:30.778925 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d43c0cf5-e3be-4b4f-b4d3-00293031ec2c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:30.779715 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d43c0cf5-e3be-4b4f-b4d3-00293031ec2c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:30.780185 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d43c0cf5-e3be-4b4f-b4d3-00293031ec2c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:30.906102 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d43c0cf5-e3be-4b4f-b4d3-00293031ec2c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:30.915569 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d43c0cf5-e3be-4b4f-b4d3-00293031ec2c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1684 microversion: 2.1 time: 0.148549 Apr 16 21:57:30.916155 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3602/7045] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:30 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1684 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:31.932611 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-97b21db5-711e-4f7c-b651-c496ffead695 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:31.933232 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-97b21db5-711e-4f7c-b651-c496ffead695 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:31.940010 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-97b21db5-711e-4f7c-b651-c496ffead695 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:31.940449 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-97b21db5-711e-4f7c-b651-c496ffead695 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:31.941226 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-97b21db5-711e-4f7c-b651-c496ffead695 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:31.941671 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-97b21db5-711e-4f7c-b651-c496ffead695 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:32.071675 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-97b21db5-711e-4f7c-b651-c496ffead695 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:32.081208 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-97b21db5-711e-4f7c-b651-c496ffead695 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1684 microversion: 2.1 time: 0.152408 Apr 16 21:57:32.101555 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3444/7046] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:31 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:33.099144 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a68405c0-5026-4012-b457-6352c6622073 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:33.099795 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a68405c0-5026-4012-b457-6352c6622073 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:33.106566 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a68405c0-5026-4012-b457-6352c6622073 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:33.107060 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a68405c0-5026-4012-b457-6352c6622073 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:33.107846 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a68405c0-5026-4012-b457-6352c6622073 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:33.108329 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a68405c0-5026-4012-b457-6352c6622073 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:33.242041 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a68405c0-5026-4012-b457-6352c6622073 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:33.245919 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a68405c0-5026-4012-b457-6352c6622073 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1684 microversion: 2.1 time: 0.151021 Apr 16 21:57:33.246507 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3603/7047] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:33 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:57:34.262190 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8a2ae528-c9b0-4500-bfbb-f4baa2440b8a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:34.262814 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8a2ae528-c9b0-4500-bfbb-f4baa2440b8a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:34.269564 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8a2ae528-c9b0-4500-bfbb-f4baa2440b8a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:34.270023 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8a2ae528-c9b0-4500-bfbb-f4baa2440b8a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:34.270797 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8a2ae528-c9b0-4500-bfbb-f4baa2440b8a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:34.271244 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8a2ae528-c9b0-4500-bfbb-f4baa2440b8a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:34.398859 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8a2ae528-c9b0-4500-bfbb-f4baa2440b8a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:34.406177 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8a2ae528-c9b0-4500-bfbb-f4baa2440b8a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1684 microversion: 2.1 time: 0.147895 Apr 16 21:57:34.406742 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3445/7048] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:34 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1684 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:57:35.423109 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3d13f644-69ef-449c-bf98-d36d7b210260 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:35.423852 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3d13f644-69ef-449c-bf98-d36d7b210260 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:35.430907 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d13f644-69ef-449c-bf98-d36d7b210260 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:35.431386 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d13f644-69ef-449c-bf98-d36d7b210260 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:35.432208 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d13f644-69ef-449c-bf98-d36d7b210260 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:35.432674 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3d13f644-69ef-449c-bf98-d36d7b210260 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:35.561469 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3d13f644-69ef-449c-bf98-d36d7b210260 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:35.569694 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3d13f644-69ef-449c-bf98-d36d7b210260 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1684 microversion: 2.1 time: 0.150666 Apr 16 21:57:35.570281 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3604/7049] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:35 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1684 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:57:36.149759 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-95fd1f23-478e-4c85-b0d1-bbdb5461fa52 req-2316d202-1b5d-45b9-9949-44e8e5c3312f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55", "name": "network-vif-unplugged", "status": "completed", "tag": "650175dd-39b5-4078-a257-9030adcf5d2d"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:57:36.158867 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-95fd1f23-478e-4c85-b0d1-bbdb5461fa52 req-2316d202-1b5d-45b9-9949-44e8e5c3312f service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:36.159351 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-95fd1f23-478e-4c85-b0d1-bbdb5461fa52 req-2316d202-1b5d-45b9-9949-44e8e5c3312f service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:36.170683 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-95fd1f23-478e-4c85-b0d1-bbdb5461fa52 req-2316d202-1b5d-45b9-9949-44e8e5c3312f service nova] Creating event network-vif-unplugged:650175dd-39b5-4078-a257-9030adcf5d2d for instance 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 on nch2-master-1 Apr 16 21:57:36.176127 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [req-95fd1f23-478e-4c85-b0d1-bbdb5461fa52 req-2316d202-1b5d-45b9-9949-44e8e5c3312f service nova] Instance 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137409) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 16 21:57:36.187632 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-95fd1f23-478e-4c85-b0d1-bbdb5461fa52 req-2316d202-1b5d-45b9-9949-44e8e5c3312f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041144 Apr 16 21:57:36.188285 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3446/7050] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:57:36.587447 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-47c539f8-cd72-4a83-a14e-8bc2c261ee71 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:36.588336 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-47c539f8-cd72-4a83-a14e-8bc2c261ee71 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:36.595721 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-47c539f8-cd72-4a83-a14e-8bc2c261ee71 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:36.596194 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-47c539f8-cd72-4a83-a14e-8bc2c261ee71 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:36.597003 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-47c539f8-cd72-4a83-a14e-8bc2c261ee71 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:36.597726 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-47c539f8-cd72-4a83-a14e-8bc2c261ee71 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:36.745415 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-47c539f8-cd72-4a83-a14e-8bc2c261ee71 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:36.753396 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-47c539f8-cd72-4a83-a14e-8bc2c261ee71 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1683 microversion: 2.1 time: 0.170003 Apr 16 21:57:36.753976 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3605/7051] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:36 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1683 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:37.776892 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e47ca9e0-7120-449e-8e97-c4b4c29e6535 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:37.777622 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e47ca9e0-7120-449e-8e97-c4b4c29e6535 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:37.783789 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e47ca9e0-7120-449e-8e97-c4b4c29e6535 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:37.784277 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e47ca9e0-7120-449e-8e97-c4b4c29e6535 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:37.785053 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e47ca9e0-7120-449e-8e97-c4b4c29e6535 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:37.785497 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e47ca9e0-7120-449e-8e97-c4b4c29e6535 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:37.917970 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e47ca9e0-7120-449e-8e97-c4b4c29e6535 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:37.925814 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e47ca9e0-7120-449e-8e97-c4b4c29e6535 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1681 microversion: 2.1 time: 0.154044 Apr 16 21:57:37.926389 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3447/7052] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:37 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:38.202312 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-4284d22d-c2be-4fc0-a988-671e9f11a8d9 req-ece89a6a-24ae-4d5f-8b0b-e70c2f863ff2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55", "tag": "650175dd-39b5-4078-a257-9030adcf5d2d"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:57:38.211139 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-4284d22d-c2be-4fc0-a988-671e9f11a8d9 req-ece89a6a-24ae-4d5f-8b0b-e70c2f863ff2 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:38.211608 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-4284d22d-c2be-4fc0-a988-671e9f11a8d9 req-ece89a6a-24ae-4d5f-8b0b-e70c2f863ff2 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:38.223883 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-4284d22d-c2be-4fc0-a988-671e9f11a8d9 req-ece89a6a-24ae-4d5f-8b0b-e70c2f863ff2 service nova] Creating event network-changed:650175dd-39b5-4078-a257-9030adcf5d2d for instance 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 on nch2-master-1 Apr 16 21:57:38.229218 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [req-4284d22d-c2be-4fc0-a988-671e9f11a8d9 req-ece89a6a-24ae-4d5f-8b0b-e70c2f863ff2 service nova] Instance 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 16 21:57:38.240633 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-4284d22d-c2be-4fc0-a988-671e9f11a8d9 req-ece89a6a-24ae-4d5f-8b0b-e70c2f863ff2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042014 Apr 16 21:57:38.241222 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3606/7053] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:57:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:57:38.943556 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-90293ca8-607c-4848-8064-397c2e49a215 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:38.944265 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-90293ca8-607c-4848-8064-397c2e49a215 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:38.950925 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-90293ca8-607c-4848-8064-397c2e49a215 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:38.951390 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-90293ca8-607c-4848-8064-397c2e49a215 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:38.952196 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-90293ca8-607c-4848-8064-397c2e49a215 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:38.952699 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-90293ca8-607c-4848-8064-397c2e49a215 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:39.085479 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-90293ca8-607c-4848-8064-397c2e49a215 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:39.092858 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-90293ca8-607c-4848-8064-397c2e49a215 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1681 microversion: 2.1 time: 0.153197 Apr 16 21:57:39.093919 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3448/7054] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:38 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:57:40.112304 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-553576ae-246c-4f07-81b0-e3f4d4b633d0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:40.113051 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-553576ae-246c-4f07-81b0-e3f4d4b633d0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:40.119482 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-553576ae-246c-4f07-81b0-e3f4d4b633d0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:40.119959 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-553576ae-246c-4f07-81b0-e3f4d4b633d0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:40.120783 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-553576ae-246c-4f07-81b0-e3f4d4b633d0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:40.121321 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-553576ae-246c-4f07-81b0-e3f4d4b633d0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:40.324374 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-553576ae-246c-4f07-81b0-e3f4d4b633d0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:40.332238 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-553576ae-246c-4f07-81b0-e3f4d4b633d0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1681 microversion: 2.1 time: 0.225607 Apr 16 21:57:40.332845 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3607/7055] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:40 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1681 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:41.349520 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e54f85b2-56b3-4b4e-afcd-bc54b374a638 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:41.350131 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e54f85b2-56b3-4b4e-afcd-bc54b374a638 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:41.356873 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e54f85b2-56b3-4b4e-afcd-bc54b374a638 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:41.357328 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e54f85b2-56b3-4b4e-afcd-bc54b374a638 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:41.358090 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e54f85b2-56b3-4b4e-afcd-bc54b374a638 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:41.358616 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e54f85b2-56b3-4b4e-afcd-bc54b374a638 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:41.487919 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e54f85b2-56b3-4b4e-afcd-bc54b374a638 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:41.495277 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e54f85b2-56b3-4b4e-afcd-bc54b374a638 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1678 microversion: 2.1 time: 0.149924 Apr 16 21:57:41.495858 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3449/7056] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:41 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:41.513189 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-880c9d0c-3ffb-4be5-9e21-2de973871921 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:57:41.514358 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-880c9d0c-3ffb-4be5-9e21-2de973871921 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:41.521823 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-880c9d0c-3ffb-4be5-9e21-2de973871921 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:41.522301 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-880c9d0c-3ffb-4be5-9e21-2de973871921 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:41.523102 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-880c9d0c-3ffb-4be5-9e21-2de973871921 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:41.523563 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-880c9d0c-3ffb-4be5-9e21-2de973871921 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:41.727044 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-880c9d0c-3ffb-4be5-9e21-2de973871921 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "POST /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55/action" status: 204 len: 0 microversion: 2.1 time: 0.217762 Apr 16 21:57:41.732784 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3608/7057] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:57:41 2022] POST /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55/action => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:57:41.735684 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-11b82d61-e0b4-4ab0-901f-2bc1d044ef3e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:41.736329 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-11b82d61-e0b4-4ab0-901f-2bc1d044ef3e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:41.751406 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-11b82d61-e0b4-4ab0-901f-2bc1d044ef3e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:41.751866 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-11b82d61-e0b4-4ab0-901f-2bc1d044ef3e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:41.752675 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-11b82d61-e0b4-4ab0-901f-2bc1d044ef3e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:41.753117 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-11b82d61-e0b4-4ab0-901f-2bc1d044ef3e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:42.225933 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-11b82d61-e0b4-4ab0-901f-2bc1d044ef3e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:42.233443 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-11b82d61-e0b4-4ab0-901f-2bc1d044ef3e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1678 microversion: 2.1 time: 0.501570 Apr 16 21:57:42.234693 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3450/7058] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:41 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1678 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:43.253054 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8a181c7d-b1dc-420e-b96f-75558bab25b6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:43.253799 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8a181c7d-b1dc-420e-b96f-75558bab25b6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:43.259946 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8a181c7d-b1dc-420e-b96f-75558bab25b6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:43.260447 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8a181c7d-b1dc-420e-b96f-75558bab25b6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:43.261277 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8a181c7d-b1dc-420e-b96f-75558bab25b6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:43.261731 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8a181c7d-b1dc-420e-b96f-75558bab25b6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:43.397563 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8a181c7d-b1dc-420e-b96f-75558bab25b6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:43.405201 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8a181c7d-b1dc-420e-b96f-75558bab25b6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1678 microversion: 2.1 time: 0.158107 Apr 16 21:57:43.405781 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3609/7059] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:43 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:43.678067 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-f42939c6-1c99-48b8-9185-9e79e12c345c req-a9b15136-1e0d-400f-8f1d-f4c14370cef7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55", "name": "network-vif-plugged", "status": "completed", "tag": "650175dd-39b5-4078-a257-9030adcf5d2d"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:57:43.689213 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-f42939c6-1c99-48b8-9185-9e79e12c345c req-a9b15136-1e0d-400f-8f1d-f4c14370cef7 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:43.689674 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-f42939c6-1c99-48b8-9185-9e79e12c345c req-a9b15136-1e0d-400f-8f1d-f4c14370cef7 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:43.700686 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-f42939c6-1c99-48b8-9185-9e79e12c345c req-a9b15136-1e0d-400f-8f1d-f4c14370cef7 service nova] Creating event network-vif-plugged:650175dd-39b5-4078-a257-9030adcf5d2d for instance 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 on nch2-master-1 Apr 16 21:57:43.705892 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-f42939c6-1c99-48b8-9185-9e79e12c345c req-a9b15136-1e0d-400f-8f1d-f4c14370cef7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032515 Apr 16 21:57:43.708497 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3451/7060] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:57:44.422899 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fba18641-5b30-4217-b44e-a6d5eb79d041 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:44.423660 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fba18641-5b30-4217-b44e-a6d5eb79d041 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:44.430328 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fba18641-5b30-4217-b44e-a6d5eb79d041 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:44.430829 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fba18641-5b30-4217-b44e-a6d5eb79d041 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:44.431616 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fba18641-5b30-4217-b44e-a6d5eb79d041 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:44.432101 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fba18641-5b30-4217-b44e-a6d5eb79d041 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:44.557099 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fba18641-5b30-4217-b44e-a6d5eb79d041 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:44.565021 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fba18641-5b30-4217-b44e-a6d5eb79d041 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1670 microversion: 2.1 time: 0.146134 Apr 16 21:57:44.565584 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3610/7061] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:44 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1670 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:44.582641 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d3069165-1209-4288-8ba2-212c7fc4b7e5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:44.583352 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d3069165-1209-4288-8ba2-212c7fc4b7e5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:44.589450 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d3069165-1209-4288-8ba2-212c7fc4b7e5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:44.589917 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d3069165-1209-4288-8ba2-212c7fc4b7e5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:44.590697 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d3069165-1209-4288-8ba2-212c7fc4b7e5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:44.591148 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d3069165-1209-4288-8ba2-212c7fc4b7e5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:44.721223 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d3069165-1209-4288-8ba2-212c7fc4b7e5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:44.728949 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d3069165-1209-4288-8ba2-212c7fc4b7e5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1670 microversion: 2.1 time: 0.150528 Apr 16 21:57:44.729506 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3452/7062] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:44 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1670 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:44.745511 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-14140c02-a739-4112-b7e9-eab99d887790 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:44.746141 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-14140c02-a739-4112-b7e9-eab99d887790 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:44.752708 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-14140c02-a739-4112-b7e9-eab99d887790 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:44.753186 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-14140c02-a739-4112-b7e9-eab99d887790 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:44.754015 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-14140c02-a739-4112-b7e9-eab99d887790 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:44.754474 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-14140c02-a739-4112-b7e9-eab99d887790 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:44.878467 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-14140c02-a739-4112-b7e9-eab99d887790 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:44.885839 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-14140c02-a739-4112-b7e9-eab99d887790 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1670 microversion: 2.1 time: 0.144175 Apr 16 21:57:44.886408 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3611/7063] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:44 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1670 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:44.901484 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-43e91d79-b4cf-48e7-be8b-ed907979fa7a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:44.901983 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-43e91d79-b4cf-48e7-be8b-ed907979fa7a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:44.907835 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-43e91d79-b4cf-48e7-be8b-ed907979fa7a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:44.908359 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-43e91d79-b4cf-48e7-be8b-ed907979fa7a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:44.909127 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-43e91d79-b4cf-48e7-be8b-ed907979fa7a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:44.909564 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-43e91d79-b4cf-48e7-be8b-ed907979fa7a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:44.933134 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-43e91d79-b4cf-48e7-be8b-ed907979fa7a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:57:45.183460 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-43e91d79-b4cf-48e7-be8b-ed907979fa7a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 204 len: 0 microversion: 2.1 time: 0.285382 Apr 16 21:57:45.184039 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3453/7064] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:57:44 2022] DELETE /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:57:45.192620 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7c3a9887-f5e1-4ddd-9477-eb52f16d89f6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:45.193300 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7c3a9887-f5e1-4ddd-9477-eb52f16d89f6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:45.199506 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7c3a9887-f5e1-4ddd-9477-eb52f16d89f6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:45.199983 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7c3a9887-f5e1-4ddd-9477-eb52f16d89f6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:45.200827 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7c3a9887-f5e1-4ddd-9477-eb52f16d89f6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:45.201282 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7c3a9887-f5e1-4ddd-9477-eb52f16d89f6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:45.331512 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7c3a9887-f5e1-4ddd-9477-eb52f16d89f6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:45.339214 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7c3a9887-f5e1-4ddd-9477-eb52f16d89f6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1676 microversion: 2.1 time: 0.150687 Apr 16 21:57:45.339792 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3612/7065] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:45 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:46.357322 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d2ecc9aa-5d3e-48b6-aced-6c9d3286e6d3 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:46.358021 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d2ecc9aa-5d3e-48b6-aced-6c9d3286e6d3 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:46.365288 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d2ecc9aa-5d3e-48b6-aced-6c9d3286e6d3 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:46.365744 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d2ecc9aa-5d3e-48b6-aced-6c9d3286e6d3 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:46.366553 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d2ecc9aa-5d3e-48b6-aced-6c9d3286e6d3 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:46.366988 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d2ecc9aa-5d3e-48b6-aced-6c9d3286e6d3 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:46.494792 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d2ecc9aa-5d3e-48b6-aced-6c9d3286e6d3 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:46.502343 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d2ecc9aa-5d3e-48b6-aced-6c9d3286e6d3 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1676 microversion: 2.1 time: 0.149244 Apr 16 21:57:46.502967 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3454/7066] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:46 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:47.519866 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-17d7980e-3854-48b5-82e2-a409116af495 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:47.520827 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-17d7980e-3854-48b5-82e2-a409116af495 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:47.529462 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-17d7980e-3854-48b5-82e2-a409116af495 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:47.530038 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-17d7980e-3854-48b5-82e2-a409116af495 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:47.531906 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-17d7980e-3854-48b5-82e2-a409116af495 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:47.531906 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-17d7980e-3854-48b5-82e2-a409116af495 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:47.611929 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-17d7980e-3854-48b5-82e2-a409116af495 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:47.619956 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-17d7980e-3854-48b5-82e2-a409116af495 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 200 len: 1609 microversion: 2.1 time: 0.104767 Apr 16 21:57:47.620868 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3613/7067] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:47 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 1609 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:47.807626 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-a57b251b-5eaf-4729-bdf1-d80701cf12b1 req-77c53ac9-4f80-4e8b-81d4-1f72bcc90547 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55", "name": "network-vif-deleted", "tag": "650175dd-39b5-4078-a257-9030adcf5d2d"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:57:47.816782 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-a57b251b-5eaf-4729-bdf1-d80701cf12b1 req-77c53ac9-4f80-4e8b-81d4-1f72bcc90547 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:47.818163 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-a57b251b-5eaf-4729-bdf1-d80701cf12b1 req-77c53ac9-4f80-4e8b-81d4-1f72bcc90547 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:47.828368 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-a57b251b-5eaf-4729-bdf1-d80701cf12b1 req-77c53ac9-4f80-4e8b-81d4-1f72bcc90547 service nova] Creating event network-vif-deleted:650175dd-39b5-4078-a257-9030adcf5d2d for instance 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 on nch2-master-1 Apr 16 21:57:47.833844 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-a57b251b-5eaf-4729-bdf1-d80701cf12b1 req-77c53ac9-4f80-4e8b-81d4-1f72bcc90547 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030286 Apr 16 21:57:47.834755 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3455/7068] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:57:48.638278 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7a805abb-4456-4907-85f1-d8280db7efa7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:48.639012 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7a805abb-4456-4907-85f1-d8280db7efa7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:48.646244 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7a805abb-4456-4907-85f1-d8280db7efa7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:48.646887 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7a805abb-4456-4907-85f1-d8280db7efa7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:48.647714 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7a805abb-4456-4907-85f1-d8280db7efa7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:48.648152 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7a805abb-4456-4907-85f1-d8280db7efa7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:48.664982 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-7a805abb-4456-4907-85f1-d8280db7efa7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] HTTP exception thrown: Instance 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 could not be found. Apr 16 21:57:48.665611 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7a805abb-4456-4907-85f1-d8280db7efa7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Returning 404 to user: Instance 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:57:48.666504 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7a805abb-4456-4907-85f1-d8280db7efa7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 404 len: 111 microversion: 2.1 time: 0.032521 Apr 16 21:57:48.667226 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3614/7069] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:48 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:57:48.687854 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-eb6bd403-6c63-443e-a501-b137d797ec4c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:48.692269 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-eb6bd403-6c63-443e-a501-b137d797ec4c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:48.695221 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eb6bd403-6c63-443e-a501-b137d797ec4c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:48.695709 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eb6bd403-6c63-443e-a501-b137d797ec4c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:48.696524 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eb6bd403-6c63-443e-a501-b137d797ec4c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:48.696998 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eb6bd403-6c63-443e-a501-b137d797ec4c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:48.709998 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-eb6bd403-6c63-443e-a501-b137d797ec4c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] HTTP exception thrown: Instance 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 could not be found. Apr 16 21:57:48.710600 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-eb6bd403-6c63-443e-a501-b137d797ec4c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Returning 404 to user: Instance 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:57:48.711432 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-eb6bd403-6c63-443e-a501-b137d797ec4c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 404 len: 111 microversion: 2.1 time: 0.027949 Apr 16 21:57:48.711968 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3456/7070] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:48 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:57:48.788936 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ea074e9b-fc7b-49b6-826e-eb348e2498c7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-98044374", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "46ed5fd0-8613-4ef4-9bd7-a5169ec06285"}], "security_groups": [{"name": "tempest-securitygroup--937765651"}], "key_name": "tempest-keypair-1181093857", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:57:48.900250 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-ea074e9b-fc7b-49b6-826e-eb348e2498c7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] validate_networks() for [('46ed5fd0-8613-4ef4-9bd7-a5169ec06285', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:57:49.254792 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-ea074e9b-fc7b-49b6-826e-eb348e2498c7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:57:49.255254 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-ea074e9b-fc7b-49b6-826e-eb348e2498c7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:57:49.255754 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-ea074e9b-fc7b-49b6-826e-eb348e2498c7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:57:49.256279 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-ea074e9b-fc7b-49b6-826e-eb348e2498c7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:57:49.256729 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-ea074e9b-fc7b-49b6-826e-eb348e2498c7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:57:49.265763 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ea074e9b-fc7b-49b6-826e-eb348e2498c7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:49.266746 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ea074e9b-fc7b-49b6-826e-eb348e2498c7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:49.267579 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ea074e9b-fc7b-49b6-826e-eb348e2498c7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:49.268040 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ea074e9b-fc7b-49b6-826e-eb348e2498c7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:49.286595 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-ea074e9b-fc7b-49b6-826e-eb348e2498c7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Getting quotas for project 14958c4ca99847bfb86911005da65809. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:57:49.291987 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-ea074e9b-fc7b-49b6-826e-eb348e2498c7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Getting quotas for user 63b69490b00b49789e7859dca41f4a5d and project 14958c4ca99847bfb86911005da65809. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:57:49.304711 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ea074e9b-fc7b-49b6-826e-eb348e2498c7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:57:49.307006 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ea074e9b-fc7b-49b6-826e-eb348e2498c7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:57:49.425333 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ea074e9b-fc7b-49b6-826e-eb348e2498c7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.640337 Apr 16 21:57:49.425989 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3615/7071] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:57:48 2022] POST /compute/v2.1/servers => generated 405 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:57:49.436144 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3b61ccfc-b58d-4e54-b044-40f76bff6abb tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:49.436778 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3b61ccfc-b58d-4e54-b044-40f76bff6abb tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:49.492063 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3b61ccfc-b58d-4e54-b044-40f76bff6abb tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:49.502151 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3b61ccfc-b58d-4e54-b044-40f76bff6abb tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1237 microversion: 2.1 time: 0.069839 Apr 16 21:57:49.502724 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3457/7072] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:49 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:50.519782 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ba743983-631c-4d5c-8e2d-65455ab8b3e6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:50.520438 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ba743983-631c-4d5c-8e2d-65455ab8b3e6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:50.527386 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ba743983-631c-4d5c-8e2d-65455ab8b3e6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:50.527853 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ba743983-631c-4d5c-8e2d-65455ab8b3e6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:50.528673 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ba743983-631c-4d5c-8e2d-65455ab8b3e6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:50.529128 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ba743983-631c-4d5c-8e2d-65455ab8b3e6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:50.595180 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ba743983-631c-4d5c-8e2d-65455ab8b3e6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:50.602800 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ba743983-631c-4d5c-8e2d-65455ab8b3e6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1233 microversion: 2.1 time: 0.087456 Apr 16 21:57:50.606874 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3616/7073] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:50 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1233 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:51.619953 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-72aa1c2b-a3be-4e6e-b086-f5de8f3fbd4c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:51.620630 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-72aa1c2b-a3be-4e6e-b086-f5de8f3fbd4c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:51.628151 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-72aa1c2b-a3be-4e6e-b086-f5de8f3fbd4c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:51.628634 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-72aa1c2b-a3be-4e6e-b086-f5de8f3fbd4c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:51.629428 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-72aa1c2b-a3be-4e6e-b086-f5de8f3fbd4c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:51.629879 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-72aa1c2b-a3be-4e6e-b086-f5de8f3fbd4c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:51.691385 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-72aa1c2b-a3be-4e6e-b086-f5de8f3fbd4c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:51.698836 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-72aa1c2b-a3be-4e6e-b086-f5de8f3fbd4c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1295 microversion: 2.1 time: 0.082824 Apr 16 21:57:51.699414 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3458/7074] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:51 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1295 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:52.716961 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0245f304-1e0a-49e8-9fc1-09a5e00a777f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:52.718330 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0245f304-1e0a-49e8-9fc1-09a5e00a777f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:52.728249 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0245f304-1e0a-49e8-9fc1-09a5e00a777f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:52.728726 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0245f304-1e0a-49e8-9fc1-09a5e00a777f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:52.729529 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0245f304-1e0a-49e8-9fc1-09a5e00a777f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:52.729992 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0245f304-1e0a-49e8-9fc1-09a5e00a777f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:52.884253 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-ea17635e-697b-4890-bd3b-f9655497a495 req-7fc406f1-ac61-4799-8563-ede4b3fa68f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81b47b35-6871-4fbd-964c-a9d15b453d7b", "tag": "7c8852e9-bee2-41a6-a668-793128d7c0c3"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:57:52.894021 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-ea17635e-697b-4890-bd3b-f9655497a495 req-7fc406f1-ac61-4799-8563-ede4b3fa68f0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:52.894481 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-ea17635e-697b-4890-bd3b-f9655497a495 req-7fc406f1-ac61-4799-8563-ede4b3fa68f0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:52.914982 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-ea17635e-697b-4890-bd3b-f9655497a495 req-7fc406f1-ac61-4799-8563-ede4b3fa68f0 service nova] Creating event network-changed:7c8852e9-bee2-41a6-a668-793128d7c0c3 for instance 81b47b35-6871-4fbd-964c-a9d15b453d7b on nch2-master-1 Apr 16 21:57:52.920629 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-ea17635e-697b-4890-bd3b-f9655497a495 req-7fc406f1-ac61-4799-8563-ede4b3fa68f0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039532 Apr 16 21:57:52.921242 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3459/7075] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:57:52.927194 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0245f304-1e0a-49e8-9fc1-09a5e00a777f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:52.935218 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0245f304-1e0a-49e8-9fc1-09a5e00a777f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1362 microversion: 2.1 time: 0.222198 Apr 16 21:57:52.946056 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3617/7076] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:52 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:53.953930 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2346804c-0a6d-4da9-864e-72ea46a49eec tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:53.955170 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2346804c-0a6d-4da9-864e-72ea46a49eec tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:53.962174 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2346804c-0a6d-4da9-864e-72ea46a49eec tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:53.962631 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2346804c-0a6d-4da9-864e-72ea46a49eec tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:53.963505 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2346804c-0a6d-4da9-864e-72ea46a49eec tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:53.963961 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2346804c-0a6d-4da9-864e-72ea46a49eec tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:54.093603 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2346804c-0a6d-4da9-864e-72ea46a49eec tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:54.101067 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2346804c-0a6d-4da9-864e-72ea46a49eec tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1362 microversion: 2.1 time: 0.151554 Apr 16 21:57:54.101635 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3460/7077] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:53 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:55.118868 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d949e75e-a0f8-47fe-a526-0d94847bdf5d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:55.119528 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d949e75e-a0f8-47fe-a526-0d94847bdf5d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:55.126393 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d949e75e-a0f8-47fe-a526-0d94847bdf5d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:55.126860 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d949e75e-a0f8-47fe-a526-0d94847bdf5d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:55.127648 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d949e75e-a0f8-47fe-a526-0d94847bdf5d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:55.128103 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d949e75e-a0f8-47fe-a526-0d94847bdf5d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:55.258357 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d949e75e-a0f8-47fe-a526-0d94847bdf5d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:55.265689 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d949e75e-a0f8-47fe-a526-0d94847bdf5d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1362 microversion: 2.1 time: 0.150736 Apr 16 21:57:55.266260 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3618/7078] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:55 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:56.282910 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-243d4050-7217-4d4a-a29d-6e4c18b7063a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:56.283524 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-243d4050-7217-4d4a-a29d-6e4c18b7063a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:56.290272 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-243d4050-7217-4d4a-a29d-6e4c18b7063a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:56.291889 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-243d4050-7217-4d4a-a29d-6e4c18b7063a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:56.291889 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-243d4050-7217-4d4a-a29d-6e4c18b7063a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:56.291889 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-243d4050-7217-4d4a-a29d-6e4c18b7063a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:56.513723 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-243d4050-7217-4d4a-a29d-6e4c18b7063a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:56.521764 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-243d4050-7217-4d4a-a29d-6e4c18b7063a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1362 microversion: 2.1 time: 0.242822 Apr 16 21:57:56.522330 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3461/7079] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:56 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1362 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:57.539455 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-08c62c43-826d-42bb-ba60-52d426c57453 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:57.540110 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-08c62c43-826d-42bb-ba60-52d426c57453 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:57.546405 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-08c62c43-826d-42bb-ba60-52d426c57453 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:57.546884 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-08c62c43-826d-42bb-ba60-52d426c57453 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:57.547688 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-08c62c43-826d-42bb-ba60-52d426c57453 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:57.548149 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-08c62c43-826d-42bb-ba60-52d426c57453 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:57.756433 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-08c62c43-826d-42bb-ba60-52d426c57453 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:57.763960 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-08c62c43-826d-42bb-ba60-52d426c57453 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1362 microversion: 2.1 time: 0.228578 Apr 16 21:57:57.770172 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3619/7080] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:57 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:57:58.781329 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-78d6e138-a85c-46b6-bb59-82424ab1efd9 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:58.782533 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-78d6e138-a85c-46b6-bb59-82424ab1efd9 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:58.789224 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-78d6e138-a85c-46b6-bb59-82424ab1efd9 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:58.789681 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-78d6e138-a85c-46b6-bb59-82424ab1efd9 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:58.790454 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-78d6e138-a85c-46b6-bb59-82424ab1efd9 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:58.790901 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-78d6e138-a85c-46b6-bb59-82424ab1efd9 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:58.918904 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-78d6e138-a85c-46b6-bb59-82424ab1efd9 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:57:58.926496 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-78d6e138-a85c-46b6-bb59-82424ab1efd9 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1362 microversion: 2.1 time: 0.148945 Apr 16 21:57:58.927071 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3462/7081] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:58 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:57:59.724783 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-29cd9104-2ef1-4fc0-9bab-1b1a1c7cf277 req-627aa9fc-3aaf-4166-92c4-fbd0c07da720 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81b47b35-6871-4fbd-964c-a9d15b453d7b", "name": "network-vif-plugged", "status": "completed", "tag": "7c8852e9-bee2-41a6-a668-793128d7c0c3"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:57:59.734481 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-29cd9104-2ef1-4fc0-9bab-1b1a1c7cf277 req-627aa9fc-3aaf-4166-92c4-fbd0c07da720 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:59.734960 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-29cd9104-2ef1-4fc0-9bab-1b1a1c7cf277 req-627aa9fc-3aaf-4166-92c4-fbd0c07da720 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:59.746279 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-29cd9104-2ef1-4fc0-9bab-1b1a1c7cf277 req-627aa9fc-3aaf-4166-92c4-fbd0c07da720 service nova] Creating event network-vif-plugged:7c8852e9-bee2-41a6-a668-793128d7c0c3 for instance 81b47b35-6871-4fbd-964c-a9d15b453d7b on nch2-master-1 Apr 16 21:57:59.751465 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-29cd9104-2ef1-4fc0-9bab-1b1a1c7cf277 req-627aa9fc-3aaf-4166-92c4-fbd0c07da720 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030774 Apr 16 21:57:59.752046 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3620/7082] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:57:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:57:59.944511 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1459c081-6bc6-4968-9ea6-a15ad5aaf88d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:57:59.945073 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1459c081-6bc6-4968-9ea6-a15ad5aaf88d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:57:59.952070 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1459c081-6bc6-4968-9ea6-a15ad5aaf88d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:59.952576 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1459c081-6bc6-4968-9ea6-a15ad5aaf88d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:57:59.953380 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1459c081-6bc6-4968-9ea6-a15ad5aaf88d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:57:59.954483 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1459c081-6bc6-4968-9ea6-a15ad5aaf88d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:00.084299 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1459c081-6bc6-4968-9ea6-a15ad5aaf88d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:00.091512 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1459c081-6bc6-4968-9ea6-a15ad5aaf88d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1362 microversion: 2.1 time: 0.151163 Apr 16 21:58:00.092077 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3463/7083] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:57:59 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:58:01.111764 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-51ba6d29-eb06-47db-8c0b-b76d66a07c76 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:01.112502 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-51ba6d29-eb06-47db-8c0b-b76d66a07c76 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:01.118609 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-51ba6d29-eb06-47db-8c0b-b76d66a07c76 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:01.119080 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-51ba6d29-eb06-47db-8c0b-b76d66a07c76 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:01.119862 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-51ba6d29-eb06-47db-8c0b-b76d66a07c76 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:01.120356 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-51ba6d29-eb06-47db-8c0b-b76d66a07c76 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:01.246746 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-51ba6d29-eb06-47db-8c0b-b76d66a07c76 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:01.257596 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-51ba6d29-eb06-47db-8c0b-b76d66a07c76 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1362 microversion: 2.1 time: 0.148805 Apr 16 21:58:01.257596 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3621/7084] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:01 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:58:02.273140 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4a3987d6-889f-423b-b9e1-eb9ce21fa4e6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:02.273765 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4a3987d6-889f-423b-b9e1-eb9ce21fa4e6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:02.280533 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4a3987d6-889f-423b-b9e1-eb9ce21fa4e6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:02.280985 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4a3987d6-889f-423b-b9e1-eb9ce21fa4e6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:02.281777 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4a3987d6-889f-423b-b9e1-eb9ce21fa4e6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:02.282230 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4a3987d6-889f-423b-b9e1-eb9ce21fa4e6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:02.412605 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4a3987d6-889f-423b-b9e1-eb9ce21fa4e6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:02.419888 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4a3987d6-889f-423b-b9e1-eb9ce21fa4e6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1550 microversion: 2.1 time: 0.150735 Apr 16 21:58:02.420491 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3464/7085] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:02 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1550 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:58:02.436468 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c2187d7f-6402-43da-ab75-8d358bd83697 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:02.437035 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c2187d7f-6402-43da-ab75-8d358bd83697 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:02.444412 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c2187d7f-6402-43da-ab75-8d358bd83697 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:02.444882 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c2187d7f-6402-43da-ab75-8d358bd83697 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:02.445669 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c2187d7f-6402-43da-ab75-8d358bd83697 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:02.446124 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c2187d7f-6402-43da-ab75-8d358bd83697 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:02.525234 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c2187d7f-6402-43da-ab75-8d358bd83697 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092726 Apr 16 21:58:02.525889 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3622/7086] 10.222.0.20 () {58 vars in 1274 bytes} [Sat Apr 16 21:58:02 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:58:03.554498 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1bb486c2-94d9-4d39-aa47-f14096ab6e67 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:58:03.563832 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-3a530650-2825-46de-8471-f1f334be739b req-3e83ae6b-a268-4544-b8ec-d13bd25ed0c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81b47b35-6871-4fbd-964c-a9d15b453d7b", "tag": "7c8852e9-bee2-41a6-a668-793128d7c0c3"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:58:03.567085 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1bb486c2-94d9-4d39-aa47-f14096ab6e67 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:03.568102 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1bb486c2-94d9-4d39-aa47-f14096ab6e67 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:03.571956 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-3a530650-2825-46de-8471-f1f334be739b req-3e83ae6b-a268-4544-b8ec-d13bd25ed0c0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:03.572694 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-3a530650-2825-46de-8471-f1f334be739b req-3e83ae6b-a268-4544-b8ec-d13bd25ed0c0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:03.584973 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-3a530650-2825-46de-8471-f1f334be739b req-3e83ae6b-a268-4544-b8ec-d13bd25ed0c0 service nova] Creating event network-changed:7c8852e9-bee2-41a6-a668-793128d7c0c3 for instance 81b47b35-6871-4fbd-964c-a9d15b453d7b on nch2-master-1 Apr 16 21:58:03.590044 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-3a530650-2825-46de-8471-f1f334be739b req-3e83ae6b-a268-4544-b8ec-d13bd25ed0c0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033767 Apr 16 21:58:03.590652 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3623/7087] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:58:03.594977 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1bb486c2-94d9-4d39-aa47-f14096ab6e67 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Going to try to stop instance {{(pid=137409) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 16 21:58:03.794937 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1bb486c2-94d9-4d39-aa47-f14096ab6e67 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "POST /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b/action" status: 202 len: 0 microversion: 2.1 time: 0.244518 Apr 16 21:58:03.796085 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3465/7088] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:58:03 2022] POST /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:58:03.804556 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c88288d7-7af2-4423-aa17-31c98d5def7f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:03.805486 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c88288d7-7af2-4423-aa17-31c98d5def7f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:03.812006 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c88288d7-7af2-4423-aa17-31c98d5def7f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:03.812810 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c88288d7-7af2-4423-aa17-31c98d5def7f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:03.814548 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c88288d7-7af2-4423-aa17-31c98d5def7f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:03.815245 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c88288d7-7af2-4423-aa17-31c98d5def7f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:04.009305 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c88288d7-7af2-4423-aa17-31c98d5def7f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:04.019313 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c88288d7-7af2-4423-aa17-31c98d5def7f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1560 microversion: 2.1 time: 0.219178 Apr 16 21:58:04.021177 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3624/7089] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:03 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1560 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:58:05.038543 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-193f16d5-4f28-4e49-ab26-cf25d345ad93 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:05.039178 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-193f16d5-4f28-4e49-ab26-cf25d345ad93 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:05.045412 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-193f16d5-4f28-4e49-ab26-cf25d345ad93 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:05.045890 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-193f16d5-4f28-4e49-ab26-cf25d345ad93 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:05.046680 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-193f16d5-4f28-4e49-ab26-cf25d345ad93 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:05.047133 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-193f16d5-4f28-4e49-ab26-cf25d345ad93 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:05.172412 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-193f16d5-4f28-4e49-ab26-cf25d345ad93 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:05.179821 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-193f16d5-4f28-4e49-ab26-cf25d345ad93 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1679 microversion: 2.1 time: 0.146427 Apr 16 21:58:05.180431 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3466/7090] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:05 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1679 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:58:06.198272 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-32439106-3047-4c62-81cb-d687d03cfbe0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:06.198936 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-32439106-3047-4c62-81cb-d687d03cfbe0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:06.206307 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-32439106-3047-4c62-81cb-d687d03cfbe0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:06.206787 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-32439106-3047-4c62-81cb-d687d03cfbe0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:06.207585 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-32439106-3047-4c62-81cb-d687d03cfbe0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:06.208046 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-32439106-3047-4c62-81cb-d687d03cfbe0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:06.334035 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-32439106-3047-4c62-81cb-d687d03cfbe0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:06.341538 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-32439106-3047-4c62-81cb-d687d03cfbe0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1679 microversion: 2.1 time: 0.147165 Apr 16 21:58:06.342118 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3625/7091] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:06 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1679 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:58:07.358854 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-06e23b8b-2a5e-4a8b-8753-1bb0aecd1611 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:07.359466 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-06e23b8b-2a5e-4a8b-8753-1bb0aecd1611 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:07.366320 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-06e23b8b-2a5e-4a8b-8753-1bb0aecd1611 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:07.366795 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-06e23b8b-2a5e-4a8b-8753-1bb0aecd1611 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:07.367583 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-06e23b8b-2a5e-4a8b-8753-1bb0aecd1611 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:07.368040 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-06e23b8b-2a5e-4a8b-8753-1bb0aecd1611 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:07.492569 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-06e23b8b-2a5e-4a8b-8753-1bb0aecd1611 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:07.499913 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-06e23b8b-2a5e-4a8b-8753-1bb0aecd1611 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1679 microversion: 2.1 time: 0.145003 Apr 16 21:58:07.501094 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3467/7092] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:07 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1679 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:58:08.518278 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d6633c67-a6bd-425e-99e9-7d455e2bf311 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:08.518940 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d6633c67-a6bd-425e-99e9-7d455e2bf311 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:08.525887 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d6633c67-a6bd-425e-99e9-7d455e2bf311 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:08.526370 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d6633c67-a6bd-425e-99e9-7d455e2bf311 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:08.527171 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d6633c67-a6bd-425e-99e9-7d455e2bf311 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:08.527635 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d6633c67-a6bd-425e-99e9-7d455e2bf311 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:08.657543 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d6633c67-a6bd-425e-99e9-7d455e2bf311 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:08.664908 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d6633c67-a6bd-425e-99e9-7d455e2bf311 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1679 microversion: 2.1 time: 0.151114 Apr 16 21:58:08.665476 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3626/7093] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:08 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:58:09.681926 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1f0398fe-68e1-4f2d-8bb8-f09ed343b4ee tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:09.682545 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1f0398fe-68e1-4f2d-8bb8-f09ed343b4ee tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:09.689773 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1f0398fe-68e1-4f2d-8bb8-f09ed343b4ee tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:09.690237 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1f0398fe-68e1-4f2d-8bb8-f09ed343b4ee tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:09.691018 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1f0398fe-68e1-4f2d-8bb8-f09ed343b4ee tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:09.691469 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1f0398fe-68e1-4f2d-8bb8-f09ed343b4ee tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:09.819712 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1f0398fe-68e1-4f2d-8bb8-f09ed343b4ee tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:09.827006 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1f0398fe-68e1-4f2d-8bb8-f09ed343b4ee tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1679 microversion: 2.1 time: 0.149103 Apr 16 21:58:09.827571 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3468/7094] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:09 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:58:10.844255 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a9f4a5b2-b941-4c48-bb6b-3a91eff29c6a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:10.844825 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a9f4a5b2-b941-4c48-bb6b-3a91eff29c6a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:10.851974 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9f4a5b2-b941-4c48-bb6b-3a91eff29c6a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:10.852490 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9f4a5b2-b941-4c48-bb6b-3a91eff29c6a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:10.853303 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9f4a5b2-b941-4c48-bb6b-3a91eff29c6a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:10.853763 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a9f4a5b2-b941-4c48-bb6b-3a91eff29c6a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:10.979658 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a9f4a5b2-b941-4c48-bb6b-3a91eff29c6a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:10.987224 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a9f4a5b2-b941-4c48-bb6b-3a91eff29c6a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1679 microversion: 2.1 time: 0.146994 Apr 16 21:58:10.987801 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3627/7095] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:10 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1679 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:58:12.004991 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9caa5f76-1048-4d2f-82b1-a8eec188e418 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:12.005555 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9caa5f76-1048-4d2f-82b1-a8eec188e418 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:12.012300 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9caa5f76-1048-4d2f-82b1-a8eec188e418 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:12.012768 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9caa5f76-1048-4d2f-82b1-a8eec188e418 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:12.013550 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9caa5f76-1048-4d2f-82b1-a8eec188e418 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:12.014002 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9caa5f76-1048-4d2f-82b1-a8eec188e418 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:12.139474 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9caa5f76-1048-4d2f-82b1-a8eec188e418 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:12.146794 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9caa5f76-1048-4d2f-82b1-a8eec188e418 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1679 microversion: 2.1 time: 0.146398 Apr 16 21:58:12.147362 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3469/7096] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:11 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1679 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:58:13.163956 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5449959d-9e4e-4d44-bf26-9a5bc528278f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:13.164637 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5449959d-9e4e-4d44-bf26-9a5bc528278f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:13.171668 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5449959d-9e4e-4d44-bf26-9a5bc528278f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:13.172143 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5449959d-9e4e-4d44-bf26-9a5bc528278f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:13.172975 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5449959d-9e4e-4d44-bf26-9a5bc528278f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:13.173415 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5449959d-9e4e-4d44-bf26-9a5bc528278f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:13.298964 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5449959d-9e4e-4d44-bf26-9a5bc528278f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:13.306448 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5449959d-9e4e-4d44-bf26-9a5bc528278f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1679 microversion: 2.1 time: 0.146643 Apr 16 21:58:13.307020 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3628/7097] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:13 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1679 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:58:14.324497 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cda788b7-2fec-4498-a1c1-daf9cd78bb81 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:14.325152 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-cda788b7-2fec-4498-a1c1-daf9cd78bb81 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:14.332850 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cda788b7-2fec-4498-a1c1-daf9cd78bb81 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:14.333299 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cda788b7-2fec-4498-a1c1-daf9cd78bb81 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:14.334078 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cda788b7-2fec-4498-a1c1-daf9cd78bb81 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:14.334518 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cda788b7-2fec-4498-a1c1-daf9cd78bb81 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:14.466484 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cda788b7-2fec-4498-a1c1-daf9cd78bb81 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:14.474162 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cda788b7-2fec-4498-a1c1-daf9cd78bb81 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1679 microversion: 2.1 time: 0.153618 Apr 16 21:58:14.474734 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3470/7098] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:14 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:58:15.490944 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-aebb17c3-87a3-4ef8-818c-07faf515a43e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:15.491586 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-aebb17c3-87a3-4ef8-818c-07faf515a43e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:15.498537 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aebb17c3-87a3-4ef8-818c-07faf515a43e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:15.499015 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aebb17c3-87a3-4ef8-818c-07faf515a43e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:15.499816 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aebb17c3-87a3-4ef8-818c-07faf515a43e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:15.500306 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-aebb17c3-87a3-4ef8-818c-07faf515a43e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:15.632538 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-aebb17c3-87a3-4ef8-818c-07faf515a43e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:15.640040 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-aebb17c3-87a3-4ef8-818c-07faf515a43e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1679 microversion: 2.1 time: 0.153061 Apr 16 21:58:15.640672 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3629/7099] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:15 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:58:16.657535 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-346d4ad8-042e-421d-9d4a-5281e0bd57e0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:16.658674 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-346d4ad8-042e-421d-9d4a-5281e0bd57e0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:16.665463 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-346d4ad8-042e-421d-9d4a-5281e0bd57e0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:16.665931 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-346d4ad8-042e-421d-9d4a-5281e0bd57e0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:16.666715 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-346d4ad8-042e-421d-9d4a-5281e0bd57e0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:16.667168 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-346d4ad8-042e-421d-9d4a-5281e0bd57e0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:16.794575 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-346d4ad8-042e-421d-9d4a-5281e0bd57e0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:16.801951 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-346d4ad8-042e-421d-9d4a-5281e0bd57e0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1679 microversion: 2.1 time: 0.148411 Apr 16 21:58:16.802523 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3471/7100] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:16 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:58:17.818885 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-04ec19dd-5782-47df-b016-31479892f67b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:17.819530 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-04ec19dd-5782-47df-b016-31479892f67b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:17.826511 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-04ec19dd-5782-47df-b016-31479892f67b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:17.826977 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-04ec19dd-5782-47df-b016-31479892f67b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:17.827797 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-04ec19dd-5782-47df-b016-31479892f67b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:17.828289 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-04ec19dd-5782-47df-b016-31479892f67b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:17.956040 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-04ec19dd-5782-47df-b016-31479892f67b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:17.963437 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-04ec19dd-5782-47df-b016-31479892f67b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1679 microversion: 2.1 time: 0.148546 Apr 16 21:58:17.964007 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3630/7101] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:17 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:58:18.980508 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-18b75525-aa88-4253-8ca4-92c6953489da tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:18.982733 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-18b75525-aa88-4253-8ca4-92c6953489da tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:18.988717 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-18b75525-aa88-4253-8ca4-92c6953489da tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:18.989140 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-18b75525-aa88-4253-8ca4-92c6953489da tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:18.989917 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-18b75525-aa88-4253-8ca4-92c6953489da tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:18.990362 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-18b75525-aa88-4253-8ca4-92c6953489da tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:19.115534 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-18b75525-aa88-4253-8ca4-92c6953489da tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:19.122922 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-18b75525-aa88-4253-8ca4-92c6953489da tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1679 microversion: 2.1 time: 0.146394 Apr 16 21:58:19.123533 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3472/7102] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:18 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1679 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:58:20.139673 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ef6f62e8-0e4c-48af-86f4-1f7fe9e9a33e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:20.140341 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ef6f62e8-0e4c-48af-86f4-1f7fe9e9a33e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:20.147194 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ef6f62e8-0e4c-48af-86f4-1f7fe9e9a33e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:20.147673 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ef6f62e8-0e4c-48af-86f4-1f7fe9e9a33e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:20.148503 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ef6f62e8-0e4c-48af-86f4-1f7fe9e9a33e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:20.148966 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ef6f62e8-0e4c-48af-86f4-1f7fe9e9a33e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:20.276940 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ef6f62e8-0e4c-48af-86f4-1f7fe9e9a33e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:20.284841 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ef6f62e8-0e4c-48af-86f4-1f7fe9e9a33e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1679 microversion: 2.1 time: 0.149152 Apr 16 21:58:20.297320 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3631/7103] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:20 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:58:21.302514 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2aad3e52-a324-4646-84da-afd6a4edd631 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:21.303126 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2aad3e52-a324-4646-84da-afd6a4edd631 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:21.309909 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2aad3e52-a324-4646-84da-afd6a4edd631 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:21.310391 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2aad3e52-a324-4646-84da-afd6a4edd631 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:21.311167 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2aad3e52-a324-4646-84da-afd6a4edd631 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:21.311698 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2aad3e52-a324-4646-84da-afd6a4edd631 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:21.441299 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2aad3e52-a324-4646-84da-afd6a4edd631 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:21.448608 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2aad3e52-a324-4646-84da-afd6a4edd631 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1679 microversion: 2.1 time: 0.150501 Apr 16 21:58:21.449179 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3473/7104] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:21 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:58:22.465049 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6bc1fc1c-ad3d-4ffc-935f-d55e143728e6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:22.465614 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6bc1fc1c-ad3d-4ffc-935f-d55e143728e6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:22.472709 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6bc1fc1c-ad3d-4ffc-935f-d55e143728e6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:22.473185 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6bc1fc1c-ad3d-4ffc-935f-d55e143728e6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:22.473974 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6bc1fc1c-ad3d-4ffc-935f-d55e143728e6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:22.474436 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6bc1fc1c-ad3d-4ffc-935f-d55e143728e6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:22.600359 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6bc1fc1c-ad3d-4ffc-935f-d55e143728e6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:22.607746 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6bc1fc1c-ad3d-4ffc-935f-d55e143728e6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1679 microversion: 2.1 time: 0.146747 Apr 16 21:58:22.608350 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3632/7105] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:22 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1679 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:58:23.625348 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bf24b02e-eaa5-45ae-8f18-83020fdc1737 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:23.625960 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bf24b02e-eaa5-45ae-8f18-83020fdc1737 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:23.632706 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bf24b02e-eaa5-45ae-8f18-83020fdc1737 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:23.633165 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bf24b02e-eaa5-45ae-8f18-83020fdc1737 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:23.633940 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bf24b02e-eaa5-45ae-8f18-83020fdc1737 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:23.634385 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bf24b02e-eaa5-45ae-8f18-83020fdc1737 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:23.759100 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-bf24b02e-eaa5-45ae-8f18-83020fdc1737 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:23.766492 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bf24b02e-eaa5-45ae-8f18-83020fdc1737 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1679 microversion: 2.1 time: 0.145029 Apr 16 21:58:23.767587 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3474/7106] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:23 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1679 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:58:24.783664 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8e956c66-0448-4ae6-b692-41a427c36556 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:24.784527 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8e956c66-0448-4ae6-b692-41a427c36556 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:24.791666 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8e956c66-0448-4ae6-b692-41a427c36556 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:24.792149 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8e956c66-0448-4ae6-b692-41a427c36556 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:24.792976 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8e956c66-0448-4ae6-b692-41a427c36556 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:24.793442 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8e956c66-0448-4ae6-b692-41a427c36556 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:24.918708 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8e956c66-0448-4ae6-b692-41a427c36556 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:24.926681 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8e956c66-0448-4ae6-b692-41a427c36556 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1679 microversion: 2.1 time: 0.147394 Apr 16 21:58:24.927263 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3633/7107] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:24 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1679 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:58:25.944127 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-db2d234e-55d2-4e53-b11a-946a34138fb8 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:25.944715 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-db2d234e-55d2-4e53-b11a-946a34138fb8 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:25.950647 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-db2d234e-55d2-4e53-b11a-946a34138fb8 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:25.951106 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-db2d234e-55d2-4e53-b11a-946a34138fb8 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:25.951876 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-db2d234e-55d2-4e53-b11a-946a34138fb8 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:25.952355 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-db2d234e-55d2-4e53-b11a-946a34138fb8 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:26.081254 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-db2d234e-55d2-4e53-b11a-946a34138fb8 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:26.088561 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-db2d234e-55d2-4e53-b11a-946a34138fb8 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1679 microversion: 2.1 time: 0.148725 Apr 16 21:58:26.089137 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3475/7108] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:25 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:58:27.108372 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9bdd9960-5659-4ede-abb2-32972a7194a6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:27.109008 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9bdd9960-5659-4ede-abb2-32972a7194a6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:27.115196 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9bdd9960-5659-4ede-abb2-32972a7194a6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:27.115670 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9bdd9960-5659-4ede-abb2-32972a7194a6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:27.116495 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9bdd9960-5659-4ede-abb2-32972a7194a6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:27.116953 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9bdd9960-5659-4ede-abb2-32972a7194a6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:27.254671 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9bdd9960-5659-4ede-abb2-32972a7194a6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:27.262237 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9bdd9960-5659-4ede-abb2-32972a7194a6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1679 microversion: 2.1 time: 0.159717 Apr 16 21:58:27.262812 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3634/7109] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:27 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:58:28.279293 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-11c96743-cba6-47a9-9339-7aa07d070f3f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:28.279911 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-11c96743-cba6-47a9-9339-7aa07d070f3f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:28.286684 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-11c96743-cba6-47a9-9339-7aa07d070f3f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:28.287140 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-11c96743-cba6-47a9-9339-7aa07d070f3f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:28.287918 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-11c96743-cba6-47a9-9339-7aa07d070f3f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:28.288397 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-11c96743-cba6-47a9-9339-7aa07d070f3f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:28.419883 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-11c96743-cba6-47a9-9339-7aa07d070f3f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:28.427954 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-11c96743-cba6-47a9-9339-7aa07d070f3f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1679 microversion: 2.1 time: 0.152550 Apr 16 21:58:28.428542 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3476/7110] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:28 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:58:29.445016 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2d28bd4c-4133-41da-964b-c70e8f641785 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:29.445654 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2d28bd4c-4133-41da-964b-c70e8f641785 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:29.452522 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2d28bd4c-4133-41da-964b-c70e8f641785 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:29.453010 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2d28bd4c-4133-41da-964b-c70e8f641785 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:29.453839 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2d28bd4c-4133-41da-964b-c70e8f641785 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:29.454348 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2d28bd4c-4133-41da-964b-c70e8f641785 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:29.584108 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2d28bd4c-4133-41da-964b-c70e8f641785 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:29.591609 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2d28bd4c-4133-41da-964b-c70e8f641785 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1656 microversion: 2.1 time: 0.150540 Apr 16 21:58:29.592196 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3635/7111] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:29 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1656 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:58:29.608896 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bfa4a131-31ad-4384-a095-a4644d53f3cd tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:58:29.609875 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bfa4a131-31ad-4384-a095-a4644d53f3cd tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:29.616815 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bfa4a131-31ad-4384-a095-a4644d53f3cd tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:29.617279 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bfa4a131-31ad-4384-a095-a4644d53f3cd tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:29.618169 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bfa4a131-31ad-4384-a095-a4644d53f3cd tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:29.618668 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bfa4a131-31ad-4384-a095-a4644d53f3cd tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:29.646578 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-bfa4a131-31ad-4384-a095-a4644d53f3cd tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:29.652496 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bfa4a131-31ad-4384-a095-a4644d53f3cd tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Old instance type m1.heat2, new instance type m1.heat {{(pid=137409) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 16 21:58:29.659369 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-bfa4a131-31ad-4384-a095-a4644d53f3cd tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:58:29.659822 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-bfa4a131-31ad-4384-a095-a4644d53f3cd tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:58:29.660342 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-bfa4a131-31ad-4384-a095-a4644d53f3cd tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:58:29.660759 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-bfa4a131-31ad-4384-a095-a4644d53f3cd tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:58:29.661170 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-bfa4a131-31ad-4384-a095-a4644d53f3cd tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:58:29.886603 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bfa4a131-31ad-4384-a095-a4644d53f3cd tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "POST /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b/action" status: 202 len: 0 microversion: 2.1 time: 0.281578 Apr 16 21:58:29.887501 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3477/7112] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:58:29 2022] POST /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:58:29.895873 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c3492d6a-ae65-44d3-9d0e-963a8c13bed5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:29.896762 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c3492d6a-ae65-44d3-9d0e-963a8c13bed5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:29.902990 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3492d6a-ae65-44d3-9d0e-963a8c13bed5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:29.903231 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3492d6a-ae65-44d3-9d0e-963a8c13bed5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:29.904019 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3492d6a-ae65-44d3-9d0e-963a8c13bed5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:29.904512 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3492d6a-ae65-44d3-9d0e-963a8c13bed5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:30.037519 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c3492d6a-ae65-44d3-9d0e-963a8c13bed5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:30.045155 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c3492d6a-ae65-44d3-9d0e-963a8c13bed5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1679 microversion: 2.1 time: 0.153790 Apr 16 21:58:30.045766 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3636/7113] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:29 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:58:31.069907 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1592e946-d8ee-417a-b368-0d1e9f5e7b25 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:31.071117 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1592e946-d8ee-417a-b368-0d1e9f5e7b25 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:31.076434 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1592e946-d8ee-417a-b368-0d1e9f5e7b25 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:31.076943 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1592e946-d8ee-417a-b368-0d1e9f5e7b25 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:31.077727 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1592e946-d8ee-417a-b368-0d1e9f5e7b25 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:31.078171 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1592e946-d8ee-417a-b368-0d1e9f5e7b25 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:31.209713 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1592e946-d8ee-417a-b368-0d1e9f5e7b25 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:31.217371 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1592e946-d8ee-417a-b368-0d1e9f5e7b25 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1679 microversion: 2.1 time: 0.153049 Apr 16 21:58:31.220559 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3478/7114] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:31 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:58:32.235003 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e070662a-e9a3-4c4c-88af-979255be2eb1 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:32.235739 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e070662a-e9a3-4c4c-88af-979255be2eb1 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:32.243521 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e070662a-e9a3-4c4c-88af-979255be2eb1 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:32.243931 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e070662a-e9a3-4c4c-88af-979255be2eb1 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:32.244771 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e070662a-e9a3-4c4c-88af-979255be2eb1 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:32.245233 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e070662a-e9a3-4c4c-88af-979255be2eb1 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:32.445694 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e070662a-e9a3-4c4c-88af-979255be2eb1 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:32.453197 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e070662a-e9a3-4c4c-88af-979255be2eb1 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1679 microversion: 2.1 time: 0.222131 Apr 16 21:58:32.453904 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3637/7115] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:32 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1679 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:58:33.470815 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-87d4bc13-7ca2-4ab1-802b-b9a7db4a4a56 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:33.471700 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-87d4bc13-7ca2-4ab1-802b-b9a7db4a4a56 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:33.478416 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-87d4bc13-7ca2-4ab1-802b-b9a7db4a4a56 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:33.478873 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-87d4bc13-7ca2-4ab1-802b-b9a7db4a4a56 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:33.479643 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-87d4bc13-7ca2-4ab1-802b-b9a7db4a4a56 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:33.480091 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-87d4bc13-7ca2-4ab1-802b-b9a7db4a4a56 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:33.618413 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-87d4bc13-7ca2-4ab1-802b-b9a7db4a4a56 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:33.625643 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-87d4bc13-7ca2-4ab1-802b-b9a7db4a4a56 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1684 microversion: 2.1 time: 0.158727 Apr 16 21:58:33.626213 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3479/7116] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:33 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:58:34.642911 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-37ba951f-7a99-4377-ab9b-96ccb9c252d6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:34.644158 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-37ba951f-7a99-4377-ab9b-96ccb9c252d6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:34.650906 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-37ba951f-7a99-4377-ab9b-96ccb9c252d6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:34.651380 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-37ba951f-7a99-4377-ab9b-96ccb9c252d6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:34.652186 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-37ba951f-7a99-4377-ab9b-96ccb9c252d6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:34.652657 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-37ba951f-7a99-4377-ab9b-96ccb9c252d6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:35.099065 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-37ba951f-7a99-4377-ab9b-96ccb9c252d6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:35.106483 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-37ba951f-7a99-4377-ab9b-96ccb9c252d6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1684 microversion: 2.1 time: 0.467476 Apr 16 21:58:35.107062 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3638/7117] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:34 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1684 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:58:35.999337 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-f506d2fc-7f21-4fca-b149-8834d3cdeadd req-d57c1950-968c-474e-bde8-7c40fba778e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81b47b35-6871-4fbd-964c-a9d15b453d7b", "name": "network-vif-unplugged", "status": "completed", "tag": "7c8852e9-bee2-41a6-a668-793128d7c0c3"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:58:36.008758 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-f506d2fc-7f21-4fca-b149-8834d3cdeadd req-d57c1950-968c-474e-bde8-7c40fba778e3 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:36.009222 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-f506d2fc-7f21-4fca-b149-8834d3cdeadd req-d57c1950-968c-474e-bde8-7c40fba778e3 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:36.021476 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-f506d2fc-7f21-4fca-b149-8834d3cdeadd req-d57c1950-968c-474e-bde8-7c40fba778e3 service nova] Creating event network-vif-unplugged:7c8852e9-bee2-41a6-a668-793128d7c0c3 for instance 81b47b35-6871-4fbd-964c-a9d15b453d7b on nch1-master-1 Apr 16 21:58:36.026774 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [req-f506d2fc-7f21-4fca-b149-8834d3cdeadd req-d57c1950-968c-474e-bde8-7c40fba778e3 service nova] Instance 81b47b35-6871-4fbd-964c-a9d15b453d7b is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137409) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 16 21:58:36.038203 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-f506d2fc-7f21-4fca-b149-8834d3cdeadd req-d57c1950-968c-474e-bde8-7c40fba778e3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042416 Apr 16 21:58:36.038806 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3480/7118] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:58:36.125150 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-427df895-c9ca-4e1d-9c77-c2a3e2fcae7f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:36.126625 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-427df895-c9ca-4e1d-9c77-c2a3e2fcae7f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:36.134559 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-427df895-c9ca-4e1d-9c77-c2a3e2fcae7f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:36.135041 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-427df895-c9ca-4e1d-9c77-c2a3e2fcae7f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:36.137121 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-427df895-c9ca-4e1d-9c77-c2a3e2fcae7f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:36.138061 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-427df895-c9ca-4e1d-9c77-c2a3e2fcae7f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:36.291000 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-427df895-c9ca-4e1d-9c77-c2a3e2fcae7f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:36.300841 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-427df895-c9ca-4e1d-9c77-c2a3e2fcae7f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1683 microversion: 2.1 time: 0.179150 Apr 16 21:58:36.301454 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3639/7119] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:36 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1683 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:58:37.319315 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7b81889f-dddd-4e41-bb0b-bf1a59d40050 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:37.319945 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7b81889f-dddd-4e41-bb0b-bf1a59d40050 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:37.326949 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7b81889f-dddd-4e41-bb0b-bf1a59d40050 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:37.327416 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7b81889f-dddd-4e41-bb0b-bf1a59d40050 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:37.328234 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7b81889f-dddd-4e41-bb0b-bf1a59d40050 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:37.328722 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7b81889f-dddd-4e41-bb0b-bf1a59d40050 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:37.466671 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7b81889f-dddd-4e41-bb0b-bf1a59d40050 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:37.474405 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7b81889f-dddd-4e41-bb0b-bf1a59d40050 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1683 microversion: 2.1 time: 0.160073 Apr 16 21:58:37.474973 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3481/7120] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:37 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:58:38.053125 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-94682794-724c-4964-a189-ea92c1c25a47 req-c46d9870-734d-4512-9235-3d2777547eb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81b47b35-6871-4fbd-964c-a9d15b453d7b", "tag": "7c8852e9-bee2-41a6-a668-793128d7c0c3"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:58:38.061950 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-94682794-724c-4964-a189-ea92c1c25a47 req-c46d9870-734d-4512-9235-3d2777547eb7 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:38.062419 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-94682794-724c-4964-a189-ea92c1c25a47 req-c46d9870-734d-4512-9235-3d2777547eb7 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:38.074518 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-94682794-724c-4964-a189-ea92c1c25a47 req-c46d9870-734d-4512-9235-3d2777547eb7 service nova] Creating event network-changed:7c8852e9-bee2-41a6-a668-793128d7c0c3 for instance 81b47b35-6871-4fbd-964c-a9d15b453d7b on nch1-master-1 Apr 16 21:58:38.079796 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [req-94682794-724c-4964-a189-ea92c1c25a47 req-c46d9870-734d-4512-9235-3d2777547eb7 service nova] Instance 81b47b35-6871-4fbd-964c-a9d15b453d7b is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 16 21:58:38.090340 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-94682794-724c-4964-a189-ea92c1c25a47 req-c46d9870-734d-4512-9235-3d2777547eb7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041520 Apr 16 21:58:38.090924 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3640/7121] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:58:38.492461 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a1d73543-22c7-4c2b-831f-dd30dc4db8e5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:38.493417 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a1d73543-22c7-4c2b-831f-dd30dc4db8e5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:38.499991 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a1d73543-22c7-4c2b-831f-dd30dc4db8e5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:38.501439 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a1d73543-22c7-4c2b-831f-dd30dc4db8e5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:38.501439 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a1d73543-22c7-4c2b-831f-dd30dc4db8e5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:38.501706 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a1d73543-22c7-4c2b-831f-dd30dc4db8e5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:38.705432 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a1d73543-22c7-4c2b-831f-dd30dc4db8e5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:38.715785 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a1d73543-22c7-4c2b-831f-dd30dc4db8e5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1681 microversion: 2.1 time: 0.226190 Apr 16 21:58:38.715785 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3482/7122] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:38 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1681 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:58:39.734120 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-513a1d3c-20e9-4df5-a9e6-2000e63a5bae tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:39.734831 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-513a1d3c-20e9-4df5-a9e6-2000e63a5bae tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:39.741035 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-513a1d3c-20e9-4df5-a9e6-2000e63a5bae tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:39.741507 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-513a1d3c-20e9-4df5-a9e6-2000e63a5bae tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:39.742292 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-513a1d3c-20e9-4df5-a9e6-2000e63a5bae tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:39.742749 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-513a1d3c-20e9-4df5-a9e6-2000e63a5bae tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:39.874015 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-513a1d3c-20e9-4df5-a9e6-2000e63a5bae tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:39.882032 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-513a1d3c-20e9-4df5-a9e6-2000e63a5bae tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1677 microversion: 2.1 time: 0.153073 Apr 16 21:58:39.882616 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3641/7123] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:39 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:58:39.899462 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-87a1cf2d-4a90-4bb0-8c07-f44a666008ce tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:58:39.899998 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-87a1cf2d-4a90-4bb0-8c07-f44a666008ce tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:39.906798 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-87a1cf2d-4a90-4bb0-8c07-f44a666008ce tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:39.907267 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-87a1cf2d-4a90-4bb0-8c07-f44a666008ce tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:39.908051 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-87a1cf2d-4a90-4bb0-8c07-f44a666008ce tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:39.908532 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-87a1cf2d-4a90-4bb0-8c07-f44a666008ce tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:40.095815 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-87a1cf2d-4a90-4bb0-8c07-f44a666008ce tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "POST /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b/action" status: 204 len: 0 microversion: 2.1 time: 0.200690 Apr 16 21:58:40.096749 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3483/7124] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:58:39 2022] POST /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b/action => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:58:40.105179 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-be6174fd-a31c-4925-8597-649aacbbf8a5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:40.105813 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-be6174fd-a31c-4925-8597-649aacbbf8a5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:40.111931 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-be6174fd-a31c-4925-8597-649aacbbf8a5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:40.112471 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-be6174fd-a31c-4925-8597-649aacbbf8a5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:40.113275 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-be6174fd-a31c-4925-8597-649aacbbf8a5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:40.114305 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-be6174fd-a31c-4925-8597-649aacbbf8a5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:40.291008 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-be6174fd-a31c-4925-8597-649aacbbf8a5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:40.300066 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-be6174fd-a31c-4925-8597-649aacbbf8a5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1677 microversion: 2.1 time: 0.199009 Apr 16 21:58:40.301689 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3642/7125] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:40 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1677 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:58:41.319477 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-79a28b77-3764-4dde-8c21-88252c66979f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:41.320342 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-79a28b77-3764-4dde-8c21-88252c66979f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:41.326800 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-79a28b77-3764-4dde-8c21-88252c66979f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:41.327269 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-79a28b77-3764-4dde-8c21-88252c66979f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:41.328055 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-79a28b77-3764-4dde-8c21-88252c66979f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:41.328579 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-79a28b77-3764-4dde-8c21-88252c66979f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:41.465186 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-79a28b77-3764-4dde-8c21-88252c66979f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:41.473125 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-79a28b77-3764-4dde-8c21-88252c66979f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1677 microversion: 2.1 time: 0.159370 Apr 16 21:58:41.473740 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3484/7126] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:41 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:58:42.490812 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2180eba2-4807-4227-9f3b-537a17b89a75 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:42.491438 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2180eba2-4807-4227-9f3b-537a17b89a75 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:42.498650 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2180eba2-4807-4227-9f3b-537a17b89a75 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:42.502121 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2180eba2-4807-4227-9f3b-537a17b89a75 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:42.502121 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2180eba2-4807-4227-9f3b-537a17b89a75 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:42.502121 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2180eba2-4807-4227-9f3b-537a17b89a75 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:42.518422 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-517cf992-c529-4036-99fe-3239ec31c54e req-9d2a5dc6-f40c-4915-a0ac-33f6253d7c82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81b47b35-6871-4fbd-964c-a9d15b453d7b", "name": "network-vif-plugged", "status": "completed", "tag": "7c8852e9-bee2-41a6-a668-793128d7c0c3"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:58:42.528934 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-517cf992-c529-4036-99fe-3239ec31c54e req-9d2a5dc6-f40c-4915-a0ac-33f6253d7c82 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:42.529468 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-517cf992-c529-4036-99fe-3239ec31c54e req-9d2a5dc6-f40c-4915-a0ac-33f6253d7c82 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:42.540542 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-517cf992-c529-4036-99fe-3239ec31c54e req-9d2a5dc6-f40c-4915-a0ac-33f6253d7c82 service nova] Creating event network-vif-plugged:7c8852e9-bee2-41a6-a668-793128d7c0c3 for instance 81b47b35-6871-4fbd-964c-a9d15b453d7b on nch1-master-1 Apr 16 21:58:42.545774 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-517cf992-c529-4036-99fe-3239ec31c54e req-9d2a5dc6-f40c-4915-a0ac-33f6253d7c82 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031086 Apr 16 21:58:42.546383 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3485/7127] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:58:42.635237 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2180eba2-4807-4227-9f3b-537a17b89a75 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:42.642962 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2180eba2-4807-4227-9f3b-537a17b89a75 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1656 microversion: 2.1 time: 0.156089 Apr 16 21:58:42.654611 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3643/7128] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:42 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1656 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:58:42.660747 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bc1704e5-44e7-4662-b62c-fda6d3030b29 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:42.661461 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bc1704e5-44e7-4662-b62c-fda6d3030b29 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:42.667914 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bc1704e5-44e7-4662-b62c-fda6d3030b29 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:42.668429 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bc1704e5-44e7-4662-b62c-fda6d3030b29 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:42.669227 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bc1704e5-44e7-4662-b62c-fda6d3030b29 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:42.669683 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bc1704e5-44e7-4662-b62c-fda6d3030b29 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:42.800450 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-bc1704e5-44e7-4662-b62c-fda6d3030b29 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:42.807829 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bc1704e5-44e7-4662-b62c-fda6d3030b29 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1656 microversion: 2.1 time: 0.151747 Apr 16 21:58:42.808427 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3486/7129] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:42 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1656 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:58:42.824539 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cdde76de-ebb6-4a4c-ab47-0802c9b08636 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:58:42.830461 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cdde76de-ebb6-4a4c-ab47-0802c9b08636 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:42.830939 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cdde76de-ebb6-4a4c-ab47-0802c9b08636 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:42.852688 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cdde76de-ebb6-4a4c-ab47-0802c9b08636 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Going to try to start instance {{(pid=137408) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 16 21:58:43.082386 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cdde76de-ebb6-4a4c-ab47-0802c9b08636 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "POST /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b/action" status: 202 len: 0 microversion: 2.1 time: 0.261515 Apr 16 21:58:43.082992 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3644/7130] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:58:42 2022] POST /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:58:43.091321 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-48978697-782c-4dc0-a223-eb44f0a8a6a5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:43.091943 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-48978697-782c-4dc0-a223-eb44f0a8a6a5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:43.098685 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-48978697-782c-4dc0-a223-eb44f0a8a6a5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:43.099154 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-48978697-782c-4dc0-a223-eb44f0a8a6a5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:43.100045 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-48978697-782c-4dc0-a223-eb44f0a8a6a5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:43.100528 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-48978697-782c-4dc0-a223-eb44f0a8a6a5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:43.231832 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-48978697-782c-4dc0-a223-eb44f0a8a6a5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:43.243999 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-48978697-782c-4dc0-a223-eb44f0a8a6a5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1665 microversion: 2.1 time: 0.156505 Apr 16 21:58:43.244636 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3487/7131] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:43 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1665 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:58:44.263532 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-95faf433-ee0f-4926-9f31-1a8b3f6e519e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:44.264323 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-95faf433-ee0f-4926-9f31-1a8b3f6e519e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:44.270501 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-95faf433-ee0f-4926-9f31-1a8b3f6e519e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:44.271553 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-95faf433-ee0f-4926-9f31-1a8b3f6e519e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:44.272398 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-95faf433-ee0f-4926-9f31-1a8b3f6e519e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:44.272861 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-95faf433-ee0f-4926-9f31-1a8b3f6e519e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:44.402177 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-95faf433-ee0f-4926-9f31-1a8b3f6e519e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:44.409763 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-95faf433-ee0f-4926-9f31-1a8b3f6e519e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1665 microversion: 2.1 time: 0.151525 Apr 16 21:58:44.410350 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3645/7132] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:44 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1665 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:58:45.426831 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a79afd64-b0e2-401f-9fda-9589971a1c57 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:45.427572 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a79afd64-b0e2-401f-9fda-9589971a1c57 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:45.434222 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a79afd64-b0e2-401f-9fda-9589971a1c57 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:45.434694 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a79afd64-b0e2-401f-9fda-9589971a1c57 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:45.435478 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a79afd64-b0e2-401f-9fda-9589971a1c57 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:45.435932 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a79afd64-b0e2-401f-9fda-9589971a1c57 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:45.564346 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a79afd64-b0e2-401f-9fda-9589971a1c57 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:45.572138 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a79afd64-b0e2-401f-9fda-9589971a1c57 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1669 microversion: 2.1 time: 0.149229 Apr 16 21:58:45.572740 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3488/7133] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:45 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1669 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:58:45.588924 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a7fd23c8-8123-4349-b214-c930dbed3979 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:45.589477 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a7fd23c8-8123-4349-b214-c930dbed3979 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:45.596599 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a7fd23c8-8123-4349-b214-c930dbed3979 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:45.597080 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a7fd23c8-8123-4349-b214-c930dbed3979 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:45.597869 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a7fd23c8-8123-4349-b214-c930dbed3979 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:45.598330 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a7fd23c8-8123-4349-b214-c930dbed3979 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:45.622129 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a7fd23c8-8123-4349-b214-c930dbed3979 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:58:45.816920 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a7fd23c8-8123-4349-b214-c930dbed3979 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "DELETE /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 204 len: 0 microversion: 2.1 time: 0.231667 Apr 16 21:58:45.818115 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3646/7134] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:58:45 2022] DELETE /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:58:45.826528 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e4bc28a3-1953-4a02-b057-64698f9e0e79 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:45.827138 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e4bc28a3-1953-4a02-b057-64698f9e0e79 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:45.833933 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e4bc28a3-1953-4a02-b057-64698f9e0e79 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:45.834393 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e4bc28a3-1953-4a02-b057-64698f9e0e79 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:45.835170 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e4bc28a3-1953-4a02-b057-64698f9e0e79 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:45.835614 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e4bc28a3-1953-4a02-b057-64698f9e0e79 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:45.967233 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e4bc28a3-1953-4a02-b057-64698f9e0e79 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:45.974886 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e4bc28a3-1953-4a02-b057-64698f9e0e79 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1675 microversion: 2.1 time: 0.152284 Apr 16 21:58:45.975461 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3489/7135] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:45 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:58:46.993371 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f9319b76-17c5-4605-9411-cf947745544d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:46.994015 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f9319b76-17c5-4605-9411-cf947745544d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:47.001269 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9319b76-17c5-4605-9411-cf947745544d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:47.001744 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9319b76-17c5-4605-9411-cf947745544d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:47.002602 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9319b76-17c5-4605-9411-cf947745544d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:47.003066 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9319b76-17c5-4605-9411-cf947745544d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:47.135751 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f9319b76-17c5-4605-9411-cf947745544d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:47.143541 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f9319b76-17c5-4605-9411-cf947745544d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1675 microversion: 2.1 time: 0.155226 Apr 16 21:58:47.144363 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3647/7136] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:46 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:58:47.665497 ncdv-master-1 devstack@n-api.service[137408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 21:58:47.665773 ncdv-master-1 devstack@n-api.service[137408]: Sat Apr 16 21:58:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 21:58:48.168928 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5527f59c-38e9-48bc-8f8b-104b9405bd62 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:48.169609 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5527f59c-38e9-48bc-8f8b-104b9405bd62 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:48.176661 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5527f59c-38e9-48bc-8f8b-104b9405bd62 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:48.177246 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5527f59c-38e9-48bc-8f8b-104b9405bd62 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:48.178241 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5527f59c-38e9-48bc-8f8b-104b9405bd62 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:48.178837 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5527f59c-38e9-48bc-8f8b-104b9405bd62 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:48.262118 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5527f59c-38e9-48bc-8f8b-104b9405bd62 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:48.269798 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5527f59c-38e9-48bc-8f8b-104b9405bd62 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 200 len: 1608 microversion: 2.1 time: 0.111920 Apr 16 21:58:48.270534 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3490/7137] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:48 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 1608 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:58:48.381011 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-97682fba-8d28-496a-8145-1ef28ca39959 req-f5f0e6d6-a537-4b20-8e79-2489f68fbfa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81b47b35-6871-4fbd-964c-a9d15b453d7b", "name": "network-vif-deleted", "tag": "7c8852e9-bee2-41a6-a668-793128d7c0c3"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:58:48.390633 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-97682fba-8d28-496a-8145-1ef28ca39959 req-f5f0e6d6-a537-4b20-8e79-2489f68fbfa8 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:48.390879 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-97682fba-8d28-496a-8145-1ef28ca39959 req-f5f0e6d6-a537-4b20-8e79-2489f68fbfa8 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:48.402833 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-97682fba-8d28-496a-8145-1ef28ca39959 req-f5f0e6d6-a537-4b20-8e79-2489f68fbfa8 service nova] Creating event network-vif-deleted:7c8852e9-bee2-41a6-a668-793128d7c0c3 for instance 81b47b35-6871-4fbd-964c-a9d15b453d7b on nch1-master-1 Apr 16 21:58:48.407959 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-97682fba-8d28-496a-8145-1ef28ca39959 req-f5f0e6d6-a537-4b20-8e79-2489f68fbfa8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031139 Apr 16 21:58:48.408946 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3648/7138] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:58:49.287506 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3b313815-309c-4dc1-82dc-ed07e93f3f67 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:49.288159 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3b313815-309c-4dc1-82dc-ed07e93f3f67 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:49.295197 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3b313815-309c-4dc1-82dc-ed07e93f3f67 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:49.303590 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3b313815-309c-4dc1-82dc-ed07e93f3f67 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:49.303590 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3b313815-309c-4dc1-82dc-ed07e93f3f67 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:49.303590 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3b313815-309c-4dc1-82dc-ed07e93f3f67 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:49.310469 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-3b313815-309c-4dc1-82dc-ed07e93f3f67 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] HTTP exception thrown: Instance 81b47b35-6871-4fbd-964c-a9d15b453d7b could not be found. Apr 16 21:58:49.311183 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3b313815-309c-4dc1-82dc-ed07e93f3f67 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Returning 404 to user: Instance 81b47b35-6871-4fbd-964c-a9d15b453d7b could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:58:49.312030 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3b313815-309c-4dc1-82dc-ed07e93f3f67 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 404 len: 111 microversion: 2.1 time: 0.028886 Apr 16 21:58:49.315933 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3491/7139] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:49 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:58:49.334255 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-805bdb42-b380-417c-989c-438a100662ec tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:49.334986 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-805bdb42-b380-417c-989c-438a100662ec tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:49.342618 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-805bdb42-b380-417c-989c-438a100662ec tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:49.343099 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-805bdb42-b380-417c-989c-438a100662ec tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:49.343941 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-805bdb42-b380-417c-989c-438a100662ec tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:49.344431 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-805bdb42-b380-417c-989c-438a100662ec tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:49.360747 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-805bdb42-b380-417c-989c-438a100662ec tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] HTTP exception thrown: Instance 81b47b35-6871-4fbd-964c-a9d15b453d7b could not be found. Apr 16 21:58:49.361375 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-805bdb42-b380-417c-989c-438a100662ec tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Returning 404 to user: Instance 81b47b35-6871-4fbd-964c-a9d15b453d7b could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:58:49.362269 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-805bdb42-b380-417c-989c-438a100662ec tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 404 len: 111 microversion: 2.1 time: 0.032974 Apr 16 21:58:49.362819 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3649/7140] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:49 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:58:49.410971 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1ae90819-2fb9-4105-91a5-a4e51c5b7d02 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1639558738", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "46ed5fd0-8613-4ef4-9bd7-a5169ec06285"}], "security_groups": [{"name": "tempest-securitygroup--937765651"}], "key_name": "tempest-keypair-1181093857", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:58:49.524690 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-1ae90819-2fb9-4105-91a5-a4e51c5b7d02 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] validate_networks() for [('46ed5fd0-8613-4ef4-9bd7-a5169ec06285', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:58:49.930517 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-1ae90819-2fb9-4105-91a5-a4e51c5b7d02 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:58:49.930954 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-1ae90819-2fb9-4105-91a5-a4e51c5b7d02 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:58:49.931439 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-1ae90819-2fb9-4105-91a5-a4e51c5b7d02 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:58:49.931866 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-1ae90819-2fb9-4105-91a5-a4e51c5b7d02 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:58:49.932319 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-1ae90819-2fb9-4105-91a5-a4e51c5b7d02 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:58:49.941090 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1ae90819-2fb9-4105-91a5-a4e51c5b7d02 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:49.941551 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1ae90819-2fb9-4105-91a5-a4e51c5b7d02 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:49.942980 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1ae90819-2fb9-4105-91a5-a4e51c5b7d02 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:49.943437 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1ae90819-2fb9-4105-91a5-a4e51c5b7d02 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:49.959758 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-1ae90819-2fb9-4105-91a5-a4e51c5b7d02 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Getting quotas for project 14958c4ca99847bfb86911005da65809. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:58:49.965322 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-1ae90819-2fb9-4105-91a5-a4e51c5b7d02 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Getting quotas for user 63b69490b00b49789e7859dca41f4a5d and project 14958c4ca99847bfb86911005da65809. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:58:49.978044 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1ae90819-2fb9-4105-91a5-a4e51c5b7d02 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:58:49.980368 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1ae90819-2fb9-4105-91a5-a4e51c5b7d02 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:58:50.098379 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1ae90819-2fb9-4105-91a5-a4e51c5b7d02 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.691543 Apr 16 21:58:50.099545 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3492/7141] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:58:49 2022] POST /compute/v2.1/servers => generated 405 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:58:50.109814 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c84611a2-8760-4a16-9eba-00f82cdcd670 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:50.112398 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c84611a2-8760-4a16-9eba-00f82cdcd670 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:50.166152 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c84611a2-8760-4a16-9eba-00f82cdcd670 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:50.172945 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c84611a2-8760-4a16-9eba-00f82cdcd670 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3" status: 200 len: 1239 microversion: 2.1 time: 0.067045 Apr 16 21:58:50.173579 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3650/7142] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:50 2022] GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3 => generated 1239 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:58:51.191758 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-551499ac-d26d-4b6c-b56d-301334a93769 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:51.193644 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-551499ac-d26d-4b6c-b56d-301334a93769 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:51.200321 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-551499ac-d26d-4b6c-b56d-301334a93769 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:51.207093 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-551499ac-d26d-4b6c-b56d-301334a93769 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:51.207093 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-551499ac-d26d-4b6c-b56d-301334a93769 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:51.207093 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-551499ac-d26d-4b6c-b56d-301334a93769 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:51.262751 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-551499ac-d26d-4b6c-b56d-301334a93769 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:51.270293 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-551499ac-d26d-4b6c-b56d-301334a93769 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3" status: 200 len: 1235 microversion: 2.1 time: 0.083392 Apr 16 21:58:51.270964 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3493/7143] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:51 2022] GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3 => generated 1235 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:58:52.287161 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-00edd1a7-f4b7-4023-88c9-631c0fdd4c1f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:52.287805 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-00edd1a7-f4b7-4023-88c9-631c0fdd4c1f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:52.295891 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-00edd1a7-f4b7-4023-88c9-631c0fdd4c1f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:52.296411 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-00edd1a7-f4b7-4023-88c9-631c0fdd4c1f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:52.297228 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-00edd1a7-f4b7-4023-88c9-631c0fdd4c1f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:52.297700 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-00edd1a7-f4b7-4023-88c9-631c0fdd4c1f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:52.359322 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-00edd1a7-f4b7-4023-88c9-631c0fdd4c1f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:52.366810 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-00edd1a7-f4b7-4023-88c9-631c0fdd4c1f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3" status: 200 len: 1297 microversion: 2.1 time: 0.083567 Apr 16 21:58:52.367380 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3651/7144] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:52 2022] GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3 => generated 1297 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:58:53.385139 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cc83cd54-d77d-4a41-a26e-69ba726f8df2 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:53.385914 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-cc83cd54-d77d-4a41-a26e-69ba726f8df2 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:53.393340 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cc83cd54-d77d-4a41-a26e-69ba726f8df2 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:53.393791 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cc83cd54-d77d-4a41-a26e-69ba726f8df2 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:53.394575 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cc83cd54-d77d-4a41-a26e-69ba726f8df2 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:53.395026 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cc83cd54-d77d-4a41-a26e-69ba726f8df2 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:53.530306 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-3c7a9ecc-5ae2-4c82-b1e8-5f0a1535baa7 req-f058fbe4-323f-45b4-bfc5-69d6f5001b83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d2409fb-599b-4139-9969-f113f6d9b0e3", "tag": "a347bd57-d18a-4a25-827c-49efe9cadfda"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:58:53.539361 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-3c7a9ecc-5ae2-4c82-b1e8-5f0a1535baa7 req-f058fbe4-323f-45b4-bfc5-69d6f5001b83 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:53.540024 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-3c7a9ecc-5ae2-4c82-b1e8-5f0a1535baa7 req-f058fbe4-323f-45b4-bfc5-69d6f5001b83 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:53.551976 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-3c7a9ecc-5ae2-4c82-b1e8-5f0a1535baa7 req-f058fbe4-323f-45b4-bfc5-69d6f5001b83 service nova] Creating event network-changed:a347bd57-d18a-4a25-827c-49efe9cadfda for instance 7d2409fb-599b-4139-9969-f113f6d9b0e3 on nch1-master-1 Apr 16 21:58:53.559209 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-3c7a9ecc-5ae2-4c82-b1e8-5f0a1535baa7 req-f058fbe4-323f-45b4-bfc5-69d6f5001b83 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030522 Apr 16 21:58:53.559209 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3652/7145] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:58:53.625954 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cc83cd54-d77d-4a41-a26e-69ba726f8df2 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:53.634747 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cc83cd54-d77d-4a41-a26e-69ba726f8df2 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3" status: 200 len: 1364 microversion: 2.1 time: 0.253483 Apr 16 21:58:53.636887 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3494/7146] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:53 2022] GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3 => generated 1364 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:58:54.653391 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4de4453f-77c0-4f50-a254-b72377ff0b26 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:54.654109 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4de4453f-77c0-4f50-a254-b72377ff0b26 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:54.660453 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4de4453f-77c0-4f50-a254-b72377ff0b26 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:54.661453 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4de4453f-77c0-4f50-a254-b72377ff0b26 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:54.662236 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4de4453f-77c0-4f50-a254-b72377ff0b26 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:54.662694 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4de4453f-77c0-4f50-a254-b72377ff0b26 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:54.794411 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4de4453f-77c0-4f50-a254-b72377ff0b26 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:54.801804 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4de4453f-77c0-4f50-a254-b72377ff0b26 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3" status: 200 len: 1364 microversion: 2.1 time: 0.153504 Apr 16 21:58:54.802379 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3653/7147] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:54 2022] GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:58:55.819402 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-86bec8a2-b7fb-4a7d-8df0-80455d9bdc1a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:55.820006 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-86bec8a2-b7fb-4a7d-8df0-80455d9bdc1a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:55.826260 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-86bec8a2-b7fb-4a7d-8df0-80455d9bdc1a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:55.826728 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-86bec8a2-b7fb-4a7d-8df0-80455d9bdc1a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:55.827517 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-86bec8a2-b7fb-4a7d-8df0-80455d9bdc1a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:55.827971 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-86bec8a2-b7fb-4a7d-8df0-80455d9bdc1a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:55.955586 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-86bec8a2-b7fb-4a7d-8df0-80455d9bdc1a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:55.963449 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-86bec8a2-b7fb-4a7d-8df0-80455d9bdc1a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3" status: 200 len: 1364 microversion: 2.1 time: 0.148326 Apr 16 21:58:55.964020 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3495/7148] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:55 2022] GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:58:56.981004 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-09fae15a-ac91-43f9-9e9a-6189454f83cd tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:56.981732 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-09fae15a-ac91-43f9-9e9a-6189454f83cd tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:56.988038 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-09fae15a-ac91-43f9-9e9a-6189454f83cd tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:56.988538 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-09fae15a-ac91-43f9-9e9a-6189454f83cd tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:56.989954 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-09fae15a-ac91-43f9-9e9a-6189454f83cd tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:56.990408 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-09fae15a-ac91-43f9-9e9a-6189454f83cd tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:57.124138 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-09fae15a-ac91-43f9-9e9a-6189454f83cd tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:57.131635 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-09fae15a-ac91-43f9-9e9a-6189454f83cd tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3" status: 200 len: 1364 microversion: 2.1 time: 0.154760 Apr 16 21:58:57.132227 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3654/7149] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:56 2022] GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:58:58.149273 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c8d31738-af0b-46ce-aab7-516ddae35b32 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:58.149901 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c8d31738-af0b-46ce-aab7-516ddae35b32 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:58.156955 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c8d31738-af0b-46ce-aab7-516ddae35b32 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:58.157433 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c8d31738-af0b-46ce-aab7-516ddae35b32 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:58.158224 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c8d31738-af0b-46ce-aab7-516ddae35b32 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:58.158681 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c8d31738-af0b-46ce-aab7-516ddae35b32 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:58.283565 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c8d31738-af0b-46ce-aab7-516ddae35b32 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:58.291961 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c8d31738-af0b-46ce-aab7-516ddae35b32 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3" status: 200 len: 1364 microversion: 2.1 time: 0.146507 Apr 16 21:58:58.295922 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3496/7150] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:58 2022] GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3 => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:58:58.482106 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-5a6fefc9-6c70-4534-b6ed-cfdcea770a46 req-0eba90c5-dfd7-426e-bf7c-133fb023bac4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d2409fb-599b-4139-9969-f113f6d9b0e3", "name": "network-vif-plugged", "status": "completed", "tag": "a347bd57-d18a-4a25-827c-49efe9cadfda"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:58:58.491947 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-5a6fefc9-6c70-4534-b6ed-cfdcea770a46 req-0eba90c5-dfd7-426e-bf7c-133fb023bac4 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:58.492436 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-5a6fefc9-6c70-4534-b6ed-cfdcea770a46 req-0eba90c5-dfd7-426e-bf7c-133fb023bac4 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:58.503566 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-5a6fefc9-6c70-4534-b6ed-cfdcea770a46 req-0eba90c5-dfd7-426e-bf7c-133fb023bac4 service nova] Creating event network-vif-plugged:a347bd57-d18a-4a25-827c-49efe9cadfda for instance 7d2409fb-599b-4139-9969-f113f6d9b0e3 on nch1-master-1 Apr 16 21:58:58.508386 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-5a6fefc9-6c70-4534-b6ed-cfdcea770a46 req-0eba90c5-dfd7-426e-bf7c-133fb023bac4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030050 Apr 16 21:58:58.508971 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3655/7151] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:58:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:58:59.309297 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7d522e41-c8f1-4d86-b319-058083b9d03e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:58:59.310010 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7d522e41-c8f1-4d86-b319-058083b9d03e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:58:59.317617 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7d522e41-c8f1-4d86-b319-058083b9d03e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:59.318080 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7d522e41-c8f1-4d86-b319-058083b9d03e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:59.318863 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7d522e41-c8f1-4d86-b319-058083b9d03e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:58:59.319315 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7d522e41-c8f1-4d86-b319-058083b9d03e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:58:59.449663 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7d522e41-c8f1-4d86-b319-058083b9d03e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:58:59.457292 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7d522e41-c8f1-4d86-b319-058083b9d03e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3" status: 200 len: 1364 microversion: 2.1 time: 0.152119 Apr 16 21:58:59.458376 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3497/7152] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:58:59 2022] GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:59:00.476635 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8ccac7cc-465d-4288-a6d6-023c027b8803 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:00.477850 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8ccac7cc-465d-4288-a6d6-023c027b8803 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:00.484243 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8ccac7cc-465d-4288-a6d6-023c027b8803 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:00.484855 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8ccac7cc-465d-4288-a6d6-023c027b8803 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:00.485649 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8ccac7cc-465d-4288-a6d6-023c027b8803 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:00.486109 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8ccac7cc-465d-4288-a6d6-023c027b8803 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:00.618892 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8ccac7cc-465d-4288-a6d6-023c027b8803 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:59:00.626550 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8ccac7cc-465d-4288-a6d6-023c027b8803 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3" status: 200 len: 1552 microversion: 2.1 time: 0.155158 Apr 16 21:59:00.627119 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3656/7153] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:00 2022] GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3 => generated 1552 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:59:00.643839 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-62ef8713-7278-4582-a1d0-2b6475c02ee0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:00.650806 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-62ef8713-7278-4582-a1d0-2b6475c02ee0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:00.651439 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-62ef8713-7278-4582-a1d0-2b6475c02ee0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:00.651911 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-62ef8713-7278-4582-a1d0-2b6475c02ee0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:00.652733 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-62ef8713-7278-4582-a1d0-2b6475c02ee0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:00.653208 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-62ef8713-7278-4582-a1d0-2b6475c02ee0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:00.734083 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-62ef8713-7278-4582-a1d0-2b6475c02ee0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094194 Apr 16 21:59:00.734683 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3498/7154] 10.222.0.20 () {58 vars in 1274 bytes} [Sat Apr 16 21:59:00 2022] GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:59:02.151663 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-217405d4-b91c-454e-9672-223a8c63725f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:59:02.152903 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-217405d4-b91c-454e-9672-223a8c63725f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:02.162472 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-217405d4-b91c-454e-9672-223a8c63725f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:02.162952 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-217405d4-b91c-454e-9672-223a8c63725f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:02.163764 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-217405d4-b91c-454e-9672-223a8c63725f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:02.164254 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-217405d4-b91c-454e-9672-223a8c63725f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:02.192311 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-217405d4-b91c-454e-9672-223a8c63725f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:59:02.198366 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-217405d4-b91c-454e-9672-223a8c63725f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Old instance type m1.heat2, new instance type m1.heat {{(pid=137408) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 16 21:59:02.204898 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-217405d4-b91c-454e-9672-223a8c63725f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:59:02.205333 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-217405d4-b91c-454e-9672-223a8c63725f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:59:02.212510 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-217405d4-b91c-454e-9672-223a8c63725f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:59:02.212959 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-217405d4-b91c-454e-9672-223a8c63725f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:59:02.213507 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-217405d4-b91c-454e-9672-223a8c63725f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:59:02.219879 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-939b4b31-7de6-4e7c-8c66-608fc3175233 req-28544145-f876-4d4a-a8e7-24f528491688 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d2409fb-599b-4139-9969-f113f6d9b0e3", "tag": "a347bd57-d18a-4a25-827c-49efe9cadfda"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:59:02.228464 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-939b4b31-7de6-4e7c-8c66-608fc3175233 req-28544145-f876-4d4a-a8e7-24f528491688 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:02.229190 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-939b4b31-7de6-4e7c-8c66-608fc3175233 req-28544145-f876-4d4a-a8e7-24f528491688 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:02.240817 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-939b4b31-7de6-4e7c-8c66-608fc3175233 req-28544145-f876-4d4a-a8e7-24f528491688 service nova] Creating event network-changed:a347bd57-d18a-4a25-827c-49efe9cadfda for instance 7d2409fb-599b-4139-9969-f113f6d9b0e3 on nch1-master-1 Apr 16 21:59:02.246431 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-939b4b31-7de6-4e7c-8c66-608fc3175233 req-28544145-f876-4d4a-a8e7-24f528491688 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097158 Apr 16 21:59:02.247578 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3499/7155] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:59:02.393623 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-217405d4-b91c-454e-9672-223a8c63725f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "POST /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3/action" status: 202 len: 0 microversion: 2.1 time: 0.246301 Apr 16 21:59:02.403226 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e3e408ff-f056-4374-9500-57c0714a2024 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:02.404265 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e3e408ff-f056-4374-9500-57c0714a2024 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:02.410143 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3657/7156] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:59:02 2022] POST /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 21:59:02.411614 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e3e408ff-f056-4374-9500-57c0714a2024 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:02.412077 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e3e408ff-f056-4374-9500-57c0714a2024 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:02.413107 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e3e408ff-f056-4374-9500-57c0714a2024 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:02.413728 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e3e408ff-f056-4374-9500-57c0714a2024 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:02.615282 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e3e408ff-f056-4374-9500-57c0714a2024 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:59:02.623134 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e3e408ff-f056-4374-9500-57c0714a2024 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3" status: 200 len: 1561 microversion: 2.1 time: 0.224225 Apr 16 21:59:02.623947 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3500/7157] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:02 2022] GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3 => generated 1561 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:59:03.641248 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bc7f68b4-af97-4b63-a324-eb508b3ca379 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:03.642138 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-bc7f68b4-af97-4b63-a324-eb508b3ca379 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:03.651068 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bc7f68b4-af97-4b63-a324-eb508b3ca379 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:03.651529 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bc7f68b4-af97-4b63-a324-eb508b3ca379 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:03.652357 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bc7f68b4-af97-4b63-a324-eb508b3ca379 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:03.652816 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bc7f68b4-af97-4b63-a324-eb508b3ca379 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:03.786125 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-bc7f68b4-af97-4b63-a324-eb508b3ca379 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:59:03.793695 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-bc7f68b4-af97-4b63-a324-eb508b3ca379 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3" status: 200 len: 1680 microversion: 2.1 time: 0.156442 Apr 16 21:59:03.794269 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3658/7158] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:03 2022] GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:59:04.811174 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b7f6a9b9-fb51-432c-83ed-790b3fd56c3a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:04.811799 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b7f6a9b9-fb51-432c-83ed-790b3fd56c3a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:04.818626 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b7f6a9b9-fb51-432c-83ed-790b3fd56c3a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:04.819120 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b7f6a9b9-fb51-432c-83ed-790b3fd56c3a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:04.819915 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b7f6a9b9-fb51-432c-83ed-790b3fd56c3a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:04.820396 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b7f6a9b9-fb51-432c-83ed-790b3fd56c3a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:05.016961 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b7f6a9b9-fb51-432c-83ed-790b3fd56c3a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:59:05.025278 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b7f6a9b9-fb51-432c-83ed-790b3fd56c3a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3" status: 200 len: 1680 microversion: 2.1 time: 0.218153 Apr 16 21:59:05.025859 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3501/7159] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:04 2022] GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3 => generated 1680 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:59:06.042873 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-31976287-19fa-4393-8c51-e83bb985e82d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:06.043527 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-31976287-19fa-4393-8c51-e83bb985e82d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:06.050219 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-31976287-19fa-4393-8c51-e83bb985e82d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:06.050690 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-31976287-19fa-4393-8c51-e83bb985e82d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:06.051569 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-31976287-19fa-4393-8c51-e83bb985e82d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:06.052032 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-31976287-19fa-4393-8c51-e83bb985e82d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:06.182445 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-31976287-19fa-4393-8c51-e83bb985e82d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:59:06.189821 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-31976287-19fa-4393-8c51-e83bb985e82d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3" status: 200 len: 1685 microversion: 2.1 time: 0.150921 Apr 16 21:59:06.190399 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3659/7160] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:06 2022] GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3 => generated 1685 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:59:07.207541 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5a431acc-43e0-42a5-92cf-c32addc5001d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:07.208137 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5a431acc-43e0-42a5-92cf-c32addc5001d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:07.215226 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5a431acc-43e0-42a5-92cf-c32addc5001d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:07.216775 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5a431acc-43e0-42a5-92cf-c32addc5001d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:07.217188 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5a431acc-43e0-42a5-92cf-c32addc5001d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:07.217643 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5a431acc-43e0-42a5-92cf-c32addc5001d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:07.350607 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5a431acc-43e0-42a5-92cf-c32addc5001d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:59:07.358968 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5a431acc-43e0-42a5-92cf-c32addc5001d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3" status: 200 len: 1685 microversion: 2.1 time: 0.155786 Apr 16 21:59:07.365847 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3502/7161] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:07 2022] GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3 => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:59:08.377390 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-013068a6-5692-4c89-a40b-eae1a9303d7d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:08.377793 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-013068a6-5692-4c89-a40b-eae1a9303d7d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:08.384559 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-013068a6-5692-4c89-a40b-eae1a9303d7d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:08.385045 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-013068a6-5692-4c89-a40b-eae1a9303d7d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:08.385864 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-013068a6-5692-4c89-a40b-eae1a9303d7d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:08.386356 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-013068a6-5692-4c89-a40b-eae1a9303d7d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:08.513727 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-013068a6-5692-4c89-a40b-eae1a9303d7d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:59:08.521642 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-013068a6-5692-4c89-a40b-eae1a9303d7d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3" status: 200 len: 1685 microversion: 2.1 time: 0.148775 Apr 16 21:59:08.522224 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3660/7162] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:08 2022] GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3 => generated 1685 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:59:09.538933 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-39e800cb-0c39-4d0b-843b-deefdeb67f28 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:09.539675 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-39e800cb-0c39-4d0b-843b-deefdeb67f28 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:09.546485 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-39e800cb-0c39-4d0b-843b-deefdeb67f28 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:09.546942 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-39e800cb-0c39-4d0b-843b-deefdeb67f28 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:09.547717 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-39e800cb-0c39-4d0b-843b-deefdeb67f28 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:09.548162 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-39e800cb-0c39-4d0b-843b-deefdeb67f28 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:09.675822 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-39e800cb-0c39-4d0b-843b-deefdeb67f28 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:59:09.684116 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-39e800cb-0c39-4d0b-843b-deefdeb67f28 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3" status: 200 len: 1685 microversion: 2.1 time: 0.149554 Apr 16 21:59:09.684722 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3503/7163] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:09 2022] GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3 => generated 1685 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:59:10.701208 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cb8f9e1e-4672-4402-9c54-f68b7da645fb tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:10.701841 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cb8f9e1e-4672-4402-9c54-f68b7da645fb tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:10.708729 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cb8f9e1e-4672-4402-9c54-f68b7da645fb tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:10.709200 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cb8f9e1e-4672-4402-9c54-f68b7da645fb tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:10.709994 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cb8f9e1e-4672-4402-9c54-f68b7da645fb tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:10.710460 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cb8f9e1e-4672-4402-9c54-f68b7da645fb tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:10.839750 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cb8f9e1e-4672-4402-9c54-f68b7da645fb tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:59:10.847420 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cb8f9e1e-4672-4402-9c54-f68b7da645fb tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3" status: 200 len: 1685 microversion: 2.1 time: 0.150301 Apr 16 21:59:10.847990 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3661/7164] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:10 2022] GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3 => generated 1685 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:59:11.864703 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-04606e91-7bdc-4752-bc4d-2e92f35e7ec1 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:11.865332 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-04606e91-7bdc-4752-bc4d-2e92f35e7ec1 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:11.872084 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-04606e91-7bdc-4752-bc4d-2e92f35e7ec1 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:11.872580 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-04606e91-7bdc-4752-bc4d-2e92f35e7ec1 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:11.873367 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-04606e91-7bdc-4752-bc4d-2e92f35e7ec1 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:11.873819 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-04606e91-7bdc-4752-bc4d-2e92f35e7ec1 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:12.006991 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-04606e91-7bdc-4752-bc4d-2e92f35e7ec1 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:59:12.014332 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-04606e91-7bdc-4752-bc4d-2e92f35e7ec1 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3" status: 200 len: 1685 microversion: 2.1 time: 0.153635 Apr 16 21:59:12.014943 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3504/7165] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:11 2022] GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3 => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:59:13.032082 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-26cbf42f-1630-43c2-88a6-b9c94b92e0b4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:13.032777 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-26cbf42f-1630-43c2-88a6-b9c94b92e0b4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:13.040392 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-26cbf42f-1630-43c2-88a6-b9c94b92e0b4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:13.040895 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-26cbf42f-1630-43c2-88a6-b9c94b92e0b4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:13.041669 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-26cbf42f-1630-43c2-88a6-b9c94b92e0b4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:13.042135 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-26cbf42f-1630-43c2-88a6-b9c94b92e0b4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:13.169493 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-26cbf42f-1630-43c2-88a6-b9c94b92e0b4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:59:13.176897 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-26cbf42f-1630-43c2-88a6-b9c94b92e0b4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3" status: 200 len: 1685 microversion: 2.1 time: 0.148766 Apr 16 21:59:13.177469 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3662/7166] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:13 2022] GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3 => generated 1685 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:59:14.194202 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ddbd0522-263a-40a8-bbcc-dbffcfd2d809 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:14.194738 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ddbd0522-263a-40a8-bbcc-dbffcfd2d809 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:14.202093 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ddbd0522-263a-40a8-bbcc-dbffcfd2d809 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:14.202562 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ddbd0522-263a-40a8-bbcc-dbffcfd2d809 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:14.203347 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ddbd0522-263a-40a8-bbcc-dbffcfd2d809 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:14.203802 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ddbd0522-263a-40a8-bbcc-dbffcfd2d809 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:14.331284 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ddbd0522-263a-40a8-bbcc-dbffcfd2d809 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:59:14.339125 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ddbd0522-263a-40a8-bbcc-dbffcfd2d809 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3" status: 200 len: 1685 microversion: 2.1 time: 0.149076 Apr 16 21:59:14.339704 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3505/7167] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:14 2022] GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3 => generated 1685 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:59:15.357027 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d3987e8c-9e88-4a56-854d-a14e32996377 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:15.357694 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d3987e8c-9e88-4a56-854d-a14e32996377 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:15.365115 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d3987e8c-9e88-4a56-854d-a14e32996377 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:15.365609 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d3987e8c-9e88-4a56-854d-a14e32996377 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:15.366399 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d3987e8c-9e88-4a56-854d-a14e32996377 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:15.366864 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d3987e8c-9e88-4a56-854d-a14e32996377 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:15.502812 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d3987e8c-9e88-4a56-854d-a14e32996377 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:59:15.510835 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d3987e8c-9e88-4a56-854d-a14e32996377 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3" status: 200 len: 1685 microversion: 2.1 time: 0.157696 Apr 16 21:59:15.511421 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3663/7168] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:15 2022] GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3 => generated 1685 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:59:16.527655 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b631deb1-ae47-4ebe-8e4d-5f40ddf7cd99 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:16.528282 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b631deb1-ae47-4ebe-8e4d-5f40ddf7cd99 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:16.535055 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b631deb1-ae47-4ebe-8e4d-5f40ddf7cd99 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:16.535516 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b631deb1-ae47-4ebe-8e4d-5f40ddf7cd99 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:16.536314 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b631deb1-ae47-4ebe-8e4d-5f40ddf7cd99 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:16.536760 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b631deb1-ae47-4ebe-8e4d-5f40ddf7cd99 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:16.666843 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b631deb1-ae47-4ebe-8e4d-5f40ddf7cd99 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:59:16.674239 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b631deb1-ae47-4ebe-8e4d-5f40ddf7cd99 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3" status: 200 len: 1685 microversion: 2.1 time: 0.150485 Apr 16 21:59:16.674830 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3506/7169] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:16 2022] GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3 => generated 1685 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:59:17.691886 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-38b0aafc-59d9-4a1a-ab6e-6a3bd471be44 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:17.692560 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-38b0aafc-59d9-4a1a-ab6e-6a3bd471be44 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:17.699598 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-38b0aafc-59d9-4a1a-ab6e-6a3bd471be44 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:17.700068 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-38b0aafc-59d9-4a1a-ab6e-6a3bd471be44 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:17.700887 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-38b0aafc-59d9-4a1a-ab6e-6a3bd471be44 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:17.701350 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-38b0aafc-59d9-4a1a-ab6e-6a3bd471be44 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:17.828374 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-38b0aafc-59d9-4a1a-ab6e-6a3bd471be44 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:59:17.836469 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-38b0aafc-59d9-4a1a-ab6e-6a3bd471be44 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3" status: 200 len: 1685 microversion: 2.1 time: 0.148507 Apr 16 21:59:17.837051 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3664/7170] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:17 2022] GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3 => generated 1685 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:59:18.854302 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d8f27ed1-0bdc-4698-84d3-ece5b9665ce0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:18.854925 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d8f27ed1-0bdc-4698-84d3-ece5b9665ce0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:18.861748 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d8f27ed1-0bdc-4698-84d3-ece5b9665ce0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:18.862215 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d8f27ed1-0bdc-4698-84d3-ece5b9665ce0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:18.862996 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d8f27ed1-0bdc-4698-84d3-ece5b9665ce0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:18.864112 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d8f27ed1-0bdc-4698-84d3-ece5b9665ce0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:18.989833 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d8f27ed1-0bdc-4698-84d3-ece5b9665ce0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:59:18.997226 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d8f27ed1-0bdc-4698-84d3-ece5b9665ce0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3" status: 200 len: 1685 microversion: 2.1 time: 0.146837 Apr 16 21:59:18.997800 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3507/7171] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:18 2022] GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3 => generated 1685 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:59:20.014243 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b0cbf4c0-4fb5-41f5-8c29-2eef21a38664 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:20.014912 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b0cbf4c0-4fb5-41f5-8c29-2eef21a38664 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:20.021907 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b0cbf4c0-4fb5-41f5-8c29-2eef21a38664 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:20.022382 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b0cbf4c0-4fb5-41f5-8c29-2eef21a38664 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:20.023180 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b0cbf4c0-4fb5-41f5-8c29-2eef21a38664 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:20.023642 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b0cbf4c0-4fb5-41f5-8c29-2eef21a38664 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:20.149333 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b0cbf4c0-4fb5-41f5-8c29-2eef21a38664 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:59:20.156771 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b0cbf4c0-4fb5-41f5-8c29-2eef21a38664 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3" status: 200 len: 1685 microversion: 2.1 time: 0.146437 Apr 16 21:59:20.157351 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3665/7172] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:20 2022] GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3 => generated 1685 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:59:21.174544 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-34f5e76f-08aa-4cee-ac1d-2e4082f3d1c1 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:21.175170 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-34f5e76f-08aa-4cee-ac1d-2e4082f3d1c1 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:21.182583 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-34f5e76f-08aa-4cee-ac1d-2e4082f3d1c1 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:21.183050 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-34f5e76f-08aa-4cee-ac1d-2e4082f3d1c1 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:21.183848 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-34f5e76f-08aa-4cee-ac1d-2e4082f3d1c1 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:21.184325 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-34f5e76f-08aa-4cee-ac1d-2e4082f3d1c1 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:21.312444 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-34f5e76f-08aa-4cee-ac1d-2e4082f3d1c1 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:59:21.320408 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-34f5e76f-08aa-4cee-ac1d-2e4082f3d1c1 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3" status: 200 len: 1685 microversion: 2.1 time: 0.149830 Apr 16 21:59:21.320985 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3508/7173] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:21 2022] GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3 => generated 1685 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:59:22.338231 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c8c4a155-087d-418a-a93b-2aaa2c61c5cd tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:22.338860 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c8c4a155-087d-418a-a93b-2aaa2c61c5cd tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:22.346208 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c8c4a155-087d-418a-a93b-2aaa2c61c5cd tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:22.346707 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c8c4a155-087d-418a-a93b-2aaa2c61c5cd tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:22.347498 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c8c4a155-087d-418a-a93b-2aaa2c61c5cd tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:22.347988 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c8c4a155-087d-418a-a93b-2aaa2c61c5cd tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:22.550455 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c8c4a155-087d-418a-a93b-2aaa2c61c5cd tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:59:22.558105 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c8c4a155-087d-418a-a93b-2aaa2c61c5cd tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3" status: 200 len: 1684 microversion: 2.1 time: 0.223758 Apr 16 21:59:22.558682 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3666/7174] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:22 2022] GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3 => generated 1684 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:59:22.794159 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-2dd679e6-5434-4138-af59-20b6a03f6ce8 req-e64916d1-70b8-4eef-9f88-a49223474a1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d2409fb-599b-4139-9969-f113f6d9b0e3", "name": "network-vif-unplugged", "status": "completed", "tag": "a347bd57-d18a-4a25-827c-49efe9cadfda"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:59:22.803511 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-2dd679e6-5434-4138-af59-20b6a03f6ce8 req-e64916d1-70b8-4eef-9f88-a49223474a1d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:22.803958 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-2dd679e6-5434-4138-af59-20b6a03f6ce8 req-e64916d1-70b8-4eef-9f88-a49223474a1d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:22.815326 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-2dd679e6-5434-4138-af59-20b6a03f6ce8 req-e64916d1-70b8-4eef-9f88-a49223474a1d service nova] Creating event network-vif-unplugged:a347bd57-d18a-4a25-827c-49efe9cadfda for instance 7d2409fb-599b-4139-9969-f113f6d9b0e3 on nch2-master-1 Apr 16 21:59:22.821697 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [req-2dd679e6-5434-4138-af59-20b6a03f6ce8 req-e64916d1-70b8-4eef-9f88-a49223474a1d service nova] Instance 7d2409fb-599b-4139-9969-f113f6d9b0e3 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137409) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 16 21:59:22.832753 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-2dd679e6-5434-4138-af59-20b6a03f6ce8 req-e64916d1-70b8-4eef-9f88-a49223474a1d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042323 Apr 16 21:59:22.833364 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3509/7175] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:59:23.578940 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-70d4260e-9707-4c9d-8c6d-9c30bec19f4d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:23.579862 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-70d4260e-9707-4c9d-8c6d-9c30bec19f4d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:23.587201 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-70d4260e-9707-4c9d-8c6d-9c30bec19f4d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:23.587671 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-70d4260e-9707-4c9d-8c6d-9c30bec19f4d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:23.588491 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-70d4260e-9707-4c9d-8c6d-9c30bec19f4d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:23.589002 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-70d4260e-9707-4c9d-8c6d-9c30bec19f4d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:23.797871 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-70d4260e-9707-4c9d-8c6d-9c30bec19f4d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:59:23.805329 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-70d4260e-9707-4c9d-8c6d-9c30bec19f4d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3" status: 200 len: 1684 microversion: 2.1 time: 0.230354 Apr 16 21:59:23.805906 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3667/7176] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:23 2022] GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3 => generated 1684 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:59:24.823426 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-68667d87-916b-4f6c-b257-7ed14d608580 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:24.824137 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-68667d87-916b-4f6c-b257-7ed14d608580 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:24.830388 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-68667d87-916b-4f6c-b257-7ed14d608580 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:24.830852 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-68667d87-916b-4f6c-b257-7ed14d608580 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:24.831631 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-68667d87-916b-4f6c-b257-7ed14d608580 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:24.832079 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-68667d87-916b-4f6c-b257-7ed14d608580 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:24.848351 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-03f062ff-7216-407b-99c1-4c7af7109a42 req-cc9a7a20-323d-4940-89e8-e7055c9ae1d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d2409fb-599b-4139-9969-f113f6d9b0e3", "tag": "a347bd57-d18a-4a25-827c-49efe9cadfda"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:59:24.857218 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-03f062ff-7216-407b-99c1-4c7af7109a42 req-cc9a7a20-323d-4940-89e8-e7055c9ae1d5 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:24.857684 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-03f062ff-7216-407b-99c1-4c7af7109a42 req-cc9a7a20-323d-4940-89e8-e7055c9ae1d5 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:24.870049 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-03f062ff-7216-407b-99c1-4c7af7109a42 req-cc9a7a20-323d-4940-89e8-e7055c9ae1d5 service nova] Creating event network-changed:a347bd57-d18a-4a25-827c-49efe9cadfda for instance 7d2409fb-599b-4139-9969-f113f6d9b0e3 on nch2-master-1 Apr 16 21:59:24.875816 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [req-03f062ff-7216-407b-99c1-4c7af7109a42 req-cc9a7a20-323d-4940-89e8-e7055c9ae1d5 service nova] Instance 7d2409fb-599b-4139-9969-f113f6d9b0e3 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 16 21:59:24.887386 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-03f062ff-7216-407b-99c1-4c7af7109a42 req-cc9a7a20-323d-4940-89e8-e7055c9ae1d5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043366 Apr 16 21:59:24.887999 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3668/7177] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:59:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:59:25.038691 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-68667d87-916b-4f6c-b257-7ed14d608580 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:59:25.046071 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-68667d87-916b-4f6c-b257-7ed14d608580 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3" status: 200 len: 1682 microversion: 2.1 time: 0.227910 Apr 16 21:59:25.046667 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3510/7178] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:24 2022] GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3 => generated 1682 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:59:26.063283 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9c2bb46d-7dd9-40e3-bedc-3182b071a30a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:26.063942 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9c2bb46d-7dd9-40e3-bedc-3182b071a30a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:26.070911 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9c2bb46d-7dd9-40e3-bedc-3182b071a30a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:26.071382 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9c2bb46d-7dd9-40e3-bedc-3182b071a30a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:26.072191 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9c2bb46d-7dd9-40e3-bedc-3182b071a30a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:26.072665 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9c2bb46d-7dd9-40e3-bedc-3182b071a30a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:26.199809 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9c2bb46d-7dd9-40e3-bedc-3182b071a30a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:59:26.207284 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9c2bb46d-7dd9-40e3-bedc-3182b071a30a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3" status: 200 len: 1682 microversion: 2.1 time: 0.148386 Apr 16 21:59:26.207852 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3669/7179] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:26 2022] GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:59:27.224758 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f3321f6a-5432-477b-bcdb-0802e26d8ae5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:27.225387 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f3321f6a-5432-477b-bcdb-0802e26d8ae5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:27.232243 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f3321f6a-5432-477b-bcdb-0802e26d8ae5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:27.232723 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f3321f6a-5432-477b-bcdb-0802e26d8ae5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:27.233517 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f3321f6a-5432-477b-bcdb-0802e26d8ae5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:27.234040 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f3321f6a-5432-477b-bcdb-0802e26d8ae5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:27.362483 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f3321f6a-5432-477b-bcdb-0802e26d8ae5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:59:27.370419 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f3321f6a-5432-477b-bcdb-0802e26d8ae5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3" status: 200 len: 1679 microversion: 2.1 time: 0.149679 Apr 16 21:59:27.371059 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3511/7180] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:27 2022] GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3 => generated 1679 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:59:27.387969 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1abb270c-b2ba-43a3-aa94-23e2b50a6cd6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:59:27.388563 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1abb270c-b2ba-43a3-aa94-23e2b50a6cd6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:27.394910 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1abb270c-b2ba-43a3-aa94-23e2b50a6cd6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:27.395386 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1abb270c-b2ba-43a3-aa94-23e2b50a6cd6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:27.396213 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1abb270c-b2ba-43a3-aa94-23e2b50a6cd6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:27.396683 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1abb270c-b2ba-43a3-aa94-23e2b50a6cd6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:27.434888 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1abb270c-b2ba-43a3-aa94-23e2b50a6cd6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:27.435299 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1abb270c-b2ba-43a3-aa94-23e2b50a6cd6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:27.436124 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1abb270c-b2ba-43a3-aa94-23e2b50a6cd6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:27.436625 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1abb270c-b2ba-43a3-aa94-23e2b50a6cd6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:27.457922 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-1abb270c-b2ba-43a3-aa94-23e2b50a6cd6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Getting quotas for project 14958c4ca99847bfb86911005da65809. Resources: {'ram', 'cores'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:59:27.463221 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-1abb270c-b2ba-43a3-aa94-23e2b50a6cd6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Getting quotas for user 63b69490b00b49789e7859dca41f4a5d and project 14958c4ca99847bfb86911005da65809. Resources: {'ram', 'cores'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:59:27.813788 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1abb270c-b2ba-43a3-aa94-23e2b50a6cd6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "POST /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3/action" status: 202 len: 0 microversion: 2.1 time: 0.429631 Apr 16 21:59:27.818351 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3670/7181] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:59:27 2022] POST /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3/action => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 16 21:59:27.822838 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f831c1e6-f6a7-4148-8d57-6e56617e5ce0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:27.823466 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f831c1e6-f6a7-4148-8d57-6e56617e5ce0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:27.829469 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f831c1e6-f6a7-4148-8d57-6e56617e5ce0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:27.830178 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f831c1e6-f6a7-4148-8d57-6e56617e5ce0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:27.830981 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f831c1e6-f6a7-4148-8d57-6e56617e5ce0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:27.831437 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f831c1e6-f6a7-4148-8d57-6e56617e5ce0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:27.971303 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f831c1e6-f6a7-4148-8d57-6e56617e5ce0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:59:27.979433 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f831c1e6-f6a7-4148-8d57-6e56617e5ce0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3" status: 200 len: 1678 microversion: 2.1 time: 0.160413 Apr 16 21:59:27.980026 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3512/7182] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:27 2022] GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:59:28.998663 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2daaf5b7-0f61-4157-8ea7-683e2806b147 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:28.999371 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2daaf5b7-0f61-4157-8ea7-683e2806b147 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:29.005662 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2daaf5b7-0f61-4157-8ea7-683e2806b147 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:29.006129 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2daaf5b7-0f61-4157-8ea7-683e2806b147 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:29.006906 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2daaf5b7-0f61-4157-8ea7-683e2806b147 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:29.007380 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2daaf5b7-0f61-4157-8ea7-683e2806b147 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:29.403613 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2daaf5b7-0f61-4157-8ea7-683e2806b147 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:59:29.411857 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2daaf5b7-0f61-4157-8ea7-683e2806b147 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3" status: 200 len: 1678 microversion: 2.1 time: 0.418263 Apr 16 21:59:29.412467 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3671/7183] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:28 2022] GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3 => generated 1678 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:59:30.098457 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-0492de2c-1159-4c8a-995e-3b35d1ff5736 req-9449c263-d74d-49d7-ab38-ae459d01c68b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d2409fb-599b-4139-9969-f113f6d9b0e3", "name": "network-vif-plugged", "status": "completed", "tag": "a347bd57-d18a-4a25-827c-49efe9cadfda"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:59:30.106922 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-0492de2c-1159-4c8a-995e-3b35d1ff5736 req-9449c263-d74d-49d7-ab38-ae459d01c68b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:30.107386 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-0492de2c-1159-4c8a-995e-3b35d1ff5736 req-9449c263-d74d-49d7-ab38-ae459d01c68b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:30.119540 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-0492de2c-1159-4c8a-995e-3b35d1ff5736 req-9449c263-d74d-49d7-ab38-ae459d01c68b service nova] Creating event network-vif-plugged:a347bd57-d18a-4a25-827c-49efe9cadfda for instance 7d2409fb-599b-4139-9969-f113f6d9b0e3 on nch2-master-1 Apr 16 21:59:30.124938 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [req-0492de2c-1159-4c8a-995e-3b35d1ff5736 req-9449c263-d74d-49d7-ab38-ae459d01c68b service nova] Instance 7d2409fb-599b-4139-9969-f113f6d9b0e3 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137409) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 16 21:59:30.136741 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-0492de2c-1159-4c8a-995e-3b35d1ff5736 req-9449c263-d74d-49d7-ab38-ae459d01c68b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042486 Apr 16 21:59:30.137469 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3513/7184] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:59:30.429761 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f9a08ac7-49d5-4bee-80a0-d97c68cd77f2 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:30.430387 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f9a08ac7-49d5-4bee-80a0-d97c68cd77f2 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:30.437453 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9a08ac7-49d5-4bee-80a0-d97c68cd77f2 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:30.437929 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9a08ac7-49d5-4bee-80a0-d97c68cd77f2 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:30.438738 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9a08ac7-49d5-4bee-80a0-d97c68cd77f2 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:30.439368 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9a08ac7-49d5-4bee-80a0-d97c68cd77f2 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:30.573128 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f9a08ac7-49d5-4bee-80a0-d97c68cd77f2 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:59:30.580696 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f9a08ac7-49d5-4bee-80a0-d97c68cd77f2 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3" status: 200 len: 1678 microversion: 2.1 time: 0.155412 Apr 16 21:59:30.581277 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3672/7185] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:30 2022] GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:59:31.313627 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-dbd80d99-2da6-4f0c-9a4b-5985c0441aba req-cc201686-5c70-432e-a0f6-8906c26fb35d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d2409fb-599b-4139-9969-f113f6d9b0e3", "name": "network-vif-unplugged", "status": "completed", "tag": "a347bd57-d18a-4a25-827c-49efe9cadfda"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:59:31.323462 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-dbd80d99-2da6-4f0c-9a4b-5985c0441aba req-cc201686-5c70-432e-a0f6-8906c26fb35d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:31.323924 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-dbd80d99-2da6-4f0c-9a4b-5985c0441aba req-cc201686-5c70-432e-a0f6-8906c26fb35d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:31.335920 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-dbd80d99-2da6-4f0c-9a4b-5985c0441aba req-cc201686-5c70-432e-a0f6-8906c26fb35d service nova] Creating event network-vif-unplugged:a347bd57-d18a-4a25-827c-49efe9cadfda for instance 7d2409fb-599b-4139-9969-f113f6d9b0e3 on nch1-master-1 Apr 16 21:59:31.341135 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [req-dbd80d99-2da6-4f0c-9a4b-5985c0441aba req-cc201686-5c70-432e-a0f6-8906c26fb35d service nova] Instance 7d2409fb-599b-4139-9969-f113f6d9b0e3 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137409) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 16 21:59:31.352524 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-dbd80d99-2da6-4f0c-9a4b-5985c0441aba req-cc201686-5c70-432e-a0f6-8906c26fb35d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043073 Apr 16 21:59:31.353130 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3514/7186] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:59:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:59:31.604509 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0b71f7f0-60f3-479b-926c-264ff35b440a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:31.605141 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0b71f7f0-60f3-479b-926c-264ff35b440a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:31.612116 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0b71f7f0-60f3-479b-926c-264ff35b440a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:31.612640 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0b71f7f0-60f3-479b-926c-264ff35b440a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:31.613963 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0b71f7f0-60f3-479b-926c-264ff35b440a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:31.614426 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0b71f7f0-60f3-479b-926c-264ff35b440a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:31.747966 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0b71f7f0-60f3-479b-926c-264ff35b440a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:59:31.756093 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0b71f7f0-60f3-479b-926c-264ff35b440a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3" status: 200 len: 1678 microversion: 2.1 time: 0.155527 Apr 16 21:59:31.756708 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3673/7187] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:31 2022] GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:59:32.781101 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-acb2a712-5e9c-4ce5-8a65-7711f693171e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:32.781806 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-acb2a712-5e9c-4ce5-8a65-7711f693171e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:32.788079 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-acb2a712-5e9c-4ce5-8a65-7711f693171e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:32.788568 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-acb2a712-5e9c-4ce5-8a65-7711f693171e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:32.789341 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-acb2a712-5e9c-4ce5-8a65-7711f693171e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:32.789785 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-acb2a712-5e9c-4ce5-8a65-7711f693171e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:32.921516 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-acb2a712-5e9c-4ce5-8a65-7711f693171e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:59:32.928844 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-acb2a712-5e9c-4ce5-8a65-7711f693171e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3" status: 200 len: 1678 microversion: 2.1 time: 0.153205 Apr 16 21:59:32.929418 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3515/7188] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:32 2022] GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:59:33.367450 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-2b679d19-1811-4384-95d9-476d60dc9bcf req-0ff93c13-f083-4187-b94f-4600a9d3ff44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d2409fb-599b-4139-9969-f113f6d9b0e3", "tag": "a347bd57-d18a-4a25-827c-49efe9cadfda"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:59:33.376517 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-2b679d19-1811-4384-95d9-476d60dc9bcf req-0ff93c13-f083-4187-b94f-4600a9d3ff44 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:33.376978 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-2b679d19-1811-4384-95d9-476d60dc9bcf req-0ff93c13-f083-4187-b94f-4600a9d3ff44 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:33.389197 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-2b679d19-1811-4384-95d9-476d60dc9bcf req-0ff93c13-f083-4187-b94f-4600a9d3ff44 service nova] Creating event network-changed:a347bd57-d18a-4a25-827c-49efe9cadfda for instance 7d2409fb-599b-4139-9969-f113f6d9b0e3 on nch1-master-1 Apr 16 21:59:33.394532 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [req-2b679d19-1811-4384-95d9-476d60dc9bcf req-0ff93c13-f083-4187-b94f-4600a9d3ff44 service nova] Instance 7d2409fb-599b-4139-9969-f113f6d9b0e3 is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 16 21:59:33.405868 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-2b679d19-1811-4384-95d9-476d60dc9bcf req-0ff93c13-f083-4187-b94f-4600a9d3ff44 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042562 Apr 16 21:59:33.406480 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3674/7189] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:59:33.947693 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6d3e839a-dfaf-4dc1-a874-fe8dac6a6ddf tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:33.948442 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6d3e839a-dfaf-4dc1-a874-fe8dac6a6ddf tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:33.958449 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6d3e839a-dfaf-4dc1-a874-fe8dac6a6ddf tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:33.959024 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6d3e839a-dfaf-4dc1-a874-fe8dac6a6ddf tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:33.964467 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6d3e839a-dfaf-4dc1-a874-fe8dac6a6ddf tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:33.964467 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6d3e839a-dfaf-4dc1-a874-fe8dac6a6ddf tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:34.344538 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6d3e839a-dfaf-4dc1-a874-fe8dac6a6ddf tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:59:34.352358 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6d3e839a-dfaf-4dc1-a874-fe8dac6a6ddf tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3" status: 200 len: 1678 microversion: 2.1 time: 0.410082 Apr 16 21:59:34.353412 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3516/7190] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:33 2022] GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3 => generated 1678 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:59:35.370513 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3b713668-9a59-4881-ada1-38bdace265f9 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:35.371237 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3b713668-9a59-4881-ada1-38bdace265f9 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:35.378442 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3b713668-9a59-4881-ada1-38bdace265f9 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:35.378993 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3b713668-9a59-4881-ada1-38bdace265f9 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:35.379787 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3b713668-9a59-4881-ada1-38bdace265f9 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:35.380277 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3b713668-9a59-4881-ada1-38bdace265f9 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:35.512596 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3b713668-9a59-4881-ada1-38bdace265f9 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:59:35.520412 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3b713668-9a59-4881-ada1-38bdace265f9 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3" status: 200 len: 1671 microversion: 2.1 time: 0.154215 Apr 16 21:59:35.520995 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3675/7191] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:35 2022] GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3 => generated 1671 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:59:35.537163 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ca8cae5f-e72d-4558-b4be-005c7f3eeb1d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:35.537786 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ca8cae5f-e72d-4558-b4be-005c7f3eeb1d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:35.544555 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ca8cae5f-e72d-4558-b4be-005c7f3eeb1d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:35.545020 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ca8cae5f-e72d-4558-b4be-005c7f3eeb1d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:35.545799 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ca8cae5f-e72d-4558-b4be-005c7f3eeb1d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:35.546245 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ca8cae5f-e72d-4558-b4be-005c7f3eeb1d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:35.671692 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ca8cae5f-e72d-4558-b4be-005c7f3eeb1d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:59:35.679069 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ca8cae5f-e72d-4558-b4be-005c7f3eeb1d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3" status: 200 len: 1671 microversion: 2.1 time: 0.146468 Apr 16 21:59:35.679661 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3517/7192] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:35 2022] GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3 => generated 1671 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:59:35.694775 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4eebc826-c040-4dc4-b2ba-c643a419f44c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:35.695397 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4eebc826-c040-4dc4-b2ba-c643a419f44c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:35.701433 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4eebc826-c040-4dc4-b2ba-c643a419f44c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:35.701904 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4eebc826-c040-4dc4-b2ba-c643a419f44c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:35.702685 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4eebc826-c040-4dc4-b2ba-c643a419f44c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:35.703136 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4eebc826-c040-4dc4-b2ba-c643a419f44c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:35.836989 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4eebc826-c040-4dc4-b2ba-c643a419f44c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:59:35.844487 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4eebc826-c040-4dc4-b2ba-c643a419f44c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3" status: 200 len: 1671 microversion: 2.1 time: 0.153501 Apr 16 21:59:35.849581 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3676/7193] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:35 2022] GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3 => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:59:35.861164 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-645db79b-56bc-41f9-8bb4-fd254b24ee8c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:35.861695 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-645db79b-56bc-41f9-8bb4-fd254b24ee8c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:35.867685 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-645db79b-56bc-41f9-8bb4-fd254b24ee8c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:35.868154 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-645db79b-56bc-41f9-8bb4-fd254b24ee8c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:35.868962 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-645db79b-56bc-41f9-8bb4-fd254b24ee8c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:35.869410 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-645db79b-56bc-41f9-8bb4-fd254b24ee8c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:35.896100 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-645db79b-56bc-41f9-8bb4-fd254b24ee8c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 21:59:36.144270 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-645db79b-56bc-41f9-8bb4-fd254b24ee8c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3" status: 204 len: 0 microversion: 2.1 time: 0.286771 Apr 16 21:59:36.144881 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3518/7194] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 21:59:35 2022] DELETE /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 21:59:36.159010 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a364db5c-49b7-4b1c-8b6d-e69385addfaf tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:36.159010 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a364db5c-49b7-4b1c-8b6d-e69385addfaf tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:36.160828 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a364db5c-49b7-4b1c-8b6d-e69385addfaf tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:36.161295 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a364db5c-49b7-4b1c-8b6d-e69385addfaf tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:36.162076 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a364db5c-49b7-4b1c-8b6d-e69385addfaf tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:36.162528 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a364db5c-49b7-4b1c-8b6d-e69385addfaf tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:36.292546 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a364db5c-49b7-4b1c-8b6d-e69385addfaf tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:59:36.299983 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a364db5c-49b7-4b1c-8b6d-e69385addfaf tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3" status: 200 len: 1677 microversion: 2.1 time: 0.150812 Apr 16 21:59:36.301080 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3677/7195] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:36 2022] GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:59:36.708287 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-9f938e01-3766-48dd-89c6-bb55093e9700 req-8fef4380-b282-41a1-b5a8-6a46a7856f9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d2409fb-599b-4139-9969-f113f6d9b0e3", "name": "network-vif-plugged", "status": "completed", "tag": "a347bd57-d18a-4a25-827c-49efe9cadfda"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:59:36.713314 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-9f938e01-3766-48dd-89c6-bb55093e9700 req-8fef4380-b282-41a1-b5a8-6a46a7856f9e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:36.713774 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-9f938e01-3766-48dd-89c6-bb55093e9700 req-8fef4380-b282-41a1-b5a8-6a46a7856f9e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:36.725669 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-9f938e01-3766-48dd-89c6-bb55093e9700 req-8fef4380-b282-41a1-b5a8-6a46a7856f9e service nova] Creating event network-vif-plugged:a347bd57-d18a-4a25-827c-49efe9cadfda for instance 7d2409fb-599b-4139-9969-f113f6d9b0e3 on nch1-master-1 Apr 16 21:59:36.731152 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-9f938e01-3766-48dd-89c6-bb55093e9700 req-8fef4380-b282-41a1-b5a8-6a46a7856f9e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030520 Apr 16 21:59:36.731152 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3519/7196] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:59:37.318432 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f792f13c-5547-4ae5-885d-a511e0769afc tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:37.319101 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f792f13c-5547-4ae5-885d-a511e0769afc tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:37.325861 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f792f13c-5547-4ae5-885d-a511e0769afc tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:37.329423 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f792f13c-5547-4ae5-885d-a511e0769afc tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:37.329423 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f792f13c-5547-4ae5-885d-a511e0769afc tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:37.329423 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f792f13c-5547-4ae5-885d-a511e0769afc tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:37.459803 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f792f13c-5547-4ae5-885d-a511e0769afc tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:59:37.467441 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f792f13c-5547-4ae5-885d-a511e0769afc tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3" status: 200 len: 1677 microversion: 2.1 time: 0.153504 Apr 16 21:59:37.467997 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3678/7197] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:37 2022] GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3 => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:59:38.405135 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-bfc50338-4617-43a2-8561-ca0feebc605e req-5197900c-cb19-4d22-a245-6f6448de3382 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d2409fb-599b-4139-9969-f113f6d9b0e3", "name": "network-vif-deleted", "tag": "a347bd57-d18a-4a25-827c-49efe9cadfda"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:59:38.415965 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-bfc50338-4617-43a2-8561-ca0feebc605e req-5197900c-cb19-4d22-a245-6f6448de3382 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:38.419008 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-bfc50338-4617-43a2-8561-ca0feebc605e req-5197900c-cb19-4d22-a245-6f6448de3382 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:38.427530 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-bfc50338-4617-43a2-8561-ca0feebc605e req-5197900c-cb19-4d22-a245-6f6448de3382 service nova] Creating event network-vif-deleted:a347bd57-d18a-4a25-827c-49efe9cadfda for instance 7d2409fb-599b-4139-9969-f113f6d9b0e3 on nch1-master-1 Apr 16 21:59:38.432528 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-bfc50338-4617-43a2-8561-ca0feebc605e req-5197900c-cb19-4d22-a245-6f6448de3382 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031354 Apr 16 21:59:38.433194 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3520/7198] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:59:38.485426 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-edd722ef-efc9-4e32-a665-e3cae6213cab tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:38.486187 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-edd722ef-efc9-4e32-a665-e3cae6213cab tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:38.493222 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-edd722ef-efc9-4e32-a665-e3cae6213cab tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:38.493762 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-edd722ef-efc9-4e32-a665-e3cae6213cab tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:38.494554 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-edd722ef-efc9-4e32-a665-e3cae6213cab tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:38.495007 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-edd722ef-efc9-4e32-a665-e3cae6213cab tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:38.558657 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-edd722ef-efc9-4e32-a665-e3cae6213cab tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:59:38.566383 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-edd722ef-efc9-4e32-a665-e3cae6213cab tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3" status: 200 len: 1610 microversion: 2.1 time: 0.084948 Apr 16 21:59:38.566967 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3679/7199] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:38 2022] GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3 => generated 1610 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:59:39.584889 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a34ec6fa-438d-47f9-8721-34e010ccd68b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:39.585602 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a34ec6fa-438d-47f9-8721-34e010ccd68b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:39.591761 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a34ec6fa-438d-47f9-8721-34e010ccd68b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:39.592330 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a34ec6fa-438d-47f9-8721-34e010ccd68b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:39.593117 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a34ec6fa-438d-47f9-8721-34e010ccd68b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:39.593568 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a34ec6fa-438d-47f9-8721-34e010ccd68b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:39.607227 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-a34ec6fa-438d-47f9-8721-34e010ccd68b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] HTTP exception thrown: Instance 7d2409fb-599b-4139-9969-f113f6d9b0e3 could not be found. Apr 16 21:59:39.607822 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a34ec6fa-438d-47f9-8721-34e010ccd68b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Returning 404 to user: Instance 7d2409fb-599b-4139-9969-f113f6d9b0e3 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:59:39.608682 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a34ec6fa-438d-47f9-8721-34e010ccd68b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3" status: 404 len: 111 microversion: 2.1 time: 0.029032 Apr 16 21:59:39.609212 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3521/7200] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:39 2022] GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 21:59:39.626852 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0ac870c0-f876-4a90-bbf2-ed03ec53246b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:39.627488 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0ac870c0-f876-4a90-bbf2-ed03ec53246b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:39.634315 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0ac870c0-f876-4a90-bbf2-ed03ec53246b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:39.634788 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0ac870c0-f876-4a90-bbf2-ed03ec53246b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:39.635578 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0ac870c0-f876-4a90-bbf2-ed03ec53246b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:39.636037 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0ac870c0-f876-4a90-bbf2-ed03ec53246b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:39.648967 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-0ac870c0-f876-4a90-bbf2-ed03ec53246b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] HTTP exception thrown: Instance 7d2409fb-599b-4139-9969-f113f6d9b0e3 could not be found. Apr 16 21:59:39.649577 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0ac870c0-f876-4a90-bbf2-ed03ec53246b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Returning 404 to user: Instance 7d2409fb-599b-4139-9969-f113f6d9b0e3 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 21:59:39.650410 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0ac870c0-f876-4a90-bbf2-ed03ec53246b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3" status: 404 len: 111 microversion: 2.1 time: 0.027553 Apr 16 21:59:39.650940 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3680/7201] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:39 2022] GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 21:59:39.697410 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fd3148f4-a4d1-42e3-81cd-0b8f27998be5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2110448470", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "46ed5fd0-8613-4ef4-9bd7-a5169ec06285"}], "security_groups": [{"name": "tempest-securitygroup--937765651"}], "key_name": "tempest-keypair-1181093857", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:59:39.797151 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-fd3148f4-a4d1-42e3-81cd-0b8f27998be5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] validate_networks() for [('46ed5fd0-8613-4ef4-9bd7-a5169ec06285', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 21:59:40.154732 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-fd3148f4-a4d1-42e3-81cd-0b8f27998be5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 21:59:40.155248 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-fd3148f4-a4d1-42e3-81cd-0b8f27998be5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 21:59:40.155687 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-fd3148f4-a4d1-42e3-81cd-0b8f27998be5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 21:59:40.156107 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-fd3148f4-a4d1-42e3-81cd-0b8f27998be5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 21:59:40.156564 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-fd3148f4-a4d1-42e3-81cd-0b8f27998be5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 21:59:40.165819 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fd3148f4-a4d1-42e3-81cd-0b8f27998be5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:40.166283 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fd3148f4-a4d1-42e3-81cd-0b8f27998be5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:40.167108 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fd3148f4-a4d1-42e3-81cd-0b8f27998be5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:40.167591 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fd3148f4-a4d1-42e3-81cd-0b8f27998be5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:40.183957 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-fd3148f4-a4d1-42e3-81cd-0b8f27998be5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Getting quotas for project 14958c4ca99847bfb86911005da65809. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 21:59:40.189192 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-fd3148f4-a4d1-42e3-81cd-0b8f27998be5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Getting quotas for user 63b69490b00b49789e7859dca41f4a5d and project 14958c4ca99847bfb86911005da65809. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 21:59:40.201199 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-fd3148f4-a4d1-42e3-81cd-0b8f27998be5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 21:59:40.203480 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-fd3148f4-a4d1-42e3-81cd-0b8f27998be5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 21:59:40.326139 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fd3148f4-a4d1-42e3-81cd-0b8f27998be5 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.632716 Apr 16 21:59:40.326794 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3522/7202] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 21:59:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 21:59:40.338048 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-215d63e9-a90f-4f1d-8d35-0a95ece8f93e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:40.338755 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-215d63e9-a90f-4f1d-8d35-0a95ece8f93e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:40.395081 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-215d63e9-a90f-4f1d-8d35-0a95ece8f93e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:59:40.401832 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-215d63e9-a90f-4f1d-8d35-0a95ece8f93e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1239 microversion: 2.1 time: 0.067803 Apr 16 21:59:40.402473 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3681/7203] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:40 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1239 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:59:41.418852 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9ec754cd-41f1-4eea-95a7-8729b566eedf tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:41.419504 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9ec754cd-41f1-4eea-95a7-8729b566eedf tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:41.427009 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9ec754cd-41f1-4eea-95a7-8729b566eedf tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:41.427473 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9ec754cd-41f1-4eea-95a7-8729b566eedf tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:41.428281 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9ec754cd-41f1-4eea-95a7-8729b566eedf tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:41.428732 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9ec754cd-41f1-4eea-95a7-8729b566eedf tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:41.488901 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9ec754cd-41f1-4eea-95a7-8729b566eedf tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:59:41.496349 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9ec754cd-41f1-4eea-95a7-8729b566eedf tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1235 microversion: 2.1 time: 0.081406 Apr 16 21:59:41.496917 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3523/7204] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:41 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1235 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:59:42.514059 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f215c295-5bd9-4da1-a62c-2772d2360c88 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:42.514865 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f215c295-5bd9-4da1-a62c-2772d2360c88 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:42.522785 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f215c295-5bd9-4da1-a62c-2772d2360c88 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:42.523282 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f215c295-5bd9-4da1-a62c-2772d2360c88 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:42.524223 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f215c295-5bd9-4da1-a62c-2772d2360c88 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:42.524706 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f215c295-5bd9-4da1-a62c-2772d2360c88 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:42.594983 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f215c295-5bd9-4da1-a62c-2772d2360c88 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:59:42.603418 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f215c295-5bd9-4da1-a62c-2772d2360c88 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1297 microversion: 2.1 time: 0.093611 Apr 16 21:59:42.604000 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3682/7205] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:42 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1297 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:59:43.625495 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5a5ccb33-a28e-420e-8ded-3682cd04e355 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:43.626047 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5a5ccb33-a28e-420e-8ded-3682cd04e355 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:43.633573 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5a5ccb33-a28e-420e-8ded-3682cd04e355 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:43.634048 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5a5ccb33-a28e-420e-8ded-3682cd04e355 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:43.634808 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5a5ccb33-a28e-420e-8ded-3682cd04e355 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:43.635249 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5a5ccb33-a28e-420e-8ded-3682cd04e355 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:43.704085 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-a4f88638-22db-4dd6-9617-6bd035775193 req-2fc62d5d-2805-4ee5-94d6-600f78ae7d3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a20cde2-6d64-4864-923b-872decfbd83f", "tag": "777f618f-2614-49d4-97d6-94c7da2c8040"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:59:43.715221 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-a4f88638-22db-4dd6-9617-6bd035775193 req-2fc62d5d-2805-4ee5-94d6-600f78ae7d3e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:43.720609 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-a4f88638-22db-4dd6-9617-6bd035775193 req-2fc62d5d-2805-4ee5-94d6-600f78ae7d3e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:43.734701 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-a4f88638-22db-4dd6-9617-6bd035775193 req-2fc62d5d-2805-4ee5-94d6-600f78ae7d3e service nova] Creating event network-changed:777f618f-2614-49d4-97d6-94c7da2c8040 for instance 7a20cde2-6d64-4864-923b-872decfbd83f on nch2-master-1 Apr 16 21:59:43.740988 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-a4f88638-22db-4dd6-9617-6bd035775193 req-2fc62d5d-2805-4ee5-94d6-600f78ae7d3e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040587 Apr 16 21:59:43.741869 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3683/7206] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:59:43.822596 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5a5ccb33-a28e-420e-8ded-3682cd04e355 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:59:43.830618 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5a5ccb33-a28e-420e-8ded-3682cd04e355 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1364 microversion: 2.1 time: 0.209505 Apr 16 21:59:43.831455 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3524/7207] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:43 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1364 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:59:44.849357 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ec8173dd-7e91-4d61-8bb5-7796cbc8d1e0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:44.850078 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ec8173dd-7e91-4d61-8bb5-7796cbc8d1e0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:44.856385 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ec8173dd-7e91-4d61-8bb5-7796cbc8d1e0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:44.856863 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ec8173dd-7e91-4d61-8bb5-7796cbc8d1e0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:44.857651 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ec8173dd-7e91-4d61-8bb5-7796cbc8d1e0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:44.858108 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ec8173dd-7e91-4d61-8bb5-7796cbc8d1e0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:44.985574 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ec8173dd-7e91-4d61-8bb5-7796cbc8d1e0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:59:44.993054 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ec8173dd-7e91-4d61-8bb5-7796cbc8d1e0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1364 microversion: 2.1 time: 0.149169 Apr 16 21:59:44.993621 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3684/7208] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:44 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:59:46.009712 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-047403f8-3564-42e9-ada8-518780a2dbf8 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:46.010330 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-047403f8-3564-42e9-ada8-518780a2dbf8 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:46.017425 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-047403f8-3564-42e9-ada8-518780a2dbf8 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:46.017887 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-047403f8-3564-42e9-ada8-518780a2dbf8 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:46.018661 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-047403f8-3564-42e9-ada8-518780a2dbf8 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:46.019992 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-047403f8-3564-42e9-ada8-518780a2dbf8 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:46.148036 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-047403f8-3564-42e9-ada8-518780a2dbf8 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:59:46.155338 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-047403f8-3564-42e9-ada8-518780a2dbf8 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1364 microversion: 2.1 time: 0.149516 Apr 16 21:59:46.155894 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3525/7209] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:46 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:59:47.172413 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f12e0d0b-c6cd-470e-aee7-6d8c8ff44659 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:47.173048 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f12e0d0b-c6cd-470e-aee7-6d8c8ff44659 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:47.180653 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f12e0d0b-c6cd-470e-aee7-6d8c8ff44659 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:47.181129 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f12e0d0b-c6cd-470e-aee7-6d8c8ff44659 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:47.182087 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f12e0d0b-c6cd-470e-aee7-6d8c8ff44659 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:47.182549 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f12e0d0b-c6cd-470e-aee7-6d8c8ff44659 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:47.313522 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f12e0d0b-c6cd-470e-aee7-6d8c8ff44659 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:59:47.320963 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f12e0d0b-c6cd-470e-aee7-6d8c8ff44659 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1364 microversion: 2.1 time: 0.152562 Apr 16 21:59:47.325815 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3685/7210] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:47 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:59:48.338576 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-28feb867-7c8a-4860-9255-7651f99cde0c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:48.339197 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-28feb867-7c8a-4860-9255-7651f99cde0c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:48.346190 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-28feb867-7c8a-4860-9255-7651f99cde0c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:48.347582 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-28feb867-7c8a-4860-9255-7651f99cde0c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:48.348392 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-28feb867-7c8a-4860-9255-7651f99cde0c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:48.348842 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-28feb867-7c8a-4860-9255-7651f99cde0c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:48.480322 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-28feb867-7c8a-4860-9255-7651f99cde0c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:59:48.488449 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-28feb867-7c8a-4860-9255-7651f99cde0c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1364 microversion: 2.1 time: 0.153167 Apr 16 21:59:48.489043 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3526/7211] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:48 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 21:59:49.506259 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1f0f61ee-31e8-4bff-afec-f74fe858bf77 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:49.506899 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1f0f61ee-31e8-4bff-afec-f74fe858bf77 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:49.513823 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1f0f61ee-31e8-4bff-afec-f74fe858bf77 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:49.514305 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1f0f61ee-31e8-4bff-afec-f74fe858bf77 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:49.515105 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1f0f61ee-31e8-4bff-afec-f74fe858bf77 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:49.515570 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1f0f61ee-31e8-4bff-afec-f74fe858bf77 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:49.641519 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1f0f61ee-31e8-4bff-afec-f74fe858bf77 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:59:49.648819 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1f0f61ee-31e8-4bff-afec-f74fe858bf77 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1364 microversion: 2.1 time: 0.147053 Apr 16 21:59:49.649390 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3686/7212] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:49 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:59:50.218199 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-a4cfa147-a9a0-43db-a2fd-808a338c145e req-ef17dc88-3913-49fc-8a45-6921c2b2b248 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a20cde2-6d64-4864-923b-872decfbd83f", "name": "network-vif-plugged", "status": "completed", "tag": "777f618f-2614-49d4-97d6-94c7da2c8040"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:59:50.225560 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-a4cfa147-a9a0-43db-a2fd-808a338c145e req-ef17dc88-3913-49fc-8a45-6921c2b2b248 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:50.226012 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-a4cfa147-a9a0-43db-a2fd-808a338c145e req-ef17dc88-3913-49fc-8a45-6921c2b2b248 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:50.236505 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-a4cfa147-a9a0-43db-a2fd-808a338c145e req-ef17dc88-3913-49fc-8a45-6921c2b2b248 service nova] Creating event network-vif-plugged:777f618f-2614-49d4-97d6-94c7da2c8040 for instance 7a20cde2-6d64-4864-923b-872decfbd83f on nch2-master-1 Apr 16 21:59:50.242090 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-a4cfa147-a9a0-43db-a2fd-808a338c145e req-ef17dc88-3913-49fc-8a45-6921c2b2b248 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091194 Apr 16 21:59:50.242743 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3527/7213] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:59:50.666428 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6a77d59a-3169-499c-9a1c-e290eb14d967 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:50.667070 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6a77d59a-3169-499c-9a1c-e290eb14d967 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:50.673934 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6a77d59a-3169-499c-9a1c-e290eb14d967 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:50.674411 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6a77d59a-3169-499c-9a1c-e290eb14d967 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:50.675258 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6a77d59a-3169-499c-9a1c-e290eb14d967 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:50.675718 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6a77d59a-3169-499c-9a1c-e290eb14d967 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:50.806528 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6a77d59a-3169-499c-9a1c-e290eb14d967 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:59:50.813839 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6a77d59a-3169-499c-9a1c-e290eb14d967 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1364 microversion: 2.1 time: 0.151352 Apr 16 21:59:50.814412 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3687/7214] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:50 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:59:51.833057 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7e54bca1-fe33-4f0f-9457-a4260dd67253 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:51.833771 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7e54bca1-fe33-4f0f-9457-a4260dd67253 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:51.839939 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7e54bca1-fe33-4f0f-9457-a4260dd67253 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:51.840455 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7e54bca1-fe33-4f0f-9457-a4260dd67253 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:51.841241 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7e54bca1-fe33-4f0f-9457-a4260dd67253 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:51.841694 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7e54bca1-fe33-4f0f-9457-a4260dd67253 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:51.972573 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7e54bca1-fe33-4f0f-9457-a4260dd67253 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:59:51.980035 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7e54bca1-fe33-4f0f-9457-a4260dd67253 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1364 microversion: 2.1 time: 0.152136 Apr 16 21:59:51.980894 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3528/7215] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:51 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:59:52.997774 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-058f5aa9-3dee-4646-aa84-1aff92d8a2dd tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:52.998344 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-058f5aa9-3dee-4646-aa84-1aff92d8a2dd tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:53.005132 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-058f5aa9-3dee-4646-aa84-1aff92d8a2dd tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:53.005604 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-058f5aa9-3dee-4646-aa84-1aff92d8a2dd tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:53.006386 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-058f5aa9-3dee-4646-aa84-1aff92d8a2dd tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:53.006841 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-058f5aa9-3dee-4646-aa84-1aff92d8a2dd tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:53.132461 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-058f5aa9-3dee-4646-aa84-1aff92d8a2dd tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:59:53.140048 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-058f5aa9-3dee-4646-aa84-1aff92d8a2dd tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1551 microversion: 2.1 time: 0.146190 Apr 16 21:59:53.140658 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3688/7216] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:52 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1551 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:59:53.156853 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4da317c4-e7a7-46de-92e6-a1ba58d08c6e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:53.157364 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4da317c4-e7a7-46de-92e6-a1ba58d08c6e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:53.164593 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4da317c4-e7a7-46de-92e6-a1ba58d08c6e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:53.165052 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4da317c4-e7a7-46de-92e6-a1ba58d08c6e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:53.165826 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4da317c4-e7a7-46de-92e6-a1ba58d08c6e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:53.166269 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4da317c4-e7a7-46de-92e6-a1ba58d08c6e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:53.243168 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4da317c4-e7a7-46de-92e6-a1ba58d08c6e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090149 Apr 16 21:59:53.243770 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3529/7217] 10.222.0.20 () {58 vars in 1274 bytes} [Sat Apr 16 21:59:53 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 21:59:54.281707 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-e50d31f5-0782-4812-8d2c-50d2d69a97dc req-b2d12743-bef5-44ec-8ff2-e5dc9749d124 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a20cde2-6d64-4864-923b-872decfbd83f", "tag": "777f618f-2614-49d4-97d6-94c7da2c8040"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:59:54.290657 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-e50d31f5-0782-4812-8d2c-50d2d69a97dc req-b2d12743-bef5-44ec-8ff2-e5dc9749d124 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:54.291202 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-e50d31f5-0782-4812-8d2c-50d2d69a97dc req-b2d12743-bef5-44ec-8ff2-e5dc9749d124 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:54.303958 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-e50d31f5-0782-4812-8d2c-50d2d69a97dc req-b2d12743-bef5-44ec-8ff2-e5dc9749d124 service nova] Creating event network-changed:777f618f-2614-49d4-97d6-94c7da2c8040 for instance 7a20cde2-6d64-4864-923b-872decfbd83f on nch2-master-1 Apr 16 21:59:54.309419 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-e50d31f5-0782-4812-8d2c-50d2d69a97dc req-b2d12743-bef5-44ec-8ff2-e5dc9749d124 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031875 Apr 16 21:59:54.310293 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3689/7218] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 21:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:59:55.953545 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2893f88e-5d67-40b2-87fa-d41bd9956c40 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 21:59:55.954158 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2893f88e-5d67-40b2-87fa-d41bd9956c40 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:55.960660 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2893f88e-5d67-40b2-87fa-d41bd9956c40 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:55.961164 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2893f88e-5d67-40b2-87fa-d41bd9956c40 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:55.961966 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2893f88e-5d67-40b2-87fa-d41bd9956c40 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:55.962410 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2893f88e-5d67-40b2-87fa-d41bd9956c40 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:56.092619 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2893f88e-5d67-40b2-87fa-d41bd9956c40 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 21:59:56.100252 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2893f88e-5d67-40b2-87fa-d41bd9956c40 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1670 microversion: 2.1 time: 0.151505 Apr 16 21:59:56.100822 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3530/7219] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 21:59:55 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1670 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 21:59:56.118059 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5ccf937f-ff64-4237-94c6-29f8893f2902 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "caecf11b-4959-4ab5-8a6a-95c2f5b310fd"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:59:56.119254 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5ccf937f-ff64-4237-94c6-29f8893f2902 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 21:59:56.125453 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5ccf937f-ff64-4237-94c6-29f8893f2902 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:56.125929 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5ccf937f-ff64-4237-94c6-29f8893f2902 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:56.126728 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5ccf937f-ff64-4237-94c6-29f8893f2902 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 21:59:56.127190 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5ccf937f-ff64-4237-94c6-29f8893f2902 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 21:59:56.714698 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5ccf937f-ff64-4237-94c6-29f8893f2902 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "POST /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.601442 Apr 16 21:59:56.715325 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3690/7220] 10.222.0.20 () {60 vars in 1322 bytes} [Sat Apr 16 21:59:56 2022] POST /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f/os-volume_attachments => generated 194 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 21:59:59.994005 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b5f7cec5-fe68-4765-99ba-60b77275c618 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 21:59:59.994973 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b5f7cec5-fe68-4765-99ba-60b77275c618 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:00.001818 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b5f7cec5-fe68-4765-99ba-60b77275c618 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:00.002284 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b5f7cec5-fe68-4765-99ba-60b77275c618 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:00.003565 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b5f7cec5-fe68-4765-99ba-60b77275c618 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:00.004012 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b5f7cec5-fe68-4765-99ba-60b77275c618 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:00.030685 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b5f7cec5-fe68-4765-99ba-60b77275c618 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:00:00.036191 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b5f7cec5-fe68-4765-99ba-60b77275c618 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Old instance type m1.heat2, new instance type m1.heat {{(pid=137409) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 16 22:00:00.042709 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-b5f7cec5-fe68-4765-99ba-60b77275c618 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 22:00:00.043139 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-b5f7cec5-fe68-4765-99ba-60b77275c618 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 22:00:00.043619 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-b5f7cec5-fe68-4765-99ba-60b77275c618 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 22:00:00.044036 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-b5f7cec5-fe68-4765-99ba-60b77275c618 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 22:00:00.044476 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-b5f7cec5-fe68-4765-99ba-60b77275c618 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 22:00:00.221962 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b5f7cec5-fe68-4765-99ba-60b77275c618 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "POST /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f/action" status: 202 len: 0 microversion: 2.1 time: 0.231866 Apr 16 22:00:00.222757 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3531/7221] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 21:59:59 2022] POST /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 22:00:00.231384 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c1d7f440-e02b-4671-94f2-48598a5e5f65 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:00.232180 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c1d7f440-e02b-4671-94f2-48598a5e5f65 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:00.239556 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c1d7f440-e02b-4671-94f2-48598a5e5f65 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:00.240042 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c1d7f440-e02b-4671-94f2-48598a5e5f65 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:00.240880 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c1d7f440-e02b-4671-94f2-48598a5e5f65 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:00.241406 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c1d7f440-e02b-4671-94f2-48598a5e5f65 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:00.372624 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c1d7f440-e02b-4671-94f2-48598a5e5f65 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:00:00.381186 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c1d7f440-e02b-4671-94f2-48598a5e5f65 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1725 microversion: 2.1 time: 0.154209 Apr 16 22:00:00.383174 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3691/7222] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:00:00 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:00:01.400203 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2bf089c1-a429-4567-a1f0-664c2e8cd7a1 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:01.400864 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2bf089c1-a429-4567-a1f0-664c2e8cd7a1 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:01.407760 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2bf089c1-a429-4567-a1f0-664c2e8cd7a1 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:01.408258 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2bf089c1-a429-4567-a1f0-664c2e8cd7a1 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:01.409069 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2bf089c1-a429-4567-a1f0-664c2e8cd7a1 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:01.409523 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2bf089c1-a429-4567-a1f0-664c2e8cd7a1 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:01.547012 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2bf089c1-a429-4567-a1f0-664c2e8cd7a1 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:00:01.554945 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2bf089c1-a429-4567-a1f0-664c2e8cd7a1 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1725 microversion: 2.1 time: 0.160288 Apr 16 22:00:01.555525 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3532/7223] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:00:01 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:00:02.572454 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a6da7150-d9ac-43a1-a0f1-8e43b70f3589 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:02.573080 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a6da7150-d9ac-43a1-a0f1-8e43b70f3589 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:02.579784 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a6da7150-d9ac-43a1-a0f1-8e43b70f3589 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:02.580285 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a6da7150-d9ac-43a1-a0f1-8e43b70f3589 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:02.581082 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a6da7150-d9ac-43a1-a0f1-8e43b70f3589 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:02.581533 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a6da7150-d9ac-43a1-a0f1-8e43b70f3589 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:02.784479 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a6da7150-d9ac-43a1-a0f1-8e43b70f3589 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:00:02.792628 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a6da7150-d9ac-43a1-a0f1-8e43b70f3589 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1725 microversion: 2.1 time: 0.223926 Apr 16 22:00:02.793105 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3692/7224] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:00:02 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1725 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 22:00:03.809852 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ea486513-5d4e-470d-ab45-c1b89d83b36e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:03.810396 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ea486513-5d4e-470d-ab45-c1b89d83b36e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:03.817060 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ea486513-5d4e-470d-ab45-c1b89d83b36e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:03.817523 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ea486513-5d4e-470d-ab45-c1b89d83b36e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:03.818297 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ea486513-5d4e-470d-ab45-c1b89d83b36e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:03.818742 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ea486513-5d4e-470d-ab45-c1b89d83b36e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:03.947116 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ea486513-5d4e-470d-ab45-c1b89d83b36e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:00:03.955077 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ea486513-5d4e-470d-ab45-c1b89d83b36e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1730 microversion: 2.1 time: 0.149217 Apr 16 22:00:03.955773 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3533/7225] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:00:03 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:00:04.973664 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b56fe684-3efd-41b8-813d-46ce38faaf62 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:04.974289 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b56fe684-3efd-41b8-813d-46ce38faaf62 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:04.981585 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b56fe684-3efd-41b8-813d-46ce38faaf62 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:04.985349 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b56fe684-3efd-41b8-813d-46ce38faaf62 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:04.985349 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b56fe684-3efd-41b8-813d-46ce38faaf62 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:04.985349 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b56fe684-3efd-41b8-813d-46ce38faaf62 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:05.114797 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b56fe684-3efd-41b8-813d-46ce38faaf62 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:00:05.123487 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b56fe684-3efd-41b8-813d-46ce38faaf62 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1730 microversion: 2.1 time: 0.154074 Apr 16 22:00:05.124195 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3693/7226] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:00:04 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:00:06.140637 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ab24bf4d-a862-4b9f-9b38-f50590502198 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:06.141256 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ab24bf4d-a862-4b9f-9b38-f50590502198 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:06.147966 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ab24bf4d-a862-4b9f-9b38-f50590502198 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:06.148455 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ab24bf4d-a862-4b9f-9b38-f50590502198 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:06.149233 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ab24bf4d-a862-4b9f-9b38-f50590502198 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:06.150523 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ab24bf4d-a862-4b9f-9b38-f50590502198 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:06.276002 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ab24bf4d-a862-4b9f-9b38-f50590502198 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:00:06.283847 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ab24bf4d-a862-4b9f-9b38-f50590502198 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1730 microversion: 2.1 time: 0.147138 Apr 16 22:00:06.284679 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3534/7227] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:00:06 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:00:07.300263 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6816ddd3-4963-4696-b96d-e75aca73a0fb tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:07.300928 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6816ddd3-4963-4696-b96d-e75aca73a0fb tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:07.307807 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6816ddd3-4963-4696-b96d-e75aca73a0fb tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:07.308321 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6816ddd3-4963-4696-b96d-e75aca73a0fb tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:07.309115 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6816ddd3-4963-4696-b96d-e75aca73a0fb tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:07.309578 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6816ddd3-4963-4696-b96d-e75aca73a0fb tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:07.438174 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6816ddd3-4963-4696-b96d-e75aca73a0fb tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:00:07.446637 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6816ddd3-4963-4696-b96d-e75aca73a0fb tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1730 microversion: 2.1 time: 0.150365 Apr 16 22:00:07.447209 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3694/7228] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:00:07 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:00:08.464326 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c5aed9a7-cea2-4667-9ad5-909ed18fda1a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:08.464946 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c5aed9a7-cea2-4667-9ad5-909ed18fda1a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:08.471931 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c5aed9a7-cea2-4667-9ad5-909ed18fda1a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:08.472436 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c5aed9a7-cea2-4667-9ad5-909ed18fda1a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:08.473215 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c5aed9a7-cea2-4667-9ad5-909ed18fda1a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:08.473666 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c5aed9a7-cea2-4667-9ad5-909ed18fda1a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:08.599447 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c5aed9a7-cea2-4667-9ad5-909ed18fda1a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:00:08.607912 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c5aed9a7-cea2-4667-9ad5-909ed18fda1a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1730 microversion: 2.1 time: 0.148124 Apr 16 22:00:08.608515 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3535/7229] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:00:08 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:00:09.625805 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-97c8608b-c890-4eb5-aba8-128a721ae8ec tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:09.626442 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-97c8608b-c890-4eb5-aba8-128a721ae8ec tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:09.633885 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-97c8608b-c890-4eb5-aba8-128a721ae8ec tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:09.634387 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-97c8608b-c890-4eb5-aba8-128a721ae8ec tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:09.635183 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-97c8608b-c890-4eb5-aba8-128a721ae8ec tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:09.635643 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-97c8608b-c890-4eb5-aba8-128a721ae8ec tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:09.762039 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-97c8608b-c890-4eb5-aba8-128a721ae8ec tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:00:09.769907 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-97c8608b-c890-4eb5-aba8-128a721ae8ec tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1730 microversion: 2.1 time: 0.148067 Apr 16 22:00:09.770474 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3695/7230] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:00:09 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:00:10.787307 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-733e50dd-a53d-41f3-965b-d8aa988af7d3 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:10.791912 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-733e50dd-a53d-41f3-965b-d8aa988af7d3 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:10.795203 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-733e50dd-a53d-41f3-965b-d8aa988af7d3 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:10.795660 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-733e50dd-a53d-41f3-965b-d8aa988af7d3 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:10.796469 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-733e50dd-a53d-41f3-965b-d8aa988af7d3 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:10.796916 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-733e50dd-a53d-41f3-965b-d8aa988af7d3 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:10.933366 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-733e50dd-a53d-41f3-965b-d8aa988af7d3 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:00:10.941487 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-733e50dd-a53d-41f3-965b-d8aa988af7d3 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1730 microversion: 2.1 time: 0.158446 Apr 16 22:00:10.942025 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3536/7231] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:00:10 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:00:11.958670 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bb75bd92-eace-4c1e-bfc9-1ff9d2313d7f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:11.959826 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-bb75bd92-eace-4c1e-bfc9-1ff9d2313d7f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:11.966673 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bb75bd92-eace-4c1e-bfc9-1ff9d2313d7f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:11.967147 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bb75bd92-eace-4c1e-bfc9-1ff9d2313d7f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:11.967939 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bb75bd92-eace-4c1e-bfc9-1ff9d2313d7f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:11.968432 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bb75bd92-eace-4c1e-bfc9-1ff9d2313d7f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:12.097881 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-bb75bd92-eace-4c1e-bfc9-1ff9d2313d7f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:00:12.105782 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-bb75bd92-eace-4c1e-bfc9-1ff9d2313d7f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1730 microversion: 2.1 time: 0.151053 Apr 16 22:00:12.106359 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3696/7232] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:00:11 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:00:13.122847 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f8e5bec2-2ad3-423f-ad6a-7b80a100d610 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:13.123509 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f8e5bec2-2ad3-423f-ad6a-7b80a100d610 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:13.130546 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f8e5bec2-2ad3-423f-ad6a-7b80a100d610 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:13.131017 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f8e5bec2-2ad3-423f-ad6a-7b80a100d610 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:13.131804 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f8e5bec2-2ad3-423f-ad6a-7b80a100d610 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:13.132288 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f8e5bec2-2ad3-423f-ad6a-7b80a100d610 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:13.257518 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f8e5bec2-2ad3-423f-ad6a-7b80a100d610 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:00:13.265490 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f8e5bec2-2ad3-423f-ad6a-7b80a100d610 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1730 microversion: 2.1 time: 0.146586 Apr 16 22:00:13.266066 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3537/7233] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:00:13 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:00:14.282458 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a3eec618-8dda-44c5-b104-9e2498dfaef0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:14.283580 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a3eec618-8dda-44c5-b104-9e2498dfaef0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:14.290012 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a3eec618-8dda-44c5-b104-9e2498dfaef0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:14.290492 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a3eec618-8dda-44c5-b104-9e2498dfaef0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:14.291284 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a3eec618-8dda-44c5-b104-9e2498dfaef0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:14.291744 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a3eec618-8dda-44c5-b104-9e2498dfaef0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:14.419823 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a3eec618-8dda-44c5-b104-9e2498dfaef0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:00:14.427808 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a3eec618-8dda-44c5-b104-9e2498dfaef0 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1730 microversion: 2.1 time: 0.149291 Apr 16 22:00:14.428909 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3697/7234] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:00:14 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:00:15.446096 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-dd656043-4456-43ab-a2e6-6d6367f6b1bc tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:15.446756 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-dd656043-4456-43ab-a2e6-6d6367f6b1bc tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:15.454433 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dd656043-4456-43ab-a2e6-6d6367f6b1bc tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:15.454897 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dd656043-4456-43ab-a2e6-6d6367f6b1bc tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:15.455678 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dd656043-4456-43ab-a2e6-6d6367f6b1bc tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:15.456149 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dd656043-4456-43ab-a2e6-6d6367f6b1bc tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:15.589214 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-dd656043-4456-43ab-a2e6-6d6367f6b1bc tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:00:15.597329 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-dd656043-4456-43ab-a2e6-6d6367f6b1bc tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1730 microversion: 2.1 time: 0.155723 Apr 16 22:00:15.597911 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3538/7235] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:00:15 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:00:16.614116 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a917a9fe-8408-4cec-b156-1a110414cb64 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:16.614751 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a917a9fe-8408-4cec-b156-1a110414cb64 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:16.621723 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a917a9fe-8408-4cec-b156-1a110414cb64 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:16.622200 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a917a9fe-8408-4cec-b156-1a110414cb64 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:16.622989 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a917a9fe-8408-4cec-b156-1a110414cb64 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:16.623447 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a917a9fe-8408-4cec-b156-1a110414cb64 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:16.753634 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a917a9fe-8408-4cec-b156-1a110414cb64 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:00:16.761765 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a917a9fe-8408-4cec-b156-1a110414cb64 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1730 microversion: 2.1 time: 0.151575 Apr 16 22:00:16.762339 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3698/7236] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:00:16 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:00:17.779055 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5e05d63d-7ebc-4b23-9f35-78271ae4db99 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:17.779607 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5e05d63d-7ebc-4b23-9f35-78271ae4db99 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:17.786557 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5e05d63d-7ebc-4b23-9f35-78271ae4db99 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:17.787072 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5e05d63d-7ebc-4b23-9f35-78271ae4db99 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:17.788358 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5e05d63d-7ebc-4b23-9f35-78271ae4db99 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:17.788813 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5e05d63d-7ebc-4b23-9f35-78271ae4db99 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:17.916533 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5e05d63d-7ebc-4b23-9f35-78271ae4db99 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:00:17.924310 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5e05d63d-7ebc-4b23-9f35-78271ae4db99 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1730 microversion: 2.1 time: 0.149347 Apr 16 22:00:17.924880 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3539/7237] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:00:17 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:00:18.942385 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5e415236-fee8-4270-a7c4-e9d63f71e09b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:18.942929 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5e415236-fee8-4270-a7c4-e9d63f71e09b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:18.950709 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5e415236-fee8-4270-a7c4-e9d63f71e09b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:18.951182 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5e415236-fee8-4270-a7c4-e9d63f71e09b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:18.955386 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5e415236-fee8-4270-a7c4-e9d63f71e09b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:18.955386 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5e415236-fee8-4270-a7c4-e9d63f71e09b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:19.081666 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5e415236-fee8-4270-a7c4-e9d63f71e09b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:00:19.089786 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5e415236-fee8-4270-a7c4-e9d63f71e09b tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1730 microversion: 2.1 time: 0.151434 Apr 16 22:00:19.090366 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3699/7238] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:00:18 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:00:20.107286 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ee5e715f-3cdc-4b68-a268-a520a48482fb tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:20.107888 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ee5e715f-3cdc-4b68-a268-a520a48482fb tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:20.114728 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ee5e715f-3cdc-4b68-a268-a520a48482fb tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:20.115196 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ee5e715f-3cdc-4b68-a268-a520a48482fb tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:20.116629 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ee5e715f-3cdc-4b68-a268-a520a48482fb tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:20.117079 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ee5e715f-3cdc-4b68-a268-a520a48482fb tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:20.241711 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ee5e715f-3cdc-4b68-a268-a520a48482fb tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:00:20.249524 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ee5e715f-3cdc-4b68-a268-a520a48482fb tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1730 microversion: 2.1 time: 0.146153 Apr 16 22:00:20.250097 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3540/7239] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:00:20 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1730 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:00:21.266921 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6790885c-556a-4a41-8be2-d0590cf1873e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:21.267530 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6790885c-556a-4a41-8be2-d0590cf1873e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:21.275093 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6790885c-556a-4a41-8be2-d0590cf1873e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:21.275567 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6790885c-556a-4a41-8be2-d0590cf1873e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:21.276391 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6790885c-556a-4a41-8be2-d0590cf1873e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:21.276854 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6790885c-556a-4a41-8be2-d0590cf1873e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:21.411078 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6790885c-556a-4a41-8be2-d0590cf1873e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:00:21.419847 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6790885c-556a-4a41-8be2-d0590cf1873e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1729 microversion: 2.1 time: 0.156856 Apr 16 22:00:21.420471 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3700/7240] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:00:21 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:00:21.802224 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-1fbc8ed4-8cad-45a8-86e9-2329640603df req-e8fc5163-35d6-4aa3-947d-b76ab40948db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a20cde2-6d64-4864-923b-872decfbd83f", "name": "network-vif-unplugged", "status": "completed", "tag": "777f618f-2614-49d4-97d6-94c7da2c8040"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:00:21.811301 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-1fbc8ed4-8cad-45a8-86e9-2329640603df req-e8fc5163-35d6-4aa3-947d-b76ab40948db service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:21.811756 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-1fbc8ed4-8cad-45a8-86e9-2329640603df req-e8fc5163-35d6-4aa3-947d-b76ab40948db service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:21.823447 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-1fbc8ed4-8cad-45a8-86e9-2329640603df req-e8fc5163-35d6-4aa3-947d-b76ab40948db service nova] Creating event network-vif-unplugged:777f618f-2614-49d4-97d6-94c7da2c8040 for instance 7a20cde2-6d64-4864-923b-872decfbd83f on nch1-master-1 Apr 16 22:00:21.828770 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [req-1fbc8ed4-8cad-45a8-86e9-2329640603df req-e8fc5163-35d6-4aa3-947d-b76ab40948db service nova] Instance 7a20cde2-6d64-4864-923b-872decfbd83f is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137409) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 16 22:00:21.841340 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-1fbc8ed4-8cad-45a8-86e9-2329640603df req-e8fc5163-35d6-4aa3-947d-b76ab40948db service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042984 Apr 16 22:00:21.844258 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3541/7241] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:00:22.437893 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-61d3bad2-1f00-4eba-931a-b908475f4164 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:22.438590 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-61d3bad2-1f00-4eba-931a-b908475f4164 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:22.446470 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-61d3bad2-1f00-4eba-931a-b908475f4164 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:22.447036 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-61d3bad2-1f00-4eba-931a-b908475f4164 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:22.447929 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-61d3bad2-1f00-4eba-931a-b908475f4164 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:22.448483 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-61d3bad2-1f00-4eba-931a-b908475f4164 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:22.584264 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-61d3bad2-1f00-4eba-931a-b908475f4164 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:00:22.592437 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-61d3bad2-1f00-4eba-931a-b908475f4164 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1729 microversion: 2.1 time: 0.158496 Apr 16 22:00:22.593229 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3701/7242] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:00:22 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:00:23.610784 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-eba11e2e-16b1-4fb6-8712-6769b7cff670 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:23.611520 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-eba11e2e-16b1-4fb6-8712-6769b7cff670 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:23.618658 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eba11e2e-16b1-4fb6-8712-6769b7cff670 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:23.619121 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eba11e2e-16b1-4fb6-8712-6769b7cff670 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:23.619896 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eba11e2e-16b1-4fb6-8712-6769b7cff670 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:23.620366 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-eba11e2e-16b1-4fb6-8712-6769b7cff670 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:23.757457 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-eba11e2e-16b1-4fb6-8712-6769b7cff670 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:00:23.765474 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-eba11e2e-16b1-4fb6-8712-6769b7cff670 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1727 microversion: 2.1 time: 0.158995 Apr 16 22:00:23.766064 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3542/7243] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:00:23 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:00:23.855519 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-61da69f8-f595-43d6-a828-43acf20b32fa req-29b7dce6-b514-4652-886e-52befc5e4b57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a20cde2-6d64-4864-923b-872decfbd83f", "tag": "777f618f-2614-49d4-97d6-94c7da2c8040"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:00:23.864447 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-61da69f8-f595-43d6-a828-43acf20b32fa req-29b7dce6-b514-4652-886e-52befc5e4b57 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:23.865016 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-61da69f8-f595-43d6-a828-43acf20b32fa req-29b7dce6-b514-4652-886e-52befc5e4b57 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:23.876410 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-61da69f8-f595-43d6-a828-43acf20b32fa req-29b7dce6-b514-4652-886e-52befc5e4b57 service nova] Creating event network-changed:777f618f-2614-49d4-97d6-94c7da2c8040 for instance 7a20cde2-6d64-4864-923b-872decfbd83f on nch1-master-1 Apr 16 22:00:23.882160 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [req-61da69f8-f595-43d6-a828-43acf20b32fa req-29b7dce6-b514-4652-886e-52befc5e4b57 service nova] Instance 7a20cde2-6d64-4864-923b-872decfbd83f is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 16 22:00:23.893332 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-61da69f8-f595-43d6-a828-43acf20b32fa req-29b7dce6-b514-4652-886e-52befc5e4b57 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041513 Apr 16 22:00:23.894210 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3702/7244] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:00:24.783287 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-91080ec6-5103-4736-8608-b13067bb8ba1 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:24.783906 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-91080ec6-5103-4736-8608-b13067bb8ba1 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:24.790005 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-91080ec6-5103-4736-8608-b13067bb8ba1 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:24.790468 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-91080ec6-5103-4736-8608-b13067bb8ba1 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:24.791236 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-91080ec6-5103-4736-8608-b13067bb8ba1 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:24.791680 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-91080ec6-5103-4736-8608-b13067bb8ba1 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:24.917543 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-91080ec6-5103-4736-8608-b13067bb8ba1 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:00:24.925438 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-91080ec6-5103-4736-8608-b13067bb8ba1 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1727 microversion: 2.1 time: 0.146343 Apr 16 22:00:24.926038 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3543/7245] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:00:24 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:00:25.945484 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f50863fa-8eb5-43c7-b6b8-365e931300d9 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:25.946218 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f50863fa-8eb5-43c7-b6b8-365e931300d9 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:25.952439 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f50863fa-8eb5-43c7-b6b8-365e931300d9 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:25.952913 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f50863fa-8eb5-43c7-b6b8-365e931300d9 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:25.953701 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f50863fa-8eb5-43c7-b6b8-365e931300d9 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:25.954177 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f50863fa-8eb5-43c7-b6b8-365e931300d9 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:26.080409 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f50863fa-8eb5-43c7-b6b8-365e931300d9 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:00:26.088844 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f50863fa-8eb5-43c7-b6b8-365e931300d9 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1727 microversion: 2.1 time: 0.149017 Apr 16 22:00:26.089449 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3703/7246] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:00:25 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:00:27.106463 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d32f3722-8735-4f76-b416-a42dbe57a9b4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:27.107202 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d32f3722-8735-4f76-b416-a42dbe57a9b4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:27.114374 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d32f3722-8735-4f76-b416-a42dbe57a9b4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:27.114850 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d32f3722-8735-4f76-b416-a42dbe57a9b4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:27.116163 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d32f3722-8735-4f76-b416-a42dbe57a9b4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:27.116637 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d32f3722-8735-4f76-b416-a42dbe57a9b4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:27.251985 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d32f3722-8735-4f76-b416-a42dbe57a9b4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:00:27.260909 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d32f3722-8735-4f76-b416-a42dbe57a9b4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1727 microversion: 2.1 time: 0.158413 Apr 16 22:00:27.261531 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3544/7247] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:00:27 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:00:28.278326 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e233601a-4dbf-4267-8cde-151190d7ec0c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:28.278956 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e233601a-4dbf-4267-8cde-151190d7ec0c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:28.284984 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e233601a-4dbf-4267-8cde-151190d7ec0c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:28.285452 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e233601a-4dbf-4267-8cde-151190d7ec0c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:28.286270 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e233601a-4dbf-4267-8cde-151190d7ec0c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:28.286718 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e233601a-4dbf-4267-8cde-151190d7ec0c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:28.420922 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e233601a-4dbf-4267-8cde-151190d7ec0c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:00:28.429794 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e233601a-4dbf-4267-8cde-151190d7ec0c tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1724 microversion: 2.1 time: 0.155647 Apr 16 22:00:28.430575 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3704/7248] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:00:28 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:00:28.446214 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-da69e934-74cb-4101-986e-14c82425ade4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:00:28.446790 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-da69e934-74cb-4101-986e-14c82425ade4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:28.454055 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-da69e934-74cb-4101-986e-14c82425ade4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:28.454514 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-da69e934-74cb-4101-986e-14c82425ade4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:28.455311 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-da69e934-74cb-4101-986e-14c82425ade4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:28.455758 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-da69e934-74cb-4101-986e-14c82425ade4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:28.495301 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-da69e934-74cb-4101-986e-14c82425ade4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:28.495787 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-da69e934-74cb-4101-986e-14c82425ade4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:28.496623 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-da69e934-74cb-4101-986e-14c82425ade4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:28.497065 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-da69e934-74cb-4101-986e-14c82425ade4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:28.517010 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-da69e934-74cb-4101-986e-14c82425ade4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Getting quotas for project 14958c4ca99847bfb86911005da65809. Resources: {'ram', 'cores'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 22:00:28.522165 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-da69e934-74cb-4101-986e-14c82425ade4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Getting quotas for user 63b69490b00b49789e7859dca41f4a5d and project 14958c4ca99847bfb86911005da65809. Resources: {'ram', 'cores'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 22:00:28.932892 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-da69e934-74cb-4101-986e-14c82425ade4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "POST /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f/action" status: 202 len: 0 microversion: 2.1 time: 0.490343 Apr 16 22:00:28.934144 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3545/7249] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 22:00:28 2022] POST /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f/action => generated 0 bytes in 492 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 22:00:28.955950 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0a0560aa-c5ee-4059-9f2f-5e16cd103b32 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:28.956636 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0a0560aa-c5ee-4059-9f2f-5e16cd103b32 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:28.973941 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0a0560aa-c5ee-4059-9f2f-5e16cd103b32 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:28.974490 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0a0560aa-c5ee-4059-9f2f-5e16cd103b32 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:28.976239 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0a0560aa-c5ee-4059-9f2f-5e16cd103b32 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:28.976733 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0a0560aa-c5ee-4059-9f2f-5e16cd103b32 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:29.120919 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0a0560aa-c5ee-4059-9f2f-5e16cd103b32 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:00:29.130465 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0a0560aa-c5ee-4059-9f2f-5e16cd103b32 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1723 microversion: 2.1 time: 0.192137 Apr 16 22:00:29.138256 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3705/7250] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:00:28 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:00:30.150415 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0c4466c6-8902-408e-a095-633789a77294 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:30.151160 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0c4466c6-8902-408e-a095-633789a77294 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:30.157409 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0c4466c6-8902-408e-a095-633789a77294 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:30.157873 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0c4466c6-8902-408e-a095-633789a77294 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:30.158654 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0c4466c6-8902-408e-a095-633789a77294 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:30.159124 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0c4466c6-8902-408e-a095-633789a77294 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:30.294033 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0c4466c6-8902-408e-a095-633789a77294 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:00:30.302120 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0c4466c6-8902-408e-a095-633789a77294 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1723 microversion: 2.1 time: 0.157391 Apr 16 22:00:30.302700 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3546/7251] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:00:30 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:00:30.863261 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-4b602f0f-94d4-4c75-a356-9e9653dc697d req-e6801c0d-1deb-4440-bd6d-258d263f6025 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a20cde2-6d64-4864-923b-872decfbd83f", "name": "network-vif-plugged", "status": "completed", "tag": "777f618f-2614-49d4-97d6-94c7da2c8040"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:00:30.872675 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-4b602f0f-94d4-4c75-a356-9e9653dc697d req-e6801c0d-1deb-4440-bd6d-258d263f6025 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:30.873140 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-4b602f0f-94d4-4c75-a356-9e9653dc697d req-e6801c0d-1deb-4440-bd6d-258d263f6025 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:30.885363 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-4b602f0f-94d4-4c75-a356-9e9653dc697d req-e6801c0d-1deb-4440-bd6d-258d263f6025 service nova] Creating event network-vif-plugged:777f618f-2614-49d4-97d6-94c7da2c8040 for instance 7a20cde2-6d64-4864-923b-872decfbd83f on nch1-master-1 Apr 16 22:00:30.890641 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [req-4b602f0f-94d4-4c75-a356-9e9653dc697d req-e6801c0d-1deb-4440-bd6d-258d263f6025 service nova] Instance 7a20cde2-6d64-4864-923b-872decfbd83f is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 16 22:00:30.901279 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-4b602f0f-94d4-4c75-a356-9e9653dc697d req-e6801c0d-1deb-4440-bd6d-258d263f6025 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041770 Apr 16 22:00:30.901887 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3706/7252] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:00:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:00:31.318890 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-dc3f9ce6-51c3-4d5c-8408-4eeba5f9e3f4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:31.319492 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-dc3f9ce6-51c3-4d5c-8408-4eeba5f9e3f4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:31.326579 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dc3f9ce6-51c3-4d5c-8408-4eeba5f9e3f4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:31.331176 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dc3f9ce6-51c3-4d5c-8408-4eeba5f9e3f4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:31.331176 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dc3f9ce6-51c3-4d5c-8408-4eeba5f9e3f4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:31.331176 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dc3f9ce6-51c3-4d5c-8408-4eeba5f9e3f4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:31.458051 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-dc3f9ce6-51c3-4d5c-8408-4eeba5f9e3f4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:00:31.465987 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-dc3f9ce6-51c3-4d5c-8408-4eeba5f9e3f4 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1723 microversion: 2.1 time: 0.151073 Apr 16 22:00:31.466563 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3547/7253] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:00:31 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:00:32.484311 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9796f50e-eb0c-4125-a302-fe67145fb455 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:32.488085 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9796f50e-eb0c-4125-a302-fe67145fb455 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:32.492255 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9796f50e-eb0c-4125-a302-fe67145fb455 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:32.492725 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9796f50e-eb0c-4125-a302-fe67145fb455 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:32.493562 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9796f50e-eb0c-4125-a302-fe67145fb455 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:32.494030 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9796f50e-eb0c-4125-a302-fe67145fb455 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:32.631169 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9796f50e-eb0c-4125-a302-fe67145fb455 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:00:32.640135 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9796f50e-eb0c-4125-a302-fe67145fb455 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1723 microversion: 2.1 time: 0.161013 Apr 16 22:00:32.640937 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3707/7254] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:00:32 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:00:33.561552 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-325f6f4f-90b6-49bc-8bf4-3dce5ec34709 req-5aca69d1-493b-4f2e-b15c-5fa42b818279 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a20cde2-6d64-4864-923b-872decfbd83f", "name": "network-vif-unplugged", "status": "completed", "tag": "777f618f-2614-49d4-97d6-94c7da2c8040"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:00:33.570823 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-325f6f4f-90b6-49bc-8bf4-3dce5ec34709 req-5aca69d1-493b-4f2e-b15c-5fa42b818279 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:33.571283 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-325f6f4f-90b6-49bc-8bf4-3dce5ec34709 req-5aca69d1-493b-4f2e-b15c-5fa42b818279 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:33.582532 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-325f6f4f-90b6-49bc-8bf4-3dce5ec34709 req-5aca69d1-493b-4f2e-b15c-5fa42b818279 service nova] Creating event network-vif-unplugged:777f618f-2614-49d4-97d6-94c7da2c8040 for instance 7a20cde2-6d64-4864-923b-872decfbd83f on nch2-master-1 Apr 16 22:00:33.588429 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [req-325f6f4f-90b6-49bc-8bf4-3dce5ec34709 req-5aca69d1-493b-4f2e-b15c-5fa42b818279 service nova] Instance 7a20cde2-6d64-4864-923b-872decfbd83f is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137409) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 16 22:00:33.599124 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-325f6f4f-90b6-49bc-8bf4-3dce5ec34709 req-5aca69d1-493b-4f2e-b15c-5fa42b818279 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041396 Apr 16 22:00:33.599716 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3548/7255] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:00:33.657425 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-768bfd3a-e781-4cad-aea9-73ee480ea11e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:33.658079 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-768bfd3a-e781-4cad-aea9-73ee480ea11e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:33.666568 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-768bfd3a-e781-4cad-aea9-73ee480ea11e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:33.667296 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-768bfd3a-e781-4cad-aea9-73ee480ea11e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:33.668107 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-768bfd3a-e781-4cad-aea9-73ee480ea11e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:33.668800 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-768bfd3a-e781-4cad-aea9-73ee480ea11e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:34.197486 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-768bfd3a-e781-4cad-aea9-73ee480ea11e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:00:34.206597 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-768bfd3a-e781-4cad-aea9-73ee480ea11e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1723 microversion: 2.1 time: 0.553207 Apr 16 22:00:34.207897 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3708/7256] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:00:33 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1723 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:00:35.226575 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0588c61e-b009-41af-ab3c-2c1a8075ff43 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:35.227543 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0588c61e-b009-41af-ab3c-2c1a8075ff43 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:35.234230 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0588c61e-b009-41af-ab3c-2c1a8075ff43 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:35.234693 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0588c61e-b009-41af-ab3c-2c1a8075ff43 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:35.235480 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0588c61e-b009-41af-ab3c-2c1a8075ff43 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:35.235924 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0588c61e-b009-41af-ab3c-2c1a8075ff43 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:35.376148 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0588c61e-b009-41af-ab3c-2c1a8075ff43 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:00:35.385298 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0588c61e-b009-41af-ab3c-2c1a8075ff43 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1723 microversion: 2.1 time: 0.163870 Apr 16 22:00:35.385820 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3549/7257] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:00:35 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:00:35.613180 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-5e537ca3-7c64-4e71-9d4b-69dba2f61de9 req-d5405a0f-1f07-440b-bc12-346d3171084b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a20cde2-6d64-4864-923b-872decfbd83f", "tag": "777f618f-2614-49d4-97d6-94c7da2c8040"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:00:35.622792 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-5e537ca3-7c64-4e71-9d4b-69dba2f61de9 req-d5405a0f-1f07-440b-bc12-346d3171084b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:35.623252 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-5e537ca3-7c64-4e71-9d4b-69dba2f61de9 req-d5405a0f-1f07-440b-bc12-346d3171084b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:35.635526 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-5e537ca3-7c64-4e71-9d4b-69dba2f61de9 req-d5405a0f-1f07-440b-bc12-346d3171084b service nova] Creating event network-changed:777f618f-2614-49d4-97d6-94c7da2c8040 for instance 7a20cde2-6d64-4864-923b-872decfbd83f on nch2-master-1 Apr 16 22:00:35.640653 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [req-5e537ca3-7c64-4e71-9d4b-69dba2f61de9 req-d5405a0f-1f07-440b-bc12-346d3171084b service nova] Instance 7a20cde2-6d64-4864-923b-872decfbd83f is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 16 22:00:35.651849 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-5e537ca3-7c64-4e71-9d4b-69dba2f61de9 req-d5405a0f-1f07-440b-bc12-346d3171084b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042415 Apr 16 22:00:35.652452 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3709/7258] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:00:36.403455 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a85759f0-d91d-4ca0-8def-979e5819f841 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:36.404327 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a85759f0-d91d-4ca0-8def-979e5819f841 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:36.411300 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a85759f0-d91d-4ca0-8def-979e5819f841 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:36.411762 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a85759f0-d91d-4ca0-8def-979e5819f841 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:36.412693 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a85759f0-d91d-4ca0-8def-979e5819f841 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:36.413179 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a85759f0-d91d-4ca0-8def-979e5819f841 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:36.549882 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a85759f0-d91d-4ca0-8def-979e5819f841 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:00:36.557754 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a85759f0-d91d-4ca0-8def-979e5819f841 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1723 microversion: 2.1 time: 0.158415 Apr 16 22:00:36.558320 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3550/7259] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:00:36 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:00:37.575548 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f1a41fb8-0f75-4c4b-9f64-14da4cbeac58 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:37.576398 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f1a41fb8-0f75-4c4b-9f64-14da4cbeac58 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:37.583544 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f1a41fb8-0f75-4c4b-9f64-14da4cbeac58 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:37.584020 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f1a41fb8-0f75-4c4b-9f64-14da4cbeac58 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:37.585346 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f1a41fb8-0f75-4c4b-9f64-14da4cbeac58 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:37.585805 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f1a41fb8-0f75-4c4b-9f64-14da4cbeac58 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:37.719953 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f1a41fb8-0f75-4c4b-9f64-14da4cbeac58 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:00:37.728890 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f1a41fb8-0f75-4c4b-9f64-14da4cbeac58 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1723 microversion: 2.1 time: 0.157656 Apr 16 22:00:37.731949 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3710/7260] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:00:37 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:00:38.747480 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3280e1ca-3999-46ff-9539-08625dd12dfc tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:38.748097 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3280e1ca-3999-46ff-9539-08625dd12dfc tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:38.754980 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3280e1ca-3999-46ff-9539-08625dd12dfc tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:38.755443 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3280e1ca-3999-46ff-9539-08625dd12dfc tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:38.756246 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3280e1ca-3999-46ff-9539-08625dd12dfc tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:38.756697 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3280e1ca-3999-46ff-9539-08625dd12dfc tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:38.885952 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3280e1ca-3999-46ff-9539-08625dd12dfc tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:00:38.893895 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3280e1ca-3999-46ff-9539-08625dd12dfc tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1723 microversion: 2.1 time: 0.150345 Apr 16 22:00:38.894476 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3551/7261] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:00:38 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:00:39.910916 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-96d722ff-e684-4cd0-8683-b24d75b1e9f7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:39.911569 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-96d722ff-e684-4cd0-8683-b24d75b1e9f7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:39.918415 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-96d722ff-e684-4cd0-8683-b24d75b1e9f7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:39.918889 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-96d722ff-e684-4cd0-8683-b24d75b1e9f7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:39.919686 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-96d722ff-e684-4cd0-8683-b24d75b1e9f7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:39.920155 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-96d722ff-e684-4cd0-8683-b24d75b1e9f7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:40.050423 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-96d722ff-e684-4cd0-8683-b24d75b1e9f7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:00:40.058837 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-96d722ff-e684-4cd0-8683-b24d75b1e9f7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1723 microversion: 2.1 time: 0.151950 Apr 16 22:00:40.059414 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3711/7262] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:00:39 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:00:41.081139 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-17e2429b-dc99-4102-a0b3-cf8903fdfaab tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:41.081759 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-17e2429b-dc99-4102-a0b3-cf8903fdfaab tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:41.089129 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-17e2429b-dc99-4102-a0b3-cf8903fdfaab tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:41.089589 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-17e2429b-dc99-4102-a0b3-cf8903fdfaab tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:41.090361 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-17e2429b-dc99-4102-a0b3-cf8903fdfaab tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:41.090805 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-17e2429b-dc99-4102-a0b3-cf8903fdfaab tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:41.218013 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-17e2429b-dc99-4102-a0b3-cf8903fdfaab tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:00:41.226085 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-17e2429b-dc99-4102-a0b3-cf8903fdfaab tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1716 microversion: 2.1 time: 0.148891 Apr 16 22:00:41.226652 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3552/7263] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:00:41 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1716 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:00:41.242265 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3cc62f4a-b164-4ffd-b4d0-7c13451fe750 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:41.242933 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3cc62f4a-b164-4ffd-b4d0-7c13451fe750 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:41.249746 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3cc62f4a-b164-4ffd-b4d0-7c13451fe750 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:41.250223 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3cc62f4a-b164-4ffd-b4d0-7c13451fe750 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:41.251051 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3cc62f4a-b164-4ffd-b4d0-7c13451fe750 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:41.251509 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3cc62f4a-b164-4ffd-b4d0-7c13451fe750 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:41.384601 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3cc62f4a-b164-4ffd-b4d0-7c13451fe750 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:00:41.392484 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3cc62f4a-b164-4ffd-b4d0-7c13451fe750 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1716 microversion: 2.1 time: 0.154138 Apr 16 22:00:41.393078 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3712/7264] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:00:41 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1716 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:00:41.408841 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2614b520-f3c8-42f4-9d5a-d5376f7ad202 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:41.412843 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2614b520-f3c8-42f4-9d5a-d5376f7ad202 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:41.415288 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2614b520-f3c8-42f4-9d5a-d5376f7ad202 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:41.415749 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2614b520-f3c8-42f4-9d5a-d5376f7ad202 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:41.416550 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2614b520-f3c8-42f4-9d5a-d5376f7ad202 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:41.416997 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2614b520-f3c8-42f4-9d5a-d5376f7ad202 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:41.550008 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2614b520-f3c8-42f4-9d5a-d5376f7ad202 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:00:41.558566 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2614b520-f3c8-42f4-9d5a-d5376f7ad202 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1716 microversion: 2.1 time: 0.153559 Apr 16 22:00:41.559318 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3553/7265] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:00:41 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1716 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:00:41.575158 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-30c90c43-1190-4962-98f1-a898cdf6284d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:41.575671 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-30c90c43-1190-4962-98f1-a898cdf6284d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:41.581618 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-30c90c43-1190-4962-98f1-a898cdf6284d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:41.582031 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-30c90c43-1190-4962-98f1-a898cdf6284d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:41.582818 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-30c90c43-1190-4962-98f1-a898cdf6284d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:41.583270 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-30c90c43-1190-4962-98f1-a898cdf6284d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:41.607202 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-30c90c43-1190-4962-98f1-a898cdf6284d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 22:00:41.886547 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-30c90c43-1190-4962-98f1-a898cdf6284d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 204 len: 0 microversion: 2.1 time: 0.314833 Apr 16 22:00:41.887062 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3713/7266] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 22:00:41 2022] DELETE /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 22:00:41.895234 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b9102962-1780-412f-b14d-2681231469d8 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:41.897852 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b9102962-1780-412f-b14d-2681231469d8 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:41.902633 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b9102962-1780-412f-b14d-2681231469d8 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:41.903095 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b9102962-1780-412f-b14d-2681231469d8 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:41.903891 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b9102962-1780-412f-b14d-2681231469d8 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:41.904352 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b9102962-1780-412f-b14d-2681231469d8 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:42.032516 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b9102962-1780-412f-b14d-2681231469d8 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:00:42.040406 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b9102962-1780-412f-b14d-2681231469d8 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1722 microversion: 2.1 time: 0.149047 Apr 16 22:00:42.040980 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3554/7267] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:00:41 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1722 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:00:42.481705 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-309bce54-55b6-46bc-a576-0340a9c426fd req-19900562-8640-4b0c-88a4-09cc526392da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a20cde2-6d64-4864-923b-872decfbd83f", "name": "network-vif-plugged", "status": "completed", "tag": "777f618f-2614-49d4-97d6-94c7da2c8040"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:00:42.491104 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-309bce54-55b6-46bc-a576-0340a9c426fd req-19900562-8640-4b0c-88a4-09cc526392da service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:42.491575 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-309bce54-55b6-46bc-a576-0340a9c426fd req-19900562-8640-4b0c-88a4-09cc526392da service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:42.502491 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-309bce54-55b6-46bc-a576-0340a9c426fd req-19900562-8640-4b0c-88a4-09cc526392da service nova] Creating event network-vif-plugged:777f618f-2614-49d4-97d6-94c7da2c8040 for instance 7a20cde2-6d64-4864-923b-872decfbd83f on nch2-master-1 Apr 16 22:00:42.507314 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-309bce54-55b6-46bc-a576-0340a9c426fd req-19900562-8640-4b0c-88a4-09cc526392da service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029863 Apr 16 22:00:42.507889 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3714/7268] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 22:00:43.057562 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d8c31bdd-24d4-421a-ad61-45a3863962de tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:43.058205 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d8c31bdd-24d4-421a-ad61-45a3863962de tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:43.064972 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d8c31bdd-24d4-421a-ad61-45a3863962de tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:43.065437 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d8c31bdd-24d4-421a-ad61-45a3863962de tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:43.066211 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d8c31bdd-24d4-421a-ad61-45a3863962de tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:43.066656 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d8c31bdd-24d4-421a-ad61-45a3863962de tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:43.198369 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d8c31bdd-24d4-421a-ad61-45a3863962de tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:00:43.206308 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d8c31bdd-24d4-421a-ad61-45a3863962de tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1722 microversion: 2.1 time: 0.152735 Apr 16 22:00:43.206889 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3555/7269] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:00:43 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:00:44.225753 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-899362e2-238d-4e27-a479-633d7b963cc7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:44.226472 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-899362e2-238d-4e27-a479-633d7b963cc7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:44.234448 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-899362e2-238d-4e27-a479-633d7b963cc7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:44.236875 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-899362e2-238d-4e27-a479-633d7b963cc7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:44.236875 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-899362e2-238d-4e27-a479-633d7b963cc7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:44.236875 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-899362e2-238d-4e27-a479-633d7b963cc7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:44.344317 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-899362e2-238d-4e27-a479-633d7b963cc7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '63b69490b00b49789e7859dca41f4a5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14958c4ca99847bfb86911005da65809', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:00:44.353402 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-899362e2-238d-4e27-a479-633d7b963cc7 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 200 len: 1655 microversion: 2.1 time: 0.133489 Apr 16 22:00:44.354679 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3715/7270] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:00:44 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 1655 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:00:44.590632 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-af14f5bb-2d25-4c12-8b11-07fa68034fc2 req-a1bcdb06-04fe-4f08-bf2d-152fd5fceae2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a20cde2-6d64-4864-923b-872decfbd83f", "name": "network-vif-deleted", "tag": "777f618f-2614-49d4-97d6-94c7da2c8040"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:00:44.600430 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-af14f5bb-2d25-4c12-8b11-07fa68034fc2 req-a1bcdb06-04fe-4f08-bf2d-152fd5fceae2 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:44.601059 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-af14f5bb-2d25-4c12-8b11-07fa68034fc2 req-a1bcdb06-04fe-4f08-bf2d-152fd5fceae2 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:44.612660 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-af14f5bb-2d25-4c12-8b11-07fa68034fc2 req-a1bcdb06-04fe-4f08-bf2d-152fd5fceae2 service nova] Creating event network-vif-deleted:777f618f-2614-49d4-97d6-94c7da2c8040 for instance 7a20cde2-6d64-4864-923b-872decfbd83f on nch2-master-1 Apr 16 22:00:44.617962 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-af14f5bb-2d25-4c12-8b11-07fa68034fc2 req-a1bcdb06-04fe-4f08-bf2d-152fd5fceae2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031460 Apr 16 22:00:44.618749 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3556/7271] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:00:45.371859 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-db911963-2397-4639-925c-77a291d61cb3 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:45.372522 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-db911963-2397-4639-925c-77a291d61cb3 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:45.379338 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-db911963-2397-4639-925c-77a291d61cb3 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:45.381648 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-db911963-2397-4639-925c-77a291d61cb3 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:45.381648 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-db911963-2397-4639-925c-77a291d61cb3 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:45.381648 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-db911963-2397-4639-925c-77a291d61cb3 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:45.397117 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-db911963-2397-4639-925c-77a291d61cb3 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] HTTP exception thrown: Instance 7a20cde2-6d64-4864-923b-872decfbd83f could not be found. Apr 16 22:00:45.397873 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-db911963-2397-4639-925c-77a291d61cb3 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Returning 404 to user: Instance 7a20cde2-6d64-4864-923b-872decfbd83f could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 22:00:45.400947 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-db911963-2397-4639-925c-77a291d61cb3 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 404 len: 111 microversion: 2.1 time: 0.030908 Apr 16 22:00:45.401545 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3716/7272] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:00:45 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 22:00:45.461557 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bd99dcdf-062b-4a00-9444-bdc7bb9a6099 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:45.466049 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bd99dcdf-062b-4a00-9444-bdc7bb9a6099 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:45.469668 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bd99dcdf-062b-4a00-9444-bdc7bb9a6099 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:45.470117 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bd99dcdf-062b-4a00-9444-bdc7bb9a6099 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:45.471107 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bd99dcdf-062b-4a00-9444-bdc7bb9a6099 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:45.471550 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bd99dcdf-062b-4a00-9444-bdc7bb9a6099 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:45.485715 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-bd99dcdf-062b-4a00-9444-bdc7bb9a6099 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] HTTP exception thrown: Instance 7a20cde2-6d64-4864-923b-872decfbd83f could not be found. Apr 16 22:00:45.486324 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bd99dcdf-062b-4a00-9444-bdc7bb9a6099 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Returning 404 to user: Instance 7a20cde2-6d64-4864-923b-872decfbd83f could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 22:00:45.487176 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bd99dcdf-062b-4a00-9444-bdc7bb9a6099 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031881 Apr 16 22:00:45.487726 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3557/7273] 10.222.0.20 () {58 vars in 1301 bytes} [Sat Apr 16 22:00:45 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 22:00:49.947758 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-acf949f0-59ab-47d8-86dc-6b181b2ee40d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:49.948325 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-acf949f0-59ab-47d8-86dc-6b181b2ee40d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:49.955375 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-acf949f0-59ab-47d8-86dc-6b181b2ee40d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:49.955861 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-acf949f0-59ab-47d8-86dc-6b181b2ee40d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:49.956692 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-acf949f0-59ab-47d8-86dc-6b181b2ee40d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:49.957158 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-acf949f0-59ab-47d8-86dc-6b181b2ee40d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:49.970656 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-acf949f0-59ab-47d8-86dc-6b181b2ee40d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] HTTP exception thrown: Instance 7a20cde2-6d64-4864-923b-872decfbd83f could not be found. Apr 16 22:00:49.971260 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-acf949f0-59ab-47d8-86dc-6b181b2ee40d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Returning 404 to user: Instance 7a20cde2-6d64-4864-923b-872decfbd83f could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 22:00:49.972103 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-acf949f0-59ab-47d8-86dc-6b181b2ee40d tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 404 len: 111 microversion: 2.1 time: 0.028253 Apr 16 22:00:49.972655 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3717/7274] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 22:00:49 2022] DELETE /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 22:00:49.981212 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b4140c9a-8e51-4a8e-914e-27bdd70c49c8 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:49.981842 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b4140c9a-8e51-4a8e-914e-27bdd70c49c8 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7a20cde2-6d64-4864-923b-872decfbd83f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:49.988734 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b4140c9a-8e51-4a8e-914e-27bdd70c49c8 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:49.989202 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b4140c9a-8e51-4a8e-914e-27bdd70c49c8 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:49.989990 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b4140c9a-8e51-4a8e-914e-27bdd70c49c8 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:49.991137 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b4140c9a-8e51-4a8e-914e-27bdd70c49c8 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:50.004389 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-b4140c9a-8e51-4a8e-914e-27bdd70c49c8 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] HTTP exception thrown: Instance 7a20cde2-6d64-4864-923b-872decfbd83f could not be found. Apr 16 22:00:50.004982 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b4140c9a-8e51-4a8e-914e-27bdd70c49c8 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Returning 404 to user: Instance 7a20cde2-6d64-4864-923b-872decfbd83f could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 22:00:50.005831 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b4140c9a-8e51-4a8e-914e-27bdd70c49c8 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f" status: 404 len: 111 microversion: 2.1 time: 0.028614 Apr 16 22:00:50.006352 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3558/7275] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:00:49 2022] GET /compute/v2.1/servers/7a20cde2-6d64-4864-923b-872decfbd83f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 22:00:50.014235 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-dcb7f374-c43a-4924-a92e-d17629fec19f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:50.014754 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-dcb7f374-c43a-4924-a92e-d17629fec19f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:50.021003 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dcb7f374-c43a-4924-a92e-d17629fec19f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:50.021547 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dcb7f374-c43a-4924-a92e-d17629fec19f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:50.022330 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dcb7f374-c43a-4924-a92e-d17629fec19f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:50.022803 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dcb7f374-c43a-4924-a92e-d17629fec19f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:50.036028 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-dcb7f374-c43a-4924-a92e-d17629fec19f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] HTTP exception thrown: Instance 7d2409fb-599b-4139-9969-f113f6d9b0e3 could not be found. Apr 16 22:00:50.036649 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-dcb7f374-c43a-4924-a92e-d17629fec19f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Returning 404 to user: Instance 7d2409fb-599b-4139-9969-f113f6d9b0e3 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 22:00:50.037979 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-dcb7f374-c43a-4924-a92e-d17629fec19f tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "DELETE /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3" status: 404 len: 111 microversion: 2.1 time: 0.027628 Apr 16 22:00:50.038500 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3718/7276] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 22:00:50 2022] DELETE /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 22:00:50.046262 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9291b648-392e-46bb-acf2-8f35c452f69e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:50.046891 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9291b648-392e-46bb-acf2-8f35c452f69e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 7d2409fb-599b-4139-9969-f113f6d9b0e3] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:50.053440 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9291b648-392e-46bb-acf2-8f35c452f69e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:50.053908 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9291b648-392e-46bb-acf2-8f35c452f69e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:50.054723 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9291b648-392e-46bb-acf2-8f35c452f69e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:50.055180 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9291b648-392e-46bb-acf2-8f35c452f69e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:50.068365 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-9291b648-392e-46bb-acf2-8f35c452f69e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] HTTP exception thrown: Instance 7d2409fb-599b-4139-9969-f113f6d9b0e3 could not be found. Apr 16 22:00:50.068962 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9291b648-392e-46bb-acf2-8f35c452f69e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Returning 404 to user: Instance 7d2409fb-599b-4139-9969-f113f6d9b0e3 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 22:00:50.069796 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9291b648-392e-46bb-acf2-8f35c452f69e tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3" status: 404 len: 111 microversion: 2.1 time: 0.027406 Apr 16 22:00:50.070326 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3559/7277] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:00:50 2022] GET /compute/v2.1/servers/7d2409fb-599b-4139-9969-f113f6d9b0e3 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 22:00:50.077950 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f1304af7-9eb5-486d-bd8c-b259279b8165 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:50.078461 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f1304af7-9eb5-486d-bd8c-b259279b8165 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:50.084290 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f1304af7-9eb5-486d-bd8c-b259279b8165 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:50.084764 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f1304af7-9eb5-486d-bd8c-b259279b8165 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:50.085542 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f1304af7-9eb5-486d-bd8c-b259279b8165 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:50.085998 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f1304af7-9eb5-486d-bd8c-b259279b8165 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:50.099191 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-f1304af7-9eb5-486d-bd8c-b259279b8165 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] HTTP exception thrown: Instance 81b47b35-6871-4fbd-964c-a9d15b453d7b could not be found. Apr 16 22:00:50.100298 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f1304af7-9eb5-486d-bd8c-b259279b8165 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Returning 404 to user: Instance 81b47b35-6871-4fbd-964c-a9d15b453d7b could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 22:00:50.101118 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f1304af7-9eb5-486d-bd8c-b259279b8165 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "DELETE /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 404 len: 111 microversion: 2.1 time: 0.027009 Apr 16 22:00:50.101630 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3719/7278] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 22:00:50 2022] DELETE /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 22:00:50.109192 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b4c05842-abaa-4795-91a9-26be85ab2e03 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:50.109809 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b4c05842-abaa-4795-91a9-26be85ab2e03 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 81b47b35-6871-4fbd-964c-a9d15b453d7b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:50.116358 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b4c05842-abaa-4795-91a9-26be85ab2e03 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:50.116820 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b4c05842-abaa-4795-91a9-26be85ab2e03 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:50.117599 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b4c05842-abaa-4795-91a9-26be85ab2e03 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:50.118053 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b4c05842-abaa-4795-91a9-26be85ab2e03 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:50.131378 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-b4c05842-abaa-4795-91a9-26be85ab2e03 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] HTTP exception thrown: Instance 81b47b35-6871-4fbd-964c-a9d15b453d7b could not be found. Apr 16 22:00:50.131965 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b4c05842-abaa-4795-91a9-26be85ab2e03 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Returning 404 to user: Instance 81b47b35-6871-4fbd-964c-a9d15b453d7b could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 22:00:50.132850 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b4c05842-abaa-4795-91a9-26be85ab2e03 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b" status: 404 len: 111 microversion: 2.1 time: 0.027506 Apr 16 22:00:50.133365 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3560/7279] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:00:50 2022] GET /compute/v2.1/servers/81b47b35-6871-4fbd-964c-a9d15b453d7b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 22:00:50.140877 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d9814d8f-7643-4c27-abd8-23be5e954c8a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:50.141393 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d9814d8f-7643-4c27-abd8-23be5e954c8a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:50.147178 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d9814d8f-7643-4c27-abd8-23be5e954c8a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:50.147648 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d9814d8f-7643-4c27-abd8-23be5e954c8a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:50.148469 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d9814d8f-7643-4c27-abd8-23be5e954c8a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:50.148926 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d9814d8f-7643-4c27-abd8-23be5e954c8a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:50.162677 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-d9814d8f-7643-4c27-abd8-23be5e954c8a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] HTTP exception thrown: Instance 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 could not be found. Apr 16 22:00:50.163271 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d9814d8f-7643-4c27-abd8-23be5e954c8a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Returning 404 to user: Instance 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 22:00:50.164085 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d9814d8f-7643-4c27-abd8-23be5e954c8a tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "DELETE /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 404 len: 111 microversion: 2.1 time: 0.026998 Apr 16 22:00:50.164621 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3720/7280] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 22:00:50 2022] DELETE /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 22:00:50.172091 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8853c423-f743-4ac0-906b-b8380a094dd6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:50.172740 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8853c423-f743-4ac0-906b-b8380a094dd6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] [instance: 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:50.179214 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8853c423-f743-4ac0-906b-b8380a094dd6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:50.179617 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8853c423-f743-4ac0-906b-b8380a094dd6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:50.180423 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8853c423-f743-4ac0-906b-b8380a094dd6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:50.180873 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8853c423-f743-4ac0-906b-b8380a094dd6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:50.195314 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-8853c423-f743-4ac0-906b-b8380a094dd6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] HTTP exception thrown: Instance 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 could not be found. Apr 16 22:00:50.195899 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8853c423-f743-4ac0-906b-b8380a094dd6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Returning 404 to user: Instance 5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 22:00:50.196763 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8853c423-f743-4ac0-906b-b8380a094dd6 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55" status: 404 len: 111 microversion: 2.1 time: 0.028464 Apr 16 22:00:50.197278 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3561/7281] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:00:50 2022] GET /compute/v2.1/servers/5d04ccc3-5cf1-4800-b6eb-3db9a0c5aa55 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 22:00:50.205086 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bd11aa47-52a3-48ab-a6cb-179b84486540 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] Calling method '.version_select at 0x7fbb959b98b0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:50.300832 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-bd11aa47-52a3-48ab-a6cb-179b84486540 tempest-ServerActionsTestJSON-739373493 tempest-ServerActionsTestJSON-739373493-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1181093857" status: 202 len: 0 microversion: 2.1 time: 0.099477 Apr 16 22:00:50.301442 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3721/7282] 10.222.0.20 () {58 vars in 1220 bytes} [Sat Apr 16 22:00:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1181093857 => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 22:00:57.846828 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9dc93463-7012-4bbb-b1cf-54d5b8bead2b tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1371366467", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "a7b3c90d-fac4-4e83-9fc6-095d28775ebb"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:00:57.896787 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-9dc93463-7012-4bbb-b1cf-54d5b8bead2b tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] validate_networks() for [('a7b3c90d-fac4-4e83-9fc6-095d28775ebb', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 22:00:58.236375 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-9dc93463-7012-4bbb-b1cf-54d5b8bead2b tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 22:00:58.236808 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-9dc93463-7012-4bbb-b1cf-54d5b8bead2b tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 22:00:58.237283 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-9dc93463-7012-4bbb-b1cf-54d5b8bead2b tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 22:00:58.237696 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-9dc93463-7012-4bbb-b1cf-54d5b8bead2b tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 22:00:58.238117 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-9dc93463-7012-4bbb-b1cf-54d5b8bead2b tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 22:00:58.248296 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9dc93463-7012-4bbb-b1cf-54d5b8bead2b tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:58.248753 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9dc93463-7012-4bbb-b1cf-54d5b8bead2b tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:58.249561 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9dc93463-7012-4bbb-b1cf-54d5b8bead2b tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:00:58.250006 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9dc93463-7012-4bbb-b1cf-54d5b8bead2b tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:00:58.266078 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-9dc93463-7012-4bbb-b1cf-54d5b8bead2b tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Getting quotas for project ee72c3d0e55c4b0c833fdbb2209901dc. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 22:00:58.271138 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-9dc93463-7012-4bbb-b1cf-54d5b8bead2b tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Getting quotas for user b16246330d7843268b6c1f72e10f5e1c and project ee72c3d0e55c4b0c833fdbb2209901dc. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 22:00:58.283073 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9dc93463-7012-4bbb-b1cf-54d5b8bead2b tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 22:00:58.285325 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9dc93463-7012-4bbb-b1cf-54d5b8bead2b tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [instance: aa363288-1148-454a-bc77-73866d94b76c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 22:00:58.415706 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9dc93463-7012-4bbb-b1cf-54d5b8bead2b tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.680952 Apr 16 22:00:58.416381 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3562/7283] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 22:00:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 22:00:58.427453 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-39516385-a8ac-40f5-a777-0a52ff41032e tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:58.428706 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-39516385-a8ac-40f5-a777-0a52ff41032e tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [instance: aa363288-1148-454a-bc77-73866d94b76c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:58.486633 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-39516385-a8ac-40f5-a777-0a52ff41032e tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16246330d7843268b6c1f72e10f5e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72c3d0e55c4b0c833fdbb2209901dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:00:58.494626 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-39516385-a8ac-40f5-a777-0a52ff41032e tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] 10.222.0.20 "GET /compute/v2.1/servers/aa363288-1148-454a-bc77-73866d94b76c" status: 200 len: 1217 microversion: 2.1 time: 0.072030 Apr 16 22:00:58.495221 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3722/7284] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:00:58 2022] GET /compute/v2.1/servers/aa363288-1148-454a-bc77-73866d94b76c => generated 1217 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:00:59.512468 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ceecd56e-ff9b-4082-804e-98ea6fd327d2 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:00:59.513120 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ceecd56e-ff9b-4082-804e-98ea6fd327d2 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [instance: aa363288-1148-454a-bc77-73866d94b76c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:00:59.564799 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ceecd56e-ff9b-4082-804e-98ea6fd327d2 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16246330d7843268b6c1f72e10f5e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72c3d0e55c4b0c833fdbb2209901dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:00:59.571969 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ceecd56e-ff9b-4082-804e-98ea6fd327d2 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] 10.222.0.20 "GET /compute/v2.1/servers/aa363288-1148-454a-bc77-73866d94b76c" status: 200 len: 1217 microversion: 2.1 time: 0.064457 Apr 16 22:00:59.572566 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3563/7285] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:00:59 2022] GET /compute/v2.1/servers/aa363288-1148-454a-bc77-73866d94b76c => generated 1217 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:01:00.589392 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-eedc92e8-bf21-4c5b-904e-297eab03db2a tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:01:00.590120 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-eedc92e8-bf21-4c5b-904e-297eab03db2a tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [instance: aa363288-1148-454a-bc77-73866d94b76c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:01:00.597396 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eedc92e8-bf21-4c5b-904e-297eab03db2a tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:00.597882 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eedc92e8-bf21-4c5b-904e-297eab03db2a tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:00.598691 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eedc92e8-bf21-4c5b-904e-297eab03db2a tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:00.599237 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eedc92e8-bf21-4c5b-904e-297eab03db2a tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:00.660859 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-eedc92e8-bf21-4c5b-904e-297eab03db2a tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16246330d7843268b6c1f72e10f5e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72c3d0e55c4b0c833fdbb2209901dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:01:00.669390 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-eedc92e8-bf21-4c5b-904e-297eab03db2a tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] 10.222.0.20 "GET /compute/v2.1/servers/aa363288-1148-454a-bc77-73866d94b76c" status: 200 len: 1277 microversion: 2.1 time: 0.084058 Apr 16 22:01:00.669961 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3723/7286] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:01:00 2022] GET /compute/v2.1/servers/aa363288-1148-454a-bc77-73866d94b76c => generated 1277 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:01:01.686823 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-27be5024-2a8f-43ba-9a7e-dfa83de92f29 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:01:01.687443 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-27be5024-2a8f-43ba-9a7e-dfa83de92f29 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [instance: aa363288-1148-454a-bc77-73866d94b76c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:01:01.694994 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-27be5024-2a8f-43ba-9a7e-dfa83de92f29 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:01.695439 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-27be5024-2a8f-43ba-9a7e-dfa83de92f29 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:01.696273 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-27be5024-2a8f-43ba-9a7e-dfa83de92f29 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:01.696712 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-27be5024-2a8f-43ba-9a7e-dfa83de92f29 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:01.844690 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-27be5024-2a8f-43ba-9a7e-dfa83de92f29 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16246330d7843268b6c1f72e10f5e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72c3d0e55c4b0c833fdbb2209901dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:01:01.852751 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-27be5024-2a8f-43ba-9a7e-dfa83de92f29 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] 10.222.0.20 "GET /compute/v2.1/servers/aa363288-1148-454a-bc77-73866d94b76c" status: 200 len: 1317 microversion: 2.1 time: 0.169853 Apr 16 22:01:01.853323 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3564/7287] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:01:01 2022] GET /compute/v2.1/servers/aa363288-1148-454a-bc77-73866d94b76c => generated 1317 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:01:02.191013 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-7da296ee-264a-443a-baed-0f4fe3b3da03 req-3260863d-d1f4-488e-8f43-88c15dd85a45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa363288-1148-454a-bc77-73866d94b76c", "tag": "f93faba5-e639-49cd-b0b0-079f81fc0a0d"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:01:02.200398 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-7da296ee-264a-443a-baed-0f4fe3b3da03 req-3260863d-d1f4-488e-8f43-88c15dd85a45 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:02.200929 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-7da296ee-264a-443a-baed-0f4fe3b3da03 req-3260863d-d1f4-488e-8f43-88c15dd85a45 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:02.213679 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-7da296ee-264a-443a-baed-0f4fe3b3da03 req-3260863d-d1f4-488e-8f43-88c15dd85a45 service nova] Creating event network-changed:f93faba5-e639-49cd-b0b0-079f81fc0a0d for instance aa363288-1148-454a-bc77-73866d94b76c on nch1-master-1 Apr 16 22:01:02.219491 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-7da296ee-264a-443a-baed-0f4fe3b3da03 req-3260863d-d1f4-488e-8f43-88c15dd85a45 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032358 Apr 16 22:01:02.220089 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3724/7288] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:01:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:01:02.870625 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d9066db0-a9ea-47cb-bf7d-9ff6d13e9322 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:01:02.871254 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d9066db0-a9ea-47cb-bf7d-9ff6d13e9322 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [instance: aa363288-1148-454a-bc77-73866d94b76c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:01:02.878012 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d9066db0-a9ea-47cb-bf7d-9ff6d13e9322 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:02.878473 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d9066db0-a9ea-47cb-bf7d-9ff6d13e9322 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:02.879264 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d9066db0-a9ea-47cb-bf7d-9ff6d13e9322 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:02.879716 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d9066db0-a9ea-47cb-bf7d-9ff6d13e9322 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:03.007527 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d9066db0-a9ea-47cb-bf7d-9ff6d13e9322 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16246330d7843268b6c1f72e10f5e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72c3d0e55c4b0c833fdbb2209901dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:01:03.014947 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d9066db0-a9ea-47cb-bf7d-9ff6d13e9322 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] 10.222.0.20 "GET /compute/v2.1/servers/aa363288-1148-454a-bc77-73866d94b76c" status: 200 len: 1317 microversion: 2.1 time: 0.149078 Apr 16 22:01:03.015521 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3565/7289] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:01:02 2022] GET /compute/v2.1/servers/aa363288-1148-454a-bc77-73866d94b76c => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:01:04.032589 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2c734d39-0424-47d1-8242-870f1edd039d tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:01:04.033304 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2c734d39-0424-47d1-8242-870f1edd039d tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [instance: aa363288-1148-454a-bc77-73866d94b76c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:01:04.040365 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2c734d39-0424-47d1-8242-870f1edd039d tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:04.040831 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2c734d39-0424-47d1-8242-870f1edd039d tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:04.041627 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2c734d39-0424-47d1-8242-870f1edd039d tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:04.042109 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2c734d39-0424-47d1-8242-870f1edd039d tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:04.176160 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2c734d39-0424-47d1-8242-870f1edd039d tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16246330d7843268b6c1f72e10f5e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72c3d0e55c4b0c833fdbb2209901dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:01:04.184405 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2c734d39-0424-47d1-8242-870f1edd039d tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] 10.222.0.20 "GET /compute/v2.1/servers/aa363288-1148-454a-bc77-73866d94b76c" status: 200 len: 1317 microversion: 2.1 time: 0.156074 Apr 16 22:01:04.184978 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3725/7290] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:01:04 2022] GET /compute/v2.1/servers/aa363288-1148-454a-bc77-73866d94b76c => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:01:05.201700 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-abba26e9-c7f6-486f-b8c8-1981d09da41d tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:01:05.202259 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-abba26e9-c7f6-486f-b8c8-1981d09da41d tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [instance: aa363288-1148-454a-bc77-73866d94b76c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:01:05.209144 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-abba26e9-c7f6-486f-b8c8-1981d09da41d tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:05.209628 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-abba26e9-c7f6-486f-b8c8-1981d09da41d tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:05.210428 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-abba26e9-c7f6-486f-b8c8-1981d09da41d tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:05.211539 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-abba26e9-c7f6-486f-b8c8-1981d09da41d tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:05.343948 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-abba26e9-c7f6-486f-b8c8-1981d09da41d tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16246330d7843268b6c1f72e10f5e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72c3d0e55c4b0c833fdbb2209901dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:01:05.351616 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-abba26e9-c7f6-486f-b8c8-1981d09da41d tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] 10.222.0.20 "GET /compute/v2.1/servers/aa363288-1148-454a-bc77-73866d94b76c" status: 200 len: 1317 microversion: 2.1 time: 0.153877 Apr 16 22:01:05.352337 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3566/7291] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:01:05 2022] GET /compute/v2.1/servers/aa363288-1148-454a-bc77-73866d94b76c => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:01:06.370205 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-54115d4f-45ea-4146-925a-274933948daa tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:01:06.371116 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-54115d4f-45ea-4146-925a-274933948daa tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [instance: aa363288-1148-454a-bc77-73866d94b76c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:01:06.378550 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-54115d4f-45ea-4146-925a-274933948daa tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:06.379033 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-54115d4f-45ea-4146-925a-274933948daa tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:06.379836 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-54115d4f-45ea-4146-925a-274933948daa tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:06.380332 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-54115d4f-45ea-4146-925a-274933948daa tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:06.506491 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-54115d4f-45ea-4146-925a-274933948daa tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16246330d7843268b6c1f72e10f5e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72c3d0e55c4b0c833fdbb2209901dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:01:06.513933 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-54115d4f-45ea-4146-925a-274933948daa tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] 10.222.0.20 "GET /compute/v2.1/servers/aa363288-1148-454a-bc77-73866d94b76c" status: 200 len: 1317 microversion: 2.1 time: 0.149213 Apr 16 22:01:06.514648 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3726/7292] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:01:06 2022] GET /compute/v2.1/servers/aa363288-1148-454a-bc77-73866d94b76c => generated 1317 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:01:07.037359 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-c8237509-018a-49a0-975e-427fd06eca13 req-07fbda5f-cfa7-41ff-9d51-aa548261c780 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa363288-1148-454a-bc77-73866d94b76c", "name": "network-vif-plugged", "status": "completed", "tag": "f93faba5-e639-49cd-b0b0-079f81fc0a0d"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:01:07.046339 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-c8237509-018a-49a0-975e-427fd06eca13 req-07fbda5f-cfa7-41ff-9d51-aa548261c780 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:07.046794 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-c8237509-018a-49a0-975e-427fd06eca13 req-07fbda5f-cfa7-41ff-9d51-aa548261c780 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:07.057627 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-c8237509-018a-49a0-975e-427fd06eca13 req-07fbda5f-cfa7-41ff-9d51-aa548261c780 service nova] Creating event network-vif-plugged:f93faba5-e639-49cd-b0b0-079f81fc0a0d for instance aa363288-1148-454a-bc77-73866d94b76c on nch1-master-1 Apr 16 22:01:07.062466 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-c8237509-018a-49a0-975e-427fd06eca13 req-07fbda5f-cfa7-41ff-9d51-aa548261c780 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028820 Apr 16 22:01:07.063047 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3567/7293] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 22:01:07.531510 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8cf3f387-a64f-47de-b12d-39f9969e9aec tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:01:07.532200 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8cf3f387-a64f-47de-b12d-39f9969e9aec tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [instance: aa363288-1148-454a-bc77-73866d94b76c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:01:07.539534 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8cf3f387-a64f-47de-b12d-39f9969e9aec tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:07.540009 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8cf3f387-a64f-47de-b12d-39f9969e9aec tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:07.540832 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8cf3f387-a64f-47de-b12d-39f9969e9aec tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:07.541295 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8cf3f387-a64f-47de-b12d-39f9969e9aec tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:07.666156 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8cf3f387-a64f-47de-b12d-39f9969e9aec tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16246330d7843268b6c1f72e10f5e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72c3d0e55c4b0c833fdbb2209901dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:01:07.673709 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8cf3f387-a64f-47de-b12d-39f9969e9aec tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] 10.222.0.20 "GET /compute/v2.1/servers/aa363288-1148-454a-bc77-73866d94b76c" status: 200 len: 1317 microversion: 2.1 time: 0.146158 Apr 16 22:01:07.674287 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3727/7294] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:01:07 2022] GET /compute/v2.1/servers/aa363288-1148-454a-bc77-73866d94b76c => generated 1317 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:01:08.692865 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3237dc96-8f9e-4396-b9c6-0bb736193c1b tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:01:08.693570 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3237dc96-8f9e-4396-b9c6-0bb736193c1b tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [instance: aa363288-1148-454a-bc77-73866d94b76c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:01:08.700562 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3237dc96-8f9e-4396-b9c6-0bb736193c1b tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:08.701025 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3237dc96-8f9e-4396-b9c6-0bb736193c1b tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:08.701796 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3237dc96-8f9e-4396-b9c6-0bb736193c1b tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:08.702267 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3237dc96-8f9e-4396-b9c6-0bb736193c1b tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:08.832158 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3237dc96-8f9e-4396-b9c6-0bb736193c1b tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16246330d7843268b6c1f72e10f5e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72c3d0e55c4b0c833fdbb2209901dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:01:08.839587 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3237dc96-8f9e-4396-b9c6-0bb736193c1b tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] 10.222.0.20 "GET /compute/v2.1/servers/aa363288-1148-454a-bc77-73866d94b76c" status: 200 len: 1506 microversion: 2.1 time: 0.151917 Apr 16 22:01:08.840149 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3568/7295] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:01:08 2022] GET /compute/v2.1/servers/aa363288-1148-454a-bc77-73866d94b76c => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:01:08.893368 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e43fc18b-3898-4048-b506-6ea27baf8893 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1345540782", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "a7b3c90d-fac4-4e83-9fc6-095d28775ebb"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:01:08.946270 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-e43fc18b-3898-4048-b506-6ea27baf8893 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] validate_networks() for [('a7b3c90d-fac4-4e83-9fc6-095d28775ebb', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 22:01:09.353520 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-e43fc18b-3898-4048-b506-6ea27baf8893 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 22:01:09.355593 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-e43fc18b-3898-4048-b506-6ea27baf8893 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 22:01:09.355593 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-e43fc18b-3898-4048-b506-6ea27baf8893 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 22:01:09.355593 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-e43fc18b-3898-4048-b506-6ea27baf8893 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 22:01:09.355593 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-e43fc18b-3898-4048-b506-6ea27baf8893 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 22:01:09.364110 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e43fc18b-3898-4048-b506-6ea27baf8893 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:09.364616 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e43fc18b-3898-4048-b506-6ea27baf8893 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:09.365433 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e43fc18b-3898-4048-b506-6ea27baf8893 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:09.365930 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e43fc18b-3898-4048-b506-6ea27baf8893 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:09.383222 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-e43fc18b-3898-4048-b506-6ea27baf8893 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Getting quotas for project ee72c3d0e55c4b0c833fdbb2209901dc. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 22:01:09.388612 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-e43fc18b-3898-4048-b506-6ea27baf8893 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Getting quotas for user b16246330d7843268b6c1f72e10f5e1c and project ee72c3d0e55c4b0c833fdbb2209901dc. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 22:01:09.401024 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e43fc18b-3898-4048-b506-6ea27baf8893 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 22:01:09.403269 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e43fc18b-3898-4048-b506-6ea27baf8893 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [instance: 0c0263e6-fc43-431f-92e7-5983902790dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 22:01:09.504178 ncdv-master-1 devstack@n-api.service[137408]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e43fc18b-3898-4048-b506-6ea27baf8893 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [cb5101be-df69-49ac-9db2-69c9d5edab12] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 16 22:01:10.511938 ncdv-master-1 devstack@n-api.service[137408]: INFO oslo.messaging._drivers.impl_rabbit [None req-e43fc18b-3898-4048-b506-6ea27baf8893 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [cb5101be-df69-49ac-9db2-69c9d5edab12] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 44164. Apr 16 22:01:10.515763 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e43fc18b-3898-4048-b506-6ea27baf8893 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.626318 Apr 16 22:01:10.516455 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3728/7296] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 22:01:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 22:01:10.526356 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-af547aab-8dc0-44b5-afc9-c90a317d8c86 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:01:10.526973 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-af547aab-8dc0-44b5-afc9-c90a317d8c86 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [instance: 0c0263e6-fc43-431f-92e7-5983902790dd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:01:10.580196 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-af547aab-8dc0-44b5-afc9-c90a317d8c86 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16246330d7843268b6c1f72e10f5e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72c3d0e55c4b0c833fdbb2209901dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:01:10.586693 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-af547aab-8dc0-44b5-afc9-c90a317d8c86 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0263e6-fc43-431f-92e7-5983902790dd" status: 200 len: 1217 microversion: 2.1 time: 0.064249 Apr 16 22:01:10.587570 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3569/7297] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:01:10 2022] GET /compute/v2.1/servers/0c0263e6-fc43-431f-92e7-5983902790dd => generated 1217 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:01:11.605315 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7513dad0-c0d1-49bd-8da9-f73e03c40ab5 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:01:11.605944 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7513dad0-c0d1-49bd-8da9-f73e03c40ab5 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [instance: 0c0263e6-fc43-431f-92e7-5983902790dd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:01:11.612744 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7513dad0-c0d1-49bd-8da9-f73e03c40ab5 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:11.613221 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7513dad0-c0d1-49bd-8da9-f73e03c40ab5 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:11.614223 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7513dad0-c0d1-49bd-8da9-f73e03c40ab5 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:11.614688 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7513dad0-c0d1-49bd-8da9-f73e03c40ab5 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:11.678132 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7513dad0-c0d1-49bd-8da9-f73e03c40ab5 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16246330d7843268b6c1f72e10f5e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72c3d0e55c4b0c833fdbb2209901dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:01:11.686743 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7513dad0-c0d1-49bd-8da9-f73e03c40ab5 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0263e6-fc43-431f-92e7-5983902790dd" status: 200 len: 1221 microversion: 2.1 time: 0.086129 Apr 16 22:01:11.687182 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3729/7298] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:01:11 2022] GET /compute/v2.1/servers/0c0263e6-fc43-431f-92e7-5983902790dd => generated 1221 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:01:12.704377 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8074f123-90e0-4959-8ff7-9ac9d456ca80 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:01:12.705092 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8074f123-90e0-4959-8ff7-9ac9d456ca80 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [instance: 0c0263e6-fc43-431f-92e7-5983902790dd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:01:12.713361 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8074f123-90e0-4959-8ff7-9ac9d456ca80 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:12.713822 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8074f123-90e0-4959-8ff7-9ac9d456ca80 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:12.714645 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8074f123-90e0-4959-8ff7-9ac9d456ca80 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:12.715093 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8074f123-90e0-4959-8ff7-9ac9d456ca80 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:12.779363 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8074f123-90e0-4959-8ff7-9ac9d456ca80 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16246330d7843268b6c1f72e10f5e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72c3d0e55c4b0c833fdbb2209901dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:01:12.786775 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8074f123-90e0-4959-8ff7-9ac9d456ca80 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0263e6-fc43-431f-92e7-5983902790dd" status: 200 len: 1287 microversion: 2.1 time: 0.086438 Apr 16 22:01:12.787369 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3570/7299] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:01:12 2022] GET /compute/v2.1/servers/0c0263e6-fc43-431f-92e7-5983902790dd => generated 1287 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:01:13.804432 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-640e3801-5071-4a59-9ae7-cf26ea962dcb tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:01:13.805069 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-640e3801-5071-4a59-9ae7-cf26ea962dcb tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [instance: 0c0263e6-fc43-431f-92e7-5983902790dd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:01:13.812221 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-640e3801-5071-4a59-9ae7-cf26ea962dcb tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:13.812702 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-640e3801-5071-4a59-9ae7-cf26ea962dcb tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:13.813519 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-640e3801-5071-4a59-9ae7-cf26ea962dcb tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:13.813982 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-640e3801-5071-4a59-9ae7-cf26ea962dcb tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:14.182653 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-640e3801-5071-4a59-9ae7-cf26ea962dcb tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16246330d7843268b6c1f72e10f5e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72c3d0e55c4b0c833fdbb2209901dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:01:14.190492 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-640e3801-5071-4a59-9ae7-cf26ea962dcb tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0263e6-fc43-431f-92e7-5983902790dd" status: 200 len: 1317 microversion: 2.1 time: 0.390198 Apr 16 22:01:14.191247 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3730/7300] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:01:13 2022] GET /compute/v2.1/servers/0c0263e6-fc43-431f-92e7-5983902790dd => generated 1317 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:01:14.386497 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-7afe6ba7-ba31-4161-8365-dbb5f9d56725 req-1984cf7c-1a7b-46d1-b510-2116dbbf16b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c0263e6-fc43-431f-92e7-5983902790dd", "tag": "2bcf5e75-7b3a-435e-9d76-0998bf5d6146"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:01:14.396019 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-7afe6ba7-ba31-4161-8365-dbb5f9d56725 req-1984cf7c-1a7b-46d1-b510-2116dbbf16b1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:14.396514 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-7afe6ba7-ba31-4161-8365-dbb5f9d56725 req-1984cf7c-1a7b-46d1-b510-2116dbbf16b1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:14.408282 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-7afe6ba7-ba31-4161-8365-dbb5f9d56725 req-1984cf7c-1a7b-46d1-b510-2116dbbf16b1 service nova] Creating event network-changed:2bcf5e75-7b3a-435e-9d76-0998bf5d6146 for instance 0c0263e6-fc43-431f-92e7-5983902790dd on nch2-master-1 Apr 16 22:01:14.413172 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-7afe6ba7-ba31-4161-8365-dbb5f9d56725 req-1984cf7c-1a7b-46d1-b510-2116dbbf16b1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030586 Apr 16 22:01:14.413802 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3571/7301] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:01:15.208266 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f9447589-be9c-4b8e-9f62-10391393f3ed tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:01:15.208841 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f9447589-be9c-4b8e-9f62-10391393f3ed tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [instance: 0c0263e6-fc43-431f-92e7-5983902790dd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:01:15.215750 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9447589-be9c-4b8e-9f62-10391393f3ed tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:15.216245 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9447589-be9c-4b8e-9f62-10391393f3ed tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:15.217034 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9447589-be9c-4b8e-9f62-10391393f3ed tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:15.217483 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f9447589-be9c-4b8e-9f62-10391393f3ed tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:15.343288 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f9447589-be9c-4b8e-9f62-10391393f3ed tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16246330d7843268b6c1f72e10f5e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72c3d0e55c4b0c833fdbb2209901dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:01:15.350812 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f9447589-be9c-4b8e-9f62-10391393f3ed tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0263e6-fc43-431f-92e7-5983902790dd" status: 200 len: 1317 microversion: 2.1 time: 0.146480 Apr 16 22:01:15.351382 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3731/7302] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:01:15 2022] GET /compute/v2.1/servers/0c0263e6-fc43-431f-92e7-5983902790dd => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:01:16.370305 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f39477b9-ada4-40a3-b899-916f7b7efb42 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:01:16.371054 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f39477b9-ada4-40a3-b899-916f7b7efb42 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [instance: 0c0263e6-fc43-431f-92e7-5983902790dd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:01:16.377275 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f39477b9-ada4-40a3-b899-916f7b7efb42 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:16.377742 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f39477b9-ada4-40a3-b899-916f7b7efb42 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:16.378523 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f39477b9-ada4-40a3-b899-916f7b7efb42 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:16.378972 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f39477b9-ada4-40a3-b899-916f7b7efb42 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:16.508582 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f39477b9-ada4-40a3-b899-916f7b7efb42 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16246330d7843268b6c1f72e10f5e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72c3d0e55c4b0c833fdbb2209901dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:01:16.515805 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f39477b9-ada4-40a3-b899-916f7b7efb42 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0263e6-fc43-431f-92e7-5983902790dd" status: 200 len: 1317 microversion: 2.1 time: 0.151148 Apr 16 22:01:16.516392 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3572/7303] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:01:16 2022] GET /compute/v2.1/servers/0c0263e6-fc43-431f-92e7-5983902790dd => generated 1317 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:01:17.531614 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9401a42c-b541-4ff9-a59b-dbf2af075cad tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:01:17.532276 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9401a42c-b541-4ff9-a59b-dbf2af075cad tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [instance: 0c0263e6-fc43-431f-92e7-5983902790dd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:01:17.539045 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9401a42c-b541-4ff9-a59b-dbf2af075cad tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:17.540017 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9401a42c-b541-4ff9-a59b-dbf2af075cad tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:17.540837 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9401a42c-b541-4ff9-a59b-dbf2af075cad tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:17.541291 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9401a42c-b541-4ff9-a59b-dbf2af075cad tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:17.671201 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9401a42c-b541-4ff9-a59b-dbf2af075cad tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16246330d7843268b6c1f72e10f5e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72c3d0e55c4b0c833fdbb2209901dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:01:17.678961 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9401a42c-b541-4ff9-a59b-dbf2af075cad tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0263e6-fc43-431f-92e7-5983902790dd" status: 200 len: 1317 microversion: 2.1 time: 0.151228 Apr 16 22:01:17.679529 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3732/7304] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:01:17 2022] GET /compute/v2.1/servers/0c0263e6-fc43-431f-92e7-5983902790dd => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:01:18.696014 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ba73745c-d8fd-4bc9-9e27-68cd687c0fd1 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:01:18.696773 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ba73745c-d8fd-4bc9-9e27-68cd687c0fd1 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [instance: 0c0263e6-fc43-431f-92e7-5983902790dd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:01:18.703594 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ba73745c-d8fd-4bc9-9e27-68cd687c0fd1 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:18.704060 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ba73745c-d8fd-4bc9-9e27-68cd687c0fd1 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:18.704877 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ba73745c-d8fd-4bc9-9e27-68cd687c0fd1 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:18.705327 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ba73745c-d8fd-4bc9-9e27-68cd687c0fd1 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:18.831762 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ba73745c-d8fd-4bc9-9e27-68cd687c0fd1 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16246330d7843268b6c1f72e10f5e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72c3d0e55c4b0c833fdbb2209901dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:01:18.839022 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ba73745c-d8fd-4bc9-9e27-68cd687c0fd1 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0263e6-fc43-431f-92e7-5983902790dd" status: 200 len: 1317 microversion: 2.1 time: 0.146912 Apr 16 22:01:18.839592 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3573/7305] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:01:18 2022] GET /compute/v2.1/servers/0c0263e6-fc43-431f-92e7-5983902790dd => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:01:19.855613 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a48332bd-71bb-406a-8f51-a6b111b5d227 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:01:19.856271 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a48332bd-71bb-406a-8f51-a6b111b5d227 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [instance: 0c0263e6-fc43-431f-92e7-5983902790dd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:01:19.863141 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a48332bd-71bb-406a-8f51-a6b111b5d227 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:19.863607 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a48332bd-71bb-406a-8f51-a6b111b5d227 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:19.864480 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a48332bd-71bb-406a-8f51-a6b111b5d227 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:19.864949 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a48332bd-71bb-406a-8f51-a6b111b5d227 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:19.990990 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a48332bd-71bb-406a-8f51-a6b111b5d227 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16246330d7843268b6c1f72e10f5e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72c3d0e55c4b0c833fdbb2209901dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:01:19.998861 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a48332bd-71bb-406a-8f51-a6b111b5d227 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0263e6-fc43-431f-92e7-5983902790dd" status: 200 len: 1317 microversion: 2.1 time: 0.147174 Apr 16 22:01:19.999442 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3733/7306] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:01:19 2022] GET /compute/v2.1/servers/0c0263e6-fc43-431f-92e7-5983902790dd => generated 1317 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:01:20.602443 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-eee48767-7e57-4c71-9d15-a73004a39911 req-cb1fb284-515e-4d3c-a5b0-d70faea95922 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c0263e6-fc43-431f-92e7-5983902790dd", "name": "network-vif-plugged", "status": "completed", "tag": "2bcf5e75-7b3a-435e-9d76-0998bf5d6146"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:01:20.612123 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-eee48767-7e57-4c71-9d15-a73004a39911 req-cb1fb284-515e-4d3c-a5b0-d70faea95922 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:20.612603 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-eee48767-7e57-4c71-9d15-a73004a39911 req-cb1fb284-515e-4d3c-a5b0-d70faea95922 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:20.623433 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-eee48767-7e57-4c71-9d15-a73004a39911 req-cb1fb284-515e-4d3c-a5b0-d70faea95922 service nova] Creating event network-vif-plugged:2bcf5e75-7b3a-435e-9d76-0998bf5d6146 for instance 0c0263e6-fc43-431f-92e7-5983902790dd on nch2-master-1 Apr 16 22:01:20.628479 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-eee48767-7e57-4c71-9d15-a73004a39911 req-cb1fb284-515e-4d3c-a5b0-d70faea95922 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029961 Apr 16 22:01:20.629274 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3574/7307] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:01:21.016091 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-898317d9-c93e-4e47-9878-4150aa09698b tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:01:21.016712 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-898317d9-c93e-4e47-9878-4150aa09698b tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [instance: 0c0263e6-fc43-431f-92e7-5983902790dd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:01:21.023574 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-898317d9-c93e-4e47-9878-4150aa09698b tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:21.025963 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-898317d9-c93e-4e47-9878-4150aa09698b tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:21.025963 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-898317d9-c93e-4e47-9878-4150aa09698b tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:21.025963 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-898317d9-c93e-4e47-9878-4150aa09698b tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:21.152582 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-898317d9-c93e-4e47-9878-4150aa09698b tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16246330d7843268b6c1f72e10f5e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72c3d0e55c4b0c833fdbb2209901dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:01:21.159931 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-898317d9-c93e-4e47-9878-4150aa09698b tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0263e6-fc43-431f-92e7-5983902790dd" status: 200 len: 1317 microversion: 2.1 time: 0.147855 Apr 16 22:01:21.160537 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3734/7308] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:01:21 2022] GET /compute/v2.1/servers/0c0263e6-fc43-431f-92e7-5983902790dd => generated 1317 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:01:22.177317 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0e7f46b9-e4de-4d04-94a5-0a2d4313a297 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:01:22.178022 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0e7f46b9-e4de-4d04-94a5-0a2d4313a297 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [instance: 0c0263e6-fc43-431f-92e7-5983902790dd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:01:22.186535 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0e7f46b9-e4de-4d04-94a5-0a2d4313a297 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:22.187366 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0e7f46b9-e4de-4d04-94a5-0a2d4313a297 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:22.188159 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0e7f46b9-e4de-4d04-94a5-0a2d4313a297 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:22.188719 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0e7f46b9-e4de-4d04-94a5-0a2d4313a297 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:22.317734 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0e7f46b9-e4de-4d04-94a5-0a2d4313a297 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16246330d7843268b6c1f72e10f5e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72c3d0e55c4b0c833fdbb2209901dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:01:22.325827 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0e7f46b9-e4de-4d04-94a5-0a2d4313a297 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0263e6-fc43-431f-92e7-5983902790dd" status: 200 len: 1506 microversion: 2.1 time: 0.152824 Apr 16 22:01:22.326402 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3575/7309] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:01:22 2022] GET /compute/v2.1/servers/0c0263e6-fc43-431f-92e7-5983902790dd => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:01:22.341636 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bc03eabc-e128-4af8-b0e2-8db3f3467760 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:01:22.342149 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-bc03eabc-e128-4af8-b0e2-8db3f3467760 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [instance: 0c0263e6-fc43-431f-92e7-5983902790dd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:01:22.349245 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bc03eabc-e128-4af8-b0e2-8db3f3467760 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:22.350908 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bc03eabc-e128-4af8-b0e2-8db3f3467760 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:22.350908 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bc03eabc-e128-4af8-b0e2-8db3f3467760 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:22.350908 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bc03eabc-e128-4af8-b0e2-8db3f3467760 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:22.378140 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-bc03eabc-e128-4af8-b0e2-8db3f3467760 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [instance: 0c0263e6-fc43-431f-92e7-5983902790dd] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 22:01:22.658836 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-bc03eabc-e128-4af8-b0e2-8db3f3467760 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0c0263e6-fc43-431f-92e7-5983902790dd" status: 204 len: 0 microversion: 2.1 time: 0.320671 Apr 16 22:01:22.659384 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3735/7310] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 22:01:22 2022] DELETE /compute/v2.1/servers/0c0263e6-fc43-431f-92e7-5983902790dd => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 22:01:22.667872 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0e2675ef-7d22-4cde-a29b-9ef7dce5a15d tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:01:22.671007 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0e2675ef-7d22-4cde-a29b-9ef7dce5a15d tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [instance: 0c0263e6-fc43-431f-92e7-5983902790dd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:01:22.675184 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0e2675ef-7d22-4cde-a29b-9ef7dce5a15d tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:22.675682 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0e2675ef-7d22-4cde-a29b-9ef7dce5a15d tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:22.676611 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0e2675ef-7d22-4cde-a29b-9ef7dce5a15d tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:22.677068 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0e2675ef-7d22-4cde-a29b-9ef7dce5a15d tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:22.807281 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0e2675ef-7d22-4cde-a29b-9ef7dce5a15d tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16246330d7843268b6c1f72e10f5e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72c3d0e55c4b0c833fdbb2209901dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:01:22.814693 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0e2675ef-7d22-4cde-a29b-9ef7dce5a15d tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0263e6-fc43-431f-92e7-5983902790dd" status: 200 len: 1512 microversion: 2.1 time: 0.151261 Apr 16 22:01:22.815264 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3576/7311] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:01:22 2022] GET /compute/v2.1/servers/0c0263e6-fc43-431f-92e7-5983902790dd => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:01:23.833270 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-47dd5b91-8c55-4d3e-b0b7-873d3bcb4c48 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:01:23.833270 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-47dd5b91-8c55-4d3e-b0b7-873d3bcb4c48 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [instance: 0c0263e6-fc43-431f-92e7-5983902790dd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:01:23.840135 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-47dd5b91-8c55-4d3e-b0b7-873d3bcb4c48 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:23.840640 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-47dd5b91-8c55-4d3e-b0b7-873d3bcb4c48 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:23.841453 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-47dd5b91-8c55-4d3e-b0b7-873d3bcb4c48 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:23.841910 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-47dd5b91-8c55-4d3e-b0b7-873d3bcb4c48 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:23.970773 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-47dd5b91-8c55-4d3e-b0b7-873d3bcb4c48 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16246330d7843268b6c1f72e10f5e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72c3d0e55c4b0c833fdbb2209901dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:01:23.978776 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-47dd5b91-8c55-4d3e-b0b7-873d3bcb4c48 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0263e6-fc43-431f-92e7-5983902790dd" status: 200 len: 1512 microversion: 2.1 time: 0.150693 Apr 16 22:01:23.979350 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3736/7312] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:01:23 2022] GET /compute/v2.1/servers/0c0263e6-fc43-431f-92e7-5983902790dd => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:01:24.660407 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-2195d475-9b1b-442d-8516-36349a3c3d7f req-13ded738-da24-4977-b6a8-123c2e1b8b5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c0263e6-fc43-431f-92e7-5983902790dd", "name": "network-vif-deleted", "tag": "2bcf5e75-7b3a-435e-9d76-0998bf5d6146"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:01:24.669432 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-2195d475-9b1b-442d-8516-36349a3c3d7f req-13ded738-da24-4977-b6a8-123c2e1b8b5a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:24.672196 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-2195d475-9b1b-442d-8516-36349a3c3d7f req-13ded738-da24-4977-b6a8-123c2e1b8b5a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:24.682506 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-2195d475-9b1b-442d-8516-36349a3c3d7f req-13ded738-da24-4977-b6a8-123c2e1b8b5a service nova] Creating event network-vif-deleted:2bcf5e75-7b3a-435e-9d76-0998bf5d6146 for instance 0c0263e6-fc43-431f-92e7-5983902790dd on nch2-master-1 Apr 16 22:01:24.687858 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-2195d475-9b1b-442d-8516-36349a3c3d7f req-13ded738-da24-4977-b6a8-123c2e1b8b5a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093971 Apr 16 22:01:24.688527 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3577/7313] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:01:24.995915 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-51b2b6d2-add1-407f-9115-e552085cd63c tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:01:24.996602 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-51b2b6d2-add1-407f-9115-e552085cd63c tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [instance: 0c0263e6-fc43-431f-92e7-5983902790dd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:01:25.003361 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-51b2b6d2-add1-407f-9115-e552085cd63c tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:25.003840 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-51b2b6d2-add1-407f-9115-e552085cd63c tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:25.004662 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-51b2b6d2-add1-407f-9115-e552085cd63c tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:25.005133 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-51b2b6d2-add1-407f-9115-e552085cd63c tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:25.035801 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-51b2b6d2-add1-407f-9115-e552085cd63c tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:25.036313 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-51b2b6d2-add1-407f-9115-e552085cd63c tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:25.036785 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-51b2b6d2-add1-407f-9115-e552085cd63c tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lazy-loading 'fault' on Instance uuid 0c0263e6-fc43-431f-92e7-5983902790dd {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 22:01:25.078594 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-51b2b6d2-add1-407f-9115-e552085cd63c tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16246330d7843268b6c1f72e10f5e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72c3d0e55c4b0c833fdbb2209901dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:01:25.086182 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-51b2b6d2-add1-407f-9115-e552085cd63c tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0263e6-fc43-431f-92e7-5983902790dd" status: 200 len: 1307 microversion: 2.1 time: 0.094191 Apr 16 22:01:25.088154 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3737/7314] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:01:24 2022] GET /compute/v2.1/servers/0c0263e6-fc43-431f-92e7-5983902790dd => generated 1307 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:01:26.105165 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3433c562-286d-416c-8fdf-99bc60c56a06 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:01:26.105882 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3433c562-286d-416c-8fdf-99bc60c56a06 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [instance: 0c0263e6-fc43-431f-92e7-5983902790dd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:01:26.112099 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3433c562-286d-416c-8fdf-99bc60c56a06 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:26.112604 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3433c562-286d-416c-8fdf-99bc60c56a06 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:26.113389 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3433c562-286d-416c-8fdf-99bc60c56a06 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:26.113841 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3433c562-286d-416c-8fdf-99bc60c56a06 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:26.127426 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-3433c562-286d-416c-8fdf-99bc60c56a06 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] HTTP exception thrown: Instance 0c0263e6-fc43-431f-92e7-5983902790dd could not be found. Apr 16 22:01:26.128046 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3433c562-286d-416c-8fdf-99bc60c56a06 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Returning 404 to user: Instance 0c0263e6-fc43-431f-92e7-5983902790dd could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 22:01:26.128901 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3433c562-286d-416c-8fdf-99bc60c56a06 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0263e6-fc43-431f-92e7-5983902790dd" status: 404 len: 111 microversion: 2.1 time: 0.029009 Apr 16 22:01:26.129424 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3578/7315] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:01:26 2022] GET /compute/v2.1/servers/0c0263e6-fc43-431f-92e7-5983902790dd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 22:01:26.138538 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-126bf7b2-4e81-40e4-8bce-ea993e890f39 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:01:26.139172 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-126bf7b2-4e81-40e4-8bce-ea993e890f39 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [instance: aa363288-1148-454a-bc77-73866d94b76c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:01:26.146001 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-126bf7b2-4e81-40e4-8bce-ea993e890f39 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:26.146475 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-126bf7b2-4e81-40e4-8bce-ea993e890f39 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:26.147268 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-126bf7b2-4e81-40e4-8bce-ea993e890f39 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:26.147729 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-126bf7b2-4e81-40e4-8bce-ea993e890f39 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:26.277223 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-126bf7b2-4e81-40e4-8bce-ea993e890f39 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16246330d7843268b6c1f72e10f5e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72c3d0e55c4b0c833fdbb2209901dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:01:26.284616 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-126bf7b2-4e81-40e4-8bce-ea993e890f39 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] 10.222.0.20 "GET /compute/v2.1/servers/aa363288-1148-454a-bc77-73866d94b76c" status: 200 len: 1506 microversion: 2.1 time: 0.150602 Apr 16 22:01:26.285191 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3738/7316] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:01:26 2022] GET /compute/v2.1/servers/aa363288-1148-454a-bc77-73866d94b76c => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:01:26.301838 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c24bb2f1-8314-4f9f-b590-fc4b13b2e7c8 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:01:26.302836 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c24bb2f1-8314-4f9f-b590-fc4b13b2e7c8 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [instance: 2ad9c8c1-27e8-4b06-8326-f562688b49fe] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:01:26.308946 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-c24bb2f1-8314-4f9f-b590-fc4b13b2e7c8 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] HTTP exception thrown: Instance 2ad9c8c1-27e8-4b06-8326-f562688b49fe could not be found. Apr 16 22:01:26.309523 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c24bb2f1-8314-4f9f-b590-fc4b13b2e7c8 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Returning 404 to user: Instance 2ad9c8c1-27e8-4b06-8326-f562688b49fe could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 22:01:26.310336 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c24bb2f1-8314-4f9f-b590-fc4b13b2e7c8 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] 10.222.0.20 "POST /compute/v2.1/servers/2ad9c8c1-27e8-4b06-8326-f562688b49fe/action" status: 404 len: 111 microversion: 2.1 time: 0.012578 Apr 16 22:01:26.310855 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3579/7317] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 22:01:26 2022] POST /compute/v2.1/servers/2ad9c8c1-27e8-4b06-8326-f562688b49fe/action => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 16 22:01:26.318481 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7bb8277c-effe-4087-9811-24ee5f05e369 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:01:26.319116 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7bb8277c-effe-4087-9811-24ee5f05e369 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [instance: aa363288-1148-454a-bc77-73866d94b76c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:01:26.325185 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7bb8277c-effe-4087-9811-24ee5f05e369 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:26.325596 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7bb8277c-effe-4087-9811-24ee5f05e369 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:26.326388 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7bb8277c-effe-4087-9811-24ee5f05e369 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:26.326850 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7bb8277c-effe-4087-9811-24ee5f05e369 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:26.451702 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7bb8277c-effe-4087-9811-24ee5f05e369 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16246330d7843268b6c1f72e10f5e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72c3d0e55c4b0c833fdbb2209901dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:01:26.459104 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7bb8277c-effe-4087-9811-24ee5f05e369 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] 10.222.0.20 "GET /compute/v2.1/servers/aa363288-1148-454a-bc77-73866d94b76c" status: 200 len: 1506 microversion: 2.1 time: 0.144382 Apr 16 22:01:26.459678 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3739/7318] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:01:26 2022] GET /compute/v2.1/servers/aa363288-1148-454a-bc77-73866d94b76c => generated 1506 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:01:26.476133 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ed366baa-c109-497c-9414-dc5e0c074dfc tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:01:26.476774 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ed366baa-c109-497c-9414-dc5e0c074dfc tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [instance: aa363288-1148-454a-bc77-73866d94b76c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:01:26.486299 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ed366baa-c109-497c-9414-dc5e0c074dfc tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:26.486756 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ed366baa-c109-497c-9414-dc5e0c074dfc tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:26.487552 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ed366baa-c109-497c-9414-dc5e0c074dfc tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:26.487995 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ed366baa-c109-497c-9414-dc5e0c074dfc tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:26.613979 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ed366baa-c109-497c-9414-dc5e0c074dfc tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16246330d7843268b6c1f72e10f5e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72c3d0e55c4b0c833fdbb2209901dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:01:26.621374 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ed366baa-c109-497c-9414-dc5e0c074dfc tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] 10.222.0.20 "GET /compute/v2.1/servers/aa363288-1148-454a-bc77-73866d94b76c" status: 200 len: 1506 microversion: 2.1 time: 0.149088 Apr 16 22:01:26.621948 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3580/7319] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:01:26 2022] GET /compute/v2.1/servers/aa363288-1148-454a-bc77-73866d94b76c => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 22:01:26.637553 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c1e242ab-d9c1-403c-8d6b-1bf8084749be tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "738bc7b9-54cf-4ab5-be9b-142c7a118d45"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:01:26.638597 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c1e242ab-d9c1-403c-8d6b-1bf8084749be tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [instance: aa363288-1148-454a-bc77-73866d94b76c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:01:26.644562 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c1e242ab-d9c1-403c-8d6b-1bf8084749be tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:26.645037 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c1e242ab-d9c1-403c-8d6b-1bf8084749be tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:26.645831 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c1e242ab-d9c1-403c-8d6b-1bf8084749be tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:26.646290 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c1e242ab-d9c1-403c-8d6b-1bf8084749be tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:26.673961 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c1e242ab-d9c1-403c-8d6b-1bf8084749be tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b16246330d7843268b6c1f72e10f5e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72c3d0e55c4b0c833fdbb2209901dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:01:26.679094 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-c1e242ab-d9c1-403c-8d6b-1bf8084749be tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] HTTP exception thrown: Flavor 738bc7b9-54cf-4ab5-be9b-142c7a118d45 could not be found. Apr 16 22:01:26.679717 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c1e242ab-d9c1-403c-8d6b-1bf8084749be tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Returning 400 to user: Flavor 738bc7b9-54cf-4ab5-be9b-142c7a118d45 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 22:01:26.680618 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c1e242ab-d9c1-403c-8d6b-1bf8084749be tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] 10.222.0.20 "POST /compute/v2.1/servers/aa363288-1148-454a-bc77-73866d94b76c/action" status: 400 len: 107 microversion: 2.1 time: 0.047037 Apr 16 22:01:26.681184 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3740/7320] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 22:01:26 2022] POST /compute/v2.1/servers/aa363288-1148-454a-bc77-73866d94b76c/action => generated 107 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 16 22:01:26.691184 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-95fb75cc-d0ba-4823-b7bf-7b6a733b0dc5 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:01:26.691184 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-95fb75cc-d0ba-4823-b7bf-7b6a733b0dc5 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [instance: aa363288-1148-454a-bc77-73866d94b76c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:01:26.696084 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-95fb75cc-d0ba-4823-b7bf-7b6a733b0dc5 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:26.696580 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-95fb75cc-d0ba-4823-b7bf-7b6a733b0dc5 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:26.697425 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-95fb75cc-d0ba-4823-b7bf-7b6a733b0dc5 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:26.697868 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-95fb75cc-d0ba-4823-b7bf-7b6a733b0dc5 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:26.826661 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-95fb75cc-d0ba-4823-b7bf-7b6a733b0dc5 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16246330d7843268b6c1f72e10f5e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72c3d0e55c4b0c833fdbb2209901dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:01:26.834225 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-95fb75cc-d0ba-4823-b7bf-7b6a733b0dc5 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] 10.222.0.20 "GET /compute/v2.1/servers/aa363288-1148-454a-bc77-73866d94b76c" status: 200 len: 1506 microversion: 2.1 time: 0.148677 Apr 16 22:01:26.834795 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3581/7321] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:01:26 2022] GET /compute/v2.1/servers/aa363288-1148-454a-bc77-73866d94b76c => generated 1506 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:01:26.852028 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-91e0a0c9-efbf-427a-8b0a-d142714e5019 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:01:26.852719 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-91e0a0c9-efbf-427a-8b0a-d142714e5019 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [instance: aa363288-1148-454a-bc77-73866d94b76c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:01:26.859474 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-91e0a0c9-efbf-427a-8b0a-d142714e5019 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:26.859958 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-91e0a0c9-efbf-427a-8b0a-d142714e5019 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:26.860790 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-91e0a0c9-efbf-427a-8b0a-d142714e5019 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:26.861257 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-91e0a0c9-efbf-427a-8b0a-d142714e5019 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:26.993150 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-91e0a0c9-efbf-427a-8b0a-d142714e5019 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16246330d7843268b6c1f72e10f5e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72c3d0e55c4b0c833fdbb2209901dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:01:27.000599 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-91e0a0c9-efbf-427a-8b0a-d142714e5019 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] 10.222.0.20 "GET /compute/v2.1/servers/aa363288-1148-454a-bc77-73866d94b76c" status: 200 len: 1506 microversion: 2.1 time: 0.152563 Apr 16 22:01:27.001174 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3741/7322] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:01:26 2022] GET /compute/v2.1/servers/aa363288-1148-454a-bc77-73866d94b76c => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:01:27.017290 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-15a20de6-da50-4602-9740-a0f70c62556e tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:01:27.018451 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-15a20de6-da50-4602-9740-a0f70c62556e tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 22:01:27.019251 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-15a20de6-da50-4602-9740-a0f70c62556e tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] 10.222.0.20 "POST /compute/v2.1/servers/aa363288-1148-454a-bc77-73866d94b76c/action" status: 400 len: 113 microversion: 2.1 time: 0.005934 Apr 16 22:01:27.019775 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3582/7323] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 22:01:27 2022] POST /compute/v2.1/servers/aa363288-1148-454a-bc77-73866d94b76c/action => generated 113 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 16 22:01:27.028147 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cbe85a56-617a-4007-9c99-f816c4777a15 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:01:27.028903 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cbe85a56-617a-4007-9c99-f816c4777a15 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [instance: aa363288-1148-454a-bc77-73866d94b76c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:01:27.034849 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cbe85a56-617a-4007-9c99-f816c4777a15 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:27.035330 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cbe85a56-617a-4007-9c99-f816c4777a15 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:27.036133 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cbe85a56-617a-4007-9c99-f816c4777a15 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:27.036623 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cbe85a56-617a-4007-9c99-f816c4777a15 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:27.164276 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cbe85a56-617a-4007-9c99-f816c4777a15 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16246330d7843268b6c1f72e10f5e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72c3d0e55c4b0c833fdbb2209901dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:01:27.172047 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cbe85a56-617a-4007-9c99-f816c4777a15 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] 10.222.0.20 "GET /compute/v2.1/servers/aa363288-1148-454a-bc77-73866d94b76c" status: 200 len: 1506 microversion: 2.1 time: 0.148271 Apr 16 22:01:27.175855 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3742/7324] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:01:27 2022] GET /compute/v2.1/servers/aa363288-1148-454a-bc77-73866d94b76c => generated 1506 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:01:27.192813 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f365e353-ef7b-436e-85e1-5d2251d0f0ab tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:01:27.193342 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f365e353-ef7b-436e-85e1-5d2251d0f0ab tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [instance: 0c0263e6-fc43-431f-92e7-5983902790dd] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:01:27.200882 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f365e353-ef7b-436e-85e1-5d2251d0f0ab tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:27.201348 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f365e353-ef7b-436e-85e1-5d2251d0f0ab tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:27.202128 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f365e353-ef7b-436e-85e1-5d2251d0f0ab tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:27.202584 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f365e353-ef7b-436e-85e1-5d2251d0f0ab tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:27.216553 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-f365e353-ef7b-436e-85e1-5d2251d0f0ab tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] HTTP exception thrown: Instance 0c0263e6-fc43-431f-92e7-5983902790dd could not be found. Apr 16 22:01:27.217201 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f365e353-ef7b-436e-85e1-5d2251d0f0ab tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Returning 404 to user: Instance 0c0263e6-fc43-431f-92e7-5983902790dd could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 22:01:27.218308 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f365e353-ef7b-436e-85e1-5d2251d0f0ab tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0c0263e6-fc43-431f-92e7-5983902790dd" status: 404 len: 111 microversion: 2.1 time: 0.030463 Apr 16 22:01:27.218853 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3583/7325] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 22:01:27 2022] DELETE /compute/v2.1/servers/0c0263e6-fc43-431f-92e7-5983902790dd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 22:01:27.226790 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c8876046-ba7c-4127-9b12-3b4bc7a883b3 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:01:27.227444 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c8876046-ba7c-4127-9b12-3b4bc7a883b3 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [instance: 0c0263e6-fc43-431f-92e7-5983902790dd] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:01:27.234389 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c8876046-ba7c-4127-9b12-3b4bc7a883b3 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:27.234870 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c8876046-ba7c-4127-9b12-3b4bc7a883b3 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:27.235753 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c8876046-ba7c-4127-9b12-3b4bc7a883b3 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:27.236242 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c8876046-ba7c-4127-9b12-3b4bc7a883b3 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:27.249960 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-c8876046-ba7c-4127-9b12-3b4bc7a883b3 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] HTTP exception thrown: Instance 0c0263e6-fc43-431f-92e7-5983902790dd could not be found. Apr 16 22:01:27.250698 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c8876046-ba7c-4127-9b12-3b4bc7a883b3 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Returning 404 to user: Instance 0c0263e6-fc43-431f-92e7-5983902790dd could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 22:01:27.251529 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c8876046-ba7c-4127-9b12-3b4bc7a883b3 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] 10.222.0.20 "GET /compute/v2.1/servers/0c0263e6-fc43-431f-92e7-5983902790dd" status: 404 len: 111 microversion: 2.1 time: 0.028606 Apr 16 22:01:27.252072 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3743/7326] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:01:27 2022] GET /compute/v2.1/servers/0c0263e6-fc43-431f-92e7-5983902790dd => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 22:01:27.260550 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-244eb7bf-a3f4-41aa-9eb6-2db95aa9d50e tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:01:27.261097 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-244eb7bf-a3f4-41aa-9eb6-2db95aa9d50e tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [instance: aa363288-1148-454a-bc77-73866d94b76c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:01:27.267224 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-244eb7bf-a3f4-41aa-9eb6-2db95aa9d50e tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:27.267692 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-244eb7bf-a3f4-41aa-9eb6-2db95aa9d50e tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:27.268510 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-244eb7bf-a3f4-41aa-9eb6-2db95aa9d50e tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:27.268960 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-244eb7bf-a3f4-41aa-9eb6-2db95aa9d50e tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:27.293909 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-244eb7bf-a3f4-41aa-9eb6-2db95aa9d50e tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [instance: aa363288-1148-454a-bc77-73866d94b76c] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 22:01:27.544550 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-244eb7bf-a3f4-41aa-9eb6-2db95aa9d50e tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] 10.222.0.20 "DELETE /compute/v2.1/servers/aa363288-1148-454a-bc77-73866d94b76c" status: 204 len: 0 microversion: 2.1 time: 0.288061 Apr 16 22:01:27.545186 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3584/7327] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 22:01:27 2022] DELETE /compute/v2.1/servers/aa363288-1148-454a-bc77-73866d94b76c => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 22:01:27.553255 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a4923dc7-5cce-4d1f-a905-60d2d9065774 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:01:27.553969 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a4923dc7-5cce-4d1f-a905-60d2d9065774 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [instance: aa363288-1148-454a-bc77-73866d94b76c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:01:27.560800 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a4923dc7-5cce-4d1f-a905-60d2d9065774 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:27.561280 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a4923dc7-5cce-4d1f-a905-60d2d9065774 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:27.562083 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a4923dc7-5cce-4d1f-a905-60d2d9065774 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:27.562548 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a4923dc7-5cce-4d1f-a905-60d2d9065774 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:27.689320 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a4923dc7-5cce-4d1f-a905-60d2d9065774 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16246330d7843268b6c1f72e10f5e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72c3d0e55c4b0c833fdbb2209901dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:01:27.696896 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a4923dc7-5cce-4d1f-a905-60d2d9065774 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] 10.222.0.20 "GET /compute/v2.1/servers/aa363288-1148-454a-bc77-73866d94b76c" status: 200 len: 1512 microversion: 2.1 time: 0.147586 Apr 16 22:01:27.698093 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3744/7328] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:01:27 2022] GET /compute/v2.1/servers/aa363288-1148-454a-bc77-73866d94b76c => generated 1512 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:01:28.715199 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e119b0b0-def5-4d9d-aa97-a194e5087d3f tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:01:28.715943 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e119b0b0-def5-4d9d-aa97-a194e5087d3f tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [instance: aa363288-1148-454a-bc77-73866d94b76c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:01:28.723067 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e119b0b0-def5-4d9d-aa97-a194e5087d3f tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:28.723531 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e119b0b0-def5-4d9d-aa97-a194e5087d3f tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:28.724349 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e119b0b0-def5-4d9d-aa97-a194e5087d3f tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:28.724799 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e119b0b0-def5-4d9d-aa97-a194e5087d3f tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:28.851128 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e119b0b0-def5-4d9d-aa97-a194e5087d3f tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16246330d7843268b6c1f72e10f5e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72c3d0e55c4b0c833fdbb2209901dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:01:28.859693 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e119b0b0-def5-4d9d-aa97-a194e5087d3f tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] 10.222.0.20 "GET /compute/v2.1/servers/aa363288-1148-454a-bc77-73866d94b76c" status: 200 len: 1512 microversion: 2.1 time: 0.148773 Apr 16 22:01:28.860291 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3585/7329] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:01:28 2022] GET /compute/v2.1/servers/aa363288-1148-454a-bc77-73866d94b76c => generated 1512 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:01:29.785899 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-186cfe6a-5945-4756-ba35-bddde8a567b1 req-d1f806a7-2504-4e1c-ace3-5e51c4441797 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa363288-1148-454a-bc77-73866d94b76c", "name": "network-vif-deleted", "tag": "f93faba5-e639-49cd-b0b0-079f81fc0a0d"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:01:29.794656 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-186cfe6a-5945-4756-ba35-bddde8a567b1 req-d1f806a7-2504-4e1c-ace3-5e51c4441797 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:29.795153 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-186cfe6a-5945-4756-ba35-bddde8a567b1 req-d1f806a7-2504-4e1c-ace3-5e51c4441797 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:29.806096 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-186cfe6a-5945-4756-ba35-bddde8a567b1 req-d1f806a7-2504-4e1c-ace3-5e51c4441797 service nova] Creating event network-vif-deleted:f93faba5-e639-49cd-b0b0-079f81fc0a0d for instance aa363288-1148-454a-bc77-73866d94b76c on nch1-master-1 Apr 16 22:01:29.811549 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-186cfe6a-5945-4756-ba35-bddde8a567b1 req-d1f806a7-2504-4e1c-ace3-5e51c4441797 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029715 Apr 16 22:01:29.812199 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3745/7330] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:01:29.876204 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8bda587e-c6c8-4d5e-b939-171b1f933246 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:01:29.876814 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8bda587e-c6c8-4d5e-b939-171b1f933246 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [instance: aa363288-1148-454a-bc77-73866d94b76c] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:01:29.883653 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8bda587e-c6c8-4d5e-b939-171b1f933246 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:29.884112 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8bda587e-c6c8-4d5e-b939-171b1f933246 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:29.885578 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8bda587e-c6c8-4d5e-b939-171b1f933246 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:29.886025 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8bda587e-c6c8-4d5e-b939-171b1f933246 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:29.948575 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-8bda587e-c6c8-4d5e-b939-171b1f933246 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b16246330d7843268b6c1f72e10f5e1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72c3d0e55c4b0c833fdbb2209901dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:01:29.956412 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8bda587e-c6c8-4d5e-b939-171b1f933246 tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] 10.222.0.20 "GET /compute/v2.1/servers/aa363288-1148-454a-bc77-73866d94b76c" status: 200 len: 1470 microversion: 2.1 time: 0.084210 Apr 16 22:01:29.956993 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3586/7331] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:01:29 2022] GET /compute/v2.1/servers/aa363288-1148-454a-bc77-73866d94b76c => generated 1470 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:01:30.975239 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f90fe983-4682-45f3-8732-557a86d506ad tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:01:30.975894 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f90fe983-4682-45f3-8732-557a86d506ad tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] [instance: aa363288-1148-454a-bc77-73866d94b76c] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:01:30.982135 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f90fe983-4682-45f3-8732-557a86d506ad tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:30.982611 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f90fe983-4682-45f3-8732-557a86d506ad tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:30.983404 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f90fe983-4682-45f3-8732-557a86d506ad tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:01:30.983861 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f90fe983-4682-45f3-8732-557a86d506ad tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:01:30.997101 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-f90fe983-4682-45f3-8732-557a86d506ad tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] HTTP exception thrown: Instance aa363288-1148-454a-bc77-73866d94b76c could not be found. Apr 16 22:01:30.997764 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f90fe983-4682-45f3-8732-557a86d506ad tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] Returning 404 to user: Instance aa363288-1148-454a-bc77-73866d94b76c could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 22:01:30.998615 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f90fe983-4682-45f3-8732-557a86d506ad tempest-ServersNegativeTestJSON-1349508956 tempest-ServersNegativeTestJSON-1349508956-project] 10.222.0.20 "GET /compute/v2.1/servers/aa363288-1148-454a-bc77-73866d94b76c" status: 404 len: 111 microversion: 2.1 time: 0.028677 Apr 16 22:01:30.999161 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3746/7332] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:01:30 2022] GET /compute/v2.1/servers/aa363288-1148-454a-bc77-73866d94b76c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 22:02:11.243430 ncdv-master-1 devstack@n-api.service[137409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:02:11.243996 ncdv-master-1 devstack@n-api.service[137409]: Sat Apr 16 22:02:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 22:02:22.768868 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6a324d84-44f4-4a82-8786-0bfe1bcaad34 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Action: 'create', calling method: .version_select at 0x7fbb9535af70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1695325830"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:02:22.782517 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-6a324d84-44f4-4a82-8786-0bfe1bcaad34 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Getting quotas for project 151ed48abb644e47bbf210bbca563e3b. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 22:02:22.787551 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-6a324d84-44f4-4a82-8786-0bfe1bcaad34 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Getting quotas for user c683afdee06e4958bc94e991dd18257b and project 151ed48abb644e47bbf210bbca563e3b. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 22:02:23.033236 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-6a324d84-44f4-4a82-8786-0bfe1bcaad34 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Getting quotas for project 151ed48abb644e47bbf210bbca563e3b. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 22:02:23.038089 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-6a324d84-44f4-4a82-8786-0bfe1bcaad34 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Getting quotas for user c683afdee06e4958bc94e991dd18257b and project 151ed48abb644e47bbf210bbca563e3b. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 22:02:23.052469 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6a324d84-44f4-4a82-8786-0bfe1bcaad34 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.287858 Apr 16 22:02:23.053065 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3587/7333] 10.222.0.20 () {60 vars in 1157 bytes} [Sat Apr 16 22:02:22 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:02:23.107075 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cb44122b-e764-4000-8028-953e8dc9f16d tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-445781123", "imageRef": "feb29549-0b94-4aeb-bd04-f5870f79b1ad", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1695325830", "networks": [{"uuid": "91cbe260-31d2-4cca-8e36-39973acf3314"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:02:23.155548 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-cb44122b-e764-4000-8028-953e8dc9f16d tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] validate_networks() for [('91cbe260-31d2-4cca-8e36-39973acf3314', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 22:02:23.512331 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-cb44122b-e764-4000-8028-953e8dc9f16d tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 22:02:23.512779 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-cb44122b-e764-4000-8028-953e8dc9f16d tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 22:02:23.513272 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-cb44122b-e764-4000-8028-953e8dc9f16d tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 22:02:23.513740 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-cb44122b-e764-4000-8028-953e8dc9f16d tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 22:02:23.514170 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-cb44122b-e764-4000-8028-953e8dc9f16d tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 22:02:23.523371 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cb44122b-e764-4000-8028-953e8dc9f16d tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:23.523851 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cb44122b-e764-4000-8028-953e8dc9f16d tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:23.525347 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cb44122b-e764-4000-8028-953e8dc9f16d tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:23.525814 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cb44122b-e764-4000-8028-953e8dc9f16d tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:23.542744 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-cb44122b-e764-4000-8028-953e8dc9f16d tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Getting quotas for project 151ed48abb644e47bbf210bbca563e3b. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 22:02:23.548035 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-cb44122b-e764-4000-8028-953e8dc9f16d tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Getting quotas for user c683afdee06e4958bc94e991dd18257b and project 151ed48abb644e47bbf210bbca563e3b. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 22:02:23.560382 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cb44122b-e764-4000-8028-953e8dc9f16d tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 22:02:23.562775 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cb44122b-e764-4000-8028-953e8dc9f16d tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='feb29549-0b94-4aeb-bd04-f5870f79b1ad',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 22:02:23.688358 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cb44122b-e764-4000-8028-953e8dc9f16d tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.586411 Apr 16 22:02:23.689011 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3747/7334] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 22:02:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 22:02:23.699379 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e910f9cf-ac9c-4b4a-ab2c-906899165753 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:02:23.700084 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e910f9cf-ac9c-4b4a-ab2c-906899165753 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:02:23.752786 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e910f9cf-ac9c-4b4a-ab2c-906899165753 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c683afdee06e4958bc94e991dd18257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ed48abb644e47bbf210bbca563e3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:02:23.763095 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e910f9cf-ac9c-4b4a-ab2c-906899165753 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588" status: 200 len: 1258 microversion: 2.1 time: 0.068165 Apr 16 22:02:23.763905 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3588/7335] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:02:23 2022] GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588 => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:02:24.781517 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ac7f768e-8629-49b3-a002-4346dd967d16 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:02:24.782066 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ac7f768e-8629-49b3-a002-4346dd967d16 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:02:24.789005 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ac7f768e-8629-49b3-a002-4346dd967d16 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:24.789474 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ac7f768e-8629-49b3-a002-4346dd967d16 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:24.790265 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ac7f768e-8629-49b3-a002-4346dd967d16 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:24.790717 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ac7f768e-8629-49b3-a002-4346dd967d16 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:24.851728 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ac7f768e-8629-49b3-a002-4346dd967d16 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c683afdee06e4958bc94e991dd18257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ed48abb644e47bbf210bbca563e3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:02:24.859770 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ac7f768e-8629-49b3-a002-4346dd967d16 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588" status: 200 len: 1262 microversion: 2.1 time: 0.083919 Apr 16 22:02:24.860365 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3748/7336] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:02:24 2022] GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588 => generated 1262 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:02:25.877098 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0d6867dc-44a3-4472-8ccb-a92b7c2a72b7 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:02:25.877733 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0d6867dc-44a3-4472-8ccb-a92b7c2a72b7 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:02:25.885598 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0d6867dc-44a3-4472-8ccb-a92b7c2a72b7 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:25.886068 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0d6867dc-44a3-4472-8ccb-a92b7c2a72b7 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:25.886857 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0d6867dc-44a3-4472-8ccb-a92b7c2a72b7 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:25.887300 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0d6867dc-44a3-4472-8ccb-a92b7c2a72b7 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:25.968657 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0d6867dc-44a3-4472-8ccb-a92b7c2a72b7 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c683afdee06e4958bc94e991dd18257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ed48abb644e47bbf210bbca563e3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:02:25.976087 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0d6867dc-44a3-4472-8ccb-a92b7c2a72b7 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588" status: 200 len: 1328 microversion: 2.1 time: 0.103068 Apr 16 22:02:25.976690 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3589/7337] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:02:25 2022] GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588 => generated 1328 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:02:26.996857 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9a071fe8-dc97-4655-87cf-d2fb19176525 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:02:26.998119 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9a071fe8-dc97-4655-87cf-d2fb19176525 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:02:27.004360 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a071fe8-dc97-4655-87cf-d2fb19176525 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:27.004788 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a071fe8-dc97-4655-87cf-d2fb19176525 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:27.005584 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a071fe8-dc97-4655-87cf-d2fb19176525 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:27.006037 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9a071fe8-dc97-4655-87cf-d2fb19176525 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:27.168464 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9a071fe8-dc97-4655-87cf-d2fb19176525 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c683afdee06e4958bc94e991dd18257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ed48abb644e47bbf210bbca563e3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:02:27.178033 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9a071fe8-dc97-4655-87cf-d2fb19176525 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588" status: 200 len: 1358 microversion: 2.1 time: 0.185339 Apr 16 22:02:27.188533 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3749/7338] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:02:26 2022] GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588 => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:02:28.199113 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-733c0864-d5c3-4638-8d6f-85daf0da99cf tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:02:28.199945 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-733c0864-d5c3-4638-8d6f-85daf0da99cf tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:02:28.207487 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-733c0864-d5c3-4638-8d6f-85daf0da99cf tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:28.208034 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-733c0864-d5c3-4638-8d6f-85daf0da99cf tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:28.208939 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-733c0864-d5c3-4638-8d6f-85daf0da99cf tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:28.209454 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-733c0864-d5c3-4638-8d6f-85daf0da99cf tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:28.379538 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-733c0864-d5c3-4638-8d6f-85daf0da99cf tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c683afdee06e4958bc94e991dd18257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ed48abb644e47bbf210bbca563e3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:02:28.387890 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-733c0864-d5c3-4638-8d6f-85daf0da99cf tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588" status: 200 len: 1358 microversion: 2.1 time: 0.192680 Apr 16 22:02:28.388963 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3590/7339] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:02:28 2022] GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588 => generated 1358 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:02:29.411794 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4816cd3f-c0f6-4050-b9ae-871d28316822 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:02:29.412496 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4816cd3f-c0f6-4050-b9ae-871d28316822 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:02:29.420531 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4816cd3f-c0f6-4050-b9ae-871d28316822 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:29.421011 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4816cd3f-c0f6-4050-b9ae-871d28316822 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:29.421833 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4816cd3f-c0f6-4050-b9ae-871d28316822 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:29.422297 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4816cd3f-c0f6-4050-b9ae-871d28316822 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:29.568366 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4816cd3f-c0f6-4050-b9ae-871d28316822 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c683afdee06e4958bc94e991dd18257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ed48abb644e47bbf210bbca563e3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:02:29.576858 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4816cd3f-c0f6-4050-b9ae-871d28316822 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588" status: 200 len: 1358 microversion: 2.1 time: 0.174434 Apr 16 22:02:29.577452 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3750/7340] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:02:29 2022] GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 22:02:30.593694 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4e4550b4-c057-43f2-a537-f7d0f5360ebe tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:02:30.594326 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4e4550b4-c057-43f2-a537-f7d0f5360ebe tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:02:30.601308 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4e4550b4-c057-43f2-a537-f7d0f5360ebe tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:30.601766 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4e4550b4-c057-43f2-a537-f7d0f5360ebe tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:30.602600 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4e4550b4-c057-43f2-a537-f7d0f5360ebe tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:30.602995 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4e4550b4-c057-43f2-a537-f7d0f5360ebe tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:30.744941 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4e4550b4-c057-43f2-a537-f7d0f5360ebe tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c683afdee06e4958bc94e991dd18257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ed48abb644e47bbf210bbca563e3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:02:30.752787 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4e4550b4-c057-43f2-a537-f7d0f5360ebe tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588" status: 200 len: 1358 microversion: 2.1 time: 0.163296 Apr 16 22:02:30.753562 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3591/7341] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:02:30 2022] GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 22:02:31.771256 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-50006b96-c4c3-456d-8a61-8379ddb91e77 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:02:31.771996 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-50006b96-c4c3-456d-8a61-8379ddb91e77 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:02:31.779935 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-50006b96-c4c3-456d-8a61-8379ddb91e77 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:31.780645 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-50006b96-c4c3-456d-8a61-8379ddb91e77 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:31.781385 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-50006b96-c4c3-456d-8a61-8379ddb91e77 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:31.781910 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-50006b96-c4c3-456d-8a61-8379ddb91e77 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:31.927102 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-50006b96-c4c3-456d-8a61-8379ddb91e77 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c683afdee06e4958bc94e991dd18257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ed48abb644e47bbf210bbca563e3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:02:31.936709 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-50006b96-c4c3-456d-8a61-8379ddb91e77 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588" status: 200 len: 1358 microversion: 2.1 time: 0.169708 Apr 16 22:02:31.946336 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3751/7342] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:02:31 2022] GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:02:32.954773 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ab653a2e-d3ec-46a9-9bd5-e192f9ce9c20 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:02:32.955407 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ab653a2e-d3ec-46a9-9bd5-e192f9ce9c20 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:02:32.962134 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ab653a2e-d3ec-46a9-9bd5-e192f9ce9c20 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:32.962606 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ab653a2e-d3ec-46a9-9bd5-e192f9ce9c20 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:32.963452 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ab653a2e-d3ec-46a9-9bd5-e192f9ce9c20 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:32.963895 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ab653a2e-d3ec-46a9-9bd5-e192f9ce9c20 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:33.109575 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ab653a2e-d3ec-46a9-9bd5-e192f9ce9c20 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c683afdee06e4958bc94e991dd18257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ed48abb644e47bbf210bbca563e3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:02:33.117645 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ab653a2e-d3ec-46a9-9bd5-e192f9ce9c20 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588" status: 200 len: 1358 microversion: 2.1 time: 0.166508 Apr 16 22:02:33.128267 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3592/7343] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:02:32 2022] GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:02:34.135467 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f2bdee20-5db2-4399-8dfa-b2f8f8697420 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:02:34.136276 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f2bdee20-5db2-4399-8dfa-b2f8f8697420 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:02:34.143127 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f2bdee20-5db2-4399-8dfa-b2f8f8697420 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:34.143601 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f2bdee20-5db2-4399-8dfa-b2f8f8697420 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:34.144440 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f2bdee20-5db2-4399-8dfa-b2f8f8697420 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:34.144903 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f2bdee20-5db2-4399-8dfa-b2f8f8697420 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:34.281144 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f2bdee20-5db2-4399-8dfa-b2f8f8697420 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c683afdee06e4958bc94e991dd18257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ed48abb644e47bbf210bbca563e3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:02:34.289159 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f2bdee20-5db2-4399-8dfa-b2f8f8697420 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588" status: 200 len: 1358 microversion: 2.1 time: 0.157786 Apr 16 22:02:34.289995 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3752/7344] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:02:34 2022] GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:02:34.793177 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-ae02e7a2-7954-498e-9f87-6182c694b8c9 req-ca59a217-4cca-419d-92bb-ffb79ea8715c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b78892c8-47d2-4188-8f72-b1d7706da588", "tag": "47c536eb-eff2-43dc-8674-c8ec3ad75665"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:02:34.802396 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-ae02e7a2-7954-498e-9f87-6182c694b8c9 req-ca59a217-4cca-419d-92bb-ffb79ea8715c service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:34.802873 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-ae02e7a2-7954-498e-9f87-6182c694b8c9 req-ca59a217-4cca-419d-92bb-ffb79ea8715c service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:34.814357 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-ae02e7a2-7954-498e-9f87-6182c694b8c9 req-ca59a217-4cca-419d-92bb-ffb79ea8715c service nova] Creating event network-changed:47c536eb-eff2-43dc-8674-c8ec3ad75665 for instance b78892c8-47d2-4188-8f72-b1d7706da588 on nch1-master-1 Apr 16 22:02:34.819825 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-ae02e7a2-7954-498e-9f87-6182c694b8c9 req-ca59a217-4cca-419d-92bb-ffb79ea8715c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030260 Apr 16 22:02:34.820478 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3593/7345] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:02:35.307241 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-373b48bd-376c-4a25-9add-e0f60053cc62 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:02:35.307882 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-373b48bd-376c-4a25-9add-e0f60053cc62 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:02:35.314760 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-373b48bd-376c-4a25-9add-e0f60053cc62 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:35.315238 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-373b48bd-376c-4a25-9add-e0f60053cc62 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:35.316096 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-373b48bd-376c-4a25-9add-e0f60053cc62 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:35.316533 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-373b48bd-376c-4a25-9add-e0f60053cc62 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:35.446160 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-373b48bd-376c-4a25-9add-e0f60053cc62 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c683afdee06e4958bc94e991dd18257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ed48abb644e47bbf210bbca563e3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:02:35.454161 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-373b48bd-376c-4a25-9add-e0f60053cc62 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588" status: 200 len: 1358 microversion: 2.1 time: 0.151465 Apr 16 22:02:35.454744 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3753/7346] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:02:35 2022] GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588 => generated 1358 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:02:36.472560 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e66149fc-df07-4c94-919e-626659223ee1 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:02:36.473269 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e66149fc-df07-4c94-919e-626659223ee1 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:02:36.479555 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e66149fc-df07-4c94-919e-626659223ee1 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:36.480021 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e66149fc-df07-4c94-919e-626659223ee1 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:36.480831 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e66149fc-df07-4c94-919e-626659223ee1 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:36.481281 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e66149fc-df07-4c94-919e-626659223ee1 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:36.614119 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e66149fc-df07-4c94-919e-626659223ee1 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c683afdee06e4958bc94e991dd18257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ed48abb644e47bbf210bbca563e3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:02:36.622002 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e66149fc-df07-4c94-919e-626659223ee1 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588" status: 200 len: 1358 microversion: 2.1 time: 0.154650 Apr 16 22:02:36.622575 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3594/7347] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:02:36 2022] GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:02:37.638874 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2aac6d75-fc82-4494-8228-ff6ba34d5a5b tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:02:37.639506 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2aac6d75-fc82-4494-8228-ff6ba34d5a5b tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:02:37.646349 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2aac6d75-fc82-4494-8228-ff6ba34d5a5b tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:37.646817 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2aac6d75-fc82-4494-8228-ff6ba34d5a5b tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:37.647601 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2aac6d75-fc82-4494-8228-ff6ba34d5a5b tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:37.648055 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2aac6d75-fc82-4494-8228-ff6ba34d5a5b tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:37.779098 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2aac6d75-fc82-4494-8228-ff6ba34d5a5b tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c683afdee06e4958bc94e991dd18257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ed48abb644e47bbf210bbca563e3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:02:37.786968 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2aac6d75-fc82-4494-8228-ff6ba34d5a5b tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588" status: 200 len: 1358 microversion: 2.1 time: 0.152122 Apr 16 22:02:37.787811 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3754/7348] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:02:37 2022] GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:02:38.804603 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2f4fe2a6-4b9b-4198-872f-b8721893dd4c tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:02:38.805229 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2f4fe2a6-4b9b-4198-872f-b8721893dd4c tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:02:38.812016 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2f4fe2a6-4b9b-4198-872f-b8721893dd4c tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:38.812519 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2f4fe2a6-4b9b-4198-872f-b8721893dd4c tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:38.813311 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2f4fe2a6-4b9b-4198-872f-b8721893dd4c tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:38.813768 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2f4fe2a6-4b9b-4198-872f-b8721893dd4c tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:38.942576 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2f4fe2a6-4b9b-4198-872f-b8721893dd4c tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c683afdee06e4958bc94e991dd18257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ed48abb644e47bbf210bbca563e3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:02:38.950863 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2f4fe2a6-4b9b-4198-872f-b8721893dd4c tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588" status: 200 len: 1358 microversion: 2.1 time: 0.150219 Apr 16 22:02:38.951473 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3595/7349] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:02:38 2022] GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:02:39.428336 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-d3be09fa-3b5d-4aa8-97ad-db215dab213e req-0ca9c29f-3901-4404-8c0a-31aa34cbecd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b78892c8-47d2-4188-8f72-b1d7706da588", "name": "network-vif-plugged", "status": "completed", "tag": "47c536eb-eff2-43dc-8674-c8ec3ad75665"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:02:39.437607 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-d3be09fa-3b5d-4aa8-97ad-db215dab213e req-0ca9c29f-3901-4404-8c0a-31aa34cbecd1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:39.438071 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-d3be09fa-3b5d-4aa8-97ad-db215dab213e req-0ca9c29f-3901-4404-8c0a-31aa34cbecd1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:39.448763 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-d3be09fa-3b5d-4aa8-97ad-db215dab213e req-0ca9c29f-3901-4404-8c0a-31aa34cbecd1 service nova] Creating event network-vif-plugged:47c536eb-eff2-43dc-8674-c8ec3ad75665 for instance b78892c8-47d2-4188-8f72-b1d7706da588 on nch1-master-1 Apr 16 22:02:39.453941 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-d3be09fa-3b5d-4aa8-97ad-db215dab213e req-0ca9c29f-3901-4404-8c0a-31aa34cbecd1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029309 Apr 16 22:02:39.454525 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3755/7350] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:02:39.968572 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a60f0d32-b286-43d3-93f6-60e4f7ad18bc tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:02:39.969198 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a60f0d32-b286-43d3-93f6-60e4f7ad18bc tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:02:39.976070 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a60f0d32-b286-43d3-93f6-60e4f7ad18bc tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:39.976574 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a60f0d32-b286-43d3-93f6-60e4f7ad18bc tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:39.977363 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a60f0d32-b286-43d3-93f6-60e4f7ad18bc tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:39.977821 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a60f0d32-b286-43d3-93f6-60e4f7ad18bc tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:40.103722 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a60f0d32-b286-43d3-93f6-60e4f7ad18bc tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c683afdee06e4958bc94e991dd18257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ed48abb644e47bbf210bbca563e3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:02:40.111136 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a60f0d32-b286-43d3-93f6-60e4f7ad18bc tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588" status: 200 len: 1358 microversion: 2.1 time: 0.146791 Apr 16 22:02:40.111724 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3596/7351] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:02:39 2022] GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 22:02:41.129622 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9fe0f98e-08db-4a65-a0b3-309bcdf9d2a5 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:02:41.130337 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9fe0f98e-08db-4a65-a0b3-309bcdf9d2a5 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:02:41.136732 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9fe0f98e-08db-4a65-a0b3-309bcdf9d2a5 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:41.137208 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9fe0f98e-08db-4a65-a0b3-309bcdf9d2a5 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:41.138026 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9fe0f98e-08db-4a65-a0b3-309bcdf9d2a5 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:41.138489 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9fe0f98e-08db-4a65-a0b3-309bcdf9d2a5 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:41.263757 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9fe0f98e-08db-4a65-a0b3-309bcdf9d2a5 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c683afdee06e4958bc94e991dd18257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ed48abb644e47bbf210bbca563e3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:02:41.271197 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9fe0f98e-08db-4a65-a0b3-309bcdf9d2a5 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588" status: 200 len: 1549 microversion: 2.1 time: 0.146875 Apr 16 22:02:41.271775 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3756/7352] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:02:41 2022] GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588 => generated 1549 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:02:41.287697 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-dc51ada2-dcc1-401b-98b7-2f92ba912112 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:02:41.288351 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-dc51ada2-dcc1-401b-98b7-2f92ba912112 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:02:41.295692 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dc51ada2-dcc1-401b-98b7-2f92ba912112 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:41.296153 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dc51ada2-dcc1-401b-98b7-2f92ba912112 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:41.296971 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dc51ada2-dcc1-401b-98b7-2f92ba912112 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:41.297424 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dc51ada2-dcc1-401b-98b7-2f92ba912112 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:41.427799 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-dc51ada2-dcc1-401b-98b7-2f92ba912112 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c683afdee06e4958bc94e991dd18257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ed48abb644e47bbf210bbca563e3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:02:41.435119 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-dc51ada2-dcc1-401b-98b7-2f92ba912112 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588" status: 200 len: 1549 microversion: 2.1 time: 0.151303 Apr 16 22:02:41.435695 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3597/7353] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:02:41 2022] GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588 => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 22:02:41.450742 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6ed692c7-d018-4286-b404-22bb3be16ece tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:02:41.454065 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6ed692c7-d018-4286-b404-22bb3be16ece tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c683afdee06e4958bc94e991dd18257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ed48abb644e47bbf210bbca563e3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:02:41.454848 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6ed692c7-d018-4286-b404-22bb3be16ece tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Searching by: {'deleted': False, 'project_id': '151ed48abb644e47bbf210bbca563e3b'} {{(pid=137408) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 16 22:02:41.460086 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6ed692c7-d018-4286-b404-22bb3be16ece tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:41.460588 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6ed692c7-d018-4286-b404-22bb3be16ece tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:41.461411 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6ed692c7-d018-4286-b404-22bb3be16ece tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:41.461879 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6ed692c7-d018-4286-b404-22bb3be16ece tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:41.486109 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.multi_cell_list [None req-6ed692c7-d018-4286-b404-22bb3be16ece tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=137408) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 16 22:02:41.514258 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6ed692c7-d018-4286-b404-22bb3be16ece tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.067342 Apr 16 22:02:41.514829 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3757/7354] 10.222.0.20 () {58 vars in 1124 bytes} [Sat Apr 16 22:02:41 2022] GET /compute/v2.1/servers => generated 342 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:02:41.525016 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6023fd5e-d888-4f3e-adcf-f0fd921871ba tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:02:41.526253 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6023fd5e-d888-4f3e-adcf-f0fd921871ba tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:02:41.532105 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6023fd5e-d888-4f3e-adcf-f0fd921871ba tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:41.532593 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6023fd5e-d888-4f3e-adcf-f0fd921871ba tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:41.533365 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6023fd5e-d888-4f3e-adcf-f0fd921871ba tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:41.533809 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6023fd5e-d888-4f3e-adcf-f0fd921871ba tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:41.660403 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6023fd5e-d888-4f3e-adcf-f0fd921871ba tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c683afdee06e4958bc94e991dd18257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ed48abb644e47bbf210bbca563e3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:02:41.667839 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6023fd5e-d888-4f3e-adcf-f0fd921871ba tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588" status: 200 len: 1549 microversion: 2.1 time: 0.146717 Apr 16 22:02:41.669337 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3598/7355] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:02:41 2022] GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588 => generated 1549 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:02:43.444342 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f4249f40-3678-4ae1-993e-f430d340f551 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ffb015bd-e3f2-4d9c-aa8f-f42c8d48ac28"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:02:43.445427 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f4249f40-3678-4ae1-993e-f430d340f551 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:02:43.452657 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f4249f40-3678-4ae1-993e-f430d340f551 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:43.453130 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f4249f40-3678-4ae1-993e-f430d340f551 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:43.453919 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f4249f40-3678-4ae1-993e-f430d340f551 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:43.454377 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f4249f40-3678-4ae1-993e-f430d340f551 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:44.003901 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f4249f40-3678-4ae1-993e-f430d340f551 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "POST /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.563397 Apr 16 22:02:44.004571 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3758/7356] 10.222.0.20 () {60 vars in 1322 bytes} [Sat Apr 16 22:02:43 2022] POST /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588/os-volume_attachments => generated 194 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:02:47.325550 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-342d8917-dd4a-4b58-91ec-ff6812e15a15 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:02:47.326167 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-342d8917-dd4a-4b58-91ec-ff6812e15a15 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:02:47.332968 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-342d8917-dd4a-4b58-91ec-ff6812e15a15 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:47.333420 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-342d8917-dd4a-4b58-91ec-ff6812e15a15 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:47.334189 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-342d8917-dd4a-4b58-91ec-ff6812e15a15 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:47.334635 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-342d8917-dd4a-4b58-91ec-ff6812e15a15 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:47.460565 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-342d8917-dd4a-4b58-91ec-ff6812e15a15 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c683afdee06e4958bc94e991dd18257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ed48abb644e47bbf210bbca563e3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:02:47.469292 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-342d8917-dd4a-4b58-91ec-ff6812e15a15 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588" status: 200 len: 1595 microversion: 2.1 time: 0.147682 Apr 16 22:02:47.469865 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3599/7357] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:02:47 2022] GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588 => generated 1595 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:02:49.719326 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-70b5a169-5948-4894-bccf-0f563c839498 req-432c872a-2d14-4e50-b244-ca7279bcda4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b78892c8-47d2-4188-8f72-b1d7706da588", "tag": "47c536eb-eff2-43dc-8674-c8ec3ad75665"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:02:49.728679 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-70b5a169-5948-4894-bccf-0f563c839498 req-432c872a-2d14-4e50-b244-ca7279bcda4b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:49.729243 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-70b5a169-5948-4894-bccf-0f563c839498 req-432c872a-2d14-4e50-b244-ca7279bcda4b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:49.740941 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-70b5a169-5948-4894-bccf-0f563c839498 req-432c872a-2d14-4e50-b244-ca7279bcda4b service nova] Creating event network-changed:47c536eb-eff2-43dc-8674-c8ec3ad75665 for instance b78892c8-47d2-4188-8f72-b1d7706da588 on nch1-master-1 Apr 16 22:02:49.746615 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-70b5a169-5948-4894-bccf-0f563c839498 req-432c872a-2d14-4e50-b244-ca7279bcda4b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032619 Apr 16 22:02:49.747247 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3759/7358] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:02:51.975533 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7fdf0161-20f7-4ff6-869b-fb436dd12e21 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1635206871"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:02:51.976075 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7fdf0161-20f7-4ff6-869b-fb436dd12e21 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:02:51.983467 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7fdf0161-20f7-4ff6-869b-fb436dd12e21 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:51.983925 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7fdf0161-20f7-4ff6-869b-fb436dd12e21 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:51.984723 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7fdf0161-20f7-4ff6-869b-fb436dd12e21 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:51.985190 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7fdf0161-20f7-4ff6-869b-fb436dd12e21 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:52.110021 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.network.security_group_api [None req-7fdf0161-20f7-4ff6-869b-fb436dd12e21 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Adding security group 505b2e0e-a84c-4ec8-a0b7-3721c3efd2e6 to port 47c536eb-eff2-43dc-8674-c8ec3ad75665 Apr 16 22:02:52.511901 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7fdf0161-20f7-4ff6-869b-fb436dd12e21 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "POST /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588/action" status: 202 len: 0 microversion: 2.1 time: 0.540326 Apr 16 22:02:52.517177 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3600/7359] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 22:02:51 2022] POST /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588/action => generated 0 bytes in 546 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 22:02:52.520976 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-1070bc2d-856b-4469-92b1-6781fa1ca4d1 req-5644d483-412c-41ae-8542-b6d3e7e4c958 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b78892c8-47d2-4188-8f72-b1d7706da588", "tag": "47c536eb-eff2-43dc-8674-c8ec3ad75665"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:02:52.522383 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c88d76e2-5c68-4cf2-b1e5-5d9927cd37ec tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:02:52.523211 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c88d76e2-5c68-4cf2-b1e5-5d9927cd37ec tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:02:52.529500 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-1070bc2d-856b-4469-92b1-6781fa1ca4d1 req-5644d483-412c-41ae-8542-b6d3e7e4c958 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:52.530418 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-1070bc2d-856b-4469-92b1-6781fa1ca4d1 req-5644d483-412c-41ae-8542-b6d3e7e4c958 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:52.534396 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c88d76e2-5c68-4cf2-b1e5-5d9927cd37ec tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:52.534984 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c88d76e2-5c68-4cf2-b1e5-5d9927cd37ec tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:52.536214 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c88d76e2-5c68-4cf2-b1e5-5d9927cd37ec tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:02:52.536893 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c88d76e2-5c68-4cf2-b1e5-5d9927cd37ec tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:02:52.549958 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-1070bc2d-856b-4469-92b1-6781fa1ca4d1 req-5644d483-412c-41ae-8542-b6d3e7e4c958 service nova] Creating event network-changed:47c536eb-eff2-43dc-8674-c8ec3ad75665 for instance b78892c8-47d2-4188-8f72-b1d7706da588 on nch1-master-1 Apr 16 22:02:52.555215 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-1070bc2d-856b-4469-92b1-6781fa1ca4d1 req-5644d483-412c-41ae-8542-b6d3e7e4c958 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039122 Apr 16 22:02:52.558462 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3760/7360] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 22:02:52.802407 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c88d76e2-5c68-4cf2-b1e5-5d9927cd37ec tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c683afdee06e4958bc94e991dd18257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ed48abb644e47bbf210bbca563e3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:02:52.811937 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c88d76e2-5c68-4cf2-b1e5-5d9927cd37ec tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588" status: 200 len: 1760 microversion: 2.1 time: 0.293681 Apr 16 22:02:52.815812 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3601/7361] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:02:52 2022] GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588 => generated 1760 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:03:15.151029 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bba2fc8d-5e15-4172-b421-290beeed11e3 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:03:15.152072 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-bba2fc8d-5e15-4172-b421-290beeed11e3 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:03:15.158318 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bba2fc8d-5e15-4172-b421-290beeed11e3 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:03:15.158788 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bba2fc8d-5e15-4172-b421-290beeed11e3 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:03:15.159609 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bba2fc8d-5e15-4172-b421-290beeed11e3 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:03:15.160067 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bba2fc8d-5e15-4172-b421-290beeed11e3 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:03:15.323296 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-bba2fc8d-5e15-4172-b421-290beeed11e3 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "POST /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588/action" status: 202 len: 0 microversion: 2.1 time: 0.177044 Apr 16 22:03:15.323992 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3761/7362] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 22:03:15 2022] POST /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 22:03:15.332464 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-646cfd40-8518-4eb5-a685-c16055c12471 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:03:15.333088 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-646cfd40-8518-4eb5-a685-c16055c12471 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:03:15.339240 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-646cfd40-8518-4eb5-a685-c16055c12471 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:03:15.339711 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-646cfd40-8518-4eb5-a685-c16055c12471 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:03:15.340532 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-646cfd40-8518-4eb5-a685-c16055c12471 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:03:15.341241 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-646cfd40-8518-4eb5-a685-c16055c12471 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:03:15.696302 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-646cfd40-8518-4eb5-a685-c16055c12471 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c683afdee06e4958bc94e991dd18257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ed48abb644e47bbf210bbca563e3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:03:15.704133 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-646cfd40-8518-4eb5-a685-c16055c12471 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588" status: 200 len: 1752 microversion: 2.1 time: 0.375754 Apr 16 22:03:15.704740 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3602/7363] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:03:15 2022] GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588 => generated 1752 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:03:16.721742 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f6f88c57-c3e2-4c9e-ba66-f868661236f6 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:03:16.722468 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f6f88c57-c3e2-4c9e-ba66-f868661236f6 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:03:16.729649 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6f88c57-c3e2-4c9e-ba66-f868661236f6 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:03:16.730136 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6f88c57-c3e2-4c9e-ba66-f868661236f6 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:03:16.730940 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6f88c57-c3e2-4c9e-ba66-f868661236f6 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:03:16.731409 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6f88c57-c3e2-4c9e-ba66-f868661236f6 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:03:16.928414 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f6f88c57-c3e2-4c9e-ba66-f868661236f6 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c683afdee06e4958bc94e991dd18257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ed48abb644e47bbf210bbca563e3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:03:16.937188 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f6f88c57-c3e2-4c9e-ba66-f868661236f6 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588" status: 200 len: 1757 microversion: 2.1 time: 0.219679 Apr 16 22:03:16.937701 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3762/7364] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:03:16 2022] GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588 => generated 1757 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 22:03:17.955362 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7f3befb2-c77d-406f-ba85-599fd8505075 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:03:17.955942 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7f3befb2-c77d-406f-ba85-599fd8505075 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:03:17.962809 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7f3befb2-c77d-406f-ba85-599fd8505075 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:03:17.963271 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7f3befb2-c77d-406f-ba85-599fd8505075 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:03:17.964048 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7f3befb2-c77d-406f-ba85-599fd8505075 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:03:17.964519 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7f3befb2-c77d-406f-ba85-599fd8505075 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:03:18.103681 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7f3befb2-c77d-406f-ba85-599fd8505075 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c683afdee06e4958bc94e991dd18257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ed48abb644e47bbf210bbca563e3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:03:18.112020 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7f3befb2-c77d-406f-ba85-599fd8505075 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588" status: 200 len: 1757 microversion: 2.1 time: 0.161302 Apr 16 22:03:18.112622 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3603/7365] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:03:17 2022] GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:03:19.129347 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0d09fd7a-7b66-4deb-bdb7-81180e1d2649 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:03:19.129980 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0d09fd7a-7b66-4deb-bdb7-81180e1d2649 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:03:19.136896 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0d09fd7a-7b66-4deb-bdb7-81180e1d2649 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:03:19.137369 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0d09fd7a-7b66-4deb-bdb7-81180e1d2649 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:03:19.138639 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0d09fd7a-7b66-4deb-bdb7-81180e1d2649 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:03:19.139103 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0d09fd7a-7b66-4deb-bdb7-81180e1d2649 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:03:19.284236 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0d09fd7a-7b66-4deb-bdb7-81180e1d2649 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c683afdee06e4958bc94e991dd18257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ed48abb644e47bbf210bbca563e3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:03:19.292306 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0d09fd7a-7b66-4deb-bdb7-81180e1d2649 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588" status: 200 len: 1757 microversion: 2.1 time: 0.166898 Apr 16 22:03:19.292886 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3763/7366] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:03:19 2022] GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 22:03:20.309771 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-14f45c96-c4d4-4d3f-9707-0a2e95af5f86 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:03:20.311675 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-14f45c96-c4d4-4d3f-9707-0a2e95af5f86 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:03:20.317618 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-14f45c96-c4d4-4d3f-9707-0a2e95af5f86 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:03:20.318082 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-14f45c96-c4d4-4d3f-9707-0a2e95af5f86 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:03:20.318854 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-14f45c96-c4d4-4d3f-9707-0a2e95af5f86 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:03:20.319331 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-14f45c96-c4d4-4d3f-9707-0a2e95af5f86 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:03:20.472311 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-14f45c96-c4d4-4d3f-9707-0a2e95af5f86 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c683afdee06e4958bc94e991dd18257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ed48abb644e47bbf210bbca563e3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:03:20.480188 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-14f45c96-c4d4-4d3f-9707-0a2e95af5f86 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588" status: 200 len: 1757 microversion: 2.1 time: 0.174361 Apr 16 22:03:20.480768 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3604/7367] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:03:20 2022] GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588 => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:03:21.498446 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-edb5cd98-dc43-4c4b-afef-7ab2c24168f9 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:03:21.499074 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-edb5cd98-dc43-4c4b-afef-7ab2c24168f9 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:03:21.505904 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-edb5cd98-dc43-4c4b-afef-7ab2c24168f9 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:03:21.506379 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-edb5cd98-dc43-4c4b-afef-7ab2c24168f9 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:03:21.507173 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-edb5cd98-dc43-4c4b-afef-7ab2c24168f9 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:03:21.507632 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-edb5cd98-dc43-4c4b-afef-7ab2c24168f9 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:03:21.648986 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-edb5cd98-dc43-4c4b-afef-7ab2c24168f9 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c683afdee06e4958bc94e991dd18257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ed48abb644e47bbf210bbca563e3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:03:21.656820 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-edb5cd98-dc43-4c4b-afef-7ab2c24168f9 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588" status: 200 len: 1757 microversion: 2.1 time: 0.162820 Apr 16 22:03:21.657388 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3764/7368] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:03:21 2022] GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:03:22.676358 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-51d2692b-b49a-4c5e-8f4c-1ba2780ccf77 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:03:22.677409 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-51d2692b-b49a-4c5e-8f4c-1ba2780ccf77 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:03:22.685480 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-51d2692b-b49a-4c5e-8f4c-1ba2780ccf77 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:03:22.685938 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-51d2692b-b49a-4c5e-8f4c-1ba2780ccf77 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:03:22.686752 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-51d2692b-b49a-4c5e-8f4c-1ba2780ccf77 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:03:22.687196 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-51d2692b-b49a-4c5e-8f4c-1ba2780ccf77 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:03:22.828567 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-51d2692b-b49a-4c5e-8f4c-1ba2780ccf77 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c683afdee06e4958bc94e991dd18257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ed48abb644e47bbf210bbca563e3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:03:22.836503 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-51d2692b-b49a-4c5e-8f4c-1ba2780ccf77 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588" status: 200 len: 1757 microversion: 2.1 time: 0.166299 Apr 16 22:03:22.837077 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3605/7369] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:03:22 2022] GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:03:23.854872 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-26a5c8f8-1f9f-4cd0-aaee-b8b9b8fa9cfb tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:03:23.855441 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-26a5c8f8-1f9f-4cd0-aaee-b8b9b8fa9cfb tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:03:23.862982 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-26a5c8f8-1f9f-4cd0-aaee-b8b9b8fa9cfb tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:03:23.867746 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-26a5c8f8-1f9f-4cd0-aaee-b8b9b8fa9cfb tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:03:23.867746 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-26a5c8f8-1f9f-4cd0-aaee-b8b9b8fa9cfb tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:03:23.867746 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-26a5c8f8-1f9f-4cd0-aaee-b8b9b8fa9cfb tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:03:24.005853 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-26a5c8f8-1f9f-4cd0-aaee-b8b9b8fa9cfb tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c683afdee06e4958bc94e991dd18257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ed48abb644e47bbf210bbca563e3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:03:24.013781 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-26a5c8f8-1f9f-4cd0-aaee-b8b9b8fa9cfb tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588" status: 200 len: 1757 microversion: 2.1 time: 0.163034 Apr 16 22:03:24.014344 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3765/7370] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:03:23 2022] GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 22:03:25.031771 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-dbbe33cf-59a4-4c89-92cb-55d4b035ed1a tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:03:25.032416 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-dbbe33cf-59a4-4c89-92cb-55d4b035ed1a tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:03:25.038635 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dbbe33cf-59a4-4c89-92cb-55d4b035ed1a tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:03:25.039096 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dbbe33cf-59a4-4c89-92cb-55d4b035ed1a tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:03:25.039880 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dbbe33cf-59a4-4c89-92cb-55d4b035ed1a tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:03:25.040352 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dbbe33cf-59a4-4c89-92cb-55d4b035ed1a tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:03:25.182618 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-dbbe33cf-59a4-4c89-92cb-55d4b035ed1a tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c683afdee06e4958bc94e991dd18257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ed48abb644e47bbf210bbca563e3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:03:25.191224 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-dbbe33cf-59a4-4c89-92cb-55d4b035ed1a tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588" status: 200 len: 1757 microversion: 2.1 time: 0.163713 Apr 16 22:03:25.191806 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3606/7371] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:03:25 2022] GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:03:26.208583 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f652e3bd-0429-4ee4-8526-c9f011f939f5 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:03:26.209387 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f652e3bd-0429-4ee4-8526-c9f011f939f5 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:03:26.217143 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f652e3bd-0429-4ee4-8526-c9f011f939f5 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:03:26.217625 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f652e3bd-0429-4ee4-8526-c9f011f939f5 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:03:26.218434 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f652e3bd-0429-4ee4-8526-c9f011f939f5 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:03:26.218926 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f652e3bd-0429-4ee4-8526-c9f011f939f5 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:03:26.363110 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f652e3bd-0429-4ee4-8526-c9f011f939f5 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c683afdee06e4958bc94e991dd18257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ed48abb644e47bbf210bbca563e3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:03:26.371060 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f652e3bd-0429-4ee4-8526-c9f011f939f5 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588" status: 200 len: 1757 microversion: 2.1 time: 0.166471 Apr 16 22:03:26.371632 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3766/7372] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:03:26 2022] GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:03:27.388466 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-03450802-c9c2-47fe-a3a4-b739dc05cf25 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:03:27.389086 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-03450802-c9c2-47fe-a3a4-b739dc05cf25 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:03:27.395981 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-03450802-c9c2-47fe-a3a4-b739dc05cf25 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:03:27.398276 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-03450802-c9c2-47fe-a3a4-b739dc05cf25 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:03:27.398276 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-03450802-c9c2-47fe-a3a4-b739dc05cf25 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:03:27.398276 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-03450802-c9c2-47fe-a3a4-b739dc05cf25 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:03:27.540731 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-03450802-c9c2-47fe-a3a4-b739dc05cf25 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c683afdee06e4958bc94e991dd18257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ed48abb644e47bbf210bbca563e3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:03:27.549260 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-03450802-c9c2-47fe-a3a4-b739dc05cf25 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588" status: 200 len: 1757 microversion: 2.1 time: 0.164842 Apr 16 22:03:27.549843 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3607/7373] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:03:27 2022] GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:03:28.566537 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7ca1bbf2-843a-4ef8-8cd2-34803ef6446b tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:03:28.567194 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7ca1bbf2-843a-4ef8-8cd2-34803ef6446b tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:03:28.573491 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ca1bbf2-843a-4ef8-8cd2-34803ef6446b tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:03:28.573958 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ca1bbf2-843a-4ef8-8cd2-34803ef6446b tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:03:28.574743 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ca1bbf2-843a-4ef8-8cd2-34803ef6446b tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:03:28.575196 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7ca1bbf2-843a-4ef8-8cd2-34803ef6446b tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:03:28.715756 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7ca1bbf2-843a-4ef8-8cd2-34803ef6446b tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c683afdee06e4958bc94e991dd18257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ed48abb644e47bbf210bbca563e3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:03:28.723685 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7ca1bbf2-843a-4ef8-8cd2-34803ef6446b tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588" status: 200 len: 1757 microversion: 2.1 time: 0.161113 Apr 16 22:03:28.724275 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3767/7374] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:03:28 2022] GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588 => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:03:29.741050 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-07c00d3d-f1f8-411d-a4cc-2aebdd15a31c tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:03:29.741681 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-07c00d3d-f1f8-411d-a4cc-2aebdd15a31c tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:03:29.749114 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-07c00d3d-f1f8-411d-a4cc-2aebdd15a31c tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:03:29.749577 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-07c00d3d-f1f8-411d-a4cc-2aebdd15a31c tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:03:29.750365 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-07c00d3d-f1f8-411d-a4cc-2aebdd15a31c tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:03:29.750817 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-07c00d3d-f1f8-411d-a4cc-2aebdd15a31c tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:03:29.961000 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-07c00d3d-f1f8-411d-a4cc-2aebdd15a31c tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c683afdee06e4958bc94e991dd18257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ed48abb644e47bbf210bbca563e3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:03:29.969334 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-07c00d3d-f1f8-411d-a4cc-2aebdd15a31c tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588" status: 200 len: 1757 microversion: 2.1 time: 0.232269 Apr 16 22:03:29.969913 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3608/7375] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:03:29 2022] GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588 => generated 1757 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:03:30.986958 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b73e8243-2474-4bc6-97cf-47871f2bba86 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:03:30.987529 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b73e8243-2474-4bc6-97cf-47871f2bba86 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:03:30.994472 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b73e8243-2474-4bc6-97cf-47871f2bba86 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:03:30.994947 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b73e8243-2474-4bc6-97cf-47871f2bba86 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:03:31.001080 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b73e8243-2474-4bc6-97cf-47871f2bba86 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:03:31.001080 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b73e8243-2474-4bc6-97cf-47871f2bba86 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:03:31.144327 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b73e8243-2474-4bc6-97cf-47871f2bba86 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c683afdee06e4958bc94e991dd18257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ed48abb644e47bbf210bbca563e3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:03:31.152501 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b73e8243-2474-4bc6-97cf-47871f2bba86 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588" status: 200 len: 1757 microversion: 2.1 time: 0.169628 Apr 16 22:03:31.153084 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3768/7376] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:03:30 2022] GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:03:32.169828 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c7b287cd-7d4a-4a29-b8b1-053c2b818b3e tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:03:32.170492 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c7b287cd-7d4a-4a29-b8b1-053c2b818b3e tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:03:32.177681 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c7b287cd-7d4a-4a29-b8b1-053c2b818b3e tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:03:32.178143 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c7b287cd-7d4a-4a29-b8b1-053c2b818b3e tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:03:32.178917 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c7b287cd-7d4a-4a29-b8b1-053c2b818b3e tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:03:32.179360 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c7b287cd-7d4a-4a29-b8b1-053c2b818b3e tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:03:32.322281 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c7b287cd-7d4a-4a29-b8b1-053c2b818b3e tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c683afdee06e4958bc94e991dd18257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ed48abb644e47bbf210bbca563e3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:03:32.330728 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c7b287cd-7d4a-4a29-b8b1-053c2b818b3e tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588" status: 200 len: 1760 microversion: 2.1 time: 0.164816 Apr 16 22:03:32.331287 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3609/7377] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:03:32 2022] GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588 => generated 1760 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:03:47.676406 ncdv-master-1 devstack@n-api.service[137408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:03:47.677008 ncdv-master-1 devstack@n-api.service[137408]: Sat Apr 16 22:03:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 22:03:51.180775 ncdv-master-1 devstack@n-api.service[137409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:03:51.181347 ncdv-master-1 devstack@n-api.service[137409]: Sat Apr 16 22:03:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 22:04:04.322746 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6578c8cf-8268-4196-95ef-2b2843ab3845 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1635206871"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:04:04.323341 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6578c8cf-8268-4196-95ef-2b2843ab3845 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:04:04.329799 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6578c8cf-8268-4196-95ef-2b2843ab3845 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:04.330277 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6578c8cf-8268-4196-95ef-2b2843ab3845 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:04.331069 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6578c8cf-8268-4196-95ef-2b2843ab3845 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:04.331527 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6578c8cf-8268-4196-95ef-2b2843ab3845 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:04.455445 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.network.security_group_api [None req-6578c8cf-8268-4196-95ef-2b2843ab3845 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Removing security group 505b2e0e-a84c-4ec8-a0b7-3721c3efd2e6 from port 47c536eb-eff2-43dc-8674-c8ec3ad75665 Apr 16 22:04:04.847361 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6578c8cf-8268-4196-95ef-2b2843ab3845 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "POST /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588/action" status: 202 len: 0 microversion: 2.1 time: 0.528915 Apr 16 22:04:04.851096 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3769/7378] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 22:04:04 2022] POST /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588/action => generated 0 bytes in 530 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 22:04:04.858119 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-29bc2d53-347e-4a2f-821f-5383ae13ecc6 req-42e7b869-7e1f-48a3-a790-ffeaa6fcd377 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b78892c8-47d2-4188-8f72-b1d7706da588", "tag": "47c536eb-eff2-43dc-8674-c8ec3ad75665"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:04:04.883040 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-29bc2d53-347e-4a2f-821f-5383ae13ecc6 req-42e7b869-7e1f-48a3-a790-ffeaa6fcd377 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:04.883515 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-29bc2d53-347e-4a2f-821f-5383ae13ecc6 req-42e7b869-7e1f-48a3-a790-ffeaa6fcd377 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:04.911751 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-29bc2d53-347e-4a2f-821f-5383ae13ecc6 req-42e7b869-7e1f-48a3-a790-ffeaa6fcd377 service nova] Creating event network-changed:47c536eb-eff2-43dc-8674-c8ec3ad75665 for instance b78892c8-47d2-4188-8f72-b1d7706da588 on nch1-master-1 Apr 16 22:04:04.922342 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-29bc2d53-347e-4a2f-821f-5383ae13ecc6 req-42e7b869-7e1f-48a3-a790-ffeaa6fcd377 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067327 Apr 16 22:04:04.926944 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3610/7379] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:04:06.140271 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c482d477-9342-48f9-8680-e909fdc67ad2 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:04:06.140824 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c482d477-9342-48f9-8680-e909fdc67ad2 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:04:06.147061 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c482d477-9342-48f9-8680-e909fdc67ad2 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:06.147545 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c482d477-9342-48f9-8680-e909fdc67ad2 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:06.148380 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c482d477-9342-48f9-8680-e909fdc67ad2 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:06.148842 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c482d477-9342-48f9-8680-e909fdc67ad2 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:06.227363 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-c482d477-9342-48f9-8680-e909fdc67ad2 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lazy-loading 'services' on Instance uuid b78892c8-47d2-4188-8f72-b1d7706da588 {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 22:04:06.426708 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c482d477-9342-48f9-8680-e909fdc67ad2 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588/os-volume_attachments/ffb015bd-e3f2-4d9c-aa8f-f42c8d48ac28" status: 202 len: 0 microversion: 2.1 time: 0.291338 Apr 16 22:04:06.427587 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3770/7380] 10.222.0.20 () {58 vars in 1415 bytes} [Sat Apr 16 22:04:06 2022] DELETE /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588/os-volume_attachments/ffb015bd-e3f2-4d9c-aa8f-f42c8d48ac28 => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 22:04:06.438125 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5e9aeac8-5776-435f-866d-61e4bdddeae7 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:04:06.439347 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5e9aeac8-5776-435f-866d-61e4bdddeae7 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:04:06.445848 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5e9aeac8-5776-435f-866d-61e4bdddeae7 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:06.446319 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5e9aeac8-5776-435f-866d-61e4bdddeae7 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:06.447111 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5e9aeac8-5776-435f-866d-61e4bdddeae7 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:06.447829 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5e9aeac8-5776-435f-866d-61e4bdddeae7 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:06.478795 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5e9aeac8-5776-435f-866d-61e4bdddeae7 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046539 Apr 16 22:04:06.479381 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3611/7381] 10.222.0.20 () {58 vars in 1301 bytes} [Sat Apr 16 22:04:06 2022] GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:04:06.939142 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-29986c34-4446-4013-ad4f-111dee87bfd0 req-060accc4-ea65-4548-9f92-dac9d1b485a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b78892c8-47d2-4188-8f72-b1d7706da588", "tag": "47c536eb-eff2-43dc-8674-c8ec3ad75665"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:04:06.947902 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-29986c34-4446-4013-ad4f-111dee87bfd0 req-060accc4-ea65-4548-9f92-dac9d1b485a1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:06.948451 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-29986c34-4446-4013-ad4f-111dee87bfd0 req-060accc4-ea65-4548-9f92-dac9d1b485a1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:06.960144 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-29986c34-4446-4013-ad4f-111dee87bfd0 req-060accc4-ea65-4548-9f92-dac9d1b485a1 service nova] Creating event network-changed:47c536eb-eff2-43dc-8674-c8ec3ad75665 for instance b78892c8-47d2-4188-8f72-b1d7706da588 on nch1-master-1 Apr 16 22:04:06.966184 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-29986c34-4446-4013-ad4f-111dee87bfd0 req-060accc4-ea65-4548-9f92-dac9d1b485a1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031218 Apr 16 22:04:06.966987 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3771/7382] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:04:07.491342 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e2b88fc4-9a54-4e03-b397-f18e9503e3fd tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:04:07.492293 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e2b88fc4-9a54-4e03-b397-f18e9503e3fd tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:04:07.498969 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e2b88fc4-9a54-4e03-b397-f18e9503e3fd tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:07.499427 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e2b88fc4-9a54-4e03-b397-f18e9503e3fd tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:07.500260 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e2b88fc4-9a54-4e03-b397-f18e9503e3fd tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:07.500708 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e2b88fc4-9a54-4e03-b397-f18e9503e3fd tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:07.528587 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e2b88fc4-9a54-4e03-b397-f18e9503e3fd tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041301 Apr 16 22:04:07.529185 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3612/7383] 10.222.0.20 () {58 vars in 1301 bytes} [Sat Apr 16 22:04:07 2022] GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 16 22:04:07.540519 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d3b02aa5-ce4b-44e7-ba6a-3492c13a9e2b tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:04:07.541950 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d3b02aa5-ce4b-44e7-ba6a-3492c13a9e2b tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:04:07.548859 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d3b02aa5-ce4b-44e7-ba6a-3492c13a9e2b tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:07.549382 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d3b02aa5-ce4b-44e7-ba6a-3492c13a9e2b tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:07.550177 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d3b02aa5-ce4b-44e7-ba6a-3492c13a9e2b tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:07.550640 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d3b02aa5-ce4b-44e7-ba6a-3492c13a9e2b tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:07.624245 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-d3b02aa5-ce4b-44e7-ba6a-3492c13a9e2b tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] HTTP exception thrown: Instance b78892c8-47d2-4188-8f72-b1d7706da588 is not attached to volume ffb015bd-e3f2-4d9c-aa8f-f42c8d48ac28 Apr 16 22:04:07.625572 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d3b02aa5-ce4b-44e7-ba6a-3492c13a9e2b tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Returning 404 to user: Instance b78892c8-47d2-4188-8f72-b1d7706da588 is not attached to volume ffb015bd-e3f2-4d9c-aa8f-f42c8d48ac28 {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 22:04:07.626396 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d3b02aa5-ce4b-44e7-ba6a-3492c13a9e2b tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588/os-volume_attachments/ffb015bd-e3f2-4d9c-aa8f-f42c8d48ac28" status: 404 len: 154 microversion: 2.1 time: 0.090495 Apr 16 22:04:07.626960 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3772/7384] 10.222.0.20 () {58 vars in 1415 bytes} [Sat Apr 16 22:04:07 2022] DELETE /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588/os-volume_attachments/ffb015bd-e3f2-4d9c-aa8f-f42c8d48ac28 => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 22:04:11.977050 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c3366973-3c68-49b3-aee4-20ba152e1989 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:04:11.977616 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c3366973-3c68-49b3-aee4-20ba152e1989 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:04:11.984310 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c3366973-3c68-49b3-aee4-20ba152e1989 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:11.984776 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c3366973-3c68-49b3-aee4-20ba152e1989 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:11.985612 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c3366973-3c68-49b3-aee4-20ba152e1989 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:11.986011 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c3366973-3c68-49b3-aee4-20ba152e1989 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:12.009811 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c3366973-3c68-49b3-aee4-20ba152e1989 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 22:04:12.255449 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c3366973-3c68-49b3-aee4-20ba152e1989 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588" status: 204 len: 0 microversion: 2.1 time: 0.281954 Apr 16 22:04:12.255967 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3613/7385] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 22:04:11 2022] DELETE /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 22:04:12.264220 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7634173d-32b5-415c-9f0d-4889f95a6cca tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:04:12.264971 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7634173d-32b5-415c-9f0d-4889f95a6cca tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:04:12.273271 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7634173d-32b5-415c-9f0d-4889f95a6cca tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:12.273744 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7634173d-32b5-415c-9f0d-4889f95a6cca tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:12.274540 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7634173d-32b5-415c-9f0d-4889f95a6cca tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:12.274999 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7634173d-32b5-415c-9f0d-4889f95a6cca tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:12.710406 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7634173d-32b5-415c-9f0d-4889f95a6cca tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c683afdee06e4958bc94e991dd18257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ed48abb644e47bbf210bbca563e3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:04:12.718036 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7634173d-32b5-415c-9f0d-4889f95a6cca tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588" status: 200 len: 1555 microversion: 2.1 time: 0.457779 Apr 16 22:04:12.718596 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3773/7386] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:04:12 2022] GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588 => generated 1555 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:04:13.735861 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ed491661-a3aa-4b3b-a39e-8d51bf1e583f tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:04:13.736602 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ed491661-a3aa-4b3b-a39e-8d51bf1e583f tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:04:13.743331 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ed491661-a3aa-4b3b-a39e-8d51bf1e583f tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:13.743801 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ed491661-a3aa-4b3b-a39e-8d51bf1e583f tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:13.744632 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ed491661-a3aa-4b3b-a39e-8d51bf1e583f tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:13.745087 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ed491661-a3aa-4b3b-a39e-8d51bf1e583f tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:13.883377 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ed491661-a3aa-4b3b-a39e-8d51bf1e583f tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c683afdee06e4958bc94e991dd18257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ed48abb644e47bbf210bbca563e3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:04:13.890960 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ed491661-a3aa-4b3b-a39e-8d51bf1e583f tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588" status: 200 len: 1555 microversion: 2.1 time: 0.159419 Apr 16 22:04:13.892550 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3614/7387] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:04:13 2022] GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588 => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:04:14.463396 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-9e975018-5143-4566-a2e1-0c537b4d97b9 req-a0dfafc7-7a3e-4fad-8aaa-6d9d24c10ac0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b78892c8-47d2-4188-8f72-b1d7706da588", "name": "network-vif-deleted", "tag": "47c536eb-eff2-43dc-8674-c8ec3ad75665"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:04:14.472757 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-9e975018-5143-4566-a2e1-0c537b4d97b9 req-a0dfafc7-7a3e-4fad-8aaa-6d9d24c10ac0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:14.473223 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-9e975018-5143-4566-a2e1-0c537b4d97b9 req-a0dfafc7-7a3e-4fad-8aaa-6d9d24c10ac0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:14.484046 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-9e975018-5143-4566-a2e1-0c537b4d97b9 req-a0dfafc7-7a3e-4fad-8aaa-6d9d24c10ac0 service nova] Creating event network-vif-deleted:47c536eb-eff2-43dc-8674-c8ec3ad75665 for instance b78892c8-47d2-4188-8f72-b1d7706da588 on nch1-master-1 Apr 16 22:04:14.489776 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-9e975018-5143-4566-a2e1-0c537b4d97b9 req-a0dfafc7-7a3e-4fad-8aaa-6d9d24c10ac0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098320 Apr 16 22:04:14.490350 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3774/7388] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:04:14.909267 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ff51b7a3-46c3-4e97-a4ab-84bfacace045 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:04:14.909802 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ff51b7a3-46c3-4e97-a4ab-84bfacace045 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:04:14.916661 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ff51b7a3-46c3-4e97-a4ab-84bfacace045 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:14.917110 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ff51b7a3-46c3-4e97-a4ab-84bfacace045 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:14.917891 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ff51b7a3-46c3-4e97-a4ab-84bfacace045 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:14.918342 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ff51b7a3-46c3-4e97-a4ab-84bfacace045 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:14.947219 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ff51b7a3-46c3-4e97-a4ab-84bfacace045 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:14.947683 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ff51b7a3-46c3-4e97-a4ab-84bfacace045 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:14.948139 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-ff51b7a3-46c3-4e97-a4ab-84bfacace045 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lazy-loading 'fault' on Instance uuid b78892c8-47d2-4188-8f72-b1d7706da588 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 22:04:14.990193 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ff51b7a3-46c3-4e97-a4ab-84bfacace045 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c683afdee06e4958bc94e991dd18257b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151ed48abb644e47bbf210bbca563e3b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:04:14.997865 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ff51b7a3-46c3-4e97-a4ab-84bfacace045 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588" status: 200 len: 1348 microversion: 2.1 time: 0.093348 Apr 16 22:04:14.998447 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3615/7389] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:04:14 2022] GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588 => generated 1348 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:04:16.016912 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b826b22e-4476-444f-84bf-358b007bfc90 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:04:16.017555 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b826b22e-4476-444f-84bf-358b007bfc90 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] [instance: b78892c8-47d2-4188-8f72-b1d7706da588] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:04:16.024547 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b826b22e-4476-444f-84bf-358b007bfc90 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:16.025018 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b826b22e-4476-444f-84bf-358b007bfc90 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:16.025810 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b826b22e-4476-444f-84bf-358b007bfc90 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:16.026266 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b826b22e-4476-444f-84bf-358b007bfc90 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:16.039845 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-b826b22e-4476-444f-84bf-358b007bfc90 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] HTTP exception thrown: Instance b78892c8-47d2-4188-8f72-b1d7706da588 could not be found. Apr 16 22:04:16.040483 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b826b22e-4476-444f-84bf-358b007bfc90 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Returning 404 to user: Instance b78892c8-47d2-4188-8f72-b1d7706da588 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 22:04:16.041312 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b826b22e-4476-444f-84bf-358b007bfc90 tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588" status: 404 len: 111 microversion: 2.1 time: 0.028841 Apr 16 22:04:16.041844 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3775/7390] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:04:16 2022] GET /compute/v2.1/servers/b78892c8-47d2-4188-8f72-b1d7706da588 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 22:04:16.050572 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-96dec914-0624-4005-8f35-1bfb89ae993c tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] Calling method '.version_select at 0x7fbb96227700>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:04:16.130754 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-96dec914-0624-4005-8f35-1bfb89ae993c tempest-TestMinimumBasicScenario-191090217 tempest-TestMinimumBasicScenario-191090217-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1695325830" status: 202 len: 0 microversion: 2.1 time: 0.084459 Apr 16 22:04:16.131260 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3616/7391] 10.222.0.20 () {58 vars in 1271 bytes} [Sat Apr 16 22:04:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1695325830 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 22:04:27.617448 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-84e9e9bd-51b2-4dcc-a01b-d3a90f0e1f20 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Action: 'create', calling method: .version_select at 0x7fbb9ff4aca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1083500429"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:04:27.631759 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-84e9e9bd-51b2-4dcc-a01b-d3a90f0e1f20 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Getting quotas for project 3d4eaa0fe99e42488e0720b18be48ac8. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 22:04:27.636841 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-84e9e9bd-51b2-4dcc-a01b-d3a90f0e1f20 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Getting quotas for user 8fa5c4f477214df880fc12d6da76283a and project 3d4eaa0fe99e42488e0720b18be48ac8. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 22:04:27.836807 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-84e9e9bd-51b2-4dcc-a01b-d3a90f0e1f20 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Getting quotas for project 3d4eaa0fe99e42488e0720b18be48ac8. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 22:04:27.842085 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-84e9e9bd-51b2-4dcc-a01b-d3a90f0e1f20 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Getting quotas for user 8fa5c4f477214df880fc12d6da76283a and project 3d4eaa0fe99e42488e0720b18be48ac8. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 22:04:27.857682 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-84e9e9bd-51b2-4dcc-a01b-d3a90f0e1f20 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2326 microversion: 2.1 time: 0.399528 Apr 16 22:04:27.858215 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3776/7392] 10.222.0.20 () {60 vars in 1157 bytes} [Sat Apr 16 22:04:27 2022] POST /compute/v2.1/os-keypairs => generated 2326 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:04:36.622412 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-29650e15-c78e-4775-83a1-5c09ecd6fbde tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-185020649", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "76426488-85a0-4d52-bad7-f2d45e3f9151"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1083500429", "security_groups": [{"name": "tempest-secgroup-smoke-1164211353"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:04:36.734229 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-29650e15-c78e-4775-83a1-5c09ecd6fbde tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] validate_networks() for [('76426488-85a0-4d52-bad7-f2d45e3f9151', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 22:04:37.158469 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-29650e15-c78e-4775-83a1-5c09ecd6fbde tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 22:04:37.158902 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-29650e15-c78e-4775-83a1-5c09ecd6fbde tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 22:04:37.159406 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-29650e15-c78e-4775-83a1-5c09ecd6fbde tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 22:04:37.159823 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-29650e15-c78e-4775-83a1-5c09ecd6fbde tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 22:04:37.160273 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-29650e15-c78e-4775-83a1-5c09ecd6fbde tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 22:04:37.168994 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-29650e15-c78e-4775-83a1-5c09ecd6fbde tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:37.169484 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-29650e15-c78e-4775-83a1-5c09ecd6fbde tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:37.173996 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-29650e15-c78e-4775-83a1-5c09ecd6fbde tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:37.173996 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-29650e15-c78e-4775-83a1-5c09ecd6fbde tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:37.187778 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-29650e15-c78e-4775-83a1-5c09ecd6fbde tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Getting quotas for project 3d4eaa0fe99e42488e0720b18be48ac8. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 22:04:37.193076 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-29650e15-c78e-4775-83a1-5c09ecd6fbde tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Getting quotas for user 8fa5c4f477214df880fc12d6da76283a and project 3d4eaa0fe99e42488e0720b18be48ac8. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 22:04:37.206584 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-29650e15-c78e-4775-83a1-5c09ecd6fbde tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 22:04:37.208943 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-29650e15-c78e-4775-83a1-5c09ecd6fbde tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 217813e0-4c22-4d44-9514-9a536d7e8721] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 22:04:37.310770 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-29650e15-c78e-4775-83a1-5c09ecd6fbde tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.692736 Apr 16 22:04:37.311436 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3617/7393] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 22:04:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 695 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 22:04:37.322454 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7121891c-0010-4206-baf2-d0bd772b72a8 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:04:37.323085 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7121891c-0010-4206-baf2-d0bd772b72a8 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 217813e0-4c22-4d44-9514-9a536d7e8721] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:04:37.378948 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7121891c-0010-4206-baf2-d0bd772b72a8 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:04:37.386488 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7121891c-0010-4206-baf2-d0bd772b72a8 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721" status: 200 len: 1266 microversion: 2.1 time: 0.068825 Apr 16 22:04:37.387427 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3777/7394] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:04:37 2022] GET /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721 => generated 1266 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 22:04:38.406451 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e78265de-c64e-4cd7-9bc3-3ef2e01f48ac tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:04:38.407603 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e78265de-c64e-4cd7-9bc3-3ef2e01f48ac tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 217813e0-4c22-4d44-9514-9a536d7e8721] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:04:38.478701 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e78265de-c64e-4cd7-9bc3-3ef2e01f48ac tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:04:38.494566 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e78265de-c64e-4cd7-9bc3-3ef2e01f48ac tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721" status: 200 len: 1266 microversion: 2.1 time: 0.093091 Apr 16 22:04:38.495254 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3618/7395] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:04:38 2022] GET /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721 => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:04:39.571957 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-46bb5ad9-8114-4179-b109-11cf9a12a286 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:04:39.571957 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-46bb5ad9-8114-4179-b109-11cf9a12a286 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 217813e0-4c22-4d44-9514-9a536d7e8721] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:04:39.571957 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-46bb5ad9-8114-4179-b109-11cf9a12a286 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:39.571957 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-46bb5ad9-8114-4179-b109-11cf9a12a286 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:39.571957 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-46bb5ad9-8114-4179-b109-11cf9a12a286 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:39.571957 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-46bb5ad9-8114-4179-b109-11cf9a12a286 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:39.607944 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-46bb5ad9-8114-4179-b109-11cf9a12a286 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:04:39.616115 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-46bb5ad9-8114-4179-b109-11cf9a12a286 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721" status: 200 len: 1326 microversion: 2.1 time: 0.108520 Apr 16 22:04:39.616726 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3778/7396] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:04:39 2022] GET /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721 => generated 1326 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:04:40.634662 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-19465ca3-4b5a-4f0e-ab32-1b506ebac713 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:04:40.635279 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-19465ca3-4b5a-4f0e-ab32-1b506ebac713 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 217813e0-4c22-4d44-9514-9a536d7e8721] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:04:40.642843 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-19465ca3-4b5a-4f0e-ab32-1b506ebac713 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:40.643300 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-19465ca3-4b5a-4f0e-ab32-1b506ebac713 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:40.644087 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-19465ca3-4b5a-4f0e-ab32-1b506ebac713 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:40.644582 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-19465ca3-4b5a-4f0e-ab32-1b506ebac713 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:40.804910 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-19465ca3-4b5a-4f0e-ab32-1b506ebac713 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:04:40.812404 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-19465ca3-4b5a-4f0e-ab32-1b506ebac713 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721" status: 200 len: 1392 microversion: 2.1 time: 0.181692 Apr 16 22:04:40.813544 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3619/7397] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:04:40 2022] GET /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721 => generated 1392 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:04:41.144347 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-62541647-39b7-4a01-938b-4b3ee793eb57 req-74543de6-bab2-470d-aa6c-dfbcd385a5e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "217813e0-4c22-4d44-9514-9a536d7e8721", "tag": "35244e48-8fc9-4c61-8edb-41ace990dafb"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:04:41.160009 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-62541647-39b7-4a01-938b-4b3ee793eb57 req-74543de6-bab2-470d-aa6c-dfbcd385a5e5 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:41.160709 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-62541647-39b7-4a01-938b-4b3ee793eb57 req-74543de6-bab2-470d-aa6c-dfbcd385a5e5 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:41.173004 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-62541647-39b7-4a01-938b-4b3ee793eb57 req-74543de6-bab2-470d-aa6c-dfbcd385a5e5 service nova] Creating event network-changed:35244e48-8fc9-4c61-8edb-41ace990dafb for instance 217813e0-4c22-4d44-9514-9a536d7e8721 on nch1-master-1 Apr 16 22:04:41.178589 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-62541647-39b7-4a01-938b-4b3ee793eb57 req-74543de6-bab2-470d-aa6c-dfbcd385a5e5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040094 Apr 16 22:04:41.179213 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3779/7398] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:04:41.830725 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2d2c2a16-b202-4170-90e4-f5fa8c1be099 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:04:41.831515 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2d2c2a16-b202-4170-90e4-f5fa8c1be099 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 217813e0-4c22-4d44-9514-9a536d7e8721] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:04:41.838337 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2d2c2a16-b202-4170-90e4-f5fa8c1be099 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:41.838806 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2d2c2a16-b202-4170-90e4-f5fa8c1be099 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:41.839862 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2d2c2a16-b202-4170-90e4-f5fa8c1be099 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:41.840352 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2d2c2a16-b202-4170-90e4-f5fa8c1be099 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:41.976108 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2d2c2a16-b202-4170-90e4-f5fa8c1be099 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:04:41.983470 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2d2c2a16-b202-4170-90e4-f5fa8c1be099 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721" status: 200 len: 1392 microversion: 2.1 time: 0.157321 Apr 16 22:04:41.984048 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3620/7399] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:04:41 2022] GET /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:04:43.002099 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-084d3f2b-8ac4-4304-8199-e695d5e833ef tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:04:43.002731 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-084d3f2b-8ac4-4304-8199-e695d5e833ef tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 217813e0-4c22-4d44-9514-9a536d7e8721] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:04:43.009037 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-084d3f2b-8ac4-4304-8199-e695d5e833ef tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:43.009511 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-084d3f2b-8ac4-4304-8199-e695d5e833ef tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:43.010291 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-084d3f2b-8ac4-4304-8199-e695d5e833ef tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:43.011050 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-084d3f2b-8ac4-4304-8199-e695d5e833ef tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:43.148376 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-084d3f2b-8ac4-4304-8199-e695d5e833ef tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:04:43.155971 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-084d3f2b-8ac4-4304-8199-e695d5e833ef tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721" status: 200 len: 1392 microversion: 2.1 time: 0.159050 Apr 16 22:04:43.157200 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3780/7400] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:04:42 2022] GET /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:04:44.173835 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2410bdd7-916a-43e8-a868-d66da5baff8b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:04:44.174551 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2410bdd7-916a-43e8-a868-d66da5baff8b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 217813e0-4c22-4d44-9514-9a536d7e8721] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:04:44.182041 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2410bdd7-916a-43e8-a868-d66da5baff8b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:44.182524 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2410bdd7-916a-43e8-a868-d66da5baff8b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:44.183347 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2410bdd7-916a-43e8-a868-d66da5baff8b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:44.183794 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2410bdd7-916a-43e8-a868-d66da5baff8b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:44.320017 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2410bdd7-916a-43e8-a868-d66da5baff8b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:04:44.327454 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2410bdd7-916a-43e8-a868-d66da5baff8b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721" status: 200 len: 1392 microversion: 2.1 time: 0.158602 Apr 16 22:04:44.328359 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3621/7401] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:04:44 2022] GET /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:04:45.344831 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8b5dfba9-3e2b-460c-9e87-e7b715a54d6d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:04:45.345463 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8b5dfba9-3e2b-460c-9e87-e7b715a54d6d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 217813e0-4c22-4d44-9514-9a536d7e8721] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:04:45.352305 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8b5dfba9-3e2b-460c-9e87-e7b715a54d6d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:45.352780 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8b5dfba9-3e2b-460c-9e87-e7b715a54d6d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:45.353565 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8b5dfba9-3e2b-460c-9e87-e7b715a54d6d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:45.354020 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8b5dfba9-3e2b-460c-9e87-e7b715a54d6d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:45.484801 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8b5dfba9-3e2b-460c-9e87-e7b715a54d6d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:04:45.492438 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8b5dfba9-3e2b-460c-9e87-e7b715a54d6d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721" status: 200 len: 1392 microversion: 2.1 time: 0.151546 Apr 16 22:04:45.493002 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3781/7402] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:04:45 2022] GET /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721 => generated 1392 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:04:46.056730 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-fba9a59f-dbdc-4ceb-8ac5-f556d74ed591 req-74cae090-7151-4b90-82c6-31f2d245f5ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "217813e0-4c22-4d44-9514-9a536d7e8721", "name": "network-vif-plugged", "status": "completed", "tag": "35244e48-8fc9-4c61-8edb-41ace990dafb"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:04:46.066281 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-fba9a59f-dbdc-4ceb-8ac5-f556d74ed591 req-74cae090-7151-4b90-82c6-31f2d245f5ce service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:46.066745 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-fba9a59f-dbdc-4ceb-8ac5-f556d74ed591 req-74cae090-7151-4b90-82c6-31f2d245f5ce service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:46.077558 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-fba9a59f-dbdc-4ceb-8ac5-f556d74ed591 req-74cae090-7151-4b90-82c6-31f2d245f5ce service nova] Creating event network-vif-plugged:35244e48-8fc9-4c61-8edb-41ace990dafb for instance 217813e0-4c22-4d44-9514-9a536d7e8721 on nch1-master-1 Apr 16 22:04:46.083269 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-fba9a59f-dbdc-4ceb-8ac5-f556d74ed591 req-74cae090-7151-4b90-82c6-31f2d245f5ce service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030347 Apr 16 22:04:46.083857 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3622/7403] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:04:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 22:04:46.508487 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2e521317-361e-4484-95a9-3d174c1eca81 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:04:46.509048 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2e521317-361e-4484-95a9-3d174c1eca81 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 217813e0-4c22-4d44-9514-9a536d7e8721] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:04:46.515849 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2e521317-361e-4484-95a9-3d174c1eca81 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:46.516362 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2e521317-361e-4484-95a9-3d174c1eca81 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:46.517151 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2e521317-361e-4484-95a9-3d174c1eca81 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:46.517606 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2e521317-361e-4484-95a9-3d174c1eca81 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:46.648558 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2e521317-361e-4484-95a9-3d174c1eca81 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:04:46.655965 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2e521317-361e-4484-95a9-3d174c1eca81 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721" status: 200 len: 1392 microversion: 2.1 time: 0.151454 Apr 16 22:04:46.657102 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3782/7404] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:04:46 2022] GET /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721 => generated 1392 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:04:47.674911 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4fbe412d-0153-48e6-b2f5-b142cebf692e tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:04:47.675674 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4fbe412d-0153-48e6-b2f5-b142cebf692e tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 217813e0-4c22-4d44-9514-9a536d7e8721] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:04:47.681923 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4fbe412d-0153-48e6-b2f5-b142cebf692e tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:47.682431 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4fbe412d-0153-48e6-b2f5-b142cebf692e tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:47.683177 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4fbe412d-0153-48e6-b2f5-b142cebf692e tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:47.683629 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4fbe412d-0153-48e6-b2f5-b142cebf692e tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:47.816065 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4fbe412d-0153-48e6-b2f5-b142cebf692e tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:04:47.823471 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4fbe412d-0153-48e6-b2f5-b142cebf692e tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721" status: 200 len: 1563 microversion: 2.1 time: 0.153877 Apr 16 22:04:47.824043 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3623/7405] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:04:47 2022] GET /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721 => generated 1563 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:04:47.840311 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2d71bdf1-4c52-4072-b2a9-16dae1f89dd6 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:04:47.840959 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2d71bdf1-4c52-4072-b2a9-16dae1f89dd6 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 217813e0-4c22-4d44-9514-9a536d7e8721] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:04:47.848335 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2d71bdf1-4c52-4072-b2a9-16dae1f89dd6 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:47.848817 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2d71bdf1-4c52-4072-b2a9-16dae1f89dd6 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:47.849614 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2d71bdf1-4c52-4072-b2a9-16dae1f89dd6 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:47.850081 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2d71bdf1-4c52-4072-b2a9-16dae1f89dd6 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:47.977653 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2d71bdf1-4c52-4072-b2a9-16dae1f89dd6 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:04:47.985120 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2d71bdf1-4c52-4072-b2a9-16dae1f89dd6 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721" status: 200 len: 1563 microversion: 2.1 time: 0.149009 Apr 16 22:04:47.985691 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3783/7406] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:04:47 2022] GET /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721 => generated 1563 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:04:49.901040 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3b0eb6d4-d090-48b0-9bdb-faad38b7bc4b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:04:49.901665 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3b0eb6d4-d090-48b0-9bdb-faad38b7bc4b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 217813e0-4c22-4d44-9514-9a536d7e8721] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:04:49.909509 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3b0eb6d4-d090-48b0-9bdb-faad38b7bc4b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:49.910289 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3b0eb6d4-d090-48b0-9bdb-faad38b7bc4b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:49.910688 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-fa5f707a-8431-4ae5-abf7-837751339d27 req-8d378a8e-7fc6-487e-a015-bb0f8a1726b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "217813e0-4c22-4d44-9514-9a536d7e8721", "tag": "35244e48-8fc9-4c61-8edb-41ace990dafb"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:04:49.914637 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3b0eb6d4-d090-48b0-9bdb-faad38b7bc4b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:49.914637 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3b0eb6d4-d090-48b0-9bdb-faad38b7bc4b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:49.919505 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-fa5f707a-8431-4ae5-abf7-837751339d27 req-8d378a8e-7fc6-487e-a015-bb0f8a1726b3 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:04:49.920110 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-fa5f707a-8431-4ae5-abf7-837751339d27 req-8d378a8e-7fc6-487e-a015-bb0f8a1726b3 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:04:49.931562 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-fa5f707a-8431-4ae5-abf7-837751339d27 req-8d378a8e-7fc6-487e-a015-bb0f8a1726b3 service nova] Creating event network-changed:35244e48-8fc9-4c61-8edb-41ace990dafb for instance 217813e0-4c22-4d44-9514-9a536d7e8721 on nch1-master-1 Apr 16 22:04:49.938932 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-fa5f707a-8431-4ae5-abf7-837751339d27 req-8d378a8e-7fc6-487e-a015-bb0f8a1726b3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032489 Apr 16 22:04:49.939534 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3784/7407] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:04:50.131691 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3b0eb6d4-d090-48b0-9bdb-faad38b7bc4b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:04:50.139599 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3b0eb6d4-d090-48b0-9bdb-faad38b7bc4b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721" status: 200 len: 1563 microversion: 2.1 time: 0.242661 Apr 16 22:04:50.144468 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3624/7408] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:04:49 2022] GET /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721 => generated 1563 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:05:13.439594 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1cff0d43-9358-43c2-a069-2d4dc6659a36 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:05:13.441142 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1cff0d43-9358-43c2-a069-2d4dc6659a36 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 217813e0-4c22-4d44-9514-9a536d7e8721] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:05:13.447794 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1cff0d43-9358-43c2-a069-2d4dc6659a36 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:13.448316 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1cff0d43-9358-43c2-a069-2d4dc6659a36 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:13.449117 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1cff0d43-9358-43c2-a069-2d4dc6659a36 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:13.449579 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1cff0d43-9358-43c2-a069-2d4dc6659a36 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:13.497650 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1cff0d43-9358-43c2-a069-2d4dc6659a36 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "POST /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721/action" status: 200 len: 24571 microversion: 2.1 time: 0.063387 Apr 16 22:05:13.498286 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3785/7409] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 22:05:13 2022] POST /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721/action => generated 24571 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 22:05:19.862514 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d3121de8-1e1d-47cc-9521-058751328b07 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:05:19.863061 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d3121de8-1e1d-47cc-9521-058751328b07 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 217813e0-4c22-4d44-9514-9a536d7e8721] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:05:19.869191 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d3121de8-1e1d-47cc-9521-058751328b07 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:19.869739 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d3121de8-1e1d-47cc-9521-058751328b07 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:19.870529 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d3121de8-1e1d-47cc-9521-058751328b07 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:19.870989 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d3121de8-1e1d-47cc-9521-058751328b07 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:20.064313 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d3121de8-1e1d-47cc-9521-058751328b07 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "POST /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721/action" status: 202 len: 0 microversion: 2.1 time: 0.206391 Apr 16 22:05:20.065626 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3625/7410] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 22:05:19 2022] POST /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 22:05:20.074509 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-350c91cc-9da7-4a01-a681-61930c90e29c tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:05:20.075331 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-350c91cc-9da7-4a01-a681-61930c90e29c tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 217813e0-4c22-4d44-9514-9a536d7e8721] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:05:20.082602 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-350c91cc-9da7-4a01-a681-61930c90e29c tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:20.083078 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-350c91cc-9da7-4a01-a681-61930c90e29c tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:20.083881 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-350c91cc-9da7-4a01-a681-61930c90e29c tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:20.084396 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-350c91cc-9da7-4a01-a681-61930c90e29c tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:20.369237 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-350c91cc-9da7-4a01-a681-61930c90e29c tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:05:20.377532 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-350c91cc-9da7-4a01-a681-61930c90e29c tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721" status: 200 len: 1687 microversion: 2.1 time: 0.306907 Apr 16 22:05:20.378106 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3786/7411] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:05:20 2022] GET /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721 => generated 1687 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:05:21.397231 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-045417df-4c03-4072-9c6a-bc2a3bb4e15f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:05:21.397935 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-045417df-4c03-4072-9c6a-bc2a3bb4e15f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 217813e0-4c22-4d44-9514-9a536d7e8721] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:05:21.404138 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-045417df-4c03-4072-9c6a-bc2a3bb4e15f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:21.404631 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-045417df-4c03-4072-9c6a-bc2a3bb4e15f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:21.405416 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-045417df-4c03-4072-9c6a-bc2a3bb4e15f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:21.405867 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-045417df-4c03-4072-9c6a-bc2a3bb4e15f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:21.652283 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-045417df-4c03-4072-9c6a-bc2a3bb4e15f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:05:21.660275 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-045417df-4c03-4072-9c6a-bc2a3bb4e15f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721" status: 200 len: 1667 microversion: 2.1 time: 0.268949 Apr 16 22:05:21.660853 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3626/7412] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:05:21 2022] GET /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721 => generated 1667 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:05:22.764461 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8cc86c28-728c-4440-97af-d2b773fddd78 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:05:22.765436 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8cc86c28-728c-4440-97af-d2b773fddd78 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 217813e0-4c22-4d44-9514-9a536d7e8721] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:05:22.773071 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8cc86c28-728c-4440-97af-d2b773fddd78 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:22.773546 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8cc86c28-728c-4440-97af-d2b773fddd78 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:22.774334 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8cc86c28-728c-4440-97af-d2b773fddd78 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:22.774794 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8cc86c28-728c-4440-97af-d2b773fddd78 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:22.822873 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8cc86c28-728c-4440-97af-d2b773fddd78 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "POST /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721/action" status: 200 len: 32648 microversion: 2.1 time: 0.062305 Apr 16 22:05:22.823497 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3787/7413] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 22:05:22 2022] POST /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721/action => generated 32648 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 22:05:22.835112 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d7f560f3-a4f0-4c24-a6c8-3b61da40f1f9 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:05:22.835668 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d7f560f3-a4f0-4c24-a6c8-3b61da40f1f9 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 217813e0-4c22-4d44-9514-9a536d7e8721] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:05:22.842749 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d7f560f3-a4f0-4c24-a6c8-3b61da40f1f9 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:22.843213 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d7f560f3-a4f0-4c24-a6c8-3b61da40f1f9 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:22.843990 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d7f560f3-a4f0-4c24-a6c8-3b61da40f1f9 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:22.844476 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d7f560f3-a4f0-4c24-a6c8-3b61da40f1f9 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:23.058117 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d7f560f3-a4f0-4c24-a6c8-3b61da40f1f9 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "POST /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721/action" status: 202 len: 0 microversion: 2.1 time: 0.226695 Apr 16 22:05:23.058658 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3627/7414] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 22:05:22 2022] POST /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 22:05:23.067475 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4803c778-56d8-495b-ae88-1ace23bdb3b5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:05:23.068299 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4803c778-56d8-495b-ae88-1ace23bdb3b5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 217813e0-4c22-4d44-9514-9a536d7e8721] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:05:23.075904 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4803c778-56d8-495b-ae88-1ace23bdb3b5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:23.076417 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4803c778-56d8-495b-ae88-1ace23bdb3b5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:23.077231 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4803c778-56d8-495b-ae88-1ace23bdb3b5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:23.077696 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4803c778-56d8-495b-ae88-1ace23bdb3b5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:23.208732 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4803c778-56d8-495b-ae88-1ace23bdb3b5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:05:23.217161 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4803c778-56d8-495b-ae88-1ace23bdb3b5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721" status: 200 len: 1674 microversion: 2.1 time: 0.153839 Apr 16 22:05:23.217742 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3788/7415] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:05:23 2022] GET /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 22:05:24.236573 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0050912e-8b04-41cc-87f2-bfc793e57d9d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:05:24.237275 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0050912e-8b04-41cc-87f2-bfc793e57d9d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 217813e0-4c22-4d44-9514-9a536d7e8721] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:05:24.243488 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0050912e-8b04-41cc-87f2-bfc793e57d9d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:24.243986 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0050912e-8b04-41cc-87f2-bfc793e57d9d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:24.244931 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0050912e-8b04-41cc-87f2-bfc793e57d9d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:24.245379 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0050912e-8b04-41cc-87f2-bfc793e57d9d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:24.375468 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0050912e-8b04-41cc-87f2-bfc793e57d9d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:05:24.383743 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0050912e-8b04-41cc-87f2-bfc793e57d9d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721" status: 200 len: 1682 microversion: 2.1 time: 0.152529 Apr 16 22:05:24.384337 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3628/7416] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:05:24 2022] GET /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:05:24.479052 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d47ef4be-85dc-4b84-913e-fae759ca7225 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:05:24.480020 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d47ef4be-85dc-4b84-913e-fae759ca7225 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 217813e0-4c22-4d44-9514-9a536d7e8721] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:05:24.488106 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d47ef4be-85dc-4b84-913e-fae759ca7225 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:24.488588 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d47ef4be-85dc-4b84-913e-fae759ca7225 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:24.489409 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d47ef4be-85dc-4b84-913e-fae759ca7225 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:24.489874 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d47ef4be-85dc-4b84-913e-fae759ca7225 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:24.538021 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d47ef4be-85dc-4b84-913e-fae759ca7225 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "POST /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721/action" status: 200 len: 35780 microversion: 2.1 time: 0.062905 Apr 16 22:05:24.538652 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3789/7417] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 22:05:24 2022] POST /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721/action => generated 35780 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 22:05:25.976559 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3726b87f-c9f1-4f8d-bf14-f7b7c74b0cb5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:05:25.977258 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3726b87f-c9f1-4f8d-bf14-f7b7c74b0cb5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 217813e0-4c22-4d44-9514-9a536d7e8721] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:05:25.984835 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3726b87f-c9f1-4f8d-bf14-f7b7c74b0cb5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:25.985377 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3726b87f-c9f1-4f8d-bf14-f7b7c74b0cb5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:25.986521 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3726b87f-c9f1-4f8d-bf14-f7b7c74b0cb5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:25.987043 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3726b87f-c9f1-4f8d-bf14-f7b7c74b0cb5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:26.025070 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3726b87f-c9f1-4f8d-bf14-f7b7c74b0cb5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 217813e0-4c22-4d44-9514-9a536d7e8721] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 22:05:26.067055 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-56828940-688e-4e45-a8cd-e60144e01a94 req-04f3776e-d76a-4061-b7f6-25dc59ae0b08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "217813e0-4c22-4d44-9514-9a536d7e8721", "tag": "35244e48-8fc9-4c61-8edb-41ace990dafb"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:05:26.076517 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-56828940-688e-4e45-a8cd-e60144e01a94 req-04f3776e-d76a-4061-b7f6-25dc59ae0b08 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:26.077013 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-56828940-688e-4e45-a8cd-e60144e01a94 req-04f3776e-d76a-4061-b7f6-25dc59ae0b08 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:26.088597 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-56828940-688e-4e45-a8cd-e60144e01a94 req-04f3776e-d76a-4061-b7f6-25dc59ae0b08 service nova] Creating event network-changed:35244e48-8fc9-4c61-8edb-41ace990dafb for instance 217813e0-4c22-4d44-9514-9a536d7e8721 on nch1-master-1 Apr 16 22:05:26.093368 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-56828940-688e-4e45-a8cd-e60144e01a94 req-04f3776e-d76a-4061-b7f6-25dc59ae0b08 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080450 Apr 16 22:05:26.098610 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3790/7418] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:05:26.271665 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3726b87f-c9f1-4f8d-bf14-f7b7c74b0cb5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "DELETE /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721" status: 204 len: 0 microversion: 2.1 time: 0.299114 Apr 16 22:05:26.272609 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3629/7419] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 22:05:25 2022] DELETE /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 22:05:26.281550 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-804447a3-5f90-4ee3-a807-c03c8de6801a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:05:26.282271 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-804447a3-5f90-4ee3-a807-c03c8de6801a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 217813e0-4c22-4d44-9514-9a536d7e8721] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:05:26.290218 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-804447a3-5f90-4ee3-a807-c03c8de6801a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:26.290706 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-804447a3-5f90-4ee3-a807-c03c8de6801a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:26.291499 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-804447a3-5f90-4ee3-a807-c03c8de6801a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:26.291961 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-804447a3-5f90-4ee3-a807-c03c8de6801a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:26.439137 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-804447a3-5f90-4ee3-a807-c03c8de6801a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:05:26.447650 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-804447a3-5f90-4ee3-a807-c03c8de6801a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721" status: 200 len: 1688 microversion: 2.1 time: 0.170563 Apr 16 22:05:26.448439 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3791/7420] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:05:26 2022] GET /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721 => generated 1688 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:05:27.467019 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2a1af069-e4ca-43c9-b076-84a9a85c78d8 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:05:27.467770 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2a1af069-e4ca-43c9-b076-84a9a85c78d8 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 217813e0-4c22-4d44-9514-9a536d7e8721] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:05:27.475264 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2a1af069-e4ca-43c9-b076-84a9a85c78d8 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:27.475807 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2a1af069-e4ca-43c9-b076-84a9a85c78d8 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:27.476633 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2a1af069-e4ca-43c9-b076-84a9a85c78d8 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:27.477114 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2a1af069-e4ca-43c9-b076-84a9a85c78d8 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:27.669417 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2a1af069-e4ca-43c9-b076-84a9a85c78d8 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:05:27.681941 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2a1af069-e4ca-43c9-b076-84a9a85c78d8 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721" status: 200 len: 1688 microversion: 2.1 time: 0.219631 Apr 16 22:05:27.682536 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3630/7421] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:05:27 2022] GET /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721 => generated 1688 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:05:27.800198 ncdv-master-1 devstack@n-api.service[137408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:05:27.800713 ncdv-master-1 devstack@n-api.service[137408]: Sat Apr 16 22:05:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 22:05:28.360279 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-4871551e-9d8f-4074-82de-797ca8a5170c req-45afd42d-cf02-4cde-ba58-a8f9e9114811 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "217813e0-4c22-4d44-9514-9a536d7e8721", "name": "network-vif-deleted", "tag": "35244e48-8fc9-4c61-8edb-41ace990dafb"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:05:28.368739 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-4871551e-9d8f-4074-82de-797ca8a5170c req-45afd42d-cf02-4cde-ba58-a8f9e9114811 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:28.372659 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-4871551e-9d8f-4074-82de-797ca8a5170c req-45afd42d-cf02-4cde-ba58-a8f9e9114811 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:28.380011 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-4871551e-9d8f-4074-82de-797ca8a5170c req-45afd42d-cf02-4cde-ba58-a8f9e9114811 service nova] Creating event network-vif-deleted:35244e48-8fc9-4c61-8edb-41ace990dafb for instance 217813e0-4c22-4d44-9514-9a536d7e8721 on nch1-master-1 Apr 16 22:05:28.384876 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-4871551e-9d8f-4074-82de-797ca8a5170c req-45afd42d-cf02-4cde-ba58-a8f9e9114811 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028488 Apr 16 22:05:28.385459 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3792/7422] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:05:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:05:28.699061 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ec7656a5-1ec4-4f41-98bc-b3d03828b604 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:05:28.699859 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ec7656a5-1ec4-4f41-98bc-b3d03828b604 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 217813e0-4c22-4d44-9514-9a536d7e8721] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:05:28.708196 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ec7656a5-1ec4-4f41-98bc-b3d03828b604 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:28.708646 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ec7656a5-1ec4-4f41-98bc-b3d03828b604 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:28.709455 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ec7656a5-1ec4-4f41-98bc-b3d03828b604 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:28.709908 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ec7656a5-1ec4-4f41-98bc-b3d03828b604 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:28.745218 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ec7656a5-1ec4-4f41-98bc-b3d03828b604 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:28.745682 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ec7656a5-1ec4-4f41-98bc-b3d03828b604 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:28.746153 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-ec7656a5-1ec4-4f41-98bc-b3d03828b604 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lazy-loading 'fault' on Instance uuid 217813e0-4c22-4d44-9514-9a536d7e8721 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 22:05:28.788874 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ec7656a5-1ec4-4f41-98bc-b3d03828b604 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:05:28.796436 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ec7656a5-1ec4-4f41-98bc-b3d03828b604 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721" status: 200 len: 1356 microversion: 2.1 time: 0.101349 Apr 16 22:05:28.797020 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3631/7423] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:05:28 2022] GET /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721 => generated 1356 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:05:29.816327 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-eb8a59cc-4c85-470f-af5d-5ab2ee11b942 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:05:29.817053 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-eb8a59cc-4c85-470f-af5d-5ab2ee11b942 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 217813e0-4c22-4d44-9514-9a536d7e8721] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:05:29.823330 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eb8a59cc-4c85-470f-af5d-5ab2ee11b942 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:29.823809 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eb8a59cc-4c85-470f-af5d-5ab2ee11b942 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:29.824642 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eb8a59cc-4c85-470f-af5d-5ab2ee11b942 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:29.825106 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-eb8a59cc-4c85-470f-af5d-5ab2ee11b942 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:29.838058 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-eb8a59cc-4c85-470f-af5d-5ab2ee11b942 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] HTTP exception thrown: Instance 217813e0-4c22-4d44-9514-9a536d7e8721 could not be found. Apr 16 22:05:29.838916 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-eb8a59cc-4c85-470f-af5d-5ab2ee11b942 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Returning 404 to user: Instance 217813e0-4c22-4d44-9514-9a536d7e8721 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 22:05:29.839753 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-eb8a59cc-4c85-470f-af5d-5ab2ee11b942 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721" status: 404 len: 111 microversion: 2.1 time: 0.029261 Apr 16 22:05:29.840293 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3793/7424] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:05:29 2022] GET /compute/v2.1/servers/217813e0-4c22-4d44-9514-9a536d7e8721 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 22:05:33.544818 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e5098d06-ca85-494b-97dc-bf2cf1ebfe1d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '.version_select at 0x7fbb96254af0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:05:33.598829 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e5098d06-ca85-494b-97dc-bf2cf1ebfe1d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1083500429" status: 202 len: 0 microversion: 2.1 time: 0.057872 Apr 16 22:05:33.599515 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3632/7425] 10.222.0.20 () {58 vars in 1283 bytes} [Sat Apr 16 22:05:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1083500429 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 22:05:33.624901 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4b39acde-36d7-4657-8d37-a1b6866f11b8 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Action: 'create', calling method: .version_select at 0x7fbb9c0cae50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-130884887"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:05:33.643442 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-4b39acde-36d7-4657-8d37-a1b6866f11b8 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Getting quotas for project 3d4eaa0fe99e42488e0720b18be48ac8. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 22:05:33.648603 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-4b39acde-36d7-4657-8d37-a1b6866f11b8 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Getting quotas for user 8fa5c4f477214df880fc12d6da76283a and project 3d4eaa0fe99e42488e0720b18be48ac8. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 22:05:34.070335 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-4b39acde-36d7-4657-8d37-a1b6866f11b8 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Getting quotas for project 3d4eaa0fe99e42488e0720b18be48ac8. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 22:05:34.075377 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-4b39acde-36d7-4657-8d37-a1b6866f11b8 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Getting quotas for user 8fa5c4f477214df880fc12d6da76283a and project 3d4eaa0fe99e42488e0720b18be48ac8. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 22:05:34.090176 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4b39acde-36d7-4657-8d37-a1b6866f11b8 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.469354 Apr 16 22:05:34.090779 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3794/7426] 10.222.0.20 () {60 vars in 1157 bytes} [Sat Apr 16 22:05:33 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:05:41.903591 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f29a517c-e5c8-419b-a6bb-50fa39234ccd tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-528558154", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "0199f7ec-ea1b-4af9-98a9-47eea4cf5c10"}], "key_name": "tempest-TestNetworkAdvancedServerOps-130884887", "security_groups": [{"name": "tempest-secgroup-smoke-102573401"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:05:42.033617 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-f29a517c-e5c8-419b-a6bb-50fa39234ccd tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] validate_networks() for [('0199f7ec-ea1b-4af9-98a9-47eea4cf5c10', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 22:05:42.499906 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-f29a517c-e5c8-419b-a6bb-50fa39234ccd tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 22:05:42.500367 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-f29a517c-e5c8-419b-a6bb-50fa39234ccd tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 22:05:42.501076 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-f29a517c-e5c8-419b-a6bb-50fa39234ccd tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 22:05:42.501735 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-f29a517c-e5c8-419b-a6bb-50fa39234ccd tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 22:05:42.502389 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-f29a517c-e5c8-419b-a6bb-50fa39234ccd tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 22:05:42.511721 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f29a517c-e5c8-419b-a6bb-50fa39234ccd tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:42.512517 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f29a517c-e5c8-419b-a6bb-50fa39234ccd tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:42.513335 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f29a517c-e5c8-419b-a6bb-50fa39234ccd tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:42.513982 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f29a517c-e5c8-419b-a6bb-50fa39234ccd tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:42.533373 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-f29a517c-e5c8-419b-a6bb-50fa39234ccd tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Getting quotas for project 3d4eaa0fe99e42488e0720b18be48ac8. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 22:05:42.539042 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-f29a517c-e5c8-419b-a6bb-50fa39234ccd tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Getting quotas for user 8fa5c4f477214df880fc12d6da76283a and project 3d4eaa0fe99e42488e0720b18be48ac8. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 22:05:42.551702 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f29a517c-e5c8-419b-a6bb-50fa39234ccd tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 22:05:42.554032 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f29a517c-e5c8-419b-a6bb-50fa39234ccd tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 803e81db-6a0f-4940-b0ca-d214be3d3bbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 22:05:42.691815 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f29a517c-e5c8-419b-a6bb-50fa39234ccd tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.792223 Apr 16 22:05:42.692689 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3633/7427] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 22:05:41 2022] POST /compute/v2.1/servers => generated 405 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 22:05:42.703391 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8f151b99-c664-4cae-a091-9f518c82bf4c tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:05:42.704026 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8f151b99-c664-4cae-a091-9f518c82bf4c tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 803e81db-6a0f-4940-b0ca-d214be3d3bbb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:05:42.763178 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8f151b99-c664-4cae-a091-9f518c82bf4c tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:05:42.774528 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8f151b99-c664-4cae-a091-9f518c82bf4c tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb" status: 200 len: 1265 microversion: 2.1 time: 0.072052 Apr 16 22:05:42.774528 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3795/7428] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:05:42 2022] GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb => generated 1265 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:05:43.792199 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-482ee525-ede4-4d80-8be6-ecd941058709 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:05:43.793442 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-482ee525-ede4-4d80-8be6-ecd941058709 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 803e81db-6a0f-4940-b0ca-d214be3d3bbb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:05:43.804403 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-482ee525-ede4-4d80-8be6-ecd941058709 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:43.806137 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-482ee525-ede4-4d80-8be6-ecd941058709 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:43.807360 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-482ee525-ede4-4d80-8be6-ecd941058709 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:43.808020 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-482ee525-ede4-4d80-8be6-ecd941058709 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:43.878772 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-482ee525-ede4-4d80-8be6-ecd941058709 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:05:43.887074 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-482ee525-ede4-4d80-8be6-ecd941058709 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb" status: 200 len: 1261 microversion: 2.1 time: 0.102815 Apr 16 22:05:43.888030 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3634/7429] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:05:43 2022] GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb => generated 1261 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:05:44.904946 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-27d6351b-e83e-4345-9ea7-b21d8cd2166e tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:05:44.905577 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-27d6351b-e83e-4345-9ea7-b21d8cd2166e tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 803e81db-6a0f-4940-b0ca-d214be3d3bbb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:05:44.914331 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-27d6351b-e83e-4345-9ea7-b21d8cd2166e tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:44.914814 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-27d6351b-e83e-4345-9ea7-b21d8cd2166e tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:44.915625 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-27d6351b-e83e-4345-9ea7-b21d8cd2166e tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:44.916086 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-27d6351b-e83e-4345-9ea7-b21d8cd2166e tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:44.986113 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-27d6351b-e83e-4345-9ea7-b21d8cd2166e tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:05:44.993543 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-27d6351b-e83e-4345-9ea7-b21d8cd2166e tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb" status: 200 len: 1323 microversion: 2.1 time: 0.092534 Apr 16 22:05:44.994120 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3796/7430] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:05:44 2022] GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb => generated 1323 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:05:45.982180 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-f9129ba2-278f-4d6e-a724-b309462f6635 req-ca844b55-b6ae-4794-89b5-101596d64049 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "803e81db-6a0f-4940-b0ca-d214be3d3bbb", "tag": "f32b9325-3ac6-4a4e-944c-38ee7b1da17a"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:05:45.992754 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-f9129ba2-278f-4d6e-a724-b309462f6635 req-ca844b55-b6ae-4794-89b5-101596d64049 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:45.999580 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-f9129ba2-278f-4d6e-a724-b309462f6635 req-ca844b55-b6ae-4794-89b5-101596d64049 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:46.010828 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-08439f19-60ef-440f-aad7-8a91151c408f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:05:46.011510 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-08439f19-60ef-440f-aad7-8a91151c408f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 803e81db-6a0f-4940-b0ca-d214be3d3bbb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:05:46.015859 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-f9129ba2-278f-4d6e-a724-b309462f6635 req-ca844b55-b6ae-4794-89b5-101596d64049 service nova] Creating event network-changed:f32b9325-3ac6-4a4e-944c-38ee7b1da17a for instance 803e81db-6a0f-4940-b0ca-d214be3d3bbb on nch1-master-1 Apr 16 22:05:46.019076 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-08439f19-60ef-440f-aad7-8a91151c408f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:46.019558 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-08439f19-60ef-440f-aad7-8a91151c408f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:46.020585 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-08439f19-60ef-440f-aad7-8a91151c408f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:46.021070 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-08439f19-60ef-440f-aad7-8a91151c408f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:46.021458 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-f9129ba2-278f-4d6e-a724-b309462f6635 req-ca844b55-b6ae-4794-89b5-101596d64049 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043467 Apr 16 22:05:46.022473 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3635/7431] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 22:05:46.247268 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-08439f19-60ef-440f-aad7-8a91151c408f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:05:46.255003 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-08439f19-60ef-440f-aad7-8a91151c408f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb" status: 200 len: 1390 microversion: 2.1 time: 0.248016 Apr 16 22:05:46.255578 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3797/7432] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:05:46 2022] GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb => generated 1390 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 22:05:47.273632 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ef99fcc3-59e5-4f7e-950c-01b9d5027407 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:05:47.274400 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ef99fcc3-59e5-4f7e-950c-01b9d5027407 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 803e81db-6a0f-4940-b0ca-d214be3d3bbb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:05:47.280689 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ef99fcc3-59e5-4f7e-950c-01b9d5027407 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:47.281154 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ef99fcc3-59e5-4f7e-950c-01b9d5027407 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:47.281935 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ef99fcc3-59e5-4f7e-950c-01b9d5027407 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:47.282872 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ef99fcc3-59e5-4f7e-950c-01b9d5027407 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:47.411935 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ef99fcc3-59e5-4f7e-950c-01b9d5027407 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:05:47.419301 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ef99fcc3-59e5-4f7e-950c-01b9d5027407 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb" status: 200 len: 1390 microversion: 2.1 time: 0.150986 Apr 16 22:05:47.419876 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3636/7433] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:05:47 2022] GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb => generated 1390 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:05:48.436767 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-74611157-0f61-4ab0-aff8-c8e60d2bc8a2 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:05:48.437399 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-74611157-0f61-4ab0-aff8-c8e60d2bc8a2 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 803e81db-6a0f-4940-b0ca-d214be3d3bbb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:05:48.444768 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-74611157-0f61-4ab0-aff8-c8e60d2bc8a2 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:48.445238 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-74611157-0f61-4ab0-aff8-c8e60d2bc8a2 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:48.446035 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-74611157-0f61-4ab0-aff8-c8e60d2bc8a2 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:48.446495 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-74611157-0f61-4ab0-aff8-c8e60d2bc8a2 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:48.575373 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-74611157-0f61-4ab0-aff8-c8e60d2bc8a2 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:05:48.582808 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-74611157-0f61-4ab0-aff8-c8e60d2bc8a2 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb" status: 200 len: 1390 microversion: 2.1 time: 0.149929 Apr 16 22:05:48.583380 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3798/7434] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:05:48 2022] GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb => generated 1390 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:05:49.599946 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-40fd3504-05f7-43ad-820c-85cd8e750d64 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:05:49.600616 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-40fd3504-05f7-43ad-820c-85cd8e750d64 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 803e81db-6a0f-4940-b0ca-d214be3d3bbb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:05:49.607458 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-40fd3504-05f7-43ad-820c-85cd8e750d64 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:49.607922 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-40fd3504-05f7-43ad-820c-85cd8e750d64 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:49.608732 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-40fd3504-05f7-43ad-820c-85cd8e750d64 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:49.609181 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-40fd3504-05f7-43ad-820c-85cd8e750d64 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:49.741361 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-40fd3504-05f7-43ad-820c-85cd8e750d64 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:05:49.748888 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-40fd3504-05f7-43ad-820c-85cd8e750d64 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb" status: 200 len: 1390 microversion: 2.1 time: 0.152837 Apr 16 22:05:49.749462 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3637/7435] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:05:49 2022] GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb => generated 1390 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:05:50.552056 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-7a81a409-204a-4762-81b7-08a127c7d1dc req-953e3724-8372-4953-b503-25434fadc68c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "803e81db-6a0f-4940-b0ca-d214be3d3bbb", "name": "network-vif-plugged", "status": "completed", "tag": "f32b9325-3ac6-4a4e-944c-38ee7b1da17a"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:05:50.560220 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-7a81a409-204a-4762-81b7-08a127c7d1dc req-953e3724-8372-4953-b503-25434fadc68c service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:50.560645 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-7a81a409-204a-4762-81b7-08a127c7d1dc req-953e3724-8372-4953-b503-25434fadc68c service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:50.572437 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-7a81a409-204a-4762-81b7-08a127c7d1dc req-953e3724-8372-4953-b503-25434fadc68c service nova] Creating event network-vif-plugged:f32b9325-3ac6-4a4e-944c-38ee7b1da17a for instance 803e81db-6a0f-4940-b0ca-d214be3d3bbb on nch1-master-1 Apr 16 22:05:50.577496 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-7a81a409-204a-4762-81b7-08a127c7d1dc req-953e3724-8372-4953-b503-25434fadc68c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079977 Apr 16 22:05:50.578229 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3799/7436] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 22:05:50.765863 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7a14f94f-bd5e-4a13-ac15-470aa493a10b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:05:50.766487 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7a14f94f-bd5e-4a13-ac15-470aa493a10b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 803e81db-6a0f-4940-b0ca-d214be3d3bbb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:05:50.773395 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7a14f94f-bd5e-4a13-ac15-470aa493a10b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:50.773855 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7a14f94f-bd5e-4a13-ac15-470aa493a10b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:50.774628 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7a14f94f-bd5e-4a13-ac15-470aa493a10b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:50.775072 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7a14f94f-bd5e-4a13-ac15-470aa493a10b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:50.903763 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7a14f94f-bd5e-4a13-ac15-470aa493a10b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:05:50.911660 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7a14f94f-bd5e-4a13-ac15-470aa493a10b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb" status: 200 len: 1390 microversion: 2.1 time: 0.149827 Apr 16 22:05:50.912246 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3638/7437] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:05:50 2022] GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb => generated 1390 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:05:51.930403 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-d702685d-89a1-4109-9662-42c3495a5bbc tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:05:51.931049 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-d702685d-89a1-4109-9662-42c3495a5bbc tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 803e81db-6a0f-4940-b0ca-d214be3d3bbb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:05:51.937399 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d702685d-89a1-4109-9662-42c3495a5bbc tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:51.937871 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d702685d-89a1-4109-9662-42c3495a5bbc tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:51.938658 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d702685d-89a1-4109-9662-42c3495a5bbc tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:51.939116 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-d702685d-89a1-4109-9662-42c3495a5bbc tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:52.071434 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-d702685d-89a1-4109-9662-42c3495a5bbc tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:05:52.078910 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-d702685d-89a1-4109-9662-42c3495a5bbc tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb" status: 200 len: 1563 microversion: 2.1 time: 0.153721 Apr 16 22:05:52.079951 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3800/7438] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:05:51 2022] GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb => generated 1563 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:05:52.096317 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-70e8152f-caed-46cd-a6ed-1dff523c615b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:05:52.096942 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-70e8152f-caed-46cd-a6ed-1dff523c615b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 803e81db-6a0f-4940-b0ca-d214be3d3bbb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:05:52.103706 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-70e8152f-caed-46cd-a6ed-1dff523c615b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:52.104191 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-70e8152f-caed-46cd-a6ed-1dff523c615b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:52.104989 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-70e8152f-caed-46cd-a6ed-1dff523c615b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:52.105457 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-70e8152f-caed-46cd-a6ed-1dff523c615b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:52.235510 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-70e8152f-caed-46cd-a6ed-1dff523c615b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:05:52.243285 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-70e8152f-caed-46cd-a6ed-1dff523c615b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb" status: 200 len: 1563 microversion: 2.1 time: 0.151464 Apr 16 22:05:52.243884 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3639/7439] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:05:52 2022] GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:05:54.092831 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0a830614-2ca8-4ae6-976a-04c41bb89ddb tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:05:54.093677 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0a830614-2ca8-4ae6-976a-04c41bb89ddb tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 803e81db-6a0f-4940-b0ca-d214be3d3bbb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:05:54.095895 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-8cf93e35-3bd7-41c4-b6fd-2cd6d92307ad req-8dfbaee9-6028-4719-83f6-3ee07a197db1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "803e81db-6a0f-4940-b0ca-d214be3d3bbb", "tag": "f32b9325-3ac6-4a4e-944c-38ee7b1da17a"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:05:54.101391 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0a830614-2ca8-4ae6-976a-04c41bb89ddb tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:54.102061 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0a830614-2ca8-4ae6-976a-04c41bb89ddb tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:54.102947 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0a830614-2ca8-4ae6-976a-04c41bb89ddb tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:54.103553 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0a830614-2ca8-4ae6-976a-04c41bb89ddb tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:54.105595 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-8cf93e35-3bd7-41c4-b6fd-2cd6d92307ad req-8dfbaee9-6028-4719-83f6-3ee07a197db1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:05:54.106052 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-8cf93e35-3bd7-41c4-b6fd-2cd6d92307ad req-8dfbaee9-6028-4719-83f6-3ee07a197db1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:05:54.118692 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-8cf93e35-3bd7-41c4-b6fd-2cd6d92307ad req-8dfbaee9-6028-4719-83f6-3ee07a197db1 service nova] Creating event network-changed:f32b9325-3ac6-4a4e-944c-38ee7b1da17a for instance 803e81db-6a0f-4940-b0ca-d214be3d3bbb on nch1-master-1 Apr 16 22:05:54.124461 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-8cf93e35-3bd7-41c4-b6fd-2cd6d92307ad req-8dfbaee9-6028-4719-83f6-3ee07a197db1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032884 Apr 16 22:05:54.125368 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3640/7440] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:05:54.663794 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0a830614-2ca8-4ae6-976a-04c41bb89ddb tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:05:54.671867 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0a830614-2ca8-4ae6-976a-04c41bb89ddb tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb" status: 200 len: 1563 microversion: 2.1 time: 0.583027 Apr 16 22:05:54.672912 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3801/7441] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:05:54 2022] GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb => generated 1563 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:06:15.915058 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5005817d-98c6-4ce3-9be0-263e405db924 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:06:15.916070 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5005817d-98c6-4ce3-9be0-263e405db924 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 803e81db-6a0f-4940-b0ca-d214be3d3bbb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:06:15.923142 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5005817d-98c6-4ce3-9be0-263e405db924 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:06:15.923623 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5005817d-98c6-4ce3-9be0-263e405db924 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:06:15.924467 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5005817d-98c6-4ce3-9be0-263e405db924 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:06:15.924925 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5005817d-98c6-4ce3-9be0-263e405db924 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:06:15.974657 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5005817d-98c6-4ce3-9be0-263e405db924 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "POST /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb/action" status: 200 len: 24567 microversion: 2.1 time: 0.063857 Apr 16 22:06:15.975373 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3641/7442] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 22:06:15 2022] POST /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb/action => generated 24567 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 22:06:26.984080 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a371a8bb-754b-4c00-85eb-d319a3ffd6fc tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:06:26.985046 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a371a8bb-754b-4c00-85eb-d319a3ffd6fc tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 803e81db-6a0f-4940-b0ca-d214be3d3bbb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:06:26.993643 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a371a8bb-754b-4c00-85eb-d319a3ffd6fc tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:06:26.994116 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a371a8bb-754b-4c00-85eb-d319a3ffd6fc tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:06:26.994910 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a371a8bb-754b-4c00-85eb-d319a3ffd6fc tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:06:26.995376 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a371a8bb-754b-4c00-85eb-d319a3ffd6fc tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:06:27.160779 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a371a8bb-754b-4c00-85eb-d319a3ffd6fc tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "POST /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb/action" status: 202 len: 0 microversion: 2.1 time: 0.180461 Apr 16 22:06:27.161439 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3802/7443] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 22:06:26 2022] POST /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 22:06:27.170514 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2b235c41-88a3-4d09-9b4d-d840997ee3e5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:06:27.171350 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2b235c41-88a3-4d09-9b4d-d840997ee3e5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 803e81db-6a0f-4940-b0ca-d214be3d3bbb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:06:27.179967 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2b235c41-88a3-4d09-9b4d-d840997ee3e5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:06:27.180468 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2b235c41-88a3-4d09-9b4d-d840997ee3e5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:06:27.181269 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2b235c41-88a3-4d09-9b4d-d840997ee3e5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:06:27.181727 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2b235c41-88a3-4d09-9b4d-d840997ee3e5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:06:27.318959 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2b235c41-88a3-4d09-9b4d-d840997ee3e5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:06:27.326431 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2b235c41-88a3-4d09-9b4d-d840997ee3e5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb" status: 200 len: 1673 microversion: 2.1 time: 0.160433 Apr 16 22:06:27.327001 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3642/7444] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:06:27 2022] GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:06:28.345623 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-dd628617-c450-4508-a664-b7994d3f3667 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:06:28.346335 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-dd628617-c450-4508-a664-b7994d3f3667 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 803e81db-6a0f-4940-b0ca-d214be3d3bbb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:06:28.352635 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dd628617-c450-4508-a664-b7994d3f3667 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:06:28.353114 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dd628617-c450-4508-a664-b7994d3f3667 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:06:28.353908 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dd628617-c450-4508-a664-b7994d3f3667 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:06:28.354378 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dd628617-c450-4508-a664-b7994d3f3667 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:06:28.488481 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-dd628617-c450-4508-a664-b7994d3f3667 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:06:28.495969 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-dd628617-c450-4508-a664-b7994d3f3667 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb" status: 200 len: 1678 microversion: 2.1 time: 0.155578 Apr 16 22:06:28.496567 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3803/7445] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:06:28 2022] GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:06:29.514195 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1b7228d7-8662-4841-8823-b5020146e65c tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:06:29.514816 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1b7228d7-8662-4841-8823-b5020146e65c tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 803e81db-6a0f-4940-b0ca-d214be3d3bbb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:06:29.524358 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1b7228d7-8662-4841-8823-b5020146e65c tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:06:29.524824 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1b7228d7-8662-4841-8823-b5020146e65c tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:06:29.525612 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1b7228d7-8662-4841-8823-b5020146e65c tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:06:29.526061 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1b7228d7-8662-4841-8823-b5020146e65c tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:06:29.656334 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1b7228d7-8662-4841-8823-b5020146e65c tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:06:29.664384 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1b7228d7-8662-4841-8823-b5020146e65c tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb" status: 200 len: 1678 microversion: 2.1 time: 0.154202 Apr 16 22:06:29.664959 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3643/7446] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:06:29 2022] GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:06:30.681863 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-150d1350-7ad8-422d-ab4f-ec1b5c479fac tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:06:30.682499 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-150d1350-7ad8-422d-ab4f-ec1b5c479fac tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 803e81db-6a0f-4940-b0ca-d214be3d3bbb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:06:30.689378 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-150d1350-7ad8-422d-ab4f-ec1b5c479fac tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:06:30.689851 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-150d1350-7ad8-422d-ab4f-ec1b5c479fac tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:06:30.690651 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-150d1350-7ad8-422d-ab4f-ec1b5c479fac tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:06:30.691111 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-150d1350-7ad8-422d-ab4f-ec1b5c479fac tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:06:30.818990 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-150d1350-7ad8-422d-ab4f-ec1b5c479fac tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:06:30.826466 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-150d1350-7ad8-422d-ab4f-ec1b5c479fac tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb" status: 200 len: 1678 microversion: 2.1 time: 0.149137 Apr 16 22:06:30.827024 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3804/7447] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:06:30 2022] GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:06:31.844066 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0c0e98ac-5162-450b-af5a-426e191ab1ae tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:06:31.855257 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0c0e98ac-5162-450b-af5a-426e191ab1ae tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 803e81db-6a0f-4940-b0ca-d214be3d3bbb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:06:31.855257 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0c0e98ac-5162-450b-af5a-426e191ab1ae tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:06:31.855257 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0c0e98ac-5162-450b-af5a-426e191ab1ae tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:06:31.855257 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0c0e98ac-5162-450b-af5a-426e191ab1ae tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:06:31.855257 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0c0e98ac-5162-450b-af5a-426e191ab1ae tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:06:31.984719 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-0c0e98ac-5162-450b-af5a-426e191ab1ae tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:06:31.992569 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0c0e98ac-5162-450b-af5a-426e191ab1ae tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb" status: 200 len: 1678 microversion: 2.1 time: 0.152427 Apr 16 22:06:31.993144 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3644/7448] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:06:31 2022] GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:06:33.010265 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c61c3511-47f7-4050-b40c-61c94cd9a235 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:06:33.010877 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c61c3511-47f7-4050-b40c-61c94cd9a235 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 803e81db-6a0f-4940-b0ca-d214be3d3bbb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:06:33.017742 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c61c3511-47f7-4050-b40c-61c94cd9a235 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:06:33.018219 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c61c3511-47f7-4050-b40c-61c94cd9a235 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:06:33.019014 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c61c3511-47f7-4050-b40c-61c94cd9a235 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:06:33.019472 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c61c3511-47f7-4050-b40c-61c94cd9a235 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:06:33.149125 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c61c3511-47f7-4050-b40c-61c94cd9a235 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:06:33.156641 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c61c3511-47f7-4050-b40c-61c94cd9a235 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb" status: 200 len: 1678 microversion: 2.1 time: 0.150307 Apr 16 22:06:33.157211 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3805/7449] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:06:33 2022] GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:06:34.173911 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1c66e08e-52bc-4cad-9dd7-54144205ebe1 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:06:34.174538 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1c66e08e-52bc-4cad-9dd7-54144205ebe1 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 803e81db-6a0f-4940-b0ca-d214be3d3bbb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:06:34.181396 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1c66e08e-52bc-4cad-9dd7-54144205ebe1 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:06:34.181868 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1c66e08e-52bc-4cad-9dd7-54144205ebe1 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:06:34.182945 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1c66e08e-52bc-4cad-9dd7-54144205ebe1 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:06:34.183400 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1c66e08e-52bc-4cad-9dd7-54144205ebe1 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:06:34.319059 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1c66e08e-52bc-4cad-9dd7-54144205ebe1 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:06:34.326700 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1c66e08e-52bc-4cad-9dd7-54144205ebe1 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb" status: 200 len: 1678 microversion: 2.1 time: 0.156723 Apr 16 22:06:34.327282 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3645/7450] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:06:34 2022] GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:06:35.344820 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5332cc31-5dfa-4b07-8750-f7236b7e8ced tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:06:35.345455 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5332cc31-5dfa-4b07-8750-f7236b7e8ced tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 803e81db-6a0f-4940-b0ca-d214be3d3bbb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:06:35.352844 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5332cc31-5dfa-4b07-8750-f7236b7e8ced tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:06:35.353325 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5332cc31-5dfa-4b07-8750-f7236b7e8ced tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:06:35.354129 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5332cc31-5dfa-4b07-8750-f7236b7e8ced tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:06:35.354590 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5332cc31-5dfa-4b07-8750-f7236b7e8ced tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:06:35.488485 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5332cc31-5dfa-4b07-8750-f7236b7e8ced tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:06:35.495915 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5332cc31-5dfa-4b07-8750-f7236b7e8ced tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb" status: 200 len: 1678 microversion: 2.1 time: 0.155218 Apr 16 22:06:35.496513 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3806/7451] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:06:35 2022] GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:06:36.513074 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-756146d3-b86f-4777-a78c-a24d1b1d2a77 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:06:36.513691 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-756146d3-b86f-4777-a78c-a24d1b1d2a77 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 803e81db-6a0f-4940-b0ca-d214be3d3bbb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:06:36.520480 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-756146d3-b86f-4777-a78c-a24d1b1d2a77 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:06:36.520940 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-756146d3-b86f-4777-a78c-a24d1b1d2a77 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:06:36.521714 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-756146d3-b86f-4777-a78c-a24d1b1d2a77 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:06:36.522154 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-756146d3-b86f-4777-a78c-a24d1b1d2a77 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:06:36.651951 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-756146d3-b86f-4777-a78c-a24d1b1d2a77 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:06:36.657757 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-756146d3-b86f-4777-a78c-a24d1b1d2a77 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb" status: 200 len: 1678 microversion: 2.1 time: 0.148631 Apr 16 22:06:36.658336 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3646/7452] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:06:36 2022] GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:06:37.674819 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-342b5e40-9720-42c7-9d09-807539ca8b8a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:06:37.675461 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-342b5e40-9720-42c7-9d09-807539ca8b8a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 803e81db-6a0f-4940-b0ca-d214be3d3bbb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:06:37.683195 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-342b5e40-9720-42c7-9d09-807539ca8b8a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:06:37.683678 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-342b5e40-9720-42c7-9d09-807539ca8b8a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:06:37.684544 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-342b5e40-9720-42c7-9d09-807539ca8b8a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:06:37.685014 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-342b5e40-9720-42c7-9d09-807539ca8b8a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:06:37.815738 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-342b5e40-9720-42c7-9d09-807539ca8b8a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:06:37.823884 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-342b5e40-9720-42c7-9d09-807539ca8b8a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb" status: 200 len: 1678 microversion: 2.1 time: 0.153001 Apr 16 22:06:37.824488 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3807/7453] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:06:37 2022] GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 22:06:38.841441 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-661024d3-677f-4f85-8150-ff0b42e55381 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:06:38.842089 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-661024d3-677f-4f85-8150-ff0b42e55381 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 803e81db-6a0f-4940-b0ca-d214be3d3bbb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:06:38.848846 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-661024d3-677f-4f85-8150-ff0b42e55381 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:06:38.849313 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-661024d3-677f-4f85-8150-ff0b42e55381 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:06:38.850094 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-661024d3-677f-4f85-8150-ff0b42e55381 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:06:38.850544 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-661024d3-677f-4f85-8150-ff0b42e55381 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:06:38.979756 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-661024d3-677f-4f85-8150-ff0b42e55381 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:06:38.987309 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-661024d3-677f-4f85-8150-ff0b42e55381 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb" status: 200 len: 1678 microversion: 2.1 time: 0.150029 Apr 16 22:06:38.987896 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3647/7454] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:06:38 2022] GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:06:40.004873 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-de14a626-126a-424c-988c-8c14c6cd63e2 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:06:40.005461 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-de14a626-126a-424c-988c-8c14c6cd63e2 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 803e81db-6a0f-4940-b0ca-d214be3d3bbb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:06:40.012316 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-de14a626-126a-424c-988c-8c14c6cd63e2 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:06:40.012797 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-de14a626-126a-424c-988c-8c14c6cd63e2 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:06:40.013593 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-de14a626-126a-424c-988c-8c14c6cd63e2 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:06:40.014058 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-de14a626-126a-424c-988c-8c14c6cd63e2 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:06:40.151652 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-de14a626-126a-424c-988c-8c14c6cd63e2 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:06:40.159067 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-de14a626-126a-424c-988c-8c14c6cd63e2 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb" status: 200 len: 1678 microversion: 2.1 time: 0.158437 Apr 16 22:06:40.159642 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3808/7455] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:06:39 2022] GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:06:41.177268 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3cb9f87d-fde2-4818-92d8-b19fbfe2ffcb tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:06:41.177844 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3cb9f87d-fde2-4818-92d8-b19fbfe2ffcb tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 803e81db-6a0f-4940-b0ca-d214be3d3bbb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:06:41.185480 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3cb9f87d-fde2-4818-92d8-b19fbfe2ffcb tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:06:41.185948 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3cb9f87d-fde2-4818-92d8-b19fbfe2ffcb tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:06:41.186735 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3cb9f87d-fde2-4818-92d8-b19fbfe2ffcb tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:06:41.187184 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3cb9f87d-fde2-4818-92d8-b19fbfe2ffcb tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:06:41.317636 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3cb9f87d-fde2-4818-92d8-b19fbfe2ffcb tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:06:41.325242 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3cb9f87d-fde2-4818-92d8-b19fbfe2ffcb tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb" status: 200 len: 1678 microversion: 2.1 time: 0.152130 Apr 16 22:06:41.325854 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3648/7456] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:06:41 2022] GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:06:42.342891 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b5da7964-907b-4fe5-bafb-81e7d545501d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:06:42.343523 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b5da7964-907b-4fe5-bafb-81e7d545501d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 803e81db-6a0f-4940-b0ca-d214be3d3bbb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:06:42.350979 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5da7964-907b-4fe5-bafb-81e7d545501d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:06:42.351482 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5da7964-907b-4fe5-bafb-81e7d545501d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:06:42.352306 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5da7964-907b-4fe5-bafb-81e7d545501d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:06:42.352769 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5da7964-907b-4fe5-bafb-81e7d545501d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:06:42.480622 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b5da7964-907b-4fe5-bafb-81e7d545501d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:06:42.488073 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b5da7964-907b-4fe5-bafb-81e7d545501d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb" status: 200 len: 1678 microversion: 2.1 time: 0.149160 Apr 16 22:06:42.488677 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3809/7457] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:06:42 2022] GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:06:43.504915 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ac07565d-f133-4b4c-b6ad-b41796d7aac3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:06:43.505529 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ac07565d-f133-4b4c-b6ad-b41796d7aac3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 803e81db-6a0f-4940-b0ca-d214be3d3bbb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:06:43.512738 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ac07565d-f133-4b4c-b6ad-b41796d7aac3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:06:43.513327 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ac07565d-f133-4b4c-b6ad-b41796d7aac3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:06:43.514131 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ac07565d-f133-4b4c-b6ad-b41796d7aac3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:06:43.514579 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ac07565d-f133-4b4c-b6ad-b41796d7aac3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:06:43.644505 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ac07565d-f133-4b4c-b6ad-b41796d7aac3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:06:43.652519 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ac07565d-f133-4b4c-b6ad-b41796d7aac3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb" status: 200 len: 1678 microversion: 2.1 time: 0.151485 Apr 16 22:06:43.653109 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3649/7458] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:06:43 2022] GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:06:44.669694 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c3dddcb6-1f10-4767-8a42-877e284fccf0 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:06:44.670327 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c3dddcb6-1f10-4767-8a42-877e284fccf0 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 803e81db-6a0f-4940-b0ca-d214be3d3bbb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:06:44.677174 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3dddcb6-1f10-4767-8a42-877e284fccf0 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:06:44.677645 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3dddcb6-1f10-4767-8a42-877e284fccf0 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:06:44.679024 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3dddcb6-1f10-4767-8a42-877e284fccf0 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:06:44.679463 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3dddcb6-1f10-4767-8a42-877e284fccf0 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:06:44.808871 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c3dddcb6-1f10-4767-8a42-877e284fccf0 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:06:44.816376 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c3dddcb6-1f10-4767-8a42-877e284fccf0 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb" status: 200 len: 1681 microversion: 2.1 time: 0.150594 Apr 16 22:06:44.816953 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3810/7459] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:06:44 2022] GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:07:07.031207 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d3cf625c-2054-42f0-ad5d-de0599487327 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:07:07.032065 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d3cf625c-2054-42f0-ad5d-de0599487327 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 803e81db-6a0f-4940-b0ca-d214be3d3bbb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:07:07.038359 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d3cf625c-2054-42f0-ad5d-de0599487327 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:07.038821 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d3cf625c-2054-42f0-ad5d-de0599487327 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:07:07.039604 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d3cf625c-2054-42f0-ad5d-de0599487327 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:07.040056 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d3cf625c-2054-42f0-ad5d-de0599487327 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:07:07.099544 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d3cf625c-2054-42f0-ad5d-de0599487327 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "POST /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb/action" status: 200 len: 68927 microversion: 2.1 time: 0.072222 Apr 16 22:07:07.100225 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3650/7460] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 22:07:07 2022] POST /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb/action => generated 68927 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 22:07:14.449035 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8c690fa8-51ce-4f7e-ba67-a75a870566c3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:07:14.449630 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8c690fa8-51ce-4f7e-ba67-a75a870566c3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 803e81db-6a0f-4940-b0ca-d214be3d3bbb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:07:14.460217 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8c690fa8-51ce-4f7e-ba67-a75a870566c3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:14.460766 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8c690fa8-51ce-4f7e-ba67-a75a870566c3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:07:14.462468 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8c690fa8-51ce-4f7e-ba67-a75a870566c3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:14.463544 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8c690fa8-51ce-4f7e-ba67-a75a870566c3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:07:14.489922 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8c690fa8-51ce-4f7e-ba67-a75a870566c3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 803e81db-6a0f-4940-b0ca-d214be3d3bbb] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 22:07:14.566742 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-5945aad0-00c4-4a24-a95e-0453b928e59e req-743a2d61-88f3-477a-bc00-a33c25a4d69c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "803e81db-6a0f-4940-b0ca-d214be3d3bbb", "tag": "f32b9325-3ac6-4a4e-944c-38ee7b1da17a"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:07:14.575516 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-5945aad0-00c4-4a24-a95e-0453b928e59e req-743a2d61-88f3-477a-bc00-a33c25a4d69c service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:14.576019 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-5945aad0-00c4-4a24-a95e-0453b928e59e req-743a2d61-88f3-477a-bc00-a33c25a4d69c service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:07:14.586864 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-5945aad0-00c4-4a24-a95e-0453b928e59e req-743a2d61-88f3-477a-bc00-a33c25a4d69c service nova] Creating event network-changed:f32b9325-3ac6-4a4e-944c-38ee7b1da17a for instance 803e81db-6a0f-4940-b0ca-d214be3d3bbb on nch1-master-1 Apr 16 22:07:14.592651 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-5945aad0-00c4-4a24-a95e-0453b928e59e req-743a2d61-88f3-477a-bc00-a33c25a4d69c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095935 Apr 16 22:07:14.597092 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3651/7461] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:07:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 22:07:14.744650 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8c690fa8-51ce-4f7e-ba67-a75a870566c3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "DELETE /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb" status: 204 len: 0 microversion: 2.1 time: 0.299531 Apr 16 22:07:14.748779 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3811/7462] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 22:07:14 2022] DELETE /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 22:07:14.755350 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-61555d8d-7d29-4d4b-bb40-6eba526796cc tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:07:14.756072 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-61555d8d-7d29-4d4b-bb40-6eba526796cc tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 803e81db-6a0f-4940-b0ca-d214be3d3bbb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:07:14.766525 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-61555d8d-7d29-4d4b-bb40-6eba526796cc tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:14.769222 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-61555d8d-7d29-4d4b-bb40-6eba526796cc tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:07:14.769222 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-61555d8d-7d29-4d4b-bb40-6eba526796cc tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:14.769222 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-61555d8d-7d29-4d4b-bb40-6eba526796cc tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:07:14.914916 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-61555d8d-7d29-4d4b-bb40-6eba526796cc tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:07:14.922570 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-61555d8d-7d29-4d4b-bb40-6eba526796cc tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb" status: 200 len: 1687 microversion: 2.1 time: 0.172168 Apr 16 22:07:14.923151 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3652/7463] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:07:14 2022] GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb => generated 1687 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:07:15.941404 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-29be4141-8c57-483d-b2d8-6665e0167d3d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:07:15.942053 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-29be4141-8c57-483d-b2d8-6665e0167d3d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 803e81db-6a0f-4940-b0ca-d214be3d3bbb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:07:15.949526 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-29be4141-8c57-483d-b2d8-6665e0167d3d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:15.949992 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-29be4141-8c57-483d-b2d8-6665e0167d3d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:07:15.950788 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-29be4141-8c57-483d-b2d8-6665e0167d3d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:15.951275 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-29be4141-8c57-483d-b2d8-6665e0167d3d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:07:16.117167 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-29be4141-8c57-483d-b2d8-6665e0167d3d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:07:16.125220 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-29be4141-8c57-483d-b2d8-6665e0167d3d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb" status: 200 len: 1687 microversion: 2.1 time: 0.188210 Apr 16 22:07:16.125795 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3812/7464] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:07:15 2022] GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb => generated 1687 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:07:16.820718 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-02eafc1c-34e6-4875-81a5-404e2c1888dd req-0d2d7201-e055-42a3-be31-1dbb268da79f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "803e81db-6a0f-4940-b0ca-d214be3d3bbb", "name": "network-vif-deleted", "tag": "f32b9325-3ac6-4a4e-944c-38ee7b1da17a"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:07:16.829470 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-02eafc1c-34e6-4875-81a5-404e2c1888dd req-0d2d7201-e055-42a3-be31-1dbb268da79f service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:16.829921 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-02eafc1c-34e6-4875-81a5-404e2c1888dd req-0d2d7201-e055-42a3-be31-1dbb268da79f service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:07:16.842153 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-02eafc1c-34e6-4875-81a5-404e2c1888dd req-0d2d7201-e055-42a3-be31-1dbb268da79f service nova] Creating event network-vif-deleted:f32b9325-3ac6-4a4e-944c-38ee7b1da17a for instance 803e81db-6a0f-4940-b0ca-d214be3d3bbb on nch1-master-1 Apr 16 22:07:16.847002 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-02eafc1c-34e6-4875-81a5-404e2c1888dd req-0d2d7201-e055-42a3-be31-1dbb268da79f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030132 Apr 16 22:07:16.847754 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3653/7465] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:07:17.143980 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-86e0924a-2cb0-4244-a7a4-7824991e6c39 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:07:17.144818 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-86e0924a-2cb0-4244-a7a4-7824991e6c39 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 803e81db-6a0f-4940-b0ca-d214be3d3bbb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:07:17.153441 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-86e0924a-2cb0-4244-a7a4-7824991e6c39 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:17.157010 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-86e0924a-2cb0-4244-a7a4-7824991e6c39 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:07:17.157010 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-86e0924a-2cb0-4244-a7a4-7824991e6c39 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:17.157010 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-86e0924a-2cb0-4244-a7a4-7824991e6c39 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:07:17.188465 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-86e0924a-2cb0-4244-a7a4-7824991e6c39 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:17.188983 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-86e0924a-2cb0-4244-a7a4-7824991e6c39 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:07:17.189464 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-86e0924a-2cb0-4244-a7a4-7824991e6c39 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lazy-loading 'fault' on Instance uuid 803e81db-6a0f-4940-b0ca-d214be3d3bbb {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 22:07:17.235447 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-86e0924a-2cb0-4244-a7a4-7824991e6c39 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:07:17.243335 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-86e0924a-2cb0-4244-a7a4-7824991e6c39 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb" status: 200 len: 1355 microversion: 2.1 time: 0.103745 Apr 16 22:07:17.244166 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3813/7466] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:07:17 2022] GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb => generated 1355 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:07:18.260928 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ec168f40-aa66-4d40-a070-8668f3ce4c66 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:07:18.261632 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ec168f40-aa66-4d40-a070-8668f3ce4c66 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 803e81db-6a0f-4940-b0ca-d214be3d3bbb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:07:18.268570 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ec168f40-aa66-4d40-a070-8668f3ce4c66 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:18.269030 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ec168f40-aa66-4d40-a070-8668f3ce4c66 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:07:18.269807 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ec168f40-aa66-4d40-a070-8668f3ce4c66 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:18.270252 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ec168f40-aa66-4d40-a070-8668f3ce4c66 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:07:18.283752 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-ec168f40-aa66-4d40-a070-8668f3ce4c66 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] HTTP exception thrown: Instance 803e81db-6a0f-4940-b0ca-d214be3d3bbb could not be found. Apr 16 22:07:18.284375 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ec168f40-aa66-4d40-a070-8668f3ce4c66 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Returning 404 to user: Instance 803e81db-6a0f-4940-b0ca-d214be3d3bbb could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 22:07:18.285230 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ec168f40-aa66-4d40-a070-8668f3ce4c66 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb" status: 404 len: 111 microversion: 2.1 time: 0.028767 Apr 16 22:07:18.285771 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3654/7467] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:07:18 2022] GET /compute/v2.1/servers/803e81db-6a0f-4940-b0ca-d214be3d3bbb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 22:07:22.149456 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-faae5f78-cc58-4d4c-af94-3c79e26f4336 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '.version_select at 0x7fbb96e8dee0>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:07:22.232116 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-faae5f78-cc58-4d4c-af94-3c79e26f4336 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-130884887" status: 202 len: 0 microversion: 2.1 time: 0.086565 Apr 16 22:07:22.232750 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3814/7468] 10.222.0.20 () {58 vars in 1280 bytes} [Sat Apr 16 22:07:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-130884887 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 16 22:07:22.259873 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b4b6f88c-a95b-4472-9c6a-1e6cf6909970 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Action: 'create', calling method: .version_select at 0x7fbb96254670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1574425534"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:07:22.277003 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-b4b6f88c-a95b-4472-9c6a-1e6cf6909970 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Getting quotas for project 3d4eaa0fe99e42488e0720b18be48ac8. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 22:07:22.282982 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-b4b6f88c-a95b-4472-9c6a-1e6cf6909970 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Getting quotas for user 8fa5c4f477214df880fc12d6da76283a and project 3d4eaa0fe99e42488e0720b18be48ac8. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 22:07:22.405791 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-b4b6f88c-a95b-4472-9c6a-1e6cf6909970 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Getting quotas for project 3d4eaa0fe99e42488e0720b18be48ac8. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 22:07:22.410741 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-b4b6f88c-a95b-4472-9c6a-1e6cf6909970 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Getting quotas for user 8fa5c4f477214df880fc12d6da76283a and project 3d4eaa0fe99e42488e0720b18be48ac8. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 22:07:22.425470 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b4b6f88c-a95b-4472-9c6a-1e6cf6909970 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2326 microversion: 2.1 time: 0.169651 Apr 16 22:07:22.426082 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3655/7469] 10.222.0.20 () {60 vars in 1157 bytes} [Sat Apr 16 22:07:22 2022] POST /compute/v2.1/os-keypairs => generated 2326 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:07:30.139737 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4152f13a-fd09-4e37-990c-0ad0bcaf8d93 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1532123018", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "60f0d3b6-f916-4f77-b29a-6d6dd90d22ac"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1574425534", "security_groups": [{"name": "tempest-secgroup-smoke-2116468120"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:07:30.281297 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-4152f13a-fd09-4e37-990c-0ad0bcaf8d93 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] validate_networks() for [('60f0d3b6-f916-4f77-b29a-6d6dd90d22ac', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 22:07:30.802833 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-4152f13a-fd09-4e37-990c-0ad0bcaf8d93 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 22:07:30.803366 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-4152f13a-fd09-4e37-990c-0ad0bcaf8d93 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 22:07:30.803930 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-4152f13a-fd09-4e37-990c-0ad0bcaf8d93 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 22:07:30.804469 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-4152f13a-fd09-4e37-990c-0ad0bcaf8d93 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 22:07:30.804991 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-4152f13a-fd09-4e37-990c-0ad0bcaf8d93 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 22:07:30.816661 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4152f13a-fd09-4e37-990c-0ad0bcaf8d93 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:30.817214 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4152f13a-fd09-4e37-990c-0ad0bcaf8d93 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:07:30.818046 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4152f13a-fd09-4e37-990c-0ad0bcaf8d93 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:30.818500 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4152f13a-fd09-4e37-990c-0ad0bcaf8d93 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:07:30.838815 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-4152f13a-fd09-4e37-990c-0ad0bcaf8d93 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Getting quotas for project 3d4eaa0fe99e42488e0720b18be48ac8. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 22:07:30.844674 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-4152f13a-fd09-4e37-990c-0ad0bcaf8d93 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Getting quotas for user 8fa5c4f477214df880fc12d6da76283a and project 3d4eaa0fe99e42488e0720b18be48ac8. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 22:07:30.857452 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4152f13a-fd09-4e37-990c-0ad0bcaf8d93 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 22:07:30.859763 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4152f13a-fd09-4e37-990c-0ad0bcaf8d93 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 22:07:30.976847 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4152f13a-fd09-4e37-990c-0ad0bcaf8d93 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.845896 Apr 16 22:07:30.983263 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3815/7470] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 22:07:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 847 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 22:07:30.990392 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d06baaf5-cb2a-4a0f-947e-e7d17e65751c tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:07:30.991246 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d06baaf5-cb2a-4a0f-947e-e7d17e65751c tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:07:31.076371 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d06baaf5-cb2a-4a0f-947e-e7d17e65751c tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:07:31.083635 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d06baaf5-cb2a-4a0f-947e-e7d17e65751c tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb" status: 200 len: 1267 microversion: 2.1 time: 0.098755 Apr 16 22:07:31.084247 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3656/7471] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:07:30 2022] GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb => generated 1267 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:07:32.101799 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7278778d-5766-4bc2-870a-fc47523b774b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:07:32.102452 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7278778d-5766-4bc2-870a-fc47523b774b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:07:32.114704 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7278778d-5766-4bc2-870a-fc47523b774b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:32.115184 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7278778d-5766-4bc2-870a-fc47523b774b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:07:32.116001 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7278778d-5766-4bc2-870a-fc47523b774b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:32.116494 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7278778d-5766-4bc2-870a-fc47523b774b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:07:32.186499 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7278778d-5766-4bc2-870a-fc47523b774b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:07:32.193916 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7278778d-5766-4bc2-870a-fc47523b774b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb" status: 200 len: 1271 microversion: 2.1 time: 0.097097 Apr 16 22:07:32.194682 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3816/7472] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:07:32 2022] GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb => generated 1271 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:07:33.212150 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-04d57d93-0546-4202-a8b4-df37b4624334 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:07:33.213456 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-04d57d93-0546-4202-a8b4-df37b4624334 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:07:33.222233 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-04d57d93-0546-4202-a8b4-df37b4624334 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:33.223009 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-04d57d93-0546-4202-a8b4-df37b4624334 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:07:33.224102 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-04d57d93-0546-4202-a8b4-df37b4624334 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:33.224698 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-04d57d93-0546-4202-a8b4-df37b4624334 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:07:33.288949 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-04d57d93-0546-4202-a8b4-df37b4624334 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:07:33.298099 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-04d57d93-0546-4202-a8b4-df37b4624334 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb" status: 200 len: 1337 microversion: 2.1 time: 0.090502 Apr 16 22:07:33.298768 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3657/7473] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:07:33 2022] GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb => generated 1337 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:07:34.315698 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cafe6720-21ac-460c-8f87-c598d62eb09f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:07:34.316431 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cafe6720-21ac-460c-8f87-c598d62eb09f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:07:34.323562 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cafe6720-21ac-460c-8f87-c598d62eb09f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:34.324148 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cafe6720-21ac-460c-8f87-c598d62eb09f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:07:34.324975 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cafe6720-21ac-460c-8f87-c598d62eb09f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:34.325435 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cafe6720-21ac-460c-8f87-c598d62eb09f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:07:34.552923 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cafe6720-21ac-460c-8f87-c598d62eb09f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:07:34.561177 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cafe6720-21ac-460c-8f87-c598d62eb09f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb" status: 200 len: 1393 microversion: 2.1 time: 0.249179 Apr 16 22:07:34.570884 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3817/7474] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:07:34 2022] GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb => generated 1393 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:07:34.764029 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-414e4d73-bf9e-4fc1-80d7-ca5af8f792ea req-1026d6d8-0dfa-42e6-ba1d-06f815b268a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d34c712-7f09-4193-941f-3a623cb994bb", "tag": "2b155b26-7042-4d21-80ba-41edd625ff3d"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:07:34.773571 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-414e4d73-bf9e-4fc1-80d7-ca5af8f792ea req-1026d6d8-0dfa-42e6-ba1d-06f815b268a7 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:34.774034 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-414e4d73-bf9e-4fc1-80d7-ca5af8f792ea req-1026d6d8-0dfa-42e6-ba1d-06f815b268a7 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:07:34.786317 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-414e4d73-bf9e-4fc1-80d7-ca5af8f792ea req-1026d6d8-0dfa-42e6-ba1d-06f815b268a7 service nova] Creating event network-changed:2b155b26-7042-4d21-80ba-41edd625ff3d for instance 1d34c712-7f09-4193-941f-3a623cb994bb on nch2-master-1 Apr 16 22:07:34.791532 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-414e4d73-bf9e-4fc1-80d7-ca5af8f792ea req-1026d6d8-0dfa-42e6-ba1d-06f815b268a7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031263 Apr 16 22:07:34.792288 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3658/7475] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:07:35.578189 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a1e617c1-02dc-40ef-9c5d-1e64457d4cc5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:07:35.578823 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a1e617c1-02dc-40ef-9c5d-1e64457d4cc5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:07:35.585757 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a1e617c1-02dc-40ef-9c5d-1e64457d4cc5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:35.586495 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a1e617c1-02dc-40ef-9c5d-1e64457d4cc5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:07:35.587294 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a1e617c1-02dc-40ef-9c5d-1e64457d4cc5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:35.587763 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a1e617c1-02dc-40ef-9c5d-1e64457d4cc5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:07:35.716808 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a1e617c1-02dc-40ef-9c5d-1e64457d4cc5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:07:35.725659 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a1e617c1-02dc-40ef-9c5d-1e64457d4cc5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb" status: 200 len: 1393 microversion: 2.1 time: 0.151951 Apr 16 22:07:35.726248 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3818/7476] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:07:35 2022] GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb => generated 1393 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:07:36.744160 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c206c253-4a6a-4eae-9fd3-93aed36ce2f1 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:07:36.744908 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c206c253-4a6a-4eae-9fd3-93aed36ce2f1 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:07:36.751610 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c206c253-4a6a-4eae-9fd3-93aed36ce2f1 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:36.752069 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c206c253-4a6a-4eae-9fd3-93aed36ce2f1 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:07:36.752866 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c206c253-4a6a-4eae-9fd3-93aed36ce2f1 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:36.753341 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c206c253-4a6a-4eae-9fd3-93aed36ce2f1 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:07:36.886349 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c206c253-4a6a-4eae-9fd3-93aed36ce2f1 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:07:36.894471 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c206c253-4a6a-4eae-9fd3-93aed36ce2f1 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb" status: 200 len: 1393 microversion: 2.1 time: 0.155389 Apr 16 22:07:36.895053 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3659/7477] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:07:36 2022] GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb => generated 1393 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:07:37.919467 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1d8d5033-5056-4eec-b1df-f512fced24d8 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:07:37.920090 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1d8d5033-5056-4eec-b1df-f512fced24d8 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:07:37.927018 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1d8d5033-5056-4eec-b1df-f512fced24d8 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:37.927485 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1d8d5033-5056-4eec-b1df-f512fced24d8 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:07:37.928294 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1d8d5033-5056-4eec-b1df-f512fced24d8 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:37.928903 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1d8d5033-5056-4eec-b1df-f512fced24d8 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:07:38.062200 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1d8d5033-5056-4eec-b1df-f512fced24d8 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:07:38.069753 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1d8d5033-5056-4eec-b1df-f512fced24d8 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb" status: 200 len: 1393 microversion: 2.1 time: 0.154219 Apr 16 22:07:38.070435 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3819/7478] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:07:37 2022] GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb => generated 1393 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:07:39.087317 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-dc76eb5d-76fc-4267-8965-6c3e6cee5434 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:07:39.087934 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-dc76eb5d-76fc-4267-8965-6c3e6cee5434 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:07:39.095226 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dc76eb5d-76fc-4267-8965-6c3e6cee5434 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:39.095694 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dc76eb5d-76fc-4267-8965-6c3e6cee5434 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:07:39.096560 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dc76eb5d-76fc-4267-8965-6c3e6cee5434 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:39.097010 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-dc76eb5d-76fc-4267-8965-6c3e6cee5434 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:07:39.226519 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-dc76eb5d-76fc-4267-8965-6c3e6cee5434 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:07:39.234460 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-dc76eb5d-76fc-4267-8965-6c3e6cee5434 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb" status: 200 len: 1393 microversion: 2.1 time: 0.151496 Apr 16 22:07:39.235036 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3660/7479] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:07:39 2022] GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb => generated 1393 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:07:40.251540 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ffd97565-e086-4b13-b591-c9e3a8e41ebd tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:07:40.252190 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ffd97565-e086-4b13-b591-c9e3a8e41ebd tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:07:40.258953 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ffd97565-e086-4b13-b591-c9e3a8e41ebd tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:40.259431 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ffd97565-e086-4b13-b591-c9e3a8e41ebd tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:07:40.260256 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ffd97565-e086-4b13-b591-c9e3a8e41ebd tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:40.260724 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ffd97565-e086-4b13-b591-c9e3a8e41ebd tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:07:40.386851 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ffd97565-e086-4b13-b591-c9e3a8e41ebd tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:07:40.395462 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ffd97565-e086-4b13-b591-c9e3a8e41ebd tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb" status: 200 len: 1393 microversion: 2.1 time: 0.147907 Apr 16 22:07:40.396304 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3820/7480] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:07:40 2022] GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb => generated 1393 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 22:07:40.617446 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-0055f068-1ad4-45de-a6b7-11602998363c req-06c0fdb4-374a-4001-82bf-b182118b1002 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d34c712-7f09-4193-941f-3a623cb994bb", "name": "network-vif-plugged", "status": "completed", "tag": "2b155b26-7042-4d21-80ba-41edd625ff3d"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:07:40.626188 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-0055f068-1ad4-45de-a6b7-11602998363c req-06c0fdb4-374a-4001-82bf-b182118b1002 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:40.626637 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-0055f068-1ad4-45de-a6b7-11602998363c req-06c0fdb4-374a-4001-82bf-b182118b1002 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:07:40.637317 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-0055f068-1ad4-45de-a6b7-11602998363c req-06c0fdb4-374a-4001-82bf-b182118b1002 service nova] Creating event network-vif-plugged:2b155b26-7042-4d21-80ba-41edd625ff3d for instance 1d34c712-7f09-4193-941f-3a623cb994bb on nch2-master-1 Apr 16 22:07:40.642265 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-0055f068-1ad4-45de-a6b7-11602998363c req-06c0fdb4-374a-4001-82bf-b182118b1002 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028542 Apr 16 22:07:40.642839 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3661/7481] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:07:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:07:41.411936 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2c76e5b5-e1b8-499c-b49f-31d865c10750 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:07:41.412628 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2c76e5b5-e1b8-499c-b49f-31d865c10750 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:07:41.420043 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2c76e5b5-e1b8-499c-b49f-31d865c10750 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:41.420545 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2c76e5b5-e1b8-499c-b49f-31d865c10750 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:07:41.421337 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2c76e5b5-e1b8-499c-b49f-31d865c10750 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:41.421797 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2c76e5b5-e1b8-499c-b49f-31d865c10750 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:07:41.549834 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2c76e5b5-e1b8-499c-b49f-31d865c10750 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:07:41.557323 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2c76e5b5-e1b8-499c-b49f-31d865c10750 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb" status: 200 len: 1393 microversion: 2.1 time: 0.149274 Apr 16 22:07:41.557912 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3821/7482] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:07:41 2022] GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb => generated 1393 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:07:42.575852 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-7284a4f3-d942-41ce-9cbe-eaf3befb0a4d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:07:42.576566 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-7284a4f3-d942-41ce-9cbe-eaf3befb0a4d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:07:42.582788 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7284a4f3-d942-41ce-9cbe-eaf3befb0a4d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:42.583254 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7284a4f3-d942-41ce-9cbe-eaf3befb0a4d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:07:42.584039 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7284a4f3-d942-41ce-9cbe-eaf3befb0a4d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:42.584515 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-7284a4f3-d942-41ce-9cbe-eaf3befb0a4d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:07:42.718725 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-7284a4f3-d942-41ce-9cbe-eaf3befb0a4d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:07:42.726272 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-7284a4f3-d942-41ce-9cbe-eaf3befb0a4d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb" status: 200 len: 1565 microversion: 2.1 time: 0.155664 Apr 16 22:07:42.726863 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3662/7483] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:07:42 2022] GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb => generated 1565 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:07:42.743285 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e4fdf484-7f5e-4d1f-8253-b52b16fc471f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:07:42.743918 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e4fdf484-7f5e-4d1f-8253-b52b16fc471f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:07:42.750912 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e4fdf484-7f5e-4d1f-8253-b52b16fc471f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:42.751390 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e4fdf484-7f5e-4d1f-8253-b52b16fc471f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:07:42.752196 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e4fdf484-7f5e-4d1f-8253-b52b16fc471f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:42.752657 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e4fdf484-7f5e-4d1f-8253-b52b16fc471f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:07:42.880676 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e4fdf484-7f5e-4d1f-8253-b52b16fc471f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:07:42.888424 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e4fdf484-7f5e-4d1f-8253-b52b16fc471f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb" status: 200 len: 1565 microversion: 2.1 time: 0.149088 Apr 16 22:07:42.889014 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3822/7484] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:07:42 2022] GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb => generated 1565 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:07:45.156578 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b5d30618-a4f9-452c-92fa-18b542c7a5a5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:07:45.157291 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b5d30618-a4f9-452c-92fa-18b542c7a5a5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:07:45.158615 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-a1c6ee43-19e3-47b0-9a86-18188a98819c req-44c20ad3-3a7d-412a-a676-4ecd4aa4ef87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d34c712-7f09-4193-941f-3a623cb994bb", "tag": "2b155b26-7042-4d21-80ba-41edd625ff3d"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:07:45.164862 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b5d30618-a4f9-452c-92fa-18b542c7a5a5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:45.165410 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b5d30618-a4f9-452c-92fa-18b542c7a5a5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:07:45.166317 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b5d30618-a4f9-452c-92fa-18b542c7a5a5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:45.166852 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b5d30618-a4f9-452c-92fa-18b542c7a5a5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:07:45.168859 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-a1c6ee43-19e3-47b0-9a86-18188a98819c req-44c20ad3-3a7d-412a-a676-4ecd4aa4ef87 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:07:45.169388 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-a1c6ee43-19e3-47b0-9a86-18188a98819c req-44c20ad3-3a7d-412a-a676-4ecd4aa4ef87 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:07:45.181379 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-a1c6ee43-19e3-47b0-9a86-18188a98819c req-44c20ad3-3a7d-412a-a676-4ecd4aa4ef87 service nova] Creating event network-changed:2b155b26-7042-4d21-80ba-41edd625ff3d for instance 1d34c712-7f09-4193-941f-3a623cb994bb on nch2-master-1 Apr 16 22:07:45.188115 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-a1c6ee43-19e3-47b0-9a86-18188a98819c req-44c20ad3-3a7d-412a-a676-4ecd4aa4ef87 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033148 Apr 16 22:07:45.189041 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3823/7485] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:07:45.667442 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b5d30618-a4f9-452c-92fa-18b542c7a5a5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:07:45.676867 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b5d30618-a4f9-452c-92fa-18b542c7a5a5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb" status: 200 len: 1565 microversion: 2.1 time: 0.525231 Apr 16 22:07:45.677465 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3663/7486] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:07:45 2022] GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb => generated 1565 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:08:16.956410 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a09dea5e-31ed-4ee0-afac-b04be66ba827 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:08:16.957360 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a09dea5e-31ed-4ee0-afac-b04be66ba827 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:08:16.964402 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a09dea5e-31ed-4ee0-afac-b04be66ba827 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:08:16.964877 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a09dea5e-31ed-4ee0-afac-b04be66ba827 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:08:16.965666 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a09dea5e-31ed-4ee0-afac-b04be66ba827 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:08:16.966125 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a09dea5e-31ed-4ee0-afac-b04be66ba827 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:08:17.013109 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a09dea5e-31ed-4ee0-afac-b04be66ba827 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "POST /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb/action" status: 200 len: 24568 microversion: 2.1 time: 0.061369 Apr 16 22:08:17.014065 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3824/7487] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 22:08:16 2022] POST /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb/action => generated 24568 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 22:08:47.426304 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e36b1698-8cd7-4094-a4e5-3fea18f9ef2f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:08:47.427327 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e36b1698-8cd7-4094-a4e5-3fea18f9ef2f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:08:47.433463 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e36b1698-8cd7-4094-a4e5-3fea18f9ef2f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:08:47.433957 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e36b1698-8cd7-4094-a4e5-3fea18f9ef2f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:08:47.434753 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e36b1698-8cd7-4094-a4e5-3fea18f9ef2f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:08:47.435210 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e36b1698-8cd7-4094-a4e5-3fea18f9ef2f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:08:47.568936 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e36b1698-8cd7-4094-a4e5-3fea18f9ef2f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:08:47.575370 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e36b1698-8cd7-4094-a4e5-3fea18f9ef2f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Old instance type m1.heat2, new instance type m1.heat {{(pid=137409) resize /opt/stack/nova/nova/compute/api.py:4164}} Apr 16 22:08:47.582145 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-e36b1698-8cd7-4094-a4e5-3fea18f9ef2f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 22:08:47.582578 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-e36b1698-8cd7-4094-a4e5-3fea18f9ef2f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 22:08:47.583060 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-e36b1698-8cd7-4094-a4e5-3fea18f9ef2f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 22:08:47.583477 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-e36b1698-8cd7-4094-a4e5-3fea18f9ef2f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 22:08:47.583899 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-e36b1698-8cd7-4094-a4e5-3fea18f9ef2f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 22:08:47.763418 ncdv-master-1 devstack@n-api.service[137409]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e36b1698-8cd7-4094-a4e5-3fea18f9ef2f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [2215982e-3f98-453a-9382-60da1365d30b] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 16 22:08:48.771899 ncdv-master-1 devstack@n-api.service[137409]: INFO oslo.messaging._drivers.impl_rabbit [None req-e36b1698-8cd7-4094-a4e5-3fea18f9ef2f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [2215982e-3f98-453a-9382-60da1365d30b] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 45662. Apr 16 22:08:48.775880 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e36b1698-8cd7-4094-a4e5-3fea18f9ef2f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "POST /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb/action" status: 202 len: 0 microversion: 2.1 time: 1.355024 Apr 16 22:08:48.776532 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3664/7488] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 22:08:47 2022] POST /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb/action => generated 0 bytes in 1357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 22:08:48.785728 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4a882796-fb83-4bcf-ae76-01a326748755 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:08:48.786439 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4a882796-fb83-4bcf-ae76-01a326748755 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:08:48.793586 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4a882796-fb83-4bcf-ae76-01a326748755 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:08:48.794057 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4a882796-fb83-4bcf-ae76-01a326748755 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:08:48.794846 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4a882796-fb83-4bcf-ae76-01a326748755 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:08:48.795299 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4a882796-fb83-4bcf-ae76-01a326748755 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:08:48.926720 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4a882796-fb83-4bcf-ae76-01a326748755 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:08:48.934701 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4a882796-fb83-4bcf-ae76-01a326748755 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb" status: 200 len: 1693 microversion: 2.1 time: 0.153645 Apr 16 22:08:48.935264 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3825/7489] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:08:48 2022] GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb => generated 1693 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:08:49.952538 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5dcbf344-023f-473a-8285-37c307f0179a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:08:49.953149 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5dcbf344-023f-473a-8285-37c307f0179a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:08:49.960423 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5dcbf344-023f-473a-8285-37c307f0179a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:08:49.960882 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5dcbf344-023f-473a-8285-37c307f0179a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:08:49.961653 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5dcbf344-023f-473a-8285-37c307f0179a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:08:49.962098 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5dcbf344-023f-473a-8285-37c307f0179a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:08:50.089240 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5dcbf344-023f-473a-8285-37c307f0179a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:08:50.097112 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5dcbf344-023f-473a-8285-37c307f0179a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb" status: 200 len: 1693 microversion: 2.1 time: 0.149345 Apr 16 22:08:50.097704 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3665/7490] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:08:49 2022] GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb => generated 1693 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 22:08:51.114568 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6f4dce7d-576a-4bf6-a47a-c4c340268b79 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:08:51.115105 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6f4dce7d-576a-4bf6-a47a-c4c340268b79 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:08:51.122152 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6f4dce7d-576a-4bf6-a47a-c4c340268b79 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:08:51.122638 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6f4dce7d-576a-4bf6-a47a-c4c340268b79 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:08:51.123446 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6f4dce7d-576a-4bf6-a47a-c4c340268b79 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:08:51.123914 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6f4dce7d-576a-4bf6-a47a-c4c340268b79 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:08:51.253675 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6f4dce7d-576a-4bf6-a47a-c4c340268b79 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:08:51.261172 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6f4dce7d-576a-4bf6-a47a-c4c340268b79 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb" status: 200 len: 1693 microversion: 2.1 time: 0.150673 Apr 16 22:08:51.261745 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3826/7491] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:08:51 2022] GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb => generated 1693 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:08:52.278419 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-61b308a2-6227-45c2-8897-6034d70d80bb tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:08:52.278970 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-61b308a2-6227-45c2-8897-6034d70d80bb tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:08:52.286647 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-61b308a2-6227-45c2-8897-6034d70d80bb tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:08:52.287127 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-61b308a2-6227-45c2-8897-6034d70d80bb tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:08:52.287911 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-61b308a2-6227-45c2-8897-6034d70d80bb tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:08:52.288396 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-61b308a2-6227-45c2-8897-6034d70d80bb tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:08:52.420831 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-61b308a2-6227-45c2-8897-6034d70d80bb tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:08:52.428355 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-61b308a2-6227-45c2-8897-6034d70d80bb tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb" status: 200 len: 1693 microversion: 2.1 time: 0.154046 Apr 16 22:08:52.428938 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3666/7492] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:08:52 2022] GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb => generated 1693 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:08:53.446304 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cef4c181-e170-4177-8cff-02c0900e4680 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:08:53.446859 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cef4c181-e170-4177-8cff-02c0900e4680 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:08:53.454167 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cef4c181-e170-4177-8cff-02c0900e4680 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:08:53.454640 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cef4c181-e170-4177-8cff-02c0900e4680 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:08:53.455425 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cef4c181-e170-4177-8cff-02c0900e4680 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:08:53.455887 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cef4c181-e170-4177-8cff-02c0900e4680 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:08:53.586533 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cef4c181-e170-4177-8cff-02c0900e4680 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:08:53.594497 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cef4c181-e170-4177-8cff-02c0900e4680 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb" status: 200 len: 1693 microversion: 2.1 time: 0.151578 Apr 16 22:08:53.595062 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3827/7493] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:08:53 2022] GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb => generated 1693 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:08:54.612358 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-258f350b-876f-46b1-93d5-a204031f2947 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:08:54.612982 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-258f350b-876f-46b1-93d5-a204031f2947 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:08:54.618953 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-258f350b-876f-46b1-93d5-a204031f2947 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:08:54.619414 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-258f350b-876f-46b1-93d5-a204031f2947 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:08:54.620296 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-258f350b-876f-46b1-93d5-a204031f2947 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:08:54.620742 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-258f350b-876f-46b1-93d5-a204031f2947 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:08:54.761121 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-258f350b-876f-46b1-93d5-a204031f2947 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:08:54.768832 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-258f350b-876f-46b1-93d5-a204031f2947 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb" status: 200 len: 1693 microversion: 2.1 time: 0.161648 Apr 16 22:08:54.769424 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3667/7494] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:08:54 2022] GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb => generated 1693 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:08:55.786854 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-40eb5fbf-fd58-494f-8777-a7ac57a3db26 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:08:55.787380 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-40eb5fbf-fd58-494f-8777-a7ac57a3db26 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:08:55.794232 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40eb5fbf-fd58-494f-8777-a7ac57a3db26 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:08:55.794710 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40eb5fbf-fd58-494f-8777-a7ac57a3db26 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:08:55.795498 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40eb5fbf-fd58-494f-8777-a7ac57a3db26 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:08:55.795957 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-40eb5fbf-fd58-494f-8777-a7ac57a3db26 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:08:55.932391 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-40eb5fbf-fd58-494f-8777-a7ac57a3db26 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:08:55.939841 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-40eb5fbf-fd58-494f-8777-a7ac57a3db26 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb" status: 200 len: 1693 microversion: 2.1 time: 0.157060 Apr 16 22:08:55.940458 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3828/7495] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:08:55 2022] GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb => generated 1693 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:08:56.956387 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-43e41691-36d0-4264-a0ab-ba0cd8381f80 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:08:56.956964 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-43e41691-36d0-4264-a0ab-ba0cd8381f80 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:08:56.963935 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-43e41691-36d0-4264-a0ab-ba0cd8381f80 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:08:56.964426 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-43e41691-36d0-4264-a0ab-ba0cd8381f80 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:08:56.965216 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-43e41691-36d0-4264-a0ab-ba0cd8381f80 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:08:56.965662 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-43e41691-36d0-4264-a0ab-ba0cd8381f80 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:08:57.104585 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-43e41691-36d0-4264-a0ab-ba0cd8381f80 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:08:57.112846 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-43e41691-36d0-4264-a0ab-ba0cd8381f80 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb" status: 200 len: 1698 microversion: 2.1 time: 0.160491 Apr 16 22:08:57.113421 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3668/7496] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:08:56 2022] GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb => generated 1698 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:08:58.131417 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-76acc256-e563-41e1-845a-a6d4bae0474a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:08:58.132056 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-76acc256-e563-41e1-845a-a6d4bae0474a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:08:58.138157 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-76acc256-e563-41e1-845a-a6d4bae0474a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:08:58.138658 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-76acc256-e563-41e1-845a-a6d4bae0474a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:08:58.139458 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-76acc256-e563-41e1-845a-a6d4bae0474a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:08:58.139924 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-76acc256-e563-41e1-845a-a6d4bae0474a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:08:58.266610 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-76acc256-e563-41e1-845a-a6d4bae0474a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:08:58.274421 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-76acc256-e563-41e1-845a-a6d4bae0474a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb" status: 200 len: 1698 microversion: 2.1 time: 0.147240 Apr 16 22:08:58.274997 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3829/7497] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:08:58 2022] GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb => generated 1698 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:08:59.292345 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2195f59a-398e-40ce-aed9-113fc5c86770 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:08:59.292961 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2195f59a-398e-40ce-aed9-113fc5c86770 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:08:59.300330 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2195f59a-398e-40ce-aed9-113fc5c86770 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:08:59.300791 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2195f59a-398e-40ce-aed9-113fc5c86770 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:08:59.301564 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2195f59a-398e-40ce-aed9-113fc5c86770 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:08:59.302009 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2195f59a-398e-40ce-aed9-113fc5c86770 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:08:59.429806 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2195f59a-398e-40ce-aed9-113fc5c86770 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:08:59.437357 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2195f59a-398e-40ce-aed9-113fc5c86770 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb" status: 200 len: 1698 microversion: 2.1 time: 0.148998 Apr 16 22:08:59.437935 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3669/7498] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:08:59 2022] GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb => generated 1698 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:09:00.454235 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-961150e5-b4fc-4b58-a884-73f132a30b7c tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:09:00.454858 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-961150e5-b4fc-4b58-a884-73f132a30b7c tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:09:00.461872 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-961150e5-b4fc-4b58-a884-73f132a30b7c tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:00.462344 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-961150e5-b4fc-4b58-a884-73f132a30b7c tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:00.463132 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-961150e5-b4fc-4b58-a884-73f132a30b7c tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:00.463612 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-961150e5-b4fc-4b58-a884-73f132a30b7c tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:00.592651 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-961150e5-b4fc-4b58-a884-73f132a30b7c tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:09:00.600357 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-961150e5-b4fc-4b58-a884-73f132a30b7c tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb" status: 200 len: 1698 microversion: 2.1 time: 0.150543 Apr 16 22:09:00.600931 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3830/7499] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:09:00 2022] GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb => generated 1698 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:09:01.618668 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a07f73ce-a18a-4101-b88e-5cb363e66466 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:09:01.619292 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a07f73ce-a18a-4101-b88e-5cb363e66466 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:09:01.627476 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a07f73ce-a18a-4101-b88e-5cb363e66466 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:01.627940 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a07f73ce-a18a-4101-b88e-5cb363e66466 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:01.628757 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a07f73ce-a18a-4101-b88e-5cb363e66466 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:01.629207 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a07f73ce-a18a-4101-b88e-5cb363e66466 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:01.761054 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a07f73ce-a18a-4101-b88e-5cb363e66466 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:09:01.771969 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a07f73ce-a18a-4101-b88e-5cb363e66466 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb" status: 200 len: 1698 microversion: 2.1 time: 0.158339 Apr 16 22:09:01.772549 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3670/7500] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:09:01 2022] GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb => generated 1698 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:09:02.789099 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b509fe32-6907-41b5-ba6f-b15271402f5d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:09:02.789729 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b509fe32-6907-41b5-ba6f-b15271402f5d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:09:02.796668 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b509fe32-6907-41b5-ba6f-b15271402f5d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:02.797139 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b509fe32-6907-41b5-ba6f-b15271402f5d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:02.797921 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b509fe32-6907-41b5-ba6f-b15271402f5d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:02.798375 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b509fe32-6907-41b5-ba6f-b15271402f5d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:02.930311 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b509fe32-6907-41b5-ba6f-b15271402f5d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:09:02.938299 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b509fe32-6907-41b5-ba6f-b15271402f5d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb" status: 200 len: 1698 microversion: 2.1 time: 0.153051 Apr 16 22:09:02.938813 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3831/7501] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:09:02 2022] GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb => generated 1698 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:09:03.955562 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bcccd9a6-007d-427f-a821-ab62caf7e0f6 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:09:03.956111 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bcccd9a6-007d-427f-a821-ab62caf7e0f6 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:09:03.963187 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bcccd9a6-007d-427f-a821-ab62caf7e0f6 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:03.963647 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bcccd9a6-007d-427f-a821-ab62caf7e0f6 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:03.964461 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bcccd9a6-007d-427f-a821-ab62caf7e0f6 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:03.964911 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bcccd9a6-007d-427f-a821-ab62caf7e0f6 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:04.098104 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-bcccd9a6-007d-427f-a821-ab62caf7e0f6 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:09:04.105438 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bcccd9a6-007d-427f-a821-ab62caf7e0f6 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb" status: 200 len: 1698 microversion: 2.1 time: 0.154490 Apr 16 22:09:04.106008 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3671/7502] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:09:03 2022] GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb => generated 1698 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:09:05.122529 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-94a50cbc-d959-4070-897c-e03a3496fd6f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:09:05.123155 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-94a50cbc-d959-4070-897c-e03a3496fd6f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:09:05.129933 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-94a50cbc-d959-4070-897c-e03a3496fd6f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:05.130404 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-94a50cbc-d959-4070-897c-e03a3496fd6f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:05.131185 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-94a50cbc-d959-4070-897c-e03a3496fd6f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:05.131639 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-94a50cbc-d959-4070-897c-e03a3496fd6f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:05.258829 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-94a50cbc-d959-4070-897c-e03a3496fd6f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:09:05.266393 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-94a50cbc-d959-4070-897c-e03a3496fd6f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb" status: 200 len: 1698 microversion: 2.1 time: 0.147730 Apr 16 22:09:05.266971 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3832/7503] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:09:05 2022] GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb => generated 1698 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:09:06.283461 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-684b6b76-71aa-4cad-a0a1-6af0382d04bb tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:09:06.284091 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-684b6b76-71aa-4cad-a0a1-6af0382d04bb tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:09:06.290905 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-684b6b76-71aa-4cad-a0a1-6af0382d04bb tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:06.291372 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-684b6b76-71aa-4cad-a0a1-6af0382d04bb tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:06.292156 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-684b6b76-71aa-4cad-a0a1-6af0382d04bb tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:06.292631 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-684b6b76-71aa-4cad-a0a1-6af0382d04bb tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:06.420735 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-684b6b76-71aa-4cad-a0a1-6af0382d04bb tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:09:06.428591 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-684b6b76-71aa-4cad-a0a1-6af0382d04bb tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb" status: 200 len: 1698 microversion: 2.1 time: 0.149069 Apr 16 22:09:06.429160 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3672/7504] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:09:06 2022] GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb => generated 1698 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:09:07.446750 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ab614f3a-0013-482e-a9f0-b5928772d8b7 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:09:07.447413 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ab614f3a-0013-482e-a9f0-b5928772d8b7 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:09:07.454988 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ab614f3a-0013-482e-a9f0-b5928772d8b7 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:07.455455 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ab614f3a-0013-482e-a9f0-b5928772d8b7 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:07.456314 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ab614f3a-0013-482e-a9f0-b5928772d8b7 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:07.456773 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ab614f3a-0013-482e-a9f0-b5928772d8b7 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:07.589764 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ab614f3a-0013-482e-a9f0-b5928772d8b7 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:09:07.597241 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ab614f3a-0013-482e-a9f0-b5928772d8b7 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb" status: 200 len: 1698 microversion: 2.1 time: 0.154821 Apr 16 22:09:07.598159 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3833/7505] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:09:07 2022] GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb => generated 1698 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:09:08.600705 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-490ae022-c8d7-45f6-a32b-73196c71c82e req-ea86a7f8-2d0b-40af-9265-686bb302ddf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d34c712-7f09-4193-941f-3a623cb994bb", "name": "network-vif-unplugged", "status": "completed", "tag": "2b155b26-7042-4d21-80ba-41edd625ff3d"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:09:08.609860 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-490ae022-c8d7-45f6-a32b-73196c71c82e req-ea86a7f8-2d0b-40af-9265-686bb302ddf7 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:08.610306 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-490ae022-c8d7-45f6-a32b-73196c71c82e req-ea86a7f8-2d0b-40af-9265-686bb302ddf7 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:08.615235 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7a5095c1-5ff8-4662-9ec9-383b231d0a4f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:09:08.616018 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7a5095c1-5ff8-4662-9ec9-383b231d0a4f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:09:08.622332 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-490ae022-c8d7-45f6-a32b-73196c71c82e req-ea86a7f8-2d0b-40af-9265-686bb302ddf7 service nova] Creating event network-vif-unplugged:2b155b26-7042-4d21-80ba-41edd625ff3d for instance 1d34c712-7f09-4193-941f-3a623cb994bb on nch1-master-1 Apr 16 22:09:08.622985 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7a5095c1-5ff8-4662-9ec9-383b231d0a4f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:08.623457 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7a5095c1-5ff8-4662-9ec9-383b231d0a4f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:08.624274 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7a5095c1-5ff8-4662-9ec9-383b231d0a4f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:08.624750 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7a5095c1-5ff8-4662-9ec9-383b231d0a4f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:08.627948 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [req-490ae022-c8d7-45f6-a32b-73196c71c82e req-ea86a7f8-2d0b-40af-9265-686bb302ddf7 service nova] Instance 1d34c712-7f09-4193-941f-3a623cb994bb is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137409) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 16 22:09:08.639455 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-490ae022-c8d7-45f6-a32b-73196c71c82e req-ea86a7f8-2d0b-40af-9265-686bb302ddf7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042533 Apr 16 22:09:08.640582 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3673/7506] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:09:08.760717 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7a5095c1-5ff8-4662-9ec9-383b231d0a4f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:09:08.768942 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7a5095c1-5ff8-4662-9ec9-383b231d0a4f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb" status: 200 len: 1697 microversion: 2.1 time: 0.157628 Apr 16 22:09:08.769599 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3834/7507] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:09:08 2022] GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:09:09.788143 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-acd5d7e8-75a5-4ecc-869e-f6c6bfba2559 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:09:09.788871 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-acd5d7e8-75a5-4ecc-869e-f6c6bfba2559 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:09:09.795281 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-acd5d7e8-75a5-4ecc-869e-f6c6bfba2559 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:09.795742 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-acd5d7e8-75a5-4ecc-869e-f6c6bfba2559 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:09.800232 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-acd5d7e8-75a5-4ecc-869e-f6c6bfba2559 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:09.800895 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-acd5d7e8-75a5-4ecc-869e-f6c6bfba2559 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:09.936955 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-acd5d7e8-75a5-4ecc-869e-f6c6bfba2559 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:09:09.944350 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-acd5d7e8-75a5-4ecc-869e-f6c6bfba2559 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb" status: 200 len: 1697 microversion: 2.1 time: 0.161460 Apr 16 22:09:09.944939 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3674/7508] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:09:09 2022] GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:09:10.654963 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-80e6f4e9-d8b3-4f68-a93e-2dec7d69ee3b req-4d04c148-1479-47d4-ad0c-f6d999c0b743 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d34c712-7f09-4193-941f-3a623cb994bb", "tag": "2b155b26-7042-4d21-80ba-41edd625ff3d"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:09:10.663916 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-80e6f4e9-d8b3-4f68-a93e-2dec7d69ee3b req-4d04c148-1479-47d4-ad0c-f6d999c0b743 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:10.664410 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-80e6f4e9-d8b3-4f68-a93e-2dec7d69ee3b req-4d04c148-1479-47d4-ad0c-f6d999c0b743 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:10.679088 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-80e6f4e9-d8b3-4f68-a93e-2dec7d69ee3b req-4d04c148-1479-47d4-ad0c-f6d999c0b743 service nova] Creating event network-changed:2b155b26-7042-4d21-80ba-41edd625ff3d for instance 1d34c712-7f09-4193-941f-3a623cb994bb on nch1-master-1 Apr 16 22:09:10.684625 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [req-80e6f4e9-d8b3-4f68-a93e-2dec7d69ee3b req-4d04c148-1479-47d4-ad0c-f6d999c0b743 service nova] Instance 1d34c712-7f09-4193-941f-3a623cb994bb is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 16 22:09:10.696077 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-80e6f4e9-d8b3-4f68-a93e-2dec7d69ee3b req-4d04c148-1479-47d4-ad0c-f6d999c0b743 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044839 Apr 16 22:09:10.696739 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3835/7509] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:09:10.962655 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5de99a9d-5cf1-477f-a975-0c14b6c2ac18 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:09:10.963279 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5de99a9d-5cf1-477f-a975-0c14b6c2ac18 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:09:10.970912 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5de99a9d-5cf1-477f-a975-0c14b6c2ac18 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:10.971463 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5de99a9d-5cf1-477f-a975-0c14b6c2ac18 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:10.972315 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5de99a9d-5cf1-477f-a975-0c14b6c2ac18 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:10.972881 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5de99a9d-5cf1-477f-a975-0c14b6c2ac18 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:11.111142 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5de99a9d-5cf1-477f-a975-0c14b6c2ac18 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:09:11.120301 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5de99a9d-5cf1-477f-a975-0c14b6c2ac18 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb" status: 200 len: 1695 microversion: 2.1 time: 0.161861 Apr 16 22:09:11.121230 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3675/7510] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:09:10 2022] GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb => generated 1695 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:09:12.139371 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-11ddcd26-01ad-4837-9b7d-7dcbea93a650 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:09:12.140084 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-11ddcd26-01ad-4837-9b7d-7dcbea93a650 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:09:12.146282 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-11ddcd26-01ad-4837-9b7d-7dcbea93a650 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:12.146755 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-11ddcd26-01ad-4837-9b7d-7dcbea93a650 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:12.147541 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-11ddcd26-01ad-4837-9b7d-7dcbea93a650 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:12.148027 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-11ddcd26-01ad-4837-9b7d-7dcbea93a650 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:12.283000 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-11ddcd26-01ad-4837-9b7d-7dcbea93a650 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:09:12.290705 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-11ddcd26-01ad-4837-9b7d-7dcbea93a650 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb" status: 200 len: 1692 microversion: 2.1 time: 0.156341 Apr 16 22:09:12.291277 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3836/7511] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:09:12 2022] GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:09:12.307315 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9cbd9a26-e26f-4a73-8b97-2da2a11088b0 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:09:12.307865 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9cbd9a26-e26f-4a73-8b97-2da2a11088b0 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:09:12.314706 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9cbd9a26-e26f-4a73-8b97-2da2a11088b0 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:12.315236 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9cbd9a26-e26f-4a73-8b97-2da2a11088b0 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:12.316024 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9cbd9a26-e26f-4a73-8b97-2da2a11088b0 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:12.316505 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9cbd9a26-e26f-4a73-8b97-2da2a11088b0 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:12.485458 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9cbd9a26-e26f-4a73-8b97-2da2a11088b0 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "POST /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb/action" status: 204 len: 0 microversion: 2.1 time: 0.181971 Apr 16 22:09:12.486041 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3676/7512] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 22:09:12 2022] POST /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb/action => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 22:09:12.494492 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-41664ace-4d27-4794-9abf-0e91a0eb91f1 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:09:12.495131 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-41664ace-4d27-4794-9abf-0e91a0eb91f1 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:09:12.501130 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-41664ace-4d27-4794-9abf-0e91a0eb91f1 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:12.501604 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-41664ace-4d27-4794-9abf-0e91a0eb91f1 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:12.502413 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-41664ace-4d27-4794-9abf-0e91a0eb91f1 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:12.502867 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-41664ace-4d27-4794-9abf-0e91a0eb91f1 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:12.661803 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-41664ace-4d27-4794-9abf-0e91a0eb91f1 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:09:12.669269 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-41664ace-4d27-4794-9abf-0e91a0eb91f1 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb" status: 200 len: 1692 microversion: 2.1 time: 0.178653 Apr 16 22:09:12.670073 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3837/7513] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:09:12 2022] GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb => generated 1692 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:09:12.688867 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c7b2b1b0-3f5c-4e99-b660-2ced4443ba53 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:09:12.689618 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c7b2b1b0-3f5c-4e99-b660-2ced4443ba53 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:09:12.695680 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c7b2b1b0-3f5c-4e99-b660-2ced4443ba53 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:12.699019 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c7b2b1b0-3f5c-4e99-b660-2ced4443ba53 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:12.699019 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c7b2b1b0-3f5c-4e99-b660-2ced4443ba53 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:12.699019 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c7b2b1b0-3f5c-4e99-b660-2ced4443ba53 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:12.838906 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c7b2b1b0-3f5c-4e99-b660-2ced4443ba53 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:09:12.846863 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c7b2b1b0-3f5c-4e99-b660-2ced4443ba53 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb" status: 200 len: 1692 microversion: 2.1 time: 0.164406 Apr 16 22:09:12.847675 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3677/7514] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:09:12 2022] GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb => generated 1692 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 22:09:13.479804 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-5c94fcbd-1a43-4599-bbb6-6c55a9f5b4e3 req-f3fdd81e-7203-470b-abee-371297b3e4d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d34c712-7f09-4193-941f-3a623cb994bb", "name": "network-vif-plugged", "status": "completed", "tag": "2b155b26-7042-4d21-80ba-41edd625ff3d"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:09:13.489443 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-5c94fcbd-1a43-4599-bbb6-6c55a9f5b4e3 req-f3fdd81e-7203-470b-abee-371297b3e4d4 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:13.489943 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-5c94fcbd-1a43-4599-bbb6-6c55a9f5b4e3 req-f3fdd81e-7203-470b-abee-371297b3e4d4 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:13.501775 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-5c94fcbd-1a43-4599-bbb6-6c55a9f5b4e3 req-f3fdd81e-7203-470b-abee-371297b3e4d4 service nova] Creating event network-vif-plugged:2b155b26-7042-4d21-80ba-41edd625ff3d for instance 1d34c712-7f09-4193-941f-3a623cb994bb on nch1-master-1 Apr 16 22:09:13.506918 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [req-5c94fcbd-1a43-4599-bbb6-6c55a9f5b4e3 req-f3fdd81e-7203-470b-abee-371297b3e4d4 service nova] Instance 1d34c712-7f09-4193-941f-3a623cb994bb is migrating within the same cell, copying events to all relevant hosts: {'nch1-master-1', 'nch2-master-1'} {{(pid=137408) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5805}} Apr 16 22:09:13.517929 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-5c94fcbd-1a43-4599-bbb6-6c55a9f5b4e3 req-f3fdd81e-7203-470b-abee-371297b3e4d4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042270 Apr 16 22:09:13.518551 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3838/7515] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:09:13.864033 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-98a7cc6b-4945-4c8d-8f71-3160a4e62b53 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:09:13.864716 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-98a7cc6b-4945-4c8d-8f71-3160a4e62b53 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:09:13.871498 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-98a7cc6b-4945-4c8d-8f71-3160a4e62b53 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:13.877784 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-98a7cc6b-4945-4c8d-8f71-3160a4e62b53 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:13.877784 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-98a7cc6b-4945-4c8d-8f71-3160a4e62b53 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:13.877784 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-98a7cc6b-4945-4c8d-8f71-3160a4e62b53 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:14.006898 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-98a7cc6b-4945-4c8d-8f71-3160a4e62b53 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:09:14.016467 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-98a7cc6b-4945-4c8d-8f71-3160a4e62b53 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb" status: 200 len: 1692 microversion: 2.1 time: 0.156357 Apr 16 22:09:14.019400 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3678/7516] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:09:13 2022] GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:09:15.036570 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-34a80b20-15e9-407e-bef2-d7e2910fe972 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:09:15.037219 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-34a80b20-15e9-407e-bef2-d7e2910fe972 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:09:15.043455 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-34a80b20-15e9-407e-bef2-d7e2910fe972 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:15.043937 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-34a80b20-15e9-407e-bef2-d7e2910fe972 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:15.044765 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-34a80b20-15e9-407e-bef2-d7e2910fe972 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:15.045233 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-34a80b20-15e9-407e-bef2-d7e2910fe972 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:15.179873 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-34a80b20-15e9-407e-bef2-d7e2910fe972 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:09:15.187431 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-34a80b20-15e9-407e-bef2-d7e2910fe972 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb" status: 200 len: 1684 microversion: 2.1 time: 0.156529 Apr 16 22:09:15.188044 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3839/7517] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:09:15 2022] GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:09:35.395806 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-13283772-4897-433c-af26-66b873404d8a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:09:35.396818 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-13283772-4897-433c-af26-66b873404d8a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:09:35.402731 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-13283772-4897-433c-af26-66b873404d8a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:35.403192 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-13283772-4897-433c-af26-66b873404d8a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:35.403973 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-13283772-4897-433c-af26-66b873404d8a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:35.404447 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-13283772-4897-433c-af26-66b873404d8a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:35.455151 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-13283772-4897-433c-af26-66b873404d8a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "POST /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb/action" status: 200 len: 24582 microversion: 2.1 time: 0.109034 Apr 16 22:09:35.455960 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3679/7518] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 22:09:35 2022] POST /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb/action => generated 24582 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 22:09:42.956582 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a61bdc6d-5051-4ba5-a4c1-9172dd34f6c3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:09:42.957127 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a61bdc6d-5051-4ba5-a4c1-9172dd34f6c3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:09:42.959325 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-9ddfcf31-070e-4bf1-bf1d-164389bb7bda req-90cad374-0b7c-4832-89ff-c679dca3fa2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1d34c712-7f09-4193-941f-3a623cb994bb", "tag": "2b155b26-7042-4d21-80ba-41edd625ff3d"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:09:42.964384 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a61bdc6d-5051-4ba5-a4c1-9172dd34f6c3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:42.965204 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a61bdc6d-5051-4ba5-a4c1-9172dd34f6c3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:42.966065 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a61bdc6d-5051-4ba5-a4c1-9172dd34f6c3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:42.966667 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a61bdc6d-5051-4ba5-a4c1-9172dd34f6c3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:42.969273 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-9ddfcf31-070e-4bf1-bf1d-164389bb7bda req-90cad374-0b7c-4832-89ff-c679dca3fa2a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:42.970297 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-9ddfcf31-070e-4bf1-bf1d-164389bb7bda req-90cad374-0b7c-4832-89ff-c679dca3fa2a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:42.982629 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-9ddfcf31-070e-4bf1-bf1d-164389bb7bda req-90cad374-0b7c-4832-89ff-c679dca3fa2a service nova] Creating event network-changed:2b155b26-7042-4d21-80ba-41edd625ff3d for instance 1d34c712-7f09-4193-941f-3a623cb994bb on nch1-master-1 Apr 16 22:09:42.988659 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-9ddfcf31-070e-4bf1-bf1d-164389bb7bda req-90cad374-0b7c-4832-89ff-c679dca3fa2a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034139 Apr 16 22:09:42.989600 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3680/7519] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:09:42.996338 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a61bdc6d-5051-4ba5-a4c1-9172dd34f6c3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 22:09:43.273111 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a61bdc6d-5051-4ba5-a4c1-9172dd34f6c3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb" status: 204 len: 0 microversion: 2.1 time: 0.321207 Apr 16 22:09:43.273778 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3840/7520] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 22:09:42 2022] DELETE /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 22:09:43.283026 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6d16cd1c-3c94-43b1-845c-9af87bc66ac3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:09:43.283733 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6d16cd1c-3c94-43b1-845c-9af87bc66ac3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:09:43.290110 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6d16cd1c-3c94-43b1-845c-9af87bc66ac3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:43.290570 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6d16cd1c-3c94-43b1-845c-9af87bc66ac3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:43.291357 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6d16cd1c-3c94-43b1-845c-9af87bc66ac3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:43.291806 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6d16cd1c-3c94-43b1-845c-9af87bc66ac3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:43.426012 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6d16cd1c-3c94-43b1-845c-9af87bc66ac3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:09:43.434485 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6d16cd1c-3c94-43b1-845c-9af87bc66ac3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb" status: 200 len: 1690 microversion: 2.1 time: 0.156181 Apr 16 22:09:43.435065 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3681/7521] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:09:43 2022] GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:09:44.452381 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c3b98ddf-75f5-4083-820a-72b585fb9224 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:09:44.453014 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c3b98ddf-75f5-4083-820a-72b585fb9224 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:09:44.460892 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3b98ddf-75f5-4083-820a-72b585fb9224 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:44.461376 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3b98ddf-75f5-4083-820a-72b585fb9224 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:44.462208 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3b98ddf-75f5-4083-820a-72b585fb9224 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:44.462668 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c3b98ddf-75f5-4083-820a-72b585fb9224 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:44.599824 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-c3b98ddf-75f5-4083-820a-72b585fb9224 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:09:44.607624 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c3b98ddf-75f5-4083-820a-72b585fb9224 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb" status: 200 len: 1690 microversion: 2.1 time: 0.159596 Apr 16 22:09:44.608224 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3841/7522] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:09:44 2022] GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb => generated 1690 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:09:45.177444 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-902a96e3-6bc5-471f-8372-550cdfd9d2a6 req-e66163e4-d4d7-433f-b713-5699316f24f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1d34c712-7f09-4193-941f-3a623cb994bb", "name": "network-vif-deleted", "tag": "2b155b26-7042-4d21-80ba-41edd625ff3d"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:09:45.186203 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-902a96e3-6bc5-471f-8372-550cdfd9d2a6 req-e66163e4-d4d7-433f-b713-5699316f24f0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:45.186659 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-902a96e3-6bc5-471f-8372-550cdfd9d2a6 req-e66163e4-d4d7-433f-b713-5699316f24f0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:45.197545 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-902a96e3-6bc5-471f-8372-550cdfd9d2a6 req-e66163e4-d4d7-433f-b713-5699316f24f0 service nova] Creating event network-vif-deleted:2b155b26-7042-4d21-80ba-41edd625ff3d for instance 1d34c712-7f09-4193-941f-3a623cb994bb on nch1-master-1 Apr 16 22:09:45.202397 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-902a96e3-6bc5-471f-8372-550cdfd9d2a6 req-e66163e4-d4d7-433f-b713-5699316f24f0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028810 Apr 16 22:09:45.202990 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3682/7523] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 22:09:45.625197 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-31c73e32-d1a5-4493-800f-d9a7e61b91fc tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:09:45.626272 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-31c73e32-d1a5-4493-800f-d9a7e61b91fc tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:09:45.633179 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-31c73e32-d1a5-4493-800f-d9a7e61b91fc tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:45.633613 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-31c73e32-d1a5-4493-800f-d9a7e61b91fc tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:45.634411 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-31c73e32-d1a5-4493-800f-d9a7e61b91fc tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:45.634875 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-31c73e32-d1a5-4493-800f-d9a7e61b91fc tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:45.667557 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-31c73e32-d1a5-4493-800f-d9a7e61b91fc tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:45.668028 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-31c73e32-d1a5-4493-800f-d9a7e61b91fc tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:45.668526 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-31c73e32-d1a5-4493-800f-d9a7e61b91fc tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lazy-loading 'fault' on Instance uuid 1d34c712-7f09-4193-941f-3a623cb994bb {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 22:09:45.709631 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-31c73e32-d1a5-4493-800f-d9a7e61b91fc tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:09:45.716981 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-31c73e32-d1a5-4493-800f-d9a7e61b91fc tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb" status: 200 len: 1357 microversion: 2.1 time: 0.095777 Apr 16 22:09:45.717550 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3842/7524] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:09:45 2022] GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb => generated 1357 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:09:46.735727 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-40f0f36a-71a1-4063-b86d-9f3d0c81e2e9 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:09:46.736508 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-40f0f36a-71a1-4063-b86d-9f3d0c81e2e9 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: 1d34c712-7f09-4193-941f-3a623cb994bb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:09:46.742652 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-40f0f36a-71a1-4063-b86d-9f3d0c81e2e9 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:46.743111 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-40f0f36a-71a1-4063-b86d-9f3d0c81e2e9 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:46.743986 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-40f0f36a-71a1-4063-b86d-9f3d0c81e2e9 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:46.744462 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-40f0f36a-71a1-4063-b86d-9f3d0c81e2e9 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:46.757408 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-40f0f36a-71a1-4063-b86d-9f3d0c81e2e9 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] HTTP exception thrown: Instance 1d34c712-7f09-4193-941f-3a623cb994bb could not be found. Apr 16 22:09:46.757999 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-40f0f36a-71a1-4063-b86d-9f3d0c81e2e9 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Returning 404 to user: Instance 1d34c712-7f09-4193-941f-3a623cb994bb could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 22:09:46.758821 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-40f0f36a-71a1-4063-b86d-9f3d0c81e2e9 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb" status: 404 len: 111 microversion: 2.1 time: 0.028290 Apr 16 22:09:46.759376 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3683/7525] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:09:46 2022] GET /compute/v2.1/servers/1d34c712-7f09-4193-941f-3a623cb994bb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 22:09:50.148593 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-134315e1-e2bd-4a58-a0f3-8c989a27e047 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '.version_select at 0x7fbb96773790>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:09:50.151868 ncdv-master-1 devstack@n-api.service[137408]: ERROR oslo.messaging._drivers.impl_rabbit [None req-134315e1-e2bd-4a58-a0f3-8c989a27e047 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [3901b61f-3e1c-4ff6-b469-98dd356d3000] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 16 22:09:51.160198 ncdv-master-1 devstack@n-api.service[137408]: INFO oslo.messaging._drivers.impl_rabbit [None req-134315e1-e2bd-4a58-a0f3-8c989a27e047 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [3901b61f-3e1c-4ff6-b469-98dd356d3000] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 45836. Apr 16 22:09:51.218279 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-134315e1-e2bd-4a58-a0f3-8c989a27e047 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1574425534" status: 202 len: 0 microversion: 2.1 time: 1.073981 Apr 16 22:09:51.218866 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3843/7526] 10.222.0.20 () {58 vars in 1283 bytes} [Sat Apr 16 22:09:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1574425534 => generated 0 bytes in 1075 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 22:09:51.244560 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b10bb3e6-0f60-4db0-bc35-cf0e72388f82 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Action: 'create', calling method: .version_select at 0x7fbb9627aca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-340581989"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:09:51.259139 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-b10bb3e6-0f60-4db0-bc35-cf0e72388f82 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Getting quotas for project 3d4eaa0fe99e42488e0720b18be48ac8. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 22:09:51.264966 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-b10bb3e6-0f60-4db0-bc35-cf0e72388f82 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Getting quotas for user 8fa5c4f477214df880fc12d6da76283a and project 3d4eaa0fe99e42488e0720b18be48ac8. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 22:09:51.433368 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-b10bb3e6-0f60-4db0-bc35-cf0e72388f82 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Getting quotas for project 3d4eaa0fe99e42488e0720b18be48ac8. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 22:09:51.438470 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-b10bb3e6-0f60-4db0-bc35-cf0e72388f82 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Getting quotas for user 8fa5c4f477214df880fc12d6da76283a and project 3d4eaa0fe99e42488e0720b18be48ac8. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 22:09:51.453637 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b10bb3e6-0f60-4db0-bc35-cf0e72388f82 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.213104 Apr 16 22:09:51.454281 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3684/7527] 10.222.0.20 () {60 vars in 1157 bytes} [Sat Apr 16 22:09:51 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:09:59.342885 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ee40161b-2bd7-472e-af35-fb35f04ee4d3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-685889338", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "811dbeab-8b8b-48f9-87b3-9a6a42f81d7a"}], "key_name": "tempest-TestNetworkAdvancedServerOps-340581989", "security_groups": [{"name": "tempest-secgroup-smoke-927136249"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:09:59.471566 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-ee40161b-2bd7-472e-af35-fb35f04ee4d3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] validate_networks() for [('811dbeab-8b8b-48f9-87b3-9a6a42f81d7a', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 22:09:59.912460 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-ee40161b-2bd7-472e-af35-fb35f04ee4d3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 22:09:59.913174 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-ee40161b-2bd7-472e-af35-fb35f04ee4d3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 22:09:59.914007 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-ee40161b-2bd7-472e-af35-fb35f04ee4d3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 22:09:59.915179 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-ee40161b-2bd7-472e-af35-fb35f04ee4d3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 22:09:59.915749 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-ee40161b-2bd7-472e-af35-fb35f04ee4d3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 22:09:59.925803 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee40161b-2bd7-472e-af35-fb35f04ee4d3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:59.926640 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee40161b-2bd7-472e-af35-fb35f04ee4d3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:59.927697 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee40161b-2bd7-472e-af35-fb35f04ee4d3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:09:59.928426 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee40161b-2bd7-472e-af35-fb35f04ee4d3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:09:59.953946 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-ee40161b-2bd7-472e-af35-fb35f04ee4d3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Getting quotas for project 3d4eaa0fe99e42488e0720b18be48ac8. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 22:09:59.960804 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-ee40161b-2bd7-472e-af35-fb35f04ee4d3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Getting quotas for user 8fa5c4f477214df880fc12d6da76283a and project 3d4eaa0fe99e42488e0720b18be48ac8. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 22:09:59.975907 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ee40161b-2bd7-472e-af35-fb35f04ee4d3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 22:09:59.984339 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ee40161b-2bd7-472e-af35-fb35f04ee4d3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: d34d71da-0773-4744-b070-b79c256dd335] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 22:10:00.147298 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ee40161b-2bd7-472e-af35-fb35f04ee4d3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.811731 Apr 16 22:10:00.154484 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3844/7528] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 22:09:59 2022] POST /compute/v2.1/servers => generated 405 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 22:10:00.164845 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-42605951-e285-46b4-ad97-fe6096a0cc69 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:10:00.166007 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-42605951-e285-46b4-ad97-fe6096a0cc69 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: d34d71da-0773-4744-b070-b79c256dd335] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:10:00.233244 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-42605951-e285-46b4-ad97-fe6096a0cc69 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:10:00.243183 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-42605951-e285-46b4-ad97-fe6096a0cc69 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335" status: 200 len: 1265 microversion: 2.1 time: 0.081015 Apr 16 22:10:00.243183 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3685/7529] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:10:00 2022] GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335 => generated 1265 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 22:10:01.260340 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-219507e5-7362-49e5-b049-0362cece5c95 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:10:01.260979 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-219507e5-7362-49e5-b049-0362cece5c95 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: d34d71da-0773-4744-b070-b79c256dd335] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:10:01.267242 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-219507e5-7362-49e5-b049-0362cece5c95 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:10:01.267721 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-219507e5-7362-49e5-b049-0362cece5c95 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:10:01.268607 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-219507e5-7362-49e5-b049-0362cece5c95 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:10:01.269083 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-219507e5-7362-49e5-b049-0362cece5c95 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:10:01.348972 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-219507e5-7362-49e5-b049-0362cece5c95 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:10:01.358000 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-219507e5-7362-49e5-b049-0362cece5c95 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335" status: 200 len: 1269 microversion: 2.1 time: 0.102889 Apr 16 22:10:01.358942 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3845/7530] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:10:01 2022] GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335 => generated 1269 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:10:02.375871 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bbbdfaca-a7cd-4b85-b139-6546dd0b6a1d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:10:02.376702 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bbbdfaca-a7cd-4b85-b139-6546dd0b6a1d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: d34d71da-0773-4744-b070-b79c256dd335] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:10:02.385073 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bbbdfaca-a7cd-4b85-b139-6546dd0b6a1d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:10:02.385626 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bbbdfaca-a7cd-4b85-b139-6546dd0b6a1d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:10:02.386486 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bbbdfaca-a7cd-4b85-b139-6546dd0b6a1d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:10:02.386940 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bbbdfaca-a7cd-4b85-b139-6546dd0b6a1d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:10:02.456146 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-bbbdfaca-a7cd-4b85-b139-6546dd0b6a1d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:10:02.464033 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bbbdfaca-a7cd-4b85-b139-6546dd0b6a1d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335" status: 200 len: 1323 microversion: 2.1 time: 0.092174 Apr 16 22:10:02.464640 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3686/7531] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:10:02 2022] GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335 => generated 1323 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:10:03.482450 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e2e66998-2d54-46f9-9bc9-982e4be82d9e tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:10:03.483141 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e2e66998-2d54-46f9-9bc9-982e4be82d9e tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: d34d71da-0773-4744-b070-b79c256dd335] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:10:03.491430 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e2e66998-2d54-46f9-9bc9-982e4be82d9e tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:10:03.492362 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e2e66998-2d54-46f9-9bc9-982e4be82d9e tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:10:03.493224 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e2e66998-2d54-46f9-9bc9-982e4be82d9e tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:10:03.493689 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e2e66998-2d54-46f9-9bc9-982e4be82d9e tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:10:03.713293 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e2e66998-2d54-46f9-9bc9-982e4be82d9e tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:10:03.720834 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e2e66998-2d54-46f9-9bc9-982e4be82d9e tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335" status: 200 len: 1390 microversion: 2.1 time: 0.242833 Apr 16 22:10:03.721420 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3846/7532] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:10:03 2022] GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335 => generated 1390 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 22:10:04.190935 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-43668a14-14d0-4b05-9a3f-8b68ee041cc4 req-bff29078-d3b1-4f3d-bc47-02f278cda06a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d34d71da-0773-4744-b070-b79c256dd335", "tag": "65d5e816-151e-46af-82bb-233d5489487a"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:10:04.199908 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-43668a14-14d0-4b05-9a3f-8b68ee041cc4 req-bff29078-d3b1-4f3d-bc47-02f278cda06a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:10:04.200752 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-43668a14-14d0-4b05-9a3f-8b68ee041cc4 req-bff29078-d3b1-4f3d-bc47-02f278cda06a service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:10:04.217608 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-43668a14-14d0-4b05-9a3f-8b68ee041cc4 req-bff29078-d3b1-4f3d-bc47-02f278cda06a service nova] Creating event network-changed:65d5e816-151e-46af-82bb-233d5489487a for instance d34d71da-0773-4744-b070-b79c256dd335 on nch2-master-1 Apr 16 22:10:04.223170 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-43668a14-14d0-4b05-9a3f-8b68ee041cc4 req-bff29078-d3b1-4f3d-bc47-02f278cda06a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038738 Apr 16 22:10:04.223782 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3687/7533] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:10:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:10:04.737173 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b5fab0e2-c344-46e2-a405-c7fb6fe93b7f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:10:04.738050 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b5fab0e2-c344-46e2-a405-c7fb6fe93b7f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: d34d71da-0773-4744-b070-b79c256dd335] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:10:04.744975 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5fab0e2-c344-46e2-a405-c7fb6fe93b7f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:10:04.745505 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5fab0e2-c344-46e2-a405-c7fb6fe93b7f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:10:04.746251 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5fab0e2-c344-46e2-a405-c7fb6fe93b7f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:10:04.746715 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b5fab0e2-c344-46e2-a405-c7fb6fe93b7f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:10:04.951036 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b5fab0e2-c344-46e2-a405-c7fb6fe93b7f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:10:04.959260 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b5fab0e2-c344-46e2-a405-c7fb6fe93b7f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335" status: 200 len: 1390 microversion: 2.1 time: 0.225695 Apr 16 22:10:04.959841 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3847/7534] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:10:04 2022] GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335 => generated 1390 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:10:05.978234 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-b80a4cb8-9d9e-4fae-b609-7d9eb66a2f73 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:10:05.979052 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-b80a4cb8-9d9e-4fae-b609-7d9eb66a2f73 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: d34d71da-0773-4744-b070-b79c256dd335] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:10:05.985410 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b80a4cb8-9d9e-4fae-b609-7d9eb66a2f73 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:10:05.985877 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b80a4cb8-9d9e-4fae-b609-7d9eb66a2f73 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:10:05.986691 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b80a4cb8-9d9e-4fae-b609-7d9eb66a2f73 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:10:05.987705 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-b80a4cb8-9d9e-4fae-b609-7d9eb66a2f73 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:10:06.119840 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-b80a4cb8-9d9e-4fae-b609-7d9eb66a2f73 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:10:06.127159 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-b80a4cb8-9d9e-4fae-b609-7d9eb66a2f73 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335" status: 200 len: 1390 microversion: 2.1 time: 0.154237 Apr 16 22:10:06.127789 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3688/7535] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:10:05 2022] GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335 => generated 1390 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:10:07.143870 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5f0370e0-8bab-4e87-8006-e83bb5891dc0 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:10:07.144642 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5f0370e0-8bab-4e87-8006-e83bb5891dc0 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: d34d71da-0773-4744-b070-b79c256dd335] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:10:07.151401 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5f0370e0-8bab-4e87-8006-e83bb5891dc0 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:10:07.151884 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5f0370e0-8bab-4e87-8006-e83bb5891dc0 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:10:07.152717 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5f0370e0-8bab-4e87-8006-e83bb5891dc0 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:10:07.153177 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5f0370e0-8bab-4e87-8006-e83bb5891dc0 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:10:07.282974 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5f0370e0-8bab-4e87-8006-e83bb5891dc0 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:10:07.290908 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5f0370e0-8bab-4e87-8006-e83bb5891dc0 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335" status: 200 len: 1390 microversion: 2.1 time: 0.151021 Apr 16 22:10:07.291477 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3848/7536] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:10:07 2022] GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335 => generated 1390 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:10:08.308521 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5295713b-dc1b-4bc8-b7dc-9e08006866d4 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:10:08.309174 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5295713b-dc1b-4bc8-b7dc-9e08006866d4 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: d34d71da-0773-4744-b070-b79c256dd335] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:10:08.316763 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5295713b-dc1b-4bc8-b7dc-9e08006866d4 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:10:08.317177 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5295713b-dc1b-4bc8-b7dc-9e08006866d4 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:10:08.317964 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5295713b-dc1b-4bc8-b7dc-9e08006866d4 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:10:08.318419 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5295713b-dc1b-4bc8-b7dc-9e08006866d4 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:10:08.445195 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5295713b-dc1b-4bc8-b7dc-9e08006866d4 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:10:08.452653 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5295713b-dc1b-4bc8-b7dc-9e08006866d4 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335" status: 200 len: 1390 microversion: 2.1 time: 0.148133 Apr 16 22:10:08.453226 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3689/7537] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:10:08 2022] GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335 => generated 1390 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:10:09.469885 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-921033f7-215d-42e7-a0a6-859e192a1f6c tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:10:09.470510 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-921033f7-215d-42e7-a0a6-859e192a1f6c tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: d34d71da-0773-4744-b070-b79c256dd335] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:10:09.477733 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-921033f7-215d-42e7-a0a6-859e192a1f6c tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:10:09.478200 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-921033f7-215d-42e7-a0a6-859e192a1f6c tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:10:09.479001 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-921033f7-215d-42e7-a0a6-859e192a1f6c tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:10:09.479455 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-921033f7-215d-42e7-a0a6-859e192a1f6c tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:10:09.609950 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-921033f7-215d-42e7-a0a6-859e192a1f6c tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:10:09.617793 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-921033f7-215d-42e7-a0a6-859e192a1f6c tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335" status: 200 len: 1390 microversion: 2.1 time: 0.151864 Apr 16 22:10:09.618368 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3849/7538] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:10:09 2022] GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335 => generated 1390 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:10:10.634426 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9f320b9f-2bcd-467c-bfdd-cca6a6c97613 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:10:10.635042 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9f320b9f-2bcd-467c-bfdd-cca6a6c97613 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: d34d71da-0773-4744-b070-b79c256dd335] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:10:10.641796 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9f320b9f-2bcd-467c-bfdd-cca6a6c97613 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:10:10.642253 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9f320b9f-2bcd-467c-bfdd-cca6a6c97613 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:10:10.643024 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9f320b9f-2bcd-467c-bfdd-cca6a6c97613 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:10:10.643468 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9f320b9f-2bcd-467c-bfdd-cca6a6c97613 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:10:10.776630 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9f320b9f-2bcd-467c-bfdd-cca6a6c97613 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:10:10.783945 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9f320b9f-2bcd-467c-bfdd-cca6a6c97613 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335" status: 200 len: 1390 microversion: 2.1 time: 0.153484 Apr 16 22:10:10.784620 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3690/7539] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:10:10 2022] GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335 => generated 1390 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:10:11.369305 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-6833cf60-2ef7-418e-b79c-9a7cb0080cc0 req-ca73724d-63ca-4567-9df9-d6e0683e9666 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d34d71da-0773-4744-b070-b79c256dd335", "name": "network-vif-plugged", "status": "completed", "tag": "65d5e816-151e-46af-82bb-233d5489487a"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:10:11.378876 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-6833cf60-2ef7-418e-b79c-9a7cb0080cc0 req-ca73724d-63ca-4567-9df9-d6e0683e9666 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:10:11.379346 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-6833cf60-2ef7-418e-b79c-9a7cb0080cc0 req-ca73724d-63ca-4567-9df9-d6e0683e9666 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:10:11.390071 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-6833cf60-2ef7-418e-b79c-9a7cb0080cc0 req-ca73724d-63ca-4567-9df9-d6e0683e9666 service nova] Creating event network-vif-plugged:65d5e816-151e-46af-82bb-233d5489487a for instance d34d71da-0773-4744-b070-b79c256dd335 on nch2-master-1 Apr 16 22:10:11.395563 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-6833cf60-2ef7-418e-b79c-9a7cb0080cc0 req-ca73724d-63ca-4567-9df9-d6e0683e9666 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030148 Apr 16 22:10:11.396143 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3850/7540] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:10:11.801015 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5f745550-dcd0-432d-afe5-b71528ca19ed tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:10:11.801643 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5f745550-dcd0-432d-afe5-b71528ca19ed tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: d34d71da-0773-4744-b070-b79c256dd335] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:10:11.808526 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5f745550-dcd0-432d-afe5-b71528ca19ed tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:10:11.808995 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5f745550-dcd0-432d-afe5-b71528ca19ed tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:10:11.809784 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5f745550-dcd0-432d-afe5-b71528ca19ed tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:10:11.810238 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5f745550-dcd0-432d-afe5-b71528ca19ed tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:10:11.938388 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5f745550-dcd0-432d-afe5-b71528ca19ed tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:10:11.946309 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5f745550-dcd0-432d-afe5-b71528ca19ed tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335" status: 200 len: 1390 microversion: 2.1 time: 0.149380 Apr 16 22:10:11.946894 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3691/7541] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:10:11 2022] GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335 => generated 1390 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:10:12.964221 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4c1165e2-7286-412e-a5f7-e9f46b3b5fa6 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:10:12.964866 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4c1165e2-7286-412e-a5f7-e9f46b3b5fa6 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: d34d71da-0773-4744-b070-b79c256dd335] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:10:12.971737 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4c1165e2-7286-412e-a5f7-e9f46b3b5fa6 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:10:12.972900 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4c1165e2-7286-412e-a5f7-e9f46b3b5fa6 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:10:12.973699 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4c1165e2-7286-412e-a5f7-e9f46b3b5fa6 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:10:12.974222 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4c1165e2-7286-412e-a5f7-e9f46b3b5fa6 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:10:13.104808 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4c1165e2-7286-412e-a5f7-e9f46b3b5fa6 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:10:13.112184 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4c1165e2-7286-412e-a5f7-e9f46b3b5fa6 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335" status: 200 len: 1563 microversion: 2.1 time: 0.152329 Apr 16 22:10:13.112769 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3851/7542] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:10:12 2022] GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:10:13.128293 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5fd865fe-7d6c-4596-88a2-9e9cfc3c49f9 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:10:13.128922 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5fd865fe-7d6c-4596-88a2-9e9cfc3c49f9 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: d34d71da-0773-4744-b070-b79c256dd335] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:10:13.135619 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5fd865fe-7d6c-4596-88a2-9e9cfc3c49f9 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:10:13.136090 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5fd865fe-7d6c-4596-88a2-9e9cfc3c49f9 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:10:13.136914 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5fd865fe-7d6c-4596-88a2-9e9cfc3c49f9 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:10:13.137375 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5fd865fe-7d6c-4596-88a2-9e9cfc3c49f9 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:10:13.269690 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5fd865fe-7d6c-4596-88a2-9e9cfc3c49f9 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:10:13.277197 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5fd865fe-7d6c-4596-88a2-9e9cfc3c49f9 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335" status: 200 len: 1563 microversion: 2.1 time: 0.152905 Apr 16 22:10:13.277778 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3692/7543] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:10:13 2022] GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335 => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:10:15.554581 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2b1b583a-a581-4fe7-8a6b-9aa73ef6eb34 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:10:15.555481 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2b1b583a-a581-4fe7-8a6b-9aa73ef6eb34 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: d34d71da-0773-4744-b070-b79c256dd335] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:10:15.555923 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-2e4bdbc6-aa48-4fb5-9163-a7f4dad10e05 req-572951d7-9ba3-4aef-aed0-eadbcd7fe513 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d34d71da-0773-4744-b070-b79c256dd335", "tag": "65d5e816-151e-46af-82bb-233d5489487a"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:10:15.563353 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b1b583a-a581-4fe7-8a6b-9aa73ef6eb34 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:10:15.563823 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b1b583a-a581-4fe7-8a6b-9aa73ef6eb34 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:10:15.564688 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b1b583a-a581-4fe7-8a6b-9aa73ef6eb34 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:10:15.565175 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b1b583a-a581-4fe7-8a6b-9aa73ef6eb34 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:10:15.565537 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-2e4bdbc6-aa48-4fb5-9163-a7f4dad10e05 req-572951d7-9ba3-4aef-aed0-eadbcd7fe513 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:10:15.565977 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-2e4bdbc6-aa48-4fb5-9163-a7f4dad10e05 req-572951d7-9ba3-4aef-aed0-eadbcd7fe513 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:10:15.577616 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-2e4bdbc6-aa48-4fb5-9163-a7f4dad10e05 req-572951d7-9ba3-4aef-aed0-eadbcd7fe513 service nova] Creating event network-changed:65d5e816-151e-46af-82bb-233d5489487a for instance d34d71da-0773-4744-b070-b79c256dd335 on nch2-master-1 Apr 16 22:10:15.585939 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-2e4bdbc6-aa48-4fb5-9163-a7f4dad10e05 req-572951d7-9ba3-4aef-aed0-eadbcd7fe513 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030671 Apr 16 22:10:15.585939 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3693/7544] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 22:10:15.795865 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2b1b583a-a581-4fe7-8a6b-9aa73ef6eb34 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:10:15.811146 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2b1b583a-a581-4fe7-8a6b-9aa73ef6eb34 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335" status: 200 len: 1563 microversion: 2.1 time: 0.261647 Apr 16 22:10:15.811744 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3852/7545] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:10:15 2022] GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335 => generated 1563 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:10:47.135204 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5f80ad3f-1a89-4687-9941-b4144e95c333 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:10:47.136266 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5f80ad3f-1a89-4687-9941-b4144e95c333 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: d34d71da-0773-4744-b070-b79c256dd335] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:10:47.142476 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5f80ad3f-1a89-4687-9941-b4144e95c333 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:10:47.142942 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5f80ad3f-1a89-4687-9941-b4144e95c333 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:10:47.143725 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5f80ad3f-1a89-4687-9941-b4144e95c333 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:10:47.144201 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5f80ad3f-1a89-4687-9941-b4144e95c333 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:10:47.192590 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5f80ad3f-1a89-4687-9941-b4144e95c333 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "POST /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335/action" status: 200 len: 24570 microversion: 2.1 time: 0.063286 Apr 16 22:10:47.193267 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3694/7546] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 22:10:47 2022] POST /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335/action => generated 24570 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 22:11:17.697301 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-414e7832-5825-4ff3-bd8b-08412fb31af5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:11:17.703262 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-414e7832-5825-4ff3-bd8b-08412fb31af5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:11:17.703726 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-414e7832-5825-4ff3-bd8b-08412fb31af5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:11:17.725184 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-414e7832-5825-4ff3-bd8b-08412fb31af5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: d34d71da-0773-4744-b070-b79c256dd335] Going to try to stop instance {{(pid=137408) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 16 22:11:17.926345 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-414e7832-5825-4ff3-bd8b-08412fb31af5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "POST /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335/action" status: 202 len: 0 microversion: 2.1 time: 0.234345 Apr 16 22:11:17.926955 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3853/7547] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 22:11:17 2022] POST /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 22:11:17.935764 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4b2d1a44-5881-424d-83c3-14c68db6e4b4 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:11:17.936584 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4b2d1a44-5881-424d-83c3-14c68db6e4b4 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: d34d71da-0773-4744-b070-b79c256dd335] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:11:17.944120 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4b2d1a44-5881-424d-83c3-14c68db6e4b4 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:11:17.944611 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4b2d1a44-5881-424d-83c3-14c68db6e4b4 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:11:17.945398 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4b2d1a44-5881-424d-83c3-14c68db6e4b4 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:11:17.945847 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4b2d1a44-5881-424d-83c3-14c68db6e4b4 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:11:18.125952 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4b2d1a44-5881-424d-83c3-14c68db6e4b4 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:11:18.133329 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4b2d1a44-5881-424d-83c3-14c68db6e4b4 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335" status: 200 len: 1692 microversion: 2.1 time: 0.202037 Apr 16 22:11:18.133892 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3695/7548] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:11:17 2022] GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335 => generated 1692 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:11:19.152473 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-717391a2-676b-4b0d-b4c5-1ddd20358861 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:11:19.153185 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-717391a2-676b-4b0d-b4c5-1ddd20358861 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: d34d71da-0773-4744-b070-b79c256dd335] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:11:19.159360 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-717391a2-676b-4b0d-b4c5-1ddd20358861 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:11:19.159828 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-717391a2-676b-4b0d-b4c5-1ddd20358861 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:11:19.160643 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-717391a2-676b-4b0d-b4c5-1ddd20358861 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:11:19.161100 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-717391a2-676b-4b0d-b4c5-1ddd20358861 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:11:19.334748 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-717391a2-676b-4b0d-b4c5-1ddd20358861 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:11:19.342753 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-717391a2-676b-4b0d-b4c5-1ddd20358861 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335" status: 200 len: 1692 microversion: 2.1 time: 0.195674 Apr 16 22:11:19.343331 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3854/7549] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:11:19 2022] GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335 => generated 1692 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:11:20.360019 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-09e67452-7140-4975-8389-9bb3f92c47f3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:11:20.360667 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-09e67452-7140-4975-8389-9bb3f92c47f3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: d34d71da-0773-4744-b070-b79c256dd335] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:11:20.368304 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-09e67452-7140-4975-8389-9bb3f92c47f3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:11:20.368770 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-09e67452-7140-4975-8389-9bb3f92c47f3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:11:20.369552 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-09e67452-7140-4975-8389-9bb3f92c47f3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:11:20.370001 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-09e67452-7140-4975-8389-9bb3f92c47f3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:11:20.499527 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-09e67452-7140-4975-8389-9bb3f92c47f3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:11:20.507092 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-09e67452-7140-4975-8389-9bb3f92c47f3 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335" status: 200 len: 1692 microversion: 2.1 time: 0.151030 Apr 16 22:11:20.507673 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3696/7550] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:11:20 2022] GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335 => generated 1692 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:11:21.524025 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-95d1017a-f193-472b-8ba8-597ad202c707 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:11:21.524686 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-95d1017a-f193-472b-8ba8-597ad202c707 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: d34d71da-0773-4744-b070-b79c256dd335] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:11:21.531445 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-95d1017a-f193-472b-8ba8-597ad202c707 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:11:21.531919 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-95d1017a-f193-472b-8ba8-597ad202c707 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:11:21.532748 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-95d1017a-f193-472b-8ba8-597ad202c707 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:11:21.533206 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-95d1017a-f193-472b-8ba8-597ad202c707 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:11:21.663849 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-95d1017a-f193-472b-8ba8-597ad202c707 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:11:21.671319 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-95d1017a-f193-472b-8ba8-597ad202c707 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335" status: 200 len: 1692 microversion: 2.1 time: 0.151149 Apr 16 22:11:21.671882 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3855/7551] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:11:21 2022] GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335 => generated 1692 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:11:22.688754 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a04ee901-b4dc-48ab-becb-9157f2f4d4bf tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:11:22.689369 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a04ee901-b4dc-48ab-becb-9157f2f4d4bf tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: d34d71da-0773-4744-b070-b79c256dd335] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:11:22.696082 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a04ee901-b4dc-48ab-becb-9157f2f4d4bf tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:11:22.696575 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a04ee901-b4dc-48ab-becb-9157f2f4d4bf tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:11:22.697354 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a04ee901-b4dc-48ab-becb-9157f2f4d4bf tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:11:22.697803 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a04ee901-b4dc-48ab-becb-9157f2f4d4bf tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:11:22.830083 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a04ee901-b4dc-48ab-becb-9157f2f4d4bf tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:11:22.837677 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a04ee901-b4dc-48ab-becb-9157f2f4d4bf tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335" status: 200 len: 1692 microversion: 2.1 time: 0.152868 Apr 16 22:11:22.838251 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3697/7552] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:11:22 2022] GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335 => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:11:23.855775 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-754b6c77-2a04-40e1-966f-d4e660f988c5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:11:23.856420 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-754b6c77-2a04-40e1-966f-d4e660f988c5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: d34d71da-0773-4744-b070-b79c256dd335] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:11:23.863134 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-754b6c77-2a04-40e1-966f-d4e660f988c5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:11:23.863603 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-754b6c77-2a04-40e1-966f-d4e660f988c5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:11:23.864420 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-754b6c77-2a04-40e1-966f-d4e660f988c5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:11:23.864877 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-754b6c77-2a04-40e1-966f-d4e660f988c5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:11:23.995432 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-754b6c77-2a04-40e1-966f-d4e660f988c5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:11:24.002858 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-754b6c77-2a04-40e1-966f-d4e660f988c5 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335" status: 200 len: 1692 microversion: 2.1 time: 0.151606 Apr 16 22:11:24.003430 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3856/7553] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:11:23 2022] GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335 => generated 1692 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:11:25.020260 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bfb289dc-73d5-4172-a841-aecccd22e4f6 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:11:25.020806 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-bfb289dc-73d5-4172-a841-aecccd22e4f6 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: d34d71da-0773-4744-b070-b79c256dd335] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:11:25.027695 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bfb289dc-73d5-4172-a841-aecccd22e4f6 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:11:25.028157 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bfb289dc-73d5-4172-a841-aecccd22e4f6 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:11:25.028949 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bfb289dc-73d5-4172-a841-aecccd22e4f6 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:11:25.029396 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-bfb289dc-73d5-4172-a841-aecccd22e4f6 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:11:25.156073 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-bfb289dc-73d5-4172-a841-aecccd22e4f6 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:11:25.163640 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bfb289dc-73d5-4172-a841-aecccd22e4f6 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335" status: 200 len: 1692 microversion: 2.1 time: 0.147578 Apr 16 22:11:25.166485 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3698/7554] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:11:25 2022] GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335 => generated 1692 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:11:26.180707 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-111aeab2-22cb-41ae-bf63-00f1662097fd tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:11:26.181357 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-111aeab2-22cb-41ae-bf63-00f1662097fd tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: d34d71da-0773-4744-b070-b79c256dd335] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:11:26.188428 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-111aeab2-22cb-41ae-bf63-00f1662097fd tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:11:26.192284 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-111aeab2-22cb-41ae-bf63-00f1662097fd tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:11:26.192284 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-111aeab2-22cb-41ae-bf63-00f1662097fd tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:11:26.192284 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-111aeab2-22cb-41ae-bf63-00f1662097fd tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:11:26.317999 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-111aeab2-22cb-41ae-bf63-00f1662097fd tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:11:26.325296 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-111aeab2-22cb-41ae-bf63-00f1662097fd tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335" status: 200 len: 1692 microversion: 2.1 time: 0.148566 Apr 16 22:11:26.325866 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3857/7555] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:11:26 2022] GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335 => generated 1692 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:11:27.343025 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2a64e66e-04ad-4b30-b812-f06c9efcd402 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:11:27.343752 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2a64e66e-04ad-4b30-b812-f06c9efcd402 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: d34d71da-0773-4744-b070-b79c256dd335] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:11:27.350679 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2a64e66e-04ad-4b30-b812-f06c9efcd402 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:11:27.351160 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2a64e66e-04ad-4b30-b812-f06c9efcd402 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:11:27.351925 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2a64e66e-04ad-4b30-b812-f06c9efcd402 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:11:27.352403 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2a64e66e-04ad-4b30-b812-f06c9efcd402 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:11:27.480662 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2a64e66e-04ad-4b30-b812-f06c9efcd402 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:11:27.488111 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2a64e66e-04ad-4b30-b812-f06c9efcd402 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335" status: 200 len: 1692 microversion: 2.1 time: 0.149104 Apr 16 22:11:27.488719 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3699/7556] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:11:27 2022] GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335 => generated 1692 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:11:28.506415 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-55a8bb7b-7808-4ffa-a10d-1ec1c6184019 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:11:28.507181 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-55a8bb7b-7808-4ffa-a10d-1ec1c6184019 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: d34d71da-0773-4744-b070-b79c256dd335] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:11:28.514286 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-55a8bb7b-7808-4ffa-a10d-1ec1c6184019 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:11:28.514751 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-55a8bb7b-7808-4ffa-a10d-1ec1c6184019 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:11:28.515563 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-55a8bb7b-7808-4ffa-a10d-1ec1c6184019 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:11:28.516020 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-55a8bb7b-7808-4ffa-a10d-1ec1c6184019 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:11:28.646113 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-55a8bb7b-7808-4ffa-a10d-1ec1c6184019 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:11:28.653795 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-55a8bb7b-7808-4ffa-a10d-1ec1c6184019 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335" status: 200 len: 1669 microversion: 2.1 time: 0.151547 Apr 16 22:11:28.654374 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3858/7557] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:11:28 2022] GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335 => generated 1669 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:11:29.746916 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-84c193c9-725a-4b92-841d-2ed4c25db59d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:11:29.747837 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-84c193c9-725a-4b92-841d-2ed4c25db59d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: d34d71da-0773-4744-b070-b79c256dd335] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:11:29.754517 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-84c193c9-725a-4b92-841d-2ed4c25db59d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:11:29.754979 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-84c193c9-725a-4b92-841d-2ed4c25db59d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:11:29.755753 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-84c193c9-725a-4b92-841d-2ed4c25db59d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:11:29.756218 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-84c193c9-725a-4b92-841d-2ed4c25db59d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:11:29.802702 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-84c193c9-725a-4b92-841d-2ed4c25db59d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "POST /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335/action" status: 200 len: 36800 microversion: 2.1 time: 0.059546 Apr 16 22:11:29.803593 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3700/7558] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 22:11:29 2022] POST /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335/action => generated 36800 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 22:11:29.814485 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b6859af5-62ee-46b2-bd17-e9be0e94eb6c tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:11:29.821416 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b6859af5-62ee-46b2-bd17-e9be0e94eb6c tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:11:29.821888 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b6859af5-62ee-46b2-bd17-e9be0e94eb6c tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:11:29.844083 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b6859af5-62ee-46b2-bd17-e9be0e94eb6c tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: d34d71da-0773-4744-b070-b79c256dd335] Going to try to start instance {{(pid=137408) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 16 22:11:30.015500 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b6859af5-62ee-46b2-bd17-e9be0e94eb6c tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "POST /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335/action" status: 202 len: 0 microversion: 2.1 time: 0.204626 Apr 16 22:11:30.016031 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3859/7559] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 22:11:29 2022] POST /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 22:11:30.025146 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e33e9e66-8ab0-4cf7-9ef2-65957be56059 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:11:30.025957 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e33e9e66-8ab0-4cf7-9ef2-65957be56059 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: d34d71da-0773-4744-b070-b79c256dd335] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:11:30.033703 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e33e9e66-8ab0-4cf7-9ef2-65957be56059 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:11:30.034169 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e33e9e66-8ab0-4cf7-9ef2-65957be56059 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:11:30.034953 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e33e9e66-8ab0-4cf7-9ef2-65957be56059 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:11:30.035403 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e33e9e66-8ab0-4cf7-9ef2-65957be56059 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:11:30.179443 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e33e9e66-8ab0-4cf7-9ef2-65957be56059 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:11:30.187167 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e33e9e66-8ab0-4cf7-9ef2-65957be56059 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335" status: 200 len: 1678 microversion: 2.1 time: 0.166414 Apr 16 22:11:30.187748 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3701/7560] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:11:30 2022] GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335 => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:11:31.207022 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1c1c00b3-dbe5-4143-a114-e93bfe4bc33e tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:11:31.207733 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1c1c00b3-dbe5-4143-a114-e93bfe4bc33e tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: d34d71da-0773-4744-b070-b79c256dd335] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:11:31.213914 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1c1c00b3-dbe5-4143-a114-e93bfe4bc33e tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:11:31.214381 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1c1c00b3-dbe5-4143-a114-e93bfe4bc33e tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:11:31.215821 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1c1c00b3-dbe5-4143-a114-e93bfe4bc33e tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:11:31.216329 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1c1c00b3-dbe5-4143-a114-e93bfe4bc33e tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:11:31.347366 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1c1c00b3-dbe5-4143-a114-e93bfe4bc33e tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:11:31.354946 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1c1c00b3-dbe5-4143-a114-e93bfe4bc33e tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335" status: 200 len: 1678 microversion: 2.1 time: 0.153299 Apr 16 22:11:31.355538 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3860/7561] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:11:31 2022] GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:11:32.371905 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-cb9e0e86-a00a-4bf4-9902-608433b0e2df tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:11:32.372552 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-cb9e0e86-a00a-4bf4-9902-608433b0e2df tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: d34d71da-0773-4744-b070-b79c256dd335] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:11:32.380055 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cb9e0e86-a00a-4bf4-9902-608433b0e2df tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:11:32.380545 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cb9e0e86-a00a-4bf4-9902-608433b0e2df tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:11:32.381326 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cb9e0e86-a00a-4bf4-9902-608433b0e2df tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:11:32.381778 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-cb9e0e86-a00a-4bf4-9902-608433b0e2df tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:11:32.515870 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-cb9e0e86-a00a-4bf4-9902-608433b0e2df tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:11:32.523448 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-cb9e0e86-a00a-4bf4-9902-608433b0e2df tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335" status: 200 len: 1682 microversion: 2.1 time: 0.155467 Apr 16 22:11:32.527846 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3702/7562] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:11:32 2022] GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:12:02.725045 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fb78a5bd-70ab-42ee-a826-ba7b76bb4bd7 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:12:02.725999 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fb78a5bd-70ab-42ee-a826-ba7b76bb4bd7 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: d34d71da-0773-4744-b070-b79c256dd335] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:12:02.731978 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fb78a5bd-70ab-42ee-a826-ba7b76bb4bd7 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:02.732492 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fb78a5bd-70ab-42ee-a826-ba7b76bb4bd7 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:02.733285 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fb78a5bd-70ab-42ee-a826-ba7b76bb4bd7 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:02.733747 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fb78a5bd-70ab-42ee-a826-ba7b76bb4bd7 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:02.785860 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fb78a5bd-70ab-42ee-a826-ba7b76bb4bd7 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "POST /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335/action" status: 200 len: 61365 microversion: 2.1 time: 0.065016 Apr 16 22:12:02.786500 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3861/7563] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 22:12:02 2022] POST /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335/action => generated 61365 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 22:12:11.259183 ncdv-master-1 devstack@n-api.service[137409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:12:11.259657 ncdv-master-1 devstack@n-api.service[137409]: Sat Apr 16 22:12:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 22:12:26.693481 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f41bac86-1529-439d-8bc5-3c651fa39bdb tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:12:26.694095 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f41bac86-1529-439d-8bc5-3c651fa39bdb tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: d34d71da-0773-4744-b070-b79c256dd335] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:12:26.701169 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f41bac86-1529-439d-8bc5-3c651fa39bdb tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:26.702402 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f41bac86-1529-439d-8bc5-3c651fa39bdb tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:26.703191 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f41bac86-1529-439d-8bc5-3c651fa39bdb tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:26.703639 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f41bac86-1529-439d-8bc5-3c651fa39bdb tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:26.731125 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f41bac86-1529-439d-8bc5-3c651fa39bdb tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: d34d71da-0773-4744-b070-b79c256dd335] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 22:12:26.755466 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-3796bfa3-b513-47bc-b0d9-46d0d61db91b req-5fc03556-5392-4a5d-937e-75634613d029 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d34d71da-0773-4744-b070-b79c256dd335", "tag": "65d5e816-151e-46af-82bb-233d5489487a"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:12:26.766093 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-3796bfa3-b513-47bc-b0d9-46d0d61db91b req-5fc03556-5392-4a5d-937e-75634613d029 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:26.766847 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-3796bfa3-b513-47bc-b0d9-46d0d61db91b req-5fc03556-5392-4a5d-937e-75634613d029 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:26.777710 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-3796bfa3-b513-47bc-b0d9-46d0d61db91b req-5fc03556-5392-4a5d-937e-75634613d029 service nova] Creating event network-changed:65d5e816-151e-46af-82bb-233d5489487a for instance d34d71da-0773-4744-b070-b79c256dd335 on nch2-master-1 Apr 16 22:12:26.782741 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-3796bfa3-b513-47bc-b0d9-46d0d61db91b req-5fc03556-5392-4a5d-937e-75634613d029 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090778 Apr 16 22:12:26.783341 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3862/7564] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:12:27.023031 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f41bac86-1529-439d-8bc5-3c651fa39bdb tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "DELETE /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335" status: 204 len: 0 microversion: 2.1 time: 0.333281 Apr 16 22:12:27.024465 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3703/7565] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 22:12:26 2022] DELETE /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 22:12:27.033093 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-76af3b08-64b1-423b-80d5-1401c035b7eb tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:12:27.033945 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-76af3b08-64b1-423b-80d5-1401c035b7eb tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: d34d71da-0773-4744-b070-b79c256dd335] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:12:27.040443 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-76af3b08-64b1-423b-80d5-1401c035b7eb tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:27.040997 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-76af3b08-64b1-423b-80d5-1401c035b7eb tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:27.041869 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-76af3b08-64b1-423b-80d5-1401c035b7eb tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:27.042396 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-76af3b08-64b1-423b-80d5-1401c035b7eb tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:27.503107 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-76af3b08-64b1-423b-80d5-1401c035b7eb tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:12:27.510762 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-76af3b08-64b1-423b-80d5-1401c035b7eb tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335" status: 200 len: 1688 microversion: 2.1 time: 0.482433 Apr 16 22:12:27.511351 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3863/7566] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:12:27 2022] GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335 => generated 1688 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:12:28.528852 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d289703e-224d-4b4f-aa8d-0d2b63351671 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:12:28.529476 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d289703e-224d-4b4f-aa8d-0d2b63351671 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: d34d71da-0773-4744-b070-b79c256dd335] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:12:28.536858 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d289703e-224d-4b4f-aa8d-0d2b63351671 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:28.537324 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d289703e-224d-4b4f-aa8d-0d2b63351671 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:28.538103 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d289703e-224d-4b4f-aa8d-0d2b63351671 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:28.538556 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d289703e-224d-4b4f-aa8d-0d2b63351671 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:28.674189 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d289703e-224d-4b4f-aa8d-0d2b63351671 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:12:28.682270 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d289703e-224d-4b4f-aa8d-0d2b63351671 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335" status: 200 len: 1569 microversion: 2.1 time: 0.157815 Apr 16 22:12:28.683040 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3704/7567] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:12:28 2022] GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:12:29.227174 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-a23394c3-a424-4f39-a0da-8a4c5da22e9a req-3dbc4186-491e-4808-b33c-0a17a7ce18d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d34d71da-0773-4744-b070-b79c256dd335", "name": "network-vif-deleted", "tag": "65d5e816-151e-46af-82bb-233d5489487a"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:12:29.236039 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-a23394c3-a424-4f39-a0da-8a4c5da22e9a req-3dbc4186-491e-4808-b33c-0a17a7ce18d1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:29.236532 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-a23394c3-a424-4f39-a0da-8a4c5da22e9a req-3dbc4186-491e-4808-b33c-0a17a7ce18d1 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:29.247490 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-a23394c3-a424-4f39-a0da-8a4c5da22e9a req-3dbc4186-491e-4808-b33c-0a17a7ce18d1 service nova] Creating event network-vif-deleted:65d5e816-151e-46af-82bb-233d5489487a for instance d34d71da-0773-4744-b070-b79c256dd335 on nch2-master-1 Apr 16 22:12:29.253376 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-a23394c3-a424-4f39-a0da-8a4c5da22e9a req-3dbc4186-491e-4808-b33c-0a17a7ce18d1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079422 Apr 16 22:12:29.253994 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3864/7568] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:12:29.701892 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-70f6d03f-f03a-421c-b48e-34750e44c4f7 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:12:29.702447 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-70f6d03f-f03a-421c-b48e-34750e44c4f7 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: d34d71da-0773-4744-b070-b79c256dd335] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:12:29.709600 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-70f6d03f-f03a-421c-b48e-34750e44c4f7 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:29.710056 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-70f6d03f-f03a-421c-b48e-34750e44c4f7 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:29.710828 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-70f6d03f-f03a-421c-b48e-34750e44c4f7 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:29.711280 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-70f6d03f-f03a-421c-b48e-34750e44c4f7 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:29.741387 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-70f6d03f-f03a-421c-b48e-34750e44c4f7 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:29.741843 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-70f6d03f-f03a-421c-b48e-34750e44c4f7 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:29.742294 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-70f6d03f-f03a-421c-b48e-34750e44c4f7 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lazy-loading 'fault' on Instance uuid d34d71da-0773-4744-b070-b79c256dd335 {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 22:12:29.782676 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-70f6d03f-f03a-421c-b48e-34750e44c4f7 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:12:29.789991 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-70f6d03f-f03a-421c-b48e-34750e44c4f7 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335" status: 200 len: 1355 microversion: 2.1 time: 0.092105 Apr 16 22:12:29.790551 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3705/7569] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:12:29 2022] GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335 => generated 1355 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 22:12:30.807907 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3194426e-6c14-49dc-882f-3b040e1727b9 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:12:30.808657 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3194426e-6c14-49dc-882f-3b040e1727b9 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: d34d71da-0773-4744-b070-b79c256dd335] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:12:30.816324 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3194426e-6c14-49dc-882f-3b040e1727b9 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:30.816797 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3194426e-6c14-49dc-882f-3b040e1727b9 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:30.817582 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3194426e-6c14-49dc-882f-3b040e1727b9 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:30.818042 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-3194426e-6c14-49dc-882f-3b040e1727b9 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:30.831197 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-3194426e-6c14-49dc-882f-3b040e1727b9 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] HTTP exception thrown: Instance d34d71da-0773-4744-b070-b79c256dd335 could not be found. Apr 16 22:12:30.831800 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3194426e-6c14-49dc-882f-3b040e1727b9 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Returning 404 to user: Instance d34d71da-0773-4744-b070-b79c256dd335 could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 22:12:30.832672 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3194426e-6c14-49dc-882f-3b040e1727b9 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335" status: 404 len: 111 microversion: 2.1 time: 0.029057 Apr 16 22:12:30.833192 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3865/7570] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:12:30 2022] GET /compute/v2.1/servers/d34d71da-0773-4744-b070-b79c256dd335 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 22:12:34.546017 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-bd2cc213-5e51-429d-8144-4cfc8e2880a4 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '.version_select at 0x7fbb9feaa790>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:12:34.626253 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-bd2cc213-5e51-429d-8144-4cfc8e2880a4 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-340581989" status: 202 len: 0 microversion: 2.1 time: 0.084958 Apr 16 22:12:34.626849 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3706/7571] 10.222.0.20 () {58 vars in 1280 bytes} [Sat Apr 16 22:12:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-340581989 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 22:12:34.656186 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c8411f7c-bd71-4e75-97c6-ba6ef6e84cdf tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Action: 'create', calling method: .version_select at 0x7fbb965e7e50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2028207928"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:12:34.671718 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-c8411f7c-bd71-4e75-97c6-ba6ef6e84cdf tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Getting quotas for project 3d4eaa0fe99e42488e0720b18be48ac8. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 22:12:34.678061 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-c8411f7c-bd71-4e75-97c6-ba6ef6e84cdf tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Getting quotas for user 8fa5c4f477214df880fc12d6da76283a and project 3d4eaa0fe99e42488e0720b18be48ac8. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 22:12:34.795405 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-c8411f7c-bd71-4e75-97c6-ba6ef6e84cdf tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Getting quotas for project 3d4eaa0fe99e42488e0720b18be48ac8. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 22:12:34.800403 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-c8411f7c-bd71-4e75-97c6-ba6ef6e84cdf tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Getting quotas for user 8fa5c4f477214df880fc12d6da76283a and project 3d4eaa0fe99e42488e0720b18be48ac8. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 22:12:34.815065 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c8411f7c-bd71-4e75-97c6-ba6ef6e84cdf tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.162837 Apr 16 22:12:34.815726 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3866/7572] 10.222.0.20 () {60 vars in 1157 bytes} [Sat Apr 16 22:12:34 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 22:12:42.690033 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-8feb0ba0-09e7-4019-9621-f95c4261ec72 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-887990631", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "networks": [{"uuid": "bdbf41a3-23bc-48aa-a97e-5b87ce8ffe6f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2028207928", "security_groups": [{"name": "tempest-secgroup-smoke-544548829"}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:12:42.802246 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-8feb0ba0-09e7-4019-9621-f95c4261ec72 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] validate_networks() for [('bdbf41a3-23bc-48aa-a97e-5b87ce8ffe6f', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 22:12:43.198935 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-8feb0ba0-09e7-4019-9621-f95c4261ec72 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 22:12:43.199610 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-8feb0ba0-09e7-4019-9621-f95c4261ec72 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 22:12:43.200106 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-8feb0ba0-09e7-4019-9621-f95c4261ec72 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 22:12:43.200566 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-8feb0ba0-09e7-4019-9621-f95c4261ec72 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 22:12:43.201212 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-8feb0ba0-09e7-4019-9621-f95c4261ec72 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 22:12:43.210697 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8feb0ba0-09e7-4019-9621-f95c4261ec72 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:43.211165 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8feb0ba0-09e7-4019-9621-f95c4261ec72 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:43.211986 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8feb0ba0-09e7-4019-9621-f95c4261ec72 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:43.212476 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-8feb0ba0-09e7-4019-9621-f95c4261ec72 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:43.234135 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-8feb0ba0-09e7-4019-9621-f95c4261ec72 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Getting quotas for project 3d4eaa0fe99e42488e0720b18be48ac8. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 22:12:43.239795 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-8feb0ba0-09e7-4019-9621-f95c4261ec72 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Getting quotas for user 8fa5c4f477214df880fc12d6da76283a and project 3d4eaa0fe99e42488e0720b18be48ac8. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 22:12:43.252543 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8feb0ba0-09e7-4019-9621-f95c4261ec72 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 22:12:43.254897 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-8feb0ba0-09e7-4019-9621-f95c4261ec72 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: fdceb21a-7767-4e17-aecc-c1218f6978db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 22:12:43.356764 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-8feb0ba0-09e7-4019-9621-f95c4261ec72 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.671386 Apr 16 22:12:43.358285 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3707/7573] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 22:12:42 2022] POST /compute/v2.1/servers => generated 405 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 22:12:43.369920 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-3535d52e-824a-43a5-85fa-302f077bd960 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:12:43.371376 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-3535d52e-824a-43a5-85fa-302f077bd960 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: fdceb21a-7767-4e17-aecc-c1218f6978db] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:12:43.439298 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-3535d52e-824a-43a5-85fa-302f077bd960 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:12:43.447314 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-3535d52e-824a-43a5-85fa-302f077bd960 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db" status: 200 len: 1266 microversion: 2.1 time: 0.082586 Apr 16 22:12:43.447829 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3867/7574] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:12:43 2022] GET /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:12:44.465274 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e190b927-1194-4dd1-94d1-dec723c17f01 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:12:44.466213 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e190b927-1194-4dd1-94d1-dec723c17f01 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: fdceb21a-7767-4e17-aecc-c1218f6978db] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:12:44.474310 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e190b927-1194-4dd1-94d1-dec723c17f01 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:44.475116 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e190b927-1194-4dd1-94d1-dec723c17f01 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:44.476495 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e190b927-1194-4dd1-94d1-dec723c17f01 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:44.477525 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e190b927-1194-4dd1-94d1-dec723c17f01 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:44.550291 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e190b927-1194-4dd1-94d1-dec723c17f01 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:12:44.556540 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e190b927-1194-4dd1-94d1-dec723c17f01 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db" status: 200 len: 1270 microversion: 2.1 time: 0.095455 Apr 16 22:12:44.557575 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3708/7575] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:12:44 2022] GET /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db => generated 1270 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:12:45.575198 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6c836551-33c3-454b-bd43-5aef015fdb7d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:12:45.576085 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6c836551-33c3-454b-bd43-5aef015fdb7d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: fdceb21a-7767-4e17-aecc-c1218f6978db] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:12:45.584518 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6c836551-33c3-454b-bd43-5aef015fdb7d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:45.584996 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6c836551-33c3-454b-bd43-5aef015fdb7d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:45.585856 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6c836551-33c3-454b-bd43-5aef015fdb7d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:45.586407 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6c836551-33c3-454b-bd43-5aef015fdb7d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:45.652777 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6c836551-33c3-454b-bd43-5aef015fdb7d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:12:45.661348 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6c836551-33c3-454b-bd43-5aef015fdb7d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db" status: 200 len: 1336 microversion: 2.1 time: 0.090554 Apr 16 22:12:45.661937 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3868/7576] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:12:45 2022] GET /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db => generated 1336 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:12:46.684148 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-45e5840f-4115-44b3-86e2-5c09af36364a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:12:46.686178 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-45e5840f-4115-44b3-86e2-5c09af36364a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: fdceb21a-7767-4e17-aecc-c1218f6978db] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:12:46.693253 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-45e5840f-4115-44b3-86e2-5c09af36364a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:46.693722 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-45e5840f-4115-44b3-86e2-5c09af36364a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:46.694522 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-45e5840f-4115-44b3-86e2-5c09af36364a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:46.695026 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-45e5840f-4115-44b3-86e2-5c09af36364a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:46.868642 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-45e5840f-4115-44b3-86e2-5c09af36364a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:12:46.878969 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-45e5840f-4115-44b3-86e2-5c09af36364a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db" status: 200 len: 1391 microversion: 2.1 time: 0.198822 Apr 16 22:12:46.881877 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3709/7577] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:12:46 2022] GET /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db => generated 1391 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:12:47.162382 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-7cbb26b9-09aa-40bd-9310-2276d8d1b67a req-8faee890-8ad8-4ccc-b59a-ffd4c2b6a3e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdceb21a-7767-4e17-aecc-c1218f6978db", "tag": "1a359ec2-552d-4caf-a46d-bcf1e6221f5b"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:12:47.173081 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-7cbb26b9-09aa-40bd-9310-2276d8d1b67a req-8faee890-8ad8-4ccc-b59a-ffd4c2b6a3e5 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:47.178016 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-7cbb26b9-09aa-40bd-9310-2276d8d1b67a req-8faee890-8ad8-4ccc-b59a-ffd4c2b6a3e5 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:47.191605 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-7cbb26b9-09aa-40bd-9310-2276d8d1b67a req-8faee890-8ad8-4ccc-b59a-ffd4c2b6a3e5 service nova] Creating event network-changed:1a359ec2-552d-4caf-a46d-bcf1e6221f5b for instance fdceb21a-7767-4e17-aecc-c1218f6978db on nch1-master-1 Apr 16 22:12:47.196759 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-7cbb26b9-09aa-40bd-9310-2276d8d1b67a req-8faee890-8ad8-4ccc-b59a-ffd4c2b6a3e5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040312 Apr 16 22:12:47.197459 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3869/7578] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:12:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:12:47.899429 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-afb834ad-6d9c-40d6-a086-dbc5f5ff30c7 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:12:47.900161 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-afb834ad-6d9c-40d6-a086-dbc5f5ff30c7 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: fdceb21a-7767-4e17-aecc-c1218f6978db] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:12:47.906930 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-afb834ad-6d9c-40d6-a086-dbc5f5ff30c7 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:47.907384 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-afb834ad-6d9c-40d6-a086-dbc5f5ff30c7 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:47.908160 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-afb834ad-6d9c-40d6-a086-dbc5f5ff30c7 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:47.908639 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-afb834ad-6d9c-40d6-a086-dbc5f5ff30c7 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:48.052550 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-afb834ad-6d9c-40d6-a086-dbc5f5ff30c7 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:12:48.060825 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-afb834ad-6d9c-40d6-a086-dbc5f5ff30c7 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db" status: 200 len: 1391 microversion: 2.1 time: 0.164712 Apr 16 22:12:48.061413 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3710/7579] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:12:47 2022] GET /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db => generated 1391 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:12:49.080115 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-72475530-f6b7-4346-9fa9-c12593370267 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:12:49.080859 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-72475530-f6b7-4346-9fa9-c12593370267 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: fdceb21a-7767-4e17-aecc-c1218f6978db] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:12:49.087034 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-72475530-f6b7-4346-9fa9-c12593370267 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:49.087509 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-72475530-f6b7-4346-9fa9-c12593370267 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:49.088333 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-72475530-f6b7-4346-9fa9-c12593370267 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:49.088793 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-72475530-f6b7-4346-9fa9-c12593370267 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:49.222574 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-72475530-f6b7-4346-9fa9-c12593370267 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:12:49.229943 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-72475530-f6b7-4346-9fa9-c12593370267 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db" status: 200 len: 1391 microversion: 2.1 time: 0.155713 Apr 16 22:12:49.230506 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3870/7580] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:12:49 2022] GET /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:12:50.246751 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6e563bc0-14e0-4da2-b120-ee1af3dbe5ef tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:12:50.247979 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6e563bc0-14e0-4da2-b120-ee1af3dbe5ef tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: fdceb21a-7767-4e17-aecc-c1218f6978db] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:12:50.254769 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6e563bc0-14e0-4da2-b120-ee1af3dbe5ef tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:50.255233 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6e563bc0-14e0-4da2-b120-ee1af3dbe5ef tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:50.256040 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6e563bc0-14e0-4da2-b120-ee1af3dbe5ef tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:50.256497 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6e563bc0-14e0-4da2-b120-ee1af3dbe5ef tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:50.383747 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6e563bc0-14e0-4da2-b120-ee1af3dbe5ef tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:12:50.391536 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6e563bc0-14e0-4da2-b120-ee1af3dbe5ef tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db" status: 200 len: 1391 microversion: 2.1 time: 0.148700 Apr 16 22:12:50.392107 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3711/7581] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:12:50 2022] GET /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db => generated 1391 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:12:51.408982 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-86bbf20a-4c21-4ce6-8225-a2377c4f0a9b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:12:51.409604 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-86bbf20a-4c21-4ce6-8225-a2377c4f0a9b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: fdceb21a-7767-4e17-aecc-c1218f6978db] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:12:51.417390 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-86bbf20a-4c21-4ce6-8225-a2377c4f0a9b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:51.417867 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-86bbf20a-4c21-4ce6-8225-a2377c4f0a9b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:51.418657 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-86bbf20a-4c21-4ce6-8225-a2377c4f0a9b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:51.419109 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-86bbf20a-4c21-4ce6-8225-a2377c4f0a9b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:51.550963 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-86bbf20a-4c21-4ce6-8225-a2377c4f0a9b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:12:51.558314 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-86bbf20a-4c21-4ce6-8225-a2377c4f0a9b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db" status: 200 len: 1391 microversion: 2.1 time: 0.153153 Apr 16 22:12:51.558884 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3871/7582] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:12:51 2022] GET /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:12:52.578832 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4e7416cd-4634-48ce-81f9-09c09717aef8 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:12:52.580542 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4e7416cd-4634-48ce-81f9-09c09717aef8 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: fdceb21a-7767-4e17-aecc-c1218f6978db] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:12:52.587570 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4e7416cd-4634-48ce-81f9-09c09717aef8 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:52.588032 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4e7416cd-4634-48ce-81f9-09c09717aef8 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:52.588849 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4e7416cd-4634-48ce-81f9-09c09717aef8 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:52.589294 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4e7416cd-4634-48ce-81f9-09c09717aef8 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:52.720080 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4e7416cd-4634-48ce-81f9-09c09717aef8 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:12:52.727469 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4e7416cd-4634-48ce-81f9-09c09717aef8 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db" status: 200 len: 1391 microversion: 2.1 time: 0.153647 Apr 16 22:12:52.728052 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3712/7583] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:12:52 2022] GET /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:12:53.744982 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-927d9568-70de-46bf-8e2b-5257ca51c88a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:12:53.745618 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-927d9568-70de-46bf-8e2b-5257ca51c88a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: fdceb21a-7767-4e17-aecc-c1218f6978db] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:12:53.752942 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-927d9568-70de-46bf-8e2b-5257ca51c88a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:53.753445 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-927d9568-70de-46bf-8e2b-5257ca51c88a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:53.754241 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-927d9568-70de-46bf-8e2b-5257ca51c88a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:53.754706 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-927d9568-70de-46bf-8e2b-5257ca51c88a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:53.887751 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-927d9568-70de-46bf-8e2b-5257ca51c88a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:12:53.895777 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-927d9568-70de-46bf-8e2b-5257ca51c88a tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db" status: 200 len: 1391 microversion: 2.1 time: 0.154700 Apr 16 22:12:53.896413 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3872/7584] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:12:53 2022] GET /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:12:54.460481 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-d5c1d653-5991-421e-94b8-ed3e491f3afe req-b513465e-169c-4163-b758-4e733c375e93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdceb21a-7767-4e17-aecc-c1218f6978db", "name": "network-vif-plugged", "status": "completed", "tag": "1a359ec2-552d-4caf-a46d-bcf1e6221f5b"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:12:54.469610 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-d5c1d653-5991-421e-94b8-ed3e491f3afe req-b513465e-169c-4163-b758-4e733c375e93 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:54.470061 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-d5c1d653-5991-421e-94b8-ed3e491f3afe req-b513465e-169c-4163-b758-4e733c375e93 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:54.480717 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-d5c1d653-5991-421e-94b8-ed3e491f3afe req-b513465e-169c-4163-b758-4e733c375e93 service nova] Creating event network-vif-plugged:1a359ec2-552d-4caf-a46d-bcf1e6221f5b for instance fdceb21a-7767-4e17-aecc-c1218f6978db on nch1-master-1 Apr 16 22:12:54.486655 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-d5c1d653-5991-421e-94b8-ed3e491f3afe req-b513465e-169c-4163-b758-4e733c375e93 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079325 Apr 16 22:12:54.487361 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3713/7585] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:12:54.912791 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a81e85b2-1acc-4c37-974f-924b6feb9aa0 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:12:54.913390 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a81e85b2-1acc-4c37-974f-924b6feb9aa0 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: fdceb21a-7767-4e17-aecc-c1218f6978db] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:12:54.920105 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a81e85b2-1acc-4c37-974f-924b6feb9aa0 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:54.924024 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a81e85b2-1acc-4c37-974f-924b6feb9aa0 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:54.924024 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a81e85b2-1acc-4c37-974f-924b6feb9aa0 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:54.924024 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a81e85b2-1acc-4c37-974f-924b6feb9aa0 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:55.049838 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a81e85b2-1acc-4c37-974f-924b6feb9aa0 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:12:55.057198 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a81e85b2-1acc-4c37-974f-924b6feb9aa0 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db" status: 200 len: 1391 microversion: 2.1 time: 0.148285 Apr 16 22:12:55.057764 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3873/7586] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:12:54 2022] GET /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db => generated 1391 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:12:56.074659 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ff4a2d14-b4a2-409b-84e1-8b94d5a09377 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:12:56.075359 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ff4a2d14-b4a2-409b-84e1-8b94d5a09377 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: fdceb21a-7767-4e17-aecc-c1218f6978db] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:12:56.082870 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ff4a2d14-b4a2-409b-84e1-8b94d5a09377 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:56.083352 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ff4a2d14-b4a2-409b-84e1-8b94d5a09377 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:56.084123 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ff4a2d14-b4a2-409b-84e1-8b94d5a09377 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:56.084644 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ff4a2d14-b4a2-409b-84e1-8b94d5a09377 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:56.213259 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ff4a2d14-b4a2-409b-84e1-8b94d5a09377 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:12:56.221736 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ff4a2d14-b4a2-409b-84e1-8b94d5a09377 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db" status: 200 len: 1563 microversion: 2.1 time: 0.151215 Apr 16 22:12:56.222335 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3714/7587] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:12:56 2022] GET /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db => generated 1563 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:12:56.239061 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0951ae7d-024b-4f15-adf4-81ed1db0118f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:12:56.239757 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0951ae7d-024b-4f15-adf4-81ed1db0118f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: fdceb21a-7767-4e17-aecc-c1218f6978db] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:12:56.246904 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0951ae7d-024b-4f15-adf4-81ed1db0118f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:56.247377 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0951ae7d-024b-4f15-adf4-81ed1db0118f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:56.248212 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0951ae7d-024b-4f15-adf4-81ed1db0118f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:56.248680 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0951ae7d-024b-4f15-adf4-81ed1db0118f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:56.379995 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0951ae7d-024b-4f15-adf4-81ed1db0118f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:12:56.387366 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0951ae7d-024b-4f15-adf4-81ed1db0118f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db" status: 200 len: 1563 microversion: 2.1 time: 0.152301 Apr 16 22:12:56.388494 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3874/7588] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:12:56 2022] GET /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:12:58.358124 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ce753133-9bca-453c-903d-c4e0d5866154 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:12:58.358747 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ce753133-9bca-453c-903d-c4e0d5866154 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: fdceb21a-7767-4e17-aecc-c1218f6978db] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:12:58.362204 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-f9fc5a57-22d1-4a70-935f-79947fc65888 req-6c1b7601-57ec-4f79-842f-d389ec1b5320 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdceb21a-7767-4e17-aecc-c1218f6978db", "tag": "1a359ec2-552d-4caf-a46d-bcf1e6221f5b"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:12:58.365944 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ce753133-9bca-453c-903d-c4e0d5866154 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:58.366608 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ce753133-9bca-453c-903d-c4e0d5866154 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:58.367595 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ce753133-9bca-453c-903d-c4e0d5866154 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:58.368260 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ce753133-9bca-453c-903d-c4e0d5866154 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:58.370932 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-f9fc5a57-22d1-4a70-935f-79947fc65888 req-6c1b7601-57ec-4f79-842f-d389ec1b5320 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:12:58.371403 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-f9fc5a57-22d1-4a70-935f-79947fc65888 req-6c1b7601-57ec-4f79-842f-d389ec1b5320 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:12:58.382918 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-f9fc5a57-22d1-4a70-935f-79947fc65888 req-6c1b7601-57ec-4f79-842f-d389ec1b5320 service nova] Creating event network-changed:1a359ec2-552d-4caf-a46d-bcf1e6221f5b for instance fdceb21a-7767-4e17-aecc-c1218f6978db on nch1-master-1 Apr 16 22:12:58.388742 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-f9fc5a57-22d1-4a70-935f-79947fc65888 req-6c1b7601-57ec-4f79-842f-d389ec1b5320 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030768 Apr 16 22:12:58.389721 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3875/7589] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:12:58.597633 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ce753133-9bca-453c-903d-c4e0d5866154 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:12:58.605294 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ce753133-9bca-453c-903d-c4e0d5866154 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db" status: 200 len: 1563 microversion: 2.1 time: 0.251158 Apr 16 22:12:58.606091 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3715/7590] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:12:58 2022] GET /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db => generated 1563 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:13:19.855032 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1b462f92-20c2-4978-b5ee-02ca9f53eb3d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:13:19.856707 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1b462f92-20c2-4978-b5ee-02ca9f53eb3d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: fdceb21a-7767-4e17-aecc-c1218f6978db] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:13:19.862965 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1b462f92-20c2-4978-b5ee-02ca9f53eb3d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:13:19.863436 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1b462f92-20c2-4978-b5ee-02ca9f53eb3d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:13:19.864264 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1b462f92-20c2-4978-b5ee-02ca9f53eb3d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:13:19.864722 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1b462f92-20c2-4978-b5ee-02ca9f53eb3d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:13:19.917322 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1b462f92-20c2-4978-b5ee-02ca9f53eb3d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "POST /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db/action" status: 200 len: 24570 microversion: 2.1 time: 0.067477 Apr 16 22:13:19.918571 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3876/7591] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 22:13:19 2022] POST /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db/action => generated 24570 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 16 22:13:30.958078 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-77df6d81-fb2b-4cd5-91f4-785abc8ed2af tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:13:30.958713 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-77df6d81-fb2b-4cd5-91f4-785abc8ed2af tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: fdceb21a-7767-4e17-aecc-c1218f6978db] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:13:30.964879 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-77df6d81-fb2b-4cd5-91f4-785abc8ed2af tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:13:30.966048 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-77df6d81-fb2b-4cd5-91f4-785abc8ed2af tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:13:30.966843 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-77df6d81-fb2b-4cd5-91f4-785abc8ed2af tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:13:30.967314 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-77df6d81-fb2b-4cd5-91f4-785abc8ed2af tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:13:30.989321 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-77df6d81-fb2b-4cd5-91f4-785abc8ed2af tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lazy-loading 'flavor' on Instance uuid fdceb21a-7767-4e17-aecc-c1218f6978db {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 22:13:31.232388 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-77df6d81-fb2b-4cd5-91f4-785abc8ed2af tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "POST /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db/action" status: 202 len: 0 microversion: 2.1 time: 0.278348 Apr 16 22:13:31.233013 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3716/7592] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 22:13:30 2022] POST /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 16 22:13:31.243542 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8fb5ceac-445e-4a60-9d20-a128eff48fdf tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:13:31.250812 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8fb5ceac-445e-4a60-9d20-a128eff48fdf tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: fdceb21a-7767-4e17-aecc-c1218f6978db] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:13:31.251817 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8fb5ceac-445e-4a60-9d20-a128eff48fdf tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:13:31.252314 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8fb5ceac-445e-4a60-9d20-a128eff48fdf tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:13:31.253112 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8fb5ceac-445e-4a60-9d20-a128eff48fdf tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:13:31.253558 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8fb5ceac-445e-4a60-9d20-a128eff48fdf tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:13:31.387914 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8fb5ceac-445e-4a60-9d20-a128eff48fdf tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:13:31.395318 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8fb5ceac-445e-4a60-9d20-a128eff48fdf tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db" status: 200 len: 1689 microversion: 2.1 time: 0.157724 Apr 16 22:13:31.395884 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3877/7593] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:13:31 2022] GET /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 22:13:32.414389 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4c274e95-5526-4d91-a5b1-942a06876f30 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:13:32.415096 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4c274e95-5526-4d91-a5b1-942a06876f30 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: fdceb21a-7767-4e17-aecc-c1218f6978db] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:13:32.421367 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4c274e95-5526-4d91-a5b1-942a06876f30 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:13:32.421856 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4c274e95-5526-4d91-a5b1-942a06876f30 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:13:32.422639 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4c274e95-5526-4d91-a5b1-942a06876f30 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:13:32.423090 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4c274e95-5526-4d91-a5b1-942a06876f30 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:13:32.551484 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-4c274e95-5526-4d91-a5b1-942a06876f30 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:13:32.558819 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4c274e95-5526-4d91-a5b1-942a06876f30 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db" status: 200 len: 1672 microversion: 2.1 time: 0.149668 Apr 16 22:13:32.559396 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3717/7594] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:13:32 2022] GET /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:13:33.651181 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ee0384ba-5623-43ba-8674-34737fcb5f30 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:13:33.652130 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ee0384ba-5623-43ba-8674-34737fcb5f30 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: fdceb21a-7767-4e17-aecc-c1218f6978db] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:13:33.660302 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee0384ba-5623-43ba-8674-34737fcb5f30 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:13:33.660783 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee0384ba-5623-43ba-8674-34737fcb5f30 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:13:33.661582 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee0384ba-5623-43ba-8674-34737fcb5f30 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:13:33.662079 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ee0384ba-5623-43ba-8674-34737fcb5f30 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:13:33.711670 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ee0384ba-5623-43ba-8674-34737fcb5f30 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "POST /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db/action" status: 200 len: 38434 microversion: 2.1 time: 0.064337 Apr 16 22:13:33.712360 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3878/7595] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 22:13:33 2022] POST /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db/action => generated 38434 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 22:13:33.724069 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-08f1c308-812f-4c3b-a398-80be1eae60c9 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:13:33.724646 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-08f1c308-812f-4c3b-a398-80be1eae60c9 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: fdceb21a-7767-4e17-aecc-c1218f6978db] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:13:33.731229 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-08f1c308-812f-4c3b-a398-80be1eae60c9 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:13:33.731688 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-08f1c308-812f-4c3b-a398-80be1eae60c9 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:13:33.732588 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-08f1c308-812f-4c3b-a398-80be1eae60c9 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:13:33.733037 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-08f1c308-812f-4c3b-a398-80be1eae60c9 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:13:33.915289 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-08f1c308-812f-4c3b-a398-80be1eae60c9 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "POST /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db/action" status: 202 len: 0 microversion: 2.1 time: 0.194850 Apr 16 22:13:33.915942 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3718/7596] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 22:13:33 2022] POST /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 16 22:13:33.924664 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-66844115-7746-4f8d-9d96-a3c37f66caaa tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:13:33.925446 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-66844115-7746-4f8d-9d96-a3c37f66caaa tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: fdceb21a-7767-4e17-aecc-c1218f6978db] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:13:33.932659 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-66844115-7746-4f8d-9d96-a3c37f66caaa tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:13:33.938315 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-66844115-7746-4f8d-9d96-a3c37f66caaa tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:13:33.938315 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-66844115-7746-4f8d-9d96-a3c37f66caaa tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:13:33.938315 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-66844115-7746-4f8d-9d96-a3c37f66caaa tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:13:34.069188 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-66844115-7746-4f8d-9d96-a3c37f66caaa tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:13:34.078043 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-66844115-7746-4f8d-9d96-a3c37f66caaa tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db" status: 200 len: 1678 microversion: 2.1 time: 0.157574 Apr 16 22:13:34.078628 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3879/7597] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:13:33 2022] GET /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:13:35.097511 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-a69ddea9-1936-4453-aa68-508c5fa0736b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:13:35.098221 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-a69ddea9-1936-4453-aa68-508c5fa0736b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: fdceb21a-7767-4e17-aecc-c1218f6978db] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:13:35.104446 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a69ddea9-1936-4453-aa68-508c5fa0736b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:13:35.104911 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a69ddea9-1936-4453-aa68-508c5fa0736b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:13:35.105694 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a69ddea9-1936-4453-aa68-508c5fa0736b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:13:35.106145 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-a69ddea9-1936-4453-aa68-508c5fa0736b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:13:35.237389 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-a69ddea9-1936-4453-aa68-508c5fa0736b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:13:35.245080 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-a69ddea9-1936-4453-aa68-508c5fa0736b tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db" status: 200 len: 1678 microversion: 2.1 time: 0.152749 Apr 16 22:13:35.245667 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3719/7598] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:13:35 2022] GET /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:13:36.262639 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b34e2400-84e9-4934-ad92-d3795e200962 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:13:36.263273 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b34e2400-84e9-4934-ad92-d3795e200962 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: fdceb21a-7767-4e17-aecc-c1218f6978db] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:13:36.270066 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b34e2400-84e9-4934-ad92-d3795e200962 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:13:36.270546 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b34e2400-84e9-4934-ad92-d3795e200962 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:13:36.271345 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b34e2400-84e9-4934-ad92-d3795e200962 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:13:36.271808 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b34e2400-84e9-4934-ad92-d3795e200962 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:13:36.402857 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b34e2400-84e9-4934-ad92-d3795e200962 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:13:36.410855 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b34e2400-84e9-4934-ad92-d3795e200962 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db" status: 200 len: 1681 microversion: 2.1 time: 0.152122 Apr 16 22:13:36.411426 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3880/7599] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:13:36 2022] GET /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:13:36.500782 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d4fffc79-e6c3-49bf-93d6-8c35f3359c61 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:13:36.501718 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d4fffc79-e6c3-49bf-93d6-8c35f3359c61 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: fdceb21a-7767-4e17-aecc-c1218f6978db] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:13:36.508520 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d4fffc79-e6c3-49bf-93d6-8c35f3359c61 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:13:36.508983 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d4fffc79-e6c3-49bf-93d6-8c35f3359c61 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:13:36.509761 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d4fffc79-e6c3-49bf-93d6-8c35f3359c61 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:13:36.510208 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d4fffc79-e6c3-49bf-93d6-8c35f3359c61 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:13:36.549275 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d4fffc79-e6c3-49bf-93d6-8c35f3359c61 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "POST /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db/action" status: 200 len: 38434 microversion: 2.1 time: 0.052234 Apr 16 22:13:36.549887 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3720/7600] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 22:13:36 2022] POST /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db/action => generated 38434 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 22:13:37.940505 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4ec98fb6-e8b0-46c7-9e53-1a079fa6d395 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:13:37.941177 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4ec98fb6-e8b0-46c7-9e53-1a079fa6d395 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: fdceb21a-7767-4e17-aecc-c1218f6978db] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:13:37.943272 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-ab92c174-fff4-4451-8a3d-717e29be367c req-9cb286aa-5cd5-433b-83ee-696de9db238e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdceb21a-7767-4e17-aecc-c1218f6978db", "tag": "1a359ec2-552d-4caf-a46d-bcf1e6221f5b"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:13:37.948334 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4ec98fb6-e8b0-46c7-9e53-1a079fa6d395 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:13:37.949062 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4ec98fb6-e8b0-46c7-9e53-1a079fa6d395 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:13:37.949979 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4ec98fb6-e8b0-46c7-9e53-1a079fa6d395 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:13:37.950513 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4ec98fb6-e8b0-46c7-9e53-1a079fa6d395 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:13:37.952580 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-ab92c174-fff4-4451-8a3d-717e29be367c req-9cb286aa-5cd5-433b-83ee-696de9db238e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:13:37.953250 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-ab92c174-fff4-4451-8a3d-717e29be367c req-9cb286aa-5cd5-433b-83ee-696de9db238e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:13:37.964820 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-ab92c174-fff4-4451-8a3d-717e29be367c req-9cb286aa-5cd5-433b-83ee-696de9db238e service nova] Creating event network-changed:1a359ec2-552d-4caf-a46d-bcf1e6221f5b for instance fdceb21a-7767-4e17-aecc-c1218f6978db on nch1-master-1 Apr 16 22:13:37.970578 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-ab92c174-fff4-4451-8a3d-717e29be367c req-9cb286aa-5cd5-433b-83ee-696de9db238e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031396 Apr 16 22:13:37.971428 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3721/7601] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 22:13:37.977493 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4ec98fb6-e8b0-46c7-9e53-1a079fa6d395 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: fdceb21a-7767-4e17-aecc-c1218f6978db] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 22:13:38.287050 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4ec98fb6-e8b0-46c7-9e53-1a079fa6d395 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db" status: 204 len: 0 microversion: 2.1 time: 0.350492 Apr 16 22:13:38.290812 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3881/7602] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 22:13:37 2022] DELETE /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 22:13:38.297278 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6f8e3a03-bff9-47bf-be0e-79eac8428347 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:13:38.297993 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6f8e3a03-bff9-47bf-be0e-79eac8428347 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: fdceb21a-7767-4e17-aecc-c1218f6978db] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:13:38.304142 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6f8e3a03-bff9-47bf-be0e-79eac8428347 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:13:38.304891 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6f8e3a03-bff9-47bf-be0e-79eac8428347 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:13:38.305888 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6f8e3a03-bff9-47bf-be0e-79eac8428347 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:13:38.306448 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6f8e3a03-bff9-47bf-be0e-79eac8428347 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:13:38.463651 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6f8e3a03-bff9-47bf-be0e-79eac8428347 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:13:38.471758 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6f8e3a03-bff9-47bf-be0e-79eac8428347 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db" status: 200 len: 1687 microversion: 2.1 time: 0.179397 Apr 16 22:13:38.472378 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3722/7603] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:13:38 2022] GET /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db => generated 1687 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:13:39.489870 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7a658e4a-68b3-45d1-a90e-060bb86a35ff tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:13:39.490693 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7a658e4a-68b3-45d1-a90e-060bb86a35ff tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: fdceb21a-7767-4e17-aecc-c1218f6978db] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:13:39.497461 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7a658e4a-68b3-45d1-a90e-060bb86a35ff tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:13:39.497937 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7a658e4a-68b3-45d1-a90e-060bb86a35ff tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:13:39.498732 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7a658e4a-68b3-45d1-a90e-060bb86a35ff tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:13:39.499188 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7a658e4a-68b3-45d1-a90e-060bb86a35ff tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:13:39.637620 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7a658e4a-68b3-45d1-a90e-060bb86a35ff tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:13:39.645497 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7a658e4a-68b3-45d1-a90e-060bb86a35ff tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db" status: 200 len: 1687 microversion: 2.1 time: 0.159959 Apr 16 22:13:39.646675 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3882/7604] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:13:39 2022] GET /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db => generated 1687 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:13:40.294781 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-feb2b6fb-d2d6-4851-9304-9e5b1272c268 req-1343289e-5a64-433f-8fa0-b1c4b2f0b7ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdceb21a-7767-4e17-aecc-c1218f6978db", "name": "network-vif-deleted", "tag": "1a359ec2-552d-4caf-a46d-bcf1e6221f5b"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:13:40.303802 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-feb2b6fb-d2d6-4851-9304-9e5b1272c268 req-1343289e-5a64-433f-8fa0-b1c4b2f0b7ef service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:13:40.304303 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-feb2b6fb-d2d6-4851-9304-9e5b1272c268 req-1343289e-5a64-433f-8fa0-b1c4b2f0b7ef service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:13:40.317960 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-feb2b6fb-d2d6-4851-9304-9e5b1272c268 req-1343289e-5a64-433f-8fa0-b1c4b2f0b7ef service nova] Creating event network-vif-deleted:1a359ec2-552d-4caf-a46d-bcf1e6221f5b for instance fdceb21a-7767-4e17-aecc-c1218f6978db on nch1-master-1 Apr 16 22:13:40.322676 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-feb2b6fb-d2d6-4851-9304-9e5b1272c268 req-1343289e-5a64-433f-8fa0-b1c4b2f0b7ef service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032246 Apr 16 22:13:40.323278 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3723/7605] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:13:40.663101 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-51cd4acd-e76e-479f-8197-b4ab8075f86d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:13:40.664381 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-51cd4acd-e76e-479f-8197-b4ab8075f86d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: fdceb21a-7767-4e17-aecc-c1218f6978db] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:13:40.671597 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-51cd4acd-e76e-479f-8197-b4ab8075f86d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:13:40.672065 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-51cd4acd-e76e-479f-8197-b4ab8075f86d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:13:40.672973 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-51cd4acd-e76e-479f-8197-b4ab8075f86d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:13:40.673594 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-51cd4acd-e76e-479f-8197-b4ab8075f86d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:13:40.706386 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-51cd4acd-e76e-479f-8197-b4ab8075f86d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:13:40.706855 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-51cd4acd-e76e-479f-8197-b4ab8075f86d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:13:40.707348 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-51cd4acd-e76e-479f-8197-b4ab8075f86d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lazy-loading 'fault' on Instance uuid fdceb21a-7767-4e17-aecc-c1218f6978db {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 22:13:40.749595 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-51cd4acd-e76e-479f-8197-b4ab8075f86d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fa5c4f477214df880fc12d6da76283a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d4eaa0fe99e42488e0720b18be48ac8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:13:40.757221 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-51cd4acd-e76e-479f-8197-b4ab8075f86d tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db" status: 200 len: 1356 microversion: 2.1 time: 0.098057 Apr 16 22:13:40.757948 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3883/7606] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:13:40 2022] GET /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db => generated 1356 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:13:41.776490 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-27636632-5541-465d-994c-d9b9698adae0 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:13:41.777201 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-27636632-5541-465d-994c-d9b9698adae0 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] [instance: fdceb21a-7767-4e17-aecc-c1218f6978db] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:13:41.784280 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-27636632-5541-465d-994c-d9b9698adae0 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:13:41.784741 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-27636632-5541-465d-994c-d9b9698adae0 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:13:41.785521 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-27636632-5541-465d-994c-d9b9698adae0 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:13:41.785972 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-27636632-5541-465d-994c-d9b9698adae0 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:13:41.799715 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-27636632-5541-465d-994c-d9b9698adae0 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] HTTP exception thrown: Instance fdceb21a-7767-4e17-aecc-c1218f6978db could not be found. Apr 16 22:13:41.800406 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-27636632-5541-465d-994c-d9b9698adae0 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Returning 404 to user: Instance fdceb21a-7767-4e17-aecc-c1218f6978db could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 22:13:41.801240 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-27636632-5541-465d-994c-d9b9698adae0 tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "GET /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db" status: 404 len: 111 microversion: 2.1 time: 0.030111 Apr 16 22:13:41.801773 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3724/7607] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:13:41 2022] GET /compute/v2.1/servers/fdceb21a-7767-4e17-aecc-c1218f6978db => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 22:13:45.634550 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8fb251df-acd1-49ec-a882-c5de45da572f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] Calling method '.version_select at 0x7fbb959ba160>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:13:45.712724 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8fb251df-acd1-49ec-a882-c5de45da572f tempest-TestNetworkAdvancedServerOps-1989351084 tempest-TestNetworkAdvancedServerOps-1989351084-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2028207928" status: 202 len: 0 microversion: 2.1 time: 0.082805 Apr 16 22:13:45.713323 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3884/7608] 10.222.0.20 () {58 vars in 1283 bytes} [Sat Apr 16 22:13:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2028207928 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 16 22:14:00.258147 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-09249cab-3218-48a3-ba06-1dccba73e972 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Action: 'create', calling method: .version_select at 0x7fbb965340d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1336047475"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:14:00.273366 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-09249cab-3218-48a3-ba06-1dccba73e972 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Getting quotas for project 8a91917b203d4a2ca179d394e04af71f. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 22:14:00.279002 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-09249cab-3218-48a3-ba06-1dccba73e972 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Getting quotas for user 37ff1c2e4f3b45f589d675028674ecb3 and project 8a91917b203d4a2ca179d394e04af71f. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 22:14:00.476199 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-09249cab-3218-48a3-ba06-1dccba73e972 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Getting quotas for project 8a91917b203d4a2ca179d394e04af71f. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 22:14:00.482272 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-09249cab-3218-48a3-ba06-1dccba73e972 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Getting quotas for user 37ff1c2e4f3b45f589d675028674ecb3 and project 8a91917b203d4a2ca179d394e04af71f. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 22:14:00.497370 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-09249cab-3218-48a3-ba06-1dccba73e972 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.420943 Apr 16 22:14:00.497969 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3725/7609] 10.222.0.20 () {60 vars in 1157 bytes} [Sat Apr 16 22:14:00 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:14:02.932215 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-67460c74-3399-41f7-8adb-1136b4461aaa tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1968883808", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1336047475", "security_groups": [{"name": "tempest-secgroup-smoke-301018753"}], "networks": [{"uuid": "ce19f73a-c474-49ea-9c81-734b1baff584"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:14:03.038512 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-67460c74-3399-41f7-8adb-1136b4461aaa tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] validate_networks() for [('ce19f73a-c474-49ea-9c81-734b1baff584', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 22:14:03.488258 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-67460c74-3399-41f7-8adb-1136b4461aaa tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 22:14:03.488749 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-67460c74-3399-41f7-8adb-1136b4461aaa tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 22:14:03.489243 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-67460c74-3399-41f7-8adb-1136b4461aaa tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 22:14:03.490178 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-67460c74-3399-41f7-8adb-1136b4461aaa tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 22:14:03.490289 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-67460c74-3399-41f7-8adb-1136b4461aaa tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 22:14:03.500670 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-67460c74-3399-41f7-8adb-1136b4461aaa tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:14:03.500670 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-67460c74-3399-41f7-8adb-1136b4461aaa tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:14:03.502751 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-67460c74-3399-41f7-8adb-1136b4461aaa tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:14:03.503393 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-67460c74-3399-41f7-8adb-1136b4461aaa tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:14:03.526127 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-67460c74-3399-41f7-8adb-1136b4461aaa tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Getting quotas for project 8a91917b203d4a2ca179d394e04af71f. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 22:14:03.531570 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-67460c74-3399-41f7-8adb-1136b4461aaa tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Getting quotas for user 37ff1c2e4f3b45f589d675028674ecb3 and project 8a91917b203d4a2ca179d394e04af71f. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 22:14:03.544342 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-67460c74-3399-41f7-8adb-1136b4461aaa tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 22:14:03.546719 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-67460c74-3399-41f7-8adb-1136b4461aaa tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 22:14:03.682335 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-67460c74-3399-41f7-8adb-1136b4461aaa tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.755635 Apr 16 22:14:03.684312 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3885/7610] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 22:14:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 22:14:03.695940 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-705e6755-975b-4756-8add-3a928e585e02 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:14:03.698533 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-705e6755-975b-4756-8add-3a928e585e02 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:14:03.768402 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-705e6755-975b-4756-8add-3a928e585e02 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:14:03.775898 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-705e6755-975b-4756-8add-3a928e585e02 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1247 microversion: 2.1 time: 0.084636 Apr 16 22:14:03.776517 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3726/7611] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:14:03 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1247 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:14:04.793314 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4425b397-6050-4548-9947-7130e10a363b tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:14:04.793984 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4425b397-6050-4548-9947-7130e10a363b tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:14:04.847024 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4425b397-6050-4548-9947-7130e10a363b tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:14:04.853644 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4425b397-6050-4548-9947-7130e10a363b tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1247 microversion: 2.1 time: 0.065139 Apr 16 22:14:04.854218 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3886/7612] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:14:04 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1247 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:14:05.870887 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ad6b4fda-e7c6-429d-8c1e-719a2b635624 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:14:05.871496 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ad6b4fda-e7c6-429d-8c1e-719a2b635624 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:14:05.879162 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ad6b4fda-e7c6-429d-8c1e-719a2b635624 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:14:05.879626 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ad6b4fda-e7c6-429d-8c1e-719a2b635624 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:14:05.880595 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ad6b4fda-e7c6-429d-8c1e-719a2b635624 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:14:05.881051 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ad6b4fda-e7c6-429d-8c1e-719a2b635624 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:14:05.966312 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ad6b4fda-e7c6-429d-8c1e-719a2b635624 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:14:05.974069 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ad6b4fda-e7c6-429d-8c1e-719a2b635624 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1307 microversion: 2.1 time: 0.107319 Apr 16 22:14:05.974657 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3727/7613] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:14:05 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1307 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:14:06.990959 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-46ea6854-1591-4a63-9219-f63406ca7454 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:14:06.991498 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-46ea6854-1591-4a63-9219-f63406ca7454 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:14:06.999581 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-46ea6854-1591-4a63-9219-f63406ca7454 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:14:07.000051 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-46ea6854-1591-4a63-9219-f63406ca7454 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:14:07.000868 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-46ea6854-1591-4a63-9219-f63406ca7454 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:14:07.001322 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-46ea6854-1591-4a63-9219-f63406ca7454 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:14:07.130774 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-46ea6854-1591-4a63-9219-f63406ca7454 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:14:07.138154 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-46ea6854-1591-4a63-9219-f63406ca7454 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1372 microversion: 2.1 time: 0.151206 Apr 16 22:14:07.139033 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3887/7614] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:14:06 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:14:07.472054 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-85f5a273-4040-4f00-b1e9-319907fb1420 req-7b9f4ffd-e0eb-471a-a6b6-db6fb8a5941d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bafbfec-97cd-4628-87cd-2963042e626b", "tag": "0ecb0fab-d4e8-4e5b-ae20-5cc6a6415e6c"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:14:07.481821 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-85f5a273-4040-4f00-b1e9-319907fb1420 req-7b9f4ffd-e0eb-471a-a6b6-db6fb8a5941d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:14:07.489866 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-85f5a273-4040-4f00-b1e9-319907fb1420 req-7b9f4ffd-e0eb-471a-a6b6-db6fb8a5941d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:14:07.497865 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-85f5a273-4040-4f00-b1e9-319907fb1420 req-7b9f4ffd-e0eb-471a-a6b6-db6fb8a5941d service nova] Creating event network-changed:0ecb0fab-d4e8-4e5b-ae20-5cc6a6415e6c for instance 2bafbfec-97cd-4628-87cd-2963042e626b on nch1-master-1 Apr 16 22:14:07.503256 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-85f5a273-4040-4f00-b1e9-319907fb1420 req-7b9f4ffd-e0eb-471a-a6b6-db6fb8a5941d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034913 Apr 16 22:14:07.503867 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3728/7615] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:14:08.156219 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-0e8efb2b-3584-4026-8eec-b13caff6b91e tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:14:08.156873 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-0e8efb2b-3584-4026-8eec-b13caff6b91e tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:14:08.163546 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0e8efb2b-3584-4026-8eec-b13caff6b91e tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:14:08.164018 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0e8efb2b-3584-4026-8eec-b13caff6b91e tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:14:08.164838 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0e8efb2b-3584-4026-8eec-b13caff6b91e tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:14:08.165291 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-0e8efb2b-3584-4026-8eec-b13caff6b91e tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:14:08.299814 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-0e8efb2b-3584-4026-8eec-b13caff6b91e tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:14:08.307255 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-0e8efb2b-3584-4026-8eec-b13caff6b91e tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1372 microversion: 2.1 time: 0.155147 Apr 16 22:14:08.307829 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3888/7616] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:14:08 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:14:09.327087 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fa5949d1-1707-4192-9831-c0a000ce36c1 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:14:09.327724 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-fa5949d1-1707-4192-9831-c0a000ce36c1 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:14:09.333965 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fa5949d1-1707-4192-9831-c0a000ce36c1 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:14:09.334428 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fa5949d1-1707-4192-9831-c0a000ce36c1 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:14:09.335247 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fa5949d1-1707-4192-9831-c0a000ce36c1 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:14:09.335703 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fa5949d1-1707-4192-9831-c0a000ce36c1 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:14:09.466165 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-fa5949d1-1707-4192-9831-c0a000ce36c1 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:14:09.473677 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fa5949d1-1707-4192-9831-c0a000ce36c1 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1372 microversion: 2.1 time: 0.152847 Apr 16 22:14:09.474252 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3729/7617] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:14:09 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:14:10.490680 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-fd0b0bb3-b986-4217-af17-a39d85129b8f tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:14:10.491623 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-fd0b0bb3-b986-4217-af17-a39d85129b8f tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:14:10.498147 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fd0b0bb3-b986-4217-af17-a39d85129b8f tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:14:10.498623 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fd0b0bb3-b986-4217-af17-a39d85129b8f tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:14:10.499434 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fd0b0bb3-b986-4217-af17-a39d85129b8f tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:14:10.499899 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-fd0b0bb3-b986-4217-af17-a39d85129b8f tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:14:10.629754 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-fd0b0bb3-b986-4217-af17-a39d85129b8f tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:14:10.638300 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-fd0b0bb3-b986-4217-af17-a39d85129b8f tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1372 microversion: 2.1 time: 0.151753 Apr 16 22:14:10.647807 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3889/7618] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:14:10 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:14:11.655621 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-e512af6e-7ad8-4d06-90ea-79a083d8da7e tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:14:11.656272 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-e512af6e-7ad8-4d06-90ea-79a083d8da7e tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:14:11.663229 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e512af6e-7ad8-4d06-90ea-79a083d8da7e tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:14:11.663694 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e512af6e-7ad8-4d06-90ea-79a083d8da7e tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:14:11.664517 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e512af6e-7ad8-4d06-90ea-79a083d8da7e tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:14:11.664972 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-e512af6e-7ad8-4d06-90ea-79a083d8da7e tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:14:11.836123 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-e512af6e-7ad8-4d06-90ea-79a083d8da7e tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:14:11.844211 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-e512af6e-7ad8-4d06-90ea-79a083d8da7e tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1372 microversion: 2.1 time: 0.193069 Apr 16 22:14:11.844793 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3730/7619] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:14:11 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1372 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:14:12.861887 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1ff8a59d-d139-48bd-84be-6999e392f581 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:14:12.866953 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1ff8a59d-d139-48bd-84be-6999e392f581 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:14:12.867067 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-cb55b2f6-5662-46b0-afc4-fa6184f5d0ab req-6a7e3d39-3fd9-4143-b8d3-5d58f470e492 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bafbfec-97cd-4628-87cd-2963042e626b", "name": "network-vif-plugged", "status": "completed", "tag": "0ecb0fab-d4e8-4e5b-ae20-5cc6a6415e6c"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:14:12.873540 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-cb55b2f6-5662-46b0-afc4-fa6184f5d0ab req-6a7e3d39-3fd9-4143-b8d3-5d58f470e492 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:14:12.873753 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1ff8a59d-d139-48bd-84be-6999e392f581 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:14:12.874001 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-cb55b2f6-5662-46b0-afc4-fa6184f5d0ab req-6a7e3d39-3fd9-4143-b8d3-5d58f470e492 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:14:12.874214 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1ff8a59d-d139-48bd-84be-6999e392f581 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:14:12.875015 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1ff8a59d-d139-48bd-84be-6999e392f581 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:14:12.875501 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1ff8a59d-d139-48bd-84be-6999e392f581 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:14:12.889488 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-cb55b2f6-5662-46b0-afc4-fa6184f5d0ab req-6a7e3d39-3fd9-4143-b8d3-5d58f470e492 service nova] Creating event network-vif-plugged:0ecb0fab-d4e8-4e5b-ae20-5cc6a6415e6c for instance 2bafbfec-97cd-4628-87cd-2963042e626b on nch1-master-1 Apr 16 22:14:12.894603 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-cb55b2f6-5662-46b0-afc4-fa6184f5d0ab req-6a7e3d39-3fd9-4143-b8d3-5d58f470e492 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034463 Apr 16 22:14:12.897552 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3731/7620] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 22:14:13.019725 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1ff8a59d-d139-48bd-84be-6999e392f581 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:14:13.029246 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1ff8a59d-d139-48bd-84be-6999e392f581 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1372 microversion: 2.1 time: 0.171405 Apr 16 22:14:13.029831 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3890/7621] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:14:12 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1372 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:14:14.047823 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1874a348-dac5-42e1-9bd1-01268dd5746e tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:14:14.048476 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1874a348-dac5-42e1-9bd1-01268dd5746e tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:14:14.055914 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1874a348-dac5-42e1-9bd1-01268dd5746e tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:14:14.056423 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1874a348-dac5-42e1-9bd1-01268dd5746e tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:14:14.058664 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1874a348-dac5-42e1-9bd1-01268dd5746e tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:14:14.058664 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1874a348-dac5-42e1-9bd1-01268dd5746e tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:14:14.198695 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1874a348-dac5-42e1-9bd1-01268dd5746e tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:14:14.204338 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1874a348-dac5-42e1-9bd1-01268dd5746e tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1372 microversion: 2.1 time: 0.161822 Apr 16 22:14:14.205678 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3732/7622] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:14:14 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:14:15.222091 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-dcccb1d6-b186-4fce-b48f-67e78d003005 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:14:15.222747 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-dcccb1d6-b186-4fce-b48f-67e78d003005 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:14:15.229516 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dcccb1d6-b186-4fce-b48f-67e78d003005 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:14:15.229987 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dcccb1d6-b186-4fce-b48f-67e78d003005 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:14:15.230798 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dcccb1d6-b186-4fce-b48f-67e78d003005 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:14:15.231253 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-dcccb1d6-b186-4fce-b48f-67e78d003005 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:14:15.357298 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-dcccb1d6-b186-4fce-b48f-67e78d003005 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:14:15.364646 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-dcccb1d6-b186-4fce-b48f-67e78d003005 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1556 microversion: 2.1 time: 0.146409 Apr 16 22:14:15.365219 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3891/7623] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:14:15 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1556 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:14:15.381836 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d9092ce0-9e92-4e14-9d2f-567691483d50 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:14:15.383560 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d9092ce0-9e92-4e14-9d2f-567691483d50 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:14:15.391434 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d9092ce0-9e92-4e14-9d2f-567691483d50 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:14:15.391966 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d9092ce0-9e92-4e14-9d2f-567691483d50 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:14:15.392863 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d9092ce0-9e92-4e14-9d2f-567691483d50 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:14:15.393374 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d9092ce0-9e92-4e14-9d2f-567691483d50 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:14:15.528800 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d9092ce0-9e92-4e14-9d2f-567691483d50 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:14:15.536158 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d9092ce0-9e92-4e14-9d2f-567691483d50 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1556 microversion: 2.1 time: 0.158808 Apr 16 22:14:15.536755 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3733/7624] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:14:15 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1556 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:14:17.508219 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-ebb83c06-e092-44c9-93b5-4ec92bb12ad9 req-215a6c12-bf2e-47b4-9dc6-027256063302 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bafbfec-97cd-4628-87cd-2963042e626b", "tag": "0ecb0fab-d4e8-4e5b-ae20-5cc6a6415e6c"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:14:17.517967 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-ebb83c06-e092-44c9-93b5-4ec92bb12ad9 req-215a6c12-bf2e-47b4-9dc6-027256063302 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:14:17.518435 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-ebb83c06-e092-44c9-93b5-4ec92bb12ad9 req-215a6c12-bf2e-47b4-9dc6-027256063302 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:14:17.530069 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-ebb83c06-e092-44c9-93b5-4ec92bb12ad9 req-215a6c12-bf2e-47b4-9dc6-027256063302 service nova] Creating event network-changed:0ecb0fab-d4e8-4e5b-ae20-5cc6a6415e6c for instance 2bafbfec-97cd-4628-87cd-2963042e626b on nch1-master-1 Apr 16 22:14:17.535299 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-ebb83c06-e092-44c9-93b5-4ec92bb12ad9 req-215a6c12-bf2e-47b4-9dc6-027256063302 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030705 Apr 16 22:14:17.536011 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3892/7625] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:15:31.197837 ncdv-master-1 devstack@n-api.service[137409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:15:31.198367 ncdv-master-1 devstack@n-api.service[137409]: Sat Apr 16 22:15:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 22:16:11.647402 ncdv-master-1 devstack@n-api.service[137409]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c4054330-0d3a-466e-a30b-fa9db79ae593] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 16 22:16:11.648400 ncdv-master-1 devstack@n-api.service[137409]: ERROR oslo.messaging._drivers.impl_rabbit [-] [288aa017-6cef-4242-b65f-3a2680f89840] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 16 22:16:11.652970 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-96aa5850-f45e-4a56-8ce1-f0156fcf3aab tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:16:11.653526 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-96aa5850-f45e-4a56-8ce1-f0156fcf3aab tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:16:11.659555 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-96aa5850-f45e-4a56-8ce1-f0156fcf3aab tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:11.660022 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-96aa5850-f45e-4a56-8ce1-f0156fcf3aab tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:11.660844 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-96aa5850-f45e-4a56-8ce1-f0156fcf3aab tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:11.661296 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-96aa5850-f45e-4a56-8ce1-f0156fcf3aab tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:11.685176 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.objects.instance [None req-96aa5850-f45e-4a56-8ce1-f0156fcf3aab tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lazy-loading 'flavor' on Instance uuid 2bafbfec-97cd-4628-87cd-2963042e626b {{(pid=137409) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 22:16:12.278176 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-96aa5850-f45e-4a56-8ce1-f0156fcf3aab tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "POST /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b/action" status: 202 len: 0 microversion: 2.1 time: 0.632349 Apr 16 22:16:12.278807 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3734/7626] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 22:16:11 2022] POST /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b/action => generated 0 bytes in 634 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 22:16:12.285392 ncdv-master-1 devstack@n-api.service[137408]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5f71e57d-51af-43d6-a26d-a848d4145923] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 16 22:16:12.286220 ncdv-master-1 devstack@n-api.service[137408]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cd30ce4f-cd80-45c8-9ec5-78e4a107947b] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 16 22:16:12.290376 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7b2081a6-eff2-4324-a3e4-0f4ebf7ec2a7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:16:12.293312 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7b2081a6-eff2-4324-a3e4-0f4ebf7ec2a7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:16:12.297446 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7b2081a6-eff2-4324-a3e4-0f4ebf7ec2a7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:12.297910 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7b2081a6-eff2-4324-a3e4-0f4ebf7ec2a7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:12.298705 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7b2081a6-eff2-4324-a3e4-0f4ebf7ec2a7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:12.299170 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7b2081a6-eff2-4324-a3e4-0f4ebf7ec2a7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:12.434313 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7b2081a6-eff2-4324-a3e4-0f4ebf7ec2a7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:16:12.441786 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7b2081a6-eff2-4324-a3e4-0f4ebf7ec2a7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1681 microversion: 2.1 time: 0.158306 Apr 16 22:16:12.442369 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3893/7627] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:16:12 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:16:13.464129 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-5438756a-0626-4bb5-a113-efa81e0ec6b1 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:16:13.464899 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-5438756a-0626-4bb5-a113-efa81e0ec6b1 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:16:13.473701 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5438756a-0626-4bb5-a113-efa81e0ec6b1 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:13.474172 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5438756a-0626-4bb5-a113-efa81e0ec6b1 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:13.474990 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5438756a-0626-4bb5-a113-efa81e0ec6b1 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:13.475440 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-5438756a-0626-4bb5-a113-efa81e0ec6b1 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:13.481599 ncdv-master-1 devstack@n-api.service[137409]: INFO oslo.messaging._drivers.impl_rabbit [-] [c4054330-0d3a-466e-a30b-fa9db79ae593] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 46544. Apr 16 22:16:13.482365 ncdv-master-1 devstack@n-api.service[137409]: INFO oslo.messaging._drivers.impl_rabbit [-] [288aa017-6cef-4242-b65f-3a2680f89840] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 46546. Apr 16 22:16:13.607640 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-5438756a-0626-4bb5-a113-efa81e0ec6b1 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:16:13.615098 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-5438756a-0626-4bb5-a113-efa81e0ec6b1 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1681 microversion: 2.1 time: 0.158314 Apr 16 22:16:13.615679 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3735/7628] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:16:13 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:16:14.632096 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1fed3af9-49a1-4b9f-bca8-893a65e4b23f tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:16:14.632661 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1fed3af9-49a1-4b9f-bca8-893a65e4b23f tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:16:14.645669 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1fed3af9-49a1-4b9f-bca8-893a65e4b23f tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:14.646141 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1fed3af9-49a1-4b9f-bca8-893a65e4b23f tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:14.646925 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1fed3af9-49a1-4b9f-bca8-893a65e4b23f tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:14.647379 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1fed3af9-49a1-4b9f-bca8-893a65e4b23f tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:14.653663 ncdv-master-1 devstack@n-api.service[137408]: INFO oslo.messaging._drivers.impl_rabbit [-] [cd30ce4f-cd80-45c8-9ec5-78e4a107947b] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 46552. Apr 16 22:16:14.656066 ncdv-master-1 devstack@n-api.service[137408]: INFO oslo.messaging._drivers.impl_rabbit [-] [5f71e57d-51af-43d6-a26d-a848d4145923] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 46550. Apr 16 22:16:15.093514 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1fed3af9-49a1-4b9f-bca8-893a65e4b23f tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:16:15.100980 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1fed3af9-49a1-4b9f-bca8-893a65e4b23f tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1681 microversion: 2.1 time: 0.472865 Apr 16 22:16:15.101552 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3894/7629] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:16:14 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1681 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:16:16.119446 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fcc335d6-9c30-4100-8c8a-b340a36fd6bb tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:16:16.120060 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-fcc335d6-9c30-4100-8c8a-b340a36fd6bb tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:16:16.126938 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fcc335d6-9c30-4100-8c8a-b340a36fd6bb tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:16.127395 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fcc335d6-9c30-4100-8c8a-b340a36fd6bb tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:16.128165 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fcc335d6-9c30-4100-8c8a-b340a36fd6bb tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:16.128633 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fcc335d6-9c30-4100-8c8a-b340a36fd6bb tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:16.255303 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-fcc335d6-9c30-4100-8c8a-b340a36fd6bb tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:16:16.263207 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fcc335d6-9c30-4100-8c8a-b340a36fd6bb tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1681 microversion: 2.1 time: 0.148221 Apr 16 22:16:16.263781 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3736/7630] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:16:16 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:16:17.281030 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bc037b7c-0995-4d2e-a790-f010055292d8 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:16:17.281662 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-bc037b7c-0995-4d2e-a790-f010055292d8 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:16:17.288636 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bc037b7c-0995-4d2e-a790-f010055292d8 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:17.289113 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bc037b7c-0995-4d2e-a790-f010055292d8 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:17.289909 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bc037b7c-0995-4d2e-a790-f010055292d8 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:17.290376 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bc037b7c-0995-4d2e-a790-f010055292d8 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:17.419274 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-bc037b7c-0995-4d2e-a790-f010055292d8 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:16:17.426980 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-bc037b7c-0995-4d2e-a790-f010055292d8 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1681 microversion: 2.1 time: 0.150023 Apr 16 22:16:17.427564 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3895/7631] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:16:17 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:16:18.443693 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-74cdacbb-bc68-484d-8105-b7054040a258 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:16:18.444332 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-74cdacbb-bc68-484d-8105-b7054040a258 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:16:18.451422 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-74cdacbb-bc68-484d-8105-b7054040a258 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:18.451879 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-74cdacbb-bc68-484d-8105-b7054040a258 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:18.452676 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-74cdacbb-bc68-484d-8105-b7054040a258 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:18.453121 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-74cdacbb-bc68-484d-8105-b7054040a258 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:18.643579 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-74cdacbb-bc68-484d-8105-b7054040a258 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:16:18.651700 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-74cdacbb-bc68-484d-8105-b7054040a258 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1681 microversion: 2.1 time: 0.211889 Apr 16 22:16:18.652295 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3737/7632] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:16:18 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1681 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:16:19.668263 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ff2f3d0f-fe1e-41d4-ad71-adf9e535d352 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:16:19.668925 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ff2f3d0f-fe1e-41d4-ad71-adf9e535d352 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:16:19.675803 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ff2f3d0f-fe1e-41d4-ad71-adf9e535d352 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:19.676314 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ff2f3d0f-fe1e-41d4-ad71-adf9e535d352 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:19.677109 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ff2f3d0f-fe1e-41d4-ad71-adf9e535d352 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:19.677566 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ff2f3d0f-fe1e-41d4-ad71-adf9e535d352 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:19.865210 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ff2f3d0f-fe1e-41d4-ad71-adf9e535d352 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:16:19.873020 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ff2f3d0f-fe1e-41d4-ad71-adf9e535d352 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1681 microversion: 2.1 time: 0.208686 Apr 16 22:16:19.873586 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3896/7633] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:16:19 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1681 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:16:20.890117 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6a5afab5-84e2-4291-8dfe-ebd671f92549 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:16:20.890731 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6a5afab5-84e2-4291-8dfe-ebd671f92549 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:16:20.897775 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6a5afab5-84e2-4291-8dfe-ebd671f92549 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:20.902002 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6a5afab5-84e2-4291-8dfe-ebd671f92549 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:20.902002 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6a5afab5-84e2-4291-8dfe-ebd671f92549 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:20.902002 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6a5afab5-84e2-4291-8dfe-ebd671f92549 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:21.031455 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6a5afab5-84e2-4291-8dfe-ebd671f92549 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:16:21.038915 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6a5afab5-84e2-4291-8dfe-ebd671f92549 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1681 microversion: 2.1 time: 0.152745 Apr 16 22:16:21.039486 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3738/7634] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:16:20 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:16:22.056860 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b38a4a41-2a1c-4577-8318-a2531e73ea87 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:16:22.058032 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b38a4a41-2a1c-4577-8318-a2531e73ea87 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:16:22.065130 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b38a4a41-2a1c-4577-8318-a2531e73ea87 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:22.065612 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b38a4a41-2a1c-4577-8318-a2531e73ea87 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:22.066414 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b38a4a41-2a1c-4577-8318-a2531e73ea87 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:22.066878 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b38a4a41-2a1c-4577-8318-a2531e73ea87 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:22.194385 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b38a4a41-2a1c-4577-8318-a2531e73ea87 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:16:22.202618 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b38a4a41-2a1c-4577-8318-a2531e73ea87 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1681 microversion: 2.1 time: 0.149775 Apr 16 22:16:22.203195 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3897/7635] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:16:22 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:16:23.220428 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-537c4555-d4ec-4e06-bed6-f664719cf178 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:16:23.221048 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-537c4555-d4ec-4e06-bed6-f664719cf178 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:16:23.227800 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-537c4555-d4ec-4e06-bed6-f664719cf178 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:23.228296 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-537c4555-d4ec-4e06-bed6-f664719cf178 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:23.229080 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-537c4555-d4ec-4e06-bed6-f664719cf178 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:23.229524 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-537c4555-d4ec-4e06-bed6-f664719cf178 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:23.361638 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-537c4555-d4ec-4e06-bed6-f664719cf178 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:16:23.369042 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-537c4555-d4ec-4e06-bed6-f664719cf178 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1702 microversion: 2.1 time: 0.152591 Apr 16 22:16:23.369619 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3739/7636] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:16:23 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1702 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:16:24.386758 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7cdbe917-3ced-475a-ad93-b692d870e6ce tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:16:24.387394 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7cdbe917-3ced-475a-ad93-b692d870e6ce tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:16:24.394245 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7cdbe917-3ced-475a-ad93-b692d870e6ce tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:24.394719 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7cdbe917-3ced-475a-ad93-b692d870e6ce tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:24.395508 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7cdbe917-3ced-475a-ad93-b692d870e6ce tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:24.395966 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7cdbe917-3ced-475a-ad93-b692d870e6ce tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:24.522969 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7cdbe917-3ced-475a-ad93-b692d870e6ce tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:16:24.530833 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7cdbe917-3ced-475a-ad93-b692d870e6ce tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1702 microversion: 2.1 time: 0.148160 Apr 16 22:16:24.531414 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3898/7637] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:16:24 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1702 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:16:25.548598 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-87c705cd-8a9e-4db4-9e0f-a6cb473d605e tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:16:25.549211 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-87c705cd-8a9e-4db4-9e0f-a6cb473d605e tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:16:25.555698 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-87c705cd-8a9e-4db4-9e0f-a6cb473d605e tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:25.556161 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-87c705cd-8a9e-4db4-9e0f-a6cb473d605e tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:25.557632 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-87c705cd-8a9e-4db4-9e0f-a6cb473d605e tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:25.558121 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-87c705cd-8a9e-4db4-9e0f-a6cb473d605e tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:25.712945 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-87c705cd-8a9e-4db4-9e0f-a6cb473d605e tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:16:25.721424 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-87c705cd-8a9e-4db4-9e0f-a6cb473d605e tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1697 microversion: 2.1 time: 0.176953 Apr 16 22:16:25.726059 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3740/7638] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:16:25 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1697 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 22:16:26.738854 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2c4babab-c11e-4c75-9c6c-2bdcdd89b047 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:16:26.740149 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2c4babab-c11e-4c75-9c6c-2bdcdd89b047 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:16:26.748283 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2c4babab-c11e-4c75-9c6c-2bdcdd89b047 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:26.749014 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2c4babab-c11e-4c75-9c6c-2bdcdd89b047 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:26.749992 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2c4babab-c11e-4c75-9c6c-2bdcdd89b047 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:26.750453 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2c4babab-c11e-4c75-9c6c-2bdcdd89b047 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:26.896538 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2c4babab-c11e-4c75-9c6c-2bdcdd89b047 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:16:26.904802 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2c4babab-c11e-4c75-9c6c-2bdcdd89b047 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1697 microversion: 2.1 time: 0.169768 Apr 16 22:16:26.905600 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3899/7639] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:16:26 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1697 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:16:27.313145 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-113e55bf-c183-4125-aa7e-7b3d3bda1a72 req-a671e50c-db84-4372-ba42-dbb016397ff9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bafbfec-97cd-4628-87cd-2963042e626b", "name": "network-vif-plugged", "status": "completed", "tag": "0ecb0fab-d4e8-4e5b-ae20-5cc6a6415e6c"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:16:27.325622 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-113e55bf-c183-4125-aa7e-7b3d3bda1a72 req-a671e50c-db84-4372-ba42-dbb016397ff9 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:27.326263 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-113e55bf-c183-4125-aa7e-7b3d3bda1a72 req-a671e50c-db84-4372-ba42-dbb016397ff9 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:27.337795 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-113e55bf-c183-4125-aa7e-7b3d3bda1a72 req-a671e50c-db84-4372-ba42-dbb016397ff9 service nova] Creating event network-vif-plugged:0ecb0fab-d4e8-4e5b-ae20-5cc6a6415e6c for instance 2bafbfec-97cd-4628-87cd-2963042e626b on nch1-master-1 Apr 16 22:16:27.343848 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-113e55bf-c183-4125-aa7e-7b3d3bda1a72 req-a671e50c-db84-4372-ba42-dbb016397ff9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034762 Apr 16 22:16:27.344606 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3741/7640] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:16:27.923151 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-75180dfb-29e9-43a1-96da-e52d448b3081 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:16:27.924559 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-75180dfb-29e9-43a1-96da-e52d448b3081 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:16:27.931613 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-75180dfb-29e9-43a1-96da-e52d448b3081 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:27.935973 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-75180dfb-29e9-43a1-96da-e52d448b3081 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:27.935973 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-75180dfb-29e9-43a1-96da-e52d448b3081 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:27.935973 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-75180dfb-29e9-43a1-96da-e52d448b3081 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:28.086968 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-75180dfb-29e9-43a1-96da-e52d448b3081 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:16:28.095980 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-75180dfb-29e9-43a1-96da-e52d448b3081 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1697 microversion: 2.1 time: 0.176778 Apr 16 22:16:28.097268 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3900/7641] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:16:27 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1697 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:16:29.114441 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ce67d988-28e8-4198-b9f8-ee0d979b6e19 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:16:29.115349 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ce67d988-28e8-4198-b9f8-ee0d979b6e19 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:16:29.122519 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ce67d988-28e8-4198-b9f8-ee0d979b6e19 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:29.123621 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ce67d988-28e8-4198-b9f8-ee0d979b6e19 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:29.124513 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ce67d988-28e8-4198-b9f8-ee0d979b6e19 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:29.124965 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ce67d988-28e8-4198-b9f8-ee0d979b6e19 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:29.285399 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ce67d988-28e8-4198-b9f8-ee0d979b6e19 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:16:29.293610 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ce67d988-28e8-4198-b9f8-ee0d979b6e19 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1697 microversion: 2.1 time: 0.183436 Apr 16 22:16:29.294276 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3742/7642] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:16:29 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1697 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:16:30.311566 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-afc50f3f-165d-4a78-8012-e5e7059e19c4 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:16:30.312339 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-afc50f3f-165d-4a78-8012-e5e7059e19c4 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:16:30.319263 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-afc50f3f-165d-4a78-8012-e5e7059e19c4 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:30.319761 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-afc50f3f-165d-4a78-8012-e5e7059e19c4 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:30.320983 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-afc50f3f-165d-4a78-8012-e5e7059e19c4 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:30.321669 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-afc50f3f-165d-4a78-8012-e5e7059e19c4 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:30.474768 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-afc50f3f-165d-4a78-8012-e5e7059e19c4 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:16:30.488156 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-afc50f3f-165d-4a78-8012-e5e7059e19c4 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1697 microversion: 2.1 time: 0.180746 Apr 16 22:16:30.489333 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3901/7643] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:16:30 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1697 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:16:31.505380 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-579a6706-c0b8-4da6-9efb-05a07e37ca9d tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:16:31.506004 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-579a6706-c0b8-4da6-9efb-05a07e37ca9d tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:16:31.513418 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-579a6706-c0b8-4da6-9efb-05a07e37ca9d tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:31.513881 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-579a6706-c0b8-4da6-9efb-05a07e37ca9d tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:31.514668 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-579a6706-c0b8-4da6-9efb-05a07e37ca9d tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:31.515119 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-579a6706-c0b8-4da6-9efb-05a07e37ca9d tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:31.676588 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-579a6706-c0b8-4da6-9efb-05a07e37ca9d tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:16:31.691125 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-579a6706-c0b8-4da6-9efb-05a07e37ca9d tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1697 microversion: 2.1 time: 0.189602 Apr 16 22:16:31.692223 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3743/7644] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:16:31 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1697 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:16:32.711602 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7dd7865b-562f-4f6a-bdfd-74ba04858020 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:16:32.712306 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7dd7865b-562f-4f6a-bdfd-74ba04858020 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:16:32.718921 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7dd7865b-562f-4f6a-bdfd-74ba04858020 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:32.720272 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7dd7865b-562f-4f6a-bdfd-74ba04858020 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:32.720272 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7dd7865b-562f-4f6a-bdfd-74ba04858020 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:32.723319 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7dd7865b-562f-4f6a-bdfd-74ba04858020 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:32.866086 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7dd7865b-562f-4f6a-bdfd-74ba04858020 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:16:32.874928 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7dd7865b-562f-4f6a-bdfd-74ba04858020 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1697 microversion: 2.1 time: 0.167299 Apr 16 22:16:32.876402 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3902/7645] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:16:32 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1697 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:16:33.892975 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2cdc90c5-e5bd-4e32-ac98-ece6468f2083 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:16:33.893725 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2cdc90c5-e5bd-4e32-ac98-ece6468f2083 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:16:33.901970 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2cdc90c5-e5bd-4e32-ac98-ece6468f2083 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:33.902435 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2cdc90c5-e5bd-4e32-ac98-ece6468f2083 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:33.903264 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2cdc90c5-e5bd-4e32-ac98-ece6468f2083 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:33.903715 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2cdc90c5-e5bd-4e32-ac98-ece6468f2083 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:34.041062 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2cdc90c5-e5bd-4e32-ac98-ece6468f2083 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:16:34.048984 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2cdc90c5-e5bd-4e32-ac98-ece6468f2083 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1697 microversion: 2.1 time: 0.160080 Apr 16 22:16:34.049574 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3744/7646] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:16:33 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1697 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:16:35.067413 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a62b2073-c8c8-42cb-bc81-052d1161c6f3 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:16:35.068081 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a62b2073-c8c8-42cb-bc81-052d1161c6f3 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:16:35.077191 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a62b2073-c8c8-42cb-bc81-052d1161c6f3 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:35.100991 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a62b2073-c8c8-42cb-bc81-052d1161c6f3 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:35.100991 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a62b2073-c8c8-42cb-bc81-052d1161c6f3 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:35.100991 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a62b2073-c8c8-42cb-bc81-052d1161c6f3 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:35.218969 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a62b2073-c8c8-42cb-bc81-052d1161c6f3 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:16:35.226367 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a62b2073-c8c8-42cb-bc81-052d1161c6f3 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1697 microversion: 2.1 time: 0.163816 Apr 16 22:16:35.226939 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3903/7647] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:16:35 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1697 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:16:36.242976 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-552c3f38-6b82-4f2a-ada2-4389d5a75967 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:16:36.243589 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-552c3f38-6b82-4f2a-ada2-4389d5a75967 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:16:36.250438 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-552c3f38-6b82-4f2a-ada2-4389d5a75967 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:36.250920 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-552c3f38-6b82-4f2a-ada2-4389d5a75967 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:36.251674 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-552c3f38-6b82-4f2a-ada2-4389d5a75967 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:36.252117 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-552c3f38-6b82-4f2a-ada2-4389d5a75967 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:36.446175 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-552c3f38-6b82-4f2a-ada2-4389d5a75967 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:16:36.453872 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-552c3f38-6b82-4f2a-ada2-4389d5a75967 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1679 microversion: 2.1 time: 0.214957 Apr 16 22:16:36.454447 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3745/7648] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:16:36 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1679 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:16:37.471971 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1f93c02a-ebe6-4058-b2c8-19654d7e9e01 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:16:37.472629 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1f93c02a-ebe6-4058-b2c8-19654d7e9e01 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:16:37.480140 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1f93c02a-ebe6-4058-b2c8-19654d7e9e01 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:37.480720 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1f93c02a-ebe6-4058-b2c8-19654d7e9e01 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:37.481495 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1f93c02a-ebe6-4058-b2c8-19654d7e9e01 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:37.482066 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1f93c02a-ebe6-4058-b2c8-19654d7e9e01 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:37.609391 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-1f93c02a-ebe6-4058-b2c8-19654d7e9e01 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:16:37.616824 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1f93c02a-ebe6-4058-b2c8-19654d7e9e01 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1679 microversion: 2.1 time: 0.148834 Apr 16 22:16:37.617388 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3904/7649] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:16:37 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:16:38.635222 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-006b4fb0-547d-453a-810f-45e17510527a tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:16:38.635980 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-006b4fb0-547d-453a-810f-45e17510527a tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:16:38.642713 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-006b4fb0-547d-453a-810f-45e17510527a tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:38.643172 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-006b4fb0-547d-453a-810f-45e17510527a tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:38.643939 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-006b4fb0-547d-453a-810f-45e17510527a tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:38.644415 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-006b4fb0-547d-453a-810f-45e17510527a tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:38.775477 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-006b4fb0-547d-453a-810f-45e17510527a tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:16:38.783170 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-006b4fb0-547d-453a-810f-45e17510527a tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1682 microversion: 2.1 time: 0.152391 Apr 16 22:16:38.783584 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3746/7650] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:16:38 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:16:38.800022 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8642a242-f2f3-48f9-81e1-d347b7b1f725 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:16:38.800650 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8642a242-f2f3-48f9-81e1-d347b7b1f725 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:16:38.808212 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8642a242-f2f3-48f9-81e1-d347b7b1f725 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:38.809238 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8642a242-f2f3-48f9-81e1-d347b7b1f725 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:38.809469 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8642a242-f2f3-48f9-81e1-d347b7b1f725 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:38.809933 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8642a242-f2f3-48f9-81e1-d347b7b1f725 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:39.027435 ncdv-master-1 devstack@n-api.service[137408]: ERROR oslo.messaging._drivers.impl_rabbit [None req-8642a242-f2f3-48f9-81e1-d347b7b1f725 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [cb5101be-df69-49ac-9db2-69c9d5edab12] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 16 22:16:39.300871 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-cd39ac8d-3df5-4f9c-967a-795ed2c3a7ef req-29231a28-635b-4edc-b595-0f99e23c0d0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bafbfec-97cd-4628-87cd-2963042e626b", "name": "network-vif-unplugged", "status": "completed", "tag": "0ecb0fab-d4e8-4e5b-ae20-5cc6a6415e6c"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:16:39.309173 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-cd39ac8d-3df5-4f9c-967a-795ed2c3a7ef req-29231a28-635b-4edc-b595-0f99e23c0d0f service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:39.309688 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-cd39ac8d-3df5-4f9c-967a-795ed2c3a7ef req-29231a28-635b-4edc-b595-0f99e23c0d0f service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:39.320564 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.compute.server_external_events [req-cd39ac8d-3df5-4f9c-967a-795ed2c3a7ef req-29231a28-635b-4edc-b595-0f99e23c0d0f service nova] Unable to find a host for instance 2bafbfec-97cd-4628-87cd-2963042e626b. Dropping event network-vif-unplugged {{(pid=137409) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Apr 16 22:16:39.321483 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-cd39ac8d-3df5-4f9c-967a-795ed2c3a7ef req-29231a28-635b-4edc-b595-0f99e23c0d0f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025151 Apr 16 22:16:39.322730 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3747/7651] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 16 22:16:40.034799 ncdv-master-1 devstack@n-api.service[137408]: INFO oslo.messaging._drivers.impl_rabbit [None req-8642a242-f2f3-48f9-81e1-d347b7b1f725 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [cb5101be-df69-49ac-9db2-69c9d5edab12] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 46674. Apr 16 22:16:40.037990 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8642a242-f2f3-48f9-81e1-d347b7b1f725 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "POST /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b/action" status: 202 len: 0 microversion: 2.1 time: 1.241910 Apr 16 22:16:40.038690 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3905/7652] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 22:16:38 2022] POST /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b/action => generated 0 bytes in 1243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 22:16:40.046758 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-53046b98-e3a2-4889-b05c-1923d004eac9 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:16:40.047398 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-53046b98-e3a2-4889-b05c-1923d004eac9 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:16:40.054564 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-53046b98-e3a2-4889-b05c-1923d004eac9 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:40.055025 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-53046b98-e3a2-4889-b05c-1923d004eac9 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:40.055806 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-53046b98-e3a2-4889-b05c-1923d004eac9 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:40.056777 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-53046b98-e3a2-4889-b05c-1923d004eac9 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:40.186695 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-53046b98-e3a2-4889-b05c-1923d004eac9 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:16:40.194255 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-53046b98-e3a2-4889-b05c-1923d004eac9 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1630 microversion: 2.1 time: 0.151424 Apr 16 22:16:40.194971 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3748/7653] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:16:40 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1630 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:16:41.214089 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2fd73b82-9db3-4e3f-bb09-e6e1173a34aa tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:16:41.214740 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2fd73b82-9db3-4e3f-bb09-e6e1173a34aa tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:16:41.221813 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2fd73b82-9db3-4e3f-bb09-e6e1173a34aa tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:41.222281 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2fd73b82-9db3-4e3f-bb09-e6e1173a34aa tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:41.223070 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2fd73b82-9db3-4e3f-bb09-e6e1173a34aa tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:41.223519 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2fd73b82-9db3-4e3f-bb09-e6e1173a34aa tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:41.356961 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2fd73b82-9db3-4e3f-bb09-e6e1173a34aa tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:16:41.364744 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2fd73b82-9db3-4e3f-bb09-e6e1173a34aa tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1630 microversion: 2.1 time: 0.156044 Apr 16 22:16:41.365327 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3906/7654] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:16:41 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1630 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:16:42.383146 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-df49db7f-ded2-4944-9c1d-e4c65628154b tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:16:42.383799 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-df49db7f-ded2-4944-9c1d-e4c65628154b tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:16:42.391684 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-df49db7f-ded2-4944-9c1d-e4c65628154b tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:42.392148 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-df49db7f-ded2-4944-9c1d-e4c65628154b tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:42.392956 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-df49db7f-ded2-4944-9c1d-e4c65628154b tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:42.393400 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-df49db7f-ded2-4944-9c1d-e4c65628154b tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:42.531049 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-df49db7f-ded2-4944-9c1d-e4c65628154b tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:16:42.538757 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-df49db7f-ded2-4944-9c1d-e4c65628154b tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1688 microversion: 2.1 time: 0.160330 Apr 16 22:16:42.539341 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3749/7655] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:16:42 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:16:43.268864 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-f9c50697-992b-4472-a750-32aaaaca3346 req-b18947f9-8b31-4132-b34e-5de8204117a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bafbfec-97cd-4628-87cd-2963042e626b", "tag": "0ecb0fab-d4e8-4e5b-ae20-5cc6a6415e6c"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:16:43.278555 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-f9c50697-992b-4472-a750-32aaaaca3346 req-b18947f9-8b31-4132-b34e-5de8204117a7 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:43.279180 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-f9c50697-992b-4472-a750-32aaaaca3346 req-b18947f9-8b31-4132-b34e-5de8204117a7 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:43.291740 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-f9c50697-992b-4472-a750-32aaaaca3346 req-b18947f9-8b31-4132-b34e-5de8204117a7 service nova] Creating event network-changed:0ecb0fab-d4e8-4e5b-ae20-5cc6a6415e6c for instance 2bafbfec-97cd-4628-87cd-2963042e626b on nch2-master-1 Apr 16 22:16:43.295414 ncdv-master-1 devstack@n-api.service[137408]: ERROR oslo.messaging._drivers.impl_rabbit [req-f9c50697-992b-4472-a750-32aaaaca3346 req-b18947f9-8b31-4132-b34e-5de8204117a7 service nova] [6a0c58c0-ec61-47f8-9993-a4b4df808b34] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 16 22:16:43.557709 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-27ecd339-1699-452c-93a7-2d271a9cc01b tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:16:43.558327 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-27ecd339-1699-452c-93a7-2d271a9cc01b tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:16:43.564588 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-27ecd339-1699-452c-93a7-2d271a9cc01b tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:43.565045 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-27ecd339-1699-452c-93a7-2d271a9cc01b tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:43.565854 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-27ecd339-1699-452c-93a7-2d271a9cc01b tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:43.566295 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-27ecd339-1699-452c-93a7-2d271a9cc01b tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:43.697994 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-27ecd339-1699-452c-93a7-2d271a9cc01b tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:16:43.705391 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-27ecd339-1699-452c-93a7-2d271a9cc01b tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1688 microversion: 2.1 time: 0.152212 Apr 16 22:16:43.705952 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3750/7656] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:16:43 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1688 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 22:16:44.302802 ncdv-master-1 devstack@n-api.service[137408]: INFO oslo.messaging._drivers.impl_rabbit [req-f9c50697-992b-4472-a750-32aaaaca3346 req-b18947f9-8b31-4132-b34e-5de8204117a7 service nova] [6a0c58c0-ec61-47f8-9993-a4b4df808b34] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 46732. Apr 16 22:16:44.306705 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-f9c50697-992b-4472-a750-32aaaaca3346 req-b18947f9-8b31-4132-b34e-5de8204117a7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.041600 Apr 16 22:16:44.307324 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3907/7657] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:16:44.723766 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c66b3a1c-5f15-45e2-a801-907cb5de1a52 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:16:44.725129 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c66b3a1c-5f15-45e2-a801-907cb5de1a52 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:16:44.733205 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c66b3a1c-5f15-45e2-a801-907cb5de1a52 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:44.733663 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c66b3a1c-5f15-45e2-a801-907cb5de1a52 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:44.734466 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c66b3a1c-5f15-45e2-a801-907cb5de1a52 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:44.735068 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c66b3a1c-5f15-45e2-a801-907cb5de1a52 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:44.895470 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c66b3a1c-5f15-45e2-a801-907cb5de1a52 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:16:44.904775 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c66b3a1c-5f15-45e2-a801-907cb5de1a52 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1688 microversion: 2.1 time: 0.185490 Apr 16 22:16:44.905880 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3751/7658] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:16:44 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1688 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:16:45.924444 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e8dc370a-4e52-49c2-a653-17737d9b8ad7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:16:45.925332 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e8dc370a-4e52-49c2-a653-17737d9b8ad7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:16:45.934882 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e8dc370a-4e52-49c2-a653-17737d9b8ad7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:45.935500 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e8dc370a-4e52-49c2-a653-17737d9b8ad7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:45.936388 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e8dc370a-4e52-49c2-a653-17737d9b8ad7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:45.936904 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e8dc370a-4e52-49c2-a653-17737d9b8ad7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:46.097887 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e8dc370a-4e52-49c2-a653-17737d9b8ad7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:16:46.106644 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e8dc370a-4e52-49c2-a653-17737d9b8ad7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1688 microversion: 2.1 time: 0.187738 Apr 16 22:16:46.107230 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3908/7659] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:16:45 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1688 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:16:47.126053 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-983f576e-37e8-4d6e-bf81-3a9c093c6782 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:16:47.126741 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-983f576e-37e8-4d6e-bf81-3a9c093c6782 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:16:47.134780 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-983f576e-37e8-4d6e-bf81-3a9c093c6782 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:47.135270 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-983f576e-37e8-4d6e-bf81-3a9c093c6782 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:47.136070 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-983f576e-37e8-4d6e-bf81-3a9c093c6782 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:47.136555 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-983f576e-37e8-4d6e-bf81-3a9c093c6782 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:47.278616 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-983f576e-37e8-4d6e-bf81-3a9c093c6782 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:16:47.286737 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-983f576e-37e8-4d6e-bf81-3a9c093c6782 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1688 microversion: 2.1 time: 0.165420 Apr 16 22:16:47.287374 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3752/7660] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:16:47 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:16:48.305356 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4b865bdf-6aff-4302-8e2c-e7c7cfeb4f5a tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:16:48.306731 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4b865bdf-6aff-4302-8e2c-e7c7cfeb4f5a tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:16:48.313932 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4b865bdf-6aff-4302-8e2c-e7c7cfeb4f5a tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:48.314404 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4b865bdf-6aff-4302-8e2c-e7c7cfeb4f5a tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:48.315287 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4b865bdf-6aff-4302-8e2c-e7c7cfeb4f5a tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:48.315782 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4b865bdf-6aff-4302-8e2c-e7c7cfeb4f5a tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:48.455723 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4b865bdf-6aff-4302-8e2c-e7c7cfeb4f5a tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:16:48.464142 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4b865bdf-6aff-4302-8e2c-e7c7cfeb4f5a tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1688 microversion: 2.1 time: 0.162779 Apr 16 22:16:48.465076 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3909/7661] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:16:48 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1688 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:16:49.482145 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-fa95f523-4e56-4f61-86fb-a79ea04baec1 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:16:49.483540 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-fa95f523-4e56-4f61-86fb-a79ea04baec1 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:16:49.490898 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fa95f523-4e56-4f61-86fb-a79ea04baec1 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:49.491558 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fa95f523-4e56-4f61-86fb-a79ea04baec1 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:49.492469 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fa95f523-4e56-4f61-86fb-a79ea04baec1 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:49.492908 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-fa95f523-4e56-4f61-86fb-a79ea04baec1 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:49.639076 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-fa95f523-4e56-4f61-86fb-a79ea04baec1 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:16:49.647819 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-fa95f523-4e56-4f61-86fb-a79ea04baec1 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1688 microversion: 2.1 time: 0.169493 Apr 16 22:16:49.657675 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3753/7662] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:16:49 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1688 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:16:50.664701 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9f34bf45-57d6-47fd-95bd-9873fb57d876 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:16:50.665550 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9f34bf45-57d6-47fd-95bd-9873fb57d876 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:16:50.673036 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9f34bf45-57d6-47fd-95bd-9873fb57d876 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:50.673512 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9f34bf45-57d6-47fd-95bd-9873fb57d876 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:50.674316 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9f34bf45-57d6-47fd-95bd-9873fb57d876 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:50.674936 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9f34bf45-57d6-47fd-95bd-9873fb57d876 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:50.818041 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9f34bf45-57d6-47fd-95bd-9873fb57d876 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:16:50.826791 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9f34bf45-57d6-47fd-95bd-9873fb57d876 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1688 microversion: 2.1 time: 0.165903 Apr 16 22:16:50.827663 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3910/7663] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:16:50 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:16:51.845920 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d53959d0-330c-482d-b94f-0a1cdaa20a4e tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:16:51.846539 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d53959d0-330c-482d-b94f-0a1cdaa20a4e tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:16:51.853865 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d53959d0-330c-482d-b94f-0a1cdaa20a4e tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:51.854329 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d53959d0-330c-482d-b94f-0a1cdaa20a4e tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:51.855107 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d53959d0-330c-482d-b94f-0a1cdaa20a4e tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:51.855572 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d53959d0-330c-482d-b94f-0a1cdaa20a4e tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:51.984138 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d53959d0-330c-482d-b94f-0a1cdaa20a4e tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:16:51.991625 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d53959d0-330c-482d-b94f-0a1cdaa20a4e tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1688 microversion: 2.1 time: 0.149620 Apr 16 22:16:51.992221 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3754/7664] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:16:51 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1688 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:16:53.009589 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b49361c3-6c21-431a-afc5-41281a37ec80 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:16:53.010190 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b49361c3-6c21-431a-afc5-41281a37ec80 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:16:53.017118 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b49361c3-6c21-431a-afc5-41281a37ec80 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:53.017585 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b49361c3-6c21-431a-afc5-41281a37ec80 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:53.018369 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b49361c3-6c21-431a-afc5-41281a37ec80 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:53.018822 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b49361c3-6c21-431a-afc5-41281a37ec80 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:53.150175 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b49361c3-6c21-431a-afc5-41281a37ec80 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:16:53.157881 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b49361c3-6c21-431a-afc5-41281a37ec80 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1688 microversion: 2.1 time: 0.152988 Apr 16 22:16:53.158463 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3911/7665] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:16:53 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:16:54.175645 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9d1c8122-9cc5-4a73-b3ac-c6e96d22de4a tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:16:54.176210 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9d1c8122-9cc5-4a73-b3ac-c6e96d22de4a tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:16:54.183551 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9d1c8122-9cc5-4a73-b3ac-c6e96d22de4a tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:54.184013 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9d1c8122-9cc5-4a73-b3ac-c6e96d22de4a tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:54.184823 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9d1c8122-9cc5-4a73-b3ac-c6e96d22de4a tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:54.185274 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9d1c8122-9cc5-4a73-b3ac-c6e96d22de4a tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:54.313458 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9d1c8122-9cc5-4a73-b3ac-c6e96d22de4a tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:16:54.320934 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9d1c8122-9cc5-4a73-b3ac-c6e96d22de4a tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1688 microversion: 2.1 time: 0.149290 Apr 16 22:16:54.322354 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3755/7666] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:16:54 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1688 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:16:55.339442 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-08481690-a465-4afb-8065-e2e6af0b79b2 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:16:55.340077 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-08481690-a465-4afb-8065-e2e6af0b79b2 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:16:55.346830 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-08481690-a465-4afb-8065-e2e6af0b79b2 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:55.347304 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-08481690-a465-4afb-8065-e2e6af0b79b2 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:55.348097 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-08481690-a465-4afb-8065-e2e6af0b79b2 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:55.348585 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-08481690-a465-4afb-8065-e2e6af0b79b2 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:55.478466 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-08481690-a465-4afb-8065-e2e6af0b79b2 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:16:55.485894 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-08481690-a465-4afb-8065-e2e6af0b79b2 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1688 microversion: 2.1 time: 0.151005 Apr 16 22:16:55.486468 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3912/7667] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:16:55 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1688 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:16:56.502889 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9d55c242-91fa-45d5-8ca5-917ab1e890a2 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:16:56.503507 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9d55c242-91fa-45d5-8ca5-917ab1e890a2 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:16:56.510966 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9d55c242-91fa-45d5-8ca5-917ab1e890a2 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:56.511426 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9d55c242-91fa-45d5-8ca5-917ab1e890a2 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:56.512219 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9d55c242-91fa-45d5-8ca5-917ab1e890a2 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:56.512665 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9d55c242-91fa-45d5-8ca5-917ab1e890a2 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:56.643270 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9d55c242-91fa-45d5-8ca5-917ab1e890a2 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:16:56.651116 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9d55c242-91fa-45d5-8ca5-917ab1e890a2 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1688 microversion: 2.1 time: 0.152198 Apr 16 22:16:56.651685 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3756/7668] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:16:56 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1688 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:16:57.668758 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-28d2b7a8-145f-4bdd-be1f-0b93e7285048 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:16:57.669407 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-28d2b7a8-145f-4bdd-be1f-0b93e7285048 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:16:57.676391 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-28d2b7a8-145f-4bdd-be1f-0b93e7285048 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:57.676868 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-28d2b7a8-145f-4bdd-be1f-0b93e7285048 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:57.677769 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-28d2b7a8-145f-4bdd-be1f-0b93e7285048 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:57.678224 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-28d2b7a8-145f-4bdd-be1f-0b93e7285048 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:57.813193 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-28d2b7a8-145f-4bdd-be1f-0b93e7285048 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:16:57.821071 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-28d2b7a8-145f-4bdd-be1f-0b93e7285048 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1688 microversion: 2.1 time: 0.156709 Apr 16 22:16:57.821920 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3913/7669] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:16:57 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:16:58.838963 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-016d78a9-a911-40cf-a037-bbaf7fa7a519 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:16:58.839599 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-016d78a9-a911-40cf-a037-bbaf7fa7a519 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:16:58.846408 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-016d78a9-a911-40cf-a037-bbaf7fa7a519 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:58.846871 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-016d78a9-a911-40cf-a037-bbaf7fa7a519 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:58.847656 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-016d78a9-a911-40cf-a037-bbaf7fa7a519 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:58.848110 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-016d78a9-a911-40cf-a037-bbaf7fa7a519 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:58.981448 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-016d78a9-a911-40cf-a037-bbaf7fa7a519 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:16:58.989095 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-016d78a9-a911-40cf-a037-bbaf7fa7a519 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1688 microversion: 2.1 time: 0.154055 Apr 16 22:16:59.000375 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3757/7670] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:16:58 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:16:59.591249 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-dc231aeb-e74c-48b0-b47c-361e797d1738 req-a5fd59b1-d1d9-4da7-bee0-c91ecea8eb07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bafbfec-97cd-4628-87cd-2963042e626b", "name": "network-vif-plugged", "status": "completed", "tag": "0ecb0fab-d4e8-4e5b-ae20-5cc6a6415e6c"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:16:59.600484 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-dc231aeb-e74c-48b0-b47c-361e797d1738 req-a5fd59b1-d1d9-4da7-bee0-c91ecea8eb07 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:16:59.600913 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-dc231aeb-e74c-48b0-b47c-361e797d1738 req-a5fd59b1-d1d9-4da7-bee0-c91ecea8eb07 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:16:59.612789 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-dc231aeb-e74c-48b0-b47c-361e797d1738 req-a5fd59b1-d1d9-4da7-bee0-c91ecea8eb07 service nova] Creating event network-vif-plugged:0ecb0fab-d4e8-4e5b-ae20-5cc6a6415e6c for instance 2bafbfec-97cd-4628-87cd-2963042e626b on nch2-master-1 Apr 16 22:16:59.618557 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-dc231aeb-e74c-48b0-b47c-361e797d1738 req-a5fd59b1-d1d9-4da7-bee0-c91ecea8eb07 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031290 Apr 16 22:16:59.618948 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3914/7671] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:17:00.009253 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-441cd9f9-7d5a-4a6d-9af0-f42015cd9662 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:17:00.009253 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-441cd9f9-7d5a-4a6d-9af0-f42015cd9662 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:17:00.015026 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-441cd9f9-7d5a-4a6d-9af0-f42015cd9662 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:17:00.015485 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-441cd9f9-7d5a-4a6d-9af0-f42015cd9662 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:17:00.016292 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-441cd9f9-7d5a-4a6d-9af0-f42015cd9662 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:17:00.016738 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-441cd9f9-7d5a-4a6d-9af0-f42015cd9662 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:17:00.148596 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-441cd9f9-7d5a-4a6d-9af0-f42015cd9662 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:17:00.156523 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-441cd9f9-7d5a-4a6d-9af0-f42015cd9662 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1688 microversion: 2.1 time: 0.153440 Apr 16 22:17:00.157094 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3758/7672] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:17:00 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:17:01.175652 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-b79c8c3c-b206-442c-b4da-67efbfbb66c3 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:17:01.175652 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-b79c8c3c-b206-442c-b4da-67efbfbb66c3 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:17:01.181757 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b79c8c3c-b206-442c-b4da-67efbfbb66c3 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:17:01.182237 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b79c8c3c-b206-442c-b4da-67efbfbb66c3 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:17:01.183032 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b79c8c3c-b206-442c-b4da-67efbfbb66c3 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:17:01.183654 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-b79c8c3c-b206-442c-b4da-67efbfbb66c3 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:17:01.319322 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-b79c8c3c-b206-442c-b4da-67efbfbb66c3 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:17:01.327575 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-b79c8c3c-b206-442c-b4da-67efbfbb66c3 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1688 microversion: 2.1 time: 0.158406 Apr 16 22:17:01.328153 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3915/7673] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:17:01 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:17:02.345552 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1c2755cf-9dfa-437c-9b56-1edfbf1aae69 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:17:02.346245 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1c2755cf-9dfa-437c-9b56-1edfbf1aae69 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:17:02.353834 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1c2755cf-9dfa-437c-9b56-1edfbf1aae69 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:17:02.364913 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1c2755cf-9dfa-437c-9b56-1edfbf1aae69 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:17:02.364913 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1c2755cf-9dfa-437c-9b56-1edfbf1aae69 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:17:02.364913 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1c2755cf-9dfa-437c-9b56-1edfbf1aae69 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:17:02.489579 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1c2755cf-9dfa-437c-9b56-1edfbf1aae69 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:17:02.496997 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1c2755cf-9dfa-437c-9b56-1edfbf1aae69 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1688 microversion: 2.1 time: 0.155496 Apr 16 22:17:02.497573 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3759/7674] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:17:02 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:17:03.514835 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e543aa41-1cd6-4ef6-a12e-816fefa95825 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:17:03.515499 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e543aa41-1cd6-4ef6-a12e-816fefa95825 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:17:03.522405 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e543aa41-1cd6-4ef6-a12e-816fefa95825 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:17:03.522901 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e543aa41-1cd6-4ef6-a12e-816fefa95825 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:17:03.523706 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e543aa41-1cd6-4ef6-a12e-816fefa95825 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:17:03.524186 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e543aa41-1cd6-4ef6-a12e-816fefa95825 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:17:03.657392 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e543aa41-1cd6-4ef6-a12e-816fefa95825 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:17:03.665675 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e543aa41-1cd6-4ef6-a12e-816fefa95825 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1675 microversion: 2.1 time: 0.154755 Apr 16 22:17:03.666245 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3916/7675] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:17:03 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:17:11.269274 ncdv-master-1 devstack@n-api.service[137409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:17:11.269745 ncdv-master-1 devstack@n-api.service[137409]: Sat Apr 16 22:17:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 22:18:40.376772 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-0f60c5a8-3961-4706-8ec0-4e9b67a83b67 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:18:40.378764 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0f60c5a8-3961-4706-8ec0-4e9b67a83b67 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:18:40.383715 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0f60c5a8-3961-4706-8ec0-4e9b67a83b67 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:18:40.384197 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0f60c5a8-3961-4706-8ec0-4e9b67a83b67 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:18:40.385709 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0f60c5a8-3961-4706-8ec0-4e9b67a83b67 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:18:40.386743 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-0f60c5a8-3961-4706-8ec0-4e9b67a83b67 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:18:40.413028 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-0f60c5a8-3961-4706-8ec0-4e9b67a83b67 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 22:18:40.490752 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-7cbd66b5-6e61-4703-a6c2-145d8b095d9a req-bc7c6ad7-b405-4048-8f7d-94ca231b4197 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bafbfec-97cd-4628-87cd-2963042e626b", "tag": "0ecb0fab-d4e8-4e5b-ae20-5cc6a6415e6c"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:18:40.499534 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-7cbd66b5-6e61-4703-a6c2-145d8b095d9a req-bc7c6ad7-b405-4048-8f7d-94ca231b4197 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:18:40.502880 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-7cbd66b5-6e61-4703-a6c2-145d8b095d9a req-bc7c6ad7-b405-4048-8f7d-94ca231b4197 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:18:40.511382 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-7cbd66b5-6e61-4703-a6c2-145d8b095d9a req-bc7c6ad7-b405-4048-8f7d-94ca231b4197 service nova] Creating event network-changed:0ecb0fab-d4e8-4e5b-ae20-5cc6a6415e6c for instance 2bafbfec-97cd-4628-87cd-2963042e626b on nch2-master-1 Apr 16 22:18:40.517002 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-7cbd66b5-6e61-4703-a6c2-145d8b095d9a req-bc7c6ad7-b405-4048-8f7d-94ca231b4197 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146105 Apr 16 22:18:40.517630 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3917/7676] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:18:40.686839 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-0f60c5a8-3961-4706-8ec0-4e9b67a83b67 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 204 len: 0 microversion: 2.1 time: 0.322389 Apr 16 22:18:40.690817 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3760/7677] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 22:18:40 2022] DELETE /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 22:18:40.697575 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-adac9f4c-0e81-465d-9fce-432a5e78580d tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:18:40.698491 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-adac9f4c-0e81-465d-9fce-432a5e78580d tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:18:40.705224 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-adac9f4c-0e81-465d-9fce-432a5e78580d tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:18:40.705696 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-adac9f4c-0e81-465d-9fce-432a5e78580d tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:18:40.706495 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-adac9f4c-0e81-465d-9fce-432a5e78580d tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:18:40.707150 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-adac9f4c-0e81-465d-9fce-432a5e78580d tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:18:40.874049 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-adac9f4c-0e81-465d-9fce-432a5e78580d tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:18:40.881815 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-adac9f4c-0e81-465d-9fce-432a5e78580d tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1681 microversion: 2.1 time: 0.189502 Apr 16 22:18:40.882396 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3918/7678] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:18:40 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1681 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:18:41.899868 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-17350707-0b51-4195-936d-ce6938a0bddd tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:18:41.900644 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-17350707-0b51-4195-936d-ce6938a0bddd tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:18:41.907668 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-17350707-0b51-4195-936d-ce6938a0bddd tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:18:41.908077 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-17350707-0b51-4195-936d-ce6938a0bddd tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:18:41.908893 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-17350707-0b51-4195-936d-ce6938a0bddd tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:18:41.909353 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-17350707-0b51-4195-936d-ce6938a0bddd tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:18:42.046993 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-17350707-0b51-4195-936d-ce6938a0bddd tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:18:42.054384 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-17350707-0b51-4195-936d-ce6938a0bddd tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1681 microversion: 2.1 time: 0.158812 Apr 16 22:18:42.054943 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3761/7679] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:18:41 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:18:42.997748 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-d28f6c0b-174c-4852-a72f-64723cd7bf91 req-7e2a4928-d334-4a9f-b5d1-8a4d2151e3b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bafbfec-97cd-4628-87cd-2963042e626b", "name": "network-vif-deleted", "tag": "0ecb0fab-d4e8-4e5b-ae20-5cc6a6415e6c"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:18:43.007187 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-d28f6c0b-174c-4852-a72f-64723cd7bf91 req-7e2a4928-d334-4a9f-b5d1-8a4d2151e3b4 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:18:43.007690 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-d28f6c0b-174c-4852-a72f-64723cd7bf91 req-7e2a4928-d334-4a9f-b5d1-8a4d2151e3b4 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:18:43.018609 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-d28f6c0b-174c-4852-a72f-64723cd7bf91 req-7e2a4928-d334-4a9f-b5d1-8a4d2151e3b4 service nova] Creating event network-vif-deleted:0ecb0fab-d4e8-4e5b-ae20-5cc6a6415e6c for instance 2bafbfec-97cd-4628-87cd-2963042e626b on nch2-master-1 Apr 16 22:18:43.023553 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-d28f6c0b-174c-4852-a72f-64723cd7bf91 req-7e2a4928-d334-4a9f-b5d1-8a4d2151e3b4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029545 Apr 16 22:18:43.026422 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3919/7680] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:18:43.072490 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-46f4783c-ca2e-45c9-9ab1-430d75a00cc0 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:18:43.073115 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-46f4783c-ca2e-45c9-9ab1-430d75a00cc0 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:18:43.079909 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-46f4783c-ca2e-45c9-9ab1-430d75a00cc0 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:18:43.080424 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-46f4783c-ca2e-45c9-9ab1-430d75a00cc0 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:18:43.081209 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-46f4783c-ca2e-45c9-9ab1-430d75a00cc0 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:18:43.081676 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-46f4783c-ca2e-45c9-9ab1-430d75a00cc0 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:18:43.149520 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-46f4783c-ca2e-45c9-9ab1-430d75a00cc0 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:18:43.158183 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-46f4783c-ca2e-45c9-9ab1-430d75a00cc0 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 200 len: 1495 microversion: 2.1 time: 0.089741 Apr 16 22:18:43.163058 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3762/7681] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:18:43 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 1495 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:18:44.177589 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e56f9a80-bbb7-446e-b597-be9b6c0eaf6c tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:18:44.178308 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e56f9a80-bbb7-446e-b597-be9b6c0eaf6c tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: 2bafbfec-97cd-4628-87cd-2963042e626b] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:18:44.185343 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e56f9a80-bbb7-446e-b597-be9b6c0eaf6c tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:18:44.185816 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e56f9a80-bbb7-446e-b597-be9b6c0eaf6c tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:18:44.186613 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e56f9a80-bbb7-446e-b597-be9b6c0eaf6c tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:18:44.187072 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e56f9a80-bbb7-446e-b597-be9b6c0eaf6c tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:18:44.200570 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-e56f9a80-bbb7-446e-b597-be9b6c0eaf6c tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] HTTP exception thrown: Instance 2bafbfec-97cd-4628-87cd-2963042e626b could not be found. Apr 16 22:18:44.201214 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e56f9a80-bbb7-446e-b597-be9b6c0eaf6c tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Returning 404 to user: Instance 2bafbfec-97cd-4628-87cd-2963042e626b could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 22:18:44.202056 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e56f9a80-bbb7-446e-b597-be9b6c0eaf6c tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b" status: 404 len: 111 microversion: 2.1 time: 0.029683 Apr 16 22:18:44.202588 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3920/7682] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:18:44 2022] GET /compute/v2.1/servers/2bafbfec-97cd-4628-87cd-2963042e626b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 22:18:44.429295 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d08f417b-5f01-4e4f-bc8c-744982421de3 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '.version_select at 0x7fbb9595e8b0>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:18:44.516080 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d08f417b-5f01-4e4f-bc8c-744982421de3 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1336047475" status: 202 len: 0 microversion: 2.1 time: 0.090834 Apr 16 22:18:44.516677 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3763/7683] 10.222.0.20 () {58 vars in 1253 bytes} [Sat Apr 16 22:18:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1336047475 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 22:18:44.539146 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6db6d76e-3f25-450d-a6b0-ab3284807fb7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Action: 'create', calling method: .version_select at 0x7fbb955925e0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1710827741"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:18:44.553682 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-6db6d76e-3f25-450d-a6b0-ab3284807fb7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Getting quotas for project 8a91917b203d4a2ca179d394e04af71f. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 22:18:44.558731 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-6db6d76e-3f25-450d-a6b0-ab3284807fb7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Getting quotas for user 37ff1c2e4f3b45f589d675028674ecb3 and project 8a91917b203d4a2ca179d394e04af71f. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 22:18:44.571852 ncdv-master-1 devstack@n-api.service[137408]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6db6d76e-3f25-450d-a6b0-ab3284807fb7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [3901b61f-3e1c-4ff6-b469-98dd356d3000] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 16 22:18:45.579027 ncdv-master-1 devstack@n-api.service[137408]: INFO oslo.messaging._drivers.impl_rabbit [None req-6db6d76e-3f25-450d-a6b0-ab3284807fb7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [3901b61f-3e1c-4ff6-b469-98dd356d3000] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 46914. Apr 16 22:18:45.776987 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-6db6d76e-3f25-450d-a6b0-ab3284807fb7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Getting quotas for project 8a91917b203d4a2ca179d394e04af71f. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 22:18:45.782046 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-6db6d76e-3f25-450d-a6b0-ab3284807fb7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Getting quotas for user 37ff1c2e4f3b45f589d675028674ecb3 and project 8a91917b203d4a2ca179d394e04af71f. Resources: {'key_pairs'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 22:18:45.796791 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6db6d76e-3f25-450d-a6b0-ab3284807fb7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 1.261614 Apr 16 22:18:45.797379 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3921/7684] 10.222.0.20 () {60 vars in 1157 bytes} [Sat Apr 16 22:18:44 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:18:51.206498 ncdv-master-1 devstack@n-api.service[137409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:18:51.207070 ncdv-master-1 devstack@n-api.service[137409]: Sat Apr 16 22:18:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 22:18:53.071442 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-34451519-dfa7-43b0-962e-b583d1f4abb7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1186842833", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1710827741", "security_groups": [{"name": "tempest-secgroup-smoke-1592743287"}], "networks": [{"uuid": "ce19f73a-c474-49ea-9c81-734b1baff584"}], "block_device_mapping_v2": [{"uuid": "716d5dcf-9ded-4bb8-b567-3f9363383a4c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:18:53.178298 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.network.neutron [None req-34451519-dfa7-43b0-962e-b583d1f4abb7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] validate_networks() for [('ce19f73a-c474-49ea-9c81-734b1baff584', None, None, None, None, None)] {{(pid=137409) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 22:18:53.606990 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-34451519-dfa7-43b0-962e-b583d1f4abb7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Flavor limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 22:18:53.607424 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-34451519-dfa7-43b0-962e-b583d1f4abb7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Image limits 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 22:18:53.607903 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-34451519-dfa7-43b0-962e-b583d1f4abb7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Flavor pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 22:18:53.608428 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-34451519-dfa7-43b0-962e-b583d1f4abb7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Image pref 0:0:0 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 22:18:53.608904 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.virt.hardware [None req-34451519-dfa7-43b0-962e-b583d1f4abb7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137409) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 22:18:53.617440 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-34451519-dfa7-43b0-962e-b583d1f4abb7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:18:53.617893 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-34451519-dfa7-43b0-962e-b583d1f4abb7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:18:53.618696 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-34451519-dfa7-43b0-962e-b583d1f4abb7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:18:53.619136 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-34451519-dfa7-43b0-962e-b583d1f4abb7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:18:53.635167 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-34451519-dfa7-43b0-962e-b583d1f4abb7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Getting quotas for project 8a91917b203d4a2ca179d394e04af71f. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 22:18:53.640291 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-34451519-dfa7-43b0-962e-b583d1f4abb7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Getting quotas for user 37ff1c2e4f3b45f589d675028674ecb3 and project 8a91917b203d4a2ca179d394e04af71f. Resources: {'cores', 'ram', 'instances'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 22:18:53.698136 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-34451519-dfa7-43b0-962e-b583d1f4abb7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Going to run 1 instances... {{(pid=137409) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 22:18:53.700225 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-34451519-dfa7-43b0-962e-b583d1f4abb7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: b9da3bd2-f3e9-4295-a0c7-0942445c65a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='716d5dcf-9ded-4bb8-b567-3f9363383a4c',volume_size=None,volume_type=None)] {{(pid=137409) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 22:18:54.105229 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-34451519-dfa7-43b0-962e-b583d1f4abb7 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.038711 Apr 16 22:18:54.105848 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3764/7685] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 22:18:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 1040 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 22:18:54.116695 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ed13294d-a2a0-4073-b190-5170a3622738 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:18:54.117362 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ed13294d-a2a0-4073-b190-5170a3622738 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: b9da3bd2-f3e9-4295-a0c7-0942445c65a5] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:18:54.177427 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ed13294d-a2a0-4073-b190-5170a3622738 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:18:54.184631 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ed13294d-a2a0-4073-b190-5170a3622738 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/b9da3bd2-f3e9-4295-a0c7-0942445c65a5" status: 200 len: 1089 microversion: 2.1 time: 0.072628 Apr 16 22:18:54.185205 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3922/7686] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:18:54 2022] GET /compute/v2.1/servers/b9da3bd2-f3e9-4295-a0c7-0942445c65a5 => generated 1089 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 22:18:55.203955 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9728087e-b361-451f-9271-4391fc5eaf14 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:18:55.204601 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9728087e-b361-451f-9271-4391fc5eaf14 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: b9da3bd2-f3e9-4295-a0c7-0942445c65a5] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:18:55.210644 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9728087e-b361-451f-9271-4391fc5eaf14 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:18:55.211104 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9728087e-b361-451f-9271-4391fc5eaf14 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:18:55.211957 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9728087e-b361-451f-9271-4391fc5eaf14 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:18:55.213059 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9728087e-b361-451f-9271-4391fc5eaf14 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:18:55.274696 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9728087e-b361-451f-9271-4391fc5eaf14 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:18:55.282577 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9728087e-b361-451f-9271-4391fc5eaf14 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/b9da3bd2-f3e9-4295-a0c7-0942445c65a5" status: 200 len: 1131 microversion: 2.1 time: 0.083525 Apr 16 22:18:55.283203 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3765/7687] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:18:55 2022] GET /compute/v2.1/servers/b9da3bd2-f3e9-4295-a0c7-0942445c65a5 => generated 1131 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:18:56.299742 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-bd02ad8b-3d7a-4677-aff3-d6fde09fbcae tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:18:56.300430 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-bd02ad8b-3d7a-4677-aff3-d6fde09fbcae tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: b9da3bd2-f3e9-4295-a0c7-0942445c65a5] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:18:56.310593 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bd02ad8b-3d7a-4677-aff3-d6fde09fbcae tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:18:56.311134 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bd02ad8b-3d7a-4677-aff3-d6fde09fbcae tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:18:56.311958 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bd02ad8b-3d7a-4677-aff3-d6fde09fbcae tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:18:56.312426 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-bd02ad8b-3d7a-4677-aff3-d6fde09fbcae tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:18:56.381100 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-bd02ad8b-3d7a-4677-aff3-d6fde09fbcae tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:18:56.389457 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-bd02ad8b-3d7a-4677-aff3-d6fde09fbcae tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/b9da3bd2-f3e9-4295-a0c7-0942445c65a5" status: 200 len: 1205 microversion: 2.1 time: 0.094093 Apr 16 22:18:56.390163 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3923/7688] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:18:56 2022] GET /compute/v2.1/servers/b9da3bd2-f3e9-4295-a0c7-0942445c65a5 => generated 1205 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:18:57.411411 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d66637d1-e621-405d-a9d8-5c033e470bb8 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:18:57.412037 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d66637d1-e621-405d-a9d8-5c033e470bb8 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: b9da3bd2-f3e9-4295-a0c7-0942445c65a5] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:18:57.421126 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d66637d1-e621-405d-a9d8-5c033e470bb8 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:18:57.422072 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d66637d1-e621-405d-a9d8-5c033e470bb8 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:18:57.423045 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d66637d1-e621-405d-a9d8-5c033e470bb8 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:18:57.423647 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d66637d1-e621-405d-a9d8-5c033e470bb8 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:18:57.626899 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d66637d1-e621-405d-a9d8-5c033e470bb8 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:18:57.634669 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d66637d1-e621-405d-a9d8-5c033e470bb8 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/b9da3bd2-f3e9-4295-a0c7-0942445c65a5" status: 200 len: 1273 microversion: 2.1 time: 0.228026 Apr 16 22:18:57.635282 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3766/7689] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:18:57 2022] GET /compute/v2.1/servers/b9da3bd2-f3e9-4295-a0c7-0942445c65a5 => generated 1273 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:18:57.797506 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-2cbb9e0b-fd61-40ec-b979-86c598b0228a req-02c7ee46-adf3-41b0-990d-69a9baec25c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9da3bd2-f3e9-4295-a0c7-0942445c65a5", "tag": "2be0c1ce-b184-45e7-9fec-55998c84eb6c"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:18:57.806357 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-2cbb9e0b-fd61-40ec-b979-86c598b0228a req-02c7ee46-adf3-41b0-990d-69a9baec25c0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:18:57.806740 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-2cbb9e0b-fd61-40ec-b979-86c598b0228a req-02c7ee46-adf3-41b0-990d-69a9baec25c0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:18:57.819485 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-2cbb9e0b-fd61-40ec-b979-86c598b0228a req-02c7ee46-adf3-41b0-990d-69a9baec25c0 service nova] Creating event network-changed:2be0c1ce-b184-45e7-9fec-55998c84eb6c for instance b9da3bd2-f3e9-4295-a0c7-0942445c65a5 on nch1-master-1 Apr 16 22:18:57.827077 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-2cbb9e0b-fd61-40ec-b979-86c598b0228a req-02c7ee46-adf3-41b0-990d-69a9baec25c0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116658 Apr 16 22:18:57.828209 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3924/7690] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:18:58.652045 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f20a4ec6-4c82-463b-be63-0b1658664905 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:18:58.652698 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f20a4ec6-4c82-463b-be63-0b1658664905 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: b9da3bd2-f3e9-4295-a0c7-0942445c65a5] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:18:58.659373 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f20a4ec6-4c82-463b-be63-0b1658664905 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:18:58.659827 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f20a4ec6-4c82-463b-be63-0b1658664905 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:18:58.660623 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f20a4ec6-4c82-463b-be63-0b1658664905 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:18:58.661062 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f20a4ec6-4c82-463b-be63-0b1658664905 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:18:58.889647 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f20a4ec6-4c82-463b-be63-0b1658664905 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:18:58.897085 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f20a4ec6-4c82-463b-be63-0b1658664905 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/b9da3bd2-f3e9-4295-a0c7-0942445c65a5" status: 200 len: 1261 microversion: 2.1 time: 0.249502 Apr 16 22:18:58.897741 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3767/7691] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:18:58 2022] GET /compute/v2.1/servers/b9da3bd2-f3e9-4295-a0c7-0942445c65a5 => generated 1261 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:18:59.916159 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6b35784c-4d03-49b2-b150-7a1af6d5b53f tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:18:59.917429 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6b35784c-4d03-49b2-b150-7a1af6d5b53f tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: b9da3bd2-f3e9-4295-a0c7-0942445c65a5] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:18:59.923657 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6b35784c-4d03-49b2-b150-7a1af6d5b53f tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:18:59.924128 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6b35784c-4d03-49b2-b150-7a1af6d5b53f tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:18:59.924939 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6b35784c-4d03-49b2-b150-7a1af6d5b53f tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:18:59.925397 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6b35784c-4d03-49b2-b150-7a1af6d5b53f tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:19:00.051851 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6b35784c-4d03-49b2-b150-7a1af6d5b53f tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:19:00.059702 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6b35784c-4d03-49b2-b150-7a1af6d5b53f tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/b9da3bd2-f3e9-4295-a0c7-0942445c65a5" status: 200 len: 1261 microversion: 2.1 time: 0.148643 Apr 16 22:19:00.060636 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3925/7692] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:18:59 2022] GET /compute/v2.1/servers/b9da3bd2-f3e9-4295-a0c7-0942445c65a5 => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:19:01.122915 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-78a0be22-cb38-48f4-b95f-ea0085d6f3e5 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:19:01.123532 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-78a0be22-cb38-48f4-b95f-ea0085d6f3e5 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: b9da3bd2-f3e9-4295-a0c7-0942445c65a5] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:19:01.129515 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-78a0be22-cb38-48f4-b95f-ea0085d6f3e5 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:19:01.129977 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-78a0be22-cb38-48f4-b95f-ea0085d6f3e5 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:19:01.130782 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-78a0be22-cb38-48f4-b95f-ea0085d6f3e5 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:19:01.131228 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-78a0be22-cb38-48f4-b95f-ea0085d6f3e5 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:19:01.259389 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-78a0be22-cb38-48f4-b95f-ea0085d6f3e5 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:19:01.266944 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-78a0be22-cb38-48f4-b95f-ea0085d6f3e5 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/b9da3bd2-f3e9-4295-a0c7-0942445c65a5" status: 200 len: 1261 microversion: 2.1 time: 0.193940 Apr 16 22:19:01.267516 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3768/7693] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:19:01 2022] GET /compute/v2.1/servers/b9da3bd2-f3e9-4295-a0c7-0942445c65a5 => generated 1261 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:19:02.283886 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-5fb8bfac-609b-47cc-8731-6b6b0d25a289 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:19:02.284548 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-5fb8bfac-609b-47cc-8731-6b6b0d25a289 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: b9da3bd2-f3e9-4295-a0c7-0942445c65a5] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:19:02.291757 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5fb8bfac-609b-47cc-8731-6b6b0d25a289 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:19:02.292254 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5fb8bfac-609b-47cc-8731-6b6b0d25a289 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:19:02.293048 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5fb8bfac-609b-47cc-8731-6b6b0d25a289 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:19:02.293505 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-5fb8bfac-609b-47cc-8731-6b6b0d25a289 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:19:02.432669 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-5fb8bfac-609b-47cc-8731-6b6b0d25a289 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:19:02.440379 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-5fb8bfac-609b-47cc-8731-6b6b0d25a289 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/b9da3bd2-f3e9-4295-a0c7-0942445c65a5" status: 200 len: 1261 microversion: 2.1 time: 0.160329 Apr 16 22:19:02.441241 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3926/7694] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:19:02 2022] GET /compute/v2.1/servers/b9da3bd2-f3e9-4295-a0c7-0942445c65a5 => generated 1261 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:19:03.458369 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-401858a0-71a4-4555-81fd-127b2137b290 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:19:03.458992 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-401858a0-71a4-4555-81fd-127b2137b290 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: b9da3bd2-f3e9-4295-a0c7-0942445c65a5] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:19:03.465957 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-401858a0-71a4-4555-81fd-127b2137b290 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:19:03.466422 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-401858a0-71a4-4555-81fd-127b2137b290 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:19:03.467218 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-401858a0-71a4-4555-81fd-127b2137b290 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:19:03.467673 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-401858a0-71a4-4555-81fd-127b2137b290 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:19:03.928365 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-401858a0-71a4-4555-81fd-127b2137b290 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:19:03.935989 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-401858a0-71a4-4555-81fd-127b2137b290 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/b9da3bd2-f3e9-4295-a0c7-0942445c65a5" status: 200 len: 1261 microversion: 2.1 time: 0.481572 Apr 16 22:19:03.936609 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3769/7695] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:19:03 2022] GET /compute/v2.1/servers/b9da3bd2-f3e9-4295-a0c7-0942445c65a5 => generated 1261 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:19:04.471662 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-792efb5a-d525-42ce-8547-a80d06293223 req-8490733b-f544-4b9d-8e03-ddfd8d17614d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9da3bd2-f3e9-4295-a0c7-0942445c65a5", "name": "network-vif-plugged", "status": "completed", "tag": "2be0c1ce-b184-45e7-9fec-55998c84eb6c"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:19:04.480321 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-792efb5a-d525-42ce-8547-a80d06293223 req-8490733b-f544-4b9d-8e03-ddfd8d17614d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:19:04.480782 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-792efb5a-d525-42ce-8547-a80d06293223 req-8490733b-f544-4b9d-8e03-ddfd8d17614d service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:19:04.492511 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-792efb5a-d525-42ce-8547-a80d06293223 req-8490733b-f544-4b9d-8e03-ddfd8d17614d service nova] Creating event network-vif-plugged:2be0c1ce-b184-45e7-9fec-55998c84eb6c for instance b9da3bd2-f3e9-4295-a0c7-0942445c65a5 on nch1-master-1 Apr 16 22:19:04.497684 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-792efb5a-d525-42ce-8547-a80d06293223 req-8490733b-f544-4b9d-8e03-ddfd8d17614d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084254 Apr 16 22:19:04.498280 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3927/7696] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:19:04.953809 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c91c7bd3-1bb2-4f2b-a6e3-2e29c787bf07 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:19:04.954445 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c91c7bd3-1bb2-4f2b-a6e3-2e29c787bf07 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: b9da3bd2-f3e9-4295-a0c7-0942445c65a5] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:19:04.961405 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c91c7bd3-1bb2-4f2b-a6e3-2e29c787bf07 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:19:04.961866 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c91c7bd3-1bb2-4f2b-a6e3-2e29c787bf07 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:19:04.962654 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c91c7bd3-1bb2-4f2b-a6e3-2e29c787bf07 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:19:04.963099 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-c91c7bd3-1bb2-4f2b-a6e3-2e29c787bf07 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:19:05.093720 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c91c7bd3-1bb2-4f2b-a6e3-2e29c787bf07 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:19:05.101126 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c91c7bd3-1bb2-4f2b-a6e3-2e29c787bf07 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/b9da3bd2-f3e9-4295-a0c7-0942445c65a5" status: 200 len: 1261 microversion: 2.1 time: 0.151473 Apr 16 22:19:05.101697 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3770/7697] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:19:04 2022] GET /compute/v2.1/servers/b9da3bd2-f3e9-4295-a0c7-0942445c65a5 => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:19:06.123561 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6b6fdd0d-d538-4318-aac5-4aff155cb911 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:19:06.124357 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6b6fdd0d-d538-4318-aac5-4aff155cb911 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: b9da3bd2-f3e9-4295-a0c7-0942445c65a5] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:19:06.131369 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6b6fdd0d-d538-4318-aac5-4aff155cb911 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:19:06.131841 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6b6fdd0d-d538-4318-aac5-4aff155cb911 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:19:06.132668 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6b6fdd0d-d538-4318-aac5-4aff155cb911 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:19:06.133119 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6b6fdd0d-d538-4318-aac5-4aff155cb911 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:19:06.268216 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6b6fdd0d-d538-4318-aac5-4aff155cb911 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:19:06.275692 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6b6fdd0d-d538-4318-aac5-4aff155cb911 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/b9da3bd2-f3e9-4295-a0c7-0942445c65a5" status: 200 len: 1446 microversion: 2.1 time: 0.156993 Apr 16 22:19:06.276320 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3928/7698] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:19:06 2022] GET /compute/v2.1/servers/b9da3bd2-f3e9-4295-a0c7-0942445c65a5 => generated 1446 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:19:06.291822 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6d23d938-bf44-4869-b381-ac6c8f994228 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:19:06.292468 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-6d23d938-bf44-4869-b381-ac6c8f994228 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: b9da3bd2-f3e9-4295-a0c7-0942445c65a5] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:19:06.299260 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6d23d938-bf44-4869-b381-ac6c8f994228 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:19:06.299722 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6d23d938-bf44-4869-b381-ac6c8f994228 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:19:06.300539 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6d23d938-bf44-4869-b381-ac6c8f994228 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:19:06.300986 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-6d23d938-bf44-4869-b381-ac6c8f994228 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:19:06.427244 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-6d23d938-bf44-4869-b381-ac6c8f994228 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:19:06.435523 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6d23d938-bf44-4869-b381-ac6c8f994228 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/b9da3bd2-f3e9-4295-a0c7-0942445c65a5" status: 200 len: 1446 microversion: 2.1 time: 0.147658 Apr 16 22:19:06.436098 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3771/7699] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:19:06 2022] GET /compute/v2.1/servers/b9da3bd2-f3e9-4295-a0c7-0942445c65a5 => generated 1446 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:19:08.328452 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-3df841fa-68fb-4fbc-abf3-19c469a7ea80 req-047bc8d5-836e-447e-8a6b-379b4f783215 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9da3bd2-f3e9-4295-a0c7-0942445c65a5", "tag": "2be0c1ce-b184-45e7-9fec-55998c84eb6c"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:19:08.337626 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-3df841fa-68fb-4fbc-abf3-19c469a7ea80 req-047bc8d5-836e-447e-8a6b-379b4f783215 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:19:08.338666 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-3df841fa-68fb-4fbc-abf3-19c469a7ea80 req-047bc8d5-836e-447e-8a6b-379b4f783215 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:19:08.349861 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-3df841fa-68fb-4fbc-abf3-19c469a7ea80 req-047bc8d5-836e-447e-8a6b-379b4f783215 service nova] Creating event network-changed:2be0c1ce-b184-45e7-9fec-55998c84eb6c for instance b9da3bd2-f3e9-4295-a0c7-0942445c65a5 on nch1-master-1 Apr 16 22:19:08.355563 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-3df841fa-68fb-4fbc-abf3-19c469a7ea80 req-047bc8d5-836e-447e-8a6b-379b4f783215 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030860 Apr 16 22:19:08.356241 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3929/7700] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:19:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:21:03.180011 ncdv-master-1 devstack@n-api.service[137409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:21:03.180626 ncdv-master-1 devstack@n-api.service[137409]: Sat Apr 16 22:21:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 22:22:07.821129 ncdv-master-1 devstack@n-api.service[137408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:22:07.821651 ncdv-master-1 devstack@n-api.service[137408]: Sat Apr 16 22:22:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 22:22:11.214592 ncdv-master-1 devstack@n-api.service[137409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:22:11.215072 ncdv-master-1 devstack@n-api.service[137409]: Sat Apr 16 22:22:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 22:22:24.395026 ncdv-master-1 devstack@n-api.service[137408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:22:24.395560 ncdv-master-1 devstack@n-api.service[137408]: Sat Apr 16 22:22:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 22:22:41.543643 ncdv-master-1 devstack@n-api.service[137409]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c4054330-0d3a-466e-a30b-fa9db79ae593] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 16 22:22:41.545007 ncdv-master-1 devstack@n-api.service[137409]: ERROR oslo.messaging._drivers.impl_rabbit [-] [288aa017-6cef-4242-b65f-3a2680f89840] AMQP server on 10.222.0.20:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 16 22:22:41.548781 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-71c18839-4aff-46d6-a066-f1c42f48405d tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:22:41.549744 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-71c18839-4aff-46d6-a066-f1c42f48405d tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: b9da3bd2-f3e9-4295-a0c7-0942445c65a5] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:22:41.556297 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-71c18839-4aff-46d6-a066-f1c42f48405d tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:22:41.556757 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-71c18839-4aff-46d6-a066-f1c42f48405d tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:22:41.557525 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-71c18839-4aff-46d6-a066-f1c42f48405d tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:22:41.557963 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-71c18839-4aff-46d6-a066-f1c42f48405d tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:22:42.552299 ncdv-master-1 devstack@n-api.service[137409]: INFO oslo.messaging._drivers.impl_rabbit [-] [c4054330-0d3a-466e-a30b-fa9db79ae593] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 47228. Apr 16 22:22:42.554451 ncdv-master-1 devstack@n-api.service[137409]: INFO oslo.messaging._drivers.impl_rabbit [-] [288aa017-6cef-4242-b65f-3a2680f89840] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 47230. Apr 16 22:22:42.558552 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-71c18839-4aff-46d6-a066-f1c42f48405d tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "POST /compute/v2.1/servers/b9da3bd2-f3e9-4295-a0c7-0942445c65a5/action" status: 200 len: 24565 microversion: 2.1 time: 1.016622 Apr 16 22:22:42.559222 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3772/7701] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 22:22:41 2022] POST /compute/v2.1/servers/b9da3bd2-f3e9-4295-a0c7-0942445c65a5/action => generated 24565 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 16 22:22:43.797009 ncdv-master-1 devstack@n-api.service[137408]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cd30ce4f-cd80-45c8-9ec5-78e4a107947b] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 16 22:22:43.797971 ncdv-master-1 devstack@n-api.service[137408]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5f71e57d-51af-43d6-a26d-a848d4145923] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 16 22:22:43.802159 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-30412565-a80a-4d23-9a82-caf5ffffd21e req-615166e9-472c-4c73-9530-ddcf3553911b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9da3bd2-f3e9-4295-a0c7-0942445c65a5", "tag": "2be0c1ce-b184-45e7-9fec-55998c84eb6c"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:22:43.802580 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-223f9301-9a87-460b-b8d3-65b2c2d67539 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:22:43.803025 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-223f9301-9a87-460b-b8d3-65b2c2d67539 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: b9da3bd2-f3e9-4295-a0c7-0942445c65a5] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:22:43.810472 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-223f9301-9a87-460b-b8d3-65b2c2d67539 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:22:43.811498 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-223f9301-9a87-460b-b8d3-65b2c2d67539 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:22:43.811843 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-223f9301-9a87-460b-b8d3-65b2c2d67539 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:22:43.812152 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-30412565-a80a-4d23-9a82-caf5ffffd21e req-615166e9-472c-4c73-9530-ddcf3553911b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:22:43.812739 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-223f9301-9a87-460b-b8d3-65b2c2d67539 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:22:43.812862 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-30412565-a80a-4d23-9a82-caf5ffffd21e req-615166e9-472c-4c73-9530-ddcf3553911b service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:22:43.824310 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-30412565-a80a-4d23-9a82-caf5ffffd21e req-615166e9-472c-4c73-9530-ddcf3553911b service nova] Creating event network-changed:2be0c1ce-b184-45e7-9fec-55998c84eb6c for instance b9da3bd2-f3e9-4295-a0c7-0942445c65a5 on nch1-master-1 Apr 16 22:22:43.830039 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-30412565-a80a-4d23-9a82-caf5ffffd21e req-615166e9-472c-4c73-9530-ddcf3553911b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032148 Apr 16 22:22:43.830744 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3773/7702] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:22:43.838482 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-223f9301-9a87-460b-b8d3-65b2c2d67539 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: b9da3bd2-f3e9-4295-a0c7-0942445c65a5] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 22:22:44.195791 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-223f9301-9a87-460b-b8d3-65b2c2d67539 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b9da3bd2-f3e9-4295-a0c7-0942445c65a5" status: 204 len: 0 microversion: 2.1 time: 0.400635 Apr 16 22:22:44.199687 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3930/7703] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 22:22:43 2022] DELETE /compute/v2.1/servers/b9da3bd2-f3e9-4295-a0c7-0942445c65a5 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 22:22:44.205939 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ed8fae15-431e-47b3-9ab2-465f5cb8a2fd tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:22:44.206719 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ed8fae15-431e-47b3-9ab2-465f5cb8a2fd tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: b9da3bd2-f3e9-4295-a0c7-0942445c65a5] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:22:44.214328 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ed8fae15-431e-47b3-9ab2-465f5cb8a2fd tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:22:44.214873 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ed8fae15-431e-47b3-9ab2-465f5cb8a2fd tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:22:44.215742 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ed8fae15-431e-47b3-9ab2-465f5cb8a2fd tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:22:44.216314 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ed8fae15-431e-47b3-9ab2-465f5cb8a2fd tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:22:44.419483 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ed8fae15-431e-47b3-9ab2-465f5cb8a2fd tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:22:44.427425 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ed8fae15-431e-47b3-9ab2-465f5cb8a2fd tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/b9da3bd2-f3e9-4295-a0c7-0942445c65a5" status: 200 len: 1571 microversion: 2.1 time: 0.226257 Apr 16 22:22:44.428081 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3774/7704] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:22:44 2022] GET /compute/v2.1/servers/b9da3bd2-f3e9-4295-a0c7-0942445c65a5 => generated 1571 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:22:45.445975 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-696b3906-d074-4ae3-9a8e-52716c3dafad tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:22:45.446694 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-696b3906-d074-4ae3-9a8e-52716c3dafad tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: b9da3bd2-f3e9-4295-a0c7-0942445c65a5] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:22:45.456460 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-696b3906-d074-4ae3-9a8e-52716c3dafad tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:22:45.464715 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-696b3906-d074-4ae3-9a8e-52716c3dafad tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:22:45.464715 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-696b3906-d074-4ae3-9a8e-52716c3dafad tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:22:45.464715 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-696b3906-d074-4ae3-9a8e-52716c3dafad tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:22:45.465017 ncdv-master-1 devstack@n-api.service[137408]: INFO oslo.messaging._drivers.impl_rabbit [-] [cd30ce4f-cd80-45c8-9ec5-78e4a107947b] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 47248. Apr 16 22:22:45.475493 ncdv-master-1 devstack@n-api.service[137408]: INFO oslo.messaging._drivers.impl_rabbit [-] [5f71e57d-51af-43d6-a26d-a848d4145923] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 47250. Apr 16 22:22:45.642127 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-696b3906-d074-4ae3-9a8e-52716c3dafad tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:22:45.649580 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-696b3906-d074-4ae3-9a8e-52716c3dafad tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/b9da3bd2-f3e9-4295-a0c7-0942445c65a5" status: 200 len: 1452 microversion: 2.1 time: 0.208032 Apr 16 22:22:45.650143 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3931/7705] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:22:45 2022] GET /compute/v2.1/servers/b9da3bd2-f3e9-4295-a0c7-0942445c65a5 => generated 1452 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:22:46.284901 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-55f70afc-685e-4509-9a90-18bd6102decc req-38920c6c-6308-4ad4-bebf-381ab5555b00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9da3bd2-f3e9-4295-a0c7-0942445c65a5", "name": "network-vif-deleted", "tag": "2be0c1ce-b184-45e7-9fec-55998c84eb6c"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:22:46.293316 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-55f70afc-685e-4509-9a90-18bd6102decc req-38920c6c-6308-4ad4-bebf-381ab5555b00 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:22:46.293766 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-55f70afc-685e-4509-9a90-18bd6102decc req-38920c6c-6308-4ad4-bebf-381ab5555b00 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:22:46.305159 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-55f70afc-685e-4509-9a90-18bd6102decc req-38920c6c-6308-4ad4-bebf-381ab5555b00 service nova] Creating event network-vif-deleted:2be0c1ce-b184-45e7-9fec-55998c84eb6c for instance b9da3bd2-f3e9-4295-a0c7-0942445c65a5 on nch1-master-1 Apr 16 22:22:46.310435 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-55f70afc-685e-4509-9a90-18bd6102decc req-38920c6c-6308-4ad4-bebf-381ab5555b00 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029271 Apr 16 22:22:46.311011 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3775/7706] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:22:46.666034 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f6863094-806e-421d-93f7-a86f0e53d3a2 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:22:46.666677 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f6863094-806e-421d-93f7-a86f0e53d3a2 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: b9da3bd2-f3e9-4295-a0c7-0942445c65a5] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:22:46.674210 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6863094-806e-421d-93f7-a86f0e53d3a2 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:22:46.677430 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6863094-806e-421d-93f7-a86f0e53d3a2 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:22:46.677430 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6863094-806e-421d-93f7-a86f0e53d3a2 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:22:46.677430 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6863094-806e-421d-93f7-a86f0e53d3a2 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:22:46.746741 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-f6863094-806e-421d-93f7-a86f0e53d3a2 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37ff1c2e4f3b45f589d675028674ecb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a91917b203d4a2ca179d394e04af71f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:22:46.754671 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f6863094-806e-421d-93f7-a86f0e53d3a2 tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/b9da3bd2-f3e9-4295-a0c7-0942445c65a5" status: 200 len: 1220 microversion: 2.1 time: 0.092755 Apr 16 22:22:46.755248 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3932/7707] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:22:46 2022] GET /compute/v2.1/servers/b9da3bd2-f3e9-4295-a0c7-0942445c65a5 => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:22:47.773620 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-77de530a-58ea-4476-ba2e-0666b0a89fdb tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:22:47.774251 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-77de530a-58ea-4476-ba2e-0666b0a89fdb tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [instance: b9da3bd2-f3e9-4295-a0c7-0942445c65a5] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:22:47.780683 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-77de530a-58ea-4476-ba2e-0666b0a89fdb tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:22:47.781143 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-77de530a-58ea-4476-ba2e-0666b0a89fdb tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:22:47.781921 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-77de530a-58ea-4476-ba2e-0666b0a89fdb tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:22:47.782364 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-77de530a-58ea-4476-ba2e-0666b0a89fdb tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:22:47.795471 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-77de530a-58ea-4476-ba2e-0666b0a89fdb tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] HTTP exception thrown: Instance b9da3bd2-f3e9-4295-a0c7-0942445c65a5 could not be found. Apr 16 22:22:47.799800 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-77de530a-58ea-4476-ba2e-0666b0a89fdb tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Returning 404 to user: Instance b9da3bd2-f3e9-4295-a0c7-0942445c65a5 could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 22:22:47.799800 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-77de530a-58ea-4476-ba2e-0666b0a89fdb tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "GET /compute/v2.1/servers/b9da3bd2-f3e9-4295-a0c7-0942445c65a5" status: 404 len: 111 microversion: 2.1 time: 0.029229 Apr 16 22:22:47.799800 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3776/7708] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:22:47 2022] GET /compute/v2.1/servers/b9da3bd2-f3e9-4295-a0c7-0942445c65a5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 22:22:48.031630 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-74c60bd0-1522-49cd-832e-4684399d303d tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] Calling method '.version_select at 0x7fbb95c30430>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:22:48.031630 ncdv-master-1 devstack@n-api.service[137408]: ERROR oslo.messaging._drivers.impl_rabbit [None req-74c60bd0-1522-49cd-832e-4684399d303d tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [3901b61f-3e1c-4ff6-b469-98dd356d3000] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 16 22:22:49.036091 ncdv-master-1 devstack@n-api.service[137408]: INFO oslo.messaging._drivers.impl_rabbit [None req-74c60bd0-1522-49cd-832e-4684399d303d tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] [3901b61f-3e1c-4ff6-b469-98dd356d3000] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 47284. Apr 16 22:22:49.093589 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-74c60bd0-1522-49cd-832e-4684399d303d tempest-TestShelveInstance-414998748 tempest-TestShelveInstance-414998748-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1710827741" status: 202 len: 0 microversion: 2.1 time: 1.073828 Apr 16 22:22:49.094174 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3933/7709] 10.222.0.20 () {58 vars in 1253 bytes} [Sat Apr 16 22:22:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1710827741 => generated 0 bytes in 1075 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 22:23:10.908828 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ee7b0e82-7544-43fd-a00d-084df005963f tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Action: 'create', calling method: .version_select at 0x7fbb95808e50>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1763670172"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:23:10.926772 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-ee7b0e82-7544-43fd-a00d-084df005963f tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Getting quotas for project 31f2cd0b26e149b589061d18a3b7af3d. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 22:23:10.937234 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-ee7b0e82-7544-43fd-a00d-084df005963f tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Getting quotas for user 9fdf8094a9314b31a4fa61a9abe18cc9 and project 31f2cd0b26e149b589061d18a3b7af3d. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 22:23:11.166535 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-ee7b0e82-7544-43fd-a00d-084df005963f tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Getting quotas for project 31f2cd0b26e149b589061d18a3b7af3d. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 22:23:11.171798 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.quota [None req-ee7b0e82-7544-43fd-a00d-084df005963f tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Getting quotas for user 9fdf8094a9314b31a4fa61a9abe18cc9 and project 31f2cd0b26e149b589061d18a3b7af3d. Resources: {'key_pairs'} {{(pid=137409) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 22:23:11.187106 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ee7b0e82-7544-43fd-a00d-084df005963f tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.449969 Apr 16 22:23:11.188307 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3777/7710] 10.222.0.20 () {60 vars in 1157 bytes} [Sat Apr 16 22:23:10 2022] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:23:13.730828 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-96078cbb-2fed-44a4-a7b6-ff05bcd7e831 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1461148689", "imageRef": "88bbe9a7-19d2-4102-9634-058b7c590848", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1763670172", "security_groups": [{"name": "tempest-secgroup-smoke-1514886454"}], "networks": [{"uuid": "c1277097-2b9c-40a0-a73d-b72779c3dcd8"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:23:13.860681 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-96078cbb-2fed-44a4-a7b6-ff05bcd7e831 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] validate_networks() for [('c1277097-2b9c-40a0-a73d-b72779c3dcd8', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 22:23:14.450358 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-96078cbb-2fed-44a4-a7b6-ff05bcd7e831 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 22:23:14.450783 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-96078cbb-2fed-44a4-a7b6-ff05bcd7e831 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 22:23:14.451581 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-96078cbb-2fed-44a4-a7b6-ff05bcd7e831 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 22:23:14.452019 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-96078cbb-2fed-44a4-a7b6-ff05bcd7e831 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 22:23:14.452518 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-96078cbb-2fed-44a4-a7b6-ff05bcd7e831 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 22:23:14.462191 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-96078cbb-2fed-44a4-a7b6-ff05bcd7e831 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:23:14.462663 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-96078cbb-2fed-44a4-a7b6-ff05bcd7e831 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:23:14.463804 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-96078cbb-2fed-44a4-a7b6-ff05bcd7e831 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:23:14.464303 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-96078cbb-2fed-44a4-a7b6-ff05bcd7e831 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:23:14.482340 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-96078cbb-2fed-44a4-a7b6-ff05bcd7e831 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Getting quotas for project 31f2cd0b26e149b589061d18a3b7af3d. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 22:23:14.487731 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-96078cbb-2fed-44a4-a7b6-ff05bcd7e831 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Getting quotas for user 9fdf8094a9314b31a4fa61a9abe18cc9 and project 31f2cd0b26e149b589061d18a3b7af3d. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 22:23:14.501815 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-96078cbb-2fed-44a4-a7b6-ff05bcd7e831 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 22:23:14.508723 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-96078cbb-2fed-44a4-a7b6-ff05bcd7e831 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: 0f9b6279-82f9-4786-9f42-1aacf55bc7eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='88bbe9a7-19d2-4102-9634-058b7c590848',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 22:23:14.616321 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-96078cbb-2fed-44a4-a7b6-ff05bcd7e831 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.890621 Apr 16 22:23:14.617014 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3934/7711] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 22:23:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Apr 16 22:23:14.628267 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-c212ed9c-3322-45a0-8b9d-1f9d1e9400e8 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:23:14.628902 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-c212ed9c-3322-45a0-8b9d-1f9d1e9400e8 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: 0f9b6279-82f9-4786-9f42-1aacf55bc7eb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:23:14.691790 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-c212ed9c-3322-45a0-8b9d-1f9d1e9400e8 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdf8094a9314b31a4fa61a9abe18cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f2cd0b26e149b589061d18a3b7af3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:23:14.698553 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-c212ed9c-3322-45a0-8b9d-1f9d1e9400e8 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] 10.222.0.20 "GET /compute/v2.1/servers/0f9b6279-82f9-4786-9f42-1aacf55bc7eb" status: 200 len: 1249 microversion: 2.1 time: 0.074785 Apr 16 22:23:14.700130 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3778/7712] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:23:14 2022] GET /compute/v2.1/servers/0f9b6279-82f9-4786-9f42-1aacf55bc7eb => generated 1249 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:23:15.717212 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-177df1fd-1a44-4b59-ac96-9abd8417c4fa tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:23:15.717850 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-177df1fd-1a44-4b59-ac96-9abd8417c4fa tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: 0f9b6279-82f9-4786-9f42-1aacf55bc7eb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:23:15.727459 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-177df1fd-1a44-4b59-ac96-9abd8417c4fa tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:23:15.727940 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-177df1fd-1a44-4b59-ac96-9abd8417c4fa tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:23:15.728774 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-177df1fd-1a44-4b59-ac96-9abd8417c4fa tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:23:15.729237 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-177df1fd-1a44-4b59-ac96-9abd8417c4fa tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:23:15.790545 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-177df1fd-1a44-4b59-ac96-9abd8417c4fa tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdf8094a9314b31a4fa61a9abe18cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f2cd0b26e149b589061d18a3b7af3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:23:15.798368 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-177df1fd-1a44-4b59-ac96-9abd8417c4fa tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] 10.222.0.20 "GET /compute/v2.1/servers/0f9b6279-82f9-4786-9f42-1aacf55bc7eb" status: 200 len: 1253 microversion: 2.1 time: 0.086309 Apr 16 22:23:15.798952 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3935/7713] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:23:15 2022] GET /compute/v2.1/servers/0f9b6279-82f9-4786-9f42-1aacf55bc7eb => generated 1253 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:23:16.816274 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-38efb989-7e21-4464-90b4-ec1f3f955114 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:23:16.816816 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-38efb989-7e21-4464-90b4-ec1f3f955114 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: 0f9b6279-82f9-4786-9f42-1aacf55bc7eb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:23:16.824799 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-38efb989-7e21-4464-90b4-ec1f3f955114 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:23:16.825298 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-38efb989-7e21-4464-90b4-ec1f3f955114 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:23:16.826090 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-38efb989-7e21-4464-90b4-ec1f3f955114 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:23:16.826537 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-38efb989-7e21-4464-90b4-ec1f3f955114 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:23:16.893849 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-38efb989-7e21-4464-90b4-ec1f3f955114 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdf8094a9314b31a4fa61a9abe18cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f2cd0b26e149b589061d18a3b7af3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:23:16.902402 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-38efb989-7e21-4464-90b4-ec1f3f955114 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] 10.222.0.20 "GET /compute/v2.1/servers/0f9b6279-82f9-4786-9f42-1aacf55bc7eb" status: 200 len: 1319 microversion: 2.1 time: 0.090484 Apr 16 22:23:16.903217 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3779/7714] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:23:16 2022] GET /compute/v2.1/servers/0f9b6279-82f9-4786-9f42-1aacf55bc7eb => generated 1319 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:23:17.928928 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-a781a0ec-afef-42bd-afa6-edc1e07855ce tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:23:17.929583 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-a781a0ec-afef-42bd-afa6-edc1e07855ce tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: 0f9b6279-82f9-4786-9f42-1aacf55bc7eb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:23:17.939621 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a781a0ec-afef-42bd-afa6-edc1e07855ce tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:23:17.939621 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a781a0ec-afef-42bd-afa6-edc1e07855ce tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:23:17.939621 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a781a0ec-afef-42bd-afa6-edc1e07855ce tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:23:17.939621 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-a781a0ec-afef-42bd-afa6-edc1e07855ce tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:23:18.085275 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-a781a0ec-afef-42bd-afa6-edc1e07855ce tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdf8094a9314b31a4fa61a9abe18cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f2cd0b26e149b589061d18a3b7af3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:23:18.093572 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-a781a0ec-afef-42bd-afa6-edc1e07855ce tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] 10.222.0.20 "GET /compute/v2.1/servers/0f9b6279-82f9-4786-9f42-1aacf55bc7eb" status: 200 len: 1375 microversion: 2.1 time: 0.168478 Apr 16 22:23:18.094852 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3936/7715] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:23:17 2022] GET /compute/v2.1/servers/0f9b6279-82f9-4786-9f42-1aacf55bc7eb => generated 1375 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:23:18.257581 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-6b8782f5-6c0d-41f9-9691-d012eb2bbbe3 req-89b6add1-ffc7-436b-ba52-428b6beaae13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f9b6279-82f9-4786-9f42-1aacf55bc7eb", "tag": "fe461ac3-2c69-476e-a75a-b48182245dcb"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:23:18.266408 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-6b8782f5-6c0d-41f9-9691-d012eb2bbbe3 req-89b6add1-ffc7-436b-ba52-428b6beaae13 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:23:18.267092 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-6b8782f5-6c0d-41f9-9691-d012eb2bbbe3 req-89b6add1-ffc7-436b-ba52-428b6beaae13 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:23:18.280642 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-6b8782f5-6c0d-41f9-9691-d012eb2bbbe3 req-89b6add1-ffc7-436b-ba52-428b6beaae13 service nova] Creating event network-changed:fe461ac3-2c69-476e-a75a-b48182245dcb for instance 0f9b6279-82f9-4786-9f42-1aacf55bc7eb on nch1-master-1 Apr 16 22:23:18.285912 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-6b8782f5-6c0d-41f9-9691-d012eb2bbbe3 req-89b6add1-ffc7-436b-ba52-428b6beaae13 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032078 Apr 16 22:23:18.287132 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3780/7716] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:23:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:23:19.112129 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-54b1a8cb-cca7-4186-bf8c-e171092ea88e tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:23:19.112848 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-54b1a8cb-cca7-4186-bf8c-e171092ea88e tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: 0f9b6279-82f9-4786-9f42-1aacf55bc7eb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:23:19.120132 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-54b1a8cb-cca7-4186-bf8c-e171092ea88e tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:23:19.120638 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-54b1a8cb-cca7-4186-bf8c-e171092ea88e tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:23:19.121434 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-54b1a8cb-cca7-4186-bf8c-e171092ea88e tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:23:19.122374 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-54b1a8cb-cca7-4186-bf8c-e171092ea88e tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:23:19.249717 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-54b1a8cb-cca7-4186-bf8c-e171092ea88e tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdf8094a9314b31a4fa61a9abe18cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f2cd0b26e149b589061d18a3b7af3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:23:19.257065 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-54b1a8cb-cca7-4186-bf8c-e171092ea88e tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] 10.222.0.20 "GET /compute/v2.1/servers/0f9b6279-82f9-4786-9f42-1aacf55bc7eb" status: 200 len: 1375 microversion: 2.1 time: 0.148823 Apr 16 22:23:19.259948 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3937/7717] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:23:19 2022] GET /compute/v2.1/servers/0f9b6279-82f9-4786-9f42-1aacf55bc7eb => generated 1375 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:23:20.275421 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-9ccb49ec-b9e0-43d7-ab0e-0ad64bfc3310 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:23:20.276053 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-9ccb49ec-b9e0-43d7-ab0e-0ad64bfc3310 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: 0f9b6279-82f9-4786-9f42-1aacf55bc7eb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:23:20.282284 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9ccb49ec-b9e0-43d7-ab0e-0ad64bfc3310 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:23:20.282747 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9ccb49ec-b9e0-43d7-ab0e-0ad64bfc3310 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:23:20.283528 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9ccb49ec-b9e0-43d7-ab0e-0ad64bfc3310 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:23:20.283979 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-9ccb49ec-b9e0-43d7-ab0e-0ad64bfc3310 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:23:20.417120 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-9ccb49ec-b9e0-43d7-ab0e-0ad64bfc3310 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdf8094a9314b31a4fa61a9abe18cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f2cd0b26e149b589061d18a3b7af3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:23:20.424343 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-9ccb49ec-b9e0-43d7-ab0e-0ad64bfc3310 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] 10.222.0.20 "GET /compute/v2.1/servers/0f9b6279-82f9-4786-9f42-1aacf55bc7eb" status: 200 len: 1375 microversion: 2.1 time: 0.154070 Apr 16 22:23:20.424917 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3781/7718] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:23:20 2022] GET /compute/v2.1/servers/0f9b6279-82f9-4786-9f42-1aacf55bc7eb => generated 1375 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:23:21.442606 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4e38bd80-97d4-4ba9-af14-f0c3cd963d1f tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:23:21.443234 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4e38bd80-97d4-4ba9-af14-f0c3cd963d1f tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: 0f9b6279-82f9-4786-9f42-1aacf55bc7eb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:23:21.450549 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4e38bd80-97d4-4ba9-af14-f0c3cd963d1f tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:23:21.451018 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4e38bd80-97d4-4ba9-af14-f0c3cd963d1f tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:23:21.451812 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4e38bd80-97d4-4ba9-af14-f0c3cd963d1f tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:23:21.452294 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4e38bd80-97d4-4ba9-af14-f0c3cd963d1f tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:23:21.582522 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4e38bd80-97d4-4ba9-af14-f0c3cd963d1f tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdf8094a9314b31a4fa61a9abe18cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f2cd0b26e149b589061d18a3b7af3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:23:21.590527 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4e38bd80-97d4-4ba9-af14-f0c3cd963d1f tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] 10.222.0.20 "GET /compute/v2.1/servers/0f9b6279-82f9-4786-9f42-1aacf55bc7eb" status: 200 len: 1375 microversion: 2.1 time: 0.151916 Apr 16 22:23:21.591123 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3938/7719] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:23:21 2022] GET /compute/v2.1/servers/0f9b6279-82f9-4786-9f42-1aacf55bc7eb => generated 1375 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:23:22.607410 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1b33b9a5-0231-4b45-88cc-6ca45b0affe9 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:23:22.608033 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1b33b9a5-0231-4b45-88cc-6ca45b0affe9 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: 0f9b6279-82f9-4786-9f42-1aacf55bc7eb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:23:22.614846 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1b33b9a5-0231-4b45-88cc-6ca45b0affe9 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:23:22.615309 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1b33b9a5-0231-4b45-88cc-6ca45b0affe9 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:23:22.616090 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1b33b9a5-0231-4b45-88cc-6ca45b0affe9 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:23:22.616565 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1b33b9a5-0231-4b45-88cc-6ca45b0affe9 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:23:22.747029 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-1b33b9a5-0231-4b45-88cc-6ca45b0affe9 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdf8094a9314b31a4fa61a9abe18cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f2cd0b26e149b589061d18a3b7af3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:23:22.754363 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1b33b9a5-0231-4b45-88cc-6ca45b0affe9 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] 10.222.0.20 "GET /compute/v2.1/servers/0f9b6279-82f9-4786-9f42-1aacf55bc7eb" status: 200 len: 1375 microversion: 2.1 time: 0.150908 Apr 16 22:23:22.754935 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3782/7720] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:23:22 2022] GET /compute/v2.1/servers/0f9b6279-82f9-4786-9f42-1aacf55bc7eb => generated 1375 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:23:23.634891 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-8f3bb389-2e54-4875-a20f-6a6e9feebf79 req-f551d1ee-d5d6-4c24-8dce-eccd5efc2ae5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f9b6279-82f9-4786-9f42-1aacf55bc7eb", "name": "network-vif-plugged", "status": "completed", "tag": "fe461ac3-2c69-476e-a75a-b48182245dcb"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:23:23.643705 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-8f3bb389-2e54-4875-a20f-6a6e9feebf79 req-f551d1ee-d5d6-4c24-8dce-eccd5efc2ae5 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:23:23.644197 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-8f3bb389-2e54-4875-a20f-6a6e9feebf79 req-f551d1ee-d5d6-4c24-8dce-eccd5efc2ae5 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:23:23.655454 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-8f3bb389-2e54-4875-a20f-6a6e9feebf79 req-f551d1ee-d5d6-4c24-8dce-eccd5efc2ae5 service nova] Creating event network-vif-plugged:fe461ac3-2c69-476e-a75a-b48182245dcb for instance 0f9b6279-82f9-4786-9f42-1aacf55bc7eb on nch1-master-1 Apr 16 22:23:23.660534 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-8f3bb389-2e54-4875-a20f-6a6e9feebf79 req-f551d1ee-d5d6-4c24-8dce-eccd5efc2ae5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029362 Apr 16 22:23:23.661048 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3939/7721] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:23:23.770984 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-601de81c-b1c1-4b81-b7f7-5c692ac3a79a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:23:23.771600 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-601de81c-b1c1-4b81-b7f7-5c692ac3a79a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: 0f9b6279-82f9-4786-9f42-1aacf55bc7eb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:23:23.778397 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-601de81c-b1c1-4b81-b7f7-5c692ac3a79a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:23:23.778860 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-601de81c-b1c1-4b81-b7f7-5c692ac3a79a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:23:23.779646 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-601de81c-b1c1-4b81-b7f7-5c692ac3a79a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:23:23.781137 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-601de81c-b1c1-4b81-b7f7-5c692ac3a79a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:23:23.907803 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-601de81c-b1c1-4b81-b7f7-5c692ac3a79a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdf8094a9314b31a4fa61a9abe18cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f2cd0b26e149b589061d18a3b7af3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:23:23.915773 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-601de81c-b1c1-4b81-b7f7-5c692ac3a79a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] 10.222.0.20 "GET /compute/v2.1/servers/0f9b6279-82f9-4786-9f42-1aacf55bc7eb" status: 200 len: 1375 microversion: 2.1 time: 0.148741 Apr 16 22:23:23.916329 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3783/7722] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:23:23 2022] GET /compute/v2.1/servers/0f9b6279-82f9-4786-9f42-1aacf55bc7eb => generated 1375 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:23:24.934077 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-7e127d05-138e-4c4f-9089-2a043cf4a771 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:23:24.934799 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-7e127d05-138e-4c4f-9089-2a043cf4a771 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: 0f9b6279-82f9-4786-9f42-1aacf55bc7eb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:23:24.946024 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7e127d05-138e-4c4f-9089-2a043cf4a771 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:23:24.946024 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7e127d05-138e-4c4f-9089-2a043cf4a771 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:23:24.946024 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7e127d05-138e-4c4f-9089-2a043cf4a771 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:23:24.946024 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-7e127d05-138e-4c4f-9089-2a043cf4a771 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:23:25.078978 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-7e127d05-138e-4c4f-9089-2a043cf4a771 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdf8094a9314b31a4fa61a9abe18cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f2cd0b26e149b589061d18a3b7af3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:23:25.087086 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-7e127d05-138e-4c4f-9089-2a043cf4a771 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] 10.222.0.20 "GET /compute/v2.1/servers/0f9b6279-82f9-4786-9f42-1aacf55bc7eb" status: 200 len: 1375 microversion: 2.1 time: 0.158077 Apr 16 22:23:25.087656 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3940/7723] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:23:24 2022] GET /compute/v2.1/servers/0f9b6279-82f9-4786-9f42-1aacf55bc7eb => generated 1375 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:23:26.103816 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2cf85d3d-baf4-4de1-b287-1efa2348d62c tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:23:26.104462 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2cf85d3d-baf4-4de1-b287-1efa2348d62c tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: 0f9b6279-82f9-4786-9f42-1aacf55bc7eb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:23:26.111216 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2cf85d3d-baf4-4de1-b287-1efa2348d62c tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:23:26.112219 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2cf85d3d-baf4-4de1-b287-1efa2348d62c tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:23:26.112475 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2cf85d3d-baf4-4de1-b287-1efa2348d62c tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:23:26.112927 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2cf85d3d-baf4-4de1-b287-1efa2348d62c tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:23:26.240570 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2cf85d3d-baf4-4de1-b287-1efa2348d62c tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdf8094a9314b31a4fa61a9abe18cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f2cd0b26e149b589061d18a3b7af3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:23:26.248488 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2cf85d3d-baf4-4de1-b287-1efa2348d62c tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] 10.222.0.20 "GET /compute/v2.1/servers/0f9b6279-82f9-4786-9f42-1aacf55bc7eb" status: 200 len: 1560 microversion: 2.1 time: 0.148535 Apr 16 22:23:26.249060 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3784/7724] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:23:26 2022] GET /compute/v2.1/servers/0f9b6279-82f9-4786-9f42-1aacf55bc7eb => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:23:26.265020 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4d609ccf-da11-4aaf-8e77-27c446e4e27f tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:23:26.265678 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4d609ccf-da11-4aaf-8e77-27c446e4e27f tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: 0f9b6279-82f9-4786-9f42-1aacf55bc7eb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:23:26.272558 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4d609ccf-da11-4aaf-8e77-27c446e4e27f tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:23:26.273029 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4d609ccf-da11-4aaf-8e77-27c446e4e27f tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:23:26.273847 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4d609ccf-da11-4aaf-8e77-27c446e4e27f tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:23:26.274300 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4d609ccf-da11-4aaf-8e77-27c446e4e27f tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:23:26.403627 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4d609ccf-da11-4aaf-8e77-27c446e4e27f tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdf8094a9314b31a4fa61a9abe18cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f2cd0b26e149b589061d18a3b7af3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:23:26.411084 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4d609ccf-da11-4aaf-8e77-27c446e4e27f tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] 10.222.0.20 "GET /compute/v2.1/servers/0f9b6279-82f9-4786-9f42-1aacf55bc7eb" status: 200 len: 1560 microversion: 2.1 time: 0.149866 Apr 16 22:23:26.411658 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3941/7725] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:23:26 2022] GET /compute/v2.1/servers/0f9b6279-82f9-4786-9f42-1aacf55bc7eb => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:23:28.345192 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-c7949984-5731-4acb-a75f-5aaff435b13b req-b171a286-e889-4415-871e-90cc563ae221 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f9b6279-82f9-4786-9f42-1aacf55bc7eb", "tag": "fe461ac3-2c69-476e-a75a-b48182245dcb"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:23:28.354260 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-c7949984-5731-4acb-a75f-5aaff435b13b req-b171a286-e889-4415-871e-90cc563ae221 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:23:28.354718 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-c7949984-5731-4acb-a75f-5aaff435b13b req-b171a286-e889-4415-871e-90cc563ae221 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:23:28.368577 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-c7949984-5731-4acb-a75f-5aaff435b13b req-b171a286-e889-4415-871e-90cc563ae221 service nova] Creating event network-changed:fe461ac3-2c69-476e-a75a-b48182245dcb for instance 0f9b6279-82f9-4786-9f42-1aacf55bc7eb on nch1-master-1 Apr 16 22:23:28.374105 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-c7949984-5731-4acb-a75f-5aaff435b13b req-b171a286-e889-4415-871e-90cc563ae221 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032410 Apr 16 22:23:28.374691 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3785/7726] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:23:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:25:23.074561 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-518cbb36-ed4e-4197-971e-2a9a53a58370 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-133009287"}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:25:23.075642 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-518cbb36-ed4e-4197-971e-2a9a53a58370 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: 0f9b6279-82f9-4786-9f42-1aacf55bc7eb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:25:23.081731 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-518cbb36-ed4e-4197-971e-2a9a53a58370 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:25:23.085451 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-518cbb36-ed4e-4197-971e-2a9a53a58370 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:25:23.085451 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-518cbb36-ed4e-4197-971e-2a9a53a58370 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:25:23.085451 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-518cbb36-ed4e-4197-971e-2a9a53a58370 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:25:23.600820 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-518cbb36-ed4e-4197-971e-2a9a53a58370 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] 10.222.0.20 "POST /compute/v2.1/servers/0f9b6279-82f9-4786-9f42-1aacf55bc7eb/action" status: 202 len: 0 microversion: 2.1 time: 0.531335 Apr 16 22:25:23.601474 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3942/7727] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 22:25:23 2022] POST /compute/v2.1/servers/0f9b6279-82f9-4786-9f42-1aacf55bc7eb/action => generated 0 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 16 22:25:28.072906 ncdv-master-1 devstack@n-api.service[137409]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c4054330-0d3a-466e-a30b-fa9db79ae593] AMQP server on 10.222.0.20:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Apr 16 22:25:28.077560 ncdv-master-1 devstack@n-api.service[137409]: ERROR oslo.messaging._drivers.impl_rabbit [-] [288aa017-6cef-4242-b65f-3a2680f89840] AMQP server on 10.222.0.20:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Apr 16 22:25:28.135257 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-1addd21f-1c95-4d96-93c3-138856253266 req-d03432a1-1c63-49c2-93c1-7dd877f4b586 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f9b6279-82f9-4786-9f42-1aacf55bc7eb", "name": "network-vif-plugged", "status": "completed", "tag": "fe461ac3-2c69-476e-a75a-b48182245dcb"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:25:28.143542 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-1addd21f-1c95-4d96-93c3-138856253266 req-d03432a1-1c63-49c2-93c1-7dd877f4b586 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:25:28.143996 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-1addd21f-1c95-4d96-93c3-138856253266 req-d03432a1-1c63-49c2-93c1-7dd877f4b586 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:25:28.155414 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-1addd21f-1c95-4d96-93c3-138856253266 req-d03432a1-1c63-49c2-93c1-7dd877f4b586 service nova] Creating event network-vif-plugged:fe461ac3-2c69-476e-a75a-b48182245dcb for instance 0f9b6279-82f9-4786-9f42-1aacf55bc7eb on nch1-master-1 Apr 16 22:25:28.160528 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-1addd21f-1c95-4d96-93c3-138856253266 req-d03432a1-1c63-49c2-93c1-7dd877f4b586 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090055 Apr 16 22:25:28.161126 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3786/7728] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 22:25:31.222579 ncdv-master-1 devstack@n-api.service[137409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:25:31.223194 ncdv-master-1 devstack@n-api.service[137409]: Sat Apr 16 22:25:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 22:25:31.283647 ncdv-master-1 devstack@n-api.service[137409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:25:31.283803 ncdv-master-1 devstack@n-api.service[137409]: Sat Apr 16 22:25:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 22:25:39.217021 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-1bed92a8-b6f1-4b73-a53c-b3e4c190a75a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1765880763", "imageRef": "972220ce-a1dc-4f93-ac77-156cdd67ae5b", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1763670172", "security_groups": [{"name": "tempest-secgroup-smoke-1514886454"}], "networks": [{"uuid": "c1277097-2b9c-40a0-a73d-b72779c3dcd8"}]}} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:25:39.325078 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.network.neutron [None req-1bed92a8-b6f1-4b73-a53c-b3e4c190a75a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] validate_networks() for [('c1277097-2b9c-40a0-a73d-b72779c3dcd8', None, None, None, None, None)] {{(pid=137408) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 16 22:25:39.693956 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-1bed92a8-b6f1-4b73-a53c-b3e4c190a75a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Flavor limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 16 22:25:39.693956 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-1bed92a8-b6f1-4b73-a53c-b3e4c190a75a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Image limits 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 16 22:25:39.694196 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-1bed92a8-b6f1-4b73-a53c-b3e4c190a75a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Flavor pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 16 22:25:39.694641 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-1bed92a8-b6f1-4b73-a53c-b3e4c190a75a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Image pref 0:0:0 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 16 22:25:39.695093 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.virt.hardware [None req-1bed92a8-b6f1-4b73-a53c-b3e4c190a75a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=137408) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 16 22:25:39.704164 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1bed92a8-b6f1-4b73-a53c-b3e4c190a75a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:25:39.704683 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1bed92a8-b6f1-4b73-a53c-b3e4c190a75a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:25:39.705492 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1bed92a8-b6f1-4b73-a53c-b3e4c190a75a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:25:39.705942 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-1bed92a8-b6f1-4b73-a53c-b3e4c190a75a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:25:39.722842 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-1bed92a8-b6f1-4b73-a53c-b3e4c190a75a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Getting quotas for project 31f2cd0b26e149b589061d18a3b7af3d. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 16 22:25:39.728387 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.quota [None req-1bed92a8-b6f1-4b73-a53c-b3e4c190a75a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Getting quotas for user 9fdf8094a9314b31a4fa61a9abe18cc9 and project 31f2cd0b26e149b589061d18a3b7af3d. Resources: {'cores', 'ram', 'instances'} {{(pid=137408) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 16 22:25:39.740867 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1bed92a8-b6f1-4b73-a53c-b3e4c190a75a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Going to run 1 instances... {{(pid=137408) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 16 22:25:39.743735 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-1bed92a8-b6f1-4b73-a53c-b3e4c190a75a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: b5e3e804-99f2-4927-898d-ac3d20c6e98f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='972220ce-a1dc-4f93-ac77-156cdd67ae5b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=137408) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 16 22:25:39.867310 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-1bed92a8-b6f1-4b73-a53c-b3e4c190a75a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.654555 Apr 16 22:25:39.868053 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3943/7729] 10.222.0.20 () {60 vars in 1146 bytes} [Sat Apr 16 22:25:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 16 22:25:39.881653 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f54bf4a3-e81d-4b5b-9fa7-bcf2768697be tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:25:39.882424 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f54bf4a3-e81d-4b5b-9fa7-bcf2768697be tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: b5e3e804-99f2-4927-898d-ac3d20c6e98f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:25:39.899631 ncdv-master-1 devstack@n-api.service[137409]: INFO oslo.messaging._drivers.impl_rabbit [-] [288aa017-6cef-4242-b65f-3a2680f89840] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 47726. Apr 16 22:25:39.903762 ncdv-master-1 devstack@n-api.service[137409]: INFO oslo.messaging._drivers.impl_rabbit [-] [c4054330-0d3a-466e-a30b-fa9db79ae593] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 47724. Apr 16 22:25:39.954792 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f54bf4a3-e81d-4b5b-9fa7-bcf2768697be tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdf8094a9314b31a4fa61a9abe18cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f2cd0b26e149b589061d18a3b7af3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:25:39.961581 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f54bf4a3-e81d-4b5b-9fa7-bcf2768697be tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] 10.222.0.20 "GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f" status: 200 len: 1249 microversion: 2.1 time: 0.087295 Apr 16 22:25:39.962159 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3787/7730] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:25:39 2022] GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f => generated 1249 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:25:40.979515 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-4e7d5315-d1d3-469d-82ae-efbeba969f9b tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:25:40.980142 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-4e7d5315-d1d3-469d-82ae-efbeba969f9b tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: b5e3e804-99f2-4927-898d-ac3d20c6e98f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:25:40.987099 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4e7d5315-d1d3-469d-82ae-efbeba969f9b tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:25:40.987574 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4e7d5315-d1d3-469d-82ae-efbeba969f9b tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:25:40.988395 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4e7d5315-d1d3-469d-82ae-efbeba969f9b tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:25:40.988857 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-4e7d5315-d1d3-469d-82ae-efbeba969f9b tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:25:41.051714 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-4e7d5315-d1d3-469d-82ae-efbeba969f9b tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdf8094a9314b31a4fa61a9abe18cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f2cd0b26e149b589061d18a3b7af3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:25:41.059320 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-4e7d5315-d1d3-469d-82ae-efbeba969f9b tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] 10.222.0.20 "GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f" status: 200 len: 1253 microversion: 2.1 time: 0.084492 Apr 16 22:25:41.061291 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3944/7731] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:25:40 2022] GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f => generated 1253 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:25:42.077321 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ccc61da1-9b19-4145-8c4d-175aef192ab5 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:25:42.081944 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ccc61da1-9b19-4145-8c4d-175aef192ab5 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: b5e3e804-99f2-4927-898d-ac3d20c6e98f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:25:42.085165 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ccc61da1-9b19-4145-8c4d-175aef192ab5 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:25:42.085639 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ccc61da1-9b19-4145-8c4d-175aef192ab5 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:25:42.086469 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ccc61da1-9b19-4145-8c4d-175aef192ab5 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:25:42.086927 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ccc61da1-9b19-4145-8c4d-175aef192ab5 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:25:42.101249 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-87b1e87d-4c7f-4518-a4b1-5a42279a03a5 req-8c02ed45-a797-484d-a3dd-018cd26eea96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f9b6279-82f9-4786-9f42-1aacf55bc7eb", "name": "network-vif-unplugged", "status": "completed", "tag": "fe461ac3-2c69-476e-a75a-b48182245dcb"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:25:42.112483 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-87b1e87d-4c7f-4518-a4b1-5a42279a03a5 req-8c02ed45-a797-484d-a3dd-018cd26eea96 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:25:42.112987 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-87b1e87d-4c7f-4518-a4b1-5a42279a03a5 req-8c02ed45-a797-484d-a3dd-018cd26eea96 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:25:42.124671 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-87b1e87d-4c7f-4518-a4b1-5a42279a03a5 req-8c02ed45-a797-484d-a3dd-018cd26eea96 service nova] Creating event network-vif-unplugged:fe461ac3-2c69-476e-a75a-b48182245dcb for instance 0f9b6279-82f9-4786-9f42-1aacf55bc7eb on nch1-master-1 Apr 16 22:25:42.130374 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-87b1e87d-4c7f-4518-a4b1-5a42279a03a5 req-8c02ed45-a797-484d-a3dd-018cd26eea96 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033197 Apr 16 22:25:42.131828 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3945/7732] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:25:42.161314 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ccc61da1-9b19-4145-8c4d-175aef192ab5 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdf8094a9314b31a4fa61a9abe18cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f2cd0b26e149b589061d18a3b7af3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:25:42.168962 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ccc61da1-9b19-4145-8c4d-175aef192ab5 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] 10.222.0.20 "GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f" status: 200 len: 1319 microversion: 2.1 time: 0.095855 Apr 16 22:25:42.169539 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3788/7733] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:25:42 2022] GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f => generated 1319 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:25:43.188591 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-6e8ab6cb-8005-462f-a072-1df94e91bff2 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:25:43.190088 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-6e8ab6cb-8005-462f-a072-1df94e91bff2 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: b5e3e804-99f2-4927-898d-ac3d20c6e98f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:25:43.197313 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6e8ab6cb-8005-462f-a072-1df94e91bff2 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:25:43.198134 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6e8ab6cb-8005-462f-a072-1df94e91bff2 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:25:43.199256 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6e8ab6cb-8005-462f-a072-1df94e91bff2 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:25:43.199983 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-6e8ab6cb-8005-462f-a072-1df94e91bff2 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:25:43.348356 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-6e8ab6cb-8005-462f-a072-1df94e91bff2 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdf8094a9314b31a4fa61a9abe18cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f2cd0b26e149b589061d18a3b7af3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:25:43.357127 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-6e8ab6cb-8005-462f-a072-1df94e91bff2 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] 10.222.0.20 "GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f" status: 200 len: 1375 microversion: 2.1 time: 0.173822 Apr 16 22:25:43.368596 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3946/7734] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:25:43 2022] GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f => generated 1375 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:25:44.377867 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-19bf7fb4-2520-40b9-8cd8-7c96178b25e9 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:25:44.379359 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-19bf7fb4-2520-40b9-8cd8-7c96178b25e9 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: b5e3e804-99f2-4927-898d-ac3d20c6e98f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:25:44.388379 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-19bf7fb4-2520-40b9-8cd8-7c96178b25e9 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:25:44.389090 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-19bf7fb4-2520-40b9-8cd8-7c96178b25e9 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:25:44.390573 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-19bf7fb4-2520-40b9-8cd8-7c96178b25e9 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:25:44.391289 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-19bf7fb4-2520-40b9-8cd8-7c96178b25e9 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:25:44.534517 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-19bf7fb4-2520-40b9-8cd8-7c96178b25e9 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdf8094a9314b31a4fa61a9abe18cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f2cd0b26e149b589061d18a3b7af3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:25:44.542529 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-19bf7fb4-2520-40b9-8cd8-7c96178b25e9 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] 10.222.0.20 "GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f" status: 200 len: 1375 microversion: 2.1 time: 0.170666 Apr 16 22:25:44.543194 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3789/7735] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:25:44 2022] GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f => generated 1375 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:25:45.560111 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-18df1456-75b1-4727-9a5a-943fa3ce9a9f tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:25:45.562490 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-18df1456-75b1-4727-9a5a-943fa3ce9a9f tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: b5e3e804-99f2-4927-898d-ac3d20c6e98f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:25:45.569436 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-18df1456-75b1-4727-9a5a-943fa3ce9a9f tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:25:45.570251 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-18df1456-75b1-4727-9a5a-943fa3ce9a9f tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:25:45.571229 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-18df1456-75b1-4727-9a5a-943fa3ce9a9f tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:25:45.571836 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-18df1456-75b1-4727-9a5a-943fa3ce9a9f tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:25:45.731682 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-18df1456-75b1-4727-9a5a-943fa3ce9a9f tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdf8094a9314b31a4fa61a9abe18cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f2cd0b26e149b589061d18a3b7af3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:25:45.741110 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-18df1456-75b1-4727-9a5a-943fa3ce9a9f tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] 10.222.0.20 "GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f" status: 200 len: 1375 microversion: 2.1 time: 0.184844 Apr 16 22:25:45.759955 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3947/7736] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:25:45 2022] GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f => generated 1375 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:25:46.763716 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-de4a2492-a297-427b-97c9-8b1b0ecadf7e tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:25:46.766043 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-de4a2492-a297-427b-97c9-8b1b0ecadf7e tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: b5e3e804-99f2-4927-898d-ac3d20c6e98f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:25:46.773802 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-de4a2492-a297-427b-97c9-8b1b0ecadf7e tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:25:46.774476 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-de4a2492-a297-427b-97c9-8b1b0ecadf7e tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:25:46.775358 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-de4a2492-a297-427b-97c9-8b1b0ecadf7e tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:25:46.775885 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-de4a2492-a297-427b-97c9-8b1b0ecadf7e tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:25:46.918939 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-de4a2492-a297-427b-97c9-8b1b0ecadf7e tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdf8094a9314b31a4fa61a9abe18cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f2cd0b26e149b589061d18a3b7af3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:25:46.927582 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-de4a2492-a297-427b-97c9-8b1b0ecadf7e tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] 10.222.0.20 "GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f" status: 200 len: 1375 microversion: 2.1 time: 0.169065 Apr 16 22:25:46.928190 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3790/7737] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:25:46 2022] GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f => generated 1375 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:25:47.945894 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-26eb692e-9fb5-4572-9488-1f7028101a4b tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:25:47.946728 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-26eb692e-9fb5-4572-9488-1f7028101a4b tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: b5e3e804-99f2-4927-898d-ac3d20c6e98f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:25:47.954087 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-26eb692e-9fb5-4572-9488-1f7028101a4b tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:25:47.954557 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-26eb692e-9fb5-4572-9488-1f7028101a4b tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:25:47.955371 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-26eb692e-9fb5-4572-9488-1f7028101a4b tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:25:47.955828 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-26eb692e-9fb5-4572-9488-1f7028101a4b tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:25:48.109784 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-26eb692e-9fb5-4572-9488-1f7028101a4b tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdf8094a9314b31a4fa61a9abe18cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f2cd0b26e149b589061d18a3b7af3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:25:48.117554 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-26eb692e-9fb5-4572-9488-1f7028101a4b tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] 10.222.0.20 "GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f" status: 200 len: 1375 microversion: 2.1 time: 0.175894 Apr 16 22:25:48.118596 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3948/7738] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:25:47 2022] GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f => generated 1375 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:25:49.137643 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d85e079a-c0cf-487a-a4c9-6abfcd86bcbf tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:25:49.138640 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d85e079a-c0cf-487a-a4c9-6abfcd86bcbf tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: b5e3e804-99f2-4927-898d-ac3d20c6e98f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:25:49.147409 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d85e079a-c0cf-487a-a4c9-6abfcd86bcbf tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:25:49.147869 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d85e079a-c0cf-487a-a4c9-6abfcd86bcbf tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:25:49.148746 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d85e079a-c0cf-487a-a4c9-6abfcd86bcbf tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:25:49.149186 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d85e079a-c0cf-487a-a4c9-6abfcd86bcbf tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:25:49.320233 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d85e079a-c0cf-487a-a4c9-6abfcd86bcbf tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdf8094a9314b31a4fa61a9abe18cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f2cd0b26e149b589061d18a3b7af3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:25:49.324996 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d85e079a-c0cf-487a-a4c9-6abfcd86bcbf tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] 10.222.0.20 "GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f" status: 200 len: 1375 microversion: 2.1 time: 0.191401 Apr 16 22:25:49.327800 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3791/7739] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:25:49 2022] GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f => generated 1375 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:25:50.341919 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-8cae9b2d-e451-4821-a2f0-f531ee8bfee7 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:25:50.342600 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-8cae9b2d-e451-4821-a2f0-f531ee8bfee7 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: b5e3e804-99f2-4927-898d-ac3d20c6e98f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:25:50.349330 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8cae9b2d-e451-4821-a2f0-f531ee8bfee7 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:25:50.349798 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8cae9b2d-e451-4821-a2f0-f531ee8bfee7 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:25:50.350581 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8cae9b2d-e451-4821-a2f0-f531ee8bfee7 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:25:50.351032 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-8cae9b2d-e451-4821-a2f0-f531ee8bfee7 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:25:50.480692 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-8cae9b2d-e451-4821-a2f0-f531ee8bfee7 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdf8094a9314b31a4fa61a9abe18cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f2cd0b26e149b589061d18a3b7af3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:25:50.487886 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-8cae9b2d-e451-4821-a2f0-f531ee8bfee7 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] 10.222.0.20 "GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f" status: 200 len: 1375 microversion: 2.1 time: 0.149821 Apr 16 22:25:50.488478 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3949/7740] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:25:50 2022] GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f => generated 1375 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:25:51.504729 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-3ffaeed5-4b40-459a-84d8-2b1ad757a65d tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:25:51.505346 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-3ffaeed5-4b40-459a-84d8-2b1ad757a65d tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: b5e3e804-99f2-4927-898d-ac3d20c6e98f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:25:51.512316 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3ffaeed5-4b40-459a-84d8-2b1ad757a65d tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:25:51.512778 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3ffaeed5-4b40-459a-84d8-2b1ad757a65d tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:25:51.513557 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3ffaeed5-4b40-459a-84d8-2b1ad757a65d tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:25:51.514001 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-3ffaeed5-4b40-459a-84d8-2b1ad757a65d tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:25:51.650325 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-3ffaeed5-4b40-459a-84d8-2b1ad757a65d tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdf8094a9314b31a4fa61a9abe18cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f2cd0b26e149b589061d18a3b7af3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:25:51.658459 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-3ffaeed5-4b40-459a-84d8-2b1ad757a65d tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] 10.222.0.20 "GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f" status: 200 len: 1375 microversion: 2.1 time: 0.157580 Apr 16 22:25:51.659270 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3792/7741] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:25:51 2022] GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f => generated 1375 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:25:52.522359 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-798554af-e799-4df3-95c9-a2e1495e0e94 req-6c0ca35d-688e-44d2-8b06-9618d94e3102 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5e3e804-99f2-4927-898d-ac3d20c6e98f", "tag": "a9d00613-b10d-4fcd-9956-4de235317a03"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:25:52.533097 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-798554af-e799-4df3-95c9-a2e1495e0e94 req-6c0ca35d-688e-44d2-8b06-9618d94e3102 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:25:52.533830 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-798554af-e799-4df3-95c9-a2e1495e0e94 req-6c0ca35d-688e-44d2-8b06-9618d94e3102 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:25:52.546635 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-798554af-e799-4df3-95c9-a2e1495e0e94 req-6c0ca35d-688e-44d2-8b06-9618d94e3102 service nova] Creating event network-changed:a9d00613-b10d-4fcd-9956-4de235317a03 for instance b5e3e804-99f2-4927-898d-ac3d20c6e98f on nch2-master-1 Apr 16 22:25:52.551965 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-798554af-e799-4df3-95c9-a2e1495e0e94 req-6c0ca35d-688e-44d2-8b06-9618d94e3102 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110742 Apr 16 22:25:52.553157 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3950/7742] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:25:52.675699 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-03711649-078f-45af-86ea-f748a57fb828 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:25:52.676892 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-03711649-078f-45af-86ea-f748a57fb828 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: b5e3e804-99f2-4927-898d-ac3d20c6e98f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:25:52.687184 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-03711649-078f-45af-86ea-f748a57fb828 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:25:52.687600 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-03711649-078f-45af-86ea-f748a57fb828 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:25:52.688465 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-03711649-078f-45af-86ea-f748a57fb828 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:25:52.688917 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-03711649-078f-45af-86ea-f748a57fb828 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:25:52.822659 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-03711649-078f-45af-86ea-f748a57fb828 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdf8094a9314b31a4fa61a9abe18cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f2cd0b26e149b589061d18a3b7af3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:25:52.829979 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-03711649-078f-45af-86ea-f748a57fb828 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] 10.222.0.20 "GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f" status: 200 len: 1375 microversion: 2.1 time: 0.158237 Apr 16 22:25:52.830549 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3793/7743] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:25:52 2022] GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f => generated 1375 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:25:53.847978 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-ab1acefa-f28d-4a98-b18e-7e629b808f44 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:25:53.848811 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-ab1acefa-f28d-4a98-b18e-7e629b808f44 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: b5e3e804-99f2-4927-898d-ac3d20c6e98f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:25:53.855668 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ab1acefa-f28d-4a98-b18e-7e629b808f44 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:25:53.856126 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ab1acefa-f28d-4a98-b18e-7e629b808f44 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:25:53.856934 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ab1acefa-f28d-4a98-b18e-7e629b808f44 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:25:53.857387 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-ab1acefa-f28d-4a98-b18e-7e629b808f44 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:25:54.302560 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-ab1acefa-f28d-4a98-b18e-7e629b808f44 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdf8094a9314b31a4fa61a9abe18cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f2cd0b26e149b589061d18a3b7af3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:25:54.310687 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-ab1acefa-f28d-4a98-b18e-7e629b808f44 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] 10.222.0.20 "GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f" status: 200 len: 1375 microversion: 2.1 time: 0.466935 Apr 16 22:25:54.311750 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3951/7744] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:25:53 2022] GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f => generated 1375 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:25:55.328549 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-198ca53e-f579-41dd-aee6-2dd43c9888a4 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:25:55.329164 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-198ca53e-f579-41dd-aee6-2dd43c9888a4 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: b5e3e804-99f2-4927-898d-ac3d20c6e98f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:25:55.335817 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-198ca53e-f579-41dd-aee6-2dd43c9888a4 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:25:55.336307 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-198ca53e-f579-41dd-aee6-2dd43c9888a4 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:25:55.337085 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-198ca53e-f579-41dd-aee6-2dd43c9888a4 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:25:55.337532 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-198ca53e-f579-41dd-aee6-2dd43c9888a4 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:25:55.465588 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-198ca53e-f579-41dd-aee6-2dd43c9888a4 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdf8094a9314b31a4fa61a9abe18cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f2cd0b26e149b589061d18a3b7af3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:25:55.473678 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-198ca53e-f579-41dd-aee6-2dd43c9888a4 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] 10.222.0.20 "GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f" status: 200 len: 1375 microversion: 2.1 time: 0.149626 Apr 16 22:25:55.474259 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3794/7745] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:25:55 2022] GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f => generated 1375 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:25:56.490424 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-429a809a-4be3-42c0-b0bf-7d696f1331d7 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:25:56.491061 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-429a809a-4be3-42c0-b0bf-7d696f1331d7 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: b5e3e804-99f2-4927-898d-ac3d20c6e98f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:25:56.497863 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-429a809a-4be3-42c0-b0bf-7d696f1331d7 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:25:56.498340 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-429a809a-4be3-42c0-b0bf-7d696f1331d7 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:25:56.499135 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-429a809a-4be3-42c0-b0bf-7d696f1331d7 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:25:56.499595 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-429a809a-4be3-42c0-b0bf-7d696f1331d7 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:25:56.632763 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-429a809a-4be3-42c0-b0bf-7d696f1331d7 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdf8094a9314b31a4fa61a9abe18cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f2cd0b26e149b589061d18a3b7af3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:25:56.640056 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-429a809a-4be3-42c0-b0bf-7d696f1331d7 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] 10.222.0.20 "GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f" status: 200 len: 1375 microversion: 2.1 time: 0.153541 Apr 16 22:25:56.640665 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3952/7746] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:25:56 2022] GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f => generated 1375 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:25:57.657850 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-f31957dc-c86a-4e92-bb32-fd62945f7a83 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:25:57.658468 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-f31957dc-c86a-4e92-bb32-fd62945f7a83 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: b5e3e804-99f2-4927-898d-ac3d20c6e98f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:25:57.665180 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f31957dc-c86a-4e92-bb32-fd62945f7a83 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:25:57.665682 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f31957dc-c86a-4e92-bb32-fd62945f7a83 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:25:57.666463 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f31957dc-c86a-4e92-bb32-fd62945f7a83 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:25:57.666911 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-f31957dc-c86a-4e92-bb32-fd62945f7a83 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:25:57.801540 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-f31957dc-c86a-4e92-bb32-fd62945f7a83 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdf8094a9314b31a4fa61a9abe18cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f2cd0b26e149b589061d18a3b7af3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:25:57.808935 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-f31957dc-c86a-4e92-bb32-fd62945f7a83 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] 10.222.0.20 "GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f" status: 200 len: 1375 microversion: 2.1 time: 0.155546 Apr 16 22:25:57.809516 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3795/7747] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:25:57 2022] GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f => generated 1375 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:25:58.826582 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-16b91d8a-e560-4b31-be62-9f8a1cf01fe9 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:25:58.827248 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-16b91d8a-e560-4b31-be62-9f8a1cf01fe9 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: b5e3e804-99f2-4927-898d-ac3d20c6e98f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:25:58.834129 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-16b91d8a-e560-4b31-be62-9f8a1cf01fe9 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:25:58.834605 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-16b91d8a-e560-4b31-be62-9f8a1cf01fe9 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:25:58.835407 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-16b91d8a-e560-4b31-be62-9f8a1cf01fe9 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:25:58.835867 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-16b91d8a-e560-4b31-be62-9f8a1cf01fe9 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:25:58.963324 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-16b91d8a-e560-4b31-be62-9f8a1cf01fe9 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdf8094a9314b31a4fa61a9abe18cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f2cd0b26e149b589061d18a3b7af3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:25:58.971335 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-16b91d8a-e560-4b31-be62-9f8a1cf01fe9 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] 10.222.0.20 "GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f" status: 200 len: 1375 microversion: 2.1 time: 0.148740 Apr 16 22:25:58.971910 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3953/7748] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:25:58 2022] GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f => generated 1375 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:25:59.988757 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-ccffba2f-98ae-4659-b6d8-d956968a8561 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:25:59.989289 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-ccffba2f-98ae-4659-b6d8-d956968a8561 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: b5e3e804-99f2-4927-898d-ac3d20c6e98f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:25:59.995959 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ccffba2f-98ae-4659-b6d8-d956968a8561 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:25:59.996451 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ccffba2f-98ae-4659-b6d8-d956968a8561 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:25:59.997221 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ccffba2f-98ae-4659-b6d8-d956968a8561 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:25:59.997664 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-ccffba2f-98ae-4659-b6d8-d956968a8561 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:26:00.130440 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-ccffba2f-98ae-4659-b6d8-d956968a8561 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdf8094a9314b31a4fa61a9abe18cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f2cd0b26e149b589061d18a3b7af3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:26:00.137753 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-ccffba2f-98ae-4659-b6d8-d956968a8561 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] 10.222.0.20 "GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f" status: 200 len: 1375 microversion: 2.1 time: 0.153418 Apr 16 22:26:00.138331 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3796/7749] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:25:59 2022] GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f => generated 1375 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:26:00.285197 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-48ac2d4b-5f92-4186-ac6a-c53a5c951fb8 req-7352e59a-6a68-4f2b-aea4-0019d17f3fcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5e3e804-99f2-4927-898d-ac3d20c6e98f", "name": "network-vif-plugged", "status": "completed", "tag": "a9d00613-b10d-4fcd-9956-4de235317a03"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:26:00.294061 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-48ac2d4b-5f92-4186-ac6a-c53a5c951fb8 req-7352e59a-6a68-4f2b-aea4-0019d17f3fcd service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:26:00.294527 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-48ac2d4b-5f92-4186-ac6a-c53a5c951fb8 req-7352e59a-6a68-4f2b-aea4-0019d17f3fcd service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:26:00.305489 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-48ac2d4b-5f92-4186-ac6a-c53a5c951fb8 req-7352e59a-6a68-4f2b-aea4-0019d17f3fcd service nova] Creating event network-vif-plugged:a9d00613-b10d-4fcd-9956-4de235317a03 for instance b5e3e804-99f2-4927-898d-ac3d20c6e98f on nch2-master-1 Apr 16 22:26:00.311321 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-48ac2d4b-5f92-4186-ac6a-c53a5c951fb8 req-7352e59a-6a68-4f2b-aea4-0019d17f3fcd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029303 Apr 16 22:26:00.314981 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3954/7750] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:26:01.155993 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-d5ab6243-10e2-4de8-98e4-e414042aa8f3 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:26:01.156614 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-d5ab6243-10e2-4de8-98e4-e414042aa8f3 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: b5e3e804-99f2-4927-898d-ac3d20c6e98f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:26:01.163303 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d5ab6243-10e2-4de8-98e4-e414042aa8f3 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:26:01.163755 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d5ab6243-10e2-4de8-98e4-e414042aa8f3 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:26:01.164563 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d5ab6243-10e2-4de8-98e4-e414042aa8f3 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:26:01.165010 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-d5ab6243-10e2-4de8-98e4-e414042aa8f3 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:26:01.293313 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-d5ab6243-10e2-4de8-98e4-e414042aa8f3 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdf8094a9314b31a4fa61a9abe18cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f2cd0b26e149b589061d18a3b7af3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:26:01.300886 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-d5ab6243-10e2-4de8-98e4-e414042aa8f3 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] 10.222.0.20 "GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f" status: 200 len: 1375 microversion: 2.1 time: 0.149336 Apr 16 22:26:01.301459 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3797/7751] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:26:01 2022] GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f => generated 1375 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:26:02.319773 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-353e0e3b-8b1c-4b6b-82b0-fe10aa50a92c tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:26:02.320520 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-353e0e3b-8b1c-4b6b-82b0-fe10aa50a92c tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: b5e3e804-99f2-4927-898d-ac3d20c6e98f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:26:02.326761 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-353e0e3b-8b1c-4b6b-82b0-fe10aa50a92c tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:26:02.327233 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-353e0e3b-8b1c-4b6b-82b0-fe10aa50a92c tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:26:02.328022 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-353e0e3b-8b1c-4b6b-82b0-fe10aa50a92c tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:26:02.328515 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-353e0e3b-8b1c-4b6b-82b0-fe10aa50a92c tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:26:02.459882 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-353e0e3b-8b1c-4b6b-82b0-fe10aa50a92c tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdf8094a9314b31a4fa61a9abe18cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f2cd0b26e149b589061d18a3b7af3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:26:02.467847 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-353e0e3b-8b1c-4b6b-82b0-fe10aa50a92c tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] 10.222.0.20 "GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f" status: 200 len: 1561 microversion: 2.1 time: 0.153250 Apr 16 22:26:02.468479 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3955/7752] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:26:02 2022] GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:26:02.484784 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-25586060-26d8-4353-98f8-1efe0ee0dd03 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:26:02.485401 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-25586060-26d8-4353-98f8-1efe0ee0dd03 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: b5e3e804-99f2-4927-898d-ac3d20c6e98f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:26:02.492074 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-25586060-26d8-4353-98f8-1efe0ee0dd03 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:26:02.492603 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-25586060-26d8-4353-98f8-1efe0ee0dd03 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:26:02.493387 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-25586060-26d8-4353-98f8-1efe0ee0dd03 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:26:02.493835 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-25586060-26d8-4353-98f8-1efe0ee0dd03 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:26:02.628764 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-25586060-26d8-4353-98f8-1efe0ee0dd03 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdf8094a9314b31a4fa61a9abe18cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f2cd0b26e149b589061d18a3b7af3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:26:02.636138 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-25586060-26d8-4353-98f8-1efe0ee0dd03 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] 10.222.0.20 "GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f" status: 200 len: 1561 microversion: 2.1 time: 0.155868 Apr 16 22:26:02.636746 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3798/7753] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:26:02 2022] GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f => generated 1561 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:26:04.901258 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-d1a587f8-57bb-4b10-b3b1-5e274adde158 req-3b0a1270-79c4-44f9-be73-e8ceebcbbd98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5e3e804-99f2-4927-898d-ac3d20c6e98f", "tag": "a9d00613-b10d-4fcd-9956-4de235317a03"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:26:04.909881 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-d1a587f8-57bb-4b10-b3b1-5e274adde158 req-3b0a1270-79c4-44f9-be73-e8ceebcbbd98 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:26:04.910293 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-d1a587f8-57bb-4b10-b3b1-5e274adde158 req-3b0a1270-79c4-44f9-be73-e8ceebcbbd98 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:26:04.921891 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-d1a587f8-57bb-4b10-b3b1-5e274adde158 req-3b0a1270-79c4-44f9-be73-e8ceebcbbd98 service nova] Creating event network-changed:a9d00613-b10d-4fcd-9956-4de235317a03 for instance b5e3e804-99f2-4927-898d-ac3d20c6e98f on nch2-master-1 Apr 16 22:26:04.926797 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-d1a587f8-57bb-4b10-b3b1-5e274adde158 req-3b0a1270-79c4-44f9-be73-e8ceebcbbd98 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029241 Apr 16 22:26:04.930362 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3956/7754] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:26:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:28:18.694676 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-1dc9eed8-19ae-4215-8f72-09bb1246922c tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-722098105"}} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:28:18.702949 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-1dc9eed8-19ae-4215-8f72-09bb1246922c tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: b5e3e804-99f2-4927-898d-ac3d20c6e98f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:28:18.702949 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1dc9eed8-19ae-4215-8f72-09bb1246922c tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:28:18.702949 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1dc9eed8-19ae-4215-8f72-09bb1246922c tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:28:18.703275 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1dc9eed8-19ae-4215-8f72-09bb1246922c tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:28:18.703630 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-1dc9eed8-19ae-4215-8f72-09bb1246922c tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:28:19.272012 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-1dc9eed8-19ae-4215-8f72-09bb1246922c tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] 10.222.0.20 "POST /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f/action" status: 202 len: 0 microversion: 2.1 time: 0.629218 Apr 16 22:28:19.272604 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3799/7755] 10.222.0.20 () {60 vars in 1277 bytes} [Sat Apr 16 22:28:18 2022] POST /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f/action => generated 0 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 16 22:28:26.952919 ncdv-master-1 devstack@n-api.service[137408]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5f71e57d-51af-43d6-a26d-a848d4145923] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 16 22:28:26.953799 ncdv-master-1 devstack@n-api.service[137408]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cd30ce4f-cd80-45c8-9ec5-78e4a107947b] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 16 22:28:26.958182 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-c334d998-0e63-463d-955e-4d6e4d27381c req-8ff32552-1826-4ac1-a63b-881da63a9a57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5e3e804-99f2-4927-898d-ac3d20c6e98f", "name": "network-vif-plugged", "status": "completed", "tag": "a9d00613-b10d-4fcd-9956-4de235317a03"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:28:26.968007 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-c334d998-0e63-463d-955e-4d6e4d27381c req-8ff32552-1826-4ac1-a63b-881da63a9a57 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:28:26.968494 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-c334d998-0e63-463d-955e-4d6e4d27381c req-8ff32552-1826-4ac1-a63b-881da63a9a57 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:28:26.982126 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-c334d998-0e63-463d-955e-4d6e4d27381c req-8ff32552-1826-4ac1-a63b-881da63a9a57 service nova] Creating event network-vif-plugged:a9d00613-b10d-4fcd-9956-4de235317a03 for instance b5e3e804-99f2-4927-898d-ac3d20c6e98f on nch2-master-1 Apr 16 22:28:26.985901 ncdv-master-1 devstack@n-api.service[137408]: ERROR oslo.messaging._drivers.impl_rabbit [req-c334d998-0e63-463d-955e-4d6e4d27381c req-8ff32552-1826-4ac1-a63b-881da63a9a57 service nova] [6a0c58c0-ec61-47f8-9993-a4b4df808b34] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 16 22:28:27.962211 ncdv-master-1 devstack@n-api.service[137408]: INFO oslo.messaging._drivers.impl_rabbit [-] [5f71e57d-51af-43d6-a26d-a848d4145923] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 47970. Apr 16 22:28:27.963864 ncdv-master-1 devstack@n-api.service[137408]: INFO oslo.messaging._drivers.impl_rabbit [-] [cd30ce4f-cd80-45c8-9ec5-78e4a107947b] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 47972. Apr 16 22:28:27.997490 ncdv-master-1 devstack@n-api.service[137408]: INFO oslo.messaging._drivers.impl_rabbit [req-c334d998-0e63-463d-955e-4d6e4d27381c req-8ff32552-1826-4ac1-a63b-881da63a9a57 service nova] [6a0c58c0-ec61-47f8-9993-a4b4df808b34] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 47974. Apr 16 22:28:28.002102 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-c334d998-0e63-463d-955e-4d6e4d27381c req-8ff32552-1826-4ac1-a63b-881da63a9a57 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.052702 Apr 16 22:28:28.003042 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3957/7756] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:28:39.947638 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-4e9c5593-7c19-4599-a125-b729511cd04e tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:28:39.948265 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4e9c5593-7c19-4599-a125-b729511cd04e tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: b5e3e804-99f2-4927-898d-ac3d20c6e98f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:28:39.950681 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [req-ab8f71ba-3e52-479f-b249-ea08d7cc9c6c req-1b12b162-e2ec-4af6-82d4-2e1b77f7102e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5e3e804-99f2-4927-898d-ac3d20c6e98f", "tag": "a9d00613-b10d-4fcd-9956-4de235317a03"}]} {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:28:39.951116 ncdv-master-1 devstack@n-api.service[137409]: ERROR oslo.messaging._drivers.impl_rabbit [-] [288aa017-6cef-4242-b65f-3a2680f89840] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 16 22:28:39.952576 ncdv-master-1 devstack@n-api.service[137409]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c4054330-0d3a-466e-a30b-fa9db79ae593] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 16 22:28:39.957564 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4e9c5593-7c19-4599-a125-b729511cd04e tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:28:39.958323 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4e9c5593-7c19-4599-a125-b729511cd04e tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:28:39.959192 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4e9c5593-7c19-4599-a125-b729511cd04e tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:28:39.959698 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-4e9c5593-7c19-4599-a125-b729511cd04e tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:28:39.961399 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-ab8f71ba-3e52-479f-b249-ea08d7cc9c6c req-1b12b162-e2ec-4af6-82d4-2e1b77f7102e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:28:39.962114 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [req-ab8f71ba-3e52-479f-b249-ea08d7cc9c6c req-1b12b162-e2ec-4af6-82d4-2e1b77f7102e service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:28:39.973455 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.compute.server_external_events [req-ab8f71ba-3e52-479f-b249-ea08d7cc9c6c req-1b12b162-e2ec-4af6-82d4-2e1b77f7102e service nova] Creating event network-changed:a9d00613-b10d-4fcd-9956-4de235317a03 for instance b5e3e804-99f2-4927-898d-ac3d20c6e98f on nch2-master-1 Apr 16 22:28:39.978858 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [req-ab8f71ba-3e52-479f-b249-ea08d7cc9c6c req-1b12b162-e2ec-4af6-82d4-2e1b77f7102e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033366 Apr 16 22:28:39.979547 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3958/7757] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:28:39.986474 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-4e9c5593-7c19-4599-a125-b729511cd04e tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: b5e3e804-99f2-4927-898d-ac3d20c6e98f] Going to try to terminate instance {{(pid=137409) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 22:28:40.254538 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-4e9c5593-7c19-4599-a125-b729511cd04e tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f" status: 204 len: 0 microversion: 2.1 time: 0.311526 Apr 16 22:28:40.256000 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3800/7758] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 22:28:39 2022] DELETE /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 22:28:40.265610 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-e416f35d-65d9-4bef-924b-2434d04d360a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:28:40.266580 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-e416f35d-65d9-4bef-924b-2434d04d360a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: b5e3e804-99f2-4927-898d-ac3d20c6e98f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:28:40.272969 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e416f35d-65d9-4bef-924b-2434d04d360a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:28:40.273526 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e416f35d-65d9-4bef-924b-2434d04d360a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:28:40.274403 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e416f35d-65d9-4bef-924b-2434d04d360a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:28:40.274931 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-e416f35d-65d9-4bef-924b-2434d04d360a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:28:40.468619 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-e416f35d-65d9-4bef-924b-2434d04d360a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdf8094a9314b31a4fa61a9abe18cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f2cd0b26e149b589061d18a3b7af3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:28:40.476658 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-e416f35d-65d9-4bef-924b-2434d04d360a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] 10.222.0.20 "GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f" status: 200 len: 1685 microversion: 2.1 time: 0.216898 Apr 16 22:28:40.477312 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3959/7759] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:28:40 2022] GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f => generated 1685 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:28:40.923695 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-87e5557c-415e-4675-ba34-9d0dd2d2b641 req-7f53eb77-e7da-4a38-9376-c770e1c20767 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5e3e804-99f2-4927-898d-ac3d20c6e98f", "name": "network-vif-unplugged", "status": "completed", "tag": "a9d00613-b10d-4fcd-9956-4de235317a03"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:28:40.932742 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-87e5557c-415e-4675-ba34-9d0dd2d2b641 req-7f53eb77-e7da-4a38-9376-c770e1c20767 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:28:40.938936 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-87e5557c-415e-4675-ba34-9d0dd2d2b641 req-7f53eb77-e7da-4a38-9376-c770e1c20767 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:28:40.944936 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-87e5557c-415e-4675-ba34-9d0dd2d2b641 req-7f53eb77-e7da-4a38-9376-c770e1c20767 service nova] Creating event network-vif-unplugged:a9d00613-b10d-4fcd-9956-4de235317a03 for instance b5e3e804-99f2-4927-898d-ac3d20c6e98f on nch2-master-1 Apr 16 22:28:40.950380 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-87e5557c-415e-4675-ba34-9d0dd2d2b641 req-7f53eb77-e7da-4a38-9376-c770e1c20767 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030787 Apr 16 22:28:40.951184 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3801/7760] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:28:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:28:41.494729 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-cd71373c-bb1c-41f6-8200-3b61f00080b8 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:28:41.495393 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-cd71373c-bb1c-41f6-8200-3b61f00080b8 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: b5e3e804-99f2-4927-898d-ac3d20c6e98f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:28:41.502208 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cd71373c-bb1c-41f6-8200-3b61f00080b8 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:28:41.502686 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cd71373c-bb1c-41f6-8200-3b61f00080b8 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:28:41.503476 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cd71373c-bb1c-41f6-8200-3b61f00080b8 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:28:41.503934 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-cd71373c-bb1c-41f6-8200-3b61f00080b8 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:28:41.704128 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-cd71373c-bb1c-41f6-8200-3b61f00080b8 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdf8094a9314b31a4fa61a9abe18cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f2cd0b26e149b589061d18a3b7af3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:28:41.712526 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-cd71373c-bb1c-41f6-8200-3b61f00080b8 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] 10.222.0.20 "GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f" status: 200 len: 1685 microversion: 2.1 time: 0.221684 Apr 16 22:28:41.713112 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3960/7761] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:28:41 2022] GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f => generated 1685 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:28:42.439159 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-29940a46-223b-4c6f-a071-aa837e898d65 req-b3ebd42a-6a05-409a-bc70-415740f281d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5e3e804-99f2-4927-898d-ac3d20c6e98f", "name": "network-vif-deleted", "tag": "a9d00613-b10d-4fcd-9956-4de235317a03"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:28:42.453562 ncdv-master-1 devstack@n-api.service[137409]: INFO oslo.messaging._drivers.impl_rabbit [-] [288aa017-6cef-4242-b65f-3a2680f89840] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 48118. Apr 16 22:28:42.457073 ncdv-master-1 devstack@n-api.service[137409]: INFO oslo.messaging._drivers.impl_rabbit [-] [c4054330-0d3a-466e-a30b-fa9db79ae593] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 48120. Apr 16 22:28:42.462174 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-29940a46-223b-4c6f-a071-aa837e898d65 req-b3ebd42a-6a05-409a-bc70-415740f281d0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:28:42.462626 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-29940a46-223b-4c6f-a071-aa837e898d65 req-b3ebd42a-6a05-409a-bc70-415740f281d0 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:28:42.473447 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-29940a46-223b-4c6f-a071-aa837e898d65 req-b3ebd42a-6a05-409a-bc70-415740f281d0 service nova] Creating event network-vif-deleted:a9d00613-b10d-4fcd-9956-4de235317a03 for instance b5e3e804-99f2-4927-898d-ac3d20c6e98f on nch2-master-1 Apr 16 22:28:42.479221 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-29940a46-223b-4c6f-a071-aa837e898d65 req-b3ebd42a-6a05-409a-bc70-415740f281d0 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046554 Apr 16 22:28:42.479940 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3802/7762] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:28:42.729482 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-9c005e7e-59ec-4a82-a4f7-22562f718a96 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:28:42.730110 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-9c005e7e-59ec-4a82-a4f7-22562f718a96 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: b5e3e804-99f2-4927-898d-ac3d20c6e98f] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:28:42.741522 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9c005e7e-59ec-4a82-a4f7-22562f718a96 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:28:42.741992 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9c005e7e-59ec-4a82-a4f7-22562f718a96 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:28:42.742850 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9c005e7e-59ec-4a82-a4f7-22562f718a96 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:28:42.743290 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9c005e7e-59ec-4a82-a4f7-22562f718a96 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:28:42.776051 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9c005e7e-59ec-4a82-a4f7-22562f718a96 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:28:42.776763 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-9c005e7e-59ec-4a82-a4f7-22562f718a96 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:28:42.777451 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.objects.instance [None req-9c005e7e-59ec-4a82-a4f7-22562f718a96 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lazy-loading 'fault' on Instance uuid b5e3e804-99f2-4927-898d-ac3d20c6e98f {{(pid=137408) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 16 22:28:42.820061 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-9c005e7e-59ec-4a82-a4f7-22562f718a96 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdf8094a9314b31a4fa61a9abe18cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f2cd0b26e149b589061d18a3b7af3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:28:42.827783 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-9c005e7e-59ec-4a82-a4f7-22562f718a96 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] 10.222.0.20 "GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f" status: 200 len: 1339 microversion: 2.1 time: 0.102320 Apr 16 22:28:42.828427 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3961/7763] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:28:42 2022] GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f => generated 1339 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:28:43.846208 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-33a70b01-0a4b-48f1-a40b-48aaffa84579 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:28:43.846908 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-33a70b01-0a4b-48f1-a40b-48aaffa84579 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: b5e3e804-99f2-4927-898d-ac3d20c6e98f] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:28:43.854458 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-33a70b01-0a4b-48f1-a40b-48aaffa84579 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:28:43.854919 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-33a70b01-0a4b-48f1-a40b-48aaffa84579 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:28:43.855697 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-33a70b01-0a4b-48f1-a40b-48aaffa84579 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:28:43.856138 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-33a70b01-0a4b-48f1-a40b-48aaffa84579 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:28:43.868854 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.wsgi [None req-33a70b01-0a4b-48f1-a40b-48aaffa84579 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] HTTP exception thrown: Instance b5e3e804-99f2-4927-898d-ac3d20c6e98f could not be found. Apr 16 22:28:43.869440 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-33a70b01-0a4b-48f1-a40b-48aaffa84579 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Returning 404 to user: Instance b5e3e804-99f2-4927-898d-ac3d20c6e98f could not be found. {{(pid=137409) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 22:28:43.870250 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-33a70b01-0a4b-48f1-a40b-48aaffa84579 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] 10.222.0.20 "GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f" status: 404 len: 111 microversion: 2.1 time: 0.028293 Apr 16 22:28:43.870787 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3803/7764] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:28:43 2022] GET /compute/v2.1/servers/b5e3e804-99f2-4927-898d-ac3d20c6e98f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 22:28:46.418957 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-f6e3c420-3299-4773-92b8-914d95fed861 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:28:46.419600 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f6e3c420-3299-4773-92b8-914d95fed861 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: 0f9b6279-82f9-4786-9f42-1aacf55bc7eb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:28:46.427713 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6e3c420-3299-4773-92b8-914d95fed861 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:28:46.428210 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6e3c420-3299-4773-92b8-914d95fed861 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:28:46.429016 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6e3c420-3299-4773-92b8-914d95fed861 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:28:46.429595 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-f6e3c420-3299-4773-92b8-914d95fed861 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:28:46.457678 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-f6e3c420-3299-4773-92b8-914d95fed861 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: 0f9b6279-82f9-4786-9f42-1aacf55bc7eb] Going to try to terminate instance {{(pid=137408) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 16 22:28:46.488744 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-8a589c39-824c-4a6d-a246-04c50008369e req-c99ea3f6-cff5-4ab4-bf5c-4d9c0a730f15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f9b6279-82f9-4786-9f42-1aacf55bc7eb", "tag": "fe461ac3-2c69-476e-a75a-b48182245dcb"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:28:46.498066 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-8a589c39-824c-4a6d-a246-04c50008369e req-c99ea3f6-cff5-4ab4-bf5c-4d9c0a730f15 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:28:46.498620 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-8a589c39-824c-4a6d-a246-04c50008369e req-c99ea3f6-cff5-4ab4-bf5c-4d9c0a730f15 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:28:46.510984 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-8a589c39-824c-4a6d-a246-04c50008369e req-c99ea3f6-cff5-4ab4-bf5c-4d9c0a730f15 service nova] Creating event network-changed:fe461ac3-2c69-476e-a75a-b48182245dcb for instance 0f9b6279-82f9-4786-9f42-1aacf55bc7eb on nch1-master-1 Apr 16 22:28:46.516931 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-8a589c39-824c-4a6d-a246-04c50008369e req-c99ea3f6-cff5-4ab4-bf5c-4d9c0a730f15 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100052 Apr 16 22:28:46.517697 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3804/7765] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:28:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 16 22:28:46.762423 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-f6e3c420-3299-4773-92b8-914d95fed861 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0f9b6279-82f9-4786-9f42-1aacf55bc7eb" status: 204 len: 0 microversion: 2.1 time: 0.348445 Apr 16 22:28:46.766679 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3962/7766] 10.222.0.20 () {58 vars in 1238 bytes} [Sat Apr 16 22:28:46 2022] DELETE /compute/v2.1/servers/0f9b6279-82f9-4786-9f42-1aacf55bc7eb => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 16 22:28:46.773251 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-2397a44d-d214-4d3c-a531-6a29c12de930 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Calling method '>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:28:46.774150 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.compute.api [None req-2397a44d-d214-4d3c-a531-6a29c12de930 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: 0f9b6279-82f9-4786-9f42-1aacf55bc7eb] Fetching instance by UUID {{(pid=137409) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:28:46.781127 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2397a44d-d214-4d3c-a531-6a29c12de930 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:28:46.781584 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2397a44d-d214-4d3c-a531-6a29c12de930 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:28:46.785312 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2397a44d-d214-4d3c-a531-6a29c12de930 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:28:46.786985 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [None req-2397a44d-d214-4d3c-a531-6a29c12de930 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:28:46.929163 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.policy [None req-2397a44d-d214-4d3c-a531-6a29c12de930 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdf8094a9314b31a4fa61a9abe18cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f2cd0b26e149b589061d18a3b7af3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137409) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:28:46.936853 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-2397a44d-d214-4d3c-a531-6a29c12de930 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] 10.222.0.20 "GET /compute/v2.1/servers/0f9b6279-82f9-4786-9f42-1aacf55bc7eb" status: 200 len: 1684 microversion: 2.1 time: 0.168655 Apr 16 22:28:46.937430 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3805/7767] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:28:46 2022] GET /compute/v2.1/servers/0f9b6279-82f9-4786-9f42-1aacf55bc7eb => generated 1684 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 16 22:28:47.708934 ncdv-master-1 devstack@n-api.service[137408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:28:47.710971 ncdv-master-1 devstack@n-api.service[137408]: Sat Apr 16 22:28:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 22:28:47.832092 ncdv-master-1 devstack@n-api.service[137408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:28:47.832320 ncdv-master-1 devstack@n-api.service[137408]: Sat Apr 16 22:28:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 22:28:47.955185 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-2b96a4de-21b7-4425-a827-af713baa68e1 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:28:47.955898 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-2b96a4de-21b7-4425-a827-af713baa68e1 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: 0f9b6279-82f9-4786-9f42-1aacf55bc7eb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:28:47.963545 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b96a4de-21b7-4425-a827-af713baa68e1 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:28:47.964012 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b96a4de-21b7-4425-a827-af713baa68e1 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:28:47.964835 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b96a4de-21b7-4425-a827-af713baa68e1 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:28:47.965288 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-2b96a4de-21b7-4425-a827-af713baa68e1 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:28:48.030990 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.policy [None req-2b96a4de-21b7-4425-a827-af713baa68e1 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fdf8094a9314b31a4fa61a9abe18cc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '31f2cd0b26e149b589061d18a3b7af3d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=137408) authorize /opt/stack/nova/nova/policy.py:199}} Apr 16 22:28:48.039019 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-2b96a4de-21b7-4425-a827-af713baa68e1 tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] 10.222.0.20 "GET /compute/v2.1/servers/0f9b6279-82f9-4786-9f42-1aacf55bc7eb" status: 200 len: 1498 microversion: 2.1 time: 0.088138 Apr 16 22:28:48.039578 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3963/7768] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:28:47 2022] GET /compute/v2.1/servers/0f9b6279-82f9-4786-9f42-1aacf55bc7eb => generated 1498 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 16 22:28:48.531894 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [req-c48960cc-5079-46fd-9519-b73f3bd27d02 req-56cc4816-7889-4bcc-aabf-4808a5f44677 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f9b6279-82f9-4786-9f42-1aacf55bc7eb", "name": "network-vif-deleted", "tag": "fe461ac3-2c69-476e-a75a-b48182245dcb"}]} {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 16 22:28:48.540950 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-c48960cc-5079-46fd-9519-b73f3bd27d02 req-56cc4816-7889-4bcc-aabf-4808a5f44677 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:28:48.541418 ncdv-master-1 devstack@n-api.service[137409]: DEBUG oslo_concurrency.lockutils [req-c48960cc-5079-46fd-9519-b73f3bd27d02 req-56cc4816-7889-4bcc-aabf-4808a5f44677 service nova] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137409) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:28:48.552590 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.compute.server_external_events [req-c48960cc-5079-46fd-9519-b73f3bd27d02 req-56cc4816-7889-4bcc-aabf-4808a5f44677 service nova] Creating event network-vif-deleted:fe461ac3-2c69-476e-a75a-b48182245dcb for instance 0f9b6279-82f9-4786-9f42-1aacf55bc7eb on nch1-master-1 Apr 16 22:28:48.557996 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [req-c48960cc-5079-46fd-9519-b73f3bd27d02 req-56cc4816-7889-4bcc-aabf-4808a5f44677 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029437 Apr 16 22:28:48.558243 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3806/7769] 10.222.0.20 () {64 vars in 1317 bytes} [Sat Apr 16 22:28:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 16 22:28:49.056732 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c2be0dff-1aad-4749-b03b-c34ec11113ba tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Calling method '>' {{(pid=137408) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:28:49.057291 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.compute.api [None req-c2be0dff-1aad-4749-b03b-c34ec11113ba tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [instance: 0f9b6279-82f9-4786-9f42-1aacf55bc7eb] Fetching instance by UUID {{(pid=137408) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 16 22:28:49.064241 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c2be0dff-1aad-4749-b03b-c34ec11113ba tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:28:49.064723 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c2be0dff-1aad-4749-b03b-c34ec11113ba tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:28:49.065520 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c2be0dff-1aad-4749-b03b-c34ec11113ba tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 16 22:28:49.066006 ncdv-master-1 devstack@n-api.service[137408]: DEBUG oslo_concurrency.lockutils [None req-c2be0dff-1aad-4749-b03b-c34ec11113ba tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Lock "f8d025b3-2d37-4d38-9ad5-4c1987181ef2" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=137408) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 16 22:28:49.079834 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.wsgi [None req-c2be0dff-1aad-4749-b03b-c34ec11113ba tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] HTTP exception thrown: Instance 0f9b6279-82f9-4786-9f42-1aacf55bc7eb could not be found. Apr 16 22:28:49.081502 ncdv-master-1 devstack@n-api.service[137408]: DEBUG nova.api.openstack.wsgi [None req-c2be0dff-1aad-4749-b03b-c34ec11113ba tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Returning 404 to user: Instance 0f9b6279-82f9-4786-9f42-1aacf55bc7eb could not be found. {{(pid=137408) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 16 22:28:49.081502 ncdv-master-1 devstack@n-api.service[137408]: INFO nova.api.openstack.requestlog [None req-c2be0dff-1aad-4749-b03b-c34ec11113ba tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] 10.222.0.20 "GET /compute/v2.1/servers/0f9b6279-82f9-4786-9f42-1aacf55bc7eb" status: 404 len: 111 microversion: 2.1 time: 0.029535 Apr 16 22:28:49.081842 ncdv-master-1 devstack@n-api.service[137408]: [pid: 137408|app: 0|req: 3964/7770] 10.222.0.20 () {58 vars in 1235 bytes} [Sat Apr 16 22:28:49 2022] GET /compute/v2.1/servers/0f9b6279-82f9-4786-9f42-1aacf55bc7eb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 16 22:28:49.305250 ncdv-master-1 devstack@n-api.service[137409]: DEBUG nova.api.openstack.wsgi [None req-6fae9e5c-c29e-4f4d-8667-6fedb8473a1a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] Calling method '.version_select at 0x7fbb957fdd30>' {{(pid=137409) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 16 22:28:49.313104 ncdv-master-1 devstack@n-api.service[137409]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6fae9e5c-c29e-4f4d-8667-6fedb8473a1a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [26eb7ec9-25ee-4b30-8c5f-d95dac8fad9a] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 16 22:28:50.317038 ncdv-master-1 devstack@n-api.service[137409]: INFO oslo.messaging._drivers.impl_rabbit [None req-6fae9e5c-c29e-4f4d-8667-6fedb8473a1a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] [26eb7ec9-25ee-4b30-8c5f-d95dac8fad9a] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 48190. Apr 16 22:28:50.383134 ncdv-master-1 devstack@n-api.service[137409]: INFO nova.api.openstack.requestlog [None req-6fae9e5c-c29e-4f4d-8667-6fedb8473a1a tempest-TestSnapshotPattern-1853721524 tempest-TestSnapshotPattern-1853721524-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1763670172" status: 202 len: 0 microversion: 2.1 time: 1.082853 Apr 16 22:28:50.383889 ncdv-master-1 devstack@n-api.service[137409]: [pid: 137409|app: 0|req: 3807/7771] 10.222.0.20 () {58 vars in 1256 bytes} [Sat Apr 16 22:28:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1763670172 => generated 0 bytes in 1085 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 16 22:28:51.231903 ncdv-master-1 devstack@n-api.service[137409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:28:51.232363 ncdv-master-1 devstack@n-api.service[137409]: Sat Apr 16 22:28:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 22:31:03.196289 ncdv-master-1 devstack@n-api.service[137409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:31:03.196965 ncdv-master-1 devstack@n-api.service[137409]: Sat Apr 16 22:31:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 22:32:07.717774 ncdv-master-1 devstack@n-api.service[137408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:32:07.718299 ncdv-master-1 devstack@n-api.service[137408]: Sat Apr 16 22:32:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 22:32:07.842368 ncdv-master-1 devstack@n-api.service[137408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:32:07.842535 ncdv-master-1 devstack@n-api.service[137408]: Sat Apr 16 22:32:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 22:32:11.241809 ncdv-master-1 devstack@n-api.service[137409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:32:11.242272 ncdv-master-1 devstack@n-api.service[137409]: Sat Apr 16 22:32:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 22:33:51.297067 ncdv-master-1 devstack@n-api.service[137409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:33:51.297836 ncdv-master-1 devstack@n-api.service[137409]: Sat Apr 16 22:33:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 22:34:04.412084 ncdv-master-1 devstack@n-api.service[137408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:34:04.412677 ncdv-master-1 devstack@n-api.service[137408]: Sat Apr 16 22:34:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 22:34:23.204329 ncdv-master-1 devstack@n-api.service[137409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:34:23.204942 ncdv-master-1 devstack@n-api.service[137409]: Sat Apr 16 22:34:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 22:35:27.725612 ncdv-master-1 devstack@n-api.service[137408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:35:27.726129 ncdv-master-1 devstack@n-api.service[137408]: Sat Apr 16 22:35:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 22:35:27.849519 ncdv-master-1 devstack@n-api.service[137408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:35:27.849668 ncdv-master-1 devstack@n-api.service[137408]: Sat Apr 16 22:35:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 22:35:31.250614 ncdv-master-1 devstack@n-api.service[137409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:35:31.251112 ncdv-master-1 devstack@n-api.service[137409]: Sat Apr 16 22:35:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 22:37:11.305237 ncdv-master-1 devstack@n-api.service[137409]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:37:11.305888 ncdv-master-1 devstack@n-api.service[137409]: Sat Apr 16 22:37:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 16 22:37:24.420520 ncdv-master-1 devstack@n-api.service[137408]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 16 22:37:24.421025 ncdv-master-1 devstack@n-api.service[137408]: Sat Apr 16 22:37:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!